2024-05-08T05:03:40.910 INFO:root:teuthology version: 0.0.1.dev271+g1ae7ad8 2024-05-08T05:03:40.910 DEBUG:teuthology.run:Teuthology command: teuthology --name vshankar-2024-05-08_04:00:39-fs:workload-wip-57676-3-testing-default-smithi --owner scheduled_vshankar@teuthology --description fs:workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate 3-modules} clusters/1a11s-mds-1c-client-3node conf/{client mds mgr mon osd} mount/kclient/{base/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} ms_mode/crc wsync/yes} objectstore-ec/bluestore-bitmap omap_limit/10000 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts pg_health session_timeout} ranks/multi/{balancer/automatic export-check n/3 replication/always} standby-replay tasks/{0-subvolume/{with-no-extra-options} 1-check-counter 2-scrub/yes 3-snaps/no 4-flush/no 5-quiesce/no 6-workunit/suites/fsstress}} --archive /home/teuthworker/archive/vshankar-2024-05-08_04:00:39-fs:workload-wip-57676-3-testing-default-smithi/7697229 --verbose -- /home/teuthworker/archive/vshankar-2024-05-08_04:00:39-fs:workload-wip-57676-3-testing-default-smithi/7697229/orig.config.yaml 2024-05-08T05:03:40.967 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-05-08T05:03:41.056 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/vshankar-2024-05-08_04:00:39-fs:workload-wip-57676-3-testing-default-smithi/7697229 branch: wip-57676-3 description: fs:workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate 3-modules} clusters/1a11s-mds-1c-client-3node conf/{client mds mgr mon osd} mount/kclient/{base/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} ms_mode/crc wsync/yes} objectstore-ec/bluestore-bitmap omap_limit/10000 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts pg_health session_timeout} ranks/multi/{balancer/automatic export-check n/3 replication/always} standby-replay tasks/{0-subvolume/{with-no-extra-options} 1-check-counter 2-scrub/yes 3-snaps/no 4-flush/no 5-quiesce/no 6-workunit/suites/fsstress}} email: vshankar@redhat.com first_in_suite: false job_id: '7697229' kernel: client: branch: testing flavor: default kdb: true sha1: 806ec36b21129f113ce356c007dd59694d340b37 ktype: upstream last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi mgrmodules: sequential: - print: Enabling mgr modules name: vshankar-2024-05-08_04:00:39-fs:workload-wip-57676-3-testing-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: centos os_version: 9.stream overrides: admin_socket: branch: wip-57676-3 ceph: cephfs: max_mds: 3 session_timeout: 300 standby_replay: true conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 rados mon op timeout: 900 rados osd op timeout: 900 global: ms die on skipped message: false mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds bal fragment size max: 10000 mds bal merge size: 5 mds bal split bits: 3 mds bal split size: 100 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true mds_bal_replicate_threshold: 1 osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: cephsqlite lock renewal timeout: 900000 debug client: 20 debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon down mkfs grace: 300 mon op complaint time: 120 osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 osd shutdown pgref assert: true osd_max_omap_entries_per_request: 10000 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - FS_DEGRADED - FS_INLINE_DATA_DEPRECATED - FS_WITH_FAILED_MDS - MDS_ALL_DOWN - MDS_DAMAGE - MDS_DEGRADED - MDS_FAILED - MDS_INSUFFICIENT_STANDBY - MDS_UP_LESS_THAN_MAX - filesystem is online with fewer MDS than max_mds - POOL_APP_NOT_ENABLED - do not have an application enabled - overall HEALTH_ - Replacing daemon - deprecated feature inline_data - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - PG_AVAILABILITY - PG_DEGRADED - Reduced data availability - slow metadata IO - SLOW_OPS - slow request sha1: bee299f4ac344e4c45e550d7a80abcadd7bc3d5a subvols: create: 2 ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: osd default pool size: 2 osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs ceph-fuse: client.0: mount_subvol_num: 0 check-counter: counters: mds: - mds.exported - mds.imported - min: 3 name: mds_cache.dir_update - min: 3 name: mds_cache.dir_update_receipt install: ceph: flavor: default sha1: bee299f4ac344e4c45e550d7a80abcadd7bc3d5a kclient: client.0: mount_subvol_num: 1 mntopts: - ms_mode=crc - wsync syntax: v2 selinux: allowlist: - scontext=system_u:system_r:logrotate_t:s0 - scontext=system_u:system_r:getty_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-57676-3 sha1: bee299f4ac344e4c45e550d7a80abcadd7bc3d5a owner: scheduled_vshankar@teuthology priority: 80 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.x - mds.a - mds.d - mds.g - mds.j - osd.0 - osd.3 - osd.6 - osd.9 - client.0 - - mon.b - mgr.y - mds.b - mds.e - mds.h - mds.k - osd.1 - osd.4 - osd.7 - osd.10 - - mon.c - mgr.z - mds.c - mds.f - mds.i - mds.l - osd.2 - osd.5 - osd.8 - osd.11 seed: 5998 sha1: bee299f4ac344e4c45e550d7a80abcadd7bc3d5a sleep_before_teardown: 0 subset: 915/1024 suite: fs:workload suite_branch: wip-57676-3 suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_bee299f4ac344e4c45e550d7a80abcadd7bc3d5a/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph-ci.git suite_sha1: bee299f4ac344e4c45e550d7a80abcadd7bc3d5a syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi087.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBKaWEfS6aOfLjH1mmCXB+dPgShRSJuPwAIdfU6U/4KKAUjEvSxXf/LV1724kPe+nOZAztSGUAvEJAh2+nF2sdmk= smithi090.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBOt3uUOEPQ141iYR/bVKiTO4Qxm+5fqE4xKkOgE/W8zh6jmdq8ozJCFzkP+F7hHd90PBoTtOLz5pe99gRR8ebQg= smithi160.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBHXvc1PSQUAXiggDPmrVQ8XGUc4TJAHVIWe8tTIAuWGKMxfljWmXVZkMI0tBt8v31yxq/OR/9JbQlPRLKURGWvY= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - cephadm: roleless: false - cephadm.shell: mon.a: - ceph orch status - ceph orch ps - ceph orch ls - ceph orch host ls - ceph orch device ls - cephadm.shell: mon.a: - ceph fs dump - ceph osd dump - fs.ready: timeout: 300 - sequential: - mgrmodules - kclient: null - exec: mon.a: - ceph fs set cephfs balance_automate true - check-counter: {} - fwd_scrub: scrub_timeout: 900 sleep_between_iterations: 1 - workunit: clients: all: - suites/fsstress.sh timeout: 6h teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return yaml.ktype == 'upstream' end - local function is_kdistro() return yaml.ktype == 'distro' end - local function is_fuse() return false end - local function syntax_version() return yaml.overrides.kclient.syntax end teuthology_branch: main teuthology_sha1: 1ae7ad82388e92a475afff437d49054826c019a1 timestamp: 2024-05-08_04:00:39 tube: smithi user: vshankar verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885 2024-05-08T05:03:41.056 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_bee299f4ac344e4c45e550d7a80abcadd7bc3d5a/qa; will attempt to use it 2024-05-08T05:03:41.057 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_bee299f4ac344e4c45e550d7a80abcadd7bc3d5a/qa/tasks 2024-05-08T05:03:41.057 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-05-08T05:03:41.059 INFO:teuthology.task.internal:Checking packages... 2024-05-08T05:03:41.083 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash 'bee299f4ac344e4c45e550d7a80abcadd7bc3d5a' 2024-05-08T05:03:41.083 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-05-08T05:03:41.084 INFO:teuthology.packaging:ref: None 2024-05-08T05:03:41.084 INFO:teuthology.packaging:tag: None 2024-05-08T05:03:41.084 INFO:teuthology.packaging:branch: wip-57676-3 2024-05-08T05:03:41.084 INFO:teuthology.packaging:sha1: bee299f4ac344e4c45e550d7a80abcadd7bc3d5a 2024-05-08T05:03:41.084 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=wip-57676-3 2024-05-08T05:03:41.223 INFO:teuthology.task.internal:Found packages for ceph version 19.0.0-3538.gbee299f4 2024-05-08T05:03:41.225 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-05-08T05:03:41.231 INFO:teuthology.task.internal:no buildpackages task found 2024-05-08T05:03:41.231 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-05-08T05:03:41.255 INFO:teuthology.task.internal:Saving configuration 2024-05-08T05:03:41.276 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-05-08T05:03:41.283 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-05-08T05:03:41.306 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi087.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2024-05-08_04:00:39-fs:workload-wip-57676-3-testing-default-smithi/7697229', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-05-08 04:56:40.229032', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBKaWEfS6aOfLjH1mmCXB+dPgShRSJuPwAIdfU6U/4KKAUjEvSxXf/LV1724kPe+nOZAztSGUAvEJAh2+nF2sdmk='} 2024-05-08T05:03:41.324 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi090.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2024-05-08_04:00:39-fs:workload-wip-57676-3-testing-default-smithi/7697229', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-05-08 04:56:40.226343', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBOt3uUOEPQ141iYR/bVKiTO4Qxm+5fqE4xKkOgE/W8zh6jmdq8ozJCFzkP+F7hHd90PBoTtOLz5pe99gRR8ebQg='} 2024-05-08T05:03:41.347 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi160.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2024-05-08_04:00:39-fs:workload-wip-57676-3-testing-default-smithi/7697229', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-05-08 04:56:40.227771', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBHXvc1PSQUAXiggDPmrVQ8XGUc4TJAHVIWe8tTIAuWGKMxfljWmXVZkMI0tBt8v31yxq/OR/9JbQlPRLKURGWvY='} 2024-05-08T05:03:41.347 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-05-08T05:03:41.354 INFO:teuthology.task.internal:roles: ubuntu@smithi087.front.sepia.ceph.com - ['mon.a', 'mgr.x', 'mds.a', 'mds.d', 'mds.g', 'mds.j', 'osd.0', 'osd.3', 'osd.6', 'osd.9', 'client.0'] 2024-05-08T05:03:41.355 INFO:teuthology.task.internal:roles: ubuntu@smithi090.front.sepia.ceph.com - ['mon.b', 'mgr.y', 'mds.b', 'mds.e', 'mds.h', 'mds.k', 'osd.1', 'osd.4', 'osd.7', 'osd.10'] 2024-05-08T05:03:41.355 INFO:teuthology.task.internal:roles: ubuntu@smithi160.front.sepia.ceph.com - ['mon.c', 'mgr.z', 'mds.c', 'mds.f', 'mds.i', 'mds.l', 'osd.2', 'osd.5', 'osd.8', 'osd.11'] 2024-05-08T05:03:41.355 INFO:teuthology.run_tasks:Running task console_log... 2024-05-08T05:03:41.474 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f506aed7f70>, signals=[15]) 2024-05-08T05:03:41.474 INFO:teuthology.run_tasks:Running task internal.connect... 2024-05-08T05:03:41.480 INFO:teuthology.task.internal:Opening connections... 2024-05-08T05:03:41.481 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi087.front.sepia.ceph.com 2024-05-08T05:03:41.482 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi087.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-08T05:03:41.561 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi090.front.sepia.ceph.com 2024-05-08T05:03:41.562 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi090.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-08T05:03:41.637 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi160.front.sepia.ceph.com 2024-05-08T05:03:41.638 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi160.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-08T05:03:41.714 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-05-08T05:03:41.721 DEBUG:teuthology.orchestra.run.smithi087:> uname -m 2024-05-08T05:03:41.739 INFO:teuthology.orchestra.run.smithi087.stdout:x86_64 2024-05-08T05:03:41.740 DEBUG:teuthology.orchestra.run.smithi087:> cat /etc/os-release 2024-05-08T05:03:41.797 INFO:teuthology.orchestra.run.smithi087.stdout:NAME="CentOS Stream" 2024-05-08T05:03:41.797 INFO:teuthology.orchestra.run.smithi087.stdout:VERSION="9" 2024-05-08T05:03:41.797 INFO:teuthology.orchestra.run.smithi087.stdout:ID="centos" 2024-05-08T05:03:41.797 INFO:teuthology.orchestra.run.smithi087.stdout:ID_LIKE="rhel fedora" 2024-05-08T05:03:41.797 INFO:teuthology.orchestra.run.smithi087.stdout:VERSION_ID="9" 2024-05-08T05:03:41.797 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM_ID="platform:el9" 2024-05-08T05:03:41.797 INFO:teuthology.orchestra.run.smithi087.stdout:PRETTY_NAME="CentOS Stream 9" 2024-05-08T05:03:41.797 INFO:teuthology.orchestra.run.smithi087.stdout:ANSI_COLOR="0;31" 2024-05-08T05:03:41.797 INFO:teuthology.orchestra.run.smithi087.stdout:LOGO="fedora-logo-icon" 2024-05-08T05:03:41.797 INFO:teuthology.orchestra.run.smithi087.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-05-08T05:03:41.797 INFO:teuthology.orchestra.run.smithi087.stdout:HOME_URL="https://centos.org/" 2024-05-08T05:03:41.797 INFO:teuthology.orchestra.run.smithi087.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-05-08T05:03:41.798 INFO:teuthology.orchestra.run.smithi087.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-05-08T05:03:41.798 INFO:teuthology.orchestra.run.smithi087.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-05-08T05:03:41.798 INFO:teuthology.lock.ops:Updating smithi087.front.sepia.ceph.com on lock server 2024-05-08T05:03:41.824 DEBUG:teuthology.orchestra.run.smithi090:> uname -m 2024-05-08T05:03:41.842 INFO:teuthology.orchestra.run.smithi090.stdout:x86_64 2024-05-08T05:03:41.843 DEBUG:teuthology.orchestra.run.smithi090:> cat /etc/os-release 2024-05-08T05:03:41.900 INFO:teuthology.orchestra.run.smithi090.stdout:NAME="CentOS Stream" 2024-05-08T05:03:41.900 INFO:teuthology.orchestra.run.smithi090.stdout:VERSION="9" 2024-05-08T05:03:41.900 INFO:teuthology.orchestra.run.smithi090.stdout:ID="centos" 2024-05-08T05:03:41.900 INFO:teuthology.orchestra.run.smithi090.stdout:ID_LIKE="rhel fedora" 2024-05-08T05:03:41.900 INFO:teuthology.orchestra.run.smithi090.stdout:VERSION_ID="9" 2024-05-08T05:03:41.900 INFO:teuthology.orchestra.run.smithi090.stdout:PLATFORM_ID="platform:el9" 2024-05-08T05:03:41.900 INFO:teuthology.orchestra.run.smithi090.stdout:PRETTY_NAME="CentOS Stream 9" 2024-05-08T05:03:41.900 INFO:teuthology.orchestra.run.smithi090.stdout:ANSI_COLOR="0;31" 2024-05-08T05:03:41.901 INFO:teuthology.orchestra.run.smithi090.stdout:LOGO="fedora-logo-icon" 2024-05-08T05:03:41.901 INFO:teuthology.orchestra.run.smithi090.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-05-08T05:03:41.901 INFO:teuthology.orchestra.run.smithi090.stdout:HOME_URL="https://centos.org/" 2024-05-08T05:03:41.901 INFO:teuthology.orchestra.run.smithi090.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-05-08T05:03:41.901 INFO:teuthology.orchestra.run.smithi090.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-05-08T05:03:41.901 INFO:teuthology.orchestra.run.smithi090.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-05-08T05:03:41.901 INFO:teuthology.lock.ops:Updating smithi090.front.sepia.ceph.com on lock server 2024-05-08T05:03:41.924 DEBUG:teuthology.orchestra.run.smithi160:> uname -m 2024-05-08T05:03:41.943 INFO:teuthology.orchestra.run.smithi160.stdout:x86_64 2024-05-08T05:03:41.943 DEBUG:teuthology.orchestra.run.smithi160:> cat /etc/os-release 2024-05-08T05:03:42.000 INFO:teuthology.orchestra.run.smithi160.stdout:NAME="CentOS Stream" 2024-05-08T05:03:42.000 INFO:teuthology.orchestra.run.smithi160.stdout:VERSION="9" 2024-05-08T05:03:42.000 INFO:teuthology.orchestra.run.smithi160.stdout:ID="centos" 2024-05-08T05:03:42.000 INFO:teuthology.orchestra.run.smithi160.stdout:ID_LIKE="rhel fedora" 2024-05-08T05:03:42.000 INFO:teuthology.orchestra.run.smithi160.stdout:VERSION_ID="9" 2024-05-08T05:03:42.000 INFO:teuthology.orchestra.run.smithi160.stdout:PLATFORM_ID="platform:el9" 2024-05-08T05:03:42.001 INFO:teuthology.orchestra.run.smithi160.stdout:PRETTY_NAME="CentOS Stream 9" 2024-05-08T05:03:42.001 INFO:teuthology.orchestra.run.smithi160.stdout:ANSI_COLOR="0;31" 2024-05-08T05:03:42.001 INFO:teuthology.orchestra.run.smithi160.stdout:LOGO="fedora-logo-icon" 2024-05-08T05:03:42.001 INFO:teuthology.orchestra.run.smithi160.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-05-08T05:03:42.001 INFO:teuthology.orchestra.run.smithi160.stdout:HOME_URL="https://centos.org/" 2024-05-08T05:03:42.001 INFO:teuthology.orchestra.run.smithi160.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-05-08T05:03:42.001 INFO:teuthology.orchestra.run.smithi160.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-05-08T05:03:42.001 INFO:teuthology.orchestra.run.smithi160.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-05-08T05:03:42.001 INFO:teuthology.lock.ops:Updating smithi160.front.sepia.ceph.com on lock server 2024-05-08T05:03:42.024 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-05-08T05:03:42.035 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-05-08T05:03:42.056 INFO:teuthology.task.internal:Checking for old test directory... 2024-05-08T05:03:42.056 DEBUG:teuthology.orchestra.run.smithi087:> test '!' -e /home/ubuntu/cephtest 2024-05-08T05:03:42.058 DEBUG:teuthology.orchestra.run.smithi090:> test '!' -e /home/ubuntu/cephtest 2024-05-08T05:03:42.061 DEBUG:teuthology.orchestra.run.smithi160:> test '!' -e /home/ubuntu/cephtest 2024-05-08T05:03:42.077 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-05-08T05:03:42.082 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-05-08T05:03:42.082 DEBUG:teuthology.orchestra.run.smithi087:> test -z $(ls -A /var/lib/ceph) 2024-05-08T05:03:42.116 DEBUG:teuthology.orchestra.run.smithi090:> test -z $(ls -A /var/lib/ceph) 2024-05-08T05:03:42.118 DEBUG:teuthology.orchestra.run.smithi160:> test -z $(ls -A /var/lib/ceph) 2024-05-08T05:03:42.210 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-05-08T05:03:42.292 INFO:teuthology.run_tasks:Running task kernel... 2024-05-08T05:03:42.306 INFO:teuthology.task.kernel:normalize config orig: {'client': {'branch': 'testing'}, 'flavor': 'default', 'kdb': True, 'sha1': '806ec36b21129f113ce356c007dd59694d340b37'} 2024-05-08T05:03:42.307 INFO:teuthology.task.kernel:normalize config final: {'client.0': {'branch': 'testing'}} 2024-05-08T05:03:42.307 INFO:teuthology.task.kernel:config {'client.0': {'branch': 'testing'}}, timeout 300 2024-05-08T05:03:42.307 DEBUG:teuthology.orchestra.run.smithi087:> test -f /run/.containerenv -o -f /.dockerenv 2024-05-08T05:03:42.324 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-08T05:03:42.324 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&ref=testing 2024-05-08T05:03:42.482 DEBUG:teuthology.task.kernel:sha1 for client.0 is 806ec36b21129f113ce356c007dd59694d340b37 2024-05-08T05:03:42.482 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "806ec36b21129f113ce356c007dd59694d340b37"... 2024-05-08T05:03:42.483 DEBUG:teuthology.orchestra.run.smithi087:> uname -r 2024-05-08T05:03:42.499 INFO:teuthology.orchestra.run.smithi087.stdout:5.14.0-437.el9.x86_64 2024-05-08T05:03:42.500 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-437.el9.x86_64 vs 806ec36b21129f113ce356c007dd59694d340b37 2024-05-08T05:03:42.500 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2024-05-08T05:03:42.500 DEBUG:teuthology.orchestra.run.smithi087:> sudo yum upgrade -y linux-firmware 2024-05-08T05:03:44.628 INFO:teuthology.orchestra.run.smithi087.stdout:CentOS Stream 9 - BaseOS 15 MB/s | 8.1 MB 00:00 2024-05-08T05:03:48.496 INFO:teuthology.orchestra.run.smithi087.stdout:CentOS Stream 9 - AppStream 6.9 MB/s | 19 MB 00:02 2024-05-08T05:03:59.764 INFO:teuthology.orchestra.run.smithi087.stdout:CentOS Stream 9 - CRB 821 kB/s | 6.2 MB 00:07 2024-05-08T05:04:01.372 INFO:teuthology.orchestra.run.smithi087.stdout:CentOS Stream 9 - Extras packages 38 kB/s | 16 kB 00:00 2024-05-08T05:04:05.931 INFO:teuthology.orchestra.run.smithi087.stdout:Extra Packages for Enterprise Linux 4.8 MB/s | 21 MB 00:04 2024-05-08T05:04:11.265 INFO:teuthology.orchestra.run.smithi087.stdout:lab-extras 32 kB/s | 1.7 kB 00:00 2024-05-08T05:04:13.342 INFO:teuthology.orchestra.run.smithi087.stdout:Dependencies resolved. 2024-05-08T05:04:13.344 INFO:teuthology.orchestra.run.smithi087.stdout:Nothing to do. 2024-05-08T05:04:13.344 INFO:teuthology.orchestra.run.smithi087.stdout:Complete! 2024-05-08T05:04:13.452 INFO:teuthology.task.kernel:Downloading kernel 806ec36b21129f113ce356c007dd59694d340b37 on client.0... 2024-05-08T05:04:13.452 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&sha1=806ec36b21129f113ce356c007dd59694d340b37 2024-05-08T05:04:13.593 INFO:teuthology.task.kernel:fetching, builder baseurl is https://4.chacra.ceph.com/r/kernel/testing/806ec36b21129f113ce356c007dd59694d340b37/centos/9/flavors/default/x86_64/ 2024-05-08T05:04:13.594 DEBUG:teuthology.orchestra.run.smithi087:> rm -f /tmp/kernel.x86_64.rpm && echo kernel-6.9.0_rc3_g806ec36b2112-1.x86_64.rpm | wget -nv -O /tmp/kernel.x86_64.rpm --base=https://4.chacra.ceph.com/r/kernel/testing/806ec36b21129f113ce356c007dd59694d340b37/centos/9/flavors/default/x86_64/ --input-file=- 2024-05-08T05:04:13.596 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi087.front.sepia.ceph.com to complete... 2024-05-08T05:04:25.773 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08 05:04:25 URL:https://4.chacra.ceph.com/r/kernel/testing/806ec36b21129f113ce356c007dd59694d340b37/centos/9/flavors/default/x86_64/kernel-6.9.0_rc3_g806ec36b2112-1.x86_64.rpm [357367792/357367792] -> "/tmp/kernel.x86_64.rpm" [1] 2024-05-08T05:04:25.774 INFO:teuthology.orchestra.run.smithi087.stderr:FINISHED --2024-05-08 05:04:25-- 2024-05-08T05:04:25.774 INFO:teuthology.orchestra.run.smithi087.stderr:Total wall clock time: 12s 2024-05-08T05:04:25.774 INFO:teuthology.orchestra.run.smithi087.stderr:Downloaded: 1 files, 341M in 12s (28.7 MB/s) 2024-05-08T05:04:25.777 INFO:teuthology.task.kernel:Installing kernel 806ec36b21129f113ce356c007dd59694d340b37 on client.0... 2024-05-08T05:04:25.778 DEBUG:teuthology.orchestra.run.smithi087:> sudo rpm -ivh --oldpackage --replacefiles --replacepkgs /tmp/kernel.x86_64.rpm 2024-05-08T05:04:27.856 INFO:teuthology.orchestra.run.smithi087.stdout:Verifying... ######################################## 2024-05-08T05:04:28.094 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing... ######################################## 2024-05-08T05:04:28.218 INFO:teuthology.orchestra.run.smithi087.stdout:Updating / installing... 2024-05-08T05:04:36.164 INFO:teuthology.orchestra.run.smithi087.stdout:kernel-6.9.0_rc3_g806ec36b2112-1 ######################################## 2024-05-08T05:05:15.446 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi087.front.sepia.ceph.com, path=/tmp/kernel.x86_64.rpm, version=None) 2024-05-08T05:05:15.446 DEBUG:teuthology.orchestra.run.smithi087:> rpm -qlp /tmp/kernel.x86_64.rpm 2024-05-08T05:05:15.526 INFO:teuthology.orchestra.run.smithi087.stdout:/boot/System.map-6.9.0-rc3-g806ec36b2112 2024-05-08T05:05:15.526 INFO:teuthology.orchestra.run.smithi087.stdout:/boot/config-6.9.0-rc3-g806ec36b2112 2024-05-08T05:05:15.526 INFO:teuthology.orchestra.run.smithi087.stdout:/boot/vmlinuz-6.9.0-rc3-g806ec36b2112 2024-05-08T05:05:15.526 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/System.map 2024-05-08T05:05:15.526 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/config 2024-05-08T05:05:15.526 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel 2024-05-08T05:05:15.526 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch 2024-05-08T05:05:15.526 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86 2024-05-08T05:05:15.526 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto 2024-05-08T05:05:15.527 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/blowfish-x86_64.ko 2024-05-08T05:05:15.527 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2024-05-08T05:05:15.527 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2024-05-08T05:05:15.527 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/camellia-x86_64.ko 2024-05-08T05:05:15.527 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2024-05-08T05:05:15.527 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2024-05-08T05:05:15.527 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/crc32-pclmul.ko 2024-05-08T05:05:15.527 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/crc32c-intel.ko 2024-05-08T05:05:15.527 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2024-05-08T05:05:15.527 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2024-05-08T05:05:15.527 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2024-05-08T05:05:15.527 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2024-05-08T05:05:15.527 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/serpent-avx2.ko 2024-05-08T05:05:15.527 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2024-05-08T05:05:15.528 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/sha1-ssse3.ko 2024-05-08T05:05:15.528 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/sha256-ssse3.ko 2024-05-08T05:05:15.528 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/sha512-ssse3.ko 2024-05-08T05:05:15.528 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2024-05-08T05:05:15.528 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2024-05-08T05:05:15.528 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/twofish-x86_64.ko 2024-05-08T05:05:15.528 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kernel 2024-05-08T05:05:15.528 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kernel/cpu 2024-05-08T05:05:15.528 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kernel/cpu/mce 2024-05-08T05:05:15.528 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2024-05-08T05:05:15.528 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kvm 2024-05-08T05:05:15.528 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kvm/kvm-amd.ko 2024-05-08T05:05:15.528 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kvm/kvm-intel.ko 2024-05-08T05:05:15.528 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kvm/kvm.ko 2024-05-08T05:05:15.529 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto 2024-05-08T05:05:15.529 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/ansi_cprng.ko 2024-05-08T05:05:15.529 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/anubis.ko 2024-05-08T05:05:15.529 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/arc4.ko 2024-05-08T05:05:15.529 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/async_tx 2024-05-08T05:05:15.529 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/async_tx/async_memcpy.ko 2024-05-08T05:05:15.529 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/async_tx/async_pq.ko 2024-05-08T05:05:15.529 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/async_tx/async_raid6_recov.ko 2024-05-08T05:05:15.529 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/async_tx/async_tx.ko 2024-05-08T05:05:15.529 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/async_tx/async_xor.ko 2024-05-08T05:05:15.529 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/async_tx/raid6test.ko 2024-05-08T05:05:15.529 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/authenc.ko 2024-05-08T05:05:15.529 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/authencesn.ko 2024-05-08T05:05:15.530 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/blake2b_generic.ko 2024-05-08T05:05:15.530 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/blowfish_common.ko 2024-05-08T05:05:15.530 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/blowfish_generic.ko 2024-05-08T05:05:15.530 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/camellia_generic.ko 2024-05-08T05:05:15.530 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/cast5_generic.ko 2024-05-08T05:05:15.530 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/cast6_generic.ko 2024-05-08T05:05:15.530 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/cast_common.ko 2024-05-08T05:05:15.530 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/ccm.ko 2024-05-08T05:05:15.530 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/cmac.ko 2024-05-08T05:05:15.530 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/crc32_generic.ko 2024-05-08T05:05:15.530 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/crypto_engine.ko 2024-05-08T05:05:15.530 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/crypto_user.ko 2024-05-08T05:05:15.530 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/cts.ko 2024-05-08T05:05:15.530 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/des_generic.ko 2024-05-08T05:05:15.531 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/dh_generic.ko 2024-05-08T05:05:15.531 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/echainiv.ko 2024-05-08T05:05:15.531 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/essiv.ko 2024-05-08T05:05:15.531 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/fcrypt.ko 2024-05-08T05:05:15.531 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/khazad.ko 2024-05-08T05:05:15.531 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/lz4.ko 2024-05-08T05:05:15.531 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/lz4hc.ko 2024-05-08T05:05:15.531 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/md4.ko 2024-05-08T05:05:15.531 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/michael_mic.ko 2024-05-08T05:05:15.531 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/pcbc.ko 2024-05-08T05:05:15.531 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/pcrypt.ko 2024-05-08T05:05:15.531 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/rmd160.ko 2024-05-08T05:05:15.531 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/seed.ko 2024-05-08T05:05:15.531 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/serpent_generic.ko 2024-05-08T05:05:15.532 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/tcrypt.ko 2024-05-08T05:05:15.532 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/tea.ko 2024-05-08T05:05:15.532 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/twofish_common.ko 2024-05-08T05:05:15.532 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/twofish_generic.ko 2024-05-08T05:05:15.532 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/vmac.ko 2024-05-08T05:05:15.532 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/wp512.ko 2024-05-08T05:05:15.532 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/xcbc.ko 2024-05-08T05:05:15.532 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/xor.ko 2024-05-08T05:05:15.532 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/xxhash_generic.ko 2024-05-08T05:05:15.532 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers 2024-05-08T05:05:15.532 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi 2024-05-08T05:05:15.532 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/acpi_ipmi.ko 2024-05-08T05:05:15.532 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/acpi_pad.ko 2024-05-08T05:05:15.532 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/ec_sys.ko 2024-05-08T05:05:15.532 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/platform_profile.ko 2024-05-08T05:05:15.533 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/sbs.ko 2024-05-08T05:05:15.533 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/sbshc.ko 2024-05-08T05:05:15.533 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/video.ko 2024-05-08T05:05:15.533 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata 2024-05-08T05:05:15.533 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/acard-ahci.ko 2024-05-08T05:05:15.533 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/ahci_platform.ko 2024-05-08T05:05:15.533 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/ata_generic.ko 2024-05-08T05:05:15.533 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/libahci_platform.ko 2024-05-08T05:05:15.533 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_acpi.ko 2024-05-08T05:05:15.533 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_ali.ko 2024-05-08T05:05:15.533 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_amd.ko 2024-05-08T05:05:15.533 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_artop.ko 2024-05-08T05:05:15.534 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_atiixp.ko 2024-05-08T05:05:15.534 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_atp867x.ko 2024-05-08T05:05:15.534 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_cmd640.ko 2024-05-08T05:05:15.534 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_cmd64x.ko 2024-05-08T05:05:15.534 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_cypress.ko 2024-05-08T05:05:15.534 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_efar.ko 2024-05-08T05:05:15.534 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_hpt366.ko 2024-05-08T05:05:15.534 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_hpt37x.ko 2024-05-08T05:05:15.534 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_hpt3x2n.ko 2024-05-08T05:05:15.534 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_hpt3x3.ko 2024-05-08T05:05:15.534 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_it8213.ko 2024-05-08T05:05:15.534 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_it821x.ko 2024-05-08T05:05:15.534 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_jmicron.ko 2024-05-08T05:05:15.535 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_marvell.ko 2024-05-08T05:05:15.535 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_mpiix.ko 2024-05-08T05:05:15.535 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_netcell.ko 2024-05-08T05:05:15.535 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_ninja32.ko 2024-05-08T05:05:15.535 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_ns87410.ko 2024-05-08T05:05:15.535 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_ns87415.ko 2024-05-08T05:05:15.535 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_oldpiix.ko 2024-05-08T05:05:15.535 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_opti.ko 2024-05-08T05:05:15.535 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_optidma.ko 2024-05-08T05:05:15.535 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_pcmcia.ko 2024-05-08T05:05:15.535 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_pdc2027x.ko 2024-05-08T05:05:15.535 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_pdc202xx_old.ko 2024-05-08T05:05:15.535 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_piccolo.ko 2024-05-08T05:05:15.536 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_rdc.ko 2024-05-08T05:05:15.536 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_sch.ko 2024-05-08T05:05:15.536 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_serverworks.ko 2024-05-08T05:05:15.536 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_sil680.ko 2024-05-08T05:05:15.536 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_sis.ko 2024-05-08T05:05:15.536 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_sl82c105.ko 2024-05-08T05:05:15.536 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_triflex.ko 2024-05-08T05:05:15.536 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_via.ko 2024-05-08T05:05:15.536 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pdc_adma.ko 2024-05-08T05:05:15.536 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_inic162x.ko 2024-05-08T05:05:15.536 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_mv.ko 2024-05-08T05:05:15.536 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_nv.ko 2024-05-08T05:05:15.536 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_promise.ko 2024-05-08T05:05:15.536 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_qstor.ko 2024-05-08T05:05:15.536 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_sil.ko 2024-05-08T05:05:15.537 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_sil24.ko 2024-05-08T05:05:15.537 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_sis.ko 2024-05-08T05:05:15.537 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_svw.ko 2024-05-08T05:05:15.537 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_sx4.ko 2024-05-08T05:05:15.537 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_uli.ko 2024-05-08T05:05:15.537 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_via.ko 2024-05-08T05:05:15.537 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_vsc.ko 2024-05-08T05:05:15.537 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/auxdisplay 2024-05-08T05:05:15.537 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/auxdisplay/ks0108.ko 2024-05-08T05:05:15.537 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/base 2024-05-08T05:05:15.537 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/base/regmap 2024-05-08T05:05:15.537 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/base/regmap/regmap-i2c.ko 2024-05-08T05:05:15.537 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/base/regmap/regmap-mmio.ko 2024-05-08T05:05:15.537 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/bcma 2024-05-08T05:05:15.538 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/bcma/bcma.ko 2024-05-08T05:05:15.538 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block 2024-05-08T05:05:15.538 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/aoe 2024-05-08T05:05:15.538 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/aoe/aoe.ko 2024-05-08T05:05:15.538 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/brd.ko 2024-05-08T05:05:15.538 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/drbd 2024-05-08T05:05:15.538 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/drbd/drbd.ko 2024-05-08T05:05:15.538 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/floppy.ko 2024-05-08T05:05:15.538 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/loop.ko 2024-05-08T05:05:15.538 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/mtip32xx 2024-05-08T05:05:15.538 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/mtip32xx/mtip32xx.ko 2024-05-08T05:05:15.538 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/nbd.ko 2024-05-08T05:05:15.538 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/null_blk 2024-05-08T05:05:15.539 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/null_blk/null_blk.ko 2024-05-08T05:05:15.539 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/pktcdvd.ko 2024-05-08T05:05:15.539 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/rbd.ko 2024-05-08T05:05:15.539 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/virtio_blk.ko 2024-05-08T05:05:15.539 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/xen-blkback 2024-05-08T05:05:15.539 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/xen-blkback/xen-blkback.ko 2024-05-08T05:05:15.539 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/xen-blkfront.ko 2024-05-08T05:05:15.539 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/zram 2024-05-08T05:05:15.539 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/zram/zram.ko 2024-05-08T05:05:15.539 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char 2024-05-08T05:05:15.539 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/hangcheck-timer.ko 2024-05-08T05:05:15.539 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/hw_random 2024-05-08T05:05:15.539 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/hw_random/amd-rng.ko 2024-05-08T05:05:15.539 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/hw_random/intel-rng.ko 2024-05-08T05:05:15.540 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/hw_random/timeriomem-rng.ko 2024-05-08T05:05:15.540 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/hw_random/via-rng.ko 2024-05-08T05:05:15.540 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/hw_random/virtio-rng.ko 2024-05-08T05:05:15.540 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ipmi 2024-05-08T05:05:15.540 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ipmi/ipmi_devintf.ko 2024-05-08T05:05:15.540 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2024-05-08T05:05:15.540 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2024-05-08T05:05:15.540 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ipmi/ipmi_si.ko 2024-05-08T05:05:15.540 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ipmi/ipmi_ssif.ko 2024-05-08T05:05:15.540 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2024-05-08T05:05:15.540 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/lp.ko 2024-05-08T05:05:15.540 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/mwave 2024-05-08T05:05:15.540 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/mwave/mwave.ko 2024-05-08T05:05:15.540 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ppdev.ko 2024-05-08T05:05:15.541 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tlclk.ko 2024-05-08T05:05:15.541 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm 2024-05-08T05:05:15.541 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm/tpm.ko 2024-05-08T05:05:15.541 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm/tpm_atmel.ko 2024-05-08T05:05:15.541 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm/tpm_infineon.ko 2024-05-08T05:05:15.541 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm/tpm_nsc.ko 2024-05-08T05:05:15.541 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm/tpm_tis.ko 2024-05-08T05:05:15.541 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm/tpm_tis_core.ko 2024-05-08T05:05:15.541 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/uv_mmtimer.ko 2024-05-08T05:05:15.541 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/virtio_console.ko 2024-05-08T05:05:15.541 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/cpufreq 2024-05-08T05:05:15.541 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/cpufreq/acpi-cpufreq.ko 2024-05-08T05:05:15.541 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2024-05-08T05:05:15.541 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/cpufreq/p4-clockmod.ko 2024-05-08T05:05:15.542 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/cpufreq/pcc-cpufreq.ko 2024-05-08T05:05:15.542 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/cpufreq/powernow-k8.ko 2024-05-08T05:05:15.542 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/cpufreq/speedstep-lib.ko 2024-05-08T05:05:15.542 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto 2024-05-08T05:05:15.542 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/ccp 2024-05-08T05:05:15.542 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/ccp/ccp-crypto.ko 2024-05-08T05:05:15.542 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/ccp/ccp.ko 2024-05-08T05:05:15.542 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/intel 2024-05-08T05:05:15.542 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/intel/qat 2024-05-08T05:05:15.542 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/intel/qat/qat_common 2024-05-08T05:05:15.542 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2024-05-08T05:05:15.542 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/intel/qat/qat_dh895xcc 2024-05-08T05:05:15.542 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2024-05-08T05:05:15.543 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/padlock-aes.ko 2024-05-08T05:05:15.543 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/padlock-sha.ko 2024-05-08T05:05:15.543 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/virtio 2024-05-08T05:05:15.543 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/virtio/virtio_crypto.ko 2024-05-08T05:05:15.543 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/dca 2024-05-08T05:05:15.543 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/dca/dca.ko 2024-05-08T05:05:15.543 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/devfreq 2024-05-08T05:05:15.543 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/devfreq/governor_simpleondemand.ko 2024-05-08T05:05:15.543 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/dma 2024-05-08T05:05:15.543 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/dma/dw 2024-05-08T05:05:15.543 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/dma/dw/dw_dmac.ko 2024-05-08T05:05:15.543 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/dma/ioat 2024-05-08T05:05:15.543 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/dma/ioat/ioatdma.ko 2024-05-08T05:05:15.544 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac 2024-05-08T05:05:15.544 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/amd64_edac.ko 2024-05-08T05:05:15.544 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/e752x_edac.ko 2024-05-08T05:05:15.544 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/edac_mce_amd.ko 2024-05-08T05:05:15.544 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/i3000_edac.ko 2024-05-08T05:05:15.544 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/i3200_edac.ko 2024-05-08T05:05:15.544 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/i5100_edac.ko 2024-05-08T05:05:15.544 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/i5400_edac.ko 2024-05-08T05:05:15.544 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/i7300_edac.ko 2024-05-08T05:05:15.544 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/i7core_edac.ko 2024-05-08T05:05:15.544 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/i82975x_edac.ko 2024-05-08T05:05:15.544 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/ie31200_edac.ko 2024-05-08T05:05:15.544 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/sb_edac.ko 2024-05-08T05:05:15.544 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/x38_edac.ko 2024-05-08T05:05:15.544 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/firmware 2024-05-08T05:05:15.545 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/firmware/edd.ko 2024-05-08T05:05:15.545 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/firmware/iscsi_ibft.ko 2024-05-08T05:05:15.545 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio 2024-05-08T05:05:15.545 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-ich.ko 2024-05-08T05:05:15.545 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-viperboard.ko 2024-05-08T05:05:15.545 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid 2024-05-08T05:05:15.545 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-appleir.ko 2024-05-08T05:05:15.545 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-aureal.ko 2024-05-08T05:05:15.545 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-axff.ko 2024-05-08T05:05:15.545 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-dr.ko 2024-05-08T05:05:15.545 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-elecom.ko 2024-05-08T05:05:15.545 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-elo.ko 2024-05-08T05:05:15.545 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-emsff.ko 2024-05-08T05:05:15.545 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-gaff.ko 2024-05-08T05:05:15.546 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-gt683r.ko 2024-05-08T05:05:15.546 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-gyration.ko 2024-05-08T05:05:15.546 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-holtek-kbd.ko 2024-05-08T05:05:15.546 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-holtek-mouse.ko 2024-05-08T05:05:15.546 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-holtekff.ko 2024-05-08T05:05:15.546 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-hyperv.ko 2024-05-08T05:05:15.546 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-icade.ko 2024-05-08T05:05:15.546 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-keytouch.ko 2024-05-08T05:05:15.546 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-kye.ko 2024-05-08T05:05:15.546 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-lcpower.ko 2024-05-08T05:05:15.546 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-led.ko 2024-05-08T05:05:15.546 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-lenovo.ko 2024-05-08T05:05:15.546 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-logitech-dj.ko 2024-05-08T05:05:15.546 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-logitech-hidpp.ko 2024-05-08T05:05:15.547 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-multitouch.ko 2024-05-08T05:05:15.547 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-ortek.ko 2024-05-08T05:05:15.547 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-penmount.ko 2024-05-08T05:05:15.547 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-petalynx.ko 2024-05-08T05:05:15.547 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-picolcd.ko 2024-05-08T05:05:15.547 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-pl.ko 2024-05-08T05:05:15.547 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-plantronics.ko 2024-05-08T05:05:15.547 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-primax.ko 2024-05-08T05:05:15.547 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-rmi.ko 2024-05-08T05:05:15.547 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-arvo.ko 2024-05-08T05:05:15.547 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-common.ko 2024-05-08T05:05:15.547 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-isku.ko 2024-05-08T05:05:15.547 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-kone.ko 2024-05-08T05:05:15.547 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-koneplus.ko 2024-05-08T05:05:15.547 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-konepure.ko 2024-05-08T05:05:15.548 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-kovaplus.ko 2024-05-08T05:05:15.548 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-lua.ko 2024-05-08T05:05:15.548 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-pyra.ko 2024-05-08T05:05:15.548 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-ryos.ko 2024-05-08T05:05:15.548 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-savu.ko 2024-05-08T05:05:15.548 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat.ko 2024-05-08T05:05:15.548 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-saitek.ko 2024-05-08T05:05:15.548 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-samsung.ko 2024-05-08T05:05:15.548 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-sensor-hub.ko 2024-05-08T05:05:15.548 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-sjoy.ko 2024-05-08T05:05:15.548 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-sony.ko 2024-05-08T05:05:15.548 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-speedlink.ko 2024-05-08T05:05:15.548 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-steelseries.ko 2024-05-08T05:05:15.548 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-sunplus.ko 2024-05-08T05:05:15.549 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-thrustmaster.ko 2024-05-08T05:05:15.549 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-tivo.ko 2024-05-08T05:05:15.549 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-tmff.ko 2024-05-08T05:05:15.549 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-topseed.ko 2024-05-08T05:05:15.549 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-twinhan.ko 2024-05-08T05:05:15.549 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-uclogic.ko 2024-05-08T05:05:15.549 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-waltop.ko 2024-05-08T05:05:15.549 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-wiimote.ko 2024-05-08T05:05:15.549 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-xinmo.ko 2024-05-08T05:05:15.549 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-zpff.ko 2024-05-08T05:05:15.549 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-zydacron.ko 2024-05-08T05:05:15.549 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/uhid.ko 2024-05-08T05:05:15.549 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/wacom.ko 2024-05-08T05:05:15.549 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hv 2024-05-08T05:05:15.549 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hv/hv_balloon.ko 2024-05-08T05:05:15.550 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hv/hv_utils.ko 2024-05-08T05:05:15.550 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hv/hv_vmbus.ko 2024-05-08T05:05:15.550 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon 2024-05-08T05:05:15.550 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/abituguru.ko 2024-05-08T05:05:15.550 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/abituguru3.ko 2024-05-08T05:05:15.550 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/acpi_power_meter.ko 2024-05-08T05:05:15.550 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ad7414.ko 2024-05-08T05:05:15.550 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ad7418.ko 2024-05-08T05:05:15.550 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adc128d818.ko 2024-05-08T05:05:15.550 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adm1025.ko 2024-05-08T05:05:15.550 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adm1026.ko 2024-05-08T05:05:15.550 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adm1029.ko 2024-05-08T05:05:15.551 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adm1031.ko 2024-05-08T05:05:15.551 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adm9240.ko 2024-05-08T05:05:15.551 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ads7828.ko 2024-05-08T05:05:15.551 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adt7410.ko 2024-05-08T05:05:15.551 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adt7411.ko 2024-05-08T05:05:15.551 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adt7462.ko 2024-05-08T05:05:15.551 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adt7470.ko 2024-05-08T05:05:15.551 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adt7475.ko 2024-05-08T05:05:15.551 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adt7x10.ko 2024-05-08T05:05:15.551 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/amc6821.ko 2024-05-08T05:05:15.552 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/applesmc.ko 2024-05-08T05:05:15.552 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/asb100.ko 2024-05-08T05:05:15.552 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/asc7621.ko 2024-05-08T05:05:15.552 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/asus_atk0110.ko 2024-05-08T05:05:15.552 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/atxp1.ko 2024-05-08T05:05:15.552 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/coretemp.ko 2024-05-08T05:05:15.552 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/dell-smm-hwmon.ko 2024-05-08T05:05:15.552 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/dme1737.ko 2024-05-08T05:05:15.552 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ds1621.ko 2024-05-08T05:05:15.552 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ds620.ko 2024-05-08T05:05:15.552 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/emc1403.ko 2024-05-08T05:05:15.552 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/emc6w201.ko 2024-05-08T05:05:15.553 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/f71805f.ko 2024-05-08T05:05:15.553 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/f71882fg.ko 2024-05-08T05:05:15.553 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/f75375s.ko 2024-05-08T05:05:15.553 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/fam15h_power.ko 2024-05-08T05:05:15.553 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/fschmd.ko 2024-05-08T05:05:15.553 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/g760a.ko 2024-05-08T05:05:15.553 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/g762.ko 2024-05-08T05:05:15.553 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/gl518sm.ko 2024-05-08T05:05:15.553 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/gl520sm.ko 2024-05-08T05:05:15.553 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/hwmon-vid.ko 2024-05-08T05:05:15.553 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/i5500_temp.ko 2024-05-08T05:05:15.553 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/i5k_amb.ko 2024-05-08T05:05:15.553 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ibmaem.ko 2024-05-08T05:05:15.553 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ibmpex.ko 2024-05-08T05:05:15.553 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ina209.ko 2024-05-08T05:05:15.554 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ina2xx.ko 2024-05-08T05:05:15.554 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/it87.ko 2024-05-08T05:05:15.554 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/k10temp.ko 2024-05-08T05:05:15.554 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/k8temp.ko 2024-05-08T05:05:15.554 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lineage-pem.ko 2024-05-08T05:05:15.554 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm63.ko 2024-05-08T05:05:15.554 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm73.ko 2024-05-08T05:05:15.554 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm75.ko 2024-05-08T05:05:15.554 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm77.ko 2024-05-08T05:05:15.554 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm78.ko 2024-05-08T05:05:15.554 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm80.ko 2024-05-08T05:05:15.554 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm83.ko 2024-05-08T05:05:15.554 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm85.ko 2024-05-08T05:05:15.554 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm87.ko 2024-05-08T05:05:15.555 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm90.ko 2024-05-08T05:05:15.555 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm92.ko 2024-05-08T05:05:15.555 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm93.ko 2024-05-08T05:05:15.555 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm95234.ko 2024-05-08T05:05:15.555 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm95241.ko 2024-05-08T05:05:15.555 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm95245.ko 2024-05-08T05:05:15.555 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ltc2945.ko 2024-05-08T05:05:15.555 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ltc4151.ko 2024-05-08T05:05:15.555 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ltc4215.ko 2024-05-08T05:05:15.555 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ltc4222.ko 2024-05-08T05:05:15.555 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ltc4245.ko 2024-05-08T05:05:15.555 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ltc4260.ko 2024-05-08T05:05:15.555 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ltc4261.ko 2024-05-08T05:05:15.555 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/max16065.ko 2024-05-08T05:05:15.555 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/max1619.ko 2024-05-08T05:05:15.556 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/max1668.ko 2024-05-08T05:05:15.556 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/max197.ko 2024-05-08T05:05:15.556 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/max6639.ko 2024-05-08T05:05:15.556 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/max6650.ko 2024-05-08T05:05:15.556 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/max6697.ko 2024-05-08T05:05:15.556 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/mcp3021.ko 2024-05-08T05:05:15.556 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/nct6683.ko 2024-05-08T05:05:15.556 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/nct6775-core.ko 2024-05-08T05:05:15.556 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/nct6775.ko 2024-05-08T05:05:15.556 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/nct7802.ko 2024-05-08T05:05:15.556 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pc87360.ko 2024-05-08T05:05:15.556 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pc87427.ko 2024-05-08T05:05:15.556 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pcf8591.ko 2024-05-08T05:05:15.556 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus 2024-05-08T05:05:15.556 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/adm1275.ko 2024-05-08T05:05:15.557 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/lm25066.ko 2024-05-08T05:05:15.557 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/ltc2978.ko 2024-05-08T05:05:15.557 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/max16064.ko 2024-05-08T05:05:15.557 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/max34440.ko 2024-05-08T05:05:15.557 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/max8688.ko 2024-05-08T05:05:15.557 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/pmbus.ko 2024-05-08T05:05:15.557 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2024-05-08T05:05:15.557 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/tps40422.ko 2024-05-08T05:05:15.557 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/ucd9000.ko 2024-05-08T05:05:15.557 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/ucd9200.ko 2024-05-08T05:05:15.557 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/zl6100.ko 2024-05-08T05:05:15.557 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/powr1220.ko 2024-05-08T05:05:15.557 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/sch5627.ko 2024-05-08T05:05:15.557 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/sch5636.ko 2024-05-08T05:05:15.557 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/sch56xx-common.ko 2024-05-08T05:05:15.558 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/sht15.ko 2024-05-08T05:05:15.558 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/sht21.ko 2024-05-08T05:05:15.558 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/shtc1.ko 2024-05-08T05:05:15.558 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/sis5595.ko 2024-05-08T05:05:15.558 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/smsc47b397.ko 2024-05-08T05:05:15.558 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/smsc47m1.ko 2024-05-08T05:05:15.558 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/smsc47m192.ko 2024-05-08T05:05:15.558 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/thmc50.ko 2024-05-08T05:05:15.558 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/tmp102.ko 2024-05-08T05:05:15.558 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/tmp103.ko 2024-05-08T05:05:15.558 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/tmp401.ko 2024-05-08T05:05:15.558 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/tmp421.ko 2024-05-08T05:05:15.558 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/via-cputemp.ko 2024-05-08T05:05:15.559 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/via686a.ko 2024-05-08T05:05:15.559 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/vt1211.ko 2024-05-08T05:05:15.559 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/vt8231.ko 2024-05-08T05:05:15.559 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83627ehf.ko 2024-05-08T05:05:15.559 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83627hf.ko 2024-05-08T05:05:15.559 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83781d.ko 2024-05-08T05:05:15.559 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83791d.ko 2024-05-08T05:05:15.559 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83792d.ko 2024-05-08T05:05:15.559 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83793.ko 2024-05-08T05:05:15.559 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83795.ko 2024-05-08T05:05:15.559 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83l785ts.ko 2024-05-08T05:05:15.559 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83l786ng.ko 2024-05-08T05:05:15.559 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c 2024-05-08T05:05:15.559 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/algos 2024-05-08T05:05:15.559 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2024-05-08T05:05:15.559 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2024-05-08T05:05:15.560 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses 2024-05-08T05:05:15.560 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2024-05-08T05:05:15.560 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-amd756.ko 2024-05-08T05:05:15.560 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-amd8111.ko 2024-05-08T05:05:15.560 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2024-05-08T05:05:15.560 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-designware-core.ko 2024-05-08T05:05:15.560 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2024-05-08T05:05:15.560 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2024-05-08T05:05:15.560 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2024-05-08T05:05:15.560 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-i801.ko 2024-05-08T05:05:15.560 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-isch.ko 2024-05-08T05:05:15.560 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-ismt.ko 2024-05-08T05:05:15.560 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2024-05-08T05:05:15.561 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-nforce2.ko 2024-05-08T05:05:15.561 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-parport.ko 2024-05-08T05:05:15.561 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2024-05-08T05:05:15.561 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-piix4.ko 2024-05-08T05:05:15.561 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-scmi.ko 2024-05-08T05:05:15.561 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-simtec.ko 2024-05-08T05:05:15.561 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-sis96x.ko 2024-05-08T05:05:15.561 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2024-05-08T05:05:15.561 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-via.ko 2024-05-08T05:05:15.561 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-viapro.ko 2024-05-08T05:05:15.561 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-viperboard.ko 2024-05-08T05:05:15.561 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/i2c-dev.ko 2024-05-08T05:05:15.562 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/i2c-mux.ko 2024-05-08T05:05:15.562 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/i2c-slave-eeprom.ko 2024-05-08T05:05:15.562 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/i2c-smbus.ko 2024-05-08T05:05:15.562 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/i2c-stub.ko 2024-05-08T05:05:15.562 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband 2024-05-08T05:05:15.562 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core 2024-05-08T05:05:15.562 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/ib_cm.ko 2024-05-08T05:05:15.562 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/ib_core.ko 2024-05-08T05:05:15.562 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/ib_umad.ko 2024-05-08T05:05:15.562 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/ib_uverbs.ko 2024-05-08T05:05:15.562 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/iw_cm.ko 2024-05-08T05:05:15.562 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/rdma_cm.ko 2024-05-08T05:05:15.562 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/rdma_ucm.ko 2024-05-08T05:05:15.563 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw 2024-05-08T05:05:15.563 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/cxgb4 2024-05-08T05:05:15.563 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2024-05-08T05:05:15.563 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/mlx4 2024-05-08T05:05:15.563 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2024-05-08T05:05:15.563 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/mlx5 2024-05-08T05:05:15.563 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2024-05-08T05:05:15.563 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/mthca 2024-05-08T05:05:15.563 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2024-05-08T05:05:15.563 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp 2024-05-08T05:05:15.563 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/ipoib 2024-05-08T05:05:15.563 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2024-05-08T05:05:15.563 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/iser 2024-05-08T05:05:15.563 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2024-05-08T05:05:15.563 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/isert 2024-05-08T05:05:15.564 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2024-05-08T05:05:15.564 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/srp 2024-05-08T05:05:15.564 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2024-05-08T05:05:15.564 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/srpt 2024-05-08T05:05:15.564 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2024-05-08T05:05:15.564 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input 2024-05-08T05:05:15.564 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/gameport 2024-05-08T05:05:15.564 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/gameport/emu10k1-gp.ko 2024-05-08T05:05:15.564 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/gameport/fm801-gp.ko 2024-05-08T05:05:15.564 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/gameport/gameport.ko 2024-05-08T05:05:15.564 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/joydev.ko 2024-05-08T05:05:15.564 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard 2024-05-08T05:05:15.564 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/gpio_keys.ko 2024-05-08T05:05:15.564 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse 2024-05-08T05:05:15.565 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/appletouch.ko 2024-05-08T05:05:15.565 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/bcm5974.ko 2024-05-08T05:05:15.565 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/cyapatp.ko 2024-05-08T05:05:15.565 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/elan_i2c.ko 2024-05-08T05:05:15.565 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/sermouse.ko 2024-05-08T05:05:15.565 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/synaptics_i2c.ko 2024-05-08T05:05:15.565 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/synaptics_usb.ko 2024-05-08T05:05:15.565 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/vsxxxaa.ko 2024-05-08T05:05:15.565 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/rmi4 2024-05-08T05:05:15.565 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/rmi4/rmi_core.ko 2024-05-08T05:05:15.565 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/serio 2024-05-08T05:05:15.565 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/serio/altera_ps2.ko 2024-05-08T05:05:15.565 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/serio/arc_ps2.ko 2024-05-08T05:05:15.565 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/serio/hyperv-keyboard.ko 2024-05-08T05:05:15.566 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/serio/serio_raw.ko 2024-05-08T05:05:15.566 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/sparse-keymap.ko 2024-05-08T05:05:15.566 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds 2024-05-08T05:05:15.566 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-blinkm.ko 2024-05-08T05:05:15.566 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-lm3530.ko 2024-05-08T05:05:15.566 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-lp3944.ko 2024-05-08T05:05:15.566 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-ss4200.ko 2024-05-08T05:05:15.566 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger 2024-05-08T05:05:15.566 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-audio.ko 2024-05-08T05:05:15.566 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2024-05-08T05:05:15.566 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-camera.ko 2024-05-08T05:05:15.566 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2024-05-08T05:05:15.566 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-gpio.ko 2024-05-08T05:05:15.566 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2024-05-08T05:05:15.567 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2024-05-08T05:05:15.567 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-timer.ko 2024-05-08T05:05:15.567 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-transient.ko 2024-05-08T05:05:15.567 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md 2024-05-08T05:05:15.567 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/bcache 2024-05-08T05:05:15.567 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/bcache/bcache.ko 2024-05-08T05:05:15.567 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-bio-prison.ko 2024-05-08T05:05:15.567 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-cache-smq.ko 2024-05-08T05:05:15.567 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-cache.ko 2024-05-08T05:05:15.567 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-crypt.ko 2024-05-08T05:05:15.567 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-delay.ko 2024-05-08T05:05:15.567 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-flakey.ko 2024-05-08T05:05:15.567 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-log-userspace.ko 2024-05-08T05:05:15.567 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-multipath.ko 2024-05-08T05:05:15.567 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-queue-length.ko 2024-05-08T05:05:15.568 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-raid.ko 2024-05-08T05:05:15.568 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-round-robin.ko 2024-05-08T05:05:15.568 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-service-time.ko 2024-05-08T05:05:15.568 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-switch.ko 2024-05-08T05:05:15.568 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-thin-pool.ko 2024-05-08T05:05:15.568 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-verity.ko 2024-05-08T05:05:15.568 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/persistent-data 2024-05-08T05:05:15.568 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2024-05-08T05:05:15.568 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/raid0.ko 2024-05-08T05:05:15.568 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/raid1.ko 2024-05-08T05:05:15.568 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/raid10.ko 2024-05-08T05:05:15.568 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/raid456.ko 2024-05-08T05:05:15.568 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message 2024-05-08T05:05:15.568 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion 2024-05-08T05:05:15.569 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/mptbase.ko 2024-05-08T05:05:15.569 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/mptctl.ko 2024-05-08T05:05:15.569 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/mptfc.ko 2024-05-08T05:05:15.569 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/mptlan.ko 2024-05-08T05:05:15.569 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/mptsas.ko 2024-05-08T05:05:15.569 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/mptscsih.ko 2024-05-08T05:05:15.569 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/mptspi.ko 2024-05-08T05:05:15.569 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd 2024-05-08T05:05:15.569 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/lpc_ich.ko 2024-05-08T05:05:15.569 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/lpc_sch.ko 2024-05-08T05:05:15.569 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/mfd-core.ko 2024-05-08T05:05:15.569 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/sm501.ko 2024-05-08T05:05:15.569 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/viperboard.ko 2024-05-08T05:05:15.569 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/vx855.ko 2024-05-08T05:05:15.569 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/wl1273-core.ko 2024-05-08T05:05:15.570 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc 2024-05-08T05:05:15.570 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/altera-stapl 2024-05-08T05:05:15.570 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2024-05-08T05:05:15.570 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/apds9802als.ko 2024-05-08T05:05:15.570 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/apds990x.ko 2024-05-08T05:05:15.570 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/bh1770glc.ko 2024-05-08T05:05:15.570 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/cb710 2024-05-08T05:05:15.570 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/cb710/cb710.ko 2024-05-08T05:05:15.570 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/eeprom 2024-05-08T05:05:15.570 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/eeprom/at24.ko 2024-05-08T05:05:15.570 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2024-05-08T05:05:15.570 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/eeprom/max6875.ko 2024-05-08T05:05:15.570 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/enclosure.ko 2024-05-08T05:05:15.570 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/hpilo.ko 2024-05-08T05:05:15.571 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/isl29003.ko 2024-05-08T05:05:15.571 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/isl29020.ko 2024-05-08T05:05:15.571 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/lis3lv02d 2024-05-08T05:05:15.571 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2024-05-08T05:05:15.571 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2024-05-08T05:05:15.571 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/mei 2024-05-08T05:05:15.571 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/mei/mei-me.ko 2024-05-08T05:05:15.571 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/mei/mei-txe.ko 2024-05-08T05:05:15.571 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/mei/mei.ko 2024-05-08T05:05:15.571 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/sgi-gru 2024-05-08T05:05:15.571 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/sgi-gru/gru.ko 2024-05-08T05:05:15.571 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/sgi-xp 2024-05-08T05:05:15.571 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/sgi-xp/xp.ko 2024-05-08T05:05:15.571 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/sgi-xp/xpc.ko 2024-05-08T05:05:15.571 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/sgi-xp/xpnet.ko 2024-05-08T05:05:15.572 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/tifm_7xx1.ko 2024-05-08T05:05:15.572 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/tifm_core.ko 2024-05-08T05:05:15.572 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/tsl2550.ko 2024-05-08T05:05:15.572 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/vmw_balloon.ko 2024-05-08T05:05:15.572 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/vmw_vmci 2024-05-08T05:05:15.572 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2024-05-08T05:05:15.572 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net 2024-05-08T05:05:15.572 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/bonding 2024-05-08T05:05:15.572 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/bonding/bonding.ko 2024-05-08T05:05:15.572 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dsa 2024-05-08T05:05:15.572 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dsa/b53 2024-05-08T05:05:15.572 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dsa/b53/b53_common.ko 2024-05-08T05:05:15.572 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dsa/bcm-sf2.ko 2024-05-08T05:05:15.573 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dsa/mv88e6060.ko 2024-05-08T05:05:15.573 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dsa/mv88e6xxx 2024-05-08T05:05:15.573 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2024-05-08T05:05:15.573 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dummy.ko 2024-05-08T05:05:15.573 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/eql.ko 2024-05-08T05:05:15.573 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet 2024-05-08T05:05:15.573 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/3com 2024-05-08T05:05:15.573 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2024-05-08T05:05:15.573 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2024-05-08T05:05:15.573 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/3com/3c59x.ko 2024-05-08T05:05:15.573 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/3com/typhoon.ko 2024-05-08T05:05:15.573 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/8390 2024-05-08T05:05:15.573 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/8390/8390.ko 2024-05-08T05:05:15.573 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2024-05-08T05:05:15.574 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2024-05-08T05:05:15.574 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2024-05-08T05:05:15.574 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/adaptec 2024-05-08T05:05:15.574 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/adaptec/starfire.ko 2024-05-08T05:05:15.574 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/agere 2024-05-08T05:05:15.574 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/agere/et131x.ko 2024-05-08T05:05:15.574 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/alteon 2024-05-08T05:05:15.574 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/alteon/acenic.ko 2024-05-08T05:05:15.574 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/altera 2024-05-08T05:05:15.574 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/altera/altera_tse.ko 2024-05-08T05:05:15.574 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/amd 2024-05-08T05:05:15.574 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/amd/amd8111e.ko 2024-05-08T05:05:15.574 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2024-05-08T05:05:15.575 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/amd/pcnet32.ko 2024-05-08T05:05:15.575 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros 2024-05-08T05:05:15.575 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/alx 2024-05-08T05:05:15.575 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2024-05-08T05:05:15.575 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/atl1c 2024-05-08T05:05:15.575 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2024-05-08T05:05:15.575 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/atl1e 2024-05-08T05:05:15.575 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2024-05-08T05:05:15.575 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/atlx 2024-05-08T05:05:15.575 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2024-05-08T05:05:15.575 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2024-05-08T05:05:15.575 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom 2024-05-08T05:05:15.575 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/b44.ko 2024-05-08T05:05:15.576 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2024-05-08T05:05:15.576 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/bnx2x 2024-05-08T05:05:15.576 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2024-05-08T05:05:15.576 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/cnic.ko 2024-05-08T05:05:15.576 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/genet 2024-05-08T05:05:15.576 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2024-05-08T05:05:15.576 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/tg3.ko 2024-05-08T05:05:15.576 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/brocade 2024-05-08T05:05:15.576 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/brocade/bna 2024-05-08T05:05:15.576 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2024-05-08T05:05:15.576 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio 2024-05-08T05:05:15.576 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb 2024-05-08T05:05:15.576 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2024-05-08T05:05:15.577 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb3 2024-05-08T05:05:15.577 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2024-05-08T05:05:15.577 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb4 2024-05-08T05:05:15.577 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2024-05-08T05:05:15.577 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb4vf 2024-05-08T05:05:15.577 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2024-05-08T05:05:15.577 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/libcxgb 2024-05-08T05:05:15.577 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2024-05-08T05:05:15.577 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/cisco 2024-05-08T05:05:15.577 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/cisco/enic 2024-05-08T05:05:15.577 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2024-05-08T05:05:15.577 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec 2024-05-08T05:05:15.577 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/tulip 2024-05-08T05:05:15.577 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2024-05-08T05:05:15.578 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2024-05-08T05:05:15.578 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2024-05-08T05:05:15.578 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2024-05-08T05:05:15.578 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2024-05-08T05:05:15.578 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2024-05-08T05:05:15.578 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dlink 2024-05-08T05:05:15.578 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dlink/dl2k.ko 2024-05-08T05:05:15.578 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dlink/sundance.ko 2024-05-08T05:05:15.578 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dnet.ko 2024-05-08T05:05:15.578 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/emulex 2024-05-08T05:05:15.578 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/emulex/benet 2024-05-08T05:05:15.578 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2024-05-08T05:05:15.578 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/ethoc.ko 2024-05-08T05:05:15.579 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/fealnx.ko 2024-05-08T05:05:15.579 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel 2024-05-08T05:05:15.579 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/e100.ko 2024-05-08T05:05:15.579 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/e1000 2024-05-08T05:05:15.579 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2024-05-08T05:05:15.579 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/e1000e 2024-05-08T05:05:15.579 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2024-05-08T05:05:15.579 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/fm10k 2024-05-08T05:05:15.579 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2024-05-08T05:05:15.579 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/i40e 2024-05-08T05:05:15.579 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2024-05-08T05:05:15.579 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/iavf 2024-05-08T05:05:15.579 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2024-05-08T05:05:15.579 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/igb 2024-05-08T05:05:15.580 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/igb/igb.ko 2024-05-08T05:05:15.580 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/igbvf 2024-05-08T05:05:15.580 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2024-05-08T05:05:15.580 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/ixgbe 2024-05-08T05:05:15.580 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2024-05-08T05:05:15.580 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/ixgbevf 2024-05-08T05:05:15.580 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2024-05-08T05:05:15.580 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/jme.ko 2024-05-08T05:05:15.580 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/marvell 2024-05-08T05:05:15.580 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2024-05-08T05:05:15.580 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/marvell/skge.ko 2024-05-08T05:05:15.580 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/marvell/sky2.ko 2024-05-08T05:05:15.580 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/mellanox 2024-05-08T05:05:15.581 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/mellanox/mlx4 2024-05-08T05:05:15.581 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2024-05-08T05:05:15.581 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2024-05-08T05:05:15.581 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/mellanox/mlx5 2024-05-08T05:05:15.581 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/mellanox/mlx5/core 2024-05-08T05:05:15.581 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2024-05-08T05:05:15.581 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/micrel 2024-05-08T05:05:15.581 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2024-05-08T05:05:15.581 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/myricom 2024-05-08T05:05:15.581 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/myricom/myri10ge 2024-05-08T05:05:15.581 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2024-05-08T05:05:15.581 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/natsemi 2024-05-08T05:05:15.581 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2024-05-08T05:05:15.581 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2024-05-08T05:05:15.581 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/neterion 2024-05-08T05:05:15.582 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/neterion/s2io.ko 2024-05-08T05:05:15.582 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/nvidia 2024-05-08T05:05:15.582 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2024-05-08T05:05:15.582 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/packetengines 2024-05-08T05:05:15.582 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2024-05-08T05:05:15.582 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2024-05-08T05:05:15.582 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/qlogic 2024-05-08T05:05:15.582 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/qlogic/netxen 2024-05-08T05:05:15.582 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2024-05-08T05:05:15.582 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2024-05-08T05:05:15.582 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/qlogic/qlcnic 2024-05-08T05:05:15.582 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2024-05-08T05:05:15.582 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/rdc 2024-05-08T05:05:15.582 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/rdc/r6040.ko 2024-05-08T05:05:15.582 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/realtek 2024-05-08T05:05:15.583 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/realtek/8139cp.ko 2024-05-08T05:05:15.583 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/realtek/8139too.ko 2024-05-08T05:05:15.583 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/realtek/atp.ko 2024-05-08T05:05:15.583 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/realtek/r8169.ko 2024-05-08T05:05:15.583 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/rocker 2024-05-08T05:05:15.583 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/rocker/rocker.ko 2024-05-08T05:05:15.583 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sfc 2024-05-08T05:05:15.583 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sfc/sfc.ko 2024-05-08T05:05:15.583 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/silan 2024-05-08T05:05:15.583 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/silan/sc92031.ko 2024-05-08T05:05:15.583 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sis 2024-05-08T05:05:15.583 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sis/sis190.ko 2024-05-08T05:05:15.583 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sis/sis900.ko 2024-05-08T05:05:15.583 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/smsc 2024-05-08T05:05:15.584 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/smsc/epic100.ko 2024-05-08T05:05:15.584 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2024-05-08T05:05:15.584 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2024-05-08T05:05:15.584 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2024-05-08T05:05:15.584 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/stmicro 2024-05-08T05:05:15.584 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/stmicro/stmmac 2024-05-08T05:05:15.584 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2024-05-08T05:05:15.584 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2024-05-08T05:05:15.584 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sun 2024-05-08T05:05:15.584 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sun/cassini.ko 2024-05-08T05:05:15.585 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sun/niu.ko 2024-05-08T05:05:15.585 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sun/sungem.ko 2024-05-08T05:05:15.585 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sun/sunhme.ko 2024-05-08T05:05:15.585 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/tehuti 2024-05-08T05:05:15.585 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2024-05-08T05:05:15.585 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/ti 2024-05-08T05:05:15.585 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/ti/tlan.ko 2024-05-08T05:05:15.585 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/via 2024-05-08T05:05:15.585 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/via/via-rhine.ko 2024-05-08T05:05:15.585 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/via/via-velocity.ko 2024-05-08T05:05:15.585 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/wiznet 2024-05-08T05:05:15.585 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/wiznet/w5100.ko 2024-05-08T05:05:15.585 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/wiznet/w5300.ko 2024-05-08T05:05:15.585 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/xircom 2024-05-08T05:05:15.585 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2024-05-08T05:05:15.586 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/geneve.ko 2024-05-08T05:05:15.586 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/hyperv 2024-05-08T05:05:15.586 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/hyperv/hv_netvsc.ko 2024-05-08T05:05:15.586 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ieee802154 2024-05-08T05:05:15.586 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ieee802154/fakelb.ko 2024-05-08T05:05:15.586 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ifb.ko 2024-05-08T05:05:15.586 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ipvlan 2024-05-08T05:05:15.586 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ipvlan/ipvlan.ko 2024-05-08T05:05:15.586 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/macvlan.ko 2024-05-08T05:05:15.586 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/macvtap.ko 2024-05-08T05:05:15.586 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/mdio 2024-05-08T05:05:15.586 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/mdio.ko 2024-05-08T05:05:15.586 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2024-05-08T05:05:15.587 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/mdio/mdio-bitbang.ko 2024-05-08T05:05:15.587 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/mdio/mdio-regmap.ko 2024-05-08T05:05:15.587 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/mii.ko 2024-05-08T05:05:15.587 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/net_failover.ko 2024-05-08T05:05:15.587 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/netconsole.ko 2024-05-08T05:05:15.587 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/nlmon.ko 2024-05-08T05:05:15.587 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/pcs 2024-05-08T05:05:15.587 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/pcs/pcs-lynx.ko 2024-05-08T05:05:15.587 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/pcs/pcs_xpcs.ko 2024-05-08T05:05:15.587 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy 2024-05-08T05:05:15.587 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/amd.ko 2024-05-08T05:05:15.587 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/bcm-phy-lib.ko 2024-05-08T05:05:15.587 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/bcm-phy-ptp.ko 2024-05-08T05:05:15.587 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/bcm7xxx.ko 2024-05-08T05:05:15.588 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/bcm87xx.ko 2024-05-08T05:05:15.588 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/broadcom.ko 2024-05-08T05:05:15.588 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/cicada.ko 2024-05-08T05:05:15.588 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/davicom.ko 2024-05-08T05:05:15.588 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/dp83640.ko 2024-05-08T05:05:15.588 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/et1011c.ko 2024-05-08T05:05:15.588 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/icplus.ko 2024-05-08T05:05:15.588 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/lxt.ko 2024-05-08T05:05:15.588 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/marvell.ko 2024-05-08T05:05:15.588 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/micrel.ko 2024-05-08T05:05:15.588 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/national.ko 2024-05-08T05:05:15.588 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/phylink.ko 2024-05-08T05:05:15.588 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/qsemi.ko 2024-05-08T05:05:15.588 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/realtek.ko 2024-05-08T05:05:15.588 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/smsc.ko 2024-05-08T05:05:15.589 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/ste10Xp.ko 2024-05-08T05:05:15.589 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/vitesse.ko 2024-05-08T05:05:15.589 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp 2024-05-08T05:05:15.589 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/bsd_comp.ko 2024-05-08T05:05:15.589 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/ppp_async.ko 2024-05-08T05:05:15.589 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/ppp_deflate.ko 2024-05-08T05:05:15.589 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/ppp_generic.ko 2024-05-08T05:05:15.589 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/ppp_mppe.ko 2024-05-08T05:05:15.589 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/ppp_synctty.ko 2024-05-08T05:05:15.589 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/pppoe.ko 2024-05-08T05:05:15.589 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/pppox.ko 2024-05-08T05:05:15.589 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/pptp.ko 2024-05-08T05:05:15.589 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/slip 2024-05-08T05:05:15.589 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/slip/slhc.ko 2024-05-08T05:05:15.590 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/slip/slip.ko 2024-05-08T05:05:15.590 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/sungem_phy.ko 2024-05-08T05:05:15.590 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/tap.ko 2024-05-08T05:05:15.590 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/team 2024-05-08T05:05:15.590 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/team/team.ko 2024-05-08T05:05:15.590 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/team/team_mode_activebackup.ko 2024-05-08T05:05:15.590 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/team/team_mode_broadcast.ko 2024-05-08T05:05:15.590 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/team/team_mode_loadbalance.ko 2024-05-08T05:05:15.590 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/team/team_mode_random.ko 2024-05-08T05:05:15.590 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/team/team_mode_roundrobin.ko 2024-05-08T05:05:15.590 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/tun.ko 2024-05-08T05:05:15.590 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/veth.ko 2024-05-08T05:05:15.590 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/virtio_net.ko 2024-05-08T05:05:15.591 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/vmxnet3 2024-05-08T05:05:15.591 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/vmxnet3/vmxnet3.ko 2024-05-08T05:05:15.591 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/vxlan 2024-05-08T05:05:15.591 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/vxlan/vxlan.ko 2024-05-08T05:05:15.591 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/xen-netback 2024-05-08T05:05:15.591 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/xen-netback/xen-netback.ko 2024-05-08T05:05:15.591 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/xen-netfront.ko 2024-05-08T05:05:15.591 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ntb 2024-05-08T05:05:15.591 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ntb/ntb.ko 2024-05-08T05:05:15.591 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/nvme 2024-05-08T05:05:15.591 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/nvme/host 2024-05-08T05:05:15.591 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/nvme/host/nvme-core.ko 2024-05-08T05:05:15.591 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/nvme/host/nvme.ko 2024-05-08T05:05:15.591 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/parport 2024-05-08T05:05:15.592 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/parport/parport.ko 2024-05-08T05:05:15.592 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/parport/parport_cs.ko 2024-05-08T05:05:15.592 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/parport/parport_pc.ko 2024-05-08T05:05:15.592 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/parport/parport_serial.ko 2024-05-08T05:05:15.592 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pci 2024-05-08T05:05:15.592 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pci/hotplug 2024-05-08T05:05:15.592 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2024-05-08T05:05:15.593 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pci/pcie 2024-05-08T05:05:15.593 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pci/pcie/aer_inject.ko 2024-05-08T05:05:15.593 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pci/xen-pcifront.ko 2024-05-08T05:05:15.593 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pcmcia 2024-05-08T05:05:15.593 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pcmcia/i82092.ko 2024-05-08T05:05:15.593 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pcmcia/pd6729.ko 2024-05-08T05:05:15.593 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pcmcia/yenta_socket.ko 2024-05-08T05:05:15.594 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pinctrl 2024-05-08T05:05:15.594 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pinctrl/intel 2024-05-08T05:05:15.594 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2024-05-08T05:05:15.594 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform 2024-05-08T05:05:15.594 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86 2024-05-08T05:05:15.594 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/acer-wmi.ko 2024-05-08T05:05:15.595 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/acerhdf.ko 2024-05-08T05:05:15.595 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/apple-gmux.ko 2024-05-08T05:05:15.595 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/asus-laptop.ko 2024-05-08T05:05:15.595 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/asus-nb-wmi.ko 2024-05-08T05:05:15.595 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/asus-wmi.ko 2024-05-08T05:05:15.595 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/classmate-laptop.ko 2024-05-08T05:05:15.595 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/eeepc-laptop.ko 2024-05-08T05:05:15.596 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/eeepc-wmi.ko 2024-05-08T05:05:15.596 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/fujitsu-laptop.ko 2024-05-08T05:05:15.596 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/fujitsu-tablet.ko 2024-05-08T05:05:15.596 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/hdaps.ko 2024-05-08T05:05:15.596 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/intel 2024-05-08T05:05:15.596 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/intel/intel-rst.ko 2024-05-08T05:05:15.596 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/intel_ips.ko 2024-05-08T05:05:15.597 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/msi-wmi.ko 2024-05-08T05:05:15.597 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/mxm-wmi.ko 2024-05-08T05:05:15.597 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/panasonic-laptop.ko 2024-05-08T05:05:15.597 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/samsung-laptop.ko 2024-05-08T05:05:15.597 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/samsung-q10.ko 2024-05-08T05:05:15.597 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/topstar-laptop.ko 2024-05-08T05:05:15.597 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2024-05-08T05:05:15.597 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/toshiba_haps.ko 2024-05-08T05:05:15.598 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/wmi-bmof.ko 2024-05-08T05:05:15.598 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/wmi.ko 2024-05-08T05:05:15.598 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/powercap 2024-05-08T05:05:15.598 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/powercap/intel_rapl_common.ko 2024-05-08T05:05:15.598 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/powercap/intel_rapl_msr.ko 2024-05-08T05:05:15.598 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pps 2024-05-08T05:05:15.598 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pps/clients 2024-05-08T05:05:15.598 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pps/clients/pps-gpio.ko 2024-05-08T05:05:15.599 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pps/clients/pps-ldisc.ko 2024-05-08T05:05:15.599 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pps/clients/pps_parport.ko 2024-05-08T05:05:15.599 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pps/pps_core.ko 2024-05-08T05:05:15.599 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ptp 2024-05-08T05:05:15.599 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ptp/ptp.ko 2024-05-08T05:05:15.599 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ptp/ptp_kvm.ko 2024-05-08T05:05:15.600 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ras 2024-05-08T05:05:15.600 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ras/amd 2024-05-08T05:05:15.600 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ras/amd/atl 2024-05-08T05:05:15.600 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ras/amd/atl/amd_atl.ko 2024-05-08T05:05:15.600 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ras/amd/fmpm.ko 2024-05-08T05:05:15.601 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc 2024-05-08T05:05:15.601 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-bq32k.ko 2024-05-08T05:05:15.601 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds1286.ko 2024-05-08T05:05:15.601 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds1307.ko 2024-05-08T05:05:15.602 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds1374.ko 2024-05-08T05:05:15.602 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds1511.ko 2024-05-08T05:05:15.602 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds1553.ko 2024-05-08T05:05:15.602 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds1672.ko 2024-05-08T05:05:15.602 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds1742.ko 2024-05-08T05:05:15.602 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds2404.ko 2024-05-08T05:05:15.602 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds3232.ko 2024-05-08T05:05:15.602 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-em3027.ko 2024-05-08T05:05:15.602 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-fm3130.ko 2024-05-08T05:05:15.603 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-isl12022.ko 2024-05-08T05:05:15.603 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-isl1208.ko 2024-05-08T05:05:15.603 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-m41t80.ko 2024-05-08T05:05:15.603 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-m48t35.ko 2024-05-08T05:05:15.603 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-m48t59.ko 2024-05-08T05:05:15.603 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-max6900.ko 2024-05-08T05:05:15.603 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-msm6242.ko 2024-05-08T05:05:15.603 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-pcf2127.ko 2024-05-08T05:05:15.603 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-pcf85063.ko 2024-05-08T05:05:15.603 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-pcf8523.ko 2024-05-08T05:05:15.603 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-pcf8563.ko 2024-05-08T05:05:15.603 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-pcf8583.ko 2024-05-08T05:05:15.603 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-rp5c01.ko 2024-05-08T05:05:15.603 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-rs5c372.ko 2024-05-08T05:05:15.604 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-rv3029c2.ko 2024-05-08T05:05:15.604 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-rx8025.ko 2024-05-08T05:05:15.604 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-rx8581.ko 2024-05-08T05:05:15.604 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-stk17ta8.ko 2024-05-08T05:05:15.604 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-x1205.ko 2024-05-08T05:05:15.604 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi 2024-05-08T05:05:15.604 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/3w-9xxx.ko 2024-05-08T05:05:15.604 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/3w-sas.ko 2024-05-08T05:05:15.604 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/3w-xxxx.ko 2024-05-08T05:05:15.604 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/BusLogic.ko 2024-05-08T05:05:15.604 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/a100u2w.ko 2024-05-08T05:05:15.604 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/aacraid 2024-05-08T05:05:15.604 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/aacraid/aacraid.ko 2024-05-08T05:05:15.604 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/advansys.ko 2024-05-08T05:05:15.605 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/aic7xxx 2024-05-08T05:05:15.605 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2024-05-08T05:05:15.605 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2024-05-08T05:05:15.605 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/am53c974.ko 2024-05-08T05:05:15.605 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/arcmsr 2024-05-08T05:05:15.605 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/arcmsr/arcmsr.ko 2024-05-08T05:05:15.605 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/atp870u.ko 2024-05-08T05:05:15.605 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/be2iscsi 2024-05-08T05:05:15.605 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2024-05-08T05:05:15.605 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/bfa 2024-05-08T05:05:15.605 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/bfa/bfa.ko 2024-05-08T05:05:15.605 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/bnx2fc 2024-05-08T05:05:15.605 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2024-05-08T05:05:15.605 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/bnx2i 2024-05-08T05:05:15.605 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/bnx2i/bnx2i.ko 2024-05-08T05:05:15.605 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/ch.ko 2024-05-08T05:05:15.606 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/csiostor 2024-05-08T05:05:15.606 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/csiostor/csiostor.ko 2024-05-08T05:05:15.606 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/cxgbi 2024-05-08T05:05:15.606 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/cxgbi/cxgb3i 2024-05-08T05:05:15.606 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2024-05-08T05:05:15.606 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/cxgbi/cxgb4i 2024-05-08T05:05:15.606 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2024-05-08T05:05:15.606 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2024-05-08T05:05:15.606 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/dc395x.ko 2024-05-08T05:05:15.606 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/device_handler 2024-05-08T05:05:15.606 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/device_handler/scsi_dh_alua.ko 2024-05-08T05:05:15.606 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/device_handler/scsi_dh_emc.ko 2024-05-08T05:05:15.607 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/device_handler/scsi_dh_hp_sw.ko 2024-05-08T05:05:15.607 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/device_handler/scsi_dh_rdac.ko 2024-05-08T05:05:15.607 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/dmx3191d.ko 2024-05-08T05:05:15.607 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/esas2r 2024-05-08T05:05:15.607 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/esas2r/esas2r.ko 2024-05-08T05:05:15.607 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/esp_scsi.ko 2024-05-08T05:05:15.607 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/fcoe 2024-05-08T05:05:15.607 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/fcoe/fcoe.ko 2024-05-08T05:05:15.607 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/fcoe/libfcoe.ko 2024-05-08T05:05:15.607 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/fnic 2024-05-08T05:05:15.607 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/fnic/fnic.ko 2024-05-08T05:05:15.607 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/hpsa.ko 2024-05-08T05:05:15.607 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/hptiop.ko 2024-05-08T05:05:15.607 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/hv_storvsc.ko 2024-05-08T05:05:15.608 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/initio.ko 2024-05-08T05:05:15.608 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/ipr.ko 2024-05-08T05:05:15.608 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/ips.ko 2024-05-08T05:05:15.608 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/isci 2024-05-08T05:05:15.608 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/isci/isci.ko 2024-05-08T05:05:15.608 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2024-05-08T05:05:15.608 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/iscsi_tcp.ko 2024-05-08T05:05:15.608 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/libfc 2024-05-08T05:05:15.608 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/libfc/libfc.ko 2024-05-08T05:05:15.608 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/libiscsi.ko 2024-05-08T05:05:15.608 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/libiscsi_tcp.ko 2024-05-08T05:05:15.608 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/libsas 2024-05-08T05:05:15.608 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/libsas/libsas.ko 2024-05-08T05:05:15.608 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/lpfc 2024-05-08T05:05:15.608 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/lpfc/lpfc.ko 2024-05-08T05:05:15.608 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/megaraid 2024-05-08T05:05:15.609 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/megaraid.ko 2024-05-08T05:05:15.609 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2024-05-08T05:05:15.609 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2024-05-08T05:05:15.609 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2024-05-08T05:05:15.609 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/mpt3sas 2024-05-08T05:05:15.609 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2024-05-08T05:05:15.609 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/mvsas 2024-05-08T05:05:15.609 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/mvsas/mvsas.ko 2024-05-08T05:05:15.609 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/mvumi.ko 2024-05-08T05:05:15.609 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/pm8001 2024-05-08T05:05:15.609 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/pm8001/pm80xx.ko 2024-05-08T05:05:15.609 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/pmcraid.ko 2024-05-08T05:05:15.609 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/qla1280.ko 2024-05-08T05:05:15.609 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/qla2xxx 2024-05-08T05:05:15.610 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2024-05-08T05:05:15.610 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2024-05-08T05:05:15.610 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/qla4xxx 2024-05-08T05:05:15.610 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2024-05-08T05:05:15.610 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/raid_class.ko 2024-05-08T05:05:15.610 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/scsi_debug.ko 2024-05-08T05:05:15.610 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/scsi_transport_fc.ko 2024-05-08T05:05:15.610 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/scsi_transport_iscsi.ko 2024-05-08T05:05:15.610 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/scsi_transport_sas.ko 2024-05-08T05:05:15.610 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/scsi_transport_spi.ko 2024-05-08T05:05:15.610 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/scsi_transport_srp.ko 2024-05-08T05:05:15.610 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/ses.ko 2024-05-08T05:05:15.610 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/st.ko 2024-05-08T05:05:15.610 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/stex.ko 2024-05-08T05:05:15.611 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/sym53c8xx_2 2024-05-08T05:05:15.611 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2024-05-08T05:05:15.611 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/virtio_scsi.ko 2024-05-08T05:05:15.611 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/vmw_pvscsi.ko 2024-05-08T05:05:15.611 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/wd719x.ko 2024-05-08T05:05:15.611 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ssb 2024-05-08T05:05:15.611 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ssb/ssb.ko 2024-05-08T05:05:15.611 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target 2024-05-08T05:05:15.611 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/iscsi 2024-05-08T05:05:15.611 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2024-05-08T05:05:15.611 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/loopback 2024-05-08T05:05:15.611 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/loopback/tcm_loop.ko 2024-05-08T05:05:15.611 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/target_core_file.ko 2024-05-08T05:05:15.611 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/target_core_iblock.ko 2024-05-08T05:05:15.612 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/target_core_mod.ko 2024-05-08T05:05:15.612 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/target_core_pscsi.ko 2024-05-08T05:05:15.612 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/target_core_user.ko 2024-05-08T05:05:15.612 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/tcm_fc 2024-05-08T05:05:15.612 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/tcm_fc/tcm_fc.ko 2024-05-08T05:05:15.612 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal 2024-05-08T05:05:15.612 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel 2024-05-08T05:05:15.612 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal 2024-05-08T05:05:15.612 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2024-05-08T05:05:15.612 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2024-05-08T05:05:15.612 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2024-05-08T05:05:15.612 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2024-05-08T05:05:15.612 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2024-05-08T05:05:15.612 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2024-05-08T05:05:15.612 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2024-05-08T05:05:15.613 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2024-05-08T05:05:15.613 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2024-05-08T05:05:15.613 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2024-05-08T05:05:15.613 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_power_floor.ko 2024-05-08T05:05:15.613 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2024-05-08T05:05:15.613 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2024-05-08T05:05:15.613 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_hint.ko 2024-05-08T05:05:15.613 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_req.ko 2024-05-08T05:05:15.613 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2024-05-08T05:05:15.613 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2024-05-08T05:05:15.613 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2024-05-08T05:05:15.613 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty 2024-05-08T05:05:15.613 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/ipwireless 2024-05-08T05:05:15.614 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/ipwireless/ipwireless.ko 2024-05-08T05:05:15.614 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/n_gsm.ko 2024-05-08T05:05:15.614 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/n_hdlc.ko 2024-05-08T05:05:15.614 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/nozomi.ko 2024-05-08T05:05:15.614 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial 2024-05-08T05:05:15.614 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/8250 2024-05-08T05:05:15.614 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/8250/serial_cs.ko 2024-05-08T05:05:15.614 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/arc_uart.ko 2024-05-08T05:05:15.614 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/jsm 2024-05-08T05:05:15.614 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/jsm/jsm.ko 2024-05-08T05:05:15.614 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ufs 2024-05-08T05:05:15.614 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ufs/core 2024-05-08T05:05:15.614 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ufs/core/ufshcd-core.ko 2024-05-08T05:05:15.615 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ufs/host 2024-05-08T05:05:15.615 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ufs/host/ufshcd-pci.ko 2024-05-08T05:05:15.615 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio 2024-05-08T05:05:15.615 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio/uio.ko 2024-05-08T05:05:15.615 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio/uio_aec.ko 2024-05-08T05:05:15.615 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio/uio_cif.ko 2024-05-08T05:05:15.615 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio/uio_pci_generic.ko 2024-05-08T05:05:15.615 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio/uio_sercos3.ko 2024-05-08T05:05:15.615 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb 2024-05-08T05:05:15.615 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/class 2024-05-08T05:05:15.615 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/class/cdc-acm.ko 2024-05-08T05:05:15.615 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/class/cdc-wdm.ko 2024-05-08T05:05:15.615 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/class/usblp.ko 2024-05-08T05:05:15.615 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/class/usbtmc.ko 2024-05-08T05:05:15.615 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/host 2024-05-08T05:05:15.616 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/host/sl811-hcd.ko 2024-05-08T05:05:15.616 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/image 2024-05-08T05:05:15.616 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/image/mdc800.ko 2024-05-08T05:05:15.616 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/image/microtek.ko 2024-05-08T05:05:15.616 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc 2024-05-08T05:05:15.616 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/adutux.ko 2024-05-08T05:05:15.616 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/appledisplay.ko 2024-05-08T05:05:15.616 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/emi26.ko 2024-05-08T05:05:15.616 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/emi62.ko 2024-05-08T05:05:15.616 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/ezusb.ko 2024-05-08T05:05:15.616 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/idmouse.ko 2024-05-08T05:05:15.616 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/iowarrior.ko 2024-05-08T05:05:15.616 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/isight_firmware.ko 2024-05-08T05:05:15.616 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/ldusb.ko 2024-05-08T05:05:15.617 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/legousbtower.ko 2024-05-08T05:05:15.617 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/sisusbvga 2024-05-08T05:05:15.617 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2024-05-08T05:05:15.617 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/trancevibrator.ko 2024-05-08T05:05:15.617 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/usb3503.ko 2024-05-08T05:05:15.617 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/usblcd.ko 2024-05-08T05:05:15.617 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/usbsevseg.ko 2024-05-08T05:05:15.617 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/uss720.ko 2024-05-08T05:05:15.617 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/yurex.ko 2024-05-08T05:05:15.617 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/phy 2024-05-08T05:05:15.617 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/phy/phy-generic.ko 2024-05-08T05:05:15.617 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial 2024-05-08T05:05:15.617 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/aircable.ko 2024-05-08T05:05:15.617 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ark3116.ko 2024-05-08T05:05:15.617 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/belkin_sa.ko 2024-05-08T05:05:15.618 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ch341.ko 2024-05-08T05:05:15.618 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/cp210x.ko 2024-05-08T05:05:15.618 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/cyberjack.ko 2024-05-08T05:05:15.618 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/cypress_m8.ko 2024-05-08T05:05:15.618 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/digi_acceleport.ko 2024-05-08T05:05:15.618 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/empeg.ko 2024-05-08T05:05:15.618 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ftdi_sio.ko 2024-05-08T05:05:15.618 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/garmin_gps.ko 2024-05-08T05:05:15.618 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/io_edgeport.ko 2024-05-08T05:05:15.618 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/io_ti.ko 2024-05-08T05:05:15.618 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ipaq.ko 2024-05-08T05:05:15.618 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ipw.ko 2024-05-08T05:05:15.618 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ir-usb.ko 2024-05-08T05:05:15.618 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/iuu_phoenix.ko 2024-05-08T05:05:15.619 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/keyspan.ko 2024-05-08T05:05:15.619 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/keyspan_pda.ko 2024-05-08T05:05:15.619 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/kl5kusb105.ko 2024-05-08T05:05:15.619 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/kobil_sct.ko 2024-05-08T05:05:15.619 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/mct_u232.ko 2024-05-08T05:05:15.619 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/mos7720.ko 2024-05-08T05:05:15.619 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/mos7840.ko 2024-05-08T05:05:15.619 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/navman.ko 2024-05-08T05:05:15.619 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/omninet.ko 2024-05-08T05:05:15.619 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/opticon.ko 2024-05-08T05:05:15.619 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/option.ko 2024-05-08T05:05:15.619 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/oti6858.ko 2024-05-08T05:05:15.619 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/pl2303.ko 2024-05-08T05:05:15.619 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/qcaux.ko 2024-05-08T05:05:15.619 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/qcserial.ko 2024-05-08T05:05:15.620 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/quatech2.ko 2024-05-08T05:05:15.620 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/safe_serial.ko 2024-05-08T05:05:15.620 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/sierra.ko 2024-05-08T05:05:15.620 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/spcp8x5.ko 2024-05-08T05:05:15.620 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ssu100.ko 2024-05-08T05:05:15.620 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/symbolserial.ko 2024-05-08T05:05:15.620 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2024-05-08T05:05:15.620 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/usb-serial-simple.ko 2024-05-08T05:05:15.620 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/usb_debug.ko 2024-05-08T05:05:15.620 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/usb_wwan.ko 2024-05-08T05:05:15.620 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/visor.ko 2024-05-08T05:05:15.620 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/whiteheat.ko 2024-05-08T05:05:15.620 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/xsens_mt.ko 2024-05-08T05:05:15.620 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage 2024-05-08T05:05:15.620 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/uas.ko 2024-05-08T05:05:15.621 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-alauda.ko 2024-05-08T05:05:15.621 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-cypress.ko 2024-05-08T05:05:15.621 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-datafab.ko 2024-05-08T05:05:15.621 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-eneub6250.ko 2024-05-08T05:05:15.621 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-freecom.ko 2024-05-08T05:05:15.621 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-isd200.ko 2024-05-08T05:05:15.621 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-jumpshot.ko 2024-05-08T05:05:15.621 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-karma.ko 2024-05-08T05:05:15.621 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-onetouch.ko 2024-05-08T05:05:15.621 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-realtek.ko 2024-05-08T05:05:15.621 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-sddr09.ko 2024-05-08T05:05:15.622 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-sddr55.ko 2024-05-08T05:05:15.622 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-usbat.ko 2024-05-08T05:05:15.622 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/usb-storage.ko 2024-05-08T05:05:15.622 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/usbip 2024-05-08T05:05:15.622 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/usbip/usbip-core.ko 2024-05-08T05:05:15.622 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/usbip/usbip-host.ko 2024-05-08T05:05:15.622 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/usbip/vhci-hcd.ko 2024-05-08T05:05:15.622 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vfio 2024-05-08T05:05:15.622 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vfio/pci 2024-05-08T05:05:15.622 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vfio/pci/vfio-pci-core.ko 2024-05-08T05:05:15.622 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vfio/pci/vfio-pci.ko 2024-05-08T05:05:15.623 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vfio/vfio.ko 2024-05-08T05:05:15.623 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vfio/vfio_iommu_type1.ko 2024-05-08T05:05:15.623 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vhost 2024-05-08T05:05:15.623 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vhost/vhost.ko 2024-05-08T05:05:15.623 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vhost/vhost_iotlb.ko 2024-05-08T05:05:15.623 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vhost/vhost_net.ko 2024-05-08T05:05:15.623 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vhost/vhost_scsi.ko 2024-05-08T05:05:15.623 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video 2024-05-08T05:05:15.623 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight 2024-05-08T05:05:15.623 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/apple_bl.ko 2024-05-08T05:05:15.623 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/lcd.ko 2024-05-08T05:05:15.623 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/platform_lcd.ko 2024-05-08T05:05:15.623 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/virtio 2024-05-08T05:05:15.623 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/virtio/virtio.ko 2024-05-08T05:05:15.623 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/virtio/virtio_balloon.ko 2024-05-08T05:05:15.623 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/virtio/virtio_mmio.ko 2024-05-08T05:05:15.624 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/virtio/virtio_pci.ko 2024-05-08T05:05:15.624 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/virtio/virtio_pci_legacy_dev.ko 2024-05-08T05:05:15.624 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/virtio/virtio_pci_modern_dev.ko 2024-05-08T05:05:15.624 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/virtio/virtio_ring.ko 2024-05-08T05:05:15.624 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1 2024-05-08T05:05:15.624 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/masters 2024-05-08T05:05:15.624 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/masters/ds2482.ko 2024-05-08T05:05:15.624 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/masters/ds2490.ko 2024-05-08T05:05:15.624 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves 2024-05-08T05:05:15.624 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2406.ko 2024-05-08T05:05:15.624 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2408.ko 2024-05-08T05:05:15.624 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2413.ko 2024-05-08T05:05:15.624 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2423.ko 2024-05-08T05:05:15.624 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2431.ko 2024-05-08T05:05:15.624 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2433.ko 2024-05-08T05:05:15.625 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2780.ko 2024-05-08T05:05:15.625 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2781.ko 2024-05-08T05:05:15.625 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds28e04.ko 2024-05-08T05:05:15.625 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_smem.ko 2024-05-08T05:05:15.625 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_therm.ko 2024-05-08T05:05:15.625 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/wire.ko 2024-05-08T05:05:15.625 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog 2024-05-08T05:05:15.625 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/alim1535_wdt.ko 2024-05-08T05:05:15.625 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/alim7101_wdt.ko 2024-05-08T05:05:15.625 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/f71808e_wdt.ko 2024-05-08T05:05:15.625 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/hpwdt.ko 2024-05-08T05:05:15.625 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/i6300esb.ko 2024-05-08T05:05:15.625 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/iTCO_vendor_support.ko 2024-05-08T05:05:15.625 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/iTCO_wdt.ko 2024-05-08T05:05:15.626 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/ib700wdt.ko 2024-05-08T05:05:15.626 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/ibmasr.ko 2024-05-08T05:05:15.626 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/ie6xx_wdt.ko 2024-05-08T05:05:15.626 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/it8712f_wdt.ko 2024-05-08T05:05:15.626 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/it87_wdt.ko 2024-05-08T05:05:15.626 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/machzwd.ko 2024-05-08T05:05:15.626 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/nv_tco.ko 2024-05-08T05:05:15.626 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/pcwd_pci.ko 2024-05-08T05:05:15.626 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/pcwd_usb.ko 2024-05-08T05:05:15.626 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2024-05-08T05:05:15.626 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/sch311x_wdt.ko 2024-05-08T05:05:15.626 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/softdog.ko 2024-05-08T05:05:15.626 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/sp5100_tco.ko 2024-05-08T05:05:15.626 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/via_wdt.ko 2024-05-08T05:05:15.627 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/w83627hf_wdt.ko 2024-05-08T05:05:15.627 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/w83877f_wdt.ko 2024-05-08T05:05:15.627 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/w83977f_wdt.ko 2024-05-08T05:05:15.627 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/wdt_pci.ko 2024-05-08T05:05:15.627 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/xen_wdt.ko 2024-05-08T05:05:15.627 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen 2024-05-08T05:05:15.627 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xen-acpi-processor.ko 2024-05-08T05:05:15.627 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xen-evtchn.ko 2024-05-08T05:05:15.627 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xen-gntalloc.ko 2024-05-08T05:05:15.627 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xen-gntdev.ko 2024-05-08T05:05:15.627 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xen-pciback 2024-05-08T05:05:15.627 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2024-05-08T05:05:15.627 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xen-privcmd.ko 2024-05-08T05:05:15.627 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xenfs 2024-05-08T05:05:15.627 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xenfs/xenfs.ko 2024-05-08T05:05:15.628 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs 2024-05-08T05:05:15.628 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/9p 2024-05-08T05:05:15.628 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/9p/9p.ko 2024-05-08T05:05:15.628 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/affs 2024-05-08T05:05:15.628 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/affs/affs.ko 2024-05-08T05:05:15.628 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/befs 2024-05-08T05:05:15.628 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/befs/befs.ko 2024-05-08T05:05:15.628 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/binfmt_misc.ko 2024-05-08T05:05:15.628 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/btrfs 2024-05-08T05:05:15.628 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/btrfs/btrfs.ko 2024-05-08T05:05:15.628 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/cachefiles 2024-05-08T05:05:15.628 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/cachefiles/cachefiles.ko 2024-05-08T05:05:15.628 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ceph 2024-05-08T05:05:15.628 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ceph/ceph.ko 2024-05-08T05:05:15.629 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/coda 2024-05-08T05:05:15.629 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/coda/coda.ko 2024-05-08T05:05:15.629 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/cramfs 2024-05-08T05:05:15.629 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/cramfs/cramfs.ko 2024-05-08T05:05:15.629 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/dlm 2024-05-08T05:05:15.629 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/dlm/dlm.ko 2024-05-08T05:05:15.629 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ecryptfs 2024-05-08T05:05:15.629 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ecryptfs/ecryptfs.ko 2024-05-08T05:05:15.629 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/f2fs 2024-05-08T05:05:15.629 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/f2fs/f2fs.ko 2024-05-08T05:05:15.629 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/fat 2024-05-08T05:05:15.629 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/fat/fat.ko 2024-05-08T05:05:15.629 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/fat/msdos.ko 2024-05-08T05:05:15.629 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/fat/vfat.ko 2024-05-08T05:05:15.630 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/fuse 2024-05-08T05:05:15.630 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/fuse/cuse.ko 2024-05-08T05:05:15.630 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/fuse/fuse.ko 2024-05-08T05:05:15.630 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/gfs2 2024-05-08T05:05:15.630 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/gfs2/gfs2.ko 2024-05-08T05:05:15.630 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/hfs 2024-05-08T05:05:15.630 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/hfs/hfs.ko 2024-05-08T05:05:15.630 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/hfsplus 2024-05-08T05:05:15.630 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/hfsplus/hfsplus.ko 2024-05-08T05:05:15.630 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/isofs 2024-05-08T05:05:15.630 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/isofs/isofs.ko 2024-05-08T05:05:15.630 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/jfs 2024-05-08T05:05:15.630 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/jfs/jfs.ko 2024-05-08T05:05:15.630 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/lockd 2024-05-08T05:05:15.631 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/lockd/lockd.ko 2024-05-08T05:05:15.631 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/minix 2024-05-08T05:05:15.631 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/minix/minix.ko 2024-05-08T05:05:15.631 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/netfs 2024-05-08T05:05:15.631 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/netfs/netfs.ko 2024-05-08T05:05:15.631 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs 2024-05-08T05:05:15.631 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/blocklayout 2024-05-08T05:05:15.631 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2024-05-08T05:05:15.631 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/filelayout 2024-05-08T05:05:15.631 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2024-05-08T05:05:15.631 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/flexfilelayout 2024-05-08T05:05:15.631 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2024-05-08T05:05:15.631 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/nfs.ko 2024-05-08T05:05:15.631 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/nfsv3.ko 2024-05-08T05:05:15.632 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/nfsv4.ko 2024-05-08T05:05:15.632 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs_common 2024-05-08T05:05:15.632 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs_common/grace.ko 2024-05-08T05:05:15.632 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs_common/nfs_acl.ko 2024-05-08T05:05:15.632 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfsd 2024-05-08T05:05:15.632 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfsd/nfsd.ko 2024-05-08T05:05:15.632 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nilfs2 2024-05-08T05:05:15.632 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nilfs2/nilfs2.ko 2024-05-08T05:05:15.632 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls 2024-05-08T05:05:15.632 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-celtic.ko 2024-05-08T05:05:15.632 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-centeuro.ko 2024-05-08T05:05:15.632 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-croatian.ko 2024-05-08T05:05:15.632 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-cyrillic.ko 2024-05-08T05:05:15.632 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-gaelic.ko 2024-05-08T05:05:15.632 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-greek.ko 2024-05-08T05:05:15.633 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-iceland.ko 2024-05-08T05:05:15.633 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-inuit.ko 2024-05-08T05:05:15.633 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-roman.ko 2024-05-08T05:05:15.633 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-romanian.ko 2024-05-08T05:05:15.633 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-turkish.ko 2024-05-08T05:05:15.633 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp1250.ko 2024-05-08T05:05:15.633 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp1251.ko 2024-05-08T05:05:15.633 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp1255.ko 2024-05-08T05:05:15.633 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp737.ko 2024-05-08T05:05:15.633 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp775.ko 2024-05-08T05:05:15.633 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp850.ko 2024-05-08T05:05:15.633 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp852.ko 2024-05-08T05:05:15.633 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp855.ko 2024-05-08T05:05:15.633 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp857.ko 2024-05-08T05:05:15.633 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp860.ko 2024-05-08T05:05:15.634 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp861.ko 2024-05-08T05:05:15.634 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp862.ko 2024-05-08T05:05:15.634 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp863.ko 2024-05-08T05:05:15.634 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp864.ko 2024-05-08T05:05:15.634 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp865.ko 2024-05-08T05:05:15.634 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp866.ko 2024-05-08T05:05:15.634 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp869.ko 2024-05-08T05:05:15.634 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp874.ko 2024-05-08T05:05:15.634 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp932.ko 2024-05-08T05:05:15.634 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp936.ko 2024-05-08T05:05:15.634 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp949.ko 2024-05-08T05:05:15.634 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp950.ko 2024-05-08T05:05:15.635 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_euc-jp.ko 2024-05-08T05:05:15.635 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-1.ko 2024-05-08T05:05:15.635 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-13.ko 2024-05-08T05:05:15.635 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-14.ko 2024-05-08T05:05:15.635 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-15.ko 2024-05-08T05:05:15.635 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-2.ko 2024-05-08T05:05:15.635 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-3.ko 2024-05-08T05:05:15.635 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-4.ko 2024-05-08T05:05:15.635 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-5.ko 2024-05-08T05:05:15.635 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-6.ko 2024-05-08T05:05:15.635 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-7.ko 2024-05-08T05:05:15.635 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-9.ko 2024-05-08T05:05:15.635 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_koi8-r.ko 2024-05-08T05:05:15.635 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_koi8-ru.ko 2024-05-08T05:05:15.635 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_koi8-u.ko 2024-05-08T05:05:15.636 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_ucs2_utils.ko 2024-05-08T05:05:15.636 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_utf8.ko 2024-05-08T05:05:15.636 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2 2024-05-08T05:05:15.636 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/cluster 2024-05-08T05:05:15.636 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2024-05-08T05:05:15.636 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/dlm 2024-05-08T05:05:15.636 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2024-05-08T05:05:15.636 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/dlmfs 2024-05-08T05:05:15.636 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2024-05-08T05:05:15.636 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/ocfs2.ko 2024-05-08T05:05:15.636 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2024-05-08T05:05:15.636 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/ocfs2_stack_user.ko 2024-05-08T05:05:15.636 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/ocfs2_stackglue.ko 2024-05-08T05:05:15.636 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/overlayfs 2024-05-08T05:05:15.636 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/overlayfs/overlay.ko 2024-05-08T05:05:15.637 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/pstore 2024-05-08T05:05:15.637 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/pstore/ramoops.ko 2024-05-08T05:05:15.637 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/reiserfs 2024-05-08T05:05:15.637 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/reiserfs/reiserfs.ko 2024-05-08T05:05:15.637 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/romfs 2024-05-08T05:05:15.637 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/romfs/romfs.ko 2024-05-08T05:05:15.637 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/smb 2024-05-08T05:05:15.637 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/smb/client 2024-05-08T05:05:15.637 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/smb/client/cifs.ko 2024-05-08T05:05:15.637 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/smb/common 2024-05-08T05:05:15.637 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/smb/common/cifs_arc4.ko 2024-05-08T05:05:15.637 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/smb/common/cifs_md4.ko 2024-05-08T05:05:15.637 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/squashfs 2024-05-08T05:05:15.637 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/squashfs/squashfs.ko 2024-05-08T05:05:15.637 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/sysv 2024-05-08T05:05:15.638 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/sysv/sysv.ko 2024-05-08T05:05:15.638 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/udf 2024-05-08T05:05:15.638 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/udf/udf.ko 2024-05-08T05:05:15.638 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ufs 2024-05-08T05:05:15.638 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ufs/ufs.ko 2024-05-08T05:05:15.638 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/xfs 2024-05-08T05:05:15.638 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/xfs/xfs.ko 2024-05-08T05:05:15.638 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/kernel 2024-05-08T05:05:15.638 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/kernel/rcu 2024-05-08T05:05:15.638 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/kernel/rcu/rcutorture.ko 2024-05-08T05:05:15.638 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/kernel/torture.ko 2024-05-08T05:05:15.638 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/kernel/trace 2024-05-08T05:05:15.638 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/kernel/trace/ring_buffer_benchmark.ko 2024-05-08T05:05:15.638 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib 2024-05-08T05:05:15.638 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/asn1_encoder.ko 2024-05-08T05:05:15.639 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/crc-itu-t.ko 2024-05-08T05:05:15.639 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/crc8.ko 2024-05-08T05:05:15.639 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/crypto 2024-05-08T05:05:15.639 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/crypto/libarc4.ko 2024-05-08T05:05:15.639 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/crypto/libdes.ko 2024-05-08T05:05:15.639 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/libcrc32c.ko 2024-05-08T05:05:15.639 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/lru_cache.ko 2024-05-08T05:05:15.639 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/lz4 2024-05-08T05:05:15.639 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/lz4/lz4_compress.ko 2024-05-08T05:05:15.639 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/lz4/lz4hc_compress.ko 2024-05-08T05:05:15.639 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/math 2024-05-08T05:05:15.639 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/math/cordic.ko 2024-05-08T05:05:15.639 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/raid6 2024-05-08T05:05:15.639 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/raid6/raid6_pq.ko 2024-05-08T05:05:15.640 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/reed_solomon 2024-05-08T05:05:15.640 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/reed_solomon/reed_solomon.ko 2024-05-08T05:05:15.640 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/ts_bm.ko 2024-05-08T05:05:15.640 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/ts_fsm.ko 2024-05-08T05:05:15.640 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/ts_kmp.ko 2024-05-08T05:05:15.640 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/zstd 2024-05-08T05:05:15.640 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/zstd/zstd_compress.ko 2024-05-08T05:05:15.640 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/mm 2024-05-08T05:05:15.640 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/mm/hwpoison-inject.ko 2024-05-08T05:05:15.640 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net 2024-05-08T05:05:15.640 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan 2024-05-08T05:05:15.640 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/6lowpan.ko 2024-05-08T05:05:15.640 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/nhc_dest.ko 2024-05-08T05:05:15.640 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/nhc_fragment.ko 2024-05-08T05:05:15.640 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/nhc_hop.ko 2024-05-08T05:05:15.641 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/nhc_ipv6.ko 2024-05-08T05:05:15.641 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/nhc_mobility.ko 2024-05-08T05:05:15.641 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/nhc_routing.ko 2024-05-08T05:05:15.641 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/nhc_udp.ko 2024-05-08T05:05:15.641 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/802 2024-05-08T05:05:15.641 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/802/garp.ko 2024-05-08T05:05:15.641 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/802/mrp.ko 2024-05-08T05:05:15.641 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/802/p8022.ko 2024-05-08T05:05:15.641 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/802/psnap.ko 2024-05-08T05:05:15.641 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/802/stp.ko 2024-05-08T05:05:15.641 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/8021q 2024-05-08T05:05:15.641 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/8021q/8021q.ko 2024-05-08T05:05:15.641 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/9p 2024-05-08T05:05:15.641 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/9p/9pnet.ko 2024-05-08T05:05:15.641 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/9p/9pnet_fd.ko 2024-05-08T05:05:15.642 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/9p/9pnet_rdma.ko 2024-05-08T05:05:15.642 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/9p/9pnet_virtio.ko 2024-05-08T05:05:15.642 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/batman-adv 2024-05-08T05:05:15.642 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/batman-adv/batman-adv.ko 2024-05-08T05:05:15.642 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge 2024-05-08T05:05:15.642 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/br_netfilter.ko 2024-05-08T05:05:15.642 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/bridge.ko 2024-05-08T05:05:15.642 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter 2024-05-08T05:05:15.642 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_802_3.ko 2024-05-08T05:05:15.642 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_among.ko 2024-05-08T05:05:15.642 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_arp.ko 2024-05-08T05:05:15.642 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_arpreply.ko 2024-05-08T05:05:15.642 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_dnat.ko 2024-05-08T05:05:15.642 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_ip.ko 2024-05-08T05:05:15.643 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_ip6.ko 2024-05-08T05:05:15.643 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_limit.ko 2024-05-08T05:05:15.643 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_log.ko 2024-05-08T05:05:15.643 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_mark.ko 2024-05-08T05:05:15.643 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_mark_m.ko 2024-05-08T05:05:15.643 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_nflog.ko 2024-05-08T05:05:15.643 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_pkttype.ko 2024-05-08T05:05:15.643 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_redirect.ko 2024-05-08T05:05:15.643 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_snat.ko 2024-05-08T05:05:15.643 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_stp.ko 2024-05-08T05:05:15.643 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_vlan.ko 2024-05-08T05:05:15.643 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebtable_broute.ko 2024-05-08T05:05:15.643 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebtable_filter.ko 2024-05-08T05:05:15.644 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebtable_nat.ko 2024-05-08T05:05:15.644 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebtables.ko 2024-05-08T05:05:15.644 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/nf_conntrack_bridge.ko 2024-05-08T05:05:15.644 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2024-05-08T05:05:15.644 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2024-05-08T05:05:15.644 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ceph 2024-05-08T05:05:15.644 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ceph/libceph.ko 2024-05-08T05:05:15.644 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/core 2024-05-08T05:05:15.644 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/core/failover.ko 2024-05-08T05:05:15.644 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/core/pktgen.ko 2024-05-08T05:05:15.644 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dccp 2024-05-08T05:05:15.644 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dccp/dccp.ko 2024-05-08T05:05:15.644 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dccp/dccp_diag.ko 2024-05-08T05:05:15.644 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dccp/dccp_ipv4.ko 2024-05-08T05:05:15.644 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dccp/dccp_ipv6.ko 2024-05-08T05:05:15.645 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dns_resolver 2024-05-08T05:05:15.645 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dns_resolver/dns_resolver.ko 2024-05-08T05:05:15.645 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dsa 2024-05-08T05:05:15.645 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dsa/dsa_core.ko 2024-05-08T05:05:15.645 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dsa/tag_brcm.ko 2024-05-08T05:05:15.645 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dsa/tag_dsa.ko 2024-05-08T05:05:15.645 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dsa/tag_none.ko 2024-05-08T05:05:15.645 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dsa/tag_trailer.ko 2024-05-08T05:05:15.645 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ieee802154 2024-05-08T05:05:15.645 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ieee802154/6lowpan 2024-05-08T05:05:15.645 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2024-05-08T05:05:15.645 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ieee802154/ieee802154.ko 2024-05-08T05:05:15.645 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ieee802154/ieee802154_socket.ko 2024-05-08T05:05:15.645 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4 2024-05-08T05:05:15.645 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/ah4.ko 2024-05-08T05:05:15.646 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/esp4.ko 2024-05-08T05:05:15.646 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/fou.ko 2024-05-08T05:05:15.646 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/gre.ko 2024-05-08T05:05:15.646 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/inet_diag.ko 2024-05-08T05:05:15.646 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/ip_gre.ko 2024-05-08T05:05:15.646 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/ip_tunnel.ko 2024-05-08T05:05:15.646 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/ip_vti.ko 2024-05-08T05:05:15.646 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/ipcomp.ko 2024-05-08T05:05:15.646 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/ipip.ko 2024-05-08T05:05:15.646 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter 2024-05-08T05:05:15.646 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/arp_tables.ko 2024-05-08T05:05:15.646 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/arpt_mangle.ko 2024-05-08T05:05:15.646 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/arptable_filter.ko 2024-05-08T05:05:15.646 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/ipt_ECN.ko 2024-05-08T05:05:15.646 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2024-05-08T05:05:15.647 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/ipt_ah.ko 2024-05-08T05:05:15.647 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2024-05-08T05:05:15.647 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/iptable_mangle.ko 2024-05-08T05:05:15.647 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/iptable_nat.ko 2024-05-08T05:05:15.647 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/iptable_raw.ko 2024-05-08T05:05:15.647 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/iptable_security.ko 2024-05-08T05:05:15.647 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2024-05-08T05:05:15.647 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2024-05-08T05:05:15.647 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2024-05-08T05:05:15.647 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2024-05-08T05:05:15.647 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2024-05-08T05:05:15.647 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2024-05-08T05:05:15.647 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2024-05-08T05:05:15.647 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2024-05-08T05:05:15.648 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2024-05-08T05:05:15.648 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2024-05-08T05:05:15.648 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_bic.ko 2024-05-08T05:05:15.648 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_dctcp.ko 2024-05-08T05:05:15.648 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_diag.ko 2024-05-08T05:05:15.648 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_highspeed.ko 2024-05-08T05:05:15.648 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_htcp.ko 2024-05-08T05:05:15.648 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_hybla.ko 2024-05-08T05:05:15.648 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_illinois.ko 2024-05-08T05:05:15.648 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_lp.ko 2024-05-08T05:05:15.648 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_scalable.ko 2024-05-08T05:05:15.648 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_vegas.ko 2024-05-08T05:05:15.648 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_veno.ko 2024-05-08T05:05:15.648 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_westwood.ko 2024-05-08T05:05:15.648 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_yeah.ko 2024-05-08T05:05:15.649 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tunnel4.ko 2024-05-08T05:05:15.649 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/udp_diag.ko 2024-05-08T05:05:15.649 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/udp_tunnel.ko 2024-05-08T05:05:15.649 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/xfrm4_tunnel.ko 2024-05-08T05:05:15.649 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6 2024-05-08T05:05:15.649 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/ah6.ko 2024-05-08T05:05:15.649 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/esp6.ko 2024-05-08T05:05:15.649 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/fou6.ko 2024-05-08T05:05:15.649 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/ip6_tunnel.ko 2024-05-08T05:05:15.649 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/ip6_udp_tunnel.ko 2024-05-08T05:05:15.649 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/ip6_vti.ko 2024-05-08T05:05:15.649 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/ipcomp6.ko 2024-05-08T05:05:15.649 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter 2024-05-08T05:05:15.649 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6_tables.ko 2024-05-08T05:05:15.649 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2024-05-08T05:05:15.650 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2024-05-08T05:05:15.650 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_ah.ko 2024-05-08T05:05:15.650 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2024-05-08T05:05:15.650 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_frag.ko 2024-05-08T05:05:15.650 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2024-05-08T05:05:15.650 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2024-05-08T05:05:15.650 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_mh.ko 2024-05-08T05:05:15.650 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2024-05-08T05:05:15.650 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_rt.ko 2024-05-08T05:05:15.650 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6table_filter.ko 2024-05-08T05:05:15.650 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2024-05-08T05:05:15.650 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6table_nat.ko 2024-05-08T05:05:15.650 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6table_raw.ko 2024-05-08T05:05:15.650 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6table_security.ko 2024-05-08T05:05:15.651 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2024-05-08T05:05:15.651 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2024-05-08T05:05:15.651 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2024-05-08T05:05:15.651 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2024-05-08T05:05:15.651 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2024-05-08T05:05:15.651 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2024-05-08T05:05:15.651 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2024-05-08T05:05:15.651 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2024-05-08T05:05:15.651 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/sit.ko 2024-05-08T05:05:15.651 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/tunnel6.ko 2024-05-08T05:05:15.651 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/xfrm6_tunnel.ko 2024-05-08T05:05:15.651 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/key 2024-05-08T05:05:15.652 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/key/af_key.ko 2024-05-08T05:05:15.652 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp 2024-05-08T05:05:15.652 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/l2tp_core.ko 2024-05-08T05:05:15.652 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/l2tp_debugfs.ko 2024-05-08T05:05:15.652 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/l2tp_eth.ko 2024-05-08T05:05:15.652 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/l2tp_ip.ko 2024-05-08T05:05:15.652 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/l2tp_ip6.ko 2024-05-08T05:05:15.652 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/l2tp_netlink.ko 2024-05-08T05:05:15.653 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/l2tp_ppp.ko 2024-05-08T05:05:15.653 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/llc 2024-05-08T05:05:15.653 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/llc/llc.ko 2024-05-08T05:05:15.653 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/mac802154 2024-05-08T05:05:15.653 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/mac802154/mac802154.ko 2024-05-08T05:05:15.653 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/mpls 2024-05-08T05:05:15.653 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/mpls/mpls_gso.ko 2024-05-08T05:05:15.653 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter 2024-05-08T05:05:15.653 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset 2024-05-08T05:05:15.653 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set.ko 2024-05-08T05:05:15.653 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2024-05-08T05:05:15.653 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2024-05-08T05:05:15.653 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2024-05-08T05:05:15.653 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2024-05-08T05:05:15.654 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2024-05-08T05:05:15.654 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2024-05-08T05:05:15.654 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2024-05-08T05:05:15.654 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2024-05-08T05:05:15.654 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2024-05-08T05:05:15.654 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2024-05-08T05:05:15.654 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2024-05-08T05:05:15.654 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2024-05-08T05:05:15.654 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2024-05-08T05:05:15.654 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2024-05-08T05:05:15.654 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_list_set.ko 2024-05-08T05:05:15.654 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs 2024-05-08T05:05:15.654 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs.ko 2024-05-08T05:05:15.654 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2024-05-08T05:05:15.655 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2024-05-08T05:05:15.655 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2024-05-08T05:05:15.655 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2024-05-08T05:05:15.655 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2024-05-08T05:05:15.655 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2024-05-08T05:05:15.655 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2024-05-08T05:05:15.655 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2024-05-08T05:05:15.655 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2024-05-08T05:05:15.655 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2024-05-08T05:05:15.655 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2024-05-08T05:05:15.655 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2024-05-08T05:05:15.655 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2024-05-08T05:05:15.655 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conncount.ko 2024-05-08T05:05:15.655 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack.ko 2024-05-08T05:05:15.655 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_amanda.ko 2024-05-08T05:05:15.656 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_broadcast.ko 2024-05-08T05:05:15.656 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_ftp.ko 2024-05-08T05:05:15.656 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_h323.ko 2024-05-08T05:05:15.656 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_irc.ko 2024-05-08T05:05:15.656 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2024-05-08T05:05:15.656 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_netlink.ko 2024-05-08T05:05:15.656 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_pptp.ko 2024-05-08T05:05:15.656 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_sane.ko 2024-05-08T05:05:15.656 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_sip.ko 2024-05-08T05:05:15.656 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_snmp.ko 2024-05-08T05:05:15.656 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_tftp.ko 2024-05-08T05:05:15.656 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_dup_netdev.ko 2024-05-08T05:05:15.656 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_flow_table.ko 2024-05-08T05:05:15.656 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_flow_table_inet.ko 2024-05-08T05:05:15.657 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_log_syslog.ko 2024-05-08T05:05:15.657 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_nat.ko 2024-05-08T05:05:15.657 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_nat_amanda.ko 2024-05-08T05:05:15.657 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_nat_ftp.ko 2024-05-08T05:05:15.657 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_nat_irc.ko 2024-05-08T05:05:15.657 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_nat_sip.ko 2024-05-08T05:05:15.657 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_nat_tftp.ko 2024-05-08T05:05:15.657 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_synproxy_core.ko 2024-05-08T05:05:15.657 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_tables.ko 2024-05-08T05:05:15.657 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nfnetlink.ko 2024-05-08T05:05:15.657 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nfnetlink_acct.ko 2024-05-08T05:05:15.657 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nfnetlink_log.ko 2024-05-08T05:05:15.657 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nfnetlink_osf.ko 2024-05-08T05:05:15.657 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nfnetlink_queue.ko 2024-05-08T05:05:15.657 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_chain_nat.ko 2024-05-08T05:05:15.658 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_compat.ko 2024-05-08T05:05:15.658 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_ct.ko 2024-05-08T05:05:15.658 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_dup_netdev.ko 2024-05-08T05:05:15.658 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_fib.ko 2024-05-08T05:05:15.658 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_fwd_netdev.ko 2024-05-08T05:05:15.658 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_hash.ko 2024-05-08T05:05:15.658 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_limit.ko 2024-05-08T05:05:15.658 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_log.ko 2024-05-08T05:05:15.658 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_masq.ko 2024-05-08T05:05:15.658 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_nat.ko 2024-05-08T05:05:15.658 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_numgen.ko 2024-05-08T05:05:15.658 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_queue.ko 2024-05-08T05:05:15.658 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_quota.ko 2024-05-08T05:05:15.659 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_redir.ko 2024-05-08T05:05:15.659 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_reject.ko 2024-05-08T05:05:15.659 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_reject_inet.ko 2024-05-08T05:05:15.659 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_socket.ko 2024-05-08T05:05:15.659 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_tunnel.ko 2024-05-08T05:05:15.659 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_AUDIT.ko 2024-05-08T05:05:15.659 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_CHECKSUM.ko 2024-05-08T05:05:15.659 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_CLASSIFY.ko 2024-05-08T05:05:15.659 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_CONNSECMARK.ko 2024-05-08T05:05:15.659 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_CT.ko 2024-05-08T05:05:15.659 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_DSCP.ko 2024-05-08T05:05:15.659 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_HL.ko 2024-05-08T05:05:15.659 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_HMARK.ko 2024-05-08T05:05:15.659 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_IDLETIMER.ko 2024-05-08T05:05:15.659 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_LED.ko 2024-05-08T05:05:15.660 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_LOG.ko 2024-05-08T05:05:15.660 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_MASQUERADE.ko 2024-05-08T05:05:15.660 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_NETMAP.ko 2024-05-08T05:05:15.660 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_NFLOG.ko 2024-05-08T05:05:15.660 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_NFQUEUE.ko 2024-05-08T05:05:15.660 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_RATEEST.ko 2024-05-08T05:05:15.660 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_REDIRECT.ko 2024-05-08T05:05:15.660 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_SECMARK.ko 2024-05-08T05:05:15.660 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_TCPMSS.ko 2024-05-08T05:05:15.660 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2024-05-08T05:05:15.660 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_TEE.ko 2024-05-08T05:05:15.660 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_TPROXY.ko 2024-05-08T05:05:15.660 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_TRACE.ko 2024-05-08T05:05:15.660 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_addrtype.ko 2024-05-08T05:05:15.660 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_bpf.ko 2024-05-08T05:05:15.661 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_cgroup.ko 2024-05-08T05:05:15.661 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_cluster.ko 2024-05-08T05:05:15.661 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_comment.ko 2024-05-08T05:05:15.661 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_connbytes.ko 2024-05-08T05:05:15.661 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_connlabel.ko 2024-05-08T05:05:15.661 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_connlimit.ko 2024-05-08T05:05:15.661 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_connmark.ko 2024-05-08T05:05:15.661 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_conntrack.ko 2024-05-08T05:05:15.661 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_cpu.ko 2024-05-08T05:05:15.661 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_dccp.ko 2024-05-08T05:05:15.661 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_devgroup.ko 2024-05-08T05:05:15.661 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_dscp.ko 2024-05-08T05:05:15.661 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_ecn.ko 2024-05-08T05:05:15.661 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_esp.ko 2024-05-08T05:05:15.661 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_hashlimit.ko 2024-05-08T05:05:15.662 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_helper.ko 2024-05-08T05:05:15.662 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_hl.ko 2024-05-08T05:05:15.662 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_ipcomp.ko 2024-05-08T05:05:15.662 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_iprange.ko 2024-05-08T05:05:15.662 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_ipvs.ko 2024-05-08T05:05:15.662 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_l2tp.ko 2024-05-08T05:05:15.662 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_length.ko 2024-05-08T05:05:15.662 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_limit.ko 2024-05-08T05:05:15.662 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_mac.ko 2024-05-08T05:05:15.662 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_mark.ko 2024-05-08T05:05:15.663 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_multiport.ko 2024-05-08T05:05:15.663 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_nat.ko 2024-05-08T05:05:15.663 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_nfacct.ko 2024-05-08T05:05:15.663 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_osf.ko 2024-05-08T05:05:15.663 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_owner.ko 2024-05-08T05:05:15.663 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_physdev.ko 2024-05-08T05:05:15.663 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_pkttype.ko 2024-05-08T05:05:15.663 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_policy.ko 2024-05-08T05:05:15.663 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_quota.ko 2024-05-08T05:05:15.663 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_rateest.ko 2024-05-08T05:05:15.663 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_realm.ko 2024-05-08T05:05:15.663 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_recent.ko 2024-05-08T05:05:15.663 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_sctp.ko 2024-05-08T05:05:15.663 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_set.ko 2024-05-08T05:05:15.663 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_socket.ko 2024-05-08T05:05:15.664 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_state.ko 2024-05-08T05:05:15.664 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_statistic.ko 2024-05-08T05:05:15.664 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_string.ko 2024-05-08T05:05:15.664 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_tcpmss.ko 2024-05-08T05:05:15.664 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_time.ko 2024-05-08T05:05:15.664 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_u32.ko 2024-05-08T05:05:15.664 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netlink 2024-05-08T05:05:15.664 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netlink/netlink_diag.ko 2024-05-08T05:05:15.664 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/nsh 2024-05-08T05:05:15.664 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/nsh/nsh.ko 2024-05-08T05:05:15.664 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/openvswitch 2024-05-08T05:05:15.664 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/openvswitch/openvswitch.ko 2024-05-08T05:05:15.664 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/openvswitch/vport-geneve.ko 2024-05-08T05:05:15.664 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/openvswitch/vport-gre.ko 2024-05-08T05:05:15.664 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/openvswitch/vport-vxlan.ko 2024-05-08T05:05:15.665 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/packet 2024-05-08T05:05:15.665 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/packet/af_packet_diag.ko 2024-05-08T05:05:15.665 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/rds 2024-05-08T05:05:15.665 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/rds/rds.ko 2024-05-08T05:05:15.665 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/rds/rds_rdma.ko 2024-05-08T05:05:15.665 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/rds/rds_tcp.ko 2024-05-08T05:05:15.665 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched 2024-05-08T05:05:15.665 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_csum.ko 2024-05-08T05:05:15.665 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_gact.ko 2024-05-08T05:05:15.665 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_mirred.ko 2024-05-08T05:05:15.665 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_nat.ko 2024-05-08T05:05:15.665 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_pedit.ko 2024-05-08T05:05:15.665 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_police.ko 2024-05-08T05:05:15.665 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_simple.ko 2024-05-08T05:05:15.665 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_skbedit.ko 2024-05-08T05:05:15.666 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_vlan.ko 2024-05-08T05:05:15.666 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/cls_basic.ko 2024-05-08T05:05:15.666 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/cls_bpf.ko 2024-05-08T05:05:15.666 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/cls_flow.ko 2024-05-08T05:05:15.666 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/cls_fw.ko 2024-05-08T05:05:15.666 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/cls_route.ko 2024-05-08T05:05:15.666 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/cls_u32.ko 2024-05-08T05:05:15.666 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/em_cmp.ko 2024-05-08T05:05:15.666 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/em_ipset.ko 2024-05-08T05:05:15.666 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/em_meta.ko 2024-05-08T05:05:15.666 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/em_nbyte.ko 2024-05-08T05:05:15.666 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/em_text.ko 2024-05-08T05:05:15.666 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/em_u32.ko 2024-05-08T05:05:15.666 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_choke.ko 2024-05-08T05:05:15.667 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_codel.ko 2024-05-08T05:05:15.667 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_drr.ko 2024-05-08T05:05:15.667 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_fq.ko 2024-05-08T05:05:15.667 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_gred.ko 2024-05-08T05:05:15.667 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_hfsc.ko 2024-05-08T05:05:15.667 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_hhf.ko 2024-05-08T05:05:15.667 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_htb.ko 2024-05-08T05:05:15.667 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_ingress.ko 2024-05-08T05:05:15.667 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_mqprio.ko 2024-05-08T05:05:15.667 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_mqprio_lib.ko 2024-05-08T05:05:15.667 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_multiq.ko 2024-05-08T05:05:15.667 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_netem.ko 2024-05-08T05:05:15.667 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_pie.ko 2024-05-08T05:05:15.667 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_plug.ko 2024-05-08T05:05:15.668 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_prio.ko 2024-05-08T05:05:15.668 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_qfq.ko 2024-05-08T05:05:15.668 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_red.ko 2024-05-08T05:05:15.668 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_sfb.ko 2024-05-08T05:05:15.668 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_sfq.ko 2024-05-08T05:05:15.668 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_tbf.ko 2024-05-08T05:05:15.668 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_teql.ko 2024-05-08T05:05:15.668 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sctp 2024-05-08T05:05:15.668 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sctp/sctp.ko 2024-05-08T05:05:15.668 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sctp/sctp_diag.ko 2024-05-08T05:05:15.668 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sunrpc 2024-05-08T05:05:15.668 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sunrpc/auth_gss 2024-05-08T05:05:15.668 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2024-05-08T05:05:15.668 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2024-05-08T05:05:15.669 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sunrpc/sunrpc.ko 2024-05-08T05:05:15.669 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sunrpc/xprtrdma 2024-05-08T05:05:15.669 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2024-05-08T05:05:15.669 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/tipc 2024-05-08T05:05:15.669 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/tipc/tipc.ko 2024-05-08T05:05:15.669 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/tipc/tipc_diag.ko 2024-05-08T05:05:15.669 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/unix 2024-05-08T05:05:15.669 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/unix/unix_diag.ko 2024-05-08T05:05:15.669 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/vmw_vsock 2024-05-08T05:05:15.669 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2024-05-08T05:05:15.669 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2024-05-08T05:05:15.669 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/vmw_vsock/vsock.ko 2024-05-08T05:05:15.669 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/vmw_vsock/vsock_diag.ko 2024-05-08T05:05:15.669 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/vmw_vsock/vsock_loopback.ko 2024-05-08T05:05:15.670 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/xfrm 2024-05-08T05:05:15.670 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/xfrm/xfrm_ipcomp.ko 2024-05-08T05:05:15.670 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/security 2024-05-08T05:05:15.670 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/security/keys 2024-05-08T05:05:15.670 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/security/keys/encrypted-keys 2024-05-08T05:05:15.670 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/security/keys/encrypted-keys/encrypted-keys.ko 2024-05-08T05:05:15.670 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/security/keys/trusted-keys 2024-05-08T05:05:15.670 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/security/keys/trusted-keys/trusted.ko 2024-05-08T05:05:15.670 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.alias 2024-05-08T05:05:15.670 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.alias.bin 2024-05-08T05:05:15.670 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.builtin 2024-05-08T05:05:15.670 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.builtin.alias.bin 2024-05-08T05:05:15.670 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.builtin.bin 2024-05-08T05:05:15.670 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.builtin.modinfo 2024-05-08T05:05:15.670 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.dep 2024-05-08T05:05:15.671 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.dep.bin 2024-05-08T05:05:15.671 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.devname 2024-05-08T05:05:15.671 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.order 2024-05-08T05:05:15.671 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.softdep 2024-05-08T05:05:15.671 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.symbols 2024-05-08T05:05:15.671 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.symbols.bin 2024-05-08T05:05:15.671 INFO:teuthology.orchestra.run.smithi087.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/vmlinuz 2024-05-08T05:05:15.675 DEBUG:teuthology.task.kernel:get_image_version: 6.9.0-rc3-g806ec36b2112 2024-05-08T05:05:15.675 DEBUG:teuthology.orchestra.run.smithi087:> rpm --scripts -qp /tmp/kernel.x86_64.rpm 2024-05-08T05:05:15.698 INFO:teuthology.orchestra.run.smithi087.stdout:postinstall scriptlet (using /bin/sh): 2024-05-08T05:05:15.698 INFO:teuthology.orchestra.run.smithi087.stdout:if [ -x /usr/bin/kernel-install ]; then 2024-05-08T05:05:15.699 INFO:teuthology.orchestra.run.smithi087.stdout: /usr/bin/kernel-install add 6.9.0-rc3-g806ec36b2112 /lib/modules/6.9.0-rc3-g806ec36b2112/vmlinuz 2024-05-08T05:05:15.699 INFO:teuthology.orchestra.run.smithi087.stdout:fi 2024-05-08T05:05:15.699 INFO:teuthology.orchestra.run.smithi087.stdout:for file in vmlinuz System.map config; do 2024-05-08T05:05:15.699 INFO:teuthology.orchestra.run.smithi087.stdout: if ! cmp --silent "/lib/modules/6.9.0-rc3-g806ec36b2112/${file}" "/boot/${file}-6.9.0-rc3-g806ec36b2112"; then 2024-05-08T05:05:15.699 INFO:teuthology.orchestra.run.smithi087.stdout: cp "/lib/modules/6.9.0-rc3-g806ec36b2112/${file}" "/boot/${file}-6.9.0-rc3-g806ec36b2112" 2024-05-08T05:05:15.699 INFO:teuthology.orchestra.run.smithi087.stdout: fi 2024-05-08T05:05:15.699 INFO:teuthology.orchestra.run.smithi087.stdout:done 2024-05-08T05:05:15.699 INFO:teuthology.orchestra.run.smithi087.stdout:if [ -d "/lib/modules/6.9.0-rc3-g806ec36b2112/dtb" ] && \ 2024-05-08T05:05:15.700 INFO:teuthology.orchestra.run.smithi087.stdout: ! diff -rq "/lib/modules/6.9.0-rc3-g806ec36b2112/dtb" "/boot/dtb-6.9.0-rc3-g806ec36b2112" >/dev/null 2>&1; then 2024-05-08T05:05:15.700 INFO:teuthology.orchestra.run.smithi087.stdout: rm -rf "/boot/dtb-6.9.0-rc3-g806ec36b2112" 2024-05-08T05:05:15.700 INFO:teuthology.orchestra.run.smithi087.stdout: cp -r "/lib/modules/6.9.0-rc3-g806ec36b2112/dtb" "/boot/dtb-6.9.0-rc3-g806ec36b2112" 2024-05-08T05:05:15.700 INFO:teuthology.orchestra.run.smithi087.stdout:fi 2024-05-08T05:05:15.700 INFO:teuthology.orchestra.run.smithi087.stdout:if [ ! -e "/lib/modules/6.9.0-rc3-g806ec36b2112/modules.dep" ]; then 2024-05-08T05:05:15.700 INFO:teuthology.orchestra.run.smithi087.stdout: /usr/sbin/depmod 6.9.0-rc3-g806ec36b2112 2024-05-08T05:05:15.701 INFO:teuthology.orchestra.run.smithi087.stdout:fi 2024-05-08T05:05:15.701 INFO:teuthology.orchestra.run.smithi087.stdout:preuninstall scriptlet (using /bin/sh): 2024-05-08T05:05:15.701 INFO:teuthology.orchestra.run.smithi087.stdout:if [ -x /usr/bin/kernel-install ]; then 2024-05-08T05:05:15.701 INFO:teuthology.orchestra.run.smithi087.stdout:kernel-install remove 6.9.0-rc3-g806ec36b2112 2024-05-08T05:05:15.701 INFO:teuthology.orchestra.run.smithi087.stdout:fi 2024-05-08T05:05:15.703 DEBUG:teuthology.orchestra.run.smithi087:> sudo rpm -qi grub2-tools 2024-05-08T05:05:15.775 INFO:teuthology.orchestra.run.smithi087.stdout:Name : grub2-tools 2024-05-08T05:05:15.775 INFO:teuthology.orchestra.run.smithi087.stdout:Epoch : 1 2024-05-08T05:05:15.775 INFO:teuthology.orchestra.run.smithi087.stdout:Version : 2.06 2024-05-08T05:05:15.775 INFO:teuthology.orchestra.run.smithi087.stdout:Release : 68.el9 2024-05-08T05:05:15.775 INFO:teuthology.orchestra.run.smithi087.stdout:Architecture: x86_64 2024-05-08T05:05:15.775 INFO:teuthology.orchestra.run.smithi087.stdout:Install Date: Fri 19 Apr 2024 09:32:39 PM UTC 2024-05-08T05:05:15.775 INFO:teuthology.orchestra.run.smithi087.stdout:Group : Unspecified 2024-05-08T05:05:15.775 INFO:teuthology.orchestra.run.smithi087.stdout:Size : 8264254 2024-05-08T05:05:15.775 INFO:teuthology.orchestra.run.smithi087.stdout:License : GPLv3+ 2024-05-08T05:05:15.775 INFO:teuthology.orchestra.run.smithi087.stdout:Signature : RSA/SHA256, Mon 07 Aug 2023 01:57:16 PM UTC, Key ID 05b555b38483c65d 2024-05-08T05:05:15.775 INFO:teuthology.orchestra.run.smithi087.stdout:Source RPM : grub2-2.06-68.el9.src.rpm 2024-05-08T05:05:15.776 INFO:teuthology.orchestra.run.smithi087.stdout:Build Date : Wed 02 Aug 2023 03:15:48 PM UTC 2024-05-08T05:05:15.776 INFO:teuthology.orchestra.run.smithi087.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-05-08T05:05:15.776 INFO:teuthology.orchestra.run.smithi087.stdout:Packager : builder@centos.org 2024-05-08T05:05:15.776 INFO:teuthology.orchestra.run.smithi087.stdout:Vendor : CentOS 2024-05-08T05:05:15.776 INFO:teuthology.orchestra.run.smithi087.stdout:URL : http://www.gnu.org/software/grub/ 2024-05-08T05:05:15.776 INFO:teuthology.orchestra.run.smithi087.stdout:Summary : Support tools for GRUB. 2024-05-08T05:05:15.776 INFO:teuthology.orchestra.run.smithi087.stdout:Description : 2024-05-08T05:05:15.776 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-05-08T05:05:15.776 INFO:teuthology.orchestra.run.smithi087.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-05-08T05:05:15.776 INFO:teuthology.orchestra.run.smithi087.stdout:customizable bootloader with modular architecture. It supports a rich 2024-05-08T05:05:15.776 INFO:teuthology.orchestra.run.smithi087.stdout:variety of kernel formats, file systems, computer architectures and 2024-05-08T05:05:15.776 INFO:teuthology.orchestra.run.smithi087.stdout:hardware devices. 2024-05-08T05:05:15.776 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-05-08T05:05:15.777 INFO:teuthology.orchestra.run.smithi087.stdout:This subpackage provides tools for support of all platforms. 2024-05-08T05:05:15.778 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-05-08T05:05:15.778 INFO:teuthology.task.kernel:Updating grub on smithi087 to boot 6.9.0-rc3-g806ec36b2112 2024-05-08T05:05:15.778 DEBUG:teuthology.orchestra.run.smithi087:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-05-08T05:05:16.307 INFO:teuthology.orchestra.run.smithi087.stderr:Generating grub configuration file ... 2024-05-08T05:05:17.565 INFO:teuthology.orchestra.run.smithi087.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-05-08T05:05:17.603 INFO:teuthology.orchestra.run.smithi087.stderr:done 2024-05-08T05:05:17.605 DEBUG:teuthology.orchestra.run.smithi087:> mktemp 2024-05-08T05:05:17.632 INFO:teuthology.orchestra.run.smithi087.stdout:/tmp/tmp.YNBN0Z3FEr 2024-05-08T05:05:17.632 DEBUG:teuthology.orchestra.run.smithi087:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.YNBN0Z3FEr 2024-05-08T05:05:17.699 DEBUG:teuthology.orchestra.run.smithi087:> sudo chmod 0666 /tmp/tmp.YNBN0Z3FEr 2024-05-08T05:05:17.831 DEBUG:teuthology.orchestra.remote:smithi087:/tmp/tmp.YNBN0Z3FEr is 6KB 2024-05-08T05:05:17.880 DEBUG:teuthology.orchestra.run.smithi087:> rm -fr /tmp/tmp.YNBN0Z3FEr 2024-05-08T05:05:17.894 DEBUG:teuthology.orchestra.run.smithi087:> sudo /bin/ls /boot/loader/entries || true 2024-05-08T05:05:17.955 INFO:teuthology.orchestra.run.smithi087.stdout:7fc8828e06d0482694bcf4a447d13cb6-0-rescue.conf 2024-05-08T05:05:17.955 INFO:teuthology.orchestra.run.smithi087.stdout:7fc8828e06d0482694bcf4a447d13cb6-5.14.0-239.el9.x86_64.conf 2024-05-08T05:05:17.955 INFO:teuthology.orchestra.run.smithi087.stdout:7fc8828e06d0482694bcf4a447d13cb6-5.14.0-437.el9.x86_64.conf 2024-05-08T05:05:17.955 INFO:teuthology.orchestra.run.smithi087.stdout:7fc8828e06d0482694bcf4a447d13cb6-6.9.0-rc3-g806ec36b2112.conf 2024-05-08T05:05:17.956 DEBUG:teuthology.orchestra.run.smithi087:> sudo grub2-set-default 7fc8828e06d0482694bcf4a447d13cb6-6.9.0-rc3-g806ec36b2112 2024-05-08T05:05:18.087 DEBUG:teuthology.orchestra.run.smithi087:> sudo shutdown -r now 2024-05-08T05:05:48.090 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2024-05-08T05:05:48.091 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi087.front.sepia.ceph.com' 2024-05-08T05:05:48.092 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi087.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-08T05:06:06.498 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.87 2024-05-08T05:06:15.499 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi087.front.sepia.ceph.com' 2024-05-08T05:06:15.500 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi087.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-08T05:06:18.558 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.87 2024-05-08T05:06:30.559 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi087.front.sepia.ceph.com' 2024-05-08T05:06:30.560 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi087.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-08T05:06:48.994 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.87 2024-05-08T05:07:03.996 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi087.front.sepia.ceph.com' 2024-05-08T05:07:03.997 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi087.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-08T05:07:07.070 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.87 2024-05-08T05:07:25.072 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi087.front.sepia.ceph.com' 2024-05-08T05:07:25.072 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi087.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-08T05:07:25.452 DEBUG:teuthology.orchestra.run.smithi087:> true 2024-05-08T05:07:26.073 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi087.front.sepia.ceph.com' 2024-05-08T05:07:26.073 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.9.0-rc3-g806ec36b2112"... 2024-05-08T05:07:26.073 DEBUG:teuthology.orchestra.run.smithi087:> uname -r 2024-05-08T05:07:26.113 INFO:teuthology.orchestra.run.smithi087.stdout:6.9.0-rc3-g806ec36b2112 2024-05-08T05:07:26.113 DEBUG:teuthology.task.kernel:current kernel version is 6.9.0-rc3-g806ec36b2112 vs 6.9.0-rc3-g806ec36b2112 2024-05-08T05:07:26.114 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-05-08T05:07:26.114 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-05-08T05:07:27.115 DEBUG:teuthology.parallel:result is None 2024-05-08T05:07:27.115 INFO:teuthology.run_tasks:Running task internal.base... 2024-05-08T05:07:27.123 INFO:teuthology.task.internal:Creating test directory... 2024-05-08T05:07:27.123 DEBUG:teuthology.orchestra.run.smithi087:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-05-08T05:07:27.131 DEBUG:teuthology.orchestra.run.smithi090:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-05-08T05:07:27.133 DEBUG:teuthology.orchestra.run.smithi160:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-05-08T05:07:27.177 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-05-08T05:07:27.184 INFO:teuthology.run_tasks:Running task internal.archive... 2024-05-08T05:07:27.205 INFO:teuthology.task.internal:Creating archive directory... 2024-05-08T05:07:27.206 DEBUG:teuthology.orchestra.run.smithi087:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-05-08T05:07:27.210 DEBUG:teuthology.orchestra.run.smithi090:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-05-08T05:07:27.213 DEBUG:teuthology.orchestra.run.smithi160:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-05-08T05:07:27.316 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-05-08T05:07:27.325 INFO:teuthology.task.internal:Enabling coredump saving... 2024-05-08T05:07:27.325 DEBUG:teuthology.orchestra.run.smithi090:> test -f /run/.containerenv -o -f /.dockerenv 2024-05-08T05:07:27.342 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-08T05:07:27.342 DEBUG:teuthology.orchestra.run.smithi160:> test -f /run/.containerenv -o -f /.dockerenv 2024-05-08T05:07:27.358 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-08T05:07:27.359 DEBUG:teuthology.orchestra.run.smithi087:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-05-08T05:07:27.367 DEBUG:teuthology.orchestra.run.smithi090:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-05-08T05:07:27.385 DEBUG:teuthology.orchestra.run.smithi160:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-05-08T05:07:27.421 INFO:teuthology.orchestra.run.smithi090.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-05-08T05:07:27.442 INFO:teuthology.orchestra.run.smithi090.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-05-08T05:07:27.453 INFO:teuthology.orchestra.run.smithi160.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-05-08T05:07:27.472 INFO:teuthology.orchestra.run.smithi160.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-05-08T05:07:27.497 INFO:teuthology.orchestra.run.smithi087.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-05-08T05:07:27.547 INFO:teuthology.orchestra.run.smithi087.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-05-08T05:07:27.552 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-05-08T05:07:27.559 INFO:teuthology.task.internal:Configuring sudo... 2024-05-08T05:07:27.559 DEBUG:teuthology.orchestra.run.smithi087:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-05-08T05:07:27.567 DEBUG:teuthology.orchestra.run.smithi090:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-05-08T05:07:27.570 DEBUG:teuthology.orchestra.run.smithi160:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-05-08T05:07:27.646 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-05-08T05:07:27.656 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-05-08T05:07:27.656 DEBUG:teuthology.orchestra.run.smithi087:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-05-08T05:07:27.662 DEBUG:teuthology.orchestra.run.smithi090:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-05-08T05:07:27.664 DEBUG:teuthology.orchestra.run.smithi160:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-05-08T05:07:27.709 DEBUG:teuthology.orchestra.run.smithi087:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-05-08T05:07:27.785 DEBUG:teuthology.orchestra.run.smithi087:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-05-08T05:07:27.879 DEBUG:teuthology.orchestra.run.smithi087:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-05-08T05:07:27.962 DEBUG:teuthology.orchestra.run.smithi087:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-05-08T05:07:28.046 DEBUG:teuthology.orchestra.run.smithi087:> set -ex 2024-05-08T05:07:28.046 DEBUG:teuthology.orchestra.run.smithi087:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-05-08T05:07:28.129 DEBUG:teuthology.orchestra.run.smithi090:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-05-08T05:07:28.175 DEBUG:teuthology.orchestra.run.smithi090:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-05-08T05:07:28.226 DEBUG:teuthology.orchestra.run.smithi090:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-05-08T05:07:28.313 DEBUG:teuthology.orchestra.run.smithi090:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-05-08T05:07:28.350 DEBUG:teuthology.orchestra.run.smithi090:> set -ex 2024-05-08T05:07:28.351 DEBUG:teuthology.orchestra.run.smithi090:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-05-08T05:07:28.416 DEBUG:teuthology.orchestra.run.smithi160:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-05-08T05:07:28.461 DEBUG:teuthology.orchestra.run.smithi160:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-05-08T05:07:28.525 DEBUG:teuthology.orchestra.run.smithi160:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-05-08T05:07:28.569 DEBUG:teuthology.orchestra.run.smithi160:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-05-08T05:07:28.611 DEBUG:teuthology.orchestra.run.smithi160:> set -ex 2024-05-08T05:07:28.611 DEBUG:teuthology.orchestra.run.smithi160:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-05-08T05:07:28.678 DEBUG:teuthology.orchestra.run.smithi087:> sudo service rsyslog restart 2024-05-08T05:07:28.685 DEBUG:teuthology.orchestra.run.smithi090:> sudo service rsyslog restart 2024-05-08T05:07:28.688 DEBUG:teuthology.orchestra.run.smithi160:> sudo service rsyslog restart 2024-05-08T05:07:28.724 INFO:teuthology.orchestra.run.smithi090.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-05-08T05:07:28.753 INFO:teuthology.orchestra.run.smithi160.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-05-08T05:07:28.789 INFO:teuthology.orchestra.run.smithi087.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-05-08T05:07:29.299 INFO:teuthology.run_tasks:Running task internal.timer... 2024-05-08T05:07:29.307 INFO:teuthology.task.internal:Starting timer... 2024-05-08T05:07:29.308 INFO:teuthology.run_tasks:Running task pcp... 2024-05-08T05:07:29.352 INFO:teuthology.run_tasks:Running task selinux... 2024-05-08T05:07:29.405 DEBUG:teuthology.task:Applying overrides for task selinux: {'allowlist': ['scontext=system_u:system_r:logrotate_t:s0', 'scontext=system_u:system_r:getty_t:s0']} 2024-05-08T05:07:29.405 DEBUG:teuthology.orchestra.run.smithi087:> sudo service auditd rotate 2024-05-08T05:07:29.541 INFO:teuthology.orchestra.run.smithi087.stdout:Rotating logs: 2024-05-08T05:07:29.546 DEBUG:teuthology.orchestra.run.smithi090:> sudo service auditd rotate 2024-05-08T05:07:29.621 INFO:teuthology.orchestra.run.smithi090.stdout:Rotating logs: 2024-05-08T05:07:29.623 DEBUG:teuthology.orchestra.run.smithi160:> sudo service auditd rotate 2024-05-08T05:07:29.694 INFO:teuthology.orchestra.run.smithi160.stdout:Rotating logs: 2024-05-08T05:07:29.696 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-05-08T05:07:29.696 DEBUG:teuthology.orchestra.run.smithi087:> /usr/sbin/getenforce 2024-05-08T05:07:29.758 INFO:teuthology.orchestra.run.smithi087.stdout:Permissive 2024-05-08T05:07:29.758 DEBUG:teuthology.orchestra.run.smithi090:> /usr/sbin/getenforce 2024-05-08T05:07:29.800 INFO:teuthology.orchestra.run.smithi090.stdout:Permissive 2024-05-08T05:07:29.801 DEBUG:teuthology.orchestra.run.smithi160:> /usr/sbin/getenforce 2024-05-08T05:07:29.819 INFO:teuthology.orchestra.run.smithi160.stdout:Permissive 2024-05-08T05:07:29.820 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi087.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi090.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi160.front.sepia.ceph.com': 'permissive'} 2024-05-08T05:07:29.820 DEBUG:teuthology.orchestra.run.smithi087:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-05-08T05:07:29.902 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-08T05:07:29.903 DEBUG:teuthology.orchestra.run.smithi090:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-05-08T05:07:29.929 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-08T05:07:29.930 DEBUG:teuthology.orchestra.run.smithi160:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-05-08T05:07:29.954 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-08T05:07:29.954 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-05-08T05:07:29.954 DEBUG:teuthology.orchestra.run.smithi087:> sudo /usr/sbin/setenforce permissive 2024-05-08T05:07:30.041 DEBUG:teuthology.orchestra.run.smithi090:> sudo /usr/sbin/setenforce permissive 2024-05-08T05:07:30.069 DEBUG:teuthology.orchestra.run.smithi160:> sudo /usr/sbin/setenforce permissive 2024-05-08T05:07:30.093 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-05-08T05:07:30.103 DEBUG:teuthology.repo_utils:Setting repo remote to https://git.ceph.com/ceph-cm-ansible.git 2024-05-08T05:07:30.109 INFO:teuthology.repo_utils:Fetching git.ceph.com_ceph-cm-ansible_main from origin 2024-05-08T05:07:30.239 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-05-08T05:07:30.254 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-05-08T05:07:30.255 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi087.front.sepia.ceph.com,smithi090.front.sepia.ceph.com,smithi160.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-05-08T05:12:59.117 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi087.front.sepia.ceph.com'), Remote(name='ubuntu@smithi090.front.sepia.ceph.com'), Remote(name='ubuntu@smithi160.front.sepia.ceph.com')] 2024-05-08T05:12:59.118 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi087.front.sepia.ceph.com' 2024-05-08T05:12:59.120 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi087.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-08T05:12:59.229 DEBUG:teuthology.orchestra.run.smithi087:> true 2024-05-08T05:12:59.388 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi087.front.sepia.ceph.com' 2024-05-08T05:12:59.388 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi090.front.sepia.ceph.com' 2024-05-08T05:12:59.389 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi090.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-08T05:12:59.460 DEBUG:teuthology.orchestra.run.smithi090:> true 2024-05-08T05:12:59.540 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi090.front.sepia.ceph.com' 2024-05-08T05:12:59.541 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi160.front.sepia.ceph.com' 2024-05-08T05:12:59.541 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi160.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-08T05:12:59.617 DEBUG:teuthology.orchestra.run.smithi160:> true 2024-05-08T05:12:59.695 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi160.front.sepia.ceph.com' 2024-05-08T05:12:59.695 INFO:teuthology.run_tasks:Running task clock... 2024-05-08T05:12:59.706 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-05-08T05:12:59.706 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-05-08T05:12:59.706 DEBUG:teuthology.orchestra.run.smithi087:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-05-08T05:12:59.714 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-05-08T05:12:59.714 DEBUG:teuthology.orchestra.run.smithi090:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-05-08T05:12:59.716 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-05-08T05:12:59.716 DEBUG:teuthology.orchestra.run.smithi160:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-05-08T05:12:59.742 INFO:teuthology.orchestra.run.smithi090.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-05-08T05:12:59.755 INFO:teuthology.orchestra.run.smithi090.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-05-08T05:12:59.766 INFO:teuthology.orchestra.run.smithi160.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-05-08T05:12:59.777 INFO:teuthology.orchestra.run.smithi090.stderr:sudo: ntpd: command not found 2024-05-08T05:12:59.780 INFO:teuthology.orchestra.run.smithi160.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-05-08T05:12:59.787 INFO:teuthology.orchestra.run.smithi090.stdout:506 Cannot talk to daemon 2024-05-08T05:12:59.800 INFO:teuthology.orchestra.run.smithi090.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-05-08T05:12:59.801 INFO:teuthology.orchestra.run.smithi087.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-05-08T05:12:59.804 INFO:teuthology.orchestra.run.smithi160.stderr:sudo: ntpd: command not found 2024-05-08T05:12:59.813 INFO:teuthology.orchestra.run.smithi090.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-05-08T05:12:59.815 INFO:teuthology.orchestra.run.smithi160.stdout:506 Cannot talk to daemon 2024-05-08T05:12:59.829 INFO:teuthology.orchestra.run.smithi160.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-05-08T05:12:59.841 INFO:teuthology.orchestra.run.smithi160.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-05-08T05:12:59.846 INFO:teuthology.orchestra.run.smithi087.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-05-08T05:12:59.865 INFO:teuthology.orchestra.run.smithi090.stderr:bash: line 1: ntpq: command not found 2024-05-08T05:12:59.869 INFO:teuthology.orchestra.run.smithi090.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-05-08T05:12:59.869 INFO:teuthology.orchestra.run.smithi090.stdout:=============================================================================== 2024-05-08T05:12:59.869 INFO:teuthology.orchestra.run.smithi090.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-08T05:12:59.869 INFO:teuthology.orchestra.run.smithi090.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-08T05:12:59.869 INFO:teuthology.orchestra.run.smithi090.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-08T05:12:59.869 INFO:teuthology.orchestra.run.smithi090.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-08T05:12:59.898 INFO:teuthology.orchestra.run.smithi160.stderr:bash: line 1: ntpq: command not found 2024-05-08T05:12:59.902 INFO:teuthology.orchestra.run.smithi160.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-05-08T05:12:59.902 INFO:teuthology.orchestra.run.smithi160.stdout:=============================================================================== 2024-05-08T05:12:59.902 INFO:teuthology.orchestra.run.smithi160.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-08T05:12:59.902 INFO:teuthology.orchestra.run.smithi160.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-08T05:12:59.902 INFO:teuthology.orchestra.run.smithi160.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-08T05:12:59.902 INFO:teuthology.orchestra.run.smithi160.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-08T05:12:59.927 INFO:teuthology.orchestra.run.smithi087.stderr:sudo: ntpd: command not found 2024-05-08T05:12:59.960 INFO:teuthology.orchestra.run.smithi087.stdout:506 Cannot talk to daemon 2024-05-08T05:12:59.999 INFO:teuthology.orchestra.run.smithi087.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-05-08T05:13:00.040 INFO:teuthology.orchestra.run.smithi087.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-05-08T05:13:00.184 INFO:teuthology.orchestra.run.smithi087.stderr:bash: line 1: ntpq: command not found 2024-05-08T05:13:00.192 INFO:teuthology.orchestra.run.smithi087.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-05-08T05:13:00.192 INFO:teuthology.orchestra.run.smithi087.stdout:=============================================================================== 2024-05-08T05:13:00.192 INFO:teuthology.orchestra.run.smithi087.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-08T05:13:00.192 INFO:teuthology.orchestra.run.smithi087.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-08T05:13:00.192 INFO:teuthology.orchestra.run.smithi087.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-08T05:13:00.192 INFO:teuthology.orchestra.run.smithi087.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-08T05:13:00.194 INFO:teuthology.run_tasks:Running task install... 2024-05-08T05:13:00.203 DEBUG:teuthology.task.install:project ceph 2024-05-08T05:13:00.203 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': 'bee299f4ac344e4c45e550d7a80abcadd7bc3d5a'}} 2024-05-08T05:13:00.203 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': 'bee299f4ac344e4c45e550d7a80abcadd7bc3d5a'} 2024-05-08T05:13:00.203 INFO:teuthology.task.install:Using flavor: default 2024-05-08T05:13:00.208 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-05-08T05:13:00.208 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']} 2024-05-08T05:13:00.209 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'bee299f4ac344e4c45e550d7a80abcadd7bc3d5a', 'tag': None, 'wait_for_package': False} 2024-05-08T05:13:00.209 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=bee299f4ac344e4c45e550d7a80abcadd7bc3d5a 2024-05-08T05:13:00.211 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'bee299f4ac344e4c45e550d7a80abcadd7bc3d5a', 'tag': None, 'wait_for_package': False} 2024-05-08T05:13:00.211 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=bee299f4ac344e4c45e550d7a80abcadd7bc3d5a 2024-05-08T05:13:00.212 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'bee299f4ac344e4c45e550d7a80abcadd7bc3d5a', 'tag': None, 'wait_for_package': False} 2024-05-08T05:13:00.212 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=bee299f4ac344e4c45e550d7a80abcadd7bc3d5a 2024-05-08T05:13:00.356 INFO:teuthology.task.install.rpm:Pulling from https://4.chacra.ceph.com/r/ceph/wip-57676-3/bee299f4ac344e4c45e550d7a80abcadd7bc3d5a/centos/9/flavors/default/ 2024-05-08T05:13:00.356 INFO:teuthology.task.install.rpm:Package version is 19.0.0-3538.gbee299f4 2024-05-08T05:13:00.424 INFO:teuthology.task.install.rpm:Pulling from https://4.chacra.ceph.com/r/ceph/wip-57676-3/bee299f4ac344e4c45e550d7a80abcadd7bc3d5a/centos/9/flavors/default/ 2024-05-08T05:13:00.424 INFO:teuthology.task.install.rpm:Package version is 19.0.0-3538.gbee299f4 2024-05-08T05:13:00.443 INFO:teuthology.task.install.rpm:Pulling from https://4.chacra.ceph.com/r/ceph/wip-57676-3/bee299f4ac344e4c45e550d7a80abcadd7bc3d5a/centos/9/flavors/default/ 2024-05-08T05:13:00.443 INFO:teuthology.task.install.rpm:Package version is 19.0.0-3538.gbee299f4 2024-05-08T05:13:00.528 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://4.chacra.ceph.com/r/ceph/wip-57676-3/bee299f4ac344e4c45e550d7a80abcadd7bc3d5a/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-57676-3/bee299f4ac344e4c45e550d7a80abcadd7bc3d5a/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-57676-3/bee299f4ac344e4c45e550d7a80abcadd7bc3d5a/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-05-08T05:13:00.528 DEBUG:teuthology.orchestra.run.smithi087:> set -ex 2024-05-08T05:13:00.528 DEBUG:teuthology.orchestra.run.smithi087:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-05-08T05:13:00.531 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://4.chacra.ceph.com/r/ceph/wip-57676-3/bee299f4ac344e4c45e550d7a80abcadd7bc3d5a/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-57676-3/bee299f4ac344e4c45e550d7a80abcadd7bc3d5a/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-57676-3/bee299f4ac344e4c45e550d7a80abcadd7bc3d5a/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-05-08T05:13:00.532 DEBUG:teuthology.orchestra.run.smithi090:> set -ex 2024-05-08T05:13:00.532 DEBUG:teuthology.orchestra.run.smithi090:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-05-08T05:13:00.558 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-05-08T05:13:00.558 DEBUG:teuthology.orchestra.run.smithi090:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/bee299f4ac344e4c45e550d7a80abcadd7bc3d5a/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-05-08T05:13:00.612 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://4.chacra.ceph.com/r/ceph/wip-57676-3/bee299f4ac344e4c45e550d7a80abcadd7bc3d5a/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-57676-3/bee299f4ac344e4c45e550d7a80abcadd7bc3d5a/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-57676-3/bee299f4ac344e4c45e550d7a80abcadd7bc3d5a/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-05-08T05:13:00.612 DEBUG:teuthology.orchestra.run.smithi160:> set -ex 2024-05-08T05:13:00.612 DEBUG:teuthology.orchestra.run.smithi160:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-05-08T05:13:00.613 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-05-08T05:13:00.613 DEBUG:teuthology.orchestra.run.smithi087:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/bee299f4ac344e4c45e550d7a80abcadd7bc3d5a/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-05-08T05:13:00.623 DEBUG:teuthology.orchestra.run.smithi090:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-05-08T05:13:00.639 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-05-08T05:13:00.639 DEBUG:teuthology.orchestra.run.smithi160:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/bee299f4ac344e4c45e550d7a80abcadd7bc3d5a/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-05-08T05:13:00.697 DEBUG:teuthology.orchestra.run.smithi090:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-05-08T05:13:00.705 DEBUG:teuthology.orchestra.run.smithi160:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-05-08T05:13:00.738 DEBUG:teuthology.orchestra.run.smithi087:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-05-08T05:13:00.760 INFO:teuthology.orchestra.run.smithi090.stdout:check_obsoletes = 1 2024-05-08T05:13:00.761 DEBUG:teuthology.orchestra.run.smithi090:> sudo yum clean all 2024-05-08T05:13:00.780 DEBUG:teuthology.orchestra.run.smithi160:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-05-08T05:13:00.844 INFO:teuthology.orchestra.run.smithi160.stdout:check_obsoletes = 1 2024-05-08T05:13:00.846 DEBUG:teuthology.orchestra.run.smithi160:> sudo yum clean all 2024-05-08T05:13:00.853 DEBUG:teuthology.orchestra.run.smithi087:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-05-08T05:13:00.928 INFO:teuthology.orchestra.run.smithi087.stdout:check_obsoletes = 1 2024-05-08T05:13:00.932 DEBUG:teuthology.orchestra.run.smithi087:> sudo yum clean all 2024-05-08T05:13:00.986 INFO:teuthology.orchestra.run.smithi090.stdout:54 files removed 2024-05-08T05:13:01.014 DEBUG:teuthology.orchestra.run.smithi090:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-05-08T05:13:01.072 INFO:teuthology.orchestra.run.smithi160.stdout:54 files removed 2024-05-08T05:13:01.099 DEBUG:teuthology.orchestra.run.smithi160:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-05-08T05:13:01.251 INFO:teuthology.orchestra.run.smithi087.stdout:54 files removed 2024-05-08T05:13:01.289 DEBUG:teuthology.orchestra.run.smithi087:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-05-08T05:13:01.780 INFO:teuthology.orchestra.run.smithi160.stdout:ceph packages for x86_64 201 kB/s | 84 kB 00:00 2024-05-08T05:13:01.946 INFO:teuthology.orchestra.run.smithi090.stdout:ceph packages for x86_64 125 kB/s | 84 kB 00:00 2024-05-08T05:13:02.148 INFO:teuthology.orchestra.run.smithi160.stdout:ceph noarch packages 36 kB/s | 12 kB 00:00 2024-05-08T05:13:02.283 INFO:teuthology.orchestra.run.smithi087.stdout:ceph packages for x86_64 150 kB/s | 84 kB 00:00 2024-05-08T05:13:02.380 INFO:teuthology.orchestra.run.smithi090.stdout:ceph noarch packages 30 kB/s | 12 kB 00:00 2024-05-08T05:13:02.565 INFO:teuthology.orchestra.run.smithi160.stdout:ceph source packages 5.0 kB/s | 1.9 kB 00:00 2024-05-08T05:13:02.890 INFO:teuthology.orchestra.run.smithi090.stdout:ceph source packages 4.0 kB/s | 1.9 kB 00:00 2024-05-08T05:13:03.849 INFO:teuthology.orchestra.run.smithi090.stdout:CentOS Stream 9 - BaseOS 8.7 MB/s | 8.1 MB 00:00 2024-05-08T05:13:03.884 INFO:teuthology.orchestra.run.smithi087.stdout:ceph noarch packages 7.8 kB/s | 12 kB 00:01 2024-05-08T05:13:04.518 INFO:teuthology.orchestra.run.smithi087.stdout:ceph source packages 3.4 kB/s | 1.9 kB 00:00 2024-05-08T05:13:05.541 INFO:teuthology.orchestra.run.smithi087.stdout:CentOS Stream 9 - BaseOS 8.6 MB/s | 8.1 MB 00:00 2024-05-08T05:13:06.309 INFO:teuthology.orchestra.run.smithi090.stdout:CentOS Stream 9 - AppStream 14 MB/s | 19 MB 00:01 2024-05-08T05:13:06.831 INFO:teuthology.orchestra.run.smithi160.stdout:CentOS Stream 9 - BaseOS 1.9 MB/s | 8.1 MB 00:04 2024-05-08T05:13:07.684 INFO:teuthology.orchestra.run.smithi087.stdout:CentOS Stream 9 - AppStream 22 MB/s | 19 MB 00:00 2024-05-08T05:13:10.486 INFO:teuthology.orchestra.run.smithi090.stdout:CentOS Stream 9 - CRB 9.9 MB/s | 6.2 MB 00:00 2024-05-08T05:13:11.945 INFO:teuthology.orchestra.run.smithi090.stdout:CentOS Stream 9 - Extras packages 55 kB/s | 16 kB 00:00 2024-05-08T05:13:13.118 INFO:teuthology.orchestra.run.smithi087.stdout:CentOS Stream 9 - CRB 4.0 MB/s | 6.2 MB 00:01 2024-05-08T05:13:14.148 INFO:teuthology.orchestra.run.smithi160.stdout:CentOS Stream 9 - AppStream 3.1 MB/s | 19 MB 00:06 2024-05-08T05:13:15.053 INFO:teuthology.orchestra.run.smithi087.stdout:CentOS Stream 9 - Extras packages 30 kB/s | 16 kB 00:00 2024-05-08T05:13:15.072 INFO:teuthology.orchestra.run.smithi090.stdout:Extra Packages for Enterprise Linux 7.1 MB/s | 21 MB 00:02 2024-05-08T05:13:17.400 INFO:teuthology.orchestra.run.smithi087.stdout:Extra Packages for Enterprise Linux 9.8 MB/s | 21 MB 00:02 2024-05-08T05:13:20.057 INFO:teuthology.orchestra.run.smithi160.stdout:CentOS Stream 9 - CRB 2.7 MB/s | 6.2 MB 00:02 2024-05-08T05:13:20.249 INFO:teuthology.orchestra.run.smithi090.stdout:lab-extras 31 kB/s | 1.7 kB 00:00 2024-05-08T05:13:21.758 INFO:teuthology.orchestra.run.smithi160.stdout:CentOS Stream 9 - Extras packages 30 kB/s | 16 kB 00:00 2024-05-08T05:13:22.542 INFO:teuthology.orchestra.run.smithi090.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-05-08T05:13:22.543 INFO:teuthology.orchestra.run.smithi090.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-05-08T05:13:22.554 INFO:teuthology.orchestra.run.smithi090.stdout:Package NetworkManager-1:1.47.4-1.el9.x86_64 is already installed. 2024-05-08T05:13:22.554 INFO:teuthology.orchestra.run.smithi090.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-05-08T05:13:22.555 INFO:teuthology.orchestra.run.smithi090.stdout:Package util-linux-2.37.4-18.el9.x86_64 is already installed. 2024-05-08T05:13:22.556 INFO:teuthology.orchestra.run.smithi090.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-05-08T05:13:22.558 INFO:teuthology.orchestra.run.smithi090.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-05-08T05:13:22.560 INFO:teuthology.orchestra.run.smithi090.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-05-08T05:13:22.560 INFO:teuthology.orchestra.run.smithi090.stdout:Package xfsprogs-6.3.0-1.el9.x86_64 is already installed. 2024-05-08T05:13:22.621 INFO:teuthology.orchestra.run.smithi090.stdout:Dependencies resolved. 2024-05-08T05:13:22.646 INFO:teuthology.orchestra.run.smithi090.stdout:======================================================================================= 2024-05-08T05:13:22.647 INFO:teuthology.orchestra.run.smithi090.stdout: Package Arch Version Repository Size 2024-05-08T05:13:22.647 INFO:teuthology.orchestra.run.smithi090.stdout:======================================================================================= 2024-05-08T05:13:22.647 INFO:teuthology.orchestra.run.smithi090.stdout:Installing: 2024-05-08T05:13:22.647 INFO:teuthology.orchestra.run.smithi090.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-05-08T05:13:22.647 INFO:teuthology.orchestra.run.smithi090.stdout: ceph x86_64 2:19.0.0-3538.gbee299f4.el9 ceph 6.6 k 2024-05-08T05:13:22.647 INFO:teuthology.orchestra.run.smithi090.stdout: ceph-base x86_64 2:19.0.0-3538.gbee299f4.el9 ceph 5.4 M 2024-05-08T05:13:22.647 INFO:teuthology.orchestra.run.smithi090.stdout: ceph-fuse x86_64 2:19.0.0-3538.gbee299f4.el9 ceph 890 k 2024-05-08T05:13:22.647 INFO:teuthology.orchestra.run.smithi090.stdout: ceph-immutable-object-cache x86_64 2:19.0.0-3538.gbee299f4.el9 ceph 145 k 2024-05-08T05:13:22.647 INFO:teuthology.orchestra.run.smithi090.stdout: ceph-mgr x86_64 2:19.0.0-3538.gbee299f4.el9 ceph 1.5 M 2024-05-08T05:13:22.647 INFO:teuthology.orchestra.run.smithi090.stdout: ceph-mgr-cephadm noarch 2:19.0.0-3538.gbee299f4.el9 ceph-noarch 142 k 2024-05-08T05:13:22.648 INFO:teuthology.orchestra.run.smithi090.stdout: ceph-mgr-dashboard noarch 2:19.0.0-3538.gbee299f4.el9 ceph-noarch 3.5 M 2024-05-08T05:13:22.648 INFO:teuthology.orchestra.run.smithi090.stdout: ceph-mgr-diskprediction-local noarch 2:19.0.0-3538.gbee299f4.el9 ceph-noarch 7.4 M 2024-05-08T05:13:22.648 INFO:teuthology.orchestra.run.smithi090.stdout: ceph-mgr-rook noarch 2:19.0.0-3538.gbee299f4.el9 ceph-noarch 49 k 2024-05-08T05:13:22.648 INFO:teuthology.orchestra.run.smithi090.stdout: ceph-radosgw x86_64 2:19.0.0-3538.gbee299f4.el9 ceph 11 M 2024-05-08T05:13:22.648 INFO:teuthology.orchestra.run.smithi090.stdout: ceph-test x86_64 2:19.0.0-3538.gbee299f4.el9 ceph 49 M 2024-05-08T05:13:22.648 INFO:teuthology.orchestra.run.smithi090.stdout: ceph-volume noarch 2:19.0.0-3538.gbee299f4.el9 ceph-noarch 273 k 2024-05-08T05:13:22.648 INFO:teuthology.orchestra.run.smithi090.stdout: cephadm noarch 2:19.0.0-3538.gbee299f4.el9 ceph-noarch 763 k 2024-05-08T05:13:22.648 INFO:teuthology.orchestra.run.smithi090.stdout: cephfs-mirror x86_64 2:19.0.0-3538.gbee299f4.el9 ceph 225 k 2024-05-08T05:13:22.648 INFO:teuthology.orchestra.run.smithi090.stdout: cephfs-shell x86_64 2:19.0.0-3538.gbee299f4.el9 ceph 27 k 2024-05-08T05:13:22.648 INFO:teuthology.orchestra.run.smithi090.stdout: cephfs-top noarch 2:19.0.0-3538.gbee299f4.el9 ceph-noarch 18 k 2024-05-08T05:13:22.648 INFO:teuthology.orchestra.run.smithi090.stdout: elfutils-libelf-devel x86_64 0.190-2.el9 appstream 21 k 2024-05-08T05:13:22.648 INFO:teuthology.orchestra.run.smithi090.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-05-08T05:13:22.649 INFO:teuthology.orchestra.run.smithi090.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-05-08T05:13:22.649 INFO:teuthology.orchestra.run.smithi090.stdout: libcephfs-devel x86_64 2:19.0.0-3538.gbee299f4.el9 ceph 32 k 2024-05-08T05:13:22.649 INFO:teuthology.orchestra.run.smithi090.stdout: libcephfs2 x86_64 2:19.0.0-3538.gbee299f4.el9 ceph 747 k 2024-05-08T05:13:22.649 INFO:teuthology.orchestra.run.smithi090.stdout: librados-devel x86_64 2:19.0.0-3538.gbee299f4.el9 ceph 127 k 2024-05-08T05:13:22.649 INFO:teuthology.orchestra.run.smithi090.stdout: libtool x86_64 2.4.6-45.el9 appstream 582 k 2024-05-08T05:13:22.649 INFO:teuthology.orchestra.run.smithi090.stdout: libuuid-devel x86_64 2.37.4-18.el9 appstream 25 k 2024-05-08T05:13:22.649 INFO:teuthology.orchestra.run.smithi090.stdout: openssl-devel x86_64 1:3.2.1-1.el9 appstream 4.4 M 2024-05-08T05:13:22.649 INFO:teuthology.orchestra.run.smithi090.stdout: postgresql x86_64 13.14-1.el9 appstream 1.6 M 2024-05-08T05:13:22.649 INFO:teuthology.orchestra.run.smithi090.stdout: postgresql-contrib x86_64 13.14-1.el9 appstream 911 k 2024-05-08T05:13:22.649 INFO:teuthology.orchestra.run.smithi090.stdout: postgresql-server x86_64 13.14-1.el9 appstream 5.8 M 2024-05-08T05:13:22.649 INFO:teuthology.orchestra.run.smithi090.stdout: python3-cephfs x86_64 2:19.0.0-3538.gbee299f4.el9 ceph 161 k 2024-05-08T05:13:22.649 INFO:teuthology.orchestra.run.smithi090.stdout: python3-rados x86_64 2:19.0.0-3538.gbee299f4.el9 ceph 321 k 2024-05-08T05:13:22.649 INFO:teuthology.orchestra.run.smithi090.stdout: python3-rbd x86_64 2:19.0.0-3538.gbee299f4.el9 ceph 299 k 2024-05-08T05:13:22.650 INFO:teuthology.orchestra.run.smithi090.stdout: python3-rgw x86_64 2:19.0.0-3538.gbee299f4.el9 ceph 100 k 2024-05-08T05:13:22.650 INFO:teuthology.orchestra.run.smithi090.stdout: rbd-fuse x86_64 2:19.0.0-3538.gbee299f4.el9 ceph 85 k 2024-05-08T05:13:22.650 INFO:teuthology.orchestra.run.smithi090.stdout: rbd-mirror x86_64 2:19.0.0-3538.gbee299f4.el9 ceph 3.1 M 2024-05-08T05:13:22.650 INFO:teuthology.orchestra.run.smithi090.stdout: rbd-nbd x86_64 2:19.0.0-3538.gbee299f4.el9 ceph 171 k 2024-05-08T05:13:22.650 INFO:teuthology.orchestra.run.smithi090.stdout: xfsprogs-devel x86_64 6.3.0-1.el9 appstream 94 k 2024-05-08T05:13:22.650 INFO:teuthology.orchestra.run.smithi090.stdout:Upgrading: 2024-05-08T05:13:22.650 INFO:teuthology.orchestra.run.smithi090.stdout: NetworkManager x86_64 1:1.47.5-1.el9 baseos 2.3 M 2024-05-08T05:13:22.650 INFO:teuthology.orchestra.run.smithi090.stdout: NetworkManager-libnm x86_64 1:1.47.5-1.el9 baseos 1.8 M 2024-05-08T05:13:22.650 INFO:teuthology.orchestra.run.smithi090.stdout: NetworkManager-team x86_64 1:1.47.5-1.el9 baseos 42 k 2024-05-08T05:13:22.650 INFO:teuthology.orchestra.run.smithi090.stdout: NetworkManager-tui x86_64 1:1.47.5-1.el9 baseos 248 k 2024-05-08T05:13:22.650 INFO:teuthology.orchestra.run.smithi090.stdout: librados2 x86_64 2:19.0.0-3538.gbee299f4.el9 ceph 3.4 M 2024-05-08T05:13:22.650 INFO:teuthology.orchestra.run.smithi090.stdout: librbd1 x86_64 2:19.0.0-3538.gbee299f4.el9 ceph 3.1 M 2024-05-08T05:13:22.650 INFO:teuthology.orchestra.run.smithi090.stdout: openssl x86_64 1:3.2.1-1.el9 baseos 1.3 M 2024-05-08T05:13:22.651 INFO:teuthology.orchestra.run.smithi090.stdout: openssl-libs x86_64 1:3.2.1-1.el9 baseos 2.4 M 2024-05-08T05:13:22.651 INFO:teuthology.orchestra.run.smithi090.stdout:Installing dependencies: 2024-05-08T05:13:22.651 INFO:teuthology.orchestra.run.smithi090.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-05-08T05:13:22.651 INFO:teuthology.orchestra.run.smithi090.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-05-08T05:13:22.651 INFO:teuthology.orchestra.run.smithi090.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-05-08T05:13:22.651 INFO:teuthology.orchestra.run.smithi090.stdout: ceph-common x86_64 2:19.0.0-3538.gbee299f4.el9 ceph 21 M 2024-05-08T05:13:22.651 INFO:teuthology.orchestra.run.smithi090.stdout: ceph-grafana-dashboards noarch 2:19.0.0-3538.gbee299f4.el9 ceph-noarch 34 k 2024-05-08T05:13:22.651 INFO:teuthology.orchestra.run.smithi090.stdout: ceph-mds x86_64 2:19.0.0-3538.gbee299f4.el9 ceph 2.4 M 2024-05-08T05:13:22.651 INFO:teuthology.orchestra.run.smithi090.stdout: ceph-mgr-modules-core noarch 2:19.0.0-3538.gbee299f4.el9 ceph-noarch 274 k 2024-05-08T05:13:22.651 INFO:teuthology.orchestra.run.smithi090.stdout: ceph-mon x86_64 2:19.0.0-3538.gbee299f4.el9 ceph 4.7 M 2024-05-08T05:13:22.651 INFO:teuthology.orchestra.run.smithi090.stdout: ceph-osd x86_64 2:19.0.0-3538.gbee299f4.el9 ceph 17 M 2024-05-08T05:13:22.651 INFO:teuthology.orchestra.run.smithi090.stdout: ceph-prometheus-alerts noarch 2:19.0.0-3538.gbee299f4.el9 ceph-noarch 16 k 2024-05-08T05:13:22.652 INFO:teuthology.orchestra.run.smithi090.stdout: ceph-selinux x86_64 2:19.0.0-3538.gbee299f4.el9 ceph 25 k 2024-05-08T05:13:22.652 INFO:teuthology.orchestra.run.smithi090.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-05-08T05:13:22.652 INFO:teuthology.orchestra.run.smithi090.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-05-08T05:13:22.652 INFO:teuthology.orchestra.run.smithi090.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-05-08T05:13:22.652 INFO:teuthology.orchestra.run.smithi090.stdout: fuse x86_64 2.9.9-15.el9 baseos 80 k 2024-05-08T05:13:22.652 INFO:teuthology.orchestra.run.smithi090.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-05-08T05:13:22.652 INFO:teuthology.orchestra.run.smithi090.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-05-08T05:13:22.652 INFO:teuthology.orchestra.run.smithi090.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-05-08T05:13:22.652 INFO:teuthology.orchestra.run.smithi090.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-05-08T05:13:22.652 INFO:teuthology.orchestra.run.smithi090.stdout: libcephsqlite x86_64 2:19.0.0-3538.gbee299f4.el9 ceph 163 k 2024-05-08T05:13:22.652 INFO:teuthology.orchestra.run.smithi090.stdout: libgfortran x86_64 11.4.1-3.el9 baseos 803 k 2024-05-08T05:13:22.652 INFO:teuthology.orchestra.run.smithi090.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-05-08T05:13:22.652 INFO:teuthology.orchestra.run.smithi090.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-05-08T05:13:22.652 INFO:teuthology.orchestra.run.smithi090.stdout: libquadmath x86_64 11.4.1-3.el9 baseos 195 k 2024-05-08T05:13:22.653 INFO:teuthology.orchestra.run.smithi090.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-05-08T05:13:22.653 INFO:teuthology.orchestra.run.smithi090.stdout: libradosstriper1 x86_64 2:19.0.0-3538.gbee299f4.el9 ceph 500 k 2024-05-08T05:13:22.653 INFO:teuthology.orchestra.run.smithi090.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-05-08T05:13:22.653 INFO:teuthology.orchestra.run.smithi090.stdout: librgw2 x86_64 2:19.0.0-3538.gbee299f4.el9 ceph 5.4 M 2024-05-08T05:13:22.653 INFO:teuthology.orchestra.run.smithi090.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-05-08T05:13:22.653 INFO:teuthology.orchestra.run.smithi090.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-05-08T05:13:22.653 INFO:teuthology.orchestra.run.smithi090.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-05-08T05:13:22.653 INFO:teuthology.orchestra.run.smithi090.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-05-08T05:13:22.653 INFO:teuthology.orchestra.run.smithi090.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-05-08T05:13:22.653 INFO:teuthology.orchestra.run.smithi090.stdout: luarocks noarch 3.9.2-1.el9 epel 151 k 2024-05-08T05:13:22.653 INFO:teuthology.orchestra.run.smithi090.stdout: openblas x86_64 0.3.21-2.el9 appstream 35 k 2024-05-08T05:13:22.653 INFO:teuthology.orchestra.run.smithi090.stdout: openblas-openmp x86_64 0.3.21-2.el9 appstream 4.7 M 2024-05-08T05:13:22.653 INFO:teuthology.orchestra.run.smithi090.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-05-08T05:13:22.654 INFO:teuthology.orchestra.run.smithi090.stdout: postgresql-private-libs x86_64 13.14-1.el9 appstream 133 k 2024-05-08T05:13:22.654 INFO:teuthology.orchestra.run.smithi090.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-05-08T05:13:22.654 INFO:teuthology.orchestra.run.smithi090.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-05-08T05:13:22.654 INFO:teuthology.orchestra.run.smithi090.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-05-08T05:13:22.654 INFO:teuthology.orchestra.run.smithi090.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-05-08T05:13:22.654 INFO:teuthology.orchestra.run.smithi090.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-05-08T05:13:22.654 INFO:teuthology.orchestra.run.smithi090.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-05-08T05:13:22.654 INFO:teuthology.orchestra.run.smithi090.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-05-08T05:13:22.654 INFO:teuthology.orchestra.run.smithi090.stdout: python3-ceph-argparse x86_64 2:19.0.0-3538.gbee299f4.el9 ceph 45 k 2024-05-08T05:13:22.654 INFO:teuthology.orchestra.run.smithi090.stdout: python3-ceph-common x86_64 2:19.0.0-3538.gbee299f4.el9 ceph 135 k 2024-05-08T05:13:22.654 INFO:teuthology.orchestra.run.smithi090.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2024-05-08T05:13:22.654 INFO:teuthology.orchestra.run.smithi090.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-05-08T05:13:22.654 INFO:teuthology.orchestra.run.smithi090.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-05-08T05:13:22.655 INFO:teuthology.orchestra.run.smithi090.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-05-08T05:13:22.655 INFO:teuthology.orchestra.run.smithi090.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-05-08T05:13:22.655 INFO:teuthology.orchestra.run.smithi090.stdout: python3-colorama noarch 0.4.4-12.el9 epel 35 k 2024-05-08T05:13:22.655 INFO:teuthology.orchestra.run.smithi090.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-05-08T05:13:22.655 INFO:teuthology.orchestra.run.smithi090.stdout: python3-devel x86_64 3.9.18-3.el9 appstream 244 k 2024-05-08T05:13:22.655 INFO:teuthology.orchestra.run.smithi090.stdout: python3-google-auth noarch 1:2.29.0-1.el9 epel 206 k 2024-05-08T05:13:22.655 INFO:teuthology.orchestra.run.smithi090.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-05-08T05:13:22.655 INFO:teuthology.orchestra.run.smithi090.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-05-08T05:13:22.655 INFO:teuthology.orchestra.run.smithi090.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-05-08T05:13:22.655 INFO:teuthology.orchestra.run.smithi090.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-05-08T05:13:22.655 INFO:teuthology.orchestra.run.smithi090.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-05-08T05:13:22.655 INFO:teuthology.orchestra.run.smithi090.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-05-08T05:13:22.655 INFO:teuthology.orchestra.run.smithi090.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-05-08T05:13:22.656 INFO:teuthology.orchestra.run.smithi090.stdout: python3-jinja2 noarch 2.11.3-5.el9 appstream 248 k 2024-05-08T05:13:22.656 INFO:teuthology.orchestra.run.smithi090.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-05-08T05:13:22.656 INFO:teuthology.orchestra.run.smithi090.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-05-08T05:13:22.656 INFO:teuthology.orchestra.run.smithi090.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-05-08T05:13:22.656 INFO:teuthology.orchestra.run.smithi090.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-05-08T05:13:22.656 INFO:teuthology.orchestra.run.smithi090.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-05-08T05:13:22.656 INFO:teuthology.orchestra.run.smithi090.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-05-08T05:13:22.656 INFO:teuthology.orchestra.run.smithi090.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-05-08T05:13:22.656 INFO:teuthology.orchestra.run.smithi090.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-05-08T05:13:22.656 INFO:teuthology.orchestra.run.smithi090.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-05-08T05:13:22.656 INFO:teuthology.orchestra.run.smithi090.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-05-08T05:13:22.656 INFO:teuthology.orchestra.run.smithi090.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-05-08T05:13:22.656 INFO:teuthology.orchestra.run.smithi090.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-05-08T05:13:22.656 INFO:teuthology.orchestra.run.smithi090.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-05-08T05:13:22.657 INFO:teuthology.orchestra.run.smithi090.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-05-08T05:13:22.657 INFO:teuthology.orchestra.run.smithi090.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-05-08T05:13:22.657 INFO:teuthology.orchestra.run.smithi090.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-05-08T05:13:22.657 INFO:teuthology.orchestra.run.smithi090.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-05-08T05:13:22.657 INFO:teuthology.orchestra.run.smithi090.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-05-08T05:13:22.657 INFO:teuthology.orchestra.run.smithi090.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-05-08T05:13:22.657 INFO:teuthology.orchestra.run.smithi090.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-05-08T05:13:22.657 INFO:teuthology.orchestra.run.smithi090.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-05-08T05:13:22.657 INFO:teuthology.orchestra.run.smithi090.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-05-08T05:13:22.657 INFO:teuthology.orchestra.run.smithi090.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-05-08T05:13:22.657 INFO:teuthology.orchestra.run.smithi090.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-05-08T05:13:22.657 INFO:teuthology.orchestra.run.smithi090.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-05-08T05:13:22.657 INFO:teuthology.orchestra.run.smithi090.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-05-08T05:13:22.657 INFO:teuthology.orchestra.run.smithi090.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-05-08T05:13:22.658 INFO:teuthology.orchestra.run.smithi090.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-05-08T05:13:22.658 INFO:teuthology.orchestra.run.smithi090.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-05-08T05:13:22.658 INFO:teuthology.orchestra.run.smithi090.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-05-08T05:13:22.658 INFO:teuthology.orchestra.run.smithi090.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-05-08T05:13:22.658 INFO:teuthology.orchestra.run.smithi090.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2024-05-08T05:13:22.658 INFO:teuthology.orchestra.run.smithi090.stdout: python3-urllib3 noarch 1.26.5-5.el9 baseos 215 k 2024-05-08T05:13:22.658 INFO:teuthology.orchestra.run.smithi090.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-05-08T05:13:22.658 INFO:teuthology.orchestra.run.smithi090.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-05-08T05:13:22.658 INFO:teuthology.orchestra.run.smithi090.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-05-08T05:13:22.658 INFO:teuthology.orchestra.run.smithi090.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-05-08T05:13:22.658 INFO:teuthology.orchestra.run.smithi090.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-05-08T05:13:22.658 INFO:teuthology.orchestra.run.smithi090.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-05-08T05:13:22.658 INFO:teuthology.orchestra.run.smithi090.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-05-08T05:13:22.659 INFO:teuthology.orchestra.run.smithi090.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2024-05-08T05:13:22.659 INFO:teuthology.orchestra.run.smithi090.stdout: socat x86_64 1.7.4.1-5.el9 appstream 305 k 2024-05-08T05:13:22.659 INFO:teuthology.orchestra.run.smithi090.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-05-08T05:13:22.659 INFO:teuthology.orchestra.run.smithi090.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-05-08T05:13:22.659 INFO:teuthology.orchestra.run.smithi090.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-05-08T05:13:22.659 INFO:teuthology.orchestra.run.smithi090.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-05-08T05:13:22.659 INFO:teuthology.orchestra.run.smithi090.stdout:Installing weak dependencies: 2024-05-08T05:13:22.659 INFO:teuthology.orchestra.run.smithi090.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-05-08T05:13:22.659 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-05-08T05:13:22.659 INFO:teuthology.orchestra.run.smithi090.stdout:Transaction Summary 2024-05-08T05:13:22.659 INFO:teuthology.orchestra.run.smithi090.stdout:======================================================================================= 2024-05-08T05:13:22.659 INFO:teuthology.orchestra.run.smithi090.stdout:Install 148 Packages 2024-05-08T05:13:22.659 INFO:teuthology.orchestra.run.smithi090.stdout:Upgrade 8 Packages 2024-05-08T05:13:22.659 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-05-08T05:13:22.660 INFO:teuthology.orchestra.run.smithi090.stdout:Total download size: 226 M 2024-05-08T05:13:22.660 INFO:teuthology.orchestra.run.smithi090.stdout:Downloading Packages: 2024-05-08T05:13:23.160 INFO:teuthology.orchestra.run.smithi090.stdout:(1/156): ceph-19.0.0-3538.gbee299f4.el9.x86_64. 28 kB/s | 6.6 kB 00:00 2024-05-08T05:13:23.543 INFO:teuthology.orchestra.run.smithi160.stdout:Extra Packages for Enterprise Linux 13 MB/s | 21 MB 00:01 2024-05-08T05:13:23.551 INFO:teuthology.orchestra.run.smithi090.stdout:(2/156): ceph-base-19.0.0-3538.gbee299f4.el9.x8 8.6 MB/s | 5.4 MB 00:00 2024-05-08T05:13:23.579 INFO:teuthology.orchestra.run.smithi087.stdout:lab-extras 19 kB/s | 1.7 kB 00:00 2024-05-08T05:13:23.594 INFO:teuthology.orchestra.run.smithi090.stdout:(3/156): ceph-fuse-19.0.0-3538.gbee299f4.el9.x8 2.0 MB/s | 890 kB 00:00 2024-05-08T05:13:23.627 INFO:teuthology.orchestra.run.smithi090.stdout:(4/156): ceph-immutable-object-cache-19.0.0-353 1.9 MB/s | 145 kB 00:00 2024-05-08T05:13:23.778 INFO:teuthology.orchestra.run.smithi090.stdout:(5/156): ceph-mgr-19.0.0-3538.gbee299f4.el9.x86 10 MB/s | 1.5 MB 00:00 2024-05-08T05:13:24.187 INFO:teuthology.orchestra.run.smithi090.stdout:(6/156): ceph-mon-19.0.0-3538.gbee299f4.el9.x86 12 MB/s | 4.7 MB 00:00 2024-05-08T05:13:24.245 INFO:teuthology.orchestra.run.smithi090.stdout:(7/156): ceph-mds-19.0.0-3538.gbee299f4.el9.x86 3.6 MB/s | 2.4 MB 00:00 2024-05-08T05:13:25.345 INFO:teuthology.orchestra.run.smithi090.stdout:(8/156): ceph-common-19.0.0-3538.gbee299f4.el9. 8.7 MB/s | 21 MB 00:02 2024-05-08T05:13:25.412 INFO:teuthology.orchestra.run.smithi090.stdout:(9/156): ceph-selinux-19.0.0-3538.gbee299f4.el9 378 kB/s | 25 kB 00:00 2024-05-08T05:13:25.647 INFO:teuthology.orchestra.run.smithi090.stdout:(10/156): ceph-osd-19.0.0-3538.gbee299f4.el9.x8 12 MB/s | 17 MB 00:01 2024-05-08T05:13:25.713 INFO:teuthology.orchestra.run.smithi090.stdout:(11/156): cephfs-mirror-19.0.0-3538.gbee299f4.e 3.3 MB/s | 225 kB 00:00 2024-05-08T05:13:25.780 INFO:teuthology.orchestra.run.smithi090.stdout:(12/156): cephfs-shell-19.0.0-3538.gbee299f4.el 405 kB/s | 27 kB 00:00 2024-05-08T05:13:25.847 INFO:teuthology.orchestra.run.smithi090.stdout:(13/156): libcephfs-devel-19.0.0-3538.gbee299f4 474 kB/s | 32 kB 00:00 2024-05-08T05:13:26.006 INFO:teuthology.orchestra.run.smithi090.stdout:(14/156): libcephfs2-19.0.0-3538.gbee299f4.el9. 4.6 MB/s | 747 kB 00:00 2024-05-08T05:13:26.091 INFO:teuthology.orchestra.run.smithi090.stdout:(15/156): libcephsqlite-19.0.0-3538.gbee299f4.e 1.9 MB/s | 163 kB 00:00 2024-05-08T05:13:26.140 INFO:teuthology.orchestra.run.smithi087.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-05-08T05:13:26.141 INFO:teuthology.orchestra.run.smithi087.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-05-08T05:13:26.161 INFO:teuthology.orchestra.run.smithi087.stdout:Package NetworkManager-1:1.47.4-1.el9.x86_64 is already installed. 2024-05-08T05:13:26.163 INFO:teuthology.orchestra.run.smithi087.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-05-08T05:13:26.164 INFO:teuthology.orchestra.run.smithi087.stdout:Package util-linux-2.37.4-18.el9.x86_64 is already installed. 2024-05-08T05:13:26.165 INFO:teuthology.orchestra.run.smithi087.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-05-08T05:13:26.168 INFO:teuthology.orchestra.run.smithi087.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-05-08T05:13:26.171 INFO:teuthology.orchestra.run.smithi087.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-05-08T05:13:26.172 INFO:teuthology.orchestra.run.smithi087.stdout:Package xfsprogs-6.3.0-1.el9.x86_64 is already installed. 2024-05-08T05:13:26.183 INFO:teuthology.orchestra.run.smithi090.stdout:(16/156): librados-devel-19.0.0-3538.gbee299f4. 1.3 MB/s | 127 kB 00:00 2024-05-08T05:13:26.243 INFO:teuthology.orchestra.run.smithi087.stdout:Dependencies resolved. 2024-05-08T05:13:26.260 INFO:teuthology.orchestra.run.smithi087.stdout:======================================================================================= 2024-05-08T05:13:26.260 INFO:teuthology.orchestra.run.smithi087.stdout: Package Arch Version Repository Size 2024-05-08T05:13:26.261 INFO:teuthology.orchestra.run.smithi087.stdout:======================================================================================= 2024-05-08T05:13:26.261 INFO:teuthology.orchestra.run.smithi087.stdout:Installing: 2024-05-08T05:13:26.261 INFO:teuthology.orchestra.run.smithi087.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-05-08T05:13:26.261 INFO:teuthology.orchestra.run.smithi087.stdout: ceph x86_64 2:19.0.0-3538.gbee299f4.el9 ceph 6.6 k 2024-05-08T05:13:26.261 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-base x86_64 2:19.0.0-3538.gbee299f4.el9 ceph 5.4 M 2024-05-08T05:13:26.261 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-fuse x86_64 2:19.0.0-3538.gbee299f4.el9 ceph 890 k 2024-05-08T05:13:26.261 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-immutable-object-cache x86_64 2:19.0.0-3538.gbee299f4.el9 ceph 145 k 2024-05-08T05:13:26.261 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-mgr x86_64 2:19.0.0-3538.gbee299f4.el9 ceph 1.5 M 2024-05-08T05:13:26.261 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-mgr-cephadm noarch 2:19.0.0-3538.gbee299f4.el9 ceph-noarch 142 k 2024-05-08T05:13:26.261 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-mgr-dashboard noarch 2:19.0.0-3538.gbee299f4.el9 ceph-noarch 3.5 M 2024-05-08T05:13:26.261 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-mgr-diskprediction-local noarch 2:19.0.0-3538.gbee299f4.el9 ceph-noarch 7.4 M 2024-05-08T05:13:26.261 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-mgr-rook noarch 2:19.0.0-3538.gbee299f4.el9 ceph-noarch 49 k 2024-05-08T05:13:26.262 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-radosgw x86_64 2:19.0.0-3538.gbee299f4.el9 ceph 11 M 2024-05-08T05:13:26.262 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-test x86_64 2:19.0.0-3538.gbee299f4.el9 ceph 49 M 2024-05-08T05:13:26.262 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-volume noarch 2:19.0.0-3538.gbee299f4.el9 ceph-noarch 273 k 2024-05-08T05:13:26.262 INFO:teuthology.orchestra.run.smithi087.stdout: cephadm noarch 2:19.0.0-3538.gbee299f4.el9 ceph-noarch 763 k 2024-05-08T05:13:26.262 INFO:teuthology.orchestra.run.smithi087.stdout: cephfs-mirror x86_64 2:19.0.0-3538.gbee299f4.el9 ceph 225 k 2024-05-08T05:13:26.262 INFO:teuthology.orchestra.run.smithi087.stdout: cephfs-shell x86_64 2:19.0.0-3538.gbee299f4.el9 ceph 27 k 2024-05-08T05:13:26.262 INFO:teuthology.orchestra.run.smithi087.stdout: cephfs-top noarch 2:19.0.0-3538.gbee299f4.el9 ceph-noarch 18 k 2024-05-08T05:13:26.262 INFO:teuthology.orchestra.run.smithi087.stdout: elfutils-libelf-devel x86_64 0.190-2.el9 appstream 21 k 2024-05-08T05:13:26.262 INFO:teuthology.orchestra.run.smithi087.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-05-08T05:13:26.262 INFO:teuthology.orchestra.run.smithi087.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-05-08T05:13:26.262 INFO:teuthology.orchestra.run.smithi087.stdout: libcephfs-devel x86_64 2:19.0.0-3538.gbee299f4.el9 ceph 32 k 2024-05-08T05:13:26.262 INFO:teuthology.orchestra.run.smithi087.stdout: libcephfs2 x86_64 2:19.0.0-3538.gbee299f4.el9 ceph 747 k 2024-05-08T05:13:26.262 INFO:teuthology.orchestra.run.smithi087.stdout: librados-devel x86_64 2:19.0.0-3538.gbee299f4.el9 ceph 127 k 2024-05-08T05:13:26.263 INFO:teuthology.orchestra.run.smithi087.stdout: libtool x86_64 2.4.6-45.el9 appstream 582 k 2024-05-08T05:13:26.263 INFO:teuthology.orchestra.run.smithi087.stdout: libuuid-devel x86_64 2.37.4-18.el9 appstream 25 k 2024-05-08T05:13:26.263 INFO:teuthology.orchestra.run.smithi087.stdout: openssl-devel x86_64 1:3.2.1-1.el9 appstream 4.4 M 2024-05-08T05:13:26.263 INFO:teuthology.orchestra.run.smithi087.stdout: postgresql x86_64 13.14-1.el9 appstream 1.6 M 2024-05-08T05:13:26.263 INFO:teuthology.orchestra.run.smithi087.stdout: postgresql-contrib x86_64 13.14-1.el9 appstream 911 k 2024-05-08T05:13:26.263 INFO:teuthology.orchestra.run.smithi087.stdout: postgresql-server x86_64 13.14-1.el9 appstream 5.8 M 2024-05-08T05:13:26.263 INFO:teuthology.orchestra.run.smithi087.stdout: python3-cephfs x86_64 2:19.0.0-3538.gbee299f4.el9 ceph 161 k 2024-05-08T05:13:26.263 INFO:teuthology.orchestra.run.smithi087.stdout: python3-rados x86_64 2:19.0.0-3538.gbee299f4.el9 ceph 321 k 2024-05-08T05:13:26.263 INFO:teuthology.orchestra.run.smithi087.stdout: python3-rbd x86_64 2:19.0.0-3538.gbee299f4.el9 ceph 299 k 2024-05-08T05:13:26.263 INFO:teuthology.orchestra.run.smithi087.stdout: python3-rgw x86_64 2:19.0.0-3538.gbee299f4.el9 ceph 100 k 2024-05-08T05:13:26.263 INFO:teuthology.orchestra.run.smithi087.stdout: rbd-fuse x86_64 2:19.0.0-3538.gbee299f4.el9 ceph 85 k 2024-05-08T05:13:26.263 INFO:teuthology.orchestra.run.smithi087.stdout: rbd-mirror x86_64 2:19.0.0-3538.gbee299f4.el9 ceph 3.1 M 2024-05-08T05:13:26.263 INFO:teuthology.orchestra.run.smithi087.stdout: rbd-nbd x86_64 2:19.0.0-3538.gbee299f4.el9 ceph 171 k 2024-05-08T05:13:26.264 INFO:teuthology.orchestra.run.smithi087.stdout: xfsprogs-devel x86_64 6.3.0-1.el9 appstream 94 k 2024-05-08T05:13:26.264 INFO:teuthology.orchestra.run.smithi087.stdout:Upgrading: 2024-05-08T05:13:26.264 INFO:teuthology.orchestra.run.smithi087.stdout: NetworkManager x86_64 1:1.47.5-1.el9 baseos 2.3 M 2024-05-08T05:13:26.264 INFO:teuthology.orchestra.run.smithi087.stdout: NetworkManager-libnm x86_64 1:1.47.5-1.el9 baseos 1.8 M 2024-05-08T05:13:26.264 INFO:teuthology.orchestra.run.smithi087.stdout: NetworkManager-team x86_64 1:1.47.5-1.el9 baseos 42 k 2024-05-08T05:13:26.264 INFO:teuthology.orchestra.run.smithi087.stdout: NetworkManager-tui x86_64 1:1.47.5-1.el9 baseos 248 k 2024-05-08T05:13:26.264 INFO:teuthology.orchestra.run.smithi087.stdout: librados2 x86_64 2:19.0.0-3538.gbee299f4.el9 ceph 3.4 M 2024-05-08T05:13:26.264 INFO:teuthology.orchestra.run.smithi087.stdout: librbd1 x86_64 2:19.0.0-3538.gbee299f4.el9 ceph 3.1 M 2024-05-08T05:13:26.264 INFO:teuthology.orchestra.run.smithi087.stdout: openssl x86_64 1:3.2.1-1.el9 baseos 1.3 M 2024-05-08T05:13:26.264 INFO:teuthology.orchestra.run.smithi087.stdout: openssl-libs x86_64 1:3.2.1-1.el9 baseos 2.4 M 2024-05-08T05:13:26.264 INFO:teuthology.orchestra.run.smithi087.stdout:Installing dependencies: 2024-05-08T05:13:26.264 INFO:teuthology.orchestra.run.smithi087.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-05-08T05:13:26.265 INFO:teuthology.orchestra.run.smithi087.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-05-08T05:13:26.265 INFO:teuthology.orchestra.run.smithi087.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-05-08T05:13:26.265 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-common x86_64 2:19.0.0-3538.gbee299f4.el9 ceph 21 M 2024-05-08T05:13:26.265 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-grafana-dashboards noarch 2:19.0.0-3538.gbee299f4.el9 ceph-noarch 34 k 2024-05-08T05:13:26.265 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-mds x86_64 2:19.0.0-3538.gbee299f4.el9 ceph 2.4 M 2024-05-08T05:13:26.265 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-mgr-modules-core noarch 2:19.0.0-3538.gbee299f4.el9 ceph-noarch 274 k 2024-05-08T05:13:26.265 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-mon x86_64 2:19.0.0-3538.gbee299f4.el9 ceph 4.7 M 2024-05-08T05:13:26.265 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-osd x86_64 2:19.0.0-3538.gbee299f4.el9 ceph 17 M 2024-05-08T05:13:26.265 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-prometheus-alerts noarch 2:19.0.0-3538.gbee299f4.el9 ceph-noarch 16 k 2024-05-08T05:13:26.265 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-selinux x86_64 2:19.0.0-3538.gbee299f4.el9 ceph 25 k 2024-05-08T05:13:26.265 INFO:teuthology.orchestra.run.smithi087.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-05-08T05:13:26.265 INFO:teuthology.orchestra.run.smithi087.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-05-08T05:13:26.265 INFO:teuthology.orchestra.run.smithi087.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-05-08T05:13:26.265 INFO:teuthology.orchestra.run.smithi087.stdout: fuse x86_64 2.9.9-15.el9 baseos 80 k 2024-05-08T05:13:26.266 INFO:teuthology.orchestra.run.smithi087.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-05-08T05:13:26.266 INFO:teuthology.orchestra.run.smithi087.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-05-08T05:13:26.266 INFO:teuthology.orchestra.run.smithi087.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-05-08T05:13:26.266 INFO:teuthology.orchestra.run.smithi087.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-05-08T05:13:26.266 INFO:teuthology.orchestra.run.smithi087.stdout: libcephsqlite x86_64 2:19.0.0-3538.gbee299f4.el9 ceph 163 k 2024-05-08T05:13:26.266 INFO:teuthology.orchestra.run.smithi087.stdout: libgfortran x86_64 11.4.1-3.el9 baseos 803 k 2024-05-08T05:13:26.266 INFO:teuthology.orchestra.run.smithi087.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-05-08T05:13:26.266 INFO:teuthology.orchestra.run.smithi087.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-05-08T05:13:26.266 INFO:teuthology.orchestra.run.smithi087.stdout: libquadmath x86_64 11.4.1-3.el9 baseos 195 k 2024-05-08T05:13:26.266 INFO:teuthology.orchestra.run.smithi087.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-05-08T05:13:26.266 INFO:teuthology.orchestra.run.smithi087.stdout: libradosstriper1 x86_64 2:19.0.0-3538.gbee299f4.el9 ceph 500 k 2024-05-08T05:13:26.266 INFO:teuthology.orchestra.run.smithi087.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-05-08T05:13:26.266 INFO:teuthology.orchestra.run.smithi087.stdout: librgw2 x86_64 2:19.0.0-3538.gbee299f4.el9 ceph 5.4 M 2024-05-08T05:13:26.267 INFO:teuthology.orchestra.run.smithi087.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-05-08T05:13:26.267 INFO:teuthology.orchestra.run.smithi087.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-05-08T05:13:26.267 INFO:teuthology.orchestra.run.smithi087.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-05-08T05:13:26.267 INFO:teuthology.orchestra.run.smithi087.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-05-08T05:13:26.267 INFO:teuthology.orchestra.run.smithi087.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-05-08T05:13:26.267 INFO:teuthology.orchestra.run.smithi087.stdout: luarocks noarch 3.9.2-1.el9 epel 151 k 2024-05-08T05:13:26.267 INFO:teuthology.orchestra.run.smithi087.stdout: openblas x86_64 0.3.21-2.el9 appstream 35 k 2024-05-08T05:13:26.267 INFO:teuthology.orchestra.run.smithi087.stdout: openblas-openmp x86_64 0.3.21-2.el9 appstream 4.7 M 2024-05-08T05:13:26.267 INFO:teuthology.orchestra.run.smithi087.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-05-08T05:13:26.267 INFO:teuthology.orchestra.run.smithi087.stdout: postgresql-private-libs x86_64 13.14-1.el9 appstream 133 k 2024-05-08T05:13:26.267 INFO:teuthology.orchestra.run.smithi087.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-05-08T05:13:26.267 INFO:teuthology.orchestra.run.smithi087.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-05-08T05:13:26.267 INFO:teuthology.orchestra.run.smithi087.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-05-08T05:13:26.267 INFO:teuthology.orchestra.run.smithi087.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-05-08T05:13:26.267 INFO:teuthology.orchestra.run.smithi087.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-05-08T05:13:26.268 INFO:teuthology.orchestra.run.smithi087.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-05-08T05:13:26.268 INFO:teuthology.orchestra.run.smithi087.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-05-08T05:13:26.268 INFO:teuthology.orchestra.run.smithi087.stdout: python3-ceph-argparse x86_64 2:19.0.0-3538.gbee299f4.el9 ceph 45 k 2024-05-08T05:13:26.268 INFO:teuthology.orchestra.run.smithi087.stdout: python3-ceph-common x86_64 2:19.0.0-3538.gbee299f4.el9 ceph 135 k 2024-05-08T05:13:26.268 INFO:teuthology.orchestra.run.smithi087.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2024-05-08T05:13:26.268 INFO:teuthology.orchestra.run.smithi087.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-05-08T05:13:26.268 INFO:teuthology.orchestra.run.smithi087.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-05-08T05:13:26.268 INFO:teuthology.orchestra.run.smithi087.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-05-08T05:13:26.268 INFO:teuthology.orchestra.run.smithi087.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-05-08T05:13:26.268 INFO:teuthology.orchestra.run.smithi087.stdout: python3-colorama noarch 0.4.4-12.el9 epel 35 k 2024-05-08T05:13:26.268 INFO:teuthology.orchestra.run.smithi087.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-05-08T05:13:26.269 INFO:teuthology.orchestra.run.smithi087.stdout: python3-devel x86_64 3.9.18-3.el9 appstream 244 k 2024-05-08T05:13:26.269 INFO:teuthology.orchestra.run.smithi087.stdout: python3-google-auth noarch 1:2.29.0-1.el9 epel 206 k 2024-05-08T05:13:26.269 INFO:teuthology.orchestra.run.smithi087.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-05-08T05:13:26.269 INFO:teuthology.orchestra.run.smithi087.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-05-08T05:13:26.269 INFO:teuthology.orchestra.run.smithi087.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-05-08T05:13:26.269 INFO:teuthology.orchestra.run.smithi087.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-05-08T05:13:26.269 INFO:teuthology.orchestra.run.smithi087.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-05-08T05:13:26.269 INFO:teuthology.orchestra.run.smithi087.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-05-08T05:13:26.269 INFO:teuthology.orchestra.run.smithi087.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-05-08T05:13:26.269 INFO:teuthology.orchestra.run.smithi087.stdout: python3-jinja2 noarch 2.11.3-5.el9 appstream 248 k 2024-05-08T05:13:26.269 INFO:teuthology.orchestra.run.smithi087.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-05-08T05:13:26.269 INFO:teuthology.orchestra.run.smithi087.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-05-08T05:13:26.269 INFO:teuthology.orchestra.run.smithi087.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-05-08T05:13:26.269 INFO:teuthology.orchestra.run.smithi087.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-05-08T05:13:26.270 INFO:teuthology.orchestra.run.smithi087.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-05-08T05:13:26.270 INFO:teuthology.orchestra.run.smithi087.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-05-08T05:13:26.270 INFO:teuthology.orchestra.run.smithi087.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-05-08T05:13:26.270 INFO:teuthology.orchestra.run.smithi087.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-05-08T05:13:26.270 INFO:teuthology.orchestra.run.smithi087.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-05-08T05:13:26.270 INFO:teuthology.orchestra.run.smithi087.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-05-08T05:13:26.270 INFO:teuthology.orchestra.run.smithi087.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-05-08T05:13:26.270 INFO:teuthology.orchestra.run.smithi087.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-05-08T05:13:26.270 INFO:teuthology.orchestra.run.smithi087.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-05-08T05:13:26.270 INFO:teuthology.orchestra.run.smithi087.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-05-08T05:13:26.270 INFO:teuthology.orchestra.run.smithi087.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-05-08T05:13:26.270 INFO:teuthology.orchestra.run.smithi087.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-05-08T05:13:26.270 INFO:teuthology.orchestra.run.smithi087.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-05-08T05:13:26.271 INFO:teuthology.orchestra.run.smithi087.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-05-08T05:13:26.271 INFO:teuthology.orchestra.run.smithi087.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-05-08T05:13:26.271 INFO:teuthology.orchestra.run.smithi087.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-05-08T05:13:26.271 INFO:teuthology.orchestra.run.smithi087.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-05-08T05:13:26.271 INFO:teuthology.orchestra.run.smithi087.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-05-08T05:13:26.271 INFO:teuthology.orchestra.run.smithi087.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-05-08T05:13:26.271 INFO:teuthology.orchestra.run.smithi087.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-05-08T05:13:26.271 INFO:teuthology.orchestra.run.smithi087.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-05-08T05:13:26.271 INFO:teuthology.orchestra.run.smithi087.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-05-08T05:13:26.271 INFO:teuthology.orchestra.run.smithi087.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-05-08T05:13:26.271 INFO:teuthology.orchestra.run.smithi087.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-05-08T05:13:26.271 INFO:teuthology.orchestra.run.smithi087.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-05-08T05:13:26.271 INFO:teuthology.orchestra.run.smithi087.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-05-08T05:13:26.271 INFO:teuthology.orchestra.run.smithi087.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-05-08T05:13:26.271 INFO:teuthology.orchestra.run.smithi087.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2024-05-08T05:13:26.272 INFO:teuthology.orchestra.run.smithi087.stdout: python3-urllib3 noarch 1.26.5-5.el9 baseos 215 k 2024-05-08T05:13:26.272 INFO:teuthology.orchestra.run.smithi087.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-05-08T05:13:26.272 INFO:teuthology.orchestra.run.smithi087.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-05-08T05:13:26.272 INFO:teuthology.orchestra.run.smithi087.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-05-08T05:13:26.272 INFO:teuthology.orchestra.run.smithi087.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-05-08T05:13:26.272 INFO:teuthology.orchestra.run.smithi087.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-05-08T05:13:26.272 INFO:teuthology.orchestra.run.smithi087.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-05-08T05:13:26.272 INFO:teuthology.orchestra.run.smithi087.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-05-08T05:13:26.272 INFO:teuthology.orchestra.run.smithi087.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2024-05-08T05:13:26.272 INFO:teuthology.orchestra.run.smithi087.stdout: socat x86_64 1.7.4.1-5.el9 appstream 305 k 2024-05-08T05:13:26.272 INFO:teuthology.orchestra.run.smithi087.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-05-08T05:13:26.272 INFO:teuthology.orchestra.run.smithi087.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-05-08T05:13:26.272 INFO:teuthology.orchestra.run.smithi087.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-05-08T05:13:26.273 INFO:teuthology.orchestra.run.smithi087.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-05-08T05:13:26.273 INFO:teuthology.orchestra.run.smithi087.stdout:Installing weak dependencies: 2024-05-08T05:13:26.273 INFO:teuthology.orchestra.run.smithi087.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-05-08T05:13:26.273 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-05-08T05:13:26.273 INFO:teuthology.orchestra.run.smithi087.stdout:Transaction Summary 2024-05-08T05:13:26.273 INFO:teuthology.orchestra.run.smithi087.stdout:======================================================================================= 2024-05-08T05:13:26.273 INFO:teuthology.orchestra.run.smithi087.stdout:Install 148 Packages 2024-05-08T05:13:26.273 INFO:teuthology.orchestra.run.smithi087.stdout:Upgrade 8 Packages 2024-05-08T05:13:26.273 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-05-08T05:13:26.274 INFO:teuthology.orchestra.run.smithi087.stdout:Total download size: 226 M 2024-05-08T05:13:26.274 INFO:teuthology.orchestra.run.smithi087.stdout:Downloading Packages: 2024-05-08T05:13:26.283 INFO:teuthology.orchestra.run.smithi090.stdout:(17/156): libradosstriper1-19.0.0-3538.gbee299f 4.9 MB/s | 500 kB 00:00 2024-05-08T05:13:26.700 INFO:teuthology.orchestra.run.smithi090.stdout:(18/156): ceph-radosgw-19.0.0-3538.gbee299f4.el 4.3 MB/s | 11 MB 00:02 2024-05-08T05:13:26.800 INFO:teuthology.orchestra.run.smithi090.stdout:(19/156): python3-ceph-argparse-19.0.0-3538.gbe 452 kB/s | 45 kB 00:00 2024-05-08T05:13:26.901 INFO:teuthology.orchestra.run.smithi090.stdout:(20/156): python3-ceph-common-19.0.0-3538.gbee2 1.3 MB/s | 135 kB 00:00 2024-05-08T05:13:26.984 INFO:teuthology.orchestra.run.smithi090.stdout:(21/156): librgw2-19.0.0-3538.gbee299f4.el9.x86 7.7 MB/s | 5.4 MB 00:00 2024-05-08T05:13:27.010 INFO:teuthology.orchestra.run.smithi090.stdout:(22/156): python3-cephfs-19.0.0-3538.gbee299f4. 1.5 MB/s | 161 kB 00:00 2024-05-08T05:13:27.060 INFO:teuthology.orchestra.run.smithi090.stdout:(23/156): python3-rados-19.0.0-3538.gbee299f4.e 4.2 MB/s | 321 kB 00:00 2024-05-08T05:13:27.094 INFO:teuthology.orchestra.run.smithi090.stdout:(24/156): python3-rbd-19.0.0-3538.gbee299f4.el9 3.5 MB/s | 299 kB 00:00 2024-05-08T05:13:27.127 INFO:teuthology.orchestra.run.smithi090.stdout:(25/156): python3-rgw-19.0.0-3538.gbee299f4.el9 1.5 MB/s | 100 kB 00:00 2024-05-08T05:13:27.178 INFO:teuthology.orchestra.run.smithi090.stdout:(26/156): rbd-fuse-19.0.0-3538.gbee299f4.el9.x8 1.0 MB/s | 85 kB 00:00 2024-05-08T05:13:27.278 INFO:teuthology.orchestra.run.smithi090.stdout:(27/156): rbd-nbd-19.0.0-3538.gbee299f4.el9.x86 1.7 MB/s | 171 kB 00:00 2024-05-08T05:13:27.331 INFO:teuthology.orchestra.run.smithi087.stdout:(1/156): ceph-19.0.0-3538.gbee299f4.el9.x86_64. 11 kB/s | 6.6 kB 00:00 2024-05-08T05:13:27.370 INFO:teuthology.orchestra.run.smithi090.stdout:(28/156): ceph-grafana-dashboards-19.0.0-3538.g 372 kB/s | 34 kB 00:00 2024-05-08T05:13:27.479 INFO:teuthology.orchestra.run.smithi090.stdout:(29/156): ceph-mgr-cephadm-19.0.0-3538.gbee299f 1.3 MB/s | 142 kB 00:00 2024-05-08T05:13:27.546 INFO:teuthology.orchestra.run.smithi090.stdout:(30/156): rbd-mirror-19.0.0-3538.gbee299f4.el9. 7.4 MB/s | 3.1 MB 00:00 2024-05-08T05:13:28.306 INFO:teuthology.orchestra.run.smithi087.stdout:(2/156): ceph-fuse-19.0.0-3538.gbee299f4.el9.x8 914 kB/s | 890 kB 00:00 2024-05-08T05:13:28.407 INFO:teuthology.orchestra.run.smithi087.stdout:(3/156): ceph-immutable-object-cache-19.0.0-353 1.4 MB/s | 145 kB 00:00 2024-05-08T05:13:28.713 INFO:teuthology.orchestra.run.smithi090.stdout:(31/156): ceph-test-19.0.0-3538.gbee299f4.el9.x 15 MB/s | 49 MB 00:03 2024-05-08T05:13:28.724 INFO:teuthology.orchestra.run.smithi087.stdout:(4/156): ceph-base-19.0.0-3538.gbee299f4.el9.x8 2.7 MB/s | 5.4 MB 00:01 2024-05-08T05:13:28.789 INFO:teuthology.orchestra.run.smithi090.stdout:(32/156): ceph-mgr-dashboard-19.0.0-3538.gbee29 2.7 MB/s | 3.5 MB 00:01 2024-05-08T05:13:28.801 INFO:teuthology.orchestra.run.smithi160.stdout:lab-extras 15 kB/s | 1.7 kB 00:00 2024-05-08T05:13:28.814 INFO:teuthology.orchestra.run.smithi090.stdout:(33/156): ceph-mgr-modules-core-19.0.0-3538.gbe 2.7 MB/s | 274 kB 00:00 2024-05-08T05:13:28.891 INFO:teuthology.orchestra.run.smithi087.stdout:(5/156): ceph-mgr-19.0.0-3538.gbee299f4.el9.x86 9.1 MB/s | 1.5 MB 00:00 2024-05-08T05:13:28.922 INFO:teuthology.orchestra.run.smithi090.stdout:(34/156): ceph-mgr-diskprediction-local-19.0.0- 5.4 MB/s | 7.4 MB 00:01 2024-05-08T05:13:28.948 INFO:teuthology.orchestra.run.smithi090.stdout:(35/156): ceph-prometheus-alerts-19.0.0-3538.gb 123 kB/s | 16 kB 00:00 2024-05-08T05:13:28.973 INFO:teuthology.orchestra.run.smithi090.stdout:(36/156): ceph-mgr-rook-19.0.0-3538.gbee299f4.e 268 kB/s | 49 kB 00:00 2024-05-08T05:13:28.998 INFO:teuthology.orchestra.run.smithi090.stdout:(37/156): ceph-volume-19.0.0-3538.gbee299f4.el9 3.5 MB/s | 273 kB 00:00 2024-05-08T05:13:29.042 INFO:teuthology.orchestra.run.smithi090.stdout:(38/156): cephfs-top-19.0.0-3538.gbee299f4.el9. 267 kB/s | 18 kB 00:00 2024-05-08T05:13:29.309 INFO:teuthology.orchestra.run.smithi090.stdout:(39/156): cephadm-19.0.0-3538.gbee299f4.el9.noa 2.1 MB/s | 763 kB 00:00 2024-05-08T05:13:29.333 INFO:teuthology.orchestra.run.smithi087.stdout:(6/156): ceph-mon-19.0.0-3538.gbee299f4.el9.x86 11 MB/s | 4.7 MB 00:00 2024-05-08T05:13:29.426 INFO:teuthology.orchestra.run.smithi090.stdout:(40/156): fuse-2.9.9-15.el9.x86_64.rpm 188 kB/s | 80 kB 00:00 2024-05-08T05:13:29.616 INFO:teuthology.orchestra.run.smithi087.stdout:(7/156): ceph-mds-19.0.0-3538.gbee299f4.el9.x86 2.0 MB/s | 2.4 MB 00:01 2024-05-08T05:13:29.701 INFO:teuthology.orchestra.run.smithi090.stdout:(41/156): python3-cffi-1.14.5-5.el9.x86_64.rpm 920 kB/s | 253 kB 00:00 2024-05-08T05:13:29.810 INFO:teuthology.orchestra.run.smithi090.stdout:(42/156): libquadmath-11.4.1-3.el9.x86_64.rpm 390 kB/s | 195 kB 00:00 2024-05-08T05:13:29.894 INFO:teuthology.orchestra.run.smithi090.stdout:(43/156): libgfortran-11.4.1-3.el9.x86_64.rpm 943 kB/s | 803 kB 00:00 2024-05-08T05:13:29.927 INFO:teuthology.orchestra.run.smithi090.stdout:(44/156): python3-ply-3.11-14.el9.noarch.rpm 910 kB/s | 106 kB 00:00 2024-05-08T05:13:30.011 INFO:teuthology.orchestra.run.smithi090.stdout:(45/156): python3-pycparser-2.20-6.el9.noarch.r 1.1 MB/s | 135 kB 00:00 2024-05-08T05:13:30.036 INFO:teuthology.orchestra.run.smithi090.stdout:(46/156): python3-requests-2.25.1-8.el9.noarch. 1.1 MB/s | 125 kB 00:00 2024-05-08T05:13:30.120 INFO:teuthology.orchestra.run.smithi090.stdout:(47/156): python3-urllib3-1.26.5-5.el9.noarch.r 1.9 MB/s | 215 kB 00:00 2024-05-08T05:13:30.295 INFO:teuthology.orchestra.run.smithi090.stdout:(48/156): python3-cryptography-36.0.1-4.el9.x86 2.1 MB/s | 1.2 MB 00:00 2024-05-08T05:13:30.495 INFO:teuthology.orchestra.run.smithi090.stdout:(49/156): automake-1.16.2-8.el9.noarch.rpm 1.5 MB/s | 689 kB 00:00 2024-05-08T05:13:30.521 INFO:teuthology.orchestra.run.smithi090.stdout:(50/156): boost-program-options-1.75.0-8.el9.x8 474 kB/s | 107 kB 00:00 2024-05-08T05:13:30.533 INFO:teuthology.orchestra.run.smithi087.stdout:(8/156): ceph-osd-19.0.0-3538.gbee299f4.el9.x86 14 MB/s | 17 MB 00:01 2024-05-08T05:13:30.546 INFO:teuthology.orchestra.run.smithi090.stdout:(51/156): elfutils-libelf-devel-0.190-2.el9.x86 426 kB/s | 21 kB 00:00 2024-05-08T05:13:30.583 INFO:teuthology.orchestra.run.smithi087.stdout:(9/156): ceph-selinux-19.0.0-3538.gbee299f4.el9 513 kB/s | 25 kB 00:00 2024-05-08T05:13:30.605 INFO:teuthology.orchestra.run.smithi090.stdout:(52/156): bison-3.7.4-5.el9.x86_64.rpm 1.9 MB/s | 943 kB 00:00 2024-05-08T05:13:30.630 INFO:teuthology.orchestra.run.smithi090.stdout:(53/156): flexiblas-3.0.4-8.el9.x86_64.rpm 391 kB/s | 33 kB 00:00 2024-05-08T05:13:30.689 INFO:teuthology.orchestra.run.smithi090.stdout:(54/156): flexiblas-openblas-openmp-3.0.4-8.el9 313 kB/s | 18 kB 00:00 2024-05-08T05:13:30.722 INFO:teuthology.orchestra.run.smithi090.stdout:(55/156): flex-2.6.4-9.el9.x86_64.rpm 1.5 MB/s | 313 kB 00:00 2024-05-08T05:13:30.756 INFO:teuthology.orchestra.run.smithi090.stdout:(56/156): libaio-devel-0.3.111-13.el9.x86_64.rp 166 kB/s | 11 kB 00:00 2024-05-08T05:13:30.806 INFO:teuthology.orchestra.run.smithi090.stdout:(57/156): libpmemobj-1.12.1-1.el9.x86_64.rpm 1.9 MB/s | 160 kB 00:00 2024-05-08T05:13:30.832 INFO:teuthology.orchestra.run.smithi090.stdout:(58/156): librabbitmq-0.11.0-7.el9.x86_64.rpm 602 kB/s | 45 kB 00:00 2024-05-08T05:13:30.867 INFO:teuthology.orchestra.run.smithi087.stdout:(10/156): ceph-common-19.0.0-3538.gbee299f4.el9 5.1 MB/s | 21 MB 00:04 2024-05-08T05:13:30.942 INFO:teuthology.orchestra.run.smithi087.stdout:(11/156): cephfs-mirror-19.0.0-3538.gbee299f4.e 3.0 MB/s | 225 kB 00:00 2024-05-08T05:13:31.026 INFO:teuthology.orchestra.run.smithi087.stdout:(12/156): cephfs-shell-19.0.0-3538.gbee299f4.el 329 kB/s | 27 kB 00:00 2024-05-08T05:13:31.052 INFO:teuthology.orchestra.run.smithi160.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-05-08T05:13:31.052 INFO:teuthology.orchestra.run.smithi160.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-05-08T05:13:31.063 INFO:teuthology.orchestra.run.smithi160.stdout:Package NetworkManager-1:1.47.4-1.el9.x86_64 is already installed. 2024-05-08T05:13:31.064 INFO:teuthology.orchestra.run.smithi160.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-05-08T05:13:31.065 INFO:teuthology.orchestra.run.smithi160.stdout:Package util-linux-2.37.4-18.el9.x86_64 is already installed. 2024-05-08T05:13:31.065 INFO:teuthology.orchestra.run.smithi090.stdout:(59/156): librdkafka-1.6.1-102.el9.x86_64.rpm 2.5 MB/s | 662 kB 00:00 2024-05-08T05:13:31.066 INFO:teuthology.orchestra.run.smithi160.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-05-08T05:13:31.067 INFO:teuthology.orchestra.run.smithi160.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-05-08T05:13:31.070 INFO:teuthology.orchestra.run.smithi160.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-05-08T05:13:31.070 INFO:teuthology.orchestra.run.smithi160.stdout:Package xfsprogs-6.3.0-1.el9.x86_64 is already installed. 2024-05-08T05:13:31.116 INFO:teuthology.orchestra.run.smithi090.stdout:(60/156): libuuid-devel-2.37.4-18.el9.x86_64.rp 508 kB/s | 25 kB 00:00 2024-05-08T05:13:31.126 INFO:teuthology.orchestra.run.smithi087.stdout:(13/156): libcephfs-devel-19.0.0-3538.gbee299f4 319 kB/s | 32 kB 00:00 2024-05-08T05:13:31.131 INFO:teuthology.orchestra.run.smithi160.stdout:Dependencies resolved. 2024-05-08T05:13:31.141 INFO:teuthology.orchestra.run.smithi160.stdout:======================================================================================= 2024-05-08T05:13:31.141 INFO:teuthology.orchestra.run.smithi160.stdout: Package Arch Version Repository Size 2024-05-08T05:13:31.141 INFO:teuthology.orchestra.run.smithi160.stdout:======================================================================================= 2024-05-08T05:13:31.141 INFO:teuthology.orchestra.run.smithi160.stdout:Installing: 2024-05-08T05:13:31.141 INFO:teuthology.orchestra.run.smithi160.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-05-08T05:13:31.141 INFO:teuthology.orchestra.run.smithi160.stdout: ceph x86_64 2:19.0.0-3538.gbee299f4.el9 ceph 6.6 k 2024-05-08T05:13:31.141 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-base x86_64 2:19.0.0-3538.gbee299f4.el9 ceph 5.4 M 2024-05-08T05:13:31.141 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-fuse x86_64 2:19.0.0-3538.gbee299f4.el9 ceph 890 k 2024-05-08T05:13:31.141 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-immutable-object-cache x86_64 2:19.0.0-3538.gbee299f4.el9 ceph 145 k 2024-05-08T05:13:31.142 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-mgr x86_64 2:19.0.0-3538.gbee299f4.el9 ceph 1.5 M 2024-05-08T05:13:31.142 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-mgr-cephadm noarch 2:19.0.0-3538.gbee299f4.el9 ceph-noarch 142 k 2024-05-08T05:13:31.142 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-mgr-dashboard noarch 2:19.0.0-3538.gbee299f4.el9 ceph-noarch 3.5 M 2024-05-08T05:13:31.142 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-mgr-diskprediction-local noarch 2:19.0.0-3538.gbee299f4.el9 ceph-noarch 7.4 M 2024-05-08T05:13:31.142 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-mgr-rook noarch 2:19.0.0-3538.gbee299f4.el9 ceph-noarch 49 k 2024-05-08T05:13:31.142 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-radosgw x86_64 2:19.0.0-3538.gbee299f4.el9 ceph 11 M 2024-05-08T05:13:31.142 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-test x86_64 2:19.0.0-3538.gbee299f4.el9 ceph 49 M 2024-05-08T05:13:31.142 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-volume noarch 2:19.0.0-3538.gbee299f4.el9 ceph-noarch 273 k 2024-05-08T05:13:31.142 INFO:teuthology.orchestra.run.smithi160.stdout: cephadm noarch 2:19.0.0-3538.gbee299f4.el9 ceph-noarch 763 k 2024-05-08T05:13:31.142 INFO:teuthology.orchestra.run.smithi160.stdout: cephfs-mirror x86_64 2:19.0.0-3538.gbee299f4.el9 ceph 225 k 2024-05-08T05:13:31.142 INFO:teuthology.orchestra.run.smithi160.stdout: cephfs-shell x86_64 2:19.0.0-3538.gbee299f4.el9 ceph 27 k 2024-05-08T05:13:31.142 INFO:teuthology.orchestra.run.smithi160.stdout: cephfs-top noarch 2:19.0.0-3538.gbee299f4.el9 ceph-noarch 18 k 2024-05-08T05:13:31.142 INFO:teuthology.orchestra.run.smithi160.stdout: elfutils-libelf-devel x86_64 0.190-2.el9 appstream 21 k 2024-05-08T05:13:31.142 INFO:teuthology.orchestra.run.smithi160.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-05-08T05:13:31.143 INFO:teuthology.orchestra.run.smithi160.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-05-08T05:13:31.143 INFO:teuthology.orchestra.run.smithi160.stdout: libcephfs-devel x86_64 2:19.0.0-3538.gbee299f4.el9 ceph 32 k 2024-05-08T05:13:31.143 INFO:teuthology.orchestra.run.smithi160.stdout: libcephfs2 x86_64 2:19.0.0-3538.gbee299f4.el9 ceph 747 k 2024-05-08T05:13:31.143 INFO:teuthology.orchestra.run.smithi160.stdout: librados-devel x86_64 2:19.0.0-3538.gbee299f4.el9 ceph 127 k 2024-05-08T05:13:31.143 INFO:teuthology.orchestra.run.smithi160.stdout: libtool x86_64 2.4.6-45.el9 appstream 582 k 2024-05-08T05:13:31.143 INFO:teuthology.orchestra.run.smithi160.stdout: libuuid-devel x86_64 2.37.4-18.el9 appstream 25 k 2024-05-08T05:13:31.143 INFO:teuthology.orchestra.run.smithi160.stdout: openssl-devel x86_64 1:3.2.1-1.el9 appstream 4.4 M 2024-05-08T05:13:31.143 INFO:teuthology.orchestra.run.smithi160.stdout: postgresql x86_64 13.14-1.el9 appstream 1.6 M 2024-05-08T05:13:31.143 INFO:teuthology.orchestra.run.smithi160.stdout: postgresql-contrib x86_64 13.14-1.el9 appstream 911 k 2024-05-08T05:13:31.143 INFO:teuthology.orchestra.run.smithi160.stdout: postgresql-server x86_64 13.14-1.el9 appstream 5.8 M 2024-05-08T05:13:31.143 INFO:teuthology.orchestra.run.smithi160.stdout: python3-cephfs x86_64 2:19.0.0-3538.gbee299f4.el9 ceph 161 k 2024-05-08T05:13:31.143 INFO:teuthology.orchestra.run.smithi160.stdout: python3-rados x86_64 2:19.0.0-3538.gbee299f4.el9 ceph 321 k 2024-05-08T05:13:31.143 INFO:teuthology.orchestra.run.smithi160.stdout: python3-rbd x86_64 2:19.0.0-3538.gbee299f4.el9 ceph 299 k 2024-05-08T05:13:31.144 INFO:teuthology.orchestra.run.smithi160.stdout: python3-rgw x86_64 2:19.0.0-3538.gbee299f4.el9 ceph 100 k 2024-05-08T05:13:31.144 INFO:teuthology.orchestra.run.smithi160.stdout: rbd-fuse x86_64 2:19.0.0-3538.gbee299f4.el9 ceph 85 k 2024-05-08T05:13:31.144 INFO:teuthology.orchestra.run.smithi160.stdout: rbd-mirror x86_64 2:19.0.0-3538.gbee299f4.el9 ceph 3.1 M 2024-05-08T05:13:31.144 INFO:teuthology.orchestra.run.smithi160.stdout: rbd-nbd x86_64 2:19.0.0-3538.gbee299f4.el9 ceph 171 k 2024-05-08T05:13:31.144 INFO:teuthology.orchestra.run.smithi160.stdout: xfsprogs-devel x86_64 6.3.0-1.el9 appstream 94 k 2024-05-08T05:13:31.144 INFO:teuthology.orchestra.run.smithi160.stdout:Upgrading: 2024-05-08T05:13:31.144 INFO:teuthology.orchestra.run.smithi160.stdout: NetworkManager x86_64 1:1.47.5-1.el9 baseos 2.3 M 2024-05-08T05:13:31.144 INFO:teuthology.orchestra.run.smithi160.stdout: NetworkManager-libnm x86_64 1:1.47.5-1.el9 baseos 1.8 M 2024-05-08T05:13:31.144 INFO:teuthology.orchestra.run.smithi160.stdout: NetworkManager-team x86_64 1:1.47.5-1.el9 baseos 42 k 2024-05-08T05:13:31.144 INFO:teuthology.orchestra.run.smithi160.stdout: NetworkManager-tui x86_64 1:1.47.5-1.el9 baseos 248 k 2024-05-08T05:13:31.144 INFO:teuthology.orchestra.run.smithi160.stdout: librados2 x86_64 2:19.0.0-3538.gbee299f4.el9 ceph 3.4 M 2024-05-08T05:13:31.144 INFO:teuthology.orchestra.run.smithi160.stdout: librbd1 x86_64 2:19.0.0-3538.gbee299f4.el9 ceph 3.1 M 2024-05-08T05:13:31.144 INFO:teuthology.orchestra.run.smithi160.stdout: openssl x86_64 1:3.2.1-1.el9 baseos 1.3 M 2024-05-08T05:13:31.144 INFO:teuthology.orchestra.run.smithi160.stdout: openssl-libs x86_64 1:3.2.1-1.el9 baseos 2.4 M 2024-05-08T05:13:31.145 INFO:teuthology.orchestra.run.smithi160.stdout:Installing dependencies: 2024-05-08T05:13:31.145 INFO:teuthology.orchestra.run.smithi160.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-05-08T05:13:31.145 INFO:teuthology.orchestra.run.smithi160.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-05-08T05:13:31.145 INFO:teuthology.orchestra.run.smithi160.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-05-08T05:13:31.145 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-common x86_64 2:19.0.0-3538.gbee299f4.el9 ceph 21 M 2024-05-08T05:13:31.145 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-grafana-dashboards noarch 2:19.0.0-3538.gbee299f4.el9 ceph-noarch 34 k 2024-05-08T05:13:31.145 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-mds x86_64 2:19.0.0-3538.gbee299f4.el9 ceph 2.4 M 2024-05-08T05:13:31.145 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-mgr-modules-core noarch 2:19.0.0-3538.gbee299f4.el9 ceph-noarch 274 k 2024-05-08T05:13:31.145 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-mon x86_64 2:19.0.0-3538.gbee299f4.el9 ceph 4.7 M 2024-05-08T05:13:31.145 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-osd x86_64 2:19.0.0-3538.gbee299f4.el9 ceph 17 M 2024-05-08T05:13:31.145 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-prometheus-alerts noarch 2:19.0.0-3538.gbee299f4.el9 ceph-noarch 16 k 2024-05-08T05:13:31.145 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-selinux x86_64 2:19.0.0-3538.gbee299f4.el9 ceph 25 k 2024-05-08T05:13:31.145 INFO:teuthology.orchestra.run.smithi160.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-05-08T05:13:31.145 INFO:teuthology.orchestra.run.smithi160.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-05-08T05:13:31.146 INFO:teuthology.orchestra.run.smithi160.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-05-08T05:13:31.146 INFO:teuthology.orchestra.run.smithi160.stdout: fuse x86_64 2.9.9-15.el9 baseos 80 k 2024-05-08T05:13:31.146 INFO:teuthology.orchestra.run.smithi160.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-05-08T05:13:31.146 INFO:teuthology.orchestra.run.smithi160.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-05-08T05:13:31.146 INFO:teuthology.orchestra.run.smithi160.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-05-08T05:13:31.146 INFO:teuthology.orchestra.run.smithi160.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-05-08T05:13:31.146 INFO:teuthology.orchestra.run.smithi160.stdout: libcephsqlite x86_64 2:19.0.0-3538.gbee299f4.el9 ceph 163 k 2024-05-08T05:13:31.146 INFO:teuthology.orchestra.run.smithi160.stdout: libgfortran x86_64 11.4.1-3.el9 baseos 803 k 2024-05-08T05:13:31.146 INFO:teuthology.orchestra.run.smithi160.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-05-08T05:13:31.146 INFO:teuthology.orchestra.run.smithi160.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-05-08T05:13:31.146 INFO:teuthology.orchestra.run.smithi160.stdout: libquadmath x86_64 11.4.1-3.el9 baseos 195 k 2024-05-08T05:13:31.146 INFO:teuthology.orchestra.run.smithi160.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-05-08T05:13:31.147 INFO:teuthology.orchestra.run.smithi160.stdout: libradosstriper1 x86_64 2:19.0.0-3538.gbee299f4.el9 ceph 500 k 2024-05-08T05:13:31.147 INFO:teuthology.orchestra.run.smithi160.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-05-08T05:13:31.147 INFO:teuthology.orchestra.run.smithi160.stdout: librgw2 x86_64 2:19.0.0-3538.gbee299f4.el9 ceph 5.4 M 2024-05-08T05:13:31.147 INFO:teuthology.orchestra.run.smithi160.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-05-08T05:13:31.147 INFO:teuthology.orchestra.run.smithi160.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-05-08T05:13:31.147 INFO:teuthology.orchestra.run.smithi160.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-05-08T05:13:31.147 INFO:teuthology.orchestra.run.smithi160.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-05-08T05:13:31.147 INFO:teuthology.orchestra.run.smithi160.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-05-08T05:13:31.147 INFO:teuthology.orchestra.run.smithi160.stdout: luarocks noarch 3.9.2-1.el9 epel 151 k 2024-05-08T05:13:31.147 INFO:teuthology.orchestra.run.smithi160.stdout: openblas x86_64 0.3.21-2.el9 appstream 35 k 2024-05-08T05:13:31.147 INFO:teuthology.orchestra.run.smithi160.stdout: openblas-openmp x86_64 0.3.21-2.el9 appstream 4.7 M 2024-05-08T05:13:31.147 INFO:teuthology.orchestra.run.smithi160.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-05-08T05:13:31.147 INFO:teuthology.orchestra.run.smithi160.stdout: postgresql-private-libs x86_64 13.14-1.el9 appstream 133 k 2024-05-08T05:13:31.147 INFO:teuthology.orchestra.run.smithi160.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-05-08T05:13:31.148 INFO:teuthology.orchestra.run.smithi160.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-05-08T05:13:31.148 INFO:teuthology.orchestra.run.smithi160.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-05-08T05:13:31.148 INFO:teuthology.orchestra.run.smithi160.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-05-08T05:13:31.148 INFO:teuthology.orchestra.run.smithi160.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-05-08T05:13:31.148 INFO:teuthology.orchestra.run.smithi160.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-05-08T05:13:31.148 INFO:teuthology.orchestra.run.smithi160.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-05-08T05:13:31.148 INFO:teuthology.orchestra.run.smithi160.stdout: python3-ceph-argparse x86_64 2:19.0.0-3538.gbee299f4.el9 ceph 45 k 2024-05-08T05:13:31.148 INFO:teuthology.orchestra.run.smithi160.stdout: python3-ceph-common x86_64 2:19.0.0-3538.gbee299f4.el9 ceph 135 k 2024-05-08T05:13:31.148 INFO:teuthology.orchestra.run.smithi160.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2024-05-08T05:13:31.148 INFO:teuthology.orchestra.run.smithi160.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-05-08T05:13:31.148 INFO:teuthology.orchestra.run.smithi160.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-05-08T05:13:31.148 INFO:teuthology.orchestra.run.smithi160.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-05-08T05:13:31.149 INFO:teuthology.orchestra.run.smithi160.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-05-08T05:13:31.149 INFO:teuthology.orchestra.run.smithi160.stdout: python3-colorama noarch 0.4.4-12.el9 epel 35 k 2024-05-08T05:13:31.149 INFO:teuthology.orchestra.run.smithi160.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-05-08T05:13:31.149 INFO:teuthology.orchestra.run.smithi160.stdout: python3-devel x86_64 3.9.18-3.el9 appstream 244 k 2024-05-08T05:13:31.149 INFO:teuthology.orchestra.run.smithi160.stdout: python3-google-auth noarch 1:2.29.0-1.el9 epel 206 k 2024-05-08T05:13:31.149 INFO:teuthology.orchestra.run.smithi160.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-05-08T05:13:31.149 INFO:teuthology.orchestra.run.smithi160.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-05-08T05:13:31.149 INFO:teuthology.orchestra.run.smithi160.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-05-08T05:13:31.149 INFO:teuthology.orchestra.run.smithi160.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-05-08T05:13:31.149 INFO:teuthology.orchestra.run.smithi160.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-05-08T05:13:31.149 INFO:teuthology.orchestra.run.smithi160.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-05-08T05:13:31.149 INFO:teuthology.orchestra.run.smithi160.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-05-08T05:13:31.149 INFO:teuthology.orchestra.run.smithi160.stdout: python3-jinja2 noarch 2.11.3-5.el9 appstream 248 k 2024-05-08T05:13:31.149 INFO:teuthology.orchestra.run.smithi160.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-05-08T05:13:31.150 INFO:teuthology.orchestra.run.smithi160.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-05-08T05:13:31.150 INFO:teuthology.orchestra.run.smithi160.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-05-08T05:13:31.150 INFO:teuthology.orchestra.run.smithi160.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-05-08T05:13:31.150 INFO:teuthology.orchestra.run.smithi160.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-05-08T05:13:31.150 INFO:teuthology.orchestra.run.smithi160.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-05-08T05:13:31.150 INFO:teuthology.orchestra.run.smithi160.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-05-08T05:13:31.150 INFO:teuthology.orchestra.run.smithi160.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-05-08T05:13:31.150 INFO:teuthology.orchestra.run.smithi160.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-05-08T05:13:31.150 INFO:teuthology.orchestra.run.smithi160.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-05-08T05:13:31.150 INFO:teuthology.orchestra.run.smithi160.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-05-08T05:13:31.150 INFO:teuthology.orchestra.run.smithi160.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-05-08T05:13:31.150 INFO:teuthology.orchestra.run.smithi160.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-05-08T05:13:31.150 INFO:teuthology.orchestra.run.smithi160.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-05-08T05:13:31.150 INFO:teuthology.orchestra.run.smithi160.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-05-08T05:13:31.150 INFO:teuthology.orchestra.run.smithi160.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-05-08T05:13:31.151 INFO:teuthology.orchestra.run.smithi160.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-05-08T05:13:31.151 INFO:teuthology.orchestra.run.smithi160.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-05-08T05:13:31.151 INFO:teuthology.orchestra.run.smithi160.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-05-08T05:13:31.151 INFO:teuthology.orchestra.run.smithi160.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-05-08T05:13:31.151 INFO:teuthology.orchestra.run.smithi160.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-05-08T05:13:31.151 INFO:teuthology.orchestra.run.smithi160.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-05-08T05:13:31.151 INFO:teuthology.orchestra.run.smithi160.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-05-08T05:13:31.151 INFO:teuthology.orchestra.run.smithi160.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-05-08T05:13:31.151 INFO:teuthology.orchestra.run.smithi160.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-05-08T05:13:31.151 INFO:teuthology.orchestra.run.smithi160.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-05-08T05:13:31.151 INFO:teuthology.orchestra.run.smithi160.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-05-08T05:13:31.151 INFO:teuthology.orchestra.run.smithi160.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-05-08T05:13:31.151 INFO:teuthology.orchestra.run.smithi160.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-05-08T05:13:31.151 INFO:teuthology.orchestra.run.smithi160.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-05-08T05:13:31.151 INFO:teuthology.orchestra.run.smithi160.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-05-08T05:13:31.151 INFO:teuthology.orchestra.run.smithi160.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2024-05-08T05:13:31.151 INFO:teuthology.orchestra.run.smithi160.stdout: python3-urllib3 noarch 1.26.5-5.el9 baseos 215 k 2024-05-08T05:13:31.152 INFO:teuthology.orchestra.run.smithi160.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-05-08T05:13:31.152 INFO:teuthology.orchestra.run.smithi160.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-05-08T05:13:31.152 INFO:teuthology.orchestra.run.smithi160.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-05-08T05:13:31.152 INFO:teuthology.orchestra.run.smithi160.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-05-08T05:13:31.152 INFO:teuthology.orchestra.run.smithi160.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-05-08T05:13:31.152 INFO:teuthology.orchestra.run.smithi160.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-05-08T05:13:31.152 INFO:teuthology.orchestra.run.smithi160.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-05-08T05:13:31.152 INFO:teuthology.orchestra.run.smithi160.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2024-05-08T05:13:31.152 INFO:teuthology.orchestra.run.smithi160.stdout: socat x86_64 1.7.4.1-5.el9 appstream 305 k 2024-05-08T05:13:31.152 INFO:teuthology.orchestra.run.smithi160.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-05-08T05:13:31.152 INFO:teuthology.orchestra.run.smithi160.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-05-08T05:13:31.152 INFO:teuthology.orchestra.run.smithi160.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-05-08T05:13:31.152 INFO:teuthology.orchestra.run.smithi160.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-05-08T05:13:31.153 INFO:teuthology.orchestra.run.smithi160.stdout:Installing weak dependencies: 2024-05-08T05:13:31.153 INFO:teuthology.orchestra.run.smithi160.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-05-08T05:13:31.153 INFO:teuthology.orchestra.run.smithi160.stdout: 2024-05-08T05:13:31.153 INFO:teuthology.orchestra.run.smithi160.stdout:Transaction Summary 2024-05-08T05:13:31.153 INFO:teuthology.orchestra.run.smithi160.stdout:======================================================================================= 2024-05-08T05:13:31.153 INFO:teuthology.orchestra.run.smithi160.stdout:Install 148 Packages 2024-05-08T05:13:31.153 INFO:teuthology.orchestra.run.smithi160.stdout:Upgrade 8 Packages 2024-05-08T05:13:31.153 INFO:teuthology.orchestra.run.smithi160.stdout: 2024-05-08T05:13:31.153 INFO:teuthology.orchestra.run.smithi090.stdout:(61/156): libtool-2.4.6-45.el9.x86_64.rpm 1.8 MB/s | 582 kB 00:00 2024-05-08T05:13:31.154 INFO:teuthology.orchestra.run.smithi160.stdout:Total download size: 226 M 2024-05-08T05:13:31.154 INFO:teuthology.orchestra.run.smithi160.stdout:Downloading Packages: 2024-05-08T05:13:31.175 INFO:teuthology.orchestra.run.smithi090.stdout:(62/156): libzstd-devel-1.5.1-2.el9.x86_64.rpm 809 kB/s | 47 kB 00:00 2024-05-08T05:13:31.260 INFO:teuthology.orchestra.run.smithi090.stdout:(63/156): lua-5.4.4-4.el9.x86_64.rpm 2.2 MB/s | 188 kB 00:00 2024-05-08T05:13:31.319 INFO:teuthology.orchestra.run.smithi090.stdout:(64/156): lttng-ust-2.12.0-6.el9.x86_64.rpm 1.7 MB/s | 292 kB 00:00 2024-05-08T05:13:31.343 INFO:teuthology.orchestra.run.smithi087.stdout:(14/156): libcephfs2-19.0.0-3538.gbee299f4.el9. 3.4 MB/s | 747 kB 00:00 2024-05-08T05:13:31.344 INFO:teuthology.orchestra.run.smithi090.stdout:(65/156): openblas-0.3.21-2.el9.x86_64.rpm 421 kB/s | 35 kB 00:00 2024-05-08T05:13:31.460 INFO:teuthology.orchestra.run.smithi087.stdout:(15/156): libcephsqlite-19.0.0-3538.gbee299f4.e 1.4 MB/s | 163 kB 00:00 2024-05-08T05:13:31.585 INFO:teuthology.orchestra.run.smithi087.stdout:(16/156): librados-devel-19.0.0-3538.gbee299f4. 1.0 MB/s | 127 kB 00:00 2024-05-08T05:13:31.669 INFO:teuthology.orchestra.run.smithi090.stdout:(66/156): flexiblas-netlib-3.0.4-8.el9.x86_64.r 2.8 MB/s | 3.0 MB 00:01 2024-05-08T05:13:32.019 INFO:teuthology.orchestra.run.smithi160.stdout:(1/156): ceph-19.0.0-3538.gbee299f4.el9.x86_64. 22 kB/s | 6.6 kB 00:00 2024-05-08T05:13:32.369 INFO:teuthology.orchestra.run.smithi090.stdout:(67/156): postgresql-13.14-1.el9.x86_64.rpm 2.3 MB/s | 1.6 MB 00:00 2024-05-08T05:13:32.595 INFO:teuthology.orchestra.run.smithi160.stdout:(2/156): ceph-fuse-19.0.0-3538.gbee299f4.el9.x8 1.5 MB/s | 890 kB 00:00 2024-05-08T05:13:32.620 INFO:teuthology.orchestra.run.smithi090.stdout:(68/156): postgresql-contrib-13.14-1.el9.x86_64 3.6 MB/s | 911 kB 00:00 2024-05-08T05:13:32.677 INFO:teuthology.orchestra.run.smithi087.stdout:(17/156): libradosstriper1-19.0.0-3538.gbee299f 459 kB/s | 500 kB 00:01 2024-05-08T05:13:32.678 INFO:teuthology.orchestra.run.smithi160.stdout:(3/156): ceph-immutable-object-cache-19.0.0-353 1.7 MB/s | 145 kB 00:00 2024-05-08T05:13:32.678 INFO:teuthology.orchestra.run.smithi090.stdout:(69/156): postgresql-private-libs-13.14-1.el9.x 2.2 MB/s | 133 kB 00:00 2024-05-08T05:13:32.796 INFO:teuthology.orchestra.run.smithi090.stdout:(70/156): openblas-openmp-0.3.21-2.el9.x86_64.r 3.2 MB/s | 4.7 MB 00:01 2024-05-08T05:13:32.896 INFO:teuthology.orchestra.run.smithi090.stdout:(71/156): openssl-devel-3.2.1-1.el9.x86_64.rpm 2.9 MB/s | 4.4 MB 00:01 2024-05-08T05:13:32.946 INFO:teuthology.orchestra.run.smithi090.stdout:(72/156): python3-attrs-20.3.0-7.el9.noarch.rpm 1.7 MB/s | 87 kB 00:00 2024-05-08T05:13:32.962 INFO:teuthology.orchestra.run.smithi160.stdout:(4/156): ceph-mds-19.0.0-3538.gbee299f4.el9.x86 8.3 MB/s | 2.4 MB 00:00 2024-05-08T05:13:33.046 INFO:teuthology.orchestra.run.smithi090.stdout:(73/156): protobuf-3.14.0-13.el9.x86_64.rpm 4.0 MB/s | 1.0 MB 00:00 2024-05-08T05:13:33.120 INFO:teuthology.orchestra.run.smithi160.stdout:(5/156): ceph-mgr-19.0.0-3538.gbee299f4.el9.x86 9.6 MB/s | 1.5 MB 00:00 2024-05-08T05:13:33.130 INFO:teuthology.orchestra.run.smithi090.stdout:(74/156): python3-devel-3.9.18-3.el9.x86_64.rpm 2.9 MB/s | 244 kB 00:00 2024-05-08T05:13:33.194 INFO:teuthology.orchestra.run.smithi087.stdout:(18/156): ceph-test-19.0.0-3538.gbee299f4.el9.x 19 MB/s | 49 MB 00:02 2024-05-08T05:13:33.214 INFO:teuthology.orchestra.run.smithi090.stdout:(75/156): python3-jinja2-2.11.3-5.el9.noarch.rp 2.9 MB/s | 248 kB 00:00 2024-05-08T05:13:33.264 INFO:teuthology.orchestra.run.smithi090.stdout:(76/156): python3-jsonpatch-1.21-16.el9.noarch. 513 kB/s | 26 kB 00:00 2024-05-08T05:13:33.315 INFO:teuthology.orchestra.run.smithi090.stdout:(77/156): python3-jsonpointer-2.0-4.el9.noarch. 384 kB/s | 19 kB 00:00 2024-05-08T05:13:33.373 INFO:teuthology.orchestra.run.smithi090.stdout:(78/156): python3-mako-1.1.4-6.el9.noarch.rpm 2.9 MB/s | 172 kB 00:00 2024-05-08T05:13:33.424 INFO:teuthology.orchestra.run.smithi090.stdout:(79/156): python3-markupsafe-1.1.1-12.el9.x86_6 692 kB/s | 35 kB 00:00 2024-05-08T05:13:33.453 INFO:teuthology.orchestra.run.smithi087.stdout:(19/156): librgw2-19.0.0-3538.gbee299f4.el9.x86 6.9 MB/s | 5.4 MB 00:00 2024-05-08T05:13:33.495 INFO:teuthology.orchestra.run.smithi087.stdout:(20/156): python3-ceph-argparse-19.0.0-3538.gbe 151 kB/s | 45 kB 00:00 2024-05-08T05:13:33.531 INFO:teuthology.orchestra.run.smithi160.stdout:(6/156): ceph-base-19.0.0-3538.gbee299f4.el9.x8 3.0 MB/s | 5.4 MB 00:01 2024-05-08T05:13:33.531 INFO:teuthology.orchestra.run.smithi087.stdout:(21/156): python3-ceph-common-19.0.0-3538.gbee2 2.0 MB/s | 135 kB 00:00 2024-05-08T05:13:33.587 INFO:teuthology.orchestra.run.smithi087.stdout:(22/156): python3-cephfs-19.0.0-3538.gbee299f4. 1.7 MB/s | 161 kB 00:00 2024-05-08T05:13:33.621 INFO:teuthology.orchestra.run.smithi087.stdout:(23/156): python3-rados-19.0.0-3538.gbee299f4.e 3.2 MB/s | 321 kB 00:00 2024-05-08T05:13:33.671 INFO:teuthology.orchestra.run.smithi087.stdout:(24/156): python3-rbd-19.0.0-3538.gbee299f4.el9 3.5 MB/s | 299 kB 00:00 2024-05-08T05:13:33.713 INFO:teuthology.orchestra.run.smithi087.stdout:(25/156): python3-rgw-19.0.0-3538.gbee299f4.el9 1.1 MB/s | 100 kB 00:00 2024-05-08T05:13:33.746 INFO:teuthology.orchestra.run.smithi087.stdout:(26/156): rbd-fuse-19.0.0-3538.gbee299f4.el9.x8 1.1 MB/s | 85 kB 00:00 2024-05-08T05:13:33.847 INFO:teuthology.orchestra.run.smithi087.stdout:(27/156): rbd-nbd-19.0.0-3538.gbee299f4.el9.x86 1.7 MB/s | 171 kB 00:00 2024-05-08T05:13:33.921 INFO:teuthology.orchestra.run.smithi160.stdout:(7/156): ceph-mon-19.0.0-3538.gbee299f4.el9.x86 5.9 MB/s | 4.7 MB 00:00 2024-05-08T05:13:33.924 INFO:teuthology.orchestra.run.smithi090.stdout:(80/156): postgresql-server-13.14-1.el9.x86_64. 4.6 MB/s | 5.8 MB 00:01 2024-05-08T05:13:33.930 INFO:teuthology.orchestra.run.smithi087.stdout:(28/156): ceph-grafana-dashboards-19.0.0-3538.g 415 kB/s | 34 kB 00:00 2024-05-08T05:13:34.022 INFO:teuthology.orchestra.run.smithi087.stdout:(29/156): ceph-mgr-cephadm-19.0.0-3538.gbee299f 1.5 MB/s | 142 kB 00:00 2024-05-08T05:13:34.049 INFO:teuthology.orchestra.run.smithi090.stdout:(81/156): python3-numpy-1.20.1-5.el9.x86_64.rpm 8.2 MB/s | 5.1 MB 00:00 2024-05-08T05:13:34.075 INFO:teuthology.orchestra.run.smithi090.stdout:(82/156): python3-numpy-f2py-1.20.1-5.el9.x86_6 1.6 MB/s | 250 kB 00:00 2024-05-08T05:13:34.108 INFO:teuthology.orchestra.run.smithi090.stdout:(83/156): python3-oauthlib-3.1.1-5.el9.noarch.r 3.7 MB/s | 222 kB 00:00 2024-05-08T05:13:34.134 INFO:teuthology.orchestra.run.smithi090.stdout:(84/156): python3-packaging-20.9-5.el9.noarch.r 1.3 MB/s | 77 kB 00:00 2024-05-08T05:13:34.259 INFO:teuthology.orchestra.run.smithi090.stdout:(85/156): python3-babel-2.9.1-2.el9.noarch.rpm 4.5 MB/s | 6.0 MB 00:01 2024-05-08T05:13:34.286 INFO:teuthology.orchestra.run.smithi090.stdout:(86/156): python3-prettytable-0.7.2-27.el9.noar 239 kB/s | 42 kB 00:00 2024-05-08T05:13:34.311 INFO:teuthology.orchestra.run.smithi090.stdout:(87/156): python3-protobuf-3.14.0-13.el9.noarch 1.5 MB/s | 269 kB 00:00 2024-05-08T05:13:34.336 INFO:teuthology.orchestra.run.smithi090.stdout:(88/156): python3-pyasn1-0.4.8-6.el9.noarch.rpm 2.0 MB/s | 159 kB 00:00 2024-05-08T05:13:34.370 INFO:teuthology.orchestra.run.smithi090.stdout:(89/156): python3-pytz-2021.1-5.el9.noarch.rpm 871 kB/s | 51 kB 00:00 2024-05-08T05:13:34.395 INFO:teuthology.orchestra.run.smithi090.stdout:(90/156): python3-requests-oauthlib-1.3.0-12.el 915 kB/s | 54 kB 00:00 2024-05-08T05:13:34.421 INFO:teuthology.orchestra.run.smithi090.stdout:(91/156): python3-pyasn1-modules-0.4.8-6.el9.no 2.0 MB/s | 279 kB 00:00 2024-05-08T05:13:34.454 INFO:teuthology.orchestra.run.smithi090.stdout:(92/156): python3-toml-0.10.2-6.el9.noarch.rpm 709 kB/s | 42 kB 00:00 2024-05-08T05:13:34.480 INFO:teuthology.orchestra.run.smithi090.stdout:(93/156): python3-wcwidth-0.2.5-8.el9.noarch.rp 753 kB/s | 44 kB 00:00 2024-05-08T05:13:34.506 INFO:teuthology.orchestra.run.smithi087.stdout:(30/156): ceph-mgr-dashboard-19.0.0-3538.gbee29 7.3 MB/s | 3.5 MB 00:00 2024-05-08T05:13:34.538 INFO:teuthology.orchestra.run.smithi090.stdout:(94/156): qatlib-service-24.02.0-1.el9.x86_64.r 614 kB/s | 36 kB 00:00 2024-05-08T05:13:34.564 INFO:teuthology.orchestra.run.smithi090.stdout:(95/156): qatlib-24.02.0-1.el9.x86_64.rpm 2.0 MB/s | 221 kB 00:00 2024-05-08T05:13:34.597 INFO:teuthology.orchestra.run.smithi090.stdout:(96/156): qatzip-libs-1.2.0-1.el9.x86_64.rpm 811 kB/s | 47 kB 00:00 2024-05-08T05:13:34.656 INFO:teuthology.orchestra.run.smithi090.stdout:(97/156): socat-1.7.4.1-5.el9.x86_64.rpm 3.2 MB/s | 305 kB 00:00 2024-05-08T05:13:34.681 INFO:teuthology.orchestra.run.smithi090.stdout:(98/156): uuid-1.6.2-55.el9.x86_64.rpm 690 kB/s | 58 kB 00:00 2024-05-08T05:13:34.715 INFO:teuthology.orchestra.run.smithi090.stdout:(99/156): xfsprogs-devel-6.3.0-1.el9.x86_64.rpm 1.6 MB/s | 94 kB 00:00 2024-05-08T05:13:34.740 INFO:teuthology.orchestra.run.smithi090.stdout:(100/156): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.1 MB/s | 64 kB 00:00 2024-05-08T05:13:34.774 INFO:teuthology.orchestra.run.smithi090.stdout:(101/156): zlib-devel-1.2.11-41.el9.x86_64.rpm 764 kB/s | 45 kB 00:00 2024-05-08T05:13:34.856 INFO:teuthology.orchestra.run.smithi087.stdout:(31/156): rbd-mirror-19.0.0-3538.gbee299f4.el9. 2.7 MB/s | 3.1 MB 00:01 2024-05-08T05:13:34.925 INFO:teuthology.orchestra.run.smithi090.stdout:(102/156): lua-devel-5.4.4-4.el9.x86_64.rpm 121 kB/s | 22 kB 00:00 2024-05-08T05:13:34.990 INFO:teuthology.orchestra.run.smithi087.stdout:(32/156): ceph-mgr-modules-core-19.0.0-3538.gbe 2.0 MB/s | 274 kB 00:00 2024-05-08T05:13:35.099 INFO:teuthology.orchestra.run.smithi087.stdout:(33/156): ceph-mgr-rook-19.0.0-3538.gbee299f4.e 459 kB/s | 49 kB 00:00 2024-05-08T05:13:35.125 INFO:teuthology.orchestra.run.smithi090.stdout:(103/156): abseil-cpp-20211102.0-3.el9.x86_64.r 2.7 MB/s | 548 kB 00:00 2024-05-08T05:13:35.199 INFO:teuthology.orchestra.run.smithi087.stdout:(34/156): ceph-prometheus-alerts-19.0.0-3538.gb 165 kB/s | 16 kB 00:00 2024-05-08T05:13:35.200 INFO:teuthology.orchestra.run.smithi090.stdout:(104/156): gperftools-libs-2.9.1-2.el9.x86_64.r 4.0 MB/s | 309 kB 00:00 2024-05-08T05:13:35.242 INFO:teuthology.orchestra.run.smithi090.stdout:(105/156): grpc-data-1.46.7-10.el9.noarch.rpm 467 kB/s | 19 kB 00:00 2024-05-08T05:13:35.366 INFO:teuthology.orchestra.run.smithi087.stdout:(35/156): ceph-mgr-diskprediction-local-19.0.0- 8.6 MB/s | 7.4 MB 00:00 2024-05-08T05:13:35.400 INFO:teuthology.orchestra.run.smithi087.stdout:(36/156): ceph-volume-19.0.0-3538.gbee299f4.el9 1.3 MB/s | 273 kB 00:00 2024-05-08T05:13:35.421 INFO:teuthology.orchestra.run.smithi160.stdout:(8/156): ceph-radosgw-19.0.0-3538.gbee299f4.el9 7.1 MB/s | 11 MB 00:01 2024-05-08T05:13:35.466 INFO:teuthology.orchestra.run.smithi087.stdout:(37/156): cephadm-19.0.0-3538.gbee299f4.el9.noa 7.5 MB/s | 763 kB 00:00 2024-05-08T05:13:35.468 INFO:teuthology.orchestra.run.smithi090.stdout:(106/156): protobuf-compiler-3.14.0-13.el9.x86_ 1.2 MB/s | 863 kB 00:00 2024-05-08T05:13:35.479 INFO:teuthology.orchestra.run.smithi160.stdout:(9/156): ceph-selinux-19.0.0-3538.gbee299f4.el9 434 kB/s | 25 kB 00:00 2024-05-08T05:13:35.483 INFO:teuthology.orchestra.run.smithi087.stdout:(38/156): cephfs-top-19.0.0-3538.gbee299f4.el9. 221 kB/s | 18 kB 00:00 2024-05-08T05:13:35.542 INFO:teuthology.orchestra.run.smithi087.stdout:(39/156): fuse-2.9.9-15.el9.x86_64.rpm 1.1 MB/s | 80 kB 00:00 2024-05-08T05:13:35.551 INFO:teuthology.orchestra.run.smithi090.stdout:(107/156): libarrow-doc-9.0.0-11.el9.noarch.rpm 312 kB/s | 26 kB 00:00 2024-05-08T05:13:35.609 INFO:teuthology.orchestra.run.smithi087.stdout:(40/156): libgfortran-11.4.1-3.el9.x86_64.rpm 6.3 MB/s | 803 kB 00:00 2024-05-08T05:13:35.651 INFO:teuthology.orchestra.run.smithi087.stdout:(41/156): libquadmath-11.4.1-3.el9.x86_64.rpm 1.8 MB/s | 195 kB 00:00 2024-05-08T05:13:35.652 INFO:teuthology.orchestra.run.smithi090.stdout:(108/156): libarrow-9.0.0-11.el9.x86_64.rpm 11 MB/s | 4.4 MB 00:00 2024-05-08T05:13:35.677 INFO:teuthology.orchestra.run.smithi090.stdout:(109/156): liboath-2.6.7-2.el9.x86_64.rpm 387 kB/s | 49 kB 00:00 2024-05-08T05:13:35.704 INFO:teuthology.orchestra.run.smithi090.stdout:(110/156): libunwind-1.6.2-1.el9.x86_64.rpm 1.3 MB/s | 67 kB 00:00 2024-05-08T05:13:35.726 INFO:teuthology.orchestra.run.smithi087.stdout:(42/156): python3-cffi-1.14.5-5.el9.x86_64.rpm 2.1 MB/s | 253 kB 00:00 2024-05-08T05:13:35.754 INFO:teuthology.orchestra.run.smithi090.stdout:(111/156): luarocks-3.9.2-1.el9.noarch.rpm 1.9 MB/s | 151 kB 00:00 2024-05-08T05:13:35.793 INFO:teuthology.orchestra.run.smithi087.stdout:(43/156): python3-cryptography-36.0.1-4.el9.x86 8.7 MB/s | 1.2 MB 00:00 2024-05-08T05:13:35.804 INFO:teuthology.orchestra.run.smithi090.stdout:(112/156): parquet-libs-9.0.0-11.el9.x86_64.rpm 8.2 MB/s | 839 kB 00:00 2024-05-08T05:13:35.827 INFO:teuthology.orchestra.run.smithi087.stdout:(44/156): python3-ply-3.11-14.el9.noarch.rpm 1.1 MB/s | 106 kB 00:00 2024-05-08T05:13:35.846 INFO:teuthology.orchestra.run.smithi090.stdout:(113/156): python3-bcrypt-3.2.2-1.el9.x86_64.rp 1.0 MB/s | 43 kB 00:00 2024-05-08T05:13:35.877 INFO:teuthology.orchestra.run.smithi087.stdout:(45/156): python3-pycparser-2.20-6.el9.noarch.r 1.6 MB/s | 135 kB 00:00 2024-05-08T05:13:35.888 INFO:teuthology.orchestra.run.smithi090.stdout:(114/156): python3-cachetools-4.2.4-1.el9.noarc 775 kB/s | 32 kB 00:00 2024-05-08T05:13:35.930 INFO:teuthology.orchestra.run.smithi090.stdout:(115/156): python3-certifi-2021.10.8-2.el9.noar 360 kB/s | 15 kB 00:00 2024-05-08T05:13:35.964 INFO:teuthology.orchestra.run.smithi090.stdout:(116/156): python3-asyncssh-2.13.2-5.el9.noarch 2.6 MB/s | 548 kB 00:00 2024-05-08T05:13:35.990 INFO:teuthology.orchestra.run.smithi090.stdout:(117/156): python3-cheroot-8.6.0-4.el9.noarch.r 2.9 MB/s | 172 kB 00:00 2024-05-08T05:13:36.040 INFO:teuthology.orchestra.run.smithi090.stdout:(118/156): python3-cmd2-2.4.2-2.el9.noarch.rpm 5.9 MB/s | 303 kB 00:00 2024-05-08T05:13:36.044 INFO:teuthology.orchestra.run.smithi087.stdout:(46/156): ceph-radosgw-19.0.0-3538.gbee299f4.el 1.6 MB/s | 11 MB 00:06 2024-05-08T05:13:36.069 INFO:teuthology.orchestra.run.smithi087.stdout:(47/156): python3-requests-2.25.1-8.el9.noarch. 517 kB/s | 125 kB 00:00 2024-05-08T05:13:36.090 INFO:teuthology.orchestra.run.smithi090.stdout:(119/156): python3-colorama-0.4.4-12.el9.noarch 706 kB/s | 35 kB 00:00 2024-05-08T05:13:36.115 INFO:teuthology.orchestra.run.smithi090.stdout:(120/156): python3-cherrypy-18.6.1-2.el9.noarch 2.3 MB/s | 358 kB 00:00 2024-05-08T05:13:36.141 INFO:teuthology.orchestra.run.smithi090.stdout:(121/156): python3-google-auth-2.29.0-1.el9.noa 4.0 MB/s | 206 kB 00:00 2024-05-08T05:13:36.145 INFO:teuthology.orchestra.run.smithi087.stdout:(48/156): python3-urllib3-1.26.5-5.el9.noarch.r 806 kB/s | 215 kB 00:00 2024-05-08T05:13:36.191 INFO:teuthology.orchestra.run.smithi090.stdout:(122/156): python3-grpcio-tools-1.46.7-10.el9.x 2.8 MB/s | 144 kB 00:00 2024-05-08T05:13:36.372 INFO:teuthology.orchestra.run.smithi160.stdout:(10/156): ceph-osd-19.0.0-3538.gbee299f4.el9.x8 5.9 MB/s | 17 MB 00:02 2024-05-08T05:13:36.392 INFO:teuthology.orchestra.run.smithi090.stdout:(123/156): python3-scipy-1.6.2-8.el9.x86_64.rpm 8.0 MB/s | 16 MB 00:02 2024-05-08T05:13:36.417 INFO:teuthology.orchestra.run.smithi090.stdout:(124/156): python3-jaraco-8.2.1-3.el9.noarch.rp 47 kB/s | 11 kB 00:00 2024-05-08T05:13:36.442 INFO:teuthology.orchestra.run.smithi090.stdout:(125/156): python3-jaraco-classes-3.2.1-5.el9.n 353 kB/s | 18 kB 00:00 2024-05-08T05:13:36.455 INFO:teuthology.orchestra.run.smithi160.stdout:(11/156): cephfs-mirror-19.0.0-3538.gbee299f4.e 2.6 MB/s | 225 kB 00:00 2024-05-08T05:13:36.493 INFO:teuthology.orchestra.run.smithi090.stdout:(126/156): python3-jaraco-functools-3.5.0-2.el9 388 kB/s | 19 kB 00:00 2024-05-08T05:13:36.518 INFO:teuthology.orchestra.run.smithi090.stdout:(127/156): python3-jaraco-collections-3.0.0-8.e 230 kB/s | 23 kB 00:00 2024-05-08T05:13:36.522 INFO:teuthology.orchestra.run.smithi160.stdout:(12/156): cephfs-shell-19.0.0-3538.gbee299f4.el 407 kB/s | 27 kB 00:00 2024-05-08T05:13:36.543 INFO:teuthology.orchestra.run.smithi090.stdout:(128/156): python3-jaraco-text-3.2.0-6.el9.noar 391 kB/s | 20 kB 00:00 2024-05-08T05:13:36.578 INFO:teuthology.orchestra.run.smithi087.stdout:(49/156): boost-program-options-1.75.0-8.el9.x8 247 kB/s | 107 kB 00:00 2024-05-08T05:13:36.586 INFO:teuthology.orchestra.run.smithi090.stdout:(129/156): python3-logutils-0.3.5-21.el9.noarch 1.1 MB/s | 46 kB 00:00 2024-05-08T05:13:36.627 INFO:teuthology.orchestra.run.smithi090.stdout:(130/156): python3-more-itertools-8.12.0-2.el9. 1.9 MB/s | 79 kB 00:00 2024-05-08T05:13:36.678 INFO:teuthology.orchestra.run.smithi090.stdout:(131/156): python3-grpcio-1.46.7-10.el9.x86_64. 3.6 MB/s | 2.0 MB 00:00 2024-05-08T05:13:36.703 INFO:teuthology.orchestra.run.smithi090.stdout:(132/156): python3-natsort-7.1.1-5.el9.noarch.r 766 kB/s | 58 kB 00:00 2024-05-08T05:13:36.714 INFO:teuthology.orchestra.run.smithi160.stdout:(13/156): ceph-common-19.0.0-3538.gbee299f4.el9 4.2 MB/s | 21 MB 00:04 2024-05-08T05:13:36.731 INFO:teuthology.orchestra.run.smithi160.stdout:(14/156): libcephfs-devel-19.0.0-3538.gbee299f4 152 kB/s | 32 kB 00:00 2024-05-08T05:13:36.798 INFO:teuthology.orchestra.run.smithi160.stdout:(15/156): libcephsqlite-19.0.0-3538.gbee299f4.e 2.4 MB/s | 163 kB 00:00 2024-05-08T05:13:36.834 INFO:teuthology.orchestra.run.smithi090.stdout:(133/156): python3-pecan-1.4.2-3.el9.noarch.rpm 1.7 MB/s | 272 kB 00:00 2024-05-08T05:13:36.855 INFO:teuthology.orchestra.run.smithi090.stdout:(134/156): python3-portend-3.1.0-2.el9.noarch.r 108 kB/s | 16 kB 00:00 2024-05-08T05:13:36.881 INFO:teuthology.orchestra.run.smithi090.stdout:(135/156): python3-pyOpenSSL-21.0.0-1.el9.noarc 1.9 MB/s | 90 kB 00:00 2024-05-08T05:13:36.881 INFO:teuthology.orchestra.run.smithi160.stdout:(16/156): libcephfs2-19.0.0-3538.gbee299f4.el9. 4.4 MB/s | 747 kB 00:00 2024-05-08T05:13:36.904 INFO:teuthology.orchestra.run.smithi087.stdout:(50/156): elfutils-libelf-devel-0.190-2.el9.x86 66 kB/s | 21 kB 00:00 2024-05-08T05:13:36.906 INFO:teuthology.orchestra.run.smithi090.stdout:(136/156): python3-pyperclip-1.8.2-2.el9.noarch 560 kB/s | 28 kB 00:00 2024-05-08T05:13:36.907 INFO:teuthology.orchestra.run.smithi160.stdout:(17/156): librados-devel-19.0.0-3538.gbee299f4. 1.1 MB/s | 127 kB 00:00 2024-05-08T05:13:36.931 INFO:teuthology.orchestra.run.smithi090.stdout:(137/156): python3-repoze-lru-0.7-16.el9.noarch 610 kB/s | 31 kB 00:00 2024-05-08T05:13:36.957 INFO:teuthology.orchestra.run.smithi090.stdout:(138/156): python3-routes-2.5.1-5.el9.noarch.rp 3.7 MB/s | 188 kB 00:00 2024-05-08T05:13:36.982 INFO:teuthology.orchestra.run.smithi090.stdout:(139/156): python3-rsa-4.9-2.el9.noarch.rpm 1.1 MB/s | 59 kB 00:00 2024-05-08T05:13:37.007 INFO:teuthology.orchestra.run.smithi090.stdout:(140/156): python3-tempora-5.0.0-2.el9.noarch.r 713 kB/s | 36 kB 00:00 2024-05-08T05:13:37.008 INFO:teuthology.orchestra.run.smithi160.stdout:(18/156): libradosstriper1-19.0.0-3538.gbee299f 3.9 MB/s | 500 kB 00:00 2024-05-08T05:13:37.033 INFO:teuthology.orchestra.run.smithi090.stdout:(141/156): python3-typing-extensions-4.4.0-2.el 1.0 MB/s | 51 kB 00:00 2024-05-08T05:13:37.075 INFO:teuthology.orchestra.run.smithi090.stdout:(142/156): python3-kubernetes-26.1.0-2.el9.noar 1.8 MB/s | 1.0 MB 00:00 2024-05-08T05:13:37.091 INFO:teuthology.orchestra.run.smithi160.stdout:(19/156): python3-ceph-argparse-19.0.0-3538.gbe 543 kB/s | 45 kB 00:00 2024-05-08T05:13:37.100 INFO:teuthology.orchestra.run.smithi090.stdout:(143/156): python3-websocket-client-1.2.3-2.el9 1.3 MB/s | 90 kB 00:00 2024-05-08T05:13:37.112 INFO:teuthology.orchestra.run.smithi087.stdout:(51/156): automake-1.16.2-8.el9.noarch.rpm 646 kB/s | 689 kB 00:01 2024-05-08T05:13:37.125 INFO:teuthology.orchestra.run.smithi090.stdout:(144/156): python3-webob-1.8.7-6.el9.noarch.rpm 1.9 MB/s | 230 kB 00:00 2024-05-08T05:13:37.151 INFO:teuthology.orchestra.run.smithi090.stdout:(145/156): python3-zc-lockfile-2.0-10.el9.noarc 396 kB/s | 20 kB 00:00 2024-05-08T05:13:37.174 INFO:teuthology.orchestra.run.smithi160.stdout:(20/156): python3-ceph-common-19.0.0-3538.gbee2 1.6 MB/s | 135 kB 00:00 2024-05-08T05:13:37.176 INFO:teuthology.orchestra.run.smithi090.stdout:(146/156): re2-20211101-3.el9.x86_64.rpm 3.7 MB/s | 192 kB 00:00 2024-05-08T05:13:37.210 INFO:teuthology.orchestra.run.smithi090.stdout:(147/156): python3-werkzeug-2.0.3-3.el9.1.noarc 3.1 MB/s | 427 kB 00:00 2024-05-08T05:13:37.258 INFO:teuthology.orchestra.run.smithi160.stdout:(21/156): python3-cephfs-19.0.0-3538.gbee299f4. 1.9 MB/s | 161 kB 00:00 2024-05-08T05:13:37.342 INFO:teuthology.orchestra.run.smithi160.stdout:(22/156): python3-rados-19.0.0-3538.gbee299f4.e 3.8 MB/s | 321 kB 00:00 2024-05-08T05:13:37.352 INFO:teuthology.orchestra.run.smithi090.stdout:(148/156): thrift-0.15.0-2.el9.x86_64.rpm 7.9 MB/s | 1.6 MB 00:00 2024-05-08T05:13:37.396 INFO:teuthology.orchestra.run.smithi087.stdout:(52/156): bison-3.7.4-5.el9.x86_64.rpm 711 kB/s | 943 kB 00:01 2024-05-08T05:13:37.434 INFO:teuthology.orchestra.run.smithi160.stdout:(23/156): python3-rbd-19.0.0-3538.gbee299f4.el9 3.2 MB/s | 299 kB 00:00 2024-05-08T05:13:37.438 INFO:teuthology.orchestra.run.smithi087.stdout:(53/156): flexiblas-3.0.4-8.el9.x86_64.rpm 101 kB/s | 33 kB 00:00 2024-05-08T05:13:37.517 INFO:teuthology.orchestra.run.smithi160.stdout:(24/156): python3-rgw-19.0.0-3538.gbee299f4.el9 1.2 MB/s | 100 kB 00:00 2024-05-08T05:13:37.609 INFO:teuthology.orchestra.run.smithi160.stdout:(25/156): rbd-fuse-19.0.0-3538.gbee299f4.el9.x8 933 kB/s | 85 kB 00:00 2024-05-08T05:13:37.722 INFO:teuthology.orchestra.run.smithi087.stdout:(54/156): flexiblas-openblas-openmp-3.0.4-8.el9 64 kB/s | 18 kB 00:00 2024-05-08T05:13:37.847 INFO:teuthology.orchestra.run.smithi087.stdout:(55/156): flex-2.6.4-9.el9.x86_64.rpm 333 kB/s | 313 kB 00:00 2024-05-08T05:13:37.860 INFO:teuthology.orchestra.run.smithi090.stdout:(149/156): librbd1-19.0.0-3538.gbee299f4.el9.x8 4.8 MB/s | 3.1 MB 00:00 2024-05-08T05:13:37.893 INFO:teuthology.orchestra.run.smithi160.stdout:(26/156): librgw2-19.0.0-3538.gbee299f4.el9.x86 5.4 MB/s | 5.4 MB 00:00 2024-05-08T05:13:37.914 INFO:teuthology.orchestra.run.smithi087.stdout:(56/156): libaio-devel-0.3.111-13.el9.x86_64.rp 58 kB/s | 11 kB 00:00 2024-05-08T05:13:37.993 INFO:teuthology.orchestra.run.smithi160.stdout:(27/156): rbd-nbd-19.0.0-3538.gbee299f4.el9.x86 1.7 MB/s | 171 kB 00:00 2024-05-08T05:13:38.068 INFO:teuthology.orchestra.run.smithi160.stdout:(28/156): ceph-grafana-dashboards-19.0.0-3538.g 456 kB/s | 34 kB 00:00 2024-05-08T05:13:38.161 INFO:teuthology.orchestra.run.smithi090.stdout:(150/156): librados2-19.0.0-3538.gbee299f4.el9. 3.5 MB/s | 3.4 MB 00:00 2024-05-08T05:13:38.177 INFO:teuthology.orchestra.run.smithi160.stdout:(29/156): rbd-mirror-19.0.0-3538.gbee299f4.el9. 5.4 MB/s | 3.1 MB 00:00 2024-05-08T05:13:38.202 INFO:teuthology.orchestra.run.smithi160.stdout:(30/156): ceph-mgr-cephadm-19.0.0-3538.gbee299f 1.0 MB/s | 142 kB 00:00 2024-05-08T05:13:38.281 INFO:teuthology.orchestra.run.smithi087.stdout:(57/156): librabbitmq-0.11.0-7.el9.x86_64.rpm 123 kB/s | 45 kB 00:00 2024-05-08T05:13:38.294 INFO:teuthology.orchestra.run.smithi090.stdout:(151/156): NetworkManager-1.47.5-1.el9.x86_64.r 2.5 MB/s | 2.3 MB 00:00 2024-05-08T05:13:38.357 INFO:teuthology.orchestra.run.smithi087.stdout:(58/156): libpmemobj-1.12.1-1.el9.x86_64.rpm 315 kB/s | 160 kB 00:00 2024-05-08T05:13:38.403 INFO:teuthology.orchestra.run.smithi090.stdout:(152/156): NetworkManager-tui-1.47.5-1.el9.x86_ 2.2 MB/s | 248 kB 00:00 2024-05-08T05:13:38.504 INFO:teuthology.orchestra.run.smithi090.stdout:(153/156): NetworkManager-team-1.47.5-1.el9.x86 122 kB/s | 42 kB 00:00 2024-05-08T05:13:38.554 INFO:teuthology.orchestra.run.smithi090.stdout:(154/156): openssl-3.2.1-1.el9.x86_64.rpm 9.0 MB/s | 1.3 MB 00:00 2024-05-08T05:13:38.637 INFO:teuthology.orchestra.run.smithi090.stdout:(155/156): NetworkManager-libnm-1.47.5-1.el9.x8 2.4 MB/s | 1.8 MB 00:00 2024-05-08T05:13:38.724 INFO:teuthology.orchestra.run.smithi160.stdout:(31/156): ceph-mgr-dashboard-19.0.0-3538.gbee29 6.7 MB/s | 3.5 MB 00:00 2024-05-08T05:13:38.803 INFO:teuthology.orchestra.run.smithi160.stdout:(32/156): ceph-mgr-modules-core-19.0.0-3538.gbe 2.7 MB/s | 274 kB 00:00 2024-05-08T05:13:38.886 INFO:teuthology.orchestra.run.smithi160.stdout:(33/156): ceph-mgr-rook-19.0.0-3538.gbee299f4.e 593 kB/s | 49 kB 00:00 2024-05-08T05:13:38.945 INFO:teuthology.orchestra.run.smithi160.stdout:(34/156): ceph-prometheus-alerts-19.0.0-3538.gb 283 kB/s | 16 kB 00:00 2024-05-08T05:13:38.957 INFO:teuthology.orchestra.run.smithi087.stdout:(59/156): libtool-2.4.6-45.el9.x86_64.rpm 972 kB/s | 582 kB 00:00 2024-05-08T05:13:39.029 INFO:teuthology.orchestra.run.smithi160.stdout:(35/156): ceph-volume-19.0.0-3538.gbee299f4.el9 3.2 MB/s | 273 kB 00:00 2024-05-08T05:13:39.032 INFO:teuthology.orchestra.run.smithi087.stdout:(60/156): librdkafka-1.6.1-102.el9.x86_64.rpm 884 kB/s | 662 kB 00:00 2024-05-08T05:13:39.232 INFO:teuthology.orchestra.run.smithi087.stdout:(61/156): libuuid-devel-2.37.4-18.el9.x86_64.rp 93 kB/s | 25 kB 00:00 2024-05-08T05:13:39.399 INFO:teuthology.orchestra.run.smithi087.stdout:(62/156): libzstd-devel-1.5.1-2.el9.x86_64.rpm 129 kB/s | 47 kB 00:00 2024-05-08T05:13:39.538 INFO:teuthology.orchestra.run.smithi160.stdout:(36/156): ceph-test-19.0.0-3538.gbee299f4.el9.x 12 MB/s | 49 MB 00:04 2024-05-08T05:13:39.571 INFO:teuthology.orchestra.run.smithi160.stdout:(37/156): cephadm-19.0.0-3538.gbee299f4.el9.noa 1.4 MB/s | 763 kB 00:00 2024-05-08T05:13:39.588 INFO:teuthology.orchestra.run.smithi160.stdout:(38/156): cephfs-top-19.0.0-3538.gbee299f4.el9. 366 kB/s | 18 kB 00:00 2024-05-08T05:13:39.689 INFO:teuthology.orchestra.run.smithi160.stdout:(39/156): ceph-mgr-diskprediction-local-19.0.0- 5.0 MB/s | 7.4 MB 00:01 2024-05-08T05:13:39.755 INFO:teuthology.orchestra.run.smithi160.stdout:(40/156): fuse-2.9.9-15.el9.x86_64.rpm 437 kB/s | 80 kB 00:00 2024-05-08T05:13:39.789 INFO:teuthology.orchestra.run.smithi160.stdout:(41/156): libquadmath-11.4.1-3.el9.x86_64.rpm 1.9 MB/s | 195 kB 00:00 2024-05-08T05:13:39.799 INFO:teuthology.orchestra.run.smithi087.stdout:(63/156): lttng-ust-2.12.0-6.el9.x86_64.rpm 517 kB/s | 292 kB 00:00 2024-05-08T05:13:39.831 INFO:teuthology.orchestra.run.smithi160.stdout:(42/156): libgfortran-11.4.1-3.el9.x86_64.rpm 3.2 MB/s | 803 kB 00:00 2024-05-08T05:13:39.898 INFO:teuthology.orchestra.run.smithi160.stdout:(43/156): python3-cffi-1.14.5-5.el9.x86_64.rpm 1.7 MB/s | 253 kB 00:00 2024-05-08T05:13:39.931 INFO:teuthology.orchestra.run.smithi160.stdout:(44/156): python3-ply-3.11-14.el9.noarch.rpm 1.0 MB/s | 106 kB 00:00 2024-05-08T05:13:39.990 INFO:teuthology.orchestra.run.smithi160.stdout:(45/156): python3-cryptography-36.0.1-4.el9.x86 6.1 MB/s | 1.2 MB 00:00 2024-05-08T05:13:40.032 INFO:teuthology.orchestra.run.smithi160.stdout:(46/156): python3-requests-2.25.1-8.el9.noarch. 1.2 MB/s | 125 kB 00:00 2024-05-08T05:13:40.049 INFO:teuthology.orchestra.run.smithi160.stdout:(47/156): python3-pycparser-2.20-6.el9.noarch.r 897 kB/s | 135 kB 00:00 2024-05-08T05:13:40.075 INFO:teuthology.orchestra.run.smithi087.stdout:(64/156): lua-5.4.4-4.el9.x86_64.rpm 279 kB/s | 188 kB 00:00 2024-05-08T05:13:40.102 INFO:teuthology.orchestra.run.smithi160.stdout:(48/156): python3-urllib3-1.26.5-5.el9.noarch.r 1.9 MB/s | 215 kB 00:00 2024-05-08T05:13:40.102 INFO:teuthology.orchestra.run.smithi087.stdout:(65/156): openblas-0.3.21-2.el9.x86_64.rpm 117 kB/s | 35 kB 00:00 2024-05-08T05:13:40.158 INFO:teuthology.orchestra.run.smithi160.stdout:(49/156): automake-1.16.2-8.el9.noarch.rpm 5.4 MB/s | 689 kB 00:00 2024-05-08T05:13:40.183 INFO:teuthology.orchestra.run.smithi160.stdout:(50/156): boost-program-options-1.75.0-8.el9.x8 1.2 MB/s | 107 kB 00:00 2024-05-08T05:13:40.225 INFO:teuthology.orchestra.run.smithi160.stdout:(51/156): bison-3.7.4-5.el9.x86_64.rpm 5.2 MB/s | 943 kB 00:00 2024-05-08T05:13:40.250 INFO:teuthology.orchestra.run.smithi160.stdout:(52/156): elfutils-libelf-devel-0.190-2.el9.x86 234 kB/s | 21 kB 00:00 2024-05-08T05:13:40.301 INFO:teuthology.orchestra.run.smithi160.stdout:(53/156): flexiblas-3.0.4-8.el9.x86_64.rpm 435 kB/s | 33 kB 00:00 2024-05-08T05:13:40.313 INFO:teuthology.orchestra.run.smithi090.stdout:(156/156): openssl-libs-3.2.1-1.el9.x86_64.rpm 1.3 MB/s | 2.4 MB 00:01 2024-05-08T05:13:40.315 INFO:teuthology.orchestra.run.smithi090.stdout:-------------------------------------------------------------------------------- 2024-05-08T05:13:40.316 INFO:teuthology.orchestra.run.smithi090.stdout:Total 13 MB/s | 226 MB 00:17 2024-05-08T05:13:40.326 INFO:teuthology.orchestra.run.smithi160.stdout:(54/156): flex-2.6.4-9.el9.x86_64.rpm 2.2 MB/s | 313 kB 00:00 2024-05-08T05:13:40.368 INFO:teuthology.orchestra.run.smithi160.stdout:(55/156): flexiblas-openblas-openmp-3.0.4-8.el9 273 kB/s | 18 kB 00:00 2024-05-08T05:13:40.393 INFO:teuthology.orchestra.run.smithi160.stdout:(56/156): libaio-devel-0.3.111-13.el9.x86_64.rp 167 kB/s | 11 kB 00:00 2024-05-08T05:13:40.485 INFO:teuthology.orchestra.run.smithi160.stdout:(57/156): flexiblas-netlib-3.0.4-8.el9.x86_64.r 13 MB/s | 3.0 MB 00:00 2024-05-08T05:13:40.510 INFO:teuthology.orchestra.run.smithi160.stdout:(58/156): librabbitmq-0.11.0-7.el9.x86_64.rpm 387 kB/s | 45 kB 00:00 2024-05-08T05:13:40.535 INFO:teuthology.orchestra.run.smithi160.stdout:(59/156): libpmemobj-1.12.1-1.el9.x86_64.rpm 957 kB/s | 160 kB 00:00 2024-05-08T05:13:40.611 INFO:teuthology.orchestra.run.smithi160.stdout:(60/156): libuuid-devel-2.37.4-18.el9.x86_64.rp 340 kB/s | 25 kB 00:00 2024-05-08T05:13:40.625 INFO:teuthology.orchestra.run.smithi087.stdout:(66/156): flexiblas-netlib-3.0.4-8.el9.x86_64.r 948 kB/s | 3.0 MB 00:03 2024-05-08T05:13:40.706 INFO:teuthology.orchestra.run.smithi160.stdout:(61/156): librdkafka-1.6.1-102.el9.x86_64.rpm 2.9 MB/s | 662 kB 00:00 2024-05-08T05:13:40.786 INFO:teuthology.orchestra.run.smithi160.stdout:(62/156): libtool-2.4.6-45.el9.x86_64.rpm 2.1 MB/s | 582 kB 00:00 2024-05-08T05:13:40.812 INFO:teuthology.orchestra.run.smithi160.stdout:(63/156): libzstd-devel-1.5.1-2.el9.x86_64.rpm 236 kB/s | 47 kB 00:00 2024-05-08T05:13:40.887 INFO:teuthology.orchestra.run.smithi160.stdout:(64/156): openblas-0.3.21-2.el9.x86_64.rpm 471 kB/s | 35 kB 00:00 2024-05-08T05:13:40.912 INFO:teuthology.orchestra.run.smithi160.stdout:(65/156): lua-5.4.4-4.el9.x86_64.rpm 1.5 MB/s | 188 kB 00:00 2024-05-08T05:13:40.938 INFO:teuthology.orchestra.run.smithi160.stdout:(66/156): lttng-ust-2.12.0-6.el9.x86_64.rpm 1.2 MB/s | 292 kB 00:00 2024-05-08T05:13:41.196 INFO:teuthology.orchestra.run.smithi160.stdout:(67/156): postgresql-13.14-1.el9.x86_64.rpm 6.2 MB/s | 1.6 MB 00:00 2024-05-08T05:13:41.397 INFO:teuthology.orchestra.run.smithi160.stdout:(68/156): openssl-devel-3.2.1-1.el9.x86_64.rpm 9.1 MB/s | 4.4 MB 00:00 2024-05-08T05:13:41.457 INFO:teuthology.orchestra.run.smithi090.stdout:Running transaction check 2024-05-08T05:13:41.480 INFO:teuthology.orchestra.run.smithi160.stdout:(69/156): postgresql-contrib-13.14-1.el9.x86_64 3.1 MB/s | 911 kB 00:00 2024-05-08T05:13:41.547 INFO:teuthology.orchestra.run.smithi160.stdout:(70/156): openblas-openmp-0.3.21-2.el9.x86_64.r 7.2 MB/s | 4.7 MB 00:00 2024-05-08T05:13:41.572 INFO:teuthology.orchestra.run.smithi160.stdout:(71/156): postgresql-private-libs-13.14-1.el9.x 760 kB/s | 133 kB 00:00 2024-05-08T05:13:41.607 INFO:teuthology.orchestra.run.smithi090.stdout:Transaction check succeeded. 2024-05-08T05:13:41.607 INFO:teuthology.orchestra.run.smithi090.stdout:Running transaction test 2024-05-08T05:13:41.639 INFO:teuthology.orchestra.run.smithi160.stdout:(72/156): python3-attrs-20.3.0-7.el9.noarch.rpm 1.3 MB/s | 87 kB 00:00 2024-05-08T05:13:41.706 INFO:teuthology.orchestra.run.smithi160.stdout:(73/156): protobuf-3.14.0-13.el9.x86_64.rpm 6.4 MB/s | 1.0 MB 00:00 2024-05-08T05:13:41.759 INFO:teuthology.orchestra.run.smithi087.stdout:(67/156): postgresql-13.14-1.el9.x86_64.rpm 1.4 MB/s | 1.6 MB 00:01 2024-05-08T05:13:41.807 INFO:teuthology.orchestra.run.smithi160.stdout:(74/156): python3-devel-3.9.18-3.el9.x86_64.rpm 2.4 MB/s | 244 kB 00:00 2024-05-08T05:13:41.882 INFO:teuthology.orchestra.run.smithi160.stdout:(75/156): python3-jinja2-2.11.3-5.el9.noarch.rp 3.2 MB/s | 248 kB 00:00 2024-05-08T05:13:41.889 INFO:teuthology.orchestra.run.smithi087.stdout:(68/156): openssl-devel-3.2.1-1.el9.x86_64.rpm 2.5 MB/s | 4.4 MB 00:01 2024-05-08T05:13:41.957 INFO:teuthology.orchestra.run.smithi160.stdout:(76/156): postgresql-server-13.14-1.el9.x86_64. 12 MB/s | 5.8 MB 00:00 2024-05-08T05:13:41.999 INFO:teuthology.orchestra.run.smithi160.stdout:(77/156): python3-jsonpatch-1.21-16.el9.noarch. 219 kB/s | 26 kB 00:00 2024-05-08T05:13:42.024 INFO:teuthology.orchestra.run.smithi160.stdout:(78/156): python3-jsonpointer-2.0-4.el9.noarch. 287 kB/s | 19 kB 00:00 2024-05-08T05:13:42.109 INFO:teuthology.orchestra.run.smithi087.stdout:(69/156): openblas-openmp-0.3.21-2.el9.x86_64.r 2.3 MB/s | 4.7 MB 00:02 2024-05-08T05:13:42.133 INFO:teuthology.orchestra.run.smithi160.stdout:(79/156): python3-babel-2.9.1-2.el9.noarch.rpm 12 MB/s | 6.0 MB 00:00 2024-05-08T05:13:42.158 INFO:teuthology.orchestra.run.smithi160.stdout:(80/156): python3-markupsafe-1.1.1-12.el9.x86_6 259 kB/s | 35 kB 00:00 2024-05-08T05:13:42.184 INFO:teuthology.orchestra.run.smithi160.stdout:(81/156): python3-mako-1.1.4-6.el9.noarch.rpm 934 kB/s | 172 kB 00:00 2024-05-08T05:13:42.259 INFO:teuthology.orchestra.run.smithi160.stdout:(82/156): python3-numpy-f2py-1.20.1-5.el9.x86_6 2.4 MB/s | 250 kB 00:00 2024-05-08T05:13:42.292 INFO:teuthology.orchestra.run.smithi160.stdout:(83/156): python3-oauthlib-3.1.1-5.el9.noarch.r 2.0 MB/s | 222 kB 00:00 2024-05-08T05:13:42.376 INFO:teuthology.orchestra.run.smithi160.stdout:(84/156): python3-packaging-20.9-5.el9.noarch.r 659 kB/s | 77 kB 00:00 2024-05-08T05:13:42.401 INFO:teuthology.orchestra.run.smithi160.stdout:(85/156): python3-prettytable-0.7.2-27.el9.noar 389 kB/s | 42 kB 00:00 2024-05-08T05:13:42.476 INFO:teuthology.orchestra.run.smithi160.stdout:(86/156): python3-protobuf-3.14.0-13.el9.noarch 2.6 MB/s | 269 kB 00:00 2024-05-08T05:13:42.493 INFO:teuthology.orchestra.run.smithi087.stdout:(70/156): postgresql-private-libs-13.14-1.el9.x 221 kB/s | 133 kB 00:00 2024-05-08T05:13:42.502 INFO:teuthology.orchestra.run.smithi160.stdout:(87/156): python3-pyasn1-0.4.8-6.el9.noarch.rpm 1.5 MB/s | 159 kB 00:00 2024-05-08T05:13:42.569 INFO:teuthology.orchestra.run.smithi160.stdout:(88/156): python3-numpy-1.20.1-5.el9.x86_64.rpm 12 MB/s | 5.1 MB 00:00 2024-05-08T05:13:42.619 INFO:teuthology.orchestra.run.smithi160.stdout:(89/156): python3-pyasn1-modules-0.4.8-6.el9.no 1.9 MB/s | 279 kB 00:00 2024-05-08T05:13:42.644 INFO:teuthology.orchestra.run.smithi160.stdout:(90/156): python3-pytz-2021.1-5.el9.noarch.rpm 358 kB/s | 51 kB 00:00 2024-05-08T05:13:42.669 INFO:teuthology.orchestra.run.smithi160.stdout:(91/156): python3-requests-oauthlib-1.3.0-12.el 533 kB/s | 54 kB 00:00 2024-05-08T05:13:42.710 INFO:teuthology.orchestra.run.smithi087.stdout:(71/156): postgresql-contrib-13.14-1.el9.x86_64 959 kB/s | 911 kB 00:00 2024-05-08T05:13:42.720 INFO:teuthology.orchestra.run.smithi160.stdout:(92/156): python3-toml-0.10.2-6.el9.noarch.rpm 555 kB/s | 42 kB 00:00 2024-05-08T05:13:42.745 INFO:teuthology.orchestra.run.smithi160.stdout:(93/156): python3-wcwidth-0.2.5-8.el9.noarch.rp 586 kB/s | 44 kB 00:00 2024-05-08T05:13:42.804 INFO:teuthology.orchestra.run.smithi160.stdout:(94/156): qatlib-service-24.02.0-1.el9.x86_64.r 613 kB/s | 36 kB 00:00 2024-05-08T05:13:42.829 INFO:teuthology.orchestra.run.smithi160.stdout:(95/156): qatlib-24.02.0-1.el9.x86_64.rpm 2.0 MB/s | 221 kB 00:00 2024-05-08T05:13:42.888 INFO:teuthology.orchestra.run.smithi160.stdout:(96/156): qatzip-libs-1.2.0-1.el9.x86_64.rpm 566 kB/s | 47 kB 00:00 2024-05-08T05:13:42.955 INFO:teuthology.orchestra.run.smithi160.stdout:(97/156): socat-1.7.4.1-5.el9.x86_64.rpm 2.4 MB/s | 305 kB 00:00 2024-05-08T05:13:42.980 INFO:teuthology.orchestra.run.smithi160.stdout:(98/156): uuid-1.6.2-55.el9.x86_64.rpm 628 kB/s | 58 kB 00:00 2024-05-08T05:13:43.081 INFO:teuthology.orchestra.run.smithi160.stdout:(99/156): xfsprogs-devel-6.3.0-1.el9.x86_64.rpm 748 kB/s | 94 kB 00:00 2024-05-08T05:13:43.106 INFO:teuthology.orchestra.run.smithi160.stdout:(100/156): xmlstarlet-1.6.1-20.el9.x86_64.rpm 509 kB/s | 64 kB 00:00 2024-05-08T05:13:43.135 INFO:teuthology.orchestra.run.smithi087.stdout:(72/156): python3-attrs-20.3.0-7.el9.noarch.rpm 206 kB/s | 87 kB 00:00 2024-05-08T05:13:43.181 INFO:teuthology.orchestra.run.smithi160.stdout:(101/156): lua-devel-5.4.4-4.el9.x86_64.rpm 297 kB/s | 22 kB 00:00 2024-05-08T05:13:43.206 INFO:teuthology.orchestra.run.smithi160.stdout:(102/156): zlib-devel-1.2.11-41.el9.x86_64.rpm 357 kB/s | 45 kB 00:00 2024-05-08T05:13:43.323 INFO:teuthology.orchestra.run.smithi160.stdout:(103/156): abseil-cpp-20211102.0-3.el9.x86_64.r 4.6 MB/s | 548 kB 00:00 2024-05-08T05:13:43.357 INFO:teuthology.orchestra.run.smithi160.stdout:(104/156): gperftools-libs-2.9.1-2.el9.x86_64.r 9.0 MB/s | 309 kB 00:00 2024-05-08T05:13:43.417 INFO:teuthology.orchestra.run.smithi090.stdout:Transaction test succeeded. 2024-05-08T05:13:43.417 INFO:teuthology.orchestra.run.smithi090.stdout:Running transaction 2024-05-08T05:13:43.508 INFO:teuthology.orchestra.run.smithi160.stdout:(105/156): python3-scipy-1.6.2-8.el9.x86_64.rpm 18 MB/s | 16 MB 00:00 2024-05-08T05:13:43.524 INFO:teuthology.orchestra.run.smithi160.stdout:(106/156): grpc-data-1.46.7-10.el9.noarch.rpm 116 kB/s | 19 kB 00:00 2024-05-08T05:13:43.558 INFO:teuthology.orchestra.run.smithi160.stdout:(107/156): protobuf-compiler-3.14.0-13.el9.x86_ 2.2 MB/s | 863 kB 00:00 2024-05-08T05:13:43.583 INFO:teuthology.orchestra.run.smithi160.stdout:(108/156): libarrow-doc-9.0.0-11.el9.noarch.rpm 443 kB/s | 26 kB 00:00 2024-05-08T05:13:43.585 INFO:teuthology.orchestra.run.smithi087.stdout:(73/156): protobuf-3.14.0-13.el9.x86_64.rpm 947 kB/s | 1.0 MB 00:01 2024-05-08T05:13:43.616 INFO:teuthology.orchestra.run.smithi160.stdout:(109/156): libunwind-1.6.2-1.el9.x86_64.rpm 2.0 MB/s | 67 kB 00:00 2024-05-08T05:13:43.642 INFO:teuthology.orchestra.run.smithi160.stdout:(110/156): liboath-2.6.7-2.el9.x86_64.rpm 579 kB/s | 49 kB 00:00 2024-05-08T05:13:43.667 INFO:teuthology.orchestra.run.smithi160.stdout:(111/156): luarocks-3.9.2-1.el9.noarch.rpm 2.9 MB/s | 151 kB 00:00 2024-05-08T05:13:43.709 INFO:teuthology.orchestra.run.smithi160.stdout:(112/156): python3-asyncssh-2.13.2-5.el9.noarch 13 MB/s | 548 kB 00:00 2024-05-08T05:13:43.742 INFO:teuthology.orchestra.run.smithi160.stdout:(113/156): parquet-libs-9.0.0-11.el9.x86_64.rpm 8.1 MB/s | 839 kB 00:00 2024-05-08T05:13:43.768 INFO:teuthology.orchestra.run.smithi160.stdout:(114/156): python3-bcrypt-3.2.2-1.el9.x86_64.rp 740 kB/s | 43 kB 00:00 2024-05-08T05:13:43.793 INFO:teuthology.orchestra.run.smithi160.stdout:(115/156): python3-cachetools-4.2.4-1.el9.noarc 639 kB/s | 32 kB 00:00 2024-05-08T05:13:43.818 INFO:teuthology.orchestra.run.smithi160.stdout:(116/156): python3-certifi-2021.10.8-2.el9.noar 298 kB/s | 15 kB 00:00 2024-05-08T05:13:43.844 INFO:teuthology.orchestra.run.smithi160.stdout:(117/156): python3-cheroot-8.6.0-4.el9.noarch.r 3.3 MB/s | 172 kB 00:00 2024-05-08T05:13:43.894 INFO:teuthology.orchestra.run.smithi160.stdout:(118/156): python3-cherrypy-18.6.1-2.el9.noarch 4.7 MB/s | 358 kB 00:00 2024-05-08T05:13:43.919 INFO:teuthology.orchestra.run.smithi160.stdout:(119/156): python3-cmd2-2.4.2-2.el9.noarch.rpm 3.9 MB/s | 303 kB 00:00 2024-05-08T05:13:43.945 INFO:teuthology.orchestra.run.smithi160.stdout:(120/156): python3-colorama-0.4.4-12.el9.noarch 702 kB/s | 35 kB 00:00 2024-05-08T05:13:43.970 INFO:teuthology.orchestra.run.smithi160.stdout:(121/156): python3-google-auth-2.29.0-1.el9.noa 4.0 MB/s | 206 kB 00:00 2024-05-08T05:13:44.045 INFO:teuthology.orchestra.run.smithi160.stdout:(122/156): libarrow-9.0.0-11.el9.x86_64.rpm 8.2 MB/s | 4.4 MB 00:00 2024-05-08T05:13:44.071 INFO:teuthology.orchestra.run.smithi160.stdout:(123/156): python3-grpcio-tools-1.46.7-10.el9.x 1.4 MB/s | 144 kB 00:00 2024-05-08T05:13:44.088 INFO:teuthology.orchestra.run.smithi160.stdout:(124/156): python3-jaraco-8.2.1-3.el9.noarch.rp 254 kB/s | 11 kB 00:00 2024-05-08T05:13:44.113 INFO:teuthology.orchestra.run.smithi160.stdout:(125/156): python3-jaraco-classes-3.2.1-5.el9.n 424 kB/s | 18 kB 00:00 2024-05-08T05:13:44.138 INFO:teuthology.orchestra.run.smithi160.stdout:(126/156): python3-jaraco-collections-3.0.0-8.e 462 kB/s | 23 kB 00:00 2024-05-08T05:13:44.164 INFO:teuthology.orchestra.run.smithi160.stdout:(127/156): python3-jaraco-functools-3.5.0-2.el9 386 kB/s | 19 kB 00:00 2024-05-08T05:13:44.169 INFO:teuthology.orchestra.run.smithi087.stdout:(74/156): postgresql-server-13.14-1.el9.x86_64. 2.8 MB/s | 5.8 MB 00:02 2024-05-08T05:13:44.180 INFO:teuthology.orchestra.run.smithi160.stdout:(128/156): python3-jaraco-text-3.2.0-6.el9.noar 469 kB/s | 20 kB 00:00 2024-05-08T05:13:44.203 INFO:teuthology.orchestra.run.smithi087.stdout:(75/156): python3-devel-3.9.18-3.el9.x86_64.rpm 396 kB/s | 244 kB 00:00 2024-05-08T05:13:44.231 INFO:teuthology.orchestra.run.smithi160.stdout:(129/156): python3-grpcio-1.46.7-10.el9.x86_64. 7.1 MB/s | 2.0 MB 00:00 2024-05-08T05:13:44.248 INFO:teuthology.orchestra.run.smithi160.stdout:(130/156): python3-logutils-0.3.5-21.el9.noarch 693 kB/s | 46 kB 00:00 2024-05-08T05:13:44.273 INFO:teuthology.orchestra.run.smithi160.stdout:(131/156): python3-more-itertools-8.12.0-2.el9. 1.8 MB/s | 79 kB 00:00 2024-05-08T05:13:44.298 INFO:teuthology.orchestra.run.smithi160.stdout:(132/156): python3-natsort-7.1.1-5.el9.noarch.r 1.1 MB/s | 58 kB 00:00 2024-05-08T05:13:44.332 INFO:teuthology.orchestra.run.smithi160.stdout:(133/156): python3-kubernetes-26.1.0-2.el9.noar 6.1 MB/s | 1.0 MB 00:00 2024-05-08T05:13:44.349 INFO:teuthology.orchestra.run.smithi160.stdout:(134/156): python3-portend-3.1.0-2.el9.noarch.r 327 kB/s | 16 kB 00:00 2024-05-08T05:13:44.374 INFO:teuthology.orchestra.run.smithi160.stdout:(135/156): python3-pyOpenSSL-21.0.0-1.el9.noarc 2.1 MB/s | 90 kB 00:00 2024-05-08T05:13:44.399 INFO:teuthology.orchestra.run.smithi160.stdout:(136/156): python3-pyperclip-1.8.2-2.el9.noarch 563 kB/s | 28 kB 00:00 2024-05-08T05:13:44.425 INFO:teuthology.orchestra.run.smithi160.stdout:(137/156): python3-pecan-1.4.2-3.el9.noarch.rpm 1.8 MB/s | 272 kB 00:00 2024-05-08T05:13:44.450 INFO:teuthology.orchestra.run.smithi160.stdout:(138/156): python3-repoze-lru-0.7-16.el9.noarch 407 kB/s | 31 kB 00:00 2024-05-08T05:13:44.475 INFO:teuthology.orchestra.run.smithi160.stdout:(139/156): python3-rsa-4.9-2.el9.noarch.rpm 1.2 MB/s | 59 kB 00:00 2024-05-08T05:13:44.478 INFO:teuthology.orchestra.run.smithi087.stdout:(76/156): python3-jsonpatch-1.21-16.el9.noarch. 93 kB/s | 26 kB 00:00 2024-05-08T05:13:44.500 INFO:teuthology.orchestra.run.smithi160.stdout:(140/156): python3-tempora-5.0.0-2.el9.noarch.r 714 kB/s | 36 kB 00:00 2024-05-08T05:13:44.534 INFO:teuthology.orchestra.run.smithi160.stdout:(141/156): python3-routes-2.5.1-5.el9.noarch.rp 1.4 MB/s | 188 kB 00:00 2024-05-08T05:13:44.559 INFO:teuthology.orchestra.run.smithi160.stdout:(142/156): python3-typing-extensions-4.4.0-2.el 609 kB/s | 51 kB 00:00 2024-05-08T05:13:44.584 INFO:teuthology.orchestra.run.smithi160.stdout:(143/156): python3-webob-1.8.7-6.el9.noarch.rpm 2.7 MB/s | 230 kB 00:00 2024-05-08T05:13:44.610 INFO:teuthology.orchestra.run.smithi160.stdout:(144/156): python3-websocket-client-1.2.3-2.el9 1.8 MB/s | 90 kB 00:00 2024-05-08T05:13:44.635 INFO:teuthology.orchestra.run.smithi160.stdout:(145/156): python3-zc-lockfile-2.0-10.el9.noarc 397 kB/s | 20 kB 00:00 2024-05-08T05:13:44.660 INFO:teuthology.orchestra.run.smithi160.stdout:(146/156): re2-20211101-3.el9.x86_64.rpm 3.7 MB/s | 192 kB 00:00 2024-05-08T05:13:44.686 INFO:teuthology.orchestra.run.smithi160.stdout:(147/156): python3-werkzeug-2.0.3-3.el9.1.noarc 3.3 MB/s | 427 kB 00:00 2024-05-08T05:13:44.728 INFO:teuthology.orchestra.run.smithi160.stdout:(148/156): thrift-0.15.0-2.el9.x86_64.rpm 17 MB/s | 1.6 MB 00:00 2024-05-08T05:13:44.763 INFO:teuthology.orchestra.run.smithi087.stdout:(77/156): python3-jsonpointer-2.0-4.el9.noarch. 67 kB/s | 19 kB 00:00 2024-05-08T05:13:44.795 INFO:teuthology.orchestra.run.smithi087.stdout:(78/156): python3-jinja2-2.11.3-5.el9.noarch.rp 397 kB/s | 248 kB 00:00 2024-05-08T05:13:44.853 INFO:teuthology.orchestra.run.smithi160.stdout:(149/156): NetworkManager-1.47.5-1.el9.x86_64.r 19 MB/s | 2.3 MB 00:00 2024-05-08T05:13:44.986 INFO:teuthology.orchestra.run.smithi160.stdout:(150/156): librados2-19.0.0-3538.gbee299f4.el9. 10 MB/s | 3.4 MB 00:00 2024-05-08T05:13:45.028 INFO:teuthology.orchestra.run.smithi160.stdout:(151/156): NetworkManager-libnm-1.47.5-1.el9.x8 10 MB/s | 1.8 MB 00:00 2024-05-08T05:13:45.070 INFO:teuthology.orchestra.run.smithi087.stdout:(79/156): python3-markupsafe-1.1.1-12.el9.x86_6 127 kB/s | 35 kB 00:00 2024-05-08T05:13:45.078 INFO:teuthology.orchestra.run.smithi160.stdout:(152/156): NetworkManager-team-1.47.5-1.el9.x86 455 kB/s | 42 kB 00:00 2024-05-08T05:13:45.129 INFO:teuthology.orchestra.run.smithi160.stdout:(153/156): NetworkManager-tui-1.47.5-1.el9.x86_ 2.4 MB/s | 248 kB 00:00 2024-05-08T05:13:45.187 INFO:teuthology.orchestra.run.smithi087.stdout:(80/156): python3-mako-1.1.4-6.el9.noarch.rpm 407 kB/s | 172 kB 00:00 2024-05-08T05:13:45.213 INFO:teuthology.orchestra.run.smithi160.stdout:(154/156): openssl-3.2.1-1.el9.x86_64.rpm 10 MB/s | 1.3 MB 00:00 2024-05-08T05:13:45.296 INFO:teuthology.orchestra.run.smithi160.stdout:(155/156): librbd1-19.0.0-3538.gbee299f4.el9.x8 5.2 MB/s | 3.1 MB 00:00 2024-05-08T05:13:45.346 INFO:teuthology.orchestra.run.smithi160.stdout:(156/156): openssl-libs-3.2.1-1.el9.x86_64.rpm 11 MB/s | 2.4 MB 00:00 2024-05-08T05:13:45.349 INFO:teuthology.orchestra.run.smithi160.stdout:-------------------------------------------------------------------------------- 2024-05-08T05:13:45.350 INFO:teuthology.orchestra.run.smithi160.stdout:Total 16 MB/s | 226 MB 00:14 2024-05-08T05:13:45.688 INFO:teuthology.orchestra.run.smithi087.stdout:(81/156): python3-numpy-f2py-1.20.1-5.el9.x86_6 502 kB/s | 250 kB 00:00 2024-05-08T05:13:46.121 INFO:teuthology.orchestra.run.smithi087.stdout:(82/156): python3-babel-2.9.1-2.el9.noarch.rpm 2.0 MB/s | 6.0 MB 00:02 2024-05-08T05:13:46.180 INFO:teuthology.orchestra.run.smithi087.stdout:(83/156): python3-oauthlib-3.1.1-5.el9.noarch.r 452 kB/s | 222 kB 00:00 2024-05-08T05:13:46.530 INFO:teuthology.orchestra.run.smithi087.stdout:(84/156): python3-prettytable-0.7.2-27.el9.noar 121 kB/s | 42 kB 00:00 2024-05-08T05:13:46.555 INFO:teuthology.orchestra.run.smithi087.stdout:(85/156): python3-packaging-20.9-5.el9.noarch.r 178 kB/s | 77 kB 00:00 2024-05-08T05:13:46.563 INFO:teuthology.orchestra.run.smithi160.stdout:Running transaction check 2024-05-08T05:13:46.714 INFO:teuthology.orchestra.run.smithi160.stdout:Transaction check succeeded. 2024-05-08T05:13:46.715 INFO:teuthology.orchestra.run.smithi160.stdout:Running transaction test 2024-05-08T05:13:46.797 INFO:teuthology.orchestra.run.smithi087.stdout:(86/156): python3-numpy-1.20.1-5.el9.x86_64.rpm 3.0 MB/s | 5.1 MB 00:01 2024-05-08T05:13:47.123 INFO:teuthology.orchestra.run.smithi087.stdout:(87/156): python3-pyasn1-0.4.8-6.el9.noarch.rpm 280 kB/s | 159 kB 00:00 2024-05-08T05:13:47.181 INFO:teuthology.orchestra.run.smithi087.stdout:(88/156): python3-protobuf-3.14.0-13.el9.noarch 414 kB/s | 269 kB 00:00 2024-05-08T05:13:47.465 INFO:teuthology.orchestra.run.smithi087.stdout:(89/156): python3-pytz-2021.1-5.el9.noarch.rpm 149 kB/s | 51 kB 00:00 2024-05-08T05:13:47.549 INFO:teuthology.orchestra.run.smithi087.stdout:(90/156): python3-requests-oauthlib-1.3.0-12.el 146 kB/s | 54 kB 00:00 2024-05-08T05:13:47.654 INFO:teuthology.orchestra.run.smithi087.stdout:(91/156): python3-pyasn1-modules-0.4.8-6.el9.no 326 kB/s | 279 kB 00:00 2024-05-08T05:13:47.832 INFO:teuthology.orchestra.run.smithi087.stdout:(92/156): python3-toml-0.10.2-6.el9.noarch.rpm 147 kB/s | 42 kB 00:00 2024-05-08T05:13:48.008 INFO:teuthology.orchestra.run.smithi087.stdout:(93/156): python3-wcwidth-0.2.5-8.el9.noarch.rp 125 kB/s | 44 kB 00:00 2024-05-08T05:13:48.275 INFO:teuthology.orchestra.run.smithi087.stdout:(94/156): qatlib-service-24.02.0-1.el9.x86_64.r 135 kB/s | 36 kB 00:00 2024-05-08T05:13:48.359 INFO:teuthology.orchestra.run.smithi087.stdout:(95/156): qatlib-24.02.0-1.el9.x86_64.rpm 421 kB/s | 221 kB 00:00 2024-05-08T05:13:48.531 INFO:teuthology.orchestra.run.smithi160.stdout:Transaction test succeeded. 2024-05-08T05:13:48.531 INFO:teuthology.orchestra.run.smithi160.stdout:Running transaction 2024-05-08T05:13:48.625 INFO:teuthology.orchestra.run.smithi087.stdout:(96/156): qatzip-libs-1.2.0-1.el9.x86_64.rpm 136 kB/s | 47 kB 00:00 2024-05-08T05:13:48.942 INFO:teuthology.orchestra.run.smithi087.stdout:(97/156): socat-1.7.4.1-5.el9.x86_64.rpm 523 kB/s | 305 kB 00:00 2024-05-08T05:13:48.984 INFO:teuthology.orchestra.run.smithi087.stdout:(98/156): uuid-1.6.2-55.el9.x86_64.rpm 162 kB/s | 58 kB 00:00 2024-05-08T05:13:49.334 INFO:teuthology.orchestra.run.smithi087.stdout:(99/156): xmlstarlet-1.6.1-20.el9.x86_64.rpm 182 kB/s | 64 kB 00:00 2024-05-08T05:13:49.385 INFO:teuthology.orchestra.run.smithi087.stdout:(100/156): xfsprogs-devel-6.3.0-1.el9.x86_64.rp 212 kB/s | 94 kB 00:00 2024-05-08T05:13:49.435 INFO:teuthology.orchestra.run.smithi087.stdout:(101/156): lua-devel-5.4.4-4.el9.x86_64.rpm 454 kB/s | 22 kB 00:00 2024-05-08T05:13:49.576 INFO:teuthology.orchestra.run.smithi087.stdout:(102/156): protobuf-compiler-3.14.0-13.el9.x86_ 6.0 MB/s | 863 kB 00:00 2024-05-08T05:13:49.590 INFO:teuthology.orchestra.run.smithi090.stdout: Preparing : 1/1 2024-05-08T05:13:49.702 INFO:teuthology.orchestra.run.smithi087.stdout:(103/156): abseil-cpp-20211102.0-3.el9.x86_64.r 4.3 MB/s | 548 kB 00:00 2024-05-08T05:13:49.727 INFO:teuthology.orchestra.run.smithi087.stdout:(104/156): zlib-devel-1.2.11-41.el9.x86_64.rpm 114 kB/s | 45 kB 00:00 2024-05-08T05:13:49.728 INFO:teuthology.orchestra.run.smithi090.stdout: Upgrading : openssl-libs-1:3.2.1-1.el9.x86_64 1/164 2024-05-08T05:13:49.761 INFO:teuthology.orchestra.run.smithi087.stdout:(105/156): gperftools-libs-2.9.1-2.el9.x86_64.r 5.2 MB/s | 309 kB 00:00 2024-05-08T05:13:49.774 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/164 2024-05-08T05:13:49.811 INFO:teuthology.orchestra.run.smithi087.stdout:(106/156): grpc-data-1.46.7-10.el9.noarch.rpm 235 kB/s | 19 kB 00:00 2024-05-08T05:13:49.836 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/164 2024-05-08T05:13:49.853 INFO:teuthology.orchestra.run.smithi087.stdout:(107/156): libarrow-doc-9.0.0-11.el9.noarch.rpm 636 kB/s | 26 kB 00:00 2024-05-08T05:13:49.870 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/164 2024-05-08T05:13:49.904 INFO:teuthology.orchestra.run.smithi087.stdout:(108/156): liboath-2.6.7-2.el9.x86_64.rpm 987 kB/s | 49 kB 00:00 2024-05-08T05:13:49.905 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/164 2024-05-08T05:13:49.937 INFO:teuthology.orchestra.run.smithi087.stdout:(109/156): libunwind-1.6.2-1.el9.x86_64.rpm 2.0 MB/s | 67 kB 00:00 2024-05-08T05:13:49.955 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/164 2024-05-08T05:13:50.038 INFO:teuthology.orchestra.run.smithi087.stdout:(110/156): libarrow-9.0.0-11.el9.x86_64.rpm 16 MB/s | 4.4 MB 00:00 2024-05-08T05:13:50.063 INFO:teuthology.orchestra.run.smithi087.stdout:(111/156): luarocks-3.9.2-1.el9.noarch.rpm 1.2 MB/s | 151 kB 00:00 2024-05-08T05:13:50.130 INFO:teuthology.orchestra.run.smithi087.stdout:(112/156): parquet-libs-9.0.0-11.el9.x86_64.rpm 9.0 MB/s | 839 kB 00:00 2024-05-08T05:13:50.180 INFO:teuthology.orchestra.run.smithi087.stdout:(113/156): python3-asyncssh-2.13.2-5.el9.noarch 4.6 MB/s | 548 kB 00:00 2024-05-08T05:13:50.206 INFO:teuthology.orchestra.run.smithi087.stdout:(114/156): python3-bcrypt-3.2.2-1.el9.x86_64.rp 581 kB/s | 43 kB 00:00 2024-05-08T05:13:50.231 INFO:teuthology.orchestra.run.smithi087.stdout:(115/156): python3-cachetools-4.2.4-1.el9.noarc 648 kB/s | 32 kB 00:00 2024-05-08T05:13:50.256 INFO:teuthology.orchestra.run.smithi087.stdout:(116/156): python3-certifi-2021.10.8-2.el9.noar 302 kB/s | 15 kB 00:00 2024-05-08T05:13:50.284 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/164 2024-05-08T05:13:50.290 INFO:teuthology.orchestra.run.smithi087.stdout:(117/156): python3-cheroot-8.6.0-4.el9.noarch.r 2.9 MB/s | 172 kB 00:00 2024-05-08T05:13:50.323 INFO:teuthology.orchestra.run.smithi087.stdout:(118/156): python3-cherrypy-18.6.1-2.el9.noarch 5.3 MB/s | 358 kB 00:00 2024-05-08T05:13:50.357 INFO:teuthology.orchestra.run.smithi087.stdout:(119/156): python3-cmd2-2.4.2-2.el9.noarch.rpm 4.5 MB/s | 303 kB 00:00 2024-05-08T05:13:50.382 INFO:teuthology.orchestra.run.smithi087.stdout:(120/156): python3-colorama-0.4.4-12.el9.noarch 610 kB/s | 35 kB 00:00 2024-05-08T05:13:50.407 INFO:teuthology.orchestra.run.smithi090.stdout: Upgrading : librados2-2:19.0.0-3538.gbee299f4.el9.x86_64 8/164 2024-05-08T05:13:50.416 INFO:teuthology.orchestra.run.smithi087.stdout:(121/156): python3-google-auth-2.29.0-1.el9.noa 3.5 MB/s | 206 kB 00:00 2024-05-08T05:13:50.458 INFO:teuthology.orchestra.run.smithi087.stdout:(122/156): python3-grpcio-tools-1.46.7-10.el9.x 3.5 MB/s | 144 kB 00:00 2024-05-08T05:13:50.483 INFO:teuthology.orchestra.run.smithi087.stdout:(123/156): python3-jaraco-8.2.1-3.el9.noarch.rp 438 kB/s | 11 kB 00:00 2024-05-08T05:13:50.528 INFO:teuthology.orchestra.run.smithi090.stdout: Running scriptlet: librados2-2:19.0.0-3538.gbee299f4.el9.x86_64 8/164 2024-05-08T05:13:50.542 INFO:teuthology.orchestra.run.smithi087.stdout:(124/156): python3-jaraco-classes-3.2.1-5.el9.n 307 kB/s | 18 kB 00:00 2024-05-08T05:13:50.550 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : libcephfs2-2:19.0.0-3538.gbee299f4.el9.x86_64 9/164 2024-05-08T05:13:50.600 INFO:teuthology.orchestra.run.smithi087.stdout:(125/156): python3-grpcio-1.46.7-10.el9.x86_64. 9.4 MB/s | 2.0 MB 00:00 2024-05-08T05:13:50.626 INFO:teuthology.orchestra.run.smithi087.stdout:(126/156): python3-jaraco-collections-3.0.0-8.e 279 kB/s | 23 kB 00:00 2024-05-08T05:13:50.641 INFO:teuthology.orchestra.run.smithi090.stdout: Running scriptlet: libcephfs2-2:19.0.0-3538.gbee299f4.el9.x86_64 9/164 2024-05-08T05:13:50.651 INFO:teuthology.orchestra.run.smithi087.stdout:(127/156): python3-jaraco-functools-3.5.0-2.el9 392 kB/s | 19 kB 00:00 2024-05-08T05:13:50.668 INFO:teuthology.orchestra.run.smithi087.stdout:(128/156): python3-jaraco-text-3.2.0-6.el9.noar 479 kB/s | 20 kB 00:00 2024-05-08T05:13:50.671 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : python3-rados-2:19.0.0-3538.gbee299f4.el9.x86_64 10/164 2024-05-08T05:13:50.702 INFO:teuthology.orchestra.run.smithi087.stdout:(129/156): python3-logutils-0.3.5-21.el9.noarch 1.4 MB/s | 46 kB 00:00 2024-05-08T05:13:50.753 INFO:teuthology.orchestra.run.smithi087.stdout:(130/156): python3-kubernetes-26.1.0-2.el9.noar 10 MB/s | 1.0 MB 00:00 2024-05-08T05:13:50.777 INFO:teuthology.orchestra.run.smithi087.stdout:(131/156): python3-more-itertools-8.12.0-2.el9. 1.0 MB/s | 79 kB 00:00 2024-05-08T05:13:50.802 INFO:teuthology.orchestra.run.smithi087.stdout:(132/156): python3-natsort-7.1.1-5.el9.noarch.r 1.1 MB/s | 58 kB 00:00 2024-05-08T05:13:50.828 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : postgresql-private-libs-13.14-1.el9.x86_64 11/164 2024-05-08T05:13:50.836 INFO:teuthology.orchestra.run.smithi087.stdout:(133/156): python3-pecan-1.4.2-3.el9.noarch.rpm 4.6 MB/s | 272 kB 00:00 2024-05-08T05:13:50.862 INFO:teuthology.orchestra.run.smithi087.stdout:(134/156): python3-portend-3.1.0-2.el9.noarch.r 284 kB/s | 16 kB 00:00 2024-05-08T05:13:50.885 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : postgresql-13.14-1.el9.x86_64 12/164 2024-05-08T05:13:50.887 INFO:teuthology.orchestra.run.smithi087.stdout:(135/156): python3-pyOpenSSL-21.0.0-1.el9.noarc 1.8 MB/s | 90 kB 00:00 2024-05-08T05:13:50.912 INFO:teuthology.orchestra.run.smithi087.stdout:(136/156): python3-pyperclip-1.8.2-2.el9.noarch 570 kB/s | 28 kB 00:00 2024-05-08T05:13:50.913 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : libcephsqlite-2:19.0.0-3538.gbee299f4.el9.x86_64 13/164 2024-05-08T05:13:50.937 INFO:teuthology.orchestra.run.smithi087.stdout:(137/156): python3-repoze-lru-0.7-16.el9.noarch 624 kB/s | 31 kB 00:00 2024-05-08T05:13:50.971 INFO:teuthology.orchestra.run.smithi087.stdout:(138/156): python3-routes-2.5.1-5.el9.noarch.rp 3.2 MB/s | 188 kB 00:00 2024-05-08T05:13:50.997 INFO:teuthology.orchestra.run.smithi087.stdout:(139/156): python3-rsa-4.9-2.el9.noarch.rpm 1.0 MB/s | 59 kB 00:00 2024-05-08T05:13:51.008 INFO:teuthology.orchestra.run.smithi090.stdout: Running scriptlet: libcephsqlite-2:19.0.0-3538.gbee299f4.el9.x86_64 13/164 2024-05-08T05:13:51.021 INFO:teuthology.orchestra.run.smithi087.stdout:(140/156): python3-tempora-5.0.0-2.el9.noarch.r 725 kB/s | 36 kB 00:00 2024-05-08T05:13:51.040 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : libradosstriper1-2:19.0.0-3538.gbee299f4.el9.x86 14/164 2024-05-08T05:13:51.055 INFO:teuthology.orchestra.run.smithi087.stdout:(141/156): python3-typing-extensions-4.4.0-2.el 880 kB/s | 51 kB 00:00 2024-05-08T05:13:51.089 INFO:teuthology.orchestra.run.smithi087.stdout:(142/156): python3-webob-1.8.7-6.el9.noarch.rpm 3.4 MB/s | 230 kB 00:00 2024-05-08T05:13:51.103 INFO:teuthology.orchestra.run.smithi090.stdout: Running scriptlet: libradosstriper1-2:19.0.0-3538.gbee299f4.el9.x86 14/164 2024-05-08T05:13:51.114 INFO:teuthology.orchestra.run.smithi087.stdout:(143/156): python3-websocket-client-1.2.3-2.el9 1.5 MB/s | 90 kB 00:00 2024-05-08T05:13:51.134 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 15/164 2024-05-08T05:13:51.154 INFO:teuthology.orchestra.run.smithi090.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 15/164 2024-05-08T05:13:51.156 INFO:teuthology.orchestra.run.smithi087.stdout:(144/156): python3-werkzeug-2.0.3-3.el9.1.noarc 6.3 MB/s | 427 kB 00:00 2024-05-08T05:13:51.182 INFO:teuthology.orchestra.run.smithi087.stdout:(145/156): python3-zc-lockfile-2.0-10.el9.noarc 302 kB/s | 20 kB 00:00 2024-05-08T05:13:51.215 INFO:teuthology.orchestra.run.smithi087.stdout:(146/156): re2-20211101-3.el9.x86_64.rpm 3.2 MB/s | 192 kB 00:00 2024-05-08T05:13:51.291 INFO:teuthology.orchestra.run.smithi087.stdout:(147/156): thrift-0.15.0-2.el9.x86_64.rpm 15 MB/s | 1.6 MB 00:00 2024-05-08T05:13:51.333 INFO:teuthology.orchestra.run.smithi090.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 16/164 2024-05-08T05:13:51.481 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 16/164 2024-05-08T05:13:51.524 INFO:teuthology.orchestra.run.smithi087.stdout:(148/156): python3-scipy-1.6.2-8.el9.x86_64.rpm 4.0 MB/s | 16 MB 00:04 2024-05-08T05:13:51.675 INFO:teuthology.orchestra.run.smithi087.stdout:(149/156): NetworkManager-1.47.5-1.el9.x86_64.r 16 MB/s | 2.3 MB 00:00 2024-05-08T05:13:51.707 INFO:teuthology.orchestra.run.smithi090.stdout: Upgrading : NetworkManager-libnm-1:1.47.5-1.el9.x86_64 17/164 2024-05-08T05:13:51.741 INFO:teuthology.orchestra.run.smithi087.stdout:(150/156): librbd1-19.0.0-3538.gbee299f4.el9.x8 7.0 MB/s | 3.1 MB 00:00 2024-05-08T05:13:51.769 INFO:teuthology.orchestra.run.smithi090.stdout: Running scriptlet: NetworkManager-libnm-1:1.47.5-1.el9.x86_64 17/164 2024-05-08T05:13:51.800 INFO:teuthology.orchestra.run.smithi087.stdout:(151/156): NetworkManager-team-1.47.5-1.el9.x86 728 kB/s | 42 kB 00:00 2024-05-08T05:13:51.870 INFO:teuthology.orchestra.run.smithi090.stdout: Running scriptlet: NetworkManager-1:1.47.5-1.el9.x86_64 18/164 2024-05-08T05:13:51.892 INFO:teuthology.orchestra.run.smithi087.stdout:(152/156): NetworkManager-libnm-1.47.5-1.el9.x8 8.4 MB/s | 1.8 MB 00:00 2024-05-08T05:13:51.926 INFO:teuthology.orchestra.run.smithi087.stdout:(153/156): NetworkManager-tui-1.47.5-1.el9.x86_ 2.0 MB/s | 248 kB 00:00 2024-05-08T05:13:51.997 INFO:teuthology.orchestra.run.smithi090.stdout: Upgrading : NetworkManager-1:1.47.5-1.el9.x86_64 18/164 2024-05-08T05:13:52.051 INFO:teuthology.orchestra.run.smithi087.stdout:(154/156): openssl-3.2.1-1.el9.x86_64.rpm 8.6 MB/s | 1.3 MB 00:00 2024-05-08T05:13:52.126 INFO:teuthology.orchestra.run.smithi087.stdout:(155/156): openssl-libs-3.2.1-1.el9.x86_64.rpm 12 MB/s | 2.4 MB 00:00 2024-05-08T05:13:52.203 INFO:teuthology.orchestra.run.smithi090.stdout: Running scriptlet: NetworkManager-1:1.47.5-1.el9.x86_64 18/164 2024-05-08T05:13:52.313 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : re2-1:20211101-3.el9.x86_64 19/164 2024-05-08T05:13:52.351 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 20/164 2024-05-08T05:13:52.394 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : liboath-2.6.7-2.el9.x86_64 21/164 2024-05-08T05:13:52.441 INFO:teuthology.orchestra.run.smithi087.stdout:(156/156): librados2-19.0.0-3538.gbee299f4.el9. 2.8 MB/s | 3.4 MB 00:01 2024-05-08T05:13:52.447 INFO:teuthology.orchestra.run.smithi087.stdout:-------------------------------------------------------------------------------- 2024-05-08T05:13:52.448 INFO:teuthology.orchestra.run.smithi087.stdout:Total 8.6 MB/s | 226 MB 00:26 2024-05-08T05:13:52.467 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 22/164 2024-05-08T05:13:52.503 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 23/164 2024-05-08T05:13:52.547 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 24/164 2024-05-08T05:13:52.579 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 25/164 2024-05-08T05:13:52.652 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : lua-5.4.4-4.el9.x86_64 26/164 2024-05-08T05:13:52.727 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 27/164 2024-05-08T05:13:52.789 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : python3-urllib3-1.26.5-5.el9.noarch 28/164 2024-05-08T05:13:52.819 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 29/164 2024-05-08T05:13:52.854 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 30/164 2024-05-08T05:13:52.931 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 31/164 2024-05-08T05:13:52.965 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : python3-ceph-common-2:19.0.0-3538.gbee299f4.el9. 32/164 2024-05-08T05:13:53.000 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : python3-ceph-argparse-2:19.0.0-3538.gbee299f4.el 33/164 2024-05-08T05:13:53.037 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : python3-cephfs-2:19.0.0-3538.gbee299f4.el9.x86_6 34/164 2024-05-08T05:13:53.117 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 35/164 2024-05-08T05:13:53.162 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : luarocks-3.9.2-1.el9.noarch 36/164 2024-05-08T05:13:53.236 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 37/164 2024-05-08T05:13:53.367 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 38/164 2024-05-08T05:13:53.423 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 39/164 2024-05-08T05:13:53.957 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : python3-rsa-4.9-2.el9.noarch 40/164 2024-05-08T05:13:54.079 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 41/164 2024-05-08T05:13:54.115 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : python3-jinja2-2.11.3-5.el9.noarch 42/164 2024-05-08T05:13:54.159 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 43/164 2024-05-08T05:13:54.198 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : librados-devel-2:19.0.0-3538.gbee299f4.el9.x86_6 44/164 2024-05-08T05:13:54.240 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 45/164 2024-05-08T05:13:54.426 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 46/164 2024-05-08T05:13:54.468 INFO:teuthology.orchestra.run.smithi090.stdout: Upgrading : openssl-1:3.2.1-1.el9.x86_64 47/164 2024-05-08T05:13:54.559 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 48/164 2024-05-08T05:13:54.624 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 49/164 2024-05-08T05:13:54.697 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 50/164 2024-05-08T05:13:54.717 INFO:teuthology.orchestra.run.smithi160.stdout: Preparing : 1/1 2024-05-08T05:13:54.737 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 51/164 2024-05-08T05:13:54.774 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 52/164 2024-05-08T05:13:54.809 INFO:teuthology.orchestra.run.smithi160.stdout: Upgrading : openssl-libs-1:3.2.1-1.el9.x86_64 1/164 2024-05-08T05:13:54.821 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 53/164 2024-05-08T05:13:54.857 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 54/164 2024-05-08T05:13:54.864 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/164 2024-05-08T05:13:54.900 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 55/164 2024-05-08T05:13:54.917 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/164 2024-05-08T05:13:54.943 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 56/164 2024-05-08T05:13:54.951 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/164 2024-05-08T05:13:54.977 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/164 2024-05-08T05:13:55.028 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/164 2024-05-08T05:13:55.089 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 57/164 2024-05-08T05:13:55.132 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 58/164 2024-05-08T05:13:55.162 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : python3-colorama-0.4.4-12.el9.noarch 59/164 2024-05-08T05:13:55.357 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/164 2024-05-08T05:13:55.453 INFO:teuthology.orchestra.run.smithi160.stdout: Upgrading : librados2-2:19.0.0-3538.gbee299f4.el9.x86_64 8/164 2024-05-08T05:13:55.477 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 60/164 2024-05-08T05:13:55.491 INFO:teuthology.orchestra.run.smithi087.stdout:Running transaction check 2024-05-08T05:13:55.574 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: librados2-2:19.0.0-3538.gbee299f4.el9.x86_64 8/164 2024-05-08T05:13:55.578 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 61/164 2024-05-08T05:13:55.612 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : libcephfs2-2:19.0.0-3538.gbee299f4.el9.x86_64 9/164 2024-05-08T05:13:55.614 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : python3-google-auth-1:2.29.0-1.el9.noarch 62/164 2024-05-08T05:13:55.654 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 63/164 2024-05-08T05:13:55.688 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 64/164 2024-05-08T05:13:55.704 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: libcephfs2-2:19.0.0-3538.gbee299f4.el9.x86_64 9/164 2024-05-08T05:13:55.721 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 65/164 2024-05-08T05:13:55.733 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-rados-2:19.0.0-3538.gbee299f4.el9.x86_64 10/164 2024-05-08T05:13:55.734 INFO:teuthology.orchestra.run.smithi087.stdout:Transaction check succeeded. 2024-05-08T05:13:55.734 INFO:teuthology.orchestra.run.smithi087.stdout:Running transaction test 2024-05-08T05:13:55.806 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 66/164 2024-05-08T05:13:55.885 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : postgresql-private-libs-13.14-1.el9.x86_64 11/164 2024-05-08T05:13:55.933 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 67/164 2024-05-08T05:13:55.947 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : postgresql-13.14-1.el9.x86_64 12/164 2024-05-08T05:13:55.972 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 68/164 2024-05-08T05:13:55.975 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : libcephsqlite-2:19.0.0-3538.gbee299f4.el9.x86_64 13/164 2024-05-08T05:13:56.009 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 69/164 2024-05-08T05:13:56.043 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 70/164 2024-05-08T05:13:56.078 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: libcephsqlite-2:19.0.0-3538.gbee299f4.el9.x86_64 13/164 2024-05-08T05:13:56.091 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : uuid-1.6.2-55.el9.x86_64 71/164 2024-05-08T05:13:56.101 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : libradosstriper1-2:19.0.0-3538.gbee299f4.el9.x86 14/164 2024-05-08T05:13:56.131 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 72/164 2024-05-08T05:13:56.163 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: libradosstriper1-2:19.0.0-3538.gbee299f4.el9.x86 14/164 2024-05-08T05:13:56.169 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 73/164 2024-05-08T05:13:56.185 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 15/164 2024-05-08T05:13:56.207 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 15/164 2024-05-08T05:13:56.229 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 74/164 2024-05-08T05:13:56.386 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 16/164 2024-05-08T05:13:56.420 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 75/164 2024-05-08T05:13:56.526 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 16/164 2024-05-08T05:13:56.584 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 76/164 2024-05-08T05:13:56.649 INFO:teuthology.orchestra.run.smithi160.stdout: Upgrading : NetworkManager-libnm-1:1.47.5-1.el9.x86_64 17/164 2024-05-08T05:13:56.709 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: NetworkManager-libnm-1:1.47.5-1.el9.x86_64 17/164 2024-05-08T05:13:56.799 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 77/164 2024-05-08T05:13:56.819 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: NetworkManager-1:1.47.5-1.el9.x86_64 18/164 2024-05-08T05:13:56.879 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 78/164 2024-05-08T05:13:56.885 INFO:teuthology.orchestra.run.smithi160.stdout: Upgrading : NetworkManager-1:1.47.5-1.el9.x86_64 18/164 2024-05-08T05:13:56.929 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 79/164 2024-05-08T05:13:56.968 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 80/164 2024-05-08T05:13:57.016 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 81/164 2024-05-08T05:13:57.086 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: NetworkManager-1:1.47.5-1.el9.x86_64 18/164 2024-05-08T05:13:57.123 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : python3-packaging-20.9-5.el9.noarch 82/164 2024-05-08T05:13:57.178 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 83/164 2024-05-08T05:13:57.192 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : re2-1:20211101-3.el9.x86_64 19/164 2024-05-08T05:13:57.232 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 20/164 2024-05-08T05:13:57.266 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : liboath-2.6.7-2.el9.x86_64 21/164 2024-05-08T05:13:57.331 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 22/164 2024-05-08T05:13:57.366 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 23/164 2024-05-08T05:13:57.409 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 24/164 2024-05-08T05:13:57.442 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 25/164 2024-05-08T05:13:57.470 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : lua-5.4.4-4.el9.x86_64 26/164 2024-05-08T05:13:57.555 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 27/164 2024-05-08T05:13:57.609 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-urllib3-1.26.5-5.el9.noarch 28/164 2024-05-08T05:13:57.639 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 29/164 2024-05-08T05:13:57.675 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 30/164 2024-05-08T05:13:57.750 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 31/164 2024-05-08T05:13:57.785 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-ceph-common-2:19.0.0-3538.gbee299f4.el9. 32/164 2024-05-08T05:13:57.829 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-ceph-argparse-2:19.0.0-3538.gbee299f4.el 33/164 2024-05-08T05:13:57.858 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-cephfs-2:19.0.0-3538.gbee299f4.el9.x86_6 34/164 2024-05-08T05:13:57.896 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 84/164 2024-05-08T05:13:57.927 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 35/164 2024-05-08T05:13:57.972 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : luarocks-3.9.2-1.el9.noarch 36/164 2024-05-08T05:13:57.977 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 85/164 2024-05-08T05:13:58.011 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 86/164 2024-05-08T05:13:58.046 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 37/164 2024-05-08T05:13:58.112 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 87/164 2024-05-08T05:13:58.170 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : python3-devel-3.9.18-3.el9.x86_64 88/164 2024-05-08T05:13:58.187 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 38/164 2024-05-08T05:13:58.241 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 39/164 2024-05-08T05:13:58.257 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 89/164 2024-05-08T05:13:58.289 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 90/164 2024-05-08T05:13:58.448 INFO:teuthology.orchestra.run.smithi087.stdout:Transaction test succeeded. 2024-05-08T05:13:58.449 INFO:teuthology.orchestra.run.smithi087.stdout:Running transaction 2024-05-08T05:13:58.467 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : openblas-0.3.21-2.el9.x86_64 91/164 2024-05-08T05:13:58.495 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 92/164 2024-05-08T05:13:58.572 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 93/164 2024-05-08T05:13:58.779 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-rsa-4.9-2.el9.noarch 40/164 2024-05-08T05:13:58.854 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 41/164 2024-05-08T05:13:58.883 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-jinja2-2.11.3-5.el9.noarch 42/164 2024-05-08T05:13:58.942 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 43/164 2024-05-08T05:13:58.980 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : librados-devel-2:19.0.0-3538.gbee299f4.el9.x86_6 44/164 2024-05-08T05:13:59.022 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 45/164 2024-05-08T05:13:59.167 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 46/164 2024-05-08T05:13:59.215 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 94/164 2024-05-08T05:13:59.216 INFO:teuthology.orchestra.run.smithi160.stdout: Upgrading : openssl-1:3.2.1-1.el9.x86_64 47/164 2024-05-08T05:13:59.309 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 48/164 2024-05-08T05:13:59.329 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 95/164 2024-05-08T05:13:59.381 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 49/164 2024-05-08T05:13:59.454 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 50/164 2024-05-08T05:13:59.484 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 51/164 2024-05-08T05:13:59.520 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 52/164 2024-05-08T05:13:59.568 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 53/164 2024-05-08T05:13:59.604 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 54/164 2024-05-08T05:13:59.646 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 55/164 2024-05-08T05:13:59.689 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 56/164 2024-05-08T05:13:59.825 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 57/164 2024-05-08T05:13:59.869 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 58/164 2024-05-08T05:13:59.899 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-colorama-0.4.4-12.el9.noarch 59/164 2024-05-08T05:13:59.941 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 60/164 2024-05-08T05:14:00.036 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 61/164 2024-05-08T05:14:00.074 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-google-auth-1:2.29.0-1.el9.noarch 62/164 2024-05-08T05:14:00.114 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 63/164 2024-05-08T05:14:00.377 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 64/164 2024-05-08T05:14:00.449 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 65/164 2024-05-08T05:14:00.532 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 66/164 2024-05-08T05:14:00.546 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 96/164 2024-05-08T05:14:00.661 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 67/164 2024-05-08T05:14:00.681 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 97/164 2024-05-08T05:14:00.696 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 68/164 2024-05-08T05:14:00.709 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 98/164 2024-05-08T05:14:00.724 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 69/164 2024-05-08T05:14:00.734 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : libuuid-devel-2.37.4-18.el9.x86_64 99/164 2024-05-08T05:14:00.759 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 70/164 2024-05-08T05:14:00.798 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : uuid-1.6.2-55.el9.x86_64 71/164 2024-05-08T05:14:00.838 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 72/164 2024-05-08T05:14:00.868 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 73/164 2024-05-08T05:14:00.902 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 74/164 2024-05-08T05:14:00.935 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 75/164 2024-05-08T05:14:00.977 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 76/164 2024-05-08T05:14:01.012 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 77/164 2024-05-08T05:14:01.048 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 100/164 2024-05-08T05:14:01.099 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 78/164 2024-05-08T05:14:01.105 INFO:teuthology.orchestra.run.smithi090.stdout: Upgrading : librbd1-2:19.0.0-3538.gbee299f4.el9.x86_64 101/164 2024-05-08T05:14:01.150 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 79/164 2024-05-08T05:14:01.182 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 80/164 2024-05-08T05:14:01.197 INFO:teuthology.orchestra.run.smithi090.stdout: Running scriptlet: librbd1-2:19.0.0-3538.gbee299f4.el9.x86_64 101/164 2024-05-08T05:14:01.228 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 81/164 2024-05-08T05:14:01.229 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : python3-rbd-2:19.0.0-3538.gbee299f4.el9.x86_64 102/164 2024-05-08T05:14:01.273 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 103/164 2024-05-08T05:14:01.327 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-packaging-20.9-5.el9.noarch 82/164 2024-05-08T05:14:01.383 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 83/164 2024-05-08T05:14:01.754 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 104/164 2024-05-08T05:14:01.785 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : librgw2-2:19.0.0-3538.gbee299f4.el9.x86_64 105/164 2024-05-08T05:14:01.856 INFO:teuthology.orchestra.run.smithi090.stdout: Running scriptlet: librgw2-2:19.0.0-3538.gbee299f4.el9.x86_64 105/164 2024-05-08T05:14:01.879 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : python3-rgw-2:19.0.0-3538.gbee299f4.el9.x86_64 106/164 2024-05-08T05:14:02.112 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 84/164 2024-05-08T05:14:02.163 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 85/164 2024-05-08T05:14:02.197 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 86/164 2024-05-08T05:14:02.296 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 87/164 2024-05-08T05:14:02.347 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-devel-3.9.18-3.el9.x86_64 88/164 2024-05-08T05:14:02.434 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 89/164 2024-05-08T05:14:02.466 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 90/164 2024-05-08T05:14:02.646 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : openblas-0.3.21-2.el9.x86_64 91/164 2024-05-08T05:14:02.672 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 92/164 2024-05-08T05:14:02.751 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 93/164 2024-05-08T05:14:03.397 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 94/164 2024-05-08T05:14:03.519 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 95/164 2024-05-08T05:14:04.148 INFO:teuthology.orchestra.run.smithi090.stdout: Running scriptlet: ceph-common-2:19.0.0-3538.gbee299f4.el9.x86_64 107/164 2024-05-08T05:14:04.185 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : ceph-common-2:19.0.0-3538.gbee299f4.el9.x86_64 107/164 2024-05-08T05:14:04.726 INFO:teuthology.orchestra.run.smithi090.stdout: Running scriptlet: ceph-common-2:19.0.0-3538.gbee299f4.el9.x86_64 107/164 2024-05-08T05:14:04.765 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : ceph-base-2:19.0.0-3538.gbee299f4.el9.x86_64 108/164 2024-05-08T05:14:04.766 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 96/164 2024-05-08T05:14:04.846 INFO:teuthology.orchestra.run.smithi090.stdout: Running scriptlet: ceph-base-2:19.0.0-3538.gbee299f4.el9.x86_64 108/164 2024-05-08T05:14:04.846 INFO:teuthology.orchestra.run.smithi090.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-05-08T05:14:04.846 INFO:teuthology.orchestra.run.smithi090.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-05-08T05:14:04.846 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-05-08T05:14:04.850 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 97/164 2024-05-08T05:14:04.874 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : ceph-selinux-2:19.0.0-3538.gbee299f4.el9.x86_64 109/164 2024-05-08T05:14:04.878 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 98/164 2024-05-08T05:14:04.911 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : libuuid-devel-2.37.4-18.el9.x86_64 99/164 2024-05-08T05:14:04.985 INFO:teuthology.orchestra.run.smithi087.stdout: Preparing : 1/1 2024-05-08T05:14:05.092 INFO:teuthology.orchestra.run.smithi087.stdout: Upgrading : openssl-libs-1:3.2.1-1.el9.x86_64 1/164 2024-05-08T05:14:05.165 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/164 2024-05-08T05:14:05.240 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 100/164 2024-05-08T05:14:05.265 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/164 2024-05-08T05:14:05.282 INFO:teuthology.orchestra.run.smithi160.stdout: Upgrading : librbd1-2:19.0.0-3538.gbee299f4.el9.x86_64 101/164 2024-05-08T05:14:05.319 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/164 2024-05-08T05:14:05.352 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/164 2024-05-08T05:14:05.357 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: librbd1-2:19.0.0-3538.gbee299f4.el9.x86_64 101/164 2024-05-08T05:14:05.387 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-rbd-2:19.0.0-3538.gbee299f4.el9.x86_64 102/164 2024-05-08T05:14:05.423 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 103/164 2024-05-08T05:14:05.450 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/164 2024-05-08T05:14:05.903 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 104/164 2024-05-08T05:14:05.905 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/164 2024-05-08T05:14:05.927 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : librgw2-2:19.0.0-3538.gbee299f4.el9.x86_64 105/164 2024-05-08T05:14:05.998 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: librgw2-2:19.0.0-3538.gbee299f4.el9.x86_64 105/164 2024-05-08T05:14:06.008 INFO:teuthology.orchestra.run.smithi087.stdout: Upgrading : librados2-2:19.0.0-3538.gbee299f4.el9.x86_64 8/164 2024-05-08T05:14:06.029 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-rgw-2:19.0.0-3538.gbee299f4.el9.x86_64 106/164 2024-05-08T05:14:06.187 INFO:teuthology.orchestra.run.smithi087.stdout: Running scriptlet: librados2-2:19.0.0-3538.gbee299f4.el9.x86_64 8/164 2024-05-08T05:14:06.217 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : libcephfs2-2:19.0.0-3538.gbee299f4.el9.x86_64 9/164 2024-05-08T05:14:06.378 INFO:teuthology.orchestra.run.smithi087.stdout: Running scriptlet: libcephfs2-2:19.0.0-3538.gbee299f4.el9.x86_64 9/164 2024-05-08T05:14:06.408 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-rados-2:19.0.0-3538.gbee299f4.el9.x86_64 10/164 2024-05-08T05:14:06.724 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : postgresql-private-libs-13.14-1.el9.x86_64 11/164 2024-05-08T05:14:06.789 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : postgresql-13.14-1.el9.x86_64 12/164 2024-05-08T05:14:06.826 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : libcephsqlite-2:19.0.0-3538.gbee299f4.el9.x86_64 13/164 2024-05-08T05:14:06.970 INFO:teuthology.orchestra.run.smithi087.stdout: Running scriptlet: libcephsqlite-2:19.0.0-3538.gbee299f4.el9.x86_64 13/164 2024-05-08T05:14:06.998 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : libradosstriper1-2:19.0.0-3538.gbee299f4.el9.x86 14/164 2024-05-08T05:14:07.083 INFO:teuthology.orchestra.run.smithi087.stdout: Running scriptlet: libradosstriper1-2:19.0.0-3538.gbee299f4.el9.x86 14/164 2024-05-08T05:14:07.116 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 15/164 2024-05-08T05:14:07.184 INFO:teuthology.orchestra.run.smithi087.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 15/164 2024-05-08T05:14:07.474 INFO:teuthology.orchestra.run.smithi087.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 16/164 2024-05-08T05:14:07.768 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 16/164 2024-05-08T05:14:07.930 INFO:teuthology.orchestra.run.smithi087.stdout: Upgrading : NetworkManager-libnm-1:1.47.5-1.el9.x86_64 17/164 2024-05-08T05:14:08.018 INFO:teuthology.orchestra.run.smithi087.stdout: Running scriptlet: NetworkManager-libnm-1:1.47.5-1.el9.x86_64 17/164 2024-05-08T05:14:08.195 INFO:teuthology.orchestra.run.smithi087.stdout: Running scriptlet: NetworkManager-1:1.47.5-1.el9.x86_64 18/164 2024-05-08T05:14:08.300 INFO:teuthology.orchestra.run.smithi087.stdout: Upgrading : NetworkManager-1:1.47.5-1.el9.x86_64 18/164 2024-05-08T05:14:08.309 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: ceph-common-2:19.0.0-3538.gbee299f4.el9.x86_64 107/164 2024-05-08T05:14:08.342 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : ceph-common-2:19.0.0-3538.gbee299f4.el9.x86_64 107/164 2024-05-08T05:14:08.609 INFO:teuthology.orchestra.run.smithi087.stdout: Running scriptlet: NetworkManager-1:1.47.5-1.el9.x86_64 18/164 2024-05-08T05:14:08.792 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : re2-1:20211101-3.el9.x86_64 19/164 2024-05-08T05:14:08.836 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 20/164 2024-05-08T05:14:08.883 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : liboath-2.6.7-2.el9.x86_64 21/164 2024-05-08T05:14:08.884 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: ceph-common-2:19.0.0-3538.gbee299f4.el9.x86_64 107/164 2024-05-08T05:14:08.928 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : ceph-base-2:19.0.0-3538.gbee299f4.el9.x86_64 108/164 2024-05-08T05:14:08.979 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 22/164 2024-05-08T05:14:09.017 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: ceph-base-2:19.0.0-3538.gbee299f4.el9.x86_64 108/164 2024-05-08T05:14:09.017 INFO:teuthology.orchestra.run.smithi160.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-05-08T05:14:09.018 INFO:teuthology.orchestra.run.smithi160.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-05-08T05:14:09.018 INFO:teuthology.orchestra.run.smithi160.stdout: 2024-05-08T05:14:09.027 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 23/164 2024-05-08T05:14:09.056 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : ceph-selinux-2:19.0.0-3538.gbee299f4.el9.x86_64 109/164 2024-05-08T05:14:09.098 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 24/164 2024-05-08T05:14:09.148 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 25/164 2024-05-08T05:14:09.187 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : lua-5.4.4-4.el9.x86_64 26/164 2024-05-08T05:14:09.303 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 27/164 2024-05-08T05:14:09.391 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-urllib3-1.26.5-5.el9.noarch 28/164 2024-05-08T05:14:09.431 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 29/164 2024-05-08T05:14:09.488 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 30/164 2024-05-08T05:14:09.596 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 31/164 2024-05-08T05:14:09.634 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-ceph-common-2:19.0.0-3538.gbee299f4.el9. 32/164 2024-05-08T05:14:09.682 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-ceph-argparse-2:19.0.0-3538.gbee299f4.el 33/164 2024-05-08T05:14:09.739 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-cephfs-2:19.0.0-3538.gbee299f4.el9.x86_6 34/164 2024-05-08T05:14:09.860 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 35/164 2024-05-08T05:14:09.922 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : luarocks-3.9.2-1.el9.noarch 36/164 2024-05-08T05:14:10.030 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 37/164 2024-05-08T05:14:10.204 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 38/164 2024-05-08T05:14:10.273 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 39/164 2024-05-08T05:14:10.977 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-rsa-4.9-2.el9.noarch 40/164 2024-05-08T05:14:11.079 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 41/164 2024-05-08T05:14:11.114 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-jinja2-2.11.3-5.el9.noarch 42/164 2024-05-08T05:14:11.163 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 43/164 2024-05-08T05:14:11.218 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : librados-devel-2:19.0.0-3538.gbee299f4.el9.x86_6 44/164 2024-05-08T05:14:11.277 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 45/164 2024-05-08T05:14:11.500 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 46/164 2024-05-08T05:14:11.568 INFO:teuthology.orchestra.run.smithi087.stdout: Upgrading : openssl-1:3.2.1-1.el9.x86_64 47/164 2024-05-08T05:14:11.692 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 48/164 2024-05-08T05:14:11.772 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 49/164 2024-05-08T05:14:11.860 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 50/164 2024-05-08T05:14:11.902 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 51/164 2024-05-08T05:14:11.939 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 52/164 2024-05-08T05:14:12.006 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 53/164 2024-05-08T05:14:12.056 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 54/164 2024-05-08T05:14:12.118 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 55/164 2024-05-08T05:14:12.184 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 56/164 2024-05-08T05:14:12.383 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 57/164 2024-05-08T05:14:12.439 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 58/164 2024-05-08T05:14:12.476 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-colorama-0.4.4-12.el9.noarch 59/164 2024-05-08T05:14:12.532 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 60/164 2024-05-08T05:14:12.660 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 61/164 2024-05-08T05:14:12.709 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-google-auth-1:2.29.0-1.el9.noarch 62/164 2024-05-08T05:14:12.766 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 63/164 2024-05-08T05:14:12.808 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 64/164 2024-05-08T05:14:12.841 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 65/164 2024-05-08T05:14:13.041 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 66/164 2024-05-08T05:14:13.214 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 67/164 2024-05-08T05:14:13.263 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 68/164 2024-05-08T05:14:13.302 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 69/164 2024-05-08T05:14:13.348 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 70/164 2024-05-08T05:14:13.406 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : uuid-1.6.2-55.el9.x86_64 71/164 2024-05-08T05:14:13.460 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 72/164 2024-05-08T05:14:13.507 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 73/164 2024-05-08T05:14:13.553 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 74/164 2024-05-08T05:14:13.604 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 75/164 2024-05-08T05:14:13.671 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 76/164 2024-05-08T05:14:13.719 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 77/164 2024-05-08T05:14:13.861 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 78/164 2024-05-08T05:14:13.926 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 79/164 2024-05-08T05:14:13.968 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 80/164 2024-05-08T05:14:14.040 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 81/164 2024-05-08T05:14:14.196 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-packaging-20.9-5.el9.noarch 82/164 2024-05-08T05:14:14.265 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 83/164 2024-05-08T05:14:15.222 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 84/164 2024-05-08T05:14:15.272 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 85/164 2024-05-08T05:14:15.306 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 86/164 2024-05-08T05:14:15.426 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 87/164 2024-05-08T05:14:15.519 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-devel-3.9.18-3.el9.x86_64 88/164 2024-05-08T05:14:15.626 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 89/164 2024-05-08T05:14:15.665 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 90/164 2024-05-08T05:14:15.901 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : openblas-0.3.21-2.el9.x86_64 91/164 2024-05-08T05:14:15.937 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 92/164 2024-05-08T05:14:16.044 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 93/164 2024-05-08T05:14:16.861 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 94/164 2024-05-08T05:14:16.999 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 95/164 2024-05-08T05:14:18.303 INFO:teuthology.orchestra.run.smithi090.stdout: Running scriptlet: ceph-selinux-2:19.0.0-3538.gbee299f4.el9.x86_64 109/164 2024-05-08T05:14:18.303 INFO:teuthology.orchestra.run.smithi090.stdout:skipping the directory /sys 2024-05-08T05:14:18.303 INFO:teuthology.orchestra.run.smithi090.stdout:skipping the directory /proc 2024-05-08T05:14:18.303 INFO:teuthology.orchestra.run.smithi090.stdout:skipping the directory /mnt 2024-05-08T05:14:18.303 INFO:teuthology.orchestra.run.smithi090.stdout:skipping the directory /var/tmp 2024-05-08T05:14:18.303 INFO:teuthology.orchestra.run.smithi090.stdout:skipping the directory /home 2024-05-08T05:14:18.303 INFO:teuthology.orchestra.run.smithi090.stdout:skipping the directory /root 2024-05-08T05:14:18.303 INFO:teuthology.orchestra.run.smithi090.stdout:skipping the directory /tmp 2024-05-08T05:14:18.303 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-05-08T05:14:18.479 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : ceph-volume-2:19.0.0-3538.gbee299f4.el9.noarch 110/164 2024-05-08T05:14:18.494 INFO:teuthology.orchestra.run.smithi090.stdout: Running scriptlet: ceph-volume-2:19.0.0-3538.gbee299f4.el9.noarch 110/164 2024-05-08T05:14:18.494 INFO:teuthology.orchestra.run.smithi090.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-08T05:14:18.494 INFO:teuthology.orchestra.run.smithi090.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-05-08T05:14:18.494 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-05-08T05:14:18.582 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 96/164 2024-05-08T05:14:18.685 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 97/164 2024-05-08T05:14:18.721 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 98/164 2024-05-08T05:14:18.757 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : libuuid-devel-2.37.4-18.el9.x86_64 99/164 2024-05-08T05:14:19.126 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 100/164 2024-05-08T05:14:19.173 INFO:teuthology.orchestra.run.smithi087.stdout: Upgrading : librbd1-2:19.0.0-3538.gbee299f4.el9.x86_64 101/164 2024-05-08T05:14:19.293 INFO:teuthology.orchestra.run.smithi087.stdout: Running scriptlet: librbd1-2:19.0.0-3538.gbee299f4.el9.x86_64 101/164 2024-05-08T05:14:19.354 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-rbd-2:19.0.0-3538.gbee299f4.el9.x86_64 102/164 2024-05-08T05:14:19.411 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 103/164 2024-05-08T05:14:19.962 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 104/164 2024-05-08T05:14:19.992 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : ceph-osd-2:19.0.0-3538.gbee299f4.el9.x86_64 111/164 2024-05-08T05:14:19.993 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : librgw2-2:19.0.0-3538.gbee299f4.el9.x86_64 105/164 2024-05-08T05:14:20.018 INFO:teuthology.orchestra.run.smithi090.stdout: Running scriptlet: ceph-osd-2:19.0.0-3538.gbee299f4.el9.x86_64 111/164 2024-05-08T05:14:20.018 INFO:teuthology.orchestra.run.smithi090.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-08T05:14:20.018 INFO:teuthology.orchestra.run.smithi090.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-05-08T05:14:20.018 INFO:teuthology.orchestra.run.smithi090.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-05-08T05:14:20.018 INFO:teuthology.orchestra.run.smithi090.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-05-08T05:14:20.019 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-05-08T05:14:20.083 INFO:teuthology.orchestra.run.smithi087.stdout: Running scriptlet: librgw2-2:19.0.0-3538.gbee299f4.el9.x86_64 105/164 2024-05-08T05:14:20.111 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-rgw-2:19.0.0-3538.gbee299f4.el9.x86_64 106/164 2024-05-08T05:14:20.243 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : ceph-mds-2:19.0.0-3538.gbee299f4.el9.x86_64 112/164 2024-05-08T05:14:20.265 INFO:teuthology.orchestra.run.smithi090.stdout: Running scriptlet: ceph-mds-2:19.0.0-3538.gbee299f4.el9.x86_64 112/164 2024-05-08T05:14:20.265 INFO:teuthology.orchestra.run.smithi090.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-08T05:14:20.265 INFO:teuthology.orchestra.run.smithi090.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-05-08T05:14:20.265 INFO:teuthology.orchestra.run.smithi090.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-05-08T05:14:20.265 INFO:teuthology.orchestra.run.smithi090.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-05-08T05:14:20.265 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-05-08T05:14:20.708 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: ceph-selinux-2:19.0.0-3538.gbee299f4.el9.x86_64 109/164 2024-05-08T05:14:20.708 INFO:teuthology.orchestra.run.smithi160.stdout:skipping the directory /sys 2024-05-08T05:14:20.708 INFO:teuthology.orchestra.run.smithi160.stdout:skipping the directory /proc 2024-05-08T05:14:20.708 INFO:teuthology.orchestra.run.smithi160.stdout:skipping the directory /mnt 2024-05-08T05:14:20.708 INFO:teuthology.orchestra.run.smithi160.stdout:skipping the directory /var/tmp 2024-05-08T05:14:20.708 INFO:teuthology.orchestra.run.smithi160.stdout:skipping the directory /home 2024-05-08T05:14:20.708 INFO:teuthology.orchestra.run.smithi160.stdout:skipping the directory /root 2024-05-08T05:14:20.708 INFO:teuthology.orchestra.run.smithi160.stdout:skipping the directory /tmp 2024-05-08T05:14:20.708 INFO:teuthology.orchestra.run.smithi160.stdout: 2024-05-08T05:14:20.727 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : ceph-mon-2:19.0.0-3538.gbee299f4.el9.x86_64 113/164 2024-05-08T05:14:20.750 INFO:teuthology.orchestra.run.smithi090.stdout: Running scriptlet: ceph-mon-2:19.0.0-3538.gbee299f4.el9.x86_64 113/164 2024-05-08T05:14:20.750 INFO:teuthology.orchestra.run.smithi090.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-08T05:14:20.750 INFO:teuthology.orchestra.run.smithi090.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-05-08T05:14:20.750 INFO:teuthology.orchestra.run.smithi090.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-05-08T05:14:20.750 INFO:teuthology.orchestra.run.smithi090.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-05-08T05:14:20.750 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-05-08T05:14:20.857 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : automake-1.16.2-8.el9.noarch 114/164 2024-05-08T05:14:20.885 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : ceph-volume-2:19.0.0-3538.gbee299f4.el9.noarch 110/164 2024-05-08T05:14:20.902 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: ceph-volume-2:19.0.0-3538.gbee299f4.el9.noarch 110/164 2024-05-08T05:14:20.902 INFO:teuthology.orchestra.run.smithi160.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-08T05:14:20.902 INFO:teuthology.orchestra.run.smithi160.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-05-08T05:14:20.902 INFO:teuthology.orchestra.run.smithi160.stdout: 2024-05-08T05:14:20.913 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : python3-ply-3.11-14.el9.noarch 115/164 2024-05-08T05:14:20.977 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 116/164 2024-05-08T05:14:21.161 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 117/164 2024-05-08T05:14:21.212 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 118/164 2024-05-08T05:14:21.290 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 119/164 2024-05-08T05:14:21.378 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 120/164 2024-05-08T05:14:21.518 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 121/164 2024-05-08T05:14:21.563 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 122/164 2024-05-08T05:14:21.596 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 123/164 2024-05-08T05:14:21.623 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : fuse-2.9.9-15.el9.x86_64 124/164 2024-05-08T05:14:22.059 INFO:teuthology.orchestra.run.smithi090.stdout: Running scriptlet: cephadm-2:19.0.0-3538.gbee299f4.el9.noarch 125/164 2024-05-08T05:14:22.091 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : cephadm-2:19.0.0-3538.gbee299f4.el9.noarch 125/164 2024-05-08T05:14:22.131 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : ceph-prometheus-alerts-2:19.0.0-3538.gbee299f4.e 126/164 2024-05-08T05:14:22.192 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : ceph-grafana-dashboards-2:19.0.0-3538.gbee299f4. 127/164 2024-05-08T05:14:22.222 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : ceph-mgr-cephadm-2:19.0.0-3538.gbee299f4.el9.noa 128/164 2024-05-08T05:14:22.396 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : ceph-osd-2:19.0.0-3538.gbee299f4.el9.x86_64 111/164 2024-05-08T05:14:22.421 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: ceph-osd-2:19.0.0-3538.gbee299f4.el9.x86_64 111/164 2024-05-08T05:14:22.422 INFO:teuthology.orchestra.run.smithi160.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-08T05:14:22.422 INFO:teuthology.orchestra.run.smithi160.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-05-08T05:14:22.422 INFO:teuthology.orchestra.run.smithi160.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-05-08T05:14:22.422 INFO:teuthology.orchestra.run.smithi160.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-05-08T05:14:22.422 INFO:teuthology.orchestra.run.smithi160.stdout: 2024-05-08T05:14:22.655 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : ceph-mds-2:19.0.0-3538.gbee299f4.el9.x86_64 112/164 2024-05-08T05:14:22.678 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: ceph-mds-2:19.0.0-3538.gbee299f4.el9.x86_64 112/164 2024-05-08T05:14:22.678 INFO:teuthology.orchestra.run.smithi160.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-08T05:14:22.678 INFO:teuthology.orchestra.run.smithi160.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-05-08T05:14:22.678 INFO:teuthology.orchestra.run.smithi160.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-05-08T05:14:22.678 INFO:teuthology.orchestra.run.smithi160.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-05-08T05:14:22.678 INFO:teuthology.orchestra.run.smithi160.stdout: 2024-05-08T05:14:22.842 INFO:teuthology.orchestra.run.smithi087.stdout: Running scriptlet: ceph-common-2:19.0.0-3538.gbee299f4.el9.x86_64 107/164 2024-05-08T05:14:22.876 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : ceph-common-2:19.0.0-3538.gbee299f4.el9.x86_64 107/164 2024-05-08T05:14:23.156 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : ceph-mon-2:19.0.0-3538.gbee299f4.el9.x86_64 113/164 2024-05-08T05:14:23.179 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: ceph-mon-2:19.0.0-3538.gbee299f4.el9.x86_64 113/164 2024-05-08T05:14:23.179 INFO:teuthology.orchestra.run.smithi160.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-08T05:14:23.179 INFO:teuthology.orchestra.run.smithi160.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-05-08T05:14:23.179 INFO:teuthology.orchestra.run.smithi160.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-05-08T05:14:23.179 INFO:teuthology.orchestra.run.smithi160.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-05-08T05:14:23.179 INFO:teuthology.orchestra.run.smithi160.stdout: 2024-05-08T05:14:23.257 INFO:teuthology.orchestra.run.smithi090.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.0.0-3538.gbee299f4.el9.noa 128/164 2024-05-08T05:14:23.286 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : automake-1.16.2-8.el9.noarch 114/164 2024-05-08T05:14:23.316 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : ceph-mgr-dashboard-2:19.0.0-3538.gbee299f4.el9.n 129/164 2024-05-08T05:14:23.343 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-ply-3.11-14.el9.noarch 115/164 2024-05-08T05:14:23.406 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 116/164 2024-05-08T05:14:23.518 INFO:teuthology.orchestra.run.smithi087.stdout: Running scriptlet: ceph-common-2:19.0.0-3538.gbee299f4.el9.x86_64 107/164 2024-05-08T05:14:23.571 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : ceph-base-2:19.0.0-3538.gbee299f4.el9.x86_64 108/164 2024-05-08T05:14:23.593 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 117/164 2024-05-08T05:14:23.640 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 118/164 2024-05-08T05:14:23.716 INFO:teuthology.orchestra.run.smithi087.stdout: Running scriptlet: ceph-base-2:19.0.0-3538.gbee299f4.el9.x86_64 108/164 2024-05-08T05:14:23.716 INFO:teuthology.orchestra.run.smithi087.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-05-08T05:14:23.717 INFO:teuthology.orchestra.run.smithi087.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-05-08T05:14:23.717 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-05-08T05:14:23.717 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 119/164 2024-05-08T05:14:23.772 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : ceph-selinux-2:19.0.0-3538.gbee299f4.el9.x86_64 109/164 2024-05-08T05:14:23.807 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 120/164 2024-05-08T05:14:23.945 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 121/164 2024-05-08T05:14:23.989 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 122/164 2024-05-08T05:14:24.021 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 123/164 2024-05-08T05:14:24.049 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : fuse-2.9.9-15.el9.x86_64 124/164 2024-05-08T05:14:24.286 INFO:teuthology.orchestra.run.smithi090.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.0.0-3538.gbee299f4.el9.n 129/164 2024-05-08T05:14:24.341 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : ceph-mgr-diskprediction-local-2:19.0.0-3538.gbee 130/164 2024-05-08T05:14:24.409 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: cephadm-2:19.0.0-3538.gbee299f4.el9.noarch 125/164 2024-05-08T05:14:24.439 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : cephadm-2:19.0.0-3538.gbee299f4.el9.noarch 125/164 2024-05-08T05:14:24.452 INFO:teuthology.orchestra.run.smithi090.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.0.0-3538.gbee 130/164 2024-05-08T05:14:24.471 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : ceph-prometheus-alerts-2:19.0.0-3538.gbee299f4.e 126/164 2024-05-08T05:14:24.532 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : ceph-grafana-dashboards-2:19.0.0-3538.gbee299f4. 127/164 2024-05-08T05:14:24.562 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : ceph-mgr-cephadm-2:19.0.0-3538.gbee299f4.el9.noa 128/164 2024-05-08T05:14:24.621 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : ceph-mgr-modules-core-2:19.0.0-3538.gbee299f4.el 131/164 2024-05-08T05:14:24.654 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : ceph-mgr-2:19.0.0-3538.gbee299f4.el9.x86_64 132/164 2024-05-08T05:14:24.676 INFO:teuthology.orchestra.run.smithi090.stdout: Running scriptlet: ceph-mgr-2:19.0.0-3538.gbee299f4.el9.x86_64 132/164 2024-05-08T05:14:24.676 INFO:teuthology.orchestra.run.smithi090.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-08T05:14:24.676 INFO:teuthology.orchestra.run.smithi090.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-05-08T05:14:24.676 INFO:teuthology.orchestra.run.smithi090.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-05-08T05:14:24.677 INFO:teuthology.orchestra.run.smithi090.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-05-08T05:14:24.677 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-05-08T05:14:24.721 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : ceph-mgr-rook-2:19.0.0-3538.gbee299f4.el9.noarch 133/164 2024-05-08T05:14:24.732 INFO:teuthology.orchestra.run.smithi090.stdout: Running scriptlet: ceph-mgr-rook-2:19.0.0-3538.gbee299f4.el9.noarch 133/164 2024-05-08T05:14:24.830 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : ceph-2:19.0.0-3538.gbee299f4.el9.x86_64 134/164 2024-05-08T05:14:24.878 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : ceph-fuse-2:19.0.0-3538.gbee299f4.el9.x86_64 135/164 2024-05-08T05:14:25.613 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.0.0-3538.gbee299f4.el9.noa 128/164 2024-05-08T05:14:25.654 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : ceph-mgr-dashboard-2:19.0.0-3538.gbee299f4.el9.n 129/164 2024-05-08T05:14:25.796 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : libtool-2.4.6-45.el9.x86_64 136/164 2024-05-08T05:14:25.841 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : ceph-radosgw-2:19.0.0-3538.gbee299f4.el9.x86_64 137/164 2024-05-08T05:14:25.863 INFO:teuthology.orchestra.run.smithi090.stdout: Running scriptlet: ceph-radosgw-2:19.0.0-3538.gbee299f4.el9.x86_64 137/164 2024-05-08T05:14:25.863 INFO:teuthology.orchestra.run.smithi090.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-08T05:14:25.863 INFO:teuthology.orchestra.run.smithi090.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-05-08T05:14:25.863 INFO:teuthology.orchestra.run.smithi090.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-05-08T05:14:25.863 INFO:teuthology.orchestra.run.smithi090.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-05-08T05:14:25.864 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-05-08T05:14:25.908 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : ceph-immutable-object-cache-2:19.0.0-3538.gbee29 138/164 2024-05-08T05:14:25.929 INFO:teuthology.orchestra.run.smithi090.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.0.0-3538.gbee29 138/164 2024-05-08T05:14:25.930 INFO:teuthology.orchestra.run.smithi090.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-08T05:14:25.930 INFO:teuthology.orchestra.run.smithi090.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-05-08T05:14:25.930 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-05-08T05:14:25.975 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : cephfs-mirror-2:19.0.0-3538.gbee299f4.el9.x86_64 139/164 2024-05-08T05:14:25.997 INFO:teuthology.orchestra.run.smithi090.stdout: Running scriptlet: cephfs-mirror-2:19.0.0-3538.gbee299f4.el9.x86_64 139/164 2024-05-08T05:14:25.997 INFO:teuthology.orchestra.run.smithi090.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-08T05:14:25.997 INFO:teuthology.orchestra.run.smithi090.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-05-08T05:14:25.998 INFO:teuthology.orchestra.run.smithi090.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-05-08T05:14:25.998 INFO:teuthology.orchestra.run.smithi090.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-05-08T05:14:25.998 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-05-08T05:14:26.301 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : rbd-mirror-2:19.0.0-3538.gbee299f4.el9.x86_64 140/164 2024-05-08T05:14:26.323 INFO:teuthology.orchestra.run.smithi090.stdout: Running scriptlet: rbd-mirror-2:19.0.0-3538.gbee299f4.el9.x86_64 140/164 2024-05-08T05:14:26.323 INFO:teuthology.orchestra.run.smithi090.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-08T05:14:26.324 INFO:teuthology.orchestra.run.smithi090.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-05-08T05:14:26.324 INFO:teuthology.orchestra.run.smithi090.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-05-08T05:14:26.324 INFO:teuthology.orchestra.run.smithi090.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-05-08T05:14:26.324 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-05-08T05:14:26.628 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.0.0-3538.gbee299f4.el9.n 129/164 2024-05-08T05:14:26.655 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : ceph-mgr-diskprediction-local-2:19.0.0-3538.gbee 130/164 2024-05-08T05:14:26.767 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.0.0-3538.gbee 130/164 2024-05-08T05:14:26.926 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : ceph-mgr-modules-core-2:19.0.0-3538.gbee299f4.el 131/164 2024-05-08T05:14:26.966 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : ceph-mgr-2:19.0.0-3538.gbee299f4.el9.x86_64 132/164 2024-05-08T05:14:26.989 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: ceph-mgr-2:19.0.0-3538.gbee299f4.el9.x86_64 132/164 2024-05-08T05:14:26.989 INFO:teuthology.orchestra.run.smithi160.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-08T05:14:26.989 INFO:teuthology.orchestra.run.smithi160.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-05-08T05:14:26.989 INFO:teuthology.orchestra.run.smithi160.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-05-08T05:14:26.989 INFO:teuthology.orchestra.run.smithi160.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-05-08T05:14:26.989 INFO:teuthology.orchestra.run.smithi160.stdout: 2024-05-08T05:14:27.033 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : ceph-mgr-rook-2:19.0.0-3538.gbee299f4.el9.noarch 133/164 2024-05-08T05:14:27.044 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: ceph-mgr-rook-2:19.0.0-3538.gbee299f4.el9.noarch 133/164 2024-05-08T05:14:27.142 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : ceph-2:19.0.0-3538.gbee299f4.el9.x86_64 134/164 2024-05-08T05:14:27.190 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : ceph-fuse-2:19.0.0-3538.gbee299f4.el9.x86_64 135/164 2024-05-08T05:14:28.117 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : libtool-2.4.6-45.el9.x86_64 136/164 2024-05-08T05:14:28.160 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : ceph-radosgw-2:19.0.0-3538.gbee299f4.el9.x86_64 137/164 2024-05-08T05:14:28.183 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: ceph-radosgw-2:19.0.0-3538.gbee299f4.el9.x86_64 137/164 2024-05-08T05:14:28.183 INFO:teuthology.orchestra.run.smithi160.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-08T05:14:28.183 INFO:teuthology.orchestra.run.smithi160.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-05-08T05:14:28.183 INFO:teuthology.orchestra.run.smithi160.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-05-08T05:14:28.183 INFO:teuthology.orchestra.run.smithi160.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-05-08T05:14:28.184 INFO:teuthology.orchestra.run.smithi160.stdout: 2024-05-08T05:14:28.227 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : ceph-immutable-object-cache-2:19.0.0-3538.gbee29 138/164 2024-05-08T05:14:28.249 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.0.0-3538.gbee29 138/164 2024-05-08T05:14:28.249 INFO:teuthology.orchestra.run.smithi160.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-08T05:14:28.249 INFO:teuthology.orchestra.run.smithi160.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-05-08T05:14:28.250 INFO:teuthology.orchestra.run.smithi160.stdout: 2024-05-08T05:14:28.295 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : cephfs-mirror-2:19.0.0-3538.gbee299f4.el9.x86_64 139/164 2024-05-08T05:14:28.317 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: cephfs-mirror-2:19.0.0-3538.gbee299f4.el9.x86_64 139/164 2024-05-08T05:14:28.317 INFO:teuthology.orchestra.run.smithi160.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-08T05:14:28.317 INFO:teuthology.orchestra.run.smithi160.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-05-08T05:14:28.317 INFO:teuthology.orchestra.run.smithi160.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-05-08T05:14:28.318 INFO:teuthology.orchestra.run.smithi160.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-05-08T05:14:28.318 INFO:teuthology.orchestra.run.smithi160.stdout: 2024-05-08T05:14:28.628 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : rbd-mirror-2:19.0.0-3538.gbee299f4.el9.x86_64 140/164 2024-05-08T05:14:28.651 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: rbd-mirror-2:19.0.0-3538.gbee299f4.el9.x86_64 140/164 2024-05-08T05:14:28.652 INFO:teuthology.orchestra.run.smithi160.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-08T05:14:28.652 INFO:teuthology.orchestra.run.smithi160.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-05-08T05:14:28.652 INFO:teuthology.orchestra.run.smithi160.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-05-08T05:14:28.652 INFO:teuthology.orchestra.run.smithi160.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-05-08T05:14:28.652 INFO:teuthology.orchestra.run.smithi160.stdout: 2024-05-08T05:14:30.999 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : ceph-test-2:19.0.0-3538.gbee299f4.el9.x86_64 141/164 2024-05-08T05:14:31.040 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : rbd-fuse-2:19.0.0-3538.gbee299f4.el9.x86_64 142/164 2024-05-08T05:14:31.089 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : rbd-nbd-2:19.0.0-3538.gbee299f4.el9.x86_64 143/164 2024-05-08T05:14:31.122 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : xfsprogs-devel-6.3.0-1.el9.x86_64 144/164 2024-05-08T05:14:31.158 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : elfutils-libelf-devel-0.190-2.el9.x86_64 145/164 2024-05-08T05:14:31.343 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : cephfs-shell-2:19.0.0-3538.gbee299f4.el9.x86_64 146/164 2024-05-08T05:14:31.397 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : postgresql-contrib-13.14-1.el9.x86_64 147/164 2024-05-08T05:14:31.428 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : libcephfs-devel-2:19.0.0-3538.gbee299f4.el9.x86_ 148/164 2024-05-08T05:14:31.457 INFO:teuthology.orchestra.run.smithi090.stdout: Upgrading : NetworkManager-team-1:1.47.5-1.el9.x86_64 149/164 2024-05-08T05:14:31.504 INFO:teuthology.orchestra.run.smithi090.stdout: Upgrading : NetworkManager-tui-1:1.47.5-1.el9.x86_64 150/164 2024-05-08T05:14:32.099 INFO:teuthology.orchestra.run.smithi090.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 151/164 2024-05-08T05:14:32.146 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : postgresql-server-13.14-1.el9.x86_64 151/164 2024-05-08T05:14:32.165 INFO:teuthology.orchestra.run.smithi090.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 151/164 2024-05-08T05:14:32.993 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : cephfs-top-2:19.0.0-3538.gbee299f4.el9.noarch 152/164 2024-05-08T05:14:33.113 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : openssl-devel-1:3.2.1-1.el9.x86_64 153/164 2024-05-08T05:14:33.154 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 154/164 2024-05-08T05:14:33.235 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : flex-2.6.4-9.el9.x86_64 155/164 2024-05-08T05:14:33.265 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : ceph-test-2:19.0.0-3538.gbee299f4.el9.x86_64 141/164 2024-05-08T05:14:33.275 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : bison-3.7.4-5.el9.x86_64 156/164 2024-05-08T05:14:33.307 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : rbd-fuse-2:19.0.0-3538.gbee299f4.el9.x86_64 142/164 2024-05-08T05:14:33.309 INFO:teuthology.orchestra.run.smithi090.stdout: Cleanup : NetworkManager-tui-1:1.47.4-1.el9.x86_64 157/164 2024-05-08T05:14:33.309 INFO:teuthology.orchestra.run.smithi090.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 158/164 2024-05-08T05:14:33.348 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : rbd-nbd-2:19.0.0-3538.gbee299f4.el9.x86_64 143/164 2024-05-08T05:14:33.379 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : xfsprogs-devel-6.3.0-1.el9.x86_64 144/164 2024-05-08T05:14:33.403 INFO:teuthology.orchestra.run.smithi090.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 158/164 2024-05-08T05:14:33.406 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : elfutils-libelf-devel-0.190-2.el9.x86_64 145/164 2024-05-08T05:14:33.436 INFO:teuthology.orchestra.run.smithi090.stdout: Cleanup : openssl-1:3.0.7-27.el9.x86_64 159/164 2024-05-08T05:14:33.436 INFO:teuthology.orchestra.run.smithi090.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 160/164 2024-05-08T05:14:33.521 INFO:teuthology.orchestra.run.smithi090.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 160/164 2024-05-08T05:14:33.546 INFO:teuthology.orchestra.run.smithi090.stdout: Cleanup : NetworkManager-team-1:1.47.4-1.el9.x86_64 161/164 2024-05-08T05:14:33.551 INFO:teuthology.orchestra.run.smithi090.stdout: Running scriptlet: NetworkManager-1:1.47.4-1.el9.x86_64 162/164 2024-05-08T05:14:33.551 INFO:teuthology.orchestra.run.smithi090.stdout: Cleanup : NetworkManager-1:1.47.4-1.el9.x86_64 162/164 2024-05-08T05:14:33.591 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : cephfs-shell-2:19.0.0-3538.gbee299f4.el9.x86_64 146/164 2024-05-08T05:14:33.636 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : postgresql-contrib-13.14-1.el9.x86_64 147/164 2024-05-08T05:14:33.666 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : libcephfs-devel-2:19.0.0-3538.gbee299f4.el9.x86_ 148/164 2024-05-08T05:14:33.696 INFO:teuthology.orchestra.run.smithi160.stdout: Upgrading : NetworkManager-team-1:1.47.5-1.el9.x86_64 149/164 2024-05-08T05:14:33.723 INFO:teuthology.orchestra.run.smithi090.stdout: Running scriptlet: NetworkManager-1:1.47.4-1.el9.x86_64 162/164 2024-05-08T05:14:33.723 INFO:teuthology.orchestra.run.smithi090.stdout: Cleanup : NetworkManager-libnm-1:1.47.4-1.el9.x86_64 163/164 2024-05-08T05:14:33.742 INFO:teuthology.orchestra.run.smithi160.stdout: Upgrading : NetworkManager-tui-1:1.47.5-1.el9.x86_64 150/164 2024-05-08T05:14:33.816 INFO:teuthology.orchestra.run.smithi090.stdout: Running scriptlet: NetworkManager-libnm-1:1.47.4-1.el9.x86_64 163/164 2024-05-08T05:14:33.888 INFO:teuthology.orchestra.run.smithi090.stdout: Cleanup : openssl-libs-1:3.0.7-27.el9.x86_64 164/164 2024-05-08T05:14:34.309 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 151/164 2024-05-08T05:14:34.348 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : postgresql-server-13.14-1.el9.x86_64 151/164 2024-05-08T05:14:34.368 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 151/164 2024-05-08T05:14:35.224 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : cephfs-top-2:19.0.0-3538.gbee299f4.el9.noarch 152/164 2024-05-08T05:14:35.310 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : openssl-devel-1:3.2.1-1.el9.x86_64 153/164 2024-05-08T05:14:35.351 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 154/164 2024-05-08T05:14:35.433 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : flex-2.6.4-9.el9.x86_64 155/164 2024-05-08T05:14:35.463 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : bison-3.7.4-5.el9.x86_64 156/164 2024-05-08T05:14:35.488 INFO:teuthology.orchestra.run.smithi160.stdout: Cleanup : NetworkManager-tui-1:1.47.4-1.el9.x86_64 157/164 2024-05-08T05:14:35.489 INFO:teuthology.orchestra.run.smithi160.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 158/164 2024-05-08T05:14:35.556 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 158/164 2024-05-08T05:14:35.598 INFO:teuthology.orchestra.run.smithi160.stdout: Cleanup : openssl-1:3.0.7-27.el9.x86_64 159/164 2024-05-08T05:14:35.598 INFO:teuthology.orchestra.run.smithi160.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 160/164 2024-05-08T05:14:35.682 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 160/164 2024-05-08T05:14:35.707 INFO:teuthology.orchestra.run.smithi160.stdout: Cleanup : NetworkManager-team-1:1.47.4-1.el9.x86_64 161/164 2024-05-08T05:14:35.712 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: NetworkManager-1:1.47.4-1.el9.x86_64 162/164 2024-05-08T05:14:35.713 INFO:teuthology.orchestra.run.smithi160.stdout: Cleanup : NetworkManager-1:1.47.4-1.el9.x86_64 162/164 2024-05-08T05:14:35.892 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: NetworkManager-1:1.47.4-1.el9.x86_64 162/164 2024-05-08T05:14:35.892 INFO:teuthology.orchestra.run.smithi160.stdout: Cleanup : NetworkManager-libnm-1:1.47.4-1.el9.x86_64 163/164 2024-05-08T05:14:35.976 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: NetworkManager-libnm-1:1.47.4-1.el9.x86_64 163/164 2024-05-08T05:14:36.039 INFO:teuthology.orchestra.run.smithi160.stdout: Cleanup : openssl-libs-1:3.0.7-27.el9.x86_64 164/164 2024-05-08T05:14:36.559 INFO:teuthology.orchestra.run.smithi087.stdout: Running scriptlet: ceph-selinux-2:19.0.0-3538.gbee299f4.el9.x86_64 109/164 2024-05-08T05:14:36.560 INFO:teuthology.orchestra.run.smithi087.stdout:skipping the directory /sys 2024-05-08T05:14:36.560 INFO:teuthology.orchestra.run.smithi087.stdout:skipping the directory /proc 2024-05-08T05:14:36.560 INFO:teuthology.orchestra.run.smithi087.stdout:skipping the directory /mnt 2024-05-08T05:14:36.560 INFO:teuthology.orchestra.run.smithi087.stdout:skipping the directory /var/tmp 2024-05-08T05:14:36.560 INFO:teuthology.orchestra.run.smithi087.stdout:skipping the directory /home 2024-05-08T05:14:36.560 INFO:teuthology.orchestra.run.smithi087.stdout:skipping the directory /root 2024-05-08T05:14:36.560 INFO:teuthology.orchestra.run.smithi087.stdout:skipping the directory /tmp 2024-05-08T05:14:36.560 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-05-08T05:14:36.788 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : ceph-volume-2:19.0.0-3538.gbee299f4.el9.noarch 110/164 2024-05-08T05:14:36.836 INFO:teuthology.orchestra.run.smithi087.stdout: Running scriptlet: ceph-volume-2:19.0.0-3538.gbee299f4.el9.noarch 110/164 2024-05-08T05:14:36.836 INFO:teuthology.orchestra.run.smithi087.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-08T05:14:36.836 INFO:teuthology.orchestra.run.smithi087.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-05-08T05:14:36.836 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-05-08T05:14:38.448 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : ceph-osd-2:19.0.0-3538.gbee299f4.el9.x86_64 111/164 2024-05-08T05:14:38.535 INFO:teuthology.orchestra.run.smithi087.stdout: Running scriptlet: ceph-osd-2:19.0.0-3538.gbee299f4.el9.x86_64 111/164 2024-05-08T05:14:38.535 INFO:teuthology.orchestra.run.smithi087.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-08T05:14:38.535 INFO:teuthology.orchestra.run.smithi087.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-05-08T05:14:38.535 INFO:teuthology.orchestra.run.smithi087.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-05-08T05:14:38.535 INFO:teuthology.orchestra.run.smithi087.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-05-08T05:14:38.536 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-05-08T05:14:38.782 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : ceph-mds-2:19.0.0-3538.gbee299f4.el9.x86_64 112/164 2024-05-08T05:14:38.859 INFO:teuthology.orchestra.run.smithi087.stdout: Running scriptlet: ceph-mds-2:19.0.0-3538.gbee299f4.el9.x86_64 112/164 2024-05-08T05:14:38.859 INFO:teuthology.orchestra.run.smithi087.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-08T05:14:38.859 INFO:teuthology.orchestra.run.smithi087.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-05-08T05:14:38.859 INFO:teuthology.orchestra.run.smithi087.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-05-08T05:14:38.859 INFO:teuthology.orchestra.run.smithi087.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-05-08T05:14:38.859 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-05-08T05:14:39.349 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : ceph-mon-2:19.0.0-3538.gbee299f4.el9.x86_64 113/164 2024-05-08T05:14:39.417 INFO:teuthology.orchestra.run.smithi087.stdout: Running scriptlet: ceph-mon-2:19.0.0-3538.gbee299f4.el9.x86_64 113/164 2024-05-08T05:14:39.417 INFO:teuthology.orchestra.run.smithi087.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-08T05:14:39.417 INFO:teuthology.orchestra.run.smithi087.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-05-08T05:14:39.417 INFO:teuthology.orchestra.run.smithi087.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-05-08T05:14:39.418 INFO:teuthology.orchestra.run.smithi087.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-05-08T05:14:39.418 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-05-08T05:14:39.558 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : automake-1.16.2-8.el9.noarch 114/164 2024-05-08T05:14:39.622 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-ply-3.11-14.el9.noarch 115/164 2024-05-08T05:14:39.695 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 116/164 2024-05-08T05:14:39.936 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 117/164 2024-05-08T05:14:39.995 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 118/164 2024-05-08T05:14:40.079 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 119/164 2024-05-08T05:14:40.197 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 120/164 2024-05-08T05:14:40.364 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 121/164 2024-05-08T05:14:40.419 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 122/164 2024-05-08T05:14:40.469 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 123/164 2024-05-08T05:14:40.502 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : fuse-2.9.9-15.el9.x86_64 124/164 2024-05-08T05:14:41.148 INFO:teuthology.orchestra.run.smithi087.stdout: Running scriptlet: cephadm-2:19.0.0-3538.gbee299f4.el9.noarch 125/164 2024-05-08T05:14:41.188 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : cephadm-2:19.0.0-3538.gbee299f4.el9.noarch 125/164 2024-05-08T05:14:41.245 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : ceph-prometheus-alerts-2:19.0.0-3538.gbee299f4.e 126/164 2024-05-08T05:14:41.354 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : ceph-grafana-dashboards-2:19.0.0-3538.gbee299f4. 127/164 2024-05-08T05:14:41.379 INFO:teuthology.orchestra.run.smithi090.stdout: Running scriptlet: openssl-libs-1:3.0.7-27.el9.x86_64 164/164 2024-05-08T05:14:41.379 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : ceph-2:19.0.0-3538.gbee299f4.el9.x86_64 1/164 2024-05-08T05:14:41.379 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : ceph-base-2:19.0.0-3538.gbee299f4.el9.x86_64 2/164 2024-05-08T05:14:41.379 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : ceph-common-2:19.0.0-3538.gbee299f4.el9.x86_64 3/164 2024-05-08T05:14:41.379 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : ceph-fuse-2:19.0.0-3538.gbee299f4.el9.x86_64 4/164 2024-05-08T05:14:41.379 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : ceph-immutable-object-cache-2:19.0.0-3538.gbee29 5/164 2024-05-08T05:14:41.379 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : ceph-mds-2:19.0.0-3538.gbee299f4.el9.x86_64 6/164 2024-05-08T05:14:41.380 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : ceph-mgr-2:19.0.0-3538.gbee299f4.el9.x86_64 7/164 2024-05-08T05:14:41.380 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : ceph-mon-2:19.0.0-3538.gbee299f4.el9.x86_64 8/164 2024-05-08T05:14:41.380 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : ceph-osd-2:19.0.0-3538.gbee299f4.el9.x86_64 9/164 2024-05-08T05:14:41.380 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : ceph-radosgw-2:19.0.0-3538.gbee299f4.el9.x86_64 10/164 2024-05-08T05:14:41.380 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : ceph-selinux-2:19.0.0-3538.gbee299f4.el9.x86_64 11/164 2024-05-08T05:14:41.380 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : ceph-test-2:19.0.0-3538.gbee299f4.el9.x86_64 12/164 2024-05-08T05:14:41.380 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : cephfs-mirror-2:19.0.0-3538.gbee299f4.el9.x86_64 13/164 2024-05-08T05:14:41.380 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : cephfs-shell-2:19.0.0-3538.gbee299f4.el9.x86_64 14/164 2024-05-08T05:14:41.380 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : libcephfs-devel-2:19.0.0-3538.gbee299f4.el9.x86_ 15/164 2024-05-08T05:14:41.380 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : libcephfs2-2:19.0.0-3538.gbee299f4.el9.x86_64 16/164 2024-05-08T05:14:41.380 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : libcephsqlite-2:19.0.0-3538.gbee299f4.el9.x86_64 17/164 2024-05-08T05:14:41.380 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : librados-devel-2:19.0.0-3538.gbee299f4.el9.x86_6 18/164 2024-05-08T05:14:41.381 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : libradosstriper1-2:19.0.0-3538.gbee299f4.el9.x86 19/164 2024-05-08T05:14:41.381 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : librgw2-2:19.0.0-3538.gbee299f4.el9.x86_64 20/164 2024-05-08T05:14:41.381 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : python3-ceph-argparse-2:19.0.0-3538.gbee299f4.el 21/164 2024-05-08T05:14:41.381 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : python3-ceph-common-2:19.0.0-3538.gbee299f4.el9. 22/164 2024-05-08T05:14:41.381 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : python3-cephfs-2:19.0.0-3538.gbee299f4.el9.x86_6 23/164 2024-05-08T05:14:41.381 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : python3-rados-2:19.0.0-3538.gbee299f4.el9.x86_64 24/164 2024-05-08T05:14:41.381 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : python3-rbd-2:19.0.0-3538.gbee299f4.el9.x86_64 25/164 2024-05-08T05:14:41.381 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : python3-rgw-2:19.0.0-3538.gbee299f4.el9.x86_64 26/164 2024-05-08T05:14:41.381 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : rbd-fuse-2:19.0.0-3538.gbee299f4.el9.x86_64 27/164 2024-05-08T05:14:41.394 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : rbd-mirror-2:19.0.0-3538.gbee299f4.el9.x86_64 28/164 2024-05-08T05:14:41.394 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : rbd-nbd-2:19.0.0-3538.gbee299f4.el9.x86_64 29/164 2024-05-08T05:14:41.394 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : ceph-grafana-dashboards-2:19.0.0-3538.gbee299f4. 30/164 2024-05-08T05:14:41.394 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : ceph-mgr-cephadm-2:19.0.0-3538.gbee299f4.el9.noa 31/164 2024-05-08T05:14:41.394 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : ceph-mgr-dashboard-2:19.0.0-3538.gbee299f4.el9.n 32/164 2024-05-08T05:14:41.394 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.0.0-3538.gbee 33/164 2024-05-08T05:14:41.394 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : ceph-mgr-modules-core-2:19.0.0-3538.gbee299f4.el 34/164 2024-05-08T05:14:41.394 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : ceph-mgr-rook-2:19.0.0-3538.gbee299f4.el9.noarch 35/164 2024-05-08T05:14:41.395 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : ceph-prometheus-alerts-2:19.0.0-3538.gbee299f4.e 36/164 2024-05-08T05:14:41.395 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : ceph-volume-2:19.0.0-3538.gbee299f4.el9.noarch 37/164 2024-05-08T05:14:41.395 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : cephadm-2:19.0.0-3538.gbee299f4.el9.noarch 38/164 2024-05-08T05:14:41.395 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : cephfs-top-2:19.0.0-3538.gbee299f4.el9.noarch 39/164 2024-05-08T05:14:41.395 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 40/164 2024-05-08T05:14:41.395 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 41/164 2024-05-08T05:14:41.395 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 42/164 2024-05-08T05:14:41.395 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/164 2024-05-08T05:14:41.395 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/164 2024-05-08T05:14:41.395 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/164 2024-05-08T05:14:41.395 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/164 2024-05-08T05:14:41.395 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/164 2024-05-08T05:14:41.395 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : python3-urllib3-1.26.5-5.el9.noarch 48/164 2024-05-08T05:14:41.396 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/164 2024-05-08T05:14:41.396 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/164 2024-05-08T05:14:41.396 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/164 2024-05-08T05:14:41.396 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : elfutils-libelf-devel-0.190-2.el9.x86_64 52/164 2024-05-08T05:14:41.396 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/164 2024-05-08T05:14:41.396 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/164 2024-05-08T05:14:41.396 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/164 2024-05-08T05:14:41.396 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/164 2024-05-08T05:14:41.396 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/164 2024-05-08T05:14:41.396 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 58/164 2024-05-08T05:14:41.396 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 59/164 2024-05-08T05:14:41.396 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 60/164 2024-05-08T05:14:41.396 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : libtool-2.4.6-45.el9.x86_64 61/164 2024-05-08T05:14:41.397 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : libuuid-devel-2.37.4-18.el9.x86_64 62/164 2024-05-08T05:14:41.397 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 63/164 2024-05-08T05:14:41.397 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 64/164 2024-05-08T05:14:41.397 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : lua-5.4.4-4.el9.x86_64 65/164 2024-05-08T05:14:41.397 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 66/164 2024-05-08T05:14:41.397 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 67/164 2024-05-08T05:14:41.397 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : openssl-devel-1:3.2.1-1.el9.x86_64 68/164 2024-05-08T05:14:41.397 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : postgresql-13.14-1.el9.x86_64 69/164 2024-05-08T05:14:41.397 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : postgresql-contrib-13.14-1.el9.x86_64 70/164 2024-05-08T05:14:41.397 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : postgresql-private-libs-13.14-1.el9.x86_64 71/164 2024-05-08T05:14:41.397 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : postgresql-server-13.14-1.el9.x86_64 72/164 2024-05-08T05:14:41.397 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 73/164 2024-05-08T05:14:41.397 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 74/164 2024-05-08T05:14:41.397 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 75/164 2024-05-08T05:14:41.398 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : python3-devel-3.9.18-3.el9.x86_64 76/164 2024-05-08T05:14:41.398 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : python3-jinja2-2.11.3-5.el9.noarch 77/164 2024-05-08T05:14:41.398 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 78/164 2024-05-08T05:14:41.398 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 79/164 2024-05-08T05:14:41.398 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 80/164 2024-05-08T05:14:41.398 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 81/164 2024-05-08T05:14:41.398 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 82/164 2024-05-08T05:14:41.398 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 83/164 2024-05-08T05:14:41.398 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 84/164 2024-05-08T05:14:41.398 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 85/164 2024-05-08T05:14:41.398 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 86/164 2024-05-08T05:14:41.398 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 87/164 2024-05-08T05:14:41.398 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 88/164 2024-05-08T05:14:41.399 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 89/164 2024-05-08T05:14:41.399 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 90/164 2024-05-08T05:14:41.399 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 91/164 2024-05-08T05:14:41.399 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 92/164 2024-05-08T05:14:41.399 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 93/164 2024-05-08T05:14:41.399 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 94/164 2024-05-08T05:14:41.399 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 95/164 2024-05-08T05:14:41.399 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 96/164 2024-05-08T05:14:41.399 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 97/164 2024-05-08T05:14:41.399 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 98/164 2024-05-08T05:14:41.399 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 99/164 2024-05-08T05:14:41.399 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : xfsprogs-devel-6.3.0-1.el9.x86_64 100/164 2024-05-08T05:14:41.399 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 101/164 2024-05-08T05:14:41.400 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 102/164 2024-05-08T05:14:41.400 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 103/164 2024-05-08T05:14:41.400 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 104/164 2024-05-08T05:14:41.400 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 105/164 2024-05-08T05:14:41.400 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 106/164 2024-05-08T05:14:41.400 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 107/164 2024-05-08T05:14:41.400 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 108/164 2024-05-08T05:14:41.400 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 109/164 2024-05-08T05:14:41.400 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 110/164 2024-05-08T05:14:41.400 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 111/164 2024-05-08T05:14:41.400 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : luarocks-3.9.2-1.el9.noarch 112/164 2024-05-08T05:14:41.400 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 113/164 2024-05-08T05:14:41.400 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 114/164 2024-05-08T05:14:41.400 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 115/164 2024-05-08T05:14:41.401 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 116/164 2024-05-08T05:14:41.401 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 117/164 2024-05-08T05:14:41.401 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 118/164 2024-05-08T05:14:41.401 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 119/164 2024-05-08T05:14:41.401 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 120/164 2024-05-08T05:14:41.401 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : python3-colorama-0.4.4-12.el9.noarch 121/164 2024-05-08T05:14:41.401 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : python3-google-auth-1:2.29.0-1.el9.noarch 122/164 2024-05-08T05:14:41.401 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 123/164 2024-05-08T05:14:41.401 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 124/164 2024-05-08T05:14:41.401 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 125/164 2024-05-08T05:14:41.401 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 126/164 2024-05-08T05:14:41.401 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 127/164 2024-05-08T05:14:41.401 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 128/164 2024-05-08T05:14:41.401 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 129/164 2024-05-08T05:14:41.402 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 130/164 2024-05-08T05:14:41.402 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 131/164 2024-05-08T05:14:41.402 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 132/164 2024-05-08T05:14:41.402 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 133/164 2024-05-08T05:14:41.402 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 134/164 2024-05-08T05:14:41.402 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 135/164 2024-05-08T05:14:41.402 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 136/164 2024-05-08T05:14:41.402 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 137/164 2024-05-08T05:14:41.402 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 138/164 2024-05-08T05:14:41.402 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 139/164 2024-05-08T05:14:41.402 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 140/164 2024-05-08T05:14:41.402 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 141/164 2024-05-08T05:14:41.402 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 142/164 2024-05-08T05:14:41.402 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 143/164 2024-05-08T05:14:41.403 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 144/164 2024-05-08T05:14:41.403 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 145/164 2024-05-08T05:14:41.403 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 146/164 2024-05-08T05:14:41.403 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : re2-1:20211101-3.el9.x86_64 147/164 2024-05-08T05:14:41.403 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 148/164 2024-05-08T05:14:41.403 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : librados2-2:19.0.0-3538.gbee299f4.el9.x86_64 149/164 2024-05-08T05:14:41.403 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 150/164 2024-05-08T05:14:41.403 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : librbd1-2:19.0.0-3538.gbee299f4.el9.x86_64 151/164 2024-05-08T05:14:41.403 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 152/164 2024-05-08T05:14:41.403 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : NetworkManager-1:1.47.5-1.el9.x86_64 153/164 2024-05-08T05:14:41.403 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : NetworkManager-1:1.47.4-1.el9.x86_64 154/164 2024-05-08T05:14:41.403 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : NetworkManager-libnm-1:1.47.5-1.el9.x86_64 155/164 2024-05-08T05:14:41.403 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : NetworkManager-libnm-1:1.47.4-1.el9.x86_64 156/164 2024-05-08T05:14:41.404 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : NetworkManager-team-1:1.47.5-1.el9.x86_64 157/164 2024-05-08T05:14:41.404 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : NetworkManager-team-1:1.47.4-1.el9.x86_64 158/164 2024-05-08T05:14:41.404 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : NetworkManager-tui-1:1.47.5-1.el9.x86_64 159/164 2024-05-08T05:14:41.404 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : NetworkManager-tui-1:1.47.4-1.el9.x86_64 160/164 2024-05-08T05:14:41.404 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : openssl-1:3.2.1-1.el9.x86_64 161/164 2024-05-08T05:14:41.404 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : openssl-1:3.0.7-27.el9.x86_64 162/164 2024-05-08T05:14:41.404 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : openssl-libs-1:3.2.1-1.el9.x86_64 163/164 2024-05-08T05:14:41.404 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : ceph-mgr-cephadm-2:19.0.0-3538.gbee299f4.el9.noa 128/164 2024-05-08T05:14:41.497 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: openssl-libs-1:3.0.7-27.el9.x86_64 164/164 2024-05-08T05:14:41.497 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : ceph-2:19.0.0-3538.gbee299f4.el9.x86_64 1/164 2024-05-08T05:14:41.497 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : ceph-base-2:19.0.0-3538.gbee299f4.el9.x86_64 2/164 2024-05-08T05:14:41.497 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : ceph-common-2:19.0.0-3538.gbee299f4.el9.x86_64 3/164 2024-05-08T05:14:41.497 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : ceph-fuse-2:19.0.0-3538.gbee299f4.el9.x86_64 4/164 2024-05-08T05:14:41.497 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : ceph-immutable-object-cache-2:19.0.0-3538.gbee29 5/164 2024-05-08T05:14:41.497 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : ceph-mds-2:19.0.0-3538.gbee299f4.el9.x86_64 6/164 2024-05-08T05:14:41.497 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : ceph-mgr-2:19.0.0-3538.gbee299f4.el9.x86_64 7/164 2024-05-08T05:14:41.497 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : ceph-mon-2:19.0.0-3538.gbee299f4.el9.x86_64 8/164 2024-05-08T05:14:41.498 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : ceph-osd-2:19.0.0-3538.gbee299f4.el9.x86_64 9/164 2024-05-08T05:14:41.498 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : ceph-radosgw-2:19.0.0-3538.gbee299f4.el9.x86_64 10/164 2024-05-08T05:14:41.498 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : ceph-selinux-2:19.0.0-3538.gbee299f4.el9.x86_64 11/164 2024-05-08T05:14:41.498 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : ceph-test-2:19.0.0-3538.gbee299f4.el9.x86_64 12/164 2024-05-08T05:14:41.498 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : cephfs-mirror-2:19.0.0-3538.gbee299f4.el9.x86_64 13/164 2024-05-08T05:14:41.498 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : cephfs-shell-2:19.0.0-3538.gbee299f4.el9.x86_64 14/164 2024-05-08T05:14:41.498 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : libcephfs-devel-2:19.0.0-3538.gbee299f4.el9.x86_ 15/164 2024-05-08T05:14:41.498 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : libcephfs2-2:19.0.0-3538.gbee299f4.el9.x86_64 16/164 2024-05-08T05:14:41.498 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : libcephsqlite-2:19.0.0-3538.gbee299f4.el9.x86_64 17/164 2024-05-08T05:14:41.498 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : librados-devel-2:19.0.0-3538.gbee299f4.el9.x86_6 18/164 2024-05-08T05:14:41.498 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : libradosstriper1-2:19.0.0-3538.gbee299f4.el9.x86 19/164 2024-05-08T05:14:41.498 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : librgw2-2:19.0.0-3538.gbee299f4.el9.x86_64 20/164 2024-05-08T05:14:41.498 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-ceph-argparse-2:19.0.0-3538.gbee299f4.el 21/164 2024-05-08T05:14:41.499 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-ceph-common-2:19.0.0-3538.gbee299f4.el9. 22/164 2024-05-08T05:14:41.499 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-cephfs-2:19.0.0-3538.gbee299f4.el9.x86_6 23/164 2024-05-08T05:14:41.499 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-rados-2:19.0.0-3538.gbee299f4.el9.x86_64 24/164 2024-05-08T05:14:41.499 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-rbd-2:19.0.0-3538.gbee299f4.el9.x86_64 25/164 2024-05-08T05:14:41.499 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-rgw-2:19.0.0-3538.gbee299f4.el9.x86_64 26/164 2024-05-08T05:14:41.499 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : rbd-fuse-2:19.0.0-3538.gbee299f4.el9.x86_64 27/164 2024-05-08T05:14:41.499 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : rbd-mirror-2:19.0.0-3538.gbee299f4.el9.x86_64 28/164 2024-05-08T05:14:41.499 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : rbd-nbd-2:19.0.0-3538.gbee299f4.el9.x86_64 29/164 2024-05-08T05:14:41.499 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : ceph-grafana-dashboards-2:19.0.0-3538.gbee299f4. 30/164 2024-05-08T05:14:41.499 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : ceph-mgr-cephadm-2:19.0.0-3538.gbee299f4.el9.noa 31/164 2024-05-08T05:14:41.499 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : ceph-mgr-dashboard-2:19.0.0-3538.gbee299f4.el9.n 32/164 2024-05-08T05:14:41.499 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.0.0-3538.gbee 33/164 2024-05-08T05:14:41.499 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : ceph-mgr-modules-core-2:19.0.0-3538.gbee299f4.el 34/164 2024-05-08T05:14:41.499 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : ceph-mgr-rook-2:19.0.0-3538.gbee299f4.el9.noarch 35/164 2024-05-08T05:14:41.500 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : ceph-prometheus-alerts-2:19.0.0-3538.gbee299f4.e 36/164 2024-05-08T05:14:41.500 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : ceph-volume-2:19.0.0-3538.gbee299f4.el9.noarch 37/164 2024-05-08T05:14:41.500 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : cephadm-2:19.0.0-3538.gbee299f4.el9.noarch 38/164 2024-05-08T05:14:41.500 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : cephfs-top-2:19.0.0-3538.gbee299f4.el9.noarch 39/164 2024-05-08T05:14:41.500 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 40/164 2024-05-08T05:14:41.500 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 41/164 2024-05-08T05:14:41.500 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 42/164 2024-05-08T05:14:41.500 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/164 2024-05-08T05:14:41.500 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/164 2024-05-08T05:14:41.500 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/164 2024-05-08T05:14:41.500 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/164 2024-05-08T05:14:41.500 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/164 2024-05-08T05:14:41.500 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-urllib3-1.26.5-5.el9.noarch 48/164 2024-05-08T05:14:41.500 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/164 2024-05-08T05:14:41.501 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/164 2024-05-08T05:14:41.501 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/164 2024-05-08T05:14:41.501 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : elfutils-libelf-devel-0.190-2.el9.x86_64 52/164 2024-05-08T05:14:41.501 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/164 2024-05-08T05:14:41.501 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/164 2024-05-08T05:14:41.501 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/164 2024-05-08T05:14:41.501 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/164 2024-05-08T05:14:41.501 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/164 2024-05-08T05:14:41.501 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 58/164 2024-05-08T05:14:41.501 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 59/164 2024-05-08T05:14:41.501 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 60/164 2024-05-08T05:14:41.501 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : libtool-2.4.6-45.el9.x86_64 61/164 2024-05-08T05:14:41.501 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : libuuid-devel-2.37.4-18.el9.x86_64 62/164 2024-05-08T05:14:41.501 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 63/164 2024-05-08T05:14:41.502 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 64/164 2024-05-08T05:14:41.502 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : lua-5.4.4-4.el9.x86_64 65/164 2024-05-08T05:14:41.502 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 66/164 2024-05-08T05:14:41.502 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 67/164 2024-05-08T05:14:41.502 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : openssl-devel-1:3.2.1-1.el9.x86_64 68/164 2024-05-08T05:14:41.502 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : postgresql-13.14-1.el9.x86_64 69/164 2024-05-08T05:14:41.502 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : postgresql-contrib-13.14-1.el9.x86_64 70/164 2024-05-08T05:14:41.502 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : postgresql-private-libs-13.14-1.el9.x86_64 71/164 2024-05-08T05:14:41.502 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : postgresql-server-13.14-1.el9.x86_64 72/164 2024-05-08T05:14:41.502 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 73/164 2024-05-08T05:14:41.502 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 74/164 2024-05-08T05:14:41.502 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 75/164 2024-05-08T05:14:41.502 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-devel-3.9.18-3.el9.x86_64 76/164 2024-05-08T05:14:41.502 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-jinja2-2.11.3-5.el9.noarch 77/164 2024-05-08T05:14:41.503 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 78/164 2024-05-08T05:14:41.503 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 79/164 2024-05-08T05:14:41.503 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 80/164 2024-05-08T05:14:41.503 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 81/164 2024-05-08T05:14:41.503 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 82/164 2024-05-08T05:14:41.503 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 83/164 2024-05-08T05:14:41.503 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 84/164 2024-05-08T05:14:41.503 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 85/164 2024-05-08T05:14:41.503 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 86/164 2024-05-08T05:14:41.503 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 87/164 2024-05-08T05:14:41.503 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 88/164 2024-05-08T05:14:41.503 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 89/164 2024-05-08T05:14:41.503 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 90/164 2024-05-08T05:14:41.503 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 91/164 2024-05-08T05:14:41.504 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 92/164 2024-05-08T05:14:41.504 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 93/164 2024-05-08T05:14:41.504 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 94/164 2024-05-08T05:14:41.504 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 95/164 2024-05-08T05:14:41.504 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 96/164 2024-05-08T05:14:41.504 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 97/164 2024-05-08T05:14:41.504 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 98/164 2024-05-08T05:14:41.504 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 99/164 2024-05-08T05:14:41.504 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : xfsprogs-devel-6.3.0-1.el9.x86_64 100/164 2024-05-08T05:14:41.504 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 101/164 2024-05-08T05:14:41.504 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 102/164 2024-05-08T05:14:41.504 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 103/164 2024-05-08T05:14:41.504 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 104/164 2024-05-08T05:14:41.505 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 105/164 2024-05-08T05:14:41.505 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 106/164 2024-05-08T05:14:41.505 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 107/164 2024-05-08T05:14:41.505 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 108/164 2024-05-08T05:14:41.505 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 109/164 2024-05-08T05:14:41.505 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 110/164 2024-05-08T05:14:41.505 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 111/164 2024-05-08T05:14:41.505 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : luarocks-3.9.2-1.el9.noarch 112/164 2024-05-08T05:14:41.505 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 113/164 2024-05-08T05:14:41.505 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 114/164 2024-05-08T05:14:41.505 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 115/164 2024-05-08T05:14:41.505 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 116/164 2024-05-08T05:14:41.505 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 117/164 2024-05-08T05:14:41.505 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 118/164 2024-05-08T05:14:41.506 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 119/164 2024-05-08T05:14:41.506 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 120/164 2024-05-08T05:14:41.506 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-colorama-0.4.4-12.el9.noarch 121/164 2024-05-08T05:14:41.506 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-google-auth-1:2.29.0-1.el9.noarch 122/164 2024-05-08T05:14:41.506 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 123/164 2024-05-08T05:14:41.506 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 124/164 2024-05-08T05:14:41.506 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 125/164 2024-05-08T05:14:41.506 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 126/164 2024-05-08T05:14:41.506 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 127/164 2024-05-08T05:14:41.506 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 128/164 2024-05-08T05:14:41.506 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 129/164 2024-05-08T05:14:41.506 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 130/164 2024-05-08T05:14:41.506 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 131/164 2024-05-08T05:14:41.507 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 132/164 2024-05-08T05:14:41.507 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 133/164 2024-05-08T05:14:41.507 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 134/164 2024-05-08T05:14:41.507 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 135/164 2024-05-08T05:14:41.507 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 136/164 2024-05-08T05:14:41.507 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 137/164 2024-05-08T05:14:41.507 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 138/164 2024-05-08T05:14:41.507 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 139/164 2024-05-08T05:14:41.507 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 140/164 2024-05-08T05:14:41.507 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 141/164 2024-05-08T05:14:41.507 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 142/164 2024-05-08T05:14:41.507 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 143/164 2024-05-08T05:14:41.507 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 144/164 2024-05-08T05:14:41.507 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 145/164 2024-05-08T05:14:41.508 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 146/164 2024-05-08T05:14:41.508 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : re2-1:20211101-3.el9.x86_64 147/164 2024-05-08T05:14:41.508 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 148/164 2024-05-08T05:14:41.508 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : librados2-2:19.0.0-3538.gbee299f4.el9.x86_64 149/164 2024-05-08T05:14:41.508 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 150/164 2024-05-08T05:14:41.508 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : librbd1-2:19.0.0-3538.gbee299f4.el9.x86_64 151/164 2024-05-08T05:14:41.508 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 152/164 2024-05-08T05:14:41.508 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : NetworkManager-1:1.47.5-1.el9.x86_64 153/164 2024-05-08T05:14:41.508 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : NetworkManager-1:1.47.4-1.el9.x86_64 154/164 2024-05-08T05:14:41.508 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : NetworkManager-libnm-1:1.47.5-1.el9.x86_64 155/164 2024-05-08T05:14:41.508 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : NetworkManager-libnm-1:1.47.4-1.el9.x86_64 156/164 2024-05-08T05:14:41.508 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : NetworkManager-team-1:1.47.5-1.el9.x86_64 157/164 2024-05-08T05:14:41.508 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : NetworkManager-team-1:1.47.4-1.el9.x86_64 158/164 2024-05-08T05:14:41.508 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : NetworkManager-tui-1:1.47.5-1.el9.x86_64 159/164 2024-05-08T05:14:41.509 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : NetworkManager-tui-1:1.47.4-1.el9.x86_64 160/164 2024-05-08T05:14:41.509 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : openssl-1:3.2.1-1.el9.x86_64 161/164 2024-05-08T05:14:41.509 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : openssl-1:3.0.7-27.el9.x86_64 162/164 2024-05-08T05:14:41.509 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : openssl-libs-1:3.2.1-1.el9.x86_64 163/164 2024-05-08T05:14:42.715 INFO:teuthology.orchestra.run.smithi087.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.0.0-3538.gbee299f4.el9.noa 128/164 2024-05-08T05:14:42.767 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : ceph-mgr-dashboard-2:19.0.0-3538.gbee299f4.el9.n 129/164 2024-05-08T05:14:43.865 INFO:teuthology.orchestra.run.smithi087.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.0.0-3538.gbee299f4.el9.n 129/164 2024-05-08T05:14:43.892 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : ceph-mgr-diskprediction-local-2:19.0.0-3538.gbee 130/164 2024-05-08T05:14:44.049 INFO:teuthology.orchestra.run.smithi087.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.0.0-3538.gbee 130/164 2024-05-08T05:14:44.081 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : openssl-libs-1:3.0.7-27.el9.x86_64 164/164 2024-05-08T05:14:44.081 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-05-08T05:14:44.081 INFO:teuthology.orchestra.run.smithi090.stdout:Upgraded: 2024-05-08T05:14:44.081 INFO:teuthology.orchestra.run.smithi090.stdout: NetworkManager-1:1.47.5-1.el9.x86_64 2024-05-08T05:14:44.081 INFO:teuthology.orchestra.run.smithi090.stdout: NetworkManager-libnm-1:1.47.5-1.el9.x86_64 2024-05-08T05:14:44.081 INFO:teuthology.orchestra.run.smithi090.stdout: NetworkManager-team-1:1.47.5-1.el9.x86_64 2024-05-08T05:14:44.081 INFO:teuthology.orchestra.run.smithi090.stdout: NetworkManager-tui-1:1.47.5-1.el9.x86_64 2024-05-08T05:14:44.081 INFO:teuthology.orchestra.run.smithi090.stdout: librados2-2:19.0.0-3538.gbee299f4.el9.x86_64 2024-05-08T05:14:44.081 INFO:teuthology.orchestra.run.smithi090.stdout: librbd1-2:19.0.0-3538.gbee299f4.el9.x86_64 2024-05-08T05:14:44.081 INFO:teuthology.orchestra.run.smithi090.stdout: openssl-1:3.2.1-1.el9.x86_64 2024-05-08T05:14:44.081 INFO:teuthology.orchestra.run.smithi090.stdout: openssl-libs-1:3.2.1-1.el9.x86_64 2024-05-08T05:14:44.082 INFO:teuthology.orchestra.run.smithi090.stdout:Installed: 2024-05-08T05:14:44.082 INFO:teuthology.orchestra.run.smithi090.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-05-08T05:14:44.082 INFO:teuthology.orchestra.run.smithi090.stdout: automake-1.16.2-8.el9.noarch 2024-05-08T05:14:44.082 INFO:teuthology.orchestra.run.smithi090.stdout: bison-3.7.4-5.el9.x86_64 2024-05-08T05:14:44.082 INFO:teuthology.orchestra.run.smithi090.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-05-08T05:14:44.082 INFO:teuthology.orchestra.run.smithi090.stdout: ceph-2:19.0.0-3538.gbee299f4.el9.x86_64 2024-05-08T05:14:44.082 INFO:teuthology.orchestra.run.smithi090.stdout: ceph-base-2:19.0.0-3538.gbee299f4.el9.x86_64 2024-05-08T05:14:44.082 INFO:teuthology.orchestra.run.smithi090.stdout: ceph-common-2:19.0.0-3538.gbee299f4.el9.x86_64 2024-05-08T05:14:44.082 INFO:teuthology.orchestra.run.smithi090.stdout: ceph-fuse-2:19.0.0-3538.gbee299f4.el9.x86_64 2024-05-08T05:14:44.082 INFO:teuthology.orchestra.run.smithi090.stdout: ceph-grafana-dashboards-2:19.0.0-3538.gbee299f4.el9.noarch 2024-05-08T05:14:44.082 INFO:teuthology.orchestra.run.smithi090.stdout: ceph-immutable-object-cache-2:19.0.0-3538.gbee299f4.el9.x86_64 2024-05-08T05:14:44.082 INFO:teuthology.orchestra.run.smithi090.stdout: ceph-mds-2:19.0.0-3538.gbee299f4.el9.x86_64 2024-05-08T05:14:44.082 INFO:teuthology.orchestra.run.smithi090.stdout: ceph-mgr-2:19.0.0-3538.gbee299f4.el9.x86_64 2024-05-08T05:14:44.082 INFO:teuthology.orchestra.run.smithi090.stdout: ceph-mgr-cephadm-2:19.0.0-3538.gbee299f4.el9.noarch 2024-05-08T05:14:44.083 INFO:teuthology.orchestra.run.smithi090.stdout: ceph-mgr-dashboard-2:19.0.0-3538.gbee299f4.el9.noarch 2024-05-08T05:14:44.083 INFO:teuthology.orchestra.run.smithi090.stdout: ceph-mgr-diskprediction-local-2:19.0.0-3538.gbee299f4.el9.noarch 2024-05-08T05:14:44.083 INFO:teuthology.orchestra.run.smithi090.stdout: ceph-mgr-modules-core-2:19.0.0-3538.gbee299f4.el9.noarch 2024-05-08T05:14:44.083 INFO:teuthology.orchestra.run.smithi090.stdout: ceph-mgr-rook-2:19.0.0-3538.gbee299f4.el9.noarch 2024-05-08T05:14:44.083 INFO:teuthology.orchestra.run.smithi090.stdout: ceph-mon-2:19.0.0-3538.gbee299f4.el9.x86_64 2024-05-08T05:14:44.083 INFO:teuthology.orchestra.run.smithi090.stdout: ceph-osd-2:19.0.0-3538.gbee299f4.el9.x86_64 2024-05-08T05:14:44.083 INFO:teuthology.orchestra.run.smithi090.stdout: ceph-prometheus-alerts-2:19.0.0-3538.gbee299f4.el9.noarch 2024-05-08T05:14:44.083 INFO:teuthology.orchestra.run.smithi090.stdout: ceph-radosgw-2:19.0.0-3538.gbee299f4.el9.x86_64 2024-05-08T05:14:44.083 INFO:teuthology.orchestra.run.smithi090.stdout: ceph-selinux-2:19.0.0-3538.gbee299f4.el9.x86_64 2024-05-08T05:14:44.083 INFO:teuthology.orchestra.run.smithi090.stdout: ceph-test-2:19.0.0-3538.gbee299f4.el9.x86_64 2024-05-08T05:14:44.083 INFO:teuthology.orchestra.run.smithi090.stdout: ceph-volume-2:19.0.0-3538.gbee299f4.el9.noarch 2024-05-08T05:14:44.083 INFO:teuthology.orchestra.run.smithi090.stdout: cephadm-2:19.0.0-3538.gbee299f4.el9.noarch 2024-05-08T05:14:44.083 INFO:teuthology.orchestra.run.smithi090.stdout: cephfs-mirror-2:19.0.0-3538.gbee299f4.el9.x86_64 2024-05-08T05:14:44.084 INFO:teuthology.orchestra.run.smithi090.stdout: cephfs-shell-2:19.0.0-3538.gbee299f4.el9.x86_64 2024-05-08T05:14:44.084 INFO:teuthology.orchestra.run.smithi090.stdout: cephfs-top-2:19.0.0-3538.gbee299f4.el9.noarch 2024-05-08T05:14:44.084 INFO:teuthology.orchestra.run.smithi090.stdout: elfutils-libelf-devel-0.190-2.el9.x86_64 2024-05-08T05:14:44.084 INFO:teuthology.orchestra.run.smithi090.stdout: flex-2.6.4-9.el9.x86_64 2024-05-08T05:14:44.084 INFO:teuthology.orchestra.run.smithi090.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-05-08T05:14:44.084 INFO:teuthology.orchestra.run.smithi090.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-05-08T05:14:44.084 INFO:teuthology.orchestra.run.smithi090.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-05-08T05:14:44.084 INFO:teuthology.orchestra.run.smithi090.stdout: fuse-2.9.9-15.el9.x86_64 2024-05-08T05:14:44.084 INFO:teuthology.orchestra.run.smithi090.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-05-08T05:14:44.084 INFO:teuthology.orchestra.run.smithi090.stdout: grpc-data-1.46.7-10.el9.noarch 2024-05-08T05:14:44.084 INFO:teuthology.orchestra.run.smithi090.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-05-08T05:14:44.084 INFO:teuthology.orchestra.run.smithi090.stdout: libarrow-9.0.0-11.el9.x86_64 2024-05-08T05:14:44.084 INFO:teuthology.orchestra.run.smithi090.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-05-08T05:14:44.084 INFO:teuthology.orchestra.run.smithi090.stdout: libcephfs-devel-2:19.0.0-3538.gbee299f4.el9.x86_64 2024-05-08T05:14:44.084 INFO:teuthology.orchestra.run.smithi090.stdout: libcephfs2-2:19.0.0-3538.gbee299f4.el9.x86_64 2024-05-08T05:14:44.085 INFO:teuthology.orchestra.run.smithi090.stdout: libcephsqlite-2:19.0.0-3538.gbee299f4.el9.x86_64 2024-05-08T05:14:44.085 INFO:teuthology.orchestra.run.smithi090.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-05-08T05:14:44.085 INFO:teuthology.orchestra.run.smithi090.stdout: liboath-2.6.7-2.el9.x86_64 2024-05-08T05:14:44.085 INFO:teuthology.orchestra.run.smithi090.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-05-08T05:14:44.085 INFO:teuthology.orchestra.run.smithi090.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-05-08T05:14:44.085 INFO:teuthology.orchestra.run.smithi090.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-05-08T05:14:44.085 INFO:teuthology.orchestra.run.smithi090.stdout: librados-devel-2:19.0.0-3538.gbee299f4.el9.x86_64 2024-05-08T05:14:44.085 INFO:teuthology.orchestra.run.smithi090.stdout: libradosstriper1-2:19.0.0-3538.gbee299f4.el9.x86_64 2024-05-08T05:14:44.085 INFO:teuthology.orchestra.run.smithi090.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-05-08T05:14:44.085 INFO:teuthology.orchestra.run.smithi090.stdout: librgw2-2:19.0.0-3538.gbee299f4.el9.x86_64 2024-05-08T05:14:44.085 INFO:teuthology.orchestra.run.smithi090.stdout: libtool-2.4.6-45.el9.x86_64 2024-05-08T05:14:44.085 INFO:teuthology.orchestra.run.smithi090.stdout: libunwind-1.6.2-1.el9.x86_64 2024-05-08T05:14:44.085 INFO:teuthology.orchestra.run.smithi090.stdout: libuuid-devel-2.37.4-18.el9.x86_64 2024-05-08T05:14:44.085 INFO:teuthology.orchestra.run.smithi090.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-05-08T05:14:44.086 INFO:teuthology.orchestra.run.smithi090.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-05-08T05:14:44.086 INFO:teuthology.orchestra.run.smithi090.stdout: lua-5.4.4-4.el9.x86_64 2024-05-08T05:14:44.086 INFO:teuthology.orchestra.run.smithi090.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-05-08T05:14:44.086 INFO:teuthology.orchestra.run.smithi090.stdout: luarocks-3.9.2-1.el9.noarch 2024-05-08T05:14:44.086 INFO:teuthology.orchestra.run.smithi090.stdout: openblas-0.3.21-2.el9.x86_64 2024-05-08T05:14:44.086 INFO:teuthology.orchestra.run.smithi090.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-05-08T05:14:44.086 INFO:teuthology.orchestra.run.smithi090.stdout: openssl-devel-1:3.2.1-1.el9.x86_64 2024-05-08T05:14:44.086 INFO:teuthology.orchestra.run.smithi090.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-05-08T05:14:44.086 INFO:teuthology.orchestra.run.smithi090.stdout: postgresql-13.14-1.el9.x86_64 2024-05-08T05:14:44.086 INFO:teuthology.orchestra.run.smithi090.stdout: postgresql-contrib-13.14-1.el9.x86_64 2024-05-08T05:14:44.086 INFO:teuthology.orchestra.run.smithi090.stdout: postgresql-private-libs-13.14-1.el9.x86_64 2024-05-08T05:14:44.086 INFO:teuthology.orchestra.run.smithi090.stdout: postgresql-server-13.14-1.el9.x86_64 2024-05-08T05:14:44.086 INFO:teuthology.orchestra.run.smithi090.stdout: protobuf-3.14.0-13.el9.x86_64 2024-05-08T05:14:44.087 INFO:teuthology.orchestra.run.smithi090.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-05-08T05:14:44.087 INFO:teuthology.orchestra.run.smithi090.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-05-08T05:14:44.087 INFO:teuthology.orchestra.run.smithi090.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-05-08T05:14:44.087 INFO:teuthology.orchestra.run.smithi090.stdout: python3-babel-2.9.1-2.el9.noarch 2024-05-08T05:14:44.087 INFO:teuthology.orchestra.run.smithi090.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-05-08T05:14:44.087 INFO:teuthology.orchestra.run.smithi090.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-05-08T05:14:44.087 INFO:teuthology.orchestra.run.smithi090.stdout: python3-ceph-argparse-2:19.0.0-3538.gbee299f4.el9.x86_64 2024-05-08T05:14:44.087 INFO:teuthology.orchestra.run.smithi090.stdout: python3-ceph-common-2:19.0.0-3538.gbee299f4.el9.x86_64 2024-05-08T05:14:44.087 INFO:teuthology.orchestra.run.smithi090.stdout: python3-cephfs-2:19.0.0-3538.gbee299f4.el9.x86_64 2024-05-08T05:14:44.087 INFO:teuthology.orchestra.run.smithi090.stdout: python3-certifi-2021.10.8-2.el9.noarch 2024-05-08T05:14:44.087 INFO:teuthology.orchestra.run.smithi090.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-05-08T05:14:44.087 INFO:teuthology.orchestra.run.smithi090.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-05-08T05:14:44.087 INFO:teuthology.orchestra.run.smithi090.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-05-08T05:14:44.087 INFO:teuthology.orchestra.run.smithi090.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-05-08T05:14:44.088 INFO:teuthology.orchestra.run.smithi090.stdout: python3-colorama-0.4.4-12.el9.noarch 2024-05-08T05:14:44.088 INFO:teuthology.orchestra.run.smithi090.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-05-08T05:14:44.088 INFO:teuthology.orchestra.run.smithi090.stdout: python3-devel-3.9.18-3.el9.x86_64 2024-05-08T05:14:44.088 INFO:teuthology.orchestra.run.smithi090.stdout: python3-google-auth-1:2.29.0-1.el9.noarch 2024-05-08T05:14:44.088 INFO:teuthology.orchestra.run.smithi090.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-05-08T05:14:44.088 INFO:teuthology.orchestra.run.smithi090.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-05-08T05:14:44.088 INFO:teuthology.orchestra.run.smithi090.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-05-08T05:14:44.088 INFO:teuthology.orchestra.run.smithi090.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-05-08T05:14:44.088 INFO:teuthology.orchestra.run.smithi090.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-05-08T05:14:44.088 INFO:teuthology.orchestra.run.smithi090.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-05-08T05:14:44.088 INFO:teuthology.orchestra.run.smithi090.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-05-08T05:14:44.088 INFO:teuthology.orchestra.run.smithi090.stdout: python3-jinja2-2.11.3-5.el9.noarch 2024-05-08T05:14:44.088 INFO:teuthology.orchestra.run.smithi090.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-05-08T05:14:44.089 INFO:teuthology.orchestra.run.smithi090.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-05-08T05:14:44.089 INFO:teuthology.orchestra.run.smithi090.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-05-08T05:14:44.089 INFO:teuthology.orchestra.run.smithi090.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-05-08T05:14:44.089 INFO:teuthology.orchestra.run.smithi090.stdout: python3-mako-1.1.4-6.el9.noarch 2024-05-08T05:14:44.089 INFO:teuthology.orchestra.run.smithi090.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-05-08T05:14:44.089 INFO:teuthology.orchestra.run.smithi090.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-05-08T05:14:44.089 INFO:teuthology.orchestra.run.smithi090.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-05-08T05:14:44.089 INFO:teuthology.orchestra.run.smithi090.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-05-08T05:14:44.089 INFO:teuthology.orchestra.run.smithi090.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-05-08T05:14:44.089 INFO:teuthology.orchestra.run.smithi090.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-05-08T05:14:44.090 INFO:teuthology.orchestra.run.smithi090.stdout: python3-packaging-20.9-5.el9.noarch 2024-05-08T05:14:44.090 INFO:teuthology.orchestra.run.smithi090.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-05-08T05:14:44.090 INFO:teuthology.orchestra.run.smithi090.stdout: python3-ply-3.11-14.el9.noarch 2024-05-08T05:14:44.090 INFO:teuthology.orchestra.run.smithi090.stdout: python3-portend-3.1.0-2.el9.noarch 2024-05-08T05:14:44.090 INFO:teuthology.orchestra.run.smithi090.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-05-08T05:14:44.090 INFO:teuthology.orchestra.run.smithi090.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-05-08T05:14:44.090 INFO:teuthology.orchestra.run.smithi090.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-05-08T05:14:44.090 INFO:teuthology.orchestra.run.smithi090.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-05-08T05:14:44.090 INFO:teuthology.orchestra.run.smithi090.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-05-08T05:14:44.090 INFO:teuthology.orchestra.run.smithi090.stdout: python3-pycparser-2.20-6.el9.noarch 2024-05-08T05:14:44.090 INFO:teuthology.orchestra.run.smithi090.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-05-08T05:14:44.090 INFO:teuthology.orchestra.run.smithi090.stdout: python3-pytz-2021.1-5.el9.noarch 2024-05-08T05:14:44.090 INFO:teuthology.orchestra.run.smithi090.stdout: python3-rados-2:19.0.0-3538.gbee299f4.el9.x86_64 2024-05-08T05:14:44.090 INFO:teuthology.orchestra.run.smithi090.stdout: python3-rbd-2:19.0.0-3538.gbee299f4.el9.x86_64 2024-05-08T05:14:44.091 INFO:teuthology.orchestra.run.smithi090.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-05-08T05:14:44.091 INFO:teuthology.orchestra.run.smithi090.stdout: python3-requests-2.25.1-8.el9.noarch 2024-05-08T05:14:44.091 INFO:teuthology.orchestra.run.smithi090.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-05-08T05:14:44.091 INFO:teuthology.orchestra.run.smithi090.stdout: python3-rgw-2:19.0.0-3538.gbee299f4.el9.x86_64 2024-05-08T05:14:44.091 INFO:teuthology.orchestra.run.smithi090.stdout: python3-routes-2.5.1-5.el9.noarch 2024-05-08T05:14:44.091 INFO:teuthology.orchestra.run.smithi090.stdout: python3-rsa-4.9-2.el9.noarch 2024-05-08T05:14:44.091 INFO:teuthology.orchestra.run.smithi090.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-05-08T05:14:44.091 INFO:teuthology.orchestra.run.smithi090.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-05-08T05:14:44.091 INFO:teuthology.orchestra.run.smithi090.stdout: python3-toml-0.10.2-6.el9.noarch 2024-05-08T05:14:44.091 INFO:teuthology.orchestra.run.smithi090.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2024-05-08T05:14:44.091 INFO:teuthology.orchestra.run.smithi090.stdout: python3-urllib3-1.26.5-5.el9.noarch 2024-05-08T05:14:44.091 INFO:teuthology.orchestra.run.smithi090.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-05-08T05:14:44.091 INFO:teuthology.orchestra.run.smithi090.stdout: python3-webob-1.8.7-6.el9.noarch 2024-05-08T05:14:44.091 INFO:teuthology.orchestra.run.smithi090.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-05-08T05:14:44.092 INFO:teuthology.orchestra.run.smithi090.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-05-08T05:14:44.092 INFO:teuthology.orchestra.run.smithi090.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-05-08T05:14:44.092 INFO:teuthology.orchestra.run.smithi090.stdout: qatlib-24.02.0-1.el9.x86_64 2024-05-08T05:14:44.092 INFO:teuthology.orchestra.run.smithi090.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-05-08T05:14:44.092 INFO:teuthology.orchestra.run.smithi090.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-05-08T05:14:44.092 INFO:teuthology.orchestra.run.smithi090.stdout: rbd-fuse-2:19.0.0-3538.gbee299f4.el9.x86_64 2024-05-08T05:14:44.092 INFO:teuthology.orchestra.run.smithi090.stdout: rbd-mirror-2:19.0.0-3538.gbee299f4.el9.x86_64 2024-05-08T05:14:44.092 INFO:teuthology.orchestra.run.smithi090.stdout: rbd-nbd-2:19.0.0-3538.gbee299f4.el9.x86_64 2024-05-08T05:14:44.092 INFO:teuthology.orchestra.run.smithi090.stdout: re2-1:20211101-3.el9.x86_64 2024-05-08T05:14:44.092 INFO:teuthology.orchestra.run.smithi090.stdout: socat-1.7.4.1-5.el9.x86_64 2024-05-08T05:14:44.092 INFO:teuthology.orchestra.run.smithi090.stdout: thrift-0.15.0-2.el9.x86_64 2024-05-08T05:14:44.092 INFO:teuthology.orchestra.run.smithi090.stdout: uuid-1.6.2-55.el9.x86_64 2024-05-08T05:14:44.092 INFO:teuthology.orchestra.run.smithi090.stdout: xfsprogs-devel-6.3.0-1.el9.x86_64 2024-05-08T05:14:44.092 INFO:teuthology.orchestra.run.smithi090.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-05-08T05:14:44.093 INFO:teuthology.orchestra.run.smithi090.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-05-08T05:14:44.093 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-05-08T05:14:44.093 INFO:teuthology.orchestra.run.smithi090.stdout:Complete! 2024-05-08T05:14:44.220 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : openssl-libs-1:3.0.7-27.el9.x86_64 164/164 2024-05-08T05:14:44.220 INFO:teuthology.orchestra.run.smithi160.stdout: 2024-05-08T05:14:44.220 INFO:teuthology.orchestra.run.smithi160.stdout:Upgraded: 2024-05-08T05:14:44.220 INFO:teuthology.orchestra.run.smithi160.stdout: NetworkManager-1:1.47.5-1.el9.x86_64 2024-05-08T05:14:44.220 INFO:teuthology.orchestra.run.smithi160.stdout: NetworkManager-libnm-1:1.47.5-1.el9.x86_64 2024-05-08T05:14:44.221 INFO:teuthology.orchestra.run.smithi160.stdout: NetworkManager-team-1:1.47.5-1.el9.x86_64 2024-05-08T05:14:44.221 INFO:teuthology.orchestra.run.smithi160.stdout: NetworkManager-tui-1:1.47.5-1.el9.x86_64 2024-05-08T05:14:44.221 INFO:teuthology.orchestra.run.smithi160.stdout: librados2-2:19.0.0-3538.gbee299f4.el9.x86_64 2024-05-08T05:14:44.221 INFO:teuthology.orchestra.run.smithi160.stdout: librbd1-2:19.0.0-3538.gbee299f4.el9.x86_64 2024-05-08T05:14:44.221 INFO:teuthology.orchestra.run.smithi160.stdout: openssl-1:3.2.1-1.el9.x86_64 2024-05-08T05:14:44.221 INFO:teuthology.orchestra.run.smithi160.stdout: openssl-libs-1:3.2.1-1.el9.x86_64 2024-05-08T05:14:44.221 INFO:teuthology.orchestra.run.smithi160.stdout:Installed: 2024-05-08T05:14:44.221 INFO:teuthology.orchestra.run.smithi160.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-05-08T05:14:44.221 INFO:teuthology.orchestra.run.smithi160.stdout: automake-1.16.2-8.el9.noarch 2024-05-08T05:14:44.221 INFO:teuthology.orchestra.run.smithi160.stdout: bison-3.7.4-5.el9.x86_64 2024-05-08T05:14:44.221 INFO:teuthology.orchestra.run.smithi160.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-05-08T05:14:44.221 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-2:19.0.0-3538.gbee299f4.el9.x86_64 2024-05-08T05:14:44.221 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-base-2:19.0.0-3538.gbee299f4.el9.x86_64 2024-05-08T05:14:44.222 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-common-2:19.0.0-3538.gbee299f4.el9.x86_64 2024-05-08T05:14:44.222 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-fuse-2:19.0.0-3538.gbee299f4.el9.x86_64 2024-05-08T05:14:44.222 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-grafana-dashboards-2:19.0.0-3538.gbee299f4.el9.noarch 2024-05-08T05:14:44.222 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-immutable-object-cache-2:19.0.0-3538.gbee299f4.el9.x86_64 2024-05-08T05:14:44.222 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-mds-2:19.0.0-3538.gbee299f4.el9.x86_64 2024-05-08T05:14:44.222 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-mgr-2:19.0.0-3538.gbee299f4.el9.x86_64 2024-05-08T05:14:44.222 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-mgr-cephadm-2:19.0.0-3538.gbee299f4.el9.noarch 2024-05-08T05:14:44.222 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-mgr-dashboard-2:19.0.0-3538.gbee299f4.el9.noarch 2024-05-08T05:14:44.222 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-mgr-diskprediction-local-2:19.0.0-3538.gbee299f4.el9.noarch 2024-05-08T05:14:44.222 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-mgr-modules-core-2:19.0.0-3538.gbee299f4.el9.noarch 2024-05-08T05:14:44.222 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-mgr-rook-2:19.0.0-3538.gbee299f4.el9.noarch 2024-05-08T05:14:44.222 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-mon-2:19.0.0-3538.gbee299f4.el9.x86_64 2024-05-08T05:14:44.222 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-osd-2:19.0.0-3538.gbee299f4.el9.x86_64 2024-05-08T05:14:44.223 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-prometheus-alerts-2:19.0.0-3538.gbee299f4.el9.noarch 2024-05-08T05:14:44.223 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-radosgw-2:19.0.0-3538.gbee299f4.el9.x86_64 2024-05-08T05:14:44.223 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-selinux-2:19.0.0-3538.gbee299f4.el9.x86_64 2024-05-08T05:14:44.223 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-test-2:19.0.0-3538.gbee299f4.el9.x86_64 2024-05-08T05:14:44.223 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-volume-2:19.0.0-3538.gbee299f4.el9.noarch 2024-05-08T05:14:44.223 INFO:teuthology.orchestra.run.smithi160.stdout: cephadm-2:19.0.0-3538.gbee299f4.el9.noarch 2024-05-08T05:14:44.223 INFO:teuthology.orchestra.run.smithi160.stdout: cephfs-mirror-2:19.0.0-3538.gbee299f4.el9.x86_64 2024-05-08T05:14:44.223 INFO:teuthology.orchestra.run.smithi160.stdout: cephfs-shell-2:19.0.0-3538.gbee299f4.el9.x86_64 2024-05-08T05:14:44.223 INFO:teuthology.orchestra.run.smithi160.stdout: cephfs-top-2:19.0.0-3538.gbee299f4.el9.noarch 2024-05-08T05:14:44.223 INFO:teuthology.orchestra.run.smithi160.stdout: elfutils-libelf-devel-0.190-2.el9.x86_64 2024-05-08T05:14:44.223 INFO:teuthology.orchestra.run.smithi160.stdout: flex-2.6.4-9.el9.x86_64 2024-05-08T05:14:44.223 INFO:teuthology.orchestra.run.smithi160.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-05-08T05:14:44.223 INFO:teuthology.orchestra.run.smithi160.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-05-08T05:14:44.224 INFO:teuthology.orchestra.run.smithi160.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-05-08T05:14:44.224 INFO:teuthology.orchestra.run.smithi160.stdout: fuse-2.9.9-15.el9.x86_64 2024-05-08T05:14:44.224 INFO:teuthology.orchestra.run.smithi160.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-05-08T05:14:44.224 INFO:teuthology.orchestra.run.smithi160.stdout: grpc-data-1.46.7-10.el9.noarch 2024-05-08T05:14:44.224 INFO:teuthology.orchestra.run.smithi160.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-05-08T05:14:44.224 INFO:teuthology.orchestra.run.smithi160.stdout: libarrow-9.0.0-11.el9.x86_64 2024-05-08T05:14:44.224 INFO:teuthology.orchestra.run.smithi160.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-05-08T05:14:44.224 INFO:teuthology.orchestra.run.smithi160.stdout: libcephfs-devel-2:19.0.0-3538.gbee299f4.el9.x86_64 2024-05-08T05:14:44.224 INFO:teuthology.orchestra.run.smithi160.stdout: libcephfs2-2:19.0.0-3538.gbee299f4.el9.x86_64 2024-05-08T05:14:44.224 INFO:teuthology.orchestra.run.smithi160.stdout: libcephsqlite-2:19.0.0-3538.gbee299f4.el9.x86_64 2024-05-08T05:14:44.224 INFO:teuthology.orchestra.run.smithi160.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-05-08T05:14:44.224 INFO:teuthology.orchestra.run.smithi160.stdout: liboath-2.6.7-2.el9.x86_64 2024-05-08T05:14:44.224 INFO:teuthology.orchestra.run.smithi160.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-05-08T05:14:44.225 INFO:teuthology.orchestra.run.smithi160.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-05-08T05:14:44.225 INFO:teuthology.orchestra.run.smithi160.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-05-08T05:14:44.225 INFO:teuthology.orchestra.run.smithi160.stdout: librados-devel-2:19.0.0-3538.gbee299f4.el9.x86_64 2024-05-08T05:14:44.225 INFO:teuthology.orchestra.run.smithi160.stdout: libradosstriper1-2:19.0.0-3538.gbee299f4.el9.x86_64 2024-05-08T05:14:44.225 INFO:teuthology.orchestra.run.smithi160.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-05-08T05:14:44.225 INFO:teuthology.orchestra.run.smithi160.stdout: librgw2-2:19.0.0-3538.gbee299f4.el9.x86_64 2024-05-08T05:14:44.225 INFO:teuthology.orchestra.run.smithi160.stdout: libtool-2.4.6-45.el9.x86_64 2024-05-08T05:14:44.225 INFO:teuthology.orchestra.run.smithi160.stdout: libunwind-1.6.2-1.el9.x86_64 2024-05-08T05:14:44.225 INFO:teuthology.orchestra.run.smithi160.stdout: libuuid-devel-2.37.4-18.el9.x86_64 2024-05-08T05:14:44.225 INFO:teuthology.orchestra.run.smithi160.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-05-08T05:14:44.226 INFO:teuthology.orchestra.run.smithi160.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-05-08T05:14:44.226 INFO:teuthology.orchestra.run.smithi160.stdout: lua-5.4.4-4.el9.x86_64 2024-05-08T05:14:44.226 INFO:teuthology.orchestra.run.smithi160.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-05-08T05:14:44.226 INFO:teuthology.orchestra.run.smithi160.stdout: luarocks-3.9.2-1.el9.noarch 2024-05-08T05:14:44.226 INFO:teuthology.orchestra.run.smithi160.stdout: openblas-0.3.21-2.el9.x86_64 2024-05-08T05:14:44.226 INFO:teuthology.orchestra.run.smithi160.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-05-08T05:14:44.226 INFO:teuthology.orchestra.run.smithi160.stdout: openssl-devel-1:3.2.1-1.el9.x86_64 2024-05-08T05:14:44.226 INFO:teuthology.orchestra.run.smithi160.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-05-08T05:14:44.226 INFO:teuthology.orchestra.run.smithi160.stdout: postgresql-13.14-1.el9.x86_64 2024-05-08T05:14:44.226 INFO:teuthology.orchestra.run.smithi160.stdout: postgresql-contrib-13.14-1.el9.x86_64 2024-05-08T05:14:44.226 INFO:teuthology.orchestra.run.smithi160.stdout: postgresql-private-libs-13.14-1.el9.x86_64 2024-05-08T05:14:44.226 INFO:teuthology.orchestra.run.smithi160.stdout: postgresql-server-13.14-1.el9.x86_64 2024-05-08T05:14:44.226 INFO:teuthology.orchestra.run.smithi160.stdout: protobuf-3.14.0-13.el9.x86_64 2024-05-08T05:14:44.226 INFO:teuthology.orchestra.run.smithi160.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-05-08T05:14:44.227 INFO:teuthology.orchestra.run.smithi160.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-05-08T05:14:44.227 INFO:teuthology.orchestra.run.smithi160.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-05-08T05:14:44.227 INFO:teuthology.orchestra.run.smithi160.stdout: python3-babel-2.9.1-2.el9.noarch 2024-05-08T05:14:44.227 INFO:teuthology.orchestra.run.smithi160.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-05-08T05:14:44.227 INFO:teuthology.orchestra.run.smithi160.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-05-08T05:14:44.227 INFO:teuthology.orchestra.run.smithi160.stdout: python3-ceph-argparse-2:19.0.0-3538.gbee299f4.el9.x86_64 2024-05-08T05:14:44.227 INFO:teuthology.orchestra.run.smithi160.stdout: python3-ceph-common-2:19.0.0-3538.gbee299f4.el9.x86_64 2024-05-08T05:14:44.227 INFO:teuthology.orchestra.run.smithi160.stdout: python3-cephfs-2:19.0.0-3538.gbee299f4.el9.x86_64 2024-05-08T05:14:44.227 INFO:teuthology.orchestra.run.smithi160.stdout: python3-certifi-2021.10.8-2.el9.noarch 2024-05-08T05:14:44.227 INFO:teuthology.orchestra.run.smithi160.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-05-08T05:14:44.227 INFO:teuthology.orchestra.run.smithi160.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-05-08T05:14:44.227 INFO:teuthology.orchestra.run.smithi160.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-05-08T05:14:44.227 INFO:teuthology.orchestra.run.smithi160.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-05-08T05:14:44.227 INFO:teuthology.orchestra.run.smithi160.stdout: python3-colorama-0.4.4-12.el9.noarch 2024-05-08T05:14:44.227 INFO:teuthology.orchestra.run.smithi160.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-05-08T05:14:44.228 INFO:teuthology.orchestra.run.smithi160.stdout: python3-devel-3.9.18-3.el9.x86_64 2024-05-08T05:14:44.228 INFO:teuthology.orchestra.run.smithi160.stdout: python3-google-auth-1:2.29.0-1.el9.noarch 2024-05-08T05:14:44.228 INFO:teuthology.orchestra.run.smithi160.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-05-08T05:14:44.228 INFO:teuthology.orchestra.run.smithi160.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-05-08T05:14:44.228 INFO:teuthology.orchestra.run.smithi160.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-05-08T05:14:44.228 INFO:teuthology.orchestra.run.smithi160.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-05-08T05:14:44.228 INFO:teuthology.orchestra.run.smithi160.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-05-08T05:14:44.228 INFO:teuthology.orchestra.run.smithi160.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-05-08T05:14:44.228 INFO:teuthology.orchestra.run.smithi160.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-05-08T05:14:44.228 INFO:teuthology.orchestra.run.smithi160.stdout: python3-jinja2-2.11.3-5.el9.noarch 2024-05-08T05:14:44.228 INFO:teuthology.orchestra.run.smithi160.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-05-08T05:14:44.228 INFO:teuthology.orchestra.run.smithi160.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-05-08T05:14:44.228 INFO:teuthology.orchestra.run.smithi160.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-05-08T05:14:44.228 INFO:teuthology.orchestra.run.smithi160.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-05-08T05:14:44.229 INFO:teuthology.orchestra.run.smithi160.stdout: python3-mako-1.1.4-6.el9.noarch 2024-05-08T05:14:44.229 INFO:teuthology.orchestra.run.smithi160.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-05-08T05:14:44.229 INFO:teuthology.orchestra.run.smithi160.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-05-08T05:14:44.229 INFO:teuthology.orchestra.run.smithi160.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-05-08T05:14:44.229 INFO:teuthology.orchestra.run.smithi160.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-05-08T05:14:44.229 INFO:teuthology.orchestra.run.smithi160.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-05-08T05:14:44.229 INFO:teuthology.orchestra.run.smithi160.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-05-08T05:14:44.229 INFO:teuthology.orchestra.run.smithi160.stdout: python3-packaging-20.9-5.el9.noarch 2024-05-08T05:14:44.229 INFO:teuthology.orchestra.run.smithi160.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-05-08T05:14:44.229 INFO:teuthology.orchestra.run.smithi160.stdout: python3-ply-3.11-14.el9.noarch 2024-05-08T05:14:44.229 INFO:teuthology.orchestra.run.smithi160.stdout: python3-portend-3.1.0-2.el9.noarch 2024-05-08T05:14:44.229 INFO:teuthology.orchestra.run.smithi160.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-05-08T05:14:44.229 INFO:teuthology.orchestra.run.smithi160.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-05-08T05:14:44.229 INFO:teuthology.orchestra.run.smithi160.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-05-08T05:14:44.229 INFO:teuthology.orchestra.run.smithi160.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-05-08T05:14:44.230 INFO:teuthology.orchestra.run.smithi160.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-05-08T05:14:44.230 INFO:teuthology.orchestra.run.smithi160.stdout: python3-pycparser-2.20-6.el9.noarch 2024-05-08T05:14:44.230 INFO:teuthology.orchestra.run.smithi160.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-05-08T05:14:44.230 INFO:teuthology.orchestra.run.smithi160.stdout: python3-pytz-2021.1-5.el9.noarch 2024-05-08T05:14:44.230 INFO:teuthology.orchestra.run.smithi160.stdout: python3-rados-2:19.0.0-3538.gbee299f4.el9.x86_64 2024-05-08T05:14:44.230 INFO:teuthology.orchestra.run.smithi160.stdout: python3-rbd-2:19.0.0-3538.gbee299f4.el9.x86_64 2024-05-08T05:14:44.230 INFO:teuthology.orchestra.run.smithi160.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-05-08T05:14:44.230 INFO:teuthology.orchestra.run.smithi160.stdout: python3-requests-2.25.1-8.el9.noarch 2024-05-08T05:14:44.230 INFO:teuthology.orchestra.run.smithi160.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-05-08T05:14:44.230 INFO:teuthology.orchestra.run.smithi160.stdout: python3-rgw-2:19.0.0-3538.gbee299f4.el9.x86_64 2024-05-08T05:14:44.230 INFO:teuthology.orchestra.run.smithi160.stdout: python3-routes-2.5.1-5.el9.noarch 2024-05-08T05:14:44.230 INFO:teuthology.orchestra.run.smithi160.stdout: python3-rsa-4.9-2.el9.noarch 2024-05-08T05:14:44.230 INFO:teuthology.orchestra.run.smithi160.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-05-08T05:14:44.230 INFO:teuthology.orchestra.run.smithi160.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-05-08T05:14:44.231 INFO:teuthology.orchestra.run.smithi160.stdout: python3-toml-0.10.2-6.el9.noarch 2024-05-08T05:14:44.231 INFO:teuthology.orchestra.run.smithi160.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2024-05-08T05:14:44.231 INFO:teuthology.orchestra.run.smithi160.stdout: python3-urllib3-1.26.5-5.el9.noarch 2024-05-08T05:14:44.231 INFO:teuthology.orchestra.run.smithi160.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-05-08T05:14:44.231 INFO:teuthology.orchestra.run.smithi160.stdout: python3-webob-1.8.7-6.el9.noarch 2024-05-08T05:14:44.231 INFO:teuthology.orchestra.run.smithi160.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-05-08T05:14:44.231 INFO:teuthology.orchestra.run.smithi160.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-05-08T05:14:44.231 INFO:teuthology.orchestra.run.smithi160.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-05-08T05:14:44.231 INFO:teuthology.orchestra.run.smithi160.stdout: qatlib-24.02.0-1.el9.x86_64 2024-05-08T05:14:44.231 INFO:teuthology.orchestra.run.smithi160.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-05-08T05:14:44.231 INFO:teuthology.orchestra.run.smithi160.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-05-08T05:14:44.231 INFO:teuthology.orchestra.run.smithi160.stdout: rbd-fuse-2:19.0.0-3538.gbee299f4.el9.x86_64 2024-05-08T05:14:44.231 INFO:teuthology.orchestra.run.smithi160.stdout: rbd-mirror-2:19.0.0-3538.gbee299f4.el9.x86_64 2024-05-08T05:14:44.231 INFO:teuthology.orchestra.run.smithi160.stdout: rbd-nbd-2:19.0.0-3538.gbee299f4.el9.x86_64 2024-05-08T05:14:44.231 INFO:teuthology.orchestra.run.smithi160.stdout: re2-1:20211101-3.el9.x86_64 2024-05-08T05:14:44.232 INFO:teuthology.orchestra.run.smithi160.stdout: socat-1.7.4.1-5.el9.x86_64 2024-05-08T05:14:44.232 INFO:teuthology.orchestra.run.smithi160.stdout: thrift-0.15.0-2.el9.x86_64 2024-05-08T05:14:44.232 INFO:teuthology.orchestra.run.smithi160.stdout: uuid-1.6.2-55.el9.x86_64 2024-05-08T05:14:44.232 INFO:teuthology.orchestra.run.smithi160.stdout: xfsprogs-devel-6.3.0-1.el9.x86_64 2024-05-08T05:14:44.232 INFO:teuthology.orchestra.run.smithi160.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-05-08T05:14:44.232 INFO:teuthology.orchestra.run.smithi160.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-05-08T05:14:44.232 INFO:teuthology.orchestra.run.smithi160.stdout: 2024-05-08T05:14:44.232 INFO:teuthology.orchestra.run.smithi160.stdout:Complete! 2024-05-08T05:14:44.240 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : ceph-mgr-modules-core-2:19.0.0-3538.gbee299f4.el 131/164 2024-05-08T05:14:44.269 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : ceph-mgr-2:19.0.0-3538.gbee299f4.el9.x86_64 132/164 2024-05-08T05:14:44.343 INFO:teuthology.orchestra.run.smithi087.stdout: Running scriptlet: ceph-mgr-2:19.0.0-3538.gbee299f4.el9.x86_64 132/164 2024-05-08T05:14:44.343 INFO:teuthology.orchestra.run.smithi087.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-08T05:14:44.343 INFO:teuthology.orchestra.run.smithi087.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-05-08T05:14:44.343 INFO:teuthology.orchestra.run.smithi087.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-05-08T05:14:44.343 INFO:teuthology.orchestra.run.smithi087.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-05-08T05:14:44.343 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-05-08T05:14:44.420 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : ceph-mgr-rook-2:19.0.0-3538.gbee299f4.el9.noarch 133/164 2024-05-08T05:14:44.459 INFO:teuthology.orchestra.run.smithi087.stdout: Running scriptlet: ceph-mgr-rook-2:19.0.0-3538.gbee299f4.el9.noarch 133/164 2024-05-08T05:14:44.541 DEBUG:teuthology.parallel:result is None 2024-05-08T05:14:44.569 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : ceph-2:19.0.0-3538.gbee299f4.el9.x86_64 134/164 2024-05-08T05:14:44.641 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : ceph-fuse-2:19.0.0-3538.gbee299f4.el9.x86_64 135/164 2024-05-08T05:14:44.649 DEBUG:teuthology.parallel:result is None 2024-05-08T05:14:45.659 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : libtool-2.4.6-45.el9.x86_64 136/164 2024-05-08T05:14:45.698 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : ceph-radosgw-2:19.0.0-3538.gbee299f4.el9.x86_64 137/164 2024-05-08T05:14:45.777 INFO:teuthology.orchestra.run.smithi087.stdout: Running scriptlet: ceph-radosgw-2:19.0.0-3538.gbee299f4.el9.x86_64 137/164 2024-05-08T05:14:45.777 INFO:teuthology.orchestra.run.smithi087.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-08T05:14:45.777 INFO:teuthology.orchestra.run.smithi087.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-05-08T05:14:45.777 INFO:teuthology.orchestra.run.smithi087.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-05-08T05:14:45.777 INFO:teuthology.orchestra.run.smithi087.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-05-08T05:14:45.777 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-05-08T05:14:45.823 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : ceph-immutable-object-cache-2:19.0.0-3538.gbee29 138/164 2024-05-08T05:14:45.910 INFO:teuthology.orchestra.run.smithi087.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.0.0-3538.gbee29 138/164 2024-05-08T05:14:45.911 INFO:teuthology.orchestra.run.smithi087.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-08T05:14:45.911 INFO:teuthology.orchestra.run.smithi087.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-05-08T05:14:45.911 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-05-08T05:14:45.983 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : cephfs-mirror-2:19.0.0-3538.gbee299f4.el9.x86_64 139/164 2024-05-08T05:14:46.081 INFO:teuthology.orchestra.run.smithi087.stdout: Running scriptlet: cephfs-mirror-2:19.0.0-3538.gbee299f4.el9.x86_64 139/164 2024-05-08T05:14:46.081 INFO:teuthology.orchestra.run.smithi087.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-08T05:14:46.081 INFO:teuthology.orchestra.run.smithi087.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-05-08T05:14:46.081 INFO:teuthology.orchestra.run.smithi087.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-05-08T05:14:46.081 INFO:teuthology.orchestra.run.smithi087.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-05-08T05:14:46.081 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-05-08T05:14:46.458 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : rbd-mirror-2:19.0.0-3538.gbee299f4.el9.x86_64 140/164 2024-05-08T05:14:46.539 INFO:teuthology.orchestra.run.smithi087.stdout: Running scriptlet: rbd-mirror-2:19.0.0-3538.gbee299f4.el9.x86_64 140/164 2024-05-08T05:14:46.540 INFO:teuthology.orchestra.run.smithi087.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-08T05:14:46.540 INFO:teuthology.orchestra.run.smithi087.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-05-08T05:14:46.540 INFO:teuthology.orchestra.run.smithi087.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-05-08T05:14:46.540 INFO:teuthology.orchestra.run.smithi087.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-05-08T05:14:46.540 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-05-08T05:14:51.634 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : ceph-test-2:19.0.0-3538.gbee299f4.el9.x86_64 141/164 2024-05-08T05:14:51.691 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : rbd-fuse-2:19.0.0-3538.gbee299f4.el9.x86_64 142/164 2024-05-08T05:14:51.755 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : rbd-nbd-2:19.0.0-3538.gbee299f4.el9.x86_64 143/164 2024-05-08T05:14:51.798 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : xfsprogs-devel-6.3.0-1.el9.x86_64 144/164 2024-05-08T05:14:51.837 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : elfutils-libelf-devel-0.190-2.el9.x86_64 145/164 2024-05-08T05:14:52.137 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : cephfs-shell-2:19.0.0-3538.gbee299f4.el9.x86_64 146/164 2024-05-08T05:14:52.194 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : postgresql-contrib-13.14-1.el9.x86_64 147/164 2024-05-08T05:14:52.223 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : libcephfs-devel-2:19.0.0-3538.gbee299f4.el9.x86_ 148/164 2024-05-08T05:14:52.256 INFO:teuthology.orchestra.run.smithi087.stdout: Upgrading : NetworkManager-team-1:1.47.5-1.el9.x86_64 149/164 2024-05-08T05:14:52.307 INFO:teuthology.orchestra.run.smithi087.stdout: Upgrading : NetworkManager-tui-1:1.47.5-1.el9.x86_64 150/164 2024-05-08T05:14:53.165 INFO:teuthology.orchestra.run.smithi087.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 151/164 2024-05-08T05:14:53.213 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : postgresql-server-13.14-1.el9.x86_64 151/164 2024-05-08T05:14:53.269 INFO:teuthology.orchestra.run.smithi087.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 151/164 2024-05-08T05:14:54.636 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : cephfs-top-2:19.0.0-3538.gbee299f4.el9.noarch 152/164 2024-05-08T05:14:54.736 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : openssl-devel-1:3.2.1-1.el9.x86_64 153/164 2024-05-08T05:14:54.798 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 154/164 2024-05-08T05:14:54.940 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : flex-2.6.4-9.el9.x86_64 155/164 2024-05-08T05:14:54.979 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : bison-3.7.4-5.el9.x86_64 156/164 2024-05-08T05:14:55.017 INFO:teuthology.orchestra.run.smithi087.stdout: Cleanup : NetworkManager-tui-1:1.47.4-1.el9.x86_64 157/164 2024-05-08T05:14:55.017 INFO:teuthology.orchestra.run.smithi087.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 158/164 2024-05-08T05:14:55.144 INFO:teuthology.orchestra.run.smithi087.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 158/164 2024-05-08T05:14:55.192 INFO:teuthology.orchestra.run.smithi087.stdout: Cleanup : openssl-1:3.0.7-27.el9.x86_64 159/164 2024-05-08T05:14:55.192 INFO:teuthology.orchestra.run.smithi087.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 160/164 2024-05-08T05:14:55.338 INFO:teuthology.orchestra.run.smithi087.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 160/164 2024-05-08T05:14:55.376 INFO:teuthology.orchestra.run.smithi087.stdout: Cleanup : NetworkManager-team-1:1.47.4-1.el9.x86_64 161/164 2024-05-08T05:14:55.408 INFO:teuthology.orchestra.run.smithi087.stdout: Running scriptlet: NetworkManager-1:1.47.4-1.el9.x86_64 162/164 2024-05-08T05:14:55.409 INFO:teuthology.orchestra.run.smithi087.stdout: Cleanup : NetworkManager-1:1.47.4-1.el9.x86_64 162/164 2024-05-08T05:14:55.714 INFO:teuthology.orchestra.run.smithi087.stdout: Running scriptlet: NetworkManager-1:1.47.4-1.el9.x86_64 162/164 2024-05-08T05:14:55.715 INFO:teuthology.orchestra.run.smithi087.stdout: Cleanup : NetworkManager-libnm-1:1.47.4-1.el9.x86_64 163/164 2024-05-08T05:14:55.850 INFO:teuthology.orchestra.run.smithi087.stdout: Running scriptlet: NetworkManager-libnm-1:1.47.4-1.el9.x86_64 163/164 2024-05-08T05:14:55.981 INFO:teuthology.orchestra.run.smithi087.stdout: Cleanup : openssl-libs-1:3.0.7-27.el9.x86_64 164/164 2024-05-08T05:14:56.290 INFO:teuthology.orchestra.run.smithi087.stdout: Running scriptlet: openssl-libs-1:3.0.7-27.el9.x86_64 164/164 2024-05-08T05:14:56.291 INFO:teuthology.orchestra.run.smithi087.stdout:Couldn't write '0' to 'kernel/yama/ptrace_scope', ignoring: No such file or directory 2024-05-08T05:14:56.291 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-05-08T05:15:01.832 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : ceph-2:19.0.0-3538.gbee299f4.el9.x86_64 1/164 2024-05-08T05:15:01.832 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : ceph-base-2:19.0.0-3538.gbee299f4.el9.x86_64 2/164 2024-05-08T05:15:01.832 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : ceph-common-2:19.0.0-3538.gbee299f4.el9.x86_64 3/164 2024-05-08T05:15:01.832 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : ceph-fuse-2:19.0.0-3538.gbee299f4.el9.x86_64 4/164 2024-05-08T05:15:01.832 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : ceph-immutable-object-cache-2:19.0.0-3538.gbee29 5/164 2024-05-08T05:15:01.832 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : ceph-mds-2:19.0.0-3538.gbee299f4.el9.x86_64 6/164 2024-05-08T05:15:01.832 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : ceph-mgr-2:19.0.0-3538.gbee299f4.el9.x86_64 7/164 2024-05-08T05:15:01.832 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : ceph-mon-2:19.0.0-3538.gbee299f4.el9.x86_64 8/164 2024-05-08T05:15:01.832 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : ceph-osd-2:19.0.0-3538.gbee299f4.el9.x86_64 9/164 2024-05-08T05:15:01.833 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : ceph-radosgw-2:19.0.0-3538.gbee299f4.el9.x86_64 10/164 2024-05-08T05:15:01.833 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : ceph-selinux-2:19.0.0-3538.gbee299f4.el9.x86_64 11/164 2024-05-08T05:15:01.833 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : ceph-test-2:19.0.0-3538.gbee299f4.el9.x86_64 12/164 2024-05-08T05:15:01.833 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : cephfs-mirror-2:19.0.0-3538.gbee299f4.el9.x86_64 13/164 2024-05-08T05:15:01.833 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : cephfs-shell-2:19.0.0-3538.gbee299f4.el9.x86_64 14/164 2024-05-08T05:15:01.833 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : libcephfs-devel-2:19.0.0-3538.gbee299f4.el9.x86_ 15/164 2024-05-08T05:15:01.833 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : libcephfs2-2:19.0.0-3538.gbee299f4.el9.x86_64 16/164 2024-05-08T05:15:01.833 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : libcephsqlite-2:19.0.0-3538.gbee299f4.el9.x86_64 17/164 2024-05-08T05:15:01.833 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : librados-devel-2:19.0.0-3538.gbee299f4.el9.x86_6 18/164 2024-05-08T05:15:01.833 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : libradosstriper1-2:19.0.0-3538.gbee299f4.el9.x86 19/164 2024-05-08T05:15:01.833 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : librgw2-2:19.0.0-3538.gbee299f4.el9.x86_64 20/164 2024-05-08T05:15:01.834 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-ceph-argparse-2:19.0.0-3538.gbee299f4.el 21/164 2024-05-08T05:15:01.834 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-ceph-common-2:19.0.0-3538.gbee299f4.el9. 22/164 2024-05-08T05:15:01.834 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-cephfs-2:19.0.0-3538.gbee299f4.el9.x86_6 23/164 2024-05-08T05:15:01.834 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-rados-2:19.0.0-3538.gbee299f4.el9.x86_64 24/164 2024-05-08T05:15:01.834 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-rbd-2:19.0.0-3538.gbee299f4.el9.x86_64 25/164 2024-05-08T05:15:01.847 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-rgw-2:19.0.0-3538.gbee299f4.el9.x86_64 26/164 2024-05-08T05:15:01.847 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : rbd-fuse-2:19.0.0-3538.gbee299f4.el9.x86_64 27/164 2024-05-08T05:15:01.847 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : rbd-mirror-2:19.0.0-3538.gbee299f4.el9.x86_64 28/164 2024-05-08T05:15:01.847 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : rbd-nbd-2:19.0.0-3538.gbee299f4.el9.x86_64 29/164 2024-05-08T05:15:01.847 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : ceph-grafana-dashboards-2:19.0.0-3538.gbee299f4. 30/164 2024-05-08T05:15:01.847 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : ceph-mgr-cephadm-2:19.0.0-3538.gbee299f4.el9.noa 31/164 2024-05-08T05:15:01.847 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : ceph-mgr-dashboard-2:19.0.0-3538.gbee299f4.el9.n 32/164 2024-05-08T05:15:01.847 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.0.0-3538.gbee 33/164 2024-05-08T05:15:01.847 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : ceph-mgr-modules-core-2:19.0.0-3538.gbee299f4.el 34/164 2024-05-08T05:15:01.847 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : ceph-mgr-rook-2:19.0.0-3538.gbee299f4.el9.noarch 35/164 2024-05-08T05:15:01.847 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : ceph-prometheus-alerts-2:19.0.0-3538.gbee299f4.e 36/164 2024-05-08T05:15:01.848 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : ceph-volume-2:19.0.0-3538.gbee299f4.el9.noarch 37/164 2024-05-08T05:15:01.848 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : cephadm-2:19.0.0-3538.gbee299f4.el9.noarch 38/164 2024-05-08T05:15:01.848 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : cephfs-top-2:19.0.0-3538.gbee299f4.el9.noarch 39/164 2024-05-08T05:15:01.848 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 40/164 2024-05-08T05:15:01.848 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 41/164 2024-05-08T05:15:01.848 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 42/164 2024-05-08T05:15:01.848 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/164 2024-05-08T05:15:01.848 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/164 2024-05-08T05:15:01.848 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/164 2024-05-08T05:15:01.848 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/164 2024-05-08T05:15:01.848 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/164 2024-05-08T05:15:01.848 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-urllib3-1.26.5-5.el9.noarch 48/164 2024-05-08T05:15:01.848 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/164 2024-05-08T05:15:01.849 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/164 2024-05-08T05:15:01.849 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/164 2024-05-08T05:15:01.849 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : elfutils-libelf-devel-0.190-2.el9.x86_64 52/164 2024-05-08T05:15:01.849 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/164 2024-05-08T05:15:01.849 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/164 2024-05-08T05:15:01.849 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/164 2024-05-08T05:15:01.849 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/164 2024-05-08T05:15:01.849 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/164 2024-05-08T05:15:01.849 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 58/164 2024-05-08T05:15:01.849 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 59/164 2024-05-08T05:15:01.849 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 60/164 2024-05-08T05:15:01.849 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : libtool-2.4.6-45.el9.x86_64 61/164 2024-05-08T05:15:01.849 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : libuuid-devel-2.37.4-18.el9.x86_64 62/164 2024-05-08T05:15:01.849 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 63/164 2024-05-08T05:15:01.850 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 64/164 2024-05-08T05:15:01.850 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : lua-5.4.4-4.el9.x86_64 65/164 2024-05-08T05:15:01.850 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 66/164 2024-05-08T05:15:01.850 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 67/164 2024-05-08T05:15:01.850 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : openssl-devel-1:3.2.1-1.el9.x86_64 68/164 2024-05-08T05:15:01.850 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : postgresql-13.14-1.el9.x86_64 69/164 2024-05-08T05:15:01.850 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : postgresql-contrib-13.14-1.el9.x86_64 70/164 2024-05-08T05:15:01.850 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : postgresql-private-libs-13.14-1.el9.x86_64 71/164 2024-05-08T05:15:01.850 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : postgresql-server-13.14-1.el9.x86_64 72/164 2024-05-08T05:15:01.850 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 73/164 2024-05-08T05:15:01.850 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 74/164 2024-05-08T05:15:01.850 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 75/164 2024-05-08T05:15:01.850 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-devel-3.9.18-3.el9.x86_64 76/164 2024-05-08T05:15:01.851 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-jinja2-2.11.3-5.el9.noarch 77/164 2024-05-08T05:15:01.851 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 78/164 2024-05-08T05:15:01.851 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 79/164 2024-05-08T05:15:01.851 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 80/164 2024-05-08T05:15:01.851 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 81/164 2024-05-08T05:15:01.851 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 82/164 2024-05-08T05:15:01.851 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 83/164 2024-05-08T05:15:01.851 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 84/164 2024-05-08T05:15:01.851 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 85/164 2024-05-08T05:15:01.851 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 86/164 2024-05-08T05:15:01.851 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 87/164 2024-05-08T05:15:01.851 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 88/164 2024-05-08T05:15:01.851 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 89/164 2024-05-08T05:15:01.851 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 90/164 2024-05-08T05:15:01.852 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 91/164 2024-05-08T05:15:01.852 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 92/164 2024-05-08T05:15:01.852 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 93/164 2024-05-08T05:15:01.852 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 94/164 2024-05-08T05:15:01.852 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 95/164 2024-05-08T05:15:01.852 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 96/164 2024-05-08T05:15:01.852 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 97/164 2024-05-08T05:15:01.852 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 98/164 2024-05-08T05:15:01.852 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 99/164 2024-05-08T05:15:01.852 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : xfsprogs-devel-6.3.0-1.el9.x86_64 100/164 2024-05-08T05:15:01.852 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 101/164 2024-05-08T05:15:01.852 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 102/164 2024-05-08T05:15:01.852 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 103/164 2024-05-08T05:15:01.852 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 104/164 2024-05-08T05:15:01.853 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 105/164 2024-05-08T05:15:01.853 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 106/164 2024-05-08T05:15:01.853 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 107/164 2024-05-08T05:15:01.853 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 108/164 2024-05-08T05:15:01.853 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 109/164 2024-05-08T05:15:01.853 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 110/164 2024-05-08T05:15:01.853 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 111/164 2024-05-08T05:15:01.853 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : luarocks-3.9.2-1.el9.noarch 112/164 2024-05-08T05:15:01.853 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 113/164 2024-05-08T05:15:01.853 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 114/164 2024-05-08T05:15:01.853 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 115/164 2024-05-08T05:15:01.853 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 116/164 2024-05-08T05:15:01.853 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 117/164 2024-05-08T05:15:01.853 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 118/164 2024-05-08T05:15:01.853 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 119/164 2024-05-08T05:15:01.854 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 120/164 2024-05-08T05:15:01.854 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-colorama-0.4.4-12.el9.noarch 121/164 2024-05-08T05:15:01.854 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-google-auth-1:2.29.0-1.el9.noarch 122/164 2024-05-08T05:15:01.854 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 123/164 2024-05-08T05:15:01.854 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 124/164 2024-05-08T05:15:01.854 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 125/164 2024-05-08T05:15:01.854 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 126/164 2024-05-08T05:15:01.854 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 127/164 2024-05-08T05:15:01.854 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 128/164 2024-05-08T05:15:01.854 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 129/164 2024-05-08T05:15:01.854 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 130/164 2024-05-08T05:15:01.854 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 131/164 2024-05-08T05:15:01.854 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 132/164 2024-05-08T05:15:01.854 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 133/164 2024-05-08T05:15:01.855 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 134/164 2024-05-08T05:15:01.855 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 135/164 2024-05-08T05:15:01.855 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 136/164 2024-05-08T05:15:01.855 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 137/164 2024-05-08T05:15:01.855 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 138/164 2024-05-08T05:15:01.855 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 139/164 2024-05-08T05:15:01.855 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 140/164 2024-05-08T05:15:01.855 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 141/164 2024-05-08T05:15:01.855 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 142/164 2024-05-08T05:15:01.855 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 143/164 2024-05-08T05:15:01.855 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 144/164 2024-05-08T05:15:01.855 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 145/164 2024-05-08T05:15:01.855 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 146/164 2024-05-08T05:15:01.855 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : re2-1:20211101-3.el9.x86_64 147/164 2024-05-08T05:15:01.855 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 148/164 2024-05-08T05:15:01.856 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : librados2-2:19.0.0-3538.gbee299f4.el9.x86_64 149/164 2024-05-08T05:15:01.856 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 150/164 2024-05-08T05:15:01.856 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : librbd1-2:19.0.0-3538.gbee299f4.el9.x86_64 151/164 2024-05-08T05:15:01.856 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 152/164 2024-05-08T05:15:01.856 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : NetworkManager-1:1.47.5-1.el9.x86_64 153/164 2024-05-08T05:15:01.856 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : NetworkManager-1:1.47.4-1.el9.x86_64 154/164 2024-05-08T05:15:01.856 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : NetworkManager-libnm-1:1.47.5-1.el9.x86_64 155/164 2024-05-08T05:15:01.856 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : NetworkManager-libnm-1:1.47.4-1.el9.x86_64 156/164 2024-05-08T05:15:01.856 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : NetworkManager-team-1:1.47.5-1.el9.x86_64 157/164 2024-05-08T05:15:01.856 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : NetworkManager-team-1:1.47.4-1.el9.x86_64 158/164 2024-05-08T05:15:01.856 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : NetworkManager-tui-1:1.47.5-1.el9.x86_64 159/164 2024-05-08T05:15:01.856 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : NetworkManager-tui-1:1.47.4-1.el9.x86_64 160/164 2024-05-08T05:15:01.856 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : openssl-1:3.2.1-1.el9.x86_64 161/164 2024-05-08T05:15:01.856 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : openssl-1:3.0.7-27.el9.x86_64 162/164 2024-05-08T05:15:01.856 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : openssl-libs-1:3.2.1-1.el9.x86_64 163/164 2024-05-08T05:15:04.003 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : openssl-libs-1:3.0.7-27.el9.x86_64 164/164 2024-05-08T05:15:04.004 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-05-08T05:15:04.004 INFO:teuthology.orchestra.run.smithi087.stdout:Upgraded: 2024-05-08T05:15:04.004 INFO:teuthology.orchestra.run.smithi087.stdout: NetworkManager-1:1.47.5-1.el9.x86_64 2024-05-08T05:15:04.004 INFO:teuthology.orchestra.run.smithi087.stdout: NetworkManager-libnm-1:1.47.5-1.el9.x86_64 2024-05-08T05:15:04.004 INFO:teuthology.orchestra.run.smithi087.stdout: NetworkManager-team-1:1.47.5-1.el9.x86_64 2024-05-08T05:15:04.004 INFO:teuthology.orchestra.run.smithi087.stdout: NetworkManager-tui-1:1.47.5-1.el9.x86_64 2024-05-08T05:15:04.004 INFO:teuthology.orchestra.run.smithi087.stdout: librados2-2:19.0.0-3538.gbee299f4.el9.x86_64 2024-05-08T05:15:04.004 INFO:teuthology.orchestra.run.smithi087.stdout: librbd1-2:19.0.0-3538.gbee299f4.el9.x86_64 2024-05-08T05:15:04.004 INFO:teuthology.orchestra.run.smithi087.stdout: openssl-1:3.2.1-1.el9.x86_64 2024-05-08T05:15:04.005 INFO:teuthology.orchestra.run.smithi087.stdout: openssl-libs-1:3.2.1-1.el9.x86_64 2024-05-08T05:15:04.005 INFO:teuthology.orchestra.run.smithi087.stdout:Installed: 2024-05-08T05:15:04.005 INFO:teuthology.orchestra.run.smithi087.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-05-08T05:15:04.005 INFO:teuthology.orchestra.run.smithi087.stdout: automake-1.16.2-8.el9.noarch 2024-05-08T05:15:04.005 INFO:teuthology.orchestra.run.smithi087.stdout: bison-3.7.4-5.el9.x86_64 2024-05-08T05:15:04.005 INFO:teuthology.orchestra.run.smithi087.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-05-08T05:15:04.005 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-2:19.0.0-3538.gbee299f4.el9.x86_64 2024-05-08T05:15:04.005 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-base-2:19.0.0-3538.gbee299f4.el9.x86_64 2024-05-08T05:15:04.005 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-common-2:19.0.0-3538.gbee299f4.el9.x86_64 2024-05-08T05:15:04.005 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-fuse-2:19.0.0-3538.gbee299f4.el9.x86_64 2024-05-08T05:15:04.005 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-grafana-dashboards-2:19.0.0-3538.gbee299f4.el9.noarch 2024-05-08T05:15:04.005 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-immutable-object-cache-2:19.0.0-3538.gbee299f4.el9.x86_64 2024-05-08T05:15:04.006 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-mds-2:19.0.0-3538.gbee299f4.el9.x86_64 2024-05-08T05:15:04.006 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-mgr-2:19.0.0-3538.gbee299f4.el9.x86_64 2024-05-08T05:15:04.006 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-mgr-cephadm-2:19.0.0-3538.gbee299f4.el9.noarch 2024-05-08T05:15:04.006 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-mgr-dashboard-2:19.0.0-3538.gbee299f4.el9.noarch 2024-05-08T05:15:04.006 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-mgr-diskprediction-local-2:19.0.0-3538.gbee299f4.el9.noarch 2024-05-08T05:15:04.006 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-mgr-modules-core-2:19.0.0-3538.gbee299f4.el9.noarch 2024-05-08T05:15:04.006 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-mgr-rook-2:19.0.0-3538.gbee299f4.el9.noarch 2024-05-08T05:15:04.006 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-mon-2:19.0.0-3538.gbee299f4.el9.x86_64 2024-05-08T05:15:04.007 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-osd-2:19.0.0-3538.gbee299f4.el9.x86_64 2024-05-08T05:15:04.007 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-prometheus-alerts-2:19.0.0-3538.gbee299f4.el9.noarch 2024-05-08T05:15:04.007 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-radosgw-2:19.0.0-3538.gbee299f4.el9.x86_64 2024-05-08T05:15:04.007 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-selinux-2:19.0.0-3538.gbee299f4.el9.x86_64 2024-05-08T05:15:04.007 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-test-2:19.0.0-3538.gbee299f4.el9.x86_64 2024-05-08T05:15:04.007 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-volume-2:19.0.0-3538.gbee299f4.el9.noarch 2024-05-08T05:15:04.007 INFO:teuthology.orchestra.run.smithi087.stdout: cephadm-2:19.0.0-3538.gbee299f4.el9.noarch 2024-05-08T05:15:04.007 INFO:teuthology.orchestra.run.smithi087.stdout: cephfs-mirror-2:19.0.0-3538.gbee299f4.el9.x86_64 2024-05-08T05:15:04.007 INFO:teuthology.orchestra.run.smithi087.stdout: cephfs-shell-2:19.0.0-3538.gbee299f4.el9.x86_64 2024-05-08T05:15:04.007 INFO:teuthology.orchestra.run.smithi087.stdout: cephfs-top-2:19.0.0-3538.gbee299f4.el9.noarch 2024-05-08T05:15:04.007 INFO:teuthology.orchestra.run.smithi087.stdout: elfutils-libelf-devel-0.190-2.el9.x86_64 2024-05-08T05:15:04.007 INFO:teuthology.orchestra.run.smithi087.stdout: flex-2.6.4-9.el9.x86_64 2024-05-08T05:15:04.008 INFO:teuthology.orchestra.run.smithi087.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-05-08T05:15:04.008 INFO:teuthology.orchestra.run.smithi087.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-05-08T05:15:04.008 INFO:teuthology.orchestra.run.smithi087.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-05-08T05:15:04.008 INFO:teuthology.orchestra.run.smithi087.stdout: fuse-2.9.9-15.el9.x86_64 2024-05-08T05:15:04.008 INFO:teuthology.orchestra.run.smithi087.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-05-08T05:15:04.008 INFO:teuthology.orchestra.run.smithi087.stdout: grpc-data-1.46.7-10.el9.noarch 2024-05-08T05:15:04.008 INFO:teuthology.orchestra.run.smithi087.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-05-08T05:15:04.008 INFO:teuthology.orchestra.run.smithi087.stdout: libarrow-9.0.0-11.el9.x86_64 2024-05-08T05:15:04.008 INFO:teuthology.orchestra.run.smithi087.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-05-08T05:15:04.008 INFO:teuthology.orchestra.run.smithi087.stdout: libcephfs-devel-2:19.0.0-3538.gbee299f4.el9.x86_64 2024-05-08T05:15:04.008 INFO:teuthology.orchestra.run.smithi087.stdout: libcephfs2-2:19.0.0-3538.gbee299f4.el9.x86_64 2024-05-08T05:15:04.008 INFO:teuthology.orchestra.run.smithi087.stdout: libcephsqlite-2:19.0.0-3538.gbee299f4.el9.x86_64 2024-05-08T05:15:04.009 INFO:teuthology.orchestra.run.smithi087.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-05-08T05:15:04.009 INFO:teuthology.orchestra.run.smithi087.stdout: liboath-2.6.7-2.el9.x86_64 2024-05-08T05:15:04.009 INFO:teuthology.orchestra.run.smithi087.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-05-08T05:15:04.009 INFO:teuthology.orchestra.run.smithi087.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-05-08T05:15:04.009 INFO:teuthology.orchestra.run.smithi087.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-05-08T05:15:04.009 INFO:teuthology.orchestra.run.smithi087.stdout: librados-devel-2:19.0.0-3538.gbee299f4.el9.x86_64 2024-05-08T05:15:04.009 INFO:teuthology.orchestra.run.smithi087.stdout: libradosstriper1-2:19.0.0-3538.gbee299f4.el9.x86_64 2024-05-08T05:15:04.009 INFO:teuthology.orchestra.run.smithi087.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-05-08T05:15:04.009 INFO:teuthology.orchestra.run.smithi087.stdout: librgw2-2:19.0.0-3538.gbee299f4.el9.x86_64 2024-05-08T05:15:04.009 INFO:teuthology.orchestra.run.smithi087.stdout: libtool-2.4.6-45.el9.x86_64 2024-05-08T05:15:04.009 INFO:teuthology.orchestra.run.smithi087.stdout: libunwind-1.6.2-1.el9.x86_64 2024-05-08T05:15:04.009 INFO:teuthology.orchestra.run.smithi087.stdout: libuuid-devel-2.37.4-18.el9.x86_64 2024-05-08T05:15:04.010 INFO:teuthology.orchestra.run.smithi087.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-05-08T05:15:04.010 INFO:teuthology.orchestra.run.smithi087.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-05-08T05:15:04.010 INFO:teuthology.orchestra.run.smithi087.stdout: lua-5.4.4-4.el9.x86_64 2024-05-08T05:15:04.010 INFO:teuthology.orchestra.run.smithi087.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-05-08T05:15:04.010 INFO:teuthology.orchestra.run.smithi087.stdout: luarocks-3.9.2-1.el9.noarch 2024-05-08T05:15:04.010 INFO:teuthology.orchestra.run.smithi087.stdout: openblas-0.3.21-2.el9.x86_64 2024-05-08T05:15:04.010 INFO:teuthology.orchestra.run.smithi087.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-05-08T05:15:04.010 INFO:teuthology.orchestra.run.smithi087.stdout: openssl-devel-1:3.2.1-1.el9.x86_64 2024-05-08T05:15:04.010 INFO:teuthology.orchestra.run.smithi087.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-05-08T05:15:04.010 INFO:teuthology.orchestra.run.smithi087.stdout: postgresql-13.14-1.el9.x86_64 2024-05-08T05:15:04.010 INFO:teuthology.orchestra.run.smithi087.stdout: postgresql-contrib-13.14-1.el9.x86_64 2024-05-08T05:15:04.011 INFO:teuthology.orchestra.run.smithi087.stdout: postgresql-private-libs-13.14-1.el9.x86_64 2024-05-08T05:15:04.011 INFO:teuthology.orchestra.run.smithi087.stdout: postgresql-server-13.14-1.el9.x86_64 2024-05-08T05:15:04.011 INFO:teuthology.orchestra.run.smithi087.stdout: protobuf-3.14.0-13.el9.x86_64 2024-05-08T05:15:04.011 INFO:teuthology.orchestra.run.smithi087.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-05-08T05:15:04.011 INFO:teuthology.orchestra.run.smithi087.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-05-08T05:15:04.011 INFO:teuthology.orchestra.run.smithi087.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-05-08T05:15:04.011 INFO:teuthology.orchestra.run.smithi087.stdout: python3-babel-2.9.1-2.el9.noarch 2024-05-08T05:15:04.011 INFO:teuthology.orchestra.run.smithi087.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-05-08T05:15:04.011 INFO:teuthology.orchestra.run.smithi087.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-05-08T05:15:04.011 INFO:teuthology.orchestra.run.smithi087.stdout: python3-ceph-argparse-2:19.0.0-3538.gbee299f4.el9.x86_64 2024-05-08T05:15:04.011 INFO:teuthology.orchestra.run.smithi087.stdout: python3-ceph-common-2:19.0.0-3538.gbee299f4.el9.x86_64 2024-05-08T05:15:04.011 INFO:teuthology.orchestra.run.smithi087.stdout: python3-cephfs-2:19.0.0-3538.gbee299f4.el9.x86_64 2024-05-08T05:15:04.011 INFO:teuthology.orchestra.run.smithi087.stdout: python3-certifi-2021.10.8-2.el9.noarch 2024-05-08T05:15:04.011 INFO:teuthology.orchestra.run.smithi087.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-05-08T05:15:04.012 INFO:teuthology.orchestra.run.smithi087.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-05-08T05:15:04.012 INFO:teuthology.orchestra.run.smithi087.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-05-08T05:15:04.012 INFO:teuthology.orchestra.run.smithi087.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-05-08T05:15:04.012 INFO:teuthology.orchestra.run.smithi087.stdout: python3-colorama-0.4.4-12.el9.noarch 2024-05-08T05:15:04.012 INFO:teuthology.orchestra.run.smithi087.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-05-08T05:15:04.012 INFO:teuthology.orchestra.run.smithi087.stdout: python3-devel-3.9.18-3.el9.x86_64 2024-05-08T05:15:04.012 INFO:teuthology.orchestra.run.smithi087.stdout: python3-google-auth-1:2.29.0-1.el9.noarch 2024-05-08T05:15:04.012 INFO:teuthology.orchestra.run.smithi087.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-05-08T05:15:04.012 INFO:teuthology.orchestra.run.smithi087.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-05-08T05:15:04.012 INFO:teuthology.orchestra.run.smithi087.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-05-08T05:15:04.012 INFO:teuthology.orchestra.run.smithi087.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-05-08T05:15:04.012 INFO:teuthology.orchestra.run.smithi087.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-05-08T05:15:04.012 INFO:teuthology.orchestra.run.smithi087.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-05-08T05:15:04.012 INFO:teuthology.orchestra.run.smithi087.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-05-08T05:15:04.013 INFO:teuthology.orchestra.run.smithi087.stdout: python3-jinja2-2.11.3-5.el9.noarch 2024-05-08T05:15:04.013 INFO:teuthology.orchestra.run.smithi087.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-05-08T05:15:04.013 INFO:teuthology.orchestra.run.smithi087.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-05-08T05:15:04.013 INFO:teuthology.orchestra.run.smithi087.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-05-08T05:15:04.013 INFO:teuthology.orchestra.run.smithi087.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-05-08T05:15:04.013 INFO:teuthology.orchestra.run.smithi087.stdout: python3-mako-1.1.4-6.el9.noarch 2024-05-08T05:15:04.013 INFO:teuthology.orchestra.run.smithi087.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-05-08T05:15:04.013 INFO:teuthology.orchestra.run.smithi087.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-05-08T05:15:04.013 INFO:teuthology.orchestra.run.smithi087.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-05-08T05:15:04.013 INFO:teuthology.orchestra.run.smithi087.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-05-08T05:15:04.013 INFO:teuthology.orchestra.run.smithi087.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-05-08T05:15:04.013 INFO:teuthology.orchestra.run.smithi087.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-05-08T05:15:04.013 INFO:teuthology.orchestra.run.smithi087.stdout: python3-packaging-20.9-5.el9.noarch 2024-05-08T05:15:04.013 INFO:teuthology.orchestra.run.smithi087.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-05-08T05:15:04.013 INFO:teuthology.orchestra.run.smithi087.stdout: python3-ply-3.11-14.el9.noarch 2024-05-08T05:15:04.014 INFO:teuthology.orchestra.run.smithi087.stdout: python3-portend-3.1.0-2.el9.noarch 2024-05-08T05:15:04.014 INFO:teuthology.orchestra.run.smithi087.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-05-08T05:15:04.014 INFO:teuthology.orchestra.run.smithi087.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-05-08T05:15:04.014 INFO:teuthology.orchestra.run.smithi087.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-05-08T05:15:04.014 INFO:teuthology.orchestra.run.smithi087.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-05-08T05:15:04.014 INFO:teuthology.orchestra.run.smithi087.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-05-08T05:15:04.014 INFO:teuthology.orchestra.run.smithi087.stdout: python3-pycparser-2.20-6.el9.noarch 2024-05-08T05:15:04.014 INFO:teuthology.orchestra.run.smithi087.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-05-08T05:15:04.014 INFO:teuthology.orchestra.run.smithi087.stdout: python3-pytz-2021.1-5.el9.noarch 2024-05-08T05:15:04.014 INFO:teuthology.orchestra.run.smithi087.stdout: python3-rados-2:19.0.0-3538.gbee299f4.el9.x86_64 2024-05-08T05:15:04.014 INFO:teuthology.orchestra.run.smithi087.stdout: python3-rbd-2:19.0.0-3538.gbee299f4.el9.x86_64 2024-05-08T05:15:04.014 INFO:teuthology.orchestra.run.smithi087.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-05-08T05:15:04.014 INFO:teuthology.orchestra.run.smithi087.stdout: python3-requests-2.25.1-8.el9.noarch 2024-05-08T05:15:04.015 INFO:teuthology.orchestra.run.smithi087.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-05-08T05:15:04.015 INFO:teuthology.orchestra.run.smithi087.stdout: python3-rgw-2:19.0.0-3538.gbee299f4.el9.x86_64 2024-05-08T05:15:04.015 INFO:teuthology.orchestra.run.smithi087.stdout: python3-routes-2.5.1-5.el9.noarch 2024-05-08T05:15:04.015 INFO:teuthology.orchestra.run.smithi087.stdout: python3-rsa-4.9-2.el9.noarch 2024-05-08T05:15:04.015 INFO:teuthology.orchestra.run.smithi087.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-05-08T05:15:04.015 INFO:teuthology.orchestra.run.smithi087.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-05-08T05:15:04.015 INFO:teuthology.orchestra.run.smithi087.stdout: python3-toml-0.10.2-6.el9.noarch 2024-05-08T05:15:04.015 INFO:teuthology.orchestra.run.smithi087.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2024-05-08T05:15:04.015 INFO:teuthology.orchestra.run.smithi087.stdout: python3-urllib3-1.26.5-5.el9.noarch 2024-05-08T05:15:04.015 INFO:teuthology.orchestra.run.smithi087.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-05-08T05:15:04.015 INFO:teuthology.orchestra.run.smithi087.stdout: python3-webob-1.8.7-6.el9.noarch 2024-05-08T05:15:04.015 INFO:teuthology.orchestra.run.smithi087.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-05-08T05:15:04.015 INFO:teuthology.orchestra.run.smithi087.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-05-08T05:15:04.015 INFO:teuthology.orchestra.run.smithi087.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-05-08T05:15:04.015 INFO:teuthology.orchestra.run.smithi087.stdout: qatlib-24.02.0-1.el9.x86_64 2024-05-08T05:15:04.016 INFO:teuthology.orchestra.run.smithi087.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-05-08T05:15:04.016 INFO:teuthology.orchestra.run.smithi087.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-05-08T05:15:04.016 INFO:teuthology.orchestra.run.smithi087.stdout: rbd-fuse-2:19.0.0-3538.gbee299f4.el9.x86_64 2024-05-08T05:15:04.016 INFO:teuthology.orchestra.run.smithi087.stdout: rbd-mirror-2:19.0.0-3538.gbee299f4.el9.x86_64 2024-05-08T05:15:04.016 INFO:teuthology.orchestra.run.smithi087.stdout: rbd-nbd-2:19.0.0-3538.gbee299f4.el9.x86_64 2024-05-08T05:15:04.016 INFO:teuthology.orchestra.run.smithi087.stdout: re2-1:20211101-3.el9.x86_64 2024-05-08T05:15:04.016 INFO:teuthology.orchestra.run.smithi087.stdout: socat-1.7.4.1-5.el9.x86_64 2024-05-08T05:15:04.016 INFO:teuthology.orchestra.run.smithi087.stdout: thrift-0.15.0-2.el9.x86_64 2024-05-08T05:15:04.016 INFO:teuthology.orchestra.run.smithi087.stdout: uuid-1.6.2-55.el9.x86_64 2024-05-08T05:15:04.016 INFO:teuthology.orchestra.run.smithi087.stdout: xfsprogs-devel-6.3.0-1.el9.x86_64 2024-05-08T05:15:04.016 INFO:teuthology.orchestra.run.smithi087.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-05-08T05:15:04.017 INFO:teuthology.orchestra.run.smithi087.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-05-08T05:15:04.017 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-05-08T05:15:04.017 INFO:teuthology.orchestra.run.smithi087.stdout:Complete! 2024-05-08T05:15:04.614 DEBUG:teuthology.parallel:result is None 2024-05-08T05:15:04.615 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=bee299f4ac344e4c45e550d7a80abcadd7bc3d5a 2024-05-08T05:15:04.775 DEBUG:teuthology.orchestra.run.smithi087:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-05-08T05:15:04.827 INFO:teuthology.orchestra.run.smithi087.stdout:19.0.0-3538.gbee299f4.el9 2024-05-08T05:15:04.827 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-3538.gbee299f4.el9 2024-05-08T05:15:04.828 INFO:teuthology.task.install:The correct ceph version 19.0.0-3538.gbee299f4 is installed. 2024-05-08T05:15:04.830 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=bee299f4ac344e4c45e550d7a80abcadd7bc3d5a 2024-05-08T05:15:05.054 DEBUG:teuthology.orchestra.run.smithi090:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-05-08T05:15:05.080 INFO:teuthology.orchestra.run.smithi090.stdout:19.0.0-3538.gbee299f4.el9 2024-05-08T05:15:05.080 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-3538.gbee299f4.el9 2024-05-08T05:15:05.080 INFO:teuthology.task.install:The correct ceph version 19.0.0-3538.gbee299f4 is installed. 2024-05-08T05:15:05.082 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=bee299f4ac344e4c45e550d7a80abcadd7bc3d5a 2024-05-08T05:15:05.223 DEBUG:teuthology.orchestra.run.smithi160:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-05-08T05:15:05.249 INFO:teuthology.orchestra.run.smithi160.stdout:19.0.0-3538.gbee299f4.el9 2024-05-08T05:15:05.249 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-3538.gbee299f4.el9 2024-05-08T05:15:05.250 INFO:teuthology.task.install:The correct ceph version 19.0.0-3538.gbee299f4 is installed. 2024-05-08T05:15:05.251 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-05-08T05:15:05.252 DEBUG:teuthology.orchestra.run.smithi087:> set -ex 2024-05-08T05:15:05.252 DEBUG:teuthology.orchestra.run.smithi087:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-05-08T05:15:05.321 DEBUG:teuthology.orchestra.run.smithi090:> set -ex 2024-05-08T05:15:05.321 DEBUG:teuthology.orchestra.run.smithi090:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-05-08T05:15:05.352 DEBUG:teuthology.orchestra.run.smithi160:> set -ex 2024-05-08T05:15:05.352 DEBUG:teuthology.orchestra.run.smithi160:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-05-08T05:15:05.383 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-05-08T05:15:05.383 DEBUG:teuthology.orchestra.run.smithi087:> set -ex 2024-05-08T05:15:05.383 DEBUG:teuthology.orchestra.run.smithi087:> sudo dd of=/usr/bin/daemon-helper 2024-05-08T05:15:05.460 DEBUG:teuthology.orchestra.run.smithi087:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-05-08T05:15:05.585 DEBUG:teuthology.orchestra.run.smithi090:> set -ex 2024-05-08T05:15:05.585 DEBUG:teuthology.orchestra.run.smithi090:> sudo dd of=/usr/bin/daemon-helper 2024-05-08T05:15:05.614 DEBUG:teuthology.orchestra.run.smithi090:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-05-08T05:15:05.681 DEBUG:teuthology.orchestra.run.smithi160:> set -ex 2024-05-08T05:15:05.762 DEBUG:teuthology.orchestra.run.smithi160:> sudo dd of=/usr/bin/daemon-helper 2024-05-08T05:15:05.791 DEBUG:teuthology.orchestra.run.smithi160:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-05-08T05:15:05.858 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-05-08T05:15:05.858 DEBUG:teuthology.orchestra.run.smithi087:> set -ex 2024-05-08T05:15:05.858 DEBUG:teuthology.orchestra.run.smithi087:> sudo dd of=/usr/bin/adjust-ulimits 2024-05-08T05:15:05.921 DEBUG:teuthology.orchestra.run.smithi087:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-05-08T05:15:06.026 DEBUG:teuthology.orchestra.run.smithi090:> set -ex 2024-05-08T05:15:06.026 DEBUG:teuthology.orchestra.run.smithi090:> sudo dd of=/usr/bin/adjust-ulimits 2024-05-08T05:15:06.060 DEBUG:teuthology.orchestra.run.smithi090:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-05-08T05:15:06.124 DEBUG:teuthology.orchestra.run.smithi160:> set -ex 2024-05-08T05:15:06.124 DEBUG:teuthology.orchestra.run.smithi160:> sudo dd of=/usr/bin/adjust-ulimits 2024-05-08T05:15:06.149 DEBUG:teuthology.orchestra.run.smithi160:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-05-08T05:15:06.214 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-05-08T05:15:06.214 DEBUG:teuthology.orchestra.run.smithi087:> set -ex 2024-05-08T05:15:06.214 DEBUG:teuthology.orchestra.run.smithi087:> sudo dd of=/usr/bin/stdin-killer 2024-05-08T05:15:06.274 DEBUG:teuthology.orchestra.run.smithi087:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-05-08T05:15:06.374 DEBUG:teuthology.orchestra.run.smithi090:> set -ex 2024-05-08T05:15:06.374 DEBUG:teuthology.orchestra.run.smithi090:> sudo dd of=/usr/bin/stdin-killer 2024-05-08T05:15:06.399 DEBUG:teuthology.orchestra.run.smithi090:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-05-08T05:15:06.462 DEBUG:teuthology.orchestra.run.smithi160:> set -ex 2024-05-08T05:15:06.462 DEBUG:teuthology.orchestra.run.smithi160:> sudo dd of=/usr/bin/stdin-killer 2024-05-08T05:15:06.486 DEBUG:teuthology.orchestra.run.smithi160:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-05-08T05:15:06.550 INFO:teuthology.run_tasks:Running task cephadm... 2024-05-08T05:15:06.657 INFO:tasks.cephadm:Config: {'roleless': False, 'cephfs': {'max_mds': 3, 'session_timeout': 300, 'standby_replay': True}, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds bal fragment size max': 10000, 'mds bal merge size': 5, 'mds bal split bits': 3, 'mds bal split size': 100, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'mds_bal_replicate_threshold': 1, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'cephsqlite lock renewal timeout': 900000, 'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180, 'osd shutdown pgref assert': True, 'osd_max_omap_entries_per_request': 10000}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'slow metadata IO', 'SLOW_OPS', 'slow request'], 'sha1': 'bee299f4ac344e4c45e550d7a80abcadd7bc3d5a', 'subvols': {'create': 2}} 2024-05-08T05:15:06.657 INFO:tasks.cephadm:Cluster image is quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a 2024-05-08T05:15:06.657 INFO:tasks.cephadm:Cluster fsid is eeeb813e-0cf9-11ef-bc97-c7b262605968 2024-05-08T05:15:06.657 INFO:tasks.cephadm:Choosing monitor IPs and ports... 2024-05-08T05:15:06.658 INFO:tasks.cephadm:Monitor IPs: {'mon.a': '172.21.15.87', 'mon.b': '172.21.15.90', 'mon.c': '172.21.15.160'} 2024-05-08T05:15:06.658 INFO:tasks.cephadm:First mon is mon.a on smithi087 2024-05-08T05:15:06.658 INFO:tasks.cephadm:First mgr is x 2024-05-08T05:15:06.658 INFO:tasks.cephadm:Normalizing hostnames... 2024-05-08T05:15:06.658 DEBUG:teuthology.orchestra.run.smithi087:> sudo hostname $(hostname -s) 2024-05-08T05:15:06.719 DEBUG:teuthology.orchestra.run.smithi090:> sudo hostname $(hostname -s) 2024-05-08T05:15:06.742 DEBUG:teuthology.orchestra.run.smithi160:> sudo hostname $(hostname -s) 2024-05-08T05:15:06.766 INFO:tasks.cephadm:Downloading "compiled" cephadm from cachra 2024-05-08T05:15:06.767 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=bee299f4ac344e4c45e550d7a80abcadd7bc3d5a 2024-05-08T05:15:06.985 INFO:tasks.cephadm:builder_project result: [{'status': 'ready', 'sha1': 'bee299f4ac344e4c45e550d7a80abcadd7bc3d5a', 'extra': {'build_url': 'https://jenkins.ceph.com/job/ceph-dev-new-build/ARCH=x86_64,AVAILABLE_ARCH=x86_64,AVAILABLE_DIST=centos9,DIST=centos9,MACHINE_SIZE=gigantic/79166/', 'root_build_cause': 'SCMTRIGGER', 'version': '19.0.0-3538-gbee299f4', 'node_name': '172.21.5.39+adami09', 'job_name': 'ceph-dev-new-build/ARCH=x86_64,AVAILABLE_ARCH=x86_64,AVAILABLE_DIST=centos9,DIST=centos9,MACHINE_SIZE=gigantic', 'package_manager_version': '19.0.0-3538.gbee299f4'}, 'url': 'https://4.chacra.ceph.com/r/ceph/wip-57676-3/bee299f4ac344e4c45e550d7a80abcadd7bc3d5a/centos/9/flavors/default/', 'distro_codename': None, 'modified': '2024-05-07 17:50:48.409840', 'distro_version': '9', 'project': 'ceph', 'flavor': 'default', 'ref': 'wip-57676-3', 'chacra_url': 'https://4.chacra.ceph.com/repos/ceph/wip-57676-3/bee299f4ac344e4c45e550d7a80abcadd7bc3d5a/centos/9/flavors/default/', 'archs': ['source', 'x86_64'], 'distro': 'centos'}] 2024-05-08T05:15:07.126 INFO:tasks.util.chacra:got chacra host 4.chacra.ceph.com, ref wip-57676-3, sha1 bee299f4ac344e4c45e550d7a80abcadd7bc3d5a from https://shaman.ceph.com/api/search/?project=ceph&distros=centos%2F9%2Fx86_64&flavor=default&sha1=bee299f4ac344e4c45e550d7a80abcadd7bc3d5a 2024-05-08T05:15:07.128 INFO:tasks.cephadm:Discovered cachra url: https://4.chacra.ceph.com/binaries/ceph/wip-57676-3/bee299f4ac344e4c45e550d7a80abcadd7bc3d5a/centos/9/x86_64/flavors/default/cephadm 2024-05-08T05:15:07.128 DEBUG:teuthology.orchestra.run.smithi087:> curl --silent -L https://4.chacra.ceph.com/binaries/ceph/wip-57676-3/bee299f4ac344e4c45e550d7a80abcadd7bc3d5a/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-05-08T05:15:08.044 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r--. 1 ubuntu ubuntu 782795 May 8 05:15 /home/ubuntu/cephtest/cephadm 2024-05-08T05:15:08.044 DEBUG:teuthology.orchestra.run.smithi090:> curl --silent -L https://4.chacra.ceph.com/binaries/ceph/wip-57676-3/bee299f4ac344e4c45e550d7a80abcadd7bc3d5a/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-05-08T05:15:08.722 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r--. 1 ubuntu ubuntu 782795 May 8 05:15 /home/ubuntu/cephtest/cephadm 2024-05-08T05:15:08.723 DEBUG:teuthology.orchestra.run.smithi160:> curl --silent -L https://4.chacra.ceph.com/binaries/ceph/wip-57676-3/bee299f4ac344e4c45e550d7a80abcadd7bc3d5a/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-05-08T05:15:09.560 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r--. 1 ubuntu ubuntu 782795 May 8 05:15 /home/ubuntu/cephtest/cephadm 2024-05-08T05:15:09.560 DEBUG:teuthology.orchestra.run.smithi087:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-05-08T05:15:09.622 DEBUG:teuthology.orchestra.run.smithi090:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-05-08T05:15:09.641 DEBUG:teuthology.orchestra.run.smithi160:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-05-08T05:15:09.676 INFO:tasks.cephadm:Pulling image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a on all hosts... 2024-05-08T05:15:09.676 DEBUG:teuthology.orchestra.run.smithi087:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a pull 2024-05-08T05:15:09.683 DEBUG:teuthology.orchestra.run.smithi090:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a pull 2024-05-08T05:15:09.685 DEBUG:teuthology.orchestra.run.smithi160:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a pull 2024-05-08T05:15:11.234 INFO:teuthology.orchestra.run.smithi160.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a... 2024-05-08T05:15:11.885 INFO:teuthology.orchestra.run.smithi087.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a... 2024-05-08T05:15:11.885 INFO:teuthology.orchestra.run.smithi090.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a... 2024-05-08T05:15:46.399 INFO:teuthology.orchestra.run.smithi160.stdout:{ 2024-05-08T05:15:46.399 INFO:teuthology.orchestra.run.smithi160.stdout: "ceph_version": "ceph version 19.0.0-3538-gbee299f4 (bee299f4ac344e4c45e550d7a80abcadd7bc3d5a) squid (dev)", 2024-05-08T05:15:46.399 INFO:teuthology.orchestra.run.smithi160.stdout: "image_id": "352576a2df49fbab3aeeba1effbcb7a94815e8fc1f120a55ddc340b4ee63b8ce", 2024-05-08T05:15:46.400 INFO:teuthology.orchestra.run.smithi160.stdout: "repo_digests": [ 2024-05-08T05:15:46.400 INFO:teuthology.orchestra.run.smithi160.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c" 2024-05-08T05:15:46.400 INFO:teuthology.orchestra.run.smithi160.stdout: ] 2024-05-08T05:15:46.400 INFO:teuthology.orchestra.run.smithi160.stdout:} 2024-05-08T05:15:52.146 INFO:teuthology.orchestra.run.smithi090.stdout:{ 2024-05-08T05:15:52.146 INFO:teuthology.orchestra.run.smithi090.stdout: "ceph_version": "ceph version 19.0.0-3538-gbee299f4 (bee299f4ac344e4c45e550d7a80abcadd7bc3d5a) squid (dev)", 2024-05-08T05:15:52.146 INFO:teuthology.orchestra.run.smithi090.stdout: "image_id": "352576a2df49fbab3aeeba1effbcb7a94815e8fc1f120a55ddc340b4ee63b8ce", 2024-05-08T05:15:52.146 INFO:teuthology.orchestra.run.smithi090.stdout: "repo_digests": [ 2024-05-08T05:15:52.146 INFO:teuthology.orchestra.run.smithi090.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c" 2024-05-08T05:15:52.146 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-05-08T05:15:52.146 INFO:teuthology.orchestra.run.smithi090.stdout:} 2024-05-08T05:15:52.570 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-05-08T05:15:52.570 INFO:teuthology.orchestra.run.smithi087.stdout: "ceph_version": "ceph version 19.0.0-3538-gbee299f4 (bee299f4ac344e4c45e550d7a80abcadd7bc3d5a) squid (dev)", 2024-05-08T05:15:52.570 INFO:teuthology.orchestra.run.smithi087.stdout: "image_id": "352576a2df49fbab3aeeba1effbcb7a94815e8fc1f120a55ddc340b4ee63b8ce", 2024-05-08T05:15:52.570 INFO:teuthology.orchestra.run.smithi087.stdout: "repo_digests": [ 2024-05-08T05:15:52.570 INFO:teuthology.orchestra.run.smithi087.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c" 2024-05-08T05:15:52.575 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-05-08T05:15:52.576 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-05-08T05:15:52.622 DEBUG:teuthology.orchestra.run.smithi087:> sudo mkdir -p /etc/ceph 2024-05-08T05:15:52.707 DEBUG:teuthology.orchestra.run.smithi090:> sudo mkdir -p /etc/ceph 2024-05-08T05:15:52.738 DEBUG:teuthology.orchestra.run.smithi160:> sudo mkdir -p /etc/ceph 2024-05-08T05:15:52.770 DEBUG:teuthology.orchestra.run.smithi087:> sudo chmod 777 /etc/ceph 2024-05-08T05:15:52.858 DEBUG:teuthology.orchestra.run.smithi090:> sudo chmod 777 /etc/ceph 2024-05-08T05:15:52.887 DEBUG:teuthology.orchestra.run.smithi160:> sudo chmod 777 /etc/ceph 2024-05-08T05:15:52.915 INFO:tasks.cephadm:Writing seed config... 2024-05-08T05:15:52.916 INFO:tasks.cephadm: override: [client] client mount timeout = 600 2024-05-08T05:15:52.916 INFO:tasks.cephadm: override: [client] debug client = 20 2024-05-08T05:15:52.916 INFO:tasks.cephadm: override: [client] debug ms = 1 2024-05-08T05:15:52.916 INFO:tasks.cephadm: override: [client] rados mon op timeout = 900 2024-05-08T05:15:52.916 INFO:tasks.cephadm: override: [client] rados osd op timeout = 900 2024-05-08T05:15:52.916 INFO:tasks.cephadm: override: [global] ms die on skipped message = False 2024-05-08T05:15:52.916 INFO:tasks.cephadm: override: [mds] debug mds = 20 2024-05-08T05:15:52.916 INFO:tasks.cephadm: override: [mds] debug mds balancer = 20 2024-05-08T05:15:52.917 INFO:tasks.cephadm: override: [mds] debug ms = 1 2024-05-08T05:15:52.917 INFO:tasks.cephadm: override: [mds] mds bal fragment size max = 10000 2024-05-08T05:15:52.917 INFO:tasks.cephadm: override: [mds] mds bal merge size = 5 2024-05-08T05:15:52.917 INFO:tasks.cephadm: override: [mds] mds bal split bits = 3 2024-05-08T05:15:52.917 INFO:tasks.cephadm: override: [mds] mds bal split size = 100 2024-05-08T05:15:52.917 INFO:tasks.cephadm: override: [mds] mds debug frag = True 2024-05-08T05:15:52.917 INFO:tasks.cephadm: override: [mds] mds debug scatterstat = True 2024-05-08T05:15:52.917 INFO:tasks.cephadm: override: [mds] mds op complaint time = 180 2024-05-08T05:15:52.917 INFO:tasks.cephadm: override: [mds] mds verify scatter = True 2024-05-08T05:15:52.917 INFO:tasks.cephadm: override: [mds] mds_bal_replicate_threshold = 1 2024-05-08T05:15:52.917 INFO:tasks.cephadm: override: [mds] osd op complaint time = 180 2024-05-08T05:15:52.917 INFO:tasks.cephadm: override: [mds] rados mon op timeout = 900 2024-05-08T05:15:52.917 INFO:tasks.cephadm: override: [mds] rados osd op timeout = 900 2024-05-08T05:15:52.917 INFO:tasks.cephadm: override: [mgr] cephsqlite lock renewal timeout = 900000 2024-05-08T05:15:52.917 INFO:tasks.cephadm: override: [mgr] debug client = 20 2024-05-08T05:15:52.918 INFO:tasks.cephadm: override: [mgr] debug mgr = 20 2024-05-08T05:15:52.918 INFO:tasks.cephadm: override: [mgr] debug ms = 1 2024-05-08T05:15:52.918 INFO:tasks.cephadm: override: [mon] debug mon = 20 2024-05-08T05:15:52.918 INFO:tasks.cephadm: override: [mon] debug ms = 1 2024-05-08T05:15:52.918 INFO:tasks.cephadm: override: [mon] debug paxos = 20 2024-05-08T05:15:52.918 INFO:tasks.cephadm: override: [mon] mon down mkfs grace = 300 2024-05-08T05:15:52.918 INFO:tasks.cephadm: override: [mon] mon op complaint time = 120 2024-05-08T05:15:52.918 INFO:tasks.cephadm: override: [osd] bdev async discard = True 2024-05-08T05:15:52.918 INFO:tasks.cephadm: override: [osd] bdev enable discard = True 2024-05-08T05:15:52.918 INFO:tasks.cephadm: override: [osd] bluestore allocator = bitmap 2024-05-08T05:15:52.918 INFO:tasks.cephadm: override: [osd] bluestore block size = 96636764160 2024-05-08T05:15:52.918 INFO:tasks.cephadm: override: [osd] bluestore fsck on mount = True 2024-05-08T05:15:52.918 INFO:tasks.cephadm: override: [osd] debug bluefs = 1/20 2024-05-08T05:15:52.919 INFO:tasks.cephadm: override: [osd] debug bluestore = 1/20 2024-05-08T05:15:52.919 INFO:tasks.cephadm: override: [osd] debug ms = 1 2024-05-08T05:15:52.919 INFO:tasks.cephadm: override: [osd] debug osd = 20 2024-05-08T05:15:52.919 INFO:tasks.cephadm: override: [osd] debug rocksdb = 4/10 2024-05-08T05:15:52.919 INFO:tasks.cephadm: override: [osd] mon osd backfillfull_ratio = 0.85 2024-05-08T05:15:52.919 INFO:tasks.cephadm: override: [osd] mon osd full ratio = 0.9 2024-05-08T05:15:52.919 INFO:tasks.cephadm: override: [osd] mon osd nearfull ratio = 0.8 2024-05-08T05:15:52.919 INFO:tasks.cephadm: override: [osd] osd failsafe full ratio = 0.95 2024-05-08T05:15:52.919 INFO:tasks.cephadm: override: [osd] osd objectstore = bluestore 2024-05-08T05:15:52.919 INFO:tasks.cephadm: override: [osd] osd op complaint time = 180 2024-05-08T05:15:52.919 INFO:tasks.cephadm: override: [osd] osd shutdown pgref assert = True 2024-05-08T05:15:52.919 INFO:tasks.cephadm: override: [osd] osd_max_omap_entries_per_request = 10000 2024-05-08T05:15:52.920 DEBUG:teuthology.orchestra.run.smithi087:> set -ex 2024-05-08T05:15:52.920 DEBUG:teuthology.orchestra.run.smithi087:> dd of=/home/ubuntu/cephtest/seed.ceph.conf 2024-05-08T05:15:52.976 DEBUG:tasks.cephadm:Final config: [global] # make logging friendly to teuthology log_to_file = true log_to_stderr = false log to journald = false mon cluster log to file = true mon cluster log file level = debug mon clock drift allowed = 1.000 # replicate across OSDs, not hosts osd crush chooseleaf type = 0 #osd pool default size = 2 osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd # enable some debugging auth debug = true ms die on old message = true ms die on bug = true debug asserts on shutdown = true # adjust warnings mon max pg per osd = 10000# >= luminous mon pg warn max object skew = 0 mon osd allow primary affinity = true mon osd allow pg remap = true mon warn on legacy crush tunables = false mon warn on crush straw calc version zero = false mon warn on no sortbitwise = false mon warn on osd down out interval zero = false mon warn on too few osds = false mon_warn_on_pool_pg_num_not_power_of_two = false # disable pg_autoscaler by default for new pools osd_pool_default_pg_autoscale_mode = off # tests delete pools mon allow pool delete = true fsid = eeeb813e-0cf9-11ef-bc97-c7b262605968 ms die on skipped message = False [osd] osd scrub load threshold = 5.0 osd scrub max interval = 600 osd mclock profile = high_recovery_ops osd recover clone overlap = true osd recovery max chunk = 1048576 osd deep scrub update digest min age = 30 osd map max advance = 10 osd memory target autotune = true # debugging osd debug shutdown = true osd debug op order = true osd debug verify stray on activate = true osd debug pg log writeout = true osd debug verify cached snaps = true osd debug verify missing on start = true osd debug misdirected ops = true osd op queue = debug_random osd op queue cut off = debug_random osd shutdown pgref assert = True bdev debug aio = true osd sloppy crc = true bdev async discard = True bdev enable discard = True bluestore allocator = bitmap bluestore block size = 96636764160 bluestore fsck on mount = True debug bluefs = 1/20 debug bluestore = 1/20 debug ms = 1 debug osd = 20 debug rocksdb = 4/10 mon osd backfillfull_ratio = 0.85 mon osd full ratio = 0.9 mon osd nearfull ratio = 0.8 osd failsafe full ratio = 0.95 osd objectstore = bluestore osd op complaint time = 180 osd_max_omap_entries_per_request = 10000 [mgr] mon reweight min pgs per osd = 4 mon reweight min bytes per osd = 10 mgr/telemetry/nag = false cephsqlite lock renewal timeout = 900000 debug client = 20 debug mgr = 20 debug ms = 1 [mon] mon data avail warn = 5 mon mgr mkfs grace = 240 mon reweight min pgs per osd = 4 mon osd reporter subtree level = osd mon osd prime pg temp = true mon reweight min bytes per osd = 10 # rotate auth tickets quickly to exercise renewal paths auth mon ticket ttl = 660# 11m auth service ticket ttl = 240# 4m # don't complain about global id reclaim mon_warn_on_insecure_global_id_reclaim = false mon_warn_on_insecure_global_id_reclaim_allowed = false debug mon = 20 debug ms = 1 debug paxos = 20 mon down mkfs grace = 300 mon op complaint time = 120 [client.rgw] rgw cache enabled = true rgw enable ops log = true rgw enable usage log = true [client] client mount timeout = 600 debug client = 20 debug ms = 1 rados mon op timeout = 900 rados osd op timeout = 900 [mds] debug mds = 20 debug mds balancer = 20 debug ms = 1 mds bal fragment size max = 10000 mds bal merge size = 5 mds bal split bits = 3 mds bal split size = 100 mds debug frag = True mds debug scatterstat = True mds op complaint time = 180 mds verify scatter = True mds_bal_replicate_threshold = 1 osd op complaint time = 180 rados mon op timeout = 900 rados osd op timeout = 900 2024-05-08T05:15:52.977 DEBUG:teuthology.orchestra.run.smithi087:mon.a> sudo journalctl -f -n 0 -u ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968@mon.a.service 2024-05-08T05:15:53.024 DEBUG:teuthology.orchestra.run.smithi087:mgr.x> sudo journalctl -f -n 0 -u ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968@mgr.x.service 2024-05-08T05:15:53.070 INFO:tasks.cephadm:Bootstrapping... 2024-05-08T05:15:53.070 DEBUG:teuthology.orchestra.run.smithi087:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a -v bootstrap --fsid eeeb813e-0cf9-11ef-bc97-c7b262605968 --config /home/ubuntu/cephtest/seed.ceph.conf --output-config /etc/ceph/ceph.conf --output-keyring /etc/ceph/ceph.client.admin.keyring --output-pub-ssh-key /home/ubuntu/cephtest/ceph.pub --mon-id a --mgr-id x --orphan-initial-daemons --skip-monitoring-stack --mon-ip 172.21.15.87 --skip-admin-label && sudo chmod +r /etc/ceph/ceph.client.admin.keyring 2024-05-08T05:15:53.336 INFO:teuthology.orchestra.run.smithi087.stdout:-------------------------------------------------------------------------------- 2024-05-08T05:15:53.336 INFO:teuthology.orchestra.run.smithi087.stdout:cephadm ['--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a', '-v', 'bootstrap', '--fsid', 'eeeb813e-0cf9-11ef-bc97-c7b262605968', '--config', '/home/ubuntu/cephtest/seed.ceph.conf', '--output-config', '/etc/ceph/ceph.conf', '--output-keyring', '/etc/ceph/ceph.client.admin.keyring', '--output-pub-ssh-key', '/home/ubuntu/cephtest/ceph.pub', '--mon-id', 'a', '--mgr-id', 'x', '--orphan-initial-daemons', '--skip-monitoring-stack', '--mon-ip', '172.21.15.87', '--skip-admin-label'] 2024-05-08T05:15:53.336 INFO:teuthology.orchestra.run.smithi087.stderr:Specifying an fsid for your cluster offers no advantages and may increase the likelihood of fsid conflicts. 2024-05-08T05:15:53.336 INFO:teuthology.orchestra.run.smithi087.stdout:Verifying podman|docker is present... 2024-05-08T05:15:53.392 INFO:teuthology.orchestra.run.smithi087.stdout:/bin/podman: stdout 4.9.4-dev 2024-05-08T05:15:53.392 INFO:teuthology.orchestra.run.smithi087.stdout:Verifying lvm2 is present... 2024-05-08T05:15:53.392 INFO:teuthology.orchestra.run.smithi087.stdout:Verifying time synchronization is in place... 2024-05-08T05:15:53.408 INFO:teuthology.orchestra.run.smithi087.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2024-05-08T05:15:53.408 INFO:teuthology.orchestra.run.smithi087.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2024-05-08T05:15:53.426 INFO:teuthology.orchestra.run.smithi087.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2024-05-08T05:15:53.426 INFO:teuthology.orchestra.run.smithi087.stdout:systemctl: stdout inactive 2024-05-08T05:15:53.447 INFO:teuthology.orchestra.run.smithi087.stdout:systemctl: stdout enabled 2024-05-08T05:15:53.462 INFO:teuthology.orchestra.run.smithi087.stdout:systemctl: stdout active 2024-05-08T05:15:53.463 INFO:teuthology.orchestra.run.smithi087.stdout:Unit chronyd.service is enabled and running 2024-05-08T05:15:53.463 INFO:teuthology.orchestra.run.smithi087.stdout:Repeating the final host check... 2024-05-08T05:15:53.516 INFO:teuthology.orchestra.run.smithi087.stdout:/bin/podman: stdout 4.9.4-dev 2024-05-08T05:15:53.516 INFO:teuthology.orchestra.run.smithi087.stdout:podman (/bin/podman) version 4.9.4 is present 2024-05-08T05:15:53.516 INFO:teuthology.orchestra.run.smithi087.stdout:systemctl is present 2024-05-08T05:15:53.516 INFO:teuthology.orchestra.run.smithi087.stdout:lvcreate is present 2024-05-08T05:15:53.531 INFO:teuthology.orchestra.run.smithi087.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2024-05-08T05:15:53.531 INFO:teuthology.orchestra.run.smithi087.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2024-05-08T05:15:53.549 INFO:teuthology.orchestra.run.smithi087.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2024-05-08T05:15:53.549 INFO:teuthology.orchestra.run.smithi087.stdout:systemctl: stdout inactive 2024-05-08T05:15:53.572 INFO:teuthology.orchestra.run.smithi087.stdout:systemctl: stdout enabled 2024-05-08T05:15:53.592 INFO:teuthology.orchestra.run.smithi087.stdout:systemctl: stdout active 2024-05-08T05:15:53.593 INFO:teuthology.orchestra.run.smithi087.stdout:Unit chronyd.service is enabled and running 2024-05-08T05:15:53.593 INFO:teuthology.orchestra.run.smithi087.stdout:Host looks OK 2024-05-08T05:15:53.593 INFO:teuthology.orchestra.run.smithi087.stdout:Cluster fsid: eeeb813e-0cf9-11ef-bc97-c7b262605968 2024-05-08T05:15:53.594 INFO:teuthology.orchestra.run.smithi087.stdout:Acquiring lock 140239091297728 on /run/cephadm/eeeb813e-0cf9-11ef-bc97-c7b262605968.lock 2024-05-08T05:15:53.594 INFO:teuthology.orchestra.run.smithi087.stdout:Lock 140239091297728 acquired on /run/cephadm/eeeb813e-0cf9-11ef-bc97-c7b262605968.lock 2024-05-08T05:15:53.596 INFO:teuthology.orchestra.run.smithi087.stdout:Verifying IP 172.21.15.87 port 3300 ... 2024-05-08T05:15:53.597 INFO:teuthology.orchestra.run.smithi087.stdout:Verifying IP 172.21.15.87 port 6789 ... 2024-05-08T05:15:53.597 INFO:teuthology.orchestra.run.smithi087.stdout:Base mon IP(s) is [172.21.15.87:3300, 172.21.15.87:6789], mon addrv is [v2:172.21.15.87:3300,v1:172.21.15.87:6789] 2024-05-08T05:15:53.611 INFO:teuthology.orchestra.run.smithi087.stdout:/sbin/ip: stdout default via 172.21.15.254 dev enp3s0f1 proto dhcp src 172.21.15.87 metric 100 2024-05-08T05:15:53.612 INFO:teuthology.orchestra.run.smithi087.stdout:/sbin/ip: stdout 172.21.0.0/20 dev enp3s0f1 proto kernel scope link src 172.21.15.87 metric 100 2024-05-08T05:15:53.623 INFO:teuthology.orchestra.run.smithi087.stdout:/sbin/ip: stdout ::1 dev lo proto kernel metric 256 pref medium 2024-05-08T05:15:53.624 INFO:teuthology.orchestra.run.smithi087.stdout:/sbin/ip: stdout fe80::/64 dev enp3s0f1 proto kernel metric 256 pref medium 2024-05-08T05:15:53.624 INFO:teuthology.orchestra.run.smithi087.stdout:/sbin/ip: stdout default via fe80::327c:5e00:6487:71e0 dev enp3s0f1 proto ra metric 1024 expires 1779sec hoplimit 64 pref medium 2024-05-08T05:15:53.634 INFO:teuthology.orchestra.run.smithi087.stdout:/sbin/ip: stdout 1: lo: mtu 65536 state UNKNOWN qlen 1000 2024-05-08T05:15:53.635 INFO:teuthology.orchestra.run.smithi087.stdout:/sbin/ip: stdout inet6 ::1/128 scope host 2024-05-08T05:15:53.635 INFO:teuthology.orchestra.run.smithi087.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2024-05-08T05:15:53.635 INFO:teuthology.orchestra.run.smithi087.stdout:/sbin/ip: stdout 5: enp3s0f1: mtu 1500 state UP qlen 1000 2024-05-08T05:15:53.636 INFO:teuthology.orchestra.run.smithi087.stdout:/sbin/ip: stdout inet6 fe80::ec4:7aff:fe8f:d5f5/64 scope link 2024-05-08T05:15:53.636 INFO:teuthology.orchestra.run.smithi087.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2024-05-08T05:15:53.638 INFO:teuthology.orchestra.run.smithi087.stdout:Mon IP `172.21.15.87` is in CIDR network `172.21.0.0/20` 2024-05-08T05:15:53.638 INFO:teuthology.orchestra.run.smithi087.stdout:Mon IP `172.21.15.87` is in CIDR network `172.21.0.0/20` 2024-05-08T05:15:53.639 INFO:teuthology.orchestra.run.smithi087.stdout:Inferred mon public CIDR from local network configuration ['172.21.0.0/20', '172.21.0.0/20'] 2024-05-08T05:15:53.641 INFO:teuthology.orchestra.run.smithi087.stdout:Internal network (--cluster-network) has not been provided, OSD replication will default to the public_network 2024-05-08T05:15:53.643 INFO:teuthology.orchestra.run.smithi087.stdout:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a... 2024-05-08T05:15:54.283 INFO:teuthology.orchestra.run.smithi087.stdout:/bin/podman: stdout 352576a2df49fbab3aeeba1effbcb7a94815e8fc1f120a55ddc340b4ee63b8ce 2024-05-08T05:15:54.284 INFO:teuthology.orchestra.run.smithi087.stdout:/bin/podman: stderr Trying to pull quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a... 2024-05-08T05:15:54.284 INFO:teuthology.orchestra.run.smithi087.stdout:/bin/podman: stderr Getting image source signatures 2024-05-08T05:15:54.284 INFO:teuthology.orchestra.run.smithi087.stdout:/bin/podman: stderr Copying blob sha256:f08a3efca46759c0efc03dda6bb4c9adf7daf77004822005f2f0da3e8d1877bb 2024-05-08T05:15:54.284 INFO:teuthology.orchestra.run.smithi087.stdout:/bin/podman: stderr Copying blob sha256:bf5b95bd68251da39c6cd2eb96c6ba4138bb37a62bdc39287908b25e92047d7e 2024-05-08T05:15:54.284 INFO:teuthology.orchestra.run.smithi087.stdout:/bin/podman: stderr Copying config sha256:352576a2df49fbab3aeeba1effbcb7a94815e8fc1f120a55ddc340b4ee63b8ce 2024-05-08T05:15:54.284 INFO:teuthology.orchestra.run.smithi087.stdout:/bin/podman: stderr Writing manifest to image destination 2024-05-08T05:15:55.545 INFO:teuthology.orchestra.run.smithi087.stdout:ceph: stdout ceph version 19.0.0-3538-gbee299f4 (bee299f4ac344e4c45e550d7a80abcadd7bc3d5a) squid (dev) 2024-05-08T05:15:55.545 INFO:teuthology.orchestra.run.smithi087.stdout:Ceph version: ceph version 19.0.0-3538-gbee299f4 (bee299f4ac344e4c45e550d7a80abcadd7bc3d5a) squid (dev) 2024-05-08T05:15:55.546 INFO:teuthology.orchestra.run.smithi087.stdout:Extracting ceph user uid/gid from container image... 2024-05-08T05:16:06.085 INFO:teuthology.orchestra.run.smithi087.stdout:stat: stdout 167 167 2024-05-08T05:16:06.085 INFO:teuthology.orchestra.run.smithi087.stdout:Creating initial keys... 2024-05-08T05:16:07.107 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph-authtool: stdout AQCWCjtmoM20HRAApNS5v8tYOU1t2PwoNIwoFg== 2024-05-08T05:16:08.305 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph-authtool: stdout AQCXCjtmyLIFIxAA+QKhEgFM3JBNFqmPcJz2kQ== 2024-05-08T05:16:09.412 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph-authtool: stdout AQCYCjtmO+NRLBAA3gYMZi+/eGRxRPZ0na9mLQ== 2024-05-08T05:16:09.413 INFO:teuthology.orchestra.run.smithi087.stdout:Creating initial monmap... 2024-05-08T05:16:11.552 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: monmap file /tmp/monmap 2024-05-08T05:16:11.552 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/monmaptool: stdout setting min_mon_release = quincy 2024-05-08T05:16:11.552 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: set fsid to eeeb813e-0cf9-11ef-bc97-c7b262605968 2024-05-08T05:16:11.552 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2024-05-08T05:16:11.552 INFO:teuthology.orchestra.run.smithi087.stdout:monmaptool for a [v2:172.21.15.87:3300,v1:172.21.15.87:6789] on /usr/bin/monmaptool: monmap file /tmp/monmap 2024-05-08T05:16:11.552 INFO:teuthology.orchestra.run.smithi087.stdout:setting min_mon_release = quincy 2024-05-08T05:16:11.552 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/monmaptool: set fsid to eeeb813e-0cf9-11ef-bc97-c7b262605968 2024-05-08T05:16:11.553 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2024-05-08T05:16:11.553 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-05-08T05:16:11.553 INFO:teuthology.orchestra.run.smithi087.stdout:Creating mon... 2024-05-08T05:16:12.623 INFO:teuthology.orchestra.run.smithi087.stdout:create mon.a on 2024-05-08T05:16:13.009 INFO:teuthology.orchestra.run.smithi087.stdout:systemctl: stderr Removed "/etc/systemd/system/multi-user.target.wants/ceph.target". 2024-05-08T05:16:13.239 INFO:teuthology.orchestra.run.smithi087.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /etc/systemd/system/ceph.target. 2024-05-08T05:16:13.520 INFO:teuthology.orchestra.run.smithi087.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968.target → /etc/systemd/system/ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968.target. 2024-05-08T05:16:13.521 INFO:teuthology.orchestra.run.smithi087.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph.target.wants/ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968.target → /etc/systemd/system/ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968.target. 2024-05-08T05:16:13.913 INFO:teuthology.orchestra.run.smithi087.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968@mon.a 2024-05-08T05:16:13.913 INFO:teuthology.orchestra.run.smithi087.stdout:systemctl: stderr Failed to reset failed state of unit ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968@mon.a.service: Unit ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968@mon.a.service not loaded. 2024-05-08T05:16:14.210 INFO:teuthology.orchestra.run.smithi087.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968.target.wants/ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968@mon.a.service → /etc/systemd/system/ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968@.service. 2024-05-08T05:16:14.910 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:16:14 smithi087 podman[29136]: 2024-05-08 05:16:14.897687194 +0000 UTC m=+0.376395380 container init 38a1bb7cf6fe44aa5b7690775f2824dac835adf8ce4e128cd7bc875a4d6d4d45 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a, name=ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-mon-a, org.label-schema.schema-version=1.0, RELEASE=wip-57676-3-bee299f, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240507, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, maintainer=Guillaume Abrioux ) 2024-05-08T05:16:14.910 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:16:14 smithi087 podman[29136]: 2024-05-08 05:16:14.908060813 +0000 UTC m=+0.386768962 container start 38a1bb7cf6fe44aa5b7690775f2824dac835adf8ce4e128cd7bc875a4d6d4d45 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a, name=ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-mon-a, io.buildah.version=1.33.5, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_CLEAN=True, RELEASE=wip-57676-3-bee299f, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240507, CEPH_POINT_RELEASE=) 2024-05-08T05:16:15.035 INFO:teuthology.orchestra.run.smithi087.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-05-08T05:16:15.036 INFO:teuthology.orchestra.run.smithi087.stdout:systemctl: stdout disabled 2024-05-08T05:16:15.049 INFO:teuthology.orchestra.run.smithi087.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-05-08T05:16:15.049 INFO:teuthology.orchestra.run.smithi087.stdout:systemctl: stdout inactive 2024-05-08T05:16:15.049 INFO:teuthology.orchestra.run.smithi087.stdout:firewalld.service is not enabled 2024-05-08T05:16:15.050 INFO:teuthology.orchestra.run.smithi087.stdout:Not possible to enable service . firewalld.service is not available 2024-05-08T05:16:15.050 INFO:teuthology.orchestra.run.smithi087.stdout:Waiting for mon to start... 2024-05-08T05:16:15.050 INFO:teuthology.orchestra.run.smithi087.stdout:Waiting for mon... 2024-05-08T05:16:15.195 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:16:14 smithi087 ceph-mon[29155]: mkfs eeeb813e-0cf9-11ef-bc97-c7b262605968 2024-05-08T05:16:15.195 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:16:14 smithi087 ceph-mon[29155]: mon.a is new leader, mons a in quorum (ranks 0) 2024-05-08T05:16:15.196 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:16:15 smithi087 bash[29136]: 38a1bb7cf6fe44aa5b7690775f2824dac835adf8ce4e128cd7bc875a4d6d4d45 2024-05-08T05:16:15.196 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:16:15 smithi087 systemd[1]: Started Ceph mon.a for eeeb813e-0cf9-11ef-bc97-c7b262605968. 2024-05-08T05:16:16.208 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:16:15 smithi087 ceph-mon[29155]: mon.a is new leader, mons a in quorum (ranks 0) 2024-05-08T05:16:16.208 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:16:15 smithi087 ceph-mon[29155]: monmap epoch 1 2024-05-08T05:16:16.209 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:16:15 smithi087 ceph-mon[29155]: fsid eeeb813e-0cf9-11ef-bc97-c7b262605968 2024-05-08T05:16:16.209 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:16:15 smithi087 ceph-mon[29155]: last_changed 2024-05-08T05:16:09.877063+0000 2024-05-08T05:16:16.209 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:16:15 smithi087 ceph-mon[29155]: created 2024-05-08T05:16:09.877063+0000 2024-05-08T05:16:16.209 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:16:15 smithi087 ceph-mon[29155]: min_mon_release 19 (squid) 2024-05-08T05:16:16.209 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:16:15 smithi087 ceph-mon[29155]: election_strategy: 1 2024-05-08T05:16:16.209 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:16:15 smithi087 ceph-mon[29155]: 0: [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] mon.a 2024-05-08T05:16:16.209 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:16:15 smithi087 ceph-mon[29155]: fsmap 2024-05-08T05:16:16.209 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:16:15 smithi087 ceph-mon[29155]: osdmap e1: 0 total, 0 up, 0 in 2024-05-08T05:16:16.209 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:16:15 smithi087 ceph-mon[29155]: mgrmap e1: no daemons active 2024-05-08T05:16:16.209 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:16:15 smithi087 ceph-mon[29155]: from='client.? 172.21.15.87:0/2820738901' entity='client.admin' cmd=[{"prefix": "status"}]: dispatch 2024-05-08T05:16:16.624 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout cluster: 2024-05-08T05:16:16.633 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout id: eeeb813e-0cf9-11ef-bc97-c7b262605968 2024-05-08T05:16:16.633 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout health: HEALTH_OK 2024-05-08T05:16:16.634 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout 2024-05-08T05:16:16.634 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout services: 2024-05-08T05:16:16.634 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout mon: 1 daemons, quorum a (age 0.783961s) 2024-05-08T05:16:16.634 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout mgr: no daemons active 2024-05-08T05:16:16.634 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout osd: 0 osds: 0 up, 0 in 2024-05-08T05:16:16.634 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout 2024-05-08T05:16:16.634 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout data: 2024-05-08T05:16:16.634 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout pools: 0 pools, 0 pgs 2024-05-08T05:16:16.634 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout objects: 0 objects, 0 B 2024-05-08T05:16:16.634 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout usage: 0 B used, 0 B / 0 B avail 2024-05-08T05:16:16.634 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout pgs: 2024-05-08T05:16:16.634 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout 2024-05-08T05:16:16.635 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:15.674+0000 7f7b28000700 1 Processor -- start 2024-05-08T05:16:16.635 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:15.674+0000 7f7b28000700 1 -- start start 2024-05-08T05:16:16.635 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:15.675+0000 7f7b28000700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7b2007ee40 0x7f7b2007d2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:16:16.635 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:15.675+0000 7f7b28000700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f7b2007d870 con 0x7f7b2007ee40 2024-05-08T05:16:16.635 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:15.676+0000 7f7b25600700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7b2007ee40 0x7f7b2007d2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:16:16.635 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:15.676+0000 7f7b25600700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7b2007ee40 0x7f7b2007d2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:49956/0 (socket says 172.21.15.87:49956) 2024-05-08T05:16:16.635 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:15.676+0000 7f7b25600700 1 -- 172.21.15.87:0/3792788022 learned_addr learned my addr 172.21.15.87:0/3792788022 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T05:16:16.635 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:15.677+0000 7f7b25600700 1 -- 172.21.15.87:0/3792788022 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7b2007d9f0 con 0x7f7b2007ee40 2024-05-08T05:16:16.636 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:15.677+0000 7f7b25600700 1 --2- 172.21.15.87:0/3792788022 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7b2007ee40 0x7f7b2007d2a0 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f7b140098a0 tx=0x7f7b14009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=58e87e52abda5eca server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:16:16.636 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:15.678+0000 7f7b1fe00700 1 -- 172.21.15.87:0/3792788022 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7b14004160 con 0x7f7b2007ee40 2024-05-08T05:16:16.636 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:15.678+0000 7f7b1fe00700 1 -- 172.21.15.87:0/3792788022 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7b14004300 con 0x7f7b2007ee40 2024-05-08T05:16:16.636 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:15.678+0000 7f7b1fe00700 1 -- 172.21.15.87:0/3792788022 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7b140036a0 con 0x7f7b2007ee40 2024-05-08T05:16:16.636 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:15.678+0000 7f7b28000700 1 -- 172.21.15.87:0/3792788022 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7b2007ee40 msgr2=0x7f7b2007d2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:16:16.636 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:15.678+0000 7f7b28000700 1 --2- 172.21.15.87:0/3792788022 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7b2007ee40 0x7f7b2007d2a0 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f7b140098a0 tx=0x7f7b14009bb0 comp rx=0 tx=0).stop 2024-05-08T05:16:16.636 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:15.678+0000 7f7b28000700 1 -- 172.21.15.87:0/3792788022 shutdown_connections 2024-05-08T05:16:16.636 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:15.678+0000 7f7b28000700 1 --2- 172.21.15.87:0/3792788022 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7b2007ee40 0x7f7b2007d2a0 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:16:16.636 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:15.679+0000 7f7b28000700 1 -- 172.21.15.87:0/3792788022 >> 172.21.15.87:0/3792788022 conn(0x7f7b20104550 msgr2=0x7f7b20106970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:16:16.636 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:15.679+0000 7f7b28000700 1 -- 172.21.15.87:0/3792788022 shutdown_connections 2024-05-08T05:16:16.636 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:15.679+0000 7f7b28000700 1 -- 172.21.15.87:0/3792788022 wait complete. 2024-05-08T05:16:16.636 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:15.680+0000 7f7b28000700 1 Processor -- start 2024-05-08T05:16:16.636 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:15.680+0000 7f7b28000700 1 -- start start 2024-05-08T05:16:16.637 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:15.680+0000 7f7b28000700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7b2007ee40 0x7f7b2019e6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:16:16.637 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:15.680+0000 7f7b28000700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f7b2007df20 con 0x7f7b2007ee40 2024-05-08T05:16:16.637 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:15.681+0000 7f7b25600700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7b2007ee40 0x7f7b2019e6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:16:16.637 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:15.681+0000 7f7b25600700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7b2007ee40 0x7f7b2019e6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:49970/0 (socket says 172.21.15.87:49970) 2024-05-08T05:16:16.637 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:15.681+0000 7f7b25600700 1 -- 172.21.15.87:0/2820738901 learned_addr learned my addr 172.21.15.87:0/2820738901 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T05:16:16.637 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:15.681+0000 7f7b25600700 1 -- 172.21.15.87:0/2820738901 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7b2019ec30 con 0x7f7b2007ee40 2024-05-08T05:16:16.637 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:15.681+0000 7f7b25600700 1 --2- 172.21.15.87:0/2820738901 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7b2007ee40 0x7f7b2019e6f0 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f7b14000c00 tx=0x7f7b14004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:16:16.637 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:15.682+0000 7f7b1e000700 1 -- 172.21.15.87:0/2820738901 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7b14003db0 con 0x7f7b2007ee40 2024-05-08T05:16:16.637 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:15.682+0000 7f7b1e000700 1 -- 172.21.15.87:0/2820738901 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7b14011630 con 0x7f7b2007ee40 2024-05-08T05:16:16.637 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:15.682+0000 7f7b1e000700 1 -- 172.21.15.87:0/2820738901 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7b14011950 con 0x7f7b2007ee40 2024-05-08T05:16:16.637 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:15.682+0000 7f7b28000700 1 -- 172.21.15.87:0/2820738901 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7b2019eec0 con 0x7f7b2007ee40 2024-05-08T05:16:16.637 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:15.682+0000 7f7b28000700 1 -- 172.21.15.87:0/2820738901 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7b201a1bb0 con 0x7f7b2007ee40 2024-05-08T05:16:16.637 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:15.682+0000 7f7b1e000700 1 -- 172.21.15.87:0/2820738901 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f7b14011af0 con 0x7f7b2007ee40 2024-05-08T05:16:16.637 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:15.682+0000 7f7b1e000700 1 -- 172.21.15.87:0/2820738901 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f7b1401c450 con 0x7f7b2007ee40 2024-05-08T05:16:16.638 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:15.683+0000 7f7b28000700 1 -- 172.21.15.87:0/2820738901 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7b20064b00 con 0x7f7b2007ee40 2024-05-08T05:16:16.638 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:15.686+0000 7f7b1e000700 1 -- 172.21.15.87:0/2820738901 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73389 (secure 0 0 0) 0x7f7b14032020 con 0x7f7b2007ee40 2024-05-08T05:16:16.638 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:15.765+0000 7f7b28000700 1 -- 172.21.15.87:0/2820738901 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "status"} v 0) -- 0x7f7b201a20a0 con 0x7f7b2007ee40 2024-05-08T05:16:16.638 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:15.766+0000 7f7b1e000700 1 -- 172.21.15.87:0/2820738901 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "status"}]=0 v0) ==== 54+0+317 (secure 0 0 0) 0x7f7b14004260 con 0x7f7b2007ee40 2024-05-08T05:16:16.638 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:15.767+0000 7f7b28000700 1 -- 172.21.15.87:0/2820738901 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7b2007ee40 msgr2=0x7f7b2019e6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:16:16.638 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:15.767+0000 7f7b28000700 1 --2- 172.21.15.87:0/2820738901 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7b2007ee40 0x7f7b2019e6f0 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f7b14000c00 tx=0x7f7b14004750 comp rx=0 tx=0).stop 2024-05-08T05:16:16.638 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:15.767+0000 7f7b28000700 1 -- 172.21.15.87:0/2820738901 shutdown_connections 2024-05-08T05:16:16.638 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:15.767+0000 7f7b28000700 1 --2- 172.21.15.87:0/2820738901 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7b2007ee40 0x7f7b2019e6f0 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:16:16.638 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:15.767+0000 7f7b28000700 1 -- 172.21.15.87:0/2820738901 >> 172.21.15.87:0/2820738901 conn(0x7f7b20104550 msgr2=0x7f7b20105260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:16:16.638 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:15.767+0000 7f7b28000700 1 -- 172.21.15.87:0/2820738901 shutdown_connections 2024-05-08T05:16:16.638 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:15.768+0000 7f7b28000700 1 -- 172.21.15.87:0/2820738901 wait complete. 2024-05-08T05:16:16.638 INFO:teuthology.orchestra.run.smithi087.stdout:mon is available 2024-05-08T05:16:16.638 INFO:teuthology.orchestra.run.smithi087.stdout:Assimilating anything we can from ceph.conf... 2024-05-08T05:16:17.655 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:16:17 smithi087 ceph-mon[29155]: from='client.? 172.21.15.87:0/1716202416' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2024-05-08T05:16:17.655 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:16:17 smithi087 ceph-mon[29155]: from='client.? 172.21.15.87:0/1716202416' entity='client.admin' cmd='[{"prefix": "config assimilate-conf"}]': finished 2024-05-08T05:16:17.953 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout 2024-05-08T05:16:17.953 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout [global] 2024-05-08T05:16:17.953 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout fsid = eeeb813e-0cf9-11ef-bc97-c7b262605968 2024-05-08T05:16:17.953 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout mon_cluster_log_file_level = debug 2024-05-08T05:16:17.953 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout mon_host = [v2:172.21.15.87:3300,v1:172.21.15.87:6789] 2024-05-08T05:16:17.953 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2024-05-08T05:16:17.953 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2024-05-08T05:16:17.953 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2024-05-08T05:16:17.953 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2024-05-08T05:16:17.954 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout 2024-05-08T05:16:17.959 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout [mgr] 2024-05-08T05:16:17.959 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2024-05-08T05:16:17.959 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout 2024-05-08T05:16:17.959 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout [osd] 2024-05-08T05:16:17.960 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout bdev_async_discard = True 2024-05-08T05:16:17.960 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2024-05-08T05:16:17.960 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2024-05-08T05:16:17.960 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2024-05-08T05:16:17.960 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2024-05-08T05:16:17.960 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2024-05-08T05:16:17.960 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:17.247+0000 7f5c21200700 1 Processor -- start 2024-05-08T05:16:17.960 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:17.247+0000 7f5c21200700 1 -- start start 2024-05-08T05:16:17.960 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:17.248+0000 7f5c21200700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5c1c107880 0x7f5c1c107ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:16:17.960 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:17.248+0000 7f5c21200700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f5c1c07ce10 con 0x7f5c1c107880 2024-05-08T05:16:17.960 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:17.248+0000 7f5c19e00700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5c1c107880 0x7f5c1c107ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:16:17.960 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:17.248+0000 7f5c19e00700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5c1c107880 0x7f5c1c107ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:50784/0 (socket says 172.21.15.87:50784) 2024-05-08T05:16:17.960 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:17.248+0000 7f5c19e00700 1 -- 172.21.15.87:0/2494183980 learned_addr learned my addr 172.21.15.87:0/2494183980 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T05:16:17.960 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:17.248+0000 7f5c19e00700 1 -- 172.21.15.87:0/2494183980 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5c1c1081e0 con 0x7f5c1c107880 2024-05-08T05:16:17.961 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:17.249+0000 7f5c19e00700 1 --2- 172.21.15.87:0/2494183980 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5c1c107880 0x7f5c1c107ca0 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7f5c0c0098a0 tx=0x7f5c0c009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=45f90feaad24e7a8 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:16:17.961 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:17.249+0000 7f5c18a00700 1 -- 172.21.15.87:0/2494183980 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5c0c004160 con 0x7f5c1c107880 2024-05-08T05:16:17.961 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:17.249+0000 7f5c18a00700 1 -- 172.21.15.87:0/2494183980 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5c0c004300 con 0x7f5c1c107880 2024-05-08T05:16:17.961 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:17.249+0000 7f5c18a00700 1 -- 172.21.15.87:0/2494183980 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5c0c0036a0 con 0x7f5c1c107880 2024-05-08T05:16:17.961 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:17.250+0000 7f5c21200700 1 -- 172.21.15.87:0/2494183980 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5c1c107880 msgr2=0x7f5c1c107ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:16:17.961 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:17.250+0000 7f5c21200700 1 --2- 172.21.15.87:0/2494183980 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5c1c107880 0x7f5c1c107ca0 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7f5c0c0098a0 tx=0x7f5c0c009bb0 comp rx=0 tx=0).stop 2024-05-08T05:16:17.961 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:17.250+0000 7f5c21200700 1 -- 172.21.15.87:0/2494183980 shutdown_connections 2024-05-08T05:16:17.961 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:17.250+0000 7f5c21200700 1 --2- 172.21.15.87:0/2494183980 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5c1c107880 0x7f5c1c107ca0 unknown :-1 s=CLOSED pgs=3 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:16:17.961 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:17.250+0000 7f5c21200700 1 -- 172.21.15.87:0/2494183980 >> 172.21.15.87:0/2494183980 conn(0x7f5c1c103460 msgr2=0x7f5c1c105880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:16:17.961 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:17.250+0000 7f5c21200700 1 -- 172.21.15.87:0/2494183980 shutdown_connections 2024-05-08T05:16:17.961 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:17.250+0000 7f5c21200700 1 -- 172.21.15.87:0/2494183980 wait complete. 2024-05-08T05:16:17.961 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:17.251+0000 7f5c21200700 1 Processor -- start 2024-05-08T05:16:17.961 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:17.251+0000 7f5c21200700 1 -- start start 2024-05-08T05:16:17.962 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:17.251+0000 7f5c21200700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5c1c107880 0x7f5c1c19e700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:16:17.962 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:17.251+0000 7f5c21200700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f5c1c108710 con 0x7f5c1c107880 2024-05-08T05:16:17.962 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:17.252+0000 7f5c19e00700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5c1c107880 0x7f5c1c19e700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:16:17.962 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:17.252+0000 7f5c19e00700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5c1c107880 0x7f5c1c19e700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:50796/0 (socket says 172.21.15.87:50796) 2024-05-08T05:16:17.962 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:17.252+0000 7f5c19e00700 1 -- 172.21.15.87:0/1716202416 learned_addr learned my addr 172.21.15.87:0/1716202416 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T05:16:17.962 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:17.252+0000 7f5c19e00700 1 -- 172.21.15.87:0/1716202416 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5c1c19ec40 con 0x7f5c1c107880 2024-05-08T05:16:17.962 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:17.252+0000 7f5c19e00700 1 --2- 172.21.15.87:0/1716202416 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5c1c107880 0x7f5c1c19e700 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7f5c0c000c00 tx=0x7f5c0c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:16:17.962 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:17.252+0000 7f5c12a00700 1 -- 172.21.15.87:0/1716202416 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5c0c003db0 con 0x7f5c1c107880 2024-05-08T05:16:17.962 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:17.252+0000 7f5c12a00700 1 -- 172.21.15.87:0/1716202416 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5c0c011630 con 0x7f5c1c107880 2024-05-08T05:16:17.962 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:17.252+0000 7f5c12a00700 1 -- 172.21.15.87:0/1716202416 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5c0c011950 con 0x7f5c1c107880 2024-05-08T05:16:17.962 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:17.252+0000 7f5c21200700 1 -- 172.21.15.87:0/1716202416 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5c1c19eed0 con 0x7f5c1c107880 2024-05-08T05:16:17.962 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:17.253+0000 7f5c21200700 1 -- 172.21.15.87:0/1716202416 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5c1c1a1bc0 con 0x7f5c1c107880 2024-05-08T05:16:17.962 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:17.253+0000 7f5c12a00700 1 -- 172.21.15.87:0/1716202416 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f5c0c011af0 con 0x7f5c1c107880 2024-05-08T05:16:17.963 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:17.253+0000 7f5c12a00700 1 -- 172.21.15.87:0/1716202416 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f5c0c01c450 con 0x7f5c1c107880 2024-05-08T05:16:17.963 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:17.254+0000 7f5c21200700 1 -- 172.21.15.87:0/1716202416 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5c1c064b00 con 0x7f5c1c107880 2024-05-08T05:16:17.963 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:17.256+0000 7f5c12a00700 1 -- 172.21.15.87:0/1716202416 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73389 (secure 0 0 0) 0x7f5c0c004260 con 0x7f5c1c107880 2024-05-08T05:16:17.963 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:17.330+0000 7f5c21200700 1 -- 172.21.15.87:0/1716202416 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "config assimilate-conf"} v 0) -- 0x7f5c1c1a1d90 con 0x7f5c1c107880 2024-05-08T05:16:17.963 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:17.339+0000 7f5c12a00700 1 -- 172.21.15.87:0/1716202416 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "config assimilate-conf"}]=0 v2) ==== 70+0+492 (secure 0 0 0) 0x7f5c0c01b450 con 0x7f5c1c107880 2024-05-08T05:16:17.963 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:17.340+0000 7f5c21200700 1 -- 172.21.15.87:0/1716202416 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5c1c107880 msgr2=0x7f5c1c19e700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:16:17.963 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:17.340+0000 7f5c21200700 1 --2- 172.21.15.87:0/1716202416 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5c1c107880 0x7f5c1c19e700 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7f5c0c000c00 tx=0x7f5c0c004750 comp rx=0 tx=0).stop 2024-05-08T05:16:17.963 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:17.340+0000 7f5c21200700 1 -- 172.21.15.87:0/1716202416 shutdown_connections 2024-05-08T05:16:17.963 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:17.340+0000 7f5c21200700 1 --2- 172.21.15.87:0/1716202416 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5c1c107880 0x7f5c1c19e700 unknown :-1 s=CLOSED pgs=4 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:16:17.963 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:17.340+0000 7f5c21200700 1 -- 172.21.15.87:0/1716202416 >> 172.21.15.87:0/1716202416 conn(0x7f5c1c103460 msgr2=0x7f5c1c194d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:16:17.963 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:17.340+0000 7f5c21200700 1 -- 172.21.15.87:0/1716202416 shutdown_connections 2024-05-08T05:16:17.963 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:17.341+0000 7f5c21200700 1 -- 172.21.15.87:0/1716202416 wait complete. 2024-05-08T05:16:17.963 INFO:teuthology.orchestra.run.smithi087.stdout:Generating new minimal ceph.conf... 2024-05-08T05:16:18.922 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:16:18 smithi087 ceph-mon[29155]: from='client.? 172.21.15.87:0/1055194896' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T05:16:19.260 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:18.533+0000 7fc224e00700 1 Processor -- start 2024-05-08T05:16:19.261 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:18.533+0000 7fc224e00700 1 -- start start 2024-05-08T05:16:19.261 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:18.533+0000 7fc224e00700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc22010fcb0 0x7fc2201120a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:16:19.261 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:18.533+0000 7fc224e00700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fc220112670 con 0x7fc22010fcb0 2024-05-08T05:16:19.261 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:18.534+0000 7fc21f400700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc22010fcb0 0x7fc2201120a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:16:19.261 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:18.534+0000 7fc21f400700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc22010fcb0 0x7fc2201120a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:50812/0 (socket says 172.21.15.87:50812) 2024-05-08T05:16:19.262 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:18.534+0000 7fc21f400700 1 -- 172.21.15.87:0/3873419007 learned_addr learned my addr 172.21.15.87:0/3873419007 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T05:16:19.262 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:18.534+0000 7fc21f400700 1 -- 172.21.15.87:0/3873419007 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc2201127f0 con 0x7fc22010fcb0 2024-05-08T05:16:19.262 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:18.535+0000 7fc21f400700 1 --2- 172.21.15.87:0/3873419007 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc22010fcb0 0x7fc2201120a0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7fc2100098a0 tx=0x7fc210009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=90a863567b845a6e server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:16:19.262 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:18.535+0000 7fc21e000700 1 -- 172.21.15.87:0/3873419007 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc210004160 con 0x7fc22010fcb0 2024-05-08T05:16:19.263 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:18.535+0000 7fc21e000700 1 -- 172.21.15.87:0/3873419007 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) ==== 1070+0+0 (secure 0 0 0) 0x7fc210004300 con 0x7fc22010fcb0 2024-05-08T05:16:19.263 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:18.535+0000 7fc21e000700 1 -- 172.21.15.87:0/3873419007 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc210011af0 con 0x7fc22010fcb0 2024-05-08T05:16:19.263 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:18.536+0000 7fc224e00700 1 -- 172.21.15.87:0/3873419007 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc22010fcb0 msgr2=0x7fc2201120a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:16:19.263 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:18.536+0000 7fc224e00700 1 --2- 172.21.15.87:0/3873419007 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc22010fcb0 0x7fc2201120a0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7fc2100098a0 tx=0x7fc210009bb0 comp rx=0 tx=0).stop 2024-05-08T05:16:19.265 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:18.536+0000 7fc224e00700 1 -- 172.21.15.87:0/3873419007 shutdown_connections 2024-05-08T05:16:19.265 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:18.536+0000 7fc224e00700 1 --2- 172.21.15.87:0/3873419007 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc22010fcb0 0x7fc2201120a0 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:16:19.265 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:18.536+0000 7fc224e00700 1 -- 172.21.15.87:0/3873419007 >> 172.21.15.87:0/3873419007 conn(0x7fc22007e800 msgr2=0x7fc220080c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:16:19.265 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:18.536+0000 7fc224e00700 1 -- 172.21.15.87:0/3873419007 shutdown_connections 2024-05-08T05:16:19.265 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:18.536+0000 7fc224e00700 1 -- 172.21.15.87:0/3873419007 wait complete. 2024-05-08T05:16:19.265 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:18.537+0000 7fc224e00700 1 Processor -- start 2024-05-08T05:16:19.265 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:18.537+0000 7fc224e00700 1 -- start start 2024-05-08T05:16:19.266 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:18.538+0000 7fc224e00700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc22010fcb0 0x7fc2201a3230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:16:19.266 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:18.538+0000 7fc224e00700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fc2201137a0 con 0x7fc22010fcb0 2024-05-08T05:16:19.266 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:18.538+0000 7fc21f400700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc22010fcb0 0x7fc2201a3230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:16:19.266 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:18.538+0000 7fc21f400700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc22010fcb0 0x7fc2201a3230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:50826/0 (socket says 172.21.15.87:50826) 2024-05-08T05:16:19.266 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:18.538+0000 7fc21f400700 1 -- 172.21.15.87:0/1055194896 learned_addr learned my addr 172.21.15.87:0/1055194896 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T05:16:19.268 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:18.538+0000 7fc21f400700 1 -- 172.21.15.87:0/1055194896 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc2201a3770 con 0x7fc22010fcb0 2024-05-08T05:16:19.268 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:18.539+0000 7fc21f400700 1 --2- 172.21.15.87:0/1055194896 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc22010fcb0 0x7fc2201a3230 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fc210011890 tx=0x7fc210011970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:16:19.268 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:18.539+0000 7fc217e00700 1 -- 172.21.15.87:0/1055194896 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc2100039e0 con 0x7fc22010fcb0 2024-05-08T05:16:19.268 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:18.539+0000 7fc217e00700 1 -- 172.21.15.87:0/1055194896 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) ==== 1070+0+0 (secure 0 0 0) 0x7fc210003b80 con 0x7fc22010fcb0 2024-05-08T05:16:19.269 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:18.539+0000 7fc217e00700 1 -- 172.21.15.87:0/1055194896 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc210024750 con 0x7fc22010fcb0 2024-05-08T05:16:19.269 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:18.539+0000 7fc224e00700 1 -- 172.21.15.87:0/1055194896 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc2201a3a00 con 0x7fc22010fcb0 2024-05-08T05:16:19.269 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:18.539+0000 7fc224e00700 1 -- 172.21.15.87:0/1055194896 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc2201a66f0 con 0x7fc22010fcb0 2024-05-08T05:16:19.269 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:18.539+0000 7fc217e00700 1 -- 172.21.15.87:0/1055194896 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fc210022020 con 0x7fc22010fcb0 2024-05-08T05:16:19.269 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:18.539+0000 7fc217e00700 1 -- 172.21.15.87:0/1055194896 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fc21002dcf0 con 0x7fc22010fcb0 2024-05-08T05:16:19.269 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:18.540+0000 7fc224e00700 1 -- 172.21.15.87:0/1055194896 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc220064b00 con 0x7fc22010fcb0 2024-05-08T05:16:19.269 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:18.543+0000 7fc217e00700 1 -- 172.21.15.87:0/1055194896 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73389 (secure 0 0 0) 0x7fc210043ec0 con 0x7fc22010fcb0 2024-05-08T05:16:19.269 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:18.619+0000 7fc224e00700 1 -- 172.21.15.87:0/1055194896 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "config generate-minimal-conf"} v 0) -- 0x7fc2201a68c0 con 0x7fc22010fcb0 2024-05-08T05:16:19.269 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:18.620+0000 7fc217e00700 1 -- 172.21.15.87:0/1055194896 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "config generate-minimal-conf"}]=0 v2) ==== 76+0+175 (secure 0 0 0) 0x7fc210032020 con 0x7fc22010fcb0 2024-05-08T05:16:19.269 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:18.622+0000 7fc224e00700 1 -- 172.21.15.87:0/1055194896 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc22010fcb0 msgr2=0x7fc2201a3230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:16:19.269 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:18.622+0000 7fc224e00700 1 --2- 172.21.15.87:0/1055194896 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc22010fcb0 0x7fc2201a3230 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fc210011890 tx=0x7fc210011970 comp rx=0 tx=0).stop 2024-05-08T05:16:19.269 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:18.622+0000 7fc224e00700 1 -- 172.21.15.87:0/1055194896 shutdown_connections 2024-05-08T05:16:19.269 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:18.622+0000 7fc224e00700 1 --2- 172.21.15.87:0/1055194896 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc22010fcb0 0x7fc2201a3230 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:16:19.270 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:18.622+0000 7fc224e00700 1 -- 172.21.15.87:0/1055194896 >> 172.21.15.87:0/1055194896 conn(0x7fc22007e800 msgr2=0x7fc220080270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:16:19.270 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:18.622+0000 7fc224e00700 1 -- 172.21.15.87:0/1055194896 shutdown_connections 2024-05-08T05:16:19.270 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:18.623+0000 7fc224e00700 1 -- 172.21.15.87:0/1055194896 wait complete. 2024-05-08T05:16:19.270 INFO:teuthology.orchestra.run.smithi087.stdout:Restarting the monitor... 2024-05-08T05:16:19.709 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:16:19 smithi087 systemd[1]: Stopping Ceph mon.a for eeeb813e-0cf9-11ef-bc97-c7b262605968... 2024-05-08T05:16:20.209 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:16:19 smithi087 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-mon-a[29151]: 2024-05-08T05:16:19.768+0000 7f3126400700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-05-08T05:16:20.209 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:16:19 smithi087 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-mon-a[29151]: 2024-05-08T05:16:19.768+0000 7f3126400700 -1 mon.a@0(leader) e1 *** Got Signal Terminated *** 2024-05-08T05:16:20.209 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:16:19 smithi087 podman[29399]: 2024-05-08 05:16:19.902438013 +0000 UTC m=+0.267476813 container died 38a1bb7cf6fe44aa5b7690775f2824dac835adf8ce4e128cd7bc875a4d6d4d45 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a, name=ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-mon-a, io.buildah.version=1.33.5, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-57676-3-bee299f, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.build-date=20240507, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2) 2024-05-08T05:16:20.562 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:16:20 smithi087 podman[29399]: 2024-05-08 05:16:20.327099121 +0000 UTC m=+0.692137945 container cleanup 38a1bb7cf6fe44aa5b7690775f2824dac835adf8ce4e128cd7bc875a4d6d4d45 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a, name=ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-mon-a, GIT_BRANCH=HEAD, RELEASE=wip-57676-3-bee299f, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, ceph=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240507, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_CLEAN=True) 2024-05-08T05:16:20.562 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:16:20 smithi087 bash[29399]: ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-mon-a 2024-05-08T05:16:20.958 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:16:20 smithi087 podman[29411]: 2024-05-08 05:16:20.561078098 +0000 UTC m=+0.647615079 container remove 38a1bb7cf6fe44aa5b7690775f2824dac835adf8ce4e128cd7bc875a4d6d4d45 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a, name=ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-mon-a, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240507, ceph=True, RELEASE=wip-57676-3-bee299f, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5) 2024-05-08T05:16:21.391 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:16:21 smithi087 systemd[1]: ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968@mon.a.service: Deactivated successfully. 2024-05-08T05:16:21.391 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:16:21 smithi087 systemd[1]: Stopped Ceph mon.a for eeeb813e-0cf9-11ef-bc97-c7b262605968. 2024-05-08T05:16:21.391 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:16:21 smithi087 systemd[1]: ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968@mon.a.service: Consumed 1.869s CPU time. 2024-05-08T05:16:21.391 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:16:21 smithi087 systemd[1]: Starting Ceph mon.a for eeeb813e-0cf9-11ef-bc97-c7b262605968... 2024-05-08T05:16:21.673 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:16:21 smithi087 podman[29504]: 2024-05-08 05:16:21.295802917 +0000 UTC m=+0.031655801 image pull 352576a2df49fbab3aeeba1effbcb7a94815e8fc1f120a55ddc340b4ee63b8ce quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a 2024-05-08T05:16:21.673 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:16:21 smithi087 podman[29504]: 2024-05-08 05:16:21.395210422 +0000 UTC m=+0.131063345 container create a734a965374b987d174d01573bfbf349ec0955099f881849964b5e9127b3d8ab (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a, name=ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-mon-a, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-57676-3-bee299f, org.label-schema.build-date=20240507, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_CLEAN=True) 2024-05-08T05:16:21.674 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:16:21 smithi087 podman[29504]: 2024-05-08 05:16:21.615176861 +0000 UTC m=+0.351029801 container init a734a965374b987d174d01573bfbf349ec0955099f881849964b5e9127b3d8ab (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a, name=ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-mon-a, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240507, io.buildah.version=1.33.5, ceph=True, RELEASE=wip-57676-3-bee299f, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS) 2024-05-08T05:16:21.674 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:16:21 smithi087 podman[29504]: 2024-05-08 05:16:21.626093924 +0000 UTC m=+0.361946817 container start a734a965374b987d174d01573bfbf349ec0955099f881849964b5e9127b3d8ab (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a, name=ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-mon-a, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, RELEASE=wip-57676-3-bee299f, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240507, ceph=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0) 2024-05-08T05:16:21.725 INFO:teuthology.orchestra.run.smithi087.stdout:Setting public_network to 172.21.0.0/20 in mon config section 2024-05-08T05:16:21.961 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:16:21 smithi087 ceph-mon[29523]: set uid:gid to 167:167 (ceph:ceph) 2024-05-08T05:16:21.961 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:16:21 smithi087 ceph-mon[29523]: ceph version 19.0.0-3538-gbee299f4 (bee299f4ac344e4c45e550d7a80abcadd7bc3d5a) squid (dev), process ceph-mon, pid 2 2024-05-08T05:16:21.961 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:16:21 smithi087 ceph-mon[29523]: pidfile_write: ignore empty --pid-file 2024-05-08T05:16:21.961 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:16:21 smithi087 ceph-mon[29523]: load: jerasure load: lrc 2024-05-08T05:16:21.961 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:16:21 smithi087 ceph-mon[29523]: rocksdb: RocksDB version: 7.9.2 2024-05-08T05:16:21.961 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:16:21 smithi087 ceph-mon[29523]: rocksdb: Git sha 0 2024-05-08T05:16:21.961 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:16:21 smithi087 ceph-mon[29523]: rocksdb: Compile date 2024-05-07 11:18:56 2024-05-08T05:16:21.961 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:16:21 smithi087 ceph-mon[29523]: rocksdb: DB SUMMARY 2024-05-08T05:16:21.961 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:16:21 smithi087 ceph-mon[29523]: rocksdb: DB Session ID: 4V1F0WN3CLTCDHZD5W07 2024-05-08T05:16:21.961 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:16:21 smithi087 ceph-mon[29523]: rocksdb: CURRENT file: CURRENT 2024-05-08T05:16:21.961 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:16:21 smithi087 ceph-mon[29523]: rocksdb: IDENTITY file: IDENTITY 2024-05-08T05:16:21.962 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:16:21 smithi087 ceph-mon[29523]: rocksdb: MANIFEST file: MANIFEST-000010 size: 179 Bytes 2024-05-08T05:16:21.962 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:16:21 smithi087 ceph-mon[29523]: rocksdb: SST files in /var/lib/ceph/mon/ceph-a/store.db dir, Total Num: 1, files: 000008.sst 2024-05-08T05:16:21.962 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:16:21 smithi087 ceph-mon[29523]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-a/store.db: 000009.log size: 105002 ; 2024-05-08T05:16:21.962 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:16:21 smithi087 ceph-mon[29523]: rocksdb: Options.error_if_exists: 0 2024-05-08T05:16:21.962 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:16:21 smithi087 ceph-mon[29523]: rocksdb: Options.create_if_missing: 0 2024-05-08T05:16:21.962 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:16:21 smithi087 ceph-mon[29523]: rocksdb: Options.paranoid_checks: 1 2024-05-08T05:16:21.962 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:16:21 smithi087 ceph-mon[29523]: rocksdb: Options.flush_verify_memtable_count: 1 2024-05-08T05:16:21.962 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:16:21 smithi087 ceph-mon[29523]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-05-08T05:16:21.962 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:16:21 smithi087 ceph-mon[29523]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-05-08T05:16:21.962 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:16:21 smithi087 ceph-mon[29523]: rocksdb: Options.env: 0x55ea70bb4cc0 2024-05-08T05:16:21.962 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:16:21 smithi087 ceph-mon[29523]: rocksdb: Options.fs: PosixFileSystem 2024-05-08T05:16:21.962 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:16:21 smithi087 ceph-mon[29523]: rocksdb: Options.info_log: 0x55eaa83a7de0 2024-05-08T05:16:21.962 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:16:21 smithi087 ceph-mon[29523]: rocksdb: Options.max_file_opening_threads: 16 2024-05-08T05:16:21.963 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:16:21 smithi087 ceph-mon[29523]: rocksdb: Options.statistics: (nil) 2024-05-08T05:16:21.963 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:16:21 smithi087 ceph-mon[29523]: rocksdb: Options.use_fsync: 0 2024-05-08T05:16:21.963 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:16:21 smithi087 ceph-mon[29523]: rocksdb: Options.max_log_file_size: 0 2024-05-08T05:16:21.963 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:16:21 smithi087 ceph-mon[29523]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-05-08T05:16:21.963 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:16:21 smithi087 ceph-mon[29523]: rocksdb: Options.log_file_time_to_roll: 0 2024-05-08T05:16:21.963 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:16:21 smithi087 ceph-mon[29523]: rocksdb: Options.keep_log_file_num: 1000 2024-05-08T05:16:21.963 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:16:21 smithi087 ceph-mon[29523]: rocksdb: Options.recycle_log_file_num: 0 2024-05-08T05:16:21.963 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:16:21 smithi087 ceph-mon[29523]: rocksdb: Options.allow_fallocate: 1 2024-05-08T05:16:21.963 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:16:21 smithi087 ceph-mon[29523]: rocksdb: Options.allow_mmap_reads: 0 2024-05-08T05:16:21.964 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:16:21 smithi087 ceph-mon[29523]: rocksdb: Options.allow_mmap_writes: 0 2024-05-08T05:16:21.964 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:16:21 smithi087 ceph-mon[29523]: rocksdb: Options.use_direct_reads: 0 2024-05-08T05:16:21.964 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:16:21 smithi087 ceph-mon[29523]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-05-08T05:16:21.964 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:16:21 smithi087 ceph-mon[29523]: rocksdb: Options.create_missing_column_families: 0 2024-05-08T05:16:21.964 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:16:21 smithi087 ceph-mon[29523]: rocksdb: Options.db_log_dir: 2024-05-08T05:16:21.964 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:16:21 smithi087 ceph-mon[29523]: rocksdb: Options.wal_dir: 2024-05-08T05:16:21.964 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:16:21 smithi087 ceph-mon[29523]: rocksdb: Options.table_cache_numshardbits: 6 2024-05-08T05:16:21.964 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:16:21 smithi087 ceph-mon[29523]: rocksdb: Options.WAL_ttl_seconds: 0 2024-05-08T05:16:21.965 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:16:21 smithi087 ceph-mon[29523]: rocksdb: Options.WAL_size_limit_MB: 0 2024-05-08T05:16:21.965 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:16:21 smithi087 ceph-mon[29523]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-05-08T05:16:21.965 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:16:21 smithi087 ceph-mon[29523]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-05-08T05:16:21.965 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:16:21 smithi087 ceph-mon[29523]: rocksdb: Options.is_fd_close_on_exec: 1 2024-05-08T05:16:21.965 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:16:21 smithi087 ceph-mon[29523]: rocksdb: Options.advise_random_on_open: 1 2024-05-08T05:16:21.965 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:16:21 smithi087 ceph-mon[29523]: rocksdb: Options.db_write_buffer_size: 0 2024-05-08T05:16:21.965 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:16:21 smithi087 ceph-mon[29523]: rocksdb: Options.write_buffer_manager: 0x55eaa83790e0 2024-05-08T05:16:21.965 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:16:21 smithi087 ceph-mon[29523]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-05-08T05:16:21.965 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:16:21 smithi087 ceph-mon[29523]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-05-08T05:16:21.965 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:16:21 smithi087 ceph-mon[29523]: rocksdb: Options.use_adaptive_mutex: 0 2024-05-08T05:16:21.965 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:16:21 smithi087 ceph-mon[29523]: rocksdb: Options.rate_limiter: (nil) 2024-05-08T05:16:21.965 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:16:21 smithi087 ceph-mon[29523]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-05-08T05:16:21.965 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:16:21 smithi087 ceph-mon[29523]: rocksdb: Options.wal_recovery_mode: 2 2024-05-08T05:16:21.966 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:16:21 smithi087 ceph-mon[29523]: rocksdb: Options.enable_thread_tracking: 0 2024-05-08T05:16:21.966 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:16:21 smithi087 ceph-mon[29523]: rocksdb: Options.enable_pipelined_write: 0 2024-05-08T05:16:21.966 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:16:21 smithi087 ceph-mon[29523]: rocksdb: Options.unordered_write: 0 2024-05-08T05:16:21.966 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:16:21 smithi087 ceph-mon[29523]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-05-08T05:16:21.966 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:16:21 smithi087 ceph-mon[29523]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-05-08T05:16:21.966 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:16:21 smithi087 ceph-mon[29523]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-05-08T05:16:21.966 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:16:21 smithi087 ceph-mon[29523]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-05-08T05:16:21.966 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:16:21 smithi087 ceph-mon[29523]: rocksdb: Options.row_cache: None 2024-05-08T05:16:21.967 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:16:21 smithi087 ceph-mon[29523]: rocksdb: Options.wal_filter: None 2024-05-08T05:16:21.967 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:16:21 smithi087 ceph-mon[29523]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-05-08T05:16:21.967 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:16:21 smithi087 ceph-mon[29523]: rocksdb: Options.allow_ingest_behind: 0 2024-05-08T05:16:21.967 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:16:21 smithi087 ceph-mon[29523]: rocksdb: Options.two_write_queues: 0 2024-05-08T05:16:21.967 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:16:21 smithi087 ceph-mon[29523]: rocksdb: Options.manual_wal_flush: 0 2024-05-08T05:16:21.967 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:16:21 smithi087 ceph-mon[29523]: rocksdb: Options.wal_compression: 0 2024-05-08T05:16:21.967 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:16:21 smithi087 ceph-mon[29523]: rocksdb: Options.atomic_flush: 0 2024-05-08T05:16:21.967 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:16:21 smithi087 ceph-mon[29523]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-05-08T05:16:21.967 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:16:21 smithi087 ceph-mon[29523]: rocksdb: Options.persist_stats_to_disk: 0 2024-05-08T05:16:21.967 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:16:21 smithi087 ceph-mon[29523]: rocksdb: Options.write_dbid_to_manifest: 0 2024-05-08T05:16:21.967 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:16:21 smithi087 ceph-mon[29523]: rocksdb: Options.log_readahead_size: 0 2024-05-08T05:16:21.967 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:16:21 smithi087 ceph-mon[29523]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-05-08T05:16:21.967 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:16:21 smithi087 ceph-mon[29523]: rocksdb: Options.best_efforts_recovery: 0 2024-05-08T05:16:21.968 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:16:21 smithi087 ceph-mon[29523]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-05-08T05:16:21.968 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:16:21 smithi087 ceph-mon[29523]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-05-08T05:16:21.968 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:16:21 smithi087 ceph-mon[29523]: rocksdb: Options.allow_data_in_errors: 0 2024-05-08T05:16:21.968 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:16:21 smithi087 ceph-mon[29523]: rocksdb: Options.db_host_id: __hostname__ 2024-05-08T05:16:21.968 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:16:21 smithi087 ceph-mon[29523]: rocksdb: Options.enforce_single_del_contracts: true 2024-05-08T05:16:21.968 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:16:21 smithi087 ceph-mon[29523]: rocksdb: Options.max_background_jobs: 2 2024-05-08T05:16:21.968 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:16:21 smithi087 ceph-mon[29523]: rocksdb: Options.max_background_compactions: -1 2024-05-08T05:16:21.969 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:16:21 smithi087 ceph-mon[29523]: rocksdb: Options.max_subcompactions: 1 2024-05-08T05:16:21.969 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:16:21 smithi087 ceph-mon[29523]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-05-08T05:16:21.969 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:16:21 smithi087 ceph-mon[29523]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-05-08T05:16:21.969 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:16:21 smithi087 ceph-mon[29523]: rocksdb: Options.delayed_write_rate : 16777216 2024-05-08T05:16:21.969 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:16:21 smithi087 ceph-mon[29523]: rocksdb: Options.max_total_wal_size: 0 2024-05-08T05:16:21.969 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:16:21 smithi087 ceph-mon[29523]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-05-08T05:16:21.969 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:16:21 smithi087 ceph-mon[29523]: rocksdb: Options.stats_dump_period_sec: 600 2024-05-08T05:16:21.969 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:16:21 smithi087 ceph-mon[29523]: rocksdb: Options.stats_persist_period_sec: 600 2024-05-08T05:16:21.969 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:16:21 smithi087 ceph-mon[29523]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-05-08T05:16:21.969 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:16:21 smithi087 ceph-mon[29523]: rocksdb: Options.max_open_files: -1 2024-05-08T05:16:21.970 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:16:21 smithi087 ceph-mon[29523]: rocksdb: Options.bytes_per_sync: 0 2024-05-08T05:16:21.970 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:16:21 smithi087 ceph-mon[29523]: rocksdb: Options.wal_bytes_per_sync: 0 2024-05-08T05:16:21.970 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:16:21 smithi087 ceph-mon[29523]: rocksdb: Options.strict_bytes_per_sync: 0 2024-05-08T05:16:21.970 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:16:21 smithi087 ceph-mon[29523]: rocksdb: Options.compaction_readahead_size: 0 2024-05-08T05:16:21.970 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:16:21 smithi087 ceph-mon[29523]: rocksdb: Options.max_background_flushes: -1 2024-05-08T05:16:21.970 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:16:21 smithi087 ceph-mon[29523]: rocksdb: Compression algorithms supported: 2024-05-08T05:16:21.970 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:16:21 smithi087 ceph-mon[29523]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-05-08T05:16:21.970 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:16:21 smithi087 ceph-mon[29523]: rocksdb: kZSTD supported: 0 2024-05-08T05:16:21.970 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:16:21 smithi087 ceph-mon[29523]: rocksdb: kXpressCompression supported: 0 2024-05-08T05:16:21.971 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:16:21 smithi087 ceph-mon[29523]: rocksdb: kLZ4HCCompression supported: 1 2024-05-08T05:16:21.971 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:16:21 smithi087 ceph-mon[29523]: rocksdb: kZlibCompression supported: 1 2024-05-08T05:16:21.971 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:16:21 smithi087 ceph-mon[29523]: rocksdb: kSnappyCompression supported: 1 2024-05-08T05:16:21.971 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:16:21 smithi087 ceph-mon[29523]: rocksdb: kLZ4Compression supported: 1 2024-05-08T05:16:21.971 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:16:21 smithi087 ceph-mon[29523]: rocksdb: kBZip2Compression supported: 0 2024-05-08T05:16:21.971 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:16:21 smithi087 ceph-mon[29523]: rocksdb: Fast CRC32 supported: Supported on x86 2024-05-08T05:16:21.971 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:16:21 smithi087 ceph-mon[29523]: rocksdb: DMutex implementation: pthread_mutex_t 2024-05-08T05:16:21.971 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:16:21 smithi087 ceph-mon[29523]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 2024-05-08T05:16:21.971 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:16:21 smithi087 ceph-mon[29523]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-05-08T05:16:21.971 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:16:21 smithi087 ceph-mon[29523]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-05-08T05:16:21.971 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:16:21 smithi087 ceph-mon[29523]: rocksdb: Options.merge_operator: 2024-05-08T05:16:21.971 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:16:21 smithi087 ceph-mon[29523]: rocksdb: Options.compaction_filter: None 2024-05-08T05:16:21.971 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:16:21 smithi087 ceph-mon[29523]: rocksdb: Options.compaction_filter_factory: None 2024-05-08T05:16:21.972 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:16:21 smithi087 ceph-mon[29523]: rocksdb: Options.sst_partitioner_factory: None 2024-05-08T05:16:21.972 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:16:21 smithi087 ceph-mon[29523]: rocksdb: Options.memtable_factory: SkipListFactory 2024-05-08T05:16:21.972 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:16:21 smithi087 ceph-mon[29523]: rocksdb: Options.table_factory: BlockBasedTable 2024-05-08T05:16:21.972 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:16:21 smithi087 ceph-mon[29523]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x55eaa83a7fa0) 2024-05-08T05:16:21.972 INFO:journalctl@ceph.mon.a.smithi087.stdout: cache_index_and_filter_blocks: 1 2024-05-08T05:16:21.972 INFO:journalctl@ceph.mon.a.smithi087.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-05-08T05:16:21.973 INFO:journalctl@ceph.mon.a.smithi087.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-05-08T05:16:21.973 INFO:journalctl@ceph.mon.a.smithi087.stdout: pin_top_level_index_and_filter: 1 2024-05-08T05:16:21.973 INFO:journalctl@ceph.mon.a.smithi087.stdout: index_type: 0 2024-05-08T05:16:21.973 INFO:journalctl@ceph.mon.a.smithi087.stdout: data_block_index_type: 0 2024-05-08T05:16:21.973 INFO:journalctl@ceph.mon.a.smithi087.stdout: index_shortening: 1 2024-05-08T05:16:21.974 INFO:journalctl@ceph.mon.a.smithi087.stdout: data_block_hash_table_util_ratio: 0.750000 2024-05-08T05:16:21.974 INFO:journalctl@ceph.mon.a.smithi087.stdout: checksum: 4 2024-05-08T05:16:21.974 INFO:journalctl@ceph.mon.a.smithi087.stdout: no_block_cache: 0 2024-05-08T05:16:21.974 INFO:journalctl@ceph.mon.a.smithi087.stdout: block_cache: 0x55eaa83ab1f0 2024-05-08T05:16:21.974 INFO:journalctl@ceph.mon.a.smithi087.stdout: block_cache_name: BinnedLRUCache 2024-05-08T05:16:21.974 INFO:journalctl@ceph.mon.a.smithi087.stdout: block_cache_options: 2024-05-08T05:16:21.974 INFO:journalctl@ceph.mon.a.smithi087.stdout: capacity : 536870912 2024-05-08T05:16:21.974 INFO:journalctl@ceph.mon.a.smithi087.stdout: num_shard_bits : 4 2024-05-08T05:16:21.974 INFO:journalctl@ceph.mon.a.smithi087.stdout: strict_capacity_limit : 0 2024-05-08T05:16:21.975 INFO:journalctl@ceph.mon.a.smithi087.stdout: high_pri_pool_ratio: 0.000 2024-05-08T05:16:21.975 INFO:journalctl@ceph.mon.a.smithi087.stdout: block_cache_compressed: (nil) 2024-05-08T05:16:21.975 INFO:journalctl@ceph.mon.a.smithi087.stdout: persistent_cache: (nil) 2024-05-08T05:16:21.975 INFO:journalctl@ceph.mon.a.smithi087.stdout: block_size: 4096 2024-05-08T05:16:21.975 INFO:journalctl@ceph.mon.a.smithi087.stdout: block_size_deviation: 10 2024-05-08T05:16:21.975 INFO:journalctl@ceph.mon.a.smithi087.stdout: block_restart_interval: 16 2024-05-08T05:16:21.975 INFO:journalctl@ceph.mon.a.smithi087.stdout: index_block_restart_interval: 1 2024-05-08T05:16:21.975 INFO:journalctl@ceph.mon.a.smithi087.stdout: metadata_block_size: 4096 2024-05-08T05:16:21.975 INFO:journalctl@ceph.mon.a.smithi087.stdout: partition_filters: 0 2024-05-08T05:16:21.975 INFO:journalctl@ceph.mon.a.smithi087.stdout: use_delta_encoding: 1 2024-05-08T05:16:21.975 INFO:journalctl@ceph.mon.a.smithi087.stdout: filter_policy: bloomfilter 2024-05-08T05:16:21.975 INFO:journalctl@ceph.mon.a.smithi087.stdout: whole_key_filtering: 1 2024-05-08T05:16:21.975 INFO:journalctl@ceph.mon.a.smithi087.stdout: verify_compression: 0 2024-05-08T05:16:21.976 INFO:journalctl@ceph.mon.a.smithi087.stdout: read_amp_bytes_per_bit: 0 2024-05-08T05:16:21.976 INFO:journalctl@ceph.mon.a.smithi087.stdout: format_version: 5 2024-05-08T05:16:21.976 INFO:journalctl@ceph.mon.a.smithi087.stdout: enable_index_compression: 1 2024-05-08T05:16:21.976 INFO:journalctl@ceph.mon.a.smithi087.stdout: block_align: 0 2024-05-08T05:16:21.976 INFO:journalctl@ceph.mon.a.smithi087.stdout: max_auto_readahead_size: 262144 2024-05-08T05:16:21.976 INFO:journalctl@ceph.mon.a.smithi087.stdout: prepopulate_block_cache: 0 2024-05-08T05:16:21.976 INFO:journalctl@ceph.mon.a.smithi087.stdout: initial_auto_readahead_size: 8192 2024-05-08T05:16:21.976 INFO:journalctl@ceph.mon.a.smithi087.stdout: num_file_reads_for_auto_readahead: 2 2024-05-08T05:16:21.976 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:16:21 smithi087 ceph-mon[29523]: rocksdb: Options.write_buffer_size: 33554432 2024-05-08T05:16:21.976 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:16:21 smithi087 ceph-mon[29523]: rocksdb: Options.max_write_buffer_number: 2 2024-05-08T05:16:21.976 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:16:21 smithi087 ceph-mon[29523]: rocksdb: Options.compression: NoCompression 2024-05-08T05:16:21.976 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:16:21 smithi087 ceph-mon[29523]: rocksdb: Options.bottommost_compression: Disabled 2024-05-08T05:16:21.976 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:16:21 smithi087 ceph-mon[29523]: rocksdb: Options.prefix_extractor: nullptr 2024-05-08T05:16:21.976 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:16:21 smithi087 ceph-mon[29523]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-05-08T05:16:21.976 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:16:21 smithi087 ceph-mon[29523]: rocksdb: Options.num_levels: 7 2024-05-08T05:16:21.977 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:16:21 smithi087 ceph-mon[29523]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-05-08T05:16:21.977 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:16:21 smithi087 ceph-mon[29523]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-05-08T05:16:21.977 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:16:21 smithi087 ceph-mon[29523]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-05-08T05:16:21.977 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:16:21 smithi087 ceph-mon[29523]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-05-08T05:16:21.977 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:16:21 smithi087 ceph-mon[29523]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-05-08T05:16:21.977 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:16:21 smithi087 ceph-mon[29523]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-05-08T05:16:21.977 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:16:21 smithi087 ceph-mon[29523]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-05-08T05:16:21.977 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:16:21 smithi087 ceph-mon[29523]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-05-08T05:16:21.977 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:16:21 smithi087 ceph-mon[29523]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-05-08T05:16:21.977 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:16:21 smithi087 ceph-mon[29523]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-05-08T05:16:21.977 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:16:21 smithi087 ceph-mon[29523]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-05-08T05:16:21.977 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:16:21 smithi087 ceph-mon[29523]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-05-08T05:16:21.977 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:16:21 smithi087 ceph-mon[29523]: rocksdb: Options.compression_opts.window_bits: -14 2024-05-08T05:16:21.977 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:16:21 smithi087 ceph-mon[29523]: rocksdb: Options.compression_opts.level: 32767 2024-05-08T05:16:21.978 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:16:21 smithi087 ceph-mon[29523]: rocksdb: Options.compression_opts.strategy: 0 2024-05-08T05:16:21.978 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:16:21 smithi087 ceph-mon[29523]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-05-08T05:16:21.978 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:16:21 smithi087 ceph-mon[29523]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-05-08T05:16:21.978 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:16:21 smithi087 ceph-mon[29523]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-05-08T05:16:21.978 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:16:21 smithi087 ceph-mon[29523]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-05-08T05:16:21.978 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:16:21 smithi087 ceph-mon[29523]: rocksdb: Options.compression_opts.enabled: false 2024-05-08T05:16:21.978 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:16:21 smithi087 ceph-mon[29523]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-05-08T05:16:21.978 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:16:21 smithi087 ceph-mon[29523]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-05-08T05:16:21.978 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:16:21 smithi087 ceph-mon[29523]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-05-08T05:16:21.978 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:16:21 smithi087 ceph-mon[29523]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-05-08T05:16:21.978 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:16:21 smithi087 ceph-mon[29523]: rocksdb: Options.target_file_size_base: 67108864 2024-05-08T05:16:21.978 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:16:21 smithi087 ceph-mon[29523]: rocksdb: Options.target_file_size_multiplier: 1 2024-05-08T05:16:21.979 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:16:21 smithi087 ceph-mon[29523]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-05-08T05:16:21.979 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:16:21 smithi087 ceph-mon[29523]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-05-08T05:16:21.979 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:16:21 smithi087 ceph-mon[29523]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-05-08T05:16:21.979 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:16:21 smithi087 ceph-mon[29523]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-05-08T05:16:21.979 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:16:21 smithi087 ceph-mon[29523]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-05-08T05:16:21.979 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:16:21 smithi087 ceph-mon[29523]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-05-08T05:16:21.979 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:16:21 smithi087 ceph-mon[29523]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-05-08T05:16:21.979 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:16:21 smithi087 ceph-mon[29523]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-05-08T05:16:21.979 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:16:21 smithi087 ceph-mon[29523]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-05-08T05:16:21.979 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:16:21 smithi087 ceph-mon[29523]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-05-08T05:16:21.979 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:16:21 smithi087 ceph-mon[29523]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-05-08T05:16:21.979 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:16:21 smithi087 ceph-mon[29523]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-05-08T05:16:21.979 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:16:21 smithi087 ceph-mon[29523]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-05-08T05:16:21.980 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:16:21 smithi087 ceph-mon[29523]: rocksdb: Options.arena_block_size: 1048576 2024-05-08T05:16:21.980 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:16:21 smithi087 ceph-mon[29523]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-05-08T05:16:21.980 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:16:21 smithi087 ceph-mon[29523]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-05-08T05:16:21.980 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:16:21 smithi087 ceph-mon[29523]: rocksdb: Options.disable_auto_compactions: 0 2024-05-08T05:16:21.980 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:16:21 smithi087 ceph-mon[29523]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-05-08T05:16:21.980 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:16:21 smithi087 ceph-mon[29523]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-05-08T05:16:21.980 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:16:21 smithi087 ceph-mon[29523]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-05-08T05:16:21.980 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:16:21 smithi087 ceph-mon[29523]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-05-08T05:16:21.980 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:16:21 smithi087 ceph-mon[29523]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-05-08T05:16:21.980 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:16:21 smithi087 ceph-mon[29523]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-05-08T05:16:21.980 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:16:21 smithi087 ceph-mon[29523]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-05-08T05:16:21.980 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:16:21 smithi087 ceph-mon[29523]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-05-08T05:16:21.981 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:16:21 smithi087 ceph-mon[29523]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-05-08T05:16:21.981 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:16:21 smithi087 ceph-mon[29523]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-05-08T05:16:21.981 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:16:21 smithi087 ceph-mon[29523]: rocksdb: Options.table_properties_collectors: CompactOnDeletionCollector (Sliding window size = 32768 Deletion trigger = 16384 Deletion ratio = 0); 2024-05-08T05:16:21.981 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:16:21 smithi087 ceph-mon[29523]: rocksdb: Options.inplace_update_support: 0 2024-05-08T05:16:21.981 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:16:21 smithi087 ceph-mon[29523]: rocksdb: Options.inplace_update_num_locks: 10000 2024-05-08T05:16:21.982 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:16:21 smithi087 ceph-mon[29523]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-05-08T05:16:21.982 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:16:21 smithi087 ceph-mon[29523]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-05-08T05:16:21.982 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:16:21 smithi087 ceph-mon[29523]: rocksdb: Options.memtable_huge_page_size: 0 2024-05-08T05:16:21.982 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:16:21 smithi087 ceph-mon[29523]: rocksdb: Options.bloom_locality: 0 2024-05-08T05:16:21.982 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:16:21 smithi087 ceph-mon[29523]: rocksdb: Options.max_successive_merges: 0 2024-05-08T05:16:21.982 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:16:21 smithi087 ceph-mon[29523]: rocksdb: Options.optimize_filters_for_hits: 0 2024-05-08T05:16:21.983 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:16:21 smithi087 ceph-mon[29523]: rocksdb: Options.paranoid_file_checks: 0 2024-05-08T05:16:21.983 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:16:21 smithi087 ceph-mon[29523]: rocksdb: Options.force_consistency_checks: 1 2024-05-08T05:16:21.983 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:16:21 smithi087 ceph-mon[29523]: rocksdb: Options.report_bg_io_stats: 0 2024-05-08T05:16:21.983 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:16:21 smithi087 ceph-mon[29523]: rocksdb: Options.ttl: 2592000 2024-05-08T05:16:21.983 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:16:21 smithi087 ceph-mon[29523]: rocksdb: Options.periodic_compaction_seconds: 0 2024-05-08T05:16:21.984 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:16:21 smithi087 ceph-mon[29523]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-05-08T05:16:21.984 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:16:21 smithi087 ceph-mon[29523]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-05-08T05:16:21.984 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:16:21 smithi087 ceph-mon[29523]: rocksdb: Options.enable_blob_files: false 2024-05-08T05:16:21.984 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:16:21 smithi087 ceph-mon[29523]: rocksdb: Options.min_blob_size: 0 2024-05-08T05:16:21.984 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:16:21 smithi087 ceph-mon[29523]: rocksdb: Options.blob_file_size: 268435456 2024-05-08T05:16:21.984 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:16:21 smithi087 ceph-mon[29523]: rocksdb: Options.blob_compression_type: NoCompression 2024-05-08T05:16:21.985 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:16:21 smithi087 ceph-mon[29523]: rocksdb: Options.enable_blob_garbage_collection: false 2024-05-08T05:16:21.985 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:16:21 smithi087 ceph-mon[29523]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-05-08T05:16:21.985 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:16:21 smithi087 ceph-mon[29523]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-05-08T05:16:21.985 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:16:21 smithi087 ceph-mon[29523]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-05-08T05:16:21.985 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:16:21 smithi087 ceph-mon[29523]: rocksdb: Options.blob_file_starting_level: 0 2024-05-08T05:16:21.985 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:16:21 smithi087 ceph-mon[29523]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-05-08T05:16:21.985 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:16:21 smithi087 ceph-mon[29523]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 succeeded,manifest_file_number is 10, next_file_number is 12, last_sequence is 5, log_number is 5,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 5 2024-05-08T05:16:21.985 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:16:21 smithi087 ceph-mon[29523]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 5 2024-05-08T05:16:21.985 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:16:21 smithi087 ceph-mon[29523]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: 05586ac2-98d1-4b73-8bc2-3c241959dd85 2024-05-08T05:16:21.985 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:16:21 smithi087 ceph-mon[29523]: rocksdb: EVENT_LOG_v1 {"time_micros": 1715145381683868, "job": 1, "event": "recovery_started", "wal_files": [9]} 2024-05-08T05:16:21.985 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:16:21 smithi087 ceph-mon[29523]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #9 mode 2 2024-05-08T05:16:21.985 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:16:21 smithi087 ceph-mon[29523]: rocksdb: EVENT_LOG_v1 {"time_micros": 1715145381685712, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 13, "file_size": 100171, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 8, "largest_seqno": 326, "table_properties": {"data_size": 98055, "index_size": 308, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 773, "raw_key_size": 14153, "raw_average_key_size": 49, "raw_value_size": 90354, "raw_average_value_size": 317, "num_data_blocks": 12, "num_entries": 285, "num_filter_entries": 285, "num_deletions": 3, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[CompactOnDeletionCollector]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1715145381, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "05586ac2-98d1-4b73-8bc2-3c241959dd85", "db_session_id": "4V1F0WN3CLTCDHZD5W07", "orig_file_number": 13, "seqno_to_time_mapping": "N/A"}} 2024-05-08T05:16:21.985 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:16:21 smithi087 ceph-mon[29523]: rocksdb: EVENT_LOG_v1 {"time_micros": 1715145381685881, "job": 1, "event": "recovery_finished"} 2024-05-08T05:16:21.986 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:16:21 smithi087 ceph-mon[29523]: rocksdb: [db/version_set.cc:5047] Creating manifest 15 2024-05-08T05:16:21.986 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:16:21 smithi087 ceph-mon[29523]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-a/store.db/000009.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-05-08T05:16:21.986 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:16:21 smithi087 ceph-mon[29523]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x55eaa84c8000 2024-05-08T05:16:21.986 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:16:21 smithi087 ceph-mon[29523]: rocksdb: DB pointer 0x55eaa84b4000 2024-05-08T05:16:21.986 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:16:21 smithi087 ceph-mon[29523]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-05-08T05:16:21.986 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:16:21 smithi087 ceph-mon[29523]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-05-08T05:16:21.986 INFO:journalctl@ceph.mon.a.smithi087.stdout: ** DB Stats ** 2024-05-08T05:16:21.986 INFO:journalctl@ceph.mon.a.smithi087.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-05-08T05:16:21.986 INFO:journalctl@ceph.mon.a.smithi087.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-05-08T05:16:21.986 INFO:journalctl@ceph.mon.a.smithi087.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-05-08T05:16:21.986 INFO:journalctl@ceph.mon.a.smithi087.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-05-08T05:16:21.986 INFO:journalctl@ceph.mon.a.smithi087.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-05-08T05:16:21.986 INFO:journalctl@ceph.mon.a.smithi087.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-05-08T05:16:21.987 INFO:journalctl@ceph.mon.a.smithi087.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-05-08T05:16:21.987 INFO:journalctl@ceph.mon.a.smithi087.stdout: 2024-05-08T05:16:21.987 INFO:journalctl@ceph.mon.a.smithi087.stdout: ** Compaction Stats [default] ** 2024-05-08T05:16:21.987 INFO:journalctl@ceph.mon.a.smithi087.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-05-08T05:16:21.987 INFO:journalctl@ceph.mon.a.smithi087.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-05-08T05:16:21.987 INFO:journalctl@ceph.mon.a.smithi087.stdout: L0 2/0 99.68 KB 0.5 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 82.9 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-05-08T05:16:21.987 INFO:journalctl@ceph.mon.a.smithi087.stdout: Sum 2/0 99.68 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 82.9 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-05-08T05:16:21.987 INFO:journalctl@ceph.mon.a.smithi087.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 82.9 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-05-08T05:16:21.987 INFO:journalctl@ceph.mon.a.smithi087.stdout: 2024-05-08T05:16:21.987 INFO:journalctl@ceph.mon.a.smithi087.stdout: ** Compaction Stats [default] ** 2024-05-08T05:16:21.987 INFO:journalctl@ceph.mon.a.smithi087.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-05-08T05:16:21.987 INFO:journalctl@ceph.mon.a.smithi087.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-05-08T05:16:21.987 INFO:journalctl@ceph.mon.a.smithi087.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 82.9 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-05-08T05:16:21.988 INFO:journalctl@ceph.mon.a.smithi087.stdout: 2024-05-08T05:16:21.988 INFO:journalctl@ceph.mon.a.smithi087.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-05-08T05:16:21.988 INFO:journalctl@ceph.mon.a.smithi087.stdout: 2024-05-08T05:16:21.988 INFO:journalctl@ceph.mon.a.smithi087.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-05-08T05:16:21.988 INFO:journalctl@ceph.mon.a.smithi087.stdout: Flush(GB): cumulative 0.000, interval 0.000 2024-05-08T05:16:21.988 INFO:journalctl@ceph.mon.a.smithi087.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-05-08T05:16:21.988 INFO:journalctl@ceph.mon.a.smithi087.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-05-08T05:16:21.988 INFO:journalctl@ceph.mon.a.smithi087.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-05-08T05:16:21.988 INFO:journalctl@ceph.mon.a.smithi087.stdout: AddFile(Keys): cumulative 0, interval 0 2024-05-08T05:16:21.988 INFO:journalctl@ceph.mon.a.smithi087.stdout: Cumulative compaction: 0.00 GB write, 14.56 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-05-08T05:16:21.988 INFO:journalctl@ceph.mon.a.smithi087.stdout: Interval compaction: 0.00 GB write, 14.56 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-05-08T05:16:21.988 INFO:journalctl@ceph.mon.a.smithi087.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-05-08T05:16:21.988 INFO:journalctl@ceph.mon.a.smithi087.stdout: Block cache BinnedLRUCache@0x55eaa83ab1f0#2 capacity: 512.00 MB usage: 1.52 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 1.2e-05 secs_since: 0 2024-05-08T05:16:21.988 INFO:journalctl@ceph.mon.a.smithi087.stdout: Block cache entry stats(count,size,portion): FilterBlock(2,1.02 KB,0.000193715%) IndexBlock(2,0.50 KB,9.53674e-05%) Misc(1,0.00 KB,0%) 2024-05-08T05:16:21.988 INFO:journalctl@ceph.mon.a.smithi087.stdout: 2024-05-08T05:16:21.988 INFO:journalctl@ceph.mon.a.smithi087.stdout: ** File Read Latency Histogram By Level [default] ** 2024-05-08T05:16:21.989 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:16:21 smithi087 ceph-mon[29523]: starting mon.a rank 0 at public addrs [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] at bind addrs [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] mon_data /var/lib/ceph/mon/ceph-a fsid eeeb813e-0cf9-11ef-bc97-c7b262605968 2024-05-08T05:16:21.989 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:16:21 smithi087 ceph-mon[29523]: mon.a@-1(???) e1 preinit fsid eeeb813e-0cf9-11ef-bc97-c7b262605968 2024-05-08T05:16:21.989 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:16:21 smithi087 ceph-mon[29523]: mon.a@-1(???).mds e1 new map 2024-05-08T05:16:21.989 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:16:21 smithi087 ceph-mon[29523]: mon.a@-1(???).mds e1 print_map 2024-05-08T05:16:21.989 INFO:journalctl@ceph.mon.a.smithi087.stdout: e1 2024-05-08T05:16:21.989 INFO:journalctl@ceph.mon.a.smithi087.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-05-08T05:16:21.989 INFO:journalctl@ceph.mon.a.smithi087.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-05-08T05:16:21.989 INFO:journalctl@ceph.mon.a.smithi087.stdout: legacy client fscid: -1 2024-05-08T05:16:21.989 INFO:journalctl@ceph.mon.a.smithi087.stdout: 2024-05-08T05:16:21.989 INFO:journalctl@ceph.mon.a.smithi087.stdout: No filesystems configured 2024-05-08T05:16:21.989 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:16:21 smithi087 ceph-mon[29523]: mon.a@-1(???).osd e1 crush map has features 3314932999778484224, adjusting msgr requires 2024-05-08T05:16:21.989 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:16:21 smithi087 ceph-mon[29523]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-05-08T05:16:21.989 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:16:21 smithi087 ceph-mon[29523]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-05-08T05:16:21.989 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:16:21 smithi087 ceph-mon[29523]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-05-08T05:16:21.989 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:16:21 smithi087 ceph-mon[29523]: mon.a@-1(???).paxosservice(auth 1..2) refresh upgraded, format 0 -> 3 2024-05-08T05:16:21.990 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:16:21 smithi087 bash[29504]: a734a965374b987d174d01573bfbf349ec0955099f881849964b5e9127b3d8ab 2024-05-08T05:16:21.990 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:16:21 smithi087 systemd[1]: Started Ceph mon.a for eeeb813e-0cf9-11ef-bc97-c7b262605968. 2024-05-08T05:16:21.990 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:16:21 smithi087 ceph-mon[29523]: mon.a is new leader, mons a in quorum (ranks 0) 2024-05-08T05:16:21.990 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:16:21 smithi087 ceph-mon[29523]: monmap epoch 1 2024-05-08T05:16:21.990 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:16:21 smithi087 ceph-mon[29523]: fsid eeeb813e-0cf9-11ef-bc97-c7b262605968 2024-05-08T05:16:21.990 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:16:21 smithi087 ceph-mon[29523]: last_changed 2024-05-08T05:16:09.877063+0000 2024-05-08T05:16:21.990 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:16:21 smithi087 ceph-mon[29523]: created 2024-05-08T05:16:09.877063+0000 2024-05-08T05:16:21.990 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:16:21 smithi087 ceph-mon[29523]: min_mon_release 19 (squid) 2024-05-08T05:16:21.990 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:16:21 smithi087 ceph-mon[29523]: election_strategy: 1 2024-05-08T05:16:21.990 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:16:21 smithi087 ceph-mon[29523]: 0: [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] mon.a 2024-05-08T05:16:21.990 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:16:21 smithi087 ceph-mon[29523]: fsmap 2024-05-08T05:16:21.990 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:16:21 smithi087 ceph-mon[29523]: osdmap e1: 0 total, 0 up, 0 in 2024-05-08T05:16:21.990 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:16:21 smithi087 ceph-mon[29523]: mgrmap e1: no daemons active 2024-05-08T05:16:23.157 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:22.377+0000 7f3f4ce00700 1 Processor -- start 2024-05-08T05:16:23.157 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:22.377+0000 7f3f4ce00700 1 -- start start 2024-05-08T05:16:23.157 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:22.378+0000 7f3f4ce00700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3f4807dd50 0x7f3f4807c1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:16:23.158 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:22.378+0000 7f3f4ce00700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f3f4807c780 con 0x7f3f4807dd50 2024-05-08T05:16:23.158 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:22.378+0000 7f3f45e00700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3f4807dd50 0x7f3f4807c1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:16:23.158 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:22.379+0000 7f3f45e00700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3f4807dd50 0x7f3f4807c1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:50834/0 (socket says 172.21.15.87:50834) 2024-05-08T05:16:23.158 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:22.379+0000 7f3f45e00700 1 -- 172.21.15.87:0/2145292436 learned_addr learned my addr 172.21.15.87:0/2145292436 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T05:16:23.158 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:22.379+0000 7f3f45e00700 1 -- 172.21.15.87:0/2145292436 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3f4807c900 con 0x7f3f4807dd50 2024-05-08T05:16:23.158 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:22.379+0000 7f3f45e00700 1 --2- 172.21.15.87:0/2145292436 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3f4807dd50 0x7f3f4807c1b0 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f3f380098a0 tx=0x7f3f38009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=98a5757a4af40d08 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:16:23.158 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:22.380+0000 7f3f44a00700 1 -- 172.21.15.87:0/2145292436 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3f38004160 con 0x7f3f4807dd50 2024-05-08T05:16:23.158 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:22.380+0000 7f3f44a00700 1 -- 172.21.15.87:0/2145292436 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) ==== 1070+0+0 (secure 0 0 0) 0x7f3f38004300 con 0x7f3f4807dd50 2024-05-08T05:16:23.158 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:22.380+0000 7f3f44a00700 1 -- 172.21.15.87:0/2145292436 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3f38011af0 con 0x7f3f4807dd50 2024-05-08T05:16:23.158 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:22.381+0000 7f3f4ce00700 1 -- 172.21.15.87:0/2145292436 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3f4807dd50 msgr2=0x7f3f4807c1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:16:23.158 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:22.381+0000 7f3f4ce00700 1 --2- 172.21.15.87:0/2145292436 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3f4807dd50 0x7f3f4807c1b0 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f3f380098a0 tx=0x7f3f38009bb0 comp rx=0 tx=0).stop 2024-05-08T05:16:23.158 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:22.381+0000 7f3f4ce00700 1 -- 172.21.15.87:0/2145292436 shutdown_connections 2024-05-08T05:16:23.159 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:22.381+0000 7f3f4ce00700 1 --2- 172.21.15.87:0/2145292436 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3f4807dd50 0x7f3f4807c1b0 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:16:23.159 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:22.381+0000 7f3f4ce00700 1 -- 172.21.15.87:0/2145292436 >> 172.21.15.87:0/2145292436 conn(0x7f3f48104560 msgr2=0x7f3f48106980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:16:23.159 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:22.381+0000 7f3f4ce00700 1 -- 172.21.15.87:0/2145292436 shutdown_connections 2024-05-08T05:16:23.159 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:22.381+0000 7f3f4ce00700 1 -- 172.21.15.87:0/2145292436 wait complete. 2024-05-08T05:16:23.159 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:22.382+0000 7f3f4ce00700 1 Processor -- start 2024-05-08T05:16:23.159 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:22.382+0000 7f3f4ce00700 1 -- start start 2024-05-08T05:16:23.159 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:22.382+0000 7f3f4ce00700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3f4807dd50 0x7f3f4819f010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:16:23.159 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:22.382+0000 7f3f4ce00700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f3f4810f510 con 0x7f3f4807dd50 2024-05-08T05:16:23.159 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:22.383+0000 7f3f45e00700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3f4807dd50 0x7f3f4819f010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:16:23.159 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:22.383+0000 7f3f45e00700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3f4807dd50 0x7f3f4819f010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:50846/0 (socket says 172.21.15.87:50846) 2024-05-08T05:16:23.159 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:22.383+0000 7f3f45e00700 1 -- 172.21.15.87:0/1707543832 learned_addr learned my addr 172.21.15.87:0/1707543832 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T05:16:23.159 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:22.383+0000 7f3f45e00700 1 -- 172.21.15.87:0/1707543832 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3f4819f550 con 0x7f3f4807dd50 2024-05-08T05:16:23.160 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:22.384+0000 7f3f45e00700 1 --2- 172.21.15.87:0/1707543832 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3f4807dd50 0x7f3f4819f010 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f3f38009fb0 tx=0x7f3f38011940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:16:23.160 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:22.384+0000 7f3f3ea00700 1 -- 172.21.15.87:0/1707543832 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3f380036a0 con 0x7f3f4807dd50 2024-05-08T05:16:23.160 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:22.384+0000 7f3f3ea00700 1 -- 172.21.15.87:0/1707543832 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) ==== 1070+0+0 (secure 0 0 0) 0x7f3f3801a430 con 0x7f3f4807dd50 2024-05-08T05:16:23.160 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:22.384+0000 7f3f3ea00700 1 -- 172.21.15.87:0/1707543832 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3f38019550 con 0x7f3f4807dd50 2024-05-08T05:16:23.160 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:22.384+0000 7f3f4ce00700 1 -- 172.21.15.87:0/1707543832 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3f4819f7e0 con 0x7f3f4807dd50 2024-05-08T05:16:23.160 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:22.384+0000 7f3f4ce00700 1 -- 172.21.15.87:0/1707543832 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3f481a24d0 con 0x7f3f4807dd50 2024-05-08T05:16:23.160 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:22.385+0000 7f3f3ea00700 1 -- 172.21.15.87:0/1707543832 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f3f38019be0 con 0x7f3f4807dd50 2024-05-08T05:16:23.160 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:22.385+0000 7f3f3ea00700 1 -- 172.21.15.87:0/1707543832 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f3f3802dd50 con 0x7f3f4807dd50 2024-05-08T05:16:23.160 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:22.386+0000 7f3f4ce00700 1 -- 172.21.15.87:0/1707543832 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3f48064b00 con 0x7f3f4807dd50 2024-05-08T05:16:23.160 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:22.391+0000 7f3f3ea00700 1 -- 172.21.15.87:0/1707543832 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73389 (secure 0 0 0) 0x7f3f3801a8e0 con 0x7f3f4807dd50 2024-05-08T05:16:23.160 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:22.469+0000 7f3f4ce00700 1 -- 172.21.15.87:0/1707543832 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command([{prefix=config set, name=public_network}] v 0) -- 0x7f3f481a26a0 con 0x7f3f4807dd50 2024-05-08T05:16:23.160 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:22.472+0000 7f3f3ea00700 1 -- 172.21.15.87:0/1707543832 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{prefix=config set, name=public_network}]=0 v3)=0 v3) ==== 124+0+0 (secure 0 0 0) 0x7f3f38032030 con 0x7f3f4807dd50 2024-05-08T05:16:23.160 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:22.474+0000 7f3f4ce00700 1 -- 172.21.15.87:0/1707543832 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3f4807dd50 msgr2=0x7f3f4819f010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:16:23.161 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:22.474+0000 7f3f4ce00700 1 --2- 172.21.15.87:0/1707543832 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3f4807dd50 0x7f3f4819f010 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f3f38009fb0 tx=0x7f3f38011940 comp rx=0 tx=0).stop 2024-05-08T05:16:23.161 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:22.474+0000 7f3f4ce00700 1 -- 172.21.15.87:0/1707543832 shutdown_connections 2024-05-08T05:16:23.161 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:22.474+0000 7f3f4ce00700 1 --2- 172.21.15.87:0/1707543832 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3f4807dd50 0x7f3f4819f010 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:16:23.161 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:22.474+0000 7f3f4ce00700 1 -- 172.21.15.87:0/1707543832 >> 172.21.15.87:0/1707543832 conn(0x7f3f48104560 msgr2=0x7f3f48104ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:16:23.161 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:22.474+0000 7f3f4ce00700 1 -- 172.21.15.87:0/1707543832 shutdown_connections 2024-05-08T05:16:23.161 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:22.474+0000 7f3f4ce00700 1 -- 172.21.15.87:0/1707543832 wait complete. 2024-05-08T05:16:23.161 INFO:teuthology.orchestra.run.smithi087.stdout:Wrote config to /etc/ceph/ceph.conf 2024-05-08T05:16:23.186 INFO:teuthology.orchestra.run.smithi087.stdout:Wrote keyring to /etc/ceph/ceph.client.admin.keyring 2024-05-08T05:16:23.186 INFO:teuthology.orchestra.run.smithi087.stdout:Creating mgr... 2024-05-08T05:16:23.186 INFO:teuthology.orchestra.run.smithi087.stdout:Verifying port 0.0.0.0:9283 ... 2024-05-08T05:16:23.187 INFO:teuthology.orchestra.run.smithi087.stdout:Verifying port 0.0.0.0:8765 ... 2024-05-08T05:16:23.595 INFO:teuthology.orchestra.run.smithi087.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968@mgr.x 2024-05-08T05:16:23.595 INFO:teuthology.orchestra.run.smithi087.stdout:systemctl: stderr Failed to reset failed state of unit ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968@mgr.x.service: Unit ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968@mgr.x.service not loaded. 2024-05-08T05:16:23.781 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:16:23 smithi087 ceph-mon[29523]: from='client.? 172.21.15.87:0/1707543832' entity='client.admin' 2024-05-08T05:16:23.834 INFO:teuthology.orchestra.run.smithi087.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968.target.wants/ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968@mgr.x.service → /etc/systemd/system/ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968@.service. 2024-05-08T05:16:24.209 INFO:journalctl@ceph.mgr.x.smithi087.stdout:May 08 05:16:23 smithi087 systemd[1]: Starting Ceph mgr.x for eeeb813e-0cf9-11ef-bc97-c7b262605968... 2024-05-08T05:16:24.499 INFO:journalctl@ceph.mgr.x.smithi087.stdout:May 08 05:16:24 smithi087 podman[29751]: 2024-05-08 05:16:24.117255384 +0000 UTC m=+0.033262802 image pull 352576a2df49fbab3aeeba1effbcb7a94815e8fc1f120a55ddc340b4ee63b8ce quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a 2024-05-08T05:16:24.499 INFO:journalctl@ceph.mgr.x.smithi087.stdout:May 08 05:16:24 smithi087 podman[29751]: 2024-05-08 05:16:24.222056322 +0000 UTC m=+0.138063758 container create 5f6ec6edab8d324166b0b30d541025f501361185ddb87d9f9ea0d02c47ca8404 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a, name=ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-mgr-x, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240507, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, RELEASE=wip-57676-3-bee299f) 2024-05-08T05:16:24.499 INFO:journalctl@ceph.mgr.x.smithi087.stdout:May 08 05:16:24 smithi087 podman[29751]: 2024-05-08 05:16:24.433554439 +0000 UTC m=+0.349561888 container init 5f6ec6edab8d324166b0b30d541025f501361185ddb87d9f9ea0d02c47ca8404 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a, name=ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-mgr-x, RELEASE=wip-57676-3-bee299f, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_BRANCH=HEAD, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240507, org.label-schema.schema-version=1.0) 2024-05-08T05:16:24.499 INFO:journalctl@ceph.mgr.x.smithi087.stdout:May 08 05:16:24 smithi087 podman[29751]: 2024-05-08 05:16:24.443354909 +0000 UTC m=+0.359362333 container start 5f6ec6edab8d324166b0b30d541025f501361185ddb87d9f9ea0d02c47ca8404 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a, name=ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-mgr-x, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , RELEASE=wip-57676-3-bee299f, GIT_BRANCH=HEAD, ceph=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240507) 2024-05-08T05:16:24.499 INFO:journalctl@ceph.mgr.x.smithi087.stdout:May 08 05:16:24 smithi087 bash[29751]: 5f6ec6edab8d324166b0b30d541025f501361185ddb87d9f9ea0d02c47ca8404 2024-05-08T05:16:24.530 INFO:teuthology.orchestra.run.smithi087.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-05-08T05:16:24.530 INFO:teuthology.orchestra.run.smithi087.stdout:systemctl: stdout disabled 2024-05-08T05:16:24.546 INFO:teuthology.orchestra.run.smithi087.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-05-08T05:16:24.546 INFO:teuthology.orchestra.run.smithi087.stdout:systemctl: stdout inactive 2024-05-08T05:16:24.546 INFO:teuthology.orchestra.run.smithi087.stdout:firewalld.service is not enabled 2024-05-08T05:16:24.546 INFO:teuthology.orchestra.run.smithi087.stdout:Not possible to enable service . firewalld.service is not available 2024-05-08T05:16:24.563 INFO:teuthology.orchestra.run.smithi087.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-05-08T05:16:24.563 INFO:teuthology.orchestra.run.smithi087.stdout:systemctl: stdout disabled 2024-05-08T05:16:24.579 INFO:teuthology.orchestra.run.smithi087.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-05-08T05:16:24.579 INFO:teuthology.orchestra.run.smithi087.stdout:systemctl: stdout inactive 2024-05-08T05:16:24.579 INFO:teuthology.orchestra.run.smithi087.stdout:firewalld.service is not enabled 2024-05-08T05:16:24.579 INFO:teuthology.orchestra.run.smithi087.stdout:Not possible to open ports <[9283, 8765]>. firewalld.service is not available 2024-05-08T05:16:24.579 INFO:teuthology.orchestra.run.smithi087.stdout:Waiting for mgr to start... 2024-05-08T05:16:24.579 INFO:teuthology.orchestra.run.smithi087.stdout:Waiting for mgr... 2024-05-08T05:16:24.775 INFO:journalctl@ceph.mgr.x.smithi087.stdout:May 08 05:16:24 smithi087 systemd[1]: Started Ceph mgr.x for eeeb813e-0cf9-11ef-bc97-c7b262605968. 2024-05-08T05:16:24.775 INFO:journalctl@ceph.mgr.x.smithi087.stdout:May 08 05:16:24 smithi087 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-mgr-x[29765]: 2024-05-08T05:16:24.677+0000 7f3e27b21200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-05-08T05:16:25.045 INFO:journalctl@ceph.mgr.x.smithi087.stdout:May 08 05:16:24 smithi087 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-mgr-x[29765]: 2024-05-08T05:16:24.933+0000 7f3e27b21200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-05-08T05:16:25.295 INFO:journalctl@ceph.mgr.x.smithi087.stdout:May 08 05:16:25 smithi087 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-mgr-x[29765]: 2024-05-08T05:16:25.068+0000 7f3e27b21200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-05-08T05:16:25.647 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:16:25 smithi087 ceph-mon[29523]: from='client.? 172.21.15.87:0/1207859716' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-05-08T05:16:25.648 INFO:journalctl@ceph.mgr.x.smithi087.stdout:May 08 05:16:25 smithi087 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-mgr-x[29765]: 2024-05-08T05:16:25.525+0000 7f3e27b21200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-05-08T05:16:25.958 INFO:journalctl@ceph.mgr.x.smithi087.stdout:May 08 05:16:25 smithi087 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-mgr-x[29765]: 2024-05-08T05:16:25.699+0000 7f3e27b21200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-05-08T05:16:26.073 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout 2024-05-08T05:16:26.074 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout { 2024-05-08T05:16:26.074 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout "fsid": "eeeb813e-0cf9-11ef-bc97-c7b262605968", 2024-05-08T05:16:26.074 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout "health": { 2024-05-08T05:16:26.074 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-05-08T05:16:26.074 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-05-08T05:16:26.074 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-05-08T05:16:26.074 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout }, 2024-05-08T05:16:26.074 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-05-08T05:16:26.074 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-05-08T05:16:26.074 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout 0 2024-05-08T05:16:26.074 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout ], 2024-05-08T05:16:26.074 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-05-08T05:16:26.074 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout "a" 2024-05-08T05:16:26.075 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout ], 2024-05-08T05:16:26.075 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout "quorum_age": 3, 2024-05-08T05:16:26.075 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout "monmap": { 2024-05-08T05:16:26.075 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-05-08T05:16:26.075 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-05-08T05:16:26.075 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-05-08T05:16:26.075 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout }, 2024-05-08T05:16:26.075 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-05-08T05:16:26.075 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-05-08T05:16:26.075 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-05-08T05:16:26.075 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-05-08T05:16:26.083 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-05-08T05:16:26.083 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-05-08T05:16:26.083 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-05-08T05:16:26.083 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-05-08T05:16:26.083 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout }, 2024-05-08T05:16:26.083 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-05-08T05:16:26.083 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-05-08T05:16:26.083 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-05-08T05:16:26.083 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-05-08T05:16:26.083 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-05-08T05:16:26.084 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-05-08T05:16:26.084 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-05-08T05:16:26.084 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-05-08T05:16:26.084 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-05-08T05:16:26.084 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout }, 2024-05-08T05:16:26.084 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-05-08T05:16:26.084 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-05-08T05:16:26.084 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-05-08T05:16:26.084 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-05-08T05:16:26.084 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout }, 2024-05-08T05:16:26.084 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-05-08T05:16:26.084 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout "available": false, 2024-05-08T05:16:26.084 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-05-08T05:16:26.084 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout "modules": [ 2024-05-08T05:16:26.084 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout "iostat", 2024-05-08T05:16:26.085 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout "nfs", 2024-05-08T05:16:26.085 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout "restful" 2024-05-08T05:16:26.085 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout ], 2024-05-08T05:16:26.085 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout "services": {} 2024-05-08T05:16:26.085 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout }, 2024-05-08T05:16:26.085 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-05-08T05:16:26.085 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-05-08T05:16:26.085 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout "modified": "2024-05-08T05:16:14.984915+0000", 2024-05-08T05:16:26.085 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout "services": {} 2024-05-08T05:16:26.085 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout }, 2024-05-08T05:16:26.085 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-05-08T05:16:26.085 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout } 2024-05-08T05:16:26.085 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:25.200+0000 7fb5fa800700 1 Processor -- start 2024-05-08T05:16:26.085 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:25.200+0000 7fb5fa800700 1 -- start start 2024-05-08T05:16:26.086 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:25.200+0000 7fb5fa800700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb5f4108fa0 0x7fb5f41093c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:16:26.086 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:25.201+0000 7fb5fa800700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fb5f4109990 con 0x7fb5f4108fa0 2024-05-08T05:16:26.086 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:25.201+0000 7fb5f3400700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb5f4108fa0 0x7fb5f41093c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:16:26.086 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:25.201+0000 7fb5f3400700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb5f4108fa0 0x7fb5f41093c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:50880/0 (socket says 172.21.15.87:50880) 2024-05-08T05:16:26.086 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:25.201+0000 7fb5f3400700 1 -- 172.21.15.87:0/3722147382 learned_addr learned my addr 172.21.15.87:0/3722147382 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T05:16:26.086 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:25.202+0000 7fb5f3400700 1 -- 172.21.15.87:0/3722147382 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb5f410a1a0 con 0x7fb5f4108fa0 2024-05-08T05:16:26.086 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:25.202+0000 7fb5f3400700 1 --2- 172.21.15.87:0/3722147382 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb5f4108fa0 0x7fb5f41093c0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7fb5e40098a0 tx=0x7fb5e4009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d4da4d1bbc9308eb server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:16:26.086 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:25.202+0000 7fb5f2000700 1 -- 172.21.15.87:0/3722147382 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb5e4004160 con 0x7fb5f4108fa0 2024-05-08T05:16:26.086 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:25.202+0000 7fb5f2000700 1 -- 172.21.15.87:0/3722147382 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) ==== 1070+0+0 (secure 0 0 0) 0x7fb5e4004300 con 0x7fb5f4108fa0 2024-05-08T05:16:26.086 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:25.202+0000 7fb5f2000700 1 -- 172.21.15.87:0/3722147382 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb5e4011af0 con 0x7fb5f4108fa0 2024-05-08T05:16:26.086 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:25.203+0000 7fb5fa800700 1 -- 172.21.15.87:0/3722147382 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb5f4108fa0 msgr2=0x7fb5f41093c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:16:26.086 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:25.203+0000 7fb5fa800700 1 --2- 172.21.15.87:0/3722147382 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb5f4108fa0 0x7fb5f41093c0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7fb5e40098a0 tx=0x7fb5e4009bb0 comp rx=0 tx=0).stop 2024-05-08T05:16:26.086 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:25.203+0000 7fb5fa800700 1 -- 172.21.15.87:0/3722147382 shutdown_connections 2024-05-08T05:16:26.087 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:25.203+0000 7fb5fa800700 1 --2- 172.21.15.87:0/3722147382 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb5f4108fa0 0x7fb5f41093c0 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:16:26.087 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:25.203+0000 7fb5fa800700 1 -- 172.21.15.87:0/3722147382 >> 172.21.15.87:0/3722147382 conn(0x7fb5f4104560 msgr2=0x7fb5f4106980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:16:26.087 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:25.203+0000 7fb5fa800700 1 -- 172.21.15.87:0/3722147382 shutdown_connections 2024-05-08T05:16:26.087 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:25.203+0000 7fb5fa800700 1 -- 172.21.15.87:0/3722147382 wait complete. 2024-05-08T05:16:26.087 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:25.204+0000 7fb5fa800700 1 Processor -- start 2024-05-08T05:16:26.087 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:25.205+0000 7fb5fa800700 1 -- start start 2024-05-08T05:16:26.087 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:25.205+0000 7fb5fa800700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb5f4108fa0 0x7fb5f419f020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:16:26.087 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:25.205+0000 7fb5fa800700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fb5f410d3d0 con 0x7fb5f4108fa0 2024-05-08T05:16:26.087 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:25.205+0000 7fb5f3400700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb5f4108fa0 0x7fb5f419f020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:16:26.087 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:25.205+0000 7fb5f3400700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb5f4108fa0 0x7fb5f419f020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:50890/0 (socket says 172.21.15.87:50890) 2024-05-08T05:16:26.087 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:25.205+0000 7fb5f3400700 1 -- 172.21.15.87:0/1207859716 learned_addr learned my addr 172.21.15.87:0/1207859716 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T05:16:26.087 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:25.205+0000 7fb5f3400700 1 -- 172.21.15.87:0/1207859716 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb5f419f560 con 0x7fb5f4108fa0 2024-05-08T05:16:26.087 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:25.206+0000 7fb5f3400700 1 --2- 172.21.15.87:0/1207859716 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb5f4108fa0 0x7fb5f419f020 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fb5e40117b0 tx=0x7fb5e4011b70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:16:26.087 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:25.206+0000 7fb5ebe00700 1 -- 172.21.15.87:0/1207859716 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb5e4003af0 con 0x7fb5f4108fa0 2024-05-08T05:16:26.088 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:25.206+0000 7fb5ebe00700 1 -- 172.21.15.87:0/1207859716 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) ==== 1070+0+0 (secure 0 0 0) 0x7fb5e4020070 con 0x7fb5f4108fa0 2024-05-08T05:16:26.088 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:25.206+0000 7fb5fa800700 1 -- 172.21.15.87:0/1207859716 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb5f419f7f0 con 0x7fb5f4108fa0 2024-05-08T05:16:26.088 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:25.206+0000 7fb5ebe00700 1 -- 172.21.15.87:0/1207859716 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb5e4019630 con 0x7fb5f4108fa0 2024-05-08T05:16:26.088 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:25.206+0000 7fb5fa800700 1 -- 172.21.15.87:0/1207859716 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb5f41a24e0 con 0x7fb5f4108fa0 2024-05-08T05:16:26.088 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:25.207+0000 7fb5ebe00700 1 -- 172.21.15.87:0/1207859716 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fb5e4019c30 con 0x7fb5f4108fa0 2024-05-08T05:16:26.088 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:25.207+0000 7fb5ebe00700 1 -- 172.21.15.87:0/1207859716 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fb5e400b720 con 0x7fb5f4108fa0 2024-05-08T05:16:26.088 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:25.207+0000 7fb5fa800700 1 -- 172.21.15.87:0/1207859716 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb5f410d550 con 0x7fb5f4108fa0 2024-05-08T05:16:26.088 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:25.210+0000 7fb5ebe00700 1 -- 172.21.15.87:0/1207859716 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73389 (secure 0 0 0) 0x7fb5e40042a0 con 0x7fb5f4108fa0 2024-05-08T05:16:26.088 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:25.290+0000 7fb5fa800700 1 -- 172.21.15.87:0/1207859716 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7fb5f41a2a10 con 0x7fb5f4108fa0 2024-05-08T05:16:26.088 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:25.290+0000 7fb5ebe00700 1 -- 172.21.15.87:0/1207859716 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+1239 (secure 0 0 0) 0x7fb5e401a9c0 con 0x7fb5f4108fa0 2024-05-08T05:16:26.088 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:25.292+0000 7fb5fa800700 1 -- 172.21.15.87:0/1207859716 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb5f4108fa0 msgr2=0x7fb5f419f020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:16:26.088 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:25.292+0000 7fb5fa800700 1 --2- 172.21.15.87:0/1207859716 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb5f4108fa0 0x7fb5f419f020 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fb5e40117b0 tx=0x7fb5e4011b70 comp rx=0 tx=0).stop 2024-05-08T05:16:26.088 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:25.292+0000 7fb5fa800700 1 -- 172.21.15.87:0/1207859716 shutdown_connections 2024-05-08T05:16:26.088 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:25.292+0000 7fb5fa800700 1 --2- 172.21.15.87:0/1207859716 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb5f4108fa0 0x7fb5f419f020 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:16:26.089 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:25.292+0000 7fb5fa800700 1 -- 172.21.15.87:0/1207859716 >> 172.21.15.87:0/1207859716 conn(0x7fb5f4104560 msgr2=0x7fb5f4105060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:16:26.089 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:25.293+0000 7fb5fa800700 1 -- 172.21.15.87:0/1207859716 shutdown_connections 2024-05-08T05:16:26.089 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:25.293+0000 7fb5fa800700 1 -- 172.21.15.87:0/1207859716 wait complete. 2024-05-08T05:16:26.089 INFO:teuthology.orchestra.run.smithi087.stdout:mgr not available, waiting (1/15)... 2024-05-08T05:16:27.710 INFO:journalctl@ceph.mgr.x.smithi087.stdout:May 08 05:16:27 smithi087 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-mgr-x[29765]: 2024-05-08T05:16:27.284+0000 7f3e27b21200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-05-08T05:16:27.710 INFO:journalctl@ceph.mgr.x.smithi087.stdout:May 08 05:16:27 smithi087 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-mgr-x[29765]: 2024-05-08T05:16:27.510+0000 7f3e27b21200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-05-08T05:16:28.098 INFO:journalctl@ceph.mgr.x.smithi087.stdout:May 08 05:16:27 smithi087 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-mgr-x[29765]: 2024-05-08T05:16:27.721+0000 7f3e27b21200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-05-08T05:16:28.369 INFO:journalctl@ceph.mgr.x.smithi087.stdout:May 08 05:16:28 smithi087 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-mgr-x[29765]: 2024-05-08T05:16:28.097+0000 7f3e27b21200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-05-08T05:16:28.369 INFO:journalctl@ceph.mgr.x.smithi087.stdout:May 08 05:16:28 smithi087 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-mgr-x[29765]: 2024-05-08T05:16:28.224+0000 7f3e27b21200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-05-08T05:16:28.621 INFO:journalctl@ceph.mgr.x.smithi087.stdout:May 08 05:16:28 smithi087 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-mgr-x[29765]: 2024-05-08T05:16:28.480+0000 7f3e27b21200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-05-08T05:16:28.959 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:16:28 smithi087 ceph-mon[29523]: from='client.? 172.21.15.87:0/3807106164' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-05-08T05:16:28.959 INFO:journalctl@ceph.mgr.x.smithi087.stdout:May 08 05:16:28 smithi087 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-mgr-x[29765]: 2024-05-08T05:16:28.737+0000 7f3e27b21200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-05-08T05:16:29.453 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout 2024-05-08T05:16:29.454 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout { 2024-05-08T05:16:29.454 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout "fsid": "eeeb813e-0cf9-11ef-bc97-c7b262605968", 2024-05-08T05:16:29.455 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout "health": { 2024-05-08T05:16:29.467 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-05-08T05:16:29.468 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-05-08T05:16:29.468 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-05-08T05:16:29.468 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout }, 2024-05-08T05:16:29.468 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-05-08T05:16:29.468 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-05-08T05:16:29.468 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout 0 2024-05-08T05:16:29.468 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout ], 2024-05-08T05:16:29.468 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-05-08T05:16:29.468 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout "a" 2024-05-08T05:16:29.468 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout ], 2024-05-08T05:16:29.468 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout "quorum_age": 7, 2024-05-08T05:16:29.468 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout "monmap": { 2024-05-08T05:16:29.468 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-05-08T05:16:29.468 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-05-08T05:16:29.469 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-05-08T05:16:29.469 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout }, 2024-05-08T05:16:29.469 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-05-08T05:16:29.469 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-05-08T05:16:29.469 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-05-08T05:16:29.469 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-05-08T05:16:29.469 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-05-08T05:16:29.469 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-05-08T05:16:29.469 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-05-08T05:16:29.469 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-05-08T05:16:29.469 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout }, 2024-05-08T05:16:29.469 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-05-08T05:16:29.469 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-05-08T05:16:29.469 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-05-08T05:16:29.470 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-05-08T05:16:29.470 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-05-08T05:16:29.470 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-05-08T05:16:29.470 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-05-08T05:16:29.470 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-05-08T05:16:29.470 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-05-08T05:16:29.470 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout }, 2024-05-08T05:16:29.470 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-05-08T05:16:29.470 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-05-08T05:16:29.470 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-05-08T05:16:29.470 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-05-08T05:16:29.470 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout }, 2024-05-08T05:16:29.470 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-05-08T05:16:29.470 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout "available": false, 2024-05-08T05:16:29.471 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-05-08T05:16:29.471 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout "modules": [ 2024-05-08T05:16:29.471 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout "iostat", 2024-05-08T05:16:29.471 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout "nfs", 2024-05-08T05:16:29.471 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout "restful" 2024-05-08T05:16:29.471 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout ], 2024-05-08T05:16:29.471 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout "services": {} 2024-05-08T05:16:29.471 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout }, 2024-05-08T05:16:29.471 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-05-08T05:16:29.471 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-05-08T05:16:29.471 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout "modified": "2024-05-08T05:16:14.984915+0000", 2024-05-08T05:16:29.471 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout "services": {} 2024-05-08T05:16:29.471 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout }, 2024-05-08T05:16:29.471 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-05-08T05:16:29.471 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout } 2024-05-08T05:16:29.472 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:28.655+0000 7fbee8800700 1 Processor -- start 2024-05-08T05:16:29.472 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:28.655+0000 7fbee8800700 1 -- start start 2024-05-08T05:16:29.472 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:28.655+0000 7fbee8800700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fbee0108fa0 0x7fbee01093c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:16:29.472 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:28.655+0000 7fbee8800700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fbee0109990 con 0x7fbee0108fa0 2024-05-08T05:16:29.472 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:28.656+0000 7fbee5e00700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fbee0108fa0 0x7fbee01093c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:16:29.472 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:28.656+0000 7fbee5e00700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fbee0108fa0 0x7fbee01093c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:56296/0 (socket says 172.21.15.87:56296) 2024-05-08T05:16:29.472 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:28.656+0000 7fbee5e00700 1 -- 172.21.15.87:0/1942104563 learned_addr learned my addr 172.21.15.87:0/1942104563 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T05:16:29.472 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:28.656+0000 7fbee5e00700 1 -- 172.21.15.87:0/1942104563 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbee010a1a0 con 0x7fbee0108fa0 2024-05-08T05:16:29.472 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:28.657+0000 7fbee5e00700 1 --2- 172.21.15.87:0/1942104563 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fbee0108fa0 0x7fbee01093c0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fbed40098a0 tx=0x7fbed4009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3eb18811f7f34ecf server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:16:29.472 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:28.657+0000 7fbee4a00700 1 -- 172.21.15.87:0/1942104563 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbed4004160 con 0x7fbee0108fa0 2024-05-08T05:16:29.472 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:28.657+0000 7fbee4a00700 1 -- 172.21.15.87:0/1942104563 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) ==== 1070+0+0 (secure 0 0 0) 0x7fbed4004300 con 0x7fbee0108fa0 2024-05-08T05:16:29.472 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:28.657+0000 7fbee4a00700 1 -- 172.21.15.87:0/1942104563 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbed4011af0 con 0x7fbee0108fa0 2024-05-08T05:16:29.472 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:28.658+0000 7fbee8800700 1 -- 172.21.15.87:0/1942104563 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fbee0108fa0 msgr2=0x7fbee01093c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:16:29.472 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:28.658+0000 7fbee8800700 1 --2- 172.21.15.87:0/1942104563 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fbee0108fa0 0x7fbee01093c0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fbed40098a0 tx=0x7fbed4009bb0 comp rx=0 tx=0).stop 2024-05-08T05:16:29.473 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:28.658+0000 7fbee8800700 1 -- 172.21.15.87:0/1942104563 shutdown_connections 2024-05-08T05:16:29.473 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:28.658+0000 7fbee8800700 1 --2- 172.21.15.87:0/1942104563 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fbee0108fa0 0x7fbee01093c0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:16:29.473 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:28.658+0000 7fbee8800700 1 -- 172.21.15.87:0/1942104563 >> 172.21.15.87:0/1942104563 conn(0x7fbee0104560 msgr2=0x7fbee0106980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:16:29.473 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:28.658+0000 7fbee8800700 1 -- 172.21.15.87:0/1942104563 shutdown_connections 2024-05-08T05:16:29.473 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:28.658+0000 7fbee8800700 1 -- 172.21.15.87:0/1942104563 wait complete. 2024-05-08T05:16:29.473 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:28.659+0000 7fbee8800700 1 Processor -- start 2024-05-08T05:16:29.473 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:28.659+0000 7fbee8800700 1 -- start start 2024-05-08T05:16:29.473 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:28.659+0000 7fbee8800700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fbee0108fa0 0x7fbee019f040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:16:29.473 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:28.659+0000 7fbee8800700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fbee010d3d0 con 0x7fbee0108fa0 2024-05-08T05:16:29.473 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:28.660+0000 7fbee5e00700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fbee0108fa0 0x7fbee019f040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:16:29.473 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:28.660+0000 7fbee5e00700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fbee0108fa0 0x7fbee019f040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:56308/0 (socket says 172.21.15.87:56308) 2024-05-08T05:16:29.473 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:28.660+0000 7fbee5e00700 1 -- 172.21.15.87:0/3807106164 learned_addr learned my addr 172.21.15.87:0/3807106164 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T05:16:29.473 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:28.660+0000 7fbee5e00700 1 -- 172.21.15.87:0/3807106164 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbee019f580 con 0x7fbee0108fa0 2024-05-08T05:16:29.473 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:28.660+0000 7fbee5e00700 1 --2- 172.21.15.87:0/3807106164 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fbee0108fa0 0x7fbee019f040 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fbed40117b0 tx=0x7fbed4011b70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:16:29.474 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:28.661+0000 7fbedaa00700 1 -- 172.21.15.87:0/3807106164 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbed4003af0 con 0x7fbee0108fa0 2024-05-08T05:16:29.474 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:28.661+0000 7fbedaa00700 1 -- 172.21.15.87:0/3807106164 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) ==== 1070+0+0 (secure 0 0 0) 0x7fbed4020070 con 0x7fbee0108fa0 2024-05-08T05:16:29.474 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:28.661+0000 7fbedaa00700 1 -- 172.21.15.87:0/3807106164 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbed4019630 con 0x7fbee0108fa0 2024-05-08T05:16:29.474 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:28.661+0000 7fbee8800700 1 -- 172.21.15.87:0/3807106164 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbee019f810 con 0x7fbee0108fa0 2024-05-08T05:16:29.474 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:28.661+0000 7fbee8800700 1 -- 172.21.15.87:0/3807106164 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbee01a2500 con 0x7fbee0108fa0 2024-05-08T05:16:29.474 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:28.661+0000 7fbedaa00700 1 -- 172.21.15.87:0/3807106164 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fbed4019c30 con 0x7fbee0108fa0 2024-05-08T05:16:29.474 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:28.661+0000 7fbedaa00700 1 -- 172.21.15.87:0/3807106164 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fbed400b720 con 0x7fbee0108fa0 2024-05-08T05:16:29.474 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:28.662+0000 7fbee8800700 1 -- 172.21.15.87:0/3807106164 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbee010d550 con 0x7fbee0108fa0 2024-05-08T05:16:29.474 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:28.665+0000 7fbedaa00700 1 -- 172.21.15.87:0/3807106164 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73389 (secure 0 0 0) 0x7fbed401a9c0 con 0x7fbee0108fa0 2024-05-08T05:16:29.474 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:28.745+0000 7fbee8800700 1 -- 172.21.15.87:0/3807106164 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7fbee0064b00 con 0x7fbee0108fa0 2024-05-08T05:16:29.474 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:28.746+0000 7fbedaa00700 1 -- 172.21.15.87:0/3807106164 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+1239 (secure 0 0 0) 0x7fbed401a430 con 0x7fbee0108fa0 2024-05-08T05:16:29.474 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:28.747+0000 7fbee8800700 1 -- 172.21.15.87:0/3807106164 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fbee0108fa0 msgr2=0x7fbee019f040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:16:29.474 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:28.747+0000 7fbee8800700 1 --2- 172.21.15.87:0/3807106164 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fbee0108fa0 0x7fbee019f040 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fbed40117b0 tx=0x7fbed4011b70 comp rx=0 tx=0).stop 2024-05-08T05:16:29.474 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:28.747+0000 7fbee8800700 1 -- 172.21.15.87:0/3807106164 shutdown_connections 2024-05-08T05:16:29.474 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:28.747+0000 7fbee8800700 1 --2- 172.21.15.87:0/3807106164 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fbee0108fa0 0x7fbee019f040 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:16:29.475 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:28.747+0000 7fbee8800700 1 -- 172.21.15.87:0/3807106164 >> 172.21.15.87:0/3807106164 conn(0x7fbee0104560 msgr2=0x7fbee0104fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:16:29.475 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:28.747+0000 7fbee8800700 1 -- 172.21.15.87:0/3807106164 shutdown_connections 2024-05-08T05:16:29.475 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:28.747+0000 7fbee8800700 1 -- 172.21.15.87:0/3807106164 wait complete. 2024-05-08T05:16:29.475 INFO:teuthology.orchestra.run.smithi087.stdout:mgr not available, waiting (2/15)... 2024-05-08T05:16:29.708 INFO:journalctl@ceph.mgr.x.smithi087.stdout:May 08 05:16:29 smithi087 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-mgr-x[29765]: 2024-05-08T05:16:29.547+0000 7f3e27b21200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-05-08T05:16:30.209 INFO:journalctl@ceph.mgr.x.smithi087.stdout:May 08 05:16:29 smithi087 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-mgr-x[29765]: 2024-05-08T05:16:29.833+0000 7f3e27b21200 -1 mgr[py] Module smb has missing NOTIFY_TYPES member 2024-05-08T05:16:30.708 INFO:journalctl@ceph.mgr.x.smithi087.stdout:May 08 05:16:30 smithi087 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-mgr-x[29765]: 2024-05-08T05:16:30.383+0000 7f3e27b21200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-05-08T05:16:30.709 INFO:journalctl@ceph.mgr.x.smithi087.stdout:May 08 05:16:30 smithi087 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-mgr-x[29765]: 2024-05-08T05:16:30.510+0000 7f3e27b21200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-05-08T05:16:31.417 INFO:journalctl@ceph.mgr.x.smithi087.stdout:May 08 05:16:30 smithi087 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-mgr-x[29765]: 2024-05-08T05:16:30.968+0000 7f3e27b21200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-05-08T05:16:31.418 INFO:journalctl@ceph.mgr.x.smithi087.stdout:May 08 05:16:31 smithi087 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-mgr-x[29765]: 2024-05-08T05:16:31.416+0000 7f3e27b21200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-05-08T05:16:31.708 INFO:journalctl@ceph.mgr.x.smithi087.stdout:May 08 05:16:31 smithi087 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-mgr-x[29765]: 2024-05-08T05:16:31.541+0000 7f3e27b21200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-05-08T05:16:32.058 INFO:journalctl@ceph.mgr.x.smithi087.stdout:May 08 05:16:31 smithi087 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-mgr-x[29765]: 2024-05-08T05:16:31.871+0000 7f3e27b21200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-05-08T05:16:32.458 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:16:32 smithi087 ceph-mon[29523]: from='client.? 172.21.15.87:0/4225304580' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-05-08T05:16:32.459 INFO:journalctl@ceph.mgr.x.smithi087.stdout:May 08 05:16:32 smithi087 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-mgr-x[29765]: 2024-05-08T05:16:32.057+0000 7f3e27b21200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-05-08T05:16:32.459 INFO:journalctl@ceph.mgr.x.smithi087.stdout:May 08 05:16:32 smithi087 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-mgr-x[29765]: 2024-05-08T05:16:32.193+0000 7f3e27b21200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-05-08T05:16:32.867 INFO:journalctl@ceph.mgr.x.smithi087.stdout:May 08 05:16:32 smithi087 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-mgr-x[29765]: 2024-05-08T05:16:32.616+0000 7f3e27b21200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-05-08T05:16:32.867 INFO:journalctl@ceph.mgr.x.smithi087.stdout:May 08 05:16:32 smithi087 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-mgr-x[29765]: 2024-05-08T05:16:32.740+0000 7f3e27b21200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-05-08T05:16:32.885 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout 2024-05-08T05:16:32.885 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout { 2024-05-08T05:16:32.885 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout "fsid": "eeeb813e-0cf9-11ef-bc97-c7b262605968", 2024-05-08T05:16:32.885 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout "health": { 2024-05-08T05:16:32.885 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-05-08T05:16:32.885 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-05-08T05:16:32.885 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-05-08T05:16:32.885 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout }, 2024-05-08T05:16:32.885 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-05-08T05:16:32.885 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-05-08T05:16:32.885 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout 0 2024-05-08T05:16:32.885 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout ], 2024-05-08T05:16:32.885 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-05-08T05:16:32.886 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout "a" 2024-05-08T05:16:32.886 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout ], 2024-05-08T05:16:32.886 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout "quorum_age": 10, 2024-05-08T05:16:32.886 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout "monmap": { 2024-05-08T05:16:32.886 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-05-08T05:16:32.886 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-05-08T05:16:32.886 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-05-08T05:16:32.886 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout }, 2024-05-08T05:16:32.886 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-05-08T05:16:32.886 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-05-08T05:16:32.886 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-05-08T05:16:32.886 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-05-08T05:16:32.886 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-05-08T05:16:32.894 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-05-08T05:16:32.894 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-05-08T05:16:32.894 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-05-08T05:16:32.894 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout }, 2024-05-08T05:16:32.895 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-05-08T05:16:32.895 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-05-08T05:16:32.895 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-05-08T05:16:32.895 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-05-08T05:16:32.895 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-05-08T05:16:32.895 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-05-08T05:16:32.895 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-05-08T05:16:32.895 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-05-08T05:16:32.895 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-05-08T05:16:32.895 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout }, 2024-05-08T05:16:32.895 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-05-08T05:16:32.895 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-05-08T05:16:32.895 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-05-08T05:16:32.896 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-05-08T05:16:32.896 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout }, 2024-05-08T05:16:32.896 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-05-08T05:16:32.896 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout "available": false, 2024-05-08T05:16:32.896 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-05-08T05:16:32.896 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout "modules": [ 2024-05-08T05:16:32.896 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout "iostat", 2024-05-08T05:16:32.896 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout "nfs", 2024-05-08T05:16:32.896 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout "restful" 2024-05-08T05:16:32.896 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout ], 2024-05-08T05:16:32.896 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout "services": {} 2024-05-08T05:16:32.896 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout }, 2024-05-08T05:16:32.896 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-05-08T05:16:32.896 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-05-08T05:16:32.897 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout "modified": "2024-05-08T05:16:14.984915+0000", 2024-05-08T05:16:32.897 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout "services": {} 2024-05-08T05:16:32.897 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout }, 2024-05-08T05:16:32.897 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-05-08T05:16:32.897 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout } 2024-05-08T05:16:32.897 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:32.067+0000 7fdf80800700 1 Processor -- start 2024-05-08T05:16:32.897 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:32.067+0000 7fdf80800700 1 -- start start 2024-05-08T05:16:32.897 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:32.068+0000 7fdf80800700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fdf7807dd50 0x7fdf7807c1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:16:32.897 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:32.068+0000 7fdf80800700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fdf7807c780 con 0x7fdf7807dd50 2024-05-08T05:16:32.897 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:32.068+0000 7fdf7de00700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fdf7807dd50 0x7fdf7807c1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:16:32.897 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:32.068+0000 7fdf7de00700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fdf7807dd50 0x7fdf7807c1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:56320/0 (socket says 172.21.15.87:56320) 2024-05-08T05:16:32.897 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:32.068+0000 7fdf7de00700 1 -- 172.21.15.87:0/1930171438 learned_addr learned my addr 172.21.15.87:0/1930171438 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T05:16:32.897 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:32.069+0000 7fdf7de00700 1 -- 172.21.15.87:0/1930171438 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdf7807c900 con 0x7fdf7807dd50 2024-05-08T05:16:32.897 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:32.069+0000 7fdf7de00700 1 --2- 172.21.15.87:0/1930171438 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fdf7807dd50 0x7fdf7807c1b0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fdf6c0098a0 tx=0x7fdf6c009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f14f464d51e7c490 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:16:32.897 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:32.069+0000 7fdf7ca00700 1 -- 172.21.15.87:0/1930171438 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdf6c004160 con 0x7fdf7807dd50 2024-05-08T05:16:32.898 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:32.069+0000 7fdf7ca00700 1 -- 172.21.15.87:0/1930171438 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) ==== 1070+0+0 (secure 0 0 0) 0x7fdf6c004300 con 0x7fdf7807dd50 2024-05-08T05:16:32.898 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:32.069+0000 7fdf7ca00700 1 -- 172.21.15.87:0/1930171438 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdf6c011af0 con 0x7fdf7807dd50 2024-05-08T05:16:32.898 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:32.070+0000 7fdf80800700 1 -- 172.21.15.87:0/1930171438 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fdf7807dd50 msgr2=0x7fdf7807c1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:16:32.898 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:32.070+0000 7fdf80800700 1 --2- 172.21.15.87:0/1930171438 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fdf7807dd50 0x7fdf7807c1b0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fdf6c0098a0 tx=0x7fdf6c009bb0 comp rx=0 tx=0).stop 2024-05-08T05:16:32.898 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:32.070+0000 7fdf80800700 1 -- 172.21.15.87:0/1930171438 shutdown_connections 2024-05-08T05:16:32.898 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:32.070+0000 7fdf80800700 1 --2- 172.21.15.87:0/1930171438 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fdf7807dd50 0x7fdf7807c1b0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:16:32.898 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:32.070+0000 7fdf80800700 1 -- 172.21.15.87:0/1930171438 >> 172.21.15.87:0/1930171438 conn(0x7fdf78104560 msgr2=0x7fdf78106980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:16:32.898 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:32.070+0000 7fdf80800700 1 -- 172.21.15.87:0/1930171438 shutdown_connections 2024-05-08T05:16:32.898 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:32.070+0000 7fdf80800700 1 -- 172.21.15.87:0/1930171438 wait complete. 2024-05-08T05:16:32.898 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:32.072+0000 7fdf80800700 1 Processor -- start 2024-05-08T05:16:32.898 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:32.072+0000 7fdf80800700 1 -- start start 2024-05-08T05:16:32.898 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:32.072+0000 7fdf80800700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fdf7807dd50 0x7fdf7819f010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:16:32.898 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:32.072+0000 7fdf80800700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fdf7810f510 con 0x7fdf7807dd50 2024-05-08T05:16:32.898 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:32.073+0000 7fdf7de00700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fdf7807dd50 0x7fdf7819f010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:16:32.899 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:32.073+0000 7fdf7de00700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fdf7807dd50 0x7fdf7819f010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:56336/0 (socket says 172.21.15.87:56336) 2024-05-08T05:16:32.899 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:32.073+0000 7fdf7de00700 1 -- 172.21.15.87:0/4225304580 learned_addr learned my addr 172.21.15.87:0/4225304580 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T05:16:32.899 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:32.073+0000 7fdf7de00700 1 -- 172.21.15.87:0/4225304580 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdf7819f550 con 0x7fdf7807dd50 2024-05-08T05:16:32.899 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:32.073+0000 7fdf7de00700 1 --2- 172.21.15.87:0/4225304580 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fdf7807dd50 0x7fdf7819f010 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fdf6c011ac0 tx=0x7fdf6c011ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:16:32.899 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:32.074+0000 7fdf72a00700 1 -- 172.21.15.87:0/4225304580 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdf6c003970 con 0x7fdf7807dd50 2024-05-08T05:16:32.899 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:32.074+0000 7fdf72a00700 1 -- 172.21.15.87:0/4225304580 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) ==== 1070+0+0 (secure 0 0 0) 0x7fdf6c003b10 con 0x7fdf7807dd50 2024-05-08T05:16:32.899 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:32.074+0000 7fdf80800700 1 -- 172.21.15.87:0/4225304580 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdf7819f7e0 con 0x7fdf7807dd50 2024-05-08T05:16:32.899 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:32.074+0000 7fdf72a00700 1 -- 172.21.15.87:0/4225304580 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdf6c024610 con 0x7fdf7807dd50 2024-05-08T05:16:32.899 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:32.074+0000 7fdf80800700 1 -- 172.21.15.87:0/4225304580 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdf781a24d0 con 0x7fdf7807dd50 2024-05-08T05:16:32.899 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:32.074+0000 7fdf72a00700 1 -- 172.21.15.87:0/4225304580 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fdf6c024bd0 con 0x7fdf7807dd50 2024-05-08T05:16:32.899 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:32.074+0000 7fdf72a00700 1 -- 172.21.15.87:0/4225304580 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fdf6c019700 con 0x7fdf7807dd50 2024-05-08T05:16:32.899 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:32.075+0000 7fdf80800700 1 -- 172.21.15.87:0/4225304580 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdf78064b00 con 0x7fdf7807dd50 2024-05-08T05:16:32.899 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:32.079+0000 7fdf72a00700 1 -- 172.21.15.87:0/4225304580 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73389 (secure 0 0 0) 0x7fdf6c043ec0 con 0x7fdf7807dd50 2024-05-08T05:16:32.899 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:32.158+0000 7fdf80800700 1 -- 172.21.15.87:0/4225304580 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7fdf781a26a0 con 0x7fdf7807dd50 2024-05-08T05:16:32.900 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:32.158+0000 7fdf72a00700 1 -- 172.21.15.87:0/4225304580 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+1240 (secure 0 0 0) 0x7fdf6c032030 con 0x7fdf7807dd50 2024-05-08T05:16:32.900 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:32.160+0000 7fdf80800700 1 -- 172.21.15.87:0/4225304580 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fdf7807dd50 msgr2=0x7fdf7819f010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:16:32.900 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:32.160+0000 7fdf80800700 1 --2- 172.21.15.87:0/4225304580 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fdf7807dd50 0x7fdf7819f010 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fdf6c011ac0 tx=0x7fdf6c011ba0 comp rx=0 tx=0).stop 2024-05-08T05:16:32.900 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:32.160+0000 7fdf80800700 1 -- 172.21.15.87:0/4225304580 shutdown_connections 2024-05-08T05:16:32.900 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:32.160+0000 7fdf80800700 1 --2- 172.21.15.87:0/4225304580 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fdf7807dd50 0x7fdf7819f010 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:16:32.900 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:32.160+0000 7fdf80800700 1 -- 172.21.15.87:0/4225304580 >> 172.21.15.87:0/4225304580 conn(0x7fdf78104560 msgr2=0x7fdf78104ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:16:32.900 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:32.160+0000 7fdf80800700 1 -- 172.21.15.87:0/4225304580 shutdown_connections 2024-05-08T05:16:32.900 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:32.160+0000 7fdf80800700 1 -- 172.21.15.87:0/4225304580 wait complete. 2024-05-08T05:16:32.900 INFO:teuthology.orchestra.run.smithi087.stdout:mgr not available, waiting (3/15)... 2024-05-08T05:16:33.788 INFO:journalctl@ceph.mgr.x.smithi087.stdout:May 08 05:16:33 smithi087 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-mgr-x[29765]: 2024-05-08T05:16:33.503+0000 7f3e27b21200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-05-08T05:16:33.788 INFO:journalctl@ceph.mgr.x.smithi087.stdout:May 08 05:16:33 smithi087 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-mgr-x[29765]: 2024-05-08T05:16:33.786+0000 7f3e27b21200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-05-08T05:16:34.209 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:16:33 smithi087 ceph-mon[29523]: Activating manager daemon x 2024-05-08T05:16:34.209 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:16:33 smithi087 ceph-mon[29523]: mgrmap e2: x(active, starting, since 0.0118422s) 2024-05-08T05:16:34.209 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:16:33 smithi087 ceph-mon[29523]: from='mgr.14100 172.21.15.87:0/2462497695' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-05-08T05:16:34.209 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:16:33 smithi087 ceph-mon[29523]: from='mgr.14100 172.21.15.87:0/2462497695' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-05-08T05:16:34.209 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:16:33 smithi087 ceph-mon[29523]: from='mgr.14100 172.21.15.87:0/2462497695' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-05-08T05:16:34.209 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:16:33 smithi087 ceph-mon[29523]: from='mgr.14100 172.21.15.87:0/2462497695' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-05-08T05:16:34.209 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:16:33 smithi087 ceph-mon[29523]: from='mgr.14100 172.21.15.87:0/2462497695' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-05-08T05:16:34.209 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:16:33 smithi087 ceph-mon[29523]: Manager daemon x is now available 2024-05-08T05:16:34.209 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:16:33 smithi087 ceph-mon[29523]: from='mgr.14100 172.21.15.87:0/2462497695' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-05-08T05:16:34.209 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:16:33 smithi087 ceph-mon[29523]: from='mgr.14100 172.21.15.87:0/2462497695' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-05-08T05:16:34.209 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:16:33 smithi087 ceph-mon[29523]: from='mgr.14100 172.21.15.87:0/2462497695' entity='mgr.x' 2024-05-08T05:16:34.210 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:16:33 smithi087 ceph-mon[29523]: from='mgr.14100 172.21.15.87:0/2462497695' entity='mgr.x' 2024-05-08T05:16:35.208 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:16:34 smithi087 ceph-mon[29523]: from='mgr.14100 172.21.15.87:0/2462497695' entity='mgr.x' 2024-05-08T05:16:35.209 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:16:34 smithi087 ceph-mon[29523]: mgrmap e3: x(active, since 1.02145s) 2024-05-08T05:16:36.487 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout 2024-05-08T05:16:36.487 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout { 2024-05-08T05:16:36.487 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout "fsid": "eeeb813e-0cf9-11ef-bc97-c7b262605968", 2024-05-08T05:16:36.487 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout "health": { 2024-05-08T05:16:36.488 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-05-08T05:16:36.490 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-05-08T05:16:36.490 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-05-08T05:16:36.490 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout }, 2024-05-08T05:16:36.490 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-05-08T05:16:36.490 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-05-08T05:16:36.490 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout 0 2024-05-08T05:16:36.490 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout ], 2024-05-08T05:16:36.490 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-05-08T05:16:36.490 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout "a" 2024-05-08T05:16:36.490 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout ], 2024-05-08T05:16:36.490 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout "quorum_age": 14, 2024-05-08T05:16:36.490 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout "monmap": { 2024-05-08T05:16:36.491 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-05-08T05:16:36.491 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-05-08T05:16:36.491 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-05-08T05:16:36.491 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout }, 2024-05-08T05:16:36.491 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-05-08T05:16:36.491 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-05-08T05:16:36.491 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-05-08T05:16:36.491 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-05-08T05:16:36.498 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-05-08T05:16:36.499 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-05-08T05:16:36.499 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-05-08T05:16:36.499 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-05-08T05:16:36.499 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout }, 2024-05-08T05:16:36.499 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-05-08T05:16:36.499 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-05-08T05:16:36.499 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-05-08T05:16:36.499 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-05-08T05:16:36.499 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-05-08T05:16:36.499 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-05-08T05:16:36.499 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-05-08T05:16:36.499 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-05-08T05:16:36.499 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-05-08T05:16:36.499 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout }, 2024-05-08T05:16:36.500 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-05-08T05:16:36.500 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-05-08T05:16:36.500 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-05-08T05:16:36.500 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-05-08T05:16:36.500 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout }, 2024-05-08T05:16:36.500 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-05-08T05:16:36.500 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout "available": true, 2024-05-08T05:16:36.500 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-05-08T05:16:36.500 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout "modules": [ 2024-05-08T05:16:36.500 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout "iostat", 2024-05-08T05:16:36.500 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout "nfs", 2024-05-08T05:16:36.500 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout "restful" 2024-05-08T05:16:36.500 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout ], 2024-05-08T05:16:36.500 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout "services": {} 2024-05-08T05:16:36.500 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout }, 2024-05-08T05:16:36.501 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-05-08T05:16:36.501 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-05-08T05:16:36.501 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout "modified": "2024-05-08T05:16:14.984915+0000", 2024-05-08T05:16:36.501 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout "services": {} 2024-05-08T05:16:36.501 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout }, 2024-05-08T05:16:36.501 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-05-08T05:16:36.501 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout } 2024-05-08T05:16:36.501 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:35.550+0000 7fe2e3200700 1 Processor -- start 2024-05-08T05:16:36.501 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:35.550+0000 7fe2e3200700 1 -- start start 2024-05-08T05:16:36.501 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:35.551+0000 7fe2e3200700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe2dc108fd0 0x7fe2dc1093f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:16:36.501 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:35.551+0000 7fe2e3200700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fe2dc1099c0 con 0x7fe2dc108fd0 2024-05-08T05:16:36.501 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:35.551+0000 7fe2dbe00700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe2dc108fd0 0x7fe2dc1093f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:16:36.501 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:35.551+0000 7fe2dbe00700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe2dc108fd0 0x7fe2dc1093f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:56404/0 (socket says 172.21.15.87:56404) 2024-05-08T05:16:36.501 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:35.551+0000 7fe2dbe00700 1 -- 172.21.15.87:0/456249718 learned_addr learned my addr 172.21.15.87:0/456249718 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T05:16:36.501 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:35.552+0000 7fe2dbe00700 1 -- 172.21.15.87:0/456249718 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe2dc10a1d0 con 0x7fe2dc108fd0 2024-05-08T05:16:36.502 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:35.552+0000 7fe2dbe00700 1 --2- 172.21.15.87:0/456249718 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe2dc108fd0 0x7fe2dc1093f0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fe2cc0098a0 tx=0x7fe2cc009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a336b6f02d7065fb server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:16:36.502 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:35.552+0000 7fe2daa00700 1 -- 172.21.15.87:0/456249718 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe2cc004160 con 0x7fe2dc108fd0 2024-05-08T05:16:36.502 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:35.552+0000 7fe2daa00700 1 -- 172.21.15.87:0/456249718 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) ==== 1070+0+0 (secure 0 0 0) 0x7fe2cc004300 con 0x7fe2dc108fd0 2024-05-08T05:16:36.502 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:35.552+0000 7fe2daa00700 1 -- 172.21.15.87:0/456249718 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe2cc011af0 con 0x7fe2dc108fd0 2024-05-08T05:16:36.502 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:35.553+0000 7fe2e3200700 1 -- 172.21.15.87:0/456249718 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe2dc108fd0 msgr2=0x7fe2dc1093f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:16:36.502 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:35.553+0000 7fe2e3200700 1 --2- 172.21.15.87:0/456249718 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe2dc108fd0 0x7fe2dc1093f0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fe2cc0098a0 tx=0x7fe2cc009bb0 comp rx=0 tx=0).stop 2024-05-08T05:16:36.502 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:35.553+0000 7fe2e3200700 1 -- 172.21.15.87:0/456249718 shutdown_connections 2024-05-08T05:16:36.502 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:35.553+0000 7fe2e3200700 1 --2- 172.21.15.87:0/456249718 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe2dc108fd0 0x7fe2dc1093f0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:16:36.502 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:35.553+0000 7fe2e3200700 1 -- 172.21.15.87:0/456249718 >> 172.21.15.87:0/456249718 conn(0x7fe2dc1045b0 msgr2=0x7fe2dc1069d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:16:36.502 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:35.553+0000 7fe2e3200700 1 -- 172.21.15.87:0/456249718 shutdown_connections 2024-05-08T05:16:36.502 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:35.553+0000 7fe2e3200700 1 -- 172.21.15.87:0/456249718 wait complete. 2024-05-08T05:16:36.502 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:35.554+0000 7fe2e3200700 1 Processor -- start 2024-05-08T05:16:36.502 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:35.555+0000 7fe2e3200700 1 -- start start 2024-05-08T05:16:36.502 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:35.555+0000 7fe2e3200700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe2dc108fd0 0x7fe2dc19f040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:16:36.502 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:35.555+0000 7fe2e3200700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fe2dc10d400 con 0x7fe2dc108fd0 2024-05-08T05:16:36.503 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:35.555+0000 7fe2dbe00700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe2dc108fd0 0x7fe2dc19f040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:16:36.503 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:35.555+0000 7fe2dbe00700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe2dc108fd0 0x7fe2dc19f040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:56412/0 (socket says 172.21.15.87:56412) 2024-05-08T05:16:36.503 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:35.555+0000 7fe2dbe00700 1 -- 172.21.15.87:0/1076466742 learned_addr learned my addr 172.21.15.87:0/1076466742 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T05:16:36.503 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:35.556+0000 7fe2dbe00700 1 -- 172.21.15.87:0/1076466742 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe2dc19f580 con 0x7fe2dc108fd0 2024-05-08T05:16:36.503 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:35.556+0000 7fe2dbe00700 1 --2- 172.21.15.87:0/1076466742 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe2dc108fd0 0x7fe2dc19f040 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fe2cc0117b0 tx=0x7fe2cc011b70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:16:36.503 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:35.556+0000 7fe2d8c00700 1 -- 172.21.15.87:0/1076466742 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe2cc003af0 con 0x7fe2dc108fd0 2024-05-08T05:16:36.503 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:35.556+0000 7fe2d8c00700 1 -- 172.21.15.87:0/1076466742 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) ==== 1070+0+0 (secure 0 0 0) 0x7fe2cc020070 con 0x7fe2dc108fd0 2024-05-08T05:16:36.503 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:35.556+0000 7fe2e3200700 1 -- 172.21.15.87:0/1076466742 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe2dc19f810 con 0x7fe2dc108fd0 2024-05-08T05:16:36.503 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:35.556+0000 7fe2d8c00700 1 -- 172.21.15.87:0/1076466742 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe2cc019630 con 0x7fe2dc108fd0 2024-05-08T05:16:36.505 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:35.556+0000 7fe2e3200700 1 -- 172.21.15.87:0/1076466742 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe2dc1a2500 con 0x7fe2dc108fd0 2024-05-08T05:16:36.506 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:35.557+0000 7fe2e3200700 1 -- 172.21.15.87:0/1076466742 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe2dc10d580 con 0x7fe2dc108fd0 2024-05-08T05:16:36.506 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:35.558+0000 7fe2d8c00700 1 -- 172.21.15.87:0/1076466742 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 3) ==== 50105+0+0 (secure 0 0 0) 0x7fe2cc01a9c0 con 0x7fe2dc108fd0 2024-05-08T05:16:36.506 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:35.558+0000 7fe2d8c00700 1 --2- 172.21.15.87:0/1076466742 >> [v2:172.21.15.87:6800/1823425617,v1:172.21.15.87:6801/1823425617] conn(0x7fe2c003e3c0 0x7fe2c0040880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:16:36.506 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:35.558+0000 7fe2d8c00700 1 -- 172.21.15.87:0/1076466742 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fe2cc053850 con 0x7fe2dc108fd0 2024-05-08T05:16:36.506 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:35.558+0000 7fe2db400700 1 --2- 172.21.15.87:0/1076466742 >> [v2:172.21.15.87:6800/1823425617,v1:172.21.15.87:6801/1823425617] conn(0x7fe2c003e3c0 0x7fe2c0040880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:16:36.506 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:35.559+0000 7fe2db400700 1 --2- 172.21.15.87:0/1076466742 >> [v2:172.21.15.87:6800/1823425617,v1:172.21.15.87:6801/1823425617] conn(0x7fe2c003e3c0 0x7fe2c0040880 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fe2c8006fd0 tx=0x7fe2c8006e40 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:16:36.506 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:35.565+0000 7fe2d8c00700 1 -- 172.21.15.87:0/1076466742 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7fe2cc0172b0 con 0x7fe2dc108fd0 2024-05-08T05:16:36.506 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:35.853+0000 7fe2d8c00700 1 -- 172.21.15.87:0/1076466742 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mgrmap(e 4) ==== 50211+0+0 (secure 0 0 0) 0x7fe2cc01a430 con 0x7fe2dc108fd0 2024-05-08T05:16:36.506 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:35.888+0000 7fe2e3200700 1 -- 172.21.15.87:0/1076466742 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7fe2dc1a2ab0 con 0x7fe2dc108fd0 2024-05-08T05:16:36.506 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:35.888+0000 7fe2d8c00700 1 -- 172.21.15.87:0/1076466742 <== mon.0 v2:172.21.15.87:3300/0 8 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+1239 (secure 0 0 0) 0x7fe2cc00f2e0 con 0x7fe2dc108fd0 2024-05-08T05:16:36.506 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:35.891+0000 7fe2e3200700 1 -- 172.21.15.87:0/1076466742 >> [v2:172.21.15.87:6800/1823425617,v1:172.21.15.87:6801/1823425617] conn(0x7fe2c003e3c0 msgr2=0x7fe2c0040880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:16:36.506 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:35.891+0000 7fe2e3200700 1 --2- 172.21.15.87:0/1076466742 >> [v2:172.21.15.87:6800/1823425617,v1:172.21.15.87:6801/1823425617] conn(0x7fe2c003e3c0 0x7fe2c0040880 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fe2c8006fd0 tx=0x7fe2c8006e40 comp rx=0 tx=0).stop 2024-05-08T05:16:36.506 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:35.891+0000 7fe2e3200700 1 -- 172.21.15.87:0/1076466742 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe2dc108fd0 msgr2=0x7fe2dc19f040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:16:36.506 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:35.891+0000 7fe2e3200700 1 --2- 172.21.15.87:0/1076466742 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe2dc108fd0 0x7fe2dc19f040 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fe2cc0117b0 tx=0x7fe2cc011b70 comp rx=0 tx=0).stop 2024-05-08T05:16:36.507 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:35.892+0000 7fe2e3200700 1 -- 172.21.15.87:0/1076466742 shutdown_connections 2024-05-08T05:16:36.507 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:35.892+0000 7fe2e3200700 1 --2- 172.21.15.87:0/1076466742 >> [v2:172.21.15.87:6800/1823425617,v1:172.21.15.87:6801/1823425617] conn(0x7fe2c003e3c0 0x7fe2c0040880 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:16:36.507 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:35.892+0000 7fe2e3200700 1 --2- 172.21.15.87:0/1076466742 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe2dc108fd0 0x7fe2dc19f040 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:16:36.507 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:35.892+0000 7fe2e3200700 1 -- 172.21.15.87:0/1076466742 >> 172.21.15.87:0/1076466742 conn(0x7fe2dc1045b0 msgr2=0x7fe2dc105070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:16:36.507 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:35.892+0000 7fe2e3200700 1 -- 172.21.15.87:0/1076466742 shutdown_connections 2024-05-08T05:16:36.507 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:35.892+0000 7fe2e3200700 1 -- 172.21.15.87:0/1076466742 wait complete. 2024-05-08T05:16:36.507 INFO:teuthology.orchestra.run.smithi087.stdout:mgr is available 2024-05-08T05:16:37.067 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:16:36 smithi087 ceph-mon[29523]: mgrmap e4: x(active, since 2s) 2024-05-08T05:16:37.067 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:16:36 smithi087 ceph-mon[29523]: from='client.? 172.21.15.87:0/1076466742' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-05-08T05:16:37.958 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:16:37 smithi087 ceph-mon[29523]: from='client.? 172.21.15.87:0/3393861234' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2024-05-08T05:16:38.063 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout 2024-05-08T05:16:38.063 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout [global] 2024-05-08T05:16:38.063 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout fsid = eeeb813e-0cf9-11ef-bc97-c7b262605968 2024-05-08T05:16:38.063 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout mon_cluster_log_file_level = debug 2024-05-08T05:16:38.063 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2024-05-08T05:16:38.063 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2024-05-08T05:16:38.063 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2024-05-08T05:16:38.063 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2024-05-08T05:16:38.063 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout 2024-05-08T05:16:38.063 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout [mgr] 2024-05-08T05:16:38.063 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2024-05-08T05:16:38.064 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout 2024-05-08T05:16:38.064 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout [osd] 2024-05-08T05:16:38.064 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout bdev_async_discard = True 2024-05-08T05:16:38.064 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2024-05-08T05:16:38.064 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2024-05-08T05:16:38.064 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2024-05-08T05:16:38.064 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2024-05-08T05:16:38.064 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2024-05-08T05:16:38.064 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:37.130+0000 7f12e0600700 1 Processor -- start 2024-05-08T05:16:38.064 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:37.130+0000 7f12e0600700 1 -- start start 2024-05-08T05:16:38.064 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:37.131+0000 7f12e0600700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f12d8107e80 0x7f12d81082a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:16:38.064 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:37.131+0000 7f12e0600700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f12d81087e0 con 0x7f12d8107e80 2024-05-08T05:16:38.064 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:37.131+0000 7f12ddc00700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f12d8107e80 0x7f12d81082a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:16:38.065 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:37.131+0000 7f12ddc00700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f12d8107e80 0x7f12d81082a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:49436/0 (socket says 172.21.15.87:49436) 2024-05-08T05:16:38.065 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:37.131+0000 7f12ddc00700 1 -- 172.21.15.87:0/1154941970 learned_addr learned my addr 172.21.15.87:0/1154941970 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T05:16:38.065 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:37.132+0000 7f12ddc00700 1 -- 172.21.15.87:0/1154941970 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f12d8108fe0 con 0x7f12d8107e80 2024-05-08T05:16:38.065 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:37.132+0000 7f12ddc00700 1 --2- 172.21.15.87:0/1154941970 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f12d8107e80 0x7f12d81082a0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f12cc0098a0 tx=0x7f12cc009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=93e4f13ae7a14f4d server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:16:38.065 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:37.132+0000 7f12d7e00700 1 -- 172.21.15.87:0/1154941970 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f12cc004160 con 0x7f12d8107e80 2024-05-08T05:16:38.065 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:37.133+0000 7f12d7e00700 1 -- 172.21.15.87:0/1154941970 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) ==== 1070+0+0 (secure 0 0 0) 0x7f12cc004300 con 0x7f12d8107e80 2024-05-08T05:16:38.065 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:37.133+0000 7f12d7e00700 1 -- 172.21.15.87:0/1154941970 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f12cc011af0 con 0x7f12d8107e80 2024-05-08T05:16:38.065 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:37.133+0000 7f12e0600700 1 -- 172.21.15.87:0/1154941970 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f12d8107e80 msgr2=0x7f12d81082a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:16:38.065 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:37.133+0000 7f12e0600700 1 --2- 172.21.15.87:0/1154941970 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f12d8107e80 0x7f12d81082a0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f12cc0098a0 tx=0x7f12cc009bb0 comp rx=0 tx=0).stop 2024-05-08T05:16:38.065 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:37.133+0000 7f12e0600700 1 -- 172.21.15.87:0/1154941970 shutdown_connections 2024-05-08T05:16:38.065 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:37.133+0000 7f12e0600700 1 --2- 172.21.15.87:0/1154941970 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f12d8107e80 0x7f12d81082a0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:16:38.065 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:37.133+0000 7f12e0600700 1 -- 172.21.15.87:0/1154941970 >> 172.21.15.87:0/1154941970 conn(0x7f12d8103480 msgr2=0x7f12d81058a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:16:38.065 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:37.133+0000 7f12e0600700 1 -- 172.21.15.87:0/1154941970 shutdown_connections 2024-05-08T05:16:38.066 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:37.133+0000 7f12e0600700 1 -- 172.21.15.87:0/1154941970 wait complete. 2024-05-08T05:16:38.066 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:37.134+0000 7f12e0600700 1 Processor -- start 2024-05-08T05:16:38.066 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:37.135+0000 7f12e0600700 1 -- start start 2024-05-08T05:16:38.066 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:37.135+0000 7f12e0600700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f12d8107e80 0x7f12d819f050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:16:38.066 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:37.135+0000 7f12e0600700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f12d810c2a0 con 0x7f12d8107e80 2024-05-08T05:16:38.066 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:37.135+0000 7f12ddc00700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f12d8107e80 0x7f12d819f050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:16:38.066 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:37.135+0000 7f12ddc00700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f12d8107e80 0x7f12d819f050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:49448/0 (socket says 172.21.15.87:49448) 2024-05-08T05:16:38.066 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:37.135+0000 7f12ddc00700 1 -- 172.21.15.87:0/3393861234 learned_addr learned my addr 172.21.15.87:0/3393861234 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T05:16:38.066 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:37.136+0000 7f12ddc00700 1 -- 172.21.15.87:0/3393861234 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f12d819f590 con 0x7f12d8107e80 2024-05-08T05:16:38.066 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:37.136+0000 7f12ddc00700 1 --2- 172.21.15.87:0/3393861234 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f12d8107e80 0x7f12d819f050 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f12cc011ac0 tx=0x7f12cc011ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:16:38.066 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:37.136+0000 7f12d6000700 1 -- 172.21.15.87:0/3393861234 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f12cc0039e0 con 0x7f12d8107e80 2024-05-08T05:16:38.066 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:37.136+0000 7f12d6000700 1 -- 172.21.15.87:0/3393861234 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) ==== 1070+0+0 (secure 0 0 0) 0x7f12cc003b80 con 0x7f12d8107e80 2024-05-08T05:16:38.066 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:37.136+0000 7f12d6000700 1 -- 172.21.15.87:0/3393861234 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f12cc0246c0 con 0x7f12d8107e80 2024-05-08T05:16:38.066 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:37.136+0000 7f12e0600700 1 -- 172.21.15.87:0/3393861234 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f12d819f820 con 0x7f12d8107e80 2024-05-08T05:16:38.067 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:37.136+0000 7f12e0600700 1 -- 172.21.15.87:0/3393861234 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f12d81a2510 con 0x7f12d8107e80 2024-05-08T05:16:38.067 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:37.138+0000 7f12d6000700 1 -- 172.21.15.87:0/3393861234 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 4) ==== 50211+0+0 (secure 0 0 0) 0x7f12cc022020 con 0x7f12d8107e80 2024-05-08T05:16:38.067 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:37.138+0000 7f12e0600700 1 -- 172.21.15.87:0/3393861234 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f12d8064b00 con 0x7f12d8107e80 2024-05-08T05:16:38.067 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:37.138+0000 7f12d6000700 1 --2- 172.21.15.87:0/3393861234 >> [v2:172.21.15.87:6800/1823425617,v1:172.21.15.87:6801/1823425617] conn(0x7f12c003e530 0x7f12c00409f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:16:38.067 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:37.138+0000 7f12d6000700 1 -- 172.21.15.87:0/3393861234 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f12cc053380 con 0x7f12d8107e80 2024-05-08T05:16:38.067 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:37.138+0000 7f12dd200700 1 --2- 172.21.15.87:0/3393861234 >> [v2:172.21.15.87:6800/1823425617,v1:172.21.15.87:6801/1823425617] conn(0x7f12c003e530 0x7f12c00409f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:16:38.067 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:37.139+0000 7f12dd200700 1 --2- 172.21.15.87:0/3393861234 >> [v2:172.21.15.87:6800/1823425617,v1:172.21.15.87:6801/1823425617] conn(0x7f12c003e530 0x7f12c00409f0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f12c4006fd0 tx=0x7f12c4006e40 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:16:38.067 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:37.144+0000 7f12d6000700 1 -- 172.21.15.87:0/3393861234 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f12cc024860 con 0x7f12d8107e80 2024-05-08T05:16:38.067 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:37.371+0000 7f12e0600700 1 -- 172.21.15.87:0/3393861234 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "config assimilate-conf"} v 0) -- 0x7f12d80008d0 con 0x7f12d8107e80 2024-05-08T05:16:38.067 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:37.373+0000 7f12d6000700 1 -- 172.21.15.87:0/3393861234 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "config assimilate-conf"}]=0 v3) ==== 70+0+436 (secure 0 0 0) 0x7f12cc02ca00 con 0x7f12d8107e80 2024-05-08T05:16:38.067 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:37.377+0000 7f12e0600700 1 -- 172.21.15.87:0/3393861234 >> [v2:172.21.15.87:6800/1823425617,v1:172.21.15.87:6801/1823425617] conn(0x7f12c003e530 msgr2=0x7f12c00409f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:16:38.067 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:37.377+0000 7f12e0600700 1 --2- 172.21.15.87:0/3393861234 >> [v2:172.21.15.87:6800/1823425617,v1:172.21.15.87:6801/1823425617] conn(0x7f12c003e530 0x7f12c00409f0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f12c4006fd0 tx=0x7f12c4006e40 comp rx=0 tx=0).stop 2024-05-08T05:16:38.067 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:37.377+0000 7f12e0600700 1 -- 172.21.15.87:0/3393861234 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f12d8107e80 msgr2=0x7f12d819f050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:16:38.067 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:37.377+0000 7f12e0600700 1 --2- 172.21.15.87:0/3393861234 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f12d8107e80 0x7f12d819f050 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f12cc011ac0 tx=0x7f12cc011ba0 comp rx=0 tx=0).stop 2024-05-08T05:16:38.068 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:37.377+0000 7f12e0600700 1 -- 172.21.15.87:0/3393861234 shutdown_connections 2024-05-08T05:16:38.068 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:37.377+0000 7f12e0600700 1 --2- 172.21.15.87:0/3393861234 >> [v2:172.21.15.87:6800/1823425617,v1:172.21.15.87:6801/1823425617] conn(0x7f12c003e530 0x7f12c00409f0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:16:38.068 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:37.377+0000 7f12e0600700 1 --2- 172.21.15.87:0/3393861234 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f12d8107e80 0x7f12d819f050 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:16:38.068 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:37.377+0000 7f12e0600700 1 -- 172.21.15.87:0/3393861234 >> 172.21.15.87:0/3393861234 conn(0x7f12d8103480 msgr2=0x7f12d8104270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:16:38.068 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:37.377+0000 7f12e0600700 1 -- 172.21.15.87:0/3393861234 shutdown_connections 2024-05-08T05:16:38.068 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:37.377+0000 7f12e0600700 1 -- 172.21.15.87:0/3393861234 wait complete. 2024-05-08T05:16:38.068 INFO:teuthology.orchestra.run.smithi087.stdout:Enabling cephadm module... 2024-05-08T05:16:39.309 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:16:39 smithi087 ceph-mon[29523]: from='client.? 172.21.15.87:0/439915487' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "cephadm"}]: dispatch 2024-05-08T05:16:39.310 INFO:journalctl@ceph.mgr.x.smithi087.stdout:May 08 05:16:39 smithi087 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-mgr-x[29765]: ignoring --setuser ceph since I am not root 2024-05-08T05:16:39.310 INFO:journalctl@ceph.mgr.x.smithi087.stdout:May 08 05:16:39 smithi087 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-mgr-x[29765]: ignoring --setgroup ceph since I am not root 2024-05-08T05:16:39.310 INFO:journalctl@ceph.mgr.x.smithi087.stdout:May 08 05:16:39 smithi087 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-mgr-x[29765]: 2024-05-08T05:16:39.308+0000 7ff190479200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-05-08T05:16:39.681 INFO:journalctl@ceph.mgr.x.smithi087.stdout:May 08 05:16:39 smithi087 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-mgr-x[29765]: 2024-05-08T05:16:39.549+0000 7ff190479200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-05-08T05:16:39.681 INFO:journalctl@ceph.mgr.x.smithi087.stdout:May 08 05:16:39 smithi087 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-mgr-x[29765]: 2024-05-08T05:16:39.680+0000 7ff190479200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-05-08T05:16:39.717 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:38.660+0000 7f5c00600700 1 Processor -- start 2024-05-08T05:16:39.718 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:38.660+0000 7f5c00600700 1 -- start start 2024-05-08T05:16:39.718 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:38.661+0000 7f5c00600700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5bf810fe80 0x7f5bf8112270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:16:39.718 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:38.661+0000 7f5c00600700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f5bf8112840 con 0x7f5bf810fe80 2024-05-08T05:16:39.718 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:38.661+0000 7f5bfdc00700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5bf810fe80 0x7f5bf8112270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:16:39.718 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:38.662+0000 7f5bfdc00700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5bf810fe80 0x7f5bf8112270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:49464/0 (socket says 172.21.15.87:49464) 2024-05-08T05:16:39.718 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:38.662+0000 7f5bfdc00700 1 -- 172.21.15.87:0/2709311255 learned_addr learned my addr 172.21.15.87:0/2709311255 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T05:16:39.718 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:38.662+0000 7f5bfdc00700 1 -- 172.21.15.87:0/2709311255 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5bf81129c0 con 0x7f5bf810fe80 2024-05-08T05:16:39.718 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:38.663+0000 7f5bfdc00700 1 --2- 172.21.15.87:0/2709311255 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5bf810fe80 0x7f5bf8112270 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f5bec0098a0 tx=0x7f5bec009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8f5a4aeca4730c8 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:16:39.718 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:38.663+0000 7f5bf7e00700 1 -- 172.21.15.87:0/2709311255 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5bec004160 con 0x7f5bf810fe80 2024-05-08T05:16:39.725 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:38.663+0000 7f5bf7e00700 1 -- 172.21.15.87:0/2709311255 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) ==== 1070+0+0 (secure 0 0 0) 0x7f5bec004300 con 0x7f5bf810fe80 2024-05-08T05:16:39.725 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:38.663+0000 7f5bf7e00700 1 -- 172.21.15.87:0/2709311255 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5bec011af0 con 0x7f5bf810fe80 2024-05-08T05:16:39.725 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:38.664+0000 7f5c00600700 1 -- 172.21.15.87:0/2709311255 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5bf810fe80 msgr2=0x7f5bf8112270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:16:39.725 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:38.664+0000 7f5c00600700 1 --2- 172.21.15.87:0/2709311255 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5bf810fe80 0x7f5bf8112270 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f5bec0098a0 tx=0x7f5bec009bb0 comp rx=0 tx=0).stop 2024-05-08T05:16:39.725 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:38.664+0000 7f5c00600700 1 -- 172.21.15.87:0/2709311255 shutdown_connections 2024-05-08T05:16:39.725 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:38.664+0000 7f5c00600700 1 --2- 172.21.15.87:0/2709311255 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5bf810fe80 0x7f5bf8112270 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:16:39.725 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:38.664+0000 7f5c00600700 1 -- 172.21.15.87:0/2709311255 >> 172.21.15.87:0/2709311255 conn(0x7f5bf807e960 msgr2=0x7f5bf8080dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:16:39.725 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:38.664+0000 7f5c00600700 1 -- 172.21.15.87:0/2709311255 shutdown_connections 2024-05-08T05:16:39.725 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:38.664+0000 7f5c00600700 1 -- 172.21.15.87:0/2709311255 wait complete. 2024-05-08T05:16:39.725 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:38.665+0000 7f5c00600700 1 Processor -- start 2024-05-08T05:16:39.725 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:38.665+0000 7f5c00600700 1 -- start start 2024-05-08T05:16:39.725 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:38.666+0000 7f5c00600700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5bf810fe80 0x7f5bf81a3390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:16:39.726 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:38.666+0000 7f5c00600700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f5bf8113910 con 0x7f5bf810fe80 2024-05-08T05:16:39.726 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:38.666+0000 7f5bfdc00700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5bf810fe80 0x7f5bf81a3390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:16:39.726 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:38.666+0000 7f5bfdc00700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5bf810fe80 0x7f5bf81a3390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:49470/0 (socket says 172.21.15.87:49470) 2024-05-08T05:16:39.726 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:38.666+0000 7f5bfdc00700 1 -- 172.21.15.87:0/439915487 learned_addr learned my addr 172.21.15.87:0/439915487 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T05:16:39.726 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:38.667+0000 7f5bfdc00700 1 -- 172.21.15.87:0/439915487 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5bf81a38d0 con 0x7f5bf810fe80 2024-05-08T05:16:39.726 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:38.667+0000 7f5bfdc00700 1 --2- 172.21.15.87:0/439915487 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5bf810fe80 0x7f5bf81a3390 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f5bec009fb0 tx=0x7f5bec011940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:16:39.726 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:38.667+0000 7f5bf6000700 1 -- 172.21.15.87:0/439915487 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5bec0036a0 con 0x7f5bf810fe80 2024-05-08T05:16:39.726 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:38.667+0000 7f5bf6000700 1 -- 172.21.15.87:0/439915487 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) ==== 1070+0+0 (secure 0 0 0) 0x7f5bec01a430 con 0x7f5bf810fe80 2024-05-08T05:16:39.726 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:38.667+0000 7f5bf6000700 1 -- 172.21.15.87:0/439915487 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5bec019550 con 0x7f5bf810fe80 2024-05-08T05:16:39.726 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:38.667+0000 7f5c00600700 1 -- 172.21.15.87:0/439915487 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5bf81a3b60 con 0x7f5bf810fe80 2024-05-08T05:16:39.726 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:38.667+0000 7f5c00600700 1 -- 172.21.15.87:0/439915487 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5bf81a6850 con 0x7f5bf810fe80 2024-05-08T05:16:39.726 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:38.669+0000 7f5c00600700 1 -- 172.21.15.87:0/439915487 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5bf8064b00 con 0x7f5bf810fe80 2024-05-08T05:16:39.726 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:38.669+0000 7f5bf6000700 1 -- 172.21.15.87:0/439915487 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 4) ==== 50211+0+0 (secure 0 0 0) 0x7f5bec003840 con 0x7f5bf810fe80 2024-05-08T05:16:39.727 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:38.669+0000 7f5bf6000700 1 --2- 172.21.15.87:0/439915487 >> [v2:172.21.15.87:6800/1823425617,v1:172.21.15.87:6801/1823425617] conn(0x7f5be003e4e0 0x7f5be00409a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:16:39.727 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:38.669+0000 7f5bf6000700 1 -- 172.21.15.87:0/439915487 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f5bec0537d0 con 0x7f5bf810fe80 2024-05-08T05:16:39.727 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:38.669+0000 7f5bfd200700 1 --2- 172.21.15.87:0/439915487 >> [v2:172.21.15.87:6800/1823425617,v1:172.21.15.87:6801/1823425617] conn(0x7f5be003e4e0 0x7f5be00409a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:16:39.727 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:38.670+0000 7f5bfd200700 1 --2- 172.21.15.87:0/439915487 >> [v2:172.21.15.87:6800/1823425617,v1:172.21.15.87:6801/1823425617] conn(0x7f5be003e4e0 0x7f5be00409a0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f5be4006fd0 tx=0x7f5be4006e40 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:16:39.727 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:38.675+0000 7f5bf6000700 1 -- 172.21.15.87:0/439915487 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f5bec00b3e0 con 0x7f5bf810fe80 2024-05-08T05:16:39.727 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:38.971+0000 7f5c00600700 1 -- 172.21.15.87:0/439915487 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "cephadm"} v 0) -- 0x7f5bf81a6a20 con 0x7f5bf810fe80 2024-05-08T05:16:39.727 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:39.025+0000 7f5bf6000700 1 -- 172.21.15.87:0/439915487 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "cephadm"}]=0 v5) ==== 86+0+0 (secure 0 0 0) 0x7f5bf81a6a20 con 0x7f5bf810fe80 2024-05-08T05:16:39.727 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:39.028+0000 7f5bf6000700 1 -- 172.21.15.87:0/439915487 <== mon.0 v2:172.21.15.87:3300/0 8 ==== mgrmap(e 5) ==== 50222+0+0 (secure 0 0 0) 0x7f5bec01a5e0 con 0x7f5bf810fe80 2024-05-08T05:16:39.727 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:39.029+0000 7f5c00600700 1 -- 172.21.15.87:0/439915487 >> [v2:172.21.15.87:6800/1823425617,v1:172.21.15.87:6801/1823425617] conn(0x7f5be003e4e0 msgr2=0x7f5be00409a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:16:39.727 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:39.029+0000 7f5c00600700 1 --2- 172.21.15.87:0/439915487 >> [v2:172.21.15.87:6800/1823425617,v1:172.21.15.87:6801/1823425617] conn(0x7f5be003e4e0 0x7f5be00409a0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f5be4006fd0 tx=0x7f5be4006e40 comp rx=0 tx=0).stop 2024-05-08T05:16:39.727 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:39.029+0000 7f5c00600700 1 -- 172.21.15.87:0/439915487 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5bf810fe80 msgr2=0x7f5bf81a3390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:16:39.727 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:39.029+0000 7f5c00600700 1 --2- 172.21.15.87:0/439915487 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5bf810fe80 0x7f5bf81a3390 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f5bec009fb0 tx=0x7f5bec011940 comp rx=0 tx=0).stop 2024-05-08T05:16:39.727 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:39.029+0000 7f5c00600700 1 -- 172.21.15.87:0/439915487 shutdown_connections 2024-05-08T05:16:39.727 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:39.029+0000 7f5c00600700 1 --2- 172.21.15.87:0/439915487 >> [v2:172.21.15.87:6800/1823425617,v1:172.21.15.87:6801/1823425617] conn(0x7f5be003e4e0 0x7f5be00409a0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:16:39.728 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:39.029+0000 7f5c00600700 1 --2- 172.21.15.87:0/439915487 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5bf810fe80 0x7f5bf81a3390 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:16:39.728 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:39.029+0000 7f5c00600700 1 -- 172.21.15.87:0/439915487 >> 172.21.15.87:0/439915487 conn(0x7f5bf807e960 msgr2=0x7f5bf8080410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:16:39.728 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:39.029+0000 7f5c00600700 1 -- 172.21.15.87:0/439915487 shutdown_connections 2024-05-08T05:16:39.728 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:39.029+0000 7f5c00600700 1 -- 172.21.15.87:0/439915487 wait complete. 2024-05-08T05:16:40.303 INFO:journalctl@ceph.mgr.x.smithi087.stdout:May 08 05:16:40 smithi087 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-mgr-x[29765]: 2024-05-08T05:16:40.096+0000 7ff190479200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-05-08T05:16:40.303 INFO:journalctl@ceph.mgr.x.smithi087.stdout:May 08 05:16:40 smithi087 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-mgr-x[29765]: 2024-05-08T05:16:40.211+0000 7ff190479200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-05-08T05:16:40.303 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:16:40 smithi087 ceph-mon[29523]: from='client.? 172.21.15.87:0/439915487' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "cephadm"}]': finished 2024-05-08T05:16:40.304 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:16:40 smithi087 ceph-mon[29523]: mgrmap e5: x(active, since 5s) 2024-05-08T05:16:41.458 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:16:41 smithi087 ceph-mon[29523]: from='client.? 172.21.15.87:0/2114593853' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2024-05-08T05:16:41.514 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout { 2024-05-08T05:16:41.514 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout "epoch": 5, 2024-05-08T05:16:41.514 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout "available": true, 2024-05-08T05:16:41.514 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout "active_name": "x", 2024-05-08T05:16:41.514 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout "num_standby": 0 2024-05-08T05:16:41.514 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout } 2024-05-08T05:16:41.514 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:40.356+0000 7fd850000700 1 Processor -- start 2024-05-08T05:16:41.514 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:40.356+0000 7fd850000700 1 -- start start 2024-05-08T05:16:41.514 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:40.357+0000 7fd850000700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd84807dd70 0x7fd84807c1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:16:41.515 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:40.357+0000 7fd850000700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fd84807c7a0 con 0x7fd84807dd70 2024-05-08T05:16:41.515 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:40.357+0000 7fd84d600700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd84807dd70 0x7fd84807c1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:16:41.515 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:40.357+0000 7fd84d600700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd84807dd70 0x7fd84807c1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:49508/0 (socket says 172.21.15.87:49508) 2024-05-08T05:16:41.515 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:40.357+0000 7fd84d600700 1 -- 172.21.15.87:0/3658977809 learned_addr learned my addr 172.21.15.87:0/3658977809 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T05:16:41.515 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:40.358+0000 7fd84d600700 1 -- 172.21.15.87:0/3658977809 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd84807c920 con 0x7fd84807dd70 2024-05-08T05:16:41.515 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:40.358+0000 7fd84d600700 1 --2- 172.21.15.87:0/3658977809 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd84807dd70 0x7fd84807c1d0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fd83c0098a0 tx=0x7fd83c009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=644ca08cb44ffd3d server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:16:41.515 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:40.358+0000 7fd847e00700 1 -- 172.21.15.87:0/3658977809 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd83c004160 con 0x7fd84807dd70 2024-05-08T05:16:41.515 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:40.358+0000 7fd847e00700 1 -- 172.21.15.87:0/3658977809 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) ==== 1070+0+0 (secure 0 0 0) 0x7fd83c004300 con 0x7fd84807dd70 2024-05-08T05:16:41.515 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:40.358+0000 7fd847e00700 1 -- 172.21.15.87:0/3658977809 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd83c011af0 con 0x7fd84807dd70 2024-05-08T05:16:41.516 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:40.359+0000 7fd850000700 1 -- 172.21.15.87:0/3658977809 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd84807dd70 msgr2=0x7fd84807c1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:16:41.516 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:40.359+0000 7fd850000700 1 --2- 172.21.15.87:0/3658977809 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd84807dd70 0x7fd84807c1d0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fd83c0098a0 tx=0x7fd83c009bb0 comp rx=0 tx=0).stop 2024-05-08T05:16:41.516 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:40.359+0000 7fd850000700 1 -- 172.21.15.87:0/3658977809 shutdown_connections 2024-05-08T05:16:41.516 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:40.359+0000 7fd850000700 1 --2- 172.21.15.87:0/3658977809 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd84807dd70 0x7fd84807c1d0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:16:41.516 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:40.359+0000 7fd850000700 1 -- 172.21.15.87:0/3658977809 >> 172.21.15.87:0/3658977809 conn(0x7fd848104560 msgr2=0x7fd848106980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:16:41.516 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:40.359+0000 7fd850000700 1 -- 172.21.15.87:0/3658977809 shutdown_connections 2024-05-08T05:16:41.516 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:40.359+0000 7fd850000700 1 -- 172.21.15.87:0/3658977809 wait complete. 2024-05-08T05:16:41.516 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:40.361+0000 7fd850000700 1 Processor -- start 2024-05-08T05:16:41.516 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:40.361+0000 7fd850000700 1 -- start start 2024-05-08T05:16:41.516 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:40.361+0000 7fd850000700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd84807dd70 0x7fd84819f080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:16:41.516 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:40.361+0000 7fd850000700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fd84810f4f0 con 0x7fd84807dd70 2024-05-08T05:16:41.516 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:40.362+0000 7fd84d600700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd84807dd70 0x7fd84819f080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:16:41.516 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:40.362+0000 7fd84d600700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd84807dd70 0x7fd84819f080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:49510/0 (socket says 172.21.15.87:49510) 2024-05-08T05:16:41.516 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:40.362+0000 7fd84d600700 1 -- 172.21.15.87:0/2114593853 learned_addr learned my addr 172.21.15.87:0/2114593853 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T05:16:41.517 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:40.362+0000 7fd84d600700 1 -- 172.21.15.87:0/2114593853 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd84819f5c0 con 0x7fd84807dd70 2024-05-08T05:16:41.517 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:40.362+0000 7fd84d600700 1 --2- 172.21.15.87:0/2114593853 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd84807dd70 0x7fd84819f080 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fd83c0117b0 tx=0x7fd83c011b70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:16:41.517 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:40.363+0000 7fd846000700 1 -- 172.21.15.87:0/2114593853 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd83c003af0 con 0x7fd84807dd70 2024-05-08T05:16:41.517 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:40.363+0000 7fd846000700 1 -- 172.21.15.87:0/2114593853 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) ==== 1070+0+0 (secure 0 0 0) 0x7fd83c020070 con 0x7fd84807dd70 2024-05-08T05:16:41.517 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:40.363+0000 7fd846000700 1 -- 172.21.15.87:0/2114593853 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd83c019630 con 0x7fd84807dd70 2024-05-08T05:16:41.517 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:40.363+0000 7fd850000700 1 -- 172.21.15.87:0/2114593853 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd84819f850 con 0x7fd84807dd70 2024-05-08T05:16:41.518 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:40.363+0000 7fd850000700 1 -- 172.21.15.87:0/2114593853 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd8481a24f0 con 0x7fd84807dd70 2024-05-08T05:16:41.518 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:40.364+0000 7fd850000700 1 -- 172.21.15.87:0/2114593853 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd848064b00 con 0x7fd84807dd70 2024-05-08T05:16:41.518 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:40.364+0000 7fd846000700 1 -- 172.21.15.87:0/2114593853 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 50222+0+0 (secure 0 0 0) 0x7fd83c01a9c0 con 0x7fd84807dd70 2024-05-08T05:16:41.518 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:40.365+0000 7fd846000700 1 --2- 172.21.15.87:0/2114593853 >> [v2:172.21.15.87:6800/1823425617,v1:172.21.15.87:6801/1823425617] conn(0x7fd83003e580 0x7fd830040a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:16:41.518 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:40.365+0000 7fd846000700 1 -- 172.21.15.87:0/2114593853 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fd83c053ab0 con 0x7fd84807dd70 2024-05-08T05:16:41.518 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:40.365+0000 7fd84cc00700 1 -- 172.21.15.87:0/2114593853 >> [v2:172.21.15.87:6800/1823425617,v1:172.21.15.87:6801/1823425617] conn(0x7fd83003e580 msgr2=0x7fd830040a40 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.87:6800/1823425617 2024-05-08T05:16:41.518 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:40.365+0000 7fd84cc00700 1 --2- 172.21.15.87:0/2114593853 >> [v2:172.21.15.87:6800/1823425617,v1:172.21.15.87:6801/1823425617] conn(0x7fd83003e580 0x7fd830040a40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-08T05:16:41.518 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:40.370+0000 7fd846000700 1 -- 172.21.15.87:0/2114593853 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7fd83c0172b0 con 0x7fd84807dd70 2024-05-08T05:16:41.518 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:40.566+0000 7fd84cc00700 1 -- 172.21.15.87:0/2114593853 >> [v2:172.21.15.87:6800/1823425617,v1:172.21.15.87:6801/1823425617] conn(0x7fd83003e580 msgr2=0x7fd830040a40 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.87:6800/1823425617 2024-05-08T05:16:41.518 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:40.566+0000 7fd84cc00700 1 --2- 172.21.15.87:0/2114593853 >> [v2:172.21.15.87:6800/1823425617,v1:172.21.15.87:6801/1823425617] conn(0x7fd83003e580 0x7fd830040a40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-05-08T05:16:41.518 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:40.659+0000 7fd850000700 1 -- 172.21.15.87:0/2114593853 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "mgr stat"} v 0) -- 0x7fd8481a26c0 con 0x7fd84807dd70 2024-05-08T05:16:41.519 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:40.660+0000 7fd846000700 1 -- 172.21.15.87:0/2114593853 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "mgr stat"}]=0 v5) ==== 56+0+88 (secure 0 0 0) 0x7fd8481a26c0 con 0x7fd84807dd70 2024-05-08T05:16:41.519 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:40.663+0000 7fd850000700 1 -- 172.21.15.87:0/2114593853 >> [v2:172.21.15.87:6800/1823425617,v1:172.21.15.87:6801/1823425617] conn(0x7fd83003e580 msgr2=0x7fd830040a40 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-05-08T05:16:41.519 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:40.663+0000 7fd850000700 1 --2- 172.21.15.87:0/2114593853 >> [v2:172.21.15.87:6800/1823425617,v1:172.21.15.87:6801/1823425617] conn(0x7fd83003e580 0x7fd830040a40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:16:41.519 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:40.663+0000 7fd850000700 1 -- 172.21.15.87:0/2114593853 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd84807dd70 msgr2=0x7fd84819f080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:16:41.519 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:40.663+0000 7fd850000700 1 --2- 172.21.15.87:0/2114593853 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd84807dd70 0x7fd84819f080 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fd83c0117b0 tx=0x7fd83c011b70 comp rx=0 tx=0).stop 2024-05-08T05:16:41.519 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:40.663+0000 7fd850000700 1 -- 172.21.15.87:0/2114593853 shutdown_connections 2024-05-08T05:16:41.519 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:40.663+0000 7fd850000700 1 --2- 172.21.15.87:0/2114593853 >> [v2:172.21.15.87:6800/1823425617,v1:172.21.15.87:6801/1823425617] conn(0x7fd83003e580 0x7fd830040a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:16:41.519 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:40.663+0000 7fd850000700 1 --2- 172.21.15.87:0/2114593853 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd84807dd70 0x7fd84819f080 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:16:41.519 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:40.663+0000 7fd850000700 1 -- 172.21.15.87:0/2114593853 >> 172.21.15.87:0/2114593853 conn(0x7fd848104560 msgr2=0x7fd8481050a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:16:41.519 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:40.663+0000 7fd850000700 1 -- 172.21.15.87:0/2114593853 shutdown_connections 2024-05-08T05:16:41.519 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:40.663+0000 7fd850000700 1 -- 172.21.15.87:0/2114593853 wait complete. 2024-05-08T05:16:41.519 INFO:teuthology.orchestra.run.smithi087.stdout:Waiting for the mgr to restart... 2024-05-08T05:16:41.519 INFO:teuthology.orchestra.run.smithi087.stdout:Waiting for mgr epoch 5... 2024-05-08T05:16:42.086 INFO:journalctl@ceph.mgr.x.smithi087.stdout:May 08 05:16:41 smithi087 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-mgr-x[29765]: 2024-05-08T05:16:41.768+0000 7ff190479200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-05-08T05:16:42.086 INFO:journalctl@ceph.mgr.x.smithi087.stdout:May 08 05:16:42 smithi087 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-mgr-x[29765]: 2024-05-08T05:16:42.002+0000 7ff190479200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-05-08T05:16:42.458 INFO:journalctl@ceph.mgr.x.smithi087.stdout:May 08 05:16:42 smithi087 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-mgr-x[29765]: 2024-05-08T05:16:42.221+0000 7ff190479200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-05-08T05:16:42.958 INFO:journalctl@ceph.mgr.x.smithi087.stdout:May 08 05:16:42 smithi087 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-mgr-x[29765]: 2024-05-08T05:16:42.595+0000 7ff190479200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-05-08T05:16:42.958 INFO:journalctl@ceph.mgr.x.smithi087.stdout:May 08 05:16:42 smithi087 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-mgr-x[29765]: 2024-05-08T05:16:42.716+0000 7ff190479200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-05-08T05:16:43.458 INFO:journalctl@ceph.mgr.x.smithi087.stdout:May 08 05:16:42 smithi087 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-mgr-x[29765]: 2024-05-08T05:16:42.967+0000 7ff190479200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-05-08T05:16:43.459 INFO:journalctl@ceph.mgr.x.smithi087.stdout:May 08 05:16:43 smithi087 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-mgr-x[29765]: 2024-05-08T05:16:43.216+0000 7ff190479200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-05-08T05:16:44.285 INFO:journalctl@ceph.mgr.x.smithi087.stdout:May 08 05:16:44 smithi087 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-mgr-x[29765]: 2024-05-08T05:16:43.999+0000 7ff190479200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-05-08T05:16:44.708 INFO:journalctl@ceph.mgr.x.smithi087.stdout:May 08 05:16:44 smithi087 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-mgr-x[29765]: 2024-05-08T05:16:44.283+0000 7ff190479200 -1 mgr[py] Module smb has missing NOTIFY_TYPES member 2024-05-08T05:16:45.130 INFO:journalctl@ceph.mgr.x.smithi087.stdout:May 08 05:16:44 smithi087 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-mgr-x[29765]: 2024-05-08T05:16:44.830+0000 7ff190479200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-05-08T05:16:45.130 INFO:journalctl@ceph.mgr.x.smithi087.stdout:May 08 05:16:44 smithi087 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-mgr-x[29765]: 2024-05-08T05:16:44.955+0000 7ff190479200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-05-08T05:16:45.708 INFO:journalctl@ceph.mgr.x.smithi087.stdout:May 08 05:16:45 smithi087 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-mgr-x[29765]: 2024-05-08T05:16:45.412+0000 7ff190479200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-05-08T05:16:46.208 INFO:journalctl@ceph.mgr.x.smithi087.stdout:May 08 05:16:45 smithi087 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-mgr-x[29765]: 2024-05-08T05:16:45.858+0000 7ff190479200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-05-08T05:16:46.208 INFO:journalctl@ceph.mgr.x.smithi087.stdout:May 08 05:16:45 smithi087 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-mgr-x[29765]: 2024-05-08T05:16:45.980+0000 7ff190479200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-05-08T05:16:46.601 INFO:journalctl@ceph.mgr.x.smithi087.stdout:May 08 05:16:46 smithi087 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-mgr-x[29765]: 2024-05-08T05:16:46.295+0000 7ff190479200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-05-08T05:16:46.602 INFO:journalctl@ceph.mgr.x.smithi087.stdout:May 08 05:16:46 smithi087 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-mgr-x[29765]: 2024-05-08T05:16:46.474+0000 7ff190479200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-05-08T05:16:46.958 INFO:journalctl@ceph.mgr.x.smithi087.stdout:May 08 05:16:46 smithi087 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-mgr-x[29765]: 2024-05-08T05:16:46.599+0000 7ff190479200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-05-08T05:16:47.458 INFO:journalctl@ceph.mgr.x.smithi087.stdout:May 08 05:16:46 smithi087 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-mgr-x[29765]: 2024-05-08T05:16:46.995+0000 7ff190479200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-05-08T05:16:47.458 INFO:journalctl@ceph.mgr.x.smithi087.stdout:May 08 05:16:47 smithi087 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-mgr-x[29765]: 2024-05-08T05:16:47.117+0000 7ff190479200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-05-08T05:16:48.152 INFO:journalctl@ceph.mgr.x.smithi087.stdout:May 08 05:16:47 smithi087 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-mgr-x[29765]: 2024-05-08T05:16:47.863+0000 7ff190479200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-05-08T05:16:48.152 INFO:journalctl@ceph.mgr.x.smithi087.stdout:May 08 05:16:48 smithi087 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-mgr-x[29765]: 2024-05-08T05:16:48.150+0000 7ff190479200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-05-08T05:16:48.459 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:16:48 smithi087 ceph-mon[29523]: Active manager daemon x restarted 2024-05-08T05:16:48.617 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:16:48 smithi087 ceph-mon[29523]: Activating manager daemon x 2024-05-08T05:16:48.618 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:16:48 smithi087 ceph-mon[29523]: osdmap e2: 0 total, 0 up, 0 in 2024-05-08T05:16:48.618 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:16:48 smithi087 ceph-mon[29523]: mgrmap e6: x(active, starting, since 0.00878399s) 2024-05-08T05:16:48.618 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:16:48 smithi087 ceph-mon[29523]: from='mgr.14120 172.21.15.87:0/603415166' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-05-08T05:16:48.618 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:16:48 smithi087 ceph-mon[29523]: from='mgr.14120 172.21.15.87:0/603415166' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-05-08T05:16:48.618 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:16:48 smithi087 ceph-mon[29523]: from='mgr.14120 172.21.15.87:0/603415166' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-05-08T05:16:48.618 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:16:48 smithi087 ceph-mon[29523]: from='mgr.14120 172.21.15.87:0/603415166' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-05-08T05:16:48.618 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:16:48 smithi087 ceph-mon[29523]: from='mgr.14120 172.21.15.87:0/603415166' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-05-08T05:16:48.618 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:16:48 smithi087 ceph-mon[29523]: Manager daemon x is now available 2024-05-08T05:16:49.459 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:16:49 smithi087 ceph-mon[29523]: Found migration_current of "None". Setting to last migration. 2024-05-08T05:16:49.459 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:16:49 smithi087 ceph-mon[29523]: from='mgr.14120 172.21.15.87:0/603415166' entity='mgr.x' 2024-05-08T05:16:49.459 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:16:49 smithi087 ceph-mon[29523]: from='mgr.14120 172.21.15.87:0/603415166' entity='mgr.x' 2024-05-08T05:16:49.459 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:16:49 smithi087 ceph-mon[29523]: from='mgr.14120 172.21.15.87:0/603415166' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T05:16:49.459 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:16:49 smithi087 ceph-mon[29523]: from='mgr.14120 172.21.15.87:0/603415166' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T05:16:49.459 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:16:49 smithi087 ceph-mon[29523]: from='mgr.14120 172.21.15.87:0/603415166' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-05-08T05:16:49.459 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:16:49 smithi087 ceph-mon[29523]: from='mgr.14120 172.21.15.87:0/603415166' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-05-08T05:16:49.459 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:16:49 smithi087 ceph-mon[29523]: from='mgr.14120 172.21.15.87:0/603415166' entity='mgr.x' 2024-05-08T05:16:49.459 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:16:49 smithi087 ceph-mon[29523]: from='mgr.14120 172.21.15.87:0/603415166' entity='mgr.x' 2024-05-08T05:16:49.459 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:16:49 smithi087 ceph-mon[29523]: [08/May/2024:05:16:49] ENGINE Bus STARTING 2024-05-08T05:16:49.459 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:16:49 smithi087 ceph-mon[29523]: mgrmap e7: x(active, since 1.0173s) 2024-05-08T05:16:49.817 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout { 2024-05-08T05:16:49.817 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 7, 2024-05-08T05:16:49.817 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout "initialized": true 2024-05-08T05:16:49.817 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout } 2024-05-08T05:16:49.818 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:42.115+0000 7f3df4400700 1 Processor -- start 2024-05-08T05:16:49.818 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:42.115+0000 7f3df4400700 1 -- start start 2024-05-08T05:16:49.818 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:42.115+0000 7f3df4400700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3dec07dd70 0x7f3dec07c1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:16:49.818 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:42.115+0000 7f3df4400700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f3dec07c7a0 con 0x7f3dec07dd70 2024-05-08T05:16:49.818 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:42.116+0000 7f3df1a00700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3dec07dd70 0x7f3dec07c1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:16:49.818 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:42.116+0000 7f3df1a00700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3dec07dd70 0x7f3dec07c1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:49512/0 (socket says 172.21.15.87:49512) 2024-05-08T05:16:49.818 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:42.116+0000 7f3df1a00700 1 -- 172.21.15.87:0/4239806805 learned_addr learned my addr 172.21.15.87:0/4239806805 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T05:16:49.818 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:42.116+0000 7f3df1a00700 1 -- 172.21.15.87:0/4239806805 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3dec07c920 con 0x7f3dec07dd70 2024-05-08T05:16:49.818 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:42.117+0000 7f3df1a00700 1 --2- 172.21.15.87:0/4239806805 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3dec07dd70 0x7f3dec07c1d0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f3de00098a0 tx=0x7f3de0009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=52332592ef047068 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:16:49.818 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:42.117+0000 7f3debe00700 1 -- 172.21.15.87:0/4239806805 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3de0004160 con 0x7f3dec07dd70 2024-05-08T05:16:49.818 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:42.117+0000 7f3debe00700 1 -- 172.21.15.87:0/4239806805 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) ==== 1070+0+0 (secure 0 0 0) 0x7f3de0004300 con 0x7f3dec07dd70 2024-05-08T05:16:49.818 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:42.117+0000 7f3debe00700 1 -- 172.21.15.87:0/4239806805 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3de0011af0 con 0x7f3dec07dd70 2024-05-08T05:16:49.818 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:42.118+0000 7f3df4400700 1 -- 172.21.15.87:0/4239806805 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3dec07dd70 msgr2=0x7f3dec07c1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:16:49.819 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:42.118+0000 7f3df4400700 1 --2- 172.21.15.87:0/4239806805 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3dec07dd70 0x7f3dec07c1d0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f3de00098a0 tx=0x7f3de0009bb0 comp rx=0 tx=0).stop 2024-05-08T05:16:49.819 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:42.118+0000 7f3df4400700 1 -- 172.21.15.87:0/4239806805 shutdown_connections 2024-05-08T05:16:49.819 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:42.118+0000 7f3df4400700 1 --2- 172.21.15.87:0/4239806805 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3dec07dd70 0x7f3dec07c1d0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:16:49.819 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:42.118+0000 7f3df4400700 1 -- 172.21.15.87:0/4239806805 >> 172.21.15.87:0/4239806805 conn(0x7f3dec104560 msgr2=0x7f3dec106980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:16:49.819 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:42.118+0000 7f3df4400700 1 -- 172.21.15.87:0/4239806805 shutdown_connections 2024-05-08T05:16:49.819 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:42.118+0000 7f3df4400700 1 -- 172.21.15.87:0/4239806805 wait complete. 2024-05-08T05:16:49.819 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:42.119+0000 7f3df4400700 1 Processor -- start 2024-05-08T05:16:49.819 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:42.119+0000 7f3df4400700 1 -- start start 2024-05-08T05:16:49.819 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:42.119+0000 7f3df4400700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3dec07dd70 0x7f3dec19eff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:16:49.824 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:42.119+0000 7f3df4400700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f3dec10f4f0 con 0x7f3dec07dd70 2024-05-08T05:16:49.825 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:42.120+0000 7f3df1a00700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3dec07dd70 0x7f3dec19eff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:16:49.825 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:42.120+0000 7f3df1a00700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3dec07dd70 0x7f3dec19eff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:49524/0 (socket says 172.21.15.87:49524) 2024-05-08T05:16:49.825 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:42.120+0000 7f3df1a00700 1 -- 172.21.15.87:0/3966475874 learned_addr learned my addr 172.21.15.87:0/3966475874 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T05:16:49.825 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:42.120+0000 7f3df1a00700 1 -- 172.21.15.87:0/3966475874 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3dec19f530 con 0x7f3dec07dd70 2024-05-08T05:16:49.825 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:42.120+0000 7f3df1a00700 1 --2- 172.21.15.87:0/3966475874 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3dec07dd70 0x7f3dec19eff0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f3de0009fb0 tx=0x7f3de0011940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:16:49.825 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:42.121+0000 7f3dea000700 1 -- 172.21.15.87:0/3966475874 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3de00036a0 con 0x7f3dec07dd70 2024-05-08T05:16:49.825 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:42.121+0000 7f3dea000700 1 -- 172.21.15.87:0/3966475874 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) ==== 1070+0+0 (secure 0 0 0) 0x7f3de001a430 con 0x7f3dec07dd70 2024-05-08T05:16:49.825 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:42.121+0000 7f3df4400700 1 -- 172.21.15.87:0/3966475874 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3dec19f7c0 con 0x7f3dec07dd70 2024-05-08T05:16:49.825 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:42.121+0000 7f3df4400700 1 -- 172.21.15.87:0/3966475874 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3dec1a24b0 con 0x7f3dec07dd70 2024-05-08T05:16:49.825 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:42.121+0000 7f3dea000700 1 -- 172.21.15.87:0/3966475874 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3de0019550 con 0x7f3dec07dd70 2024-05-08T05:16:49.825 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:42.122+0000 7f3dea000700 1 -- 172.21.15.87:0/3966475874 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 50222+0+0 (secure 0 0 0) 0x7f3de001a8e0 con 0x7f3dec07dd70 2024-05-08T05:16:49.825 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:42.123+0000 7f3dea000700 1 --2- 172.21.15.87:0/3966475874 >> [v2:172.21.15.87:6800/1823425617,v1:172.21.15.87:6801/1823425617] conn(0x7f3dd403e530 0x7f3dd40409f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:16:49.825 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:42.123+0000 7f3dea000700 1 -- 172.21.15.87:0/3966475874 --> [v2:172.21.15.87:6800/1823425617,v1:172.21.15.87:6801/1823425617] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f3dd4041100 con 0x7f3dd403e530 2024-05-08T05:16:49.825 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:42.123+0000 7f3dea000700 1 -- 172.21.15.87:0/3966475874 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f3de0053810 con 0x7f3dec07dd70 2024-05-08T05:16:49.826 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:42.123+0000 7f3df1000700 1 -- 172.21.15.87:0/3966475874 >> [v2:172.21.15.87:6800/1823425617,v1:172.21.15.87:6801/1823425617] conn(0x7f3dd403e530 msgr2=0x7f3dd40409f0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.87:6800/1823425617 2024-05-08T05:16:49.826 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:42.123+0000 7f3df1000700 1 --2- 172.21.15.87:0/3966475874 >> [v2:172.21.15.87:6800/1823425617,v1:172.21.15.87:6801/1823425617] conn(0x7f3dd403e530 0x7f3dd40409f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-08T05:16:49.826 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:42.324+0000 7f3df1000700 1 -- 172.21.15.87:0/3966475874 >> [v2:172.21.15.87:6800/1823425617,v1:172.21.15.87:6801/1823425617] conn(0x7f3dd403e530 msgr2=0x7f3dd40409f0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.87:6800/1823425617 2024-05-08T05:16:49.826 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:42.324+0000 7f3df1000700 1 --2- 172.21.15.87:0/3966475874 >> [v2:172.21.15.87:6800/1823425617,v1:172.21.15.87:6801/1823425617] conn(0x7f3dd403e530 0x7f3dd40409f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-05-08T05:16:49.829 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:42.725+0000 7f3df1000700 1 -- 172.21.15.87:0/3966475874 >> [v2:172.21.15.87:6800/1823425617,v1:172.21.15.87:6801/1823425617] conn(0x7f3dd403e530 msgr2=0x7f3dd40409f0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.87:6800/1823425617 2024-05-08T05:16:49.829 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:42.725+0000 7f3df1000700 1 --2- 172.21.15.87:0/3966475874 >> [v2:172.21.15.87:6800/1823425617,v1:172.21.15.87:6801/1823425617] conn(0x7f3dd403e530 0x7f3dd40409f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-05-08T05:16:49.829 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:43.526+0000 7f3df1000700 1 -- 172.21.15.87:0/3966475874 >> [v2:172.21.15.87:6800/1823425617,v1:172.21.15.87:6801/1823425617] conn(0x7f3dd403e530 msgr2=0x7f3dd40409f0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.87:6800/1823425617 2024-05-08T05:16:49.829 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:43.526+0000 7f3df1000700 1 --2- 172.21.15.87:0/3966475874 >> [v2:172.21.15.87:6800/1823425617,v1:172.21.15.87:6801/1823425617] conn(0x7f3dd403e530 0x7f3dd40409f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-05-08T05:16:49.829 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:45.128+0000 7f3df1000700 1 -- 172.21.15.87:0/3966475874 >> [v2:172.21.15.87:6800/1823425617,v1:172.21.15.87:6801/1823425617] conn(0x7f3dd403e530 msgr2=0x7f3dd40409f0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.87:6800/1823425617 2024-05-08T05:16:49.830 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:45.128+0000 7f3df1000700 1 --2- 172.21.15.87:0/3966475874 >> [v2:172.21.15.87:6800/1823425617,v1:172.21.15.87:6801/1823425617] conn(0x7f3dd403e530 0x7f3dd40409f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 3.200000 2024-05-08T05:16:49.830 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:48.159+0000 7f3dea000700 1 -- 172.21.15.87:0/3966475874 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mgrmap(e 6) ==== 49989+0+0 (secure 0 0 0) 0x7f3de0003840 con 0x7f3dec07dd70 2024-05-08T05:16:49.830 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:48.160+0000 7f3dea000700 1 -- 172.21.15.87:0/3966475874 >> [v2:172.21.15.87:6800/1823425617,v1:172.21.15.87:6801/1823425617] conn(0x7f3dd403e530 msgr2=0x7f3dd40409f0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-05-08T05:16:49.830 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:48.160+0000 7f3dea000700 1 --2- 172.21.15.87:0/3966475874 >> [v2:172.21.15.87:6800/1823425617,v1:172.21.15.87:6801/1823425617] conn(0x7f3dd403e530 0x7f3dd40409f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:16:49.830 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:49.165+0000 7f3dea000700 1 -- 172.21.15.87:0/3966475874 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mgrmap(e 7) ==== 50116+0+0 (secure 0 0 0) 0x7f3de0054fc0 con 0x7f3dec07dd70 2024-05-08T05:16:49.830 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:49.166+0000 7f3dea000700 1 --2- 172.21.15.87:0/3966475874 >> [v2:172.21.15.87:6800/2710124295,v1:172.21.15.87:6801/2710124295] conn(0x7f3dd4041e20 0x7f3dd4044210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:16:49.830 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:49.166+0000 7f3dea000700 1 -- 172.21.15.87:0/3966475874 --> [v2:172.21.15.87:6800/2710124295,v1:172.21.15.87:6801/2710124295] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f3dd4041100 con 0x7f3dd4041e20 2024-05-08T05:16:49.830 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:49.168+0000 7f3df1000700 1 --2- 172.21.15.87:0/3966475874 >> [v2:172.21.15.87:6800/2710124295,v1:172.21.15.87:6801/2710124295] conn(0x7f3dd4041e20 0x7f3dd4044210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:16:49.830 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:49.170+0000 7f3df1000700 1 --2- 172.21.15.87:0/3966475874 >> [v2:172.21.15.87:6800/2710124295,v1:172.21.15.87:6801/2710124295] conn(0x7f3dd4041e20 0x7f3dd4044210 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f3dd8003a10 tx=0x7f3dd80092b0 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:16:49.830 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:49.172+0000 7f3dea000700 1 -- 172.21.15.87:0/3966475874 <== mgr.14120 v2:172.21.15.87:6800/2710124295 1 ==== command_reply(tid 0: 0 ) ==== 8+0+9564 (secure 0 0 0) 0x7f3dd4041100 con 0x7f3dd4041e20 2024-05-08T05:16:49.830 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:49.181+0000 7f3df4400700 1 -- 172.21.15.87:0/3966475874 --> [v2:172.21.15.87:6800/2710124295,v1:172.21.15.87:6801/2710124295] -- command(tid 1: {"prefix": "mgr_status"}) -- 0x7f3dec064b00 con 0x7f3dd4041e20 2024-05-08T05:16:49.830 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:49.182+0000 7f3dea000700 1 -- 172.21.15.87:0/3966475874 <== mgr.14120 v2:172.21.15.87:6800/2710124295 2 ==== command_reply(tid 1: 0 ) ==== 8+0+51 (secure 0 0 0) 0x7f3dec064b00 con 0x7f3dd4041e20 2024-05-08T05:16:49.830 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:49.182+0000 7f3df4400700 1 -- 172.21.15.87:0/3966475874 >> [v2:172.21.15.87:6800/2710124295,v1:172.21.15.87:6801/2710124295] conn(0x7f3dd4041e20 msgr2=0x7f3dd4044210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:16:49.830 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:49.182+0000 7f3df4400700 1 --2- 172.21.15.87:0/3966475874 >> [v2:172.21.15.87:6800/2710124295,v1:172.21.15.87:6801/2710124295] conn(0x7f3dd4041e20 0x7f3dd4044210 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f3dd8003a10 tx=0x7f3dd80092b0 comp rx=0 tx=0).stop 2024-05-08T05:16:49.831 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:49.182+0000 7f3df4400700 1 -- 172.21.15.87:0/3966475874 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3dec07dd70 msgr2=0x7f3dec19eff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:16:49.831 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:49.182+0000 7f3df4400700 1 --2- 172.21.15.87:0/3966475874 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3dec07dd70 0x7f3dec19eff0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f3de0009fb0 tx=0x7f3de0011940 comp rx=0 tx=0).stop 2024-05-08T05:16:49.831 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:49.183+0000 7f3df4400700 1 -- 172.21.15.87:0/3966475874 shutdown_connections 2024-05-08T05:16:49.831 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:49.183+0000 7f3df4400700 1 --2- 172.21.15.87:0/3966475874 >> [v2:172.21.15.87:6800/2710124295,v1:172.21.15.87:6801/2710124295] conn(0x7f3dd4041e20 0x7f3dd4044210 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:16:49.831 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:49.183+0000 7f3df4400700 1 --2- 172.21.15.87:0/3966475874 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3dec07dd70 0x7f3dec19eff0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:16:49.831 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:49.183+0000 7f3df4400700 1 --2- 172.21.15.87:0/3966475874 >> [v2:172.21.15.87:6800/1823425617,v1:172.21.15.87:6801/1823425617] conn(0x7f3dd403e530 0x7f3dd40409f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:16:49.831 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:49.183+0000 7f3df4400700 1 -- 172.21.15.87:0/3966475874 >> 172.21.15.87:0/3966475874 conn(0x7f3dec104560 msgr2=0x7f3dec105080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:16:49.831 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:49.183+0000 7f3df4400700 1 -- 172.21.15.87:0/3966475874 shutdown_connections 2024-05-08T05:16:49.831 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:49.183+0000 7f3df4400700 1 -- 172.21.15.87:0/3966475874 wait complete. 2024-05-08T05:16:49.831 INFO:teuthology.orchestra.run.smithi087.stdout:mgr epoch 5 is available 2024-05-08T05:16:49.831 INFO:teuthology.orchestra.run.smithi087.stdout:Setting orchestrator backend to cephadm... 2024-05-08T05:16:50.376 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:16:50 smithi087 ceph-mon[29523]: from='client.14124 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2024-05-08T05:16:50.376 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:16:50 smithi087 ceph-mon[29523]: [08/May/2024:05:16:49] ENGINE Serving on http://172.21.15.87:8765 2024-05-08T05:16:50.376 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:16:50 smithi087 ceph-mon[29523]: from='client.14124 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2024-05-08T05:16:50.376 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:16:50 smithi087 ceph-mon[29523]: [08/May/2024:05:16:49] ENGINE Serving on https://172.21.15.87:7150 2024-05-08T05:16:50.376 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:16:50 smithi087 ceph-mon[29523]: [08/May/2024:05:16:49] ENGINE Bus STARTED 2024-05-08T05:16:50.377 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:16:50 smithi087 ceph-mon[29523]: from='mgr.14120 172.21.15.87:0/603415166' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T05:16:51.355 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:16:51 smithi087 ceph-mon[29523]: mgrmap e8: x(active, since 2s) 2024-05-08T05:16:51.355 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:16:51 smithi087 ceph-mon[29523]: from='client.14132 -' entity='client.admin' cmd=[{"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}]: dispatch 2024-05-08T05:16:51.355 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:16:51 smithi087 ceph-mon[29523]: from='mgr.14120 172.21.15.87:0/603415166' entity='mgr.x' 2024-05-08T05:16:51.355 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:16:51 smithi087 ceph-mon[29523]: from='mgr.14120 172.21.15.87:0/603415166' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T05:16:51.363 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:50.438+0000 7f04ae400700 1 Processor -- start 2024-05-08T05:16:51.364 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:50.438+0000 7f04ae400700 1 -- start start 2024-05-08T05:16:51.364 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:50.439+0000 7f04ae400700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f04a807dd50 0x7f04a807c1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:16:51.364 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:50.439+0000 7f04ae400700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f04a807c780 con 0x7f04a807dd50 2024-05-08T05:16:51.365 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:50.439+0000 7f04a7400700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f04a807dd50 0x7f04a807c1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:16:51.365 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:50.439+0000 7f04a7400700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f04a807dd50 0x7f04a807c1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:40734/0 (socket says 172.21.15.87:40734) 2024-05-08T05:16:51.365 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:50.439+0000 7f04a7400700 1 -- 172.21.15.87:0/1752210638 learned_addr learned my addr 172.21.15.87:0/1752210638 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T05:16:51.365 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:50.440+0000 7f04a7400700 1 -- 172.21.15.87:0/1752210638 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f04a807c900 con 0x7f04a807dd50 2024-05-08T05:16:51.365 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:50.440+0000 7f04a7400700 1 --2- 172.21.15.87:0/1752210638 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f04a807dd50 0x7f04a807c1b0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f0498009e80 tx=0x7f049800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2bb04bea57cfa166 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:16:51.366 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:50.440+0000 7f04a6000700 1 -- 172.21.15.87:0/1752210638 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0498017070 con 0x7f04a807dd50 2024-05-08T05:16:51.366 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:50.440+0000 7f04a6000700 1 -- 172.21.15.87:0/1752210638 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) ==== 1070+0+0 (secure 0 0 0) 0x7f049800b8c0 con 0x7f04a807dd50 2024-05-08T05:16:51.366 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:50.440+0000 7f04a6000700 1 -- 172.21.15.87:0/1752210638 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0498004490 con 0x7f04a807dd50 2024-05-08T05:16:51.366 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:50.441+0000 7f04ae400700 1 -- 172.21.15.87:0/1752210638 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f04a807dd50 msgr2=0x7f04a807c1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:16:51.367 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:50.441+0000 7f04ae400700 1 --2- 172.21.15.87:0/1752210638 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f04a807dd50 0x7f04a807c1b0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f0498009e80 tx=0x7f049800b330 comp rx=0 tx=0).stop 2024-05-08T05:16:51.367 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:50.441+0000 7f04ae400700 1 -- 172.21.15.87:0/1752210638 shutdown_connections 2024-05-08T05:16:51.367 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:50.441+0000 7f04ae400700 1 --2- 172.21.15.87:0/1752210638 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f04a807dd50 0x7f04a807c1b0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:16:51.368 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:50.441+0000 7f04ae400700 1 -- 172.21.15.87:0/1752210638 >> 172.21.15.87:0/1752210638 conn(0x7f04a8104560 msgr2=0x7f04a8106980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:16:51.368 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:50.441+0000 7f04ae400700 1 -- 172.21.15.87:0/1752210638 shutdown_connections 2024-05-08T05:16:51.368 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:50.441+0000 7f04ae400700 1 -- 172.21.15.87:0/1752210638 wait complete. 2024-05-08T05:16:51.368 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:50.442+0000 7f04ae400700 1 Processor -- start 2024-05-08T05:16:51.368 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:50.442+0000 7f04ae400700 1 -- start start 2024-05-08T05:16:51.368 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:50.442+0000 7f04ae400700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f04a807dd50 0x7f04a819ef70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:16:51.368 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:50.442+0000 7f04ae400700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f04a810f510 con 0x7f04a807dd50 2024-05-08T05:16:51.369 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:50.443+0000 7f04a7400700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f04a807dd50 0x7f04a819ef70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:16:51.369 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:50.443+0000 7f04a7400700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f04a807dd50 0x7f04a819ef70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:40738/0 (socket says 172.21.15.87:40738) 2024-05-08T05:16:51.369 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:50.443+0000 7f04a7400700 1 -- 172.21.15.87:0/217068134 learned_addr learned my addr 172.21.15.87:0/217068134 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T05:16:51.369 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:50.443+0000 7f04a7400700 1 -- 172.21.15.87:0/217068134 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f04a819f4b0 con 0x7f04a807dd50 2024-05-08T05:16:51.369 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:50.443+0000 7f04a7400700 1 --2- 172.21.15.87:0/217068134 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f04a807dd50 0x7f04a819ef70 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f049800b7b0 tx=0x7f049800be90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:16:51.370 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:50.444+0000 7f049fe00700 1 -- 172.21.15.87:0/217068134 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0498020020 con 0x7f04a807dd50 2024-05-08T05:16:51.370 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:50.444+0000 7f049fe00700 1 -- 172.21.15.87:0/217068134 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) ==== 1070+0+0 (secure 0 0 0) 0x7f0498003d10 con 0x7f04a807dd50 2024-05-08T05:16:51.370 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:50.444+0000 7f04ae400700 1 -- 172.21.15.87:0/217068134 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f04a819f740 con 0x7f04a807dd50 2024-05-08T05:16:51.371 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:50.444+0000 7f049fe00700 1 -- 172.21.15.87:0/217068134 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0498017040 con 0x7f04a807dd50 2024-05-08T05:16:51.371 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:50.444+0000 7f04ae400700 1 -- 172.21.15.87:0/217068134 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f04a81a2430 con 0x7f04a807dd50 2024-05-08T05:16:51.371 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:50.445+0000 7f04ae400700 1 -- 172.21.15.87:0/217068134 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f04a8064b00 con 0x7f04a807dd50 2024-05-08T05:16:51.371 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:50.445+0000 7f049fe00700 1 -- 172.21.15.87:0/217068134 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 8) ==== 50222+0+0 (secure 0 0 0) 0x7f0498023020 con 0x7f04a807dd50 2024-05-08T05:16:51.371 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:50.446+0000 7f049fe00700 1 --2- 172.21.15.87:0/217068134 >> [v2:172.21.15.87:6800/2710124295,v1:172.21.15.87:6801/2710124295] conn(0x7f048c03e580 0x7f048c040a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:16:51.371 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:50.446+0000 7f049fe00700 1 -- 172.21.15.87:0/217068134 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f049800f050 con 0x7f04a807dd50 2024-05-08T05:16:51.371 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:50.446+0000 7f04a6a00700 1 --2- 172.21.15.87:0/217068134 >> [v2:172.21.15.87:6800/2710124295,v1:172.21.15.87:6801/2710124295] conn(0x7f048c03e580 0x7f048c040a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:16:51.371 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:50.447+0000 7f04a6a00700 1 --2- 172.21.15.87:0/217068134 >> [v2:172.21.15.87:6800/2710124295,v1:172.21.15.87:6801/2710124295] conn(0x7f048c03e580 0x7f048c040a40 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f0494006fd0 tx=0x7f0494006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:16:51.371 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:50.451+0000 7f049fe00700 1 -- 172.21.15.87:0/217068134 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f049802a020 con 0x7f04a807dd50 2024-05-08T05:16:51.373 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:50.698+0000 7f04ae400700 1 -- 172.21.15.87:0/217068134 --> [v2:172.21.15.87:6800/2710124295,v1:172.21.15.87:6801/2710124295] -- mgr_command(tid 0: {"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}) -- 0x7f04a8105710 con 0x7f048c03e580 2024-05-08T05:16:51.373 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:50.708+0000 7f049fe00700 1 -- 172.21.15.87:0/217068134 <== mgr.14120 v2:172.21.15.87:6800/2710124295 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f04a8105710 con 0x7f048c03e580 2024-05-08T05:16:51.373 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:50.711+0000 7f04ae400700 1 -- 172.21.15.87:0/217068134 >> [v2:172.21.15.87:6800/2710124295,v1:172.21.15.87:6801/2710124295] conn(0x7f048c03e580 msgr2=0x7f048c040a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:16:51.373 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:50.711+0000 7f04ae400700 1 --2- 172.21.15.87:0/217068134 >> [v2:172.21.15.87:6800/2710124295,v1:172.21.15.87:6801/2710124295] conn(0x7f048c03e580 0x7f048c040a40 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f0494006fd0 tx=0x7f0494006e40 comp rx=0 tx=0).stop 2024-05-08T05:16:51.373 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:50.711+0000 7f04ae400700 1 -- 172.21.15.87:0/217068134 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f04a807dd50 msgr2=0x7f04a819ef70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:16:51.373 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:50.711+0000 7f04ae400700 1 --2- 172.21.15.87:0/217068134 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f04a807dd50 0x7f04a819ef70 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f049800b7b0 tx=0x7f049800be90 comp rx=0 tx=0).stop 2024-05-08T05:16:51.373 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:50.711+0000 7f04ae400700 1 -- 172.21.15.87:0/217068134 shutdown_connections 2024-05-08T05:16:51.373 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:50.711+0000 7f04ae400700 1 --2- 172.21.15.87:0/217068134 >> [v2:172.21.15.87:6800/2710124295,v1:172.21.15.87:6801/2710124295] conn(0x7f048c03e580 0x7f048c040a40 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:16:51.373 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:50.711+0000 7f04ae400700 1 --2- 172.21.15.87:0/217068134 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f04a807dd50 0x7f04a819ef70 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:16:51.374 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:50.711+0000 7f04ae400700 1 -- 172.21.15.87:0/217068134 >> 172.21.15.87:0/217068134 conn(0x7f04a8104560 msgr2=0x7f04a8105000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:16:51.374 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:50.711+0000 7f04ae400700 1 -- 172.21.15.87:0/217068134 shutdown_connections 2024-05-08T05:16:51.374 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:50.711+0000 7f04ae400700 1 -- 172.21.15.87:0/217068134 wait complete. 2024-05-08T05:16:52.894 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout value unchanged 2024-05-08T05:16:52.894 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:51.946+0000 7f8e6aa00700 1 Processor -- start 2024-05-08T05:16:52.894 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:51.946+0000 7f8e6aa00700 1 -- start start 2024-05-08T05:16:52.894 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:51.946+0000 7f8e6aa00700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8e64108fa0 0x7f8e641093c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:16:52.894 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:51.946+0000 7f8e6aa00700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f8e64109990 con 0x7f8e64108fa0 2024-05-08T05:16:52.894 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:51.948+0000 7f8e63e00700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8e64108fa0 0x7f8e641093c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:16:52.894 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:51.948+0000 7f8e63e00700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8e64108fa0 0x7f8e641093c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:40754/0 (socket says 172.21.15.87:40754) 2024-05-08T05:16:52.894 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:51.948+0000 7f8e63e00700 1 -- 172.21.15.87:0/3464436761 learned_addr learned my addr 172.21.15.87:0/3464436761 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T05:16:52.894 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:51.948+0000 7f8e63e00700 1 -- 172.21.15.87:0/3464436761 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8e6410a1a0 con 0x7f8e64108fa0 2024-05-08T05:16:52.894 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:51.948+0000 7f8e63e00700 1 --2- 172.21.15.87:0/3464436761 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8e64108fa0 0x7f8e641093c0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f8e540098a0 tx=0x7f8e54009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c40da20ba61944 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:16:52.895 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:51.948+0000 7f8e62a00700 1 -- 172.21.15.87:0/3464436761 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8e54004160 con 0x7f8e64108fa0 2024-05-08T05:16:52.895 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:51.948+0000 7f8e62a00700 1 -- 172.21.15.87:0/3464436761 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) ==== 1070+0+0 (secure 0 0 0) 0x7f8e54004300 con 0x7f8e64108fa0 2024-05-08T05:16:52.895 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:51.948+0000 7f8e62a00700 1 -- 172.21.15.87:0/3464436761 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8e54011af0 con 0x7f8e64108fa0 2024-05-08T05:16:52.895 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:51.949+0000 7f8e6aa00700 1 -- 172.21.15.87:0/3464436761 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8e64108fa0 msgr2=0x7f8e641093c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:16:52.895 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:51.949+0000 7f8e6aa00700 1 --2- 172.21.15.87:0/3464436761 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8e64108fa0 0x7f8e641093c0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f8e540098a0 tx=0x7f8e54009bb0 comp rx=0 tx=0).stop 2024-05-08T05:16:52.895 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:51.949+0000 7f8e6aa00700 1 -- 172.21.15.87:0/3464436761 shutdown_connections 2024-05-08T05:16:52.895 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:51.949+0000 7f8e6aa00700 1 --2- 172.21.15.87:0/3464436761 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8e64108fa0 0x7f8e641093c0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:16:52.895 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:51.949+0000 7f8e6aa00700 1 -- 172.21.15.87:0/3464436761 >> 172.21.15.87:0/3464436761 conn(0x7f8e64104560 msgr2=0x7f8e64106980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:16:52.895 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:51.949+0000 7f8e6aa00700 1 -- 172.21.15.87:0/3464436761 shutdown_connections 2024-05-08T05:16:52.895 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:51.950+0000 7f8e6aa00700 1 -- 172.21.15.87:0/3464436761 wait complete. 2024-05-08T05:16:52.895 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:51.951+0000 7f8e6aa00700 1 Processor -- start 2024-05-08T05:16:52.895 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:51.951+0000 7f8e6aa00700 1 -- start start 2024-05-08T05:16:52.895 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:51.951+0000 7f8e6aa00700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8e64108fa0 0x7f8e6419f020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:16:52.896 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:51.951+0000 7f8e6aa00700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f8e6410d3d0 con 0x7f8e64108fa0 2024-05-08T05:16:52.896 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:51.951+0000 7f8e63e00700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8e64108fa0 0x7f8e6419f020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:16:52.896 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:51.951+0000 7f8e63e00700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8e64108fa0 0x7f8e6419f020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:40762/0 (socket says 172.21.15.87:40762) 2024-05-08T05:16:52.896 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:51.951+0000 7f8e63e00700 1 -- 172.21.15.87:0/2141687674 learned_addr learned my addr 172.21.15.87:0/2141687674 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T05:16:52.896 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:51.952+0000 7f8e63e00700 1 -- 172.21.15.87:0/2141687674 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8e6419f560 con 0x7f8e64108fa0 2024-05-08T05:16:52.896 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:51.952+0000 7f8e63e00700 1 --2- 172.21.15.87:0/2141687674 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8e64108fa0 0x7f8e6419f020 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f8e540117b0 tx=0x7f8e54011b70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:16:52.896 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:51.952+0000 7f8e60c00700 1 -- 172.21.15.87:0/2141687674 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8e54003af0 con 0x7f8e64108fa0 2024-05-08T05:16:52.896 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:51.952+0000 7f8e60c00700 1 -- 172.21.15.87:0/2141687674 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) ==== 1070+0+0 (secure 0 0 0) 0x7f8e54020070 con 0x7f8e64108fa0 2024-05-08T05:16:52.896 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:51.952+0000 7f8e6aa00700 1 -- 172.21.15.87:0/2141687674 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8e6419f7f0 con 0x7f8e64108fa0 2024-05-08T05:16:52.896 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:51.953+0000 7f8e6aa00700 1 -- 172.21.15.87:0/2141687674 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8e641a24e0 con 0x7f8e64108fa0 2024-05-08T05:16:52.896 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:51.953+0000 7f8e60c00700 1 -- 172.21.15.87:0/2141687674 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8e540042a0 con 0x7f8e64108fa0 2024-05-08T05:16:52.896 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:51.954+0000 7f8e6aa00700 1 -- 172.21.15.87:0/2141687674 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8e6410d550 con 0x7f8e64108fa0 2024-05-08T05:16:52.896 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:51.954+0000 7f8e60c00700 1 -- 172.21.15.87:0/2141687674 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 8) ==== 50222+0+0 (secure 0 0 0) 0x7f8e5401a9c0 con 0x7f8e64108fa0 2024-05-08T05:16:52.896 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:51.955+0000 7f8e60c00700 1 --2- 172.21.15.87:0/2141687674 >> [v2:172.21.15.87:6800/2710124295,v1:172.21.15.87:6801/2710124295] conn(0x7f8e4803e530 0x7f8e480409f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:16:52.896 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:51.955+0000 7f8e60c00700 1 -- 172.21.15.87:0/2141687674 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f8e54053bf0 con 0x7f8e64108fa0 2024-05-08T05:16:52.897 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:51.955+0000 7f8e63400700 1 --2- 172.21.15.87:0/2141687674 >> [v2:172.21.15.87:6800/2710124295,v1:172.21.15.87:6801/2710124295] conn(0x7f8e4803e530 0x7f8e480409f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:16:52.897 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:51.956+0000 7f8e63400700 1 --2- 172.21.15.87:0/2141687674 >> [v2:172.21.15.87:6800/2710124295,v1:172.21.15.87:6801/2710124295] conn(0x7f8e4803e530 0x7f8e480409f0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f8e50006fd0 tx=0x7f8e50006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:16:52.897 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:51.961+0000 7f8e60c00700 1 -- 172.21.15.87:0/2141687674 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f8e54024e80 con 0x7f8e64108fa0 2024-05-08T05:16:52.897 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:52.194+0000 7f8e6aa00700 1 -- 172.21.15.87:0/2141687674 --> [v2:172.21.15.87:6800/2710124295,v1:172.21.15.87:6801/2710124295] -- mgr_command(tid 0: {"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}) -- 0x7f8e641056c0 con 0x7f8e4803e530 2024-05-08T05:16:52.897 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:52.196+0000 7f8e60c00700 1 -- 172.21.15.87:0/2141687674 <== mgr.14120 v2:172.21.15.87:6800/2710124295 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+16 (secure 0 0 0) 0x7f8e641056c0 con 0x7f8e4803e530 2024-05-08T05:16:52.897 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:52.199+0000 7f8e6aa00700 1 -- 172.21.15.87:0/2141687674 >> [v2:172.21.15.87:6800/2710124295,v1:172.21.15.87:6801/2710124295] conn(0x7f8e4803e530 msgr2=0x7f8e480409f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:16:52.897 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:52.199+0000 7f8e6aa00700 1 --2- 172.21.15.87:0/2141687674 >> [v2:172.21.15.87:6800/2710124295,v1:172.21.15.87:6801/2710124295] conn(0x7f8e4803e530 0x7f8e480409f0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f8e50006fd0 tx=0x7f8e50006e40 comp rx=0 tx=0).stop 2024-05-08T05:16:52.897 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:52.199+0000 7f8e6aa00700 1 -- 172.21.15.87:0/2141687674 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8e64108fa0 msgr2=0x7f8e6419f020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:16:52.897 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:52.199+0000 7f8e6aa00700 1 --2- 172.21.15.87:0/2141687674 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8e64108fa0 0x7f8e6419f020 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f8e540117b0 tx=0x7f8e54011b70 comp rx=0 tx=0).stop 2024-05-08T05:16:52.897 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:52.199+0000 7f8e6aa00700 1 -- 172.21.15.87:0/2141687674 shutdown_connections 2024-05-08T05:16:52.897 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:52.199+0000 7f8e6aa00700 1 --2- 172.21.15.87:0/2141687674 >> [v2:172.21.15.87:6800/2710124295,v1:172.21.15.87:6801/2710124295] conn(0x7f8e4803e530 0x7f8e480409f0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:16:52.897 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:52.199+0000 7f8e6aa00700 1 --2- 172.21.15.87:0/2141687674 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8e64108fa0 0x7f8e6419f020 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:16:52.897 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:52.199+0000 7f8e6aa00700 1 -- 172.21.15.87:0/2141687674 >> 172.21.15.87:0/2141687674 conn(0x7f8e64104560 msgr2=0x7f8e64104fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:16:52.898 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:52.199+0000 7f8e6aa00700 1 -- 172.21.15.87:0/2141687674 shutdown_connections 2024-05-08T05:16:52.898 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:52.199+0000 7f8e6aa00700 1 -- 172.21.15.87:0/2141687674 wait complete. 2024-05-08T05:16:52.898 INFO:teuthology.orchestra.run.smithi087.stdout:Generating ssh key... 2024-05-08T05:16:53.452 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:16:53 smithi087 ceph-mon[29523]: from='client.14134 -' entity='client.admin' cmd=[{"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}]: dispatch 2024-05-08T05:16:54.210 INFO:journalctl@ceph.mgr.x.smithi087.stdout:May 08 05:16:53 smithi087 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-mgr-x[29765]: Generating public/private rsa key pair. 2024-05-08T05:16:54.211 INFO:journalctl@ceph.mgr.x.smithi087.stdout:May 08 05:16:53 smithi087 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-mgr-x[29765]: Your identification has been saved in /tmp/tmp8hwv0_s4/key. 2024-05-08T05:16:54.211 INFO:journalctl@ceph.mgr.x.smithi087.stdout:May 08 05:16:53 smithi087 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-mgr-x[29765]: Your public key has been saved in /tmp/tmp8hwv0_s4/key.pub. 2024-05-08T05:16:54.211 INFO:journalctl@ceph.mgr.x.smithi087.stdout:May 08 05:16:53 smithi087 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-mgr-x[29765]: The key fingerprint is: 2024-05-08T05:16:54.211 INFO:journalctl@ceph.mgr.x.smithi087.stdout:May 08 05:16:53 smithi087 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-mgr-x[29765]: SHA256:/WUI708seBX20DDKjQmIzfJEssqcehcf4XsJbtp7qbk ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968 2024-05-08T05:16:54.211 INFO:journalctl@ceph.mgr.x.smithi087.stdout:May 08 05:16:53 smithi087 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-mgr-x[29765]: The key's randomart image is: 2024-05-08T05:16:54.211 INFO:journalctl@ceph.mgr.x.smithi087.stdout:May 08 05:16:53 smithi087 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-mgr-x[29765]: +---[RSA 3072]----+ 2024-05-08T05:16:54.211 INFO:journalctl@ceph.mgr.x.smithi087.stdout:May 08 05:16:53 smithi087 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-mgr-x[29765]: | .=... o | 2024-05-08T05:16:54.211 INFO:journalctl@ceph.mgr.x.smithi087.stdout:May 08 05:16:53 smithi087 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-mgr-x[29765]: | oo= o = + | 2024-05-08T05:16:54.211 INFO:journalctl@ceph.mgr.x.smithi087.stdout:May 08 05:16:53 smithi087 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-mgr-x[29765]: | .+. . = = .| 2024-05-08T05:16:54.211 INFO:journalctl@ceph.mgr.x.smithi087.stdout:May 08 05:16:53 smithi087 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-mgr-x[29765]: | o o ..o o o + | 2024-05-08T05:16:54.211 INFO:journalctl@ceph.mgr.x.smithi087.stdout:May 08 05:16:53 smithi087 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-mgr-x[29765]: | = . S . o + .| 2024-05-08T05:16:54.211 INFO:journalctl@ceph.mgr.x.smithi087.stdout:May 08 05:16:53 smithi087 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-mgr-x[29765]: | . + + = = | 2024-05-08T05:16:54.211 INFO:journalctl@ceph.mgr.x.smithi087.stdout:May 08 05:16:53 smithi087 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-mgr-x[29765]: | . . . = +.= o | 2024-05-08T05:16:54.212 INFO:journalctl@ceph.mgr.x.smithi087.stdout:May 08 05:16:53 smithi087 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-mgr-x[29765]: | . . + oo. + | 2024-05-08T05:16:54.212 INFO:journalctl@ceph.mgr.x.smithi087.stdout:May 08 05:16:53 smithi087 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-mgr-x[29765]: | . E= . | 2024-05-08T05:16:54.212 INFO:journalctl@ceph.mgr.x.smithi087.stdout:May 08 05:16:53 smithi087 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-mgr-x[29765]: +----[SHA256]-----+ 2024-05-08T05:16:54.620 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:53.450+0000 7fb8e3e00700 1 Processor -- start 2024-05-08T05:16:54.620 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:53.450+0000 7fb8e3e00700 1 -- start start 2024-05-08T05:16:54.620 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:53.451+0000 7fb8e3e00700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb8e407dd90 0x7fb8e407c1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:16:54.622 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:53.451+0000 7fb8e3e00700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fb8e407c7c0 con 0x7fb8e407dd90 2024-05-08T05:16:54.622 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:53.451+0000 7fb8e2a00700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb8e407dd90 0x7fb8e407c1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:16:54.622 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:53.452+0000 7fb8e2a00700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb8e407dd90 0x7fb8e407c1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:40774/0 (socket says 172.21.15.87:40774) 2024-05-08T05:16:54.622 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:53.452+0000 7fb8e2a00700 1 -- 172.21.15.87:0/1361179690 learned_addr learned my addr 172.21.15.87:0/1361179690 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T05:16:54.622 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:53.452+0000 7fb8e2a00700 1 -- 172.21.15.87:0/1361179690 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb8e407c940 con 0x7fb8e407dd90 2024-05-08T05:16:54.622 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:53.452+0000 7fb8e2a00700 1 --2- 172.21.15.87:0/1361179690 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb8e407dd90 0x7fb8e407c1f0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fb8d40098a0 tx=0x7fb8d4009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=53454c7088270608 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:16:54.622 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:53.453+0000 7fb8e1600700 1 -- 172.21.15.87:0/1361179690 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb8d4004160 con 0x7fb8e407dd90 2024-05-08T05:16:54.622 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:53.453+0000 7fb8e1600700 1 -- 172.21.15.87:0/1361179690 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) ==== 1070+0+0 (secure 0 0 0) 0x7fb8d4004300 con 0x7fb8e407dd90 2024-05-08T05:16:54.626 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:53.453+0000 7fb8e1600700 1 -- 172.21.15.87:0/1361179690 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb8d4011af0 con 0x7fb8e407dd90 2024-05-08T05:16:54.626 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:53.453+0000 7fb8e3e00700 1 -- 172.21.15.87:0/1361179690 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb8e407dd90 msgr2=0x7fb8e407c1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:16:54.627 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:53.453+0000 7fb8e3e00700 1 --2- 172.21.15.87:0/1361179690 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb8e407dd90 0x7fb8e407c1f0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fb8d40098a0 tx=0x7fb8d4009bb0 comp rx=0 tx=0).stop 2024-05-08T05:16:54.627 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:53.454+0000 7fb8e3e00700 1 -- 172.21.15.87:0/1361179690 shutdown_connections 2024-05-08T05:16:54.627 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:53.454+0000 7fb8e3e00700 1 --2- 172.21.15.87:0/1361179690 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb8e407dd90 0x7fb8e407c1f0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:16:54.627 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:53.454+0000 7fb8e3e00700 1 -- 172.21.15.87:0/1361179690 >> 172.21.15.87:0/1361179690 conn(0x7fb8e41043c0 msgr2=0x7fb8e41067e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:16:54.627 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:53.454+0000 7fb8e3e00700 1 -- 172.21.15.87:0/1361179690 shutdown_connections 2024-05-08T05:16:54.627 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:53.454+0000 7fb8e3e00700 1 -- 172.21.15.87:0/1361179690 wait complete. 2024-05-08T05:16:54.627 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:53.455+0000 7fb8e3e00700 1 Processor -- start 2024-05-08T05:16:54.627 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:53.455+0000 7fb8e3e00700 1 -- start start 2024-05-08T05:16:54.627 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:53.455+0000 7fb8e3e00700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb8e407dd90 0x7fb8e419ee00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:16:54.627 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:53.455+0000 7fb8e3e00700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fb8e410f310 con 0x7fb8e407dd90 2024-05-08T05:16:54.627 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:53.456+0000 7fb8e2a00700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb8e407dd90 0x7fb8e419ee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:16:54.627 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:53.456+0000 7fb8e2a00700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb8e407dd90 0x7fb8e419ee00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:40784/0 (socket says 172.21.15.87:40784) 2024-05-08T05:16:54.627 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:53.456+0000 7fb8e2a00700 1 -- 172.21.15.87:0/4114851207 learned_addr learned my addr 172.21.15.87:0/4114851207 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T05:16:54.628 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:53.456+0000 7fb8e2a00700 1 -- 172.21.15.87:0/4114851207 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb8e419f340 con 0x7fb8e407dd90 2024-05-08T05:16:54.628 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:53.456+0000 7fb8e2a00700 1 --2- 172.21.15.87:0/4114851207 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb8e407dd90 0x7fb8e419ee00 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fb8d40117b0 tx=0x7fb8d4011b70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:16:54.628 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:53.456+0000 7fb8db400700 1 -- 172.21.15.87:0/4114851207 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb8d4003af0 con 0x7fb8e407dd90 2024-05-08T05:16:54.628 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:53.456+0000 7fb8db400700 1 -- 172.21.15.87:0/4114851207 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) ==== 1070+0+0 (secure 0 0 0) 0x7fb8d4020070 con 0x7fb8e407dd90 2024-05-08T05:16:54.628 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:53.456+0000 7fb8db400700 1 -- 172.21.15.87:0/4114851207 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb8d4019630 con 0x7fb8e407dd90 2024-05-08T05:16:54.628 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:53.456+0000 7fb8e3e00700 1 -- 172.21.15.87:0/4114851207 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb8e419f5d0 con 0x7fb8e407dd90 2024-05-08T05:16:54.628 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:53.457+0000 7fb8e3e00700 1 -- 172.21.15.87:0/4114851207 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb8e41a22c0 con 0x7fb8e407dd90 2024-05-08T05:16:54.628 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:53.458+0000 7fb8e3e00700 1 -- 172.21.15.87:0/4114851207 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb8e4064b00 con 0x7fb8e407dd90 2024-05-08T05:16:54.628 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:53.458+0000 7fb8db400700 1 -- 172.21.15.87:0/4114851207 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 8) ==== 50222+0+0 (secure 0 0 0) 0x7fb8d401a9c0 con 0x7fb8e407dd90 2024-05-08T05:16:54.628 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:53.459+0000 7fb8db400700 1 --2- 172.21.15.87:0/4114851207 >> [v2:172.21.15.87:6800/2710124295,v1:172.21.15.87:6801/2710124295] conn(0x7fb8c803e580 0x7fb8c8040a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:16:54.628 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:53.459+0000 7fb8db400700 1 -- 172.21.15.87:0/4114851207 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7fb8d4053b20 con 0x7fb8e407dd90 2024-05-08T05:16:54.628 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:53.459+0000 7fb8e2000700 1 --2- 172.21.15.87:0/4114851207 >> [v2:172.21.15.87:6800/2710124295,v1:172.21.15.87:6801/2710124295] conn(0x7fb8c803e580 0x7fb8c8040a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:16:54.628 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:53.460+0000 7fb8e2000700 1 --2- 172.21.15.87:0/4114851207 >> [v2:172.21.15.87:6800/2710124295,v1:172.21.15.87:6801/2710124295] conn(0x7fb8c803e580 0x7fb8c8040a40 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fb8d0006fd0 tx=0x7fb8d0006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:16:54.628 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:53.464+0000 7fb8db400700 1 -- 172.21.15.87:0/4114851207 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7fb8d4053470 con 0x7fb8e407dd90 2024-05-08T05:16:54.629 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:53.678+0000 7fb8e3e00700 1 -- 172.21.15.87:0/4114851207 --> [v2:172.21.15.87:6800/2710124295,v1:172.21.15.87:6801/2710124295] -- mgr_command(tid 0: {"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}) -- 0x7fb8e41054f0 con 0x7fb8c803e580 2024-05-08T05:16:54.629 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:53.893+0000 7fb8db400700 1 -- 172.21.15.87:0/4114851207 <== mgr.14120 v2:172.21.15.87:6800/2710124295 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7fb8e41054f0 con 0x7fb8c803e580 2024-05-08T05:16:54.629 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:53.896+0000 7fb8e3e00700 1 -- 172.21.15.87:0/4114851207 >> [v2:172.21.15.87:6800/2710124295,v1:172.21.15.87:6801/2710124295] conn(0x7fb8c803e580 msgr2=0x7fb8c8040a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:16:54.629 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:53.896+0000 7fb8e3e00700 1 --2- 172.21.15.87:0/4114851207 >> [v2:172.21.15.87:6800/2710124295,v1:172.21.15.87:6801/2710124295] conn(0x7fb8c803e580 0x7fb8c8040a40 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fb8d0006fd0 tx=0x7fb8d0006e40 comp rx=0 tx=0).stop 2024-05-08T05:16:54.629 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:53.897+0000 7fb8e3e00700 1 -- 172.21.15.87:0/4114851207 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb8e407dd90 msgr2=0x7fb8e419ee00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:16:54.629 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:53.897+0000 7fb8e3e00700 1 --2- 172.21.15.87:0/4114851207 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb8e407dd90 0x7fb8e419ee00 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fb8d40117b0 tx=0x7fb8d4011b70 comp rx=0 tx=0).stop 2024-05-08T05:16:54.629 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:53.897+0000 7fb8e3e00700 1 -- 172.21.15.87:0/4114851207 shutdown_connections 2024-05-08T05:16:54.629 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:53.897+0000 7fb8e3e00700 1 --2- 172.21.15.87:0/4114851207 >> [v2:172.21.15.87:6800/2710124295,v1:172.21.15.87:6801/2710124295] conn(0x7fb8c803e580 0x7fb8c8040a40 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:16:54.629 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:53.897+0000 7fb8e3e00700 1 --2- 172.21.15.87:0/4114851207 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb8e407dd90 0x7fb8e419ee00 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:16:54.629 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:53.897+0000 7fb8e3e00700 1 -- 172.21.15.87:0/4114851207 >> 172.21.15.87:0/4114851207 conn(0x7fb8e41043c0 msgr2=0x7fb8e4104de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:16:54.629 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:53.897+0000 7fb8e3e00700 1 -- 172.21.15.87:0/4114851207 shutdown_connections 2024-05-08T05:16:54.629 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:53.897+0000 7fb8e3e00700 1 -- 172.21.15.87:0/4114851207 wait complete. 2024-05-08T05:16:55.152 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:16:54 smithi087 ceph-mon[29523]: from='client.14136 -' entity='client.admin' cmd=[{"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}]: dispatch 2024-05-08T05:16:55.152 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:16:54 smithi087 ceph-mon[29523]: Generating ssh key... 2024-05-08T05:16:55.152 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:16:54 smithi087 ceph-mon[29523]: from='mgr.14120 172.21.15.87:0/603415166' entity='mgr.x' 2024-05-08T05:16:55.152 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:16:54 smithi087 ceph-mon[29523]: from='mgr.14120 172.21.15.87:0/603415166' entity='mgr.x' 2024-05-08T05:16:56.119 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCy+b4wR0xAyucYQ8oM3r/VsyWeZ4ZWexZqwkCUcbrW4UQk7kt1/Nv2BntvITGTciyLVD5q/NsXxs8ZsQgfVnT2/vMGT+zeijW8v4uEU/UzLuljJApl6AT8TFggHx28OqkaSxjsQjYIbHbFkgRi735JT6hKV5DLJ9b0b8HoorzZGZqbXKKwsJEdxwUmL7qMgHPcjwR1+LHLCab8syYZwvixU63D11vxPjj4Ft+WgR8aw456DjrrHe1JbUEhfiB/hW5lDIVSahuFWlBfSDLmHgemgLA2x7gjRtWvqPYrFOHhcVab5Ho8ofo2T4z4GSSrHhq6OExXcPt6+qA6CyF9c9TuOx5/tC0L7kofysuCY2Zh+31mGVj98nqijM101P8P6K/bok+v3rA4gnrWttVOmFwAVwPbaQh+7BUxaHRp8hWys1M1I36Xuvah+HdGaMNdXvCi6aoyWokrXm9/xFYFpSUOV+i7b7ly9oeP+sY5D5EGXv7zt9a1kENOEflzv6rHOF8= ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968 2024-05-08T05:16:56.119 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:55.230+0000 7f51a7600700 1 Processor -- start 2024-05-08T05:16:56.119 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:55.230+0000 7f51a7600700 1 -- start start 2024-05-08T05:16:56.119 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:55.231+0000 7f51a7600700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f51a010b1d0 0x7f51a010b5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:16:56.119 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:55.231+0000 7f51a7600700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f51a010bbc0 con 0x7f51a010b1d0 2024-05-08T05:16:56.120 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:55.231+0000 7f51a4c00700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f51a010b1d0 0x7f51a010b5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:16:56.120 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:55.231+0000 7f51a4c00700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f51a010b1d0 0x7f51a010b5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:40790/0 (socket says 172.21.15.87:40790) 2024-05-08T05:16:56.120 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:55.231+0000 7f51a4c00700 1 -- 172.21.15.87:0/3202815737 learned_addr learned my addr 172.21.15.87:0/3202815737 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T05:16:56.120 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:55.232+0000 7f51a4c00700 1 -- 172.21.15.87:0/3202815737 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f51a010c380 con 0x7f51a010b1d0 2024-05-08T05:16:56.120 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:55.232+0000 7f51a4c00700 1 --2- 172.21.15.87:0/3202815737 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f51a010b1d0 0x7f51a010b5f0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f51940098a0 tx=0x7f5194009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a54684a65c4600b4 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:16:56.120 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:55.232+0000 7f519f400700 1 -- 172.21.15.87:0/3202815737 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5194004160 con 0x7f51a010b1d0 2024-05-08T05:16:56.120 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:55.232+0000 7f519f400700 1 -- 172.21.15.87:0/3202815737 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) ==== 1070+0+0 (secure 0 0 0) 0x7f5194004300 con 0x7f51a010b1d0 2024-05-08T05:16:56.120 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:55.232+0000 7f519f400700 1 -- 172.21.15.87:0/3202815737 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5194011af0 con 0x7f51a010b1d0 2024-05-08T05:16:56.120 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:55.233+0000 7f51a7600700 1 -- 172.21.15.87:0/3202815737 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f51a010b1d0 msgr2=0x7f51a010b5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:16:56.120 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:55.233+0000 7f51a7600700 1 --2- 172.21.15.87:0/3202815737 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f51a010b1d0 0x7f51a010b5f0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f51940098a0 tx=0x7f5194009bb0 comp rx=0 tx=0).stop 2024-05-08T05:16:56.120 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:55.233+0000 7f51a7600700 1 -- 172.21.15.87:0/3202815737 shutdown_connections 2024-05-08T05:16:56.120 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:55.233+0000 7f51a7600700 1 --2- 172.21.15.87:0/3202815737 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f51a010b1d0 0x7f51a010b5f0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:16:56.120 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:55.233+0000 7f51a7600700 1 -- 172.21.15.87:0/3202815737 >> 172.21.15.87:0/3202815737 conn(0x7f51a007e8c0 msgr2=0x7f51a01094b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:16:56.120 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:55.233+0000 7f51a7600700 1 -- 172.21.15.87:0/3202815737 shutdown_connections 2024-05-08T05:16:56.121 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:55.233+0000 7f51a7600700 1 -- 172.21.15.87:0/3202815737 wait complete. 2024-05-08T05:16:56.121 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:55.234+0000 7f51a7600700 1 Processor -- start 2024-05-08T05:16:56.121 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:55.234+0000 7f51a7600700 1 -- start start 2024-05-08T05:16:56.121 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:55.235+0000 7f51a7600700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f51a010b1d0 0x7f51a019efd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:16:56.121 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:55.235+0000 7f51a7600700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f51a010f5b0 con 0x7f51a010b1d0 2024-05-08T05:16:56.121 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:55.235+0000 7f51a4c00700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f51a010b1d0 0x7f51a019efd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:16:56.121 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:55.235+0000 7f51a4c00700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f51a010b1d0 0x7f51a019efd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:40796/0 (socket says 172.21.15.87:40796) 2024-05-08T05:16:56.121 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:55.235+0000 7f51a4c00700 1 -- 172.21.15.87:0/807447752 learned_addr learned my addr 172.21.15.87:0/807447752 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T05:16:56.121 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:55.235+0000 7f51a4c00700 1 -- 172.21.15.87:0/807447752 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f51a019f510 con 0x7f51a010b1d0 2024-05-08T05:16:56.121 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:55.236+0000 7f51a4c00700 1 --2- 172.21.15.87:0/807447752 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f51a010b1d0 0x7f51a019efd0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f5194000c00 tx=0x7f5194011b70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:16:56.121 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:55.236+0000 7f519d600700 1 -- 172.21.15.87:0/807447752 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5194003b20 con 0x7f51a010b1d0 2024-05-08T05:16:56.121 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:55.236+0000 7f519d600700 1 -- 172.21.15.87:0/807447752 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) ==== 1070+0+0 (secure 0 0 0) 0x7f519401a8c0 con 0x7f51a010b1d0 2024-05-08T05:16:56.121 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:55.236+0000 7f519d600700 1 -- 172.21.15.87:0/807447752 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5194024940 con 0x7f51a010b1d0 2024-05-08T05:16:56.121 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:55.236+0000 7f51a7600700 1 -- 172.21.15.87:0/807447752 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f51a019f7a0 con 0x7f51a010b1d0 2024-05-08T05:16:56.122 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:55.236+0000 7f51a7600700 1 -- 172.21.15.87:0/807447752 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f51a01a2490 con 0x7f51a010b1d0 2024-05-08T05:16:56.122 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:55.237+0000 7f51a7600700 1 -- 172.21.15.87:0/807447752 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f51a010f730 con 0x7f51a010b1d0 2024-05-08T05:16:56.122 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:55.237+0000 7f519d600700 1 -- 172.21.15.87:0/807447752 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 8) ==== 50222+0+0 (secure 0 0 0) 0x7f5194022020 con 0x7f51a010b1d0 2024-05-08T05:16:56.122 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:55.238+0000 7f519d600700 1 --2- 172.21.15.87:0/807447752 >> [v2:172.21.15.87:6800/2710124295,v1:172.21.15.87:6801/2710124295] conn(0x7f518803e580 0x7f5188040a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:16:56.122 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:55.238+0000 7f519d600700 1 -- 172.21.15.87:0/807447752 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f5194053740 con 0x7f51a010b1d0 2024-05-08T05:16:56.122 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:55.238+0000 7f519fe00700 1 --2- 172.21.15.87:0/807447752 >> [v2:172.21.15.87:6800/2710124295,v1:172.21.15.87:6801/2710124295] conn(0x7f518803e580 0x7f5188040a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:16:56.122 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:55.239+0000 7f519fe00700 1 --2- 172.21.15.87:0/807447752 >> [v2:172.21.15.87:6800/2710124295,v1:172.21.15.87:6801/2710124295] conn(0x7f518803e580 0x7f5188040a40 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f518c006fd0 tx=0x7f518c006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:16:56.122 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:55.243+0000 7f519d600700 1 -- 172.21.15.87:0/807447752 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f51940042a0 con 0x7f51a010b1d0 2024-05-08T05:16:56.122 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:55.479+0000 7f51a7600700 1 -- 172.21.15.87:0/807447752 --> [v2:172.21.15.87:6800/2710124295,v1:172.21.15.87:6801/2710124295] -- mgr_command(tid 0: {"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}) -- 0x7f51a01092e0 con 0x7f518803e580 2024-05-08T05:16:56.122 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:55.481+0000 7f519d600700 1 -- 172.21.15.87:0/807447752 <== mgr.14120 v2:172.21.15.87:6800/2710124295 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+595 (secure 0 0 0) 0x7f51a01092e0 con 0x7f518803e580 2024-05-08T05:16:56.122 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:55.484+0000 7f51a7600700 1 -- 172.21.15.87:0/807447752 >> [v2:172.21.15.87:6800/2710124295,v1:172.21.15.87:6801/2710124295] conn(0x7f518803e580 msgr2=0x7f5188040a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:16:56.122 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:55.484+0000 7f51a7600700 1 --2- 172.21.15.87:0/807447752 >> [v2:172.21.15.87:6800/2710124295,v1:172.21.15.87:6801/2710124295] conn(0x7f518803e580 0x7f5188040a40 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f518c006fd0 tx=0x7f518c006e40 comp rx=0 tx=0).stop 2024-05-08T05:16:56.122 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:55.484+0000 7f51a7600700 1 -- 172.21.15.87:0/807447752 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f51a010b1d0 msgr2=0x7f51a019efd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:16:56.123 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:55.484+0000 7f51a7600700 1 --2- 172.21.15.87:0/807447752 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f51a010b1d0 0x7f51a019efd0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f5194000c00 tx=0x7f5194011b70 comp rx=0 tx=0).stop 2024-05-08T05:16:56.123 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:55.484+0000 7f51a7600700 1 -- 172.21.15.87:0/807447752 shutdown_connections 2024-05-08T05:16:56.123 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:55.484+0000 7f51a7600700 1 --2- 172.21.15.87:0/807447752 >> [v2:172.21.15.87:6800/2710124295,v1:172.21.15.87:6801/2710124295] conn(0x7f518803e580 0x7f5188040a40 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:16:56.123 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:55.484+0000 7f51a7600700 1 --2- 172.21.15.87:0/807447752 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f51a010b1d0 0x7f51a019efd0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:16:56.123 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:55.484+0000 7f51a7600700 1 -- 172.21.15.87:0/807447752 >> 172.21.15.87:0/807447752 conn(0x7f51a007e8c0 msgr2=0x7f51a0108bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:16:56.123 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:55.484+0000 7f51a7600700 1 -- 172.21.15.87:0/807447752 shutdown_connections 2024-05-08T05:16:56.123 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:55.484+0000 7f51a7600700 1 -- 172.21.15.87:0/807447752 wait complete. 2024-05-08T05:16:56.123 INFO:teuthology.orchestra.run.smithi087.stdout:Wrote public SSH key to /home/ubuntu/cephtest/ceph.pub 2024-05-08T05:16:56.124 INFO:teuthology.orchestra.run.smithi087.stdout:Adding key to root@localhost authorized_keys... 2024-05-08T05:16:56.124 INFO:teuthology.orchestra.run.smithi087.stdout:Adding host smithi087... 2024-05-08T05:16:56.438 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:16:56 smithi087 ceph-mon[29523]: from='client.14138 -' entity='client.admin' cmd=[{"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}]: dispatch 2024-05-08T05:16:57.358 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:16:57 smithi087 ceph-mon[29523]: from='client.14140 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi087", "addr": "172.21.15.87", "target": ["mon-mgr", ""]}]: dispatch 2024-05-08T05:16:59.459 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:16:59 smithi087 ceph-mon[29523]: Deploying cephadm binary to smithi087 2024-05-08T05:17:03.665 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout Added host 'smithi087' with addr '172.21.15.87' 2024-05-08T05:17:03.666 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:56.768+0000 7fa8f6a00700 1 Processor -- start 2024-05-08T05:17:03.666 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:56.768+0000 7fa8f6a00700 1 -- start start 2024-05-08T05:17:03.666 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:56.769+0000 7fa8f6a00700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa8f0108f70 0x7fa8f0109390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:17:03.666 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:56.769+0000 7fa8f6a00700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fa8f0109960 con 0x7fa8f0108f70 2024-05-08T05:17:03.666 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:56.769+0000 7fa8efe00700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa8f0108f70 0x7fa8f0109390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:17:03.666 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:56.769+0000 7fa8efe00700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa8f0108f70 0x7fa8f0109390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:41162/0 (socket says 172.21.15.87:41162) 2024-05-08T05:17:03.666 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:56.769+0000 7fa8efe00700 1 -- 172.21.15.87:0/3619422498 learned_addr learned my addr 172.21.15.87:0/3619422498 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T05:17:03.666 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:56.770+0000 7fa8efe00700 1 -- 172.21.15.87:0/3619422498 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa8f010a170 con 0x7fa8f0108f70 2024-05-08T05:17:03.666 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:56.770+0000 7fa8efe00700 1 --2- 172.21.15.87:0/3619422498 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa8f0108f70 0x7fa8f0109390 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fa8e00098a0 tx=0x7fa8e0009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2d339b687972175f server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:17:03.666 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:56.770+0000 7fa8eea00700 1 -- 172.21.15.87:0/3619422498 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa8e0004160 con 0x7fa8f0108f70 2024-05-08T05:17:03.666 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:56.771+0000 7fa8eea00700 1 -- 172.21.15.87:0/3619422498 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) ==== 1070+0+0 (secure 0 0 0) 0x7fa8e0004300 con 0x7fa8f0108f70 2024-05-08T05:17:03.667 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:56.771+0000 7fa8eea00700 1 -- 172.21.15.87:0/3619422498 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa8e0011af0 con 0x7fa8f0108f70 2024-05-08T05:17:03.667 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:56.771+0000 7fa8f6a00700 1 -- 172.21.15.87:0/3619422498 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa8f0108f70 msgr2=0x7fa8f0109390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:17:03.667 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:56.771+0000 7fa8f6a00700 1 --2- 172.21.15.87:0/3619422498 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa8f0108f70 0x7fa8f0109390 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fa8e00098a0 tx=0x7fa8e0009bb0 comp rx=0 tx=0).stop 2024-05-08T05:17:03.667 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:56.771+0000 7fa8f6a00700 1 -- 172.21.15.87:0/3619422498 shutdown_connections 2024-05-08T05:17:03.667 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:56.771+0000 7fa8f6a00700 1 --2- 172.21.15.87:0/3619422498 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa8f0108f70 0x7fa8f0109390 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:17:03.667 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:56.771+0000 7fa8f6a00700 1 -- 172.21.15.87:0/3619422498 >> 172.21.15.87:0/3619422498 conn(0x7fa8f0104550 msgr2=0x7fa8f0106970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:17:03.667 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:56.771+0000 7fa8f6a00700 1 -- 172.21.15.87:0/3619422498 shutdown_connections 2024-05-08T05:17:03.667 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:56.772+0000 7fa8f6a00700 1 -- 172.21.15.87:0/3619422498 wait complete. 2024-05-08T05:17:03.667 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:56.773+0000 7fa8f6a00700 1 Processor -- start 2024-05-08T05:17:03.667 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:56.773+0000 7fa8f6a00700 1 -- start start 2024-05-08T05:17:03.667 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:56.773+0000 7fa8f6a00700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa8f0108f70 0x7fa8f007eb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:17:03.667 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:56.773+0000 7fa8f6a00700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fa8f010d3a0 con 0x7fa8f0108f70 2024-05-08T05:17:03.667 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:56.773+0000 7fa8efe00700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa8f0108f70 0x7fa8f007eb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:17:03.667 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:56.773+0000 7fa8efe00700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa8f0108f70 0x7fa8f007eb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:41176/0 (socket says 172.21.15.87:41176) 2024-05-08T05:17:03.667 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:56.773+0000 7fa8efe00700 1 -- 172.21.15.87:0/3064807433 learned_addr learned my addr 172.21.15.87:0/3064807433 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T05:17:03.668 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:56.774+0000 7fa8efe00700 1 -- 172.21.15.87:0/3064807433 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa8f007f090 con 0x7fa8f0108f70 2024-05-08T05:17:03.668 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:56.774+0000 7fa8efe00700 1 --2- 172.21.15.87:0/3064807433 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa8f0108f70 0x7fa8f007eb50 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fa8e0000c00 tx=0x7fa8e0011b70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:17:03.668 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:56.774+0000 7fa8ecc00700 1 -- 172.21.15.87:0/3064807433 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa8e0003b20 con 0x7fa8f0108f70 2024-05-08T05:17:03.668 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:56.774+0000 7fa8ecc00700 1 -- 172.21.15.87:0/3064807433 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) ==== 1070+0+0 (secure 0 0 0) 0x7fa8e001a8c0 con 0x7fa8f0108f70 2024-05-08T05:17:03.668 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:56.774+0000 7fa8f6a00700 1 -- 172.21.15.87:0/3064807433 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa8f007d280 con 0x7fa8f0108f70 2024-05-08T05:17:03.668 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:56.774+0000 7fa8ecc00700 1 -- 172.21.15.87:0/3064807433 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa8e0024940 con 0x7fa8f0108f70 2024-05-08T05:17:03.668 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:56.775+0000 7fa8f6a00700 1 -- 172.21.15.87:0/3064807433 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa8f007d7c0 con 0x7fa8f0108f70 2024-05-08T05:17:03.668 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:56.776+0000 7fa8f6a00700 1 -- 172.21.15.87:0/3064807433 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa8f0064b00 con 0x7fa8f0108f70 2024-05-08T05:17:03.668 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:56.776+0000 7fa8ecc00700 1 -- 172.21.15.87:0/3064807433 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 8) ==== 50222+0+0 (secure 0 0 0) 0x7fa8e0022020 con 0x7fa8f0108f70 2024-05-08T05:17:03.668 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:56.776+0000 7fa8ecc00700 1 --2- 172.21.15.87:0/3064807433 >> [v2:172.21.15.87:6800/2710124295,v1:172.21.15.87:6801/2710124295] conn(0x7fa8d403e580 0x7fa8d4040a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:17:03.668 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:56.776+0000 7fa8ecc00700 1 -- 172.21.15.87:0/3064807433 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7fa8e0053740 con 0x7fa8f0108f70 2024-05-08T05:17:03.668 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:56.777+0000 7fa8ef400700 1 --2- 172.21.15.87:0/3064807433 >> [v2:172.21.15.87:6800/2710124295,v1:172.21.15.87:6801/2710124295] conn(0x7fa8d403e580 0x7fa8d4040a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:17:03.668 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:56.777+0000 7fa8ef400700 1 --2- 172.21.15.87:0/3064807433 >> [v2:172.21.15.87:6800/2710124295,v1:172.21.15.87:6801/2710124295] conn(0x7fa8d403e580 0x7fa8d4040a40 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fa8dc006fd0 tx=0x7fa8dc006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:17:03.668 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:56.782+0000 7fa8ecc00700 1 -- 172.21.15.87:0/3064807433 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7fa8e001aa70 con 0x7fa8f0108f70 2024-05-08T05:17:03.669 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:16:57.012+0000 7fa8f6a00700 1 -- 172.21.15.87:0/3064807433 --> [v2:172.21.15.87:6800/2710124295,v1:172.21.15.87:6801/2710124295] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi087", "addr": "172.21.15.87", "target": ["mon-mgr", ""]}) -- 0x7fa8f0105660 con 0x7fa8d403e580 2024-05-08T05:17:03.669 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:02.884+0000 7fa8ecc00700 1 -- 172.21.15.87:0/3064807433 <== mgr.14120 v2:172.21.15.87:6800/2710124295 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+48 (secure 0 0 0) 0x7fa8f0105660 con 0x7fa8d403e580 2024-05-08T05:17:03.669 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:02.888+0000 7fa8f6a00700 1 -- 172.21.15.87:0/3064807433 >> [v2:172.21.15.87:6800/2710124295,v1:172.21.15.87:6801/2710124295] conn(0x7fa8d403e580 msgr2=0x7fa8d4040a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:17:03.669 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:02.888+0000 7fa8f6a00700 1 --2- 172.21.15.87:0/3064807433 >> [v2:172.21.15.87:6800/2710124295,v1:172.21.15.87:6801/2710124295] conn(0x7fa8d403e580 0x7fa8d4040a40 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fa8dc006fd0 tx=0x7fa8dc006e40 comp rx=0 tx=0).stop 2024-05-08T05:17:03.669 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:02.888+0000 7fa8f6a00700 1 -- 172.21.15.87:0/3064807433 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa8f0108f70 msgr2=0x7fa8f007eb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:17:03.669 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:02.888+0000 7fa8f6a00700 1 --2- 172.21.15.87:0/3064807433 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa8f0108f70 0x7fa8f007eb50 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fa8e0000c00 tx=0x7fa8e0011b70 comp rx=0 tx=0).stop 2024-05-08T05:17:03.669 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:02.888+0000 7fa8f6a00700 1 -- 172.21.15.87:0/3064807433 shutdown_connections 2024-05-08T05:17:03.669 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:02.888+0000 7fa8f6a00700 1 --2- 172.21.15.87:0/3064807433 >> [v2:172.21.15.87:6800/2710124295,v1:172.21.15.87:6801/2710124295] conn(0x7fa8d403e580 0x7fa8d4040a40 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:17:03.669 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:02.888+0000 7fa8f6a00700 1 --2- 172.21.15.87:0/3064807433 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa8f0108f70 0x7fa8f007eb50 secure :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fa8e0000c00 tx=0x7fa8e0011b70 comp rx=0 tx=0).stop 2024-05-08T05:17:03.669 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:02.888+0000 7fa8f6a00700 1 -- 172.21.15.87:0/3064807433 >> 172.21.15.87:0/3064807433 conn(0x7fa8f0104550 msgr2=0x7fa8f0104f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:17:03.669 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:02.889+0000 7fa8f6a00700 1 -- 172.21.15.87:0/3064807433 shutdown_connections 2024-05-08T05:17:03.669 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:02.889+0000 7fa8f6a00700 1 -- 172.21.15.87:0/3064807433 wait complete. 2024-05-08T05:17:03.669 INFO:teuthology.orchestra.run.smithi087.stdout:Deploying unmanaged mon service... 2024-05-08T05:17:03.960 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:17:03 smithi087 ceph-mon[29523]: from='mgr.14120 172.21.15.87:0/603415166' entity='mgr.x' 2024-05-08T05:17:03.960 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:17:03 smithi087 ceph-mon[29523]: Added host smithi087 2024-05-08T05:17:03.960 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:17:03 smithi087 ceph-mon[29523]: from='mgr.14120 172.21.15.87:0/603415166' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T05:17:05.426 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout Scheduled mon update... 2024-05-08T05:17:05.427 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:04.374+0000 7fc367000700 1 Processor -- start 2024-05-08T05:17:05.427 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:04.374+0000 7fc367000700 1 -- start start 2024-05-08T05:17:05.427 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:04.375+0000 7fc367000700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc360107870 0x7fc360107c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:17:05.427 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:04.375+0000 7fc367000700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fc36007ce10 con 0x7fc360107870 2024-05-08T05:17:05.427 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:04.375+0000 7fc35fe00700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc360107870 0x7fc360107c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:17:05.427 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:04.375+0000 7fc35fe00700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc360107870 0x7fc360107c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:41190/0 (socket says 172.21.15.87:41190) 2024-05-08T05:17:05.431 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:04.375+0000 7fc35fe00700 1 -- 172.21.15.87:0/2175962390 learned_addr learned my addr 172.21.15.87:0/2175962390 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T05:17:05.432 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:04.376+0000 7fc35fe00700 1 -- 172.21.15.87:0/2175962390 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc3601081d0 con 0x7fc360107870 2024-05-08T05:17:05.432 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:04.376+0000 7fc35fe00700 1 --2- 172.21.15.87:0/2175962390 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc360107870 0x7fc360107c90 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fc3500098a0 tx=0x7fc350009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ec1675c6bcc6632e server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:17:05.432 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:04.376+0000 7fc35f400700 1 -- 172.21.15.87:0/2175962390 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc350004160 con 0x7fc360107870 2024-05-08T05:17:05.432 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:04.376+0000 7fc35f400700 1 -- 172.21.15.87:0/2175962390 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) ==== 1070+0+0 (secure 0 0 0) 0x7fc350004300 con 0x7fc360107870 2024-05-08T05:17:05.432 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:04.376+0000 7fc35f400700 1 -- 172.21.15.87:0/2175962390 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc350011af0 con 0x7fc360107870 2024-05-08T05:17:05.432 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:04.377+0000 7fc367000700 1 -- 172.21.15.87:0/2175962390 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc360107870 msgr2=0x7fc360107c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:17:05.432 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:04.377+0000 7fc367000700 1 --2- 172.21.15.87:0/2175962390 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc360107870 0x7fc360107c90 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fc3500098a0 tx=0x7fc350009bb0 comp rx=0 tx=0).stop 2024-05-08T05:17:05.432 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:04.377+0000 7fc367000700 1 -- 172.21.15.87:0/2175962390 shutdown_connections 2024-05-08T05:17:05.432 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:04.377+0000 7fc367000700 1 --2- 172.21.15.87:0/2175962390 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc360107870 0x7fc360107c90 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:17:05.432 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:04.377+0000 7fc367000700 1 -- 172.21.15.87:0/2175962390 >> 172.21.15.87:0/2175962390 conn(0x7fc360103450 msgr2=0x7fc360105870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:17:05.432 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:04.377+0000 7fc367000700 1 -- 172.21.15.87:0/2175962390 shutdown_connections 2024-05-08T05:17:05.432 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:04.377+0000 7fc367000700 1 -- 172.21.15.87:0/2175962390 wait complete. 2024-05-08T05:17:05.433 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:04.378+0000 7fc367000700 1 Processor -- start 2024-05-08T05:17:05.433 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:04.379+0000 7fc367000700 1 -- start start 2024-05-08T05:17:05.433 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:04.379+0000 7fc367000700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc360107870 0x7fc36019ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:17:05.433 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:04.379+0000 7fc367000700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fc360109190 con 0x7fc360107870 2024-05-08T05:17:05.433 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:04.379+0000 7fc35fe00700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc360107870 0x7fc36019ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:17:05.433 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:04.379+0000 7fc35fe00700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc360107870 0x7fc36019ef60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:41196/0 (socket says 172.21.15.87:41196) 2024-05-08T05:17:05.433 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:04.379+0000 7fc35fe00700 1 -- 172.21.15.87:0/3201870839 learned_addr learned my addr 172.21.15.87:0/3201870839 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T05:17:05.433 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:04.380+0000 7fc35fe00700 1 -- 172.21.15.87:0/3201870839 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc36019f4a0 con 0x7fc360107870 2024-05-08T05:17:05.433 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:04.380+0000 7fc35fe00700 1 --2- 172.21.15.87:0/3201870839 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc360107870 0x7fc36019ef60 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fc350011ac0 tx=0x7fc350011ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:17:05.433 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:04.380+0000 7fc35d600700 1 -- 172.21.15.87:0/3201870839 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc350003b20 con 0x7fc360107870 2024-05-08T05:17:05.433 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:04.380+0000 7fc35d600700 1 -- 172.21.15.87:0/3201870839 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) ==== 1070+0+0 (secure 0 0 0) 0x7fc35001a8c0 con 0x7fc360107870 2024-05-08T05:17:05.433 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:04.380+0000 7fc367000700 1 -- 172.21.15.87:0/3201870839 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc36019f730 con 0x7fc360107870 2024-05-08T05:17:05.433 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:04.380+0000 7fc35d600700 1 -- 172.21.15.87:0/3201870839 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc3500248d0 con 0x7fc360107870 2024-05-08T05:17:05.434 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:04.380+0000 7fc367000700 1 -- 172.21.15.87:0/3201870839 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc3601a2420 con 0x7fc360107870 2024-05-08T05:17:05.434 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:04.382+0000 7fc35d600700 1 -- 172.21.15.87:0/3201870839 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 8) ==== 50222+0+0 (secure 0 0 0) 0x7fc350022020 con 0x7fc360107870 2024-05-08T05:17:05.434 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:04.382+0000 7fc367000700 1 -- 172.21.15.87:0/3201870839 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc360064b00 con 0x7fc360107870 2024-05-08T05:17:05.434 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:04.382+0000 7fc35d600700 1 --2- 172.21.15.87:0/3201870839 >> [v2:172.21.15.87:6800/2710124295,v1:172.21.15.87:6801/2710124295] conn(0x7fc34403e580 0x7fc344040a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:17:05.434 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:04.382+0000 7fc35d600700 1 -- 172.21.15.87:0/3201870839 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7fc350053810 con 0x7fc360107870 2024-05-08T05:17:05.434 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:04.382+0000 7fc357e00700 1 --2- 172.21.15.87:0/3201870839 >> [v2:172.21.15.87:6800/2710124295,v1:172.21.15.87:6801/2710124295] conn(0x7fc34403e580 0x7fc344040a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:17:05.434 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:04.383+0000 7fc357e00700 1 --2- 172.21.15.87:0/3201870839 >> [v2:172.21.15.87:6800/2710124295,v1:172.21.15.87:6801/2710124295] conn(0x7fc34403e580 0x7fc344040a40 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fc348006fd0 tx=0x7fc348006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:17:05.434 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:04.388+0000 7fc35d600700 1 -- 172.21.15.87:0/3201870839 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7fc35001aa70 con 0x7fc360107870 2024-05-08T05:17:05.434 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:04.651+0000 7fc367000700 1 -- 172.21.15.87:0/3201870839 --> [v2:172.21.15.87:6800/2710124295,v1:172.21.15.87:6801/2710124295] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mon", "unmanaged": true, "target": ["mon-mgr", ""]}) -- 0x7fc3600008d0 con 0x7fc34403e580 2024-05-08T05:17:05.434 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:04.658+0000 7fc35d600700 1 -- 172.21.15.87:0/3201870839 <== mgr.14120 v2:172.21.15.87:6800/2710124295 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+24 (secure 0 0 0) 0x7fc3600008d0 con 0x7fc34403e580 2024-05-08T05:17:05.434 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:04.661+0000 7fc367000700 1 -- 172.21.15.87:0/3201870839 >> [v2:172.21.15.87:6800/2710124295,v1:172.21.15.87:6801/2710124295] conn(0x7fc34403e580 msgr2=0x7fc344040a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:17:05.434 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:04.661+0000 7fc367000700 1 --2- 172.21.15.87:0/3201870839 >> [v2:172.21.15.87:6800/2710124295,v1:172.21.15.87:6801/2710124295] conn(0x7fc34403e580 0x7fc344040a40 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fc348006fd0 tx=0x7fc348006e40 comp rx=0 tx=0).stop 2024-05-08T05:17:05.434 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:04.661+0000 7fc367000700 1 -- 172.21.15.87:0/3201870839 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc360107870 msgr2=0x7fc36019ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:17:05.434 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:04.661+0000 7fc367000700 1 --2- 172.21.15.87:0/3201870839 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc360107870 0x7fc36019ef60 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fc350011ac0 tx=0x7fc350011ba0 comp rx=0 tx=0).stop 2024-05-08T05:17:05.435 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:04.661+0000 7fc367000700 1 -- 172.21.15.87:0/3201870839 shutdown_connections 2024-05-08T05:17:05.436 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:04.661+0000 7fc367000700 1 --2- 172.21.15.87:0/3201870839 >> [v2:172.21.15.87:6800/2710124295,v1:172.21.15.87:6801/2710124295] conn(0x7fc34403e580 0x7fc344040a40 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:17:05.436 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:04.661+0000 7fc367000700 1 --2- 172.21.15.87:0/3201870839 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc360107870 0x7fc36019ef60 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:17:05.436 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:04.661+0000 7fc367000700 1 -- 172.21.15.87:0/3201870839 >> 172.21.15.87:0/3201870839 conn(0x7fc360103450 msgr2=0x7fc360193200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:17:05.436 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:04.661+0000 7fc367000700 1 -- 172.21.15.87:0/3201870839 shutdown_connections 2024-05-08T05:17:05.436 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:04.661+0000 7fc367000700 1 -- 172.21.15.87:0/3201870839 wait complete. 2024-05-08T05:17:05.436 INFO:teuthology.orchestra.run.smithi087.stdout:Deploying unmanaged mgr service... 2024-05-08T05:17:05.667 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:17:05 smithi087 ceph-mon[29523]: from='client.14142 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "unmanaged": true, "target": ["mon-mgr", ""]}]: dispatch 2024-05-08T05:17:05.667 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:17:05 smithi087 ceph-mon[29523]: Saving service mon spec with placement count:5 2024-05-08T05:17:05.667 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:17:05 smithi087 ceph-mon[29523]: from='mgr.14120 172.21.15.87:0/603415166' entity='mgr.x' 2024-05-08T05:17:07.708 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:17:07 smithi087 ceph-mon[29523]: from='mgr.14120 172.21.15.87:0/603415166' entity='mgr.x' 2024-05-08T05:17:07.708 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:17:07 smithi087 ceph-mon[29523]: from='mgr.14120 172.21.15.87:0/603415166' entity='mgr.x' 2024-05-08T05:17:07.708 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:17:07 smithi087 ceph-mon[29523]: from='mgr.14120 172.21.15.87:0/603415166' entity='mgr.x' 2024-05-08T05:17:07.861 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout Scheduled mgr update... 2024-05-08T05:17:07.862 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:06.917+0000 7f8722600700 1 Processor -- start 2024-05-08T05:17:07.862 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:06.917+0000 7f8722600700 1 -- start start 2024-05-08T05:17:07.862 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:06.918+0000 7f8722600700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f871c07dd90 0x7f871c07c1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:17:07.862 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:06.918+0000 7f8722600700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f871c07c7c0 con 0x7f871c07dd90 2024-05-08T05:17:07.862 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:06.918+0000 7f871b400700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f871c07dd90 0x7f871c07c1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:17:07.862 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:06.918+0000 7f871b400700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f871c07dd90 0x7f871c07c1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:47326/0 (socket says 172.21.15.87:47326) 2024-05-08T05:17:07.862 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:06.918+0000 7f871b400700 1 -- 172.21.15.87:0/2903159349 learned_addr learned my addr 172.21.15.87:0/2903159349 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T05:17:07.862 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:06.919+0000 7f871b400700 1 -- 172.21.15.87:0/2903159349 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f871c07c940 con 0x7f871c07dd90 2024-05-08T05:17:07.862 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:06.919+0000 7f871b400700 1 --2- 172.21.15.87:0/2903159349 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f871c07dd90 0x7f871c07c1f0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f870c0098a0 tx=0x7f870c009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b6b1b5a6bf55bfdd server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:17:07.862 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:06.919+0000 7f871a000700 1 -- 172.21.15.87:0/2903159349 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f870c004160 con 0x7f871c07dd90 2024-05-08T05:17:07.862 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:06.919+0000 7f871a000700 1 -- 172.21.15.87:0/2903159349 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f870c004300 con 0x7f871c07dd90 2024-05-08T05:17:07.862 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:06.919+0000 7f871a000700 1 -- 172.21.15.87:0/2903159349 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f870c011a20 con 0x7f871c07dd90 2024-05-08T05:17:07.863 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:06.920+0000 7f8722600700 1 -- 172.21.15.87:0/2903159349 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f871c07dd90 msgr2=0x7f871c07c1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:17:07.863 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:06.920+0000 7f8722600700 1 --2- 172.21.15.87:0/2903159349 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f871c07dd90 0x7f871c07c1f0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f870c0098a0 tx=0x7f870c009bb0 comp rx=0 tx=0).stop 2024-05-08T05:17:07.863 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:06.920+0000 7f8722600700 1 -- 172.21.15.87:0/2903159349 shutdown_connections 2024-05-08T05:17:07.863 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:06.920+0000 7f8722600700 1 --2- 172.21.15.87:0/2903159349 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f871c07dd90 0x7f871c07c1f0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:17:07.863 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:06.920+0000 7f8722600700 1 -- 172.21.15.87:0/2903159349 >> 172.21.15.87:0/2903159349 conn(0x7f871c104560 msgr2=0x7f871c106980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:17:07.863 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:06.920+0000 7f8722600700 1 -- 172.21.15.87:0/2903159349 shutdown_connections 2024-05-08T05:17:07.863 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:06.920+0000 7f8722600700 1 -- 172.21.15.87:0/2903159349 wait complete. 2024-05-08T05:17:07.863 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:06.921+0000 7f8722600700 1 Processor -- start 2024-05-08T05:17:07.863 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:06.921+0000 7f8722600700 1 -- start start 2024-05-08T05:17:07.863 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:06.922+0000 7f8722600700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f871c07dd90 0x7f871c19ef70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:17:07.863 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:06.922+0000 7f8722600700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f871c10f580 con 0x7f871c07dd90 2024-05-08T05:17:07.863 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:06.922+0000 7f871b400700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f871c07dd90 0x7f871c19ef70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:17:07.863 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:06.922+0000 7f871b400700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f871c07dd90 0x7f871c19ef70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:47330/0 (socket says 172.21.15.87:47330) 2024-05-08T05:17:07.863 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:06.922+0000 7f871b400700 1 -- 172.21.15.87:0/2614355293 learned_addr learned my addr 172.21.15.87:0/2614355293 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T05:17:07.863 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:06.922+0000 7f871b400700 1 -- 172.21.15.87:0/2614355293 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f871c19f4b0 con 0x7f871c07dd90 2024-05-08T05:17:07.864 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:06.923+0000 7f871b400700 1 --2- 172.21.15.87:0/2614355293 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f871c07dd90 0x7f871c19ef70 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f870c000c00 tx=0x7f870c011aa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:17:07.864 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:06.923+0000 7f8713e00700 1 -- 172.21.15.87:0/2614355293 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f870c003aa0 con 0x7f871c07dd90 2024-05-08T05:17:07.864 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:06.923+0000 7f8713e00700 1 -- 172.21.15.87:0/2614355293 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f870c01b8f0 con 0x7f871c07dd90 2024-05-08T05:17:07.864 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:06.923+0000 7f8713e00700 1 -- 172.21.15.87:0/2614355293 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f870c023890 con 0x7f871c07dd90 2024-05-08T05:17:07.864 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:06.923+0000 7f8722600700 1 -- 172.21.15.87:0/2614355293 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f871c19f740 con 0x7f871c07dd90 2024-05-08T05:17:07.864 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:06.923+0000 7f8722600700 1 -- 172.21.15.87:0/2614355293 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f871c1a2430 con 0x7f871c07dd90 2024-05-08T05:17:07.864 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:06.924+0000 7f8722600700 1 -- 172.21.15.87:0/2614355293 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f871c064b00 con 0x7f871c07dd90 2024-05-08T05:17:07.864 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:06.925+0000 7f8713e00700 1 -- 172.21.15.87:0/2614355293 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 8) ==== 50222+0+0 (secure 0 0 0) 0x7f870c01b440 con 0x7f871c07dd90 2024-05-08T05:17:07.864 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:06.925+0000 7f8713e00700 1 --2- 172.21.15.87:0/2614355293 >> [v2:172.21.15.87:6800/2710124295,v1:172.21.15.87:6801/2710124295] conn(0x7f870003e530 0x7f87000409f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:17:07.864 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:06.925+0000 7f8713e00700 1 -- 172.21.15.87:0/2614355293 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f870c053f40 con 0x7f871c07dd90 2024-05-08T05:17:07.864 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:06.926+0000 7f871aa00700 1 --2- 172.21.15.87:0/2614355293 >> [v2:172.21.15.87:6800/2710124295,v1:172.21.15.87:6801/2710124295] conn(0x7f870003e530 0x7f87000409f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:17:07.864 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:06.926+0000 7f871aa00700 1 --2- 172.21.15.87:0/2614355293 >> [v2:172.21.15.87:6800/2710124295,v1:172.21.15.87:6801/2710124295] conn(0x7f870003e530 0x7f87000409f0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f8708006fd0 tx=0x7f8708006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:17:07.864 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:06.932+0000 7f8713e00700 1 -- 172.21.15.87:0/2614355293 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f870c01f030 con 0x7f871c07dd90 2024-05-08T05:17:07.864 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:07.180+0000 7f8722600700 1 -- 172.21.15.87:0/2614355293 --> [v2:172.21.15.87:6800/2710124295,v1:172.21.15.87:6801/2710124295] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mgr", "unmanaged": true, "target": ["mon-mgr", ""]}) -- 0x7f871c105650 con 0x7f870003e530 2024-05-08T05:17:07.864 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:07.187+0000 7f8713e00700 1 -- 172.21.15.87:0/2614355293 <== mgr.14120 v2:172.21.15.87:6800/2710124295 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+24 (secure 0 0 0) 0x7f871c105650 con 0x7f870003e530 2024-05-08T05:17:07.865 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:07.191+0000 7f8722600700 1 -- 172.21.15.87:0/2614355293 >> [v2:172.21.15.87:6800/2710124295,v1:172.21.15.87:6801/2710124295] conn(0x7f870003e530 msgr2=0x7f87000409f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:17:07.865 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:07.191+0000 7f8722600700 1 --2- 172.21.15.87:0/2614355293 >> [v2:172.21.15.87:6800/2710124295,v1:172.21.15.87:6801/2710124295] conn(0x7f870003e530 0x7f87000409f0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f8708006fd0 tx=0x7f8708006e40 comp rx=0 tx=0).stop 2024-05-08T05:17:07.865 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:07.191+0000 7f8722600700 1 -- 172.21.15.87:0/2614355293 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f871c07dd90 msgr2=0x7f871c19ef70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:17:07.865 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:07.191+0000 7f8722600700 1 --2- 172.21.15.87:0/2614355293 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f871c07dd90 0x7f871c19ef70 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f870c000c00 tx=0x7f870c011aa0 comp rx=0 tx=0).stop 2024-05-08T05:17:07.865 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:07.192+0000 7f8722600700 1 -- 172.21.15.87:0/2614355293 shutdown_connections 2024-05-08T05:17:07.865 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:07.192+0000 7f8722600700 1 --2- 172.21.15.87:0/2614355293 >> [v2:172.21.15.87:6800/2710124295,v1:172.21.15.87:6801/2710124295] conn(0x7f870003e530 0x7f87000409f0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:17:07.865 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:07.192+0000 7f8722600700 1 --2- 172.21.15.87:0/2614355293 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f871c07dd90 0x7f871c19ef70 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:17:07.865 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:07.192+0000 7f8722600700 1 -- 172.21.15.87:0/2614355293 >> 172.21.15.87:0/2614355293 conn(0x7f871c104560 msgr2=0x7f871c104f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:17:07.865 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:07.192+0000 7f8722600700 1 -- 172.21.15.87:0/2614355293 shutdown_connections 2024-05-08T05:17:07.865 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:07.192+0000 7f8722600700 1 -- 172.21.15.87:0/2614355293 wait complete. 2024-05-08T05:17:08.708 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:17:08 smithi087 ceph-mon[29523]: from='client.14144 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "unmanaged": true, "target": ["mon-mgr", ""]}]: dispatch 2024-05-08T05:17:08.708 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:17:08 smithi087 ceph-mon[29523]: Saving service mgr spec with placement count:2 2024-05-08T05:17:09.673 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:08.459+0000 7fa608c00700 1 Processor -- start 2024-05-08T05:17:09.673 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:08.459+0000 7fa608c00700 1 -- start start 2024-05-08T05:17:09.673 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:08.460+0000 7fa608c00700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa60410b180 0x7fa60410b5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:17:09.673 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:08.460+0000 7fa608c00700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fa60410bb70 con 0x7fa60410b180 2024-05-08T05:17:09.673 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:08.460+0000 7fa601e00700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa60410b180 0x7fa60410b5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:17:09.674 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:08.460+0000 7fa601e00700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa60410b180 0x7fa60410b5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:47332/0 (socket says 172.21.15.87:47332) 2024-05-08T05:17:09.674 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:08.460+0000 7fa601e00700 1 -- 172.21.15.87:0/4176317800 learned_addr learned my addr 172.21.15.87:0/4176317800 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T05:17:09.674 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:08.461+0000 7fa601e00700 1 -- 172.21.15.87:0/4176317800 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa60410c380 con 0x7fa60410b180 2024-05-08T05:17:09.674 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:08.461+0000 7fa601e00700 1 --2- 172.21.15.87:0/4176317800 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa60410b180 0x7fa60410b5a0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fa5f40098a0 tx=0x7fa5f4009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e6d2d93d9e21032e server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:17:09.674 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:08.461+0000 7fa600a00700 1 -- 172.21.15.87:0/4176317800 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa5f4004160 con 0x7fa60410b180 2024-05-08T05:17:09.674 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:08.461+0000 7fa600a00700 1 -- 172.21.15.87:0/4176317800 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa5f4004300 con 0x7fa60410b180 2024-05-08T05:17:09.674 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:08.461+0000 7fa600a00700 1 -- 172.21.15.87:0/4176317800 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa5f4011a20 con 0x7fa60410b180 2024-05-08T05:17:09.674 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:08.462+0000 7fa608c00700 1 -- 172.21.15.87:0/4176317800 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa60410b180 msgr2=0x7fa60410b5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:17:09.674 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:08.462+0000 7fa608c00700 1 --2- 172.21.15.87:0/4176317800 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa60410b180 0x7fa60410b5a0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fa5f40098a0 tx=0x7fa5f4009bb0 comp rx=0 tx=0).stop 2024-05-08T05:17:09.674 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:08.462+0000 7fa608c00700 1 -- 172.21.15.87:0/4176317800 shutdown_connections 2024-05-08T05:17:09.674 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:08.462+0000 7fa608c00700 1 --2- 172.21.15.87:0/4176317800 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa60410b180 0x7fa60410b5a0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:17:09.674 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:08.462+0000 7fa608c00700 1 -- 172.21.15.87:0/4176317800 >> 172.21.15.87:0/4176317800 conn(0x7fa604106900 msgr2=0x7fa604108cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:17:09.674 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:08.462+0000 7fa608c00700 1 -- 172.21.15.87:0/4176317800 shutdown_connections 2024-05-08T05:17:09.675 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:08.462+0000 7fa608c00700 1 -- 172.21.15.87:0/4176317800 wait complete. 2024-05-08T05:17:09.675 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:08.463+0000 7fa608c00700 1 Processor -- start 2024-05-08T05:17:09.675 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:08.463+0000 7fa608c00700 1 -- start start 2024-05-08T05:17:09.675 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:08.464+0000 7fa608c00700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa60410b180 0x7fa60419ef30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:17:09.675 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:08.464+0000 7fa608c00700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fa60410f730 con 0x7fa60410b180 2024-05-08T05:17:09.675 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:08.464+0000 7fa601e00700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa60410b180 0x7fa60419ef30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:17:09.675 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:08.464+0000 7fa601e00700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa60410b180 0x7fa60419ef30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:47336/0 (socket says 172.21.15.87:47336) 2024-05-08T05:17:09.675 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:08.464+0000 7fa601e00700 1 -- 172.21.15.87:0/3434106291 learned_addr learned my addr 172.21.15.87:0/3434106291 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T05:17:09.675 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:08.464+0000 7fa601e00700 1 -- 172.21.15.87:0/3434106291 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa60419f470 con 0x7fa60410b180 2024-05-08T05:17:09.675 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:08.464+0000 7fa601e00700 1 --2- 172.21.15.87:0/3434106291 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa60410b180 0x7fa60419ef30 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fa5f40116e0 tx=0x7fa5f4011aa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:17:09.675 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:08.465+0000 7fa5faa00700 1 -- 172.21.15.87:0/3434106291 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa5f40039e0 con 0x7fa60410b180 2024-05-08T05:17:09.675 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:08.465+0000 7fa608c00700 1 -- 172.21.15.87:0/3434106291 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa60419f700 con 0x7fa60410b180 2024-05-08T05:17:09.675 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:08.465+0000 7fa5faa00700 1 -- 172.21.15.87:0/3434106291 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa5f401b8f0 con 0x7fa60410b180 2024-05-08T05:17:09.675 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:08.465+0000 7fa5faa00700 1 -- 172.21.15.87:0/3434106291 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa5f4023760 con 0x7fa60410b180 2024-05-08T05:17:09.676 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:08.465+0000 7fa608c00700 1 -- 172.21.15.87:0/3434106291 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa6041a23f0 con 0x7fa60410b180 2024-05-08T05:17:09.676 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:08.466+0000 7fa5faa00700 1 -- 172.21.15.87:0/3434106291 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 8) ==== 50222+0+0 (secure 0 0 0) 0x7fa5f401b440 con 0x7fa60410b180 2024-05-08T05:17:09.676 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:08.466+0000 7fa608c00700 1 -- 172.21.15.87:0/3434106291 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa60410f8b0 con 0x7fa60410b180 2024-05-08T05:17:09.676 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:08.467+0000 7fa5faa00700 1 --2- 172.21.15.87:0/3434106291 >> [v2:172.21.15.87:6800/2710124295,v1:172.21.15.87:6801/2710124295] conn(0x7fa5e803e4e0 0x7fa5e80409a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:17:09.676 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:08.467+0000 7fa5faa00700 1 -- 172.21.15.87:0/3434106291 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7fa5f4053e10 con 0x7fa60410b180 2024-05-08T05:17:09.676 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:08.467+0000 7fa601400700 1 --2- 172.21.15.87:0/3434106291 >> [v2:172.21.15.87:6800/2710124295,v1:172.21.15.87:6801/2710124295] conn(0x7fa5e803e4e0 0x7fa5e80409a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:17:09.676 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:08.468+0000 7fa601400700 1 --2- 172.21.15.87:0/3434106291 >> [v2:172.21.15.87:6800/2710124295,v1:172.21.15.87:6801/2710124295] conn(0x7fa5e803e4e0 0x7fa5e80409a0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fa5f0006fd0 tx=0x7fa5f0006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:17:09.676 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:08.472+0000 7fa5faa00700 1 -- 172.21.15.87:0/3434106291 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7fa5f401f030 con 0x7fa60410b180 2024-05-08T05:17:09.676 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:08.734+0000 7fa608c00700 1 -- 172.21.15.87:0/3434106291 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command([{prefix=config set, name=mgr/cephadm/container_init}] v 0) -- 0x7fa6041a29a0 con 0x7fa60410b180 2024-05-08T05:17:09.676 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:08.738+0000 7fa5faa00700 1 -- 172.21.15.87:0/3434106291 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/container_init}]=0 v7)=0 v7) ==== 142+0+0 (secure 0 0 0) 0x7fa5f4023e00 con 0x7fa60410b180 2024-05-08T05:17:09.676 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:08.741+0000 7fa608c00700 1 -- 172.21.15.87:0/3434106291 >> [v2:172.21.15.87:6800/2710124295,v1:172.21.15.87:6801/2710124295] conn(0x7fa5e803e4e0 msgr2=0x7fa5e80409a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:17:09.676 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:08.741+0000 7fa608c00700 1 --2- 172.21.15.87:0/3434106291 >> [v2:172.21.15.87:6800/2710124295,v1:172.21.15.87:6801/2710124295] conn(0x7fa5e803e4e0 0x7fa5e80409a0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fa5f0006fd0 tx=0x7fa5f0006e40 comp rx=0 tx=0).stop 2024-05-08T05:17:09.676 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:08.741+0000 7fa608c00700 1 -- 172.21.15.87:0/3434106291 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa60410b180 msgr2=0x7fa60419ef30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:17:09.676 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:08.741+0000 7fa608c00700 1 --2- 172.21.15.87:0/3434106291 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa60410b180 0x7fa60419ef30 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fa5f40116e0 tx=0x7fa5f4011aa0 comp rx=0 tx=0).stop 2024-05-08T05:17:09.677 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:08.741+0000 7fa608c00700 1 -- 172.21.15.87:0/3434106291 shutdown_connections 2024-05-08T05:17:09.677 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:08.741+0000 7fa608c00700 1 --2- 172.21.15.87:0/3434106291 >> [v2:172.21.15.87:6800/2710124295,v1:172.21.15.87:6801/2710124295] conn(0x7fa5e803e4e0 0x7fa5e80409a0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:17:09.677 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:08.741+0000 7fa608c00700 1 --2- 172.21.15.87:0/3434106291 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa60410b180 0x7fa60419ef30 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:17:09.677 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:08.741+0000 7fa608c00700 1 -- 172.21.15.87:0/3434106291 >> 172.21.15.87:0/3434106291 conn(0x7fa604106900 msgr2=0x7fa6041082a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:17:09.677 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:08.742+0000 7fa608c00700 1 -- 172.21.15.87:0/3434106291 shutdown_connections 2024-05-08T05:17:09.677 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:08.742+0000 7fa608c00700 1 -- 172.21.15.87:0/3434106291 wait complete. 2024-05-08T05:17:09.823 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:17:09 smithi087 ceph-mon[29523]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-08T05:17:09.823 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:17:09 smithi087 ceph-mon[29523]: from='client.? 172.21.15.87:0/3434106291' entity='client.admin' 2024-05-08T05:17:11.458 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:17:11 smithi087 ceph-mon[29523]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-08T05:17:11.458 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:17:11 smithi087 ceph-mon[29523]: from='mgr.14120 172.21.15.87:0/603415166' entity='mgr.x' 2024-05-08T05:17:11.459 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:17:11 smithi087 ceph-mon[29523]: from='client.? 172.21.15.87:0/853369416' entity='client.admin' 2024-05-08T05:17:11.492 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:10.613+0000 7fa59aa00700 1 Processor -- start 2024-05-08T05:17:11.492 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:10.613+0000 7fa59aa00700 1 -- start start 2024-05-08T05:17:11.492 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:10.614+0000 7fa59aa00700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa594108fa0 0x7fa5941093c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:17:11.493 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:10.614+0000 7fa59aa00700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fa594109990 con 0x7fa594108fa0 2024-05-08T05:17:11.493 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:10.614+0000 7fa593e00700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa594108fa0 0x7fa5941093c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:17:11.493 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:10.614+0000 7fa593e00700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa594108fa0 0x7fa5941093c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:47352/0 (socket says 172.21.15.87:47352) 2024-05-08T05:17:11.493 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:10.614+0000 7fa593e00700 1 -- 172.21.15.87:0/3552594769 learned_addr learned my addr 172.21.15.87:0/3552594769 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T05:17:11.493 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:10.615+0000 7fa593e00700 1 -- 172.21.15.87:0/3552594769 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa59410a1a0 con 0x7fa594108fa0 2024-05-08T05:17:11.497 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:10.615+0000 7fa593e00700 1 --2- 172.21.15.87:0/3552594769 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa594108fa0 0x7fa5941093c0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fa5840098a0 tx=0x7fa584009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3c3fc6088cc6590e server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:17:11.497 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:10.615+0000 7fa592a00700 1 -- 172.21.15.87:0/3552594769 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa584004160 con 0x7fa594108fa0 2024-05-08T05:17:11.498 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:10.615+0000 7fa592a00700 1 -- 172.21.15.87:0/3552594769 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa584004300 con 0x7fa594108fa0 2024-05-08T05:17:11.498 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:10.615+0000 7fa592a00700 1 -- 172.21.15.87:0/3552594769 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa584011a20 con 0x7fa594108fa0 2024-05-08T05:17:11.498 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:10.616+0000 7fa59aa00700 1 -- 172.21.15.87:0/3552594769 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa594108fa0 msgr2=0x7fa5941093c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:17:11.498 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:10.616+0000 7fa59aa00700 1 --2- 172.21.15.87:0/3552594769 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa594108fa0 0x7fa5941093c0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fa5840098a0 tx=0x7fa584009bb0 comp rx=0 tx=0).stop 2024-05-08T05:17:11.498 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:10.616+0000 7fa59aa00700 1 -- 172.21.15.87:0/3552594769 shutdown_connections 2024-05-08T05:17:11.498 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:10.616+0000 7fa59aa00700 1 --2- 172.21.15.87:0/3552594769 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa594108fa0 0x7fa5941093c0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:17:11.498 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:10.616+0000 7fa59aa00700 1 -- 172.21.15.87:0/3552594769 >> 172.21.15.87:0/3552594769 conn(0x7fa594104560 msgr2=0x7fa594106980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:17:11.499 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:10.616+0000 7fa59aa00700 1 -- 172.21.15.87:0/3552594769 shutdown_connections 2024-05-08T05:17:11.499 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:10.616+0000 7fa59aa00700 1 -- 172.21.15.87:0/3552594769 wait complete. 2024-05-08T05:17:11.499 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:10.617+0000 7fa59aa00700 1 Processor -- start 2024-05-08T05:17:11.499 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:10.618+0000 7fa59aa00700 1 -- start start 2024-05-08T05:17:11.499 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:10.618+0000 7fa59aa00700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa594108fa0 0x7fa59419f000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:17:11.499 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:10.618+0000 7fa59aa00700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fa59410d550 con 0x7fa594108fa0 2024-05-08T05:17:11.499 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:10.618+0000 7fa593e00700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa594108fa0 0x7fa59419f000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:17:11.499 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:10.618+0000 7fa593e00700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa594108fa0 0x7fa59419f000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:47356/0 (socket says 172.21.15.87:47356) 2024-05-08T05:17:11.499 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:10.618+0000 7fa593e00700 1 -- 172.21.15.87:0/853369416 learned_addr learned my addr 172.21.15.87:0/853369416 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T05:17:11.499 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:10.619+0000 7fa593e00700 1 -- 172.21.15.87:0/853369416 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa59419f540 con 0x7fa594108fa0 2024-05-08T05:17:11.499 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:10.619+0000 7fa593e00700 1 --2- 172.21.15.87:0/853369416 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa594108fa0 0x7fa59419f000 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fa5840119f0 tx=0x7fa584011ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:17:11.499 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:10.619+0000 7fa590c00700 1 -- 172.21.15.87:0/853369416 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa5840039e0 con 0x7fa594108fa0 2024-05-08T05:17:11.499 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:10.619+0000 7fa590c00700 1 -- 172.21.15.87:0/853369416 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa58401b8f0 con 0x7fa594108fa0 2024-05-08T05:17:11.500 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:10.619+0000 7fa59aa00700 1 -- 172.21.15.87:0/853369416 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa59419f7d0 con 0x7fa594108fa0 2024-05-08T05:17:11.500 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:10.619+0000 7fa590c00700 1 -- 172.21.15.87:0/853369416 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa5840237a0 con 0x7fa594108fa0 2024-05-08T05:17:11.500 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:10.619+0000 7fa59aa00700 1 -- 172.21.15.87:0/853369416 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa5941a24c0 con 0x7fa594108fa0 2024-05-08T05:17:11.500 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:10.621+0000 7fa59aa00700 1 -- 172.21.15.87:0/853369416 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa59410d6d0 con 0x7fa594108fa0 2024-05-08T05:17:11.500 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:10.621+0000 7fa590c00700 1 -- 172.21.15.87:0/853369416 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 8) ==== 50222+0+0 (secure 0 0 0) 0x7fa58401b440 con 0x7fa594108fa0 2024-05-08T05:17:11.500 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:10.622+0000 7fa590c00700 1 --2- 172.21.15.87:0/853369416 >> [v2:172.21.15.87:6800/2710124295,v1:172.21.15.87:6801/2710124295] conn(0x7fa57803e4e0 0x7fa5780409a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:17:11.500 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:10.622+0000 7fa590c00700 1 -- 172.21.15.87:0/853369416 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7fa584053ef0 con 0x7fa594108fa0 2024-05-08T05:17:11.500 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:10.622+0000 7fa593400700 1 --2- 172.21.15.87:0/853369416 >> [v2:172.21.15.87:6800/2710124295,v1:172.21.15.87:6801/2710124295] conn(0x7fa57803e4e0 0x7fa5780409a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:17:11.500 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:10.623+0000 7fa593400700 1 --2- 172.21.15.87:0/853369416 >> [v2:172.21.15.87:6800/2710124295,v1:172.21.15.87:6801/2710124295] conn(0x7fa57803e4e0 0x7fa5780409a0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fa580006fd0 tx=0x7fa580006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:17:11.500 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:10.632+0000 7fa590c00700 1 -- 172.21.15.87:0/853369416 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7fa58401f030 con 0x7fa594108fa0 2024-05-08T05:17:11.500 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:10.862+0000 7fa59aa00700 1 -- 172.21.15.87:0/853369416 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command([{prefix=config set, name=mgr/dashboard/ssl_server_port}] v 0) -- 0x7fa5941a2ae0 con 0x7fa594108fa0 2024-05-08T05:17:11.500 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:10.867+0000 7fa590c00700 1 -- 172.21.15.87:0/853369416 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/dashboard/ssl_server_port}]=0 v8)=0 v8) ==== 130+0+0 (secure 0 0 0) 0x7fa584019e20 con 0x7fa594108fa0 2024-05-08T05:17:11.500 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:10.871+0000 7fa59aa00700 1 -- 172.21.15.87:0/853369416 >> [v2:172.21.15.87:6800/2710124295,v1:172.21.15.87:6801/2710124295] conn(0x7fa57803e4e0 msgr2=0x7fa5780409a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:17:11.501 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:10.871+0000 7fa59aa00700 1 --2- 172.21.15.87:0/853369416 >> [v2:172.21.15.87:6800/2710124295,v1:172.21.15.87:6801/2710124295] conn(0x7fa57803e4e0 0x7fa5780409a0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fa580006fd0 tx=0x7fa580006e40 comp rx=0 tx=0).stop 2024-05-08T05:17:11.501 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:10.871+0000 7fa59aa00700 1 -- 172.21.15.87:0/853369416 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa594108fa0 msgr2=0x7fa59419f000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:17:11.501 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:10.871+0000 7fa59aa00700 1 --2- 172.21.15.87:0/853369416 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa594108fa0 0x7fa59419f000 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fa5840119f0 tx=0x7fa584011ad0 comp rx=0 tx=0).stop 2024-05-08T05:17:11.501 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:10.872+0000 7fa59aa00700 1 -- 172.21.15.87:0/853369416 shutdown_connections 2024-05-08T05:17:11.501 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:10.872+0000 7fa59aa00700 1 --2- 172.21.15.87:0/853369416 >> [v2:172.21.15.87:6800/2710124295,v1:172.21.15.87:6801/2710124295] conn(0x7fa57803e4e0 0x7fa5780409a0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:17:11.501 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:10.872+0000 7fa59aa00700 1 --2- 172.21.15.87:0/853369416 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa594108fa0 0x7fa59419f000 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:17:11.501 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:10.872+0000 7fa59aa00700 1 -- 172.21.15.87:0/853369416 >> 172.21.15.87:0/853369416 conn(0x7fa594104560 msgr2=0x7fa594104f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:17:11.501 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:10.872+0000 7fa59aa00700 1 -- 172.21.15.87:0/853369416 shutdown_connections 2024-05-08T05:17:11.501 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:10.872+0000 7fa59aa00700 1 -- 172.21.15.87:0/853369416 wait complete. 2024-05-08T05:17:11.501 INFO:teuthology.orchestra.run.smithi087.stdout:Enabling the dashboard module... 2024-05-08T05:17:13.681 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:17:13 smithi087 ceph-mon[29523]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-08T05:17:13.681 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:17:13 smithi087 ceph-mon[29523]: from='client.? 172.21.15.87:0/393848608' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "dashboard"}]: dispatch 2024-05-08T05:17:13.681 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:17:13 smithi087 ceph-mon[29523]: from='mgr.14120 172.21.15.87:0/603415166' entity='mgr.x' 2024-05-08T05:17:13.681 INFO:journalctl@ceph.mgr.x.smithi087.stdout:May 08 05:17:13 smithi087 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-mgr-x[29765]: ignoring --setuser ceph since I am not root 2024-05-08T05:17:13.681 INFO:journalctl@ceph.mgr.x.smithi087.stdout:May 08 05:17:13 smithi087 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-mgr-x[29765]: ignoring --setgroup ceph since I am not root 2024-05-08T05:17:13.681 INFO:journalctl@ceph.mgr.x.smithi087.stdout:May 08 05:17:13 smithi087 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-mgr-x[29765]: 2024-05-08T05:17:13.679+0000 7f6e450ec200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-05-08T05:17:14.093 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:12.141+0000 7fec55400700 1 Processor -- start 2024-05-08T05:17:14.094 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:12.141+0000 7fec55400700 1 -- start start 2024-05-08T05:17:14.094 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:12.142+0000 7fec55400700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fec50108e00 0x7fec50109220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:17:14.095 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:12.142+0000 7fec55400700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fec501097f0 con 0x7fec50108e00 2024-05-08T05:17:14.095 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:12.142+0000 7fec4fe00700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fec50108e00 0x7fec50109220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:17:14.095 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:12.142+0000 7fec4fe00700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fec50108e00 0x7fec50109220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:47370/0 (socket says 172.21.15.87:47370) 2024-05-08T05:17:14.095 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:12.142+0000 7fec4fe00700 1 -- 172.21.15.87:0/2532647625 learned_addr learned my addr 172.21.15.87:0/2532647625 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T05:17:14.096 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:12.143+0000 7fec4fe00700 1 -- 172.21.15.87:0/2532647625 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fec50109fb0 con 0x7fec50108e00 2024-05-08T05:17:14.097 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:12.143+0000 7fec4fe00700 1 --2- 172.21.15.87:0/2532647625 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fec50108e00 0x7fec50109220 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fec400098a0 tx=0x7fec40009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=39dd62b58382279e server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:17:14.097 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:12.143+0000 7fec4ea00700 1 -- 172.21.15.87:0/2532647625 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fec40004160 con 0x7fec50108e00 2024-05-08T05:17:14.097 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:12.143+0000 7fec4ea00700 1 -- 172.21.15.87:0/2532647625 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fec40004300 con 0x7fec50108e00 2024-05-08T05:17:14.097 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:12.143+0000 7fec4ea00700 1 -- 172.21.15.87:0/2532647625 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fec40011a20 con 0x7fec50108e00 2024-05-08T05:17:14.097 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:12.144+0000 7fec55400700 1 -- 172.21.15.87:0/2532647625 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fec50108e00 msgr2=0x7fec50109220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:17:14.097 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:12.144+0000 7fec55400700 1 --2- 172.21.15.87:0/2532647625 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fec50108e00 0x7fec50109220 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fec400098a0 tx=0x7fec40009bb0 comp rx=0 tx=0).stop 2024-05-08T05:17:14.097 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:12.144+0000 7fec55400700 1 -- 172.21.15.87:0/2532647625 shutdown_connections 2024-05-08T05:17:14.097 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:12.144+0000 7fec55400700 1 --2- 172.21.15.87:0/2532647625 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fec50108e00 0x7fec50109220 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:17:14.097 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:12.144+0000 7fec55400700 1 -- 172.21.15.87:0/2532647625 >> 172.21.15.87:0/2532647625 conn(0x7fec501043a0 msgr2=0x7fec501067e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:17:14.097 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:12.144+0000 7fec55400700 1 -- 172.21.15.87:0/2532647625 shutdown_connections 2024-05-08T05:17:14.099 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:12.145+0000 7fec55400700 1 -- 172.21.15.87:0/2532647625 wait complete. 2024-05-08T05:17:14.099 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:12.146+0000 7fec55400700 1 Processor -- start 2024-05-08T05:17:14.099 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:12.146+0000 7fec55400700 1 -- start start 2024-05-08T05:17:14.099 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:12.146+0000 7fec55400700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fec50108e00 0x7fec5019cb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:17:14.099 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:12.146+0000 7fec55400700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fec5010d360 con 0x7fec50108e00 2024-05-08T05:17:14.099 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:12.146+0000 7fec4fe00700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fec50108e00 0x7fec5019cb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:17:14.099 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:12.146+0000 7fec4fe00700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fec50108e00 0x7fec5019cb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:47386/0 (socket says 172.21.15.87:47386) 2024-05-08T05:17:14.099 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:12.146+0000 7fec4fe00700 1 -- 172.21.15.87:0/393848608 learned_addr learned my addr 172.21.15.87:0/393848608 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T05:17:14.099 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:12.147+0000 7fec4fe00700 1 -- 172.21.15.87:0/393848608 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fec5019d0d0 con 0x7fec50108e00 2024-05-08T05:17:14.099 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:12.147+0000 7fec4fe00700 1 --2- 172.21.15.87:0/393848608 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fec50108e00 0x7fec5019cb90 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fec40000c00 tx=0x7fec40011aa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:17:14.099 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:12.147+0000 7fec4cc00700 1 -- 172.21.15.87:0/393848608 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fec40003aa0 con 0x7fec50108e00 2024-05-08T05:17:14.100 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:12.147+0000 7fec4cc00700 1 -- 172.21.15.87:0/393848608 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fec4001b8f0 con 0x7fec50108e00 2024-05-08T05:17:14.101 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:12.147+0000 7fec55400700 1 -- 172.21.15.87:0/393848608 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fec5019d360 con 0x7fec50108e00 2024-05-08T05:17:14.101 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:12.147+0000 7fec4cc00700 1 -- 172.21.15.87:0/393848608 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fec40023890 con 0x7fec50108e00 2024-05-08T05:17:14.101 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:12.147+0000 7fec55400700 1 -- 172.21.15.87:0/393848608 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fec501a0050 con 0x7fec50108e00 2024-05-08T05:17:14.101 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:12.149+0000 7fec55400700 1 -- 172.21.15.87:0/393848608 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fec5010d4e0 con 0x7fec50108e00 2024-05-08T05:17:14.101 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:12.149+0000 7fec4cc00700 1 -- 172.21.15.87:0/393848608 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 8) ==== 50222+0+0 (secure 0 0 0) 0x7fec4001b440 con 0x7fec50108e00 2024-05-08T05:17:14.101 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:12.150+0000 7fec4cc00700 1 --2- 172.21.15.87:0/393848608 >> [v2:172.21.15.87:6800/2710124295,v1:172.21.15.87:6801/2710124295] conn(0x7fec3403e530 0x7fec340409f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:17:14.101 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:12.150+0000 7fec4cc00700 1 -- 172.21.15.87:0/393848608 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7fec40053ec0 con 0x7fec50108e00 2024-05-08T05:17:14.102 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:12.150+0000 7fec4f400700 1 --2- 172.21.15.87:0/393848608 >> [v2:172.21.15.87:6800/2710124295,v1:172.21.15.87:6801/2710124295] conn(0x7fec3403e530 0x7fec340409f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:17:14.102 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:12.151+0000 7fec4f400700 1 --2- 172.21.15.87:0/393848608 >> [v2:172.21.15.87:6800/2710124295,v1:172.21.15.87:6801/2710124295] conn(0x7fec3403e530 0x7fec340409f0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fec3c006fd0 tx=0x7fec3c006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:17:14.102 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:12.156+0000 7fec4cc00700 1 -- 172.21.15.87:0/393848608 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7fec4001f030 con 0x7fec50108e00 2024-05-08T05:17:14.102 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:12.455+0000 7fec55400700 1 -- 172.21.15.87:0/393848608 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "dashboard"} v 0) -- 0x7fec501a0650 con 0x7fec50108e00 2024-05-08T05:17:14.102 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:13.377+0000 7fec4cc00700 1 -- 172.21.15.87:0/393848608 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "dashboard"}]=0 v9) ==== 88+0+0 (secure 0 0 0) 0x7fec40016260 con 0x7fec50108e00 2024-05-08T05:17:14.103 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:13.380+0000 7fec4cc00700 1 -- 172.21.15.87:0/393848608 <== mon.0 v2:172.21.15.87:3300/0 8 ==== mgrmap(e 9) ==== 50235+0+0 (secure 0 0 0) 0x7fec40058070 con 0x7fec50108e00 2024-05-08T05:17:14.103 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:13.381+0000 7fec55400700 1 -- 172.21.15.87:0/393848608 >> [v2:172.21.15.87:6800/2710124295,v1:172.21.15.87:6801/2710124295] conn(0x7fec3403e530 msgr2=0x7fec340409f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:17:14.103 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:13.381+0000 7fec55400700 1 --2- 172.21.15.87:0/393848608 >> [v2:172.21.15.87:6800/2710124295,v1:172.21.15.87:6801/2710124295] conn(0x7fec3403e530 0x7fec340409f0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fec3c006fd0 tx=0x7fec3c006e40 comp rx=0 tx=0).stop 2024-05-08T05:17:14.104 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:13.381+0000 7fec55400700 1 -- 172.21.15.87:0/393848608 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fec50108e00 msgr2=0x7fec5019cb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:17:14.104 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:13.381+0000 7fec55400700 1 --2- 172.21.15.87:0/393848608 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fec50108e00 0x7fec5019cb90 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fec40000c00 tx=0x7fec40011aa0 comp rx=0 tx=0).stop 2024-05-08T05:17:14.104 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:13.381+0000 7fec55400700 1 -- 172.21.15.87:0/393848608 shutdown_connections 2024-05-08T05:17:14.104 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:13.381+0000 7fec55400700 1 --2- 172.21.15.87:0/393848608 >> [v2:172.21.15.87:6800/2710124295,v1:172.21.15.87:6801/2710124295] conn(0x7fec3403e530 0x7fec340409f0 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:17:14.104 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:13.381+0000 7fec55400700 1 --2- 172.21.15.87:0/393848608 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fec50108e00 0x7fec5019cb90 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:17:14.104 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:13.381+0000 7fec55400700 1 -- 172.21.15.87:0/393848608 >> 172.21.15.87:0/393848608 conn(0x7fec501043a0 msgr2=0x7fec50104df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:17:14.104 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:13.381+0000 7fec55400700 1 -- 172.21.15.87:0/393848608 shutdown_connections 2024-05-08T05:17:14.104 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:13.381+0000 7fec55400700 1 -- 172.21.15.87:0/393848608 wait complete. 2024-05-08T05:17:14.208 INFO:journalctl@ceph.mgr.x.smithi087.stdout:May 08 05:17:13 smithi087 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-mgr-x[29765]: 2024-05-08T05:17:13.930+0000 7f6e450ec200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-05-08T05:17:14.208 INFO:journalctl@ceph.mgr.x.smithi087.stdout:May 08 05:17:14 smithi087 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-mgr-x[29765]: 2024-05-08T05:17:14.061+0000 7f6e450ec200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-05-08T05:17:14.591 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:17:14 smithi087 ceph-mon[29523]: from='client.? 172.21.15.87:0/393848608' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "dashboard"}]': finished 2024-05-08T05:17:14.591 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:17:14 smithi087 ceph-mon[29523]: mgrmap e9: x(active, since 25s) 2024-05-08T05:17:14.591 INFO:journalctl@ceph.mgr.x.smithi087.stdout:May 08 05:17:14 smithi087 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-mgr-x[29765]: 2024-05-08T05:17:14.476+0000 7f6e450ec200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-05-08T05:17:14.876 INFO:journalctl@ceph.mgr.x.smithi087.stdout:May 08 05:17:14 smithi087 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-mgr-x[29765]: 2024-05-08T05:17:14.589+0000 7f6e450ec200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-05-08T05:17:15.665 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:17:15 smithi087 ceph-mon[29523]: from='client.? 172.21.15.87:0/2329323509' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2024-05-08T05:17:15.980 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout { 2024-05-08T05:17:15.986 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout "epoch": 9, 2024-05-08T05:17:15.987 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout "available": true, 2024-05-08T05:17:15.987 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout "active_name": "x", 2024-05-08T05:17:15.987 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout "num_standby": 0 2024-05-08T05:17:15.987 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout } 2024-05-08T05:17:15.987 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:14.776+0000 7fc1f5400700 1 Processor -- start 2024-05-08T05:17:15.987 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:14.776+0000 7fc1f5400700 1 -- start start 2024-05-08T05:17:15.987 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:14.776+0000 7fc1f5400700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc1f0107d10 0x7fc1f0108130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:17:15.987 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:14.776+0000 7fc1f5400700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fc1f0108700 con 0x7fc1f0107d10 2024-05-08T05:17:15.987 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:14.777+0000 7fc1efe00700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc1f0107d10 0x7fc1f0108130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:17:15.988 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:14.777+0000 7fc1efe00700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc1f0107d10 0x7fc1f0108130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:47432/0 (socket says 172.21.15.87:47432) 2024-05-08T05:17:15.988 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:14.777+0000 7fc1efe00700 1 -- 172.21.15.87:0/1215817513 learned_addr learned my addr 172.21.15.87:0/1215817513 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T05:17:15.988 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:14.777+0000 7fc1efe00700 1 -- 172.21.15.87:0/1215817513 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc1f0108f10 con 0x7fc1f0107d10 2024-05-08T05:17:15.988 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:14.777+0000 7fc1efe00700 1 --2- 172.21.15.87:0/1215817513 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc1f0107d10 0x7fc1f0108130 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fc1e000bb40 tx=0x7fc1e000be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bfde064f136b537b server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:17:15.988 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:14.778+0000 7fc1eea00700 1 -- 172.21.15.87:0/1215817513 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc1e000dbe0 con 0x7fc1f0107d10 2024-05-08T05:17:15.988 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:14.778+0000 7fc1eea00700 1 -- 172.21.15.87:0/1215817513 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc1e00044e0 con 0x7fc1f0107d10 2024-05-08T05:17:15.988 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:14.778+0000 7fc1eea00700 1 -- 172.21.15.87:0/1215817513 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc1e0010470 con 0x7fc1f0107d10 2024-05-08T05:17:15.988 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:14.778+0000 7fc1f5400700 1 -- 172.21.15.87:0/1215817513 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc1f0107d10 msgr2=0x7fc1f0108130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:17:15.988 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:14.778+0000 7fc1f5400700 1 --2- 172.21.15.87:0/1215817513 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc1f0107d10 0x7fc1f0108130 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fc1e000bb40 tx=0x7fc1e000be50 comp rx=0 tx=0).stop 2024-05-08T05:17:15.988 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:14.779+0000 7fc1f5400700 1 -- 172.21.15.87:0/1215817513 shutdown_connections 2024-05-08T05:17:15.988 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:14.779+0000 7fc1f5400700 1 --2- 172.21.15.87:0/1215817513 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc1f0107d10 0x7fc1f0108130 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:17:15.988 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:14.779+0000 7fc1f5400700 1 -- 172.21.15.87:0/1215817513 >> 172.21.15.87:0/1215817513 conn(0x7fc1f01032b0 msgr2=0x7fc1f01056f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:17:15.989 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:14.779+0000 7fc1f5400700 1 -- 172.21.15.87:0/1215817513 shutdown_connections 2024-05-08T05:17:15.989 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:14.779+0000 7fc1f5400700 1 -- 172.21.15.87:0/1215817513 wait complete. 2024-05-08T05:17:15.989 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:14.780+0000 7fc1f5400700 1 Processor -- start 2024-05-08T05:17:15.989 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:14.780+0000 7fc1f5400700 1 -- start start 2024-05-08T05:17:15.989 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:14.780+0000 7fc1f5400700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc1f0107d10 0x7fc1f019ee00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:17:15.989 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:14.780+0000 7fc1f5400700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fc1f0075ec0 con 0x7fc1f0107d10 2024-05-08T05:17:15.989 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:14.780+0000 7fc1efe00700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc1f0107d10 0x7fc1f019ee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:17:15.989 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:14.780+0000 7fc1efe00700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc1f0107d10 0x7fc1f019ee00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:47444/0 (socket says 172.21.15.87:47444) 2024-05-08T05:17:15.989 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:14.781+0000 7fc1efe00700 1 -- 172.21.15.87:0/2329323509 learned_addr learned my addr 172.21.15.87:0/2329323509 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T05:17:15.989 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:14.781+0000 7fc1efe00700 1 -- 172.21.15.87:0/2329323509 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc1f019f340 con 0x7fc1f0107d10 2024-05-08T05:17:15.989 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:14.781+0000 7fc1efe00700 1 --2- 172.21.15.87:0/2329323509 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc1f0107d10 0x7fc1f019ee00 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fc1e0003c30 tx=0x7fc1e0003ff0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:17:15.989 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:14.781+0000 7fc1ecc00700 1 -- 172.21.15.87:0/2329323509 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc1e0010720 con 0x7fc1f0107d10 2024-05-08T05:17:15.989 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:14.781+0000 7fc1ecc00700 1 -- 172.21.15.87:0/2329323509 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc1e001d070 con 0x7fc1f0107d10 2024-05-08T05:17:15.989 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:14.781+0000 7fc1f5400700 1 -- 172.21.15.87:0/2329323509 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc1f019f5d0 con 0x7fc1f0107d10 2024-05-08T05:17:15.990 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:14.781+0000 7fc1ecc00700 1 -- 172.21.15.87:0/2329323509 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc1e0021aa0 con 0x7fc1f0107d10 2024-05-08T05:17:15.990 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:14.782+0000 7fc1f5400700 1 -- 172.21.15.87:0/2329323509 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc1f01a22c0 con 0x7fc1f0107d10 2024-05-08T05:17:15.990 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:14.783+0000 7fc1ecc00700 1 -- 172.21.15.87:0/2329323509 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 9) ==== 50235+0+0 (secure 0 0 0) 0x7fc1e001f030 con 0x7fc1f0107d10 2024-05-08T05:17:15.990 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:14.783+0000 7fc1f5400700 1 -- 172.21.15.87:0/2329323509 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc1f0064b00 con 0x7fc1f0107d10 2024-05-08T05:17:15.990 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:14.783+0000 7fc1ecc00700 1 --2- 172.21.15.87:0/2329323509 >> [v2:172.21.15.87:6800/2710124295,v1:172.21.15.87:6801/2710124295] conn(0x7fc1d403e5e0 0x7fc1d4040aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:17:15.990 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:14.783+0000 7fc1ecc00700 1 -- 172.21.15.87:0/2329323509 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7fc1e0053980 con 0x7fc1f0107d10 2024-05-08T05:17:15.990 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:14.783+0000 7fc1ef400700 1 -- 172.21.15.87:0/2329323509 >> [v2:172.21.15.87:6800/2710124295,v1:172.21.15.87:6801/2710124295] conn(0x7fc1d403e5e0 msgr2=0x7fc1d4040aa0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.87:6800/2710124295 2024-05-08T05:17:15.990 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:14.783+0000 7fc1ef400700 1 --2- 172.21.15.87:0/2329323509 >> [v2:172.21.15.87:6800/2710124295,v1:172.21.15.87:6801/2710124295] conn(0x7fc1d403e5e0 0x7fc1d4040aa0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-08T05:17:15.990 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:14.789+0000 7fc1ecc00700 1 -- 172.21.15.87:0/2329323509 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7fc1e0015070 con 0x7fc1f0107d10 2024-05-08T05:17:15.990 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:14.984+0000 7fc1ef400700 1 -- 172.21.15.87:0/2329323509 >> [v2:172.21.15.87:6800/2710124295,v1:172.21.15.87:6801/2710124295] conn(0x7fc1d403e5e0 msgr2=0x7fc1d4040aa0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.87:6800/2710124295 2024-05-08T05:17:15.990 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:14.984+0000 7fc1ef400700 1 --2- 172.21.15.87:0/2329323509 >> [v2:172.21.15.87:6800/2710124295,v1:172.21.15.87:6801/2710124295] conn(0x7fc1d403e5e0 0x7fc1d4040aa0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-05-08T05:17:15.990 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:15.086+0000 7fc1f5400700 1 -- 172.21.15.87:0/2329323509 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "mgr stat"} v 0) -- 0x7fc1f0198360 con 0x7fc1f0107d10 2024-05-08T05:17:15.990 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:15.087+0000 7fc1ecc00700 1 -- 172.21.15.87:0/2329323509 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "mgr stat"}]=0 v9) ==== 56+0+88 (secure 0 0 0) 0x7fc1f0198360 con 0x7fc1f0107d10 2024-05-08T05:17:15.990 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:15.090+0000 7fc1f5400700 1 -- 172.21.15.87:0/2329323509 >> [v2:172.21.15.87:6800/2710124295,v1:172.21.15.87:6801/2710124295] conn(0x7fc1d403e5e0 msgr2=0x7fc1d4040aa0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-05-08T05:17:15.991 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:15.090+0000 7fc1f5400700 1 --2- 172.21.15.87:0/2329323509 >> [v2:172.21.15.87:6800/2710124295,v1:172.21.15.87:6801/2710124295] conn(0x7fc1d403e5e0 0x7fc1d4040aa0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:17:15.991 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:15.090+0000 7fc1f5400700 1 -- 172.21.15.87:0/2329323509 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc1f0107d10 msgr2=0x7fc1f019ee00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:17:15.991 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:15.090+0000 7fc1f5400700 1 --2- 172.21.15.87:0/2329323509 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc1f0107d10 0x7fc1f019ee00 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fc1e0003c30 tx=0x7fc1e0003ff0 comp rx=0 tx=0).stop 2024-05-08T05:17:15.991 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:15.090+0000 7fc1f5400700 1 -- 172.21.15.87:0/2329323509 shutdown_connections 2024-05-08T05:17:15.991 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:15.090+0000 7fc1f5400700 1 --2- 172.21.15.87:0/2329323509 >> [v2:172.21.15.87:6800/2710124295,v1:172.21.15.87:6801/2710124295] conn(0x7fc1d403e5e0 0x7fc1d4040aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:17:15.991 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:15.090+0000 7fc1f5400700 1 --2- 172.21.15.87:0/2329323509 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc1f0107d10 0x7fc1f019ee00 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:17:15.991 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:15.090+0000 7fc1f5400700 1 -- 172.21.15.87:0/2329323509 >> 172.21.15.87:0/2329323509 conn(0x7fc1f01032b0 msgr2=0x7fc1f0195440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:17:15.991 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:15.090+0000 7fc1f5400700 1 -- 172.21.15.87:0/2329323509 shutdown_connections 2024-05-08T05:17:15.991 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:15.090+0000 7fc1f5400700 1 -- 172.21.15.87:0/2329323509 wait complete. 2024-05-08T05:17:15.992 INFO:teuthology.orchestra.run.smithi087.stdout:Waiting for the mgr to restart... 2024-05-08T05:17:15.992 INFO:teuthology.orchestra.run.smithi087.stdout:Waiting for mgr epoch 9... 2024-05-08T05:17:16.630 INFO:journalctl@ceph.mgr.x.smithi087.stdout:May 08 05:17:16 smithi087 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-mgr-x[29765]: 2024-05-08T05:17:16.224+0000 7f6e450ec200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-05-08T05:17:16.630 INFO:journalctl@ceph.mgr.x.smithi087.stdout:May 08 05:17:16 smithi087 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-mgr-x[29765]: 2024-05-08T05:17:16.454+0000 7f6e450ec200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-05-08T05:17:16.925 INFO:journalctl@ceph.mgr.x.smithi087.stdout:May 08 05:17:16 smithi087 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-mgr-x[29765]: 2024-05-08T05:17:16.673+0000 7f6e450ec200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-05-08T05:17:17.190 INFO:journalctl@ceph.mgr.x.smithi087.stdout:May 08 05:17:17 smithi087 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-mgr-x[29765]: 2024-05-08T05:17:17.065+0000 7f6e450ec200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-05-08T05:17:17.440 INFO:journalctl@ceph.mgr.x.smithi087.stdout:May 08 05:17:17 smithi087 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-mgr-x[29765]: 2024-05-08T05:17:17.189+0000 7f6e450ec200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-05-08T05:17:17.708 INFO:journalctl@ceph.mgr.x.smithi087.stdout:May 08 05:17:17 smithi087 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-mgr-x[29765]: 2024-05-08T05:17:17.439+0000 7f6e450ec200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-05-08T05:17:17.708 INFO:journalctl@ceph.mgr.x.smithi087.stdout:May 08 05:17:17 smithi087 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-mgr-x[29765]: 2024-05-08T05:17:17.686+0000 7f6e450ec200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-05-08T05:17:18.753 INFO:journalctl@ceph.mgr.x.smithi087.stdout:May 08 05:17:18 smithi087 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-mgr-x[29765]: 2024-05-08T05:17:18.467+0000 7f6e450ec200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-05-08T05:17:19.208 INFO:journalctl@ceph.mgr.x.smithi087.stdout:May 08 05:17:18 smithi087 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-mgr-x[29765]: 2024-05-08T05:17:18.752+0000 7f6e450ec200 -1 mgr[py] Module smb has missing NOTIFY_TYPES member 2024-05-08T05:17:19.708 INFO:journalctl@ceph.mgr.x.smithi087.stdout:May 08 05:17:19 smithi087 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-mgr-x[29765]: 2024-05-08T05:17:19.309+0000 7f6e450ec200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-05-08T05:17:19.708 INFO:journalctl@ceph.mgr.x.smithi087.stdout:May 08 05:17:19 smithi087 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-mgr-x[29765]: 2024-05-08T05:17:19.436+0000 7f6e450ec200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-05-08T05:17:20.208 INFO:journalctl@ceph.mgr.x.smithi087.stdout:May 08 05:17:19 smithi087 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-mgr-x[29765]: 2024-05-08T05:17:19.898+0000 7f6e450ec200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-05-08T05:17:20.471 INFO:journalctl@ceph.mgr.x.smithi087.stdout:May 08 05:17:20 smithi087 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-mgr-x[29765]: 2024-05-08T05:17:20.345+0000 7f6e450ec200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-05-08T05:17:20.789 INFO:journalctl@ceph.mgr.x.smithi087.stdout:May 08 05:17:20 smithi087 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-mgr-x[29765]: 2024-05-08T05:17:20.470+0000 7f6e450ec200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-05-08T05:17:21.101 INFO:journalctl@ceph.mgr.x.smithi087.stdout:May 08 05:17:20 smithi087 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-mgr-x[29765]: 2024-05-08T05:17:20.788+0000 7f6e450ec200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-05-08T05:17:21.101 INFO:journalctl@ceph.mgr.x.smithi087.stdout:May 08 05:17:20 smithi087 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-mgr-x[29765]: 2024-05-08T05:17:20.970+0000 7f6e450ec200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-05-08T05:17:21.101 INFO:journalctl@ceph.mgr.x.smithi087.stdout:May 08 05:17:21 smithi087 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-mgr-x[29765]: 2024-05-08T05:17:21.100+0000 7f6e450ec200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-05-08T05:17:21.885 INFO:journalctl@ceph.mgr.x.smithi087.stdout:May 08 05:17:21 smithi087 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-mgr-x[29765]: 2024-05-08T05:17:21.507+0000 7f6e450ec200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-05-08T05:17:21.886 INFO:journalctl@ceph.mgr.x.smithi087.stdout:May 08 05:17:21 smithi087 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-mgr-x[29765]: 2024-05-08T05:17:21.636+0000 7f6e450ec200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-05-08T05:17:22.709 INFO:journalctl@ceph.mgr.x.smithi087.stdout:May 08 05:17:22 smithi087 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-mgr-x[29765]: 2024-05-08T05:17:22.443+0000 7f6e450ec200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-05-08T05:17:23.208 INFO:journalctl@ceph.mgr.x.smithi087.stdout:May 08 05:17:22 smithi087 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-mgr-x[29765]: 2024-05-08T05:17:22.731+0000 7f6e450ec200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-05-08T05:17:23.209 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:17:22 smithi087 ceph-mon[29523]: Active manager daemon x restarted 2024-05-08T05:17:23.209 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:17:22 smithi087 ceph-mon[29523]: Activating manager daemon x 2024-05-08T05:17:23.209 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:17:22 smithi087 ceph-mon[29523]: osdmap e3: 0 total, 0 up, 0 in 2024-05-08T05:17:23.209 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:17:22 smithi087 ceph-mon[29523]: mgrmap e10: x(active, starting, since 0.00891894s) 2024-05-08T05:17:23.209 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:17:22 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-05-08T05:17:23.209 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:17:22 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-05-08T05:17:23.209 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:17:22 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-05-08T05:17:23.209 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:17:22 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-05-08T05:17:23.209 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:17:22 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-05-08T05:17:23.209 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:17:22 smithi087 ceph-mon[29523]: Manager daemon x is now available 2024-05-08T05:17:24.116 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:17:23 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T05:17:24.116 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:17:23 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-05-08T05:17:24.116 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:17:23 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-05-08T05:17:24.116 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:17:23 smithi087 ceph-mon[29523]: [08/May/2024:05:17:23] ENGINE Bus STARTING 2024-05-08T05:17:24.116 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:17:23 smithi087 ceph-mon[29523]: [08/May/2024:05:17:23] ENGINE Serving on https://172.21.15.87:7150 2024-05-08T05:17:24.116 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:17:23 smithi087 ceph-mon[29523]: [08/May/2024:05:17:23] ENGINE Serving on http://172.21.15.87:8765 2024-05-08T05:17:24.116 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:17:23 smithi087 ceph-mon[29523]: [08/May/2024:05:17:23] ENGINE Bus STARTED 2024-05-08T05:17:24.116 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:17:23 smithi087 ceph-mon[29523]: mgrmap e11: x(active, since 1.01344s) 2024-05-08T05:17:24.457 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout { 2024-05-08T05:17:24.457 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 11, 2024-05-08T05:17:24.458 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout "initialized": true 2024-05-08T05:17:24.458 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout } 2024-05-08T05:17:24.458 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:17.078+0000 7f209ce00700 1 Processor -- start 2024-05-08T05:17:24.458 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:17.078+0000 7f209ce00700 1 -- start start 2024-05-08T05:17:24.458 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:17.078+0000 7f209ce00700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2098108fa0 0x7f20981093c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:17:24.458 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:17.078+0000 7f209ce00700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f2098109990 con 0x7f2098108fa0 2024-05-08T05:17:24.458 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:17.079+0000 7f2095e00700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2098108fa0 0x7f20981093c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:17:24.458 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:17.079+0000 7f2095e00700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2098108fa0 0x7f20981093c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:42034/0 (socket says 172.21.15.87:42034) 2024-05-08T05:17:24.458 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:17.079+0000 7f2095e00700 1 -- 172.21.15.87:0/885380204 learned_addr learned my addr 172.21.15.87:0/885380204 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T05:17:24.458 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:17.079+0000 7f2095e00700 1 -- 172.21.15.87:0/885380204 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f209810a1a0 con 0x7f2098108fa0 2024-05-08T05:17:24.458 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:17.080+0000 7f2095e00700 1 --2- 172.21.15.87:0/885380204 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2098108fa0 0x7f20981093c0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f20880098a0 tx=0x7f2088009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f356520502f0102f server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:17:24.458 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:17.080+0000 7f2094a00700 1 -- 172.21.15.87:0/885380204 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2088004160 con 0x7f2098108fa0 2024-05-08T05:17:24.458 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:17.080+0000 7f2094a00700 1 -- 172.21.15.87:0/885380204 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2088004300 con 0x7f2098108fa0 2024-05-08T05:17:24.459 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:17.080+0000 7f2094a00700 1 -- 172.21.15.87:0/885380204 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2088011a20 con 0x7f2098108fa0 2024-05-08T05:17:24.459 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:17.081+0000 7f209ce00700 1 -- 172.21.15.87:0/885380204 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2098108fa0 msgr2=0x7f20981093c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:17:24.459 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:17.081+0000 7f209ce00700 1 --2- 172.21.15.87:0/885380204 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2098108fa0 0x7f20981093c0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f20880098a0 tx=0x7f2088009bb0 comp rx=0 tx=0).stop 2024-05-08T05:17:24.459 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:17.081+0000 7f209ce00700 1 -- 172.21.15.87:0/885380204 shutdown_connections 2024-05-08T05:17:24.459 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:17.081+0000 7f209ce00700 1 --2- 172.21.15.87:0/885380204 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2098108fa0 0x7f20981093c0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:17:24.459 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:17.081+0000 7f209ce00700 1 -- 172.21.15.87:0/885380204 >> 172.21.15.87:0/885380204 conn(0x7f2098104560 msgr2=0x7f2098106980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:17:24.459 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:17.081+0000 7f209ce00700 1 -- 172.21.15.87:0/885380204 shutdown_connections 2024-05-08T05:17:24.459 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:17.081+0000 7f209ce00700 1 -- 172.21.15.87:0/885380204 wait complete. 2024-05-08T05:17:24.459 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:17.082+0000 7f209ce00700 1 Processor -- start 2024-05-08T05:17:24.459 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:17.082+0000 7f209ce00700 1 -- start start 2024-05-08T05:17:24.459 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:17.082+0000 7f209ce00700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2098108fa0 0x7f209807da40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:17:24.460 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:17.082+0000 7f209ce00700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f209810d550 con 0x7f2098108fa0 2024-05-08T05:17:24.460 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:17.083+0000 7f2095e00700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2098108fa0 0x7f209807da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:17:24.460 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:17.083+0000 7f2095e00700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2098108fa0 0x7f209807da40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:42040/0 (socket says 172.21.15.87:42040) 2024-05-08T05:17:24.462 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:17.083+0000 7f2095e00700 1 -- 172.21.15.87:0/1664068582 learned_addr learned my addr 172.21.15.87:0/1664068582 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T05:17:24.462 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:17.083+0000 7f2095e00700 1 -- 172.21.15.87:0/1664068582 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f209807df80 con 0x7f2098108fa0 2024-05-08T05:17:24.462 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:17.083+0000 7f2095e00700 1 --2- 172.21.15.87:0/1664068582 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2098108fa0 0x7f209807da40 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f2088000c00 tx=0x7f2088011aa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:17:24.462 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:17.083+0000 7f208ea00700 1 -- 172.21.15.87:0/1664068582 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2088003aa0 con 0x7f2098108fa0 2024-05-08T05:17:24.463 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:17.083+0000 7f208ea00700 1 -- 172.21.15.87:0/1664068582 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f208801b8f0 con 0x7f2098108fa0 2024-05-08T05:17:24.463 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:17.083+0000 7f208ea00700 1 -- 172.21.15.87:0/1664068582 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2088023890 con 0x7f2098108fa0 2024-05-08T05:17:24.463 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:17.083+0000 7f209ce00700 1 -- 172.21.15.87:0/1664068582 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f209807c170 con 0x7f2098108fa0 2024-05-08T05:17:24.463 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:17.084+0000 7f209ce00700 1 -- 172.21.15.87:0/1664068582 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f209807c6b0 con 0x7f2098108fa0 2024-05-08T05:17:24.463 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:17.085+0000 7f208ea00700 1 -- 172.21.15.87:0/1664068582 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 9) ==== 50235+0+0 (secure 0 0 0) 0x7f208801b440 con 0x7f2098108fa0 2024-05-08T05:17:24.463 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:17.086+0000 7f208ea00700 1 --2- 172.21.15.87:0/1664068582 >> [v2:172.21.15.87:6800/2710124295,v1:172.21.15.87:6801/2710124295] conn(0x7f207c03e580 0x7f207c040a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:17:24.463 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:17.086+0000 7f208ea00700 1 -- 172.21.15.87:0/1664068582 --> [v2:172.21.15.87:6800/2710124295,v1:172.21.15.87:6801/2710124295] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f207c041150 con 0x7f207c03e580 2024-05-08T05:17:24.463 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:17.086+0000 7f208ea00700 1 -- 172.21.15.87:0/1664068582 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f2088053e80 con 0x7f2098108fa0 2024-05-08T05:17:24.463 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:17.086+0000 7f2095400700 1 -- 172.21.15.87:0/1664068582 >> [v2:172.21.15.87:6800/2710124295,v1:172.21.15.87:6801/2710124295] conn(0x7f207c03e580 msgr2=0x7f207c040a40 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.87:6800/2710124295 2024-05-08T05:17:24.463 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:17.086+0000 7f2095400700 1 --2- 172.21.15.87:0/1664068582 >> [v2:172.21.15.87:6800/2710124295,v1:172.21.15.87:6801/2710124295] conn(0x7f207c03e580 0x7f207c040a40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-08T05:17:24.463 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:17.287+0000 7f2095400700 1 -- 172.21.15.87:0/1664068582 >> [v2:172.21.15.87:6800/2710124295,v1:172.21.15.87:6801/2710124295] conn(0x7f207c03e580 msgr2=0x7f207c040a40 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.87:6800/2710124295 2024-05-08T05:17:24.463 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:17.287+0000 7f2095400700 1 --2- 172.21.15.87:0/1664068582 >> [v2:172.21.15.87:6800/2710124295,v1:172.21.15.87:6801/2710124295] conn(0x7f207c03e580 0x7f207c040a40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-05-08T05:17:24.463 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:17.688+0000 7f2095400700 1 -- 172.21.15.87:0/1664068582 >> [v2:172.21.15.87:6800/2710124295,v1:172.21.15.87:6801/2710124295] conn(0x7f207c03e580 msgr2=0x7f207c040a40 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.87:6800/2710124295 2024-05-08T05:17:24.463 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:17.688+0000 7f2095400700 1 --2- 172.21.15.87:0/1664068582 >> [v2:172.21.15.87:6800/2710124295,v1:172.21.15.87:6801/2710124295] conn(0x7f207c03e580 0x7f207c040a40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-05-08T05:17:24.463 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:18.489+0000 7f2095400700 1 -- 172.21.15.87:0/1664068582 >> [v2:172.21.15.87:6800/2710124295,v1:172.21.15.87:6801/2710124295] conn(0x7f207c03e580 msgr2=0x7f207c040a40 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.87:6800/2710124295 2024-05-08T05:17:24.464 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:18.489+0000 7f2095400700 1 --2- 172.21.15.87:0/1664068582 >> [v2:172.21.15.87:6800/2710124295,v1:172.21.15.87:6801/2710124295] conn(0x7f207c03e580 0x7f207c040a40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-05-08T05:17:24.464 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:20.091+0000 7f2095400700 1 -- 172.21.15.87:0/1664068582 >> [v2:172.21.15.87:6800/2710124295,v1:172.21.15.87:6801/2710124295] conn(0x7f207c03e580 msgr2=0x7f207c040a40 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.87:6800/2710124295 2024-05-08T05:17:24.464 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:20.091+0000 7f2095400700 1 --2- 172.21.15.87:0/1664068582 >> [v2:172.21.15.87:6800/2710124295,v1:172.21.15.87:6801/2710124295] conn(0x7f207c03e580 0x7f207c040a40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 3.200000 2024-05-08T05:17:24.464 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:22.744+0000 7f208ea00700 1 -- 172.21.15.87:0/1664068582 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mgrmap(e 10) ==== 50002+0+0 (secure 0 0 0) 0x7f208800b3e0 con 0x7f2098108fa0 2024-05-08T05:17:24.465 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:22.744+0000 7f208ea00700 1 -- 172.21.15.87:0/1664068582 >> [v2:172.21.15.87:6800/2710124295,v1:172.21.15.87:6801/2710124295] conn(0x7f207c03e580 msgr2=0x7f207c040a40 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-05-08T05:17:24.465 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:22.744+0000 7f208ea00700 1 --2- 172.21.15.87:0/1664068582 >> [v2:172.21.15.87:6800/2710124295,v1:172.21.15.87:6801/2710124295] conn(0x7f207c03e580 0x7f207c040a40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:17:24.465 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:23.745+0000 7f208ea00700 1 -- 172.21.15.87:0/1664068582 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mgrmap(e 11) ==== 50129+0+0 (secure 0 0 0) 0x7f208802c940 con 0x7f2098108fa0 2024-05-08T05:17:24.465 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:23.746+0000 7f208ea00700 1 --2- 172.21.15.87:0/1664068582 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f207c041fb0 0x7f207c0443a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:17:24.466 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:23.746+0000 7f208ea00700 1 -- 172.21.15.87:0/1664068582 --> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f2088007e50 con 0x7f207c041fb0 2024-05-08T05:17:24.466 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:23.747+0000 7f2095400700 1 --2- 172.21.15.87:0/1664068582 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f207c041fb0 0x7f207c0443a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:17:24.466 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:23.748+0000 7f2095400700 1 --2- 172.21.15.87:0/1664068582 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f207c041fb0 0x7f207c0443a0 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f2084003a10 tx=0x7f20840092b0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:17:24.466 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:23.749+0000 7f208ea00700 1 -- 172.21.15.87:0/1664068582 <== mgr.14152 v2:172.21.15.87:6800/1189186457 1 ==== command_reply(tid 0: 0 ) ==== 8+0+9564 (secure 0 0 0) 0x7f2088007e50 con 0x7f207c041fb0 2024-05-08T05:17:24.466 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:23.759+0000 7f209ce00700 1 -- 172.21.15.87:0/1664068582 --> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] -- command(tid 1: {"prefix": "mgr_status"}) -- 0x7f209810d6d0 con 0x7f207c041fb0 2024-05-08T05:17:24.466 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:23.759+0000 7f208ea00700 1 -- 172.21.15.87:0/1664068582 <== mgr.14152 v2:172.21.15.87:6800/1189186457 2 ==== command_reply(tid 1: 0 ) ==== 8+0+52 (secure 0 0 0) 0x7f209810d6d0 con 0x7f207c041fb0 2024-05-08T05:17:24.467 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:23.760+0000 7f209ce00700 1 -- 172.21.15.87:0/1664068582 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f207c041fb0 msgr2=0x7f207c0443a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:17:24.467 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:23.760+0000 7f209ce00700 1 --2- 172.21.15.87:0/1664068582 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f207c041fb0 0x7f207c0443a0 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f2084003a10 tx=0x7f20840092b0 comp rx=0 tx=0).stop 2024-05-08T05:17:24.468 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:23.760+0000 7f209ce00700 1 -- 172.21.15.87:0/1664068582 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2098108fa0 msgr2=0x7f209807da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:17:24.468 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:23.760+0000 7f209ce00700 1 --2- 172.21.15.87:0/1664068582 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2098108fa0 0x7f209807da40 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f2088000c00 tx=0x7f2088011aa0 comp rx=0 tx=0).stop 2024-05-08T05:17:24.468 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:23.760+0000 7f209ce00700 1 -- 172.21.15.87:0/1664068582 shutdown_connections 2024-05-08T05:17:24.468 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:23.760+0000 7f209ce00700 1 --2- 172.21.15.87:0/1664068582 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f207c041fb0 0x7f207c0443a0 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:17:24.468 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:23.760+0000 7f209ce00700 1 --2- 172.21.15.87:0/1664068582 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2098108fa0 0x7f209807da40 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:17:24.468 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:23.760+0000 7f209ce00700 1 --2- 172.21.15.87:0/1664068582 >> [v2:172.21.15.87:6800/2710124295,v1:172.21.15.87:6801/2710124295] conn(0x7f207c03e580 0x7f207c040a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:17:24.468 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:23.760+0000 7f209ce00700 1 -- 172.21.15.87:0/1664068582 >> 172.21.15.87:0/1664068582 conn(0x7f2098104560 msgr2=0x7f2098104f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:17:24.468 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:23.760+0000 7f209ce00700 1 -- 172.21.15.87:0/1664068582 shutdown_connections 2024-05-08T05:17:24.468 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:23.760+0000 7f209ce00700 1 -- 172.21.15.87:0/1664068582 wait complete. 2024-05-08T05:17:24.468 INFO:teuthology.orchestra.run.smithi087.stdout:mgr epoch 9 is available 2024-05-08T05:17:24.468 INFO:teuthology.orchestra.run.smithi087.stdout:Generating a dashboard self-signed certificate... 2024-05-08T05:17:25.043 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:17:24 smithi087 ceph-mon[29523]: from='client.14156 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2024-05-08T05:17:25.044 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:17:24 smithi087 ceph-mon[29523]: from='client.14156 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2024-05-08T05:17:26.209 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:17:25 smithi087 ceph-mon[29523]: mgrmap e12: x(active, since 2s) 2024-05-08T05:17:26.209 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:17:25 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:17:26.731 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout Self-signed certificate created 2024-05-08T05:17:26.731 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:25.595+0000 7fb416c00700 1 Processor -- start 2024-05-08T05:17:26.731 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:25.595+0000 7fb416c00700 1 -- start start 2024-05-08T05:17:26.731 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:25.596+0000 7fb416c00700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb410108da0 0x7fb4101091c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:17:26.732 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:25.596+0000 7fb416c00700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fb410109790 con 0x7fb410108da0 2024-05-08T05:17:26.732 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:25.596+0000 7fb415800700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb410108da0 0x7fb4101091c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:17:26.732 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:25.596+0000 7fb415800700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb410108da0 0x7fb4101091c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:42122/0 (socket says 172.21.15.87:42122) 2024-05-08T05:17:26.732 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:25.596+0000 7fb415800700 1 -- 172.21.15.87:0/699042892 learned_addr learned my addr 172.21.15.87:0/699042892 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T05:17:26.732 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:25.597+0000 7fb415800700 1 -- 172.21.15.87:0/699042892 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb410109fa0 con 0x7fb410108da0 2024-05-08T05:17:26.732 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:25.597+0000 7fb415800700 1 --2- 172.21.15.87:0/699042892 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb410108da0 0x7fb4101091c0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fb4040098a0 tx=0x7fb404009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5145a460a1403f5b server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:17:26.732 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:25.597+0000 7fb40fe00700 1 -- 172.21.15.87:0/699042892 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb404004160 con 0x7fb410108da0 2024-05-08T05:17:26.732 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:25.597+0000 7fb40fe00700 1 -- 172.21.15.87:0/699042892 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb404004300 con 0x7fb410108da0 2024-05-08T05:17:26.732 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:25.597+0000 7fb40fe00700 1 -- 172.21.15.87:0/699042892 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb404011a20 con 0x7fb410108da0 2024-05-08T05:17:26.732 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:25.598+0000 7fb416c00700 1 -- 172.21.15.87:0/699042892 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb410108da0 msgr2=0x7fb4101091c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:17:26.732 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:25.598+0000 7fb416c00700 1 --2- 172.21.15.87:0/699042892 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb410108da0 0x7fb4101091c0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fb4040098a0 tx=0x7fb404009bb0 comp rx=0 tx=0).stop 2024-05-08T05:17:26.732 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:25.598+0000 7fb416c00700 1 -- 172.21.15.87:0/699042892 shutdown_connections 2024-05-08T05:17:26.732 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:25.598+0000 7fb416c00700 1 --2- 172.21.15.87:0/699042892 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb410108da0 0x7fb4101091c0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:17:26.733 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:25.598+0000 7fb416c00700 1 -- 172.21.15.87:0/699042892 >> 172.21.15.87:0/699042892 conn(0x7fb410104380 msgr2=0x7fb4101067a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:17:26.733 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:25.598+0000 7fb416c00700 1 -- 172.21.15.87:0/699042892 shutdown_connections 2024-05-08T05:17:26.733 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:25.598+0000 7fb416c00700 1 -- 172.21.15.87:0/699042892 wait complete. 2024-05-08T05:17:26.733 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:25.599+0000 7fb416c00700 1 Processor -- start 2024-05-08T05:17:26.733 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:25.599+0000 7fb416c00700 1 -- start start 2024-05-08T05:17:26.733 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:25.600+0000 7fb416c00700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb410108da0 0x7fb41019cba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:17:26.733 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:25.600+0000 7fb416c00700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fb41010d350 con 0x7fb410108da0 2024-05-08T05:17:26.733 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:25.600+0000 7fb415800700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb410108da0 0x7fb41019cba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:17:26.733 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:25.600+0000 7fb415800700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb410108da0 0x7fb41019cba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:42130/0 (socket says 172.21.15.87:42130) 2024-05-08T05:17:26.733 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:25.600+0000 7fb415800700 1 -- 172.21.15.87:0/2371199657 learned_addr learned my addr 172.21.15.87:0/2371199657 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T05:17:26.733 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:25.600+0000 7fb415800700 1 -- 172.21.15.87:0/2371199657 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb41019d0e0 con 0x7fb410108da0 2024-05-08T05:17:26.733 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:25.601+0000 7fb415800700 1 --2- 172.21.15.87:0/2371199657 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb410108da0 0x7fb41019cba0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fb404000c00 tx=0x7fb404011aa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:17:26.733 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:25.601+0000 7fb40e000700 1 -- 172.21.15.87:0/2371199657 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb404003aa0 con 0x7fb410108da0 2024-05-08T05:17:26.733 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:25.601+0000 7fb40e000700 1 -- 172.21.15.87:0/2371199657 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb40401b8f0 con 0x7fb410108da0 2024-05-08T05:17:26.733 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:25.601+0000 7fb416c00700 1 -- 172.21.15.87:0/2371199657 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb41019d370 con 0x7fb410108da0 2024-05-08T05:17:26.734 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:25.601+0000 7fb40e000700 1 -- 172.21.15.87:0/2371199657 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb404023890 con 0x7fb410108da0 2024-05-08T05:17:26.734 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:25.601+0000 7fb416c00700 1 -- 172.21.15.87:0/2371199657 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb4101a0060 con 0x7fb410108da0 2024-05-08T05:17:26.734 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:25.602+0000 7fb40e000700 1 -- 172.21.15.87:0/2371199657 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 12) ==== 50235+0+0 (secure 0 0 0) 0x7fb40402c3f0 con 0x7fb410108da0 2024-05-08T05:17:26.734 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:25.602+0000 7fb403400700 1 -- 172.21.15.87:0/2371199657 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb3ec005330 con 0x7fb410108da0 2024-05-08T05:17:26.734 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:25.603+0000 7fb40e000700 1 --2- 172.21.15.87:0/2371199657 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7fb3f803e580 0x7fb3f8040a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:17:26.734 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:25.603+0000 7fb40e000700 1 -- 172.21.15.87:0/2371199657 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7fb404054060 con 0x7fb410108da0 2024-05-08T05:17:26.734 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:25.603+0000 7fb414e00700 1 --2- 172.21.15.87:0/2371199657 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7fb3f803e580 0x7fb3f8040a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:17:26.734 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:25.604+0000 7fb414e00700 1 --2- 172.21.15.87:0/2371199657 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7fb3f803e580 0x7fb3f8040a40 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fb3fc006fd0 tx=0x7fb3fc006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:17:26.734 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:25.608+0000 7fb40e000700 1 -- 172.21.15.87:0/2371199657 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7fb40401f030 con 0x7fb410108da0 2024-05-08T05:17:26.734 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:25.847+0000 7fb403400700 1 -- 172.21.15.87:0/2371199657 --> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] -- mgr_command(tid 0: {"prefix": "dashboard create-self-signed-cert", "target": ["mon-mgr", ""]}) -- 0x7fb3ec000bc0 con 0x7fb3f803e580 2024-05-08T05:17:26.734 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:25.940+0000 7fb40e000700 1 -- 172.21.15.87:0/2371199657 <== mgr.14152 v2:172.21.15.87:6800/1189186457 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+32 (secure 0 0 0) 0x7fb3ec000bc0 con 0x7fb3f803e580 2024-05-08T05:17:26.734 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:25.944+0000 7fb403400700 1 -- 172.21.15.87:0/2371199657 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7fb3f803e580 msgr2=0x7fb3f8040a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:17:26.734 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:25.944+0000 7fb403400700 1 --2- 172.21.15.87:0/2371199657 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7fb3f803e580 0x7fb3f8040a40 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fb3fc006fd0 tx=0x7fb3fc006e40 comp rx=0 tx=0).stop 2024-05-08T05:17:26.735 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:25.944+0000 7fb403400700 1 -- 172.21.15.87:0/2371199657 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb410108da0 msgr2=0x7fb41019cba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:17:26.735 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:25.944+0000 7fb403400700 1 --2- 172.21.15.87:0/2371199657 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb410108da0 0x7fb41019cba0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fb404000c00 tx=0x7fb404011aa0 comp rx=0 tx=0).stop 2024-05-08T05:17:26.735 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:25.944+0000 7fb403400700 1 -- 172.21.15.87:0/2371199657 shutdown_connections 2024-05-08T05:17:26.735 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:25.944+0000 7fb403400700 1 --2- 172.21.15.87:0/2371199657 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7fb3f803e580 0x7fb3f8040a40 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:17:26.735 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:25.944+0000 7fb403400700 1 --2- 172.21.15.87:0/2371199657 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb410108da0 0x7fb41019cba0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:17:26.735 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:25.944+0000 7fb403400700 1 -- 172.21.15.87:0/2371199657 >> 172.21.15.87:0/2371199657 conn(0x7fb410104380 msgr2=0x7fb410104de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:17:26.735 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:25.944+0000 7fb403400700 1 -- 172.21.15.87:0/2371199657 shutdown_connections 2024-05-08T05:17:26.735 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:25.944+0000 7fb403400700 1 -- 172.21.15.87:0/2371199657 wait complete. 2024-05-08T05:17:26.735 INFO:teuthology.orchestra.run.smithi087.stdout:Creating initial admin user... 2024-05-08T05:17:27.026 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:17:26 smithi087 ceph-mon[29523]: from='client.14164 -' entity='client.admin' cmd=[{"prefix": "dashboard create-self-signed-cert", "target": ["mon-mgr", ""]}]: dispatch 2024-05-08T05:17:27.026 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:17:26 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:17:27.026 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:17:26 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:17:28.576 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout {"username": "admin", "password": "$2b$12$DHXaHK1CviE8/hTNuv1YCOTYv/sCkCGQAdqxETyDr8IGmawzTfNbS", "roles": ["administrator"], "name": null, "email": null, "lastUpdate": 1715145447, "enabled": true, "pwdExpirationDate": null, "pwdUpdateRequired": true} 2024-05-08T05:17:28.576 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:27.331+0000 7fe400400700 1 Processor -- start 2024-05-08T05:17:28.576 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:27.331+0000 7fe400400700 1 -- start start 2024-05-08T05:17:28.576 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:27.331+0000 7fe400400700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe3f807eec0 0x7fe3f807d320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:17:28.576 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:27.331+0000 7fe400400700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fe3f807d8f0 con 0x7fe3f807eec0 2024-05-08T05:17:28.576 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:27.332+0000 7fe3fda00700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe3f807eec0 0x7fe3f807d320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:17:28.576 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:27.332+0000 7fe3fda00700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe3f807eec0 0x7fe3f807d320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:57640/0 (socket says 172.21.15.87:57640) 2024-05-08T05:17:28.576 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:27.332+0000 7fe3fda00700 1 -- 172.21.15.87:0/2792892379 learned_addr learned my addr 172.21.15.87:0/2792892379 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T05:17:28.576 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:27.332+0000 7fe3fda00700 1 -- 172.21.15.87:0/2792892379 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe3f807da70 con 0x7fe3f807eec0 2024-05-08T05:17:28.576 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:27.333+0000 7fe3fda00700 1 --2- 172.21.15.87:0/2792892379 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe3f807eec0 0x7fe3f807d320 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fe3ec0098a0 tx=0x7fe3ec009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=db72ba02245c7dd0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:17:28.576 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:27.333+0000 7fe3f7e00700 1 -- 172.21.15.87:0/2792892379 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe3ec004160 con 0x7fe3f807eec0 2024-05-08T05:17:28.577 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:27.333+0000 7fe3f7e00700 1 -- 172.21.15.87:0/2792892379 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe3ec004300 con 0x7fe3f807eec0 2024-05-08T05:17:28.577 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:27.333+0000 7fe3f7e00700 1 -- 172.21.15.87:0/2792892379 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe3ec011a20 con 0x7fe3f807eec0 2024-05-08T05:17:28.577 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:27.334+0000 7fe400400700 1 -- 172.21.15.87:0/2792892379 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe3f807eec0 msgr2=0x7fe3f807d320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:17:28.577 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:27.334+0000 7fe400400700 1 --2- 172.21.15.87:0/2792892379 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe3f807eec0 0x7fe3f807d320 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fe3ec0098a0 tx=0x7fe3ec009bb0 comp rx=0 tx=0).stop 2024-05-08T05:17:28.577 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:27.334+0000 7fe400400700 1 -- 172.21.15.87:0/2792892379 shutdown_connections 2024-05-08T05:17:28.577 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:27.334+0000 7fe400400700 1 --2- 172.21.15.87:0/2792892379 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe3f807eec0 0x7fe3f807d320 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:17:28.577 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:27.334+0000 7fe400400700 1 -- 172.21.15.87:0/2792892379 >> 172.21.15.87:0/2792892379 conn(0x7fe3f8104590 msgr2=0x7fe3f81069b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:17:28.577 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:27.334+0000 7fe400400700 1 -- 172.21.15.87:0/2792892379 shutdown_connections 2024-05-08T05:17:28.577 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:27.334+0000 7fe400400700 1 -- 172.21.15.87:0/2792892379 wait complete. 2024-05-08T05:17:28.577 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:27.335+0000 7fe400400700 1 Processor -- start 2024-05-08T05:17:28.577 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:27.335+0000 7fe400400700 1 -- start start 2024-05-08T05:17:28.577 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:27.336+0000 7fe400400700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe3f807eec0 0x7fe3f819ef90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:17:28.577 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:27.336+0000 7fe400400700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fe3f810f5c0 con 0x7fe3f807eec0 2024-05-08T05:17:28.577 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:27.336+0000 7fe3fda00700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe3f807eec0 0x7fe3f819ef90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:17:28.578 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:27.336+0000 7fe3fda00700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe3f807eec0 0x7fe3f819ef90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:57646/0 (socket says 172.21.15.87:57646) 2024-05-08T05:17:28.578 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:27.336+0000 7fe3fda00700 1 -- 172.21.15.87:0/4011341759 learned_addr learned my addr 172.21.15.87:0/4011341759 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T05:17:28.578 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:27.336+0000 7fe3fda00700 1 -- 172.21.15.87:0/4011341759 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe3f819f4d0 con 0x7fe3f807eec0 2024-05-08T05:17:28.578 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:27.337+0000 7fe3fda00700 1 --2- 172.21.15.87:0/4011341759 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe3f807eec0 0x7fe3f819ef90 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fe3ec009520 tx=0x7fe3ec011aa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:17:28.578 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:27.337+0000 7fe3f6000700 1 -- 172.21.15.87:0/4011341759 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe3ec003af0 con 0x7fe3f807eec0 2024-05-08T05:17:28.578 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:27.337+0000 7fe3f6000700 1 -- 172.21.15.87:0/4011341759 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe3ec01a8e0 con 0x7fe3f807eec0 2024-05-08T05:17:28.578 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:27.337+0000 7fe3f6000700 1 -- 172.21.15.87:0/4011341759 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe3ec0247a0 con 0x7fe3f807eec0 2024-05-08T05:17:28.578 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:27.337+0000 7fe400400700 1 -- 172.21.15.87:0/4011341759 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe3f819f760 con 0x7fe3f807eec0 2024-05-08T05:17:28.578 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:27.337+0000 7fe400400700 1 -- 172.21.15.87:0/4011341759 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe3f81a2450 con 0x7fe3f807eec0 2024-05-08T05:17:28.578 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:27.338+0000 7fe3f6000700 1 -- 172.21.15.87:0/4011341759 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 12) ==== 50235+0+0 (secure 0 0 0) 0x7fe3ec022020 con 0x7fe3f807eec0 2024-05-08T05:17:28.578 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:27.338+0000 7fe400400700 1 -- 172.21.15.87:0/4011341759 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe3f8064b00 con 0x7fe3f807eec0 2024-05-08T05:17:28.578 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:27.339+0000 7fe3f6000700 1 --2- 172.21.15.87:0/4011341759 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7fe3e003e5e0 0x7fe3e0040aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:17:28.578 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:27.339+0000 7fe3f6000700 1 -- 172.21.15.87:0/4011341759 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7fe3ec053910 con 0x7fe3f807eec0 2024-05-08T05:17:28.579 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:27.339+0000 7fe3fd000700 1 --2- 172.21.15.87:0/4011341759 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7fe3e003e5e0 0x7fe3e0040aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:17:28.579 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:27.340+0000 7fe3fd000700 1 --2- 172.21.15.87:0/4011341759 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7fe3e003e5e0 0x7fe3e0040aa0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fe3e4006fd0 tx=0x7fe3e4006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:17:28.579 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:27.345+0000 7fe3f6000700 1 -- 172.21.15.87:0/4011341759 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7fe3ec021d80 con 0x7fe3f807eec0 2024-05-08T05:17:28.579 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:27.593+0000 7fe400400700 1 -- 172.21.15.87:0/4011341759 --> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] -- mgr_command(tid 0: {"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}) -- 0x7fe3f819fc40 con 0x7fe3e003e5e0 2024-05-08T05:17:28.579 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:27.848+0000 7fe3f6000700 1 -- 172.21.15.87:0/4011341759 <== mgr.14152 v2:172.21.15.87:6800/1189186457 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+252 (secure 0 0 0) 0x7fe3f819fc40 con 0x7fe3e003e5e0 2024-05-08T05:17:28.579 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:27.851+0000 7fe400400700 1 -- 172.21.15.87:0/4011341759 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7fe3e003e5e0 msgr2=0x7fe3e0040aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:17:28.579 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:27.851+0000 7fe400400700 1 --2- 172.21.15.87:0/4011341759 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7fe3e003e5e0 0x7fe3e0040aa0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fe3e4006fd0 tx=0x7fe3e4006e40 comp rx=0 tx=0).stop 2024-05-08T05:17:28.579 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:27.851+0000 7fe400400700 1 -- 172.21.15.87:0/4011341759 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe3f807eec0 msgr2=0x7fe3f819ef90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:17:28.579 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:27.851+0000 7fe400400700 1 --2- 172.21.15.87:0/4011341759 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe3f807eec0 0x7fe3f819ef90 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fe3ec009520 tx=0x7fe3ec011aa0 comp rx=0 tx=0).stop 2024-05-08T05:17:28.579 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:27.851+0000 7fe400400700 1 -- 172.21.15.87:0/4011341759 shutdown_connections 2024-05-08T05:17:28.579 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:27.851+0000 7fe400400700 1 --2- 172.21.15.87:0/4011341759 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7fe3e003e5e0 0x7fe3e0040aa0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:17:28.579 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:27.851+0000 7fe400400700 1 --2- 172.21.15.87:0/4011341759 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe3f807eec0 0x7fe3f819ef90 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:17:28.579 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:27.851+0000 7fe400400700 1 -- 172.21.15.87:0/4011341759 >> 172.21.15.87:0/4011341759 conn(0x7fe3f8104590 msgr2=0x7fe3f8104f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:17:28.579 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:27.851+0000 7fe400400700 1 -- 172.21.15.87:0/4011341759 shutdown_connections 2024-05-08T05:17:28.579 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:27.851+0000 7fe400400700 1 -- 172.21.15.87:0/4011341759 wait complete. 2024-05-08T05:17:28.580 INFO:teuthology.orchestra.run.smithi087.stdout:Fetching dashboard port number... 2024-05-08T05:17:28.878 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:17:28 smithi087 ceph-mon[29523]: from='client.14166 -' entity='client.admin' cmd=[{"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}]: dispatch 2024-05-08T05:17:28.878 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:17:28 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:17:28.878 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:17:28 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:17:29.709 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:17:29 smithi087 ceph-mon[29523]: from='client.? 172.21.15.87:0/3763843341' entity='client.admin' cmd=[{"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"}]: dispatch 2024-05-08T05:17:30.958 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:17:30 smithi087 ceph-mon[29523]: mgrmap e13: x(active, since 6s) 2024-05-08T05:17:31.065 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout 8443 2024-05-08T05:17:31.065 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:29.178+0000 7fb66f200700 1 Processor -- start 2024-05-08T05:17:31.065 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:29.178+0000 7fb66f200700 1 -- start start 2024-05-08T05:17:31.066 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:29.178+0000 7fb66f200700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb66807dd50 0x7fb66807c1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:17:31.066 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:29.178+0000 7fb66f200700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fb66807c780 con 0x7fb66807dd50 2024-05-08T05:17:31.066 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:29.179+0000 7fb667e00700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb66807dd50 0x7fb66807c1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:17:31.066 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:29.179+0000 7fb667e00700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb66807dd50 0x7fb66807c1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:57656/0 (socket says 172.21.15.87:57656) 2024-05-08T05:17:31.067 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:29.179+0000 7fb667e00700 1 -- 172.21.15.87:0/1406003747 learned_addr learned my addr 172.21.15.87:0/1406003747 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T05:17:31.067 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:29.179+0000 7fb667e00700 1 -- 172.21.15.87:0/1406003747 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb66807c900 con 0x7fb66807dd50 2024-05-08T05:17:31.067 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:29.179+0000 7fb667e00700 1 --2- 172.21.15.87:0/1406003747 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb66807dd50 0x7fb66807c1b0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fb6580098a0 tx=0x7fb658009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=666120954bc15b54 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:17:31.067 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:29.180+0000 7fb666a00700 1 -- 172.21.15.87:0/1406003747 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb658004160 con 0x7fb66807dd50 2024-05-08T05:17:31.067 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:29.180+0000 7fb666a00700 1 -- 172.21.15.87:0/1406003747 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb658004300 con 0x7fb66807dd50 2024-05-08T05:17:31.068 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:29.180+0000 7fb666a00700 1 -- 172.21.15.87:0/1406003747 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb658011a20 con 0x7fb66807dd50 2024-05-08T05:17:31.068 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:29.181+0000 7fb66f200700 1 -- 172.21.15.87:0/1406003747 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb66807dd50 msgr2=0x7fb66807c1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:17:31.068 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:29.181+0000 7fb66f200700 1 --2- 172.21.15.87:0/1406003747 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb66807dd50 0x7fb66807c1b0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fb6580098a0 tx=0x7fb658009bb0 comp rx=0 tx=0).stop 2024-05-08T05:17:31.073 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:29.181+0000 7fb66f200700 1 -- 172.21.15.87:0/1406003747 shutdown_connections 2024-05-08T05:17:31.073 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:29.181+0000 7fb66f200700 1 --2- 172.21.15.87:0/1406003747 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb66807dd50 0x7fb66807c1b0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:17:31.073 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:29.181+0000 7fb66f200700 1 -- 172.21.15.87:0/1406003747 >> 172.21.15.87:0/1406003747 conn(0x7fb668104560 msgr2=0x7fb668106980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:17:31.074 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:29.181+0000 7fb66f200700 1 -- 172.21.15.87:0/1406003747 shutdown_connections 2024-05-08T05:17:31.074 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:29.181+0000 7fb66f200700 1 -- 172.21.15.87:0/1406003747 wait complete. 2024-05-08T05:17:31.074 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:29.182+0000 7fb66f200700 1 Processor -- start 2024-05-08T05:17:31.074 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:29.182+0000 7fb66f200700 1 -- start start 2024-05-08T05:17:31.074 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:29.182+0000 7fb66f200700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb66807dd50 0x7fb66819ef50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:17:31.074 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:29.182+0000 7fb66f200700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fb66810f5c0 con 0x7fb66807dd50 2024-05-08T05:17:31.077 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:29.183+0000 7fb667e00700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb66807dd50 0x7fb66819ef50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:17:31.077 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:29.183+0000 7fb667e00700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb66807dd50 0x7fb66819ef50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:57664/0 (socket says 172.21.15.87:57664) 2024-05-08T05:17:31.077 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:29.183+0000 7fb667e00700 1 -- 172.21.15.87:0/3763843341 learned_addr learned my addr 172.21.15.87:0/3763843341 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T05:17:31.078 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:29.183+0000 7fb667e00700 1 -- 172.21.15.87:0/3763843341 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb66819f490 con 0x7fb66807dd50 2024-05-08T05:17:31.078 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:29.183+0000 7fb667e00700 1 --2- 172.21.15.87:0/3763843341 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb66807dd50 0x7fb66819ef50 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fb6580116e0 tx=0x7fb658011aa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:17:31.078 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:29.184+0000 7fb664c00700 1 -- 172.21.15.87:0/3763843341 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb658003b20 con 0x7fb66807dd50 2024-05-08T05:17:31.078 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:29.184+0000 7fb664c00700 1 -- 172.21.15.87:0/3763843341 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb65801b8f0 con 0x7fb66807dd50 2024-05-08T05:17:31.078 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:29.184+0000 7fb66f200700 1 -- 172.21.15.87:0/3763843341 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb66819f720 con 0x7fb66807dd50 2024-05-08T05:17:31.078 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:29.184+0000 7fb664c00700 1 -- 172.21.15.87:0/3763843341 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb6580238c0 con 0x7fb66807dd50 2024-05-08T05:17:31.078 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:29.184+0000 7fb66f200700 1 -- 172.21.15.87:0/3763843341 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb6681a2410 con 0x7fb66807dd50 2024-05-08T05:17:31.078 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:29.185+0000 7fb66f200700 1 -- 172.21.15.87:0/3763843341 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb668064b00 con 0x7fb66807dd50 2024-05-08T05:17:31.078 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:29.185+0000 7fb664c00700 1 -- 172.21.15.87:0/3763843341 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 12) ==== 50235+0+0 (secure 0 0 0) 0x7fb65801b440 con 0x7fb66807dd50 2024-05-08T05:17:31.078 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:29.186+0000 7fb664c00700 1 --2- 172.21.15.87:0/3763843341 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7fb64c03e590 0x7fb64c040a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:17:31.078 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:29.186+0000 7fb664c00700 1 -- 172.21.15.87:0/3763843341 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7fb6580541b0 con 0x7fb66807dd50 2024-05-08T05:17:31.078 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:29.186+0000 7fb667400700 1 --2- 172.21.15.87:0/3763843341 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7fb64c03e590 0x7fb64c040a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:17:31.078 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:29.187+0000 7fb667400700 1 --2- 172.21.15.87:0/3763843341 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7fb64c03e590 0x7fb64c040a50 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fb654006fd0 tx=0x7fb654006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:17:31.079 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:29.192+0000 7fb664c00700 1 -- 172.21.15.87:0/3763843341 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7fb65801f030 con 0x7fb66807dd50 2024-05-08T05:17:31.079 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:29.431+0000 7fb66f200700 1 -- 172.21.15.87:0/3763843341 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"} v 0) -- 0x7fb6681a25e0 con 0x7fb66807dd50 2024-05-08T05:17:31.079 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:29.432+0000 7fb664c00700 1 -- 172.21.15.87:0/3763843341 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"}]=0 v8) ==== 112+0+5 (secure 0 0 0) 0x7fb65801baa0 con 0x7fb66807dd50 2024-05-08T05:17:31.079 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:29.435+0000 7fb66f200700 1 -- 172.21.15.87:0/3763843341 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7fb64c03e590 msgr2=0x7fb64c040a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:17:31.079 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:29.435+0000 7fb66f200700 1 --2- 172.21.15.87:0/3763843341 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7fb64c03e590 0x7fb64c040a50 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fb654006fd0 tx=0x7fb654006e40 comp rx=0 tx=0).stop 2024-05-08T05:17:31.079 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:29.436+0000 7fb66f200700 1 -- 172.21.15.87:0/3763843341 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb66807dd50 msgr2=0x7fb66819ef50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:17:31.079 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:29.436+0000 7fb66f200700 1 --2- 172.21.15.87:0/3763843341 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb66807dd50 0x7fb66819ef50 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fb6580116e0 tx=0x7fb658011aa0 comp rx=0 tx=0).stop 2024-05-08T05:17:31.079 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:29.436+0000 7fb66f200700 1 -- 172.21.15.87:0/3763843341 shutdown_connections 2024-05-08T05:17:31.079 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:29.436+0000 7fb66f200700 1 --2- 172.21.15.87:0/3763843341 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7fb64c03e590 0x7fb64c040a50 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:17:31.079 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:29.436+0000 7fb66f200700 1 --2- 172.21.15.87:0/3763843341 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb66807dd50 0x7fb66819ef50 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:17:31.079 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:29.436+0000 7fb66f200700 1 -- 172.21.15.87:0/3763843341 >> 172.21.15.87:0/3763843341 conn(0x7fb668104560 msgr2=0x7fb668104f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:17:31.079 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:29.437+0000 7fb66f200700 1 -- 172.21.15.87:0/3763843341 shutdown_connections 2024-05-08T05:17:31.079 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:29.437+0000 7fb66f200700 1 -- 172.21.15.87:0/3763843341 wait complete. 2024-05-08T05:17:31.108 INFO:teuthology.orchestra.run.smithi087.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-05-08T05:17:31.108 INFO:teuthology.orchestra.run.smithi087.stdout:systemctl: stdout disabled 2024-05-08T05:17:31.127 INFO:teuthology.orchestra.run.smithi087.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-05-08T05:17:31.127 INFO:teuthology.orchestra.run.smithi087.stdout:systemctl: stdout inactive 2024-05-08T05:17:31.127 INFO:teuthology.orchestra.run.smithi087.stdout:firewalld.service is not enabled 2024-05-08T05:17:31.127 INFO:teuthology.orchestra.run.smithi087.stdout:Not possible to open ports <[8443]>. firewalld.service is not available 2024-05-08T05:17:31.131 INFO:teuthology.orchestra.run.smithi087.stdout:Ceph Dashboard is now available at: 2024-05-08T05:17:31.131 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-05-08T05:17:31.131 INFO:teuthology.orchestra.run.smithi087.stdout: URL: https://smithi087.front.sepia.ceph.com:8443/ 2024-05-08T05:17:31.131 INFO:teuthology.orchestra.run.smithi087.stdout: User: admin 2024-05-08T05:17:31.131 INFO:teuthology.orchestra.run.smithi087.stdout: Password: hlb5rguwes 2024-05-08T05:17:31.131 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-05-08T05:17:31.131 INFO:teuthology.orchestra.run.smithi087.stdout:Saving cluster configuration to /var/lib/ceph/eeeb813e-0cf9-11ef-bc97-c7b262605968/config directory 2024-05-08T05:17:31.132 INFO:teuthology.orchestra.run.smithi087.stdout:Enabling autotune for osd_memory_target 2024-05-08T05:17:32.667 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:31.706+0000 7f51dd600700 1 Processor -- start 2024-05-08T05:17:32.667 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:31.706+0000 7f51dd600700 1 -- start start 2024-05-08T05:17:32.667 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:31.707+0000 7f51dd600700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f51d8107e80 0x7f51d81082a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:17:32.667 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:31.707+0000 7f51dd600700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f51d81087e0 con 0x7f51d8107e80 2024-05-08T05:17:32.667 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:31.707+0000 7f51d6a00700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f51d8107e80 0x7f51d81082a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:17:32.667 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:31.707+0000 7f51d6a00700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f51d8107e80 0x7f51d81082a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:57676/0 (socket says 172.21.15.87:57676) 2024-05-08T05:17:32.667 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:31.707+0000 7f51d6a00700 1 -- 172.21.15.87:0/3560528408 learned_addr learned my addr 172.21.15.87:0/3560528408 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T05:17:32.667 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:31.708+0000 7f51d6a00700 1 -- 172.21.15.87:0/3560528408 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f51d8108fe0 con 0x7f51d8107e80 2024-05-08T05:17:32.667 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:31.708+0000 7f51d6a00700 1 --2- 172.21.15.87:0/3560528408 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f51d8107e80 0x7f51d81082a0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f51c800bb40 tx=0x7f51c800be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=51a52d571ff791a server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:17:32.667 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:31.708+0000 7f51d5600700 1 -- 172.21.15.87:0/3560528408 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f51c800dbe0 con 0x7f51d8107e80 2024-05-08T05:17:32.667 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:31.708+0000 7f51d5600700 1 -- 172.21.15.87:0/3560528408 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f51c80044e0 con 0x7f51d8107e80 2024-05-08T05:17:32.667 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:31.708+0000 7f51d5600700 1 -- 172.21.15.87:0/3560528408 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f51c8010470 con 0x7f51d8107e80 2024-05-08T05:17:32.668 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:31.709+0000 7f51dd600700 1 -- 172.21.15.87:0/3560528408 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f51d8107e80 msgr2=0x7f51d81082a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:17:32.668 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:31.709+0000 7f51dd600700 1 --2- 172.21.15.87:0/3560528408 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f51d8107e80 0x7f51d81082a0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f51c800bb40 tx=0x7f51c800be50 comp rx=0 tx=0).stop 2024-05-08T05:17:32.668 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:31.709+0000 7f51dd600700 1 -- 172.21.15.87:0/3560528408 shutdown_connections 2024-05-08T05:17:32.668 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:31.709+0000 7f51dd600700 1 --2- 172.21.15.87:0/3560528408 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f51d8107e80 0x7f51d81082a0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:17:32.668 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:31.709+0000 7f51dd600700 1 -- 172.21.15.87:0/3560528408 >> 172.21.15.87:0/3560528408 conn(0x7f51d8103480 msgr2=0x7f51d81058a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:17:32.668 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:31.709+0000 7f51dd600700 1 -- 172.21.15.87:0/3560528408 shutdown_connections 2024-05-08T05:17:32.668 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:31.709+0000 7f51dd600700 1 -- 172.21.15.87:0/3560528408 wait complete. 2024-05-08T05:17:32.668 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:31.711+0000 7f51dd600700 1 Processor -- start 2024-05-08T05:17:32.668 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:31.711+0000 7f51dd600700 1 -- start start 2024-05-08T05:17:32.668 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:31.711+0000 7f51dd600700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f51d8107e80 0x7f51d819ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:17:32.668 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:31.711+0000 7f51dd600700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f51d8075ec0 con 0x7f51d8107e80 2024-05-08T05:17:32.668 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:31.712+0000 7f51d6a00700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f51d8107e80 0x7f51d819ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:17:32.668 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:31.712+0000 7f51d6a00700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f51d8107e80 0x7f51d819ef60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:57688/0 (socket says 172.21.15.87:57688) 2024-05-08T05:17:32.668 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:31.712+0000 7f51d6a00700 1 -- 172.21.15.87:0/2910603780 learned_addr learned my addr 172.21.15.87:0/2910603780 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T05:17:32.669 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:31.712+0000 7f51d6a00700 1 -- 172.21.15.87:0/2910603780 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f51d819f4a0 con 0x7f51d8107e80 2024-05-08T05:17:32.669 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:31.712+0000 7f51d6a00700 1 --2- 172.21.15.87:0/2910603780 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f51d8107e80 0x7f51d819ef60 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f51c8003c30 tx=0x7f51c8003ff0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:17:32.669 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:31.712+0000 7f51cf400700 1 -- 172.21.15.87:0/2910603780 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f51c8010850 con 0x7f51d8107e80 2024-05-08T05:17:32.669 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:31.713+0000 7f51cf400700 1 -- 172.21.15.87:0/2910603780 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f51c801d070 con 0x7f51d8107e80 2024-05-08T05:17:32.669 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:31.713+0000 7f51cf400700 1 -- 172.21.15.87:0/2910603780 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f51c8021b30 con 0x7f51d8107e80 2024-05-08T05:17:32.669 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:31.713+0000 7f51dd600700 1 -- 172.21.15.87:0/2910603780 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f51d819f730 con 0x7f51d8107e80 2024-05-08T05:17:32.669 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:31.713+0000 7f51dd600700 1 -- 172.21.15.87:0/2910603780 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f51d81a2420 con 0x7f51d8107e80 2024-05-08T05:17:32.669 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:31.714+0000 7f51dd600700 1 -- 172.21.15.87:0/2910603780 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f51d8064b00 con 0x7f51d8107e80 2024-05-08T05:17:32.669 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:31.714+0000 7f51cf400700 1 -- 172.21.15.87:0/2910603780 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 13) ==== 50278+0+0 (secure 0 0 0) 0x7f51c801f030 con 0x7f51d8107e80 2024-05-08T05:17:32.669 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:31.715+0000 7f51cf400700 1 --2- 172.21.15.87:0/2910603780 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f51bc03e680 0x7f51bc040b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:17:32.669 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:31.715+0000 7f51cf400700 1 -- 172.21.15.87:0/2910603780 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f51c8053c60 con 0x7f51d8107e80 2024-05-08T05:17:32.669 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:31.715+0000 7f51d6000700 1 --2- 172.21.15.87:0/2910603780 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f51bc03e680 0x7f51bc040b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:17:32.669 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:31.716+0000 7f51d6000700 1 --2- 172.21.15.87:0/2910603780 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f51bc03e680 0x7f51bc040b40 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f51c4006fd0 tx=0x7f51c4006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:17:32.669 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:31.720+0000 7f51cf400700 1 -- 172.21.15.87:0/2910603780 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f51c8015070 con 0x7f51d8107e80 2024-05-08T05:17:32.669 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:31.949+0000 7f51dd600700 1 -- 172.21.15.87:0/2910603780 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command([{prefix=config set, name=osd_memory_target_autotune}] v 0) -- 0x7f51d8198420 con 0x7f51d8107e80 2024-05-08T05:17:32.670 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:31.950+0000 7f51cf400700 1 -- 172.21.15.87:0/2910603780 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{prefix=config set, name=osd_memory_target_autotune}]=0 v8)=0 v8) ==== 127+0+0 (secure 0 0 0) 0x7f51d8198420 con 0x7f51d8107e80 2024-05-08T05:17:32.670 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:31.953+0000 7f51dd600700 1 -- 172.21.15.87:0/2910603780 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f51bc03e680 msgr2=0x7f51bc040b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:17:32.670 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:31.953+0000 7f51dd600700 1 --2- 172.21.15.87:0/2910603780 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f51bc03e680 0x7f51bc040b40 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f51c4006fd0 tx=0x7f51c4006e40 comp rx=0 tx=0).stop 2024-05-08T05:17:32.670 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:31.953+0000 7f51dd600700 1 -- 172.21.15.87:0/2910603780 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f51d8107e80 msgr2=0x7f51d819ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:17:32.670 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:31.953+0000 7f51dd600700 1 --2- 172.21.15.87:0/2910603780 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f51d8107e80 0x7f51d819ef60 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f51c8003c30 tx=0x7f51c8003ff0 comp rx=0 tx=0).stop 2024-05-08T05:17:32.670 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:31.953+0000 7f51dd600700 1 -- 172.21.15.87:0/2910603780 shutdown_connections 2024-05-08T05:17:32.670 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:31.953+0000 7f51dd600700 1 --2- 172.21.15.87:0/2910603780 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f51bc03e680 0x7f51bc040b40 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:17:32.670 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:31.953+0000 7f51dd600700 1 --2- 172.21.15.87:0/2910603780 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f51d8107e80 0x7f51d819ef60 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:17:32.670 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:31.953+0000 7f51dd600700 1 -- 172.21.15.87:0/2910603780 >> 172.21.15.87:0/2910603780 conn(0x7f51d8103480 msgr2=0x7f51d8195500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:17:32.670 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:31.953+0000 7f51dd600700 1 -- 172.21.15.87:0/2910603780 shutdown_connections 2024-05-08T05:17:32.671 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:31.953+0000 7f51dd600700 1 -- 172.21.15.87:0/2910603780 wait complete. 2024-05-08T05:17:34.324 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:33.287+0000 7fa534000700 1 Processor -- start 2024-05-08T05:17:34.324 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:33.287+0000 7fa534000700 1 -- start start 2024-05-08T05:17:34.324 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:33.287+0000 7fa534000700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa52c10b180 0x7fa52c10b5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:17:34.324 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:33.288+0000 7fa534000700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fa52c10bb70 con 0x7fa52c10b180 2024-05-08T05:17:34.325 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:33.288+0000 7fa531600700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa52c10b180 0x7fa52c10b5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:17:34.325 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:33.288+0000 7fa531600700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa52c10b180 0x7fa52c10b5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:57690/0 (socket says 172.21.15.87:57690) 2024-05-08T05:17:34.325 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:33.288+0000 7fa531600700 1 -- 172.21.15.87:0/1611835568 learned_addr learned my addr 172.21.15.87:0/1611835568 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T05:17:34.325 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:33.288+0000 7fa531600700 1 -- 172.21.15.87:0/1611835568 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa52c10c370 con 0x7fa52c10b180 2024-05-08T05:17:34.325 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:33.289+0000 7fa531600700 1 --2- 172.21.15.87:0/1611835568 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa52c10b180 0x7fa52c10b5a0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fa5200098a0 tx=0x7fa520009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c34a2e7e693f433a server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:17:34.325 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:33.289+0000 7fa52be00700 1 -- 172.21.15.87:0/1611835568 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa520004160 con 0x7fa52c10b180 2024-05-08T05:17:34.325 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:33.289+0000 7fa52be00700 1 -- 172.21.15.87:0/1611835568 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa520004300 con 0x7fa52c10b180 2024-05-08T05:17:34.325 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:33.289+0000 7fa52be00700 1 -- 172.21.15.87:0/1611835568 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa520011a20 con 0x7fa52c10b180 2024-05-08T05:17:34.325 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:33.290+0000 7fa534000700 1 -- 172.21.15.87:0/1611835568 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa52c10b180 msgr2=0x7fa52c10b5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:17:34.325 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:33.290+0000 7fa534000700 1 --2- 172.21.15.87:0/1611835568 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa52c10b180 0x7fa52c10b5a0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fa5200098a0 tx=0x7fa520009bb0 comp rx=0 tx=0).stop 2024-05-08T05:17:34.325 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:33.290+0000 7fa534000700 1 -- 172.21.15.87:0/1611835568 shutdown_connections 2024-05-08T05:17:34.325 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:33.290+0000 7fa534000700 1 --2- 172.21.15.87:0/1611835568 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa52c10b180 0x7fa52c10b5a0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:17:34.326 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:33.290+0000 7fa534000700 1 -- 172.21.15.87:0/1611835568 >> 172.21.15.87:0/1611835568 conn(0x7fa52c07e960 msgr2=0x7fa52c1094b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:17:34.326 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:33.290+0000 7fa534000700 1 -- 172.21.15.87:0/1611835568 shutdown_connections 2024-05-08T05:17:34.326 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:33.290+0000 7fa534000700 1 -- 172.21.15.87:0/1611835568 wait complete. 2024-05-08T05:17:34.326 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:33.291+0000 7fa534000700 1 Processor -- start 2024-05-08T05:17:34.326 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:33.291+0000 7fa534000700 1 -- start start 2024-05-08T05:17:34.326 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:33.292+0000 7fa534000700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa52c10b180 0x7fa52c19efa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:17:34.326 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:33.292+0000 7fa534000700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fa52c10f720 con 0x7fa52c10b180 2024-05-08T05:17:34.326 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:33.292+0000 7fa531600700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa52c10b180 0x7fa52c19efa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:17:34.326 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:33.292+0000 7fa531600700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa52c10b180 0x7fa52c19efa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:57698/0 (socket says 172.21.15.87:57698) 2024-05-08T05:17:34.326 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:33.292+0000 7fa531600700 1 -- 172.21.15.87:0/2518662771 learned_addr learned my addr 172.21.15.87:0/2518662771 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T05:17:34.326 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:33.293+0000 7fa531600700 1 -- 172.21.15.87:0/2518662771 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa52c19f4e0 con 0x7fa52c10b180 2024-05-08T05:17:34.326 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:33.293+0000 7fa531600700 1 --2- 172.21.15.87:0/2518662771 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa52c10b180 0x7fa52c19efa0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fa520009520 tx=0x7fa520011aa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:17:34.326 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:33.293+0000 7fa52a000700 1 -- 172.21.15.87:0/2518662771 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa5200039e0 con 0x7fa52c10b180 2024-05-08T05:17:34.327 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:33.293+0000 7fa52a000700 1 -- 172.21.15.87:0/2518662771 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa52001b8f0 con 0x7fa52c10b180 2024-05-08T05:17:34.327 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:33.293+0000 7fa52a000700 1 -- 172.21.15.87:0/2518662771 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa520019770 con 0x7fa52c10b180 2024-05-08T05:17:34.327 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:33.293+0000 7fa534000700 1 -- 172.21.15.87:0/2518662771 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa52c19f770 con 0x7fa52c10b180 2024-05-08T05:17:34.327 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:33.293+0000 7fa534000700 1 -- 172.21.15.87:0/2518662771 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa52c1a2460 con 0x7fa52c10b180 2024-05-08T05:17:34.327 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:33.295+0000 7fa534000700 1 -- 172.21.15.87:0/2518662771 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa52c10f8a0 con 0x7fa52c10b180 2024-05-08T05:17:34.327 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:33.295+0000 7fa52a000700 1 -- 172.21.15.87:0/2518662771 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 13) ==== 50278+0+0 (secure 0 0 0) 0x7fa52001b440 con 0x7fa52c10b180 2024-05-08T05:17:34.327 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:33.295+0000 7fa52a000700 1 --2- 172.21.15.87:0/2518662771 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7fa51403e670 0x7fa514040b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:17:34.327 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:33.295+0000 7fa52a000700 1 -- 172.21.15.87:0/2518662771 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7fa520054140 con 0x7fa52c10b180 2024-05-08T05:17:34.327 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:33.296+0000 7fa530c00700 1 --2- 172.21.15.87:0/2518662771 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7fa51403e670 0x7fa514040b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:17:34.327 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:33.296+0000 7fa530c00700 1 --2- 172.21.15.87:0/2518662771 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7fa51403e670 0x7fa514040b30 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fa518006fd0 tx=0x7fa518006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:17:34.327 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:33.300+0000 7fa52a000700 1 -- 172.21.15.87:0/2518662771 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7fa52001f030 con 0x7fa52c10b180 2024-05-08T05:17:34.327 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:33.655+0000 7fa534000700 1 -- 172.21.15.87:0/2518662771 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command([{prefix=config-key set, key=mgr/dashboard/cluster/status}] v 0) -- 0x7fa52c1a2630 con 0x7fa52c10b180 2024-05-08T05:17:34.327 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:33.661+0000 7fa52a000700 1 -- 172.21.15.87:0/2518662771 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{prefix=config-key set, key=mgr/dashboard/cluster/status}]=0 set mgr/dashboard/cluster/status v28)=0 set mgr/dashboard/cluster/status v28) ==== 153+0+0 (secure 0 0 0) 0x7fa520018d60 con 0x7fa52c10b180 2024-05-08T05:17:34.327 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:33.664+0000 7fa534000700 1 -- 172.21.15.87:0/2518662771 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7fa51403e670 msgr2=0x7fa514040b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:17:34.327 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:33.664+0000 7fa534000700 1 --2- 172.21.15.87:0/2518662771 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7fa51403e670 0x7fa514040b30 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fa518006fd0 tx=0x7fa518006e40 comp rx=0 tx=0).stop 2024-05-08T05:17:34.328 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:33.664+0000 7fa534000700 1 -- 172.21.15.87:0/2518662771 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa52c10b180 msgr2=0x7fa52c19efa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:17:34.328 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:33.664+0000 7fa534000700 1 --2- 172.21.15.87:0/2518662771 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa52c10b180 0x7fa52c19efa0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fa520009520 tx=0x7fa520011aa0 comp rx=0 tx=0).stop 2024-05-08T05:17:34.328 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:33.664+0000 7fa534000700 1 -- 172.21.15.87:0/2518662771 shutdown_connections 2024-05-08T05:17:34.328 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:33.664+0000 7fa534000700 1 --2- 172.21.15.87:0/2518662771 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7fa51403e670 0x7fa514040b30 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:17:34.328 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:33.664+0000 7fa534000700 1 --2- 172.21.15.87:0/2518662771 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa52c10b180 0x7fa52c19efa0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:17:34.328 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:33.664+0000 7fa534000700 1 -- 172.21.15.87:0/2518662771 >> 172.21.15.87:0/2518662771 conn(0x7fa52c07e960 msgr2=0x7fa52c108a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:17:34.328 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:33.664+0000 7fa534000700 1 -- 172.21.15.87:0/2518662771 shutdown_connections 2024-05-08T05:17:34.328 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-05-08T05:17:33.664+0000 7fa534000700 1 -- 172.21.15.87:0/2518662771 wait complete. 2024-05-08T05:17:34.328 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr set mgr/dashboard/cluster/status 2024-05-08T05:17:34.328 INFO:teuthology.orchestra.run.smithi087.stdout:You can access the Ceph CLI as following in case of multi-cluster or non-default config: 2024-05-08T05:17:34.328 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-05-08T05:17:34.328 INFO:teuthology.orchestra.run.smithi087.stdout: sudo /home/ubuntu/cephtest/cephadm shell --fsid eeeb813e-0cf9-11ef-bc97-c7b262605968 -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring 2024-05-08T05:17:34.328 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-05-08T05:17:34.328 INFO:teuthology.orchestra.run.smithi087.stdout:Or, if you are only running a single cluster on this host: 2024-05-08T05:17:34.328 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-05-08T05:17:34.329 INFO:teuthology.orchestra.run.smithi087.stdout: sudo /home/ubuntu/cephtest/cephadm shell 2024-05-08T05:17:34.329 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-05-08T05:17:34.329 INFO:teuthology.orchestra.run.smithi087.stdout:Please consider enabling telemetry to help improve Ceph: 2024-05-08T05:17:34.329 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-05-08T05:17:34.329 INFO:teuthology.orchestra.run.smithi087.stdout: ceph telemetry on 2024-05-08T05:17:34.329 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-05-08T05:17:34.329 INFO:teuthology.orchestra.run.smithi087.stdout:For more information see: 2024-05-08T05:17:34.329 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-05-08T05:17:34.329 INFO:teuthology.orchestra.run.smithi087.stdout: https://docs.ceph.com/en/latest/mgr/telemetry/ 2024-05-08T05:17:34.329 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-05-08T05:17:34.329 INFO:teuthology.orchestra.run.smithi087.stdout:Bootstrap complete. 2024-05-08T05:17:34.421 INFO:tasks.cephadm:Fetching config... 2024-05-08T05:17:34.421 DEBUG:teuthology.orchestra.run.smithi087:> set -ex 2024-05-08T05:17:34.421 DEBUG:teuthology.orchestra.run.smithi087:> dd if=/etc/ceph/ceph.conf of=/dev/stdout 2024-05-08T05:17:34.479 INFO:tasks.cephadm:Fetching client.admin keyring... 2024-05-08T05:17:34.480 DEBUG:teuthology.orchestra.run.smithi087:> set -ex 2024-05-08T05:17:34.480 DEBUG:teuthology.orchestra.run.smithi087:> dd if=/etc/ceph/ceph.client.admin.keyring of=/dev/stdout 2024-05-08T05:17:34.560 INFO:tasks.cephadm:Fetching mon keyring... 2024-05-08T05:17:34.560 DEBUG:teuthology.orchestra.run.smithi087:> set -ex 2024-05-08T05:17:34.561 DEBUG:teuthology.orchestra.run.smithi087:> sudo dd if=/var/lib/ceph/eeeb813e-0cf9-11ef-bc97-c7b262605968/mon.a/keyring of=/dev/stdout 2024-05-08T05:17:34.678 INFO:tasks.cephadm:Fetching pub ssh key... 2024-05-08T05:17:34.679 DEBUG:teuthology.orchestra.run.smithi087:> set -ex 2024-05-08T05:17:34.679 DEBUG:teuthology.orchestra.run.smithi087:> dd if=/home/ubuntu/cephtest/ceph.pub of=/dev/stdout 2024-05-08T05:17:34.776 INFO:tasks.cephadm:Installing pub ssh key for root users... 2024-05-08T05:17:34.776 DEBUG:teuthology.orchestra.run.smithi087:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCy+b4wR0xAyucYQ8oM3r/VsyWeZ4ZWexZqwkCUcbrW4UQk7kt1/Nv2BntvITGTciyLVD5q/NsXxs8ZsQgfVnT2/vMGT+zeijW8v4uEU/UzLuljJApl6AT8TFggHx28OqkaSxjsQjYIbHbFkgRi735JT6hKV5DLJ9b0b8HoorzZGZqbXKKwsJEdxwUmL7qMgHPcjwR1+LHLCab8syYZwvixU63D11vxPjj4Ft+WgR8aw456DjrrHe1JbUEhfiB/hW5lDIVSahuFWlBfSDLmHgemgLA2x7gjRtWvqPYrFOHhcVab5Ho8ofo2T4z4GSSrHhq6OExXcPt6+qA6CyF9c9TuOx5/tC0L7kofysuCY2Zh+31mGVj98nqijM101P8P6K/bok+v3rA4gnrWttVOmFwAVwPbaQh+7BUxaHRp8hWys1M1I36Xuvah+HdGaMNdXvCi6aoyWokrXm9/xFYFpSUOV+i7b7ly9oeP+sY5D5EGXv7zt9a1kENOEflzv6rHOF8= ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-05-08T05:17:34.878 INFO:teuthology.orchestra.run.smithi087.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCy+b4wR0xAyucYQ8oM3r/VsyWeZ4ZWexZqwkCUcbrW4UQk7kt1/Nv2BntvITGTciyLVD5q/NsXxs8ZsQgfVnT2/vMGT+zeijW8v4uEU/UzLuljJApl6AT8TFggHx28OqkaSxjsQjYIbHbFkgRi735JT6hKV5DLJ9b0b8HoorzZGZqbXKKwsJEdxwUmL7qMgHPcjwR1+LHLCab8syYZwvixU63D11vxPjj4Ft+WgR8aw456DjrrHe1JbUEhfiB/hW5lDIVSahuFWlBfSDLmHgemgLA2x7gjRtWvqPYrFOHhcVab5Ho8ofo2T4z4GSSrHhq6OExXcPt6+qA6CyF9c9TuOx5/tC0L7kofysuCY2Zh+31mGVj98nqijM101P8P6K/bok+v3rA4gnrWttVOmFwAVwPbaQh+7BUxaHRp8hWys1M1I36Xuvah+HdGaMNdXvCi6aoyWokrXm9/xFYFpSUOV+i7b7ly9oeP+sY5D5EGXv7zt9a1kENOEflzv6rHOF8= ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968 2024-05-08T05:17:34.909 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:17:34 smithi087 ceph-mon[29523]: from='client.? 172.21.15.87:0/2518662771' entity='client.admin' 2024-05-08T05:17:34.924 DEBUG:teuthology.orchestra.run.smithi090:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCy+b4wR0xAyucYQ8oM3r/VsyWeZ4ZWexZqwkCUcbrW4UQk7kt1/Nv2BntvITGTciyLVD5q/NsXxs8ZsQgfVnT2/vMGT+zeijW8v4uEU/UzLuljJApl6AT8TFggHx28OqkaSxjsQjYIbHbFkgRi735JT6hKV5DLJ9b0b8HoorzZGZqbXKKwsJEdxwUmL7qMgHPcjwR1+LHLCab8syYZwvixU63D11vxPjj4Ft+WgR8aw456DjrrHe1JbUEhfiB/hW5lDIVSahuFWlBfSDLmHgemgLA2x7gjRtWvqPYrFOHhcVab5Ho8ofo2T4z4GSSrHhq6OExXcPt6+qA6CyF9c9TuOx5/tC0L7kofysuCY2Zh+31mGVj98nqijM101P8P6K/bok+v3rA4gnrWttVOmFwAVwPbaQh+7BUxaHRp8hWys1M1I36Xuvah+HdGaMNdXvCi6aoyWokrXm9/xFYFpSUOV+i7b7ly9oeP+sY5D5EGXv7zt9a1kENOEflzv6rHOF8= ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-05-08T05:17:34.965 INFO:teuthology.orchestra.run.smithi090.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCy+b4wR0xAyucYQ8oM3r/VsyWeZ4ZWexZqwkCUcbrW4UQk7kt1/Nv2BntvITGTciyLVD5q/NsXxs8ZsQgfVnT2/vMGT+zeijW8v4uEU/UzLuljJApl6AT8TFggHx28OqkaSxjsQjYIbHbFkgRi735JT6hKV5DLJ9b0b8HoorzZGZqbXKKwsJEdxwUmL7qMgHPcjwR1+LHLCab8syYZwvixU63D11vxPjj4Ft+WgR8aw456DjrrHe1JbUEhfiB/hW5lDIVSahuFWlBfSDLmHgemgLA2x7gjRtWvqPYrFOHhcVab5Ho8ofo2T4z4GSSrHhq6OExXcPt6+qA6CyF9c9TuOx5/tC0L7kofysuCY2Zh+31mGVj98nqijM101P8P6K/bok+v3rA4gnrWttVOmFwAVwPbaQh+7BUxaHRp8hWys1M1I36Xuvah+HdGaMNdXvCi6aoyWokrXm9/xFYFpSUOV+i7b7ly9oeP+sY5D5EGXv7zt9a1kENOEflzv6rHOF8= ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968 2024-05-08T05:17:34.977 DEBUG:teuthology.orchestra.run.smithi160:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCy+b4wR0xAyucYQ8oM3r/VsyWeZ4ZWexZqwkCUcbrW4UQk7kt1/Nv2BntvITGTciyLVD5q/NsXxs8ZsQgfVnT2/vMGT+zeijW8v4uEU/UzLuljJApl6AT8TFggHx28OqkaSxjsQjYIbHbFkgRi735JT6hKV5DLJ9b0b8HoorzZGZqbXKKwsJEdxwUmL7qMgHPcjwR1+LHLCab8syYZwvixU63D11vxPjj4Ft+WgR8aw456DjrrHe1JbUEhfiB/hW5lDIVSahuFWlBfSDLmHgemgLA2x7gjRtWvqPYrFOHhcVab5Ho8ofo2T4z4GSSrHhq6OExXcPt6+qA6CyF9c9TuOx5/tC0L7kofysuCY2Zh+31mGVj98nqijM101P8P6K/bok+v3rA4gnrWttVOmFwAVwPbaQh+7BUxaHRp8hWys1M1I36Xuvah+HdGaMNdXvCi6aoyWokrXm9/xFYFpSUOV+i7b7ly9oeP+sY5D5EGXv7zt9a1kENOEflzv6rHOF8= ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-05-08T05:17:35.018 INFO:teuthology.orchestra.run.smithi160.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCy+b4wR0xAyucYQ8oM3r/VsyWeZ4ZWexZqwkCUcbrW4UQk7kt1/Nv2BntvITGTciyLVD5q/NsXxs8ZsQgfVnT2/vMGT+zeijW8v4uEU/UzLuljJApl6AT8TFggHx28OqkaSxjsQjYIbHbFkgRi735JT6hKV5DLJ9b0b8HoorzZGZqbXKKwsJEdxwUmL7qMgHPcjwR1+LHLCab8syYZwvixU63D11vxPjj4Ft+WgR8aw456DjrrHe1JbUEhfiB/hW5lDIVSahuFWlBfSDLmHgemgLA2x7gjRtWvqPYrFOHhcVab5Ho8ofo2T4z4GSSrHhq6OExXcPt6+qA6CyF9c9TuOx5/tC0L7kofysuCY2Zh+31mGVj98nqijM101P8P6K/bok+v3rA4gnrWttVOmFwAVwPbaQh+7BUxaHRp8hWys1M1I36Xuvah+HdGaMNdXvCi6aoyWokrXm9/xFYFpSUOV+i7b7ly9oeP+sY5D5EGXv7zt9a1kENOEflzv6rHOF8= ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968 2024-05-08T05:17:35.030 DEBUG:teuthology.orchestra.run.smithi087:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid eeeb813e-0cf9-11ef-bc97-c7b262605968 -- ceph config set mgr mgr/cephadm/allow_ptrace true 2024-05-08T05:17:35.494 INFO:teuthology.orchestra.run.smithi087.stderr:Inferring config /var/lib/ceph/eeeb813e-0cf9-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T05:17:38.271 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:17:38.144+0000 7fedd6600700 1 -- 172.21.15.87:0/2798643223 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fedd0104f80 msgr2=0x7fedd01053a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:17:38.271 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:17:38.144+0000 7fedd6600700 1 --2- 172.21.15.87:0/2798643223 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fedd0104f80 0x7fedd01053a0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fedc0009910 tx=0x7fedc0009c20 comp rx=0 tx=0).stop 2024-05-08T05:17:38.271 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:17:38.144+0000 7fedd6600700 1 -- 172.21.15.87:0/2798643223 shutdown_connections 2024-05-08T05:17:38.271 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:17:38.144+0000 7fedd6600700 1 --2- 172.21.15.87:0/2798643223 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fedd0104f80 0x7fedd01053a0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:17:38.271 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:17:38.144+0000 7fedd6600700 1 -- 172.21.15.87:0/2798643223 >> 172.21.15.87:0/2798643223 conn(0x7fedd0100500 msgr2=0x7fedd0102960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:17:38.271 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:17:38.144+0000 7fedd6600700 1 -- 172.21.15.87:0/2798643223 shutdown_connections 2024-05-08T05:17:38.271 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:17:38.144+0000 7fedd6600700 1 -- 172.21.15.87:0/2798643223 wait complete. 2024-05-08T05:17:38.271 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:17:38.145+0000 7fedd6600700 1 Processor -- start 2024-05-08T05:17:38.271 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:17:38.145+0000 7fedd6600700 1 -- start start 2024-05-08T05:17:38.271 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:17:38.146+0000 7fedd6600700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fedd0104f80 0x7fedd019a590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:17:38.272 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:17:38.146+0000 7fedd6600700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fedd010aec0 con 0x7fedd0104f80 2024-05-08T05:17:38.272 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:17:38.146+0000 7fedd5200700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fedd0104f80 0x7fedd019a590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:17:38.272 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:17:38.146+0000 7fedd5200700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fedd0104f80 0x7fedd019a590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:46734/0 (socket says 172.21.15.87:46734) 2024-05-08T05:17:38.272 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:17:38.146+0000 7fedd5200700 1 -- 172.21.15.87:0/2483773922 learned_addr learned my addr 172.21.15.87:0/2483773922 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T05:17:38.272 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:17:38.146+0000 7fedd5200700 1 -- 172.21.15.87:0/2483773922 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fedd019aad0 con 0x7fedd0104f80 2024-05-08T05:17:38.272 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:17:38.147+0000 7fedd5200700 1 --2- 172.21.15.87:0/2483773922 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fedd0104f80 0x7fedd019a590 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fedc0005950 tx=0x7fedc0004fa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:17:38.272 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:17:38.147+0000 7fedcd600700 1 -- 172.21.15.87:0/2483773922 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fedc0026070 con 0x7fedd0104f80 2024-05-08T05:17:38.272 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:17:38.147+0000 7fedcd600700 1 -- 172.21.15.87:0/2483773922 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fedc000bc00 con 0x7fedd0104f80 2024-05-08T05:17:38.272 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:17:38.147+0000 7fedcd600700 1 -- 172.21.15.87:0/2483773922 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fedc0003a10 con 0x7fedd0104f80 2024-05-08T05:17:38.273 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:17:38.147+0000 7fedd6600700 1 -- 172.21.15.87:0/2483773922 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fedd019ad60 con 0x7fedd0104f80 2024-05-08T05:17:38.273 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:17:38.147+0000 7fedd6600700 1 -- 172.21.15.87:0/2483773922 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fedd019da50 con 0x7fedd0104f80 2024-05-08T05:17:38.273 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:17:38.148+0000 7fedcd600700 1 -- 172.21.15.87:0/2483773922 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 13) ==== 50278+0+0 (secure 0 0 0) 0x7fedc0029070 con 0x7fedd0104f80 2024-05-08T05:17:38.273 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:17:38.148+0000 7fedd6600700 1 -- 172.21.15.87:0/2483773922 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fedd010b640 con 0x7fedd0104f80 2024-05-08T05:17:38.273 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:17:38.149+0000 7fedcd600700 1 --2- 172.21.15.87:0/2483773922 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7fedb403e570 0x7fedb4040a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:17:38.273 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:17:38.149+0000 7fedcd600700 1 -- 172.21.15.87:0/2483773922 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7fedc001e070 con 0x7fedd0104f80 2024-05-08T05:17:38.273 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:17:38.149+0000 7fedcfe00700 1 --2- 172.21.15.87:0/2483773922 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7fedb403e570 0x7fedb4040a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:17:38.273 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:17:38.150+0000 7fedcfe00700 1 --2- 172.21.15.87:0/2483773922 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7fedb403e570 0x7fedb4040a30 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fedb800ad30 tx=0x7fedb80093f0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:17:38.273 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:17:38.155+0000 7fedcd600700 1 -- 172.21.15.87:0/2483773922 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7fedc0013070 con 0x7fedd0104f80 2024-05-08T05:17:38.396 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:17:38.395+0000 7fedd6600700 1 -- 172.21.15.87:0/2483773922 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command([{prefix=config set, name=mgr/cephadm/allow_ptrace}] v 0) -- 0x7fedd002e620 con 0x7fedd0104f80 2024-05-08T05:17:38.401 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:17:38.399+0000 7fedcd600700 1 -- 172.21.15.87:0/2483773922 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/allow_ptrace}]=0 v9)=0 v9) ==== 125+0+0 (secure 0 0 0) 0x7fedc00300c0 con 0x7fedd0104f80 2024-05-08T05:17:38.405 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:17:38.403+0000 7fedd6600700 1 -- 172.21.15.87:0/2483773922 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7fedb403e570 msgr2=0x7fedb4040a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:17:38.405 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:17:38.403+0000 7fedd6600700 1 --2- 172.21.15.87:0/2483773922 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7fedb403e570 0x7fedb4040a30 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fedb800ad30 tx=0x7fedb80093f0 comp rx=0 tx=0).stop 2024-05-08T05:17:38.405 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:17:38.403+0000 7fedd6600700 1 -- 172.21.15.87:0/2483773922 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fedd0104f80 msgr2=0x7fedd019a590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:17:38.405 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:17:38.403+0000 7fedd6600700 1 --2- 172.21.15.87:0/2483773922 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fedd0104f80 0x7fedd019a590 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fedc0005950 tx=0x7fedc0004fa0 comp rx=0 tx=0).stop 2024-05-08T05:17:38.405 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:17:38.403+0000 7fedd6600700 1 -- 172.21.15.87:0/2483773922 shutdown_connections 2024-05-08T05:17:38.405 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:17:38.403+0000 7fedd6600700 1 --2- 172.21.15.87:0/2483773922 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7fedb403e570 0x7fedb4040a30 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:17:38.405 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:17:38.403+0000 7fedd6600700 1 --2- 172.21.15.87:0/2483773922 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fedd0104f80 0x7fedd019a590 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:17:38.405 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:17:38.403+0000 7fedd6600700 1 -- 172.21.15.87:0/2483773922 >> 172.21.15.87:0/2483773922 conn(0x7fedd0100500 msgr2=0x7fedd01010b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:17:38.405 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:17:38.403+0000 7fedd6600700 1 -- 172.21.15.87:0/2483773922 shutdown_connections 2024-05-08T05:17:38.405 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:17:38.403+0000 7fedd6600700 1 -- 172.21.15.87:0/2483773922 wait complete. 2024-05-08T05:17:38.959 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:17:38 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:17:38.959 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:17:38 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:17:38.959 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:17:38 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi087", "name": "osd_memory_target"}]: dispatch 2024-05-08T05:17:38.959 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:17:38 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:17:38.959 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:17:38 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T05:17:38.959 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:17:38 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:17:38.959 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:17:38 smithi087 ceph-mon[29523]: from='client.? 172.21.15.87:0/2483773922' entity='client.admin' 2024-05-08T05:17:38.959 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:17:38 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T05:17:38.959 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:17:38 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:17:39.205 INFO:tasks.cephadm:Distributing conf and client.admin keyring to all hosts + 0755 2024-05-08T05:17:39.206 DEBUG:teuthology.orchestra.run.smithi087:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid eeeb813e-0cf9-11ef-bc97-c7b262605968 -- ceph orch client-keyring set client.admin '*' --mode 0755 2024-05-08T05:17:39.620 INFO:teuthology.orchestra.run.smithi087.stderr:Inferring config /var/lib/ceph/eeeb813e-0cf9-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T05:17:42.107 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:17:42.104+0000 7f92d7000700 1 -- 172.21.15.87:0/1839454018 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f92d0105150 msgr2=0x7f92d0105570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:17:42.107 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:17:42.105+0000 7f92d7000700 1 --2- 172.21.15.87:0/1839454018 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f92d0105150 0x7f92d0105570 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f92c0009910 tx=0x7f92c0009c20 comp rx=0 tx=0).stop 2024-05-08T05:17:42.107 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:17:42.105+0000 7f92d7000700 1 -- 172.21.15.87:0/1839454018 shutdown_connections 2024-05-08T05:17:42.107 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:17:42.105+0000 7f92d7000700 1 --2- 172.21.15.87:0/1839454018 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f92d0105150 0x7f92d0105570 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:17:42.107 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:17:42.105+0000 7f92d7000700 1 -- 172.21.15.87:0/1839454018 >> 172.21.15.87:0/1839454018 conn(0x7f92d01006d0 msgr2=0x7f92d0102b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:17:42.107 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:17:42.105+0000 7f92d7000700 1 -- 172.21.15.87:0/1839454018 shutdown_connections 2024-05-08T05:17:42.107 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:17:42.105+0000 7f92d7000700 1 -- 172.21.15.87:0/1839454018 wait complete. 2024-05-08T05:17:42.108 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:17:42.106+0000 7f92d7000700 1 Processor -- start 2024-05-08T05:17:42.108 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:17:42.106+0000 7f92d7000700 1 -- start start 2024-05-08T05:17:42.109 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:17:42.106+0000 7f92d7000700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f92d0105150 0x7f92d019a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:17:42.109 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:17:42.106+0000 7f92d7000700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f92d010b090 con 0x7f92d0105150 2024-05-08T05:17:42.109 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:17:42.107+0000 7f92cfe00700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f92d0105150 0x7f92d019a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:17:42.109 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:17:42.107+0000 7f92cfe00700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f92d0105150 0x7f92d019a7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:46754/0 (socket says 172.21.15.87:46754) 2024-05-08T05:17:42.109 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:17:42.107+0000 7f92cfe00700 1 -- 172.21.15.87:0/3055069961 learned_addr learned my addr 172.21.15.87:0/3055069961 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T05:17:42.109 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:17:42.107+0000 7f92cfe00700 1 -- 172.21.15.87:0/3055069961 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f92d019ace0 con 0x7f92d0105150 2024-05-08T05:17:42.109 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:17:42.107+0000 7f92cfe00700 1 --2- 172.21.15.87:0/3055069961 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f92d0105150 0x7f92d019a7a0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f92c0005800 tx=0x7f92c0009f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:17:42.110 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:17:42.107+0000 7f92ccc00700 1 -- 172.21.15.87:0/3055069961 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f92c0027070 con 0x7f92d0105150 2024-05-08T05:17:42.110 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:17:42.107+0000 7f92ccc00700 1 -- 172.21.15.87:0/3055069961 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f92c000be10 con 0x7f92d0105150 2024-05-08T05:17:42.110 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:17:42.108+0000 7f92d7000700 1 -- 172.21.15.87:0/3055069961 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f92d019af70 con 0x7f92d0105150 2024-05-08T05:17:42.110 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:17:42.108+0000 7f92ccc00700 1 -- 172.21.15.87:0/3055069961 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f92c000f460 con 0x7f92d0105150 2024-05-08T05:17:42.110 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:17:42.108+0000 7f92d7000700 1 -- 172.21.15.87:0/3055069961 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f92d019dc10 con 0x7f92d0105150 2024-05-08T05:17:42.111 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:17:42.109+0000 7f92d7000700 1 -- 172.21.15.87:0/3055069961 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f92d010b810 con 0x7f92d0105150 2024-05-08T05:17:42.111 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:17:42.109+0000 7f92ccc00700 1 -- 172.21.15.87:0/3055069961 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 13) ==== 50278+0+0 (secure 0 0 0) 0x7f92c002a070 con 0x7f92d0105150 2024-05-08T05:17:42.111 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:17:42.110+0000 7f92ccc00700 1 --2- 172.21.15.87:0/3055069961 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f92b403e510 0x7f92b40409d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:17:42.111 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:17:42.110+0000 7f92ccc00700 1 -- 172.21.15.87:0/3055069961 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f92c001e030 con 0x7f92d0105150 2024-05-08T05:17:42.111 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:17:42.110+0000 7f92cf400700 1 --2- 172.21.15.87:0/3055069961 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f92b403e510 0x7f92b40409d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:17:42.112 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:17:42.111+0000 7f92cf400700 1 --2- 172.21.15.87:0/3055069961 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f92b403e510 0x7f92b40409d0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f92bc006fd0 tx=0x7f92bc006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:17:42.117 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:17:42.116+0000 7f92ccc00700 1 -- 172.21.15.87:0/3055069961 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f92c0013070 con 0x7f92d0105150 2024-05-08T05:17:42.354 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:17:42.353+0000 7f92d7000700 1 -- 172.21.15.87:0/3055069961 --> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] -- mgr_command(tid 0: {"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}) -- 0x7f92d002e620 con 0x7f92b403e510 2024-05-08T05:17:42.361 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:17:42.361+0000 7f92ccc00700 1 -- 172.21.15.87:0/3055069961 <== mgr.14152 v2:172.21.15.87:6800/1189186457 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f92d002e620 con 0x7f92b403e510 2024-05-08T05:17:42.364 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:17:42.364+0000 7f92d7000700 1 -- 172.21.15.87:0/3055069961 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f92b403e510 msgr2=0x7f92b40409d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:17:42.364 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:17:42.364+0000 7f92d7000700 1 --2- 172.21.15.87:0/3055069961 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f92b403e510 0x7f92b40409d0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f92bc006fd0 tx=0x7f92bc006e40 comp rx=0 tx=0).stop 2024-05-08T05:17:42.364 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:17:42.364+0000 7f92d7000700 1 -- 172.21.15.87:0/3055069961 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f92d0105150 msgr2=0x7f92d019a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:17:42.364 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:17:42.364+0000 7f92d7000700 1 --2- 172.21.15.87:0/3055069961 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f92d0105150 0x7f92d019a7a0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f92c0005800 tx=0x7f92c0009f60 comp rx=0 tx=0).stop 2024-05-08T05:17:42.365 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:17:42.364+0000 7f92d7000700 1 -- 172.21.15.87:0/3055069961 shutdown_connections 2024-05-08T05:17:42.365 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:17:42.364+0000 7f92d7000700 1 --2- 172.21.15.87:0/3055069961 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f92b403e510 0x7f92b40409d0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:17:42.365 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:17:42.364+0000 7f92d7000700 1 --2- 172.21.15.87:0/3055069961 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f92d0105150 0x7f92d019a7a0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:17:42.365 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:17:42.364+0000 7f92d7000700 1 -- 172.21.15.87:0/3055069961 >> 172.21.15.87:0/3055069961 conn(0x7f92d01006d0 msgr2=0x7f92d01011e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:17:42.365 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:17:42.364+0000 7f92d7000700 1 -- 172.21.15.87:0/3055069961 shutdown_connections 2024-05-08T05:17:42.365 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:17:42.364+0000 7f92d7000700 1 -- 172.21.15.87:0/3055069961 wait complete. 2024-05-08T05:17:43.229 INFO:tasks.cephadm:Writing (initial) conf and keyring to smithi090 2024-05-08T05:17:43.230 DEBUG:teuthology.orchestra.run.smithi090:> set -ex 2024-05-08T05:17:43.230 DEBUG:teuthology.orchestra.run.smithi090:> dd of=/etc/ceph/ceph.conf 2024-05-08T05:17:43.249 DEBUG:teuthology.orchestra.run.smithi090:> set -ex 2024-05-08T05:17:43.249 DEBUG:teuthology.orchestra.run.smithi090:> dd of=/etc/ceph/ceph.client.admin.keyring 2024-05-08T05:17:43.305 INFO:tasks.cephadm:Adding host smithi090 to orchestrator... 2024-05-08T05:17:43.306 DEBUG:teuthology.orchestra.run.smithi087:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid eeeb813e-0cf9-11ef-bc97-c7b262605968 -- ceph orch host add smithi090 2024-05-08T05:17:43.458 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:17:43 smithi087 ceph-mon[29523]: from='client.14176 -' entity='client.admin' cmd=[{"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}]: dispatch 2024-05-08T05:17:43.458 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:17:43 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:17:43.458 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:17:43 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T05:17:43.458 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:17:43 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T05:17:43.459 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:17:43 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T05:17:43.459 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:17:43 smithi087 ceph-mon[29523]: Updating smithi087:/etc/ceph/ceph.conf 2024-05-08T05:17:43.718 INFO:teuthology.orchestra.run.smithi087.stderr:Inferring config /var/lib/ceph/eeeb813e-0cf9-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T05:17:44.458 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:17:44 smithi087 ceph-mon[29523]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-08T05:17:44.458 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:17:44 smithi087 ceph-mon[29523]: Updating smithi087:/var/lib/ceph/eeeb813e-0cf9-11ef-bc97-c7b262605968/config/ceph.conf 2024-05-08T05:17:45.614 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:17:45 smithi087 ceph-mon[29523]: Updating smithi087:/etc/ceph/ceph.client.admin.keyring 2024-05-08T05:17:45.614 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:17:45 smithi087 ceph-mon[29523]: Updating smithi087:/var/lib/ceph/eeeb813e-0cf9-11ef-bc97-c7b262605968/config/ceph.client.admin.keyring 2024-05-08T05:17:45.614 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:17:45 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:17:45.614 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:17:45 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:17:45.614 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:17:45 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:17:45.781 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:17:45.780+0000 7fe9d2200700 1 -- 172.21.15.87:0/999308632 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe9cc101af0 msgr2=0x7fe9cc101ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:17:45.781 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:17:45.780+0000 7fe9d2200700 1 --2- 172.21.15.87:0/999308632 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe9cc101af0 0x7fe9cc101ed0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fe9c0009910 tx=0x7fe9c0009c20 comp rx=0 tx=0).stop 2024-05-08T05:17:45.781 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:17:45.780+0000 7fe9d2200700 1 -- 172.21.15.87:0/999308632 shutdown_connections 2024-05-08T05:17:45.781 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:17:45.780+0000 7fe9d2200700 1 --2- 172.21.15.87:0/999308632 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe9cc101af0 0x7fe9cc101ed0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:17:45.782 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:17:45.780+0000 7fe9d2200700 1 -- 172.21.15.87:0/999308632 >> 172.21.15.87:0/999308632 conn(0x7fe9cc0fd730 msgr2=0x7fe9cc0ffb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:17:45.782 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:17:45.780+0000 7fe9d2200700 1 -- 172.21.15.87:0/999308632 shutdown_connections 2024-05-08T05:17:45.782 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:17:45.780+0000 7fe9d2200700 1 -- 172.21.15.87:0/999308632 wait complete. 2024-05-08T05:17:45.783 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:17:45.781+0000 7fe9d2200700 1 Processor -- start 2024-05-08T05:17:45.783 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:17:45.781+0000 7fe9d2200700 1 -- start start 2024-05-08T05:17:45.783 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:17:45.782+0000 7fe9d2200700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe9cc101af0 0x7fe9cc1a0620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:17:45.783 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:17:45.782+0000 7fe9d2200700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fe9cc10f460 con 0x7fe9cc101af0 2024-05-08T05:17:45.783 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:17:45.782+0000 7fe9d0e00700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe9cc101af0 0x7fe9cc1a0620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:17:45.783 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:17:45.782+0000 7fe9d0e00700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe9cc101af0 0x7fe9cc1a0620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:46776/0 (socket says 172.21.15.87:46776) 2024-05-08T05:17:45.783 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:17:45.782+0000 7fe9d0e00700 1 -- 172.21.15.87:0/2263855782 learned_addr learned my addr 172.21.15.87:0/2263855782 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T05:17:45.783 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:17:45.782+0000 7fe9d0e00700 1 -- 172.21.15.87:0/2263855782 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe9cc1a0b60 con 0x7fe9cc101af0 2024-05-08T05:17:45.783 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:17:45.783+0000 7fe9d0e00700 1 --2- 172.21.15.87:0/2263855782 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe9cc101af0 0x7fe9cc1a0620 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fe9c00056d0 tx=0x7fe9c00057b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:17:45.784 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:17:45.783+0000 7fe9c9600700 1 -- 172.21.15.87:0/2263855782 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe9c0026070 con 0x7fe9cc101af0 2024-05-08T05:17:45.784 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:17:45.783+0000 7fe9c9600700 1 -- 172.21.15.87:0/2263855782 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe9c000bc00 con 0x7fe9cc101af0 2024-05-08T05:17:45.784 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:17:45.783+0000 7fe9d2200700 1 -- 172.21.15.87:0/2263855782 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe9cc1a0df0 con 0x7fe9cc101af0 2024-05-08T05:17:45.784 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:17:45.783+0000 7fe9c9600700 1 -- 172.21.15.87:0/2263855782 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe9c0003920 con 0x7fe9cc101af0 2024-05-08T05:17:45.784 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:17:45.783+0000 7fe9d2200700 1 -- 172.21.15.87:0/2263855782 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe9cc19a7a0 con 0x7fe9cc101af0 2024-05-08T05:17:45.785 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:17:45.784+0000 7fe9d2200700 1 -- 172.21.15.87:0/2263855782 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe9cc06b9b0 con 0x7fe9cc101af0 2024-05-08T05:17:45.785 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:17:45.785+0000 7fe9c9600700 1 -- 172.21.15.87:0/2263855782 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 13) ==== 50278+0+0 (secure 0 0 0) 0x7fe9c0029070 con 0x7fe9cc101af0 2024-05-08T05:17:45.786 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:17:45.785+0000 7fe9c9600700 1 --2- 172.21.15.87:0/2263855782 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7fe9b403e510 0x7fe9b40409d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:17:45.786 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:17:45.785+0000 7fe9c9600700 1 -- 172.21.15.87:0/2263855782 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7fe9c001e070 con 0x7fe9cc101af0 2024-05-08T05:17:45.786 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:17:45.785+0000 7fe9cbe00700 1 --2- 172.21.15.87:0/2263855782 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7fe9b403e510 0x7fe9b40409d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:17:45.786 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:17:45.786+0000 7fe9cbe00700 1 --2- 172.21.15.87:0/2263855782 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7fe9b403e510 0x7fe9b40409d0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fe9b8006fd0 tx=0x7fe9b8006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:17:45.791 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:17:45.791+0000 7fe9c9600700 1 -- 172.21.15.87:0/2263855782 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7fe9c0013070 con 0x7fe9cc101af0 2024-05-08T05:17:46.029 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:17:46.029+0000 7fe9d2200700 1 -- 172.21.15.87:0/2263855782 --> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi090", "target": ["mon-mgr", ""]}) -- 0x7fe9cc064b00 con 0x7fe9b403e510 2024-05-08T05:17:46.708 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:17:46 smithi087 ceph-mon[29523]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-08T05:17:47.708 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:17:47 smithi087 ceph-mon[29523]: from='client.14178 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi090", "target": ["mon-mgr", ""]}]: dispatch 2024-05-08T05:17:48.708 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:17:48 smithi087 ceph-mon[29523]: Deploying cephadm binary to smithi090 2024-05-08T05:17:48.708 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:17:48 smithi087 ceph-mon[29523]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-08T05:17:50.669 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:17:50.668+0000 7fe9c9600700 1 -- 172.21.15.87:0/2263855782 <== mgr.14152 v2:172.21.15.87:6800/1189186457 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+48 (secure 0 0 0) 0x7fe9cc064b00 con 0x7fe9b403e510 2024-05-08T05:17:50.670 INFO:teuthology.orchestra.run.smithi087.stdout:Added host 'smithi090' with addr '172.21.15.90' 2024-05-08T05:17:50.670 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:17:50 smithi087 ceph-mon[29523]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-08T05:17:50.674 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:17:50.673+0000 7fe9d2200700 1 -- 172.21.15.87:0/2263855782 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7fe9b403e510 msgr2=0x7fe9b40409d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:17:50.674 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:17:50.673+0000 7fe9d2200700 1 --2- 172.21.15.87:0/2263855782 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7fe9b403e510 0x7fe9b40409d0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fe9b8006fd0 tx=0x7fe9b8006e40 comp rx=0 tx=0).stop 2024-05-08T05:17:50.674 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:17:50.673+0000 7fe9d2200700 1 -- 172.21.15.87:0/2263855782 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe9cc101af0 msgr2=0x7fe9cc1a0620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:17:50.674 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:17:50.673+0000 7fe9d2200700 1 --2- 172.21.15.87:0/2263855782 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe9cc101af0 0x7fe9cc1a0620 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fe9c00056d0 tx=0x7fe9c00057b0 comp rx=0 tx=0).stop 2024-05-08T05:17:50.675 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:17:50.674+0000 7fe9d2200700 1 -- 172.21.15.87:0/2263855782 shutdown_connections 2024-05-08T05:17:50.675 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:17:50.674+0000 7fe9d2200700 1 --2- 172.21.15.87:0/2263855782 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7fe9b403e510 0x7fe9b40409d0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:17:50.675 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:17:50.674+0000 7fe9d2200700 1 --2- 172.21.15.87:0/2263855782 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe9cc101af0 0x7fe9cc1a0620 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:17:50.675 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:17:50.674+0000 7fe9d2200700 1 -- 172.21.15.87:0/2263855782 >> 172.21.15.87:0/2263855782 conn(0x7fe9cc0fd730 msgr2=0x7fe9cc0fe7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:17:50.675 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:17:50.674+0000 7fe9d2200700 1 -- 172.21.15.87:0/2263855782 shutdown_connections 2024-05-08T05:17:50.675 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:17:50.674+0000 7fe9d2200700 1 -- 172.21.15.87:0/2263855782 wait complete. 2024-05-08T05:17:51.502 DEBUG:teuthology.orchestra.run.smithi087:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid eeeb813e-0cf9-11ef-bc97-c7b262605968 -- ceph orch host ls --format=json 2024-05-08T05:17:51.908 INFO:teuthology.orchestra.run.smithi087.stderr:Inferring config /var/lib/ceph/eeeb813e-0cf9-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T05:17:51.958 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:17:51 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:17:51.958 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:17:51 smithi087 ceph-mon[29523]: Added host smithi090 2024-05-08T05:17:51.958 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:17:51 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T05:17:51.958 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:17:51 smithi087 ceph-mon[29523]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-08T05:17:51.958 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:17:51 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:17:53.075 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:17:52 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:17:54.028 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:17:54.027+0000 7fcca2200700 1 -- 172.21.15.87:0/2756951304 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcc9c105170 msgr2=0x7fcc9c105550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:17:54.028 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:17:54.027+0000 7fcca2200700 1 --2- 172.21.15.87:0/2756951304 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcc9c105170 0x7fcc9c105550 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fcc90009910 tx=0x7fcc90009c20 comp rx=0 tx=0).stop 2024-05-08T05:17:54.028 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:17:54.027+0000 7fcca2200700 1 -- 172.21.15.87:0/2756951304 shutdown_connections 2024-05-08T05:17:54.028 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:17:54.027+0000 7fcca2200700 1 --2- 172.21.15.87:0/2756951304 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcc9c105170 0x7fcc9c105550 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:17:54.028 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:17:54.027+0000 7fcca2200700 1 -- 172.21.15.87:0/2756951304 >> 172.21.15.87:0/2756951304 conn(0x7fcc9c100a20 msgr2=0x7fcc9c102e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:17:54.028 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:17:54.027+0000 7fcca2200700 1 -- 172.21.15.87:0/2756951304 shutdown_connections 2024-05-08T05:17:54.028 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:17:54.027+0000 7fcca2200700 1 -- 172.21.15.87:0/2756951304 wait complete. 2024-05-08T05:17:54.029 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:17:54.028+0000 7fcca2200700 1 Processor -- start 2024-05-08T05:17:54.029 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:17:54.028+0000 7fcca2200700 1 -- start start 2024-05-08T05:17:54.029 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:17:54.029+0000 7fcca2200700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcc9c105170 0x7fcc9c1a0610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:17:54.029 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:17:54.029+0000 7fcca2200700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fcc9c10f3f0 con 0x7fcc9c105170 2024-05-08T05:17:54.030 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:17:54.029+0000 7fcca0e00700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcc9c105170 0x7fcc9c1a0610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:17:54.030 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:17:54.029+0000 7fcca0e00700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcc9c105170 0x7fcc9c1a0610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:55494/0 (socket says 172.21.15.87:55494) 2024-05-08T05:17:54.030 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:17:54.029+0000 7fcca0e00700 1 -- 172.21.15.87:0/2258117524 learned_addr learned my addr 172.21.15.87:0/2258117524 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T05:17:54.030 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:17:54.029+0000 7fcca0e00700 1 -- 172.21.15.87:0/2258117524 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcc9c1a0b50 con 0x7fcc9c105170 2024-05-08T05:17:54.031 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:17:54.030+0000 7fcca0e00700 1 --2- 172.21.15.87:0/2258117524 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcc9c105170 0x7fcc9c1a0610 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fcc900056d0 tx=0x7fcc900057b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:17:54.031 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:17:54.030+0000 7fcc99600700 1 -- 172.21.15.87:0/2258117524 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcc90026070 con 0x7fcc9c105170 2024-05-08T05:17:54.031 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:17:54.030+0000 7fcc99600700 1 -- 172.21.15.87:0/2258117524 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fcc9000bba0 con 0x7fcc9c105170 2024-05-08T05:17:54.031 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:17:54.030+0000 7fcca2200700 1 -- 172.21.15.87:0/2258117524 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcc9c1a0e40 con 0x7fcc9c105170 2024-05-08T05:17:54.031 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:17:54.030+0000 7fcc99600700 1 -- 172.21.15.87:0/2258117524 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcc90003920 con 0x7fcc9c105170 2024-05-08T05:17:54.031 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:17:54.030+0000 7fcca2200700 1 -- 172.21.15.87:0/2258117524 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcc9c19a790 con 0x7fcc9c105170 2024-05-08T05:17:54.032 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:17:54.031+0000 7fcca2200700 1 -- 172.21.15.87:0/2258117524 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcc9c106650 con 0x7fcc9c105170 2024-05-08T05:17:54.032 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:17:54.031+0000 7fcc99600700 1 -- 172.21.15.87:0/2258117524 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 13) ==== 50278+0+0 (secure 0 0 0) 0x7fcc90029070 con 0x7fcc9c105170 2024-05-08T05:17:54.032 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:17:54.032+0000 7fcc99600700 1 --2- 172.21.15.87:0/2258117524 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7fcc8403e510 0x7fcc840409d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:17:54.032 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:17:54.032+0000 7fcc99600700 1 -- 172.21.15.87:0/2258117524 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7fcc9001e070 con 0x7fcc9c105170 2024-05-08T05:17:54.032 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:17:54.032+0000 7fcc9be00700 1 --2- 172.21.15.87:0/2258117524 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7fcc8403e510 0x7fcc840409d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:17:54.033 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:17:54.033+0000 7fcc9be00700 1 --2- 172.21.15.87:0/2258117524 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7fcc8403e510 0x7fcc840409d0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fcc88006fd0 tx=0x7fcc88006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:17:54.038 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:17:54.037+0000 7fcc99600700 1 -- 172.21.15.87:0/2258117524 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7fcc90013070 con 0x7fcc9c105170 2024-05-08T05:17:54.275 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:17:54.274+0000 7fcca2200700 1 -- 172.21.15.87:0/2258117524 --> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fcc9c19bcc0 con 0x7fcc8403e510 2024-05-08T05:17:54.277 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:17:54.276+0000 7fcc99600700 1 -- 172.21.15.87:0/2258117524 <== mgr.14152 v2:172.21.15.87:6800/1189186457 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+159 (secure 0 0 0) 0x7fcc9c19bcc0 con 0x7fcc8403e510 2024-05-08T05:17:54.277 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-05-08T05:17:54.277 INFO:teuthology.orchestra.run.smithi087.stdout:[{"addr": "172.21.15.87", "hostname": "smithi087", "labels": [], "status": ""}, {"addr": "172.21.15.90", "hostname": "smithi090", "labels": [], "status": ""}] 2024-05-08T05:17:54.280 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:17:54.279+0000 7fcca2200700 1 -- 172.21.15.87:0/2258117524 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7fcc8403e510 msgr2=0x7fcc840409d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:17:54.280 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:17:54.279+0000 7fcca2200700 1 --2- 172.21.15.87:0/2258117524 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7fcc8403e510 0x7fcc840409d0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fcc88006fd0 tx=0x7fcc88006e40 comp rx=0 tx=0).stop 2024-05-08T05:17:54.281 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:17:54.279+0000 7fcca2200700 1 -- 172.21.15.87:0/2258117524 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcc9c105170 msgr2=0x7fcc9c1a0610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:17:54.281 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:17:54.279+0000 7fcca2200700 1 --2- 172.21.15.87:0/2258117524 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcc9c105170 0x7fcc9c1a0610 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fcc900056d0 tx=0x7fcc900057b0 comp rx=0 tx=0).stop 2024-05-08T05:17:54.281 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:17:54.280+0000 7fcca2200700 1 -- 172.21.15.87:0/2258117524 shutdown_connections 2024-05-08T05:17:54.281 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:17:54.280+0000 7fcca2200700 1 --2- 172.21.15.87:0/2258117524 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7fcc8403e510 0x7fcc840409d0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:17:54.281 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:17:54.280+0000 7fcca2200700 1 --2- 172.21.15.87:0/2258117524 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcc9c105170 0x7fcc9c1a0610 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:17:54.281 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:17:54.280+0000 7fcca2200700 1 -- 172.21.15.87:0/2258117524 >> 172.21.15.87:0/2258117524 conn(0x7fcc9c100a20 msgr2=0x7fcc9c106b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:17:54.281 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:17:54.280+0000 7fcca2200700 1 -- 172.21.15.87:0/2258117524 shutdown_connections 2024-05-08T05:17:54.281 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:17:54.280+0000 7fcca2200700 1 -- 172.21.15.87:0/2258117524 wait complete. 2024-05-08T05:17:54.626 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:17:54 smithi087 ceph-mon[29523]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-08T05:17:54.626 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:17:54 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:17:54.988 INFO:tasks.cephadm:Writing (initial) conf and keyring to smithi160 2024-05-08T05:17:54.989 DEBUG:teuthology.orchestra.run.smithi160:> set -ex 2024-05-08T05:17:54.989 DEBUG:teuthology.orchestra.run.smithi160:> dd of=/etc/ceph/ceph.conf 2024-05-08T05:17:55.007 DEBUG:teuthology.orchestra.run.smithi160:> set -ex 2024-05-08T05:17:55.007 DEBUG:teuthology.orchestra.run.smithi160:> dd of=/etc/ceph/ceph.client.admin.keyring 2024-05-08T05:17:55.065 INFO:tasks.cephadm:Adding host smithi160 to orchestrator... 2024-05-08T05:17:55.065 DEBUG:teuthology.orchestra.run.smithi087:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid eeeb813e-0cf9-11ef-bc97-c7b262605968 -- ceph orch host add smithi160 2024-05-08T05:17:55.497 INFO:teuthology.orchestra.run.smithi087.stderr:Inferring config /var/lib/ceph/eeeb813e-0cf9-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T05:17:55.708 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:17:55 smithi087 ceph-mon[29523]: from='client.14180 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-05-08T05:17:56.664 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:17:56 smithi087 ceph-mon[29523]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-08T05:17:56.664 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:17:56 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:17:56.664 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:17:56 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:17:56.664 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:17:56 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:17:56.664 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:17:56 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:17:56.664 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:17:56 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi090", "name": "osd_memory_target"}]: dispatch 2024-05-08T05:17:56.664 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:17:56 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T05:17:56.664 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:17:56 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T05:17:57.578 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:17:57.576+0000 7fc2f2c00700 1 -- 172.21.15.87:0/436518412 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc2ec105170 msgr2=0x7fc2ec105550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:17:57.578 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:17:57.576+0000 7fc2f2c00700 1 --2- 172.21.15.87:0/436518412 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc2ec105170 0x7fc2ec105550 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fc2e0009910 tx=0x7fc2e0009c20 comp rx=0 tx=0).stop 2024-05-08T05:17:57.578 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:17:57.577+0000 7fc2f2c00700 1 -- 172.21.15.87:0/436518412 shutdown_connections 2024-05-08T05:17:57.578 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:17:57.577+0000 7fc2f2c00700 1 --2- 172.21.15.87:0/436518412 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc2ec105170 0x7fc2ec105550 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:17:57.578 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:17:57.577+0000 7fc2f2c00700 1 -- 172.21.15.87:0/436518412 >> 172.21.15.87:0/436518412 conn(0x7fc2ec100a20 msgr2=0x7fc2ec102e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:17:57.578 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:17:57.577+0000 7fc2f2c00700 1 -- 172.21.15.87:0/436518412 shutdown_connections 2024-05-08T05:17:57.578 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:17:57.577+0000 7fc2f2c00700 1 -- 172.21.15.87:0/436518412 wait complete. 2024-05-08T05:17:57.579 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:17:57 smithi087 ceph-mon[29523]: Updating smithi090:/etc/ceph/ceph.conf 2024-05-08T05:17:57.579 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:17:57.578+0000 7fc2f2c00700 1 Processor -- start 2024-05-08T05:17:57.579 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:17:57.578+0000 7fc2f2c00700 1 -- start start 2024-05-08T05:17:57.580 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:17:57.579+0000 7fc2f2c00700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc2ec105170 0x7fc2ec1a0670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:17:57.580 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:17:57.579+0000 7fc2f2c00700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fc2ec10f3f0 con 0x7fc2ec105170 2024-05-08T05:17:57.580 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:17:57.579+0000 7fc2f1800700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc2ec105170 0x7fc2ec1a0670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:17:57.580 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:17:57.579+0000 7fc2f1800700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc2ec105170 0x7fc2ec1a0670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:57222/0 (socket says 172.21.15.87:57222) 2024-05-08T05:17:57.580 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:17:57.579+0000 7fc2f1800700 1 -- 172.21.15.87:0/1786950381 learned_addr learned my addr 172.21.15.87:0/1786950381 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T05:17:57.581 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:17:57.579+0000 7fc2f1800700 1 -- 172.21.15.87:0/1786950381 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc2ec1a0bb0 con 0x7fc2ec105170 2024-05-08T05:17:57.581 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:17:57.580+0000 7fc2f1800700 1 --2- 172.21.15.87:0/1786950381 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc2ec105170 0x7fc2ec1a0670 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fc2e00056d0 tx=0x7fc2e00057b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:17:57.581 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:17:57.580+0000 7fc2ea000700 1 -- 172.21.15.87:0/1786950381 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc2e0026070 con 0x7fc2ec105170 2024-05-08T05:17:57.581 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:17:57.580+0000 7fc2ea000700 1 -- 172.21.15.87:0/1786950381 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc2e000bba0 con 0x7fc2ec105170 2024-05-08T05:17:57.581 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:17:57.580+0000 7fc2f2c00700 1 -- 172.21.15.87:0/1786950381 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc2ec1a0ea0 con 0x7fc2ec105170 2024-05-08T05:17:57.581 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:17:57.580+0000 7fc2ea000700 1 -- 172.21.15.87:0/1786950381 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc2e0003920 con 0x7fc2ec105170 2024-05-08T05:17:57.581 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:17:57.580+0000 7fc2f2c00700 1 -- 172.21.15.87:0/1786950381 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc2ec19a960 con 0x7fc2ec105170 2024-05-08T05:17:57.581 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:17:57.581+0000 7fc2ea000700 1 -- 172.21.15.87:0/1786950381 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 13) ==== 50278+0+0 (secure 0 0 0) 0x7fc2e0029070 con 0x7fc2ec105170 2024-05-08T05:17:57.582 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:17:57.582+0000 7fc2f2c00700 1 -- 172.21.15.87:0/1786950381 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc2ec106650 con 0x7fc2ec105170 2024-05-08T05:17:57.582 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:17:57.582+0000 7fc2ea000700 1 --2- 172.21.15.87:0/1786950381 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7fc2d403e570 0x7fc2d4040a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:17:57.582 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:17:57.582+0000 7fc2ea000700 1 -- 172.21.15.87:0/1786950381 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7fc2e001e070 con 0x7fc2ec105170 2024-05-08T05:17:57.583 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:17:57.582+0000 7fc2f0e00700 1 --2- 172.21.15.87:0/1786950381 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7fc2d403e570 0x7fc2d4040a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:17:57.583 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:17:57.583+0000 7fc2f0e00700 1 --2- 172.21.15.87:0/1786950381 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7fc2d403e570 0x7fc2d4040a30 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fc2d8006fd0 tx=0x7fc2d8006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:17:57.588 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:17:57.588+0000 7fc2ea000700 1 -- 172.21.15.87:0/1786950381 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7fc2e0013070 con 0x7fc2ec105170 2024-05-08T05:17:57.829 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:17:57.828+0000 7fc2f2c00700 1 -- 172.21.15.87:0/1786950381 --> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi160", "target": ["mon-mgr", ""]}) -- 0x7fc2ec19bce0 con 0x7fc2d403e570 2024-05-08T05:17:58.709 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:17:58 smithi087 ceph-mon[29523]: Updating smithi090:/var/lib/ceph/eeeb813e-0cf9-11ef-bc97-c7b262605968/config/ceph.conf 2024-05-08T05:17:58.709 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:17:58 smithi087 ceph-mon[29523]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-08T05:17:58.709 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:17:58 smithi087 ceph-mon[29523]: Updating smithi090:/etc/ceph/ceph.client.admin.keyring 2024-05-08T05:17:58.709 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:17:58 smithi087 ceph-mon[29523]: Updating smithi090:/var/lib/ceph/eeeb813e-0cf9-11ef-bc97-c7b262605968/config/ceph.client.admin.keyring 2024-05-08T05:17:58.709 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:17:58 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:17:58.709 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:17:58 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:17:58.709 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:17:58 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:17:59.958 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:17:59 smithi087 ceph-mon[29523]: from='client.14182 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi160", "target": ["mon-mgr", ""]}]: dispatch 2024-05-08T05:18:00.958 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:18:00 smithi087 ceph-mon[29523]: Deploying cephadm binary to smithi160 2024-05-08T05:18:00.958 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:18:00 smithi087 ceph-mon[29523]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-08T05:18:02.469 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:18:02.468+0000 7fc2ea000700 1 -- 172.21.15.87:0/1786950381 <== mgr.14152 v2:172.21.15.87:6800/1189186457 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+49 (secure 0 0 0) 0x7fc2ec19bce0 con 0x7fc2d403e570 2024-05-08T05:18:02.470 INFO:teuthology.orchestra.run.smithi087.stdout:Added host 'smithi160' with addr '172.21.15.160' 2024-05-08T05:18:02.474 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:18:02.473+0000 7fc2f2c00700 1 -- 172.21.15.87:0/1786950381 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7fc2d403e570 msgr2=0x7fc2d4040a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:18:02.474 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:18:02.473+0000 7fc2f2c00700 1 --2- 172.21.15.87:0/1786950381 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7fc2d403e570 0x7fc2d4040a30 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fc2d8006fd0 tx=0x7fc2d8006e40 comp rx=0 tx=0).stop 2024-05-08T05:18:02.474 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:18:02.473+0000 7fc2f2c00700 1 -- 172.21.15.87:0/1786950381 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc2ec105170 msgr2=0x7fc2ec1a0670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:18:02.474 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:18:02.473+0000 7fc2f2c00700 1 --2- 172.21.15.87:0/1786950381 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc2ec105170 0x7fc2ec1a0670 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fc2e00056d0 tx=0x7fc2e00057b0 comp rx=0 tx=0).stop 2024-05-08T05:18:02.474 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:18:02.473+0000 7fc2f2c00700 1 -- 172.21.15.87:0/1786950381 shutdown_connections 2024-05-08T05:18:02.474 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:18:02.473+0000 7fc2f2c00700 1 --2- 172.21.15.87:0/1786950381 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7fc2d403e570 0x7fc2d4040a30 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:18:02.474 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:18:02.473+0000 7fc2f2c00700 1 --2- 172.21.15.87:0/1786950381 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc2ec105170 0x7fc2ec1a0670 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:18:02.474 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:18:02.473+0000 7fc2f2c00700 1 -- 172.21.15.87:0/1786950381 >> 172.21.15.87:0/1786950381 conn(0x7fc2ec100a20 msgr2=0x7fc2ec106b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:18:02.474 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:18:02.473+0000 7fc2f2c00700 1 -- 172.21.15.87:0/1786950381 shutdown_connections 2024-05-08T05:18:02.474 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:18:02.474+0000 7fc2f2c00700 1 -- 172.21.15.87:0/1786950381 wait complete. 2024-05-08T05:18:02.790 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:18:02 smithi087 ceph-mon[29523]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-08T05:18:03.290 DEBUG:teuthology.orchestra.run.smithi087:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid eeeb813e-0cf9-11ef-bc97-c7b262605968 -- ceph orch host ls --format=json 2024-05-08T05:18:03.726 INFO:teuthology.orchestra.run.smithi087.stderr:Inferring config /var/lib/ceph/eeeb813e-0cf9-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T05:18:03.871 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:18:03 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:18:03.872 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:18:03 smithi087 ceph-mon[29523]: Added host smithi160 2024-05-08T05:18:03.872 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:18:03 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T05:18:03.872 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:18:03 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:18:04.829 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:18:04 smithi087 ceph-mon[29523]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-08T05:18:04.829 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:18:04 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:18:05.602 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:18:05.601+0000 7f7727200700 1 -- 172.21.15.87:0/2910532232 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f772010e4e0 msgr2=0x7f772010e8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:18:05.602 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:18:05.601+0000 7f7727200700 1 --2- 172.21.15.87:0/2910532232 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f772010e4e0 0x7f772010e8c0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f7710009910 tx=0x7f7710009c20 comp rx=0 tx=0).stop 2024-05-08T05:18:05.602 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:18:05.601+0000 7f7727200700 1 -- 172.21.15.87:0/2910532232 shutdown_connections 2024-05-08T05:18:05.603 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:18:05.601+0000 7f7727200700 1 --2- 172.21.15.87:0/2910532232 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f772010e4e0 0x7f772010e8c0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:18:05.603 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:18:05.601+0000 7f7727200700 1 -- 172.21.15.87:0/2910532232 >> 172.21.15.87:0/2910532232 conn(0x7f7720078c40 msgr2=0x7f772007b060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:18:05.603 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:18:05.601+0000 7f7727200700 1 -- 172.21.15.87:0/2910532232 shutdown_connections 2024-05-08T05:18:05.603 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:18:05.601+0000 7f7727200700 1 -- 172.21.15.87:0/2910532232 wait complete. 2024-05-08T05:18:05.604 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:18:05.602+0000 7f7727200700 1 Processor -- start 2024-05-08T05:18:05.604 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:18:05.603+0000 7f7727200700 1 -- start start 2024-05-08T05:18:05.604 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:18:05.603+0000 7f7727200700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f772010e4e0 0x7f772019eef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:18:05.604 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:18:05.603+0000 7f7727200700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f7720113a00 con 0x7f772010e4e0 2024-05-08T05:18:05.604 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:18:05.603+0000 7f771fe00700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f772010e4e0 0x7f772019eef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:18:05.604 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:18:05.603+0000 7f771fe00700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f772010e4e0 0x7f772019eef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:57240/0 (socket says 172.21.15.87:57240) 2024-05-08T05:18:05.604 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:18:05.603+0000 7f771fe00700 1 -- 172.21.15.87:0/1353240994 learned_addr learned my addr 172.21.15.87:0/1353240994 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T05:18:05.604 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:18:05.604+0000 7f771fe00700 1 -- 172.21.15.87:0/1353240994 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f772019f430 con 0x7f772010e4e0 2024-05-08T05:18:05.605 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:18:05.604+0000 7f771fe00700 1 --2- 172.21.15.87:0/1353240994 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f772010e4e0 0x7f772019eef0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f77100092e0 tx=0x7f7710005780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:18:05.606 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:18:05.604+0000 7f771d600700 1 -- 172.21.15.87:0/1353240994 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7710026070 con 0x7f772010e4e0 2024-05-08T05:18:05.606 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:18:05.604+0000 7f7727200700 1 -- 172.21.15.87:0/1353240994 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f772019f6c0 con 0x7f772010e4e0 2024-05-08T05:18:05.606 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:18:05.604+0000 7f771d600700 1 -- 172.21.15.87:0/1353240994 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f771000b750 con 0x7f772010e4e0 2024-05-08T05:18:05.606 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:18:05.604+0000 7f771d600700 1 -- 172.21.15.87:0/1353240994 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f77100038a0 con 0x7f772010e4e0 2024-05-08T05:18:05.606 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:18:05.605+0000 7f7727200700 1 -- 172.21.15.87:0/1353240994 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f77201a3770 con 0x7f772010e4e0 2024-05-08T05:18:05.607 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:18:05.606+0000 7f771d600700 1 -- 172.21.15.87:0/1353240994 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 13) ==== 50278+0+0 (secure 0 0 0) 0x7f7710029070 con 0x7f772010e4e0 2024-05-08T05:18:05.607 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:18:05.606+0000 7f7727200700 1 -- 172.21.15.87:0/1353240994 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f772010abe0 con 0x7f772010e4e0 2024-05-08T05:18:05.607 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:18:05.606+0000 7f771d600700 1 --2- 172.21.15.87:0/1353240994 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f770403e510 0x7f77040409d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:18:05.607 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:18:05.606+0000 7f771d600700 1 -- 172.21.15.87:0/1353240994 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f771001e070 con 0x7f772010e4e0 2024-05-08T05:18:05.607 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:18:05.607+0000 7f7717400700 1 --2- 172.21.15.87:0/1353240994 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f770403e510 0x7f77040409d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:18:05.608 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:18:05.607+0000 7f7717400700 1 --2- 172.21.15.87:0/1353240994 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f770403e510 0x7f77040409d0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f770800ad30 tx=0x7f77080093f0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:18:05.613 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:18:05.612+0000 7f771d600700 1 -- 172.21.15.87:0/1353240994 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f7710013070 con 0x7f772010e4e0 2024-05-08T05:18:05.849 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:18:05.848+0000 7f7727200700 1 -- 172.21.15.87:0/1353240994 --> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f77201a0200 con 0x7f770403e510 2024-05-08T05:18:05.850 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:18:05.850+0000 7f771d600700 1 -- 172.21.15.87:0/1353240994 <== mgr.14152 v2:172.21.15.87:6800/1189186457 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+239 (secure 0 0 0) 0x7f77201a0200 con 0x7f770403e510 2024-05-08T05:18:05.850 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-05-08T05:18:05.851 INFO:teuthology.orchestra.run.smithi087.stdout:[{"addr": "172.21.15.87", "hostname": "smithi087", "labels": [], "status": ""}, {"addr": "172.21.15.90", "hostname": "smithi090", "labels": [], "status": ""}, {"addr": "172.21.15.160", "hostname": "smithi160", "labels": [], "status": ""}] 2024-05-08T05:18:05.853 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:18:05.853+0000 7f7727200700 1 -- 172.21.15.87:0/1353240994 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f770403e510 msgr2=0x7f77040409d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:18:05.853 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:18:05.853+0000 7f7727200700 1 --2- 172.21.15.87:0/1353240994 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f770403e510 0x7f77040409d0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f770800ad30 tx=0x7f77080093f0 comp rx=0 tx=0).stop 2024-05-08T05:18:05.853 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:18:05.853+0000 7f7727200700 1 -- 172.21.15.87:0/1353240994 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f772010e4e0 msgr2=0x7f772019eef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:18:05.853 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:18:05.853+0000 7f7727200700 1 --2- 172.21.15.87:0/1353240994 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f772010e4e0 0x7f772019eef0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f77100092e0 tx=0x7f7710005780 comp rx=0 tx=0).stop 2024-05-08T05:18:05.854 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:18:05.853+0000 7f7727200700 1 -- 172.21.15.87:0/1353240994 shutdown_connections 2024-05-08T05:18:05.854 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:18:05.853+0000 7f7727200700 1 --2- 172.21.15.87:0/1353240994 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f770403e510 0x7f77040409d0 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:18:05.854 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:18:05.853+0000 7f7727200700 1 --2- 172.21.15.87:0/1353240994 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f772010e4e0 0x7f772019eef0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:18:05.854 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:18:05.853+0000 7f7727200700 1 -- 172.21.15.87:0/1353240994 >> 172.21.15.87:0/1353240994 conn(0x7f7720078c40 msgr2=0x7f7720111040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:18:05.854 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:18:05.853+0000 7f7727200700 1 -- 172.21.15.87:0/1353240994 shutdown_connections 2024-05-08T05:18:05.854 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:18:05.853+0000 7f7727200700 1 -- 172.21.15.87:0/1353240994 wait complete. 2024-05-08T05:18:06.502 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:18:06 smithi087 ceph-mon[29523]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-08T05:18:06.502 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:18:06 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:18:06.581 INFO:tasks.cephadm:Setting crush tunables to default 2024-05-08T05:18:06.581 DEBUG:teuthology.orchestra.run.smithi087:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid eeeb813e-0cf9-11ef-bc97-c7b262605968 -- ceph osd crush tunables default 2024-05-08T05:18:07.016 INFO:teuthology.orchestra.run.smithi087.stderr:Inferring config /var/lib/ceph/eeeb813e-0cf9-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T05:18:07.336 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:18:07 smithi087 ceph-mon[29523]: from='client.14184 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-05-08T05:18:08.574 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:18:08 smithi087 ceph-mon[29523]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-08T05:18:09.143 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:18:09.141+0000 7fda7f200700 1 -- 172.21.15.87:0/3372912058 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fda8010f3e0 msgr2=0x7fda8010f7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:18:09.143 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:18:09.141+0000 7fda7f200700 1 --2- 172.21.15.87:0/3372912058 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fda8010f3e0 0x7fda8010f7c0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fda70009910 tx=0x7fda70009c20 comp rx=0 tx=0).stop 2024-05-08T05:18:09.143 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:18:09.142+0000 7fda7f200700 1 -- 172.21.15.87:0/3372912058 shutdown_connections 2024-05-08T05:18:09.143 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:18:09.142+0000 7fda7f200700 1 --2- 172.21.15.87:0/3372912058 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fda8010f3e0 0x7fda8010f7c0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:18:09.143 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:18:09.142+0000 7fda7f200700 1 -- 172.21.15.87:0/3372912058 >> 172.21.15.87:0/3372912058 conn(0x7fda80078ab0 msgr2=0x7fda8007aed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:18:09.143 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:18:09.142+0000 7fda7f200700 1 -- 172.21.15.87:0/3372912058 shutdown_connections 2024-05-08T05:18:09.143 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:18:09.142+0000 7fda7f200700 1 -- 172.21.15.87:0/3372912058 wait complete. 2024-05-08T05:18:09.144 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:18:09.143+0000 7fda7f200700 1 Processor -- start 2024-05-08T05:18:09.144 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:18:09.143+0000 7fda7f200700 1 -- start start 2024-05-08T05:18:09.144 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:18:09.143+0000 7fda7f200700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fda8010f3e0 0x7fda801a48d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:18:09.144 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:18:09.144+0000 7fda7f200700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fda801137e0 con 0x7fda8010f3e0 2024-05-08T05:18:09.144 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:18:09.144+0000 7fda7de00700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fda8010f3e0 0x7fda801a48d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:18:09.144 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:18:09.144+0000 7fda7de00700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fda8010f3e0 0x7fda801a48d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:47242/0 (socket says 172.21.15.87:47242) 2024-05-08T05:18:09.145 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:18:09.144+0000 7fda7de00700 1 -- 172.21.15.87:0/2822684009 learned_addr learned my addr 172.21.15.87:0/2822684009 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T05:18:09.145 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:18:09.144+0000 7fda7de00700 1 -- 172.21.15.87:0/2822684009 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fda801a4e10 con 0x7fda8010f3e0 2024-05-08T05:18:09.145 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:18:09.144+0000 7fda7de00700 1 --2- 172.21.15.87:0/2822684009 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fda8010f3e0 0x7fda801a48d0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fda70006010 tx=0x7fda70005780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:18:09.145 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:18:09.145+0000 7fda76a00700 1 -- 172.21.15.87:0/2822684009 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fda70026070 con 0x7fda8010f3e0 2024-05-08T05:18:09.145 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:18:09.145+0000 7fda7f200700 1 -- 172.21.15.87:0/2822684009 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fda801a5100 con 0x7fda8010f3e0 2024-05-08T05:18:09.145 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:18:09.145+0000 7fda76a00700 1 -- 172.21.15.87:0/2822684009 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fda7000bba0 con 0x7fda8010f3e0 2024-05-08T05:18:09.146 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:18:09.145+0000 7fda76a00700 1 -- 172.21.15.87:0/2822684009 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fda70003930 con 0x7fda8010f3e0 2024-05-08T05:18:09.146 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:18:09.145+0000 7fda7f200700 1 -- 172.21.15.87:0/2822684009 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fda8019ea90 con 0x7fda8010f3e0 2024-05-08T05:18:09.146 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:18:09.146+0000 7fda7f200700 1 -- 172.21.15.87:0/2822684009 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fda8010aa20 con 0x7fda8010f3e0 2024-05-08T05:18:09.147 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:18:09.146+0000 7fda76a00700 1 -- 172.21.15.87:0/2822684009 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 13) ==== 50278+0+0 (secure 0 0 0) 0x7fda70029070 con 0x7fda8010f3e0 2024-05-08T05:18:09.147 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:18:09.147+0000 7fda76a00700 1 --2- 172.21.15.87:0/2822684009 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7fda6403e570 0x7fda64040a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:18:09.147 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:18:09.147+0000 7fda76a00700 1 -- 172.21.15.87:0/2822684009 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7fda7001e070 con 0x7fda8010f3e0 2024-05-08T05:18:09.148 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:18:09.147+0000 7fda7d400700 1 --2- 172.21.15.87:0/2822684009 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7fda6403e570 0x7fda64040a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:18:09.148 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:18:09.148+0000 7fda7d400700 1 --2- 172.21.15.87:0/2822684009 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7fda6403e570 0x7fda64040a30 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fda6c006fd0 tx=0x7fda6c006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:18:09.153 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:18:09.153+0000 7fda76a00700 1 -- 172.21.15.87:0/2822684009 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7fda70013070 con 0x7fda8010f3e0 2024-05-08T05:18:09.396 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:18:09.396+0000 7fda7f200700 1 -- 172.21.15.87:0/2822684009 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) -- 0x7fda801a0060 con 0x7fda8010f3e0 2024-05-08T05:18:09.397 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:18:09 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:18:09.397 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:18:09 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:18:09.397 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:18:09 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:18:09.397 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:18:09 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:18:09.397 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:18:09 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi160", "name": "osd_memory_target"}]: dispatch 2024-05-08T05:18:09.397 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:18:09 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T05:18:09.397 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:18:09 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T05:18:09.397 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:18:09 smithi087 ceph-mon[29523]: Updating smithi160:/etc/ceph/ceph.conf 2024-05-08T05:18:10.366 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:18:10.365+0000 7fda76a00700 1 -- 172.21.15.87:0/2822684009 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v4) ==== 124+0+0 (secure 0 0 0) 0x7fda7002b440 con 0x7fda8010f3e0 2024-05-08T05:18:10.370 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:18:10.369+0000 7fda7f200700 1 -- 172.21.15.87:0/2822684009 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7fda6403e570 msgr2=0x7fda64040a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:18:10.371 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:18:10.369+0000 7fda7f200700 1 --2- 172.21.15.87:0/2822684009 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7fda6403e570 0x7fda64040a30 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fda6c006fd0 tx=0x7fda6c006e40 comp rx=0 tx=0).stop 2024-05-08T05:18:10.371 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:18:10.369+0000 7fda7f200700 1 -- 172.21.15.87:0/2822684009 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fda8010f3e0 msgr2=0x7fda801a48d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:18:10.371 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:18:10.369+0000 7fda7f200700 1 --2- 172.21.15.87:0/2822684009 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fda8010f3e0 0x7fda801a48d0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fda70006010 tx=0x7fda70005780 comp rx=0 tx=0).stop 2024-05-08T05:18:10.371 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:18:10.370+0000 7fda7f200700 1 -- 172.21.15.87:0/2822684009 shutdown_connections 2024-05-08T05:18:10.371 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:18:10.370+0000 7fda7f200700 1 --2- 172.21.15.87:0/2822684009 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7fda6403e570 0x7fda64040a30 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:18:10.371 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:18:10.370+0000 7fda7f200700 1 --2- 172.21.15.87:0/2822684009 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fda8010f3e0 0x7fda801a48d0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:18:10.371 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:18:10.370+0000 7fda7f200700 1 -- 172.21.15.87:0/2822684009 >> 172.21.15.87:0/2822684009 conn(0x7fda80078ab0 msgr2=0x7fda8007a350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:18:10.371 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:18:10.370+0000 7fda7f200700 1 -- 172.21.15.87:0/2822684009 shutdown_connections 2024-05-08T05:18:10.371 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:18:10.370+0000 7fda7f200700 1 -- 172.21.15.87:0/2822684009 wait complete. 2024-05-08T05:18:10.372 INFO:teuthology.orchestra.run.smithi087.stderr:adjusted tunables profile to default 2024-05-08T05:18:10.708 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:18:10 smithi087 ceph-mon[29523]: Updating smithi160:/var/lib/ceph/eeeb813e-0cf9-11ef-bc97-c7b262605968/config/ceph.conf 2024-05-08T05:18:10.708 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:18:10 smithi087 ceph-mon[29523]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-08T05:18:10.709 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:18:10 smithi087 ceph-mon[29523]: Updating smithi160:/etc/ceph/ceph.client.admin.keyring 2024-05-08T05:18:10.709 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:18:10 smithi087 ceph-mon[29523]: Updating smithi160:/var/lib/ceph/eeeb813e-0cf9-11ef-bc97-c7b262605968/config/ceph.client.admin.keyring 2024-05-08T05:18:10.709 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:18:10 smithi087 ceph-mon[29523]: from='client.? 172.21.15.87:0/2822684009' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2024-05-08T05:18:10.709 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:18:10 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:18:10.709 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:18:10 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:18:10.709 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:18:10 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:18:11.132 INFO:tasks.cephadm:Adding mon.a on smithi087 2024-05-08T05:18:11.132 INFO:tasks.cephadm:Adding mon.b on smithi090 2024-05-08T05:18:11.132 INFO:tasks.cephadm:Adding mon.c on smithi160 2024-05-08T05:18:11.132 DEBUG:teuthology.orchestra.run.smithi160:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid eeeb813e-0cf9-11ef-bc97-c7b262605968 -- ceph orch apply mon '3;smithi087:172.21.15.87=a;smithi090:172.21.15.90=b;smithi160:172.21.15.160=c' 2024-05-08T05:18:11.372 INFO:teuthology.orchestra.run.smithi160.stderr:Inferring config /var/lib/ceph/eeeb813e-0cf9-11ef-bc97-c7b262605968/config/ceph.conf 2024-05-08T05:18:11.708 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:18:11 smithi087 ceph-mon[29523]: from='client.? 172.21.15.87:0/2822684009' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2024-05-08T05:18:11.708 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:18:11 smithi087 ceph-mon[29523]: osdmap e4: 0 total, 0 up, 0 in 2024-05-08T05:18:12.708 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:18:12 smithi087 ceph-mon[29523]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-08T05:18:12.770 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-08T05:18:12.768+0000 7f03f3023700 1 -- 172.21.15.160:0/3141743069 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f03ec102050 msgr2=0x7f03ec102430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:18:12.770 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-08T05:18:12.768+0000 7f03f3023700 1 --2- 172.21.15.160:0/3141743069 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f03ec102050 0x7f03ec102430 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f03dc009910 tx=0x7f03dc009c20 comp rx=0 tx=0).stop 2024-05-08T05:18:12.770 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-08T05:18:12.768+0000 7f03f3023700 1 -- 172.21.15.160:0/3141743069 shutdown_connections 2024-05-08T05:18:12.770 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-08T05:18:12.768+0000 7f03f3023700 1 --2- 172.21.15.160:0/3141743069 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f03ec102050 0x7f03ec102430 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:18:12.770 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-08T05:18:12.768+0000 7f03f3023700 1 -- 172.21.15.160:0/3141743069 >> 172.21.15.160:0/3141743069 conn(0x7f03ec077900 msgr2=0x7f03ec077d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:18:12.770 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-08T05:18:12.768+0000 7f03f3023700 1 -- 172.21.15.160:0/3141743069 shutdown_connections 2024-05-08T05:18:12.770 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-08T05:18:12.768+0000 7f03f3023700 1 -- 172.21.15.160:0/3141743069 wait complete. 2024-05-08T05:18:12.771 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-08T05:18:12.769+0000 7f03f3023700 1 Processor -- start 2024-05-08T05:18:12.771 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-08T05:18:12.769+0000 7f03f3023700 1 -- start start 2024-05-08T05:18:12.771 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-08T05:18:12.769+0000 7f03f3023700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f03ec102050 0x7f03ec199730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:18:12.771 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-08T05:18:12.769+0000 7f03f3023700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f03ec10c280 con 0x7f03ec102050 2024-05-08T05:18:12.772 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-08T05:18:12.770+0000 7f03f0dbf700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f03ec102050 0x7f03ec199730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:18:12.772 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-08T05:18:12.770+0000 7f03f0dbf700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f03ec102050 0x7f03ec199730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.160:43078/0 (socket says 172.21.15.160:43078) 2024-05-08T05:18:12.772 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-08T05:18:12.770+0000 7f03f0dbf700 1 -- 172.21.15.160:0/1323967170 learned_addr learned my addr 172.21.15.160:0/1323967170 (peer_addr_for_me v2:172.21.15.160:0/0) 2024-05-08T05:18:12.772 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-08T05:18:12.771+0000 7f03f0dbf700 1 -- 172.21.15.160:0/1323967170 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f03ec199c70 con 0x7f03ec102050 2024-05-08T05:18:12.772 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-08T05:18:12.771+0000 7f03f0dbf700 1 --2- 172.21.15.160:0/1323967170 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f03ec102050 0x7f03ec199730 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f03dc0056d0 tx=0x7f03dc0057b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:18:12.772 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-08T05:18:12.771+0000 7f03e1ffb700 1 -- 172.21.15.160:0/1323967170 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f03dc026070 con 0x7f03ec102050 2024-05-08T05:18:12.772 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-08T05:18:12.771+0000 7f03f3023700 1 -- 172.21.15.160:0/1323967170 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f03ec199f60 con 0x7f03ec102050 2024-05-08T05:18:12.773 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-08T05:18:12.772+0000 7f03f3023700 1 -- 172.21.15.160:0/1323967170 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f03ec19a420 con 0x7f03ec102050 2024-05-08T05:18:12.773 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-08T05:18:12.772+0000 7f03e1ffb700 1 -- 172.21.15.160:0/1323967170 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f03dc00bba0 con 0x7f03ec102050 2024-05-08T05:18:12.773 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-08T05:18:12.772+0000 7f03e1ffb700 1 -- 172.21.15.160:0/1323967170 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f03dc0037f0 con 0x7f03ec102050 2024-05-08T05:18:12.773 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-08T05:18:12.773+0000 7f03f3023700 1 -- 172.21.15.160:0/1323967170 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f03ec1034e0 con 0x7f03ec102050 2024-05-08T05:18:12.773 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-08T05:18:12.773+0000 7f03e1ffb700 1 -- 172.21.15.160:0/1323967170 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 13) ==== 50278+0+0 (secure 0 0 0) 0x7f03dc029070 con 0x7f03ec102050 2024-05-08T05:18:12.774 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-08T05:18:12.773+0000 7f03e1ffb700 1 --2- 172.21.15.160:0/1323967170 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f03d403e570 0x7f03d4040a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:18:12.774 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-08T05:18:12.773+0000 7f03e1ffb700 1 -- 172.21.15.160:0/1323967170 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f03dc01e070 con 0x7f03ec102050 2024-05-08T05:18:12.774 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-08T05:18:12.774+0000 7f03e3fff700 1 --2- 172.21.15.160:0/1323967170 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f03d403e570 0x7f03d4040a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:18:12.775 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-08T05:18:12.775+0000 7f03e3fff700 1 --2- 172.21.15.160:0/1323967170 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f03d403e570 0x7f03d4040a30 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f03e8006fd0 tx=0x7f03e8006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:18:12.789 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-08T05:18:12.789+0000 7f03e1ffb700 1 -- 172.21.15.160:0/1323967170 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f03dc013070 con 0x7f03ec102050 2024-05-08T05:18:13.003 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-08T05:18:13.002+0000 7f03f3023700 1 -- 172.21.15.160:0/1323967170 --> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi087:172.21.15.87=a;smithi090:172.21.15.90=b;smithi160:172.21.15.160=c", "target": ["mon-mgr", ""]}) -- 0x7f03ec06aed0 con 0x7f03d403e570 2024-05-08T05:18:13.018 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-08T05:18:13.017+0000 7f03e1ffb700 1 -- 172.21.15.160:0/1323967170 <== mgr.14152 v2:172.21.15.87:6800/1189186457 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+24 (secure 0 0 0) 0x7f03ec06aed0 con 0x7f03d403e570 2024-05-08T05:18:13.018 INFO:teuthology.orchestra.run.smithi160.stdout:Scheduled mon update... 2024-05-08T05:18:13.020 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-08T05:18:13.020+0000 7f03f3023700 1 -- 172.21.15.160:0/1323967170 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f03d403e570 msgr2=0x7f03d4040a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:18:13.021 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-08T05:18:13.020+0000 7f03f3023700 1 --2- 172.21.15.160:0/1323967170 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f03d403e570 0x7f03d4040a30 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f03e8006fd0 tx=0x7f03e8006e40 comp rx=0 tx=0).stop 2024-05-08T05:18:13.021 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-08T05:18:13.020+0000 7f03f3023700 1 -- 172.21.15.160:0/1323967170 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f03ec102050 msgr2=0x7f03ec199730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:18:13.021 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-08T05:18:13.020+0000 7f03f3023700 1 --2- 172.21.15.160:0/1323967170 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f03ec102050 0x7f03ec199730 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f03dc0056d0 tx=0x7f03dc0057b0 comp rx=0 tx=0).stop 2024-05-08T05:18:13.021 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-08T05:18:13.020+0000 7f03f3023700 1 -- 172.21.15.160:0/1323967170 shutdown_connections 2024-05-08T05:18:13.021 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-08T05:18:13.020+0000 7f03f3023700 1 --2- 172.21.15.160:0/1323967170 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f03d403e570 0x7f03d4040a30 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:18:13.021 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-08T05:18:13.020+0000 7f03f3023700 1 --2- 172.21.15.160:0/1323967170 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f03ec102050 0x7f03ec199730 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:18:13.021 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-08T05:18:13.020+0000 7f03f3023700 1 -- 172.21.15.160:0/1323967170 >> 172.21.15.160:0/1323967170 conn(0x7f03ec077900 msgr2=0x7f03ec109b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:18:13.021 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-08T05:18:13.020+0000 7f03f3023700 1 -- 172.21.15.160:0/1323967170 shutdown_connections 2024-05-08T05:18:13.021 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-08T05:18:13.020+0000 7f03f3023700 1 -- 172.21.15.160:0/1323967170 wait complete. 2024-05-08T05:18:13.615 DEBUG:teuthology.orchestra.run.smithi090:mon.b> sudo journalctl -f -n 0 -u ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968@mon.b.service 2024-05-08T05:18:13.618 DEBUG:teuthology.orchestra.run.smithi160:mon.c> sudo journalctl -f -n 0 -u ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968@mon.c.service 2024-05-08T05:18:13.620 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-05-08T05:18:13.620 DEBUG:teuthology.orchestra.run.smithi160:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid eeeb813e-0cf9-11ef-bc97-c7b262605968 -- ceph mon dump -f json 2024-05-08T05:18:14.459 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:18:14 smithi087 ceph-mon[29523]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-08T05:18:14.459 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:18:14 smithi087 ceph-mon[29523]: from='client.14188 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi087:172.21.15.87=a;smithi090:172.21.15.90=b;smithi160:172.21.15.160=c", "target": ["mon-mgr", ""]}]: dispatch 2024-05-08T05:18:14.459 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:18:14 smithi087 ceph-mon[29523]: Saving service mon spec with placement smithi087:172.21.15.87=a;smithi090:172.21.15.90=b;smithi160:172.21.15.160=c;count:3 2024-05-08T05:18:14.459 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:18:14 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:18:14.459 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:18:14 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T05:18:14.459 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:18:14 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T05:18:14.459 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:18:14 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T05:18:14.459 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:18:14 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:18:14.459 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:18:14 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-05-08T05:18:14.460 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:18:14 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T05:18:14.460 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:18:14 smithi087 ceph-mon[29523]: Deploying daemon mon.c on smithi160 2024-05-08T05:18:15.322 INFO:teuthology.orchestra.run.smithi160.stderr:Inferring config /var/lib/ceph/eeeb813e-0cf9-11ef-bc97-c7b262605968/config/ceph.conf 2024-05-08T05:18:16.458 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:18:16 smithi087 ceph-mon[29523]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-08T05:18:17.443 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-08T05:18:17.442+0000 7f6eadfec700 1 -- 172.21.15.160:0/1891236247 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6ea8103110 msgr2=0x7f6ea81034f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:18:17.444 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-08T05:18:17.442+0000 7f6eadfec700 1 --2- 172.21.15.160:0/1891236247 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6ea8103110 0x7f6ea81034f0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f6e98009910 tx=0x7f6e98009c20 comp rx=0 tx=0).stop 2024-05-08T05:18:17.444 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-08T05:18:17.442+0000 7f6eadfec700 1 -- 172.21.15.160:0/1891236247 shutdown_connections 2024-05-08T05:18:17.444 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-08T05:18:17.442+0000 7f6eadfec700 1 --2- 172.21.15.160:0/1891236247 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6ea8103110 0x7f6ea81034f0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:18:17.444 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-08T05:18:17.442+0000 7f6eadfec700 1 -- 172.21.15.160:0/1891236247 >> 172.21.15.160:0/1891236247 conn(0x7f6ea80fe9e0 msgr2=0x7f6ea8100e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:18:17.444 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-08T05:18:17.442+0000 7f6eadfec700 1 -- 172.21.15.160:0/1891236247 shutdown_connections 2024-05-08T05:18:17.444 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-08T05:18:17.442+0000 7f6eadfec700 1 -- 172.21.15.160:0/1891236247 wait complete. 2024-05-08T05:18:17.444 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-08T05:18:17.443+0000 7f6eadfec700 1 Processor -- start 2024-05-08T05:18:17.444 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-08T05:18:17.443+0000 7f6eadfec700 1 -- start start 2024-05-08T05:18:17.444 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-08T05:18:17.443+0000 7f6eadfec700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6ea8103110 0x7f6ea80757a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:18:17.444 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-08T05:18:17.443+0000 7f6eadfec700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f6ea810d390 con 0x7f6ea8103110 2024-05-08T05:18:17.445 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-08T05:18:17.443+0000 7f6ea77fe700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6ea8103110 0x7f6ea80757a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:18:17.446 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-08T05:18:17.444+0000 7f6ea77fe700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6ea8103110 0x7f6ea80757a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.160:43102/0 (socket says 172.21.15.160:43102) 2024-05-08T05:18:17.446 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-08T05:18:17.444+0000 7f6ea77fe700 1 -- 172.21.15.160:0/1886732429 learned_addr learned my addr 172.21.15.160:0/1886732429 (peer_addr_for_me v2:172.21.15.160:0/0) 2024-05-08T05:18:17.446 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-08T05:18:17.444+0000 7f6ea77fe700 1 -- 172.21.15.160:0/1886732429 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6ea8077690 con 0x7f6ea8103110 2024-05-08T05:18:17.446 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-08T05:18:17.445+0000 7f6ea77fe700 1 --2- 172.21.15.160:0/1886732429 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6ea8103110 0x7f6ea80757a0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f6e980056d0 tx=0x7f6e980057b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:18:17.446 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-08T05:18:17.445+0000 7f6ea57fa700 1 -- 172.21.15.160:0/1886732429 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6e98026070 con 0x7f6ea8103110 2024-05-08T05:18:17.446 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-08T05:18:17.445+0000 7f6eadfec700 1 -- 172.21.15.160:0/1886732429 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6ea8075d40 con 0x7f6ea8103110 2024-05-08T05:18:17.446 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-08T05:18:17.445+0000 7f6eadfec700 1 -- 172.21.15.160:0/1886732429 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6ea8076200 con 0x7f6ea8103110 2024-05-08T05:18:17.446 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-08T05:18:17.445+0000 7f6ea57fa700 1 -- 172.21.15.160:0/1886732429 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6e9800bba0 con 0x7f6ea8103110 2024-05-08T05:18:17.446 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-08T05:18:17.445+0000 7f6ea57fa700 1 -- 172.21.15.160:0/1886732429 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6e980037f0 con 0x7f6ea8103110 2024-05-08T05:18:17.447 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-08T05:18:17.446+0000 7f6eadfec700 1 -- 172.21.15.160:0/1886732429 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6ea81045f0 con 0x7f6ea8103110 2024-05-08T05:18:17.447 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-08T05:18:17.447+0000 7f6ea57fa700 1 -- 172.21.15.160:0/1886732429 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 13) ==== 50278+0+0 (secure 0 0 0) 0x7f6e98029070 con 0x7f6ea8103110 2024-05-08T05:18:17.447 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-08T05:18:17.447+0000 7f6ea57fa700 1 --2- 172.21.15.160:0/1886732429 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f6e9403e510 0x7f6e940409d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:18:17.447 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-08T05:18:17.447+0000 7f6ea57fa700 1 -- 172.21.15.160:0/1886732429 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f6e9801e070 con 0x7f6ea8103110 2024-05-08T05:18:17.448 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-08T05:18:17.447+0000 7f6e9ffff700 1 --2- 172.21.15.160:0/1886732429 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f6e9403e510 0x7f6e940409d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:18:17.448 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-08T05:18:17.448+0000 7f6e9ffff700 1 --2- 172.21.15.160:0/1886732429 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f6e9403e510 0x7f6e940409d0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f6e90006fd0 tx=0x7f6e90006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:18:17.463 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-08T05:18:17.463+0000 7f6ea57fa700 1 -- 172.21.15.160:0/1886732429 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f6e98013070 con 0x7f6ea8103110 2024-05-08T05:18:17.761 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-08T05:18:17.760+0000 7f6eadfec700 1 -- 172.21.15.160:0/1886732429 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) -- 0x7f6ea8076d70 con 0x7f6ea8103110 2024-05-08T05:18:17.761 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-08T05:18:17.760+0000 7f6ea57fa700 1 -- 172.21.15.160:0/1886732429 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) ==== 95+0+745 (secure 0 0 0) 0x7f6e98017440 con 0x7f6ea8103110 2024-05-08T05:18:17.761 INFO:teuthology.orchestra.run.smithi160.stdout: 2024-05-08T05:18:17.762 INFO:teuthology.orchestra.run.smithi160.stdout:{"epoch":1,"fsid":"eeeb813e-0cf9-11ef-bc97-c7b262605968","modified":"2024-05-08T05:16:09.877063Z","created":"2024-05-08T05:16:09.877063Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:3300","nonce":0},{"type":"v1","addr":"172.21.15.87:6789","nonce":0}]},"addr":"172.21.15.87:6789/0","public_addr":"172.21.15.87:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-05-08T05:18:17.763 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-08T05:18:17.763+0000 7f6eadfec700 1 -- 172.21.15.160:0/1886732429 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f6e9403e510 msgr2=0x7f6e940409d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:18:17.764 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-08T05:18:17.763+0000 7f6eadfec700 1 --2- 172.21.15.160:0/1886732429 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f6e9403e510 0x7f6e940409d0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f6e90006fd0 tx=0x7f6e90006e40 comp rx=0 tx=0).stop 2024-05-08T05:18:17.764 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-08T05:18:17.763+0000 7f6eadfec700 1 -- 172.21.15.160:0/1886732429 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6ea8103110 msgr2=0x7f6ea80757a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:18:17.764 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-08T05:18:17.763+0000 7f6eadfec700 1 --2- 172.21.15.160:0/1886732429 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6ea8103110 0x7f6ea80757a0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f6e980056d0 tx=0x7f6e980057b0 comp rx=0 tx=0).stop 2024-05-08T05:18:17.764 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-08T05:18:17.763+0000 7f6eadfec700 1 -- 172.21.15.160:0/1886732429 shutdown_connections 2024-05-08T05:18:17.764 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-08T05:18:17.763+0000 7f6eadfec700 1 --2- 172.21.15.160:0/1886732429 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f6e9403e510 0x7f6e940409d0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:18:17.764 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-08T05:18:17.763+0000 7f6eadfec700 1 --2- 172.21.15.160:0/1886732429 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6ea8103110 0x7f6ea80757a0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:18:17.764 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-08T05:18:17.763+0000 7f6eadfec700 1 -- 172.21.15.160:0/1886732429 >> 172.21.15.160:0/1886732429 conn(0x7f6ea80fe9e0 msgr2=0x7f6ea8104ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:18:17.764 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-08T05:18:17.763+0000 7f6eadfec700 1 -- 172.21.15.160:0/1886732429 shutdown_connections 2024-05-08T05:18:17.764 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-08T05:18:17.763+0000 7f6eadfec700 1 -- 172.21.15.160:0/1886732429 wait complete. 2024-05-08T05:18:17.764 INFO:teuthology.orchestra.run.smithi160.stderr:dumped monmap epoch 1 2024-05-08T05:18:19.466 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-05-08T05:18:19.467 DEBUG:teuthology.orchestra.run.smithi160:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid eeeb813e-0cf9-11ef-bc97-c7b262605968 -- ceph mon dump -f json 2024-05-08T05:18:19.711 INFO:teuthology.orchestra.run.smithi160.stderr:Inferring config /var/lib/ceph/eeeb813e-0cf9-11ef-bc97-c7b262605968/mon.c/config 2024-05-08T05:18:23.210 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:18:22 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-05-08T05:18:23.210 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:18:22 smithi087 ceph-mon[29523]: mon.a calling monitor election 2024-05-08T05:18:23.210 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:18:22 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-08T05:18:23.210 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:18:22 smithi087 ceph-mon[29523]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-08T05:18:23.211 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:18:22 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-08T05:18:23.211 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:18:22 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-08T05:18:23.211 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:18:22 smithi087 ceph-mon[29523]: mon.c calling monitor election 2024-05-08T05:18:23.211 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:18:22 smithi087 ceph-mon[29523]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-08T05:18:23.211 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:18:22 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-08T05:18:23.211 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:18:22 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-08T05:18:23.211 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:18:22 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-08T05:18:23.211 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:18:22 smithi087 ceph-mon[29523]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-05-08T05:18:23.211 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:18:22 smithi087 ceph-mon[29523]: monmap epoch 2 2024-05-08T05:18:23.211 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:18:22 smithi087 ceph-mon[29523]: fsid eeeb813e-0cf9-11ef-bc97-c7b262605968 2024-05-08T05:18:23.211 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:18:22 smithi087 ceph-mon[29523]: last_changed 2024-05-08T05:18:17.867185+0000 2024-05-08T05:18:23.211 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:18:22 smithi087 ceph-mon[29523]: created 2024-05-08T05:16:09.877063+0000 2024-05-08T05:18:23.211 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:18:22 smithi087 ceph-mon[29523]: min_mon_release 19 (squid) 2024-05-08T05:18:23.211 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:18:22 smithi087 ceph-mon[29523]: election_strategy: 1 2024-05-08T05:18:23.212 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:18:22 smithi087 ceph-mon[29523]: 0: [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] mon.a 2024-05-08T05:18:23.212 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:18:22 smithi087 ceph-mon[29523]: 1: [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] mon.c 2024-05-08T05:18:23.212 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:18:22 smithi087 ceph-mon[29523]: fsmap 2024-05-08T05:18:23.212 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:18:22 smithi087 ceph-mon[29523]: osdmap e4: 0 total, 0 up, 0 in 2024-05-08T05:18:23.212 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:18:22 smithi087 ceph-mon[29523]: mgrmap e13: x(active, since 60s) 2024-05-08T05:18:23.212 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:18:22 smithi087 ceph-mon[29523]: overall HEALTH_OK 2024-05-08T05:18:23.212 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:18:22 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:18:23.212 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:18:22 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:18:24.209 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:18:23 smithi087 ceph-mon[29523]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-08T05:18:24.209 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:18:23 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:18:24.209 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:18:23 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-05-08T05:18:24.209 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:18:23 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T05:18:24.209 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:18:23 smithi087 ceph-mon[29523]: Deploying daemon mon.b on smithi090 2024-05-08T05:18:24.209 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:18:23 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-08T05:18:24.266 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-08T05:18:24.265+0000 7fbec470e700 1 -- 172.21.15.160:0/2551237788 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fbea80035c0 msgr2=0x7fbea8005a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:18:24.266 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-08T05:18:24.265+0000 7fbec470e700 1 --2- 172.21.15.160:0/2551237788 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fbea80035c0 0x7fbea8005a50 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fbebc102ee0 tx=0x7fbeac00feb0 comp rx=0 tx=0).stop 2024-05-08T05:18:24.266 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-08T05:18:24.265+0000 7fbec470e700 1 -- 172.21.15.160:0/2551237788 shutdown_connections 2024-05-08T05:18:24.266 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-08T05:18:24.265+0000 7fbec470e700 1 --2- 172.21.15.160:0/2551237788 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fbea80035c0 0x7fbea8005a50 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:18:24.266 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-08T05:18:24.265+0000 7fbec470e700 1 -- 172.21.15.160:0/2551237788 >> 172.21.15.160:0/2551237788 conn(0x7fbebc0feaa0 msgr2=0x7fbebc100ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:18:24.266 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-08T05:18:24.265+0000 7fbec470e700 1 -- 172.21.15.160:0/2551237788 shutdown_connections 2024-05-08T05:18:24.266 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-08T05:18:24.265+0000 7fbec470e700 1 -- 172.21.15.160:0/2551237788 wait complete. 2024-05-08T05:18:24.267 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:18:23 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-08T05:18:24.269 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-08T05:18:24.266+0000 7fbec470e700 1 Processor -- start 2024-05-08T05:18:24.269 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-08T05:18:24.266+0000 7fbec470e700 1 -- start start 2024-05-08T05:18:24.269 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-08T05:18:24.266+0000 7fbec470e700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fbea80035c0 0x7fbebc1a08c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:18:24.269 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-08T05:18:24.266+0000 7fbec470e700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fbebc1a0e00 0x7fbebc19aa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:18:24.269 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-08T05:18:24.266+0000 7fbec470e700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fbebc10af00 con 0x7fbebc1a0e00 2024-05-08T05:18:24.269 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-08T05:18:24.266+0000 7fbec470e700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7fbebc10ad80 con 0x7fbea80035c0 2024-05-08T05:18:24.269 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-08T05:18:24.266+0000 7fbec24aa700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fbea80035c0 0x7fbebc1a08c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:18:24.269 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-08T05:18:24.266+0000 7fbec24aa700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fbea80035c0 0x7fbebc1a08c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.160:45244/0 (socket says 172.21.15.160:45244) 2024-05-08T05:18:24.269 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-08T05:18:24.266+0000 7fbec24aa700 1 -- 172.21.15.160:0/1092310308 learned_addr learned my addr 172.21.15.160:0/1092310308 (peer_addr_for_me v2:172.21.15.160:0/0) 2024-05-08T05:18:24.269 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-08T05:18:24.267+0000 7fbec24aa700 1 -- 172.21.15.160:0/1092310308 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fbea80035c0 msgr2=0x7fbebc1a08c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 12 2024-05-08T05:18:24.270 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-08T05:18:24.267+0000 7fbec24aa700 1 -- 172.21.15.160:0/1092310308 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fbea80035c0 msgr2=0x7fbebc1a08c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-05-08T05:18:24.270 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-08T05:18:24.267+0000 7fbec24aa700 1 --2- 172.21.15.160:0/1092310308 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fbea80035c0 0x7fbebc1a08c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-08T05:18:24.270 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-08T05:18:24.267+0000 7fbec24aa700 1 --2- 172.21.15.160:0/1092310308 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fbea80035c0 0x7fbebc1a08c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-08T05:18:24.270 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-08T05:18:24.267+0000 7fbec1ca9700 1 --2- 172.21.15.160:0/1092310308 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fbebc1a0e00 0x7fbebc19aa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:18:24.270 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-08T05:18:24.267+0000 7fbec1ca9700 1 -- 172.21.15.160:0/1092310308 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fbea80035c0 msgr2=0x7fbebc1a08c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-05-08T05:18:24.270 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-08T05:18:24.267+0000 7fbec1ca9700 1 --2- 172.21.15.160:0/1092310308 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fbea80035c0 0x7fbebc1a08c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:18:24.270 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-08T05:18:24.267+0000 7fbec1ca9700 1 -- 172.21.15.160:0/1092310308 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbebc1a1440 con 0x7fbebc1a0e00 2024-05-08T05:18:24.270 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-08T05:18:24.268+0000 7fbec1ca9700 1 --2- 172.21.15.160:0/1092310308 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fbebc1a0e00 0x7fbebc19aa80 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fbeb800b4d0 tx=0x7fbeb800b890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:18:24.270 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-08T05:18:24.268+0000 7fbeb37fe700 1 -- 172.21.15.160:0/1092310308 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 309+0+0 (secure 0 0 0) 0x7fbeb8011630 con 0x7fbebc1a0e00 2024-05-08T05:18:24.270 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-08T05:18:24.268+0000 7fbec470e700 1 -- 172.21.15.160:0/1092310308 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbebc19afc0 con 0x7fbebc1a0e00 2024-05-08T05:18:24.271 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-08T05:18:24.268+0000 7fbeb37fe700 1 -- 172.21.15.160:0/1092310308 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbeb8011c80 con 0x7fbebc1a0e00 2024-05-08T05:18:24.271 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-08T05:18:24.268+0000 7fbec470e700 1 -- 172.21.15.160:0/1092310308 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbebc19b550 con 0x7fbebc1a0e00 2024-05-08T05:18:24.271 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-08T05:18:24.268+0000 7fbeb37fe700 1 -- 172.21.15.160:0/1092310308 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 309+0+0 (secure 0 0 0) 0x7fbeb801adc0 con 0x7fbebc1a0e00 2024-05-08T05:18:24.272 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-08T05:18:24.269+0000 7fbec470e700 1 -- 172.21.15.160:0/1092310308 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbebc1046f0 con 0x7fbebc1a0e00 2024-05-08T05:18:24.272 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-08T05:18:24.270+0000 7fbeb37fe700 1 -- 172.21.15.160:0/1092310308 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 13) ==== 50278+0+0 (secure 0 0 0) 0x7fbeb8018020 con 0x7fbebc1a0e00 2024-05-08T05:18:24.273 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-08T05:18:24.270+0000 7fbeb37fe700 1 --2- 172.21.15.160:0/1092310308 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7fbea003e2b0 0x7fbea0040770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:18:24.273 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-08T05:18:24.270+0000 7fbeb37fe700 1 -- 172.21.15.160:0/1092310308 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7fbeb8052320 con 0x7fbebc1a0e00 2024-05-08T05:18:24.273 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-08T05:18:24.271+0000 7fbec24aa700 1 --2- 172.21.15.160:0/1092310308 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7fbea003e2b0 0x7fbea0040770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:18:24.273 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-08T05:18:24.272+0000 7fbec24aa700 1 --2- 172.21.15.160:0/1092310308 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7fbea003e2b0 0x7fbea0040770 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fbeac00fa60 tx=0x7fbeac005960 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:18:24.285 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-08T05:18:24.285+0000 7fbeb37fe700 1 -- 172.21.15.160:0/1092310308 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7fbeb801f020 con 0x7fbebc1a0e00 2024-05-08T05:18:24.574 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-08T05:18:24.573+0000 7fbec470e700 1 -- 172.21.15.160:0/1092310308 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) -- 0x7fbebc19c050 con 0x7fbebc1a0e00 2024-05-08T05:18:24.575 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-08T05:18:24.574+0000 7fbeb37fe700 1 -- 172.21.15.160:0/1092310308 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 2 v2) ==== 95+0+1015 (secure 0 0 0) 0x7fbeb801a490 con 0x7fbebc1a0e00 2024-05-08T05:18:24.575 INFO:teuthology.orchestra.run.smithi160.stdout: 2024-05-08T05:18:24.575 INFO:teuthology.orchestra.run.smithi160.stdout:{"epoch":2,"fsid":"eeeb813e-0cf9-11ef-bc97-c7b262605968","modified":"2024-05-08T05:18:17.867185Z","created":"2024-05-08T05:16:09.877063Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:3300","nonce":0},{"type":"v1","addr":"172.21.15.87:6789","nonce":0}]},"addr":"172.21.15.87:6789/0","public_addr":"172.21.15.87:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:3300","nonce":0},{"type":"v1","addr":"172.21.15.160:6789","nonce":0}]},"addr":"172.21.15.160:6789/0","public_addr":"172.21.15.160:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2024-05-08T05:18:24.577 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-08T05:18:24.577+0000 7fbec470e700 1 -- 172.21.15.160:0/1092310308 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7fbea003e2b0 msgr2=0x7fbea0040770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:18:24.577 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-08T05:18:24.577+0000 7fbec470e700 1 --2- 172.21.15.160:0/1092310308 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7fbea003e2b0 0x7fbea0040770 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fbeac00fa60 tx=0x7fbeac005960 comp rx=0 tx=0).stop 2024-05-08T05:18:24.577 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-08T05:18:24.577+0000 7fbec470e700 1 -- 172.21.15.160:0/1092310308 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fbebc1a0e00 msgr2=0x7fbebc19aa80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:18:24.577 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-08T05:18:24.577+0000 7fbec470e700 1 --2- 172.21.15.160:0/1092310308 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fbebc1a0e00 0x7fbebc19aa80 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fbeb800b4d0 tx=0x7fbeb800b890 comp rx=0 tx=0).stop 2024-05-08T05:18:24.578 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-08T05:18:24.577+0000 7fbec470e700 1 -- 172.21.15.160:0/1092310308 shutdown_connections 2024-05-08T05:18:24.578 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-08T05:18:24.577+0000 7fbec470e700 1 --2- 172.21.15.160:0/1092310308 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7fbea003e2b0 0x7fbea0040770 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:18:24.578 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-08T05:18:24.577+0000 7fbec470e700 1 --2- 172.21.15.160:0/1092310308 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fbea80035c0 0x7fbebc1a08c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:18:24.578 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-08T05:18:24.577+0000 7fbec470e700 1 --2- 172.21.15.160:0/1092310308 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fbebc1a0e00 0x7fbebc19aa80 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:18:24.578 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-08T05:18:24.577+0000 7fbec470e700 1 -- 172.21.15.160:0/1092310308 >> 172.21.15.160:0/1092310308 conn(0x7fbebc0feaa0 msgr2=0x7fbebc104be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:18:24.578 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-08T05:18:24.577+0000 7fbec470e700 1 -- 172.21.15.160:0/1092310308 shutdown_connections 2024-05-08T05:18:24.578 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-08T05:18:24.577+0000 7fbec470e700 1 -- 172.21.15.160:0/1092310308 wait complete. 2024-05-08T05:18:24.578 INFO:teuthology.orchestra.run.smithi160.stderr:dumped monmap epoch 2 2024-05-08T05:18:25.158 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:18:24 smithi160 ceph-mon[34827]: from='client.? 172.21.15.160:0/1092310308' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-05-08T05:18:25.208 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:18:24 smithi087 ceph-mon[29523]: from='client.? 172.21.15.160:0/1092310308' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-05-08T05:18:26.187 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-05-08T05:18:26.187 DEBUG:teuthology.orchestra.run.smithi160:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid eeeb813e-0cf9-11ef-bc97-c7b262605968 -- ceph mon dump -f json 2024-05-08T05:18:26.208 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:18:25 smithi087 ceph-mon[29523]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-08T05:18:26.214 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:18:25 smithi160 ceph-mon[34827]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-08T05:18:26.430 INFO:teuthology.orchestra.run.smithi160.stderr:Inferring config /var/lib/ceph/eeeb813e-0cf9-11ef-bc97-c7b262605968/mon.c/config 2024-05-08T05:18:26.723 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:18:26 smithi090 ceph-mon[34526]: mon.b@-1(synchronizing).paxosservice(auth 1..3) refresh upgraded, format 0 -> 3 2024-05-08T05:18:26.984 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:18:26 smithi090 bash[34508]: aa13368ec9bc64f9b16f6008f6d1565cbb52659f648dc98ab25c7bc42d721a12 2024-05-08T05:18:26.984 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:18:26 smithi090 systemd[1]: Started Ceph mon.b for eeeb813e-0cf9-11ef-bc97-c7b262605968. 2024-05-08T05:18:32.039 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:18:31 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-05-08T05:18:32.039 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:18:31 smithi160 ceph-mon[34827]: mon.a calling monitor election 2024-05-08T05:18:32.040 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:18:31 smithi160 ceph-mon[34827]: mon.c calling monitor election 2024-05-08T05:18:32.040 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:18:31 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-08T05:18:32.040 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:18:31 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-08T05:18:32.040 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:18:31 smithi160 ceph-mon[34827]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-08T05:18:32.040 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:18:31 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-08T05:18:32.040 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:18:31 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-08T05:18:32.040 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:18:31 smithi160 ceph-mon[34827]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-08T05:18:32.040 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:18:31 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-08T05:18:32.040 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:18:31 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-08T05:18:32.040 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:18:31 smithi160 ceph-mon[34827]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-08T05:18:32.040 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:18:31 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-08T05:18:32.040 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:18:31 smithi160 ceph-mon[34827]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-05-08T05:18:32.040 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:18:31 smithi160 ceph-mon[34827]: monmap epoch 3 2024-05-08T05:18:32.040 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:18:31 smithi160 ceph-mon[34827]: fsid eeeb813e-0cf9-11ef-bc97-c7b262605968 2024-05-08T05:18:32.041 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:18:31 smithi160 ceph-mon[34827]: last_changed 2024-05-08T05:18:26.705086+0000 2024-05-08T05:18:32.041 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:18:31 smithi160 ceph-mon[34827]: created 2024-05-08T05:16:09.877063+0000 2024-05-08T05:18:32.041 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:18:31 smithi160 ceph-mon[34827]: min_mon_release 19 (squid) 2024-05-08T05:18:32.041 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:18:31 smithi160 ceph-mon[34827]: election_strategy: 1 2024-05-08T05:18:32.041 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:18:31 smithi160 ceph-mon[34827]: 0: [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] mon.a 2024-05-08T05:18:32.041 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:18:31 smithi160 ceph-mon[34827]: 1: [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] mon.c 2024-05-08T05:18:32.041 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:18:31 smithi160 ceph-mon[34827]: 2: [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] mon.b 2024-05-08T05:18:32.041 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:18:31 smithi160 ceph-mon[34827]: fsmap 2024-05-08T05:18:32.041 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:18:31 smithi160 ceph-mon[34827]: osdmap e4: 0 total, 0 up, 0 in 2024-05-08T05:18:32.041 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:18:31 smithi160 ceph-mon[34827]: mgrmap e13: x(active, since 68s) 2024-05-08T05:18:32.041 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:18:31 smithi160 ceph-mon[34827]: overall HEALTH_OK 2024-05-08T05:18:32.041 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:18:31 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:18:32.041 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:18:31 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:18:32.041 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:18:31 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:18:32.041 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:18:31 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:18:32.209 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:18:31 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-05-08T05:18:32.209 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:18:31 smithi087 ceph-mon[29523]: mon.a calling monitor election 2024-05-08T05:18:32.209 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:18:31 smithi087 ceph-mon[29523]: mon.c calling monitor election 2024-05-08T05:18:32.209 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:18:31 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-08T05:18:32.209 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:18:31 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-08T05:18:32.209 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:18:31 smithi087 ceph-mon[29523]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-08T05:18:32.209 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:18:31 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-08T05:18:32.209 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:18:31 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-08T05:18:32.209 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:18:31 smithi087 ceph-mon[29523]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-08T05:18:32.209 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:18:31 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-08T05:18:32.209 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:18:31 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-08T05:18:32.210 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:18:31 smithi087 ceph-mon[29523]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-08T05:18:32.210 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:18:31 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-08T05:18:32.210 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:18:31 smithi087 ceph-mon[29523]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-05-08T05:18:32.210 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:18:31 smithi087 ceph-mon[29523]: monmap epoch 3 2024-05-08T05:18:32.210 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:18:31 smithi087 ceph-mon[29523]: fsid eeeb813e-0cf9-11ef-bc97-c7b262605968 2024-05-08T05:18:32.210 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:18:31 smithi087 ceph-mon[29523]: last_changed 2024-05-08T05:18:26.705086+0000 2024-05-08T05:18:32.210 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:18:31 smithi087 ceph-mon[29523]: created 2024-05-08T05:16:09.877063+0000 2024-05-08T05:18:32.210 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:18:31 smithi087 ceph-mon[29523]: min_mon_release 19 (squid) 2024-05-08T05:18:32.210 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:18:31 smithi087 ceph-mon[29523]: election_strategy: 1 2024-05-08T05:18:32.210 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:18:31 smithi087 ceph-mon[29523]: 0: [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] mon.a 2024-05-08T05:18:32.210 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:18:31 smithi087 ceph-mon[29523]: 1: [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] mon.c 2024-05-08T05:18:32.210 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:18:31 smithi087 ceph-mon[29523]: 2: [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] mon.b 2024-05-08T05:18:32.210 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:18:31 smithi087 ceph-mon[29523]: fsmap 2024-05-08T05:18:32.210 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:18:31 smithi087 ceph-mon[29523]: osdmap e4: 0 total, 0 up, 0 in 2024-05-08T05:18:32.211 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:18:31 smithi087 ceph-mon[29523]: mgrmap e13: x(active, since 68s) 2024-05-08T05:18:32.211 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:18:31 smithi087 ceph-mon[29523]: overall HEALTH_OK 2024-05-08T05:18:32.211 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:18:31 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:18:32.211 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:18:31 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:18:32.211 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:18:31 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:18:32.211 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:18:31 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:18:32.334 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-08T05:18:32.331+0000 7fa4d5d42700 1 -- 172.21.15.160:0/3971011656 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa4b80035c0 msgr2=0x7fa4b8005a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:18:32.334 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-08T05:18:32.331+0000 7fa4d5d42700 1 --2- 172.21.15.160:0/3971011656 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa4b80035c0 0x7fa4b8005a50 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fa4d0102ef0 tx=0x7fa4c000fe60 comp rx=0 tx=0).stop 2024-05-08T05:18:32.334 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-08T05:18:32.331+0000 7fa4d5d42700 1 -- 172.21.15.160:0/3971011656 shutdown_connections 2024-05-08T05:18:32.334 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-08T05:18:32.331+0000 7fa4d5d42700 1 --2- 172.21.15.160:0/3971011656 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa4b80035c0 0x7fa4b8005a50 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:18:32.334 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-08T05:18:32.331+0000 7fa4d5d42700 1 -- 172.21.15.160:0/3971011656 >> 172.21.15.160:0/3971011656 conn(0x7fa4d00feab0 msgr2=0x7fa4d0100ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:18:32.334 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-08T05:18:32.331+0000 7fa4d5d42700 1 -- 172.21.15.160:0/3971011656 shutdown_connections 2024-05-08T05:18:32.334 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-08T05:18:32.331+0000 7fa4d5d42700 1 -- 172.21.15.160:0/3971011656 wait complete. 2024-05-08T05:18:32.335 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-08T05:18:32.331+0000 7fa4d5d42700 1 Processor -- start 2024-05-08T05:18:32.335 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-08T05:18:32.332+0000 7fa4d5d42700 1 -- start start 2024-05-08T05:18:32.335 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-08T05:18:32.332+0000 7fa4d5d42700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa4b80035c0 0x7fa4d00757a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:18:32.335 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-08T05:18:32.332+0000 7fa4d5d42700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa4d0075ce0 0x7fa4d0076160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:18:32.335 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-08T05:18:32.332+0000 7fa4d5d42700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa4d01a4df0 0x7fa4d01a71e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:18:32.335 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-08T05:18:32.332+0000 7fa4d5d42700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fa4d010aeb0 con 0x7fa4b80035c0 2024-05-08T05:18:32.335 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-08T05:18:32.332+0000 7fa4d5d42700 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fa4d010ad30 con 0x7fa4d0075ce0 2024-05-08T05:18:32.335 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-08T05:18:32.332+0000 7fa4d5d42700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7fa4d010b030 con 0x7fa4d01a4df0 2024-05-08T05:18:32.335 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-08T05:18:32.332+0000 7fa4cffff700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa4d01a4df0 0x7fa4d01a71e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:18:32.335 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-08T05:18:32.332+0000 7fa4cffff700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa4d01a4df0 0x7fa4d01a71e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.160:37766/0 (socket says 172.21.15.160:37766) 2024-05-08T05:18:32.335 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-08T05:18:32.332+0000 7fa4cffff700 1 -- 172.21.15.160:0/415834315 learned_addr learned my addr 172.21.15.160:0/415834315 (peer_addr_for_me v2:172.21.15.160:0/0) 2024-05-08T05:18:32.336 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-08T05:18:32.332+0000 7fa4cffff700 1 -- 172.21.15.160:0/415834315 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa4d01a4df0 msgr2=0x7fa4d01a71e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 14 2024-05-08T05:18:32.336 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-08T05:18:32.332+0000 7fa4cf7fe700 1 --2- 172.21.15.160:0/415834315 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa4b80035c0 0x7fa4d00757a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:18:32.336 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-08T05:18:32.332+0000 7fa4cffff700 1 -- 172.21.15.160:0/415834315 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa4d01a4df0 msgr2=0x7fa4d01a71e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-05-08T05:18:32.336 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-08T05:18:32.332+0000 7fa4cffff700 1 --2- 172.21.15.160:0/415834315 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa4d01a4df0 0x7fa4d01a71e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-08T05:18:32.336 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-08T05:18:32.332+0000 7fa4cffff700 1 --2- 172.21.15.160:0/415834315 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa4d01a4df0 0x7fa4d01a71e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-08T05:18:32.336 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-08T05:18:32.332+0000 7fa4ceffd700 1 --2- 172.21.15.160:0/415834315 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa4d0075ce0 0x7fa4d0076160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:18:32.336 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-08T05:18:32.332+0000 7fa4ceffd700 1 -- 172.21.15.160:0/415834315 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa4d0075ce0 msgr2=0x7fa4d0076160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 13 2024-05-08T05:18:32.336 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-08T05:18:32.332+0000 7fa4ceffd700 1 -- 172.21.15.160:0/415834315 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa4d0075ce0 msgr2=0x7fa4d0076160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-05-08T05:18:32.336 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-08T05:18:32.332+0000 7fa4ceffd700 1 --2- 172.21.15.160:0/415834315 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa4d0075ce0 0x7fa4d0076160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-08T05:18:32.336 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-08T05:18:32.332+0000 7fa4ceffd700 1 --2- 172.21.15.160:0/415834315 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa4d0075ce0 0x7fa4d0076160 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-08T05:18:32.336 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-08T05:18:32.333+0000 7fa4cf7fe700 1 -- 172.21.15.160:0/415834315 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa4d01a4df0 msgr2=0x7fa4d01a71e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-05-08T05:18:32.336 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-08T05:18:32.333+0000 7fa4cf7fe700 1 --2- 172.21.15.160:0/415834315 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa4d01a4df0 0x7fa4d01a71e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:18:32.336 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-08T05:18:32.333+0000 7fa4cf7fe700 1 -- 172.21.15.160:0/415834315 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa4d0075ce0 msgr2=0x7fa4d0076160 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-05-08T05:18:32.337 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-08T05:18:32.333+0000 7fa4cf7fe700 1 --2- 172.21.15.160:0/415834315 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa4d0075ce0 0x7fa4d0076160 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:18:32.337 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-08T05:18:32.333+0000 7fa4cf7fe700 1 -- 172.21.15.160:0/415834315 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa4d01a78b0 con 0x7fa4b80035c0 2024-05-08T05:18:32.337 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-08T05:18:32.333+0000 7fa4cf7fe700 1 --2- 172.21.15.160:0/415834315 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa4b80035c0 0x7fa4d00757a0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fa4c001f000 tx=0x7fa4c0003ca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:18:32.337 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-08T05:18:32.333+0000 7fa4ccff9700 1 -- 172.21.15.160:0/415834315 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4c002b020 con 0x7fa4b80035c0 2024-05-08T05:18:32.337 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-08T05:18:32.333+0000 7fa4d5d42700 1 -- 172.21.15.160:0/415834315 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa4d01a7b40 con 0x7fa4b80035c0 2024-05-08T05:18:32.337 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-08T05:18:32.333+0000 7fa4ccff9700 1 -- 172.21.15.160:0/415834315 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa4c00056c0 con 0x7fa4b80035c0 2024-05-08T05:18:32.337 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-08T05:18:32.333+0000 7fa4d5d42700 1 -- 172.21.15.160:0/415834315 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa4d01a80d0 con 0x7fa4b80035c0 2024-05-08T05:18:32.337 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-08T05:18:32.333+0000 7fa4ccff9700 1 -- 172.21.15.160:0/415834315 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4c0022040 con 0x7fa4b80035c0 2024-05-08T05:18:32.338 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-08T05:18:32.334+0000 7fa4d5d42700 1 -- 172.21.15.160:0/415834315 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa4d0064b00 con 0x7fa4b80035c0 2024-05-08T05:18:32.338 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-08T05:18:32.334+0000 7fa4ccff9700 1 -- 172.21.15.160:0/415834315 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 13) ==== 50278+0+0 (secure 0 0 0) 0x7fa4c002e020 con 0x7fa4b80035c0 2024-05-08T05:18:32.338 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-08T05:18:32.335+0000 7fa4ccff9700 1 --2- 172.21.15.160:0/415834315 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7fa4bc03e9a0 0x7fa4bc040e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:18:32.338 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-08T05:18:32.335+0000 7fa4ccff9700 1 -- 172.21.15.160:0/415834315 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7fa4c0055200 con 0x7fa4b80035c0 2024-05-08T05:18:32.338 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-08T05:18:32.335+0000 7fa4ceffd700 1 --2- 172.21.15.160:0/415834315 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7fa4bc03e9a0 0x7fa4bc040e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:18:32.338 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-08T05:18:32.336+0000 7fa4ceffd700 1 --2- 172.21.15.160:0/415834315 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7fa4bc03e9a0 0x7fa4bc040e60 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fa4c4009850 tx=0x7fa4c4008040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:18:32.343 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-08T05:18:32.343+0000 7fa4ccff9700 1 -- 172.21.15.160:0/415834315 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7fa4c0035020 con 0x7fa4b80035c0 2024-05-08T05:18:32.676 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-08T05:18:32.675+0000 7fa4d5d42700 1 -- 172.21.15.160:0/415834315 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) -- 0x7fa4d01a82a0 con 0x7fa4b80035c0 2024-05-08T05:18:32.677 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-08T05:18:32.677+0000 7fa4ccff9700 1 -- 172.21.15.160:0/415834315 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 3 v3) ==== 95+0+1279 (secure 0 0 0) 0x7fa4c00389e0 con 0x7fa4b80035c0 2024-05-08T05:18:32.677 INFO:teuthology.orchestra.run.smithi160.stdout: 2024-05-08T05:18:32.678 INFO:teuthology.orchestra.run.smithi160.stdout:{"epoch":3,"fsid":"eeeb813e-0cf9-11ef-bc97-c7b262605968","modified":"2024-05-08T05:18:26.705086Z","created":"2024-05-08T05:16:09.877063Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:3300","nonce":0},{"type":"v1","addr":"172.21.15.87:6789","nonce":0}]},"addr":"172.21.15.87:6789/0","public_addr":"172.21.15.87:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:3300","nonce":0},{"type":"v1","addr":"172.21.15.160:6789","nonce":0}]},"addr":"172.21.15.160:6789/0","public_addr":"172.21.15.160:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:3300","nonce":0},{"type":"v1","addr":"172.21.15.90:6789","nonce":0}]},"addr":"172.21.15.90:6789/0","public_addr":"172.21.15.90:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2024-05-08T05:18:32.680 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-08T05:18:32.679+0000 7fa4d5d42700 1 -- 172.21.15.160:0/415834315 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7fa4bc03e9a0 msgr2=0x7fa4bc040e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:18:32.680 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-08T05:18:32.679+0000 7fa4d5d42700 1 --2- 172.21.15.160:0/415834315 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7fa4bc03e9a0 0x7fa4bc040e60 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fa4c4009850 tx=0x7fa4c4008040 comp rx=0 tx=0).stop 2024-05-08T05:18:32.680 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-08T05:18:32.679+0000 7fa4d5d42700 1 -- 172.21.15.160:0/415834315 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa4b80035c0 msgr2=0x7fa4d00757a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:18:32.680 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-08T05:18:32.679+0000 7fa4d5d42700 1 --2- 172.21.15.160:0/415834315 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa4b80035c0 0x7fa4d00757a0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fa4c001f000 tx=0x7fa4c0003ca0 comp rx=0 tx=0).stop 2024-05-08T05:18:32.680 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-08T05:18:32.679+0000 7fa4d5d42700 1 -- 172.21.15.160:0/415834315 shutdown_connections 2024-05-08T05:18:32.680 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-08T05:18:32.679+0000 7fa4d5d42700 1 --2- 172.21.15.160:0/415834315 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7fa4bc03e9a0 0x7fa4bc040e60 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:18:32.680 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-08T05:18:32.679+0000 7fa4d5d42700 1 --2- 172.21.15.160:0/415834315 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa4d01a4df0 0x7fa4d01a71e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:18:32.680 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-08T05:18:32.679+0000 7fa4d5d42700 1 --2- 172.21.15.160:0/415834315 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa4b80035c0 0x7fa4d00757a0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:18:32.681 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-08T05:18:32.679+0000 7fa4d5d42700 1 --2- 172.21.15.160:0/415834315 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa4d0075ce0 0x7fa4d0076160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:18:32.681 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-08T05:18:32.679+0000 7fa4d5d42700 1 -- 172.21.15.160:0/415834315 >> 172.21.15.160:0/415834315 conn(0x7fa4d00feab0 msgr2=0x7fa4d0106c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:18:32.681 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-08T05:18:32.680+0000 7fa4d5d42700 1 -- 172.21.15.160:0/415834315 shutdown_connections 2024-05-08T05:18:32.681 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-08T05:18:32.680+0000 7fa4d5d42700 1 -- 172.21.15.160:0/415834315 wait complete. 2024-05-08T05:18:32.681 INFO:teuthology.orchestra.run.smithi160.stderr:dumped monmap epoch 3 2024-05-08T05:18:33.039 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:18:32 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T05:18:33.039 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:18:32 smithi160 ceph-mon[34827]: from='client.? 172.21.15.160:0/415834315' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-05-08T05:18:33.039 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:18:32 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-08T05:18:33.208 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:18:32 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T05:18:33.208 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:18:32 smithi087 ceph-mon[29523]: from='client.? 172.21.15.160:0/415834315' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-05-08T05:18:33.209 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:18:32 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-08T05:18:33.346 INFO:tasks.cephadm:Generating final ceph.conf file... 2024-05-08T05:18:33.346 DEBUG:teuthology.orchestra.run.smithi087:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid eeeb813e-0cf9-11ef-bc97-c7b262605968 -- ceph config generate-minimal-conf 2024-05-08T05:18:33.778 INFO:teuthology.orchestra.run.smithi087.stderr:Inferring config /var/lib/ceph/eeeb813e-0cf9-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T05:18:33.984 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:18:33 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-05-08T05:18:33.984 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:18:33 smithi090 ceph-mon[34526]: mon.a calling monitor election 2024-05-08T05:18:33.984 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:18:33 smithi090 ceph-mon[34526]: mon.c calling monitor election 2024-05-08T05:18:33.984 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:18:33 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-08T05:18:33.984 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:18:33 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-08T05:18:33.984 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:18:33 smithi090 ceph-mon[34526]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-08T05:18:33.984 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:18:33 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-08T05:18:33.984 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:18:33 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-08T05:18:33.985 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:18:33 smithi090 ceph-mon[34526]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-08T05:18:33.985 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:18:33 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-08T05:18:33.985 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:18:33 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-08T05:18:33.985 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:18:33 smithi090 ceph-mon[34526]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-08T05:18:33.985 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:18:33 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-08T05:18:33.985 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:18:33 smithi090 ceph-mon[34526]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-05-08T05:18:33.985 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:18:33 smithi090 ceph-mon[34526]: monmap epoch 3 2024-05-08T05:18:33.985 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:18:33 smithi090 ceph-mon[34526]: fsid eeeb813e-0cf9-11ef-bc97-c7b262605968 2024-05-08T05:18:33.985 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:18:33 smithi090 ceph-mon[34526]: last_changed 2024-05-08T05:18:26.705086+0000 2024-05-08T05:18:33.985 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:18:33 smithi090 ceph-mon[34526]: created 2024-05-08T05:16:09.877063+0000 2024-05-08T05:18:33.985 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:18:33 smithi090 ceph-mon[34526]: min_mon_release 19 (squid) 2024-05-08T05:18:33.985 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:18:33 smithi090 ceph-mon[34526]: election_strategy: 1 2024-05-08T05:18:33.985 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:18:33 smithi090 ceph-mon[34526]: 0: [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] mon.a 2024-05-08T05:18:33.985 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:18:33 smithi090 ceph-mon[34526]: 1: [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] mon.c 2024-05-08T05:18:33.985 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:18:33 smithi090 ceph-mon[34526]: 2: [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] mon.b 2024-05-08T05:18:33.986 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:18:33 smithi090 ceph-mon[34526]: fsmap 2024-05-08T05:18:33.986 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:18:33 smithi090 ceph-mon[34526]: osdmap e4: 0 total, 0 up, 0 in 2024-05-08T05:18:33.986 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:18:33 smithi090 ceph-mon[34526]: mgrmap e13: x(active, since 68s) 2024-05-08T05:18:33.986 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:18:33 smithi090 ceph-mon[34526]: overall HEALTH_OK 2024-05-08T05:18:33.986 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:18:33 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:18:33.986 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:18:33 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:18:33.986 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:18:33 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:18:33.986 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:18:33 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:18:33.986 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:18:33 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T05:18:33.986 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:18:33 smithi090 ceph-mon[34526]: from='client.? 172.21.15.160:0/415834315' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-05-08T05:18:33.986 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:18:33 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-08T05:18:34.459 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:18:34 smithi087 ceph-mon[29523]: mon.b calling monitor election 2024-05-08T05:18:34.459 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:18:34 smithi087 ceph-mon[29523]: mon.b calling monitor election 2024-05-08T05:18:34.459 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:18:34 smithi087 ceph-mon[29523]: mon.c calling monitor election 2024-05-08T05:18:34.459 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:18:34 smithi087 ceph-mon[29523]: mon.a calling monitor election 2024-05-08T05:18:34.459 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:18:34 smithi087 ceph-mon[29523]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-05-08T05:18:34.459 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:18:34 smithi087 ceph-mon[29523]: monmap epoch 3 2024-05-08T05:18:34.459 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:18:34 smithi087 ceph-mon[29523]: fsid eeeb813e-0cf9-11ef-bc97-c7b262605968 2024-05-08T05:18:34.459 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:18:34 smithi087 ceph-mon[29523]: last_changed 2024-05-08T05:18:26.705086+0000 2024-05-08T05:18:34.459 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:18:34 smithi087 ceph-mon[29523]: created 2024-05-08T05:16:09.877063+0000 2024-05-08T05:18:34.459 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:18:34 smithi087 ceph-mon[29523]: min_mon_release 19 (squid) 2024-05-08T05:18:34.459 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:18:34 smithi087 ceph-mon[29523]: election_strategy: 1 2024-05-08T05:18:34.459 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:18:34 smithi087 ceph-mon[29523]: 0: [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] mon.a 2024-05-08T05:18:34.459 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:18:34 smithi087 ceph-mon[29523]: 1: [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] mon.c 2024-05-08T05:18:34.460 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:18:34 smithi087 ceph-mon[29523]: 2: [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] mon.b 2024-05-08T05:18:34.460 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:18:34 smithi087 ceph-mon[29523]: fsmap 2024-05-08T05:18:34.460 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:18:34 smithi087 ceph-mon[29523]: osdmap e4: 0 total, 0 up, 0 in 2024-05-08T05:18:34.460 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:18:34 smithi087 ceph-mon[29523]: mgrmap e13: x(active, since 70s) 2024-05-08T05:18:34.460 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:18:34 smithi087 ceph-mon[29523]: overall HEALTH_OK 2024-05-08T05:18:34.460 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:18:34 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:18:34.460 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:18:34 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:18:34.460 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:18:34 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T05:18:34.460 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:18:34 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T05:18:34.734 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:18:34 smithi090 ceph-mon[34526]: mon.b calling monitor election 2024-05-08T05:18:34.734 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:18:34 smithi090 ceph-mon[34526]: mon.b calling monitor election 2024-05-08T05:18:34.734 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:18:34 smithi090 ceph-mon[34526]: mon.c calling monitor election 2024-05-08T05:18:34.734 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:18:34 smithi090 ceph-mon[34526]: mon.a calling monitor election 2024-05-08T05:18:34.734 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:18:34 smithi090 ceph-mon[34526]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-05-08T05:18:34.734 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:18:34 smithi090 ceph-mon[34526]: monmap epoch 3 2024-05-08T05:18:34.734 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:18:34 smithi090 ceph-mon[34526]: fsid eeeb813e-0cf9-11ef-bc97-c7b262605968 2024-05-08T05:18:34.734 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:18:34 smithi090 ceph-mon[34526]: last_changed 2024-05-08T05:18:26.705086+0000 2024-05-08T05:18:34.734 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:18:34 smithi090 ceph-mon[34526]: created 2024-05-08T05:16:09.877063+0000 2024-05-08T05:18:34.734 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:18:34 smithi090 ceph-mon[34526]: min_mon_release 19 (squid) 2024-05-08T05:18:34.735 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:18:34 smithi090 ceph-mon[34526]: election_strategy: 1 2024-05-08T05:18:34.735 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:18:34 smithi090 ceph-mon[34526]: 0: [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] mon.a 2024-05-08T05:18:34.735 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:18:34 smithi090 ceph-mon[34526]: 1: [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] mon.c 2024-05-08T05:18:34.735 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:18:34 smithi090 ceph-mon[34526]: 2: [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] mon.b 2024-05-08T05:18:34.735 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:18:34 smithi090 ceph-mon[34526]: fsmap 2024-05-08T05:18:34.735 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:18:34 smithi090 ceph-mon[34526]: osdmap e4: 0 total, 0 up, 0 in 2024-05-08T05:18:34.735 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:18:34 smithi090 ceph-mon[34526]: mgrmap e13: x(active, since 70s) 2024-05-08T05:18:34.735 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:18:34 smithi090 ceph-mon[34526]: overall HEALTH_OK 2024-05-08T05:18:34.735 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:18:34 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:18:34.735 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:18:34 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:18:34.735 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:18:34 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T05:18:34.735 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:18:34 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T05:18:34.789 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:18:34 smithi160 ceph-mon[34827]: mon.b calling monitor election 2024-05-08T05:18:34.789 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:18:34 smithi160 ceph-mon[34827]: mon.b calling monitor election 2024-05-08T05:18:34.789 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:18:34 smithi160 ceph-mon[34827]: mon.c calling monitor election 2024-05-08T05:18:34.789 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:18:34 smithi160 ceph-mon[34827]: mon.a calling monitor election 2024-05-08T05:18:34.789 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:18:34 smithi160 ceph-mon[34827]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-05-08T05:18:34.789 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:18:34 smithi160 ceph-mon[34827]: monmap epoch 3 2024-05-08T05:18:34.789 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:18:34 smithi160 ceph-mon[34827]: fsid eeeb813e-0cf9-11ef-bc97-c7b262605968 2024-05-08T05:18:34.789 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:18:34 smithi160 ceph-mon[34827]: last_changed 2024-05-08T05:18:26.705086+0000 2024-05-08T05:18:34.790 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:18:34 smithi160 ceph-mon[34827]: created 2024-05-08T05:16:09.877063+0000 2024-05-08T05:18:34.790 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:18:34 smithi160 ceph-mon[34827]: min_mon_release 19 (squid) 2024-05-08T05:18:34.790 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:18:34 smithi160 ceph-mon[34827]: election_strategy: 1 2024-05-08T05:18:34.790 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:18:34 smithi160 ceph-mon[34827]: 0: [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] mon.a 2024-05-08T05:18:34.790 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:18:34 smithi160 ceph-mon[34827]: 1: [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] mon.c 2024-05-08T05:18:34.790 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:18:34 smithi160 ceph-mon[34827]: 2: [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] mon.b 2024-05-08T05:18:34.790 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:18:34 smithi160 ceph-mon[34827]: fsmap 2024-05-08T05:18:34.790 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:18:34 smithi160 ceph-mon[34827]: osdmap e4: 0 total, 0 up, 0 in 2024-05-08T05:18:34.790 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:18:34 smithi160 ceph-mon[34827]: mgrmap e13: x(active, since 70s) 2024-05-08T05:18:34.790 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:18:34 smithi160 ceph-mon[34827]: overall HEALTH_OK 2024-05-08T05:18:34.790 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:18:34 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:18:34.790 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:18:34 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:18:34.790 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:18:34 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T05:18:34.791 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:18:34 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T05:18:35.789 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:18:35 smithi160 ceph-mon[34827]: Updating smithi087:/etc/ceph/ceph.conf 2024-05-08T05:18:35.789 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:18:35 smithi160 ceph-mon[34827]: Updating smithi090:/etc/ceph/ceph.conf 2024-05-08T05:18:35.789 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:18:35 smithi160 ceph-mon[34827]: Updating smithi160:/etc/ceph/ceph.conf 2024-05-08T05:18:35.789 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:18:35 smithi160 ceph-mon[34827]: Updating smithi090:/var/lib/ceph/eeeb813e-0cf9-11ef-bc97-c7b262605968/config/ceph.conf 2024-05-08T05:18:35.789 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:18:35 smithi160 ceph-mon[34827]: Updating smithi160:/var/lib/ceph/eeeb813e-0cf9-11ef-bc97-c7b262605968/config/ceph.conf 2024-05-08T05:18:35.789 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:18:35 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:18:35.790 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:18:35 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:18:35.790 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:18:35 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:18:35.790 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:18:35 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:18:35.790 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:18:35 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-08T05:18:35.790 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:18:35 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:18:35.790 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:18:35 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:18:35.790 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:18:35 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:18:35.790 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:18:35 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:18:35.790 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:18:35 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:18:35.790 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:18:35 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:18:35.790 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:18:35 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:18:35.791 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:18:35 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-05-08T05:18:35.791 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:18:35 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-05-08T05:18:35.791 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:18:35 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T05:18:35.812 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:18:35.810+0000 7fa8b8000700 1 -- 172.21.15.87:0/1775455519 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa8b0103110 msgr2=0x7fa8b01034f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:18:35.812 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:18:35.810+0000 7fa8b8000700 1 --2- 172.21.15.87:0/1775455519 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa8b0103110 0x7fa8b01034f0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fa8a4009910 tx=0x7fa8a4009c20 comp rx=0 tx=0).stop 2024-05-08T05:18:35.812 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:18:35.811+0000 7fa8b8000700 1 -- 172.21.15.87:0/1775455519 shutdown_connections 2024-05-08T05:18:35.812 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:18:35.811+0000 7fa8b8000700 1 --2- 172.21.15.87:0/1775455519 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa8b0103110 0x7fa8b01034f0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:18:35.812 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:18:35.811+0000 7fa8b8000700 1 -- 172.21.15.87:0/1775455519 >> 172.21.15.87:0/1775455519 conn(0x7fa8b00fe9e0 msgr2=0x7fa8b0100e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:18:35.812 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:18:35.811+0000 7fa8b8000700 1 -- 172.21.15.87:0/1775455519 shutdown_connections 2024-05-08T05:18:35.812 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:18:35.811+0000 7fa8b8000700 1 -- 172.21.15.87:0/1775455519 wait complete. 2024-05-08T05:18:35.812 INFO:journalctl@ceph.mgr.x.smithi087.stdout:May 08 05:18:35 smithi087 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-mgr-x[29765]: 2024-05-08T05:18:35.705+0000 7f6e0a000700 -1 mgr.server handle_report got status from non-daemon mon.b 2024-05-08T05:18:35.813 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:18:35 smithi087 ceph-mon[29523]: Updating smithi087:/etc/ceph/ceph.conf 2024-05-08T05:18:35.813 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:18:35 smithi087 ceph-mon[29523]: Updating smithi090:/etc/ceph/ceph.conf 2024-05-08T05:18:35.813 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:18:35 smithi087 ceph-mon[29523]: Updating smithi160:/etc/ceph/ceph.conf 2024-05-08T05:18:35.813 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:18:35 smithi087 ceph-mon[29523]: Updating smithi090:/var/lib/ceph/eeeb813e-0cf9-11ef-bc97-c7b262605968/config/ceph.conf 2024-05-08T05:18:35.813 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:18:35 smithi087 ceph-mon[29523]: Updating smithi160:/var/lib/ceph/eeeb813e-0cf9-11ef-bc97-c7b262605968/config/ceph.conf 2024-05-08T05:18:35.813 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:18:35 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:18:35.813 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:18:35 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:18:35.813 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:18:35 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:18:35.814 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:18:35 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:18:35.814 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:18:35 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-08T05:18:35.814 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:18:35 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:18:35.814 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:18:35 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:18:35.814 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:18:35 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:18:35.814 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:18:35 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:18:35.814 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:18:35 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:18:35.814 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:18:35 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:18:35.814 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:18:35 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:18:35.814 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:18:35 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-05-08T05:18:35.814 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:18:35 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-05-08T05:18:35.814 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:18:35 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T05:18:35.816 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:18:35.812+0000 7fa8b8000700 1 Processor -- start 2024-05-08T05:18:35.816 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:18:35.812+0000 7fa8b8000700 1 -- start start 2024-05-08T05:18:35.816 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:18:35.813+0000 7fa8b8000700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa8b0103110 0x7fa8b019e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:18:35.816 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:18:35.813+0000 7fa8b8000700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa8b019ece0 0x7fa8b0196770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:18:35.817 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:18:35.813+0000 7fa8b8000700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa8b0196cb0 0x7fa8b0197110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:18:35.817 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:18:35.813+0000 7fa8b8000700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fa8b010d390 con 0x7fa8b019ece0 2024-05-08T05:18:35.817 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:18:35.813+0000 7fa8b8000700 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fa8b010d210 con 0x7fa8b0196cb0 2024-05-08T05:18:35.817 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:18:35.813+0000 7fa8b8000700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7fa8b010d510 con 0x7fa8b0103110 2024-05-08T05:18:35.817 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:18:35.813+0000 7fa8b4c00700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa8b019ece0 0x7fa8b0196770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:18:35.817 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:18:35.813+0000 7fa8b5600700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa8b0103110 0x7fa8b019e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:18:35.817 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:18:35.813+0000 7fa8b5600700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa8b0103110 0x7fa8b019e7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.87:48664/0 (socket says 172.21.15.87:48664) 2024-05-08T05:18:35.817 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:18:35.813+0000 7fa8b5600700 1 -- 172.21.15.87:0/2025749253 learned_addr learned my addr 172.21.15.87:0/2025749253 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T05:18:35.817 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:18:35.813+0000 7fa8b4c00700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa8b019ece0 0x7fa8b0196770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:46256/0 (socket says 172.21.15.87:46256) 2024-05-08T05:18:35.818 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:18:35.813+0000 7fa8b6000700 1 --2- 172.21.15.87:0/2025749253 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa8b0196cb0 0x7fa8b0197110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:18:35.818 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:18:35.814+0000 7fa8b5600700 1 -- 172.21.15.87:0/2025749253 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa8b0196cb0 msgr2=0x7fa8b0197110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:18:35.818 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:18:35.814+0000 7fa8b5600700 1 --2- 172.21.15.87:0/2025749253 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa8b0196cb0 0x7fa8b0197110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:18:35.818 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:18:35.814+0000 7fa8b5600700 1 -- 172.21.15.87:0/2025749253 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa8b019ece0 msgr2=0x7fa8b0196770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:18:35.818 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:18:35.814+0000 7fa8b5600700 1 --2- 172.21.15.87:0/2025749253 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa8b019ece0 0x7fa8b0196770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:18:35.818 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:18:35.814+0000 7fa8b5600700 1 -- 172.21.15.87:0/2025749253 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa8b01b4470 con 0x7fa8b0103110 2024-05-08T05:18:35.818 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:18:35.814+0000 7fa8b6000700 1 --2- 172.21.15.87:0/2025749253 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa8b0196cb0 0x7fa8b0197110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T05:18:35.818 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:18:35.814+0000 7fa8b4c00700 1 --2- 172.21.15.87:0/2025749253 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa8b019ece0 0x7fa8b0196770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T05:18:35.818 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:18:35.814+0000 7fa8b5600700 1 --2- 172.21.15.87:0/2025749253 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa8b0103110 0x7fa8b019e7a0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7fa8a4004f80 tx=0x7fa8a4004fb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:18:35.818 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:18:35.815+0000 7fa8ae000700 1 -- 172.21.15.87:0/2025749253 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8a4026070 con 0x7fa8b0103110 2024-05-08T05:18:35.818 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:18:35.815+0000 7fa8ae000700 1 -- 172.21.15.87:0/2025749253 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa8a400b6f0 con 0x7fa8b0103110 2024-05-08T05:18:35.818 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:18:35.815+0000 7fa8b8000700 1 -- 172.21.15.87:0/2025749253 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa8b01b4760 con 0x7fa8b0103110 2024-05-08T05:18:35.818 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:18:35.815+0000 7fa8ae000700 1 -- 172.21.15.87:0/2025749253 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8a40038e0 con 0x7fa8b0103110 2024-05-08T05:18:35.818 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:18:35.815+0000 7fa8b8000700 1 -- 172.21.15.87:0/2025749253 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa8b01b4ca0 con 0x7fa8b0103110 2024-05-08T05:18:35.820 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:18:35.817+0000 7fa8b8000700 1 -- 172.21.15.87:0/2025749253 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa8b01045f0 con 0x7fa8b0103110 2024-05-08T05:18:35.820 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:18:35.817+0000 7fa8ae000700 1 -- 172.21.15.87:0/2025749253 <== mon.1 v2:172.21.15.160:3300/0 4 ==== mgrmap(e 13) ==== 50278+0+0 (secure 0 0 0) 0x7fa8a4029070 con 0x7fa8b0103110 2024-05-08T05:18:35.820 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:18:35.818+0000 7fa8ae000700 1 --2- 172.21.15.87:0/2025749253 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7fa89803e9a0 0x7fa898040e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:18:35.820 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:18:35.818+0000 7fa8ae000700 1 -- 172.21.15.87:0/2025749253 <== mon.1 v2:172.21.15.160:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7fa8a4053410 con 0x7fa8b0103110 2024-05-08T05:18:35.820 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:18:35.818+0000 7fa8b4c00700 1 --2- 172.21.15.87:0/2025749253 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7fa89803e9a0 0x7fa898040e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:18:35.820 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:18:35.819+0000 7fa8b4c00700 1 --2- 172.21.15.87:0/2025749253 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7fa89803e9a0 0x7fa898040e60 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fa89c009ec0 tx=0x7fa89c009210 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:18:35.825 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:18:35.823+0000 7fa8ae000700 1 -- 172.21.15.87:0/2025749253 <== mon.1 v2:172.21.15.160:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7fa8a4013070 con 0x7fa8b0103110 2024-05-08T05:18:35.983 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:18:35 smithi090 ceph-mon[34526]: Updating smithi087:/etc/ceph/ceph.conf 2024-05-08T05:18:35.984 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:18:35 smithi090 ceph-mon[34526]: Updating smithi090:/etc/ceph/ceph.conf 2024-05-08T05:18:35.984 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:18:35 smithi090 ceph-mon[34526]: Updating smithi160:/etc/ceph/ceph.conf 2024-05-08T05:18:35.984 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:18:35 smithi090 ceph-mon[34526]: Updating smithi090:/var/lib/ceph/eeeb813e-0cf9-11ef-bc97-c7b262605968/config/ceph.conf 2024-05-08T05:18:35.984 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:18:35 smithi090 ceph-mon[34526]: Updating smithi160:/var/lib/ceph/eeeb813e-0cf9-11ef-bc97-c7b262605968/config/ceph.conf 2024-05-08T05:18:35.984 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:18:35 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:18:35.984 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:18:35 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:18:35.984 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:18:35 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:18:35.984 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:18:35 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:18:35.984 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:18:35 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-08T05:18:35.984 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:18:35 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:18:35.984 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:18:35 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:18:35.985 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:18:35 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:18:35.985 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:18:35 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:18:35.985 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:18:35 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:18:35.985 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:18:35 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:18:35.985 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:18:35 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:18:35.985 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:18:35 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-05-08T05:18:35.985 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:18:35 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-05-08T05:18:35.985 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:18:35 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T05:18:36.069 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:18:36.068+0000 7fa8b8000700 1 -- 172.21.15.87:0/2025749253 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_command({"prefix": "config generate-minimal-conf"} v 0) -- 0x7fa8b0197d40 con 0x7fa8b0103110 2024-05-08T05:18:36.070 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:18:36.069+0000 7fa8ae000700 1 -- 172.21.15.87:0/2025749253 <== mon.1 v2:172.21.15.160:3300/0 7 ==== mon_command_ack([{"prefix": "config generate-minimal-conf"}]=0 v9) ==== 76+0+273 (secure 0 0 0) 0x7fa8a4030090 con 0x7fa8b0103110 2024-05-08T05:18:36.070 INFO:teuthology.orchestra.run.smithi087.stdout:# minimal ceph.conf for eeeb813e-0cf9-11ef-bc97-c7b262605968 2024-05-08T05:18:36.070 INFO:teuthology.orchestra.run.smithi087.stdout:[global] 2024-05-08T05:18:36.070 INFO:teuthology.orchestra.run.smithi087.stdout: fsid = eeeb813e-0cf9-11ef-bc97-c7b262605968 2024-05-08T05:18:36.070 INFO:teuthology.orchestra.run.smithi087.stdout: mon_host = [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] 2024-05-08T05:18:36.073 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:18:36.072+0000 7fa8b8000700 1 -- 172.21.15.87:0/2025749253 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7fa89803e9a0 msgr2=0x7fa898040e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:18:36.073 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:18:36.072+0000 7fa8b8000700 1 --2- 172.21.15.87:0/2025749253 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7fa89803e9a0 0x7fa898040e60 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fa89c009ec0 tx=0x7fa89c009210 comp rx=0 tx=0).stop 2024-05-08T05:18:36.073 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:18:36.072+0000 7fa8b8000700 1 -- 172.21.15.87:0/2025749253 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa8b0103110 msgr2=0x7fa8b019e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:18:36.073 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:18:36.072+0000 7fa8b8000700 1 --2- 172.21.15.87:0/2025749253 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa8b0103110 0x7fa8b019e7a0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7fa8a4004f80 tx=0x7fa8a4004fb0 comp rx=0 tx=0).stop 2024-05-08T05:18:36.073 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:18:36.073+0000 7fa8b8000700 1 -- 172.21.15.87:0/2025749253 shutdown_connections 2024-05-08T05:18:36.073 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:18:36.073+0000 7fa8b8000700 1 --2- 172.21.15.87:0/2025749253 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa8b0196cb0 0x7fa8b0197110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:18:36.073 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:18:36.073+0000 7fa8b8000700 1 --2- 172.21.15.87:0/2025749253 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7fa89803e9a0 0x7fa898040e60 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:18:36.073 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:18:36.073+0000 7fa8b8000700 1 --2- 172.21.15.87:0/2025749253 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa8b0103110 0x7fa8b019e7a0 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:18:36.074 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:18:36.073+0000 7fa8b8000700 1 --2- 172.21.15.87:0/2025749253 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa8b019ece0 0x7fa8b0196770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:18:36.074 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:18:36.073+0000 7fa8b8000700 1 -- 172.21.15.87:0/2025749253 >> 172.21.15.87:0/2025749253 conn(0x7fa8b00fe9e0 msgr2=0x7fa8b0106af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:18:36.074 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:18:36.073+0000 7fa8b8000700 1 -- 172.21.15.87:0/2025749253 shutdown_connections 2024-05-08T05:18:36.074 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:18:36.073+0000 7fa8b8000700 1 -- 172.21.15.87:0/2025749253 wait complete. 2024-05-08T05:18:36.708 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:18:36 smithi087 ceph-mon[29523]: Updating smithi087:/var/lib/ceph/eeeb813e-0cf9-11ef-bc97-c7b262605968/config/ceph.conf 2024-05-08T05:18:36.708 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:18:36 smithi087 ceph-mon[29523]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-08T05:18:36.709 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:18:36 smithi087 ceph-mon[29523]: Reconfiguring mon.a (unknown last config time)... 2024-05-08T05:18:36.709 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:18:36 smithi087 ceph-mon[29523]: Reconfiguring daemon mon.a on smithi087 2024-05-08T05:18:36.709 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:18:36 smithi087 ceph-mon[29523]: from='client.? 172.21.15.87:0/2025749253' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T05:18:36.788 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:18:36 smithi160 ceph-mon[34827]: Updating smithi087:/var/lib/ceph/eeeb813e-0cf9-11ef-bc97-c7b262605968/config/ceph.conf 2024-05-08T05:18:36.788 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:18:36 smithi160 ceph-mon[34827]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-08T05:18:36.789 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:18:36 smithi160 ceph-mon[34827]: Reconfiguring mon.a (unknown last config time)... 2024-05-08T05:18:36.789 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:18:36 smithi160 ceph-mon[34827]: Reconfiguring daemon mon.a on smithi087 2024-05-08T05:18:36.789 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:18:36 smithi160 ceph-mon[34827]: from='client.? 172.21.15.87:0/2025749253' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T05:18:36.815 INFO:tasks.cephadm:Distributing (final) config and client.admin keyring... 2024-05-08T05:18:36.815 DEBUG:teuthology.orchestra.run.smithi087:> set -ex 2024-05-08T05:18:36.815 DEBUG:teuthology.orchestra.run.smithi087:> sudo dd of=/etc/ceph/ceph.conf 2024-05-08T05:18:36.881 DEBUG:teuthology.orchestra.run.smithi087:> set -ex 2024-05-08T05:18:36.881 DEBUG:teuthology.orchestra.run.smithi087:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-05-08T05:18:36.983 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:18:36 smithi090 ceph-mon[34526]: Updating smithi087:/var/lib/ceph/eeeb813e-0cf9-11ef-bc97-c7b262605968/config/ceph.conf 2024-05-08T05:18:36.984 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:18:36 smithi090 ceph-mon[34526]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-08T05:18:36.984 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:18:36 smithi090 ceph-mon[34526]: Reconfiguring mon.a (unknown last config time)... 2024-05-08T05:18:36.984 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:18:36 smithi090 ceph-mon[34526]: Reconfiguring daemon mon.a on smithi087 2024-05-08T05:18:36.984 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:18:36 smithi090 ceph-mon[34526]: from='client.? 172.21.15.87:0/2025749253' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T05:18:36.991 DEBUG:teuthology.orchestra.run.smithi090:> set -ex 2024-05-08T05:18:36.991 DEBUG:teuthology.orchestra.run.smithi090:> sudo dd of=/etc/ceph/ceph.conf 2024-05-08T05:18:37.023 DEBUG:teuthology.orchestra.run.smithi090:> set -ex 2024-05-08T05:18:37.023 DEBUG:teuthology.orchestra.run.smithi090:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-05-08T05:18:37.090 DEBUG:teuthology.orchestra.run.smithi160:> set -ex 2024-05-08T05:18:37.090 DEBUG:teuthology.orchestra.run.smithi160:> sudo dd of=/etc/ceph/ceph.conf 2024-05-08T05:18:37.118 DEBUG:teuthology.orchestra.run.smithi160:> set -ex 2024-05-08T05:18:37.118 DEBUG:teuthology.orchestra.run.smithi160:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-05-08T05:18:37.182 INFO:tasks.cephadm:Adding mgr.x on smithi087 2024-05-08T05:18:37.182 INFO:tasks.cephadm:Adding mgr.y on smithi090 2024-05-08T05:18:37.182 INFO:tasks.cephadm:Adding mgr.z on smithi160 2024-05-08T05:18:37.182 DEBUG:teuthology.orchestra.run.smithi160:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid eeeb813e-0cf9-11ef-bc97-c7b262605968 -- ceph orch apply mgr '3;smithi087=x;smithi090=y;smithi160=z' 2024-05-08T05:18:37.450 INFO:teuthology.orchestra.run.smithi160.stderr:Inferring config /var/lib/ceph/eeeb813e-0cf9-11ef-bc97-c7b262605968/mon.c/config 2024-05-08T05:18:38.603 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:18:38 smithi160 ceph-mon[34827]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-08T05:18:38.603 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:18:38 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:18:38.603 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:18:38 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:18:38.604 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:18:38 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-05-08T05:18:38.604 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:18:38 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-05-08T05:18:38.604 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:18:38 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T05:18:38.854 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-08T05:18:38.851+0000 7f1e703f3700 1 -- 172.21.15.160:0/3008185369 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1e68103b10 msgr2=0x7f1e68105f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:18:38.854 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-08T05:18:38.851+0000 7f1e703f3700 1 --2- 172.21.15.160:0/3008185369 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1e68103b10 0x7f1e68105f00 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f1e6400b0a0 tx=0x7f1e6400b3b0 comp rx=0 tx=0).stop 2024-05-08T05:18:38.854 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-08T05:18:38.851+0000 7f1e703f3700 1 -- 172.21.15.160:0/3008185369 shutdown_connections 2024-05-08T05:18:38.854 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-08T05:18:38.851+0000 7f1e703f3700 1 --2- 172.21.15.160:0/3008185369 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1e68103b10 0x7f1e68105f00 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:18:38.854 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-08T05:18:38.851+0000 7f1e703f3700 1 -- 172.21.15.160:0/3008185369 >> 172.21.15.160:0/3008185369 conn(0x7f1e680fd4a0 msgr2=0x7f1e680ff8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:18:38.854 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-08T05:18:38.851+0000 7f1e703f3700 1 -- 172.21.15.160:0/3008185369 shutdown_connections 2024-05-08T05:18:38.854 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-08T05:18:38.851+0000 7f1e703f3700 1 -- 172.21.15.160:0/3008185369 wait complete. 2024-05-08T05:18:38.854 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-08T05:18:38.852+0000 7f1e703f3700 1 Processor -- start 2024-05-08T05:18:38.855 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-08T05:18:38.852+0000 7f1e703f3700 1 -- start start 2024-05-08T05:18:38.855 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-08T05:18:38.852+0000 7f1e703f3700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1e68103b10 0x7f1e68198710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:18:38.855 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-08T05:18:38.852+0000 7f1e703f3700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1e68198c50 0x7f1e6819dcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:18:38.855 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-08T05:18:38.852+0000 7f1e703f3700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1e681990d0 0x7f1e681a0250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:18:38.855 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-08T05:18:38.852+0000 7f1e703f3700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f1e68108ef0 con 0x7f1e68198c50 2024-05-08T05:18:38.855 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-08T05:18:38.852+0000 7f1e703f3700 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f1e68108d70 con 0x7f1e681990d0 2024-05-08T05:18:38.855 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-08T05:18:38.852+0000 7f1e703f3700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f1e68109070 con 0x7f1e68103b10 2024-05-08T05:18:38.855 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-08T05:18:38.852+0000 7f1e6e18f700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1e68103b10 0x7f1e68198710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:18:38.855 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-08T05:18:38.852+0000 7f1e6e18f700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1e68103b10 0x7f1e68198710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.160:37776/0 (socket says 172.21.15.160:37776) 2024-05-08T05:18:38.855 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-08T05:18:38.852+0000 7f1e6e18f700 1 -- 172.21.15.160:0/1356243487 learned_addr learned my addr 172.21.15.160:0/1356243487 (peer_addr_for_me v2:172.21.15.160:0/0) 2024-05-08T05:18:38.855 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-08T05:18:38.853+0000 7f1e6e18f700 1 -- 172.21.15.160:0/1356243487 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1e681990d0 msgr2=0x7f1e681a0250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:18:38.855 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-08T05:18:38.853+0000 7f1e6e990700 1 --2- 172.21.15.160:0/1356243487 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1e681990d0 0x7f1e681a0250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:18:38.855 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-08T05:18:38.853+0000 7f1e6d98e700 1 --2- 172.21.15.160:0/1356243487 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1e68198c50 0x7f1e6819dcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:18:38.856 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-08T05:18:38.853+0000 7f1e6e18f700 1 --2- 172.21.15.160:0/1356243487 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1e681990d0 0x7f1e681a0250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:18:38.856 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-08T05:18:38.853+0000 7f1e6e18f700 1 -- 172.21.15.160:0/1356243487 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1e68198c50 msgr2=0x7f1e6819dcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:18:38.856 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-08T05:18:38.853+0000 7f1e6e18f700 1 --2- 172.21.15.160:0/1356243487 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1e68198c50 0x7f1e6819dcc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:18:38.856 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-08T05:18:38.853+0000 7f1e6e18f700 1 -- 172.21.15.160:0/1356243487 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1e681a0b20 con 0x7f1e68103b10 2024-05-08T05:18:38.856 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-08T05:18:38.853+0000 7f1e6e18f700 1 --2- 172.21.15.160:0/1356243487 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1e68103b10 0x7f1e68198710 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f1e6400b830 tx=0x7f1e6400bdc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:18:38.856 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-08T05:18:38.853+0000 7f1e5f7fe700 1 -- 172.21.15.160:0/1356243487 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e64017040 con 0x7f1e68103b10 2024-05-08T05:18:38.856 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-08T05:18:38.853+0000 7f1e5f7fe700 1 -- 172.21.15.160:0/1356243487 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1e64005780 con 0x7f1e68103b10 2024-05-08T05:18:38.856 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-08T05:18:38.853+0000 7f1e703f3700 1 -- 172.21.15.160:0/1356243487 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1e681a0db0 con 0x7f1e68103b10 2024-05-08T05:18:38.856 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-08T05:18:38.853+0000 7f1e5f7fe700 1 -- 172.21.15.160:0/1356243487 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e64012ad0 con 0x7f1e68103b10 2024-05-08T05:18:38.856 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-08T05:18:38.853+0000 7f1e703f3700 1 -- 172.21.15.160:0/1356243487 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1e681a1280 con 0x7f1e68103b10 2024-05-08T05:18:38.857 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-08T05:18:38.854+0000 7f1e5f7fe700 1 -- 172.21.15.160:0/1356243487 <== mon.1 v2:172.21.15.160:3300/0 4 ==== mgrmap(e 13) ==== 50278+0+0 (secure 0 0 0) 0x7f1e64012c70 con 0x7f1e68103b10 2024-05-08T05:18:38.857 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-08T05:18:38.854+0000 7f1e5f7fe700 1 --2- 172.21.15.160:0/1356243487 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f1e5403e9a0 0x7f1e54040e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:18:38.857 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-08T05:18:38.854+0000 7f1e5f7fe700 1 -- 172.21.15.160:0/1356243487 <== mon.1 v2:172.21.15.160:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f1e6400f020 con 0x7f1e68103b10 2024-05-08T05:18:38.857 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-08T05:18:38.855+0000 7f1e703f3700 1 -- 172.21.15.160:0/1356243487 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1e6802e510 con 0x7f1e68103b10 2024-05-08T05:18:38.857 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-08T05:18:38.855+0000 7f1e6d98e700 1 --2- 172.21.15.160:0/1356243487 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f1e5403e9a0 0x7f1e54040e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:18:38.857 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-08T05:18:38.856+0000 7f1e6d98e700 1 --2- 172.21.15.160:0/1356243487 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f1e5403e9a0 0x7f1e54040e60 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f1e580078e0 tx=0x7f1e58008040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:18:38.860 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-08T05:18:38.860+0000 7f1e5f7fe700 1 -- 172.21.15.160:0/1356243487 <== mon.1 v2:172.21.15.160:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f1e64029020 con 0x7f1e68103b10 2024-05-08T05:18:38.873 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:18:38 smithi090 ceph-mon[34526]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-08T05:18:38.873 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:18:38 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:18:38.873 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:18:38 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:18:38.873 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:18:38 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-05-08T05:18:38.873 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:18:38 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-05-08T05:18:38.873 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:18:38 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T05:18:38.958 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:18:38 smithi087 ceph-mon[29523]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-08T05:18:38.959 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:18:38 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:18:38.959 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:18:38 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:18:38.959 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:18:38 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-05-08T05:18:38.959 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:18:38 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-05-08T05:18:38.959 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:18:38 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T05:18:39.075 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-08T05:18:39.075+0000 7f1e703f3700 1 -- 172.21.15.160:0/1356243487 --> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi087=x;smithi090=y;smithi160=z", "target": ["mon-mgr", ""]}) -- 0x7f1e680638e0 con 0x7f1e5403e9a0 2024-05-08T05:18:39.089 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-08T05:18:39.088+0000 7f1e5f7fe700 1 -- 172.21.15.160:0/1356243487 <== mgr.14152 v2:172.21.15.87:6800/1189186457 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+24 (secure 0 0 0) 0x7f1e680638e0 con 0x7f1e5403e9a0 2024-05-08T05:18:39.089 INFO:teuthology.orchestra.run.smithi160.stdout:Scheduled mgr update... 2024-05-08T05:18:39.091 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-08T05:18:39.090+0000 7f1e703f3700 1 -- 172.21.15.160:0/1356243487 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f1e5403e9a0 msgr2=0x7f1e54040e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:18:39.091 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-08T05:18:39.091+0000 7f1e703f3700 1 --2- 172.21.15.160:0/1356243487 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f1e5403e9a0 0x7f1e54040e60 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f1e580078e0 tx=0x7f1e58008040 comp rx=0 tx=0).stop 2024-05-08T05:18:39.091 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-08T05:18:39.091+0000 7f1e703f3700 1 -- 172.21.15.160:0/1356243487 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1e68103b10 msgr2=0x7f1e68198710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:18:39.092 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-08T05:18:39.091+0000 7f1e703f3700 1 --2- 172.21.15.160:0/1356243487 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1e68103b10 0x7f1e68198710 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f1e6400b830 tx=0x7f1e6400bdc0 comp rx=0 tx=0).stop 2024-05-08T05:18:39.092 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-08T05:18:39.091+0000 7f1e703f3700 1 -- 172.21.15.160:0/1356243487 shutdown_connections 2024-05-08T05:18:39.092 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-08T05:18:39.091+0000 7f1e703f3700 1 --2- 172.21.15.160:0/1356243487 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1e681990d0 0x7f1e681a0250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:18:39.092 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-08T05:18:39.091+0000 7f1e703f3700 1 --2- 172.21.15.160:0/1356243487 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f1e5403e9a0 0x7f1e54040e60 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:18:39.092 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-08T05:18:39.091+0000 7f1e703f3700 1 --2- 172.21.15.160:0/1356243487 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1e68103b10 0x7f1e68198710 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:18:39.092 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-08T05:18:39.091+0000 7f1e703f3700 1 --2- 172.21.15.160:0/1356243487 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1e68198c50 0x7f1e6819dcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:18:39.092 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-08T05:18:39.091+0000 7f1e703f3700 1 -- 172.21.15.160:0/1356243487 >> 172.21.15.160:0/1356243487 conn(0x7f1e680fd4a0 msgr2=0x7f1e680fe120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:18:39.092 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-08T05:18:39.091+0000 7f1e703f3700 1 -- 172.21.15.160:0/1356243487 shutdown_connections 2024-05-08T05:18:39.092 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-08T05:18:39.091+0000 7f1e703f3700 1 -- 172.21.15.160:0/1356243487 wait complete. 2024-05-08T05:18:39.634 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:18:39 smithi160 ceph-mon[34827]: Reconfiguring mon.b (monmap changed)... 2024-05-08T05:18:39.634 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:18:39 smithi160 ceph-mon[34827]: Reconfiguring daemon mon.b on smithi090 2024-05-08T05:18:39.634 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:18:39 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:18:39.635 DEBUG:teuthology.orchestra.run.smithi090:mgr.y> sudo journalctl -f -n 0 -u ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968@mgr.y.service 2024-05-08T05:18:39.638 DEBUG:teuthology.orchestra.run.smithi160:mgr.z> sudo journalctl -f -n 0 -u ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968@mgr.z.service 2024-05-08T05:18:39.640 INFO:tasks.cephadm:Deploying OSDs... 2024-05-08T05:18:39.641 DEBUG:teuthology.orchestra.run.smithi087:> set -ex 2024-05-08T05:18:39.641 DEBUG:teuthology.orchestra.run.smithi087:> dd if=/scratch_devs of=/dev/stdout 2024-05-08T05:18:39.701 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-05-08T05:18:39.701 DEBUG:teuthology.orchestra.run.smithi087:> stat /dev/vg_nvme/lv_1 2024-05-08T05:18:39.757 INFO:teuthology.orchestra.run.smithi087.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-05-08T05:18:39.757 INFO:teuthology.orchestra.run.smithi087.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-08T05:18:39.757 INFO:teuthology.orchestra.run.smithi087.stdout:Device: 6h/6d Inode: 634 Links: 1 2024-05-08T05:18:39.757 INFO:teuthology.orchestra.run.smithi087.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-08T05:18:39.757 INFO:teuthology.orchestra.run.smithi087.stdout:Context: system_u:object_r:device_t:s0 2024-05-08T05:18:39.757 INFO:teuthology.orchestra.run.smithi087.stdout:Access: 2024-05-08 05:17:39.418714398 +0000 2024-05-08T05:18:39.758 INFO:teuthology.orchestra.run.smithi087.stdout:Modify: 2024-05-08 05:12:32.161525613 +0000 2024-05-08T05:18:39.758 INFO:teuthology.orchestra.run.smithi087.stdout:Change: 2024-05-08 05:12:32.161525613 +0000 2024-05-08T05:18:39.758 INFO:teuthology.orchestra.run.smithi087.stdout: Birth: 2024-05-08 05:12:32.161525613 +0000 2024-05-08T05:18:39.758 DEBUG:teuthology.orchestra.run.smithi087:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-05-08T05:18:39.824 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:18:39 smithi087 ceph-mon[29523]: Reconfiguring mon.b (monmap changed)... 2024-05-08T05:18:39.824 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:18:39 smithi087 ceph-mon[29523]: Reconfiguring daemon mon.b on smithi090 2024-05-08T05:18:39.824 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:18:39 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:18:39.833 INFO:teuthology.orchestra.run.smithi087.stderr:1+0 records in 2024-05-08T05:18:39.833 INFO:teuthology.orchestra.run.smithi087.stderr:1+0 records out 2024-05-08T05:18:39.833 INFO:teuthology.orchestra.run.smithi087.stderr:512 bytes copied, 0.000404657 s, 1.3 MB/s 2024-05-08T05:18:39.837 DEBUG:teuthology.orchestra.run.smithi087:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-05-08T05:18:39.875 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:18:39 smithi090 ceph-mon[34526]: Reconfiguring mon.b (monmap changed)... 2024-05-08T05:18:39.875 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:18:39 smithi090 ceph-mon[34526]: Reconfiguring daemon mon.b on smithi090 2024-05-08T05:18:39.875 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:18:39 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:18:39.887 DEBUG:teuthology.orchestra.run.smithi087:> stat /dev/vg_nvme/lv_2 2024-05-08T05:18:39.934 INFO:teuthology.orchestra.run.smithi087.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-05-08T05:18:39.934 INFO:teuthology.orchestra.run.smithi087.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-08T05:18:39.934 INFO:teuthology.orchestra.run.smithi087.stdout:Device: 6h/6d Inode: 651 Links: 1 2024-05-08T05:18:39.934 INFO:teuthology.orchestra.run.smithi087.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-08T05:18:39.934 INFO:teuthology.orchestra.run.smithi087.stdout:Context: system_u:object_r:device_t:s0 2024-05-08T05:18:39.935 INFO:teuthology.orchestra.run.smithi087.stdout:Access: 2024-05-08 05:17:39.488712864 +0000 2024-05-08T05:18:39.935 INFO:teuthology.orchestra.run.smithi087.stdout:Modify: 2024-05-08 05:12:32.756512501 +0000 2024-05-08T05:18:39.935 INFO:teuthology.orchestra.run.smithi087.stdout:Change: 2024-05-08 05:12:32.756512501 +0000 2024-05-08T05:18:39.935 INFO:teuthology.orchestra.run.smithi087.stdout: Birth: 2024-05-08 05:12:32.756512501 +0000 2024-05-08T05:18:39.935 DEBUG:teuthology.orchestra.run.smithi087:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-05-08T05:18:40.012 INFO:teuthology.orchestra.run.smithi087.stderr:1+0 records in 2024-05-08T05:18:40.013 INFO:teuthology.orchestra.run.smithi087.stderr:1+0 records out 2024-05-08T05:18:40.013 INFO:teuthology.orchestra.run.smithi087.stderr:512 bytes copied, 0.00040969 s, 1.2 MB/s 2024-05-08T05:18:40.018 DEBUG:teuthology.orchestra.run.smithi087:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-05-08T05:18:40.071 DEBUG:teuthology.orchestra.run.smithi087:> stat /dev/vg_nvme/lv_3 2024-05-08T05:18:40.122 INFO:teuthology.orchestra.run.smithi087.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-05-08T05:18:40.122 INFO:teuthology.orchestra.run.smithi087.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-08T05:18:40.122 INFO:teuthology.orchestra.run.smithi087.stdout:Device: 6h/6d Inode: 671 Links: 1 2024-05-08T05:18:40.122 INFO:teuthology.orchestra.run.smithi087.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-08T05:18:40.122 INFO:teuthology.orchestra.run.smithi087.stdout:Context: system_u:object_r:device_t:s0 2024-05-08T05:18:40.122 INFO:teuthology.orchestra.run.smithi087.stdout:Access: 2024-05-08 05:17:39.546711593 +0000 2024-05-08T05:18:40.122 INFO:teuthology.orchestra.run.smithi087.stdout:Modify: 2024-05-08 05:12:33.379498772 +0000 2024-05-08T05:18:40.123 INFO:teuthology.orchestra.run.smithi087.stdout:Change: 2024-05-08 05:12:33.379498772 +0000 2024-05-08T05:18:40.123 INFO:teuthology.orchestra.run.smithi087.stdout: Birth: 2024-05-08 05:12:33.379498772 +0000 2024-05-08T05:18:40.123 DEBUG:teuthology.orchestra.run.smithi087:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-05-08T05:18:40.204 INFO:teuthology.orchestra.run.smithi087.stderr:1+0 records in 2024-05-08T05:18:40.204 INFO:teuthology.orchestra.run.smithi087.stderr:1+0 records out 2024-05-08T05:18:40.204 INFO:teuthology.orchestra.run.smithi087.stderr:512 bytes copied, 0.000385337 s, 1.3 MB/s 2024-05-08T05:18:40.208 DEBUG:teuthology.orchestra.run.smithi087:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-05-08T05:18:40.262 DEBUG:teuthology.orchestra.run.smithi087:> stat /dev/vg_nvme/lv_4 2024-05-08T05:18:40.312 INFO:teuthology.orchestra.run.smithi087.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-05-08T05:18:40.313 INFO:teuthology.orchestra.run.smithi087.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-08T05:18:40.313 INFO:teuthology.orchestra.run.smithi087.stdout:Device: 6h/6d Inode: 690 Links: 1 2024-05-08T05:18:40.313 INFO:teuthology.orchestra.run.smithi087.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-08T05:18:40.313 INFO:teuthology.orchestra.run.smithi087.stdout:Context: system_u:object_r:device_t:s0 2024-05-08T05:18:40.313 INFO:teuthology.orchestra.run.smithi087.stdout:Access: 2024-05-08 05:17:39.602710366 +0000 2024-05-08T05:18:40.313 INFO:teuthology.orchestra.run.smithi087.stdout:Modify: 2024-05-08 05:12:33.963485902 +0000 2024-05-08T05:18:40.313 INFO:teuthology.orchestra.run.smithi087.stdout:Change: 2024-05-08 05:12:33.963485902 +0000 2024-05-08T05:18:40.313 INFO:teuthology.orchestra.run.smithi087.stdout: Birth: 2024-05-08 05:12:33.963485902 +0000 2024-05-08T05:18:40.313 DEBUG:teuthology.orchestra.run.smithi087:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-05-08T05:18:40.389 INFO:teuthology.orchestra.run.smithi087.stderr:1+0 records in 2024-05-08T05:18:40.389 INFO:teuthology.orchestra.run.smithi087.stderr:1+0 records out 2024-05-08T05:18:40.389 INFO:teuthology.orchestra.run.smithi087.stderr:512 bytes copied, 0.000383398 s, 1.3 MB/s 2024-05-08T05:18:40.393 DEBUG:teuthology.orchestra.run.smithi087:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-05-08T05:18:40.450 DEBUG:teuthology.orchestra.run.smithi090:> set -ex 2024-05-08T05:18:40.451 DEBUG:teuthology.orchestra.run.smithi090:> dd if=/scratch_devs of=/dev/stdout 2024-05-08T05:18:40.468 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-05-08T05:18:40.469 DEBUG:teuthology.orchestra.run.smithi090:> stat /dev/vg_nvme/lv_1 2024-05-08T05:18:40.525 INFO:teuthology.orchestra.run.smithi090.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-05-08T05:18:40.525 INFO:teuthology.orchestra.run.smithi090.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-08T05:18:40.525 INFO:teuthology.orchestra.run.smithi090.stdout:Device: 5h/5d Inode: 665 Links: 1 2024-05-08T05:18:40.525 INFO:teuthology.orchestra.run.smithi090.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-08T05:18:40.526 INFO:teuthology.orchestra.run.smithi090.stdout:Context: system_u:object_r:device_t:s0 2024-05-08T05:18:40.526 INFO:teuthology.orchestra.run.smithi090.stdout:Access: 2024-05-08 05:18:26.175104463 +0000 2024-05-08T05:18:40.526 INFO:teuthology.orchestra.run.smithi090.stdout:Modify: 2024-05-08 05:11:39.550734035 +0000 2024-05-08T05:18:40.526 INFO:teuthology.orchestra.run.smithi090.stdout:Change: 2024-05-08 05:11:39.550734035 +0000 2024-05-08T05:18:40.526 INFO:teuthology.orchestra.run.smithi090.stdout: Birth: 2024-05-08 05:11:39.550734035 +0000 2024-05-08T05:18:40.526 DEBUG:teuthology.orchestra.run.smithi090:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-05-08T05:18:40.590 INFO:teuthology.orchestra.run.smithi090.stderr:1+0 records in 2024-05-08T05:18:40.591 INFO:teuthology.orchestra.run.smithi090.stderr:1+0 records out 2024-05-08T05:18:40.591 INFO:teuthology.orchestra.run.smithi090.stderr:512 bytes copied, 0.000201906 s, 2.5 MB/s 2024-05-08T05:18:40.592 DEBUG:teuthology.orchestra.run.smithi090:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-05-08T05:18:40.650 DEBUG:teuthology.orchestra.run.smithi090:> stat /dev/vg_nvme/lv_2 2024-05-08T05:18:40.705 INFO:teuthology.orchestra.run.smithi090.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-05-08T05:18:40.705 INFO:teuthology.orchestra.run.smithi090.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-08T05:18:40.705 INFO:teuthology.orchestra.run.smithi090.stdout:Device: 5h/5d Inode: 684 Links: 1 2024-05-08T05:18:40.706 INFO:teuthology.orchestra.run.smithi090.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-08T05:18:40.706 INFO:teuthology.orchestra.run.smithi090.stdout:Context: system_u:object_r:device_t:s0 2024-05-08T05:18:40.706 INFO:teuthology.orchestra.run.smithi090.stdout:Access: 2024-05-08 05:18:26.175104463 +0000 2024-05-08T05:18:40.706 INFO:teuthology.orchestra.run.smithi090.stdout:Modify: 2024-05-08 05:11:39.888728966 +0000 2024-05-08T05:18:40.706 INFO:teuthology.orchestra.run.smithi090.stdout:Change: 2024-05-08 05:11:39.888728966 +0000 2024-05-08T05:18:40.706 INFO:teuthology.orchestra.run.smithi090.stdout: Birth: 2024-05-08 05:11:39.888728966 +0000 2024-05-08T05:18:40.706 DEBUG:teuthology.orchestra.run.smithi090:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-05-08T05:18:40.769 INFO:teuthology.orchestra.run.smithi090.stderr:1+0 records in 2024-05-08T05:18:40.769 INFO:teuthology.orchestra.run.smithi090.stderr:1+0 records out 2024-05-08T05:18:40.769 INFO:teuthology.orchestra.run.smithi090.stderr:512 bytes copied, 0.000206383 s, 2.5 MB/s 2024-05-08T05:18:40.771 DEBUG:teuthology.orchestra.run.smithi090:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-05-08T05:18:40.788 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:18:40 smithi160 ceph-mon[34827]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-08T05:18:40.789 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:18:40 smithi160 ceph-mon[34827]: from='client.24103 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi087=x;smithi090=y;smithi160=z", "target": ["mon-mgr", ""]}]: dispatch 2024-05-08T05:18:40.789 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:18:40 smithi160 ceph-mon[34827]: Saving service mgr spec with placement smithi087=x;smithi090=y;smithi160=z;count:3 2024-05-08T05:18:40.789 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:18:40 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:18:40.789 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:18:40 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:18:40.789 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:18:40 smithi160 ceph-mon[34827]: Reconfiguring mon.c (monmap changed)... 2024-05-08T05:18:40.789 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:18:40 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-05-08T05:18:40.789 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:18:40 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-05-08T05:18:40.789 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:18:40 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T05:18:40.789 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:18:40 smithi160 ceph-mon[34827]: Reconfiguring daemon mon.c on smithi160 2024-05-08T05:18:40.826 DEBUG:teuthology.orchestra.run.smithi090:> stat /dev/vg_nvme/lv_3 2024-05-08T05:18:40.882 INFO:teuthology.orchestra.run.smithi090.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-05-08T05:18:40.882 INFO:teuthology.orchestra.run.smithi090.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-08T05:18:40.882 INFO:teuthology.orchestra.run.smithi090.stdout:Device: 5h/5d Inode: 701 Links: 1 2024-05-08T05:18:40.882 INFO:teuthology.orchestra.run.smithi090.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-08T05:18:40.882 INFO:teuthology.orchestra.run.smithi090.stdout:Context: system_u:object_r:device_t:s0 2024-05-08T05:18:40.882 INFO:teuthology.orchestra.run.smithi090.stdout:Access: 2024-05-08 05:18:26.176104449 +0000 2024-05-08T05:18:40.882 INFO:teuthology.orchestra.run.smithi090.stdout:Modify: 2024-05-08 05:11:40.231723822 +0000 2024-05-08T05:18:40.882 INFO:teuthology.orchestra.run.smithi090.stdout:Change: 2024-05-08 05:11:40.231723822 +0000 2024-05-08T05:18:40.882 INFO:teuthology.orchestra.run.smithi090.stdout: Birth: 2024-05-08 05:11:40.231723822 +0000 2024-05-08T05:18:40.883 DEBUG:teuthology.orchestra.run.smithi090:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-05-08T05:18:40.942 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:18:40 smithi090 ceph-mon[34526]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-08T05:18:40.942 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:18:40 smithi090 ceph-mon[34526]: from='client.24103 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi087=x;smithi090=y;smithi160=z", "target": ["mon-mgr", ""]}]: dispatch 2024-05-08T05:18:40.942 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:18:40 smithi090 ceph-mon[34526]: Saving service mgr spec with placement smithi087=x;smithi090=y;smithi160=z;count:3 2024-05-08T05:18:40.942 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:18:40 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:18:40.942 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:18:40 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:18:40.942 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:18:40 smithi090 ceph-mon[34526]: Reconfiguring mon.c (monmap changed)... 2024-05-08T05:18:40.945 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:18:40 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-05-08T05:18:40.945 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:18:40 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-05-08T05:18:40.946 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:18:40 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T05:18:40.946 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:18:40 smithi090 ceph-mon[34526]: Reconfiguring daemon mon.c on smithi160 2024-05-08T05:18:40.947 INFO:teuthology.orchestra.run.smithi090.stderr:1+0 records in 2024-05-08T05:18:40.947 INFO:teuthology.orchestra.run.smithi090.stderr:1+0 records out 2024-05-08T05:18:40.947 INFO:teuthology.orchestra.run.smithi090.stderr:512 bytes copied, 0.000208201 s, 2.5 MB/s 2024-05-08T05:18:40.947 DEBUG:teuthology.orchestra.run.smithi090:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-05-08T05:18:40.958 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:18:40 smithi087 ceph-mon[29523]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-08T05:18:40.958 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:18:40 smithi087 ceph-mon[29523]: from='client.24103 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi087=x;smithi090=y;smithi160=z", "target": ["mon-mgr", ""]}]: dispatch 2024-05-08T05:18:40.958 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:18:40 smithi087 ceph-mon[29523]: Saving service mgr spec with placement smithi087=x;smithi090=y;smithi160=z;count:3 2024-05-08T05:18:40.959 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:18:40 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:18:40.959 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:18:40 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:18:40.959 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:18:40 smithi087 ceph-mon[29523]: Reconfiguring mon.c (monmap changed)... 2024-05-08T05:18:40.959 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:18:40 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-05-08T05:18:40.959 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:18:40 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-05-08T05:18:40.959 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:18:40 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T05:18:40.959 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:18:40 smithi087 ceph-mon[29523]: Reconfiguring daemon mon.c on smithi160 2024-05-08T05:18:41.002 DEBUG:teuthology.orchestra.run.smithi090:> stat /dev/vg_nvme/lv_4 2024-05-08T05:18:41.058 INFO:teuthology.orchestra.run.smithi090.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-05-08T05:18:41.058 INFO:teuthology.orchestra.run.smithi090.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-08T05:18:41.058 INFO:teuthology.orchestra.run.smithi090.stdout:Device: 5h/5d Inode: 721 Links: 1 2024-05-08T05:18:41.058 INFO:teuthology.orchestra.run.smithi090.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-08T05:18:41.058 INFO:teuthology.orchestra.run.smithi090.stdout:Context: system_u:object_r:device_t:s0 2024-05-08T05:18:41.058 INFO:teuthology.orchestra.run.smithi090.stdout:Access: 2024-05-08 05:18:26.176104449 +0000 2024-05-08T05:18:41.058 INFO:teuthology.orchestra.run.smithi090.stdout:Modify: 2024-05-08 05:11:40.565718813 +0000 2024-05-08T05:18:41.059 INFO:teuthology.orchestra.run.smithi090.stdout:Change: 2024-05-08 05:11:40.565718813 +0000 2024-05-08T05:18:41.059 INFO:teuthology.orchestra.run.smithi090.stdout: Birth: 2024-05-08 05:11:40.565718813 +0000 2024-05-08T05:18:41.059 DEBUG:teuthology.orchestra.run.smithi090:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-05-08T05:18:41.121 INFO:teuthology.orchestra.run.smithi090.stderr:1+0 records in 2024-05-08T05:18:41.121 INFO:teuthology.orchestra.run.smithi090.stderr:1+0 records out 2024-05-08T05:18:41.121 INFO:teuthology.orchestra.run.smithi090.stderr:512 bytes copied, 0.000187048 s, 2.7 MB/s 2024-05-08T05:18:41.122 DEBUG:teuthology.orchestra.run.smithi090:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-05-08T05:18:41.178 DEBUG:teuthology.orchestra.run.smithi160:> set -ex 2024-05-08T05:18:41.179 DEBUG:teuthology.orchestra.run.smithi160:> dd if=/scratch_devs of=/dev/stdout 2024-05-08T05:18:41.193 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-05-08T05:18:41.194 DEBUG:teuthology.orchestra.run.smithi160:> stat /dev/vg_nvme/lv_1 2024-05-08T05:18:41.261 INFO:teuthology.orchestra.run.smithi160.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-05-08T05:18:41.330 INFO:teuthology.orchestra.run.smithi160.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-08T05:18:41.330 INFO:teuthology.orchestra.run.smithi160.stdout:Device: 5h/5d Inode: 666 Links: 1 2024-05-08T05:18:41.330 INFO:teuthology.orchestra.run.smithi160.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-08T05:18:41.330 INFO:teuthology.orchestra.run.smithi160.stdout:Context: system_u:object_r:device_t:s0 2024-05-08T05:18:41.330 INFO:teuthology.orchestra.run.smithi160.stdout:Access: 2024-05-08 05:18:16.831533348 +0000 2024-05-08T05:18:41.331 INFO:teuthology.orchestra.run.smithi160.stdout:Modify: 2024-05-08 05:11:51.405345293 +0000 2024-05-08T05:18:41.331 INFO:teuthology.orchestra.run.smithi160.stdout:Change: 2024-05-08 05:11:51.405345293 +0000 2024-05-08T05:18:41.331 INFO:teuthology.orchestra.run.smithi160.stdout: Birth: 2024-05-08 05:11:51.405345293 +0000 2024-05-08T05:18:41.331 DEBUG:teuthology.orchestra.run.smithi160:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-05-08T05:18:41.359 INFO:teuthology.orchestra.run.smithi160.stderr:1+0 records in 2024-05-08T05:18:41.359 INFO:teuthology.orchestra.run.smithi160.stderr:1+0 records out 2024-05-08T05:18:41.359 INFO:teuthology.orchestra.run.smithi160.stderr:512 bytes copied, 0.000269062 s, 1.9 MB/s 2024-05-08T05:18:41.360 DEBUG:teuthology.orchestra.run.smithi160:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-05-08T05:18:41.419 DEBUG:teuthology.orchestra.run.smithi160:> stat /dev/vg_nvme/lv_2 2024-05-08T05:18:41.479 INFO:teuthology.orchestra.run.smithi160.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-05-08T05:18:41.479 INFO:teuthology.orchestra.run.smithi160.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-08T05:18:41.479 INFO:teuthology.orchestra.run.smithi160.stdout:Device: 5h/5d Inode: 684 Links: 1 2024-05-08T05:18:41.479 INFO:teuthology.orchestra.run.smithi160.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-08T05:18:41.479 INFO:teuthology.orchestra.run.smithi160.stdout:Context: system_u:object_r:device_t:s0 2024-05-08T05:18:41.479 INFO:teuthology.orchestra.run.smithi160.stdout:Access: 2024-05-08 05:18:16.831533348 +0000 2024-05-08T05:18:41.479 INFO:teuthology.orchestra.run.smithi160.stdout:Modify: 2024-05-08 05:11:51.752340200 +0000 2024-05-08T05:18:41.479 INFO:teuthology.orchestra.run.smithi160.stdout:Change: 2024-05-08 05:11:51.752340200 +0000 2024-05-08T05:18:41.480 INFO:teuthology.orchestra.run.smithi160.stdout: Birth: 2024-05-08 05:11:51.752340200 +0000 2024-05-08T05:18:41.480 DEBUG:teuthology.orchestra.run.smithi160:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-05-08T05:18:41.548 INFO:teuthology.orchestra.run.smithi160.stderr:1+0 records in 2024-05-08T05:18:41.548 INFO:teuthology.orchestra.run.smithi160.stderr:1+0 records out 2024-05-08T05:18:41.548 INFO:teuthology.orchestra.run.smithi160.stderr:512 bytes copied, 0.000234997 s, 2.2 MB/s 2024-05-08T05:18:41.550 DEBUG:teuthology.orchestra.run.smithi160:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-05-08T05:18:41.607 DEBUG:teuthology.orchestra.run.smithi160:> stat /dev/vg_nvme/lv_3 2024-05-08T05:18:41.665 INFO:teuthology.orchestra.run.smithi160.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-05-08T05:18:41.665 INFO:teuthology.orchestra.run.smithi160.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-08T05:18:41.665 INFO:teuthology.orchestra.run.smithi160.stdout:Device: 5h/5d Inode: 702 Links: 1 2024-05-08T05:18:41.665 INFO:teuthology.orchestra.run.smithi160.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-08T05:18:41.665 INFO:teuthology.orchestra.run.smithi160.stdout:Context: system_u:object_r:device_t:s0 2024-05-08T05:18:41.665 INFO:teuthology.orchestra.run.smithi160.stdout:Access: 2024-05-08 05:18:16.831533348 +0000 2024-05-08T05:18:41.665 INFO:teuthology.orchestra.run.smithi160.stdout:Modify: 2024-05-08 05:11:52.115334872 +0000 2024-05-08T05:18:41.665 INFO:teuthology.orchestra.run.smithi160.stdout:Change: 2024-05-08 05:11:52.115334872 +0000 2024-05-08T05:18:41.666 INFO:teuthology.orchestra.run.smithi160.stdout: Birth: 2024-05-08 05:11:52.115334872 +0000 2024-05-08T05:18:41.666 DEBUG:teuthology.orchestra.run.smithi160:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-05-08T05:18:41.728 INFO:teuthology.orchestra.run.smithi160.stderr:1+0 records in 2024-05-08T05:18:41.729 INFO:teuthology.orchestra.run.smithi160.stderr:1+0 records out 2024-05-08T05:18:41.729 INFO:teuthology.orchestra.run.smithi160.stderr:512 bytes copied, 0.0002053 s, 2.5 MB/s 2024-05-08T05:18:41.730 DEBUG:teuthology.orchestra.run.smithi160:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-05-08T05:18:41.787 DEBUG:teuthology.orchestra.run.smithi160:> stat /dev/vg_nvme/lv_4 2024-05-08T05:18:41.842 INFO:teuthology.orchestra.run.smithi160.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-05-08T05:18:41.842 INFO:teuthology.orchestra.run.smithi160.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-08T05:18:41.842 INFO:teuthology.orchestra.run.smithi160.stdout:Device: 5h/5d Inode: 721 Links: 1 2024-05-08T05:18:41.842 INFO:teuthology.orchestra.run.smithi160.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-08T05:18:41.842 INFO:teuthology.orchestra.run.smithi160.stdout:Context: system_u:object_r:device_t:s0 2024-05-08T05:18:41.842 INFO:teuthology.orchestra.run.smithi160.stdout:Access: 2024-05-08 05:18:16.832533334 +0000 2024-05-08T05:18:41.842 INFO:teuthology.orchestra.run.smithi160.stdout:Modify: 2024-05-08 05:11:52.445330028 +0000 2024-05-08T05:18:41.842 INFO:teuthology.orchestra.run.smithi160.stdout:Change: 2024-05-08 05:11:52.445330028 +0000 2024-05-08T05:18:41.842 INFO:teuthology.orchestra.run.smithi160.stdout: Birth: 2024-05-08 05:11:52.445330028 +0000 2024-05-08T05:18:41.843 DEBUG:teuthology.orchestra.run.smithi160:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-05-08T05:18:41.905 INFO:teuthology.orchestra.run.smithi160.stderr:1+0 records in 2024-05-08T05:18:41.905 INFO:teuthology.orchestra.run.smithi160.stderr:1+0 records out 2024-05-08T05:18:41.905 INFO:teuthology.orchestra.run.smithi160.stderr:512 bytes copied, 0.000236299 s, 2.2 MB/s 2024-05-08T05:18:41.906 DEBUG:teuthology.orchestra.run.smithi160:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-05-08T05:18:41.961 INFO:tasks.cephadm:Deploying osd.0 on smithi087 with /dev/vg_nvme/lv_4... 2024-05-08T05:18:41.962 DEBUG:teuthology.orchestra.run.smithi087:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid eeeb813e-0cf9-11ef-bc97-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_4 2024-05-08T05:18:42.289 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:18:42 smithi160 ceph-mon[34827]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-08T05:18:42.289 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:18:42 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:18:42.289 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:18:42 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:18:42.289 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:18:42 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T05:18:42.289 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:18:42 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T05:18:42.289 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:18:42 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T05:18:42.290 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:18:42 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:18:42.290 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:18:42 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-05-08T05:18:42.290 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:18:42 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-05-08T05:18:42.290 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:18:42 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-05-08T05:18:42.290 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:18:42 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T05:18:42.290 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:18:42 smithi160 ceph-mon[34827]: Deploying daemon mgr.z on smithi160 2024-05-08T05:18:42.405 INFO:teuthology.orchestra.run.smithi087.stderr:Inferring config /var/lib/ceph/eeeb813e-0cf9-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T05:18:42.458 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:18:42 smithi087 ceph-mon[29523]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-08T05:18:42.458 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:18:42 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:18:42.458 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:18:42 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:18:42.458 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:18:42 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T05:18:42.458 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:18:42 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T05:18:42.458 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:18:42 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T05:18:42.459 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:18:42 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:18:42.459 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:18:42 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-05-08T05:18:42.459 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:18:42 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-05-08T05:18:42.459 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:18:42 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-05-08T05:18:42.459 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:18:42 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T05:18:42.459 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:18:42 smithi087 ceph-mon[29523]: Deploying daemon mgr.z on smithi160 2024-05-08T05:18:42.483 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:18:42 smithi090 ceph-mon[34526]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-08T05:18:42.484 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:18:42 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:18:42.484 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:18:42 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:18:42.484 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:18:42 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T05:18:42.484 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:18:42 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T05:18:42.484 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:18:42 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T05:18:42.484 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:18:42 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:18:42.484 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:18:42 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-05-08T05:18:42.484 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:18:42 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-05-08T05:18:42.484 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:18:42 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-05-08T05:18:42.484 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:18:42 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T05:18:42.484 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:18:42 smithi090 ceph-mon[34526]: Deploying daemon mgr.z on smithi160 2024-05-08T05:18:43.654 INFO:journalctl@ceph.mgr.z.smithi160.stdout:May 08 05:18:43 smithi160 systemd[1]: Started Ceph mgr.z for eeeb813e-0cf9-11ef-bc97-c7b262605968. 2024-05-08T05:18:43.947 INFO:journalctl@ceph.mgr.z.smithi160.stdout:May 08 05:18:43 smithi160 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-mgr-z[36691]: 2024-05-08T05:18:43.653+0000 7ff211328200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-05-08T05:18:43.947 INFO:journalctl@ceph.mgr.z.smithi160.stdout:May 08 05:18:43 smithi160 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-mgr-z[36691]: 2024-05-08T05:18:43.843+0000 7ff211328200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-05-08T05:18:43.948 INFO:journalctl@ceph.mgr.z.smithi160.stdout:May 08 05:18:43 smithi160 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-mgr-z[36691]: 2024-05-08T05:18:43.946+0000 7ff211328200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-05-08T05:18:44.209 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:18:44 smithi087 ceph-mon[29523]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-08T05:18:44.209 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:18:44 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:18:44.209 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:18:44 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:18:44.209 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:18:44 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:18:44.209 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:18:44 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-05-08T05:18:44.209 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:18:44 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-05-08T05:18:44.209 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:18:44 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-05-08T05:18:44.209 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:18:44 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T05:18:44.262 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:18:44 smithi160 ceph-mon[34827]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-08T05:18:44.263 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:18:44 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:18:44.263 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:18:44 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:18:44.263 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:18:44 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:18:44.263 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:18:44 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-05-08T05:18:44.263 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:18:44 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-05-08T05:18:44.263 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:18:44 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-05-08T05:18:44.263 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:18:44 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T05:18:44.343 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:18:44 smithi090 ceph-mon[34526]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-08T05:18:44.343 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:18:44 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:18:44.344 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:18:44 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:18:44.344 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:18:44 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:18:44.344 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:18:44 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-05-08T05:18:44.344 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:18:44 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-05-08T05:18:44.344 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:18:44 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-05-08T05:18:44.344 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:18:44 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T05:18:44.539 INFO:journalctl@ceph.mgr.z.smithi160.stdout:May 08 05:18:44 smithi160 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-mgr-z[36691]: 2024-05-08T05:18:44.262+0000 7ff211328200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-05-08T05:18:44.539 INFO:journalctl@ceph.mgr.z.smithi160.stdout:May 08 05:18:44 smithi160 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-mgr-z[36691]: 2024-05-08T05:18:44.349+0000 7ff211328200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-05-08T05:18:45.170 INFO:teuthology.orchestra.run.smithi087.stderr:--> Zapping: /dev/vg_nvme/lv_4 2024-05-08T05:18:45.170 INFO:teuthology.orchestra.run.smithi087.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_4 bs=1M count=10 conv=fsync 2024-05-08T05:18:45.170 INFO:teuthology.orchestra.run.smithi087.stderr: stderr: 10+0 records in 2024-05-08T05:18:45.170 INFO:teuthology.orchestra.run.smithi087.stderr:10+0 records out 2024-05-08T05:18:45.170 INFO:teuthology.orchestra.run.smithi087.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0329605 s, 318 MB/s 2024-05-08T05:18:45.170 INFO:teuthology.orchestra.run.smithi087.stderr:--> Zapping successful for: 2024-05-08T05:18:45.206 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:18:45 smithi090 ceph-mon[34526]: Deploying daemon mgr.y on smithi090 2024-05-08T05:18:45.458 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:18:45 smithi087 ceph-mon[29523]: Deploying daemon mgr.y on smithi090 2024-05-08T05:18:45.539 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:18:45 smithi160 ceph-mon[34827]: Deploying daemon mgr.y on smithi090 2024-05-08T05:18:45.727 INFO:journalctl@ceph.mgr.y.smithi090.stdout:May 08 05:18:45 smithi090 systemd[1]: Starting Ceph mgr.y for eeeb813e-0cf9-11ef-bc97-c7b262605968... 2024-05-08T05:18:45.922 INFO:journalctl@ceph.mgr.z.smithi160.stdout:May 08 05:18:45 smithi160 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-mgr-z[36691]: 2024-05-08T05:18:45.577+0000 7ff211328200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-05-08T05:18:45.922 INFO:journalctl@ceph.mgr.z.smithi160.stdout:May 08 05:18:45 smithi160 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-mgr-z[36691]: 2024-05-08T05:18:45.749+0000 7ff211328200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-05-08T05:18:45.922 INFO:journalctl@ceph.mgr.z.smithi160.stdout:May 08 05:18:45 smithi160 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-mgr-z[36691]: 2024-05-08T05:18:45.921+0000 7ff211328200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-05-08T05:18:45.978 INFO:journalctl@ceph.mgr.y.smithi090.stdout:May 08 05:18:45 smithi090 podman[35903]: 2024-05-08 05:18:45.761370118 +0000 UTC m=+0.017889974 image pull 352576a2df49fbab3aeeba1effbcb7a94815e8fc1f120a55ddc340b4ee63b8ce quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c 2024-05-08T05:18:45.978 INFO:journalctl@ceph.mgr.y.smithi090.stdout:May 08 05:18:45 smithi090 podman[35903]: 2024-05-08 05:18:45.858818656 +0000 UTC m=+0.115338527 container create 3bdf571c19ca6c4dca43744eb8f32abe9a188d9ea5f2a8ea0d9f62bb49ab0cf9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c, name=ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-mgr-y, org.label-schema.build-date=20240507, RELEASE=wip-57676-3-bee299f, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5) 2024-05-08T05:18:46.015 DEBUG:teuthology.orchestra.run.smithi087:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid eeeb813e-0cf9-11ef-bc97-c7b262605968 -- ceph orch daemon add osd smithi087:vg_nvme/lv_4 2024-05-08T05:18:46.208 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:18:46 smithi087 ceph-mon[29523]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-08T05:18:46.214 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:18:46 smithi160 ceph-mon[34827]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-08T05:18:46.400 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:18:46 smithi090 ceph-mon[34526]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-08T05:18:46.400 INFO:journalctl@ceph.mgr.y.smithi090.stdout:May 08 05:18:46 smithi090 podman[35903]: 2024-05-08 05:18:46.061425295 +0000 UTC m=+0.317945123 container init 3bdf571c19ca6c4dca43744eb8f32abe9a188d9ea5f2a8ea0d9f62bb49ab0cf9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c, name=ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-mgr-y, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.build-date=20240507, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, RELEASE=wip-57676-3-bee299f) 2024-05-08T05:18:46.400 INFO:journalctl@ceph.mgr.y.smithi090.stdout:May 08 05:18:46 smithi090 podman[35903]: 2024-05-08 05:18:46.064144948 +0000 UTC m=+0.320664786 container start 3bdf571c19ca6c4dca43744eb8f32abe9a188d9ea5f2a8ea0d9f62bb49ab0cf9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c, name=ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-mgr-y, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_CLEAN=True, CEPH_POINT_RELEASE=, ceph=True, RELEASE=wip-57676-3-bee299f, io.buildah.version=1.33.5, org.label-schema.build-date=20240507, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux ) 2024-05-08T05:18:46.401 INFO:journalctl@ceph.mgr.y.smithi090.stdout:May 08 05:18:46 smithi090 ceph-mgr[35923]: -- 172.21.15.90:0/1010984100 <== mon.2 v2:172.21.15.90:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55de68dd65a0 con 0x55de68dab000 2024-05-08T05:18:46.401 INFO:journalctl@ceph.mgr.y.smithi090.stdout:May 08 05:18:46 smithi090 bash[35903]: 3bdf571c19ca6c4dca43744eb8f32abe9a188d9ea5f2a8ea0d9f62bb49ab0cf9 2024-05-08T05:18:46.401 INFO:journalctl@ceph.mgr.y.smithi090.stdout:May 08 05:18:46 smithi090 systemd[1]: Started Ceph mgr.y for eeeb813e-0cf9-11ef-bc97-c7b262605968. 2024-05-08T05:18:46.401 INFO:journalctl@ceph.mgr.y.smithi090.stdout:May 08 05:18:46 smithi090 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-mgr-y[35919]: 2024-05-08T05:18:46.213+0000 7f2c3ba9d200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-05-08T05:18:46.401 INFO:journalctl@ceph.mgr.y.smithi090.stdout:May 08 05:18:46 smithi090 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-mgr-y[35919]: 2024-05-08T05:18:46.398+0000 7f2c3ba9d200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-05-08T05:18:46.462 INFO:teuthology.orchestra.run.smithi087.stderr:Inferring config /var/lib/ceph/eeeb813e-0cf9-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T05:18:46.520 INFO:journalctl@ceph.mgr.z.smithi160.stdout:May 08 05:18:46 smithi160 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-mgr-z[36691]: 2024-05-08T05:18:46.214+0000 7ff211328200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-05-08T05:18:46.520 INFO:journalctl@ceph.mgr.z.smithi160.stdout:May 08 05:18:46 smithi160 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-mgr-z[36691]: 2024-05-08T05:18:46.309+0000 7ff211328200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-05-08T05:18:46.520 INFO:journalctl@ceph.mgr.z.smithi160.stdout:May 08 05:18:46 smithi160 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-mgr-z[36691]: 2024-05-08T05:18:46.517+0000 7ff211328200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-05-08T05:18:46.734 INFO:journalctl@ceph.mgr.y.smithi090.stdout:May 08 05:18:46 smithi090 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-mgr-y[35919]: 2024-05-08T05:18:46.505+0000 7f2c3ba9d200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-05-08T05:18:46.789 INFO:journalctl@ceph.mgr.z.smithi160.stdout:May 08 05:18:46 smithi160 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-mgr-z[36691]: 2024-05-08T05:18:46.721+0000 7ff211328200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-05-08T05:18:47.234 INFO:journalctl@ceph.mgr.y.smithi090.stdout:May 08 05:18:46 smithi090 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-mgr-y[35919]: 2024-05-08T05:18:46.833+0000 7f2c3ba9d200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-05-08T05:18:47.234 INFO:journalctl@ceph.mgr.y.smithi090.stdout:May 08 05:18:46 smithi090 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-mgr-y[35919]: 2024-05-08T05:18:46.921+0000 7f2c3ba9d200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-05-08T05:18:47.409 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:18:47 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:18:47.409 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:18:47 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:18:47.409 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:18:47 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:18:47.410 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:18:47 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:18:47.410 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:18:47 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T05:18:47.539 INFO:journalctl@ceph.mgr.z.smithi160.stdout:May 08 05:18:47 smithi160 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-mgr-z[36691]: 2024-05-08T05:18:47.373+0000 7ff211328200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-05-08T05:18:47.539 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:18:47 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:18:47.539 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:18:47 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:18:47.539 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:18:47 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:18:47.539 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:18:47 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:18:47.540 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:18:47 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T05:18:47.733 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:18:47 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:18:47.734 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:18:47 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:18:47.734 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:18:47 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:18:47.734 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:18:47 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:18:47.734 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:18:47 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T05:18:48.038 INFO:journalctl@ceph.mgr.z.smithi160.stdout:May 08 05:18:47 smithi160 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-mgr-z[36691]: 2024-05-08T05:18:47.605+0000 7ff211328200 -1 mgr[py] Module smb has missing NOTIFY_TYPES member 2024-05-08T05:18:48.483 INFO:journalctl@ceph.mgr.y.smithi090.stdout:May 08 05:18:48 smithi090 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-mgr-y[35919]: 2024-05-08T05:18:48.160+0000 7f2c3ba9d200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-05-08T05:18:48.484 INFO:journalctl@ceph.mgr.y.smithi090.stdout:May 08 05:18:48 smithi090 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-mgr-y[35919]: 2024-05-08T05:18:48.329+0000 7f2c3ba9d200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-05-08T05:18:48.484 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:18:48 smithi090 ceph-mon[34526]: pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-08T05:18:48.484 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:18:48 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:18:48.484 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:18:48 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:18:48.484 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:18:48 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:18:48.484 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:18:48 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:18:48.484 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:18:48 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T05:18:48.484 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:18:48 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T05:18:48.484 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:18:48 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:18:48.484 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:18:48 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:18:48.485 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:18:48 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-05-08T05:18:48.485 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:18:48 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-05-08T05:18:48.485 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:18:48 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T05:18:48.524 INFO:journalctl@ceph.mgr.z.smithi160.stdout:May 08 05:18:48 smithi160 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-mgr-z[36691]: 2024-05-08T05:18:48.046+0000 7ff211328200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-05-08T05:18:48.524 INFO:journalctl@ceph.mgr.z.smithi160.stdout:May 08 05:18:48 smithi160 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-mgr-z[36691]: 2024-05-08T05:18:48.147+0000 7ff211328200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-05-08T05:18:48.524 INFO:journalctl@ceph.mgr.z.smithi160.stdout:May 08 05:18:48 smithi160 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-mgr-z[36691]: 2024-05-08T05:18:48.523+0000 7ff211328200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-05-08T05:18:48.524 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:18:48 smithi160 ceph-mon[34827]: pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-08T05:18:48.524 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:18:48 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:18:48.524 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:18:48 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:18:48.524 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:18:48 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:18:48.524 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:18:48 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:18:48.524 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:18:48 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T05:18:48.525 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:18:48 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T05:18:48.525 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:18:48 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:18:48.525 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:18:48 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:18:48.525 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:18:48 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-05-08T05:18:48.525 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:18:48 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-05-08T05:18:48.525 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:18:48 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T05:18:48.536 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:18:48.535+0000 7feaeb200700 1 -- 172.21.15.87:0/1789985308 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7feaec103ec0 msgr2=0x7feaec1062b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:18:48.537 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:18:48.535+0000 7feaeb200700 1 --2- 172.21.15.87:0/1789985308 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7feaec103ec0 0x7feaec1062b0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7feadc009990 tx=0x7feadc009ca0 comp rx=0 tx=0).stop 2024-05-08T05:18:48.537 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:18:48.536+0000 7feaeb200700 1 -- 172.21.15.87:0/1789985308 shutdown_connections 2024-05-08T05:18:48.537 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:18:48.536+0000 7feaeb200700 1 --2- 172.21.15.87:0/1789985308 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7feaec109120 0x7feaec10b590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:18:48.537 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:18:48.536+0000 7feaeb200700 1 --2- 172.21.15.87:0/1789985308 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7feaec103ec0 0x7feaec1062b0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:18:48.537 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:18:48.536+0000 7feaeb200700 1 --2- 172.21.15.87:0/1789985308 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7feaec1067f0 0x7feaec108be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:18:48.537 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:18:48.536+0000 7feaeb200700 1 -- 172.21.15.87:0/1789985308 >> 172.21.15.87:0/1789985308 conn(0x7feaec0fd8b0 msgr2=0x7feaec0ffd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:18:48.537 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:18:48.536+0000 7feaeb200700 1 -- 172.21.15.87:0/1789985308 shutdown_connections 2024-05-08T05:18:48.537 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:18:48 smithi087 ceph-mon[29523]: pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-08T05:18:48.537 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:18:48 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:18:48.538 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:18:48 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:18:48.538 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:18:48 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:18:48.538 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:18:48 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:18:48.538 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:18:48 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T05:18:48.538 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:18:48 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T05:18:48.538 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:18:48 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:18:48.538 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:18:48 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:18:48.538 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:18:48 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-05-08T05:18:48.538 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:18:48 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-05-08T05:18:48.538 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:18:48 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T05:18:48.540 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:18:48.536+0000 7feaeb200700 1 -- 172.21.15.87:0/1789985308 wait complete. 2024-05-08T05:18:48.540 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:18:48.537+0000 7feaeb200700 1 Processor -- start 2024-05-08T05:18:48.540 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:18:48.537+0000 7feaeb200700 1 -- start start 2024-05-08T05:18:48.540 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:18:48.538+0000 7feaeb200700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7feaec103ec0 0x7feaec19b740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:18:48.540 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:18:48.538+0000 7feaeb200700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7feaec1067f0 0x7feaec19bc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:18:48.540 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:18:48.538+0000 7feaeb200700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7feaec109120 0x7feaec1a2d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:18:48.540 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:18:48.538+0000 7feaeb200700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7feaec10ef40 con 0x7feaec109120 2024-05-08T05:18:48.540 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:18:48.538+0000 7feaeb200700 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7feaec10edc0 con 0x7feaec103ec0 2024-05-08T05:18:48.540 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:18:48.538+0000 7feaeb200700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7feaec10f0c0 con 0x7feaec1067f0 2024-05-08T05:18:48.541 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:18:48.538+0000 7feae9400700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7feaec1067f0 0x7feaec19bc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:18:48.541 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:18:48.538+0000 7feae9e00700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7feaec103ec0 0x7feaec19b740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:18:48.541 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:18:48.538+0000 7feae9400700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7feaec1067f0 0x7feaec19bc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.87:60726/0 (socket says 172.21.15.87:60726) 2024-05-08T05:18:48.541 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:18:48.538+0000 7feae9400700 1 -- 172.21.15.87:0/1712062606 learned_addr learned my addr 172.21.15.87:0/1712062606 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T05:18:48.541 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:18:48.538+0000 7feaea800700 1 --2- 172.21.15.87:0/1712062606 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7feaec109120 0x7feaec1a2d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:18:48.541 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:18:48.538+0000 7feae9400700 1 -- 172.21.15.87:0/1712062606 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7feaec103ec0 msgr2=0x7feaec19b740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:18:48.541 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:18:48.538+0000 7feae9400700 1 --2- 172.21.15.87:0/1712062606 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7feaec103ec0 0x7feaec19b740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:18:48.541 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:18:48.538+0000 7feae9400700 1 -- 172.21.15.87:0/1712062606 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7feaec109120 msgr2=0x7feaec1a2d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:18:48.541 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:18:48.538+0000 7feae9400700 1 --2- 172.21.15.87:0/1712062606 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7feaec109120 0x7feaec1a2d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:18:48.541 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:18:48.538+0000 7feae9400700 1 -- 172.21.15.87:0/1712062606 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feaec1a33a0 con 0x7feaec1067f0 2024-05-08T05:18:48.541 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:18:48.539+0000 7feae9400700 1 --2- 172.21.15.87:0/1712062606 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7feaec1067f0 0x7feaec19bc80 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fead800e9d0 tx=0x7fead800ece0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:18:48.541 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:18:48.539+0000 7feae2a00700 1 -- 172.21.15.87:0/1712062606 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fead800cbd0 con 0x7feaec1067f0 2024-05-08T05:18:48.541 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:18:48.539+0000 7feae2a00700 1 -- 172.21.15.87:0/1712062606 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fead800ee70 con 0x7feaec1067f0 2024-05-08T05:18:48.542 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:18:48.539+0000 7feae2a00700 1 -- 172.21.15.87:0/1712062606 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fead8018680 con 0x7feaec1067f0 2024-05-08T05:18:48.542 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:18:48.539+0000 7feaeb200700 1 -- 172.21.15.87:0/1712062606 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feaec1a3690 con 0x7feaec1067f0 2024-05-08T05:18:48.542 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:18:48.539+0000 7feaeb200700 1 -- 172.21.15.87:0/1712062606 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feaec1a3c20 con 0x7feaec1067f0 2024-05-08T05:18:48.543 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:18:48.540+0000 7feae2a00700 1 -- 172.21.15.87:0/1712062606 <== mon.1 v2:172.21.15.160:3300/0 4 ==== mgrmap(e 13) ==== 50278+0+0 (secure 0 0 0) 0x7fead8018820 con 0x7feaec1067f0 2024-05-08T05:18:48.543 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:18:48.541+0000 7feaeb200700 1 -- 172.21.15.87:0/1712062606 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feaec06a190 con 0x7feaec1067f0 2024-05-08T05:18:48.543 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:18:48.541+0000 7feae2a00700 1 --2- 172.21.15.87:0/1712062606 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7fead003e750 0x7fead0040c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:18:48.543 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:18:48.541+0000 7feae2a00700 1 -- 172.21.15.87:0/1712062606 <== mon.1 v2:172.21.15.160:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7fead8052d40 con 0x7feaec1067f0 2024-05-08T05:18:48.543 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:18:48.541+0000 7feae9e00700 1 --2- 172.21.15.87:0/1712062606 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7fead003e750 0x7fead0040c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:18:48.543 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:18:48.542+0000 7feae9e00700 1 --2- 172.21.15.87:0/1712062606 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7fead003e750 0x7fead0040c10 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7feadc00b2e0 tx=0x7feadc005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:18:48.547 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:18:48.547+0000 7feae2a00700 1 -- 172.21.15.87:0/1712062606 <== mon.1 v2:172.21.15.160:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7fead8020360 con 0x7feaec1067f0 2024-05-08T05:18:48.785 INFO:journalctl@ceph.mgr.y.smithi090.stdout:May 08 05:18:48 smithi090 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-mgr-y[35919]: 2024-05-08T05:18:48.498+0000 7f2c3ba9d200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-05-08T05:18:48.786 INFO:journalctl@ceph.mgr.y.smithi090.stdout:May 08 05:18:48 smithi090 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-mgr-y[35919]: 2024-05-08T05:18:48.784+0000 7f2c3ba9d200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-05-08T05:18:48.813 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:18:48.813+0000 7feaeb200700 1 -- 172.21.15.87:0/1712062606 --> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi087:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) -- 0x7feaec0638e0 con 0x7fead003e750 2024-05-08T05:18:49.077 INFO:journalctl@ceph.mgr.y.smithi090.stdout:May 08 05:18:48 smithi090 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-mgr-y[35919]: 2024-05-08T05:18:48.876+0000 7f2c3ba9d200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-05-08T05:18:49.078 INFO:journalctl@ceph.mgr.y.smithi090.stdout:May 08 05:18:49 smithi090 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-mgr-y[35919]: 2024-05-08T05:18:49.076+0000 7f2c3ba9d200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-05-08T05:18:49.230 INFO:journalctl@ceph.mgr.z.smithi160.stdout:May 08 05:18:48 smithi160 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-mgr-z[36691]: 2024-05-08T05:18:48.886+0000 7ff211328200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-05-08T05:18:49.231 INFO:journalctl@ceph.mgr.z.smithi160.stdout:May 08 05:18:48 smithi160 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-mgr-z[36691]: 2024-05-08T05:18:48.980+0000 7ff211328200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-05-08T05:18:49.458 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:18:49 smithi087 ceph-mon[29523]: Reconfiguring mgr.x (unknown last config time)... 2024-05-08T05:18:49.458 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:18:49 smithi087 ceph-mon[29523]: Reconfiguring daemon mgr.x on smithi087 2024-05-08T05:18:49.458 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:18:49 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-08T05:18:49.458 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:18:49 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-08T05:18:49.458 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:18:49 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T05:18:49.483 INFO:journalctl@ceph.mgr.y.smithi090.stdout:May 08 05:18:49 smithi090 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-mgr-y[35919]: 2024-05-08T05:18:49.266+0000 7f2c3ba9d200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-05-08T05:18:49.483 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:18:49 smithi090 ceph-mon[34526]: Reconfiguring mgr.x (unknown last config time)... 2024-05-08T05:18:49.484 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:18:49 smithi090 ceph-mon[34526]: Reconfiguring daemon mgr.x on smithi087 2024-05-08T05:18:49.484 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:18:49 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-08T05:18:49.484 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:18:49 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-08T05:18:49.484 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:18:49 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T05:18:49.538 INFO:journalctl@ceph.mgr.z.smithi160.stdout:May 08 05:18:49 smithi160 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-mgr-z[36691]: 2024-05-08T05:18:49.230+0000 7ff211328200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-05-08T05:18:49.539 INFO:journalctl@ceph.mgr.z.smithi160.stdout:May 08 05:18:49 smithi160 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-mgr-z[36691]: 2024-05-08T05:18:49.367+0000 7ff211328200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-05-08T05:18:49.539 INFO:journalctl@ceph.mgr.z.smithi160.stdout:May 08 05:18:49 smithi160 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-mgr-z[36691]: 2024-05-08T05:18:49.463+0000 7ff211328200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-05-08T05:18:49.539 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:18:49 smithi160 ceph-mon[34827]: Reconfiguring mgr.x (unknown last config time)... 2024-05-08T05:18:49.539 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:18:49 smithi160 ceph-mon[34827]: Reconfiguring daemon mgr.x on smithi087 2024-05-08T05:18:49.539 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:18:49 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-08T05:18:49.539 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:18:49 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-08T05:18:49.539 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:18:49 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T05:18:50.233 INFO:journalctl@ceph.mgr.y.smithi090.stdout:May 08 05:18:49 smithi090 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-mgr-y[35919]: 2024-05-08T05:18:49.862+0000 7f2c3ba9d200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-05-08T05:18:50.233 INFO:journalctl@ceph.mgr.y.smithi090.stdout:May 08 05:18:50 smithi090 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-mgr-y[35919]: 2024-05-08T05:18:50.081+0000 7f2c3ba9d200 -1 mgr[py] Module smb has missing NOTIFY_TYPES member 2024-05-08T05:18:50.289 INFO:journalctl@ceph.mgr.z.smithi160.stdout:May 08 05:18:49 smithi160 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-mgr-z[36691]: 2024-05-08T05:18:49.794+0000 7ff211328200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-05-08T05:18:50.289 INFO:journalctl@ceph.mgr.z.smithi160.stdout:May 08 05:18:49 smithi160 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-mgr-z[36691]: 2024-05-08T05:18:49.887+0000 7ff211328200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-05-08T05:18:50.599 INFO:journalctl@ceph.mgr.y.smithi090.stdout:May 08 05:18:50 smithi090 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-mgr-y[35919]: 2024-05-08T05:18:50.503+0000 7f2c3ba9d200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-05-08T05:18:50.600 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:18:50 smithi090 ceph-mon[34526]: pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-08T05:18:50.600 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:18:50 smithi090 ceph-mon[34526]: from='client.24118 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi087:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-05-08T05:18:50.600 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:18:50 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:18:50.600 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:18:50 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:18:50.600 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:18:50 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T05:18:50.600 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:18:50 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T05:18:50.600 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:18:50 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T05:18:50.600 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:18:50 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:18:50.621 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:18:50 smithi087 ceph-mon[29523]: pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-08T05:18:50.621 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:18:50 smithi087 ceph-mon[29523]: from='client.24118 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi087:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-05-08T05:18:50.621 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:18:50 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:18:50.621 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:18:50 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:18:50.621 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:18:50 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T05:18:50.621 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:18:50 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T05:18:50.622 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:18:50 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T05:18:50.622 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:18:50 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:18:50.715 INFO:journalctl@ceph.mgr.z.smithi160.stdout:May 08 05:18:50 smithi160 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-mgr-z[36691]: 2024-05-08T05:18:50.496+0000 7ff211328200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-05-08T05:18:50.715 INFO:journalctl@ceph.mgr.z.smithi160.stdout:May 08 05:18:50 smithi160 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-mgr-z[36691]: 2024-05-08T05:18:50.714+0000 7ff211328200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-05-08T05:18:50.715 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:18:50 smithi160 ceph-mon[34827]: pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-08T05:18:50.715 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:18:50 smithi160 ceph-mon[34827]: from='client.24118 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi087:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-05-08T05:18:50.715 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:18:50 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:18:50.716 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:18:50 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:18:50.716 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:18:50 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T05:18:50.716 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:18:50 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T05:18:50.716 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:18:50 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T05:18:50.716 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:18:50 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:18:50.970 INFO:journalctl@ceph.mgr.y.smithi090.stdout:May 08 05:18:50 smithi090 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-mgr-y[35919]: 2024-05-08T05:18:50.598+0000 7f2c3ba9d200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-05-08T05:18:50.970 INFO:journalctl@ceph.mgr.y.smithi090.stdout:May 08 05:18:50 smithi090 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-mgr-y[35919]: 2024-05-08T05:18:50.966+0000 7f2c3ba9d200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-05-08T05:18:51.316 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:18:51.315+0000 7feae2a00700 1 -- 172.21.15.87:0/1712062606 <== mon.1 v2:172.21.15.160:3300/0 7 ==== mgrmap(e 14) ==== 99937+0+0 (secure 0 0 0) 0x7fead8016330 con 0x7feaec1067f0 2024-05-08T05:18:51.414 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:18:51 smithi087 ceph-mon[29523]: Standby manager daemon z started 2024-05-08T05:18:51.414 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:18:51 smithi087 ceph-mon[29523]: from='mgr.? 172.21.15.160:0/3690881889' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2024-05-08T05:18:51.415 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:18:51 smithi087 ceph-mon[29523]: from='mgr.? 172.21.15.160:0/3690881889' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-05-08T05:18:51.415 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:18:51 smithi087 ceph-mon[29523]: from='mgr.? 172.21.15.160:0/3690881889' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2024-05-08T05:18:51.415 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:18:51 smithi087 ceph-mon[29523]: from='mgr.? 172.21.15.160:0/3690881889' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-05-08T05:18:51.658 INFO:journalctl@ceph.mgr.y.smithi090.stdout:May 08 05:18:51 smithi090 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-mgr-y[35919]: 2024-05-08T05:18:51.322+0000 7f2c3ba9d200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-05-08T05:18:51.658 INFO:journalctl@ceph.mgr.y.smithi090.stdout:May 08 05:18:51 smithi090 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-mgr-y[35919]: 2024-05-08T05:18:51.414+0000 7f2c3ba9d200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-05-08T05:18:51.658 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:18:51 smithi090 ceph-mon[34526]: Standby manager daemon z started 2024-05-08T05:18:51.658 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:18:51 smithi090 ceph-mon[34526]: from='mgr.? 172.21.15.160:0/3690881889' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2024-05-08T05:18:51.658 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:18:51 smithi090 ceph-mon[34526]: from='mgr.? 172.21.15.160:0/3690881889' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-05-08T05:18:51.659 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:18:51 smithi090 ceph-mon[34526]: from='mgr.? 172.21.15.160:0/3690881889' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2024-05-08T05:18:51.659 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:18:51 smithi090 ceph-mon[34526]: from='mgr.? 172.21.15.160:0/3690881889' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-05-08T05:18:51.790 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:18:51 smithi160 ceph-mon[34827]: Standby manager daemon z started 2024-05-08T05:18:51.790 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:18:51 smithi160 ceph-mon[34827]: from='mgr.? 172.21.15.160:0/3690881889' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2024-05-08T05:18:51.790 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:18:51 smithi160 ceph-mon[34827]: from='mgr.? 172.21.15.160:0/3690881889' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-05-08T05:18:51.790 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:18:51 smithi160 ceph-mon[34827]: from='mgr.? 172.21.15.160:0/3690881889' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2024-05-08T05:18:51.790 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:18:51 smithi160 ceph-mon[34827]: from='mgr.? 172.21.15.160:0/3690881889' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-05-08T05:18:51.983 INFO:journalctl@ceph.mgr.y.smithi090.stdout:May 08 05:18:51 smithi090 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-mgr-y[35919]: 2024-05-08T05:18:51.657+0000 7f2c3ba9d200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-05-08T05:18:51.983 INFO:journalctl@ceph.mgr.y.smithi090.stdout:May 08 05:18:51 smithi090 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-mgr-y[35919]: 2024-05-08T05:18:51.790+0000 7f2c3ba9d200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-05-08T05:18:51.984 INFO:journalctl@ceph.mgr.y.smithi090.stdout:May 08 05:18:51 smithi090 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-mgr-y[35919]: 2024-05-08T05:18:51.884+0000 7f2c3ba9d200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-05-08T05:18:52.483 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:18:52 smithi090 ceph-mon[34526]: pgmap v38: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-08T05:18:52.484 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:18:52 smithi090 ceph-mon[34526]: mgrmap e14: x(active, since 88s), standbys: z 2024-05-08T05:18:52.484 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:18:52 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2024-05-08T05:18:52.484 INFO:journalctl@ceph.mgr.y.smithi090.stdout:May 08 05:18:52 smithi090 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-mgr-y[35919]: 2024-05-08T05:18:52.205+0000 7f2c3ba9d200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-05-08T05:18:52.484 INFO:journalctl@ceph.mgr.y.smithi090.stdout:May 08 05:18:52 smithi090 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-mgr-y[35919]: 2024-05-08T05:18:52.296+0000 7f2c3ba9d200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-05-08T05:18:52.709 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:18:52 smithi087 ceph-mon[29523]: pgmap v38: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-08T05:18:52.709 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:18:52 smithi087 ceph-mon[29523]: mgrmap e14: x(active, since 88s), standbys: z 2024-05-08T05:18:52.709 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:18:52 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2024-05-08T05:18:52.788 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:18:52 smithi160 ceph-mon[34827]: pgmap v38: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-08T05:18:52.789 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:18:52 smithi160 ceph-mon[34827]: mgrmap e14: x(active, since 88s), standbys: z 2024-05-08T05:18:52.789 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:18:52 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2024-05-08T05:18:53.233 INFO:journalctl@ceph.mgr.y.smithi090.stdout:May 08 05:18:52 smithi090 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-mgr-y[35919]: 2024-05-08T05:18:52.896+0000 7f2c3ba9d200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-05-08T05:18:53.234 INFO:journalctl@ceph.mgr.y.smithi090.stdout:May 08 05:18:53 smithi090 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-mgr-y[35919]: 2024-05-08T05:18:53.111+0000 7f2c3ba9d200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-05-08T05:18:53.333 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:18:53.331+0000 7feae2a00700 1 -- 172.21.15.87:0/1712062606 <== mon.1 v2:172.21.15.160:3300/0 8 ==== mgrmap(e 15) ==== 149596+0+0 (secure 0 0 0) 0x7fead80667c0 con 0x7feaec1067f0 2024-05-08T05:18:53.611 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:18:53 smithi087 ceph-mon[29523]: from='mgr.? 172.21.15.90:0/221931812' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-05-08T05:18:53.611 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:18:53 smithi087 ceph-mon[29523]: Standby manager daemon y started 2024-05-08T05:18:53.611 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:18:53 smithi087 ceph-mon[29523]: from='mgr.? 172.21.15.90:0/221931812' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-05-08T05:18:53.611 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:18:53 smithi087 ceph-mon[29523]: from='mgr.? 172.21.15.90:0/221931812' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-05-08T05:18:53.611 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:18:53 smithi087 ceph-mon[29523]: from='mgr.? 172.21.15.90:0/221931812' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-05-08T05:18:53.611 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:18:53 smithi087 ceph-mon[29523]: from='client.? 172.21.15.87:0/1914916828' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f3e25ce0-0762-46fd-83fb-6766a2e9db69"}]: dispatch 2024-05-08T05:18:53.611 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:18:53 smithi087 ceph-mon[29523]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f3e25ce0-0762-46fd-83fb-6766a2e9db69"}]: dispatch 2024-05-08T05:18:53.611 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:18:53 smithi087 ceph-mon[29523]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "f3e25ce0-0762-46fd-83fb-6766a2e9db69"}]': finished 2024-05-08T05:18:53.611 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:18:53 smithi087 ceph-mon[29523]: osdmap e5: 1 total, 0 up, 1 in 2024-05-08T05:18:53.611 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:18:53 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-05-08T05:18:53.733 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:18:53 smithi090 ceph-mon[34526]: from='mgr.? 172.21.15.90:0/221931812' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-05-08T05:18:53.734 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:18:53 smithi090 ceph-mon[34526]: Standby manager daemon y started 2024-05-08T05:18:53.734 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:18:53 smithi090 ceph-mon[34526]: from='mgr.? 172.21.15.90:0/221931812' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-05-08T05:18:53.734 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:18:53 smithi090 ceph-mon[34526]: from='mgr.? 172.21.15.90:0/221931812' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-05-08T05:18:53.734 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:18:53 smithi090 ceph-mon[34526]: from='mgr.? 172.21.15.90:0/221931812' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-05-08T05:18:53.734 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:18:53 smithi090 ceph-mon[34526]: from='client.? 172.21.15.87:0/1914916828' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f3e25ce0-0762-46fd-83fb-6766a2e9db69"}]: dispatch 2024-05-08T05:18:53.734 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:18:53 smithi090 ceph-mon[34526]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f3e25ce0-0762-46fd-83fb-6766a2e9db69"}]: dispatch 2024-05-08T05:18:53.734 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:18:53 smithi090 ceph-mon[34526]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "f3e25ce0-0762-46fd-83fb-6766a2e9db69"}]': finished 2024-05-08T05:18:53.734 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:18:53 smithi090 ceph-mon[34526]: osdmap e5: 1 total, 0 up, 1 in 2024-05-08T05:18:53.734 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:18:53 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-05-08T05:18:53.789 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:18:53 smithi160 ceph-mon[34827]: from='mgr.? 172.21.15.90:0/221931812' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-05-08T05:18:53.789 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:18:53 smithi160 ceph-mon[34827]: Standby manager daemon y started 2024-05-08T05:18:53.789 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:18:53 smithi160 ceph-mon[34827]: from='mgr.? 172.21.15.90:0/221931812' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-05-08T05:18:53.789 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:18:53 smithi160 ceph-mon[34827]: from='mgr.? 172.21.15.90:0/221931812' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-05-08T05:18:53.789 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:18:53 smithi160 ceph-mon[34827]: from='mgr.? 172.21.15.90:0/221931812' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-05-08T05:18:53.789 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:18:53 smithi160 ceph-mon[34827]: from='client.? 172.21.15.87:0/1914916828' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f3e25ce0-0762-46fd-83fb-6766a2e9db69"}]: dispatch 2024-05-08T05:18:53.789 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:18:53 smithi160 ceph-mon[34827]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f3e25ce0-0762-46fd-83fb-6766a2e9db69"}]: dispatch 2024-05-08T05:18:53.789 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:18:53 smithi160 ceph-mon[34827]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "f3e25ce0-0762-46fd-83fb-6766a2e9db69"}]': finished 2024-05-08T05:18:53.789 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:18:53 smithi160 ceph-mon[34827]: osdmap e5: 1 total, 0 up, 1 in 2024-05-08T05:18:53.789 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:18:53 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-05-08T05:18:54.641 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:18:54 smithi087 ceph-mon[29523]: pgmap v39: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-08T05:18:54.641 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:18:54 smithi087 ceph-mon[29523]: mgrmap e15: x(active, since 90s), standbys: z, y 2024-05-08T05:18:54.641 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:18:54 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-05-08T05:18:54.641 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:18:54 smithi087 ceph-mon[29523]: from='client.? 172.21.15.87:0/3418646874' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-08T05:18:54.734 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:18:54 smithi090 ceph-mon[34526]: pgmap v39: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-08T05:18:54.734 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:18:54 smithi090 ceph-mon[34526]: mgrmap e15: x(active, since 90s), standbys: z, y 2024-05-08T05:18:54.734 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:18:54 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-05-08T05:18:54.734 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:18:54 smithi090 ceph-mon[34526]: from='client.? 172.21.15.87:0/3418646874' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-08T05:18:54.789 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:18:54 smithi160 ceph-mon[34827]: pgmap v39: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-08T05:18:54.789 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:18:54 smithi160 ceph-mon[34827]: mgrmap e15: x(active, since 90s), standbys: z, y 2024-05-08T05:18:54.789 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:18:54 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-05-08T05:18:54.789 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:18:54 smithi160 ceph-mon[34827]: from='client.? 172.21.15.87:0/3418646874' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-08T05:18:56.708 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:18:56 smithi087 ceph-mon[29523]: pgmap v41: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-08T05:18:56.733 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:18:56 smithi090 ceph-mon[34526]: pgmap v41: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-08T05:18:56.789 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:18:56 smithi160 ceph-mon[34827]: pgmap v41: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-08T05:18:58.458 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:18:58 smithi087 ceph-mon[29523]: pgmap v42: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-08T05:18:58.733 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:18:58 smithi090 ceph-mon[34526]: pgmap v42: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-08T05:18:58.788 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:18:58 smithi160 ceph-mon[34827]: pgmap v42: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-08T05:19:00.574 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:19:00 smithi087 ceph-mon[29523]: pgmap v43: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-08T05:19:00.733 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:19:00 smithi090 ceph-mon[34526]: pgmap v43: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-08T05:19:00.788 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:19:00 smithi160 ceph-mon[34827]: pgmap v43: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-08T05:19:02.459 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:19:02 smithi087 ceph-mon[29523]: pgmap v44: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-08T05:19:02.733 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:19:02 smithi090 ceph-mon[34526]: pgmap v44: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-08T05:19:02.789 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:19:02 smithi160 ceph-mon[34827]: pgmap v44: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-08T05:19:03.687 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:19:03 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-05-08T05:19:03.688 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:19:03 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T05:19:03.733 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:19:03 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-05-08T05:19:03.733 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:19:03 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T05:19:03.789 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:19:03 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-05-08T05:19:03.789 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:19:03 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T05:19:04.580 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:19:04 smithi087 ceph-mon[29523]: Deploying daemon osd.0 on smithi087 2024-05-08T05:19:04.580 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:19:04 smithi087 ceph-mon[29523]: pgmap v45: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-08T05:19:04.733 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:19:04 smithi090 ceph-mon[34526]: Deploying daemon osd.0 on smithi087 2024-05-08T05:19:04.733 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:19:04 smithi090 ceph-mon[34526]: pgmap v45: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-08T05:19:04.788 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:19:04 smithi160 ceph-mon[34827]: Deploying daemon osd.0 on smithi087 2024-05-08T05:19:04.789 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:19:04 smithi160 ceph-mon[34827]: pgmap v45: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-08T05:19:06.458 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:19:06 smithi087 ceph-mon[29523]: pgmap v46: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-08T05:19:06.733 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:19:06 smithi090 ceph-mon[34526]: pgmap v46: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-08T05:19:06.788 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:19:06 smithi160 ceph-mon[34827]: pgmap v46: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-08T05:19:08.459 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:19:08 smithi087 ceph-mon[29523]: pgmap v47: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-08T05:19:08.733 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:19:08 smithi090 ceph-mon[34526]: pgmap v47: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-08T05:19:08.788 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:19:08 smithi160 ceph-mon[34827]: pgmap v47: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-08T05:19:10.624 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:19:10 smithi087 ceph-mon[29523]: pgmap v48: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-08T05:19:10.734 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:19:10 smithi090 ceph-mon[34526]: pgmap v48: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-08T05:19:10.789 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:19:10 smithi160 ceph-mon[34827]: pgmap v48: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-08T05:19:12.101 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:19:11 smithi087 ceph-mon[29523]: pgmap v49: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-08T05:19:12.101 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:19:11 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:19:12.101 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:19:11 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:19:12.102 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:19:11 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T05:19:12.233 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:19:11 smithi090 ceph-mon[34526]: pgmap v49: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-08T05:19:12.234 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:19:11 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:19:12.234 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:19:11 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:19:12.234 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:19:11 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T05:19:12.289 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:19:11 smithi160 ceph-mon[34827]: pgmap v49: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-08T05:19:12.289 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:19:11 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:19:12.289 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:19:11 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:19:12.289 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:19:11 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T05:19:14.208 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:19:13 smithi087 ceph-mon[29523]: pgmap v50: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-08T05:19:14.233 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:19:13 smithi090 ceph-mon[34526]: pgmap v50: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-08T05:19:14.289 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:19:13 smithi160 ceph-mon[34827]: pgmap v50: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-08T05:19:15.377 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:19:15 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:19:15.377 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:19:15 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:19:15.377 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:19:15 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T05:19:15.377 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:19:15 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T05:19:15.377 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:19:15 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:19:15.377 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:19:15 smithi087 ceph-mon[29523]: from='osd.0 [v2:172.21.15.87:6802/2285285644,v1:172.21.15.87:6803/2285285644]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-05-08T05:19:15.377 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:19:15 smithi087 ceph-mon[29523]: from='osd.0 ' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-05-08T05:19:15.436 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:19:15 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:19:15.436 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:19:15 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:19:15.436 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:19:15 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T05:19:15.436 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:19:15 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T05:19:15.436 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:19:15 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:19:15.437 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:19:15 smithi090 ceph-mon[34526]: from='osd.0 [v2:172.21.15.87:6802/2285285644,v1:172.21.15.87:6803/2285285644]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-05-08T05:19:15.437 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:19:15 smithi090 ceph-mon[34526]: from='osd.0 ' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-05-08T05:19:15.539 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:19:15 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:19:15.539 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:19:15 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:19:15.539 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:19:15 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T05:19:15.539 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:19:15 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T05:19:15.539 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:19:15 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:19:15.539 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:19:15 smithi160 ceph-mon[34827]: from='osd.0 [v2:172.21.15.87:6802/2285285644,v1:172.21.15.87:6803/2285285644]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-05-08T05:19:15.539 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:19:15 smithi160 ceph-mon[34827]: from='osd.0 ' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-05-08T05:19:15.709 INFO:teuthology.orchestra.run.smithi087.stdout:Created osd(s) 0 on host 'smithi087' 2024-05-08T05:19:15.709 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:19:15.708+0000 7feae2a00700 1 -- 172.21.15.87:0/1712062606 <== mgr.14152 v2:172.21.15.87:6800/1189186457 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7feaec0638e0 con 0x7fead003e750 2024-05-08T05:19:15.712 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:19:15.712+0000 7feaeb200700 1 -- 172.21.15.87:0/1712062606 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7fead003e750 msgr2=0x7fead0040c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:19:15.712 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:19:15.712+0000 7feaeb200700 1 --2- 172.21.15.87:0/1712062606 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7fead003e750 0x7fead0040c10 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7feadc00b2e0 tx=0x7feadc005fb0 comp rx=0 tx=0).stop 2024-05-08T05:19:15.712 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:19:15.712+0000 7feaeb200700 1 -- 172.21.15.87:0/1712062606 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7feaec1067f0 msgr2=0x7feaec19bc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:19:15.712 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:19:15.712+0000 7feaeb200700 1 --2- 172.21.15.87:0/1712062606 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7feaec1067f0 0x7feaec19bc80 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fead800e9d0 tx=0x7fead800ece0 comp rx=0 tx=0).stop 2024-05-08T05:19:15.713 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:19:15.712+0000 7feaeb200700 1 -- 172.21.15.87:0/1712062606 shutdown_connections 2024-05-08T05:19:15.713 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:19:15.712+0000 7feaeb200700 1 --2- 172.21.15.87:0/1712062606 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7feaec109120 0x7feaec1a2d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:19:15.713 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:19:15.712+0000 7feaeb200700 1 --2- 172.21.15.87:0/1712062606 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7feaec103ec0 0x7feaec19b740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:19:15.713 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:19:15.712+0000 7feaeb200700 1 --2- 172.21.15.87:0/1712062606 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7fead003e750 0x7fead0040c10 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:19:15.713 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:19:15.712+0000 7feaeb200700 1 --2- 172.21.15.87:0/1712062606 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7feaec1067f0 0x7feaec19bc80 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:19:15.713 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:19:15.712+0000 7feaeb200700 1 -- 172.21.15.87:0/1712062606 >> 172.21.15.87:0/1712062606 conn(0x7feaec0fd8b0 msgr2=0x7feaec1036a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:19:15.713 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:19:15.712+0000 7feaeb200700 1 -- 172.21.15.87:0/1712062606 shutdown_connections 2024-05-08T05:19:15.713 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:19:15.712+0000 7feaeb200700 1 -- 172.21.15.87:0/1712062606 wait complete. 2024-05-08T05:19:16.434 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:19:16 smithi087 ceph-mon[29523]: pgmap v51: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-08T05:19:16.434 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:19:16 smithi087 ceph-mon[29523]: from='osd.0 ' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-05-08T05:19:16.434 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:19:16 smithi087 ceph-mon[29523]: from='osd.0 [v2:172.21.15.87:6802/2285285644,v1:172.21.15.87:6803/2285285644]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi087", "root=default"]}]: dispatch 2024-05-08T05:19:16.434 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:19:16 smithi087 ceph-mon[29523]: osdmap e6: 1 total, 0 up, 1 in 2024-05-08T05:19:16.434 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:19:16 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-05-08T05:19:16.434 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:19:16 smithi087 ceph-mon[29523]: from='osd.0 ' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi087", "root=default"]}]: dispatch 2024-05-08T05:19:16.435 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:19:16 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:19:16.435 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:19:16 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:19:16.435 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:19:16 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T05:19:16.481 DEBUG:teuthology.orchestra.run.smithi087:osd.0> sudo journalctl -f -n 0 -u ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968@osd.0.service 2024-05-08T05:19:16.483 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:19:16 smithi090 ceph-mon[34526]: pgmap v51: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-08T05:19:16.483 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:19:16 smithi090 ceph-mon[34526]: from='osd.0 ' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-05-08T05:19:16.483 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:19:16 smithi090 ceph-mon[34526]: from='osd.0 [v2:172.21.15.87:6802/2285285644,v1:172.21.15.87:6803/2285285644]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi087", "root=default"]}]: dispatch 2024-05-08T05:19:16.483 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:19:16 smithi090 ceph-mon[34526]: osdmap e6: 1 total, 0 up, 1 in 2024-05-08T05:19:16.484 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:19:16 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-05-08T05:19:16.484 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:19:16 smithi090 ceph-mon[34526]: from='osd.0 ' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi087", "root=default"]}]: dispatch 2024-05-08T05:19:16.484 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:19:16 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:19:16.484 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:19:16 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:19:16.484 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:19:16 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T05:19:16.485 INFO:tasks.cephadm:Deploying osd.1 on smithi090 with /dev/vg_nvme/lv_4... 2024-05-08T05:19:16.486 DEBUG:teuthology.orchestra.run.smithi090:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid eeeb813e-0cf9-11ef-bc97-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_4 2024-05-08T05:19:16.539 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:19:16 smithi160 ceph-mon[34827]: pgmap v51: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-08T05:19:16.541 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:19:16 smithi160 ceph-mon[34827]: from='osd.0 ' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-05-08T05:19:16.541 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:19:16 smithi160 ceph-mon[34827]: from='osd.0 [v2:172.21.15.87:6802/2285285644,v1:172.21.15.87:6803/2285285644]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi087", "root=default"]}]: dispatch 2024-05-08T05:19:16.541 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:19:16 smithi160 ceph-mon[34827]: osdmap e6: 1 total, 0 up, 1 in 2024-05-08T05:19:16.541 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:19:16 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-05-08T05:19:16.541 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:19:16 smithi160 ceph-mon[34827]: from='osd.0 ' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi087", "root=default"]}]: dispatch 2024-05-08T05:19:16.541 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:19:16 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:19:16.541 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:19:16 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:19:16.541 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:19:16 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T05:19:16.726 INFO:teuthology.orchestra.run.smithi090.stderr:Inferring config /var/lib/ceph/eeeb813e-0cf9-11ef-bc97-c7b262605968/mon.b/config 2024-05-08T05:19:17.459 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:19:17 smithi087 ceph-mon[29523]: from='osd.0 ' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi087", "root=default"]}]': finished 2024-05-08T05:19:17.459 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:19:17 smithi087 ceph-mon[29523]: osdmap e7: 1 total, 0 up, 1 in 2024-05-08T05:19:17.459 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:19:17 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-05-08T05:19:17.459 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:19:17 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-05-08T05:19:17.459 INFO:journalctl@ceph.osd.0.smithi087.stdout:May 08 05:19:17 smithi087 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-0[44115]: 2024-05-08T05:19:17.157+0000 7f7f3ca00700 -1 osd.0 0 waiting for initial osdmap 2024-05-08T05:19:17.460 INFO:journalctl@ceph.osd.0.smithi087.stdout:May 08 05:19:17 smithi087 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-0[44115]: 2024-05-08T05:19:17.207+0000 7f7f32800700 -1 osd.0 7 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-08T05:19:17.483 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:19:17 smithi090 ceph-mon[34526]: from='osd.0 ' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi087", "root=default"]}]': finished 2024-05-08T05:19:17.484 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:19:17 smithi090 ceph-mon[34526]: osdmap e7: 1 total, 0 up, 1 in 2024-05-08T05:19:17.484 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:19:17 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-05-08T05:19:17.484 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:19:17 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-05-08T05:19:17.539 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:19:17 smithi160 ceph-mon[34827]: from='osd.0 ' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi087", "root=default"]}]': finished 2024-05-08T05:19:17.539 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:19:17 smithi160 ceph-mon[34827]: osdmap e7: 1 total, 0 up, 1 in 2024-05-08T05:19:17.539 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:19:17 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-05-08T05:19:17.539 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:19:17 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-05-08T05:19:18.208 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:19:18 smithi087 ceph-mon[29523]: purged_snaps scrub starts 2024-05-08T05:19:18.209 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:19:18 smithi087 ceph-mon[29523]: purged_snaps scrub ok 2024-05-08T05:19:18.209 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:19:18 smithi087 ceph-mon[29523]: pgmap v54: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-08T05:19:18.209 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:19:18 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-05-08T05:19:18.209 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:19:18 smithi087 ceph-mon[29523]: from='osd.0 ' entity='osd.0' 2024-05-08T05:19:18.209 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:19:18 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-05-08T05:19:18.298 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:19:18 smithi090 ceph-mon[34526]: purged_snaps scrub starts 2024-05-08T05:19:18.299 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:19:18 smithi090 ceph-mon[34526]: purged_snaps scrub ok 2024-05-08T05:19:18.299 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:19:18 smithi090 ceph-mon[34526]: pgmap v54: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-08T05:19:18.299 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:19:18 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-05-08T05:19:18.299 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:19:18 smithi090 ceph-mon[34526]: from='osd.0 ' entity='osd.0' 2024-05-08T05:19:18.299 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:19:18 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-05-08T05:19:18.539 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:19:18 smithi160 ceph-mon[34827]: purged_snaps scrub starts 2024-05-08T05:19:18.539 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:19:18 smithi160 ceph-mon[34827]: purged_snaps scrub ok 2024-05-08T05:19:18.539 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:19:18 smithi160 ceph-mon[34827]: pgmap v54: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-08T05:19:18.539 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:19:18 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-05-08T05:19:18.539 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:19:18 smithi160 ceph-mon[34827]: from='osd.0 ' entity='osd.0' 2024-05-08T05:19:18.539 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:19:18 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-05-08T05:19:18.604 INFO:teuthology.orchestra.run.smithi090.stderr:--> Zapping: /dev/vg_nvme/lv_4 2024-05-08T05:19:18.604 INFO:teuthology.orchestra.run.smithi090.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_4 bs=1M count=10 conv=fsync 2024-05-08T05:19:18.604 INFO:teuthology.orchestra.run.smithi090.stderr: stderr: 10+0 records in 2024-05-08T05:19:18.604 INFO:teuthology.orchestra.run.smithi090.stderr:10+0 records out 2024-05-08T05:19:18.604 INFO:teuthology.orchestra.run.smithi090.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0116014 s, 904 MB/s 2024-05-08T05:19:18.605 INFO:teuthology.orchestra.run.smithi090.stderr:--> Zapping successful for: 2024-05-08T05:19:19.195 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:19:19 smithi090 ceph-mon[34526]: osd.0 [v2:172.21.15.87:6802/2285285644,v1:172.21.15.87:6803/2285285644] boot 2024-05-08T05:19:19.195 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:19:19 smithi090 ceph-mon[34526]: osdmap e8: 1 total, 1 up, 1 in 2024-05-08T05:19:19.195 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:19:19 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-05-08T05:19:19.221 DEBUG:teuthology.orchestra.run.smithi090:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid eeeb813e-0cf9-11ef-bc97-c7b262605968 -- ceph orch daemon add osd smithi090:vg_nvme/lv_4 2024-05-08T05:19:19.451 INFO:teuthology.orchestra.run.smithi090.stderr:Inferring config /var/lib/ceph/eeeb813e-0cf9-11ef-bc97-c7b262605968/mon.b/config 2024-05-08T05:19:19.459 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:19:19 smithi087 ceph-mon[29523]: osd.0 [v2:172.21.15.87:6802/2285285644,v1:172.21.15.87:6803/2285285644] boot 2024-05-08T05:19:19.459 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:19:19 smithi087 ceph-mon[29523]: osdmap e8: 1 total, 1 up, 1 in 2024-05-08T05:19:19.459 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:19:19 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-05-08T05:19:19.539 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:19:19 smithi160 ceph-mon[34827]: osd.0 [v2:172.21.15.87:6802/2285285644,v1:172.21.15.87:6803/2285285644] boot 2024-05-08T05:19:19.539 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:19:19 smithi160 ceph-mon[34827]: osdmap e8: 1 total, 1 up, 1 in 2024-05-08T05:19:19.539 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:19:19 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-05-08T05:19:20.458 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:19:20 smithi087 ceph-mon[29523]: pgmap v56: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-08T05:19:20.458 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:19:20 smithi087 ceph-mon[29523]: osdmap e9: 1 total, 1 up, 1 in 2024-05-08T05:19:20.483 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:19:20 smithi090 ceph-mon[34526]: pgmap v56: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-08T05:19:20.483 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:19:20 smithi090 ceph-mon[34526]: osdmap e9: 1 total, 1 up, 1 in 2024-05-08T05:19:20.539 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:19:20 smithi160 ceph-mon[34827]: pgmap v56: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-08T05:19:20.539 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:19:20 smithi160 ceph-mon[34827]: osdmap e9: 1 total, 1 up, 1 in 2024-05-08T05:19:21.041 INFO:teuthology.orchestra.run.smithi090.stderr:2024-05-08T05:19:21.037+0000 7fdb89c0b700 1 -- 172.21.15.90:0/2075297681 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fdb84101bd0 msgr2=0x7fdb84101ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:19:21.041 INFO:teuthology.orchestra.run.smithi090.stderr:2024-05-08T05:19:21.037+0000 7fdb89c0b700 1 --2- 172.21.15.90:0/2075297681 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fdb84101bd0 0x7fdb84101ff0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fdb6c0099c0 tx=0x7fdb6c009cd0 comp rx=0 tx=0).stop 2024-05-08T05:19:21.041 INFO:teuthology.orchestra.run.smithi090.stderr:2024-05-08T05:19:21.037+0000 7fdb89c0b700 1 -- 172.21.15.90:0/2075297681 shutdown_connections 2024-05-08T05:19:21.041 INFO:teuthology.orchestra.run.smithi090.stderr:2024-05-08T05:19:21.037+0000 7fdb89c0b700 1 --2- 172.21.15.90:0/2075297681 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fdb84103770 0x7fdb8410a020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:19:21.041 INFO:teuthology.orchestra.run.smithi090.stderr:2024-05-08T05:19:21.037+0000 7fdb89c0b700 1 --2- 172.21.15.90:0/2075297681 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fdb84101bd0 0x7fdb84101ff0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:19:21.041 INFO:teuthology.orchestra.run.smithi090.stderr:2024-05-08T05:19:21.037+0000 7fdb89c0b700 1 --2- 172.21.15.90:0/2075297681 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fdb84102dd0 0x7fdb84103230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:19:21.041 INFO:teuthology.orchestra.run.smithi090.stderr:2024-05-08T05:19:21.037+0000 7fdb89c0b700 1 -- 172.21.15.90:0/2075297681 >> 172.21.15.90:0/2075297681 conn(0x7fdb840fd170 msgr2=0x7fdb840ff5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:19:21.041 INFO:teuthology.orchestra.run.smithi090.stderr:2024-05-08T05:19:21.037+0000 7fdb89c0b700 1 -- 172.21.15.90:0/2075297681 shutdown_connections 2024-05-08T05:19:21.041 INFO:teuthology.orchestra.run.smithi090.stderr:2024-05-08T05:19:21.037+0000 7fdb89c0b700 1 -- 172.21.15.90:0/2075297681 wait complete. 2024-05-08T05:19:21.041 INFO:teuthology.orchestra.run.smithi090.stderr:2024-05-08T05:19:21.038+0000 7fdb89c0b700 1 Processor -- start 2024-05-08T05:19:21.041 INFO:teuthology.orchestra.run.smithi090.stderr:2024-05-08T05:19:21.038+0000 7fdb89c0b700 1 -- start start 2024-05-08T05:19:21.042 INFO:teuthology.orchestra.run.smithi090.stderr:2024-05-08T05:19:21.038+0000 7fdb89c0b700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fdb84101bd0 0x7fdb84199720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:19:21.042 INFO:teuthology.orchestra.run.smithi090.stderr:2024-05-08T05:19:21.038+0000 7fdb89c0b700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fdb84102dd0 0x7fdb84199c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:19:21.042 INFO:teuthology.orchestra.run.smithi090.stderr:2024-05-08T05:19:21.038+0000 7fdb89c0b700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fdb84103770 0x7fdb841a0c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:19:21.042 INFO:teuthology.orchestra.run.smithi090.stderr:2024-05-08T05:19:21.038+0000 7fdb89c0b700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fdb8410df50 con 0x7fdb84103770 2024-05-08T05:19:21.042 INFO:teuthology.orchestra.run.smithi090.stderr:2024-05-08T05:19:21.038+0000 7fdb89c0b700 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fdb8410ddd0 con 0x7fdb84101bd0 2024-05-08T05:19:21.042 INFO:teuthology.orchestra.run.smithi090.stderr:2024-05-08T05:19:21.038+0000 7fdb89c0b700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7fdb8410e0d0 con 0x7fdb84102dd0 2024-05-08T05:19:21.042 INFO:teuthology.orchestra.run.smithi090.stderr:2024-05-08T05:19:21.038+0000 7fdb837fe700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fdb84101bd0 0x7fdb84199720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:19:21.042 INFO:teuthology.orchestra.run.smithi090.stderr:2024-05-08T05:19:21.038+0000 7fdb837fe700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fdb84101bd0 0x7fdb84199720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:45474/0 (socket says 172.21.15.90:45474) 2024-05-08T05:19:21.042 INFO:teuthology.orchestra.run.smithi090.stderr:2024-05-08T05:19:21.038+0000 7fdb837fe700 1 -- 172.21.15.90:0/3545904308 learned_addr learned my addr 172.21.15.90:0/3545904308 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-05-08T05:19:21.042 INFO:teuthology.orchestra.run.smithi090.stderr:2024-05-08T05:19:21.039+0000 7fdb82ffd700 1 --2- 172.21.15.90:0/3545904308 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fdb84102dd0 0x7fdb84199c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:19:21.042 INFO:teuthology.orchestra.run.smithi090.stderr:2024-05-08T05:19:21.039+0000 7fdb837fe700 1 -- 172.21.15.90:0/3545904308 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fdb84102dd0 msgr2=0x7fdb84199c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:19:21.042 INFO:teuthology.orchestra.run.smithi090.stderr:2024-05-08T05:19:21.039+0000 7fdb837fe700 1 --2- 172.21.15.90:0/3545904308 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fdb84102dd0 0x7fdb84199c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:19:21.042 INFO:teuthology.orchestra.run.smithi090.stderr:2024-05-08T05:19:21.039+0000 7fdb837fe700 1 -- 172.21.15.90:0/3545904308 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fdb84103770 msgr2=0x7fdb841a0c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:19:21.042 INFO:teuthology.orchestra.run.smithi090.stderr:2024-05-08T05:19:21.039+0000 7fdb837fe700 1 --2- 172.21.15.90:0/3545904308 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fdb84103770 0x7fdb841a0c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:19:21.043 INFO:teuthology.orchestra.run.smithi090.stderr:2024-05-08T05:19:21.039+0000 7fdb837fe700 1 -- 172.21.15.90:0/3545904308 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdb841a1330 con 0x7fdb84101bd0 2024-05-08T05:19:21.043 INFO:teuthology.orchestra.run.smithi090.stderr:2024-05-08T05:19:21.039+0000 7fdb837fe700 1 --2- 172.21.15.90:0/3545904308 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fdb84101bd0 0x7fdb84199720 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fdb6c0038c0 tx=0x7fdb6c0047b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:19:21.043 INFO:teuthology.orchestra.run.smithi090.stderr:2024-05-08T05:19:21.039+0000 7fdb80ff9700 1 -- 172.21.15.90:0/3545904308 <== mon.2 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb6c027070 con 0x7fdb84101bd0 2024-05-08T05:19:21.043 INFO:teuthology.orchestra.run.smithi090.stderr:2024-05-08T05:19:21.039+0000 7fdb80ff9700 1 -- 172.21.15.90:0/3545904308 <== mon.2 v2:172.21.15.90:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fdb6c004160 con 0x7fdb84101bd0 2024-05-08T05:19:21.043 INFO:teuthology.orchestra.run.smithi090.stderr:2024-05-08T05:19:21.039+0000 7fdb80ff9700 1 -- 172.21.15.90:0/3545904308 <== mon.2 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb6c022e50 con 0x7fdb84101bd0 2024-05-08T05:19:21.043 INFO:teuthology.orchestra.run.smithi090.stderr:2024-05-08T05:19:21.039+0000 7fdb89c0b700 1 -- 172.21.15.90:0/3545904308 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdb841a15c0 con 0x7fdb84101bd0 2024-05-08T05:19:21.043 INFO:teuthology.orchestra.run.smithi090.stderr:2024-05-08T05:19:21.039+0000 7fdb89c0b700 1 -- 172.21.15.90:0/3545904308 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdb841a1aa0 con 0x7fdb84101bd0 2024-05-08T05:19:21.043 INFO:teuthology.orchestra.run.smithi090.stderr:2024-05-08T05:19:21.040+0000 7fdb89c0b700 1 -- 172.21.15.90:0/3545904308 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdb8406a190 con 0x7fdb84101bd0 2024-05-08T05:19:21.044 INFO:teuthology.orchestra.run.smithi090.stderr:2024-05-08T05:19:21.041+0000 7fdb80ff9700 1 -- 172.21.15.90:0/3545904308 <== mon.2 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 15) ==== 149596+0+0 (secure 0 0 0) 0x7fdb6c02a070 con 0x7fdb84101bd0 2024-05-08T05:19:21.044 INFO:teuthology.orchestra.run.smithi090.stderr:2024-05-08T05:19:21.042+0000 7fdb80ff9700 1 --2- 172.21.15.90:0/3545904308 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7fdb700b2a10 0x7fdb700b4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:19:21.044 INFO:teuthology.orchestra.run.smithi090.stderr:2024-05-08T05:19:21.042+0000 7fdb80ff9700 1 -- 172.21.15.90:0/3545904308 <== mon.2 v2:172.21.15.90:3300/0 5 ==== osd_map(9..9 src has 1..9) ==== 1767+0+0 (secure 0 0 0) 0x7fdb6c0e15a0 con 0x7fdb84101bd0 2024-05-08T05:19:21.044 INFO:teuthology.orchestra.run.smithi090.stderr:2024-05-08T05:19:21.043+0000 7fdb82ffd700 1 --2- 172.21.15.90:0/3545904308 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7fdb700b2a10 0x7fdb700b4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:19:21.044 INFO:teuthology.orchestra.run.smithi090.stderr:2024-05-08T05:19:21.044+0000 7fdb82ffd700 1 --2- 172.21.15.90:0/3545904308 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7fdb700b2a10 0x7fdb700b4ed0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fdb74005950 tx=0x7fdb7400b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:19:21.047 INFO:teuthology.orchestra.run.smithi090.stderr:2024-05-08T05:19:21.046+0000 7fdb80ff9700 1 -- 172.21.15.90:0/3545904308 <== mon.2 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7fdb6c013070 con 0x7fdb84101bd0 2024-05-08T05:19:21.259 INFO:teuthology.orchestra.run.smithi090.stderr:2024-05-08T05:19:21.258+0000 7fdb89c0b700 1 -- 172.21.15.90:0/3545904308 --> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi090:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) -- 0x7fdb840ff310 con 0x7fdb700b2a10 2024-05-08T05:19:22.484 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:19:22 smithi090 ceph-mon[34526]: pgmap v58: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-05-08T05:19:22.484 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:19:22 smithi090 ceph-mon[34526]: Detected new or changed devices on smithi087 2024-05-08T05:19:22.484 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:19:22 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:19:22.484 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:19:22 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:19:22.484 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:19:22 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-05-08T05:19:22.484 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:19:22 smithi090 ceph-mon[34526]: Adjusting osd_memory_target on smithi087 to 17089M 2024-05-08T05:19:22.484 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:19:22 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:19:22.485 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:19:22 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T05:19:22.485 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:19:22 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T05:19:22.485 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:19:22 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:19:22.485 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:19:22 smithi090 ceph-mon[34526]: from='client.24143 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi090:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-05-08T05:19:22.485 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:19:22 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-08T05:19:22.485 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:19:22 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-08T05:19:22.485 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:19:22 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T05:19:22.539 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:19:22 smithi160 ceph-mon[34827]: pgmap v58: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-05-08T05:19:22.539 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:19:22 smithi160 ceph-mon[34827]: Detected new or changed devices on smithi087 2024-05-08T05:19:22.539 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:19:22 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:19:22.539 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:19:22 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:19:22.539 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:19:22 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-05-08T05:19:22.539 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:19:22 smithi160 ceph-mon[34827]: Adjusting osd_memory_target on smithi087 to 17089M 2024-05-08T05:19:22.540 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:19:22 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:19:22.540 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:19:22 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T05:19:22.540 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:19:22 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T05:19:22.540 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:19:22 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:19:22.540 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:19:22 smithi160 ceph-mon[34827]: from='client.24143 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi090:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-05-08T05:19:22.540 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:19:22 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-08T05:19:22.540 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:19:22 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-08T05:19:22.540 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:19:22 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T05:19:22.709 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:19:22 smithi087 ceph-mon[29523]: pgmap v58: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-05-08T05:19:22.709 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:19:22 smithi087 ceph-mon[29523]: Detected new or changed devices on smithi087 2024-05-08T05:19:22.709 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:19:22 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:19:22.709 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:19:22 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:19:22.709 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:19:22 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-05-08T05:19:22.709 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:19:22 smithi087 ceph-mon[29523]: Adjusting osd_memory_target on smithi087 to 17089M 2024-05-08T05:19:22.709 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:19:22 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:19:22.709 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:19:22 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T05:19:22.709 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:19:22 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T05:19:22.710 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:19:22 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:19:22.710 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:19:22 smithi087 ceph-mon[29523]: from='client.24143 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi090:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-05-08T05:19:22.710 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:19:22 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-08T05:19:22.710 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:19:22 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-08T05:19:22.710 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:19:22 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T05:19:24.483 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:19:24 smithi090 ceph-mon[34526]: pgmap v59: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-05-08T05:19:24.484 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:19:24 smithi090 ceph-mon[34526]: from='client.? 172.21.15.90:0/1922414555' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "b6de5f4c-1d79-41ff-adee-03d8a47ab55e"}]: dispatch 2024-05-08T05:19:24.484 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:19:24 smithi090 ceph-mon[34526]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "b6de5f4c-1d79-41ff-adee-03d8a47ab55e"}]: dispatch 2024-05-08T05:19:24.484 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:19:24 smithi090 ceph-mon[34526]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "b6de5f4c-1d79-41ff-adee-03d8a47ab55e"}]': finished 2024-05-08T05:19:24.484 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:19:24 smithi090 ceph-mon[34526]: osdmap e10: 2 total, 1 up, 2 in 2024-05-08T05:19:24.484 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:19:24 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-05-08T05:19:24.512 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:19:24 smithi087 ceph-mon[29523]: pgmap v59: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-05-08T05:19:24.512 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:19:24 smithi087 ceph-mon[29523]: from='client.? 172.21.15.90:0/1922414555' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "b6de5f4c-1d79-41ff-adee-03d8a47ab55e"}]: dispatch 2024-05-08T05:19:24.512 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:19:24 smithi087 ceph-mon[29523]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "b6de5f4c-1d79-41ff-adee-03d8a47ab55e"}]: dispatch 2024-05-08T05:19:24.512 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:19:24 smithi087 ceph-mon[29523]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "b6de5f4c-1d79-41ff-adee-03d8a47ab55e"}]': finished 2024-05-08T05:19:24.512 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:19:24 smithi087 ceph-mon[29523]: osdmap e10: 2 total, 1 up, 2 in 2024-05-08T05:19:24.512 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:19:24 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-05-08T05:19:24.538 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:19:24 smithi160 ceph-mon[34827]: pgmap v59: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-05-08T05:19:24.539 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:19:24 smithi160 ceph-mon[34827]: from='client.? 172.21.15.90:0/1922414555' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "b6de5f4c-1d79-41ff-adee-03d8a47ab55e"}]: dispatch 2024-05-08T05:19:24.539 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:19:24 smithi160 ceph-mon[34827]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "b6de5f4c-1d79-41ff-adee-03d8a47ab55e"}]: dispatch 2024-05-08T05:19:24.539 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:19:24 smithi160 ceph-mon[34827]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "b6de5f4c-1d79-41ff-adee-03d8a47ab55e"}]': finished 2024-05-08T05:19:24.539 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:19:24 smithi160 ceph-mon[34827]: osdmap e10: 2 total, 1 up, 2 in 2024-05-08T05:19:24.539 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:19:24 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-05-08T05:19:25.539 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:19:25 smithi160 ceph-mon[34827]: from='client.? 172.21.15.90:0/383262495' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-08T05:19:25.708 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:19:25 smithi087 ceph-mon[29523]: from='client.? 172.21.15.90:0/383262495' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-08T05:19:25.733 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:19:25 smithi090 ceph-mon[34526]: from='client.? 172.21.15.90:0/383262495' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-08T05:19:26.458 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:19:26 smithi087 ceph-mon[29523]: pgmap v61: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-05-08T05:19:26.538 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:19:26 smithi160 ceph-mon[34827]: pgmap v61: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-05-08T05:19:26.733 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:19:26 smithi090 ceph-mon[34526]: pgmap v61: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-05-08T05:19:28.484 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:19:28 smithi090 ceph-mon[34526]: pgmap v62: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-05-08T05:19:28.538 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:19:28 smithi160 ceph-mon[34827]: pgmap v62: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-05-08T05:19:28.708 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:19:28 smithi087 ceph-mon[29523]: pgmap v62: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-05-08T05:19:30.497 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:19:30 smithi090 ceph-mon[34526]: pgmap v63: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-05-08T05:19:30.538 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:19:30 smithi160 ceph-mon[34827]: pgmap v63: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-05-08T05:19:30.708 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:19:30 smithi087 ceph-mon[29523]: pgmap v63: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-05-08T05:19:32.539 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:19:32 smithi160 ceph-mon[34827]: pgmap v64: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-05-08T05:19:32.539 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:19:32 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-05-08T05:19:32.539 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:19:32 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T05:19:32.558 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:19:32 smithi090 ceph-mon[34526]: pgmap v64: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-05-08T05:19:32.559 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:19:32 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-05-08T05:19:32.559 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:19:32 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T05:19:32.708 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:19:32 smithi087 ceph-mon[29523]: pgmap v64: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-05-08T05:19:32.708 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:19:32 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-05-08T05:19:32.709 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:19:32 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T05:19:33.517 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:19:33 smithi090 ceph-mon[34526]: Deploying daemon osd.1 on smithi090 2024-05-08T05:19:33.538 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:19:33 smithi160 ceph-mon[34827]: Deploying daemon osd.1 on smithi090 2024-05-08T05:19:33.708 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:19:33 smithi087 ceph-mon[29523]: Deploying daemon osd.1 on smithi090 2024-05-08T05:19:34.525 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:19:34 smithi090 ceph-mon[34526]: pgmap v65: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-05-08T05:19:34.538 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:19:34 smithi160 ceph-mon[34827]: pgmap v65: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-05-08T05:19:34.708 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:19:34 smithi087 ceph-mon[29523]: pgmap v65: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-05-08T05:19:36.538 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:19:36 smithi160 ceph-mon[34827]: pgmap v66: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-05-08T05:19:36.576 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:19:36 smithi090 ceph-mon[34526]: pgmap v66: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-05-08T05:19:36.708 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:19:36 smithi087 ceph-mon[29523]: pgmap v66: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-05-08T05:19:38.458 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:19:38 smithi087 ceph-mon[29523]: pgmap v67: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-05-08T05:19:38.459 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:19:38 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:19:38.459 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:19:38 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:19:38.459 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:19:38 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T05:19:38.483 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:19:38 smithi090 ceph-mon[34526]: pgmap v67: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-05-08T05:19:38.483 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:19:38 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:19:38.483 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:19:38 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:19:38.483 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:19:38 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T05:19:38.539 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:19:38 smithi160 ceph-mon[34827]: pgmap v67: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-05-08T05:19:38.539 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:19:38 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:19:38.539 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:19:38 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:19:38.539 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:19:38 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T05:19:40.659 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:19:40 smithi090 ceph-mon[34526]: pgmap v68: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-05-08T05:19:40.659 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:19:40 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:19:40.660 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:19:40 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:19:40.660 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:19:40 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T05:19:40.660 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:19:40 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T05:19:40.660 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:19:40 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:19:40.708 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:19:40 smithi087 ceph-mon[29523]: pgmap v68: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-05-08T05:19:40.709 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:19:40 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:19:40.709 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:19:40 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:19:40.709 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:19:40 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T05:19:40.709 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:19:40 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T05:19:40.709 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:19:40 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:19:40.760 INFO:teuthology.orchestra.run.smithi090.stderr:2024-05-08T05:19:40.760+0000 7fdb80ff9700 1 -- 172.21.15.90:0/3545904308 <== mgr.14152 v2:172.21.15.87:6800/1189186457 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7fdb840ff310 con 0x7fdb700b2a10 2024-05-08T05:19:40.760 INFO:teuthology.orchestra.run.smithi090.stdout:Created osd(s) 1 on host 'smithi090' 2024-05-08T05:19:40.762 INFO:teuthology.orchestra.run.smithi090.stderr:2024-05-08T05:19:40.762+0000 7fdb89c0b700 1 -- 172.21.15.90:0/3545904308 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7fdb700b2a10 msgr2=0x7fdb700b4ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:19:40.762 INFO:teuthology.orchestra.run.smithi090.stderr:2024-05-08T05:19:40.762+0000 7fdb89c0b700 1 --2- 172.21.15.90:0/3545904308 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7fdb700b2a10 0x7fdb700b4ed0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fdb74005950 tx=0x7fdb7400b410 comp rx=0 tx=0).stop 2024-05-08T05:19:40.762 INFO:teuthology.orchestra.run.smithi090.stderr:2024-05-08T05:19:40.762+0000 7fdb89c0b700 1 -- 172.21.15.90:0/3545904308 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fdb84101bd0 msgr2=0x7fdb84199720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:19:40.763 INFO:teuthology.orchestra.run.smithi090.stderr:2024-05-08T05:19:40.762+0000 7fdb89c0b700 1 --2- 172.21.15.90:0/3545904308 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fdb84101bd0 0x7fdb84199720 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fdb6c0038c0 tx=0x7fdb6c0047b0 comp rx=0 tx=0).stop 2024-05-08T05:19:40.763 INFO:teuthology.orchestra.run.smithi090.stderr:2024-05-08T05:19:40.762+0000 7fdb89c0b700 1 -- 172.21.15.90:0/3545904308 shutdown_connections 2024-05-08T05:19:40.763 INFO:teuthology.orchestra.run.smithi090.stderr:2024-05-08T05:19:40.762+0000 7fdb89c0b700 1 --2- 172.21.15.90:0/3545904308 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fdb84103770 0x7fdb841a0c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:19:40.763 INFO:teuthology.orchestra.run.smithi090.stderr:2024-05-08T05:19:40.762+0000 7fdb89c0b700 1 --2- 172.21.15.90:0/3545904308 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fdb84101bd0 0x7fdb84199720 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:19:40.763 INFO:teuthology.orchestra.run.smithi090.stderr:2024-05-08T05:19:40.762+0000 7fdb89c0b700 1 --2- 172.21.15.90:0/3545904308 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7fdb700b2a10 0x7fdb700b4ed0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:19:40.763 INFO:teuthology.orchestra.run.smithi090.stderr:2024-05-08T05:19:40.762+0000 7fdb89c0b700 1 --2- 172.21.15.90:0/3545904308 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fdb84102dd0 0x7fdb84199c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:19:40.763 INFO:teuthology.orchestra.run.smithi090.stderr:2024-05-08T05:19:40.762+0000 7fdb89c0b700 1 -- 172.21.15.90:0/3545904308 >> 172.21.15.90:0/3545904308 conn(0x7fdb840fd170 msgr2=0x7fdb840fec00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:19:40.763 INFO:teuthology.orchestra.run.smithi090.stderr:2024-05-08T05:19:40.762+0000 7fdb89c0b700 1 -- 172.21.15.90:0/3545904308 shutdown_connections 2024-05-08T05:19:40.763 INFO:teuthology.orchestra.run.smithi090.stderr:2024-05-08T05:19:40.762+0000 7fdb89c0b700 1 -- 172.21.15.90:0/3545904308 wait complete. 2024-05-08T05:19:40.789 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:19:40 smithi160 ceph-mon[34827]: pgmap v68: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-05-08T05:19:40.789 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:19:40 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:19:40.789 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:19:40 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:19:40.789 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:19:40 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T05:19:40.789 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:19:40 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T05:19:40.789 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:19:40 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:19:41.357 DEBUG:teuthology.orchestra.run.smithi090:osd.1> sudo journalctl -f -n 0 -u ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968@osd.1.service 2024-05-08T05:19:41.360 INFO:tasks.cephadm:Deploying osd.2 on smithi160 with /dev/vg_nvme/lv_4... 2024-05-08T05:19:41.360 DEBUG:teuthology.orchestra.run.smithi160:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid eeeb813e-0cf9-11ef-bc97-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_4 2024-05-08T05:19:41.602 INFO:teuthology.orchestra.run.smithi160.stderr:Inferring config /var/lib/ceph/eeeb813e-0cf9-11ef-bc97-c7b262605968/mon.c/config 2024-05-08T05:19:41.958 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:19:41 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:19:41.959 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:19:41 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:19:41.959 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:19:41 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T05:19:41.959 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:19:41 smithi087 ceph-mon[29523]: pgmap v69: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-05-08T05:19:41.959 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:19:41 smithi087 ceph-mon[29523]: from='osd.1 [v2:172.21.15.90:6800/1681573998,v1:172.21.15.90:6801/1681573998]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-05-08T05:19:41.959 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:19:41 smithi087 ceph-mon[29523]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-05-08T05:19:41.983 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:19:41 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:19:41.983 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:19:41 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:19:41.983 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:19:41 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T05:19:41.983 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:19:41 smithi090 ceph-mon[34526]: pgmap v69: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-05-08T05:19:41.984 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:19:41 smithi090 ceph-mon[34526]: from='osd.1 [v2:172.21.15.90:6800/1681573998,v1:172.21.15.90:6801/1681573998]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-05-08T05:19:41.984 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:19:41 smithi090 ceph-mon[34526]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-05-08T05:19:42.010 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:19:41 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:19:42.010 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:19:41 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:19:42.010 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:19:41 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T05:19:42.010 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:19:41 smithi160 ceph-mon[34827]: pgmap v69: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-05-08T05:19:42.010 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:19:41 smithi160 ceph-mon[34827]: from='osd.1 [v2:172.21.15.90:6800/1681573998,v1:172.21.15.90:6801/1681573998]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-05-08T05:19:42.010 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:19:41 smithi160 ceph-mon[34827]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-05-08T05:19:42.977 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:19:42 smithi090 ceph-mon[34526]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-05-08T05:19:42.977 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:19:42 smithi090 ceph-mon[34526]: osdmap e11: 2 total, 1 up, 2 in 2024-05-08T05:19:42.977 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:19:42 smithi090 ceph-mon[34526]: from='osd.1 [v2:172.21.15.90:6800/1681573998,v1:172.21.15.90:6801/1681573998]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi090", "root=default"]}]: dispatch 2024-05-08T05:19:42.978 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:19:42 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-05-08T05:19:42.978 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:19:42 smithi090 ceph-mon[34526]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi090", "root=default"]}]: dispatch 2024-05-08T05:19:42.978 INFO:journalctl@ceph.osd.1.smithi090.stdout:May 08 05:19:42 smithi090 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-1[39118]: 2024-05-08T05:19:42.726+0000 7f18936be700 -1 osd.1 0 waiting for initial osdmap 2024-05-08T05:19:42.978 INFO:journalctl@ceph.osd.1.smithi090.stdout:May 08 05:19:42 smithi090 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-1[39118]: 2024-05-08T05:19:42.738+0000 7f188f4b1700 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-08T05:19:43.039 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:19:42 smithi160 ceph-mon[34827]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-05-08T05:19:43.039 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:19:42 smithi160 ceph-mon[34827]: osdmap e11: 2 total, 1 up, 2 in 2024-05-08T05:19:43.039 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:19:42 smithi160 ceph-mon[34827]: from='osd.1 [v2:172.21.15.90:6800/1681573998,v1:172.21.15.90:6801/1681573998]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi090", "root=default"]}]: dispatch 2024-05-08T05:19:43.039 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:19:42 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-05-08T05:19:43.039 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:19:42 smithi160 ceph-mon[34827]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi090", "root=default"]}]: dispatch 2024-05-08T05:19:43.209 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:19:42 smithi087 ceph-mon[29523]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-05-08T05:19:43.209 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:19:42 smithi087 ceph-mon[29523]: osdmap e11: 2 total, 1 up, 2 in 2024-05-08T05:19:43.209 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:19:42 smithi087 ceph-mon[29523]: from='osd.1 [v2:172.21.15.90:6800/1681573998,v1:172.21.15.90:6801/1681573998]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi090", "root=default"]}]: dispatch 2024-05-08T05:19:43.209 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:19:42 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-05-08T05:19:43.209 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:19:42 smithi087 ceph-mon[29523]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi090", "root=default"]}]: dispatch 2024-05-08T05:19:43.599 INFO:teuthology.orchestra.run.smithi160.stderr:--> Zapping: /dev/vg_nvme/lv_4 2024-05-08T05:19:43.599 INFO:teuthology.orchestra.run.smithi160.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_4 bs=1M count=10 conv=fsync 2024-05-08T05:19:43.599 INFO:teuthology.orchestra.run.smithi160.stderr: stderr: 10+0 records in 2024-05-08T05:19:43.599 INFO:teuthology.orchestra.run.smithi160.stderr:10+0 records out 2024-05-08T05:19:43.600 INFO:teuthology.orchestra.run.smithi160.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0112475 s, 932 MB/s 2024-05-08T05:19:43.600 INFO:teuthology.orchestra.run.smithi160.stderr:--> Zapping successful for: 2024-05-08T05:19:43.864 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:19:43 smithi090 ceph-mon[34526]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi090", "root=default"]}]': finished 2024-05-08T05:19:43.865 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:19:43 smithi090 ceph-mon[34526]: osdmap e12: 2 total, 1 up, 2 in 2024-05-08T05:19:43.865 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:19:43 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-05-08T05:19:43.865 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:19:43 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-05-08T05:19:43.865 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:19:43 smithi090 ceph-mon[34526]: pgmap v72: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-05-08T05:19:43.869 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:19:43 smithi160 ceph-mon[34827]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi090", "root=default"]}]': finished 2024-05-08T05:19:43.869 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:19:43 smithi160 ceph-mon[34827]: osdmap e12: 2 total, 1 up, 2 in 2024-05-08T05:19:43.869 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:19:43 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-05-08T05:19:43.869 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:19:43 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-05-08T05:19:43.870 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:19:43 smithi160 ceph-mon[34827]: pgmap v72: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-05-08T05:19:44.163 DEBUG:teuthology.orchestra.run.smithi160:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid eeeb813e-0cf9-11ef-bc97-c7b262605968 -- ceph orch daemon add osd smithi160:vg_nvme/lv_4 2024-05-08T05:19:44.208 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:19:43 smithi087 ceph-mon[29523]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi090", "root=default"]}]': finished 2024-05-08T05:19:44.208 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:19:43 smithi087 ceph-mon[29523]: osdmap e12: 2 total, 1 up, 2 in 2024-05-08T05:19:44.208 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:19:43 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-05-08T05:19:44.208 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:19:43 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-05-08T05:19:44.208 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:19:43 smithi087 ceph-mon[29523]: pgmap v72: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-05-08T05:19:44.395 INFO:teuthology.orchestra.run.smithi160.stderr:Inferring config /var/lib/ceph/eeeb813e-0cf9-11ef-bc97-c7b262605968/mon.c/config 2024-05-08T05:19:44.789 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:19:44 smithi160 ceph-mon[34827]: purged_snaps scrub starts 2024-05-08T05:19:44.789 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:19:44 smithi160 ceph-mon[34827]: purged_snaps scrub ok 2024-05-08T05:19:44.789 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:19:44 smithi160 ceph-mon[34827]: osd.1 [v2:172.21.15.90:6800/1681573998,v1:172.21.15.90:6801/1681573998] boot 2024-05-08T05:19:44.789 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:19:44 smithi160 ceph-mon[34827]: osdmap e13: 2 total, 2 up, 2 in 2024-05-08T05:19:44.789 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:19:44 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-05-08T05:19:44.789 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:19:44 smithi160 ceph-mon[34827]: Detected new or changed devices on smithi090 2024-05-08T05:19:44.789 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:19:44 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:19:44.789 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:19:44 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:19:44.789 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:19:44 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-05-08T05:19:44.790 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:19:44 smithi160 ceph-mon[34827]: Adjusting osd_memory_target on smithi090 to 17088M 2024-05-08T05:19:44.790 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:19:44 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:19:44.790 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:19:44 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T05:19:44.790 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:19:44 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T05:19:44.790 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:19:44 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:19:45.209 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:19:44 smithi087 ceph-mon[29523]: purged_snaps scrub starts 2024-05-08T05:19:45.209 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:19:44 smithi087 ceph-mon[29523]: purged_snaps scrub ok 2024-05-08T05:19:45.209 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:19:44 smithi087 ceph-mon[29523]: osd.1 [v2:172.21.15.90:6800/1681573998,v1:172.21.15.90:6801/1681573998] boot 2024-05-08T05:19:45.209 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:19:44 smithi087 ceph-mon[29523]: osdmap e13: 2 total, 2 up, 2 in 2024-05-08T05:19:45.209 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:19:44 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-05-08T05:19:45.209 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:19:44 smithi087 ceph-mon[29523]: Detected new or changed devices on smithi090 2024-05-08T05:19:45.209 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:19:44 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:19:45.209 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:19:44 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:19:45.209 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:19:44 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-05-08T05:19:45.209 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:19:44 smithi087 ceph-mon[29523]: Adjusting osd_memory_target on smithi090 to 17088M 2024-05-08T05:19:45.209 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:19:44 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:19:45.209 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:19:44 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T05:19:45.210 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:19:44 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T05:19:45.210 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:19:44 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:19:45.233 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:19:44 smithi090 ceph-mon[34526]: purged_snaps scrub starts 2024-05-08T05:19:45.233 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:19:44 smithi090 ceph-mon[34526]: purged_snaps scrub ok 2024-05-08T05:19:45.234 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:19:44 smithi090 ceph-mon[34526]: osd.1 [v2:172.21.15.90:6800/1681573998,v1:172.21.15.90:6801/1681573998] boot 2024-05-08T05:19:45.234 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:19:44 smithi090 ceph-mon[34526]: osdmap e13: 2 total, 2 up, 2 in 2024-05-08T05:19:45.234 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:19:44 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-05-08T05:19:45.234 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:19:44 smithi090 ceph-mon[34526]: Detected new or changed devices on smithi090 2024-05-08T05:19:45.234 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:19:44 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:19:45.234 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:19:44 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:19:45.234 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:19:44 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-05-08T05:19:45.234 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:19:44 smithi090 ceph-mon[34526]: Adjusting osd_memory_target on smithi090 to 17088M 2024-05-08T05:19:45.234 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:19:44 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:19:45.234 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:19:44 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T05:19:45.234 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:19:44 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T05:19:45.234 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:19:44 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:19:45.782 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:19:45 smithi090 ceph-mon[34526]: osdmap e14: 2 total, 2 up, 2 in 2024-05-08T05:19:45.782 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:19:45 smithi090 ceph-mon[34526]: pgmap v75: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-05-08T05:19:45.992 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-08T05:19:45.989+0000 7f9dc8272700 1 -- 172.21.15.160:0/1721085261 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f9dc0103f90 msgr2=0x7f9dc010a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:19:45.992 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-08T05:19:45.989+0000 7f9dc8272700 1 --2- 172.21.15.160:0/1721085261 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f9dc0103f90 0x7f9dc010a840 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f9db800b0a0 tx=0x7f9db800b3b0 comp rx=0 tx=0).stop 2024-05-08T05:19:45.992 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-08T05:19:45.989+0000 7f9dc8272700 1 -- 172.21.15.160:0/1721085261 shutdown_connections 2024-05-08T05:19:45.992 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-08T05:19:45.989+0000 7f9dc8272700 1 --2- 172.21.15.160:0/1721085261 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f9dc0103f90 0x7f9dc010a840 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:19:45.992 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-08T05:19:45.989+0000 7f9dc8272700 1 --2- 172.21.15.160:0/1721085261 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9dc01023f0 0x7f9dc0102810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:19:45.992 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-08T05:19:45.989+0000 7f9dc8272700 1 --2- 172.21.15.160:0/1721085261 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9dc01035f0 0x7f9dc0103a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:19:45.992 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-08T05:19:45.989+0000 7f9dc8272700 1 -- 172.21.15.160:0/1721085261 >> 172.21.15.160:0/1721085261 conn(0x7f9dc00fd990 msgr2=0x7f9dc00ffdd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:19:45.992 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-08T05:19:45.989+0000 7f9dc8272700 1 -- 172.21.15.160:0/1721085261 shutdown_connections 2024-05-08T05:19:45.992 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-08T05:19:45.989+0000 7f9dc8272700 1 -- 172.21.15.160:0/1721085261 wait complete. 2024-05-08T05:19:45.993 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-08T05:19:45.990+0000 7f9dc8272700 1 Processor -- start 2024-05-08T05:19:45.993 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-08T05:19:45.990+0000 7f9dc8272700 1 -- start start 2024-05-08T05:19:45.993 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-08T05:19:45.990+0000 7f9dc8272700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f9dc01023f0 0x7f9dc01984f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:19:45.993 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-08T05:19:45.990+0000 7f9dc8272700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9dc01035f0 0x7f9dc0198a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:19:45.993 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-08T05:19:45.990+0000 7f9dc8272700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9dc0103f90 0x7f9dc019fab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:19:45.993 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-08T05:19:45.990+0000 7f9dc8272700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f9dc010dee0 con 0x7f9dc0103f90 2024-05-08T05:19:45.993 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-08T05:19:45.990+0000 7f9dc8272700 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f9dc010dd60 con 0x7f9dc01035f0 2024-05-08T05:19:45.993 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-08T05:19:45.990+0000 7f9dc8272700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f9dc010e060 con 0x7f9dc01023f0 2024-05-08T05:19:45.993 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-08T05:19:45.990+0000 7f9dc600e700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f9dc01023f0 0x7f9dc01984f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:19:45.993 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-08T05:19:45.990+0000 7f9dc600e700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f9dc01023f0 0x7f9dc01984f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.160:38668/0 (socket says 172.21.15.160:38668) 2024-05-08T05:19:45.993 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-08T05:19:45.990+0000 7f9dc600e700 1 -- 172.21.15.160:0/3402802400 learned_addr learned my addr 172.21.15.160:0/3402802400 (peer_addr_for_me v2:172.21.15.160:0/0) 2024-05-08T05:19:45.993 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-08T05:19:45.990+0000 7f9dc580d700 1 --2- 172.21.15.160:0/3402802400 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9dc01035f0 0x7f9dc0198a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:19:45.993 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-08T05:19:45.991+0000 7f9dc600e700 1 -- 172.21.15.160:0/3402802400 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9dc01035f0 msgr2=0x7f9dc0198a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:19:45.993 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-08T05:19:45.991+0000 7f9dc600e700 1 --2- 172.21.15.160:0/3402802400 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9dc01035f0 0x7f9dc0198a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:19:45.993 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-08T05:19:45.991+0000 7f9dc600e700 1 -- 172.21.15.160:0/3402802400 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9dc0103f90 msgr2=0x7f9dc019fab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:19:45.994 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-08T05:19:45.991+0000 7f9dc600e700 1 --2- 172.21.15.160:0/3402802400 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9dc0103f90 0x7f9dc019fab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:19:45.994 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-08T05:19:45.991+0000 7f9dc600e700 1 -- 172.21.15.160:0/3402802400 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9dc01a0150 con 0x7f9dc01023f0 2024-05-08T05:19:45.994 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-08T05:19:45.991+0000 7f9dc600e700 1 --2- 172.21.15.160:0/3402802400 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f9dc01023f0 0x7f9dc01984f0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f9dbc009920 tx=0x7f9dbc009c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:19:45.994 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-08T05:19:45.991+0000 7f9db77fe700 1 -- 172.21.15.160:0/3402802400 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9dbc00d030 con 0x7f9dc01023f0 2024-05-08T05:19:45.994 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-08T05:19:45.991+0000 7f9db77fe700 1 -- 172.21.15.160:0/3402802400 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9dbc0044d0 con 0x7f9dc01023f0 2024-05-08T05:19:45.994 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-08T05:19:45.991+0000 7f9db77fe700 1 -- 172.21.15.160:0/3402802400 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9dbc003680 con 0x7f9dc01023f0 2024-05-08T05:19:45.994 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-08T05:19:45.991+0000 7f9dc8272700 1 -- 172.21.15.160:0/3402802400 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9dc006bc90 con 0x7f9dc01023f0 2024-05-08T05:19:45.994 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-08T05:19:45.991+0000 7f9dc8272700 1 -- 172.21.15.160:0/3402802400 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9dc006c2a0 con 0x7f9dc01023f0 2024-05-08T05:19:45.995 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-08T05:19:45.992+0000 7f9dc8272700 1 -- 172.21.15.160:0/3402802400 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9dc006a190 con 0x7f9dc01023f0 2024-05-08T05:19:45.995 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-08T05:19:45.993+0000 7f9db77fe700 1 -- 172.21.15.160:0/3402802400 <== mon.1 v2:172.21.15.160:3300/0 4 ==== mgrmap(e 15) ==== 149596+0+0 (secure 0 0 0) 0x7f9dbc019480 con 0x7f9dc01023f0 2024-05-08T05:19:45.995 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-08T05:19:45.994+0000 7f9db77fe700 1 --2- 172.21.15.160:0/3402802400 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f9dac0b2870 0x7f9dac0b4d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:19:45.995 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-08T05:19:45.994+0000 7f9db77fe700 1 -- 172.21.15.160:0/3402802400 <== mon.1 v2:172.21.15.160:3300/0 5 ==== osd_map(14..14 src has 1..14) ==== 2309+0+0 (secure 0 0 0) 0x7f9dbc0e2220 con 0x7f9dc01023f0 2024-05-08T05:19:45.995 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-08T05:19:45.994+0000 7f9dc580d700 1 --2- 172.21.15.160:0/3402802400 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f9dac0b2870 0x7f9dac0b4d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:19:45.995 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-08T05:19:45.995+0000 7f9dc580d700 1 --2- 172.21.15.160:0/3402802400 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f9dac0b2870 0x7f9dac0b4d30 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f9db0009a10 tx=0x7f9db0009190 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:19:45.998 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-08T05:19:45.997+0000 7f9db77fe700 1 -- 172.21.15.160:0/3402802400 <== mon.1 v2:172.21.15.160:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f9dbc0ab790 con 0x7f9dc01023f0 2024-05-08T05:19:46.038 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:19:45 smithi160 ceph-mon[34827]: osdmap e14: 2 total, 2 up, 2 in 2024-05-08T05:19:46.038 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:19:45 smithi160 ceph-mon[34827]: pgmap v75: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-05-08T05:19:46.207 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-08T05:19:46.207+0000 7f9dc8272700 1 -- 172.21.15.160:0/3402802400 --> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi160:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) -- 0x7f9dc006c560 con 0x7f9dac0b2870 2024-05-08T05:19:46.208 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:19:45 smithi087 ceph-mon[29523]: osdmap e14: 2 total, 2 up, 2 in 2024-05-08T05:19:46.208 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:19:45 smithi087 ceph-mon[29523]: pgmap v75: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-05-08T05:19:46.984 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:19:46 smithi090 ceph-mon[34526]: from='client.24163 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi160:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-05-08T05:19:46.984 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:19:46 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-08T05:19:46.984 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:19:46 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-08T05:19:46.984 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:19:46 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T05:19:47.039 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:19:46 smithi160 ceph-mon[34827]: from='client.24163 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi160:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-05-08T05:19:47.039 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:19:46 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-08T05:19:47.039 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:19:46 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-08T05:19:47.039 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:19:46 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T05:19:47.210 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:19:46 smithi087 ceph-mon[29523]: from='client.24163 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi160:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-05-08T05:19:47.210 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:19:46 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-08T05:19:47.210 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:19:46 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-08T05:19:47.210 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:19:46 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T05:19:47.999 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:19:47 smithi160 ceph-mon[34827]: pgmap v76: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-05-08T05:19:48.208 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:19:47 smithi087 ceph-mon[29523]: pgmap v76: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-05-08T05:19:48.233 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:19:47 smithi090 ceph-mon[34526]: pgmap v76: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-05-08T05:19:49.136 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:19:48 smithi160 ceph-mon[34827]: from='client.? 172.21.15.160:0/491804296' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "ee3a2729-93b2-4985-b84d-165f92cae8e1"}]: dispatch 2024-05-08T05:19:49.136 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:19:48 smithi160 ceph-mon[34827]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "ee3a2729-93b2-4985-b84d-165f92cae8e1"}]: dispatch 2024-05-08T05:19:49.136 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:19:48 smithi160 ceph-mon[34827]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "ee3a2729-93b2-4985-b84d-165f92cae8e1"}]': finished 2024-05-08T05:19:49.136 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:19:48 smithi160 ceph-mon[34827]: osdmap e15: 3 total, 2 up, 3 in 2024-05-08T05:19:49.136 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:19:48 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-05-08T05:19:49.208 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:19:48 smithi087 ceph-mon[29523]: from='client.? 172.21.15.160:0/491804296' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "ee3a2729-93b2-4985-b84d-165f92cae8e1"}]: dispatch 2024-05-08T05:19:49.208 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:19:48 smithi087 ceph-mon[29523]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "ee3a2729-93b2-4985-b84d-165f92cae8e1"}]: dispatch 2024-05-08T05:19:49.208 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:19:48 smithi087 ceph-mon[29523]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "ee3a2729-93b2-4985-b84d-165f92cae8e1"}]': finished 2024-05-08T05:19:49.208 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:19:48 smithi087 ceph-mon[29523]: osdmap e15: 3 total, 2 up, 3 in 2024-05-08T05:19:49.209 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:19:48 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-05-08T05:19:49.233 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:19:48 smithi090 ceph-mon[34526]: from='client.? 172.21.15.160:0/491804296' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "ee3a2729-93b2-4985-b84d-165f92cae8e1"}]: dispatch 2024-05-08T05:19:49.233 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:19:48 smithi090 ceph-mon[34526]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "ee3a2729-93b2-4985-b84d-165f92cae8e1"}]: dispatch 2024-05-08T05:19:49.233 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:19:48 smithi090 ceph-mon[34526]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "ee3a2729-93b2-4985-b84d-165f92cae8e1"}]': finished 2024-05-08T05:19:49.233 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:19:48 smithi090 ceph-mon[34526]: osdmap e15: 3 total, 2 up, 3 in 2024-05-08T05:19:49.234 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:19:48 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-05-08T05:19:50.208 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:19:49 smithi087 ceph-mon[29523]: pgmap v77: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-05-08T05:19:50.208 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:19:49 smithi087 ceph-mon[29523]: from='client.? 172.21.15.160:0/1609412761' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-08T05:19:50.233 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:19:49 smithi090 ceph-mon[34526]: pgmap v77: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-05-08T05:19:50.233 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:19:49 smithi090 ceph-mon[34526]: from='client.? 172.21.15.160:0/1609412761' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-08T05:19:50.289 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:19:49 smithi160 ceph-mon[34827]: pgmap v77: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-05-08T05:19:50.289 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:19:49 smithi160 ceph-mon[34827]: from='client.? 172.21.15.160:0/1609412761' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-08T05:19:52.208 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:19:51 smithi087 ceph-mon[29523]: pgmap v79: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-05-08T05:19:52.233 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:19:51 smithi090 ceph-mon[34526]: pgmap v79: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-05-08T05:19:52.289 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:19:51 smithi160 ceph-mon[34827]: pgmap v79: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-05-08T05:19:54.197 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:19:53 smithi160 ceph-mon[34827]: pgmap v80: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-05-08T05:19:54.208 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:19:53 smithi087 ceph-mon[29523]: pgmap v80: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-05-08T05:19:54.233 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:19:53 smithi090 ceph-mon[34526]: pgmap v80: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-05-08T05:19:55.958 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:19:55 smithi087 ceph-mon[29523]: pgmap v81: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-05-08T05:19:56.198 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:19:55 smithi160 ceph-mon[34827]: pgmap v81: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-05-08T05:19:56.209 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:19:55 smithi090 ceph-mon[34526]: pgmap v81: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-05-08T05:19:57.167 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:19:56 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-05-08T05:19:57.167 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:19:56 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T05:19:57.168 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:19:56 smithi160 ceph-mon[34827]: Deploying daemon osd.2 on smithi160 2024-05-08T05:19:57.208 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:19:56 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-05-08T05:19:57.208 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:19:56 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T05:19:57.208 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:19:56 smithi087 ceph-mon[29523]: Deploying daemon osd.2 on smithi160 2024-05-08T05:19:57.233 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:19:56 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-05-08T05:19:57.234 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:19:56 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T05:19:57.234 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:19:56 smithi090 ceph-mon[34526]: Deploying daemon osd.2 on smithi160 2024-05-08T05:19:58.148 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:19:57 smithi160 ceph-mon[34827]: pgmap v82: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-05-08T05:19:58.208 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:19:57 smithi087 ceph-mon[29523]: pgmap v82: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-05-08T05:19:58.233 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:19:57 smithi090 ceph-mon[34526]: pgmap v82: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-05-08T05:20:00.039 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:19:59 smithi160 ceph-mon[34827]: pgmap v83: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-05-08T05:20:00.208 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:19:59 smithi087 ceph-mon[29523]: pgmap v83: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-05-08T05:20:00.233 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:19:59 smithi090 ceph-mon[34526]: pgmap v83: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-05-08T05:20:01.026 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:20:00 smithi160 ceph-mon[34827]: overall HEALTH_OK 2024-05-08T05:20:01.208 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:20:00 smithi087 ceph-mon[29523]: overall HEALTH_OK 2024-05-08T05:20:01.233 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:20:00 smithi090 ceph-mon[34526]: overall HEALTH_OK 2024-05-08T05:20:02.208 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:20:01 smithi087 ceph-mon[29523]: pgmap v84: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-05-08T05:20:02.208 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:20:01 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:20:02.209 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:20:01 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:20:02.209 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:20:01 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T05:20:02.233 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:20:01 smithi090 ceph-mon[34526]: pgmap v84: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-05-08T05:20:02.234 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:20:01 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:20:02.234 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:20:01 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:20:02.234 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:20:01 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T05:20:02.262 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:20:01 smithi160 ceph-mon[34827]: pgmap v84: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-05-08T05:20:02.262 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:20:01 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:20:02.262 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:20:01 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:20:02.262 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:20:01 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T05:20:04.208 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:20:03 smithi087 ceph-mon[29523]: pgmap v85: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-05-08T05:20:04.229 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:20:03 smithi160 ceph-mon[34827]: pgmap v85: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-05-08T05:20:04.233 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:20:03 smithi090 ceph-mon[34526]: pgmap v85: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-05-08T05:20:04.942 INFO:teuthology.orchestra.run.smithi160.stdout:Created osd(s) 2 on host 'smithi160' 2024-05-08T05:20:04.943 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-08T05:20:04.941+0000 7f9db77fe700 1 -- 172.21.15.160:0/3402802400 <== mgr.14152 v2:172.21.15.87:6800/1189186457 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f9dc006c560 con 0x7f9dac0b2870 2024-05-08T05:20:04.945 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-08T05:20:04.943+0000 7f9dc8272700 1 -- 172.21.15.160:0/3402802400 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f9dac0b2870 msgr2=0x7f9dac0b4d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:20:04.945 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-08T05:20:04.943+0000 7f9dc8272700 1 --2- 172.21.15.160:0/3402802400 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f9dac0b2870 0x7f9dac0b4d30 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f9db0009a10 tx=0x7f9db0009190 comp rx=0 tx=0).stop 2024-05-08T05:20:04.945 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-08T05:20:04.943+0000 7f9dc8272700 1 -- 172.21.15.160:0/3402802400 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f9dc01023f0 msgr2=0x7f9dc01984f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:20:04.945 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-08T05:20:04.943+0000 7f9dc8272700 1 --2- 172.21.15.160:0/3402802400 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f9dc01023f0 0x7f9dc01984f0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f9dbc009920 tx=0x7f9dbc009c30 comp rx=0 tx=0).stop 2024-05-08T05:20:04.945 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-08T05:20:04.943+0000 7f9dc8272700 1 -- 172.21.15.160:0/3402802400 shutdown_connections 2024-05-08T05:20:04.946 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-08T05:20:04.943+0000 7f9dc8272700 1 --2- 172.21.15.160:0/3402802400 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9dc0103f90 0x7f9dc019fab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:20:04.946 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-08T05:20:04.943+0000 7f9dc8272700 1 --2- 172.21.15.160:0/3402802400 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f9dac0b2870 0x7f9dac0b4d30 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:20:04.946 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-08T05:20:04.943+0000 7f9dc8272700 1 --2- 172.21.15.160:0/3402802400 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f9dc01023f0 0x7f9dc01984f0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:20:04.946 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-08T05:20:04.943+0000 7f9dc8272700 1 --2- 172.21.15.160:0/3402802400 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9dc01035f0 0x7f9dc0198a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:20:04.946 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-08T05:20:04.943+0000 7f9dc8272700 1 -- 172.21.15.160:0/3402802400 >> 172.21.15.160:0/3402802400 conn(0x7f9dc00fd990 msgr2=0x7f9dc01068f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:20:04.946 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-08T05:20:04.944+0000 7f9dc8272700 1 -- 172.21.15.160:0/3402802400 shutdown_connections 2024-05-08T05:20:04.946 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-08T05:20:04.944+0000 7f9dc8272700 1 -- 172.21.15.160:0/3402802400 wait complete. 2024-05-08T05:20:05.458 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:20:05 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:20:05.459 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:20:05 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:20:05.459 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:20:05 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T05:20:05.459 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:20:05 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T05:20:05.459 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:20:05 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:20:05.459 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:20:05 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:20:05.459 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:20:05 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:20:05.459 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:20:05 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T05:20:05.539 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:20:05 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:20:05.539 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:20:05 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:20:05.539 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:20:05 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T05:20:05.539 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:20:05 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T05:20:05.539 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:20:05 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:20:05.539 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:20:05 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:20:05.539 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:20:05 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:20:05.539 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:20:05 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T05:20:05.592 DEBUG:teuthology.orchestra.run.smithi160:osd.2> sudo journalctl -f -n 0 -u ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968@osd.2.service 2024-05-08T05:20:05.595 INFO:tasks.cephadm:Deploying osd.3 on smithi087 with /dev/vg_nvme/lv_3... 2024-05-08T05:20:05.595 DEBUG:teuthology.orchestra.run.smithi087:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid eeeb813e-0cf9-11ef-bc97-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_3 2024-05-08T05:20:05.733 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:20:05 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:20:05.734 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:20:05 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:20:05.734 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:20:05 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T05:20:05.734 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:20:05 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T05:20:05.734 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:20:05 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:20:05.734 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:20:05 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:20:05.734 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:20:05 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:20:05.734 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:20:05 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T05:20:06.039 INFO:teuthology.orchestra.run.smithi087.stderr:Inferring config /var/lib/ceph/eeeb813e-0cf9-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T05:20:06.433 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:20:06 smithi087 ceph-mon[29523]: pgmap v86: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-05-08T05:20:06.433 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:20:06 smithi087 ceph-mon[29523]: from='osd.2 [v2:172.21.15.160:6800/2137179096,v1:172.21.15.160:6801/2137179096]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-05-08T05:20:06.433 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:20:06 smithi087 ceph-mon[29523]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-05-08T05:20:06.694 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:20:06 smithi160 ceph-mon[34827]: pgmap v86: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-05-08T05:20:06.695 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:20:06 smithi160 ceph-mon[34827]: from='osd.2 [v2:172.21.15.160:6800/2137179096,v1:172.21.15.160:6801/2137179096]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-05-08T05:20:06.695 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:20:06 smithi160 ceph-mon[34827]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-05-08T05:20:06.733 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:20:06 smithi090 ceph-mon[34526]: pgmap v86: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-05-08T05:20:06.733 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:20:06 smithi090 ceph-mon[34526]: from='osd.2 [v2:172.21.15.160:6800/2137179096,v1:172.21.15.160:6801/2137179096]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-05-08T05:20:06.734 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:20:06 smithi090 ceph-mon[34526]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-05-08T05:20:07.615 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:20:07 smithi087 ceph-mon[29523]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-05-08T05:20:07.615 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:20:07 smithi087 ceph-mon[29523]: from='osd.2 [v2:172.21.15.160:6800/2137179096,v1:172.21.15.160:6801/2137179096]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi160", "root=default"]}]: dispatch 2024-05-08T05:20:07.615 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:20:07 smithi087 ceph-mon[29523]: osdmap e16: 3 total, 2 up, 3 in 2024-05-08T05:20:07.615 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:20:07 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-05-08T05:20:07.615 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:20:07 smithi087 ceph-mon[29523]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi160", "root=default"]}]: dispatch 2024-05-08T05:20:07.733 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:20:07 smithi090 ceph-mon[34526]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-05-08T05:20:07.734 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:20:07 smithi090 ceph-mon[34526]: from='osd.2 [v2:172.21.15.160:6800/2137179096,v1:172.21.15.160:6801/2137179096]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi160", "root=default"]}]: dispatch 2024-05-08T05:20:07.734 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:20:07 smithi090 ceph-mon[34526]: osdmap e16: 3 total, 2 up, 3 in 2024-05-08T05:20:07.734 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:20:07 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-05-08T05:20:07.734 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:20:07 smithi090 ceph-mon[34526]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi160", "root=default"]}]: dispatch 2024-05-08T05:20:07.789 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:20:07 smithi160 ceph-mon[34827]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-05-08T05:20:07.789 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:20:07 smithi160 ceph-mon[34827]: from='osd.2 [v2:172.21.15.160:6800/2137179096,v1:172.21.15.160:6801/2137179096]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi160", "root=default"]}]: dispatch 2024-05-08T05:20:07.789 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:20:07 smithi160 ceph-mon[34827]: osdmap e16: 3 total, 2 up, 3 in 2024-05-08T05:20:07.789 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:20:07 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-05-08T05:20:07.789 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:20:07 smithi160 ceph-mon[34827]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi160", "root=default"]}]: dispatch 2024-05-08T05:20:07.790 INFO:journalctl@ceph.osd.2.smithi160.stdout:May 08 05:20:07 smithi160 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-2[39945]: 2024-05-08T05:20:07.343+0000 7f38ce28f700 -1 osd.2 0 waiting for initial osdmap 2024-05-08T05:20:07.790 INFO:journalctl@ceph.osd.2.smithi160.stdout:May 08 05:20:07 smithi160 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-2[39945]: 2024-05-08T05:20:07.347+0000 7f38ca082700 -1 osd.2 17 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-08T05:20:08.606 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:20:08 smithi087 ceph-mon[29523]: pgmap v88: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-05-08T05:20:08.607 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:20:08 smithi087 ceph-mon[29523]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi160", "root=default"]}]': finished 2024-05-08T05:20:08.607 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:20:08 smithi087 ceph-mon[29523]: osdmap e17: 3 total, 2 up, 3 in 2024-05-08T05:20:08.607 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:20:08 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-05-08T05:20:08.607 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:20:08 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-05-08T05:20:08.733 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:20:08 smithi090 ceph-mon[34526]: pgmap v88: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-05-08T05:20:08.734 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:20:08 smithi090 ceph-mon[34526]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi160", "root=default"]}]': finished 2024-05-08T05:20:08.734 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:20:08 smithi090 ceph-mon[34526]: osdmap e17: 3 total, 2 up, 3 in 2024-05-08T05:20:08.734 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:20:08 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-05-08T05:20:08.734 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:20:08 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-05-08T05:20:08.788 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:20:08 smithi160 ceph-mon[34827]: pgmap v88: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-05-08T05:20:08.789 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:20:08 smithi160 ceph-mon[34827]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi160", "root=default"]}]': finished 2024-05-08T05:20:08.789 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:20:08 smithi160 ceph-mon[34827]: osdmap e17: 3 total, 2 up, 3 in 2024-05-08T05:20:08.789 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:20:08 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-05-08T05:20:08.789 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:20:08 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-05-08T05:20:08.848 INFO:teuthology.orchestra.run.smithi087.stderr:--> Zapping: /dev/vg_nvme/lv_3 2024-05-08T05:20:08.848 INFO:teuthology.orchestra.run.smithi087.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_3 bs=1M count=10 conv=fsync 2024-05-08T05:20:08.848 INFO:teuthology.orchestra.run.smithi087.stderr: stderr: 10+0 records in 2024-05-08T05:20:08.848 INFO:teuthology.orchestra.run.smithi087.stderr:10+0 records out 2024-05-08T05:20:08.848 INFO:teuthology.orchestra.run.smithi087.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0352491 s, 297 MB/s 2024-05-08T05:20:08.848 INFO:teuthology.orchestra.run.smithi087.stderr:--> Zapping successful for: 2024-05-08T05:20:09.624 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:20:09 smithi087 ceph-mon[29523]: purged_snaps scrub starts 2024-05-08T05:20:09.624 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:20:09 smithi087 ceph-mon[29523]: purged_snaps scrub ok 2024-05-08T05:20:09.625 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:20:09 smithi087 ceph-mon[29523]: osd.2 [v2:172.21.15.160:6800/2137179096,v1:172.21.15.160:6801/2137179096] boot 2024-05-08T05:20:09.625 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:20:09 smithi087 ceph-mon[29523]: osdmap e18: 3 total, 3 up, 3 in 2024-05-08T05:20:09.625 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:20:09 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-05-08T05:20:09.625 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:20:09 smithi087 ceph-mon[29523]: Detected new or changed devices on smithi160 2024-05-08T05:20:09.625 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:20:09 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:20:09.625 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:20:09 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:20:09.625 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:20:09 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-05-08T05:20:09.625 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:20:09 smithi087 ceph-mon[29523]: Adjusting osd_memory_target on smithi160 to 17088M 2024-05-08T05:20:09.625 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:20:09 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:20:09.625 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:20:09 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T05:20:09.625 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:20:09 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T05:20:09.625 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:20:09 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:20:09.625 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:20:09 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2024-05-08T05:20:09.672 DEBUG:teuthology.orchestra.run.smithi087:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid eeeb813e-0cf9-11ef-bc97-c7b262605968 -- ceph orch daemon add osd smithi087:vg_nvme/lv_3 2024-05-08T05:20:09.734 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:20:09 smithi090 ceph-mon[34526]: purged_snaps scrub starts 2024-05-08T05:20:09.734 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:20:09 smithi090 ceph-mon[34526]: purged_snaps scrub ok 2024-05-08T05:20:09.734 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:20:09 smithi090 ceph-mon[34526]: osd.2 [v2:172.21.15.160:6800/2137179096,v1:172.21.15.160:6801/2137179096] boot 2024-05-08T05:20:09.734 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:20:09 smithi090 ceph-mon[34526]: osdmap e18: 3 total, 3 up, 3 in 2024-05-08T05:20:09.734 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:20:09 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-05-08T05:20:09.735 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:20:09 smithi090 ceph-mon[34526]: Detected new or changed devices on smithi160 2024-05-08T05:20:09.735 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:20:09 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:20:09.735 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:20:09 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:20:09.735 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:20:09 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-05-08T05:20:09.735 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:20:09 smithi090 ceph-mon[34526]: Adjusting osd_memory_target on smithi160 to 17088M 2024-05-08T05:20:09.735 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:20:09 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:20:09.735 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:20:09 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T05:20:09.736 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:20:09 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T05:20:09.736 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:20:09 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:20:09.736 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:20:09 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2024-05-08T05:20:09.789 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:20:09 smithi160 ceph-mon[34827]: purged_snaps scrub starts 2024-05-08T05:20:09.789 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:20:09 smithi160 ceph-mon[34827]: purged_snaps scrub ok 2024-05-08T05:20:09.789 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:20:09 smithi160 ceph-mon[34827]: osd.2 [v2:172.21.15.160:6800/2137179096,v1:172.21.15.160:6801/2137179096] boot 2024-05-08T05:20:09.789 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:20:09 smithi160 ceph-mon[34827]: osdmap e18: 3 total, 3 up, 3 in 2024-05-08T05:20:09.789 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:20:09 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-05-08T05:20:09.789 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:20:09 smithi160 ceph-mon[34827]: Detected new or changed devices on smithi160 2024-05-08T05:20:09.789 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:20:09 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:20:09.789 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:20:09 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:20:09.789 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:20:09 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-05-08T05:20:09.789 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:20:09 smithi160 ceph-mon[34827]: Adjusting osd_memory_target on smithi160 to 17088M 2024-05-08T05:20:09.789 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:20:09 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:20:09.789 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:20:09 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T05:20:09.790 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:20:09 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T05:20:09.790 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:20:09 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:20:09.790 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:20:09 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2024-05-08T05:20:10.075 INFO:teuthology.orchestra.run.smithi087.stderr:Inferring config /var/lib/ceph/eeeb813e-0cf9-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T05:20:10.512 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:20:10 smithi087 ceph-mon[29523]: pgmap v91: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-05-08T05:20:10.512 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:20:10 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-05-08T05:20:10.512 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:20:10 smithi087 ceph-mon[29523]: osdmap e19: 3 total, 3 up, 3 in 2024-05-08T05:20:10.512 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:20:10 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-05-08T05:20:10.733 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:20:10 smithi090 ceph-mon[34526]: pgmap v91: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-05-08T05:20:10.734 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:20:10 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-05-08T05:20:10.734 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:20:10 smithi090 ceph-mon[34526]: osdmap e19: 3 total, 3 up, 3 in 2024-05-08T05:20:10.734 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:20:10 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-05-08T05:20:10.789 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:20:10 smithi160 ceph-mon[34827]: pgmap v91: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-05-08T05:20:10.789 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:20:10 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-05-08T05:20:10.789 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:20:10 smithi160 ceph-mon[34827]: osdmap e19: 3 total, 3 up, 3 in 2024-05-08T05:20:10.789 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:20:10 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-05-08T05:20:11.365 INFO:journalctl@ceph.osd.0.smithi087.stdout:May 08 05:20:11 smithi087 sudo[48722]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-05-08T05:20:11.365 INFO:journalctl@ceph.osd.0.smithi087.stdout:May 08 05:20:11 smithi087 sudo[48722]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-05-08T05:20:11.365 INFO:journalctl@ceph.osd.0.smithi087.stdout:May 08 05:20:11 smithi087 sudo[48722]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-05-08T05:20:11.365 INFO:journalctl@ceph.osd.0.smithi087.stdout:May 08 05:20:11 smithi087 sudo[48722]: pam_unix(sudo:session): session closed for user root 2024-05-08T05:20:11.365 INFO:journalctl@ceph.osd.0.smithi087.stdout:May 08 05:20:11 smithi087 sudo[48725]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-05-08T05:20:11.365 INFO:journalctl@ceph.osd.0.smithi087.stdout:May 08 05:20:11 smithi087 sudo[48725]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-05-08T05:20:11.365 INFO:journalctl@ceph.osd.0.smithi087.stdout:May 08 05:20:11 smithi087 sudo[48725]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-05-08T05:20:11.365 INFO:journalctl@ceph.osd.0.smithi087.stdout:May 08 05:20:11 smithi087 sudo[48725]: pam_unix(sudo:session): session closed for user root 2024-05-08T05:20:11.470 INFO:journalctl@ceph.osd.1.smithi090.stdout:May 08 05:20:11 smithi090 sudo[42829]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-05-08T05:20:11.471 INFO:journalctl@ceph.osd.1.smithi090.stdout:May 08 05:20:11 smithi090 sudo[42829]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-05-08T05:20:11.471 INFO:journalctl@ceph.osd.1.smithi090.stdout:May 08 05:20:11 smithi090 sudo[42829]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-05-08T05:20:11.471 INFO:journalctl@ceph.osd.1.smithi090.stdout:May 08 05:20:11 smithi090 sudo[42829]: pam_unix(sudo:session): session closed for user root 2024-05-08T05:20:11.471 INFO:journalctl@ceph.osd.1.smithi090.stdout:May 08 05:20:11 smithi090 sudo[42832]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-05-08T05:20:11.471 INFO:journalctl@ceph.osd.1.smithi090.stdout:May 08 05:20:11 smithi090 sudo[42832]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-05-08T05:20:11.471 INFO:journalctl@ceph.osd.1.smithi090.stdout:May 08 05:20:11 smithi090 sudo[42832]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-05-08T05:20:11.471 INFO:journalctl@ceph.osd.1.smithi090.stdout:May 08 05:20:11 smithi090 sudo[42832]: pam_unix(sudo:session): session closed for user root 2024-05-08T05:20:11.648 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:20:11 smithi087 sudo[48730]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-05-08T05:20:11.648 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:20:11 smithi087 sudo[48730]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-05-08T05:20:11.648 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:20:11 smithi087 sudo[48730]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-05-08T05:20:11.648 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:20:11 smithi087 sudo[48730]: pam_unix(sudo:session): session closed for user root 2024-05-08T05:20:11.648 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:20:11 smithi087 sudo[48733]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-05-08T05:20:11.648 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:20:11 smithi087 sudo[48733]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-05-08T05:20:11.648 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:20:11 smithi087 sudo[48733]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-05-08T05:20:11.648 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:20:11 smithi087 sudo[48733]: pam_unix(sudo:session): session closed for user root 2024-05-08T05:20:11.649 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:20:11 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-05-08T05:20:11.649 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:20:11 smithi087 ceph-mon[29523]: osdmap e20: 3 total, 3 up, 3 in 2024-05-08T05:20:11.649 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:20:11 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:20:11.649 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:20:11 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:20:11.649 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:20:11 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:20:11.734 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:20:11 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-05-08T05:20:11.734 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:20:11 smithi090 ceph-mon[34526]: osdmap e20: 3 total, 3 up, 3 in 2024-05-08T05:20:11.734 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:20:11 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:20:11.734 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:20:11 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:20:11.734 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:20:11 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:20:11.734 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:20:11 smithi090 sudo[42835]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-05-08T05:20:11.734 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:20:11 smithi090 sudo[42835]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-05-08T05:20:11.734 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:20:11 smithi090 sudo[42835]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-05-08T05:20:11.734 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:20:11 smithi090 sudo[42835]: pam_unix(sudo:session): session closed for user root 2024-05-08T05:20:11.734 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:20:11 smithi090 sudo[42838]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-05-08T05:20:11.734 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:20:11 smithi090 sudo[42838]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-05-08T05:20:11.734 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:20:11 smithi090 sudo[42838]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-05-08T05:20:11.735 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:20:11 smithi090 sudo[42838]: pam_unix(sudo:session): session closed for user root 2024-05-08T05:20:11.789 INFO:journalctl@ceph.osd.2.smithi160.stdout:May 08 05:20:11 smithi160 sudo[43846]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-05-08T05:20:11.789 INFO:journalctl@ceph.osd.2.smithi160.stdout:May 08 05:20:11 smithi160 sudo[43846]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-05-08T05:20:11.789 INFO:journalctl@ceph.osd.2.smithi160.stdout:May 08 05:20:11 smithi160 sudo[43846]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-05-08T05:20:11.789 INFO:journalctl@ceph.osd.2.smithi160.stdout:May 08 05:20:11 smithi160 sudo[43846]: pam_unix(sudo:session): session closed for user root 2024-05-08T05:20:11.789 INFO:journalctl@ceph.osd.2.smithi160.stdout:May 08 05:20:11 smithi160 sudo[43849]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-05-08T05:20:11.789 INFO:journalctl@ceph.osd.2.smithi160.stdout:May 08 05:20:11 smithi160 sudo[43849]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-05-08T05:20:11.789 INFO:journalctl@ceph.osd.2.smithi160.stdout:May 08 05:20:11 smithi160 sudo[43849]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-05-08T05:20:11.789 INFO:journalctl@ceph.osd.2.smithi160.stdout:May 08 05:20:11 smithi160 sudo[43849]: pam_unix(sudo:session): session closed for user root 2024-05-08T05:20:11.789 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:20:11 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-05-08T05:20:11.789 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:20:11 smithi160 ceph-mon[34827]: osdmap e20: 3 total, 3 up, 3 in 2024-05-08T05:20:11.790 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:20:11 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:20:11.790 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:20:11 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:20:11.790 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:20:11 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:20:11.790 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:20:11 smithi160 sudo[43852]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-05-08T05:20:11.790 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:20:11 smithi160 sudo[43852]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-05-08T05:20:11.790 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:20:11 smithi160 sudo[43852]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-05-08T05:20:11.790 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:20:11 smithi160 sudo[43852]: pam_unix(sudo:session): session closed for user root 2024-05-08T05:20:11.790 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:20:11 smithi160 sudo[43855]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-05-08T05:20:11.790 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:20:11 smithi160 sudo[43855]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-05-08T05:20:11.790 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:20:11 smithi160 sudo[43855]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-05-08T05:20:11.790 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:20:11 smithi160 sudo[43855]: pam_unix(sudo:session): session closed for user root 2024-05-08T05:20:12.107 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:20:12.106+0000 7f0319800700 1 -- 172.21.15.87:0/4265983415 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f031410b6e0 msgr2=0x7f0314111f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:20:12.107 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:20:12.106+0000 7f0319800700 1 --2- 172.21.15.87:0/4265983415 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f031410b6e0 0x7f0314111f90 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f030c00b0d0 tx=0x7f030c00b3e0 comp rx=0 tx=0).stop 2024-05-08T05:20:12.107 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:20:12.106+0000 7f0319800700 1 -- 172.21.15.87:0/4265983415 shutdown_connections 2024-05-08T05:20:12.108 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:20:12.106+0000 7f0319800700 1 --2- 172.21.15.87:0/4265983415 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f031410b6e0 0x7f0314111f90 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:20:12.108 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:20:12.106+0000 7f0319800700 1 --2- 172.21.15.87:0/4265983415 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0314109b40 0x7f0314109f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:20:12.108 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:20:12.106+0000 7f0319800700 1 --2- 172.21.15.87:0/4265983415 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f031410ad40 0x7f031410b1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:20:12.108 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:20:12.106+0000 7f0319800700 1 -- 172.21.15.87:0/4265983415 >> 172.21.15.87:0/4265983415 conn(0x7f0314078b10 msgr2=0x7f031407af50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:20:12.108 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:20:12.106+0000 7f0319800700 1 -- 172.21.15.87:0/4265983415 shutdown_connections 2024-05-08T05:20:12.108 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:20:12.106+0000 7f0319800700 1 -- 172.21.15.87:0/4265983415 wait complete. 2024-05-08T05:20:12.109 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:20:12.108+0000 7f0319800700 1 Processor -- start 2024-05-08T05:20:12.109 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:20:12.108+0000 7f0319800700 1 -- start start 2024-05-08T05:20:12.109 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:20:12.108+0000 7f0319800700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0314109b40 0x7f031419fc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:20:12.109 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:20:12.108+0000 7f0319800700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f031410ad40 0x7f03141a0170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:20:12.109 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:20:12.108+0000 7f0319800700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f031410b6e0 0x7f03141a71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:20:12.109 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:20:12.108+0000 7f0319800700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f0314115630 con 0x7f031410ad40 2024-05-08T05:20:12.109 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:20:12.108+0000 7f0319800700 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f03141154b0 con 0x7f031410b6e0 2024-05-08T05:20:12.109 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:20:12.108+0000 7f0319800700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f03141157b0 con 0x7f0314109b40 2024-05-08T05:20:12.110 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:20:12.108+0000 7f0312a00700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0314109b40 0x7f031419fc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:20:12.110 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:20:12.108+0000 7f0312000700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f031410ad40 0x7f03141a0170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:20:12.110 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:20:12.109+0000 7f0312a00700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0314109b40 0x7f031419fc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.87:54292/0 (socket says 172.21.15.87:54292) 2024-05-08T05:20:12.110 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:20:12.109+0000 7f0312a00700 1 -- 172.21.15.87:0/3656046416 learned_addr learned my addr 172.21.15.87:0/3656046416 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T05:20:12.110 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:20:12.109+0000 7f0313400700 1 --2- 172.21.15.87:0/3656046416 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f031410b6e0 0x7f03141a71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:20:12.111 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:20:12.109+0000 7f0313400700 1 -- 172.21.15.87:0/3656046416 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0314109b40 msgr2=0x7f031419fc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:20:12.111 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:20:12.109+0000 7f0313400700 1 --2- 172.21.15.87:0/3656046416 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0314109b40 0x7f031419fc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:20:12.111 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:20:12.109+0000 7f0313400700 1 -- 172.21.15.87:0/3656046416 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f031410ad40 msgr2=0x7f03141a0170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:20:12.111 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:20:12.109+0000 7f0313400700 1 --2- 172.21.15.87:0/3656046416 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f031410ad40 0x7f03141a0170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:20:12.111 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:20:12.109+0000 7f0313400700 1 -- 172.21.15.87:0/3656046416 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f03141a7880 con 0x7f031410b6e0 2024-05-08T05:20:12.111 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:20:12.109+0000 7f0313400700 1 --2- 172.21.15.87:0/3656046416 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f031410b6e0 0x7f03141a71b0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f030c006070 tx=0x7f030c004c80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:20:12.111 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:20:12.110+0000 7f030b400700 1 -- 172.21.15.87:0/3656046416 <== mon.2 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f030c01f070 con 0x7f031410b6e0 2024-05-08T05:20:12.111 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:20:12.110+0000 7f030b400700 1 -- 172.21.15.87:0/3656046416 <== mon.2 v2:172.21.15.90:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f030c007b80 con 0x7f031410b6e0 2024-05-08T05:20:12.111 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:20:12.110+0000 7f0319800700 1 -- 172.21.15.87:0/3656046416 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f03141a7b10 con 0x7f031410b6e0 2024-05-08T05:20:12.111 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:20:12.110+0000 7f030b400700 1 -- 172.21.15.87:0/3656046416 <== mon.2 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f030c01b690 con 0x7f031410b6e0 2024-05-08T05:20:12.112 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:20:12.110+0000 7f0319800700 1 -- 172.21.15.87:0/3656046416 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f03141a7f60 con 0x7f031410b6e0 2024-05-08T05:20:12.112 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:20:12.111+0000 7f0319800700 1 -- 172.21.15.87:0/3656046416 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f031402e510 con 0x7f031410b6e0 2024-05-08T05:20:12.113 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:20:12.113+0000 7f030b400700 1 -- 172.21.15.87:0/3656046416 <== mon.2 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 15) ==== 149596+0+0 (secure 0 0 0) 0x7f030c022070 con 0x7f031410b6e0 2024-05-08T05:20:12.115 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:20:12.115+0000 7f030b400700 1 --2- 172.21.15.87:0/3656046416 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f02f80b2870 0x7f02f80b4d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:20:12.115 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:20:12.115+0000 7f030b400700 1 -- 172.21.15.87:0/3656046416 <== mon.2 v2:172.21.15.90:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 3237+0+0 (secure 0 0 0) 0x7f030c0e1db0 con 0x7f031410b6e0 2024-05-08T05:20:12.115 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:20:12.115+0000 7f0312a00700 1 --2- 172.21.15.87:0/3656046416 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f02f80b2870 0x7f02f80b4d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:20:12.116 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:20:12.116+0000 7f0312a00700 1 --2- 172.21.15.87:0/3656046416 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f02f80b2870 0x7f02f80b4d30 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f03141a1110 tx=0x7f0304009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:20:12.117 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:20:12.117+0000 7f030b400700 1 -- 172.21.15.87:0/3656046416 <== mon.2 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f030c0aaf70 con 0x7f031410b6e0 2024-05-08T05:20:12.358 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:20:12.357+0000 7f0319800700 1 -- 172.21.15.87:0/3656046416 --> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi087:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) -- 0x7f03140638e0 con 0x7f02f80b2870 2024-05-08T05:20:12.709 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:20:12 smithi087 ceph-mon[29523]: pgmap v94: 1 pgs: 1 creating+peering; 0 B data, 84 MiB used, 268 GiB / 268 GiB avail 2024-05-08T05:20:12.709 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:20:12 smithi087 ceph-mon[29523]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-05-08T05:20:12.709 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:20:12 smithi087 ceph-mon[29523]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-05-08T05:20:12.709 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:20:12 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-05-08T05:20:12.709 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:20:12 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-08T05:20:12.709 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:20:12 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-08T05:20:12.710 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:20:12 smithi087 ceph-mon[29523]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-05-08T05:20:12.710 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:20:12 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-05-08T05:20:12.710 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:20:12 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-08T05:20:12.710 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:20:12 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-08T05:20:12.710 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:20:12 smithi087 ceph-mon[29523]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-05-08T05:20:12.710 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:20:12 smithi087 ceph-mon[29523]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-05-08T05:20:12.710 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:20:12 smithi087 ceph-mon[29523]: osdmap e21: 3 total, 3 up, 3 in 2024-05-08T05:20:12.710 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:20:12 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-05-08T05:20:12.710 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:20:12 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-08T05:20:12.710 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:20:12 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-08T05:20:12.710 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:20:12 smithi087 ceph-mon[29523]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-05-08T05:20:12.710 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:20:12 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-08T05:20:12.710 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:20:12 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-08T05:20:12.710 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:20:12 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T05:20:12.734 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:20:12 smithi090 ceph-mon[34526]: pgmap v94: 1 pgs: 1 creating+peering; 0 B data, 84 MiB used, 268 GiB / 268 GiB avail 2024-05-08T05:20:12.734 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:20:12 smithi090 ceph-mon[34526]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-05-08T05:20:12.734 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:20:12 smithi090 ceph-mon[34526]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-05-08T05:20:12.734 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:20:12 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-05-08T05:20:12.734 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:20:12 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-08T05:20:12.734 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:20:12 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-08T05:20:12.734 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:20:12 smithi090 ceph-mon[34526]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-05-08T05:20:12.734 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:20:12 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-05-08T05:20:12.734 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:20:12 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-08T05:20:12.734 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:20:12 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-08T05:20:12.734 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:20:12 smithi090 ceph-mon[34526]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-05-08T05:20:12.734 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:20:12 smithi090 ceph-mon[34526]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-05-08T05:20:12.735 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:20:12 smithi090 ceph-mon[34526]: osdmap e21: 3 total, 3 up, 3 in 2024-05-08T05:20:12.735 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:20:12 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-05-08T05:20:12.735 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:20:12 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-08T05:20:12.735 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:20:12 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-08T05:20:12.735 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:20:12 smithi090 ceph-mon[34526]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-05-08T05:20:12.735 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:20:12 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-08T05:20:12.735 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:20:12 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-08T05:20:12.735 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:20:12 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T05:20:12.789 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:20:12 smithi160 ceph-mon[34827]: pgmap v94: 1 pgs: 1 creating+peering; 0 B data, 84 MiB used, 268 GiB / 268 GiB avail 2024-05-08T05:20:12.789 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:20:12 smithi160 ceph-mon[34827]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-05-08T05:20:12.789 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:20:12 smithi160 ceph-mon[34827]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-05-08T05:20:12.789 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:20:12 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-05-08T05:20:12.789 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:20:12 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-08T05:20:12.789 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:20:12 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-08T05:20:12.790 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:20:12 smithi160 ceph-mon[34827]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-05-08T05:20:12.790 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:20:12 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-05-08T05:20:12.790 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:20:12 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-08T05:20:12.790 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:20:12 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-08T05:20:12.790 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:20:12 smithi160 ceph-mon[34827]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-05-08T05:20:12.790 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:20:12 smithi160 ceph-mon[34827]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-05-08T05:20:12.790 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:20:12 smithi160 ceph-mon[34827]: osdmap e21: 3 total, 3 up, 3 in 2024-05-08T05:20:12.790 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:20:12 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-05-08T05:20:12.790 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:20:12 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-08T05:20:12.790 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:20:12 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-08T05:20:12.790 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:20:12 smithi160 ceph-mon[34827]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-05-08T05:20:12.791 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:20:12 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-08T05:20:12.791 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:20:12 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-08T05:20:12.791 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:20:12 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T05:20:13.491 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:20:13.489+0000 7f030b400700 1 -- 172.21.15.87:0/3656046416 <== mon.2 v2:172.21.15.90:3300/0 7 ==== mgrmap(e 16) ==== 149652+0+0 (secure 0 0 0) 0x7f030c0a6b00 con 0x7f031410b6e0 2024-05-08T05:20:13.596 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:20:13 smithi087 ceph-mon[29523]: from='client.24185 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi087:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-05-08T05:20:13.733 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:20:13 smithi090 ceph-mon[34526]: from='client.24185 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi087:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-05-08T05:20:13.788 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:20:13 smithi160 ceph-mon[34827]: from='client.24185 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi087:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-05-08T05:20:14.671 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:20:14 smithi087 ceph-mon[29523]: pgmap v96: 1 pgs: 1 creating+peering; 0 B data, 84 MiB used, 268 GiB / 268 GiB avail 2024-05-08T05:20:14.671 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:20:14 smithi087 ceph-mon[29523]: mgrmap e16: x(active, since 2m), standbys: z, y 2024-05-08T05:20:14.788 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:20:14 smithi160 ceph-mon[34827]: pgmap v96: 1 pgs: 1 creating+peering; 0 B data, 84 MiB used, 268 GiB / 268 GiB avail 2024-05-08T05:20:14.789 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:20:14 smithi160 ceph-mon[34827]: mgrmap e16: x(active, since 2m), standbys: z, y 2024-05-08T05:20:14.983 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:20:14 smithi090 ceph-mon[34526]: pgmap v96: 1 pgs: 1 creating+peering; 0 B data, 84 MiB used, 268 GiB / 268 GiB avail 2024-05-08T05:20:14.984 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:20:14 smithi090 ceph-mon[34526]: mgrmap e16: x(active, since 2m), standbys: z, y 2024-05-08T05:20:16.789 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:20:16 smithi160 ceph-mon[34827]: pgmap v97: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-05-08T05:20:16.789 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:20:16 smithi160 ceph-mon[34827]: from='client.? 172.21.15.87:0/1572352271' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "fc7bd69f-5a62-4ec6-b95c-c170be46a7d3"}]: dispatch 2024-05-08T05:20:16.789 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:20:16 smithi160 ceph-mon[34827]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "fc7bd69f-5a62-4ec6-b95c-c170be46a7d3"}]: dispatch 2024-05-08T05:20:16.789 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:20:16 smithi160 ceph-mon[34827]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "fc7bd69f-5a62-4ec6-b95c-c170be46a7d3"}]': finished 2024-05-08T05:20:16.789 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:20:16 smithi160 ceph-mon[34827]: osdmap e22: 4 total, 3 up, 4 in 2024-05-08T05:20:16.789 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:20:16 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-05-08T05:20:16.959 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:20:16 smithi087 ceph-mon[29523]: pgmap v97: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-05-08T05:20:16.959 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:20:16 smithi087 ceph-mon[29523]: from='client.? 172.21.15.87:0/1572352271' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "fc7bd69f-5a62-4ec6-b95c-c170be46a7d3"}]: dispatch 2024-05-08T05:20:16.959 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:20:16 smithi087 ceph-mon[29523]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "fc7bd69f-5a62-4ec6-b95c-c170be46a7d3"}]: dispatch 2024-05-08T05:20:16.959 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:20:16 smithi087 ceph-mon[29523]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "fc7bd69f-5a62-4ec6-b95c-c170be46a7d3"}]': finished 2024-05-08T05:20:16.959 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:20:16 smithi087 ceph-mon[29523]: osdmap e22: 4 total, 3 up, 4 in 2024-05-08T05:20:16.959 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:20:16 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-05-08T05:20:16.983 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:20:16 smithi090 ceph-mon[34526]: pgmap v97: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-05-08T05:20:16.983 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:20:16 smithi090 ceph-mon[34526]: from='client.? 172.21.15.87:0/1572352271' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "fc7bd69f-5a62-4ec6-b95c-c170be46a7d3"}]: dispatch 2024-05-08T05:20:16.983 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:20:16 smithi090 ceph-mon[34526]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "fc7bd69f-5a62-4ec6-b95c-c170be46a7d3"}]: dispatch 2024-05-08T05:20:16.984 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:20:16 smithi090 ceph-mon[34526]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "fc7bd69f-5a62-4ec6-b95c-c170be46a7d3"}]': finished 2024-05-08T05:20:16.984 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:20:16 smithi090 ceph-mon[34526]: osdmap e22: 4 total, 3 up, 4 in 2024-05-08T05:20:16.984 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:20:16 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-05-08T05:20:17.959 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:20:17 smithi087 ceph-mon[29523]: from='client.? 172.21.15.87:0/361888403' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-08T05:20:17.983 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:20:17 smithi090 ceph-mon[34526]: from='client.? 172.21.15.87:0/361888403' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-08T05:20:18.039 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:20:17 smithi160 ceph-mon[34827]: from='client.? 172.21.15.87:0/361888403' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-08T05:20:18.789 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:20:18 smithi160 ceph-mon[34827]: pgmap v99: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-05-08T05:20:18.958 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:20:18 smithi087 ceph-mon[29523]: pgmap v99: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-05-08T05:20:18.983 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:20:18 smithi090 ceph-mon[34526]: pgmap v99: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-05-08T05:20:19.958 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:20:19 smithi087 ceph-mon[29523]: pgmap v100: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-05-08T05:20:19.983 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:20:19 smithi090 ceph-mon[34526]: pgmap v100: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-05-08T05:20:20.038 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:20:19 smithi160 ceph-mon[34827]: pgmap v100: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-05-08T05:20:22.208 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:20:21 smithi087 ceph-mon[29523]: pgmap v101: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-05-08T05:20:22.233 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:20:21 smithi090 ceph-mon[34526]: pgmap v101: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-05-08T05:20:22.288 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:20:21 smithi160 ceph-mon[34827]: pgmap v101: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-05-08T05:20:24.125 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:20:23 smithi087 ceph-mon[29523]: pgmap v102: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-05-08T05:20:24.233 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:20:23 smithi090 ceph-mon[34526]: pgmap v102: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-05-08T05:20:24.288 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:20:23 smithi160 ceph-mon[34827]: pgmap v102: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-05-08T05:20:26.208 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:20:25 smithi087 ceph-mon[29523]: pgmap v103: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-05-08T05:20:26.208 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:20:25 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-05-08T05:20:26.208 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:20:25 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T05:20:26.209 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:20:25 smithi087 ceph-mon[29523]: Deploying daemon osd.3 on smithi087 2024-05-08T05:20:26.233 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:20:25 smithi090 ceph-mon[34526]: pgmap v103: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-05-08T05:20:26.233 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:20:25 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-05-08T05:20:26.234 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:20:25 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T05:20:26.234 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:20:25 smithi090 ceph-mon[34526]: Deploying daemon osd.3 on smithi087 2024-05-08T05:20:26.288 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:20:25 smithi160 ceph-mon[34827]: pgmap v103: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-05-08T05:20:26.288 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:20:25 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-05-08T05:20:26.289 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:20:25 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T05:20:26.289 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:20:25 smithi160 ceph-mon[34827]: Deploying daemon osd.3 on smithi087 2024-05-08T05:20:28.144 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:20:27 smithi087 ceph-mon[29523]: pgmap v104: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-05-08T05:20:28.233 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:20:27 smithi090 ceph-mon[34526]: pgmap v104: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-05-08T05:20:28.288 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:20:27 smithi160 ceph-mon[34827]: pgmap v104: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-05-08T05:20:30.049 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:20:29 smithi087 ceph-mon[29523]: pgmap v105: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-05-08T05:20:30.233 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:20:29 smithi090 ceph-mon[34526]: pgmap v105: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-05-08T05:20:30.288 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:20:29 smithi160 ceph-mon[34827]: pgmap v105: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-05-08T05:20:32.209 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:20:31 smithi087 ceph-mon[29523]: pgmap v106: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-05-08T05:20:32.233 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:20:31 smithi090 ceph-mon[34526]: pgmap v106: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-05-08T05:20:32.288 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:20:31 smithi160 ceph-mon[34827]: pgmap v106: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-05-08T05:20:34.759 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:20:34 smithi087 ceph-mon[29523]: pgmap v107: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-05-08T05:20:34.759 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:20:34 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:20:34.759 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:20:34 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:20:34.759 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:20:34 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T05:20:34.789 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:20:34 smithi160 ceph-mon[34827]: pgmap v107: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-05-08T05:20:34.789 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:20:34 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:20:34.789 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:20:34 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:20:34.789 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:20:34 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T05:20:34.983 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:20:34 smithi090 ceph-mon[34526]: pgmap v107: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-05-08T05:20:34.983 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:20:34 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:20:34.984 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:20:34 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:20:34.984 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:20:34 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T05:20:36.606 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:20:36 smithi087 ceph-mon[29523]: pgmap v108: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-05-08T05:20:36.788 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:20:36 smithi160 ceph-mon[34827]: pgmap v108: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-05-08T05:20:36.983 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:20:36 smithi090 ceph-mon[34526]: pgmap v108: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-05-08T05:20:38.307 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:20:38.305+0000 7f030b400700 1 -- 172.21.15.87:0/3656046416 <== mgr.14152 v2:172.21.15.87:6800/1189186457 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f03140638e0 con 0x7f02f80b2870 2024-05-08T05:20:38.307 INFO:teuthology.orchestra.run.smithi087.stdout:Created osd(s) 3 on host 'smithi087' 2024-05-08T05:20:38.311 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:20:38.309+0000 7f0319800700 1 -- 172.21.15.87:0/3656046416 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f02f80b2870 msgr2=0x7f02f80b4d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:20:38.311 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:20:38.309+0000 7f0319800700 1 --2- 172.21.15.87:0/3656046416 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f02f80b2870 0x7f02f80b4d30 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f03141a1110 tx=0x7f0304009260 comp rx=0 tx=0).stop 2024-05-08T05:20:38.311 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:20:38.309+0000 7f0319800700 1 -- 172.21.15.87:0/3656046416 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f031410b6e0 msgr2=0x7f03141a71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:20:38.312 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:20:38.309+0000 7f0319800700 1 --2- 172.21.15.87:0/3656046416 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f031410b6e0 0x7f03141a71b0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f030c006070 tx=0x7f030c004c80 comp rx=0 tx=0).stop 2024-05-08T05:20:38.312 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:20:38.309+0000 7f0319800700 1 -- 172.21.15.87:0/3656046416 shutdown_connections 2024-05-08T05:20:38.312 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:20:38.309+0000 7f0319800700 1 --2- 172.21.15.87:0/3656046416 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f031410b6e0 0x7f03141a71b0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:20:38.312 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:20:38.309+0000 7f0319800700 1 --2- 172.21.15.87:0/3656046416 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f02f80b2870 0x7f02f80b4d30 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:20:38.312 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:20:38.309+0000 7f0319800700 1 --2- 172.21.15.87:0/3656046416 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0314109b40 0x7f031419fc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:20:38.312 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:20:38.309+0000 7f0319800700 1 --2- 172.21.15.87:0/3656046416 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f031410ad40 0x7f03141a0170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:20:38.312 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:20:38.309+0000 7f0319800700 1 -- 172.21.15.87:0/3656046416 >> 172.21.15.87:0/3656046416 conn(0x7f0314078b10 msgr2=0x7f031410e040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:20:38.312 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:20:38.310+0000 7f0319800700 1 -- 172.21.15.87:0/3656046416 shutdown_connections 2024-05-08T05:20:38.312 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:20:38.310+0000 7f0319800700 1 -- 172.21.15.87:0/3656046416 wait complete. 2024-05-08T05:20:38.458 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:20:38 smithi087 ceph-mon[29523]: pgmap v109: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-05-08T05:20:38.458 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:20:38 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:20:38.458 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:20:38 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:20:38.458 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:20:38 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T05:20:38.458 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:20:38 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T05:20:38.459 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:20:38 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:20:38.459 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:20:38 smithi087 ceph-mon[29523]: from='osd.3 [v2:172.21.15.87:6810/2022667023,v1:172.21.15.87:6811/2022667023]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-05-08T05:20:38.459 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:20:38 smithi087 ceph-mon[29523]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-05-08T05:20:38.483 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:20:38 smithi090 ceph-mon[34526]: pgmap v109: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-05-08T05:20:38.484 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:20:38 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:20:38.484 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:20:38 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:20:38.484 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:20:38 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T05:20:38.484 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:20:38 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T05:20:38.484 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:20:38 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:20:38.484 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:20:38 smithi090 ceph-mon[34526]: from='osd.3 [v2:172.21.15.87:6810/2022667023,v1:172.21.15.87:6811/2022667023]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-05-08T05:20:38.484 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:20:38 smithi090 ceph-mon[34526]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-05-08T05:20:38.539 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:20:38 smithi160 ceph-mon[34827]: pgmap v109: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-05-08T05:20:38.539 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:20:38 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:20:38.539 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:20:38 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:20:38.539 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:20:38 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T05:20:38.539 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:20:38 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T05:20:38.539 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:20:38 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:20:38.539 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:20:38 smithi160 ceph-mon[34827]: from='osd.3 [v2:172.21.15.87:6810/2022667023,v1:172.21.15.87:6811/2022667023]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-05-08T05:20:38.539 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:20:38 smithi160 ceph-mon[34827]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-05-08T05:20:39.135 DEBUG:teuthology.orchestra.run.smithi087:osd.3> sudo journalctl -f -n 0 -u ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968@osd.3.service 2024-05-08T05:20:39.139 INFO:tasks.cephadm:Deploying osd.4 on smithi090 with /dev/vg_nvme/lv_3... 2024-05-08T05:20:39.139 DEBUG:teuthology.orchestra.run.smithi090:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid eeeb813e-0cf9-11ef-bc97-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_3 2024-05-08T05:20:39.324 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:20:39 smithi087 ceph-mon[29523]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-05-08T05:20:39.324 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:20:39 smithi087 ceph-mon[29523]: from='osd.3 [v2:172.21.15.87:6810/2022667023,v1:172.21.15.87:6811/2022667023]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi087", "root=default"]}]: dispatch 2024-05-08T05:20:39.324 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:20:39 smithi087 ceph-mon[29523]: osdmap e23: 4 total, 3 up, 4 in 2024-05-08T05:20:39.324 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:20:39 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-05-08T05:20:39.325 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:20:39 smithi087 ceph-mon[29523]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi087", "root=default"]}]: dispatch 2024-05-08T05:20:39.325 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:20:39 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:20:39.325 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:20:39 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:20:39.325 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:20:39 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T05:20:39.384 INFO:teuthology.orchestra.run.smithi090.stderr:Inferring config /var/lib/ceph/eeeb813e-0cf9-11ef-bc97-c7b262605968/mon.b/config 2024-05-08T05:20:39.483 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:20:39 smithi090 ceph-mon[34526]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-05-08T05:20:39.484 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:20:39 smithi090 ceph-mon[34526]: from='osd.3 [v2:172.21.15.87:6810/2022667023,v1:172.21.15.87:6811/2022667023]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi087", "root=default"]}]: dispatch 2024-05-08T05:20:39.484 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:20:39 smithi090 ceph-mon[34526]: osdmap e23: 4 total, 3 up, 4 in 2024-05-08T05:20:39.484 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:20:39 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-05-08T05:20:39.484 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:20:39 smithi090 ceph-mon[34526]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi087", "root=default"]}]: dispatch 2024-05-08T05:20:39.484 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:20:39 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:20:39.484 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:20:39 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:20:39.484 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:20:39 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T05:20:39.541 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:20:39 smithi160 ceph-mon[34827]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-05-08T05:20:39.541 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:20:39 smithi160 ceph-mon[34827]: from='osd.3 [v2:172.21.15.87:6810/2022667023,v1:172.21.15.87:6811/2022667023]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi087", "root=default"]}]: dispatch 2024-05-08T05:20:39.541 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:20:39 smithi160 ceph-mon[34827]: osdmap e23: 4 total, 3 up, 4 in 2024-05-08T05:20:39.542 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:20:39 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-05-08T05:20:39.542 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:20:39 smithi160 ceph-mon[34827]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi087", "root=default"]}]: dispatch 2024-05-08T05:20:39.542 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:20:39 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:20:39.542 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:20:39 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:20:39.542 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:20:39 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T05:20:40.395 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:20:40 smithi087 ceph-mon[29523]: pgmap v111: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-05-08T05:20:40.395 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:20:40 smithi087 ceph-mon[29523]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi087", "root=default"]}]': finished 2024-05-08T05:20:40.395 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:20:40 smithi087 ceph-mon[29523]: osdmap e24: 4 total, 3 up, 4 in 2024-05-08T05:20:40.395 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:20:40 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-05-08T05:20:40.395 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:20:40 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-05-08T05:20:40.470 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:20:40 smithi090 ceph-mon[34526]: pgmap v111: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-05-08T05:20:40.471 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:20:40 smithi090 ceph-mon[34526]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi087", "root=default"]}]': finished 2024-05-08T05:20:40.471 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:20:40 smithi090 ceph-mon[34526]: osdmap e24: 4 total, 3 up, 4 in 2024-05-08T05:20:40.471 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:20:40 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-05-08T05:20:40.471 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:20:40 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-05-08T05:20:40.539 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:20:40 smithi160 ceph-mon[34827]: pgmap v111: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-05-08T05:20:40.539 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:20:40 smithi160 ceph-mon[34827]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi087", "root=default"]}]': finished 2024-05-08T05:20:40.539 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:20:40 smithi160 ceph-mon[34827]: osdmap e24: 4 total, 3 up, 4 in 2024-05-08T05:20:40.539 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:20:40 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-05-08T05:20:40.539 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:20:40 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-05-08T05:20:41.308 INFO:teuthology.orchestra.run.smithi090.stderr:--> Zapping: /dev/vg_nvme/lv_3 2024-05-08T05:20:41.308 INFO:teuthology.orchestra.run.smithi090.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_3 bs=1M count=10 conv=fsync 2024-05-08T05:20:41.308 INFO:teuthology.orchestra.run.smithi090.stderr: stderr: 10+0 records in 2024-05-08T05:20:41.308 INFO:teuthology.orchestra.run.smithi090.stderr:10+0 records out 2024-05-08T05:20:41.308 INFO:teuthology.orchestra.run.smithi090.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0116448 s, 900 MB/s 2024-05-08T05:20:41.308 INFO:teuthology.orchestra.run.smithi090.stderr:--> Zapping successful for: 2024-05-08T05:20:41.459 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:20:41 smithi087 ceph-mon[29523]: purged_snaps scrub starts 2024-05-08T05:20:41.459 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:20:41 smithi087 ceph-mon[29523]: purged_snaps scrub ok 2024-05-08T05:20:41.459 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:20:41 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-05-08T05:20:41.459 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:20:41 smithi087 ceph-mon[29523]: osd.3 [v2:172.21.15.87:6810/2022667023,v1:172.21.15.87:6811/2022667023] boot 2024-05-08T05:20:41.459 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:20:41 smithi087 ceph-mon[29523]: osdmap e25: 4 total, 4 up, 4 in 2024-05-08T05:20:41.459 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:20:41 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-05-08T05:20:41.483 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:20:41 smithi090 ceph-mon[34526]: purged_snaps scrub starts 2024-05-08T05:20:41.483 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:20:41 smithi090 ceph-mon[34526]: purged_snaps scrub ok 2024-05-08T05:20:41.483 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:20:41 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-05-08T05:20:41.483 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:20:41 smithi090 ceph-mon[34526]: osd.3 [v2:172.21.15.87:6810/2022667023,v1:172.21.15.87:6811/2022667023] boot 2024-05-08T05:20:41.484 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:20:41 smithi090 ceph-mon[34526]: osdmap e25: 4 total, 4 up, 4 in 2024-05-08T05:20:41.484 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:20:41 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-05-08T05:20:41.538 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:20:41 smithi160 ceph-mon[34827]: purged_snaps scrub starts 2024-05-08T05:20:41.539 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:20:41 smithi160 ceph-mon[34827]: purged_snaps scrub ok 2024-05-08T05:20:41.539 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:20:41 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-05-08T05:20:41.539 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:20:41 smithi160 ceph-mon[34827]: osd.3 [v2:172.21.15.87:6810/2022667023,v1:172.21.15.87:6811/2022667023] boot 2024-05-08T05:20:41.539 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:20:41 smithi160 ceph-mon[34827]: osdmap e25: 4 total, 4 up, 4 in 2024-05-08T05:20:41.539 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:20:41 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-05-08T05:20:41.908 DEBUG:teuthology.orchestra.run.smithi090:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid eeeb813e-0cf9-11ef-bc97-c7b262605968 -- ceph orch daemon add osd smithi090:vg_nvme/lv_3 2024-05-08T05:20:42.148 INFO:teuthology.orchestra.run.smithi090.stderr:Inferring config /var/lib/ceph/eeeb813e-0cf9-11ef-bc97-c7b262605968/mon.b/config 2024-05-08T05:20:42.458 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:20:42 smithi087 ceph-mon[29523]: pgmap v114: 1 pgs: 1 peering; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-05-08T05:20:42.458 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:20:42 smithi087 ceph-mon[29523]: osdmap e26: 4 total, 4 up, 4 in 2024-05-08T05:20:42.476 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:20:42 smithi090 ceph-mon[34526]: pgmap v114: 1 pgs: 1 peering; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-05-08T05:20:42.476 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:20:42 smithi090 ceph-mon[34526]: osdmap e26: 4 total, 4 up, 4 in 2024-05-08T05:20:42.539 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:20:42 smithi160 ceph-mon[34827]: pgmap v114: 1 pgs: 1 peering; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-05-08T05:20:42.539 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:20:42 smithi160 ceph-mon[34827]: osdmap e26: 4 total, 4 up, 4 in 2024-05-08T05:20:43.188 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:20:43 smithi090 ceph-mon[34526]: osdmap e27: 4 total, 4 up, 4 in 2024-05-08T05:20:43.458 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:20:43 smithi087 ceph-mon[29523]: osdmap e27: 4 total, 4 up, 4 in 2024-05-08T05:20:43.538 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:20:43 smithi160 ceph-mon[34827]: osdmap e27: 4 total, 4 up, 4 in 2024-05-08T05:20:43.681 INFO:teuthology.orchestra.run.smithi090.stderr:2024-05-08T05:20:43.680+0000 7f0a28368700 1 -- 172.21.15.90:0/4068000397 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0a20102db0 msgr2=0x7f0a20103210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:20:43.681 INFO:teuthology.orchestra.run.smithi090.stderr:2024-05-08T05:20:43.680+0000 7f0a28368700 1 --2- 172.21.15.90:0/4068000397 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0a20102db0 0x7f0a20103210 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f0a100099c0 tx=0x7f0a10009cd0 comp rx=0 tx=0).stop 2024-05-08T05:20:43.681 INFO:teuthology.orchestra.run.smithi090.stderr:2024-05-08T05:20:43.681+0000 7f0a28368700 1 -- 172.21.15.90:0/4068000397 shutdown_connections 2024-05-08T05:20:43.681 INFO:teuthology.orchestra.run.smithi090.stderr:2024-05-08T05:20:43.681+0000 7f0a28368700 1 --2- 172.21.15.90:0/4068000397 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0a20103750 0x7f0a2010a000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:20:43.681 INFO:teuthology.orchestra.run.smithi090.stderr:2024-05-08T05:20:43.681+0000 7f0a28368700 1 --2- 172.21.15.90:0/4068000397 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0a20101bb0 0x7f0a20101fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:20:43.681 INFO:teuthology.orchestra.run.smithi090.stderr:2024-05-08T05:20:43.681+0000 7f0a28368700 1 --2- 172.21.15.90:0/4068000397 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0a20102db0 0x7f0a20103210 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:20:43.681 INFO:teuthology.orchestra.run.smithi090.stderr:2024-05-08T05:20:43.681+0000 7f0a28368700 1 -- 172.21.15.90:0/4068000397 >> 172.21.15.90:0/4068000397 conn(0x7f0a200fd150 msgr2=0x7f0a200ff590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:20:43.681 INFO:teuthology.orchestra.run.smithi090.stderr:2024-05-08T05:20:43.681+0000 7f0a28368700 1 -- 172.21.15.90:0/4068000397 shutdown_connections 2024-05-08T05:20:43.681 INFO:teuthology.orchestra.run.smithi090.stderr:2024-05-08T05:20:43.681+0000 7f0a28368700 1 -- 172.21.15.90:0/4068000397 wait complete. 2024-05-08T05:20:43.683 INFO:teuthology.orchestra.run.smithi090.stderr:2024-05-08T05:20:43.681+0000 7f0a28368700 1 Processor -- start 2024-05-08T05:20:43.684 INFO:teuthology.orchestra.run.smithi090.stderr:2024-05-08T05:20:43.681+0000 7f0a28368700 1 -- start start 2024-05-08T05:20:43.684 INFO:teuthology.orchestra.run.smithi090.stderr:2024-05-08T05:20:43.682+0000 7f0a28368700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0a20101bb0 0x7f0a20104c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:20:43.684 INFO:teuthology.orchestra.run.smithi090.stderr:2024-05-08T05:20:43.682+0000 7f0a28368700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0a20102db0 0x7f0a2019e3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:20:43.684 INFO:teuthology.orchestra.run.smithi090.stderr:2024-05-08T05:20:43.682+0000 7f0a28368700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0a20103750 0x7f0a201a0a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:20:43.684 INFO:teuthology.orchestra.run.smithi090.stderr:2024-05-08T05:20:43.682+0000 7f0a28368700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f0a2010d6e0 con 0x7f0a20102db0 2024-05-08T05:20:43.684 INFO:teuthology.orchestra.run.smithi090.stderr:2024-05-08T05:20:43.682+0000 7f0a28368700 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f0a2010d560 con 0x7f0a20103750 2024-05-08T05:20:43.684 INFO:teuthology.orchestra.run.smithi090.stderr:2024-05-08T05:20:43.682+0000 7f0a28368700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f0a2010d860 con 0x7f0a20101bb0 2024-05-08T05:20:43.684 INFO:teuthology.orchestra.run.smithi090.stderr:2024-05-08T05:20:43.682+0000 7f0a26905700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0a20103750 0x7f0a201a0a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:20:43.684 INFO:teuthology.orchestra.run.smithi090.stderr:2024-05-08T05:20:43.682+0000 7f0a26905700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0a20103750 0x7f0a201a0a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:47880/0 (socket says 172.21.15.90:47880) 2024-05-08T05:20:43.684 INFO:teuthology.orchestra.run.smithi090.stderr:2024-05-08T05:20:43.682+0000 7f0a26905700 1 -- 172.21.15.90:0/185185189 learned_addr learned my addr 172.21.15.90:0/185185189 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-05-08T05:20:43.684 INFO:teuthology.orchestra.run.smithi090.stderr:2024-05-08T05:20:43.682+0000 7f0a26104700 1 --2- 172.21.15.90:0/185185189 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0a20101bb0 0x7f0a20104c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:20:43.684 INFO:teuthology.orchestra.run.smithi090.stderr:2024-05-08T05:20:43.682+0000 7f0a26905700 1 -- 172.21.15.90:0/185185189 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0a20101bb0 msgr2=0x7f0a20104c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:20:43.685 INFO:teuthology.orchestra.run.smithi090.stderr:2024-05-08T05:20:43.682+0000 7f0a26905700 1 --2- 172.21.15.90:0/185185189 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0a20101bb0 0x7f0a20104c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:20:43.685 INFO:teuthology.orchestra.run.smithi090.stderr:2024-05-08T05:20:43.682+0000 7f0a26905700 1 -- 172.21.15.90:0/185185189 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0a20102db0 msgr2=0x7f0a2019e3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:20:43.685 INFO:teuthology.orchestra.run.smithi090.stderr:2024-05-08T05:20:43.682+0000 7f0a26905700 1 --2- 172.21.15.90:0/185185189 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0a20102db0 0x7f0a2019e3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:20:43.685 INFO:teuthology.orchestra.run.smithi090.stderr:2024-05-08T05:20:43.682+0000 7f0a26905700 1 -- 172.21.15.90:0/185185189 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0a201a12e0 con 0x7f0a20103750 2024-05-08T05:20:43.685 INFO:teuthology.orchestra.run.smithi090.stderr:2024-05-08T05:20:43.682+0000 7f0a26104700 1 --2- 172.21.15.90:0/185185189 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0a20101bb0 0x7f0a20104c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T05:20:43.685 INFO:teuthology.orchestra.run.smithi090.stderr:2024-05-08T05:20:43.682+0000 7f0a26905700 1 --2- 172.21.15.90:0/185185189 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0a20103750 0x7f0a201a0a10 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f0a1800ada0 tx=0x7f0a1800c330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:20:43.685 INFO:teuthology.orchestra.run.smithi090.stderr:2024-05-08T05:20:43.682+0000 7f0a177fe700 1 -- 172.21.15.90:0/185185189 <== mon.2 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a18017020 con 0x7f0a20103750 2024-05-08T05:20:43.685 INFO:teuthology.orchestra.run.smithi090.stderr:2024-05-08T05:20:43.682+0000 7f0a28368700 1 -- 172.21.15.90:0/185185189 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0a201a15d0 con 0x7f0a20103750 2024-05-08T05:20:43.685 INFO:teuthology.orchestra.run.smithi090.stderr:2024-05-08T05:20:43.682+0000 7f0a177fe700 1 -- 172.21.15.90:0/185185189 <== mon.2 v2:172.21.15.90:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0a1800ce30 con 0x7f0a20103750 2024-05-08T05:20:43.685 INFO:teuthology.orchestra.run.smithi090.stderr:2024-05-08T05:20:43.683+0000 7f0a177fe700 1 -- 172.21.15.90:0/185185189 <== mon.2 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a180054a0 con 0x7f0a20103750 2024-05-08T05:20:43.685 INFO:teuthology.orchestra.run.smithi090.stderr:2024-05-08T05:20:43.683+0000 7f0a28368700 1 -- 172.21.15.90:0/185185189 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0a201a1b10 con 0x7f0a20103750 2024-05-08T05:20:43.685 INFO:teuthology.orchestra.run.smithi090.stderr:2024-05-08T05:20:43.683+0000 7f0a28368700 1 -- 172.21.15.90:0/185185189 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0a2006a190 con 0x7f0a20103750 2024-05-08T05:20:43.686 INFO:teuthology.orchestra.run.smithi090.stderr:2024-05-08T05:20:43.685+0000 7f0a177fe700 1 -- 172.21.15.90:0/185185189 <== mon.2 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 16) ==== 149652+0+0 (secure 0 0 0) 0x7f0a1800c980 con 0x7f0a20103750 2024-05-08T05:20:43.686 INFO:teuthology.orchestra.run.smithi090.stderr:2024-05-08T05:20:43.685+0000 7f0a177fe700 1 --2- 172.21.15.90:0/185185189 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f0a0c0b2880 0x7f0a0c0b4d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:20:43.686 INFO:teuthology.orchestra.run.smithi090.stderr:2024-05-08T05:20:43.685+0000 7f0a177fe700 1 -- 172.21.15.90:0/185185189 <== mon.2 v2:172.21.15.90:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 3669+0+0 (secure 0 0 0) 0x7f0a180e07e0 con 0x7f0a20103750 2024-05-08T05:20:43.686 INFO:teuthology.orchestra.run.smithi090.stderr:2024-05-08T05:20:43.686+0000 7f0a26104700 1 --2- 172.21.15.90:0/185185189 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f0a0c0b2880 0x7f0a0c0b4d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:20:43.687 INFO:teuthology.orchestra.run.smithi090.stderr:2024-05-08T05:20:43.687+0000 7f0a26104700 1 --2- 172.21.15.90:0/185185189 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f0a0c0b2880 0x7f0a0c0b4d40 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f0a20102c10 tx=0x7f0a1c008040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:20:43.690 INFO:teuthology.orchestra.run.smithi090.stderr:2024-05-08T05:20:43.690+0000 7f0a177fe700 1 -- 172.21.15.90:0/185185189 <== mon.2 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f0a18021020 con 0x7f0a20103750 2024-05-08T05:20:43.906 INFO:teuthology.orchestra.run.smithi090.stderr:2024-05-08T05:20:43.906+0000 7f0a28368700 1 -- 172.21.15.90:0/185185189 --> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi090:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) -- 0x7f0a200638e0 con 0x7f0a0c0b2880 2024-05-08T05:20:44.459 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:20:44 smithi087 ceph-mon[29523]: pgmap v117: 1 pgs: 1 peering; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-05-08T05:20:44.459 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:20:44 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:20:44.459 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:20:44 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:20:44.459 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:20:44 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-05-08T05:20:44.459 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:20:44 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-05-08T05:20:44.459 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:20:44 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:20:44.459 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:20:44 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T05:20:44.459 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:20:44 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T05:20:44.459 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:20:44 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:20:44.459 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:20:44 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-08T05:20:44.459 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:20:44 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-08T05:20:44.460 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:20:44 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T05:20:44.483 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:20:44 smithi090 ceph-mon[34526]: pgmap v117: 1 pgs: 1 peering; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-05-08T05:20:44.483 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:20:44 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:20:44.484 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:20:44 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:20:44.484 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:20:44 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-05-08T05:20:44.484 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:20:44 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-05-08T05:20:44.484 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:20:44 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:20:44.484 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:20:44 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T05:20:44.484 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:20:44 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T05:20:44.484 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:20:44 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:20:44.484 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:20:44 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-08T05:20:44.484 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:20:44 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-08T05:20:44.484 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:20:44 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T05:20:44.539 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:20:44 smithi160 ceph-mon[34827]: pgmap v117: 1 pgs: 1 peering; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-05-08T05:20:44.539 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:20:44 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:20:44.539 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:20:44 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:20:44.539 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:20:44 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-05-08T05:20:44.539 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:20:44 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-05-08T05:20:44.539 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:20:44 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:20:44.539 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:20:44 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T05:20:44.539 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:20:44 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T05:20:44.539 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:20:44 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:20:44.539 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:20:44 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-08T05:20:44.539 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:20:44 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-08T05:20:44.539 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:20:44 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T05:20:45.458 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:20:45 smithi087 ceph-mon[29523]: Detected new or changed devices on smithi087 2024-05-08T05:20:45.459 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:20:45 smithi087 ceph-mon[29523]: Adjusting osd_memory_target on smithi087 to 8544M 2024-05-08T05:20:45.459 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:20:45 smithi087 ceph-mon[29523]: from='client.24212 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi090:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-05-08T05:20:45.483 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:20:45 smithi090 ceph-mon[34526]: Detected new or changed devices on smithi087 2024-05-08T05:20:45.484 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:20:45 smithi090 ceph-mon[34526]: Adjusting osd_memory_target on smithi087 to 8544M 2024-05-08T05:20:45.484 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:20:45 smithi090 ceph-mon[34526]: from='client.24212 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi090:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-05-08T05:20:45.539 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:20:45 smithi160 ceph-mon[34827]: Detected new or changed devices on smithi087 2024-05-08T05:20:45.539 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:20:45 smithi160 ceph-mon[34827]: Adjusting osd_memory_target on smithi087 to 8544M 2024-05-08T05:20:45.539 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:20:45 smithi160 ceph-mon[34827]: from='client.24212 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi090:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-05-08T05:20:46.458 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:20:46 smithi087 ceph-mon[29523]: pgmap v118: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail; 102 KiB/s, 0 objects/s recovering 2024-05-08T05:20:46.486 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:20:46 smithi090 ceph-mon[34526]: pgmap v118: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail; 102 KiB/s, 0 objects/s recovering 2024-05-08T05:20:46.539 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:20:46 smithi160 ceph-mon[34827]: pgmap v118: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail; 102 KiB/s, 0 objects/s recovering 2024-05-08T05:20:47.233 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:20:47 smithi090 ceph-mon[34526]: from='client.? 172.21.15.90:0/2625823730' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "a05f7bd1-962a-4f3e-8f70-e7ef4c68bac2"}]: dispatch 2024-05-08T05:20:47.234 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:20:47 smithi090 ceph-mon[34526]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "a05f7bd1-962a-4f3e-8f70-e7ef4c68bac2"}]: dispatch 2024-05-08T05:20:47.234 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:20:47 smithi090 ceph-mon[34526]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "a05f7bd1-962a-4f3e-8f70-e7ef4c68bac2"}]': finished 2024-05-08T05:20:47.234 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:20:47 smithi090 ceph-mon[34526]: osdmap e28: 5 total, 4 up, 5 in 2024-05-08T05:20:47.234 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:20:47 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-05-08T05:20:47.458 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:20:47 smithi087 ceph-mon[29523]: from='client.? 172.21.15.90:0/2625823730' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "a05f7bd1-962a-4f3e-8f70-e7ef4c68bac2"}]: dispatch 2024-05-08T05:20:47.459 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:20:47 smithi087 ceph-mon[29523]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "a05f7bd1-962a-4f3e-8f70-e7ef4c68bac2"}]: dispatch 2024-05-08T05:20:47.459 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:20:47 smithi087 ceph-mon[29523]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "a05f7bd1-962a-4f3e-8f70-e7ef4c68bac2"}]': finished 2024-05-08T05:20:47.459 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:20:47 smithi087 ceph-mon[29523]: osdmap e28: 5 total, 4 up, 5 in 2024-05-08T05:20:47.459 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:20:47 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-05-08T05:20:47.538 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:20:47 smithi160 ceph-mon[34827]: from='client.? 172.21.15.90:0/2625823730' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "a05f7bd1-962a-4f3e-8f70-e7ef4c68bac2"}]: dispatch 2024-05-08T05:20:47.539 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:20:47 smithi160 ceph-mon[34827]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "a05f7bd1-962a-4f3e-8f70-e7ef4c68bac2"}]: dispatch 2024-05-08T05:20:47.539 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:20:47 smithi160 ceph-mon[34827]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "a05f7bd1-962a-4f3e-8f70-e7ef4c68bac2"}]': finished 2024-05-08T05:20:47.539 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:20:47 smithi160 ceph-mon[34827]: osdmap e28: 5 total, 4 up, 5 in 2024-05-08T05:20:47.539 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:20:47 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-05-08T05:20:48.458 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:20:48 smithi087 ceph-mon[29523]: pgmap v120: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-05-08T05:20:48.459 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:20:48 smithi087 ceph-mon[29523]: from='client.? 172.21.15.90:0/4133227013' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-08T05:20:48.483 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:20:48 smithi090 ceph-mon[34526]: pgmap v120: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-05-08T05:20:48.483 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:20:48 smithi090 ceph-mon[34526]: from='client.? 172.21.15.90:0/4133227013' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-08T05:20:48.539 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:20:48 smithi160 ceph-mon[34827]: pgmap v120: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-05-08T05:20:48.539 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:20:48 smithi160 ceph-mon[34827]: from='client.? 172.21.15.90:0/4133227013' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-08T05:20:50.458 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:20:50 smithi087 ceph-mon[29523]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail; 75 KiB/s, 0 objects/s recovering 2024-05-08T05:20:50.483 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:20:50 smithi090 ceph-mon[34526]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail; 75 KiB/s, 0 objects/s recovering 2024-05-08T05:20:50.538 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:20:50 smithi160 ceph-mon[34827]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail; 75 KiB/s, 0 objects/s recovering 2024-05-08T05:20:52.458 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:20:52 smithi087 ceph-mon[29523]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail; 67 KiB/s, 0 objects/s recovering 2024-05-08T05:20:52.483 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:20:52 smithi090 ceph-mon[34526]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail; 67 KiB/s, 0 objects/s recovering 2024-05-08T05:20:52.539 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:20:52 smithi160 ceph-mon[34827]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail; 67 KiB/s, 0 objects/s recovering 2024-05-08T05:20:54.459 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:20:54 smithi087 ceph-mon[29523]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-05-08T05:20:54.459 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:20:54 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-05-08T05:20:54.459 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:20:54 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T05:20:54.483 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:20:54 smithi090 ceph-mon[34526]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-05-08T05:20:54.483 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:20:54 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-05-08T05:20:54.483 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:20:54 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T05:20:54.538 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:20:54 smithi160 ceph-mon[34827]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-05-08T05:20:54.539 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:20:54 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-05-08T05:20:54.539 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:20:54 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T05:20:55.441 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:20:55 smithi090 ceph-mon[34526]: Deploying daemon osd.4 on smithi090 2024-05-08T05:20:55.538 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:20:55 smithi160 ceph-mon[34827]: Deploying daemon osd.4 on smithi090 2024-05-08T05:20:55.708 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:20:55 smithi087 ceph-mon[29523]: Deploying daemon osd.4 on smithi090 2024-05-08T05:20:56.351 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:20:56 smithi090 ceph-mon[34526]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-05-08T05:20:56.539 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:20:56 smithi160 ceph-mon[34827]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-05-08T05:20:56.708 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:20:56 smithi087 ceph-mon[29523]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-05-08T05:20:58.466 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:20:58 smithi090 ceph-mon[34526]: pgmap v125: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-05-08T05:20:58.538 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:20:58 smithi160 ceph-mon[34827]: pgmap v125: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-05-08T05:20:58.708 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:20:58 smithi087 ceph-mon[29523]: pgmap v125: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-05-08T05:21:00.268 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:21:00 smithi090 ceph-mon[34526]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-05-08T05:21:00.268 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:21:00 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:21:00.269 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:21:00 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:21:00.269 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:21:00 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T05:21:00.539 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:21:00 smithi160 ceph-mon[34827]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-05-08T05:21:00.539 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:21:00 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:21:00.539 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:21:00 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:21:00.539 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:21:00 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T05:21:00.708 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:21:00 smithi087 ceph-mon[29523]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-05-08T05:21:00.708 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:21:00 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:21:00.708 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:21:00 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:21:00.709 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:21:00 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T05:21:02.483 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:21:02 smithi090 ceph-mon[34526]: pgmap v127: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-05-08T05:21:02.538 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:21:02 smithi160 ceph-mon[34827]: pgmap v127: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-05-08T05:21:02.708 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:21:02 smithi087 ceph-mon[29523]: pgmap v127: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-05-08T05:21:03.454 INFO:teuthology.orchestra.run.smithi090.stderr:2024-05-08T05:21:03.453+0000 7f0a177fe700 1 -- 172.21.15.90:0/185185189 <== mgr.14152 v2:172.21.15.87:6800/1189186457 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f0a200638e0 con 0x7f0a0c0b2880 2024-05-08T05:21:03.455 INFO:teuthology.orchestra.run.smithi090.stdout:Created osd(s) 4 on host 'smithi090' 2024-05-08T05:21:03.457 INFO:teuthology.orchestra.run.smithi090.stderr:2024-05-08T05:21:03.456+0000 7f0a28368700 1 -- 172.21.15.90:0/185185189 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f0a0c0b2880 msgr2=0x7f0a0c0b4d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:21:03.457 INFO:teuthology.orchestra.run.smithi090.stderr:2024-05-08T05:21:03.456+0000 7f0a28368700 1 --2- 172.21.15.90:0/185185189 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f0a0c0b2880 0x7f0a0c0b4d40 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f0a20102c10 tx=0x7f0a1c008040 comp rx=0 tx=0).stop 2024-05-08T05:21:03.457 INFO:teuthology.orchestra.run.smithi090.stderr:2024-05-08T05:21:03.456+0000 7f0a28368700 1 -- 172.21.15.90:0/185185189 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0a20103750 msgr2=0x7f0a201a0a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:21:03.457 INFO:teuthology.orchestra.run.smithi090.stderr:2024-05-08T05:21:03.456+0000 7f0a28368700 1 --2- 172.21.15.90:0/185185189 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0a20103750 0x7f0a201a0a10 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f0a1800ada0 tx=0x7f0a1800c330 comp rx=0 tx=0).stop 2024-05-08T05:21:03.457 INFO:teuthology.orchestra.run.smithi090.stderr:2024-05-08T05:21:03.456+0000 7f0a28368700 1 -- 172.21.15.90:0/185185189 shutdown_connections 2024-05-08T05:21:03.457 INFO:teuthology.orchestra.run.smithi090.stderr:2024-05-08T05:21:03.456+0000 7f0a28368700 1 --2- 172.21.15.90:0/185185189 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0a20103750 0x7f0a201a0a10 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:21:03.457 INFO:teuthology.orchestra.run.smithi090.stderr:2024-05-08T05:21:03.456+0000 7f0a28368700 1 --2- 172.21.15.90:0/185185189 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f0a0c0b2880 0x7f0a0c0b4d40 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:21:03.457 INFO:teuthology.orchestra.run.smithi090.stderr:2024-05-08T05:21:03.456+0000 7f0a28368700 1 --2- 172.21.15.90:0/185185189 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0a20101bb0 0x7f0a20104c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:21:03.457 INFO:teuthology.orchestra.run.smithi090.stderr:2024-05-08T05:21:03.456+0000 7f0a28368700 1 --2- 172.21.15.90:0/185185189 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0a20102db0 0x7f0a2019e3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:21:03.457 INFO:teuthology.orchestra.run.smithi090.stderr:2024-05-08T05:21:03.456+0000 7f0a28368700 1 -- 172.21.15.90:0/185185189 >> 172.21.15.90:0/185185189 conn(0x7f0a200fd150 msgr2=0x7f0a2006b380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:21:03.458 INFO:teuthology.orchestra.run.smithi090.stderr:2024-05-08T05:21:03.456+0000 7f0a28368700 1 -- 172.21.15.90:0/185185189 shutdown_connections 2024-05-08T05:21:03.458 INFO:teuthology.orchestra.run.smithi090.stderr:2024-05-08T05:21:03.456+0000 7f0a28368700 1 -- 172.21.15.90:0/185185189 wait complete. 2024-05-08T05:21:03.734 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:21:03 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:21:03.734 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:21:03 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:21:03.734 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:21:03 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T05:21:03.734 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:21:03 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T05:21:03.734 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:21:03 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:21:03.735 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:21:03 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:21:03.735 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:21:03 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:21:03.735 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:21:03 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T05:21:03.789 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:21:03 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:21:03.789 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:21:03 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:21:03.789 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:21:03 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T05:21:03.789 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:21:03 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T05:21:03.789 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:21:03 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:21:03.789 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:21:03 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:21:03.789 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:21:03 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:21:03.789 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:21:03 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T05:21:03.958 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:21:03 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:21:03.959 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:21:03 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:21:03.959 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:21:03 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T05:21:03.959 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:21:03 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T05:21:03.959 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:21:03 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:21:03.959 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:21:03 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:21:03.959 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:21:03 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:21:03.959 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:21:03 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T05:21:04.053 DEBUG:teuthology.orchestra.run.smithi090:osd.4> sudo journalctl -f -n 0 -u ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968@osd.4.service 2024-05-08T05:21:04.055 INFO:tasks.cephadm:Deploying osd.5 on smithi160 with /dev/vg_nvme/lv_3... 2024-05-08T05:21:04.055 DEBUG:teuthology.orchestra.run.smithi160:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid eeeb813e-0cf9-11ef-bc97-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_3 2024-05-08T05:21:04.303 INFO:teuthology.orchestra.run.smithi160.stderr:Inferring config /var/lib/ceph/eeeb813e-0cf9-11ef-bc97-c7b262605968/mon.c/config 2024-05-08T05:21:04.733 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:21:04 smithi090 ceph-mon[34526]: pgmap v128: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-05-08T05:21:04.734 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:21:04 smithi090 ceph-mon[34526]: from='osd.4 [v2:172.21.15.90:6808/1371607578,v1:172.21.15.90:6809/1371607578]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-05-08T05:21:04.734 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:21:04 smithi090 ceph-mon[34526]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-05-08T05:21:04.750 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:21:04 smithi160 ceph-mon[34827]: pgmap v128: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-05-08T05:21:04.750 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:21:04 smithi160 ceph-mon[34827]: from='osd.4 [v2:172.21.15.90:6808/1371607578,v1:172.21.15.90:6809/1371607578]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-05-08T05:21:04.750 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:21:04 smithi160 ceph-mon[34827]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-05-08T05:21:04.958 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:21:04 smithi087 ceph-mon[29523]: pgmap v128: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-05-08T05:21:04.958 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:21:04 smithi087 ceph-mon[29523]: from='osd.4 [v2:172.21.15.90:6808/1371607578,v1:172.21.15.90:6809/1371607578]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-05-08T05:21:04.958 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:21:04 smithi087 ceph-mon[29523]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-05-08T05:21:05.709 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:21:05 smithi087 ceph-mon[29523]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-05-08T05:21:05.709 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:21:05 smithi087 ceph-mon[29523]: from='osd.4 [v2:172.21.15.90:6808/1371607578,v1:172.21.15.90:6809/1371607578]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi090", "root=default"]}]: dispatch 2024-05-08T05:21:05.709 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:21:05 smithi087 ceph-mon[29523]: osdmap e29: 5 total, 4 up, 5 in 2024-05-08T05:21:05.709 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:21:05 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-05-08T05:21:05.709 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:21:05 smithi087 ceph-mon[29523]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi090", "root=default"]}]: dispatch 2024-05-08T05:21:05.729 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:21:05 smithi160 ceph-mon[34827]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-05-08T05:21:05.730 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:21:05 smithi160 ceph-mon[34827]: from='osd.4 [v2:172.21.15.90:6808/1371607578,v1:172.21.15.90:6809/1371607578]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi090", "root=default"]}]: dispatch 2024-05-08T05:21:05.730 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:21:05 smithi160 ceph-mon[34827]: osdmap e29: 5 total, 4 up, 5 in 2024-05-08T05:21:05.730 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:21:05 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-05-08T05:21:05.730 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:21:05 smithi160 ceph-mon[34827]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi090", "root=default"]}]: dispatch 2024-05-08T05:21:05.733 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:21:05 smithi090 ceph-mon[34526]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-05-08T05:21:05.734 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:21:05 smithi090 ceph-mon[34526]: from='osd.4 [v2:172.21.15.90:6808/1371607578,v1:172.21.15.90:6809/1371607578]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi090", "root=default"]}]: dispatch 2024-05-08T05:21:05.734 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:21:05 smithi090 ceph-mon[34526]: osdmap e29: 5 total, 4 up, 5 in 2024-05-08T05:21:05.735 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:21:05 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-05-08T05:21:05.735 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:21:05 smithi090 ceph-mon[34526]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi090", "root=default"]}]: dispatch 2024-05-08T05:21:06.322 INFO:teuthology.orchestra.run.smithi160.stderr:--> Zapping: /dev/vg_nvme/lv_3 2024-05-08T05:21:06.322 INFO:teuthology.orchestra.run.smithi160.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_3 bs=1M count=10 conv=fsync 2024-05-08T05:21:06.322 INFO:teuthology.orchestra.run.smithi160.stderr: stderr: 10+0 records in 2024-05-08T05:21:06.322 INFO:teuthology.orchestra.run.smithi160.stderr:10+0 records out 2024-05-08T05:21:06.322 INFO:teuthology.orchestra.run.smithi160.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0112529 s, 932 MB/s 2024-05-08T05:21:06.322 INFO:teuthology.orchestra.run.smithi160.stderr:--> Zapping successful for: 2024-05-08T05:21:06.676 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:21:06 smithi160 ceph-mon[34827]: purged_snaps scrub starts 2024-05-08T05:21:06.676 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:21:06 smithi160 ceph-mon[34827]: purged_snaps scrub ok 2024-05-08T05:21:06.676 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:21:06 smithi160 ceph-mon[34827]: pgmap v130: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-05-08T05:21:06.676 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:21:06 smithi160 ceph-mon[34827]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi090", "root=default"]}]': finished 2024-05-08T05:21:06.676 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:21:06 smithi160 ceph-mon[34827]: osdmap e30: 5 total, 4 up, 5 in 2024-05-08T05:21:06.676 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:21:06 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-05-08T05:21:06.676 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:21:06 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-05-08T05:21:06.676 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:21:06 smithi160 ceph-mon[34827]: from='osd.4 ' entity='osd.4' 2024-05-08T05:21:06.677 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:21:06 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-05-08T05:21:06.733 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:21:06 smithi090 ceph-mon[34526]: purged_snaps scrub starts 2024-05-08T05:21:06.733 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:21:06 smithi090 ceph-mon[34526]: purged_snaps scrub ok 2024-05-08T05:21:06.734 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:21:06 smithi090 ceph-mon[34526]: pgmap v130: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-05-08T05:21:06.734 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:21:06 smithi090 ceph-mon[34526]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi090", "root=default"]}]': finished 2024-05-08T05:21:06.734 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:21:06 smithi090 ceph-mon[34526]: osdmap e30: 5 total, 4 up, 5 in 2024-05-08T05:21:06.734 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:21:06 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-05-08T05:21:06.734 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:21:06 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-05-08T05:21:06.734 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:21:06 smithi090 ceph-mon[34526]: from='osd.4 ' entity='osd.4' 2024-05-08T05:21:06.734 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:21:06 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-05-08T05:21:06.734 INFO:journalctl@ceph.osd.4.smithi090.stdout:May 08 05:21:06 smithi090 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-4[45654]: 2024-05-08T05:21:06.443+0000 7f0edafd6700 -1 osd.4 0 waiting for initial osdmap 2024-05-08T05:21:06.734 INFO:journalctl@ceph.osd.4.smithi090.stdout:May 08 05:21:06 smithi090 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-4[45654]: 2024-05-08T05:21:06.595+0000 7f0ed2dc1700 -1 osd.4 30 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-08T05:21:06.958 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:21:06 smithi087 ceph-mon[29523]: purged_snaps scrub starts 2024-05-08T05:21:06.959 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:21:06 smithi087 ceph-mon[29523]: purged_snaps scrub ok 2024-05-08T05:21:06.959 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:21:06 smithi087 ceph-mon[29523]: pgmap v130: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-05-08T05:21:06.959 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:21:06 smithi087 ceph-mon[29523]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi090", "root=default"]}]': finished 2024-05-08T05:21:06.959 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:21:06 smithi087 ceph-mon[29523]: osdmap e30: 5 total, 4 up, 5 in 2024-05-08T05:21:06.959 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:21:06 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-05-08T05:21:06.959 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:21:06 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-05-08T05:21:06.959 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:21:06 smithi087 ceph-mon[29523]: from='osd.4 ' entity='osd.4' 2024-05-08T05:21:06.959 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:21:06 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-05-08T05:21:06.968 DEBUG:teuthology.orchestra.run.smithi160:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid eeeb813e-0cf9-11ef-bc97-c7b262605968 -- ceph orch daemon add osd smithi160:vg_nvme/lv_3 2024-05-08T05:21:07.209 INFO:teuthology.orchestra.run.smithi160.stderr:Inferring config /var/lib/ceph/eeeb813e-0cf9-11ef-bc97-c7b262605968/mon.c/config 2024-05-08T05:21:08.182 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:21:08 smithi160 ceph-mon[34827]: pgmap v132: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-05-08T05:21:08.183 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:21:08 smithi160 ceph-mon[34827]: Detected new or changed devices on smithi090 2024-05-08T05:21:08.183 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:21:08 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:21:08.183 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:21:08 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:21:08.183 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:21:08 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-05-08T05:21:08.183 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:21:08 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-05-08T05:21:08.183 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:21:08 smithi160 ceph-mon[34827]: Adjusting osd_memory_target on smithi090 to 8544M 2024-05-08T05:21:08.183 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:21:08 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:21:08.183 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:21:08 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T05:21:08.183 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:21:08 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T05:21:08.183 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:21:08 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:21:08.183 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:21:08 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-05-08T05:21:08.184 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:21:08 smithi160 ceph-mon[34827]: osd.4 [v2:172.21.15.90:6808/1371607578,v1:172.21.15.90:6809/1371607578] boot 2024-05-08T05:21:08.184 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:21:08 smithi160 ceph-mon[34827]: osdmap e31: 5 total, 5 up, 5 in 2024-05-08T05:21:08.184 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:21:08 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-05-08T05:21:08.459 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:21:08 smithi087 ceph-mon[29523]: pgmap v132: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-05-08T05:21:08.459 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:21:08 smithi087 ceph-mon[29523]: Detected new or changed devices on smithi090 2024-05-08T05:21:08.459 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:21:08 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:21:08.459 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:21:08 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:21:08.459 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:21:08 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-05-08T05:21:08.459 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:21:08 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-05-08T05:21:08.459 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:21:08 smithi087 ceph-mon[29523]: Adjusting osd_memory_target on smithi090 to 8544M 2024-05-08T05:21:08.459 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:21:08 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:21:08.459 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:21:08 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T05:21:08.459 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:21:08 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T05:21:08.459 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:21:08 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:21:08.459 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:21:08 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-05-08T05:21:08.459 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:21:08 smithi087 ceph-mon[29523]: osd.4 [v2:172.21.15.90:6808/1371607578,v1:172.21.15.90:6809/1371607578] boot 2024-05-08T05:21:08.460 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:21:08 smithi087 ceph-mon[29523]: osdmap e31: 5 total, 5 up, 5 in 2024-05-08T05:21:08.460 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:21:08 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-05-08T05:21:08.484 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:21:08 smithi090 ceph-mon[34526]: pgmap v132: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-05-08T05:21:08.484 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:21:08 smithi090 ceph-mon[34526]: Detected new or changed devices on smithi090 2024-05-08T05:21:08.484 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:21:08 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:21:08.484 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:21:08 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:21:08.484 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:21:08 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-05-08T05:21:08.484 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:21:08 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-05-08T05:21:08.484 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:21:08 smithi090 ceph-mon[34526]: Adjusting osd_memory_target on smithi090 to 8544M 2024-05-08T05:21:08.484 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:21:08 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:21:08.484 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:21:08 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T05:21:08.484 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:21:08 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T05:21:08.484 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:21:08 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:21:08.484 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:21:08 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-05-08T05:21:08.484 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:21:08 smithi090 ceph-mon[34526]: osd.4 [v2:172.21.15.90:6808/1371607578,v1:172.21.15.90:6809/1371607578] boot 2024-05-08T05:21:08.484 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:21:08 smithi090 ceph-mon[34526]: osdmap e31: 5 total, 5 up, 5 in 2024-05-08T05:21:08.484 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:21:08 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-05-08T05:21:08.666 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-08T05:21:08.664+0000 7f706085a700 1 -- 172.21.15.160:0/1029298496 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f705c103a40 msgr2=0x7f705c103e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:21:08.666 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-08T05:21:08.664+0000 7f706085a700 1 --2- 172.21.15.160:0/1029298496 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f705c103a40 0x7f705c103e60 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f704c009990 tx=0x7f704c009ca0 comp rx=0 tx=0).stop 2024-05-08T05:21:08.666 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-08T05:21:08.664+0000 7f706085a700 1 -- 172.21.15.160:0/1029298496 shutdown_connections 2024-05-08T05:21:08.666 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-08T05:21:08.664+0000 7f706085a700 1 --2- 172.21.15.160:0/1029298496 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f705c103060 0x7f705c10a900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:21:08.666 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-08T05:21:08.664+0000 7f706085a700 1 --2- 172.21.15.160:0/1029298496 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f705c103a40 0x7f705c103e60 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:21:08.666 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-08T05:21:08.664+0000 7f706085a700 1 --2- 172.21.15.160:0/1029298496 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f705c1026a0 0x7f705c102b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:21:08.667 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-08T05:21:08.664+0000 7f706085a700 1 -- 172.21.15.160:0/1029298496 >> 172.21.15.160:0/1029298496 conn(0x7f705c0fd150 msgr2=0x7f705c0ff590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:21:08.667 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-08T05:21:08.664+0000 7f706085a700 1 -- 172.21.15.160:0/1029298496 shutdown_connections 2024-05-08T05:21:08.667 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-08T05:21:08.664+0000 7f706085a700 1 -- 172.21.15.160:0/1029298496 wait complete. 2024-05-08T05:21:08.667 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-08T05:21:08.664+0000 7f706085a700 1 Processor -- start 2024-05-08T05:21:08.667 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-08T05:21:08.665+0000 7f706085a700 1 -- start start 2024-05-08T05:21:08.667 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-08T05:21:08.665+0000 7f706085a700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f705c1026a0 0x7f705c1997d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:21:08.667 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-08T05:21:08.665+0000 7f706085a700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f705c103060 0x7f705c199d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:21:08.667 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-08T05:21:08.665+0000 7f706085a700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f705c103a40 0x7f705c1a0d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:21:08.667 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-08T05:21:08.665+0000 7f706085a700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f705c10df90 con 0x7f705c103060 2024-05-08T05:21:08.667 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-08T05:21:08.665+0000 7f706085a700 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f705c10de10 con 0x7f705c1026a0 2024-05-08T05:21:08.667 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-08T05:21:08.665+0000 7f706085a700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f705c10e110 con 0x7f705c103a40 2024-05-08T05:21:08.667 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-08T05:21:08.665+0000 7f705ad9d700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f705c103a40 0x7f705c1a0d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:21:08.667 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-08T05:21:08.665+0000 7f705ad9d700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f705c103a40 0x7f705c1a0d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.160:60214/0 (socket says 172.21.15.160:60214) 2024-05-08T05:21:08.668 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-08T05:21:08.665+0000 7f705ad9d700 1 -- 172.21.15.160:0/319738626 learned_addr learned my addr 172.21.15.160:0/319738626 (peer_addr_for_me v2:172.21.15.160:0/0) 2024-05-08T05:21:08.668 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-08T05:21:08.665+0000 7f705a59c700 1 --2- 172.21.15.160:0/319738626 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f705c1026a0 0x7f705c1997d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:21:08.668 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-08T05:21:08.665+0000 7f705ad9d700 1 -- 172.21.15.160:0/319738626 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f705c1026a0 msgr2=0x7f705c1997d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:21:08.668 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-08T05:21:08.665+0000 7f705ad9d700 1 --2- 172.21.15.160:0/319738626 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f705c1026a0 0x7f705c1997d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:21:08.668 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-08T05:21:08.665+0000 7f705ad9d700 1 -- 172.21.15.160:0/319738626 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f705c103060 msgr2=0x7f705c199d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:21:08.668 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-08T05:21:08.665+0000 7f705ad9d700 1 --2- 172.21.15.160:0/319738626 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f705c103060 0x7f705c199d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:21:08.668 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-08T05:21:08.665+0000 7f705ad9d700 1 -- 172.21.15.160:0/319738626 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f705c1a1430 con 0x7f705c103a40 2024-05-08T05:21:08.668 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-08T05:21:08.665+0000 7f705ad9d700 1 --2- 172.21.15.160:0/319738626 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f705c103a40 0x7f705c1a0d90 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f705400b9a0 tx=0x7f705400bd60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:21:08.668 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-08T05:21:08.665+0000 7f704b7fe700 1 -- 172.21.15.160:0/319738626 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7054019070 con 0x7f705c103a40 2024-05-08T05:21:08.668 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-08T05:21:08.665+0000 7f704b7fe700 1 -- 172.21.15.160:0/319738626 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7054014440 con 0x7f705c103a40 2024-05-08T05:21:08.668 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-08T05:21:08.665+0000 7f704b7fe700 1 -- 172.21.15.160:0/319738626 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f705400ce60 con 0x7f705c103a40 2024-05-08T05:21:08.668 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-08T05:21:08.666+0000 7f706085a700 1 -- 172.21.15.160:0/319738626 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f705c1a1720 con 0x7f705c103a40 2024-05-08T05:21:08.669 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-08T05:21:08.666+0000 7f706085a700 1 -- 172.21.15.160:0/319738626 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f705c1a1c90 con 0x7f705c103a40 2024-05-08T05:21:08.669 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-08T05:21:08.667+0000 7f706085a700 1 -- 172.21.15.160:0/319738626 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f705c1a1f50 con 0x7f705c103a40 2024-05-08T05:21:08.669 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-08T05:21:08.668+0000 7f704b7fe700 1 -- 172.21.15.160:0/319738626 <== mon.1 v2:172.21.15.160:3300/0 4 ==== mgrmap(e 16) ==== 149652+0+0 (secure 0 0 0) 0x7f705401c070 con 0x7f705c103a40 2024-05-08T05:21:08.669 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-08T05:21:08.668+0000 7f704b7fe700 1 --2- 172.21.15.160:0/319738626 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f70440b2900 0x7f70440b4dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:21:08.669 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-08T05:21:08.669+0000 7f704b7fe700 1 -- 172.21.15.160:0/319738626 <== mon.1 v2:172.21.15.160:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 4101+0+0 (secure 0 0 0) 0x7f70540e0a10 con 0x7f705c103a40 2024-05-08T05:21:08.670 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-08T05:21:08.669+0000 7f705a59c700 1 --2- 172.21.15.160:0/319738626 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f70440b2900 0x7f70440b4dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:21:08.670 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-08T05:21:08.670+0000 7f705a59c700 1 --2- 172.21.15.160:0/319738626 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f70440b2900 0x7f70440b4dc0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f704c0038a0 tx=0x7f704c005fd0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:21:08.673 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-08T05:21:08.672+0000 7f704b7fe700 1 -- 172.21.15.160:0/319738626 <== mon.1 v2:172.21.15.160:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f70540a9830 con 0x7f705c103a40 2024-05-08T05:21:08.888 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-08T05:21:08.887+0000 7f706085a700 1 -- 172.21.15.160:0/319738626 --> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi160:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) -- 0x7f705c101ca0 con 0x7f70440b2900 2024-05-08T05:21:09.779 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:21:09 smithi160 ceph-mon[34827]: osdmap e32: 5 total, 5 up, 5 in 2024-05-08T05:21:09.779 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:21:09 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-08T05:21:09.780 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:21:09 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-08T05:21:09.780 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:21:09 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T05:21:09.958 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:21:09 smithi087 ceph-mon[29523]: osdmap e32: 5 total, 5 up, 5 in 2024-05-08T05:21:09.958 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:21:09 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-08T05:21:09.958 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:21:09 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-08T05:21:09.959 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:21:09 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T05:21:09.983 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:21:09 smithi090 ceph-mon[34526]: osdmap e32: 5 total, 5 up, 5 in 2024-05-08T05:21:09.983 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:21:09 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-08T05:21:09.983 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:21:09 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-08T05:21:09.983 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:21:09 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T05:21:10.754 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:21:10 smithi160 ceph-mon[34827]: pgmap v135: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-05-08T05:21:10.754 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:21:10 smithi160 ceph-mon[34827]: from='client.24235 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi160:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-05-08T05:21:10.958 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:21:10 smithi087 ceph-mon[29523]: pgmap v135: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-05-08T05:21:10.958 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:21:10 smithi087 ceph-mon[29523]: from='client.24235 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi160:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-05-08T05:21:10.983 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:21:10 smithi090 ceph-mon[34526]: pgmap v135: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-05-08T05:21:10.983 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:21:10 smithi090 ceph-mon[34526]: from='client.24235 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi160:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-05-08T05:21:12.959 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:21:12 smithi087 ceph-mon[29523]: pgmap v136: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-05-08T05:21:12.959 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:21:12 smithi087 ceph-mon[29523]: from='client.? 172.21.15.160:0/1664775565' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "85e3af08-32ee-4f26-97df-8d54ba928715"}]: dispatch 2024-05-08T05:21:12.959 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:21:12 smithi087 ceph-mon[29523]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "85e3af08-32ee-4f26-97df-8d54ba928715"}]: dispatch 2024-05-08T05:21:12.959 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:21:12 smithi087 ceph-mon[29523]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "85e3af08-32ee-4f26-97df-8d54ba928715"}]': finished 2024-05-08T05:21:12.959 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:21:12 smithi087 ceph-mon[29523]: osdmap e33: 6 total, 5 up, 6 in 2024-05-08T05:21:12.959 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:21:12 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-05-08T05:21:12.959 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:21:12 smithi087 ceph-mon[29523]: from='client.? 172.21.15.160:0/2013001337' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-08T05:21:12.983 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:21:12 smithi090 ceph-mon[34526]: pgmap v136: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-05-08T05:21:12.983 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:21:12 smithi090 ceph-mon[34526]: from='client.? 172.21.15.160:0/1664775565' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "85e3af08-32ee-4f26-97df-8d54ba928715"}]: dispatch 2024-05-08T05:21:12.984 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:21:12 smithi090 ceph-mon[34526]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "85e3af08-32ee-4f26-97df-8d54ba928715"}]: dispatch 2024-05-08T05:21:12.984 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:21:12 smithi090 ceph-mon[34526]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "85e3af08-32ee-4f26-97df-8d54ba928715"}]': finished 2024-05-08T05:21:12.984 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:21:12 smithi090 ceph-mon[34526]: osdmap e33: 6 total, 5 up, 6 in 2024-05-08T05:21:12.984 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:21:12 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-05-08T05:21:12.984 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:21:12 smithi090 ceph-mon[34526]: from='client.? 172.21.15.160:0/2013001337' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-08T05:21:13.039 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:21:12 smithi160 ceph-mon[34827]: pgmap v136: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-05-08T05:21:13.039 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:21:12 smithi160 ceph-mon[34827]: from='client.? 172.21.15.160:0/1664775565' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "85e3af08-32ee-4f26-97df-8d54ba928715"}]: dispatch 2024-05-08T05:21:13.039 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:21:12 smithi160 ceph-mon[34827]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "85e3af08-32ee-4f26-97df-8d54ba928715"}]: dispatch 2024-05-08T05:21:13.039 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:21:12 smithi160 ceph-mon[34827]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "85e3af08-32ee-4f26-97df-8d54ba928715"}]': finished 2024-05-08T05:21:13.039 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:21:12 smithi160 ceph-mon[34827]: osdmap e33: 6 total, 5 up, 6 in 2024-05-08T05:21:13.039 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:21:12 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-05-08T05:21:13.039 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:21:12 smithi160 ceph-mon[34827]: from='client.? 172.21.15.160:0/2013001337' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-08T05:21:13.958 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:21:13 smithi087 ceph-mon[29523]: pgmap v138: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-05-08T05:21:13.983 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:21:13 smithi090 ceph-mon[34526]: pgmap v138: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-05-08T05:21:14.038 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:21:13 smithi160 ceph-mon[34827]: pgmap v138: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-05-08T05:21:16.208 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:21:15 smithi087 ceph-mon[29523]: pgmap v139: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-05-08T05:21:16.215 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:21:15 smithi160 ceph-mon[34827]: pgmap v139: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-05-08T05:21:16.233 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:21:15 smithi090 ceph-mon[34526]: pgmap v139: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-05-08T05:21:18.097 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:21:17 smithi160 ceph-mon[34827]: pgmap v140: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-05-08T05:21:18.208 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:21:17 smithi087 ceph-mon[29523]: pgmap v140: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-05-08T05:21:18.234 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:21:17 smithi090 ceph-mon[34526]: pgmap v140: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-05-08T05:21:20.155 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:21:19 smithi160 ceph-mon[34827]: pgmap v141: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-05-08T05:21:20.155 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:21:19 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-05-08T05:21:20.155 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:21:19 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T05:21:20.156 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:21:19 smithi160 ceph-mon[34827]: Deploying daemon osd.5 on smithi160 2024-05-08T05:21:20.208 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:21:19 smithi087 ceph-mon[29523]: pgmap v141: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-05-08T05:21:20.209 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:21:19 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-05-08T05:21:20.209 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:21:19 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T05:21:20.209 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:21:19 smithi087 ceph-mon[29523]: Deploying daemon osd.5 on smithi160 2024-05-08T05:21:20.233 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:21:19 smithi090 ceph-mon[34526]: pgmap v141: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-05-08T05:21:20.234 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:21:19 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-05-08T05:21:20.234 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:21:19 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T05:21:20.234 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:21:19 smithi090 ceph-mon[34526]: Deploying daemon osd.5 on smithi160 2024-05-08T05:21:22.208 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:21:21 smithi087 ceph-mon[29523]: pgmap v142: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-05-08T05:21:22.229 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:21:21 smithi160 ceph-mon[34827]: pgmap v142: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-05-08T05:21:22.233 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:21:21 smithi090 ceph-mon[34526]: pgmap v142: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-05-08T05:21:24.097 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:21:23 smithi160 ceph-mon[34827]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-05-08T05:21:24.208 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:21:23 smithi087 ceph-mon[29523]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-05-08T05:21:24.233 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:21:23 smithi090 ceph-mon[34526]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-05-08T05:21:25.208 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:21:24 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T05:21:25.208 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:21:24 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:21:25.208 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:21:24 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:21:25.233 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:21:24 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T05:21:25.233 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:21:24 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:21:25.233 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:21:24 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:21:25.288 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:21:24 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T05:21:25.288 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:21:24 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:21:25.288 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:21:24 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:21:26.039 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:21:25 smithi160 ceph-mon[34827]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-05-08T05:21:26.208 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:21:25 smithi087 ceph-mon[29523]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-05-08T05:21:26.233 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:21:25 smithi090 ceph-mon[34526]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-05-08T05:21:28.323 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-08T05:21:28.322+0000 7f704b7fe700 1 -- 172.21.15.160:0/319738626 <== mgr.14152 v2:172.21.15.87:6800/1189186457 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f705c101ca0 con 0x7f70440b2900 2024-05-08T05:21:28.323 INFO:teuthology.orchestra.run.smithi160.stdout:Created osd(s) 5 on host 'smithi160' 2024-05-08T05:21:28.325 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-08T05:21:28.324+0000 7f706085a700 1 -- 172.21.15.160:0/319738626 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f70440b2900 msgr2=0x7f70440b4dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:21:28.325 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-08T05:21:28.324+0000 7f706085a700 1 --2- 172.21.15.160:0/319738626 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f70440b2900 0x7f70440b4dc0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f704c0038a0 tx=0x7f704c005fd0 comp rx=0 tx=0).stop 2024-05-08T05:21:28.326 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-08T05:21:28.324+0000 7f706085a700 1 -- 172.21.15.160:0/319738626 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f705c103a40 msgr2=0x7f705c1a0d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:21:28.326 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-08T05:21:28.324+0000 7f706085a700 1 --2- 172.21.15.160:0/319738626 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f705c103a40 0x7f705c1a0d90 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f705400b9a0 tx=0x7f705400bd60 comp rx=0 tx=0).stop 2024-05-08T05:21:28.326 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-08T05:21:28.324+0000 7f706085a700 1 -- 172.21.15.160:0/319738626 shutdown_connections 2024-05-08T05:21:28.326 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-08T05:21:28.324+0000 7f706085a700 1 --2- 172.21.15.160:0/319738626 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f70440b2900 0x7f70440b4dc0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:21:28.326 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-08T05:21:28.324+0000 7f706085a700 1 --2- 172.21.15.160:0/319738626 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f705c103a40 0x7f705c1a0d90 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:21:28.326 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-08T05:21:28.324+0000 7f706085a700 1 --2- 172.21.15.160:0/319738626 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f705c1026a0 0x7f705c1997d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:21:28.326 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-08T05:21:28.324+0000 7f706085a700 1 --2- 172.21.15.160:0/319738626 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f705c103060 0x7f705c199d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:21:28.326 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-08T05:21:28.324+0000 7f706085a700 1 -- 172.21.15.160:0/319738626 >> 172.21.15.160:0/319738626 conn(0x7f705c0fd150 msgr2=0x7f705c101590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:21:28.326 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-08T05:21:28.324+0000 7f706085a700 1 -- 172.21.15.160:0/319738626 shutdown_connections 2024-05-08T05:21:28.326 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-08T05:21:28.324+0000 7f706085a700 1 -- 172.21.15.160:0/319738626 wait complete. 2024-05-08T05:21:28.733 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:21:28 smithi090 ceph-mon[34526]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-05-08T05:21:28.734 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:21:28 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:21:28.734 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:21:28 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:21:28.734 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:21:28 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T05:21:28.734 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:21:28 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T05:21:28.734 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:21:28 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:21:28.734 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:21:28 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:21:28.734 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:21:28 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T05:21:28.734 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:21:28 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:21:28.789 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:21:28 smithi160 ceph-mon[34827]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-05-08T05:21:28.789 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:21:28 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:21:28.789 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:21:28 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:21:28.789 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:21:28 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T05:21:28.789 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:21:28 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T05:21:28.789 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:21:28 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:21:28.789 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:21:28 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:21:28.789 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:21:28 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T05:21:28.789 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:21:28 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:21:28.958 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:21:28 smithi087 ceph-mon[29523]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-05-08T05:21:28.959 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:21:28 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:21:28.959 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:21:28 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:21:28.959 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:21:28 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T05:21:28.959 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:21:28 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T05:21:28.959 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:21:28 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:21:28.959 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:21:28 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:21:28.959 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:21:28 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T05:21:28.959 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:21:28 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:21:28.961 DEBUG:teuthology.orchestra.run.smithi160:osd.5> sudo journalctl -f -n 0 -u ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968@osd.5.service 2024-05-08T05:21:28.964 INFO:tasks.cephadm:Deploying osd.6 on smithi087 with /dev/vg_nvme/lv_2... 2024-05-08T05:21:28.964 DEBUG:teuthology.orchestra.run.smithi087:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid eeeb813e-0cf9-11ef-bc97-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_2 2024-05-08T05:21:29.407 INFO:teuthology.orchestra.run.smithi087.stderr:Inferring config /var/lib/ceph/eeeb813e-0cf9-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T05:21:29.539 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:21:29 smithi160 ceph-mon[34827]: from='osd.5 [v2:172.21.15.160:6808/2190054276,v1:172.21.15.160:6809/2190054276]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-05-08T05:21:29.539 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:21:29 smithi160 ceph-mon[34827]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-05-08T05:21:29.759 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:21:29 smithi087 ceph-mon[29523]: from='osd.5 [v2:172.21.15.160:6808/2190054276,v1:172.21.15.160:6809/2190054276]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-05-08T05:21:29.759 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:21:29 smithi087 ceph-mon[29523]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-05-08T05:21:29.983 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:21:29 smithi090 ceph-mon[34526]: from='osd.5 [v2:172.21.15.160:6808/2190054276,v1:172.21.15.160:6809/2190054276]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-05-08T05:21:29.983 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:21:29 smithi090 ceph-mon[34526]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-05-08T05:21:30.586 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:21:30 smithi087 ceph-mon[29523]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-05-08T05:21:30.586 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:21:30 smithi087 ceph-mon[29523]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-05-08T05:21:30.586 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:21:30 smithi087 ceph-mon[29523]: from='osd.5 [v2:172.21.15.160:6808/2190054276,v1:172.21.15.160:6809/2190054276]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi160", "root=default"]}]: dispatch 2024-05-08T05:21:30.586 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:21:30 smithi087 ceph-mon[29523]: osdmap e34: 6 total, 5 up, 6 in 2024-05-08T05:21:30.586 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:21:30 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-05-08T05:21:30.586 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:21:30 smithi087 ceph-mon[29523]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi160", "root=default"]}]: dispatch 2024-05-08T05:21:30.789 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:21:30 smithi160 ceph-mon[34827]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-05-08T05:21:30.789 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:21:30 smithi160 ceph-mon[34827]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-05-08T05:21:30.789 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:21:30 smithi160 ceph-mon[34827]: from='osd.5 [v2:172.21.15.160:6808/2190054276,v1:172.21.15.160:6809/2190054276]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi160", "root=default"]}]: dispatch 2024-05-08T05:21:30.789 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:21:30 smithi160 ceph-mon[34827]: osdmap e34: 6 total, 5 up, 6 in 2024-05-08T05:21:30.789 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:21:30 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-05-08T05:21:30.789 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:21:30 smithi160 ceph-mon[34827]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi160", "root=default"]}]: dispatch 2024-05-08T05:21:30.789 INFO:journalctl@ceph.osd.5.smithi160.stdout:May 08 05:21:30 smithi160 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-5[46734]: 2024-05-08T05:21:30.496+0000 7f6332bd7700 -1 osd.5 0 waiting for initial osdmap 2024-05-08T05:21:30.790 INFO:journalctl@ceph.osd.5.smithi160.stdout:May 08 05:21:30 smithi160 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-5[46734]: 2024-05-08T05:21:30.505+0000 7f632e9ca700 -1 osd.5 35 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-08T05:21:30.984 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:21:30 smithi090 ceph-mon[34526]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-05-08T05:21:30.984 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:21:30 smithi090 ceph-mon[34526]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-05-08T05:21:30.984 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:21:30 smithi090 ceph-mon[34526]: from='osd.5 [v2:172.21.15.160:6808/2190054276,v1:172.21.15.160:6809/2190054276]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi160", "root=default"]}]: dispatch 2024-05-08T05:21:30.984 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:21:30 smithi090 ceph-mon[34526]: osdmap e34: 6 total, 5 up, 6 in 2024-05-08T05:21:30.984 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:21:30 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-05-08T05:21:30.984 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:21:30 smithi090 ceph-mon[34526]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi160", "root=default"]}]: dispatch 2024-05-08T05:21:31.709 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:21:31 smithi087 ceph-mon[29523]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi160", "root=default"]}]': finished 2024-05-08T05:21:31.709 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:21:31 smithi087 ceph-mon[29523]: osdmap e35: 6 total, 5 up, 6 in 2024-05-08T05:21:31.709 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:21:31 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-05-08T05:21:31.709 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:21:31 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-05-08T05:21:31.709 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:21:31 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-05-08T05:21:31.788 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:21:31 smithi160 ceph-mon[34827]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi160", "root=default"]}]': finished 2024-05-08T05:21:31.789 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:21:31 smithi160 ceph-mon[34827]: osdmap e35: 6 total, 5 up, 6 in 2024-05-08T05:21:31.789 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:21:31 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-05-08T05:21:31.789 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:21:31 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-05-08T05:21:31.789 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:21:31 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-05-08T05:21:31.983 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:21:31 smithi090 ceph-mon[34526]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi160", "root=default"]}]': finished 2024-05-08T05:21:31.984 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:21:31 smithi090 ceph-mon[34526]: osdmap e35: 6 total, 5 up, 6 in 2024-05-08T05:21:31.984 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:21:31 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-05-08T05:21:31.984 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:21:31 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-05-08T05:21:31.984 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:21:31 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-05-08T05:21:32.228 INFO:teuthology.orchestra.run.smithi087.stderr:--> Zapping: /dev/vg_nvme/lv_2 2024-05-08T05:21:32.228 INFO:teuthology.orchestra.run.smithi087.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_2 bs=1M count=10 conv=fsync 2024-05-08T05:21:32.228 INFO:teuthology.orchestra.run.smithi087.stderr: stderr: 10+0 records in 2024-05-08T05:21:32.228 INFO:teuthology.orchestra.run.smithi087.stderr:10+0 records out 2024-05-08T05:21:32.228 INFO:teuthology.orchestra.run.smithi087.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.033683 s, 311 MB/s 2024-05-08T05:21:32.228 INFO:teuthology.orchestra.run.smithi087.stderr:--> Zapping successful for: 2024-05-08T05:21:32.789 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:21:32 smithi160 ceph-mon[34827]: purged_snaps scrub starts 2024-05-08T05:21:32.789 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:21:32 smithi160 ceph-mon[34827]: purged_snaps scrub ok 2024-05-08T05:21:32.789 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:21:32 smithi160 ceph-mon[34827]: pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-05-08T05:21:32.789 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:21:32 smithi160 ceph-mon[34827]: osd.5 [v2:172.21.15.160:6808/2190054276,v1:172.21.15.160:6809/2190054276] boot 2024-05-08T05:21:32.789 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:21:32 smithi160 ceph-mon[34827]: osdmap e36: 6 total, 6 up, 6 in 2024-05-08T05:21:32.789 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:21:32 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-05-08T05:21:32.789 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:21:32 smithi160 ceph-mon[34827]: osdmap e37: 6 total, 6 up, 6 in 2024-05-08T05:21:32.789 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:21:32 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:21:32.789 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:21:32 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:21:32.790 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:21:32 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-05-08T05:21:32.790 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:21:32 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-05-08T05:21:32.790 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:21:32 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:21:32.790 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:21:32 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T05:21:32.790 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:21:32 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T05:21:32.790 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:21:32 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:21:32.959 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:21:32 smithi087 ceph-mon[29523]: purged_snaps scrub starts 2024-05-08T05:21:32.959 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:21:32 smithi087 ceph-mon[29523]: purged_snaps scrub ok 2024-05-08T05:21:32.959 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:21:32 smithi087 ceph-mon[29523]: pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-05-08T05:21:32.959 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:21:32 smithi087 ceph-mon[29523]: osd.5 [v2:172.21.15.160:6808/2190054276,v1:172.21.15.160:6809/2190054276] boot 2024-05-08T05:21:32.959 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:21:32 smithi087 ceph-mon[29523]: osdmap e36: 6 total, 6 up, 6 in 2024-05-08T05:21:32.959 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:21:32 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-05-08T05:21:32.960 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:21:32 smithi087 ceph-mon[29523]: osdmap e37: 6 total, 6 up, 6 in 2024-05-08T05:21:32.960 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:21:32 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:21:32.960 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:21:32 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:21:32.960 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:21:32 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-05-08T05:21:32.960 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:21:32 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-05-08T05:21:32.960 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:21:32 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:21:32.960 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:21:32 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T05:21:32.960 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:21:32 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T05:21:32.960 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:21:32 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:21:32.984 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:21:32 smithi090 ceph-mon[34526]: purged_snaps scrub starts 2024-05-08T05:21:32.984 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:21:32 smithi090 ceph-mon[34526]: purged_snaps scrub ok 2024-05-08T05:21:32.984 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:21:32 smithi090 ceph-mon[34526]: pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-05-08T05:21:32.984 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:21:32 smithi090 ceph-mon[34526]: osd.5 [v2:172.21.15.160:6808/2190054276,v1:172.21.15.160:6809/2190054276] boot 2024-05-08T05:21:32.984 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:21:32 smithi090 ceph-mon[34526]: osdmap e36: 6 total, 6 up, 6 in 2024-05-08T05:21:32.984 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:21:32 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-05-08T05:21:32.984 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:21:32 smithi090 ceph-mon[34526]: osdmap e37: 6 total, 6 up, 6 in 2024-05-08T05:21:32.984 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:21:32 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:21:32.984 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:21:32 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:21:32.984 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:21:32 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-05-08T05:21:32.984 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:21:32 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-05-08T05:21:32.984 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:21:32 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:21:32.984 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:21:32 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T05:21:32.984 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:21:32 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T05:21:32.985 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:21:32 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:21:33.179 DEBUG:teuthology.orchestra.run.smithi087:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid eeeb813e-0cf9-11ef-bc97-c7b262605968 -- ceph orch daemon add osd smithi087:vg_nvme/lv_2 2024-05-08T05:21:33.607 INFO:teuthology.orchestra.run.smithi087.stderr:Inferring config /var/lib/ceph/eeeb813e-0cf9-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T05:21:33.789 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:21:33 smithi160 ceph-mon[34827]: Detected new or changed devices on smithi160 2024-05-08T05:21:33.789 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:21:33 smithi160 ceph-mon[34827]: Adjusting osd_memory_target on smithi160 to 8544M 2024-05-08T05:21:33.789 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:21:33 smithi160 ceph-mon[34827]: osdmap e38: 6 total, 6 up, 6 in 2024-05-08T05:21:33.909 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:21:33 smithi087 ceph-mon[29523]: Detected new or changed devices on smithi160 2024-05-08T05:21:33.909 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:21:33 smithi087 ceph-mon[29523]: Adjusting osd_memory_target on smithi160 to 8544M 2024-05-08T05:21:33.909 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:21:33 smithi087 ceph-mon[29523]: osdmap e38: 6 total, 6 up, 6 in 2024-05-08T05:21:33.983 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:21:33 smithi090 ceph-mon[34526]: Detected new or changed devices on smithi160 2024-05-08T05:21:33.983 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:21:33 smithi090 ceph-mon[34526]: Adjusting osd_memory_target on smithi160 to 8544M 2024-05-08T05:21:33.983 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:21:33 smithi090 ceph-mon[34526]: osdmap e38: 6 total, 6 up, 6 in 2024-05-08T05:21:34.788 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:21:34 smithi160 ceph-mon[34827]: pgmap v153: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-05-08T05:21:34.839 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:21:34 smithi087 ceph-mon[29523]: pgmap v153: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-05-08T05:21:34.983 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:21:34 smithi090 ceph-mon[34526]: pgmap v153: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-05-08T05:21:35.614 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:21:35.613+0000 7fa061800700 1 -- 172.21.15.87:0/3567105114 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa05c105740 msgr2=0x7fa05c105b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:21:35.615 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:21:35.613+0000 7fa061800700 1 --2- 172.21.15.87:0/3567105114 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa05c105740 0x7fa05c105b60 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fa04c009fc0 tx=0x7fa04c00b330 comp rx=0 tx=0).stop 2024-05-08T05:21:35.615 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:21:35.613+0000 7fa061800700 1 -- 172.21.15.87:0/3567105114 shutdown_connections 2024-05-08T05:21:35.615 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:21:35.613+0000 7fa061800700 1 --2- 172.21.15.87:0/3567105114 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa05c1072e0 0x7fa05c10db90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:21:35.615 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:21:35.613+0000 7fa061800700 1 --2- 172.21.15.87:0/3567105114 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa05c105740 0x7fa05c105b60 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:21:35.615 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:21:35.613+0000 7fa061800700 1 --2- 172.21.15.87:0/3567105114 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa05c106940 0x7fa05c106da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:21:35.615 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:21:35.613+0000 7fa061800700 1 -- 172.21.15.87:0/3567105114 >> 172.21.15.87:0/3567105114 conn(0x7fa05c100d00 msgr2=0x7fa05c103120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:21:35.615 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:21:35.614+0000 7fa061800700 1 -- 172.21.15.87:0/3567105114 shutdown_connections 2024-05-08T05:21:35.615 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:21:35.614+0000 7fa061800700 1 -- 172.21.15.87:0/3567105114 wait complete. 2024-05-08T05:21:35.617 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:21:35.615+0000 7fa061800700 1 Processor -- start 2024-05-08T05:21:35.617 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:21:35.615+0000 7fa061800700 1 -- start start 2024-05-08T05:21:35.617 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:21:35.616+0000 7fa061800700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa05c105740 0x7fa05c19b830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:21:35.617 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:21:35.616+0000 7fa061800700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa05c106940 0x7fa05c19bd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:21:35.617 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:21:35.616+0000 7fa061800700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa05c1072e0 0x7fa05c1a2df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:21:35.617 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:21:35.616+0000 7fa061800700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fa05c1111b0 con 0x7fa05c105740 2024-05-08T05:21:35.617 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:21:35.616+0000 7fa061800700 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fa05c111030 con 0x7fa05c1072e0 2024-05-08T05:21:35.617 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:21:35.616+0000 7fa061800700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7fa05c111330 con 0x7fa05c106940 2024-05-08T05:21:35.617 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:21:35.616+0000 7fa05aa00700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa05c105740 0x7fa05c19b830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:21:35.618 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:21:35.616+0000 7fa05aa00700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa05c105740 0x7fa05c19b830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:50950/0 (socket says 172.21.15.87:50950) 2024-05-08T05:21:35.618 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:21:35.616+0000 7fa05aa00700 1 -- 172.21.15.87:0/4177069253 learned_addr learned my addr 172.21.15.87:0/4177069253 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T05:21:35.618 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:21:35.616+0000 7fa05b400700 1 --2- 172.21.15.87:0/4177069253 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa05c1072e0 0x7fa05c1a2df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:21:35.618 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:21:35.616+0000 7fa052000700 1 --2- 172.21.15.87:0/4177069253 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa05c106940 0x7fa05c19bd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:21:35.618 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:21:35.616+0000 7fa05aa00700 1 -- 172.21.15.87:0/4177069253 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa05c106940 msgr2=0x7fa05c19bd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:21:35.618 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:21:35.616+0000 7fa05aa00700 1 --2- 172.21.15.87:0/4177069253 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa05c106940 0x7fa05c19bd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:21:35.618 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:21:35.616+0000 7fa05aa00700 1 -- 172.21.15.87:0/4177069253 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa05c1072e0 msgr2=0x7fa05c1a2df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:21:35.618 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:21:35.616+0000 7fa05aa00700 1 --2- 172.21.15.87:0/4177069253 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa05c1072e0 0x7fa05c1a2df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:21:35.618 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:21:35.616+0000 7fa05aa00700 1 -- 172.21.15.87:0/4177069253 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa05c1a3490 con 0x7fa05c105740 2024-05-08T05:21:35.618 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:21:35.616+0000 7fa05b400700 1 --2- 172.21.15.87:0/4177069253 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa05c1072e0 0x7fa05c1a2df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T05:21:35.618 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:21:35.617+0000 7fa05aa00700 1 --2- 172.21.15.87:0/4177069253 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa05c105740 0x7fa05c19b830 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fa04c00cfa0 tx=0x7fa04c00cfd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:21:35.619 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:21:35.617+0000 7fa053e00700 1 -- 172.21.15.87:0/4177069253 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa04c021070 con 0x7fa05c105740 2024-05-08T05:21:35.619 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:21:35.617+0000 7fa053e00700 1 -- 172.21.15.87:0/4177069253 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa04c007ac0 con 0x7fa05c105740 2024-05-08T05:21:35.619 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:21:35.617+0000 7fa061800700 1 -- 172.21.15.87:0/4177069253 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa05c1a3720 con 0x7fa05c105740 2024-05-08T05:21:35.619 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:21:35.617+0000 7fa053e00700 1 -- 172.21.15.87:0/4177069253 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa04c005330 con 0x7fa05c105740 2024-05-08T05:21:35.619 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:21:35.617+0000 7fa061800700 1 -- 172.21.15.87:0/4177069253 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa05c1a3c20 con 0x7fa05c105740 2024-05-08T05:21:35.619 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:21:35.619+0000 7fa061800700 1 -- 172.21.15.87:0/4177069253 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa05c06a190 con 0x7fa05c105740 2024-05-08T05:21:35.621 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:21:35.621+0000 7fa053e00700 1 -- 172.21.15.87:0/4177069253 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 16) ==== 149652+0+0 (secure 0 0 0) 0x7fa04c024070 con 0x7fa05c105740 2024-05-08T05:21:35.622 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:21:35.622+0000 7fa053e00700 1 --2- 172.21.15.87:0/4177069253 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7fa0400b2900 0x7fa0400b4dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:21:35.623 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:21:35.622+0000 7fa053e00700 1 -- 172.21.15.87:0/4177069253 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 4533+0+0 (secure 0 0 0) 0x7fa04c00f020 con 0x7fa05c105740 2024-05-08T05:21:35.623 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:21:35.622+0000 7fa052000700 1 --2- 172.21.15.87:0/4177069253 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7fa0400b2900 0x7fa0400b4dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:21:35.623 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:21:35.623+0000 7fa052000700 1 --2- 172.21.15.87:0/4177069253 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7fa0400b2900 0x7fa0400b4dc0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fa044009680 tx=0x7fa044009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:21:35.627 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:21:35.627+0000 7fa053e00700 1 -- 172.21.15.87:0/4177069253 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7fa04c02b020 con 0x7fa05c105740 2024-05-08T05:21:35.873 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:21:35.872+0000 7fa061800700 1 -- 172.21.15.87:0/4177069253 --> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi087:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) -- 0x7fa05c0638e0 con 0x7fa0400b2900 2024-05-08T05:21:36.788 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:21:36 smithi160 ceph-mon[34827]: pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail; 133 KiB/s, 0 objects/s recovering 2024-05-08T05:21:36.789 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:21:36 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-08T05:21:36.789 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:21:36 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-08T05:21:36.789 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:21:36 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T05:21:36.813 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:21:36 smithi087 ceph-mon[29523]: pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail; 133 KiB/s, 0 objects/s recovering 2024-05-08T05:21:36.813 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:21:36 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-08T05:21:36.813 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:21:36 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-08T05:21:36.813 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:21:36 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T05:21:36.984 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:21:36 smithi090 ceph-mon[34526]: pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail; 133 KiB/s, 0 objects/s recovering 2024-05-08T05:21:36.984 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:21:36 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-08T05:21:36.984 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:21:36 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-08T05:21:36.984 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:21:36 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T05:21:37.786 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:21:37 smithi160 ceph-mon[34827]: from='client.14274 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi087:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-05-08T05:21:37.856 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:21:37 smithi087 ceph-mon[29523]: from='client.14274 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi087:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-05-08T05:21:37.983 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:21:37 smithi090 ceph-mon[34526]: from='client.14274 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi087:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-05-08T05:21:38.687 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:21:38 smithi087 ceph-mon[29523]: pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-05-08T05:21:38.788 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:21:38 smithi160 ceph-mon[34827]: pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-05-08T05:21:38.983 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:21:38 smithi090 ceph-mon[34526]: pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-05-08T05:21:40.709 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:21:40 smithi087 ceph-mon[29523]: pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail; 79 KiB/s, 0 objects/s recovering 2024-05-08T05:21:40.709 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:21:40 smithi087 ceph-mon[29523]: from='client.? 172.21.15.87:0/735561222' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "df4b22a9-6cd8-473e-a17b-a0cb9ad32e98"}]: dispatch 2024-05-08T05:21:40.709 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:21:40 smithi087 ceph-mon[29523]: from='client.? 172.21.15.87:0/735561222' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "df4b22a9-6cd8-473e-a17b-a0cb9ad32e98"}]': finished 2024-05-08T05:21:40.709 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:21:40 smithi087 ceph-mon[29523]: osdmap e39: 7 total, 6 up, 7 in 2024-05-08T05:21:40.709 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:21:40 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-05-08T05:21:40.983 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:21:40 smithi090 ceph-mon[34526]: pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail; 79 KiB/s, 0 objects/s recovering 2024-05-08T05:21:40.984 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:21:40 smithi090 ceph-mon[34526]: from='client.? 172.21.15.87:0/735561222' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "df4b22a9-6cd8-473e-a17b-a0cb9ad32e98"}]: dispatch 2024-05-08T05:21:40.984 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:21:40 smithi090 ceph-mon[34526]: from='client.? 172.21.15.87:0/735561222' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "df4b22a9-6cd8-473e-a17b-a0cb9ad32e98"}]': finished 2024-05-08T05:21:40.984 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:21:40 smithi090 ceph-mon[34526]: osdmap e39: 7 total, 6 up, 7 in 2024-05-08T05:21:40.984 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:21:40 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-05-08T05:21:41.038 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:21:40 smithi160 ceph-mon[34827]: pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail; 79 KiB/s, 0 objects/s recovering 2024-05-08T05:21:41.039 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:21:40 smithi160 ceph-mon[34827]: from='client.? 172.21.15.87:0/735561222' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "df4b22a9-6cd8-473e-a17b-a0cb9ad32e98"}]: dispatch 2024-05-08T05:21:41.039 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:21:40 smithi160 ceph-mon[34827]: from='client.? 172.21.15.87:0/735561222' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "df4b22a9-6cd8-473e-a17b-a0cb9ad32e98"}]': finished 2024-05-08T05:21:41.039 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:21:40 smithi160 ceph-mon[34827]: osdmap e39: 7 total, 6 up, 7 in 2024-05-08T05:21:41.039 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:21:40 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-05-08T05:21:41.958 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:21:41 smithi087 ceph-mon[29523]: from='client.? 172.21.15.87:0/698954419' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-08T05:21:41.983 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:21:41 smithi090 ceph-mon[34526]: from='client.? 172.21.15.87:0/698954419' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-08T05:21:42.038 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:21:41 smithi160 ceph-mon[34827]: from='client.? 172.21.15.87:0/698954419' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-08T05:21:42.958 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:21:42 smithi087 ceph-mon[29523]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-05-08T05:21:42.983 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:21:42 smithi090 ceph-mon[34526]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-05-08T05:21:43.038 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:21:42 smithi160 ceph-mon[34827]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-05-08T05:21:44.958 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:21:44 smithi087 ceph-mon[29523]: pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-05-08T05:21:44.983 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:21:44 smithi090 ceph-mon[34526]: pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-05-08T05:21:45.038 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:21:44 smithi160 ceph-mon[34827]: pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-05-08T05:21:46.770 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:21:46 smithi087 ceph-mon[29523]: pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-05-08T05:21:46.983 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:21:46 smithi090 ceph-mon[34526]: pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-05-08T05:21:47.038 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:21:46 smithi160 ceph-mon[34827]: pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-05-08T05:21:47.854 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:21:47 smithi160 ceph-mon[34827]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-05-08T05:21:47.958 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:21:47 smithi087 ceph-mon[29523]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-05-08T05:21:47.983 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:21:47 smithi090 ceph-mon[34526]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-05-08T05:21:49.984 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:21:49 smithi090 ceph-mon[34526]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-05-08T05:21:49.984 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:21:49 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2024-05-08T05:21:49.984 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:21:49 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T05:21:50.208 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:21:49 smithi087 ceph-mon[29523]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-05-08T05:21:50.208 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:21:49 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2024-05-08T05:21:50.208 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:21:49 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T05:21:50.288 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:21:49 smithi160 ceph-mon[34827]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-05-08T05:21:50.289 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:21:49 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2024-05-08T05:21:50.289 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:21:49 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T05:21:50.958 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:21:50 smithi087 ceph-mon[29523]: Deploying daemon osd.6 on smithi087 2024-05-08T05:21:51.233 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:21:50 smithi090 ceph-mon[34526]: Deploying daemon osd.6 on smithi087 2024-05-08T05:21:51.288 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:21:50 smithi160 ceph-mon[34827]: Deploying daemon osd.6 on smithi087 2024-05-08T05:21:52.208 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:21:51 smithi087 ceph-mon[29523]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-05-08T05:21:52.233 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:21:51 smithi090 ceph-mon[34526]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-05-08T05:21:52.289 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:21:51 smithi160 ceph-mon[34827]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-05-08T05:21:54.173 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:21:53 smithi087 ceph-mon[29523]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-05-08T05:21:54.233 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:21:53 smithi090 ceph-mon[34526]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-05-08T05:21:54.288 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:21:53 smithi160 ceph-mon[34827]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-05-08T05:21:56.209 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:21:55 smithi087 ceph-mon[29523]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-05-08T05:21:56.233 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:21:55 smithi090 ceph-mon[34526]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-05-08T05:21:56.288 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:21:55 smithi160 ceph-mon[34827]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-05-08T05:21:58.208 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:21:57 smithi087 ceph-mon[29523]: pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-05-08T05:21:58.233 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:21:57 smithi090 ceph-mon[34526]: pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-05-08T05:21:58.288 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:21:57 smithi160 ceph-mon[34827]: pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-05-08T05:21:59.298 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:21:59 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:21:59.298 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:21:59 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:21:59.298 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:21:59 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T05:21:59.483 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:21:59 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:21:59.483 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:21:59 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:21:59.484 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:21:59 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T05:21:59.538 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:21:59 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:21:59.539 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:21:59 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:21:59.539 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:21:59 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T05:22:00.208 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:22:00 smithi087 ceph-mon[29523]: pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-05-08T05:22:00.483 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:22:00 smithi090 ceph-mon[34526]: pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-05-08T05:22:00.538 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:22:00 smithi160 ceph-mon[34827]: pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-05-08T05:22:02.355 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:22:02 smithi087 ceph-mon[29523]: pgmap v168: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-05-08T05:22:02.355 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:22:02 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:22:02.355 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:22:02 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:22:02.483 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:22:02 smithi090 ceph-mon[34526]: pgmap v168: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-05-08T05:22:02.483 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:22:02 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:22:02.484 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:22:02 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:22:02.538 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:22:02 smithi160 ceph-mon[34827]: pgmap v168: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-05-08T05:22:02.539 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:22:02 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:22:02.539 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:22:02 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:22:02.833 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:22:02.831+0000 7fa053e00700 1 -- 172.21.15.87:0/4177069253 <== mgr.14152 v2:172.21.15.87:6800/1189186457 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7fa05c0638e0 con 0x7fa0400b2900 2024-05-08T05:22:02.833 INFO:teuthology.orchestra.run.smithi087.stdout:Created osd(s) 6 on host 'smithi087' 2024-05-08T05:22:02.836 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:22:02.834+0000 7fa061800700 1 -- 172.21.15.87:0/4177069253 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7fa0400b2900 msgr2=0x7fa0400b4dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:22:02.836 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:22:02.834+0000 7fa061800700 1 --2- 172.21.15.87:0/4177069253 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7fa0400b2900 0x7fa0400b4dc0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fa044009680 tx=0x7fa044009260 comp rx=0 tx=0).stop 2024-05-08T05:22:02.836 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:22:02.834+0000 7fa061800700 1 -- 172.21.15.87:0/4177069253 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa05c105740 msgr2=0x7fa05c19b830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:22:02.837 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:22:02.834+0000 7fa061800700 1 --2- 172.21.15.87:0/4177069253 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa05c105740 0x7fa05c19b830 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fa04c00cfa0 tx=0x7fa04c00cfd0 comp rx=0 tx=0).stop 2024-05-08T05:22:02.837 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:22:02.835+0000 7fa061800700 1 -- 172.21.15.87:0/4177069253 shutdown_connections 2024-05-08T05:22:02.837 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:22:02.835+0000 7fa061800700 1 --2- 172.21.15.87:0/4177069253 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa05c1072e0 0x7fa05c1a2df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:22:02.837 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:22:02.835+0000 7fa061800700 1 --2- 172.21.15.87:0/4177069253 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa05c105740 0x7fa05c19b830 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:22:02.837 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:22:02.835+0000 7fa061800700 1 --2- 172.21.15.87:0/4177069253 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7fa0400b2900 0x7fa0400b4dc0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:22:02.837 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:22:02.835+0000 7fa061800700 1 --2- 172.21.15.87:0/4177069253 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa05c106940 0x7fa05c19bd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:22:02.837 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:22:02.835+0000 7fa061800700 1 -- 172.21.15.87:0/4177069253 >> 172.21.15.87:0/4177069253 conn(0x7fa05c100d00 msgr2=0x7fa05c109d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:22:02.837 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:22:02.835+0000 7fa061800700 1 -- 172.21.15.87:0/4177069253 shutdown_connections 2024-05-08T05:22:02.837 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:22:02.835+0000 7fa061800700 1 -- 172.21.15.87:0/4177069253 wait complete. 2024-05-08T05:22:03.458 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:22:03 smithi087 ceph-mon[29523]: from='osd.6 [v2:172.21.15.87:6818/2863681447,v1:172.21.15.87:6819/2863681447]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-05-08T05:22:03.458 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:22:03 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:22:03.458 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:22:03 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:22:03.483 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:22:03 smithi090 ceph-mon[34526]: from='osd.6 [v2:172.21.15.87:6818/2863681447,v1:172.21.15.87:6819/2863681447]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-05-08T05:22:03.483 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:22:03 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:22:03.483 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:22:03 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:22:03.538 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:22:03 smithi160 ceph-mon[34827]: from='osd.6 [v2:172.21.15.87:6818/2863681447,v1:172.21.15.87:6819/2863681447]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-05-08T05:22:03.539 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:22:03 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:22:03.539 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:22:03 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:22:03.589 DEBUG:teuthology.orchestra.run.smithi087:osd.6> sudo journalctl -f -n 0 -u ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968@osd.6.service 2024-05-08T05:22:03.593 INFO:tasks.cephadm:Deploying osd.7 on smithi090 with /dev/vg_nvme/lv_2... 2024-05-08T05:22:03.594 DEBUG:teuthology.orchestra.run.smithi090:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid eeeb813e-0cf9-11ef-bc97-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_2 2024-05-08T05:22:03.839 INFO:teuthology.orchestra.run.smithi090.stderr:Inferring config /var/lib/ceph/eeeb813e-0cf9-11ef-bc97-c7b262605968/mon.b/config 2024-05-08T05:22:04.211 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:22:04 smithi090 ceph-mon[34526]: pgmap v169: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-05-08T05:22:04.211 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:22:04 smithi090 ceph-mon[34526]: from='osd.6 [v2:172.21.15.87:6818/2863681447,v1:172.21.15.87:6819/2863681447]' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-05-08T05:22:04.211 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:22:04 smithi090 ceph-mon[34526]: osdmap e40: 7 total, 6 up, 7 in 2024-05-08T05:22:04.211 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:22:04 smithi090 ceph-mon[34526]: from='osd.6 [v2:172.21.15.87:6818/2863681447,v1:172.21.15.87:6819/2863681447]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi087", "root=default"]}]: dispatch 2024-05-08T05:22:04.211 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:22:04 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-05-08T05:22:04.458 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:22:04 smithi087 ceph-mon[29523]: pgmap v169: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-05-08T05:22:04.459 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:22:04 smithi087 ceph-mon[29523]: from='osd.6 [v2:172.21.15.87:6818/2863681447,v1:172.21.15.87:6819/2863681447]' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-05-08T05:22:04.459 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:22:04 smithi087 ceph-mon[29523]: osdmap e40: 7 total, 6 up, 7 in 2024-05-08T05:22:04.459 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:22:04 smithi087 ceph-mon[29523]: from='osd.6 [v2:172.21.15.87:6818/2863681447,v1:172.21.15.87:6819/2863681447]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi087", "root=default"]}]: dispatch 2024-05-08T05:22:04.459 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:22:04 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-05-08T05:22:04.539 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:22:04 smithi160 ceph-mon[34827]: pgmap v169: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-05-08T05:22:04.539 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:22:04 smithi160 ceph-mon[34827]: from='osd.6 [v2:172.21.15.87:6818/2863681447,v1:172.21.15.87:6819/2863681447]' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-05-08T05:22:04.539 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:22:04 smithi160 ceph-mon[34827]: osdmap e40: 7 total, 6 up, 7 in 2024-05-08T05:22:04.539 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:22:04 smithi160 ceph-mon[34827]: from='osd.6 [v2:172.21.15.87:6818/2863681447,v1:172.21.15.87:6819/2863681447]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi087", "root=default"]}]: dispatch 2024-05-08T05:22:04.539 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:22:04 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-05-08T05:22:05.234 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:22:05 smithi090 ceph-mon[34526]: purged_snaps scrub starts 2024-05-08T05:22:05.234 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:22:05 smithi090 ceph-mon[34526]: purged_snaps scrub ok 2024-05-08T05:22:05.234 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:22:05 smithi090 ceph-mon[34526]: from='osd.6 [v2:172.21.15.87:6818/2863681447,v1:172.21.15.87:6819/2863681447]' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi087", "root=default"]}]': finished 2024-05-08T05:22:05.234 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:22:05 smithi090 ceph-mon[34526]: osdmap e41: 7 total, 6 up, 7 in 2024-05-08T05:22:05.234 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:22:05 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-05-08T05:22:05.234 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:22:05 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-05-08T05:22:05.459 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:22:05 smithi087 ceph-mon[29523]: purged_snaps scrub starts 2024-05-08T05:22:05.459 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:22:05 smithi087 ceph-mon[29523]: purged_snaps scrub ok 2024-05-08T05:22:05.459 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:22:05 smithi087 ceph-mon[29523]: from='osd.6 [v2:172.21.15.87:6818/2863681447,v1:172.21.15.87:6819/2863681447]' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi087", "root=default"]}]': finished 2024-05-08T05:22:05.459 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:22:05 smithi087 ceph-mon[29523]: osdmap e41: 7 total, 6 up, 7 in 2024-05-08T05:22:05.459 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:22:05 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-05-08T05:22:05.459 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:22:05 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-05-08T05:22:05.459 INFO:journalctl@ceph.osd.6.smithi087.stdout:May 08 05:22:05 smithi087 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-6[58000]: 2024-05-08T05:22:05.294+0000 7f1ad2e00700 -1 osd.6 0 waiting for initial osdmap 2024-05-08T05:22:05.459 INFO:journalctl@ceph.osd.6.smithi087.stdout:May 08 05:22:05 smithi087 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-6[58000]: 2024-05-08T05:22:05.332+0000 7f1ac8200700 -1 osd.6 41 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-08T05:22:05.538 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:22:05 smithi160 ceph-mon[34827]: purged_snaps scrub starts 2024-05-08T05:22:05.539 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:22:05 smithi160 ceph-mon[34827]: purged_snaps scrub ok 2024-05-08T05:22:05.539 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:22:05 smithi160 ceph-mon[34827]: from='osd.6 [v2:172.21.15.87:6818/2863681447,v1:172.21.15.87:6819/2863681447]' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi087", "root=default"]}]': finished 2024-05-08T05:22:05.539 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:22:05 smithi160 ceph-mon[34827]: osdmap e41: 7 total, 6 up, 7 in 2024-05-08T05:22:05.539 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:22:05 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-05-08T05:22:05.539 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:22:05 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-05-08T05:22:05.836 INFO:teuthology.orchestra.run.smithi090.stderr:--> Zapping: /dev/vg_nvme/lv_2 2024-05-08T05:22:05.836 INFO:teuthology.orchestra.run.smithi090.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_2 bs=1M count=10 conv=fsync 2024-05-08T05:22:05.836 INFO:teuthology.orchestra.run.smithi090.stderr: stderr: 10+0 records in 2024-05-08T05:22:05.836 INFO:teuthology.orchestra.run.smithi090.stderr:10+0 records out 2024-05-08T05:22:05.836 INFO:teuthology.orchestra.run.smithi090.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0115366 s, 909 MB/s 2024-05-08T05:22:05.836 INFO:teuthology.orchestra.run.smithi090.stderr:--> Zapping successful for: 2024-05-08T05:22:06.440 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:22:06 smithi160 ceph-mon[34827]: pgmap v172: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-05-08T05:22:06.440 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:22:06 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-05-08T05:22:06.440 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:22:06 smithi160 ceph-mon[34827]: from='osd.6 [v2:172.21.15.87:6818/2863681447,v1:172.21.15.87:6819/2863681447]' entity='osd.6' 2024-05-08T05:22:06.458 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:22:06 smithi087 ceph-mon[29523]: pgmap v172: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-05-08T05:22:06.459 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:22:06 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-05-08T05:22:06.459 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:22:06 smithi087 ceph-mon[29523]: from='osd.6 [v2:172.21.15.87:6818/2863681447,v1:172.21.15.87:6819/2863681447]' entity='osd.6' 2024-05-08T05:22:06.470 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:22:06 smithi090 ceph-mon[34526]: pgmap v172: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-05-08T05:22:06.470 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:22:06 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-05-08T05:22:06.470 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:22:06 smithi090 ceph-mon[34526]: from='osd.6 [v2:172.21.15.87:6818/2863681447,v1:172.21.15.87:6819/2863681447]' entity='osd.6' 2024-05-08T05:22:06.496 DEBUG:teuthology.orchestra.run.smithi090:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid eeeb813e-0cf9-11ef-bc97-c7b262605968 -- ceph orch daemon add osd smithi090:vg_nvme/lv_2 2024-05-08T05:22:06.737 INFO:teuthology.orchestra.run.smithi090.stderr:Inferring config /var/lib/ceph/eeeb813e-0cf9-11ef-bc97-c7b262605968/mon.b/config 2024-05-08T05:22:07.437 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:22:07 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-05-08T05:22:07.437 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:22:07 smithi087 ceph-mon[29523]: osd.6 [v2:172.21.15.87:6818/2863681447,v1:172.21.15.87:6819/2863681447] boot 2024-05-08T05:22:07.437 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:22:07 smithi087 ceph-mon[29523]: osdmap e42: 7 total, 7 up, 7 in 2024-05-08T05:22:07.437 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:22:07 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-05-08T05:22:07.483 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:22:07 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-05-08T05:22:07.483 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:22:07 smithi090 ceph-mon[34526]: osd.6 [v2:172.21.15.87:6818/2863681447,v1:172.21.15.87:6819/2863681447] boot 2024-05-08T05:22:07.484 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:22:07 smithi090 ceph-mon[34526]: osdmap e42: 7 total, 7 up, 7 in 2024-05-08T05:22:07.484 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:22:07 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-05-08T05:22:07.538 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:22:07 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-05-08T05:22:07.539 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:22:07 smithi160 ceph-mon[34827]: osd.6 [v2:172.21.15.87:6818/2863681447,v1:172.21.15.87:6819/2863681447] boot 2024-05-08T05:22:07.539 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:22:07 smithi160 ceph-mon[34827]: osdmap e42: 7 total, 7 up, 7 in 2024-05-08T05:22:07.539 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:22:07 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-05-08T05:22:08.345 INFO:teuthology.orchestra.run.smithi090.stderr:2024-05-08T05:22:08.342+0000 7f9721c69700 1 -- 172.21.15.90:0/1287404221 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f971c1050a0 msgr2=0x7f971c10b950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:22:08.346 INFO:teuthology.orchestra.run.smithi090.stderr:2024-05-08T05:22:08.342+0000 7f9721c69700 1 --2- 172.21.15.90:0/1287404221 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f971c1050a0 0x7f971c10b950 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f971400b0d0 tx=0x7f971400b3e0 comp rx=0 tx=0).stop 2024-05-08T05:22:08.346 INFO:teuthology.orchestra.run.smithi090.stderr:2024-05-08T05:22:08.342+0000 7f9721c69700 1 -- 172.21.15.90:0/1287404221 shutdown_connections 2024-05-08T05:22:08.346 INFO:teuthology.orchestra.run.smithi090.stderr:2024-05-08T05:22:08.342+0000 7f9721c69700 1 --2- 172.21.15.90:0/1287404221 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f971c1050a0 0x7f971c10b950 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:22:08.346 INFO:teuthology.orchestra.run.smithi090.stderr:2024-05-08T05:22:08.342+0000 7f9721c69700 1 --2- 172.21.15.90:0/1287404221 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f971c103500 0x7f971c103920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:22:08.346 INFO:teuthology.orchestra.run.smithi090.stderr:2024-05-08T05:22:08.342+0000 7f9721c69700 1 --2- 172.21.15.90:0/1287404221 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f971c104700 0x7f971c104b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:22:08.346 INFO:teuthology.orchestra.run.smithi090.stderr:2024-05-08T05:22:08.342+0000 7f9721c69700 1 -- 172.21.15.90:0/1287404221 >> 172.21.15.90:0/1287404221 conn(0x7f971c0feaa0 msgr2=0x7f971c100ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:22:08.346 INFO:teuthology.orchestra.run.smithi090.stderr:2024-05-08T05:22:08.342+0000 7f9721c69700 1 -- 172.21.15.90:0/1287404221 shutdown_connections 2024-05-08T05:22:08.346 INFO:teuthology.orchestra.run.smithi090.stderr:2024-05-08T05:22:08.343+0000 7f9721c69700 1 -- 172.21.15.90:0/1287404221 wait complete. 2024-05-08T05:22:08.346 INFO:teuthology.orchestra.run.smithi090.stderr:2024-05-08T05:22:08.343+0000 7f9721c69700 1 Processor -- start 2024-05-08T05:22:08.346 INFO:teuthology.orchestra.run.smithi090.stderr:2024-05-08T05:22:08.343+0000 7f9721c69700 1 -- start start 2024-05-08T05:22:08.347 INFO:teuthology.orchestra.run.smithi090.stderr:2024-05-08T05:22:08.343+0000 7f9721c69700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f971c103500 0x7f971c199760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:22:08.347 INFO:teuthology.orchestra.run.smithi090.stderr:2024-05-08T05:22:08.343+0000 7f9721c69700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f971c104700 0x7f971c199ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:22:08.347 INFO:teuthology.orchestra.run.smithi090.stderr:2024-05-08T05:22:08.343+0000 7f9721c69700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f971c1050a0 0x7f971c1a0d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:22:08.347 INFO:teuthology.orchestra.run.smithi090.stderr:2024-05-08T05:22:08.343+0000 7f9721c69700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f971c10f090 con 0x7f971c103500 2024-05-08T05:22:08.347 INFO:teuthology.orchestra.run.smithi090.stderr:2024-05-08T05:22:08.343+0000 7f9721c69700 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f971c10ef10 con 0x7f971c104700 2024-05-08T05:22:08.347 INFO:teuthology.orchestra.run.smithi090.stderr:2024-05-08T05:22:08.343+0000 7f9721c69700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f971c10f210 con 0x7f971c1050a0 2024-05-08T05:22:08.347 INFO:teuthology.orchestra.run.smithi090.stderr:2024-05-08T05:22:08.344+0000 7f971affd700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f971c104700 0x7f971c199ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:22:08.347 INFO:teuthology.orchestra.run.smithi090.stderr:2024-05-08T05:22:08.344+0000 7f971affd700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f971c104700 0x7f971c199ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:54106/0 (socket says 172.21.15.90:54106) 2024-05-08T05:22:08.347 INFO:teuthology.orchestra.run.smithi090.stderr:2024-05-08T05:22:08.344+0000 7f971affd700 1 -- 172.21.15.90:0/1439498726 learned_addr learned my addr 172.21.15.90:0/1439498726 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-05-08T05:22:08.347 INFO:teuthology.orchestra.run.smithi090.stderr:2024-05-08T05:22:08.344+0000 7f971affd700 1 -- 172.21.15.90:0/1439498726 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f971c1050a0 msgr2=0x7f971c1a0d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:22:08.347 INFO:teuthology.orchestra.run.smithi090.stderr:2024-05-08T05:22:08.344+0000 7f971affd700 1 --2- 172.21.15.90:0/1439498726 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f971c1050a0 0x7f971c1a0d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:22:08.347 INFO:teuthology.orchestra.run.smithi090.stderr:2024-05-08T05:22:08.344+0000 7f971affd700 1 -- 172.21.15.90:0/1439498726 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f971c103500 msgr2=0x7f971c199760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:22:08.347 INFO:teuthology.orchestra.run.smithi090.stderr:2024-05-08T05:22:08.344+0000 7f971affd700 1 --2- 172.21.15.90:0/1439498726 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f971c103500 0x7f971c199760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:22:08.348 INFO:teuthology.orchestra.run.smithi090.stderr:2024-05-08T05:22:08.344+0000 7f971affd700 1 -- 172.21.15.90:0/1439498726 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f971c1a13c0 con 0x7f971c104700 2024-05-08T05:22:08.348 INFO:teuthology.orchestra.run.smithi090.stderr:2024-05-08T05:22:08.344+0000 7f971affd700 1 --2- 172.21.15.90:0/1439498726 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f971c104700 0x7f971c199ca0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f970c00b530 tx=0x7f970c00b8f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:22:08.348 INFO:teuthology.orchestra.run.smithi090.stderr:2024-05-08T05:22:08.344+0000 7f9718ff9700 1 -- 172.21.15.90:0/1439498726 <== mon.2 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f970c015020 con 0x7f971c104700 2024-05-08T05:22:08.348 INFO:teuthology.orchestra.run.smithi090.stderr:2024-05-08T05:22:08.344+0000 7f9718ff9700 1 -- 172.21.15.90:0/1439498726 <== mon.2 v2:172.21.15.90:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f970c011ce0 con 0x7f971c104700 2024-05-08T05:22:08.348 INFO:teuthology.orchestra.run.smithi090.stderr:2024-05-08T05:22:08.344+0000 7f9721c69700 1 -- 172.21.15.90:0/1439498726 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f971c1a16b0 con 0x7f971c104700 2024-05-08T05:22:08.348 INFO:teuthology.orchestra.run.smithi090.stderr:2024-05-08T05:22:08.344+0000 7f9718ff9700 1 -- 172.21.15.90:0/1439498726 <== mon.2 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f970c010d50 con 0x7f971c104700 2024-05-08T05:22:08.348 INFO:teuthology.orchestra.run.smithi090.stderr:2024-05-08T05:22:08.344+0000 7f9721c69700 1 -- 172.21.15.90:0/1439498726 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f971c1a1c70 con 0x7f971c104700 2024-05-08T05:22:08.349 INFO:teuthology.orchestra.run.smithi090.stderr:2024-05-08T05:22:08.345+0000 7f9721c69700 1 -- 172.21.15.90:0/1439498726 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f971c06a190 con 0x7f971c104700 2024-05-08T05:22:08.349 INFO:teuthology.orchestra.run.smithi090.stderr:2024-05-08T05:22:08.346+0000 7f9718ff9700 1 -- 172.21.15.90:0/1439498726 <== mon.2 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 16) ==== 149652+0+0 (secure 0 0 0) 0x7f970c018020 con 0x7f971c104700 2024-05-08T05:22:08.349 INFO:teuthology.orchestra.run.smithi090.stderr:2024-05-08T05:22:08.347+0000 7f9718ff9700 1 --2- 172.21.15.90:0/1439498726 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f97040b2880 0x7f97040b4d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:22:08.349 INFO:teuthology.orchestra.run.smithi090.stderr:2024-05-08T05:22:08.347+0000 7f9718ff9700 1 -- 172.21.15.90:0/1439498726 <== mon.2 v2:172.21.15.90:3300/0 5 ==== osd_map(43..43 src has 1..43) ==== 4965+0+0 (secure 0 0 0) 0x7f970c0e0d20 con 0x7f971c104700 2024-05-08T05:22:08.349 INFO:teuthology.orchestra.run.smithi090.stderr:2024-05-08T05:22:08.347+0000 7f971b7fe700 1 --2- 172.21.15.90:0/1439498726 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f97040b2880 0x7f97040b4d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:22:08.349 INFO:teuthology.orchestra.run.smithi090.stderr:2024-05-08T05:22:08.348+0000 7f971b7fe700 1 --2- 172.21.15.90:0/1439498726 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f97040b2880 0x7f97040b4d40 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f971c104560 tx=0x7f9710006d20 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:22:08.353 INFO:teuthology.orchestra.run.smithi090.stderr:2024-05-08T05:22:08.352+0000 7f9718ff9700 1 -- 172.21.15.90:0/1439498726 <== mon.2 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f970c01f020 con 0x7f971c104700 2024-05-08T05:22:08.353 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:22:08 smithi090 ceph-mon[34526]: pgmap v174: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-05-08T05:22:08.353 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:22:08 smithi090 ceph-mon[34526]: osdmap e43: 7 total, 7 up, 7 in 2024-05-08T05:22:08.565 INFO:teuthology.orchestra.run.smithi090.stderr:2024-05-08T05:22:08.564+0000 7f9721c69700 1 -- 172.21.15.90:0/1439498726 --> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi090:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) -- 0x7f971c0638e0 con 0x7f97040b2880 2024-05-08T05:22:08.708 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:22:08 smithi087 ceph-mon[29523]: pgmap v174: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-05-08T05:22:08.708 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:22:08 smithi087 ceph-mon[29523]: osdmap e43: 7 total, 7 up, 7 in 2024-05-08T05:22:08.788 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:22:08 smithi160 ceph-mon[34827]: pgmap v174: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-05-08T05:22:08.789 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:22:08 smithi160 ceph-mon[34827]: osdmap e43: 7 total, 7 up, 7 in 2024-05-08T05:22:09.484 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:22:09 smithi090 ceph-mon[34526]: Detected new or changed devices on smithi087 2024-05-08T05:22:09.484 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:22:09 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:22:09.484 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:22:09 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:22:09.484 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:22:09 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-05-08T05:22:09.484 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:22:09 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-05-08T05:22:09.484 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:22:09 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-05-08T05:22:09.484 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:22:09 smithi090 ceph-mon[34526]: Adjusting osd_memory_target on smithi087 to 5696M 2024-05-08T05:22:09.485 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:22:09 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:22:09.485 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:22:09 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T05:22:09.485 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:22:09 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T05:22:09.485 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:22:09 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:22:09.485 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:22:09 smithi090 ceph-mon[34526]: from='client.24278 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi090:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-05-08T05:22:09.485 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:22:09 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-08T05:22:09.485 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:22:09 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-08T05:22:09.485 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:22:09 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T05:22:09.485 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:22:09 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T05:22:09.485 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:22:09 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T05:22:09.485 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:22:09 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T05:22:09.485 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:22:09 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:22:09.709 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:22:09 smithi087 ceph-mon[29523]: Detected new or changed devices on smithi087 2024-05-08T05:22:09.709 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:22:09 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:22:09.709 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:22:09 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:22:09.709 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:22:09 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-05-08T05:22:09.709 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:22:09 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-05-08T05:22:09.709 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:22:09 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-05-08T05:22:09.709 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:22:09 smithi087 ceph-mon[29523]: Adjusting osd_memory_target on smithi087 to 5696M 2024-05-08T05:22:09.709 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:22:09 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:22:09.710 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:22:09 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T05:22:09.710 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:22:09 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T05:22:09.710 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:22:09 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:22:09.710 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:22:09 smithi087 ceph-mon[29523]: from='client.24278 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi090:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-05-08T05:22:09.710 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:22:09 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-08T05:22:09.710 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:22:09 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-08T05:22:09.710 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:22:09 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T05:22:09.710 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:22:09 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T05:22:09.710 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:22:09 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T05:22:09.710 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:22:09 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T05:22:09.710 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:22:09 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:22:09.789 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:22:09 smithi160 ceph-mon[34827]: Detected new or changed devices on smithi087 2024-05-08T05:22:09.789 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:22:09 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:22:09.789 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:22:09 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:22:09.789 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:22:09 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-05-08T05:22:09.789 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:22:09 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-05-08T05:22:09.789 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:22:09 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-05-08T05:22:09.789 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:22:09 smithi160 ceph-mon[34827]: Adjusting osd_memory_target on smithi087 to 5696M 2024-05-08T05:22:09.789 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:22:09 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:22:09.789 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:22:09 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T05:22:09.789 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:22:09 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T05:22:09.789 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:22:09 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:22:09.790 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:22:09 smithi160 ceph-mon[34827]: from='client.24278 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi090:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-05-08T05:22:09.790 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:22:09 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-08T05:22:09.790 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:22:09 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-08T05:22:09.790 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:22:09 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T05:22:09.790 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:22:09 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T05:22:09.790 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:22:09 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T05:22:09.790 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:22:09 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T05:22:09.790 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:22:09 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:22:10.680 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:22:10 smithi090 ceph-mon[34526]: pgmap v176: 1 pgs: 1 active+clean; 577 KiB data, 209 MiB used, 626 GiB / 626 GiB avail 2024-05-08T05:22:10.708 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:22:10 smithi087 ceph-mon[29523]: pgmap v176: 1 pgs: 1 active+clean; 577 KiB data, 209 MiB used, 626 GiB / 626 GiB avail 2024-05-08T05:22:10.788 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:22:10 smithi160 ceph-mon[34827]: pgmap v176: 1 pgs: 1 active+clean; 577 KiB data, 209 MiB used, 626 GiB / 626 GiB avail 2024-05-08T05:22:11.668 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:22:11 smithi090 ceph-mon[34526]: from='client.? 172.21.15.90:0/3968513159' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f6ef3857-0366-4408-932a-a8c8479ba780"}]: dispatch 2024-05-08T05:22:11.668 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:22:11 smithi090 ceph-mon[34526]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f6ef3857-0366-4408-932a-a8c8479ba780"}]: dispatch 2024-05-08T05:22:11.668 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:22:11 smithi090 ceph-mon[34526]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "f6ef3857-0366-4408-932a-a8c8479ba780"}]': finished 2024-05-08T05:22:11.668 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:22:11 smithi090 ceph-mon[34526]: osdmap e44: 8 total, 7 up, 8 in 2024-05-08T05:22:11.668 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:22:11 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-05-08T05:22:11.708 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:22:11 smithi087 ceph-mon[29523]: from='client.? 172.21.15.90:0/3968513159' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f6ef3857-0366-4408-932a-a8c8479ba780"}]: dispatch 2024-05-08T05:22:11.709 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:22:11 smithi087 ceph-mon[29523]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f6ef3857-0366-4408-932a-a8c8479ba780"}]: dispatch 2024-05-08T05:22:11.709 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:22:11 smithi087 ceph-mon[29523]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "f6ef3857-0366-4408-932a-a8c8479ba780"}]': finished 2024-05-08T05:22:11.709 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:22:11 smithi087 ceph-mon[29523]: osdmap e44: 8 total, 7 up, 8 in 2024-05-08T05:22:11.709 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:22:11 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-05-08T05:22:11.788 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:22:11 smithi160 ceph-mon[34827]: from='client.? 172.21.15.90:0/3968513159' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f6ef3857-0366-4408-932a-a8c8479ba780"}]: dispatch 2024-05-08T05:22:11.789 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:22:11 smithi160 ceph-mon[34827]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f6ef3857-0366-4408-932a-a8c8479ba780"}]: dispatch 2024-05-08T05:22:11.789 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:22:11 smithi160 ceph-mon[34827]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "f6ef3857-0366-4408-932a-a8c8479ba780"}]': finished 2024-05-08T05:22:11.789 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:22:11 smithi160 ceph-mon[34827]: osdmap e44: 8 total, 7 up, 8 in 2024-05-08T05:22:11.789 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:22:11 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-05-08T05:22:12.708 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:22:12 smithi087 ceph-mon[29523]: pgmap v177: 1 pgs: 1 active+clean; 577 KiB data, 209 MiB used, 626 GiB / 626 GiB avail 2024-05-08T05:22:12.708 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:22:12 smithi087 ceph-mon[29523]: from='client.? 172.21.15.90:0/3882283901' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-08T05:22:12.733 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:22:12 smithi090 ceph-mon[34526]: pgmap v177: 1 pgs: 1 active+clean; 577 KiB data, 209 MiB used, 626 GiB / 626 GiB avail 2024-05-08T05:22:12.733 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:22:12 smithi090 ceph-mon[34526]: from='client.? 172.21.15.90:0/3882283901' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-08T05:22:12.788 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:22:12 smithi160 ceph-mon[34827]: pgmap v177: 1 pgs: 1 active+clean; 577 KiB data, 209 MiB used, 626 GiB / 626 GiB avail 2024-05-08T05:22:12.788 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:22:12 smithi160 ceph-mon[34827]: from='client.? 172.21.15.90:0/3882283901' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-08T05:22:14.708 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:22:14 smithi087 ceph-mon[29523]: pgmap v179: 1 pgs: 1 active+clean; 577 KiB data, 209 MiB used, 626 GiB / 626 GiB avail 2024-05-08T05:22:14.733 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:22:14 smithi090 ceph-mon[34526]: pgmap v179: 1 pgs: 1 active+clean; 577 KiB data, 209 MiB used, 626 GiB / 626 GiB avail 2024-05-08T05:22:14.788 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:22:14 smithi160 ceph-mon[34827]: pgmap v179: 1 pgs: 1 active+clean; 577 KiB data, 209 MiB used, 626 GiB / 626 GiB avail 2024-05-08T05:22:16.515 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:22:16 smithi090 ceph-mon[34526]: pgmap v180: 1 pgs: 1 active+clean; 577 KiB data, 209 MiB used, 626 GiB / 626 GiB avail 2024-05-08T05:22:16.708 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:22:16 smithi087 ceph-mon[29523]: pgmap v180: 1 pgs: 1 active+clean; 577 KiB data, 209 MiB used, 626 GiB / 626 GiB avail 2024-05-08T05:22:16.788 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:22:16 smithi160 ceph-mon[34827]: pgmap v180: 1 pgs: 1 active+clean; 577 KiB data, 209 MiB used, 626 GiB / 626 GiB avail 2024-05-08T05:22:18.690 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:22:18 smithi090 ceph-mon[34526]: pgmap v181: 1 pgs: 1 active+clean; 577 KiB data, 209 MiB used, 626 GiB / 626 GiB avail 2024-05-08T05:22:18.708 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:22:18 smithi087 ceph-mon[29523]: pgmap v181: 1 pgs: 1 active+clean; 577 KiB data, 209 MiB used, 626 GiB / 626 GiB avail 2024-05-08T05:22:18.788 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:22:18 smithi160 ceph-mon[34827]: pgmap v181: 1 pgs: 1 active+clean; 577 KiB data, 209 MiB used, 626 GiB / 626 GiB avail 2024-05-08T05:22:19.618 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:22:19 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2024-05-08T05:22:19.619 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:22:19 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T05:22:19.708 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:22:19 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2024-05-08T05:22:19.708 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:22:19 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T05:22:19.788 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:22:19 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2024-05-08T05:22:19.789 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:22:19 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T05:22:20.693 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:22:20 smithi090 ceph-mon[34526]: Deploying daemon osd.7 on smithi090 2024-05-08T05:22:20.693 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:22:20 smithi090 ceph-mon[34526]: pgmap v182: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-05-08T05:22:20.708 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:22:20 smithi087 ceph-mon[29523]: Deploying daemon osd.7 on smithi090 2024-05-08T05:22:20.708 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:22:20 smithi087 ceph-mon[29523]: pgmap v182: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-05-08T05:22:20.789 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:22:20 smithi160 ceph-mon[34827]: Deploying daemon osd.7 on smithi090 2024-05-08T05:22:20.789 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:22:20 smithi160 ceph-mon[34827]: pgmap v182: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-05-08T05:22:22.708 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:22:22 smithi087 ceph-mon[29523]: pgmap v183: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-05-08T05:22:22.734 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:22:22 smithi090 ceph-mon[34526]: pgmap v183: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-05-08T05:22:22.788 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:22:22 smithi160 ceph-mon[34827]: pgmap v183: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-05-08T05:22:24.708 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:22:24 smithi087 ceph-mon[29523]: pgmap v184: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-05-08T05:22:24.709 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:22:24 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:22:24.709 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:22:24 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:22:24.709 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:22:24 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T05:22:24.726 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:22:24 smithi090 ceph-mon[34526]: pgmap v184: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-05-08T05:22:24.726 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:22:24 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:22:24.727 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:22:24 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:22:24.727 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:22:24 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T05:22:24.789 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:22:24 smithi160 ceph-mon[34827]: pgmap v184: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-05-08T05:22:24.789 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:22:24 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:22:24.789 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:22:24 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:22:24.789 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:22:24 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T05:22:26.709 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:22:26 smithi087 ceph-mon[29523]: pgmap v185: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-05-08T05:22:26.733 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:22:26 smithi090 ceph-mon[34526]: pgmap v185: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-05-08T05:22:26.788 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:22:26 smithi160 ceph-mon[34827]: pgmap v185: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-05-08T05:22:28.104 INFO:teuthology.orchestra.run.smithi090.stderr:2024-05-08T05:22:28.103+0000 7f9718ff9700 1 -- 172.21.15.90:0/1439498726 <== mgr.14152 v2:172.21.15.87:6800/1189186457 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f971c0638e0 con 0x7f97040b2880 2024-05-08T05:22:28.104 INFO:teuthology.orchestra.run.smithi090.stdout:Created osd(s) 7 on host 'smithi090' 2024-05-08T05:22:28.106 INFO:teuthology.orchestra.run.smithi090.stderr:2024-05-08T05:22:28.105+0000 7f9721c69700 1 -- 172.21.15.90:0/1439498726 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f97040b2880 msgr2=0x7f97040b4d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:22:28.106 INFO:teuthology.orchestra.run.smithi090.stderr:2024-05-08T05:22:28.105+0000 7f9721c69700 1 --2- 172.21.15.90:0/1439498726 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f97040b2880 0x7f97040b4d40 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f971c104560 tx=0x7f9710006d20 comp rx=0 tx=0).stop 2024-05-08T05:22:28.107 INFO:teuthology.orchestra.run.smithi090.stderr:2024-05-08T05:22:28.105+0000 7f9721c69700 1 -- 172.21.15.90:0/1439498726 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f971c104700 msgr2=0x7f971c199ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:22:28.107 INFO:teuthology.orchestra.run.smithi090.stderr:2024-05-08T05:22:28.105+0000 7f9721c69700 1 --2- 172.21.15.90:0/1439498726 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f971c104700 0x7f971c199ca0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f970c00b530 tx=0x7f970c00b8f0 comp rx=0 tx=0).stop 2024-05-08T05:22:28.107 INFO:teuthology.orchestra.run.smithi090.stderr:2024-05-08T05:22:28.105+0000 7f9721c69700 1 -- 172.21.15.90:0/1439498726 shutdown_connections 2024-05-08T05:22:28.107 INFO:teuthology.orchestra.run.smithi090.stderr:2024-05-08T05:22:28.105+0000 7f9721c69700 1 --2- 172.21.15.90:0/1439498726 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f97040b2880 0x7f97040b4d40 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:22:28.107 INFO:teuthology.orchestra.run.smithi090.stderr:2024-05-08T05:22:28.105+0000 7f9721c69700 1 --2- 172.21.15.90:0/1439498726 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f971c1050a0 0x7f971c1a0d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:22:28.107 INFO:teuthology.orchestra.run.smithi090.stderr:2024-05-08T05:22:28.105+0000 7f9721c69700 1 --2- 172.21.15.90:0/1439498726 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f971c103500 0x7f971c199760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:22:28.107 INFO:teuthology.orchestra.run.smithi090.stderr:2024-05-08T05:22:28.105+0000 7f9721c69700 1 --2- 172.21.15.90:0/1439498726 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f971c104700 0x7f971c199ca0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:22:28.107 INFO:teuthology.orchestra.run.smithi090.stderr:2024-05-08T05:22:28.105+0000 7f9721c69700 1 -- 172.21.15.90:0/1439498726 >> 172.21.15.90:0/1439498726 conn(0x7f971c0feaa0 msgr2=0x7f971c107b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:22:28.107 INFO:teuthology.orchestra.run.smithi090.stderr:2024-05-08T05:22:28.105+0000 7f9721c69700 1 -- 172.21.15.90:0/1439498726 shutdown_connections 2024-05-08T05:22:28.107 INFO:teuthology.orchestra.run.smithi090.stderr:2024-05-08T05:22:28.105+0000 7f9721c69700 1 -- 172.21.15.90:0/1439498726 wait complete. 2024-05-08T05:22:28.409 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:22:28 smithi090 ceph-mon[34526]: pgmap v186: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-05-08T05:22:28.409 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:22:28 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:22:28.409 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:22:28 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:22:28.409 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:22:28 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T05:22:28.409 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:22:28 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T05:22:28.409 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:22:28 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:22:28.409 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:22:28 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:22:28.409 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:22:28 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:22:28.409 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:22:28 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T05:22:28.409 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:22:28 smithi090 ceph-mon[34526]: from='osd.7 [v2:172.21.15.90:6816/1964248958,v1:172.21.15.90:6817/1964248958]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-05-08T05:22:28.410 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:22:28 smithi090 ceph-mon[34526]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-05-08T05:22:28.539 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:22:28 smithi160 ceph-mon[34827]: pgmap v186: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-05-08T05:22:28.539 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:22:28 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:22:28.539 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:22:28 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:22:28.539 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:22:28 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T05:22:28.539 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:22:28 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T05:22:28.539 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:22:28 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:22:28.539 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:22:28 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:22:28.539 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:22:28 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:22:28.539 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:22:28 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T05:22:28.539 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:22:28 smithi160 ceph-mon[34827]: from='osd.7 [v2:172.21.15.90:6816/1964248958,v1:172.21.15.90:6817/1964248958]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-05-08T05:22:28.540 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:22:28 smithi160 ceph-mon[34827]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-05-08T05:22:28.709 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:22:28 smithi087 ceph-mon[29523]: pgmap v186: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-05-08T05:22:28.709 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:22:28 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:22:28.709 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:22:28 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:22:28.709 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:22:28 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T05:22:28.709 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:22:28 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T05:22:28.709 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:22:28 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:22:28.709 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:22:28 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:22:28.709 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:22:28 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:22:28.709 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:22:28 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T05:22:28.709 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:22:28 smithi087 ceph-mon[29523]: from='osd.7 [v2:172.21.15.90:6816/1964248958,v1:172.21.15.90:6817/1964248958]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-05-08T05:22:28.709 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:22:28 smithi087 ceph-mon[29523]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-05-08T05:22:28.787 DEBUG:teuthology.orchestra.run.smithi090:osd.7> sudo journalctl -f -n 0 -u ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968@osd.7.service 2024-05-08T05:22:28.789 INFO:tasks.cephadm:Deploying osd.8 on smithi160 with /dev/vg_nvme/lv_2... 2024-05-08T05:22:28.789 DEBUG:teuthology.orchestra.run.smithi160:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid eeeb813e-0cf9-11ef-bc97-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_2 2024-05-08T05:22:29.033 INFO:teuthology.orchestra.run.smithi160.stderr:Inferring config /var/lib/ceph/eeeb813e-0cf9-11ef-bc97-c7b262605968/mon.c/config 2024-05-08T05:22:30.226 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:22:30 smithi090 ceph-mon[34526]: pgmap v187: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-05-08T05:22:30.226 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:22:30 smithi090 ceph-mon[34526]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-05-08T05:22:30.226 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:22:30 smithi090 ceph-mon[34526]: from='osd.7 [v2:172.21.15.90:6816/1964248958,v1:172.21.15.90:6817/1964248958]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi090", "root=default"]}]: dispatch 2024-05-08T05:22:30.226 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:22:30 smithi090 ceph-mon[34526]: osdmap e45: 8 total, 7 up, 8 in 2024-05-08T05:22:30.226 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:22:30 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-05-08T05:22:30.226 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:22:30 smithi090 ceph-mon[34526]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi090", "root=default"]}]: dispatch 2024-05-08T05:22:30.326 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:22:30 smithi160 ceph-mon[34827]: pgmap v187: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-05-08T05:22:30.326 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:22:30 smithi160 ceph-mon[34827]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-05-08T05:22:30.326 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:22:30 smithi160 ceph-mon[34827]: from='osd.7 [v2:172.21.15.90:6816/1964248958,v1:172.21.15.90:6817/1964248958]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi090", "root=default"]}]: dispatch 2024-05-08T05:22:30.327 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:22:30 smithi160 ceph-mon[34827]: osdmap e45: 8 total, 7 up, 8 in 2024-05-08T05:22:30.327 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:22:30 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-05-08T05:22:30.327 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:22:30 smithi160 ceph-mon[34827]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi090", "root=default"]}]: dispatch 2024-05-08T05:22:30.458 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:22:30 smithi087 ceph-mon[29523]: pgmap v187: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-05-08T05:22:30.459 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:22:30 smithi087 ceph-mon[29523]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-05-08T05:22:30.459 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:22:30 smithi087 ceph-mon[29523]: from='osd.7 [v2:172.21.15.90:6816/1964248958,v1:172.21.15.90:6817/1964248958]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi090", "root=default"]}]: dispatch 2024-05-08T05:22:30.459 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:22:30 smithi087 ceph-mon[29523]: osdmap e45: 8 total, 7 up, 8 in 2024-05-08T05:22:30.459 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:22:30 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-05-08T05:22:30.459 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:22:30 smithi087 ceph-mon[29523]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi090", "root=default"]}]: dispatch 2024-05-08T05:22:30.900 INFO:teuthology.orchestra.run.smithi160.stderr:--> Zapping: /dev/vg_nvme/lv_2 2024-05-08T05:22:30.901 INFO:teuthology.orchestra.run.smithi160.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_2 bs=1M count=10 conv=fsync 2024-05-08T05:22:30.901 INFO:teuthology.orchestra.run.smithi160.stderr: stderr: 10+0 records in 2024-05-08T05:22:30.901 INFO:teuthology.orchestra.run.smithi160.stderr:10+0 records out 2024-05-08T05:22:30.901 INFO:teuthology.orchestra.run.smithi160.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0114944 s, 912 MB/s 2024-05-08T05:22:30.901 INFO:teuthology.orchestra.run.smithi160.stderr: stderr: 2024-05-08T05:22:30.901 INFO:teuthology.orchestra.run.smithi160.stderr:--> Zapping successful for: 2024-05-08T05:22:31.458 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:22:31 smithi087 ceph-mon[29523]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi090", "root=default"]}]': finished 2024-05-08T05:22:31.459 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:22:31 smithi087 ceph-mon[29523]: osdmap e46: 8 total, 7 up, 8 in 2024-05-08T05:22:31.459 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:22:31 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-05-08T05:22:31.459 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:22:31 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-05-08T05:22:31.459 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:22:31 smithi087 ceph-mon[29523]: from='osd.7 ' entity='osd.7' 2024-05-08T05:22:31.483 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:22:31 smithi090 ceph-mon[34526]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi090", "root=default"]}]': finished 2024-05-08T05:22:31.484 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:22:31 smithi090 ceph-mon[34526]: osdmap e46: 8 total, 7 up, 8 in 2024-05-08T05:22:31.484 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:22:31 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-05-08T05:22:31.484 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:22:31 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-05-08T05:22:31.484 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:22:31 smithi090 ceph-mon[34526]: from='osd.7 ' entity='osd.7' 2024-05-08T05:22:31.484 INFO:journalctl@ceph.osd.7.smithi090.stdout:May 08 05:22:31 smithi090 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-7[52517]: 2024-05-08T05:22:31.061+0000 7f2f29cb7700 -1 osd.7 0 waiting for initial osdmap 2024-05-08T05:22:31.484 INFO:journalctl@ceph.osd.7.smithi090.stdout:May 08 05:22:31 smithi090 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-7[52517]: 2024-05-08T05:22:31.202+0000 7f2f21aa2700 -1 osd.7 47 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-08T05:22:31.530 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:22:31 smithi160 ceph-mon[34827]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi090", "root=default"]}]': finished 2024-05-08T05:22:31.530 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:22:31 smithi160 ceph-mon[34827]: osdmap e46: 8 total, 7 up, 8 in 2024-05-08T05:22:31.530 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:22:31 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-05-08T05:22:31.530 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:22:31 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-05-08T05:22:31.531 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:22:31 smithi160 ceph-mon[34827]: from='osd.7 ' entity='osd.7' 2024-05-08T05:22:31.558 DEBUG:teuthology.orchestra.run.smithi160:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid eeeb813e-0cf9-11ef-bc97-c7b262605968 -- ceph orch daemon add osd smithi160:vg_nvme/lv_2 2024-05-08T05:22:31.801 INFO:teuthology.orchestra.run.smithi160.stderr:Inferring config /var/lib/ceph/eeeb813e-0cf9-11ef-bc97-c7b262605968/mon.c/config 2024-05-08T05:22:32.459 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:22:32 smithi087 ceph-mon[29523]: purged_snaps scrub starts 2024-05-08T05:22:32.459 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:22:32 smithi087 ceph-mon[29523]: purged_snaps scrub ok 2024-05-08T05:22:32.459 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:22:32 smithi087 ceph-mon[29523]: pgmap v190: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-05-08T05:22:32.459 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:22:32 smithi087 ceph-mon[29523]: osdmap e47: 8 total, 7 up, 8 in 2024-05-08T05:22:32.459 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:22:32 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-05-08T05:22:32.459 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:22:32 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:22:32.459 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:22:32 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:22:32.459 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:22:32 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-05-08T05:22:32.460 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:22:32 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-05-08T05:22:32.460 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:22:32 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-05-08T05:22:32.460 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:22:32 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:22:32.460 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:22:32 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T05:22:32.460 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:22:32 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T05:22:32.460 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:22:32 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:22:32.460 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:22:32 smithi087 ceph-mon[29523]: osd.7 [v2:172.21.15.90:6816/1964248958,v1:172.21.15.90:6817/1964248958] boot 2024-05-08T05:22:32.460 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:22:32 smithi087 ceph-mon[29523]: osdmap e48: 8 total, 8 up, 8 in 2024-05-08T05:22:32.460 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:22:32 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-05-08T05:22:32.484 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:22:32 smithi090 ceph-mon[34526]: purged_snaps scrub starts 2024-05-08T05:22:32.484 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:22:32 smithi090 ceph-mon[34526]: purged_snaps scrub ok 2024-05-08T05:22:32.484 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:22:32 smithi090 ceph-mon[34526]: pgmap v190: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-05-08T05:22:32.484 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:22:32 smithi090 ceph-mon[34526]: osdmap e47: 8 total, 7 up, 8 in 2024-05-08T05:22:32.484 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:22:32 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-05-08T05:22:32.484 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:22:32 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:22:32.484 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:22:32 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:22:32.484 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:22:32 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-05-08T05:22:32.484 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:22:32 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-05-08T05:22:32.484 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:22:32 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-05-08T05:22:32.484 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:22:32 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:22:32.484 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:22:32 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T05:22:32.484 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:22:32 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T05:22:32.485 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:22:32 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:22:32.485 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:22:32 smithi090 ceph-mon[34526]: osd.7 [v2:172.21.15.90:6816/1964248958,v1:172.21.15.90:6817/1964248958] boot 2024-05-08T05:22:32.485 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:22:32 smithi090 ceph-mon[34526]: osdmap e48: 8 total, 8 up, 8 in 2024-05-08T05:22:32.485 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:22:32 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-05-08T05:22:32.539 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:22:32 smithi160 ceph-mon[34827]: purged_snaps scrub starts 2024-05-08T05:22:32.539 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:22:32 smithi160 ceph-mon[34827]: purged_snaps scrub ok 2024-05-08T05:22:32.539 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:22:32 smithi160 ceph-mon[34827]: pgmap v190: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-05-08T05:22:32.539 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:22:32 smithi160 ceph-mon[34827]: osdmap e47: 8 total, 7 up, 8 in 2024-05-08T05:22:32.539 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:22:32 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-05-08T05:22:32.539 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:22:32 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:22:32.539 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:22:32 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:22:32.539 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:22:32 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-05-08T05:22:32.539 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:22:32 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-05-08T05:22:32.539 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:22:32 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-05-08T05:22:32.539 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:22:32 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:22:32.539 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:22:32 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T05:22:32.540 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:22:32 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T05:22:32.540 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:22:32 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:22:32.540 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:22:32 smithi160 ceph-mon[34827]: osd.7 [v2:172.21.15.90:6816/1964248958,v1:172.21.15.90:6817/1964248958] boot 2024-05-08T05:22:32.540 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:22:32 smithi160 ceph-mon[34827]: osdmap e48: 8 total, 8 up, 8 in 2024-05-08T05:22:32.540 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:22:32 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-05-08T05:22:33.168 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:22:33 smithi160 ceph-mon[34827]: Detected new or changed devices on smithi090 2024-05-08T05:22:33.168 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:22:33 smithi160 ceph-mon[34827]: Adjusting osd_memory_target on smithi090 to 5696M 2024-05-08T05:22:33.169 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:22:33 smithi160 ceph-mon[34827]: osdmap e49: 8 total, 8 up, 8 in 2024-05-08T05:22:33.378 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-08T05:22:33.374+0000 7f2cbc11d700 1 -- 172.21.15.160:0/2238897723 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2cb41046f0 msgr2=0x7f2cb4104b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:22:33.378 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-08T05:22:33.374+0000 7f2cbc11d700 1 --2- 172.21.15.160:0/2238897723 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2cb41046f0 0x7f2cb4104b50 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f2cb0009990 tx=0x7f2cb0009ca0 comp rx=0 tx=0).stop 2024-05-08T05:22:33.378 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-08T05:22:33.374+0000 7f2cbc11d700 1 -- 172.21.15.160:0/2238897723 shutdown_connections 2024-05-08T05:22:33.378 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-08T05:22:33.374+0000 7f2cbc11d700 1 --2- 172.21.15.160:0/2238897723 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2cb4105090 0x7f2cb410b940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:22:33.378 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-08T05:22:33.374+0000 7f2cbc11d700 1 --2- 172.21.15.160:0/2238897723 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2cb41034f0 0x7f2cb4103910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:22:33.378 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-08T05:22:33.374+0000 7f2cbc11d700 1 --2- 172.21.15.160:0/2238897723 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2cb41046f0 0x7f2cb4104b50 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:22:33.378 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-08T05:22:33.374+0000 7f2cbc11d700 1 -- 172.21.15.160:0/2238897723 >> 172.21.15.160:0/2238897723 conn(0x7f2cb40fea90 msgr2=0x7f2cb4100ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:22:33.378 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-08T05:22:33.374+0000 7f2cbc11d700 1 -- 172.21.15.160:0/2238897723 shutdown_connections 2024-05-08T05:22:33.378 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-08T05:22:33.375+0000 7f2cbc11d700 1 -- 172.21.15.160:0/2238897723 wait complete. 2024-05-08T05:22:33.378 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-08T05:22:33.375+0000 7f2cbc11d700 1 Processor -- start 2024-05-08T05:22:33.379 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-08T05:22:33.375+0000 7f2cbc11d700 1 -- start start 2024-05-08T05:22:33.379 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-08T05:22:33.375+0000 7f2cbc11d700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2cb41034f0 0x7f2cb41996e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:22:33.379 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-08T05:22:33.375+0000 7f2cbc11d700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2cb41046f0 0x7f2cb4199c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:22:33.379 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-08T05:22:33.375+0000 7f2cbc11d700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2cb4105090 0x7f2cb41a0ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:22:33.379 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-08T05:22:33.375+0000 7f2cbc11d700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f2cb410f010 con 0x7f2cb41046f0 2024-05-08T05:22:33.379 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-08T05:22:33.375+0000 7f2cbc11d700 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f2cb410ee90 con 0x7f2cb41034f0 2024-05-08T05:22:33.379 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-08T05:22:33.375+0000 7f2cbc11d700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f2cb410f190 con 0x7f2cb4105090 2024-05-08T05:22:33.379 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-08T05:22:33.375+0000 7f2cba6ba700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2cb4105090 0x7f2cb41a0ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:22:33.379 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-08T05:22:33.375+0000 7f2cba6ba700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2cb4105090 0x7f2cb41a0ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.160:60968/0 (socket says 172.21.15.160:60968) 2024-05-08T05:22:33.379 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-08T05:22:33.375+0000 7f2cba6ba700 1 -- 172.21.15.160:0/3850627238 learned_addr learned my addr 172.21.15.160:0/3850627238 (peer_addr_for_me v2:172.21.15.160:0/0) 2024-05-08T05:22:33.379 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-08T05:22:33.376+0000 7f2cb9eb9700 1 --2- 172.21.15.160:0/3850627238 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2cb41034f0 0x7f2cb41996e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:22:33.379 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-08T05:22:33.376+0000 7f2cba6ba700 1 -- 172.21.15.160:0/3850627238 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2cb41034f0 msgr2=0x7f2cb41996e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:22:33.379 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-08T05:22:33.376+0000 7f2cba6ba700 1 --2- 172.21.15.160:0/3850627238 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2cb41034f0 0x7f2cb41996e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:22:33.379 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-08T05:22:33.376+0000 7f2cba6ba700 1 -- 172.21.15.160:0/3850627238 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2cb41046f0 msgr2=0x7f2cb4199c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:22:33.379 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-08T05:22:33.376+0000 7f2cba6ba700 1 --2- 172.21.15.160:0/3850627238 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2cb41046f0 0x7f2cb4199c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:22:33.380 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-08T05:22:33.376+0000 7f2cba6ba700 1 -- 172.21.15.160:0/3850627238 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2cb41a1340 con 0x7f2cb4105090 2024-05-08T05:22:33.380 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-08T05:22:33.376+0000 7f2cba6ba700 1 --2- 172.21.15.160:0/3850627238 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2cb4105090 0x7f2cb41a0ca0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f2cac007f10 tx=0x7f2cac00d3b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:22:33.380 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-08T05:22:33.376+0000 7f2caaffd700 1 -- 172.21.15.160:0/3850627238 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2cac004bb0 con 0x7f2cb4105090 2024-05-08T05:22:33.380 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-08T05:22:33.376+0000 7f2caaffd700 1 -- 172.21.15.160:0/3850627238 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2cac004d50 con 0x7f2cb4105090 2024-05-08T05:22:33.380 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-08T05:22:33.376+0000 7f2cbc11d700 1 -- 172.21.15.160:0/3850627238 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2cb41a1630 con 0x7f2cb4105090 2024-05-08T05:22:33.380 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-08T05:22:33.376+0000 7f2caaffd700 1 -- 172.21.15.160:0/3850627238 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2cac005a30 con 0x7f2cb4105090 2024-05-08T05:22:33.380 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-08T05:22:33.376+0000 7f2cbc11d700 1 -- 172.21.15.160:0/3850627238 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2cb41a1b20 con 0x7f2cb4105090 2024-05-08T05:22:33.381 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-08T05:22:33.377+0000 7f2cbc11d700 1 -- 172.21.15.160:0/3850627238 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2cb406a190 con 0x7f2cb4105090 2024-05-08T05:22:33.381 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-08T05:22:33.378+0000 7f2caaffd700 1 -- 172.21.15.160:0/3850627238 <== mon.1 v2:172.21.15.160:3300/0 4 ==== mgrmap(e 16) ==== 149652+0+0 (secure 0 0 0) 0x7f2cac01a020 con 0x7f2cb4105090 2024-05-08T05:22:33.381 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-08T05:22:33.379+0000 7f2caaffd700 1 --2- 172.21.15.160:0/3850627238 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f2ca00b2880 0x7f2ca00b4d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:22:33.381 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-08T05:22:33.379+0000 7f2caaffd700 1 -- 172.21.15.160:0/3850627238 <== mon.1 v2:172.21.15.160:3300/0 5 ==== osd_map(49..49 src has 1..49) ==== 5397+0+0 (secure 0 0 0) 0x7f2cac0e1550 con 0x7f2cb4105090 2024-05-08T05:22:33.381 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-08T05:22:33.380+0000 7f2cb9eb9700 1 --2- 172.21.15.160:0/3850627238 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f2ca00b2880 0x7f2ca00b4d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:22:33.382 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-08T05:22:33.381+0000 7f2cb9eb9700 1 --2- 172.21.15.160:0/3850627238 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f2ca00b2880 0x7f2ca00b4d40 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f2ca4006fd0 tx=0x7f2ca4008040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:22:33.384 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-08T05:22:33.383+0000 7f2caaffd700 1 -- 172.21.15.160:0/3850627238 <== mon.1 v2:172.21.15.160:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f2cac010070 con 0x7f2cb4105090 2024-05-08T05:22:33.458 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:22:33 smithi087 ceph-mon[29523]: Detected new or changed devices on smithi090 2024-05-08T05:22:33.458 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:22:33 smithi087 ceph-mon[29523]: Adjusting osd_memory_target on smithi090 to 5696M 2024-05-08T05:22:33.458 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:22:33 smithi087 ceph-mon[29523]: osdmap e49: 8 total, 8 up, 8 in 2024-05-08T05:22:33.483 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:22:33 smithi090 ceph-mon[34526]: Detected new or changed devices on smithi090 2024-05-08T05:22:33.483 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:22:33 smithi090 ceph-mon[34526]: Adjusting osd_memory_target on smithi090 to 5696M 2024-05-08T05:22:33.483 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:22:33 smithi090 ceph-mon[34526]: osdmap e49: 8 total, 8 up, 8 in 2024-05-08T05:22:33.597 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-08T05:22:33.596+0000 7f2cbc11d700 1 -- 172.21.15.160:0/3850627238 --> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi160:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) -- 0x7f2cb40638e0 con 0x7f2ca00b2880 2024-05-08T05:22:34.459 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:22:34 smithi087 ceph-mon[29523]: pgmap v193: 1 pgs: 1 remapped; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-05-08T05:22:34.459 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:22:34 smithi087 ceph-mon[29523]: Health check failed: Reduced data availability: 1 pg inactive (PG_AVAILABILITY) 2024-05-08T05:22:34.459 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:22:34 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-08T05:22:34.459 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:22:34 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-08T05:22:34.459 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:22:34 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T05:22:34.459 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:22:34 smithi087 ceph-mon[29523]: osdmap e50: 8 total, 8 up, 8 in 2024-05-08T05:22:34.475 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:22:34 smithi160 ceph-mon[34827]: pgmap v193: 1 pgs: 1 remapped; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-05-08T05:22:34.475 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:22:34 smithi160 ceph-mon[34827]: Health check failed: Reduced data availability: 1 pg inactive (PG_AVAILABILITY) 2024-05-08T05:22:34.476 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:22:34 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-08T05:22:34.476 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:22:34 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-08T05:22:34.476 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:22:34 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T05:22:34.476 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:22:34 smithi160 ceph-mon[34827]: osdmap e50: 8 total, 8 up, 8 in 2024-05-08T05:22:34.483 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:22:34 smithi090 ceph-mon[34526]: pgmap v193: 1 pgs: 1 remapped; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-05-08T05:22:34.483 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:22:34 smithi090 ceph-mon[34526]: Health check failed: Reduced data availability: 1 pg inactive (PG_AVAILABILITY) 2024-05-08T05:22:34.483 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:22:34 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-08T05:22:34.484 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:22:34 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-08T05:22:34.484 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:22:34 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T05:22:34.484 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:22:34 smithi090 ceph-mon[34526]: osdmap e50: 8 total, 8 up, 8 in 2024-05-08T05:22:35.431 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:22:35 smithi160 ceph-mon[34827]: from='client.24292 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi160:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-05-08T05:22:35.458 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:22:35 smithi087 ceph-mon[29523]: from='client.24292 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi160:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-05-08T05:22:35.483 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:22:35 smithi090 ceph-mon[34526]: from='client.24292 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi160:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-05-08T05:22:36.458 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:22:36 smithi087 ceph-mon[29523]: pgmap v196: 1 pgs: 1 remapped; 577 KiB data, 240 MiB used, 715 GiB / 715 GiB avail 2024-05-08T05:22:36.483 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:22:36 smithi090 ceph-mon[34526]: pgmap v196: 1 pgs: 1 remapped; 577 KiB data, 240 MiB used, 715 GiB / 715 GiB avail 2024-05-08T05:22:36.538 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:22:36 smithi160 ceph-mon[34827]: pgmap v196: 1 pgs: 1 remapped; 577 KiB data, 240 MiB used, 715 GiB / 715 GiB avail 2024-05-08T05:22:37.458 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:22:37 smithi087 ceph-mon[29523]: from='client.? 172.21.15.160:0/146549732' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "027dede9-d0be-4fbe-b7b8-02ce88d57f4d"}]: dispatch 2024-05-08T05:22:37.459 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:22:37 smithi087 ceph-mon[29523]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "027dede9-d0be-4fbe-b7b8-02ce88d57f4d"}]: dispatch 2024-05-08T05:22:37.459 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:22:37 smithi087 ceph-mon[29523]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "027dede9-d0be-4fbe-b7b8-02ce88d57f4d"}]': finished 2024-05-08T05:22:37.459 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:22:37 smithi087 ceph-mon[29523]: osdmap e51: 9 total, 8 up, 9 in 2024-05-08T05:22:37.459 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:22:37 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-05-08T05:22:37.459 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:22:37 smithi087 ceph-mon[29523]: from='client.? 172.21.15.160:0/4040365137' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-08T05:22:37.483 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:22:37 smithi090 ceph-mon[34526]: from='client.? 172.21.15.160:0/146549732' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "027dede9-d0be-4fbe-b7b8-02ce88d57f4d"}]: dispatch 2024-05-08T05:22:37.483 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:22:37 smithi090 ceph-mon[34526]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "027dede9-d0be-4fbe-b7b8-02ce88d57f4d"}]: dispatch 2024-05-08T05:22:37.484 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:22:37 smithi090 ceph-mon[34526]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "027dede9-d0be-4fbe-b7b8-02ce88d57f4d"}]': finished 2024-05-08T05:22:37.484 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:22:37 smithi090 ceph-mon[34526]: osdmap e51: 9 total, 8 up, 9 in 2024-05-08T05:22:37.484 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:22:37 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-05-08T05:22:37.484 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:22:37 smithi090 ceph-mon[34526]: from='client.? 172.21.15.160:0/4040365137' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-08T05:22:37.538 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:22:37 smithi160 ceph-mon[34827]: from='client.? 172.21.15.160:0/146549732' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "027dede9-d0be-4fbe-b7b8-02ce88d57f4d"}]: dispatch 2024-05-08T05:22:37.539 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:22:37 smithi160 ceph-mon[34827]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "027dede9-d0be-4fbe-b7b8-02ce88d57f4d"}]: dispatch 2024-05-08T05:22:37.539 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:22:37 smithi160 ceph-mon[34827]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "027dede9-d0be-4fbe-b7b8-02ce88d57f4d"}]': finished 2024-05-08T05:22:37.539 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:22:37 smithi160 ceph-mon[34827]: osdmap e51: 9 total, 8 up, 9 in 2024-05-08T05:22:37.539 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:22:37 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-05-08T05:22:37.539 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:22:37 smithi160 ceph-mon[34827]: from='client.? 172.21.15.160:0/4040365137' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-08T05:22:38.708 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:22:38 smithi087 ceph-mon[29523]: pgmap v198: 1 pgs: 1 remapped; 577 KiB data, 240 MiB used, 715 GiB / 715 GiB avail 2024-05-08T05:22:38.733 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:22:38 smithi090 ceph-mon[34526]: pgmap v198: 1 pgs: 1 remapped; 577 KiB data, 240 MiB used, 715 GiB / 715 GiB avail 2024-05-08T05:22:38.788 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:22:38 smithi160 ceph-mon[34827]: pgmap v198: 1 pgs: 1 remapped; 577 KiB data, 240 MiB used, 715 GiB / 715 GiB avail 2024-05-08T05:22:39.708 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:22:39 smithi087 ceph-mon[29523]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg inactive) 2024-05-08T05:22:39.708 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:22:39 smithi087 ceph-mon[29523]: Cluster is now healthy 2024-05-08T05:22:39.733 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:22:39 smithi090 ceph-mon[34526]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg inactive) 2024-05-08T05:22:39.733 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:22:39 smithi090 ceph-mon[34526]: Cluster is now healthy 2024-05-08T05:22:39.788 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:22:39 smithi160 ceph-mon[34827]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg inactive) 2024-05-08T05:22:39.788 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:22:39 smithi160 ceph-mon[34827]: Cluster is now healthy 2024-05-08T05:22:40.539 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:22:40 smithi160 ceph-mon[34827]: pgmap v199: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail; 192 KiB/s, 0 objects/s recovering 2024-05-08T05:22:40.708 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:22:40 smithi087 ceph-mon[29523]: pgmap v199: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail; 192 KiB/s, 0 objects/s recovering 2024-05-08T05:22:40.733 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:22:40 smithi090 ceph-mon[34526]: pgmap v199: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail; 192 KiB/s, 0 objects/s recovering 2024-05-08T05:22:42.677 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:22:42 smithi160 ceph-mon[34827]: pgmap v200: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail; 149 KiB/s, 0 objects/s recovering 2024-05-08T05:22:42.708 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:22:42 smithi087 ceph-mon[29523]: pgmap v200: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail; 149 KiB/s, 0 objects/s recovering 2024-05-08T05:22:42.733 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:22:42 smithi090 ceph-mon[34526]: pgmap v200: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail; 149 KiB/s, 0 objects/s recovering 2024-05-08T05:22:44.617 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:22:44 smithi160 ceph-mon[34827]: pgmap v201: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail; 132 KiB/s, 0 objects/s recovering 2024-05-08T05:22:44.617 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:22:44 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.8"}]: dispatch 2024-05-08T05:22:44.617 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:22:44 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T05:22:44.708 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:22:44 smithi087 ceph-mon[29523]: pgmap v201: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail; 132 KiB/s, 0 objects/s recovering 2024-05-08T05:22:44.709 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:22:44 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.8"}]: dispatch 2024-05-08T05:22:44.709 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:22:44 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T05:22:44.733 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:22:44 smithi090 ceph-mon[34526]: pgmap v201: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail; 132 KiB/s, 0 objects/s recovering 2024-05-08T05:22:44.733 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:22:44 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.8"}]: dispatch 2024-05-08T05:22:44.733 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:22:44 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T05:22:45.455 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:22:45 smithi160 ceph-mon[34827]: Deploying daemon osd.8 on smithi160 2024-05-08T05:22:45.708 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:22:45 smithi087 ceph-mon[29523]: Deploying daemon osd.8 on smithi160 2024-05-08T05:22:45.733 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:22:45 smithi090 ceph-mon[34526]: Deploying daemon osd.8 on smithi160 2024-05-08T05:22:46.539 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:22:46 smithi160 ceph-mon[34827]: pgmap v202: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail; 115 KiB/s, 0 objects/s recovering 2024-05-08T05:22:46.635 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:22:46 smithi090 ceph-mon[34526]: pgmap v202: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail; 115 KiB/s, 0 objects/s recovering 2024-05-08T05:22:46.708 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:22:46 smithi087 ceph-mon[29523]: pgmap v202: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail; 115 KiB/s, 0 objects/s recovering 2024-05-08T05:22:48.703 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:22:48 smithi160 ceph-mon[34827]: pgmap v203: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail; 109 KiB/s, 0 objects/s recovering 2024-05-08T05:22:48.708 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:22:48 smithi087 ceph-mon[29523]: pgmap v203: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail; 109 KiB/s, 0 objects/s recovering 2024-05-08T05:22:48.733 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:22:48 smithi090 ceph-mon[34526]: pgmap v203: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail; 109 KiB/s, 0 objects/s recovering 2024-05-08T05:22:50.630 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:22:50 smithi160 ceph-mon[34827]: pgmap v204: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-05-08T05:22:50.630 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:22:50 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:22:50.630 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:22:50 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T05:22:50.630 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:22:50 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:22:50.709 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:22:50 smithi087 ceph-mon[29523]: pgmap v204: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-05-08T05:22:50.709 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:22:50 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:22:50.709 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:22:50 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T05:22:50.709 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:22:50 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:22:50.733 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:22:50 smithi090 ceph-mon[34526]: pgmap v204: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-05-08T05:22:50.734 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:22:50 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:22:50.734 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:22:50 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T05:22:50.734 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:22:50 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:22:52.497 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:22:52 smithi160 ceph-mon[34827]: pgmap v205: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-05-08T05:22:52.708 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:22:52 smithi087 ceph-mon[29523]: pgmap v205: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-05-08T05:22:52.733 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:22:52 smithi090 ceph-mon[34526]: pgmap v205: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-05-08T05:22:53.535 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-08T05:22:53.533+0000 7f2caaffd700 1 -- 172.21.15.160:0/3850627238 <== mgr.14152 v2:172.21.15.87:6800/1189186457 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f2cb40638e0 con 0x7f2ca00b2880 2024-05-08T05:22:53.535 INFO:teuthology.orchestra.run.smithi160.stdout:Created osd(s) 8 on host 'smithi160' 2024-05-08T05:22:53.537 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-08T05:22:53.536+0000 7f2cbc11d700 1 -- 172.21.15.160:0/3850627238 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f2ca00b2880 msgr2=0x7f2ca00b4d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:22:53.537 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-08T05:22:53.536+0000 7f2cbc11d700 1 --2- 172.21.15.160:0/3850627238 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f2ca00b2880 0x7f2ca00b4d40 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f2ca4006fd0 tx=0x7f2ca4008040 comp rx=0 tx=0).stop 2024-05-08T05:22:53.537 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-08T05:22:53.536+0000 7f2cbc11d700 1 -- 172.21.15.160:0/3850627238 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2cb4105090 msgr2=0x7f2cb41a0ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:22:53.537 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-08T05:22:53.536+0000 7f2cbc11d700 1 --2- 172.21.15.160:0/3850627238 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2cb4105090 0x7f2cb41a0ca0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f2cac007f10 tx=0x7f2cac00d3b0 comp rx=0 tx=0).stop 2024-05-08T05:22:53.537 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-08T05:22:53.536+0000 7f2cbc11d700 1 -- 172.21.15.160:0/3850627238 shutdown_connections 2024-05-08T05:22:53.537 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-08T05:22:53.536+0000 7f2cbc11d700 1 --2- 172.21.15.160:0/3850627238 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f2ca00b2880 0x7f2ca00b4d40 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:22:53.537 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-08T05:22:53.536+0000 7f2cbc11d700 1 --2- 172.21.15.160:0/3850627238 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2cb4105090 0x7f2cb41a0ca0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:22:53.537 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-08T05:22:53.536+0000 7f2cbc11d700 1 --2- 172.21.15.160:0/3850627238 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2cb41034f0 0x7f2cb41996e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:22:53.537 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-08T05:22:53.536+0000 7f2cbc11d700 1 --2- 172.21.15.160:0/3850627238 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2cb41046f0 0x7f2cb4199c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:22:53.537 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-08T05:22:53.536+0000 7f2cbc11d700 1 -- 172.21.15.160:0/3850627238 >> 172.21.15.160:0/3850627238 conn(0x7f2cb40fea90 msgr2=0x7f2cb4107a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:22:53.537 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-08T05:22:53.536+0000 7f2cbc11d700 1 -- 172.21.15.160:0/3850627238 shutdown_connections 2024-05-08T05:22:53.537 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-08T05:22:53.536+0000 7f2cbc11d700 1 -- 172.21.15.160:0/3850627238 wait complete. 2024-05-08T05:22:53.986 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:22:53 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:22:53.986 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:22:53 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:22:53.986 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:22:53 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T05:22:53.986 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:22:53 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T05:22:53.986 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:22:53 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:22:53.986 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:22:53 smithi090 ceph-mon[34526]: pgmap v206: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-05-08T05:22:53.986 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:22:53 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:22:53.987 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:22:53 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:22:53.987 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:22:53 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T05:22:53.987 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:22:53 smithi090 ceph-mon[34526]: from='osd.8 [v2:172.21.15.160:6816/927680738,v1:172.21.15.160:6817/927680738]' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-05-08T05:22:53.987 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:22:53 smithi090 ceph-mon[34526]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-05-08T05:22:54.039 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:22:53 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:22:54.039 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:22:53 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:22:54.039 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:22:53 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T05:22:54.039 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:22:53 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T05:22:54.039 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:22:53 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:22:54.039 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:22:53 smithi160 ceph-mon[34827]: pgmap v206: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-05-08T05:22:54.039 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:22:53 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:22:54.039 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:22:53 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:22:54.039 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:22:53 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T05:22:54.039 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:22:53 smithi160 ceph-mon[34827]: from='osd.8 [v2:172.21.15.160:6816/927680738,v1:172.21.15.160:6817/927680738]' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-05-08T05:22:54.039 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:22:53 smithi160 ceph-mon[34827]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-05-08T05:22:54.209 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:22:53 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:22:54.209 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:22:53 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:22:54.209 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:22:53 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T05:22:54.209 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:22:53 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T05:22:54.209 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:22:53 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:22:54.209 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:22:53 smithi087 ceph-mon[29523]: pgmap v206: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-05-08T05:22:54.210 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:22:53 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:22:54.210 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:22:53 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:22:54.210 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:22:53 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T05:22:54.210 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:22:53 smithi087 ceph-mon[29523]: from='osd.8 [v2:172.21.15.160:6816/927680738,v1:172.21.15.160:6817/927680738]' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-05-08T05:22:54.210 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:22:53 smithi087 ceph-mon[29523]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-05-08T05:22:54.223 DEBUG:teuthology.orchestra.run.smithi160:osd.8> sudo journalctl -f -n 0 -u ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968@osd.8.service 2024-05-08T05:22:54.225 INFO:tasks.cephadm:Deploying osd.9 on smithi087 with /dev/vg_nvme/lv_1... 2024-05-08T05:22:54.225 DEBUG:teuthology.orchestra.run.smithi087:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid eeeb813e-0cf9-11ef-bc97-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_1 2024-05-08T05:22:54.663 INFO:teuthology.orchestra.run.smithi087.stderr:Inferring config /var/lib/ceph/eeeb813e-0cf9-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T05:22:55.645 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:22:55 smithi160 ceph-mon[34827]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2024-05-08T05:22:55.645 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:22:55 smithi160 ceph-mon[34827]: from='osd.8 [v2:172.21.15.160:6816/927680738,v1:172.21.15.160:6817/927680738]' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi160", "root=default"]}]: dispatch 2024-05-08T05:22:55.645 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:22:55 smithi160 ceph-mon[34827]: osdmap e52: 9 total, 8 up, 9 in 2024-05-08T05:22:55.645 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:22:55 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-05-08T05:22:55.645 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:22:55 smithi160 ceph-mon[34827]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi160", "root=default"]}]: dispatch 2024-05-08T05:22:55.645 INFO:journalctl@ceph.osd.8.smithi160.stdout:May 08 05:22:55 smithi160 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-8[53438]: 2024-05-08T05:22:55.502+0000 7f9bacec1700 -1 osd.8 0 waiting for initial osdmap 2024-05-08T05:22:55.646 INFO:journalctl@ceph.osd.8.smithi160.stdout:May 08 05:22:55 smithi160 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-8[53438]: 2024-05-08T05:22:55.513+0000 7f9ba8cb4700 -1 osd.8 53 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-08T05:22:55.875 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:22:55 smithi087 ceph-mon[29523]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2024-05-08T05:22:55.875 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:22:55 smithi087 ceph-mon[29523]: from='osd.8 [v2:172.21.15.160:6816/927680738,v1:172.21.15.160:6817/927680738]' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi160", "root=default"]}]: dispatch 2024-05-08T05:22:55.875 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:22:55 smithi087 ceph-mon[29523]: osdmap e52: 9 total, 8 up, 9 in 2024-05-08T05:22:55.875 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:22:55 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-05-08T05:22:55.875 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:22:55 smithi087 ceph-mon[29523]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi160", "root=default"]}]: dispatch 2024-05-08T05:22:55.983 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:22:55 smithi090 ceph-mon[34526]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2024-05-08T05:22:55.983 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:22:55 smithi090 ceph-mon[34526]: from='osd.8 [v2:172.21.15.160:6816/927680738,v1:172.21.15.160:6817/927680738]' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi160", "root=default"]}]: dispatch 2024-05-08T05:22:55.984 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:22:55 smithi090 ceph-mon[34526]: osdmap e52: 9 total, 8 up, 9 in 2024-05-08T05:22:55.984 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:22:55 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-05-08T05:22:55.984 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:22:55 smithi090 ceph-mon[34526]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi160", "root=default"]}]: dispatch 2024-05-08T05:22:56.612 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:22:56 smithi087 ceph-mon[29523]: pgmap v208: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-05-08T05:22:56.612 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:22:56 smithi087 ceph-mon[29523]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi160", "root=default"]}]': finished 2024-05-08T05:22:56.612 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:22:56 smithi087 ceph-mon[29523]: osdmap e53: 9 total, 8 up, 9 in 2024-05-08T05:22:56.612 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:22:56 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-05-08T05:22:56.612 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:22:56 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-05-08T05:22:56.613 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:22:56 smithi087 ceph-mon[29523]: osd.8 [v2:172.21.15.160:6816/927680738,v1:172.21.15.160:6817/927680738] boot 2024-05-08T05:22:56.613 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:22:56 smithi087 ceph-mon[29523]: osdmap e54: 9 total, 9 up, 9 in 2024-05-08T05:22:56.613 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:22:56 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-05-08T05:22:56.756 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:22:56 smithi160 ceph-mon[34827]: pgmap v208: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-05-08T05:22:56.756 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:22:56 smithi160 ceph-mon[34827]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi160", "root=default"]}]': finished 2024-05-08T05:22:56.756 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:22:56 smithi160 ceph-mon[34827]: osdmap e53: 9 total, 8 up, 9 in 2024-05-08T05:22:56.756 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:22:56 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-05-08T05:22:56.756 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:22:56 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-05-08T05:22:56.756 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:22:56 smithi160 ceph-mon[34827]: osd.8 [v2:172.21.15.160:6816/927680738,v1:172.21.15.160:6817/927680738] boot 2024-05-08T05:22:56.756 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:22:56 smithi160 ceph-mon[34827]: osdmap e54: 9 total, 9 up, 9 in 2024-05-08T05:22:56.756 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:22:56 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-05-08T05:22:56.983 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:22:56 smithi090 ceph-mon[34526]: pgmap v208: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-05-08T05:22:56.983 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:22:56 smithi090 ceph-mon[34526]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi160", "root=default"]}]': finished 2024-05-08T05:22:56.984 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:22:56 smithi090 ceph-mon[34526]: osdmap e53: 9 total, 8 up, 9 in 2024-05-08T05:22:56.984 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:22:56 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-05-08T05:22:56.984 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:22:56 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-05-08T05:22:56.984 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:22:56 smithi090 ceph-mon[34526]: osd.8 [v2:172.21.15.160:6816/927680738,v1:172.21.15.160:6817/927680738] boot 2024-05-08T05:22:56.984 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:22:56 smithi090 ceph-mon[34526]: osdmap e54: 9 total, 9 up, 9 in 2024-05-08T05:22:56.984 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:22:56 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-05-08T05:22:57.485 INFO:teuthology.orchestra.run.smithi087.stderr:--> Zapping: /dev/vg_nvme/lv_1 2024-05-08T05:22:57.485 INFO:teuthology.orchestra.run.smithi087.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_1 bs=1M count=10 conv=fsync 2024-05-08T05:22:57.485 INFO:teuthology.orchestra.run.smithi087.stderr: stderr: 10+0 records in 2024-05-08T05:22:57.485 INFO:teuthology.orchestra.run.smithi087.stderr:10+0 records out 2024-05-08T05:22:57.485 INFO:teuthology.orchestra.run.smithi087.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0345976 s, 303 MB/s 2024-05-08T05:22:57.485 INFO:teuthology.orchestra.run.smithi087.stderr:--> Zapping successful for: 2024-05-08T05:22:57.789 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:22:57 smithi160 ceph-mon[34827]: purged_snaps scrub starts 2024-05-08T05:22:57.789 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:22:57 smithi160 ceph-mon[34827]: purged_snaps scrub ok 2024-05-08T05:22:57.789 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:22:57 smithi160 ceph-mon[34827]: osdmap e55: 9 total, 9 up, 9 in 2024-05-08T05:22:57.789 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:22:57 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:22:57.789 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:22:57 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:22:57.789 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:22:57 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-05-08T05:22:57.789 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:22:57 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-05-08T05:22:57.789 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:22:57 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-05-08T05:22:57.789 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:22:57 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:22:57.789 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:22:57 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T05:22:57.790 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:22:57 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T05:22:57.790 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:22:57 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:22:57.859 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:22:57 smithi087 ceph-mon[29523]: purged_snaps scrub starts 2024-05-08T05:22:57.859 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:22:57 smithi087 ceph-mon[29523]: purged_snaps scrub ok 2024-05-08T05:22:57.859 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:22:57 smithi087 ceph-mon[29523]: osdmap e55: 9 total, 9 up, 9 in 2024-05-08T05:22:57.859 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:22:57 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:22:57.859 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:22:57 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:22:57.860 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:22:57 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-05-08T05:22:57.860 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:22:57 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-05-08T05:22:57.860 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:22:57 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-05-08T05:22:57.860 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:22:57 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:22:57.860 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:22:57 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T05:22:57.860 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:22:57 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T05:22:57.860 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:22:57 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:22:57.983 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:22:57 smithi090 ceph-mon[34526]: purged_snaps scrub starts 2024-05-08T05:22:57.983 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:22:57 smithi090 ceph-mon[34526]: purged_snaps scrub ok 2024-05-08T05:22:57.984 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:22:57 smithi090 ceph-mon[34526]: osdmap e55: 9 total, 9 up, 9 in 2024-05-08T05:22:57.984 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:22:57 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:22:57.984 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:22:57 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:22:57.984 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:22:57 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-05-08T05:22:57.984 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:22:57 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-05-08T05:22:57.984 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:22:57 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-05-08T05:22:57.984 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:22:57 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:22:57.984 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:22:57 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T05:22:57.984 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:22:57 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T05:22:57.984 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:22:57 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:22:58.315 DEBUG:teuthology.orchestra.run.smithi087:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid eeeb813e-0cf9-11ef-bc97-c7b262605968 -- ceph orch daemon add osd smithi087:vg_nvme/lv_1 2024-05-08T05:22:58.708 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:22:58 smithi087 ceph-mon[29523]: pgmap v212: 1 pgs: 1 active+clean; 577 KiB data, 268 MiB used, 804 GiB / 805 GiB avail 2024-05-08T05:22:58.708 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:22:58 smithi087 ceph-mon[29523]: Detected new or changed devices on smithi160 2024-05-08T05:22:58.708 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:22:58 smithi087 ceph-mon[29523]: Adjusting osd_memory_target on smithi160 to 5696M 2024-05-08T05:22:58.709 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:22:58 smithi087 ceph-mon[29523]: osdmap e56: 9 total, 9 up, 9 in 2024-05-08T05:22:58.733 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:22:58 smithi090 ceph-mon[34526]: pgmap v212: 1 pgs: 1 active+clean; 577 KiB data, 268 MiB used, 804 GiB / 805 GiB avail 2024-05-08T05:22:58.733 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:22:58 smithi090 ceph-mon[34526]: Detected new or changed devices on smithi160 2024-05-08T05:22:58.734 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:22:58 smithi090 ceph-mon[34526]: Adjusting osd_memory_target on smithi160 to 5696M 2024-05-08T05:22:58.734 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:22:58 smithi090 ceph-mon[34526]: osdmap e56: 9 total, 9 up, 9 in 2024-05-08T05:22:58.746 INFO:teuthology.orchestra.run.smithi087.stderr:Inferring config /var/lib/ceph/eeeb813e-0cf9-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T05:22:58.788 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:22:58 smithi160 ceph-mon[34827]: pgmap v212: 1 pgs: 1 active+clean; 577 KiB data, 268 MiB used, 804 GiB / 805 GiB avail 2024-05-08T05:22:58.788 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:22:58 smithi160 ceph-mon[34827]: Detected new or changed devices on smithi160 2024-05-08T05:22:58.788 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:22:58 smithi160 ceph-mon[34827]: Adjusting osd_memory_target on smithi160 to 5696M 2024-05-08T05:22:58.789 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:22:58 smithi160 ceph-mon[34827]: osdmap e56: 9 total, 9 up, 9 in 2024-05-08T05:22:59.959 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:22:59 smithi087 ceph-mon[29523]: Health check failed: Degraded data redundancy: 2/6 objects degraded (33.333%), 1 pg degraded (PG_DEGRADED) 2024-05-08T05:22:59.983 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:22:59 smithi090 ceph-mon[34526]: Health check failed: Degraded data redundancy: 2/6 objects degraded (33.333%), 1 pg degraded (PG_DEGRADED) 2024-05-08T05:23:00.038 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:22:59 smithi160 ceph-mon[34827]: Health check failed: Degraded data redundancy: 2/6 objects degraded (33.333%), 1 pg degraded (PG_DEGRADED) 2024-05-08T05:23:00.787 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:23:00.785+0000 7f9e7a200700 1 -- 172.21.15.87:0/2216800529 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9e74106940 msgr2=0x7f9e74106da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:23:00.788 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:23:00.785+0000 7f9e7a200700 1 --2- 172.21.15.87:0/2216800529 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9e74106940 0x7f9e74106da0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f9e600099c0 tx=0x7f9e60009cd0 comp rx=0 tx=0).stop 2024-05-08T05:23:00.788 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:23:00.785+0000 7f9e7a200700 1 -- 172.21.15.87:0/2216800529 shutdown_connections 2024-05-08T05:23:00.788 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:23:00.785+0000 7f9e7a200700 1 --2- 172.21.15.87:0/2216800529 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9e741072e0 0x7f9e7410db90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:23:00.788 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:23:00.785+0000 7f9e7a200700 1 --2- 172.21.15.87:0/2216800529 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f9e74105740 0x7f9e74105b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:23:00.788 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:23:00.785+0000 7f9e7a200700 1 --2- 172.21.15.87:0/2216800529 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9e74106940 0x7f9e74106da0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:23:00.788 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:23:00.785+0000 7f9e7a200700 1 -- 172.21.15.87:0/2216800529 >> 172.21.15.87:0/2216800529 conn(0x7f9e74100d00 msgr2=0x7f9e74103120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:23:00.788 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:23:00.786+0000 7f9e7a200700 1 -- 172.21.15.87:0/2216800529 shutdown_connections 2024-05-08T05:23:00.788 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:23:00.786+0000 7f9e7a200700 1 -- 172.21.15.87:0/2216800529 wait complete. 2024-05-08T05:23:00.791 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:23:00.787+0000 7f9e7a200700 1 Processor -- start 2024-05-08T05:23:00.791 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:23:00.787+0000 7f9e7a200700 1 -- start start 2024-05-08T05:23:00.791 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:23:00.787+0000 7f9e7a200700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f9e74105740 0x7f9e7419b820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:23:00.791 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:23:00.787+0000 7f9e7a200700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9e74106940 0x7f9e7419bd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:23:00.791 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:23:00.787+0000 7f9e7a200700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9e741072e0 0x7f9e741a2de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:23:00.791 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:23:00.787+0000 7f9e7a200700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f9e741111b0 con 0x7f9e741072e0 2024-05-08T05:23:00.791 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:23:00.787+0000 7f9e7a200700 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f9e74111030 con 0x7f9e74106940 2024-05-08T05:23:00.791 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:23:00.787+0000 7f9e7a200700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f9e74111330 con 0x7f9e74105740 2024-05-08T05:23:00.791 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:23:00.787+0000 7f9e72a00700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9e74106940 0x7f9e7419bd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:23:00.791 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:23:00.787+0000 7f9e72a00700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9e74106940 0x7f9e7419bd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.87:33158/0 (socket says 172.21.15.87:33158) 2024-05-08T05:23:00.791 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:23:00.787+0000 7f9e72a00700 1 -- 172.21.15.87:0/3629997122 learned_addr learned my addr 172.21.15.87:0/3629997122 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T05:23:00.792 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:23:00.787+0000 7f9e73e00700 1 --2- 172.21.15.87:0/3629997122 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9e741072e0 0x7f9e741a2de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:23:00.792 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:23:00.788+0000 7f9e73400700 1 --2- 172.21.15.87:0/3629997122 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f9e74105740 0x7f9e7419b820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:23:00.792 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:23:00.788+0000 7f9e72a00700 1 -- 172.21.15.87:0/3629997122 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f9e74105740 msgr2=0x7f9e7419b820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:23:00.792 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:23:00.788+0000 7f9e72a00700 1 --2- 172.21.15.87:0/3629997122 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f9e74105740 0x7f9e7419b820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:23:00.792 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:23:00.788+0000 7f9e72a00700 1 -- 172.21.15.87:0/3629997122 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9e741072e0 msgr2=0x7f9e741a2de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:23:00.792 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:23:00.788+0000 7f9e72a00700 1 --2- 172.21.15.87:0/3629997122 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9e741072e0 0x7f9e741a2de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:23:00.792 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:23:00.788+0000 7f9e72a00700 1 -- 172.21.15.87:0/3629997122 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9e741a3480 con 0x7f9e74106940 2024-05-08T05:23:00.792 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:23:00.788+0000 7f9e72a00700 1 --2- 172.21.15.87:0/3629997122 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9e74106940 0x7f9e7419bd60 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f9e6000b580 tx=0x7f9e60003af0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:23:00.792 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:23:00.788+0000 7f9e6be00700 1 -- 172.21.15.87:0/3629997122 <== mon.2 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e600050c0 con 0x7f9e74106940 2024-05-08T05:23:00.792 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:23:00.788+0000 7f9e6be00700 1 -- 172.21.15.87:0/3629997122 <== mon.2 v2:172.21.15.90:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9e6000f460 con 0x7f9e74106940 2024-05-08T05:23:00.792 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:23:00.788+0000 7f9e7a200700 1 -- 172.21.15.87:0/3629997122 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9e741a3710 con 0x7f9e74106940 2024-05-08T05:23:00.792 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:23:00.789+0000 7f9e6be00700 1 -- 172.21.15.87:0/3629997122 <== mon.2 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e60017650 con 0x7f9e74106940 2024-05-08T05:23:00.792 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:23:00.789+0000 7f9e7a200700 1 -- 172.21.15.87:0/3629997122 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9e741a3bc0 con 0x7f9e74106940 2024-05-08T05:23:00.793 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:23:00.790+0000 7f9e7a200700 1 -- 172.21.15.87:0/3629997122 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9e7406a190 con 0x7f9e74106940 2024-05-08T05:23:00.793 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:23:00.792+0000 7f9e6be00700 1 -- 172.21.15.87:0/3629997122 <== mon.2 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 16) ==== 149652+0+0 (secure 0 0 0) 0x7f9e6000f610 con 0x7f9e74106940 2024-05-08T05:23:00.795 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:23:00.793+0000 7f9e6be00700 1 --2- 172.21.15.87:0/3629997122 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f9e580b2900 0x7f9e580b4dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:23:00.795 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:23:00.794+0000 7f9e6be00700 1 -- 172.21.15.87:0/3629997122 <== mon.2 v2:172.21.15.90:3300/0 5 ==== osd_map(56..56 src has 1..56) ==== 5829+0+0 (secure 0 0 0) 0x7f9e600e26a0 con 0x7f9e74106940 2024-05-08T05:23:00.795 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:23:00.794+0000 7f9e73400700 1 --2- 172.21.15.87:0/3629997122 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f9e580b2900 0x7f9e580b4dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:23:00.796 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:23:00.794+0000 7f9e73400700 1 --2- 172.21.15.87:0/3629997122 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f9e580b2900 0x7f9e580b4dc0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f9e741067a0 tx=0x7f9e64009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:23:00.797 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:23:00.796+0000 7f9e6be00700 1 -- 172.21.15.87:0/3629997122 <== mon.2 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f9e60013070 con 0x7f9e74106940 2024-05-08T05:23:00.804 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:23:00 smithi087 ceph-mon[29523]: pgmap v214: 1 pgs: 1 activating+degraded; 577 KiB data, 268 MiB used, 804 GiB / 805 GiB avail; 2/6 objects degraded (33.333%) 2024-05-08T05:23:00.983 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:23:00 smithi090 ceph-mon[34526]: pgmap v214: 1 pgs: 1 activating+degraded; 577 KiB data, 268 MiB used, 804 GiB / 805 GiB avail; 2/6 objects degraded (33.333%) 2024-05-08T05:23:01.038 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:23:00 smithi160 ceph-mon[34827]: pgmap v214: 1 pgs: 1 activating+degraded; 577 KiB data, 268 MiB used, 804 GiB / 805 GiB avail; 2/6 objects degraded (33.333%) 2024-05-08T05:23:01.043 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:23:01.042+0000 7f9e7a200700 1 -- 172.21.15.87:0/3629997122 --> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi087:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) -- 0x7f9e740639a0 con 0x7f9e580b2900 2024-05-08T05:23:01.958 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:23:01 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-08T05:23:01.959 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:23:01 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-08T05:23:01.959 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:23:01 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T05:23:01.983 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:23:01 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-08T05:23:01.983 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:23:01 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-08T05:23:01.983 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:23:01 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T05:23:02.039 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:23:01 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-08T05:23:02.039 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:23:01 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-08T05:23:02.039 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:23:01 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T05:23:02.958 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:23:02 smithi087 ceph-mon[29523]: pgmap v215: 1 pgs: 1 activating+degraded; 577 KiB data, 268 MiB used, 804 GiB / 805 GiB avail; 2/6 objects degraded (33.333%) 2024-05-08T05:23:02.958 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:23:02 smithi087 ceph-mon[29523]: from='client.24323 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi087:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-05-08T05:23:02.983 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:23:02 smithi090 ceph-mon[34526]: pgmap v215: 1 pgs: 1 activating+degraded; 577 KiB data, 268 MiB used, 804 GiB / 805 GiB avail; 2/6 objects degraded (33.333%) 2024-05-08T05:23:02.984 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:23:02 smithi090 ceph-mon[34526]: from='client.24323 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi087:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-05-08T05:23:03.038 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:23:02 smithi160 ceph-mon[34827]: pgmap v215: 1 pgs: 1 activating+degraded; 577 KiB data, 268 MiB used, 804 GiB / 805 GiB avail; 2/6 objects degraded (33.333%) 2024-05-08T05:23:03.038 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:23:02 smithi160 ceph-mon[34827]: from='client.24323 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi087:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-05-08T05:23:03.888 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:23:03 smithi087 ceph-mon[29523]: pgmap v216: 1 pgs: 1 activating+degraded; 577 KiB data, 268 MiB used, 804 GiB / 805 GiB avail; 2/6 objects degraded (33.333%) 2024-05-08T05:23:03.983 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:23:03 smithi090 ceph-mon[34526]: pgmap v216: 1 pgs: 1 activating+degraded; 577 KiB data, 268 MiB used, 804 GiB / 805 GiB avail; 2/6 objects degraded (33.333%) 2024-05-08T05:23:04.038 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:23:03 smithi160 ceph-mon[34827]: pgmap v216: 1 pgs: 1 activating+degraded; 577 KiB data, 268 MiB used, 804 GiB / 805 GiB avail; 2/6 objects degraded (33.333%) 2024-05-08T05:23:05.208 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:23:04 smithi087 ceph-mon[29523]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 2/6 objects degraded (33.333%), 1 pg degraded) 2024-05-08T05:23:05.208 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:23:04 smithi087 ceph-mon[29523]: Cluster is now healthy 2024-05-08T05:23:05.233 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:23:04 smithi090 ceph-mon[34526]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 2/6 objects degraded (33.333%), 1 pg degraded) 2024-05-08T05:23:05.233 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:23:04 smithi090 ceph-mon[34526]: Cluster is now healthy 2024-05-08T05:23:05.289 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:23:04 smithi160 ceph-mon[34827]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 2/6 objects degraded (33.333%), 1 pg degraded) 2024-05-08T05:23:05.289 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:23:04 smithi160 ceph-mon[34827]: Cluster is now healthy 2024-05-08T05:23:06.204 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:23:05 smithi160 ceph-mon[34827]: pgmap v217: 1 pgs: 1 active+clean; 577 KiB data, 268 MiB used, 804 GiB / 805 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-05-08T05:23:06.204 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:23:05 smithi160 ceph-mon[34827]: from='client.? 172.21.15.87:0/138736532' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "bc9e37de-e509-4db6-bd58-b68e2c8e1aff"}]: dispatch 2024-05-08T05:23:06.204 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:23:05 smithi160 ceph-mon[34827]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "bc9e37de-e509-4db6-bd58-b68e2c8e1aff"}]: dispatch 2024-05-08T05:23:06.204 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:23:05 smithi160 ceph-mon[34827]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "bc9e37de-e509-4db6-bd58-b68e2c8e1aff"}]': finished 2024-05-08T05:23:06.204 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:23:05 smithi160 ceph-mon[34827]: osdmap e57: 10 total, 9 up, 10 in 2024-05-08T05:23:06.204 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:23:05 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-05-08T05:23:06.208 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:23:05 smithi087 ceph-mon[29523]: pgmap v217: 1 pgs: 1 active+clean; 577 KiB data, 268 MiB used, 804 GiB / 805 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-05-08T05:23:06.208 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:23:05 smithi087 ceph-mon[29523]: from='client.? 172.21.15.87:0/138736532' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "bc9e37de-e509-4db6-bd58-b68e2c8e1aff"}]: dispatch 2024-05-08T05:23:06.208 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:23:05 smithi087 ceph-mon[29523]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "bc9e37de-e509-4db6-bd58-b68e2c8e1aff"}]: dispatch 2024-05-08T05:23:06.208 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:23:05 smithi087 ceph-mon[29523]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "bc9e37de-e509-4db6-bd58-b68e2c8e1aff"}]': finished 2024-05-08T05:23:06.208 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:23:05 smithi087 ceph-mon[29523]: osdmap e57: 10 total, 9 up, 10 in 2024-05-08T05:23:06.208 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:23:05 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-05-08T05:23:06.233 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:23:05 smithi090 ceph-mon[34526]: pgmap v217: 1 pgs: 1 active+clean; 577 KiB data, 268 MiB used, 804 GiB / 805 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-05-08T05:23:06.233 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:23:05 smithi090 ceph-mon[34526]: from='client.? 172.21.15.87:0/138736532' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "bc9e37de-e509-4db6-bd58-b68e2c8e1aff"}]: dispatch 2024-05-08T05:23:06.233 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:23:05 smithi090 ceph-mon[34526]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "bc9e37de-e509-4db6-bd58-b68e2c8e1aff"}]: dispatch 2024-05-08T05:23:06.234 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:23:05 smithi090 ceph-mon[34526]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "bc9e37de-e509-4db6-bd58-b68e2c8e1aff"}]': finished 2024-05-08T05:23:06.234 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:23:05 smithi090 ceph-mon[34526]: osdmap e57: 10 total, 9 up, 10 in 2024-05-08T05:23:06.234 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:23:05 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-05-08T05:23:07.233 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:23:06 smithi090 ceph-mon[34526]: from='client.? 172.21.15.87:0/3873811553' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-08T05:23:07.288 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:23:06 smithi160 ceph-mon[34827]: from='client.? 172.21.15.87:0/3873811553' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-08T05:23:07.458 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:23:06 smithi087 ceph-mon[29523]: from='client.? 172.21.15.87:0/3873811553' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-08T05:23:08.233 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:23:07 smithi090 ceph-mon[34526]: pgmap v219: 1 pgs: 1 active+clean; 577 KiB data, 268 MiB used, 804 GiB / 805 GiB avail; 64 KiB/s, 0 objects/s recovering 2024-05-08T05:23:08.288 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:23:07 smithi160 ceph-mon[34827]: pgmap v219: 1 pgs: 1 active+clean; 577 KiB data, 268 MiB used, 804 GiB / 805 GiB avail; 64 KiB/s, 0 objects/s recovering 2024-05-08T05:23:08.458 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:23:07 smithi087 ceph-mon[29523]: pgmap v219: 1 pgs: 1 active+clean; 577 KiB data, 268 MiB used, 804 GiB / 805 GiB avail; 64 KiB/s, 0 objects/s recovering 2024-05-08T05:23:10.208 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:23:09 smithi087 ceph-mon[29523]: pgmap v220: 1 pgs: 1 active+clean; 577 KiB data, 268 MiB used, 804 GiB / 805 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-05-08T05:23:10.233 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:23:09 smithi090 ceph-mon[34526]: pgmap v220: 1 pgs: 1 active+clean; 577 KiB data, 268 MiB used, 804 GiB / 805 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-05-08T05:23:10.288 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:23:09 smithi160 ceph-mon[34827]: pgmap v220: 1 pgs: 1 active+clean; 577 KiB data, 268 MiB used, 804 GiB / 805 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-05-08T05:23:12.233 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:23:11 smithi090 ceph-mon[34526]: pgmap v221: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 804 GiB / 805 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-05-08T05:23:12.288 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:23:11 smithi160 ceph-mon[34827]: pgmap v221: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 804 GiB / 805 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-05-08T05:23:12.458 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:23:11 smithi087 ceph-mon[29523]: pgmap v221: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 804 GiB / 805 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-05-08T05:23:14.208 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:23:13 smithi087 ceph-mon[29523]: pgmap v222: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 804 GiB / 805 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-05-08T05:23:14.233 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:23:13 smithi090 ceph-mon[34526]: pgmap v222: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 804 GiB / 805 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-05-08T05:23:14.288 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:23:13 smithi160 ceph-mon[34827]: pgmap v222: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 804 GiB / 805 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-05-08T05:23:15.233 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:23:14 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.9"}]: dispatch 2024-05-08T05:23:15.233 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:23:14 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T05:23:15.288 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:23:14 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.9"}]: dispatch 2024-05-08T05:23:15.288 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:23:14 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T05:23:15.458 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:23:14 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.9"}]: dispatch 2024-05-08T05:23:15.458 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:23:14 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T05:23:16.288 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:23:15 smithi160 ceph-mon[34827]: Deploying daemon osd.9 on smithi087 2024-05-08T05:23:16.289 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:23:15 smithi160 ceph-mon[34827]: pgmap v223: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 804 GiB / 805 GiB avail 2024-05-08T05:23:16.405 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:23:15 smithi090 ceph-mon[34526]: Deploying daemon osd.9 on smithi087 2024-05-08T05:23:16.405 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:23:15 smithi090 ceph-mon[34526]: pgmap v223: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 804 GiB / 805 GiB avail 2024-05-08T05:23:16.458 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:23:15 smithi087 ceph-mon[29523]: Deploying daemon osd.9 on smithi087 2024-05-08T05:23:16.458 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:23:15 smithi087 ceph-mon[29523]: pgmap v223: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 804 GiB / 805 GiB avail 2024-05-08T05:23:18.288 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:23:17 smithi160 ceph-mon[34827]: pgmap v224: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 804 GiB / 805 GiB avail 2024-05-08T05:23:18.323 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:23:17 smithi087 ceph-mon[29523]: pgmap v224: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 804 GiB / 805 GiB avail 2024-05-08T05:23:18.484 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:23:17 smithi090 ceph-mon[34526]: pgmap v224: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 804 GiB / 805 GiB avail 2024-05-08T05:23:20.288 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:23:19 smithi160 ceph-mon[34827]: pgmap v225: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 804 GiB / 805 GiB avail 2024-05-08T05:23:20.309 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:23:19 smithi087 ceph-mon[29523]: pgmap v225: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 804 GiB / 805 GiB avail 2024-05-08T05:23:20.483 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:23:19 smithi090 ceph-mon[34526]: pgmap v225: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 804 GiB / 805 GiB avail 2024-05-08T05:23:22.289 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:23:22 smithi160 ceph-mon[34827]: pgmap v226: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 804 GiB / 805 GiB avail 2024-05-08T05:23:22.397 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:23:22 smithi087 ceph-mon[29523]: pgmap v226: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 804 GiB / 805 GiB avail 2024-05-08T05:23:22.483 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:23:22 smithi090 ceph-mon[34526]: pgmap v226: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 804 GiB / 805 GiB avail 2024-05-08T05:23:24.208 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:23:23 smithi087 ceph-mon[29523]: pgmap v227: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 804 GiB / 805 GiB avail 2024-05-08T05:23:24.208 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:23:23 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:23:24.208 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:23:23 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:23:24.208 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:23:23 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T05:23:24.233 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:23:23 smithi090 ceph-mon[34526]: pgmap v227: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 804 GiB / 805 GiB avail 2024-05-08T05:23:24.233 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:23:23 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:23:24.233 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:23:23 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:23:24.234 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:23:23 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T05:23:24.289 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:23:23 smithi160 ceph-mon[34827]: pgmap v227: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 804 GiB / 805 GiB avail 2024-05-08T05:23:24.289 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:23:23 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:23:24.289 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:23:23 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:23:24.289 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:23:23 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T05:23:26.246 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:23:25 smithi087 ceph-mon[29523]: pgmap v228: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 804 GiB / 805 GiB avail 2024-05-08T05:23:26.288 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:23:25 smithi160 ceph-mon[34827]: pgmap v228: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 804 GiB / 805 GiB avail 2024-05-08T05:23:26.483 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:23:25 smithi090 ceph-mon[34526]: pgmap v228: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 804 GiB / 805 GiB avail 2024-05-08T05:23:27.666 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:23:27 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:23:27.666 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:23:27 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:23:27.666 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:23:27 smithi087 ceph-mon[29523]: from='osd.9 [v2:172.21.15.87:6826/3789116749,v1:172.21.15.87:6827/3789116749]' entity='osd.9' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]: dispatch 2024-05-08T05:23:27.733 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:23:27 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:23:27.733 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:23:27 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:23:27.733 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:23:27 smithi090 ceph-mon[34526]: from='osd.9 [v2:172.21.15.87:6826/3789116749,v1:172.21.15.87:6827/3789116749]' entity='osd.9' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]: dispatch 2024-05-08T05:23:27.751 INFO:teuthology.orchestra.run.smithi087.stdout:Created osd(s) 9 on host 'smithi087' 2024-05-08T05:23:27.751 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:23:27.750+0000 7f9e6be00700 1 -- 172.21.15.87:0/3629997122 <== mgr.14152 v2:172.21.15.87:6800/1189186457 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f9e740639a0 con 0x7f9e580b2900 2024-05-08T05:23:27.755 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:23:27.754+0000 7f9e7a200700 1 -- 172.21.15.87:0/3629997122 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f9e580b2900 msgr2=0x7f9e580b4dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:23:27.755 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:23:27.754+0000 7f9e7a200700 1 --2- 172.21.15.87:0/3629997122 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f9e580b2900 0x7f9e580b4dc0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f9e741067a0 tx=0x7f9e64009260 comp rx=0 tx=0).stop 2024-05-08T05:23:27.755 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:23:27.754+0000 7f9e7a200700 1 -- 172.21.15.87:0/3629997122 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9e74106940 msgr2=0x7f9e7419bd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:23:27.755 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:23:27.754+0000 7f9e7a200700 1 --2- 172.21.15.87:0/3629997122 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9e74106940 0x7f9e7419bd60 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f9e6000b580 tx=0x7f9e60003af0 comp rx=0 tx=0).stop 2024-05-08T05:23:27.755 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:23:27.754+0000 7f9e7a200700 1 -- 172.21.15.87:0/3629997122 shutdown_connections 2024-05-08T05:23:27.755 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:23:27.754+0000 7f9e7a200700 1 --2- 172.21.15.87:0/3629997122 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9e741072e0 0x7f9e741a2de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:23:27.756 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:23:27.754+0000 7f9e7a200700 1 --2- 172.21.15.87:0/3629997122 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f9e580b2900 0x7f9e580b4dc0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:23:27.756 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:23:27.754+0000 7f9e7a200700 1 --2- 172.21.15.87:0/3629997122 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f9e74105740 0x7f9e7419b820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:23:27.756 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:23:27.754+0000 7f9e7a200700 1 --2- 172.21.15.87:0/3629997122 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9e74106940 0x7f9e7419bd60 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:23:27.756 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:23:27.754+0000 7f9e7a200700 1 -- 172.21.15.87:0/3629997122 >> 172.21.15.87:0/3629997122 conn(0x7f9e74100d00 msgr2=0x7f9e74109cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:23:27.756 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:23:27.755+0000 7f9e7a200700 1 -- 172.21.15.87:0/3629997122 shutdown_connections 2024-05-08T05:23:27.756 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:23:27.755+0000 7f9e7a200700 1 -- 172.21.15.87:0/3629997122 wait complete. 2024-05-08T05:23:27.788 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:23:27 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:23:27.788 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:23:27 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:23:27.789 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:23:27 smithi160 ceph-mon[34827]: from='osd.9 [v2:172.21.15.87:6826/3789116749,v1:172.21.15.87:6827/3789116749]' entity='osd.9' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]: dispatch 2024-05-08T05:23:28.546 DEBUG:teuthology.orchestra.run.smithi087:osd.9> sudo journalctl -f -n 0 -u ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968@osd.9.service 2024-05-08T05:23:28.550 INFO:tasks.cephadm:Deploying osd.10 on smithi090 with /dev/vg_nvme/lv_1... 2024-05-08T05:23:28.551 DEBUG:teuthology.orchestra.run.smithi090:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid eeeb813e-0cf9-11ef-bc97-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_1 2024-05-08T05:23:28.733 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:23:28 smithi090 ceph-mon[34526]: pgmap v229: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 804 GiB / 805 GiB avail 2024-05-08T05:23:28.733 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:23:28 smithi090 ceph-mon[34526]: from='osd.9 [v2:172.21.15.87:6826/3789116749,v1:172.21.15.87:6827/3789116749]' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2024-05-08T05:23:28.733 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:23:28 smithi090 ceph-mon[34526]: osdmap e58: 10 total, 9 up, 10 in 2024-05-08T05:23:28.733 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:23:28 smithi090 ceph-mon[34526]: from='osd.9 [v2:172.21.15.87:6826/3789116749,v1:172.21.15.87:6827/3789116749]' entity='osd.9' cmd=[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi087", "root=default"]}]: dispatch 2024-05-08T05:23:28.733 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:23:28 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-05-08T05:23:28.734 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:23:28 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:23:28.734 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:23:28 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:23:28.788 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:23:28 smithi160 ceph-mon[34827]: pgmap v229: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 804 GiB / 805 GiB avail 2024-05-08T05:23:28.789 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:23:28 smithi160 ceph-mon[34827]: from='osd.9 [v2:172.21.15.87:6826/3789116749,v1:172.21.15.87:6827/3789116749]' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2024-05-08T05:23:28.789 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:23:28 smithi160 ceph-mon[34827]: osdmap e58: 10 total, 9 up, 10 in 2024-05-08T05:23:28.789 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:23:28 smithi160 ceph-mon[34827]: from='osd.9 [v2:172.21.15.87:6826/3789116749,v1:172.21.15.87:6827/3789116749]' entity='osd.9' cmd=[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi087", "root=default"]}]: dispatch 2024-05-08T05:23:28.789 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:23:28 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-05-08T05:23:28.789 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:23:28 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:23:28.789 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:23:28 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:23:28.794 INFO:teuthology.orchestra.run.smithi090.stderr:Inferring config /var/lib/ceph/eeeb813e-0cf9-11ef-bc97-c7b262605968/mon.b/config 2024-05-08T05:23:28.817 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:23:28 smithi087 ceph-mon[29523]: pgmap v229: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 804 GiB / 805 GiB avail 2024-05-08T05:23:28.817 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:23:28 smithi087 ceph-mon[29523]: from='osd.9 [v2:172.21.15.87:6826/3789116749,v1:172.21.15.87:6827/3789116749]' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2024-05-08T05:23:28.817 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:23:28 smithi087 ceph-mon[29523]: osdmap e58: 10 total, 9 up, 10 in 2024-05-08T05:23:28.817 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:23:28 smithi087 ceph-mon[29523]: from='osd.9 [v2:172.21.15.87:6826/3789116749,v1:172.21.15.87:6827/3789116749]' entity='osd.9' cmd=[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi087", "root=default"]}]: dispatch 2024-05-08T05:23:28.817 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:23:28 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-05-08T05:23:28.817 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:23:28 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:23:28.817 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:23:28 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:23:29.789 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:23:29 smithi160 ceph-mon[34827]: from='osd.9 [v2:172.21.15.87:6826/3789116749,v1:172.21.15.87:6827/3789116749]' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi087", "root=default"]}]': finished 2024-05-08T05:23:29.789 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:23:29 smithi160 ceph-mon[34827]: osdmap e59: 10 total, 9 up, 10 in 2024-05-08T05:23:29.789 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:23:29 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-05-08T05:23:29.789 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:23:29 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-05-08T05:23:29.873 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:23:29 smithi087 ceph-mon[29523]: from='osd.9 [v2:172.21.15.87:6826/3789116749,v1:172.21.15.87:6827/3789116749]' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi087", "root=default"]}]': finished 2024-05-08T05:23:29.873 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:23:29 smithi087 ceph-mon[29523]: osdmap e59: 10 total, 9 up, 10 in 2024-05-08T05:23:29.873 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:23:29 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-05-08T05:23:29.873 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:23:29 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-05-08T05:23:29.873 INFO:journalctl@ceph.osd.9.smithi087.stdout:May 08 05:23:29 smithi087 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-9[64574]: 2024-05-08T05:23:29.495+0000 7fb301c00700 -1 osd.9 0 waiting for initial osdmap 2024-05-08T05:23:29.874 INFO:journalctl@ceph.osd.9.smithi087.stdout:May 08 05:23:29 smithi087 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-9[64574]: 2024-05-08T05:23:29.577+0000 7fb2f7a00700 -1 osd.9 59 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-08T05:23:29.930 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:23:29 smithi090 ceph-mon[34526]: from='osd.9 [v2:172.21.15.87:6826/3789116749,v1:172.21.15.87:6827/3789116749]' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi087", "root=default"]}]': finished 2024-05-08T05:23:29.930 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:23:29 smithi090 ceph-mon[34526]: osdmap e59: 10 total, 9 up, 10 in 2024-05-08T05:23:29.930 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:23:29 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-05-08T05:23:29.931 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:23:29 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-05-08T05:23:30.734 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:23:30 smithi090 ceph-mon[34526]: purged_snaps scrub starts 2024-05-08T05:23:30.734 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:23:30 smithi090 ceph-mon[34526]: purged_snaps scrub ok 2024-05-08T05:23:30.734 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:23:30 smithi090 ceph-mon[34526]: pgmap v232: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 804 GiB / 805 GiB avail 2024-05-08T05:23:30.734 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:23:30 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-05-08T05:23:30.734 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:23:30 smithi090 ceph-mon[34526]: from='osd.9 [v2:172.21.15.87:6826/3789116749,v1:172.21.15.87:6827/3789116749]' entity='osd.9' 2024-05-08T05:23:30.788 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:23:30 smithi160 ceph-mon[34827]: purged_snaps scrub starts 2024-05-08T05:23:30.789 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:23:30 smithi160 ceph-mon[34827]: purged_snaps scrub ok 2024-05-08T05:23:30.789 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:23:30 smithi160 ceph-mon[34827]: pgmap v232: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 804 GiB / 805 GiB avail 2024-05-08T05:23:30.789 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:23:30 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-05-08T05:23:30.789 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:23:30 smithi160 ceph-mon[34827]: from='osd.9 [v2:172.21.15.87:6826/3789116749,v1:172.21.15.87:6827/3789116749]' entity='osd.9' 2024-05-08T05:23:30.842 INFO:teuthology.orchestra.run.smithi090.stderr:--> Zapping: /dev/vg_nvme/lv_1 2024-05-08T05:23:30.842 INFO:teuthology.orchestra.run.smithi090.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_1 bs=1M count=10 conv=fsync 2024-05-08T05:23:30.842 INFO:teuthology.orchestra.run.smithi090.stderr: stderr: 10+0 records in 2024-05-08T05:23:30.842 INFO:teuthology.orchestra.run.smithi090.stderr:10+0 records out 2024-05-08T05:23:30.842 INFO:teuthology.orchestra.run.smithi090.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0134876 s, 777 MB/s 2024-05-08T05:23:30.842 INFO:teuthology.orchestra.run.smithi090.stderr:--> Zapping successful for: 2024-05-08T05:23:30.959 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:23:30 smithi087 ceph-mon[29523]: purged_snaps scrub starts 2024-05-08T05:23:30.959 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:23:30 smithi087 ceph-mon[29523]: purged_snaps scrub ok 2024-05-08T05:23:30.959 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:23:30 smithi087 ceph-mon[29523]: pgmap v232: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 804 GiB / 805 GiB avail 2024-05-08T05:23:30.959 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:23:30 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-05-08T05:23:30.959 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:23:30 smithi087 ceph-mon[29523]: from='osd.9 [v2:172.21.15.87:6826/3789116749,v1:172.21.15.87:6827/3789116749]' entity='osd.9' 2024-05-08T05:23:31.502 DEBUG:teuthology.orchestra.run.smithi090:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid eeeb813e-0cf9-11ef-bc97-c7b262605968 -- ceph orch daemon add osd smithi090:vg_nvme/lv_1 2024-05-08T05:23:31.733 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:23:31 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-05-08T05:23:31.733 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:23:31 smithi090 ceph-mon[34526]: osd.9 [v2:172.21.15.87:6826/3789116749,v1:172.21.15.87:6827/3789116749] boot 2024-05-08T05:23:31.733 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:23:31 smithi090 ceph-mon[34526]: osdmap e60: 10 total, 10 up, 10 in 2024-05-08T05:23:31.733 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:23:31 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-05-08T05:23:31.743 INFO:teuthology.orchestra.run.smithi090.stderr:Inferring config /var/lib/ceph/eeeb813e-0cf9-11ef-bc97-c7b262605968/mon.b/config 2024-05-08T05:23:31.788 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:23:31 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-05-08T05:23:31.789 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:23:31 smithi160 ceph-mon[34827]: osd.9 [v2:172.21.15.87:6826/3789116749,v1:172.21.15.87:6827/3789116749] boot 2024-05-08T05:23:31.789 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:23:31 smithi160 ceph-mon[34827]: osdmap e60: 10 total, 10 up, 10 in 2024-05-08T05:23:31.789 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:23:31 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-05-08T05:23:31.958 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:23:31 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-05-08T05:23:31.958 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:23:31 smithi087 ceph-mon[29523]: osd.9 [v2:172.21.15.87:6826/3789116749,v1:172.21.15.87:6827/3789116749] boot 2024-05-08T05:23:31.958 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:23:31 smithi087 ceph-mon[29523]: osdmap e60: 10 total, 10 up, 10 in 2024-05-08T05:23:31.959 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:23:31 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-05-08T05:23:32.708 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:23:32 smithi087 ceph-mon[29523]: pgmap v234: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 804 GiB / 805 GiB avail 2024-05-08T05:23:32.708 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:23:32 smithi087 ceph-mon[29523]: osdmap e61: 10 total, 10 up, 10 in 2024-05-08T05:23:32.788 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:23:32 smithi160 ceph-mon[34827]: pgmap v234: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 804 GiB / 805 GiB avail 2024-05-08T05:23:32.789 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:23:32 smithi160 ceph-mon[34827]: osdmap e61: 10 total, 10 up, 10 in 2024-05-08T05:23:32.841 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:23:32 smithi090 ceph-mon[34526]: pgmap v234: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 804 GiB / 805 GiB avail 2024-05-08T05:23:32.841 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:23:32 smithi090 ceph-mon[34526]: osdmap e61: 10 total, 10 up, 10 in 2024-05-08T05:23:33.316 INFO:teuthology.orchestra.run.smithi090.stderr:2024-05-08T05:23:33.313+0000 7f71c37f9700 1 -- 172.21.15.90:0/2767488503 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f71bc103620 msgr2=0x7f71bc103a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:23:33.316 INFO:teuthology.orchestra.run.smithi090.stderr:2024-05-08T05:23:33.313+0000 7f71c37f9700 1 --2- 172.21.15.90:0/2767488503 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f71bc103620 0x7f71bc103a80 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f71b80099c0 tx=0x7f71b8009cd0 comp rx=0 tx=0).stop 2024-05-08T05:23:33.317 INFO:teuthology.orchestra.run.smithi090.stderr:2024-05-08T05:23:33.313+0000 7f71c37f9700 1 -- 172.21.15.90:0/2767488503 shutdown_connections 2024-05-08T05:23:33.317 INFO:teuthology.orchestra.run.smithi090.stderr:2024-05-08T05:23:33.313+0000 7f71c37f9700 1 --2- 172.21.15.90:0/2767488503 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f71bc103fc0 0x7f71bc10a870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:23:33.317 INFO:teuthology.orchestra.run.smithi090.stderr:2024-05-08T05:23:33.313+0000 7f71c37f9700 1 --2- 172.21.15.90:0/2767488503 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f71bc102420 0x7f71bc102840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:23:33.317 INFO:teuthology.orchestra.run.smithi090.stderr:2024-05-08T05:23:33.313+0000 7f71c37f9700 1 --2- 172.21.15.90:0/2767488503 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f71bc103620 0x7f71bc103a80 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:23:33.317 INFO:teuthology.orchestra.run.smithi090.stderr:2024-05-08T05:23:33.313+0000 7f71c37f9700 1 -- 172.21.15.90:0/2767488503 >> 172.21.15.90:0/2767488503 conn(0x7f71bc0fda00 msgr2=0x7f71bc0ffe20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:23:33.317 INFO:teuthology.orchestra.run.smithi090.stderr:2024-05-08T05:23:33.313+0000 7f71c37f9700 1 -- 172.21.15.90:0/2767488503 shutdown_connections 2024-05-08T05:23:33.317 INFO:teuthology.orchestra.run.smithi090.stderr:2024-05-08T05:23:33.313+0000 7f71c37f9700 1 -- 172.21.15.90:0/2767488503 wait complete. 2024-05-08T05:23:33.317 INFO:teuthology.orchestra.run.smithi090.stderr:2024-05-08T05:23:33.314+0000 7f71c37f9700 1 Processor -- start 2024-05-08T05:23:33.317 INFO:teuthology.orchestra.run.smithi090.stderr:2024-05-08T05:23:33.314+0000 7f71c37f9700 1 -- start start 2024-05-08T05:23:33.317 INFO:teuthology.orchestra.run.smithi090.stderr:2024-05-08T05:23:33.314+0000 7f71c37f9700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f71bc102420 0x7f71bc198620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:23:33.317 INFO:teuthology.orchestra.run.smithi090.stderr:2024-05-08T05:23:33.314+0000 7f71c37f9700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f71bc103620 0x7f71bc198b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:23:33.317 INFO:teuthology.orchestra.run.smithi090.stderr:2024-05-08T05:23:33.314+0000 7f71c37f9700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f71bc103fc0 0x7f71bc19fbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:23:33.317 INFO:teuthology.orchestra.run.smithi090.stderr:2024-05-08T05:23:33.314+0000 7f71c37f9700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f71bc10dfb0 con 0x7f71bc103620 2024-05-08T05:23:33.317 INFO:teuthology.orchestra.run.smithi090.stderr:2024-05-08T05:23:33.314+0000 7f71c37f9700 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f71bc10de30 con 0x7f71bc103fc0 2024-05-08T05:23:33.317 INFO:teuthology.orchestra.run.smithi090.stderr:2024-05-08T05:23:33.314+0000 7f71c37f9700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f71bc10e130 con 0x7f71bc102420 2024-05-08T05:23:33.318 INFO:teuthology.orchestra.run.smithi090.stderr:2024-05-08T05:23:33.314+0000 7f71c1d96700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f71bc103fc0 0x7f71bc19fbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:23:33.318 INFO:teuthology.orchestra.run.smithi090.stderr:2024-05-08T05:23:33.314+0000 7f71c1d96700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f71bc103fc0 0x7f71bc19fbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:50984/0 (socket says 172.21.15.90:50984) 2024-05-08T05:23:33.318 INFO:teuthology.orchestra.run.smithi090.stderr:2024-05-08T05:23:33.314+0000 7f71c1d96700 1 -- 172.21.15.90:0/1007501707 learned_addr learned my addr 172.21.15.90:0/1007501707 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-05-08T05:23:33.318 INFO:teuthology.orchestra.run.smithi090.stderr:2024-05-08T05:23:33.314+0000 7f71c1595700 1 --2- 172.21.15.90:0/1007501707 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f71bc102420 0x7f71bc198620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:23:33.318 INFO:teuthology.orchestra.run.smithi090.stderr:2024-05-08T05:23:33.314+0000 7f71c0d94700 1 --2- 172.21.15.90:0/1007501707 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f71bc103620 0x7f71bc198b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:23:33.318 INFO:teuthology.orchestra.run.smithi090.stderr:2024-05-08T05:23:33.314+0000 7f71c1d96700 1 -- 172.21.15.90:0/1007501707 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f71bc102420 msgr2=0x7f71bc198620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:23:33.318 INFO:teuthology.orchestra.run.smithi090.stderr:2024-05-08T05:23:33.314+0000 7f71c1d96700 1 --2- 172.21.15.90:0/1007501707 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f71bc102420 0x7f71bc198620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:23:33.318 INFO:teuthology.orchestra.run.smithi090.stderr:2024-05-08T05:23:33.314+0000 7f71c1d96700 1 -- 172.21.15.90:0/1007501707 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f71bc103620 msgr2=0x7f71bc198b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:23:33.318 INFO:teuthology.orchestra.run.smithi090.stderr:2024-05-08T05:23:33.314+0000 7f71c1d96700 1 --2- 172.21.15.90:0/1007501707 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f71bc103620 0x7f71bc198b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:23:33.318 INFO:teuthology.orchestra.run.smithi090.stderr:2024-05-08T05:23:33.314+0000 7f71c1d96700 1 -- 172.21.15.90:0/1007501707 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f71bc1a0280 con 0x7f71bc103fc0 2024-05-08T05:23:33.318 INFO:teuthology.orchestra.run.smithi090.stderr:2024-05-08T05:23:33.314+0000 7f71c1595700 1 --2- 172.21.15.90:0/1007501707 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f71bc102420 0x7f71bc198620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T05:23:33.318 INFO:teuthology.orchestra.run.smithi090.stderr:2024-05-08T05:23:33.315+0000 7f71c1d96700 1 --2- 172.21.15.90:0/1007501707 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f71bc103fc0 0x7f71bc19fbe0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f71b400b970 tx=0x7f71b400bd30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:23:33.318 INFO:teuthology.orchestra.run.smithi090.stderr:2024-05-08T05:23:33.315+0000 7f71b27fc700 1 -- 172.21.15.90:0/1007501707 <== mon.2 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71b4019070 con 0x7f71bc103fc0 2024-05-08T05:23:33.318 INFO:teuthology.orchestra.run.smithi090.stderr:2024-05-08T05:23:33.315+0000 7f71c37f9700 1 -- 172.21.15.90:0/1007501707 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f71bc1a0570 con 0x7f71bc103fc0 2024-05-08T05:23:33.318 INFO:teuthology.orchestra.run.smithi090.stderr:2024-05-08T05:23:33.315+0000 7f71b27fc700 1 -- 172.21.15.90:0/1007501707 <== mon.2 v2:172.21.15.90:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f71b4014440 con 0x7f71bc103fc0 2024-05-08T05:23:33.319 INFO:teuthology.orchestra.run.smithi090.stderr:2024-05-08T05:23:33.315+0000 7f71b27fc700 1 -- 172.21.15.90:0/1007501707 <== mon.2 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71b400ce60 con 0x7f71bc103fc0 2024-05-08T05:23:33.319 INFO:teuthology.orchestra.run.smithi090.stderr:2024-05-08T05:23:33.315+0000 7f71c37f9700 1 -- 172.21.15.90:0/1007501707 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f71bc1a0b30 con 0x7f71bc103fc0 2024-05-08T05:23:33.319 INFO:teuthology.orchestra.run.smithi090.stderr:2024-05-08T05:23:33.316+0000 7f71c37f9700 1 -- 172.21.15.90:0/1007501707 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f71bc06a190 con 0x7f71bc103fc0 2024-05-08T05:23:33.319 INFO:teuthology.orchestra.run.smithi090.stderr:2024-05-08T05:23:33.317+0000 7f71b27fc700 1 -- 172.21.15.90:0/1007501707 <== mon.2 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 16) ==== 149652+0+0 (secure 0 0 0) 0x7f71b401c070 con 0x7f71bc103fc0 2024-05-08T05:23:33.319 INFO:teuthology.orchestra.run.smithi090.stderr:2024-05-08T05:23:33.318+0000 7f71b27fc700 1 --2- 172.21.15.90:0/1007501707 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f71a80b2880 0x7f71a80b4d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:23:33.320 INFO:teuthology.orchestra.run.smithi090.stderr:2024-05-08T05:23:33.318+0000 7f71b27fc700 1 -- 172.21.15.90:0/1007501707 <== mon.2 v2:172.21.15.90:3300/0 5 ==== osd_map(61..61 src has 1..61) ==== 6261+0+0 (secure 0 0 0) 0x7f71b40e1260 con 0x7f71bc103fc0 2024-05-08T05:23:33.320 INFO:teuthology.orchestra.run.smithi090.stderr:2024-05-08T05:23:33.318+0000 7f71c1595700 1 --2- 172.21.15.90:0/1007501707 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f71a80b2880 0x7f71a80b4d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:23:33.320 INFO:teuthology.orchestra.run.smithi090.stderr:2024-05-08T05:23:33.319+0000 7f71c1595700 1 --2- 172.21.15.90:0/1007501707 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f71a80b2880 0x7f71a80b4d40 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f71bc103480 tx=0x7f71ac008040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:23:33.322 INFO:teuthology.orchestra.run.smithi090.stderr:2024-05-08T05:23:33.321+0000 7f71b27fc700 1 -- 172.21.15.90:0/1007501707 <== mon.2 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f71b40a9780 con 0x7f71bc103fc0 2024-05-08T05:23:33.536 INFO:teuthology.orchestra.run.smithi090.stderr:2024-05-08T05:23:33.535+0000 7f71c37f9700 1 -- 172.21.15.90:0/1007501707 --> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi090:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) -- 0x7f71bc0638e0 con 0x7f71a80b2880 2024-05-08T05:23:34.484 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:23:34 smithi090 ceph-mon[34526]: pgmap v236: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 894 GiB / 894 GiB avail 2024-05-08T05:23:34.484 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:23:34 smithi090 ceph-mon[34526]: Detected new or changed devices on smithi087 2024-05-08T05:23:34.484 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:23:34 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:23:34.484 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:23:34 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:23:34.484 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:23:34 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-05-08T05:23:34.484 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:23:34 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-05-08T05:23:34.484 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:23:34 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-05-08T05:23:34.484 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:23:34 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-05-08T05:23:34.484 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:23:34 smithi090 ceph-mon[34526]: Adjusting osd_memory_target on smithi087 to 4272M 2024-05-08T05:23:34.484 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:23:34 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:23:34.484 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:23:34 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T05:23:34.484 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:23:34 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T05:23:34.484 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:23:34 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:23:34.485 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:23:34 smithi090 ceph-mon[34526]: from='client.24350 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi090:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-05-08T05:23:34.485 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:23:34 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-08T05:23:34.485 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:23:34 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-08T05:23:34.485 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:23:34 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T05:23:34.485 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:23:34 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T05:23:34.485 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:23:34 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T05:23:34.485 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:23:34 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T05:23:34.485 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:23:34 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:23:34.709 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:23:34 smithi087 ceph-mon[29523]: pgmap v236: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 894 GiB / 894 GiB avail 2024-05-08T05:23:34.709 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:23:34 smithi087 ceph-mon[29523]: Detected new or changed devices on smithi087 2024-05-08T05:23:34.709 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:23:34 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:23:34.709 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:23:34 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:23:34.709 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:23:34 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-05-08T05:23:34.709 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:23:34 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-05-08T05:23:34.710 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:23:34 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-05-08T05:23:34.710 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:23:34 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-05-08T05:23:34.710 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:23:34 smithi087 ceph-mon[29523]: Adjusting osd_memory_target on smithi087 to 4272M 2024-05-08T05:23:34.710 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:23:34 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:23:34.710 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:23:34 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T05:23:34.710 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:23:34 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T05:23:34.710 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:23:34 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:23:34.710 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:23:34 smithi087 ceph-mon[29523]: from='client.24350 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi090:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-05-08T05:23:34.710 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:23:34 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-08T05:23:34.710 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:23:34 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-08T05:23:34.710 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:23:34 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T05:23:34.710 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:23:34 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T05:23:34.710 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:23:34 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T05:23:34.710 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:23:34 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T05:23:34.710 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:23:34 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:23:34.789 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:23:34 smithi160 ceph-mon[34827]: pgmap v236: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 894 GiB / 894 GiB avail 2024-05-08T05:23:34.789 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:23:34 smithi160 ceph-mon[34827]: Detected new or changed devices on smithi087 2024-05-08T05:23:34.789 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:23:34 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:23:34.789 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:23:34 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:23:34.789 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:23:34 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-05-08T05:23:34.789 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:23:34 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-05-08T05:23:34.789 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:23:34 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-05-08T05:23:34.789 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:23:34 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-05-08T05:23:34.789 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:23:34 smithi160 ceph-mon[34827]: Adjusting osd_memory_target on smithi087 to 4272M 2024-05-08T05:23:34.789 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:23:34 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:23:34.789 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:23:34 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T05:23:34.789 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:23:34 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T05:23:34.789 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:23:34 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:23:34.790 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:23:34 smithi160 ceph-mon[34827]: from='client.24350 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi090:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-05-08T05:23:34.790 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:23:34 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-08T05:23:34.790 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:23:34 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-08T05:23:34.790 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:23:34 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T05:23:34.790 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:23:34 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T05:23:34.790 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:23:34 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T05:23:34.790 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:23:34 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T05:23:34.790 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:23:34 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:23:36.591 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:23:36 smithi160 ceph-mon[34827]: pgmap v237: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 894 GiB / 894 GiB avail 2024-05-08T05:23:36.591 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:23:36 smithi160 ceph-mon[34827]: from='client.? 172.21.15.90:0/2600764085' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "43945081-b4c8-4f5d-9301-3540709e69e4"}]: dispatch 2024-05-08T05:23:36.591 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:23:36 smithi160 ceph-mon[34827]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "43945081-b4c8-4f5d-9301-3540709e69e4"}]: dispatch 2024-05-08T05:23:36.591 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:23:36 smithi160 ceph-mon[34827]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "43945081-b4c8-4f5d-9301-3540709e69e4"}]': finished 2024-05-08T05:23:36.591 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:23:36 smithi160 ceph-mon[34827]: osdmap e62: 11 total, 10 up, 11 in 2024-05-08T05:23:36.591 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:23:36 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-05-08T05:23:36.645 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:23:36 smithi090 ceph-mon[34526]: pgmap v237: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 894 GiB / 894 GiB avail 2024-05-08T05:23:36.645 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:23:36 smithi090 ceph-mon[34526]: from='client.? 172.21.15.90:0/2600764085' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "43945081-b4c8-4f5d-9301-3540709e69e4"}]: dispatch 2024-05-08T05:23:36.645 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:23:36 smithi090 ceph-mon[34526]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "43945081-b4c8-4f5d-9301-3540709e69e4"}]: dispatch 2024-05-08T05:23:36.645 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:23:36 smithi090 ceph-mon[34526]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "43945081-b4c8-4f5d-9301-3540709e69e4"}]': finished 2024-05-08T05:23:36.645 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:23:36 smithi090 ceph-mon[34526]: osdmap e62: 11 total, 10 up, 11 in 2024-05-08T05:23:36.645 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:23:36 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-05-08T05:23:36.708 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:23:36 smithi087 ceph-mon[29523]: pgmap v237: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 894 GiB / 894 GiB avail 2024-05-08T05:23:36.708 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:23:36 smithi087 ceph-mon[29523]: from='client.? 172.21.15.90:0/2600764085' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "43945081-b4c8-4f5d-9301-3540709e69e4"}]: dispatch 2024-05-08T05:23:36.708 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:23:36 smithi087 ceph-mon[29523]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "43945081-b4c8-4f5d-9301-3540709e69e4"}]: dispatch 2024-05-08T05:23:36.709 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:23:36 smithi087 ceph-mon[29523]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "43945081-b4c8-4f5d-9301-3540709e69e4"}]': finished 2024-05-08T05:23:36.709 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:23:36 smithi087 ceph-mon[29523]: osdmap e62: 11 total, 10 up, 11 in 2024-05-08T05:23:36.709 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:23:36 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-05-08T05:23:37.708 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:23:37 smithi087 ceph-mon[29523]: from='client.? 172.21.15.90:0/3355317680' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-08T05:23:37.733 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:23:37 smithi090 ceph-mon[34526]: from='client.? 172.21.15.90:0/3355317680' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-08T05:23:37.781 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:23:37 smithi160 ceph-mon[34827]: from='client.? 172.21.15.90:0/3355317680' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-08T05:23:38.708 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:23:38 smithi087 ceph-mon[29523]: pgmap v239: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 894 GiB / 894 GiB avail 2024-05-08T05:23:38.733 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:23:38 smithi090 ceph-mon[34526]: pgmap v239: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 894 GiB / 894 GiB avail 2024-05-08T05:23:38.788 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:23:38 smithi160 ceph-mon[34827]: pgmap v239: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 894 GiB / 894 GiB avail 2024-05-08T05:23:40.483 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:23:40 smithi090 ceph-mon[34526]: pgmap v240: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 894 GiB / 894 GiB avail 2024-05-08T05:23:40.708 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:23:40 smithi087 ceph-mon[29523]: pgmap v240: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 894 GiB / 894 GiB avail 2024-05-08T05:23:40.788 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:23:40 smithi160 ceph-mon[34827]: pgmap v240: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 894 GiB / 894 GiB avail 2024-05-08T05:23:42.483 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:23:42 smithi090 ceph-mon[34526]: pgmap v241: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 894 GiB / 894 GiB avail 2024-05-08T05:23:42.708 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:23:42 smithi087 ceph-mon[29523]: pgmap v241: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 894 GiB / 894 GiB avail 2024-05-08T05:23:42.788 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:23:42 smithi160 ceph-mon[34827]: pgmap v241: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 894 GiB / 894 GiB avail 2024-05-08T05:23:44.708 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:23:44 smithi087 ceph-mon[29523]: pgmap v242: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 894 GiB / 894 GiB avail 2024-05-08T05:23:44.708 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:23:44 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.10"}]: dispatch 2024-05-08T05:23:44.709 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:23:44 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T05:23:44.733 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:23:44 smithi090 ceph-mon[34526]: pgmap v242: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 894 GiB / 894 GiB avail 2024-05-08T05:23:44.734 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:23:44 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.10"}]: dispatch 2024-05-08T05:23:44.734 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:23:44 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T05:23:44.789 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:23:44 smithi160 ceph-mon[34827]: pgmap v242: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 894 GiB / 894 GiB avail 2024-05-08T05:23:44.789 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:23:44 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.10"}]: dispatch 2024-05-08T05:23:44.789 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:23:44 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T05:23:45.708 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:23:45 smithi087 ceph-mon[29523]: Deploying daemon osd.10 on smithi090 2024-05-08T05:23:45.733 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:23:45 smithi090 ceph-mon[34526]: Deploying daemon osd.10 on smithi090 2024-05-08T05:23:45.788 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:23:45 smithi160 ceph-mon[34827]: Deploying daemon osd.10 on smithi090 2024-05-08T05:23:46.527 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:23:46 smithi090 ceph-mon[34526]: pgmap v243: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 894 GiB / 894 GiB avail 2024-05-08T05:23:46.708 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:23:46 smithi087 ceph-mon[29523]: pgmap v243: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 894 GiB / 894 GiB avail 2024-05-08T05:23:46.789 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:23:46 smithi160 ceph-mon[34827]: pgmap v243: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 894 GiB / 894 GiB avail 2024-05-08T05:23:48.483 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:23:48 smithi090 ceph-mon[34526]: pgmap v244: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 894 GiB / 894 GiB avail 2024-05-08T05:23:48.708 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:23:48 smithi087 ceph-mon[29523]: pgmap v244: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 894 GiB / 894 GiB avail 2024-05-08T05:23:48.788 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:23:48 smithi160 ceph-mon[34827]: pgmap v244: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 894 GiB / 894 GiB avail 2024-05-08T05:23:50.475 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:23:50 smithi090 ceph-mon[34526]: pgmap v245: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 894 GiB / 894 GiB avail 2024-05-08T05:23:50.475 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:23:50 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T05:23:50.475 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:23:50 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:23:50.475 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:23:50 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:23:50.708 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:23:50 smithi087 ceph-mon[29523]: pgmap v245: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 894 GiB / 894 GiB avail 2024-05-08T05:23:50.709 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:23:50 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T05:23:50.709 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:23:50 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:23:50.709 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:23:50 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:23:50.788 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:23:50 smithi160 ceph-mon[34827]: pgmap v245: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 894 GiB / 894 GiB avail 2024-05-08T05:23:50.789 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:23:50 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T05:23:50.789 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:23:50 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:23:50.789 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:23:50 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:23:52.708 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:23:52 smithi087 ceph-mon[29523]: pgmap v246: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 894 GiB / 894 GiB avail 2024-05-08T05:23:52.734 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:23:52 smithi090 ceph-mon[34526]: pgmap v246: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 894 GiB / 894 GiB avail 2024-05-08T05:23:52.789 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:23:52 smithi160 ceph-mon[34827]: pgmap v246: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 894 GiB / 894 GiB avail 2024-05-08T05:23:53.369 INFO:teuthology.orchestra.run.smithi090.stdout:Created osd(s) 10 on host 'smithi090' 2024-05-08T05:23:53.370 INFO:teuthology.orchestra.run.smithi090.stderr:2024-05-08T05:23:53.368+0000 7f71b27fc700 1 -- 172.21.15.90:0/1007501707 <== mgr.14152 v2:172.21.15.87:6800/1189186457 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+38 (secure 0 0 0) 0x7f71bc0638e0 con 0x7f71a80b2880 2024-05-08T05:23:53.371 INFO:teuthology.orchestra.run.smithi090.stderr:2024-05-08T05:23:53.370+0000 7f71c37f9700 1 -- 172.21.15.90:0/1007501707 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f71a80b2880 msgr2=0x7f71a80b4d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:23:53.371 INFO:teuthology.orchestra.run.smithi090.stderr:2024-05-08T05:23:53.370+0000 7f71c37f9700 1 --2- 172.21.15.90:0/1007501707 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f71a80b2880 0x7f71a80b4d40 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f71bc103480 tx=0x7f71ac008040 comp rx=0 tx=0).stop 2024-05-08T05:23:53.372 INFO:teuthology.orchestra.run.smithi090.stderr:2024-05-08T05:23:53.370+0000 7f71c37f9700 1 -- 172.21.15.90:0/1007501707 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f71bc103fc0 msgr2=0x7f71bc19fbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:23:53.372 INFO:teuthology.orchestra.run.smithi090.stderr:2024-05-08T05:23:53.370+0000 7f71c37f9700 1 --2- 172.21.15.90:0/1007501707 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f71bc103fc0 0x7f71bc19fbe0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f71b400b970 tx=0x7f71b400bd30 comp rx=0 tx=0).stop 2024-05-08T05:23:53.372 INFO:teuthology.orchestra.run.smithi090.stderr:2024-05-08T05:23:53.370+0000 7f71c37f9700 1 -- 172.21.15.90:0/1007501707 shutdown_connections 2024-05-08T05:23:53.372 INFO:teuthology.orchestra.run.smithi090.stderr:2024-05-08T05:23:53.370+0000 7f71c37f9700 1 --2- 172.21.15.90:0/1007501707 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f71bc103fc0 0x7f71bc19fbe0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:23:53.372 INFO:teuthology.orchestra.run.smithi090.stderr:2024-05-08T05:23:53.370+0000 7f71c37f9700 1 --2- 172.21.15.90:0/1007501707 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f71a80b2880 0x7f71a80b4d40 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:23:53.373 INFO:teuthology.orchestra.run.smithi090.stderr:2024-05-08T05:23:53.370+0000 7f71c37f9700 1 --2- 172.21.15.90:0/1007501707 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f71bc102420 0x7f71bc198620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:23:53.373 INFO:teuthology.orchestra.run.smithi090.stderr:2024-05-08T05:23:53.370+0000 7f71c37f9700 1 --2- 172.21.15.90:0/1007501707 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f71bc103620 0x7f71bc198b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:23:53.373 INFO:teuthology.orchestra.run.smithi090.stderr:2024-05-08T05:23:53.370+0000 7f71c37f9700 1 -- 172.21.15.90:0/1007501707 >> 172.21.15.90:0/1007501707 conn(0x7f71bc0fda00 msgr2=0x7f71bc1069a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:23:53.373 INFO:teuthology.orchestra.run.smithi090.stderr:2024-05-08T05:23:53.370+0000 7f71c37f9700 1 -- 172.21.15.90:0/1007501707 shutdown_connections 2024-05-08T05:23:53.374 INFO:teuthology.orchestra.run.smithi090.stderr:2024-05-08T05:23:53.370+0000 7f71c37f9700 1 -- 172.21.15.90:0/1007501707 wait complete. 2024-05-08T05:23:54.015 DEBUG:teuthology.orchestra.run.smithi090:osd.10> sudo journalctl -f -n 0 -u ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968@osd.10.service 2024-05-08T05:23:54.017 INFO:tasks.cephadm:Deploying osd.11 on smithi160 with /dev/vg_nvme/lv_1... 2024-05-08T05:23:54.017 DEBUG:teuthology.orchestra.run.smithi160:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid eeeb813e-0cf9-11ef-bc97-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_1 2024-05-08T05:23:54.266 INFO:teuthology.orchestra.run.smithi160.stderr:Inferring config /var/lib/ceph/eeeb813e-0cf9-11ef-bc97-c7b262605968/mon.c/config 2024-05-08T05:23:54.622 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:23:54 smithi160 ceph-mon[34827]: pgmap v247: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 894 GiB / 894 GiB avail 2024-05-08T05:23:54.622 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:23:54 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:23:54.622 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:23:54 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:23:54.623 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:23:54 smithi160 ceph-mon[34827]: from='osd.10 [v2:172.21.15.90:6824/716529498,v1:172.21.15.90:6825/716529498]' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-05-08T05:23:54.623 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:23:54 smithi160 ceph-mon[34827]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-05-08T05:23:54.623 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:23:54 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:23:54.623 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:23:54 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:23:54.709 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:23:54 smithi087 ceph-mon[29523]: pgmap v247: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 894 GiB / 894 GiB avail 2024-05-08T05:23:54.709 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:23:54 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:23:54.709 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:23:54 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:23:54.709 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:23:54 smithi087 ceph-mon[29523]: from='osd.10 [v2:172.21.15.90:6824/716529498,v1:172.21.15.90:6825/716529498]' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-05-08T05:23:54.709 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:23:54 smithi087 ceph-mon[29523]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-05-08T05:23:54.709 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:23:54 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:23:54.709 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:23:54 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:23:54.733 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:23:54 smithi090 ceph-mon[34526]: pgmap v247: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 894 GiB / 894 GiB avail 2024-05-08T05:23:54.733 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:23:54 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:23:54.733 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:23:54 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:23:54.733 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:23:54 smithi090 ceph-mon[34526]: from='osd.10 [v2:172.21.15.90:6824/716529498,v1:172.21.15.90:6825/716529498]' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-05-08T05:23:54.733 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:23:54 smithi090 ceph-mon[34526]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-05-08T05:23:54.734 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:23:54 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:23:54.734 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:23:54 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:23:55.708 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:23:55 smithi087 ceph-mon[29523]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2024-05-08T05:23:55.708 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:23:55 smithi087 ceph-mon[29523]: from='osd.10 [v2:172.21.15.90:6824/716529498,v1:172.21.15.90:6825/716529498]' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi090", "root=default"]}]: dispatch 2024-05-08T05:23:55.708 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:23:55 smithi087 ceph-mon[29523]: osdmap e63: 11 total, 10 up, 11 in 2024-05-08T05:23:55.708 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:23:55 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-05-08T05:23:55.709 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:23:55 smithi087 ceph-mon[29523]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi090", "root=default"]}]: dispatch 2024-05-08T05:23:55.712 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:23:55 smithi160 ceph-mon[34827]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2024-05-08T05:23:55.712 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:23:55 smithi160 ceph-mon[34827]: from='osd.10 [v2:172.21.15.90:6824/716529498,v1:172.21.15.90:6825/716529498]' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi090", "root=default"]}]: dispatch 2024-05-08T05:23:55.712 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:23:55 smithi160 ceph-mon[34827]: osdmap e63: 11 total, 10 up, 11 in 2024-05-08T05:23:55.712 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:23:55 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-05-08T05:23:55.712 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:23:55 smithi160 ceph-mon[34827]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi090", "root=default"]}]: dispatch 2024-05-08T05:23:55.733 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:23:55 smithi090 ceph-mon[34526]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2024-05-08T05:23:55.733 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:23:55 smithi090 ceph-mon[34526]: from='osd.10 [v2:172.21.15.90:6824/716529498,v1:172.21.15.90:6825/716529498]' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi090", "root=default"]}]: dispatch 2024-05-08T05:23:55.733 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:23:55 smithi090 ceph-mon[34526]: osdmap e63: 11 total, 10 up, 11 in 2024-05-08T05:23:55.733 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:23:55 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-05-08T05:23:55.733 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:23:55 smithi090 ceph-mon[34526]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi090", "root=default"]}]: dispatch 2024-05-08T05:23:56.327 INFO:teuthology.orchestra.run.smithi160.stderr:--> Zapping: /dev/vg_nvme/lv_1 2024-05-08T05:23:56.328 INFO:teuthology.orchestra.run.smithi160.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_1 bs=1M count=10 conv=fsync 2024-05-08T05:23:56.328 INFO:teuthology.orchestra.run.smithi160.stderr: stderr: 10+0 records in 2024-05-08T05:23:56.328 INFO:teuthology.orchestra.run.smithi160.stderr:10+0 records out 2024-05-08T05:23:56.328 INFO:teuthology.orchestra.run.smithi160.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0114899 s, 913 MB/s 2024-05-08T05:23:56.328 INFO:teuthology.orchestra.run.smithi160.stderr:--> Zapping successful for: 2024-05-08T05:23:56.440 INFO:journalctl@ceph.osd.10.smithi090.stdout:May 08 05:23:56 smithi090 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-10[59300]: 2024-05-08T05:23:56.341+0000 7f51627cd700 -1 osd.10 0 waiting for initial osdmap 2024-05-08T05:23:56.657 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:23:56 smithi160 ceph-mon[34827]: pgmap v249: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 894 GiB / 894 GiB avail 2024-05-08T05:23:56.657 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:23:56 smithi160 ceph-mon[34827]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi090", "root=default"]}]': finished 2024-05-08T05:23:56.657 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:23:56 smithi160 ceph-mon[34827]: osdmap e64: 11 total, 10 up, 11 in 2024-05-08T05:23:56.657 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:23:56 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-05-08T05:23:56.657 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:23:56 smithi160 ceph-mon[34827]: from='osd.10 ' entity='osd.10' 2024-05-08T05:23:56.708 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:23:56 smithi087 ceph-mon[29523]: pgmap v249: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 894 GiB / 894 GiB avail 2024-05-08T05:23:56.709 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:23:56 smithi087 ceph-mon[29523]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi090", "root=default"]}]': finished 2024-05-08T05:23:56.709 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:23:56 smithi087 ceph-mon[29523]: osdmap e64: 11 total, 10 up, 11 in 2024-05-08T05:23:56.709 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:23:56 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-05-08T05:23:56.709 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:23:56 smithi087 ceph-mon[29523]: from='osd.10 ' entity='osd.10' 2024-05-08T05:23:56.733 INFO:journalctl@ceph.osd.10.smithi090.stdout:May 08 05:23:56 smithi090 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-10[59300]: 2024-05-08T05:23:56.490+0000 7f515a5b8700 -1 osd.10 65 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-08T05:23:56.734 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:23:56 smithi090 ceph-mon[34526]: pgmap v249: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 894 GiB / 894 GiB avail 2024-05-08T05:23:56.734 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:23:56 smithi090 ceph-mon[34526]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi090", "root=default"]}]': finished 2024-05-08T05:23:56.734 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:23:56 smithi090 ceph-mon[34526]: osdmap e64: 11 total, 10 up, 11 in 2024-05-08T05:23:56.734 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:23:56 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-05-08T05:23:56.734 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:23:56 smithi090 ceph-mon[34526]: from='osd.10 ' entity='osd.10' 2024-05-08T05:23:56.994 DEBUG:teuthology.orchestra.run.smithi160:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid eeeb813e-0cf9-11ef-bc97-c7b262605968 -- ceph orch daemon add osd smithi160:vg_nvme/lv_1 2024-05-08T05:23:57.234 INFO:teuthology.orchestra.run.smithi160.stderr:Inferring config /var/lib/ceph/eeeb813e-0cf9-11ef-bc97-c7b262605968/mon.c/config 2024-05-08T05:23:57.602 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:23:57 smithi160 ceph-mon[34827]: purged_snaps scrub starts 2024-05-08T05:23:57.602 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:23:57 smithi160 ceph-mon[34827]: purged_snaps scrub ok 2024-05-08T05:23:57.602 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:23:57 smithi160 ceph-mon[34827]: osdmap e65: 11 total, 10 up, 11 in 2024-05-08T05:23:57.603 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:23:57 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-05-08T05:23:57.642 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:23:57 smithi090 ceph-mon[34526]: purged_snaps scrub starts 2024-05-08T05:23:57.642 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:23:57 smithi090 ceph-mon[34526]: purged_snaps scrub ok 2024-05-08T05:23:57.642 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:23:57 smithi090 ceph-mon[34526]: osdmap e65: 11 total, 10 up, 11 in 2024-05-08T05:23:57.642 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:23:57 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-05-08T05:23:57.708 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:23:57 smithi087 ceph-mon[29523]: purged_snaps scrub starts 2024-05-08T05:23:57.709 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:23:57 smithi087 ceph-mon[29523]: purged_snaps scrub ok 2024-05-08T05:23:57.709 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:23:57 smithi087 ceph-mon[29523]: osdmap e65: 11 total, 10 up, 11 in 2024-05-08T05:23:57.709 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:23:57 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-05-08T05:23:58.670 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:23:58 smithi160 ceph-mon[34827]: pgmap v252: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 894 GiB / 894 GiB avail 2024-05-08T05:23:58.670 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:23:58 smithi160 ceph-mon[34827]: osd.10 [v2:172.21.15.90:6824/716529498,v1:172.21.15.90:6825/716529498] boot 2024-05-08T05:23:58.670 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:23:58 smithi160 ceph-mon[34827]: osdmap e66: 11 total, 11 up, 11 in 2024-05-08T05:23:58.670 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:23:58 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-05-08T05:23:58.670 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:23:58 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:23:58.670 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:23:58 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:23:58.670 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:23:58 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-05-08T05:23:58.670 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:23:58 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-05-08T05:23:58.670 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:23:58 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-05-08T05:23:58.670 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:23:58 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-05-08T05:23:58.670 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:23:58 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:23:58.670 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:23:58 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T05:23:58.671 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:23:58 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T05:23:58.671 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:23:58 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:23:58.671 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:23:58 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T05:23:58.671 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:23:58 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T05:23:58.671 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:23:58 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T05:23:58.671 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:23:58 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:23:58.671 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:23:58 smithi160 ceph-mon[34827]: osdmap e67: 11 total, 11 up, 11 in 2024-05-08T05:23:58.734 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:23:58 smithi090 ceph-mon[34526]: pgmap v252: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 894 GiB / 894 GiB avail 2024-05-08T05:23:58.734 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:23:58 smithi090 ceph-mon[34526]: osd.10 [v2:172.21.15.90:6824/716529498,v1:172.21.15.90:6825/716529498] boot 2024-05-08T05:23:58.734 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:23:58 smithi090 ceph-mon[34526]: osdmap e66: 11 total, 11 up, 11 in 2024-05-08T05:23:58.734 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:23:58 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-05-08T05:23:58.734 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:23:58 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:23:58.734 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:23:58 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:23:58.734 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:23:58 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-05-08T05:23:58.735 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:23:58 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-05-08T05:23:58.735 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:23:58 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-05-08T05:23:58.735 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:23:58 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-05-08T05:23:58.735 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:23:58 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:23:58.735 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:23:58 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T05:23:58.735 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:23:58 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T05:23:58.735 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:23:58 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:23:58.735 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:23:58 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T05:23:58.735 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:23:58 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T05:23:58.735 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:23:58 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T05:23:58.735 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:23:58 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:23:58.735 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:23:58 smithi090 ceph-mon[34526]: osdmap e67: 11 total, 11 up, 11 in 2024-05-08T05:23:58.916 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-08T05:23:58.911+0000 7f020e178700 1 -- 172.21.15.160:0/1115843204 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0208103600 msgr2=0x7f0208103a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:23:58.916 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-08T05:23:58.911+0000 7f020e178700 1 --2- 172.21.15.160:0/1115843204 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0208103600 0x7f0208103a60 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f01f0009990 tx=0x7f01f0009ca0 comp rx=0 tx=0).stop 2024-05-08T05:23:58.916 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-08T05:23:58.911+0000 7f020e178700 1 -- 172.21.15.160:0/1115843204 shutdown_connections 2024-05-08T05:23:58.916 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-08T05:23:58.911+0000 7f020e178700 1 --2- 172.21.15.160:0/1115843204 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0208103fa0 0x7f020810a850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:23:58.917 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-08T05:23:58.911+0000 7f020e178700 1 --2- 172.21.15.160:0/1115843204 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0208102400 0x7f0208102820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:23:58.917 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-08T05:23:58.911+0000 7f020e178700 1 --2- 172.21.15.160:0/1115843204 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0208103600 0x7f0208103a60 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:23:58.917 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-08T05:23:58.911+0000 7f020e178700 1 -- 172.21.15.160:0/1115843204 >> 172.21.15.160:0/1115843204 conn(0x7f02080fd9a0 msgr2=0x7f02080ffde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:23:58.917 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-08T05:23:58.911+0000 7f020e178700 1 -- 172.21.15.160:0/1115843204 shutdown_connections 2024-05-08T05:23:58.917 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-08T05:23:58.911+0000 7f020e178700 1 -- 172.21.15.160:0/1115843204 wait complete. 2024-05-08T05:23:58.917 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-08T05:23:58.912+0000 7f020e178700 1 Processor -- start 2024-05-08T05:23:58.918 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-08T05:23:58.912+0000 7f020e178700 1 -- start start 2024-05-08T05:23:58.918 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-08T05:23:58.912+0000 7f020e178700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0208102400 0x7f0208199710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:23:58.918 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-08T05:23:58.912+0000 7f020e178700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0208103600 0x7f0208199c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:23:58.918 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-08T05:23:58.912+0000 7f020e178700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0208103fa0 0x7f02081a0cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:23:58.918 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-08T05:23:58.912+0000 7f020e178700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f020810df10 con 0x7f0208102400 2024-05-08T05:23:58.919 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-08T05:23:58.912+0000 7f020e178700 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f020810dd90 con 0x7f0208103fa0 2024-05-08T05:23:58.919 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-08T05:23:58.912+0000 7f020e178700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f020810e090 con 0x7f0208103600 2024-05-08T05:23:58.919 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-08T05:23:58.912+0000 7f0206ffd700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0208103600 0x7f0208199c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:23:58.919 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-08T05:23:58.912+0000 7f0206ffd700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0208103600 0x7f0208199c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.160:52930/0 (socket says 172.21.15.160:52930) 2024-05-08T05:23:58.919 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-08T05:23:58.912+0000 7f0206ffd700 1 -- 172.21.15.160:0/2981396509 learned_addr learned my addr 172.21.15.160:0/2981396509 (peer_addr_for_me v2:172.21.15.160:0/0) 2024-05-08T05:23:58.919 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-08T05:23:58.913+0000 7f0207fff700 1 --2- 172.21.15.160:0/2981396509 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0208103fa0 0x7f02081a0cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:23:58.920 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-08T05:23:58.913+0000 7f0206ffd700 1 -- 172.21.15.160:0/2981396509 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0208103fa0 msgr2=0x7f02081a0cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:23:58.920 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-08T05:23:58.913+0000 7f0206ffd700 1 --2- 172.21.15.160:0/2981396509 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0208103fa0 0x7f02081a0cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:23:58.920 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-08T05:23:58.913+0000 7f0206ffd700 1 -- 172.21.15.160:0/2981396509 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0208102400 msgr2=0x7f0208199710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:23:58.920 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-08T05:23:58.913+0000 7f0206ffd700 1 --2- 172.21.15.160:0/2981396509 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0208102400 0x7f0208199710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:23:58.920 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-08T05:23:58.913+0000 7f0206ffd700 1 -- 172.21.15.160:0/2981396509 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f02081a1370 con 0x7f0208103600 2024-05-08T05:23:58.920 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-08T05:23:58.913+0000 7f0206ffd700 1 --2- 172.21.15.160:0/2981396509 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0208103600 0x7f0208199c50 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f01f00059d0 tx=0x7f01f00039f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:23:58.921 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-08T05:23:58.913+0000 7f0204ff9700 1 -- 172.21.15.160:0/2981396509 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01f0027070 con 0x7f0208103600 2024-05-08T05:23:58.921 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-08T05:23:58.913+0000 7f0204ff9700 1 -- 172.21.15.160:0/2981396509 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f01f0022470 con 0x7f0208103600 2024-05-08T05:23:58.921 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-08T05:23:58.913+0000 7f020e178700 1 -- 172.21.15.160:0/2981396509 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f02081a1600 con 0x7f0208103600 2024-05-08T05:23:58.921 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-08T05:23:58.913+0000 7f0204ff9700 1 -- 172.21.15.160:0/2981396509 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01f000f6c0 con 0x7f0208103600 2024-05-08T05:23:58.921 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-08T05:23:58.913+0000 7f020e178700 1 -- 172.21.15.160:0/2981396509 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f02081a1a50 con 0x7f0208103600 2024-05-08T05:23:58.921 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-08T05:23:58.914+0000 7f020e178700 1 -- 172.21.15.160:0/2981396509 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f020806a190 con 0x7f0208103600 2024-05-08T05:23:58.921 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-08T05:23:58.915+0000 7f0204ff9700 1 -- 172.21.15.160:0/2981396509 <== mon.1 v2:172.21.15.160:3300/0 4 ==== mgrmap(e 16) ==== 149652+0+0 (secure 0 0 0) 0x7f01f002a070 con 0x7f0208103600 2024-05-08T05:23:58.923 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-08T05:23:58.916+0000 7f0204ff9700 1 --2- 172.21.15.160:0/2981396509 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f01f40b2880 0x7f01f40b4d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:23:58.923 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-08T05:23:58.916+0000 7f0204ff9700 1 -- 172.21.15.160:0/2981396509 <== mon.1 v2:172.21.15.160:3300/0 5 ==== osd_map(67..67 src has 1..67) ==== 6694+0+0 (secure 0 0 0) 0x7f01f00e2cc0 con 0x7f0208103600 2024-05-08T05:23:58.923 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-08T05:23:58.917+0000 7f02077fe700 1 --2- 172.21.15.160:0/2981396509 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f01f40b2880 0x7f01f40b4d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:23:58.924 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-08T05:23:58.918+0000 7f02077fe700 1 --2- 172.21.15.160:0/2981396509 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f01f40b2880 0x7f01f40b4d40 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f0208103460 tx=0x7f0200008560 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:23:58.924 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-08T05:23:58.920+0000 7f0204ff9700 1 -- 172.21.15.160:0/2981396509 <== mon.1 v2:172.21.15.160:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f01f0013070 con 0x7f0208103600 2024-05-08T05:23:58.959 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:23:58 smithi087 ceph-mon[29523]: pgmap v252: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 894 GiB / 894 GiB avail 2024-05-08T05:23:58.959 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:23:58 smithi087 ceph-mon[29523]: osd.10 [v2:172.21.15.90:6824/716529498,v1:172.21.15.90:6825/716529498] boot 2024-05-08T05:23:58.960 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:23:58 smithi087 ceph-mon[29523]: osdmap e66: 11 total, 11 up, 11 in 2024-05-08T05:23:58.960 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:23:58 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-05-08T05:23:58.960 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:23:58 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:23:58.960 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:23:58 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:23:58.960 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:23:58 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-05-08T05:23:58.960 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:23:58 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-05-08T05:23:58.961 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:23:58 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-05-08T05:23:58.961 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:23:58 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-05-08T05:23:58.961 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:23:58 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:23:58.961 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:23:58 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T05:23:58.961 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:23:58 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T05:23:58.961 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:23:58 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:23:58.962 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:23:58 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T05:23:58.962 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:23:58 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T05:23:58.962 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:23:58 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T05:23:58.962 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:23:58 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:23:58.962 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:23:58 smithi087 ceph-mon[29523]: osdmap e67: 11 total, 11 up, 11 in 2024-05-08T05:23:59.134 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-08T05:23:59.134+0000 7f020e178700 1 -- 172.21.15.160:0/2981396509 --> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi160:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) -- 0x7f02080fe7c0 con 0x7f01f40b2880 2024-05-08T05:23:59.734 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:23:59 smithi090 ceph-mon[34526]: Detected new or changed devices on smithi090 2024-05-08T05:23:59.734 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:23:59 smithi090 ceph-mon[34526]: Adjusting osd_memory_target on smithi090 to 4272M 2024-05-08T05:23:59.734 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:23:59 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-08T05:23:59.734 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:23:59 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-08T05:23:59.734 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:23:59 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T05:23:59.734 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:23:59 smithi090 ceph-mon[34526]: osdmap e68: 11 total, 11 up, 11 in 2024-05-08T05:23:59.776 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:23:59 smithi160 ceph-mon[34827]: Detected new or changed devices on smithi090 2024-05-08T05:23:59.776 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:23:59 smithi160 ceph-mon[34827]: Adjusting osd_memory_target on smithi090 to 4272M 2024-05-08T05:23:59.776 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:23:59 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-08T05:23:59.776 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:23:59 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-08T05:23:59.776 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:23:59 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T05:23:59.777 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:23:59 smithi160 ceph-mon[34827]: osdmap e68: 11 total, 11 up, 11 in 2024-05-08T05:23:59.959 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:23:59 smithi087 ceph-mon[29523]: Detected new or changed devices on smithi090 2024-05-08T05:23:59.959 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:23:59 smithi087 ceph-mon[29523]: Adjusting osd_memory_target on smithi090 to 4272M 2024-05-08T05:23:59.959 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:23:59 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-08T05:23:59.959 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:23:59 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-08T05:23:59.959 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:23:59 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T05:23:59.960 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:23:59 smithi087 ceph-mon[29523]: osdmap e68: 11 total, 11 up, 11 in 2024-05-08T05:24:00.733 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:24:00 smithi090 ceph-mon[34526]: pgmap v255: 1 pgs: 1 remapped+peering; 577 KiB data, 331 MiB used, 983 GiB / 983 GiB avail 2024-05-08T05:24:00.734 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:24:00 smithi090 ceph-mon[34526]: from='client.24361 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi160:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-05-08T05:24:00.765 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:24:00 smithi160 ceph-mon[34827]: pgmap v255: 1 pgs: 1 remapped+peering; 577 KiB data, 331 MiB used, 983 GiB / 983 GiB avail 2024-05-08T05:24:00.766 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:24:00 smithi160 ceph-mon[34827]: from='client.24361 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi160:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-05-08T05:24:00.959 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:24:00 smithi087 ceph-mon[29523]: pgmap v255: 1 pgs: 1 remapped+peering; 577 KiB data, 331 MiB used, 983 GiB / 983 GiB avail 2024-05-08T05:24:00.960 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:24:00 smithi087 ceph-mon[29523]: from='client.24361 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi160:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-05-08T05:24:02.734 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:24:02 smithi090 ceph-mon[34526]: pgmap v257: 1 pgs: 1 remapped+peering; 577 KiB data, 332 MiB used, 983 GiB / 983 GiB avail 2024-05-08T05:24:02.734 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:24:02 smithi090 ceph-mon[34526]: from='client.? 172.21.15.160:0/4090373469' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "da23ff5c-3f79-44e3-bca3-d9d5a003c999"}]: dispatch 2024-05-08T05:24:02.734 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:24:02 smithi090 ceph-mon[34526]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "da23ff5c-3f79-44e3-bca3-d9d5a003c999"}]: dispatch 2024-05-08T05:24:02.734 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:24:02 smithi090 ceph-mon[34526]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "da23ff5c-3f79-44e3-bca3-d9d5a003c999"}]': finished 2024-05-08T05:24:02.734 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:24:02 smithi090 ceph-mon[34526]: osdmap e69: 12 total, 11 up, 12 in 2024-05-08T05:24:02.734 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:24:02 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-05-08T05:24:02.789 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:24:02 smithi160 ceph-mon[34827]: pgmap v257: 1 pgs: 1 remapped+peering; 577 KiB data, 332 MiB used, 983 GiB / 983 GiB avail 2024-05-08T05:24:02.789 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:24:02 smithi160 ceph-mon[34827]: from='client.? 172.21.15.160:0/4090373469' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "da23ff5c-3f79-44e3-bca3-d9d5a003c999"}]: dispatch 2024-05-08T05:24:02.789 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:24:02 smithi160 ceph-mon[34827]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "da23ff5c-3f79-44e3-bca3-d9d5a003c999"}]: dispatch 2024-05-08T05:24:02.789 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:24:02 smithi160 ceph-mon[34827]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "da23ff5c-3f79-44e3-bca3-d9d5a003c999"}]': finished 2024-05-08T05:24:02.789 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:24:02 smithi160 ceph-mon[34827]: osdmap e69: 12 total, 11 up, 12 in 2024-05-08T05:24:02.789 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:24:02 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-05-08T05:24:02.958 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:24:02 smithi087 ceph-mon[29523]: pgmap v257: 1 pgs: 1 remapped+peering; 577 KiB data, 332 MiB used, 983 GiB / 983 GiB avail 2024-05-08T05:24:02.958 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:24:02 smithi087 ceph-mon[29523]: from='client.? 172.21.15.160:0/4090373469' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "da23ff5c-3f79-44e3-bca3-d9d5a003c999"}]: dispatch 2024-05-08T05:24:02.959 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:24:02 smithi087 ceph-mon[29523]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "da23ff5c-3f79-44e3-bca3-d9d5a003c999"}]: dispatch 2024-05-08T05:24:02.959 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:24:02 smithi087 ceph-mon[29523]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "da23ff5c-3f79-44e3-bca3-d9d5a003c999"}]': finished 2024-05-08T05:24:02.959 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:24:02 smithi087 ceph-mon[29523]: osdmap e69: 12 total, 11 up, 12 in 2024-05-08T05:24:02.959 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:24:02 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-05-08T05:24:03.788 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:24:03 smithi160 ceph-mon[34827]: from='client.? 172.21.15.160:0/2116279695' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-08T05:24:03.958 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:24:03 smithi087 ceph-mon[29523]: from='client.? 172.21.15.160:0/2116279695' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-08T05:24:03.983 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:24:03 smithi090 ceph-mon[34526]: from='client.? 172.21.15.160:0/2116279695' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-08T05:24:04.788 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:24:04 smithi160 ceph-mon[34827]: pgmap v259: 1 pgs: 1 remapped+peering; 577 KiB data, 331 MiB used, 983 GiB / 983 GiB avail 2024-05-08T05:24:04.958 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:24:04 smithi087 ceph-mon[29523]: pgmap v259: 1 pgs: 1 remapped+peering; 577 KiB data, 331 MiB used, 983 GiB / 983 GiB avail 2024-05-08T05:24:04.983 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:24:04 smithi090 ceph-mon[34526]: pgmap v259: 1 pgs: 1 remapped+peering; 577 KiB data, 331 MiB used, 983 GiB / 983 GiB avail 2024-05-08T05:24:06.708 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:24:06 smithi087 ceph-mon[29523]: pgmap v260: 1 pgs: 1 active+clean; 577 KiB data, 332 MiB used, 983 GiB / 983 GiB avail; 90 KiB/s, 0 objects/s recovering 2024-05-08T05:24:06.767 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:24:06 smithi160 ceph-mon[34827]: pgmap v260: 1 pgs: 1 active+clean; 577 KiB data, 332 MiB used, 983 GiB / 983 GiB avail; 90 KiB/s, 0 objects/s recovering 2024-05-08T05:24:06.983 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:24:06 smithi090 ceph-mon[34526]: pgmap v260: 1 pgs: 1 active+clean; 577 KiB data, 332 MiB used, 983 GiB / 983 GiB avail; 90 KiB/s, 0 objects/s recovering 2024-05-08T05:24:08.565 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:24:08 smithi160 ceph-mon[34827]: pgmap v261: 1 pgs: 1 active+clean; 577 KiB data, 332 MiB used, 983 GiB / 983 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-05-08T05:24:08.958 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:24:08 smithi087 ceph-mon[29523]: pgmap v261: 1 pgs: 1 active+clean; 577 KiB data, 332 MiB used, 983 GiB / 983 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-05-08T05:24:08.983 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:24:08 smithi090 ceph-mon[34526]: pgmap v261: 1 pgs: 1 active+clean; 577 KiB data, 332 MiB used, 983 GiB / 983 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-05-08T05:24:10.632 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:24:10 smithi160 ceph-mon[34827]: pgmap v262: 1 pgs: 1 active+clean; 577 KiB data, 332 MiB used, 983 GiB / 983 GiB avail; 61 KiB/s, 0 objects/s recovering 2024-05-08T05:24:10.632 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:24:10 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.11"}]: dispatch 2024-05-08T05:24:10.632 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:24:10 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T05:24:10.958 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:24:10 smithi087 ceph-mon[29523]: pgmap v262: 1 pgs: 1 active+clean; 577 KiB data, 332 MiB used, 983 GiB / 983 GiB avail; 61 KiB/s, 0 objects/s recovering 2024-05-08T05:24:10.958 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:24:10 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.11"}]: dispatch 2024-05-08T05:24:10.958 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:24:10 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T05:24:10.983 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:24:10 smithi090 ceph-mon[34526]: pgmap v262: 1 pgs: 1 active+clean; 577 KiB data, 332 MiB used, 983 GiB / 983 GiB avail; 61 KiB/s, 0 objects/s recovering 2024-05-08T05:24:10.983 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:24:10 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.11"}]: dispatch 2024-05-08T05:24:10.983 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:24:10 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T05:24:11.619 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:24:11 smithi160 ceph-mon[34827]: Deploying daemon osd.11 on smithi160 2024-05-08T05:24:11.958 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:24:11 smithi087 ceph-mon[29523]: Deploying daemon osd.11 on smithi160 2024-05-08T05:24:11.983 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:24:11 smithi090 ceph-mon[34526]: Deploying daemon osd.11 on smithi160 2024-05-08T05:24:12.742 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:24:12 smithi160 ceph-mon[34827]: pgmap v263: 1 pgs: 1 active+clean; 577 KiB data, 332 MiB used, 983 GiB / 983 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-05-08T05:24:12.958 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:24:12 smithi087 ceph-mon[29523]: pgmap v263: 1 pgs: 1 active+clean; 577 KiB data, 332 MiB used, 983 GiB / 983 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-05-08T05:24:12.983 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:24:12 smithi090 ceph-mon[34526]: pgmap v263: 1 pgs: 1 active+clean; 577 KiB data, 332 MiB used, 983 GiB / 983 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-05-08T05:24:14.789 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:24:14 smithi160 ceph-mon[34827]: pgmap v264: 1 pgs: 1 active+clean; 577 KiB data, 332 MiB used, 983 GiB / 983 GiB avail; 53 KiB/s, 0 objects/s recovering 2024-05-08T05:24:14.958 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:24:14 smithi087 ceph-mon[29523]: pgmap v264: 1 pgs: 1 active+clean; 577 KiB data, 332 MiB used, 983 GiB / 983 GiB avail; 53 KiB/s, 0 objects/s recovering 2024-05-08T05:24:14.983 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:24:14 smithi090 ceph-mon[34526]: pgmap v264: 1 pgs: 1 active+clean; 577 KiB data, 332 MiB used, 983 GiB / 983 GiB avail; 53 KiB/s, 0 objects/s recovering 2024-05-08T05:24:16.708 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:24:16 smithi087 ceph-mon[29523]: pgmap v265: 1 pgs: 1 active+clean; 577 KiB data, 332 MiB used, 983 GiB / 983 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-05-08T05:24:16.709 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:24:16 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:24:16.709 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:24:16 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:24:16.709 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:24:16 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T05:24:16.733 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:24:16 smithi090 ceph-mon[34526]: pgmap v265: 1 pgs: 1 active+clean; 577 KiB data, 332 MiB used, 983 GiB / 983 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-05-08T05:24:16.734 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:24:16 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:24:16.734 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:24:16 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:24:16.734 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:24:16 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T05:24:16.789 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:24:16 smithi160 ceph-mon[34827]: pgmap v265: 1 pgs: 1 active+clean; 577 KiB data, 332 MiB used, 983 GiB / 983 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-05-08T05:24:16.789 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:24:16 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:24:16.789 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:24:16 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:24:16.789 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:24:16 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T05:24:18.013 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:24:17 smithi090 ceph-mon[34526]: pgmap v266: 1 pgs: 1 active+clean; 577 KiB data, 332 MiB used, 983 GiB / 983 GiB avail 2024-05-08T05:24:18.109 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:24:17 smithi160 ceph-mon[34827]: pgmap v266: 1 pgs: 1 active+clean; 577 KiB data, 332 MiB used, 983 GiB / 983 GiB avail 2024-05-08T05:24:18.208 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:24:17 smithi087 ceph-mon[29523]: pgmap v266: 1 pgs: 1 active+clean; 577 KiB data, 332 MiB used, 983 GiB / 983 GiB avail 2024-05-08T05:24:19.371 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-08T05:24:19.371+0000 7f0204ff9700 1 -- 172.21.15.160:0/2981396509 <== mgr.14152 v2:172.21.15.87:6800/1189186457 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+38 (secure 0 0 0) 0x7f02080fe7c0 con 0x7f01f40b2880 2024-05-08T05:24:19.372 INFO:teuthology.orchestra.run.smithi160.stdout:Created osd(s) 11 on host 'smithi160' 2024-05-08T05:24:19.374 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-08T05:24:19.373+0000 7f020e178700 1 -- 172.21.15.160:0/2981396509 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f01f40b2880 msgr2=0x7f01f40b4d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:24:19.374 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-08T05:24:19.373+0000 7f020e178700 1 --2- 172.21.15.160:0/2981396509 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f01f40b2880 0x7f01f40b4d40 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f0208103460 tx=0x7f0200008560 comp rx=0 tx=0).stop 2024-05-08T05:24:19.374 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-08T05:24:19.373+0000 7f020e178700 1 -- 172.21.15.160:0/2981396509 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0208103600 msgr2=0x7f0208199c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:24:19.374 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-08T05:24:19.373+0000 7f020e178700 1 --2- 172.21.15.160:0/2981396509 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0208103600 0x7f0208199c50 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f01f00059d0 tx=0x7f01f00039f0 comp rx=0 tx=0).stop 2024-05-08T05:24:19.374 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-08T05:24:19.373+0000 7f020e178700 1 -- 172.21.15.160:0/2981396509 shutdown_connections 2024-05-08T05:24:19.374 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-08T05:24:19.373+0000 7f020e178700 1 --2- 172.21.15.160:0/2981396509 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0208103fa0 0x7f02081a0cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:24:19.374 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-08T05:24:19.373+0000 7f020e178700 1 --2- 172.21.15.160:0/2981396509 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0208102400 0x7f0208199710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:24:19.374 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-08T05:24:19.373+0000 7f020e178700 1 --2- 172.21.15.160:0/2981396509 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f01f40b2880 0x7f01f40b4d40 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:24:19.374 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-08T05:24:19.373+0000 7f020e178700 1 --2- 172.21.15.160:0/2981396509 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0208103600 0x7f0208199c50 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:24:19.374 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-08T05:24:19.373+0000 7f020e178700 1 -- 172.21.15.160:0/2981396509 >> 172.21.15.160:0/2981396509 conn(0x7f02080fd9a0 msgr2=0x7f02080fe0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:24:19.374 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-08T05:24:19.373+0000 7f020e178700 1 -- 172.21.15.160:0/2981396509 shutdown_connections 2024-05-08T05:24:19.375 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-08T05:24:19.373+0000 7f020e178700 1 -- 172.21.15.160:0/2981396509 wait complete. 2024-05-08T05:24:19.538 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:24:19 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:24:19.539 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:24:19 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:24:19.539 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:24:19 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T05:24:19.539 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:24:19 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T05:24:19.539 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:24:19 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:24:19.539 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:24:19 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:24:19.539 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:24:19 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:24:19.539 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:24:19 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T05:24:19.539 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:24:19 smithi160 ceph-mon[34827]: from='osd.11 [v2:172.21.15.160:6824/1842739135,v1:172.21.15.160:6825/1842739135]' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-05-08T05:24:19.539 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:24:19 smithi160 ceph-mon[34827]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-05-08T05:24:19.709 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:24:19 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:24:19.709 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:24:19 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:24:19.709 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:24:19 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T05:24:19.709 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:24:19 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T05:24:19.709 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:24:19 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:24:19.709 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:24:19 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:24:19.709 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:24:19 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:24:19.709 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:24:19 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T05:24:19.709 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:24:19 smithi087 ceph-mon[29523]: from='osd.11 [v2:172.21.15.160:6824/1842739135,v1:172.21.15.160:6825/1842739135]' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-05-08T05:24:19.709 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:24:19 smithi087 ceph-mon[29523]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-05-08T05:24:19.733 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:24:19 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:24:19.733 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:24:19 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:24:19.733 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:24:19 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T05:24:19.733 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:24:19 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T05:24:19.733 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:24:19 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:24:19.734 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:24:19 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:24:19.734 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:24:19 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:24:19.734 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:24:19 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T05:24:19.734 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:24:19 smithi090 ceph-mon[34526]: from='osd.11 [v2:172.21.15.160:6824/1842739135,v1:172.21.15.160:6825/1842739135]' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-05-08T05:24:19.734 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:24:19 smithi090 ceph-mon[34526]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-05-08T05:24:20.075 DEBUG:teuthology.orchestra.run.smithi160:osd.11> sudo journalctl -f -n 0 -u ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968@osd.11.service 2024-05-08T05:24:20.077 INFO:tasks.cephadm:Waiting for 12 OSDs to come up... 2024-05-08T05:24:20.078 DEBUG:teuthology.orchestra.run.smithi087:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid eeeb813e-0cf9-11ef-bc97-c7b262605968 -- ceph osd stat -f json 2024-05-08T05:24:20.554 INFO:teuthology.orchestra.run.smithi087.stderr:Inferring config /var/lib/ceph/eeeb813e-0cf9-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T05:24:20.644 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:24:20 smithi160 ceph-mon[34827]: pgmap v267: 1 pgs: 1 active+clean; 577 KiB data, 332 MiB used, 983 GiB / 983 GiB avail 2024-05-08T05:24:20.644 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:24:20 smithi160 ceph-mon[34827]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2024-05-08T05:24:20.644 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:24:20 smithi160 ceph-mon[34827]: from='osd.11 [v2:172.21.15.160:6824/1842739135,v1:172.21.15.160:6825/1842739135]' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi160", "root=default"]}]: dispatch 2024-05-08T05:24:20.644 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:24:20 smithi160 ceph-mon[34827]: osdmap e70: 12 total, 11 up, 12 in 2024-05-08T05:24:20.644 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:24:20 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-05-08T05:24:20.644 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:24:20 smithi160 ceph-mon[34827]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi160", "root=default"]}]: dispatch 2024-05-08T05:24:20.695 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:24:20 smithi087 ceph-mon[29523]: pgmap v267: 1 pgs: 1 active+clean; 577 KiB data, 332 MiB used, 983 GiB / 983 GiB avail 2024-05-08T05:24:20.696 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:24:20 smithi087 ceph-mon[29523]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2024-05-08T05:24:20.696 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:24:20 smithi087 ceph-mon[29523]: from='osd.11 [v2:172.21.15.160:6824/1842739135,v1:172.21.15.160:6825/1842739135]' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi160", "root=default"]}]: dispatch 2024-05-08T05:24:20.696 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:24:20 smithi087 ceph-mon[29523]: osdmap e70: 12 total, 11 up, 12 in 2024-05-08T05:24:20.696 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:24:20 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-05-08T05:24:20.696 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:24:20 smithi087 ceph-mon[29523]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi160", "root=default"]}]: dispatch 2024-05-08T05:24:20.733 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:24:20 smithi090 ceph-mon[34526]: pgmap v267: 1 pgs: 1 active+clean; 577 KiB data, 332 MiB used, 983 GiB / 983 GiB avail 2024-05-08T05:24:20.734 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:24:20 smithi090 ceph-mon[34526]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2024-05-08T05:24:20.734 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:24:20 smithi090 ceph-mon[34526]: from='osd.11 [v2:172.21.15.160:6824/1842739135,v1:172.21.15.160:6825/1842739135]' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi160", "root=default"]}]: dispatch 2024-05-08T05:24:20.734 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:24:20 smithi090 ceph-mon[34526]: osdmap e70: 12 total, 11 up, 12 in 2024-05-08T05:24:20.734 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:24:20 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-05-08T05:24:20.734 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:24:20 smithi090 ceph-mon[34526]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi160", "root=default"]}]: dispatch 2024-05-08T05:24:21.539 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 08 05:24:21 smithi160 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-11[60042]: 2024-05-08T05:24:21.333+0000 7f0623610700 -1 osd.11 0 waiting for initial osdmap 2024-05-08T05:24:21.539 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 08 05:24:21 smithi160 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-11[60042]: 2024-05-08T05:24:21.348+0000 7f061f403700 -1 osd.11 71 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-08T05:24:22.576 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:24:22 smithi087 ceph-mon[29523]: pgmap v269: 1 pgs: 1 active+clean; 577 KiB data, 332 MiB used, 983 GiB / 983 GiB avail 2024-05-08T05:24:22.576 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:24:22 smithi087 ceph-mon[29523]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi160", "root=default"]}]': finished 2024-05-08T05:24:22.576 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:24:22 smithi087 ceph-mon[29523]: osdmap e71: 12 total, 11 up, 12 in 2024-05-08T05:24:22.576 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:24:22 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-05-08T05:24:22.576 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:24:22 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-05-08T05:24:22.729 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:24:22 smithi160 ceph-mon[34827]: pgmap v269: 1 pgs: 1 active+clean; 577 KiB data, 332 MiB used, 983 GiB / 983 GiB avail 2024-05-08T05:24:22.729 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:24:22 smithi160 ceph-mon[34827]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi160", "root=default"]}]': finished 2024-05-08T05:24:22.729 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:24:22 smithi160 ceph-mon[34827]: osdmap e71: 12 total, 11 up, 12 in 2024-05-08T05:24:22.729 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:24:22 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-05-08T05:24:22.729 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:24:22 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-05-08T05:24:22.733 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:24:22 smithi090 ceph-mon[34526]: pgmap v269: 1 pgs: 1 active+clean; 577 KiB data, 332 MiB used, 983 GiB / 983 GiB avail 2024-05-08T05:24:22.733 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:24:22 smithi090 ceph-mon[34526]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi160", "root=default"]}]': finished 2024-05-08T05:24:22.733 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:24:22 smithi090 ceph-mon[34526]: osdmap e71: 12 total, 11 up, 12 in 2024-05-08T05:24:22.733 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:24:22 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-05-08T05:24:22.733 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:24:22 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-05-08T05:24:22.866 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:24:22.864+0000 7fd74d800700 1 -- 172.21.15.87:0/1262813302 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd748104620 msgr2=0x7fd748104a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:24:22.867 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:24:22.864+0000 7fd74d800700 1 --2- 172.21.15.87:0/1262813302 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd748104620 0x7fd748104a80 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fd7340099c0 tx=0x7fd734009cd0 comp rx=0 tx=0).stop 2024-05-08T05:24:22.867 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:24:22.864+0000 7fd74d800700 1 -- 172.21.15.87:0/1262813302 shutdown_connections 2024-05-08T05:24:22.867 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:24:22.864+0000 7fd74d800700 1 --2- 172.21.15.87:0/1262813302 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd748104fc0 0x7fd74810b870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:24:22.867 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:24:22.864+0000 7fd74d800700 1 --2- 172.21.15.87:0/1262813302 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd748103420 0x7fd748103840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:24:22.867 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:24:22.864+0000 7fd74d800700 1 --2- 172.21.15.87:0/1262813302 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd748104620 0x7fd748104a80 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:24:22.867 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:24:22.864+0000 7fd74d800700 1 -- 172.21.15.87:0/1262813302 >> 172.21.15.87:0/1262813302 conn(0x7fd7480fe9e0 msgr2=0x7fd748100e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:24:22.867 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:24:22.865+0000 7fd74d800700 1 -- 172.21.15.87:0/1262813302 shutdown_connections 2024-05-08T05:24:22.867 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:24:22.865+0000 7fd74d800700 1 -- 172.21.15.87:0/1262813302 wait complete. 2024-05-08T05:24:22.869 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:24:22.866+0000 7fd74d800700 1 Processor -- start 2024-05-08T05:24:22.869 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:24:22.866+0000 7fd74d800700 1 -- start start 2024-05-08T05:24:22.869 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:24:22.866+0000 7fd74d800700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd748103420 0x7fd74819b810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:24:22.869 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:24:22.866+0000 7fd74d800700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd748104620 0x7fd74819bd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:24:22.869 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:24:22.866+0000 7fd74d800700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd748104fc0 0x7fd7481a2d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:24:22.869 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:24:22.866+0000 7fd74d800700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fd74810eef0 con 0x7fd748104fc0 2024-05-08T05:24:22.869 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:24:22.866+0000 7fd74d800700 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fd74810ed70 con 0x7fd748104620 2024-05-08T05:24:22.869 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:24:22.866+0000 7fd74d800700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7fd74810f070 con 0x7fd748103420 2024-05-08T05:24:22.869 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:24:22.867+0000 7fd747e00700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd748103420 0x7fd74819b810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:24:22.869 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:24:22.867+0000 7fd74ce00700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd748104fc0 0x7fd7481a2d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:24:22.869 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:24:22.867+0000 7fd747e00700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd748103420 0x7fd74819b810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.87:50008/0 (socket says 172.21.15.87:50008) 2024-05-08T05:24:22.869 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:24:22.867+0000 7fd747e00700 1 -- 172.21.15.87:0/2521743839 learned_addr learned my addr 172.21.15.87:0/2521743839 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T05:24:22.869 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:24:22.867+0000 7fd747400700 1 --2- 172.21.15.87:0/2521743839 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd748104620 0x7fd74819bd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:24:22.870 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:24:22.867+0000 7fd747e00700 1 -- 172.21.15.87:0/2521743839 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd748104620 msgr2=0x7fd74819bd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:24:22.870 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:24:22.867+0000 7fd747e00700 1 --2- 172.21.15.87:0/2521743839 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd748104620 0x7fd74819bd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:24:22.870 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:24:22.867+0000 7fd747e00700 1 -- 172.21.15.87:0/2521743839 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd748104fc0 msgr2=0x7fd7481a2d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:24:22.870 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:24:22.867+0000 7fd747e00700 1 --2- 172.21.15.87:0/2521743839 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd748104fc0 0x7fd7481a2d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:24:22.870 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:24:22.867+0000 7fd747e00700 1 -- 172.21.15.87:0/2521743839 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd7481a33d0 con 0x7fd748103420 2024-05-08T05:24:22.870 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:24:22.867+0000 7fd747e00700 1 --2- 172.21.15.87:0/2521743839 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd748103420 0x7fd74819b810 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fd73800ea80 tx=0x7fd73800ed90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:24:22.871 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:24:22.868+0000 7fd744c00700 1 -- 172.21.15.87:0/2521743839 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd73800cbd0 con 0x7fd748103420 2024-05-08T05:24:22.871 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:24:22.868+0000 7fd744c00700 1 -- 172.21.15.87:0/2521743839 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd73800cd70 con 0x7fd748103420 2024-05-08T05:24:22.871 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:24:22.868+0000 7fd74d800700 1 -- 172.21.15.87:0/2521743839 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd7481a36c0 con 0x7fd748103420 2024-05-08T05:24:22.871 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:24:22.868+0000 7fd744c00700 1 -- 172.21.15.87:0/2521743839 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd738018680 con 0x7fd748103420 2024-05-08T05:24:22.871 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:24:22.868+0000 7fd74d800700 1 -- 172.21.15.87:0/2521743839 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd7481a3c00 con 0x7fd748103420 2024-05-08T05:24:22.871 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:24:22.869+0000 7fd74d800700 1 -- 172.21.15.87:0/2521743839 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd74806a190 con 0x7fd748103420 2024-05-08T05:24:22.872 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:24:22.871+0000 7fd744c00700 1 -- 172.21.15.87:0/2521743839 <== mon.1 v2:172.21.15.160:3300/0 4 ==== mgrmap(e 16) ==== 149652+0+0 (secure 0 0 0) 0x7fd73801f020 con 0x7fd748103420 2024-05-08T05:24:22.874 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:24:22.872+0000 7fd744c00700 1 --2- 172.21.15.87:0/2521743839 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7fd72c0b2900 0x7fd72c0b4dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:24:22.874 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:24:22.873+0000 7fd744c00700 1 -- 172.21.15.87:0/2521743839 <== mon.1 v2:172.21.15.160:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 7127+0+0 (secure 0 0 0) 0x7fd7380e1d10 con 0x7fd748103420 2024-05-08T05:24:22.874 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:24:22.873+0000 7fd747400700 1 --2- 172.21.15.87:0/2521743839 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7fd72c0b2900 0x7fd72c0b4dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:24:22.874 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:24:22.873+0000 7fd747400700 1 --2- 172.21.15.87:0/2521743839 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7fd72c0b2900 0x7fd72c0b4dc0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fd734000c00 tx=0x7fd734005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:24:22.878 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:24:22.877+0000 7fd744c00700 1 -- 172.21.15.87:0/2521743839 <== mon.1 v2:172.21.15.160:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7fd7380a9e30 con 0x7fd748103420 2024-05-08T05:24:23.112 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:24:23.111+0000 7fd74d800700 1 -- 172.21.15.87:0/2521743839 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) -- 0x7fd7481a45d0 con 0x7fd748103420 2024-05-08T05:24:23.113 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:24:23.111+0000 7fd744c00700 1 -- 172.21.15.87:0/2521743839 <== mon.1 v2:172.21.15.160:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v72) ==== 74+0+133 (secure 0 0 0) 0x7fd7380a9730 con 0x7fd748103420 2024-05-08T05:24:23.113 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-05-08T05:24:23.116 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:24:23.114+0000 7fd74d800700 1 -- 172.21.15.87:0/2521743839 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7fd72c0b2900 msgr2=0x7fd72c0b4dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:24:23.116 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:24:23.114+0000 7fd74d800700 1 --2- 172.21.15.87:0/2521743839 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7fd72c0b2900 0x7fd72c0b4dc0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fd734000c00 tx=0x7fd734005fb0 comp rx=0 tx=0).stop 2024-05-08T05:24:23.116 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:24:23.114+0000 7fd74d800700 1 -- 172.21.15.87:0/2521743839 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd748103420 msgr2=0x7fd74819b810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:24:23.117 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:24:23.114+0000 7fd74d800700 1 --2- 172.21.15.87:0/2521743839 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd748103420 0x7fd74819b810 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fd73800ea80 tx=0x7fd73800ed90 comp rx=0 tx=0).stop 2024-05-08T05:24:23.117 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:24:23.115+0000 7fd74d800700 1 -- 172.21.15.87:0/2521743839 shutdown_connections 2024-05-08T05:24:23.117 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:24:23.115+0000 7fd74d800700 1 --2- 172.21.15.87:0/2521743839 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd748104fc0 0x7fd7481a2d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:24:23.117 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:24:23.115+0000 7fd74d800700 1 --2- 172.21.15.87:0/2521743839 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7fd72c0b2900 0x7fd72c0b4dc0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:24:23.117 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:24:23.115+0000 7fd74d800700 1 --2- 172.21.15.87:0/2521743839 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd748103420 0x7fd74819b810 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:24:23.117 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:24:23.115+0000 7fd74d800700 1 --2- 172.21.15.87:0/2521743839 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd748104620 0x7fd74819bd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:24:23.117 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:24:23.115+0000 7fd74d800700 1 -- 172.21.15.87:0/2521743839 >> 172.21.15.87:0/2521743839 conn(0x7fd7480fe9e0 msgr2=0x7fd7480756d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:24:23.117 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:24:23.115+0000 7fd74d800700 1 -- 172.21.15.87:0/2521743839 shutdown_connections 2024-05-08T05:24:23.117 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:24:23.115+0000 7fd74d800700 1 -- 172.21.15.87:0/2521743839 wait complete. 2024-05-08T05:24:23.459 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:24:23 smithi087 ceph-mon[29523]: purged_snaps scrub starts 2024-05-08T05:24:23.459 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:24:23 smithi087 ceph-mon[29523]: purged_snaps scrub ok 2024-05-08T05:24:23.459 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:24:23 smithi087 ceph-mon[29523]: osd.11 [v2:172.21.15.160:6824/1842739135,v1:172.21.15.160:6825/1842739135] boot 2024-05-08T05:24:23.459 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:24:23 smithi087 ceph-mon[29523]: osdmap e72: 12 total, 12 up, 12 in 2024-05-08T05:24:23.459 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:24:23 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-05-08T05:24:23.459 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:24:23 smithi087 ceph-mon[29523]: from='client.? 172.21.15.87:0/2521743839' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-05-08T05:24:23.459 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:24:23 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:24:23.459 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:24:23 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:24:23.459 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:24:23 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-05-08T05:24:23.459 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:24:23 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-05-08T05:24:23.460 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:24:23 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-05-08T05:24:23.460 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:24:23 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-05-08T05:24:23.460 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:24:23 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:24:23.460 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:24:23 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T05:24:23.460 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:24:23 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T05:24:23.460 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:24:23 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:24:23.734 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:24:23 smithi090 ceph-mon[34526]: purged_snaps scrub starts 2024-05-08T05:24:23.734 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:24:23 smithi090 ceph-mon[34526]: purged_snaps scrub ok 2024-05-08T05:24:23.734 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:24:23 smithi090 ceph-mon[34526]: osd.11 [v2:172.21.15.160:6824/1842739135,v1:172.21.15.160:6825/1842739135] boot 2024-05-08T05:24:23.734 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:24:23 smithi090 ceph-mon[34526]: osdmap e72: 12 total, 12 up, 12 in 2024-05-08T05:24:23.734 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:24:23 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-05-08T05:24:23.734 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:24:23 smithi090 ceph-mon[34526]: from='client.? 172.21.15.87:0/2521743839' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-05-08T05:24:23.734 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:24:23 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:24:23.734 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:24:23 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:24:23.734 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:24:23 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-05-08T05:24:23.734 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:24:23 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-05-08T05:24:23.735 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:24:23 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-05-08T05:24:23.735 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:24:23 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-05-08T05:24:23.735 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:24:23 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:24:23.735 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:24:23 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T05:24:23.735 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:24:23 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T05:24:23.735 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:24:23 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:24:23.789 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:24:23 smithi160 ceph-mon[34827]: purged_snaps scrub starts 2024-05-08T05:24:23.789 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:24:23 smithi160 ceph-mon[34827]: purged_snaps scrub ok 2024-05-08T05:24:23.789 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:24:23 smithi160 ceph-mon[34827]: osd.11 [v2:172.21.15.160:6824/1842739135,v1:172.21.15.160:6825/1842739135] boot 2024-05-08T05:24:23.789 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:24:23 smithi160 ceph-mon[34827]: osdmap e72: 12 total, 12 up, 12 in 2024-05-08T05:24:23.789 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:24:23 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-05-08T05:24:23.789 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:24:23 smithi160 ceph-mon[34827]: from='client.? 172.21.15.87:0/2521743839' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-05-08T05:24:23.789 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:24:23 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:24:23.789 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:24:23 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:24:23.790 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:24:23 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-05-08T05:24:23.790 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:24:23 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-05-08T05:24:23.790 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:24:23 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-05-08T05:24:23.790 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:24:23 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-05-08T05:24:23.790 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:24:23 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:24:23.790 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:24:23 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T05:24:23.790 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:24:23 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T05:24:23.790 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:24:23 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:24:23.864 INFO:teuthology.orchestra.run.smithi087.stdout:{"epoch":72,"num_osds":12,"num_up_osds":12,"osd_up_since":1715145862,"num_in_osds":12,"osd_in_since":1715145841,"num_remapped_pgs":0} 2024-05-08T05:24:23.865 DEBUG:teuthology.orchestra.run.smithi087:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid eeeb813e-0cf9-11ef-bc97-c7b262605968 -- ceph osd dump --format=json 2024-05-08T05:24:24.295 INFO:teuthology.orchestra.run.smithi087.stderr:Inferring config /var/lib/ceph/eeeb813e-0cf9-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T05:24:24.467 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:24:24 smithi087 ceph-mon[29523]: pgmap v272: 1 pgs: 1 active+clean; 577 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-08T05:24:24.467 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:24:24 smithi087 ceph-mon[29523]: Detected new or changed devices on smithi160 2024-05-08T05:24:24.467 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:24:24 smithi087 ceph-mon[29523]: Adjusting osd_memory_target on smithi160 to 4272M 2024-05-08T05:24:24.467 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:24:24 smithi087 ceph-mon[29523]: osdmap e73: 12 total, 12 up, 12 in 2024-05-08T05:24:24.733 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:24:24 smithi090 ceph-mon[34526]: pgmap v272: 1 pgs: 1 active+clean; 577 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-08T05:24:24.734 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:24:24 smithi090 ceph-mon[34526]: Detected new or changed devices on smithi160 2024-05-08T05:24:24.734 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:24:24 smithi090 ceph-mon[34526]: Adjusting osd_memory_target on smithi160 to 4272M 2024-05-08T05:24:24.734 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:24:24 smithi090 ceph-mon[34526]: osdmap e73: 12 total, 12 up, 12 in 2024-05-08T05:24:24.788 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:24:24 smithi160 ceph-mon[34827]: pgmap v272: 1 pgs: 1 active+clean; 577 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-08T05:24:24.789 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:24:24 smithi160 ceph-mon[34827]: Detected new or changed devices on smithi160 2024-05-08T05:24:24.789 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:24:24 smithi160 ceph-mon[34827]: Adjusting osd_memory_target on smithi160 to 4272M 2024-05-08T05:24:24.789 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:24:24 smithi160 ceph-mon[34827]: osdmap e73: 12 total, 12 up, 12 in 2024-05-08T05:24:26.438 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:24:26.436+0000 7f8a4ac00700 1 -- 172.21.15.87:0/130504785 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8a44109510 msgr2=0x7f8a441098f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:24:26.438 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:24:26.436+0000 7f8a4ac00700 1 --2- 172.21.15.87:0/130504785 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8a44109510 0x7f8a441098f0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f8a3400b0a0 tx=0x7f8a3400b3b0 comp rx=0 tx=0).stop 2024-05-08T05:24:26.438 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:24:26.436+0000 7f8a4ac00700 1 -- 172.21.15.87:0/130504785 shutdown_connections 2024-05-08T05:24:26.438 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:24:26.436+0000 7f8a4ac00700 1 --2- 172.21.15.87:0/130504785 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8a4406bb40 0x7f8a44110330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:24:26.438 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:24:26.436+0000 7f8a4ac00700 1 --2- 172.21.15.87:0/130504785 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8a44109510 0x7f8a441098f0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:24:26.438 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:24:26.436+0000 7f8a4ac00700 1 --2- 172.21.15.87:0/130504785 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f8a4406b180 0x7f8a4406b600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:24:26.438 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:24:26.436+0000 7f8a4ac00700 1 -- 172.21.15.87:0/130504785 >> 172.21.15.87:0/130504785 conn(0x7f8a44079350 msgr2=0x7f8a44079760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:24:26.438 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:24:26.436+0000 7f8a4ac00700 1 -- 172.21.15.87:0/130504785 shutdown_connections 2024-05-08T05:24:26.438 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:24:26.436+0000 7f8a4ac00700 1 -- 172.21.15.87:0/130504785 wait complete. 2024-05-08T05:24:26.439 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:24:26.437+0000 7f8a4ac00700 1 Processor -- start 2024-05-08T05:24:26.439 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:24:26.438+0000 7f8a4ac00700 1 -- start start 2024-05-08T05:24:26.439 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:24:26.438+0000 7f8a4ac00700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f8a4406b180 0x7f8a4419f7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:24:26.440 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:24:26.438+0000 7f8a4ac00700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8a4406bb40 0x7f8a4419fd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:24:26.440 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:24:26.438+0000 7f8a4ac00700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8a44109510 0x7f8a441999b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:24:26.440 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:24:26.438+0000 7f8a4ac00700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f8a44113670 con 0x7f8a44109510 2024-05-08T05:24:26.440 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:24:26.438+0000 7f8a4ac00700 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f8a441134f0 con 0x7f8a4406bb40 2024-05-08T05:24:26.440 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:24:26.438+0000 7f8a4ac00700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f8a441137f0 con 0x7f8a4406b180 2024-05-08T05:24:26.440 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:24:26.438+0000 7f8a48c00700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8a44109510 0x7f8a441999b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:24:26.440 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:24:26.438+0000 7f8a48c00700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8a44109510 0x7f8a441999b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:55596/0 (socket says 172.21.15.87:55596) 2024-05-08T05:24:26.440 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:24:26.438+0000 7f8a48c00700 1 -- 172.21.15.87:0/1302895290 learned_addr learned my addr 172.21.15.87:0/1302895290 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T05:24:26.441 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:24:26.438+0000 7f8a3b400700 1 --2- 172.21.15.87:0/1302895290 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8a4406bb40 0x7f8a4419fd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:24:26.441 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:24:26.438+0000 7f8a43e00700 1 --2- 172.21.15.87:0/1302895290 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f8a4406b180 0x7f8a4419f7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:24:26.441 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:24:26.439+0000 7f8a48c00700 1 -- 172.21.15.87:0/1302895290 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f8a4406b180 msgr2=0x7f8a4419f7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:24:26.441 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:24:26.439+0000 7f8a48c00700 1 --2- 172.21.15.87:0/1302895290 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f8a4406b180 0x7f8a4419f7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:24:26.442 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:24:26.439+0000 7f8a48c00700 1 -- 172.21.15.87:0/1302895290 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8a4406bb40 msgr2=0x7f8a4419fd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:24:26.442 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:24:26.439+0000 7f8a48c00700 1 --2- 172.21.15.87:0/1302895290 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8a4406bb40 0x7f8a4419fd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:24:26.442 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:24:26.439+0000 7f8a48c00700 1 -- 172.21.15.87:0/1302895290 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8a4419a110 con 0x7f8a44109510 2024-05-08T05:24:26.442 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:24:26.439+0000 7f8a48c00700 1 --2- 172.21.15.87:0/1302895290 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8a44109510 0x7f8a441999b0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f8a3c00e940 tx=0x7f8a3c00ec50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:24:26.442 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:24:26.439+0000 7f8a41600700 1 -- 172.21.15.87:0/1302895290 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a3c004a30 con 0x7f8a44109510 2024-05-08T05:24:26.442 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:24:26.439+0000 7f8a4ac00700 1 -- 172.21.15.87:0/1302895290 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8a4419a400 con 0x7f8a44109510 2024-05-08T05:24:26.442 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:24:26.439+0000 7f8a41600700 1 -- 172.21.15.87:0/1302895290 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8a3c0054d0 con 0x7f8a44109510 2024-05-08T05:24:26.442 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:24:26.439+0000 7f8a41600700 1 -- 172.21.15.87:0/1302895290 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a3c00ccf0 con 0x7f8a44109510 2024-05-08T05:24:26.442 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:24:26.440+0000 7f8a4ac00700 1 -- 172.21.15.87:0/1302895290 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8a441a66c0 con 0x7f8a44109510 2024-05-08T05:24:26.443 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:24:26.441+0000 7f8a4ac00700 1 -- 172.21.15.87:0/1302895290 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8a4410b9f0 con 0x7f8a44109510 2024-05-08T05:24:26.444 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:24:26.443+0000 7f8a41600700 1 -- 172.21.15.87:0/1302895290 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 16) ==== 149652+0+0 (secure 0 0 0) 0x7f8a3c005020 con 0x7f8a44109510 2024-05-08T05:24:26.446 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:24:26.444+0000 7f8a41600700 1 --2- 172.21.15.87:0/1302895290 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f8a280b2880 0x7f8a280b4d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:24:26.446 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:24:26.445+0000 7f8a41600700 1 -- 172.21.15.87:0/1302895290 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 7127+0+0 (secure 0 0 0) 0x7f8a3c0e1f00 con 0x7f8a44109510 2024-05-08T05:24:26.446 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:24:26.445+0000 7f8a43e00700 1 --2- 172.21.15.87:0/1302895290 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f8a280b2880 0x7f8a280b4d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:24:26.447 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:24:26.445+0000 7f8a43e00700 1 --2- 172.21.15.87:0/1302895290 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f8a280b2880 0x7f8a280b4d40 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f8a340062a0 tx=0x7f8a34006210 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:24:26.450 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:24:26.449+0000 7f8a41600700 1 -- 172.21.15.87:0/1302895290 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f8a3c0aa020 con 0x7f8a44109510 2024-05-08T05:24:26.685 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:24:26.684+0000 7f8a4ac00700 1 -- 172.21.15.87:0/1302895290 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f8a4410b3d0 con 0x7f8a44109510 2024-05-08T05:24:26.686 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:24:26 smithi087 ceph-mon[29523]: pgmap v274: 1 pgs: 1 active+clean; 577 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-08T05:24:26.687 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:24:26.686+0000 7f8a41600700 1 -- 172.21.15.87:0/1302895290 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v73) ==== 74+0+18421 (secure 0 0 0) 0x7f8a3c0a9920 con 0x7f8a44109510 2024-05-08T05:24:26.688 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-05-08T05:24:26.688 INFO:teuthology.orchestra.run.smithi087.stdout:{"epoch":73,"fsid":"eeeb813e-0cf9-11ef-bc97-c7b262605968","created":"2024-05-08T05:16:14.984330+0000","modified":"2024-05-08T05:24:23.341343+0000","last_up_change":"2024-05-08T05:24:22.324501+0000","last_in_change":"2024-05-08T05:24:01.962570+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-08T05:20:08.907941+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"f3e25ce0-0762-46fd-83fb-6766a2e9db69","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6802","nonce":2285285644},{"type":"v1","addr":"172.21.15.87:6803","nonce":2285285644}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6804","nonce":2285285644},{"type":"v1","addr":"172.21.15.87:6805","nonce":2285285644}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6808","nonce":2285285644},{"type":"v1","addr":"172.21.15.87:6809","nonce":2285285644}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6806","nonce":2285285644},{"type":"v1","addr":"172.21.15.87:6807","nonce":2285285644}]},"public_addr":"172.21.15.87:6803/2285285644","cluster_addr":"172.21.15.87:6805/2285285644","heartbeat_back_addr":"172.21.15.87:6809/2285285644","heartbeat_front_addr":"172.21.15.87:6807/2285285644","state":["exists","up"]},{"osd":1,"uuid":"b6de5f4c-1d79-41ff-adee-03d8a47ab55e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6800","nonce":1681573998},{"type":"v1","addr":"172.21.15.90:6801","nonce":1681573998}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6802","nonce":1681573998},{"type":"v1","addr":"172.21.15.90:6803","nonce":1681573998}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6806","nonce":1681573998},{"type":"v1","addr":"172.21.15.90:6807","nonce":1681573998}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6804","nonce":1681573998},{"type":"v1","addr":"172.21.15.90:6805","nonce":1681573998}]},"public_addr":"172.21.15.90:6801/1681573998","cluster_addr":"172.21.15.90:6803/1681573998","heartbeat_back_addr":"172.21.15.90:6807/1681573998","heartbeat_front_addr":"172.21.15.90:6805/1681573998","state":["exists","up"]},{"osd":2,"uuid":"ee3a2729-93b2-4985-b84d-165f92cae8e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6800","nonce":2137179096},{"type":"v1","addr":"172.21.15.160:6801","nonce":2137179096}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6802","nonce":2137179096},{"type":"v1","addr":"172.21.15.160:6803","nonce":2137179096}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6806","nonce":2137179096},{"type":"v1","addr":"172.21.15.160:6807","nonce":2137179096}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6804","nonce":2137179096},{"type":"v1","addr":"172.21.15.160:6805","nonce":2137179096}]},"public_addr":"172.21.15.160:6801/2137179096","cluster_addr":"172.21.15.160:6803/2137179096","heartbeat_back_addr":"172.21.15.160:6807/2137179096","heartbeat_front_addr":"172.21.15.160:6805/2137179096","state":["exists","up"]},{"osd":3,"uuid":"fc7bd69f-5a62-4ec6-b95c-c170be46a7d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6810","nonce":2022667023},{"type":"v1","addr":"172.21.15.87:6811","nonce":2022667023}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6812","nonce":2022667023},{"type":"v1","addr":"172.21.15.87:6813","nonce":2022667023}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6816","nonce":2022667023},{"type":"v1","addr":"172.21.15.87:6817","nonce":2022667023}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6814","nonce":2022667023},{"type":"v1","addr":"172.21.15.87:6815","nonce":2022667023}]},"public_addr":"172.21.15.87:6811/2022667023","cluster_addr":"172.21.15.87:6813/2022667023","heartbeat_back_addr":"172.21.15.87:6817/2022667023","heartbeat_front_addr":"172.21.15.87:6815/2022667023","state":["exists","up"]},{"osd":4,"uuid":"a05f7bd1-962a-4f3e-8f70-e7ef4c68bac2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6808","nonce":1371607578},{"type":"v1","addr":"172.21.15.90:6809","nonce":1371607578}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6810","nonce":1371607578},{"type":"v1","addr":"172.21.15.90:6811","nonce":1371607578}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6814","nonce":1371607578},{"type":"v1","addr":"172.21.15.90:6815","nonce":1371607578}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6812","nonce":1371607578},{"type":"v1","addr":"172.21.15.90:6813","nonce":1371607578}]},"public_addr":"172.21.15.90:6809/1371607578","cluster_addr":"172.21.15.90:6811/1371607578","heartbeat_back_addr":"172.21.15.90:6815/1371607578","heartbeat_front_addr":"172.21.15.90:6813/1371607578","state":["exists","up"]},{"osd":5,"uuid":"85e3af08-32ee-4f26-97df-8d54ba928715","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6808","nonce":2190054276},{"type":"v1","addr":"172.21.15.160:6809","nonce":2190054276}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6810","nonce":2190054276},{"type":"v1","addr":"172.21.15.160:6811","nonce":2190054276}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6814","nonce":2190054276},{"type":"v1","addr":"172.21.15.160:6815","nonce":2190054276}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6812","nonce":2190054276},{"type":"v1","addr":"172.21.15.160:6813","nonce":2190054276}]},"public_addr":"172.21.15.160:6809/2190054276","cluster_addr":"172.21.15.160:6811/2190054276","heartbeat_back_addr":"172.21.15.160:6815/2190054276","heartbeat_front_addr":"172.21.15.160:6813/2190054276","state":["exists","up"]},{"osd":6,"uuid":"df4b22a9-6cd8-473e-a17b-a0cb9ad32e98","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":42,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6818","nonce":2863681447},{"type":"v1","addr":"172.21.15.87:6819","nonce":2863681447}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6820","nonce":2863681447},{"type":"v1","addr":"172.21.15.87:6821","nonce":2863681447}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6824","nonce":2863681447},{"type":"v1","addr":"172.21.15.87:6825","nonce":2863681447}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6822","nonce":2863681447},{"type":"v1","addr":"172.21.15.87:6823","nonce":2863681447}]},"public_addr":"172.21.15.87:6819/2863681447","cluster_addr":"172.21.15.87:6821/2863681447","heartbeat_back_addr":"172.21.15.87:6825/2863681447","heartbeat_front_addr":"172.21.15.87:6823/2863681447","state":["exists","up"]},{"osd":7,"uuid":"f6ef3857-0366-4408-932a-a8c8479ba780","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6816","nonce":1964248958},{"type":"v1","addr":"172.21.15.90:6817","nonce":1964248958}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6818","nonce":1964248958},{"type":"v1","addr":"172.21.15.90:6819","nonce":1964248958}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6822","nonce":1964248958},{"type":"v1","addr":"172.21.15.90:6823","nonce":1964248958}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6820","nonce":1964248958},{"type":"v1","addr":"172.21.15.90:6821","nonce":1964248958}]},"public_addr":"172.21.15.90:6817/1964248958","cluster_addr":"172.21.15.90:6819/1964248958","heartbeat_back_addr":"172.21.15.90:6823/1964248958","heartbeat_front_addr":"172.21.15.90:6821/1964248958","state":["exists","up"]},{"osd":8,"uuid":"027dede9-d0be-4fbe-b7b8-02ce88d57f4d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":54,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6816","nonce":927680738},{"type":"v1","addr":"172.21.15.160:6817","nonce":927680738}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6818","nonce":927680738},{"type":"v1","addr":"172.21.15.160:6819","nonce":927680738}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6822","nonce":927680738},{"type":"v1","addr":"172.21.15.160:6823","nonce":927680738}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6820","nonce":927680738},{"type":"v1","addr":"172.21.15.160:6821","nonce":927680738}]},"public_addr":"172.21.15.160:6817/927680738","cluster_addr":"172.21.15.160:6819/927680738","heartbeat_back_addr":"172.21.15.160:6823/927680738","heartbeat_front_addr":"172.21.15.160:6821/927680738","state":["exists","up"]},{"osd":9,"uuid":"bc9e37de-e509-4db6-bd58-b68e2c8e1aff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6826","nonce":3789116749},{"type":"v1","addr":"172.21.15.87:6827","nonce":3789116749}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6828","nonce":3789116749},{"type":"v1","addr":"172.21.15.87:6829","nonce":3789116749}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6832","nonce":3789116749},{"type":"v1","addr":"172.21.15.87:6833","nonce":3789116749}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6830","nonce":3789116749},{"type":"v1","addr":"172.21.15.87:6831","nonce":3789116749}]},"public_addr":"172.21.15.87:6827/3789116749","cluster_addr":"172.21.15.87:6829/3789116749","heartbeat_back_addr":"172.21.15.87:6833/3789116749","heartbeat_front_addr":"172.21.15.87:6831/3789116749","state":["exists","up"]},{"osd":10,"uuid":"43945081-b4c8-4f5d-9301-3540709e69e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":66,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6824","nonce":716529498},{"type":"v1","addr":"172.21.15.90:6825","nonce":716529498}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6826","nonce":716529498},{"type":"v1","addr":"172.21.15.90:6827","nonce":716529498}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6830","nonce":716529498},{"type":"v1","addr":"172.21.15.90:6831","nonce":716529498}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6828","nonce":716529498},{"type":"v1","addr":"172.21.15.90:6829","nonce":716529498}]},"public_addr":"172.21.15.90:6825/716529498","cluster_addr":"172.21.15.90:6827/716529498","heartbeat_back_addr":"172.21.15.90:6831/716529498","heartbeat_front_addr":"172.21.15.90:6829/716529498","state":["exists","up"]},{"osd":11,"uuid":"da23ff5c-3f79-44e3-bca3-d9d5a003c999","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6824","nonce":1842739135},{"type":"v1","addr":"172.21.15.160:6825","nonce":1842739135}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6826","nonce":1842739135},{"type":"v1","addr":"172.21.15.160:6827","nonce":1842739135}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6830","nonce":1842739135},{"type":"v1","addr":"172.21.15.160:6831","nonce":1842739135}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6828","nonce":1842739135},{"type":"v1","addr":"172.21.15.160:6829","nonce":1842739135}]},"public_addr":"172.21.15.160:6825/1842739135","cluster_addr":"172.21.15.160:6827/1842739135","heartbeat_back_addr":"172.21.15.160:6831/1842739135","heartbeat_front_addr":"172.21.15.160:6829/1842739135","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T05:19:15.869398+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T05:19:42.014078+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T05:20:06.430660+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T05:20:38.555519+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T05:21:04.530605+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T05:21:29.545252+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T05:22:03.141982+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T05:22:29.191127+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T05:22:54.502994+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T05:23:27.899000+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T05:23:54.693979+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T05:24:20.307119+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.87:0/4226160503":"2024-05-09T05:17:22.736165+0000","172.21.15.87:0/2773684806":"2024-05-09T05:17:22.736165+0000","172.21.15.87:0/349590592":"2024-05-09T05:17:22.736165+0000","172.21.15.87:6801/2710124295":"2024-05-09T05:17:22.736165+0000","172.21.15.87:6800/1823425617":"2024-05-09T05:16:48.155337+0000","172.21.15.87:0/2393072013":"2024-05-09T05:16:48.155337+0000","172.21.15.87:0/1291525416":"2024-05-09T05:16:48.155337+0000","172.21.15.87:6801/1823425617":"2024-05-09T05:16:48.155337+0000","172.21.15.87:0/3839463573":"2024-05-09T05:16:48.155337+0000","172.21.15.87:6800/2710124295":"2024-05-09T05:17:22.736165+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-08T05:24:26.690 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:24:26.689+0000 7f8a4ac00700 1 -- 172.21.15.87:0/1302895290 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f8a280b2880 msgr2=0x7f8a280b4d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:24:26.690 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:24:26.689+0000 7f8a4ac00700 1 --2- 172.21.15.87:0/1302895290 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f8a280b2880 0x7f8a280b4d40 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f8a340062a0 tx=0x7f8a34006210 comp rx=0 tx=0).stop 2024-05-08T05:24:26.690 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:24:26.689+0000 7f8a4ac00700 1 -- 172.21.15.87:0/1302895290 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8a44109510 msgr2=0x7f8a441999b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:24:26.691 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:24:26.689+0000 7f8a4ac00700 1 --2- 172.21.15.87:0/1302895290 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8a44109510 0x7f8a441999b0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f8a3c00e940 tx=0x7f8a3c00ec50 comp rx=0 tx=0).stop 2024-05-08T05:24:26.691 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:24:26.689+0000 7f8a4ac00700 1 -- 172.21.15.87:0/1302895290 shutdown_connections 2024-05-08T05:24:26.691 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:24:26.689+0000 7f8a4ac00700 1 --2- 172.21.15.87:0/1302895290 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8a44109510 0x7f8a441999b0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:24:26.691 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:24:26.689+0000 7f8a4ac00700 1 --2- 172.21.15.87:0/1302895290 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f8a280b2880 0x7f8a280b4d40 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:24:26.691 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:24:26.689+0000 7f8a4ac00700 1 --2- 172.21.15.87:0/1302895290 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f8a4406b180 0x7f8a4419f7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:24:26.691 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:24:26.689+0000 7f8a4ac00700 1 --2- 172.21.15.87:0/1302895290 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8a4406bb40 0x7f8a4419fd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:24:26.691 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:24:26.689+0000 7f8a4ac00700 1 -- 172.21.15.87:0/1302895290 >> 172.21.15.87:0/1302895290 conn(0x7f8a44079350 msgr2=0x7f8a441011a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:24:26.691 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:24:26.689+0000 7f8a4ac00700 1 -- 172.21.15.87:0/1302895290 shutdown_connections 2024-05-08T05:24:26.691 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:24:26.689+0000 7f8a4ac00700 1 -- 172.21.15.87:0/1302895290 wait complete. 2024-05-08T05:24:26.733 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:24:26 smithi090 ceph-mon[34526]: pgmap v274: 1 pgs: 1 active+clean; 577 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-08T05:24:26.789 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:24:26 smithi160 ceph-mon[34827]: pgmap v274: 1 pgs: 1 active+clean; 577 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-08T05:24:27.512 INFO:tasks.cephadm.ceph_manager.ceph:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-05-08T05:20:08.907941+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-05-08T05:24:27.512 DEBUG:teuthology.orchestra.run.smithi087:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid eeeb813e-0cf9-11ef-bc97-c7b262605968 -- ceph osd pool get .mgr pg_num 2024-05-08T05:24:27.631 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:24:27 smithi087 ceph-mon[29523]: from='client.? 172.21.15.87:0/1302895290' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-08T05:24:27.733 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:24:27 smithi090 ceph-mon[34526]: from='client.? 172.21.15.87:0/1302895290' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-08T05:24:27.788 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:24:27 smithi160 ceph-mon[34827]: from='client.? 172.21.15.87:0/1302895290' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-08T05:24:27.995 INFO:teuthology.orchestra.run.smithi087.stderr:Inferring config /var/lib/ceph/eeeb813e-0cf9-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T05:24:28.450 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:24:28 smithi087 ceph-mon[29523]: pgmap v275: 1 pgs: 1 active+clean; 577 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-08T05:24:28.733 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:24:28 smithi090 ceph-mon[34526]: pgmap v275: 1 pgs: 1 active+clean; 577 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-08T05:24:28.788 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:24:28 smithi160 ceph-mon[34827]: pgmap v275: 1 pgs: 1 active+clean; 577 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-08T05:24:30.087 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:24:30.085+0000 7fd7fca00700 1 -- 172.21.15.87:0/1861470551 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd7f81056c0 msgr2=0x7fd7f8105b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:24:30.088 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:24:30.085+0000 7fd7fca00700 1 --2- 172.21.15.87:0/1861470551 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd7f81056c0 0x7fd7f8105b40 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fd7e00098f0 tx=0x7fd7e0009c00 comp rx=0 tx=0).stop 2024-05-08T05:24:30.088 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:24:30.085+0000 7fd7fca00700 1 -- 172.21.15.87:0/1861470551 shutdown_connections 2024-05-08T05:24:30.088 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:24:30.085+0000 7fd7fca00700 1 --2- 172.21.15.87:0/1861470551 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd7f8106080 0x7fd7f8112590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:24:30.088 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:24:30.085+0000 7fd7fca00700 1 --2- 172.21.15.87:0/1861470551 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd7f810b6c0 0x7fd7f810baa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:24:30.088 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:24:30.085+0000 7fd7fca00700 1 --2- 172.21.15.87:0/1861470551 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd7f81056c0 0x7fd7f8105b40 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:24:30.088 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:24:30.085+0000 7fd7fca00700 1 -- 172.21.15.87:0/1861470551 >> 172.21.15.87:0/1861470551 conn(0x7fd7f81011b0 msgr2=0x7fd7f81035d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:24:30.088 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:24:30.085+0000 7fd7fca00700 1 -- 172.21.15.87:0/1861470551 shutdown_connections 2024-05-08T05:24:30.088 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:24:30.086+0000 7fd7fca00700 1 -- 172.21.15.87:0/1861470551 wait complete. 2024-05-08T05:24:30.089 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:24:30.087+0000 7fd7fca00700 1 Processor -- start 2024-05-08T05:24:30.090 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:24:30.087+0000 7fd7fca00700 1 -- start start 2024-05-08T05:24:30.090 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:24:30.087+0000 7fd7fca00700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd7f81056c0 0x7fd7f819be10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:24:30.090 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:24:30.087+0000 7fd7fca00700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd7f8106080 0x7fd7f819c350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:24:30.090 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:24:30.087+0000 7fd7fca00700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd7f810b6c0 0x7fd7f81a0690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:24:30.090 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:24:30.087+0000 7fd7fca00700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fd7f81158a0 con 0x7fd7f810b6c0 2024-05-08T05:24:30.090 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:24:30.087+0000 7fd7fca00700 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fd7f8115720 con 0x7fd7f8106080 2024-05-08T05:24:30.090 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:24:30.087+0000 7fd7fca00700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7fd7f8115a20 con 0x7fd7f81056c0 2024-05-08T05:24:30.090 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:24:30.088+0000 7fd7f5e00700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd7f81056c0 0x7fd7f819be10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:24:30.090 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:24:30.088+0000 7fd7f5e00700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd7f81056c0 0x7fd7f819be10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.87:38270/0 (socket says 172.21.15.87:38270) 2024-05-08T05:24:30.090 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:24:30.088+0000 7fd7f5e00700 1 -- 172.21.15.87:0/4008163395 learned_addr learned my addr 172.21.15.87:0/4008163395 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T05:24:30.090 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:24:30.088+0000 7fd7ed400700 1 --2- 172.21.15.87:0/4008163395 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd7f8106080 0x7fd7f819c350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:24:30.090 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:24:30.088+0000 7fd7f6800700 1 --2- 172.21.15.87:0/4008163395 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd7f810b6c0 0x7fd7f81a0690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:24:30.091 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:24:30.088+0000 7fd7ed400700 1 -- 172.21.15.87:0/4008163395 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd7f81056c0 msgr2=0x7fd7f819be10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:24:30.091 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:24:30.088+0000 7fd7ed400700 1 --2- 172.21.15.87:0/4008163395 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd7f81056c0 0x7fd7f819be10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:24:30.091 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:24:30.088+0000 7fd7ed400700 1 -- 172.21.15.87:0/4008163395 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd7f810b6c0 msgr2=0x7fd7f81a0690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:24:30.091 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:24:30.088+0000 7fd7ed400700 1 --2- 172.21.15.87:0/4008163395 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd7f810b6c0 0x7fd7f81a0690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:24:30.091 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:24:30.088+0000 7fd7ed400700 1 -- 172.21.15.87:0/4008163395 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd7f81a0dd0 con 0x7fd7f8106080 2024-05-08T05:24:30.091 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:24:30.088+0000 7fd7ed400700 1 --2- 172.21.15.87:0/4008163395 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd7f8106080 0x7fd7f819c350 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fd7e0009230 tx=0x7fd7e000fa00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:24:30.092 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:24:30.089+0000 7fd7ef400700 1 -- 172.21.15.87:0/4008163395 <== mon.2 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7e0005040 con 0x7fd7f8106080 2024-05-08T05:24:30.092 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:24:30.089+0000 7fd7ef400700 1 -- 172.21.15.87:0/4008163395 <== mon.2 v2:172.21.15.90:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd7e0005690 con 0x7fd7f8106080 2024-05-08T05:24:30.092 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:24:30.089+0000 7fd7fca00700 1 -- 172.21.15.87:0/4008163395 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd7f81a1060 con 0x7fd7f8106080 2024-05-08T05:24:30.092 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:24:30.089+0000 7fd7ef400700 1 -- 172.21.15.87:0/4008163395 <== mon.2 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7e00038e0 con 0x7fd7f8106080 2024-05-08T05:24:30.092 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:24:30.089+0000 7fd7fca00700 1 -- 172.21.15.87:0/4008163395 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd7f81a8940 con 0x7fd7f8106080 2024-05-08T05:24:30.092 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:24:30.090+0000 7fd7fca00700 1 -- 172.21.15.87:0/4008163395 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd7f806a190 con 0x7fd7f8106080 2024-05-08T05:24:30.093 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:24:30.092+0000 7fd7ef400700 1 -- 172.21.15.87:0/4008163395 <== mon.2 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 16) ==== 149652+0+0 (secure 0 0 0) 0x7fd7e000b760 con 0x7fd7f8106080 2024-05-08T05:24:30.095 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:24:30.094+0000 7fd7ef400700 1 --2- 172.21.15.87:0/4008163395 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7fd7dc0b2900 0x7fd7dc0b4dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:24:30.095 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:24:30.094+0000 7fd7ef400700 1 -- 172.21.15.87:0/4008163395 <== mon.2 v2:172.21.15.90:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 7127+0+0 (secure 0 0 0) 0x7fd7e00e2f80 con 0x7fd7f8106080 2024-05-08T05:24:30.095 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:24:30.094+0000 7fd7f5e00700 1 --2- 172.21.15.87:0/4008163395 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7fd7dc0b2900 0x7fd7dc0b4dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:24:30.096 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:24:30.095+0000 7fd7f5e00700 1 --2- 172.21.15.87:0/4008163395 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7fd7dc0b2900 0x7fd7dc0b4dc0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fd7e8009750 tx=0x7fd7e8009310 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:24:30.097 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:24:30.096+0000 7fd7ef400700 1 -- 172.21.15.87:0/4008163395 <== mon.2 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7fd7e0013030 con 0x7fd7f8106080 2024-05-08T05:24:30.326 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:24:30.324+0000 7fd7fca00700 1 -- 172.21.15.87:0/4008163395 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fd7f802e510 con 0x7fd7f8106080 2024-05-08T05:24:30.327 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:24:30.325+0000 7fd7ef400700 1 -- 172.21.15.87:0/4008163395 <== mon.2 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v73) ==== 93+0+10 (secure 0 0 0) 0x7fd7e00ab130 con 0x7fd7f8106080 2024-05-08T05:24:30.327 INFO:teuthology.orchestra.run.smithi087.stdout:pg_num: 1 2024-05-08T05:24:30.330 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:24:30.328+0000 7fd7fca00700 1 -- 172.21.15.87:0/4008163395 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7fd7dc0b2900 msgr2=0x7fd7dc0b4dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:24:30.330 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:24:30.328+0000 7fd7fca00700 1 --2- 172.21.15.87:0/4008163395 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7fd7dc0b2900 0x7fd7dc0b4dc0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fd7e8009750 tx=0x7fd7e8009310 comp rx=0 tx=0).stop 2024-05-08T05:24:30.331 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:24:30.329+0000 7fd7fca00700 1 -- 172.21.15.87:0/4008163395 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd7f8106080 msgr2=0x7fd7f819c350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:24:30.331 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:24:30.329+0000 7fd7fca00700 1 --2- 172.21.15.87:0/4008163395 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd7f8106080 0x7fd7f819c350 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fd7e0009230 tx=0x7fd7e000fa00 comp rx=0 tx=0).stop 2024-05-08T05:24:30.331 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:24:30.329+0000 7fd7fca00700 1 -- 172.21.15.87:0/4008163395 shutdown_connections 2024-05-08T05:24:30.331 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:24:30.329+0000 7fd7fca00700 1 --2- 172.21.15.87:0/4008163395 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd7f810b6c0 0x7fd7f81a0690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:24:30.331 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:24:30.329+0000 7fd7fca00700 1 --2- 172.21.15.87:0/4008163395 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7fd7dc0b2900 0x7fd7dc0b4dc0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:24:30.331 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:24:30.329+0000 7fd7fca00700 1 --2- 172.21.15.87:0/4008163395 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd7f81056c0 0x7fd7f819be10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:24:30.331 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:24:30.329+0000 7fd7fca00700 1 --2- 172.21.15.87:0/4008163395 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd7f8106080 0x7fd7f819c350 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:24:30.331 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:24:30.329+0000 7fd7fca00700 1 -- 172.21.15.87:0/4008163395 >> 172.21.15.87:0/4008163395 conn(0x7fd7f81011b0 msgr2=0x7fd7f81019d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:24:30.331 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:24:30.329+0000 7fd7fca00700 1 -- 172.21.15.87:0/4008163395 shutdown_connections 2024-05-08T05:24:30.331 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:24:30.329+0000 7fd7fca00700 1 -- 172.21.15.87:0/4008163395 wait complete. 2024-05-08T05:24:30.654 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:24:30 smithi087 ceph-mon[29523]: pgmap v276: 1 pgs: 1 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-08T05:24:30.654 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:24:30 smithi087 ceph-mon[29523]: from='client.? 172.21.15.87:0/4008163395' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-05-08T05:24:30.733 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:24:30 smithi090 ceph-mon[34526]: pgmap v276: 1 pgs: 1 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-08T05:24:30.733 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:24:30 smithi090 ceph-mon[34526]: from='client.? 172.21.15.87:0/4008163395' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-05-08T05:24:30.789 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:24:30 smithi160 ceph-mon[34827]: pgmap v276: 1 pgs: 1 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-08T05:24:30.789 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:24:30 smithi160 ceph-mon[34827]: from='client.? 172.21.15.87:0/4008163395' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-05-08T05:24:31.016 INFO:tasks.cephadm:Adding mds.a on smithi087 2024-05-08T05:24:31.016 INFO:tasks.cephadm:Adding mds.d on smithi087 2024-05-08T05:24:31.016 INFO:tasks.cephadm:Adding mds.g on smithi087 2024-05-08T05:24:31.016 INFO:tasks.cephadm:Adding mds.j on smithi087 2024-05-08T05:24:31.016 INFO:tasks.cephadm:Adding mds.b on smithi090 2024-05-08T05:24:31.016 INFO:tasks.cephadm:Adding mds.e on smithi090 2024-05-08T05:24:31.016 INFO:tasks.cephadm:Adding mds.h on smithi090 2024-05-08T05:24:31.016 INFO:tasks.cephadm:Adding mds.k on smithi090 2024-05-08T05:24:31.016 INFO:tasks.cephadm:Adding mds.c on smithi160 2024-05-08T05:24:31.016 INFO:tasks.cephadm:Adding mds.f on smithi160 2024-05-08T05:24:31.016 INFO:tasks.cephadm:Adding mds.i on smithi160 2024-05-08T05:24:31.016 INFO:tasks.cephadm:Adding mds.l on smithi160 2024-05-08T05:24:31.017 DEBUG:teuthology.orchestra.run.smithi160:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid eeeb813e-0cf9-11ef-bc97-c7b262605968 -- ceph orch apply mds all '12;smithi087=a;smithi087=d;smithi087=g;smithi087=j;smithi090=b;smithi090=e;smithi090=h;smithi090=k;smithi160=c;smithi160=f;smithi160=i;smithi160=l' 2024-05-08T05:24:31.265 INFO:teuthology.orchestra.run.smithi160.stderr:Inferring config /var/lib/ceph/eeeb813e-0cf9-11ef-bc97-c7b262605968/mon.c/config 2024-05-08T05:24:32.670 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:24:32 smithi160 ceph-mon[34827]: pgmap v277: 1 pgs: 1 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-08T05:24:32.708 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:24:32 smithi087 ceph-mon[29523]: pgmap v277: 1 pgs: 1 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-08T05:24:32.733 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:24:32 smithi090 ceph-mon[34526]: pgmap v277: 1 pgs: 1 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-08T05:24:32.878 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-08T05:24:32.875+0000 7fc3ff24e700 1 -- 172.21.15.160:0/3855063591 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc3f8103610 msgr2=0x7fc3f8103a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:24:32.878 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-08T05:24:32.875+0000 7fc3ff24e700 1 --2- 172.21.15.160:0/3855063591 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc3f8103610 0x7fc3f8103a70 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fc3e4009990 tx=0x7fc3e4009ca0 comp rx=0 tx=0).stop 2024-05-08T05:24:32.878 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-08T05:24:32.876+0000 7fc3ff24e700 1 -- 172.21.15.160:0/3855063591 shutdown_connections 2024-05-08T05:24:32.878 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-08T05:24:32.876+0000 7fc3ff24e700 1 --2- 172.21.15.160:0/3855063591 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc3f8103fb0 0x7fc3f810a860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:24:32.878 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-08T05:24:32.876+0000 7fc3ff24e700 1 --2- 172.21.15.160:0/3855063591 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc3f8102410 0x7fc3f8102830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:24:32.878 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-08T05:24:32.876+0000 7fc3ff24e700 1 --2- 172.21.15.160:0/3855063591 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc3f8103610 0x7fc3f8103a70 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:24:32.878 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-08T05:24:32.876+0000 7fc3ff24e700 1 -- 172.21.15.160:0/3855063591 >> 172.21.15.160:0/3855063591 conn(0x7fc3f80fd9d0 msgr2=0x7fc3f80ffdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:24:32.878 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-08T05:24:32.876+0000 7fc3ff24e700 1 -- 172.21.15.160:0/3855063591 shutdown_connections 2024-05-08T05:24:32.878 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-08T05:24:32.876+0000 7fc3ff24e700 1 -- 172.21.15.160:0/3855063591 wait complete. 2024-05-08T05:24:32.879 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-08T05:24:32.876+0000 7fc3ff24e700 1 Processor -- start 2024-05-08T05:24:32.879 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-08T05:24:32.876+0000 7fc3ff24e700 1 -- start start 2024-05-08T05:24:32.879 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-08T05:24:32.876+0000 7fc3ff24e700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc3f8102410 0x7fc3f8199780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:24:32.879 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-08T05:24:32.876+0000 7fc3ff24e700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc3f8103610 0x7fc3f8199cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:24:32.879 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-08T05:24:32.876+0000 7fc3ff24e700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc3f8103fb0 0x7fc3f81a0d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:24:32.879 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-08T05:24:32.876+0000 7fc3ff24e700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fc3f810dfa0 con 0x7fc3f8102410 2024-05-08T05:24:32.879 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-08T05:24:32.876+0000 7fc3ff24e700 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fc3f810de20 con 0x7fc3f8103610 2024-05-08T05:24:32.879 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-08T05:24:32.876+0000 7fc3ff24e700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7fc3f810e120 con 0x7fc3f8103fb0 2024-05-08T05:24:32.879 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-08T05:24:32.876+0000 7fc3fd7eb700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc3f8103fb0 0x7fc3f81a0d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:24:32.879 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-08T05:24:32.877+0000 7fc3fd7eb700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc3f8103fb0 0x7fc3f81a0d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.160:43722/0 (socket says 172.21.15.160:43722) 2024-05-08T05:24:32.879 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-08T05:24:32.877+0000 7fc3fd7eb700 1 -- 172.21.15.160:0/3061918625 learned_addr learned my addr 172.21.15.160:0/3061918625 (peer_addr_for_me v2:172.21.15.160:0/0) 2024-05-08T05:24:32.879 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-08T05:24:32.877+0000 7fc3f7fff700 1 --2- 172.21.15.160:0/3061918625 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc3f8103610 0x7fc3f8199cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:24:32.879 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-08T05:24:32.877+0000 7fc3fd7eb700 1 -- 172.21.15.160:0/3061918625 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc3f8103610 msgr2=0x7fc3f8199cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:24:32.879 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-08T05:24:32.877+0000 7fc3fd7eb700 1 --2- 172.21.15.160:0/3061918625 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc3f8103610 0x7fc3f8199cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:24:32.880 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-08T05:24:32.877+0000 7fc3fd7eb700 1 -- 172.21.15.160:0/3061918625 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc3f8102410 msgr2=0x7fc3f8199780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:24:32.880 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-08T05:24:32.877+0000 7fc3fd7eb700 1 --2- 172.21.15.160:0/3061918625 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc3f8102410 0x7fc3f8199780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:24:32.880 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-08T05:24:32.877+0000 7fc3fd7eb700 1 -- 172.21.15.160:0/3061918625 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc3f81a13e0 con 0x7fc3f8103fb0 2024-05-08T05:24:32.880 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-08T05:24:32.877+0000 7fc3fd7eb700 1 --2- 172.21.15.160:0/3061918625 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc3f8103fb0 0x7fc3f81a0d40 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fc3f000b9a0 tx=0x7fc3f000bd60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:24:32.880 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-08T05:24:32.877+0000 7fc3f5ffb700 1 -- 172.21.15.160:0/3061918625 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3f0019070 con 0x7fc3f8103fb0 2024-05-08T05:24:32.880 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-08T05:24:32.877+0000 7fc3f5ffb700 1 -- 172.21.15.160:0/3061918625 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc3f0014440 con 0x7fc3f8103fb0 2024-05-08T05:24:32.880 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-08T05:24:32.877+0000 7fc3ff24e700 1 -- 172.21.15.160:0/3061918625 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc3f81a16d0 con 0x7fc3f8103fb0 2024-05-08T05:24:32.880 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-08T05:24:32.877+0000 7fc3f5ffb700 1 -- 172.21.15.160:0/3061918625 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3f000ce60 con 0x7fc3f8103fb0 2024-05-08T05:24:32.880 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-08T05:24:32.877+0000 7fc3ff24e700 1 -- 172.21.15.160:0/3061918625 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc3f81a1c90 con 0x7fc3f8103fb0 2024-05-08T05:24:32.881 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-08T05:24:32.878+0000 7fc3ff24e700 1 -- 172.21.15.160:0/3061918625 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc3f806a190 con 0x7fc3f8103fb0 2024-05-08T05:24:32.881 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-08T05:24:32.879+0000 7fc3f5ffb700 1 -- 172.21.15.160:0/3061918625 <== mon.1 v2:172.21.15.160:3300/0 4 ==== mgrmap(e 16) ==== 149652+0+0 (secure 0 0 0) 0x7fc3f001c070 con 0x7fc3f8103fb0 2024-05-08T05:24:32.881 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-08T05:24:32.880+0000 7fc3f5ffb700 1 --2- 172.21.15.160:0/3061918625 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7fc3e80b2880 0x7fc3e80b4d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:24:32.881 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-08T05:24:32.880+0000 7fc3f5ffb700 1 -- 172.21.15.160:0/3061918625 <== mon.1 v2:172.21.15.160:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 7127+0+0 (secure 0 0 0) 0x7fc3f00e1170 con 0x7fc3f8103fb0 2024-05-08T05:24:32.881 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-08T05:24:32.881+0000 7fc3fcfea700 1 --2- 172.21.15.160:0/3061918625 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7fc3e80b2880 0x7fc3e80b4d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:24:32.882 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-08T05:24:32.882+0000 7fc3fcfea700 1 --2- 172.21.15.160:0/3061918625 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7fc3e80b2880 0x7fc3e80b4d40 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fc3f8103470 tx=0x7fc3ec006d20 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:24:32.885 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-08T05:24:32.885+0000 7fc3f5ffb700 1 -- 172.21.15.160:0/3061918625 <== mon.1 v2:172.21.15.160:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7fc3f00a93c0 con 0x7fc3f8103fb0 2024-05-08T05:24:33.103 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-08T05:24:33.102+0000 7fc3ff24e700 1 -- 172.21.15.160:0/3061918625 --> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] -- mgr_command(tid 0: {"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi087=a;smithi087=d;smithi087=g;smithi087=j;smithi090=b;smithi090=e;smithi090=h;smithi090=k;smithi160=c;smithi160=f;smithi160=i;smithi160=l", "target": ["mon-mgr", ""]}) -- 0x7fc3f80ffc00 con 0x7fc3e80b2880 2024-05-08T05:24:33.120 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-08T05:24:33.119+0000 7fc3f5ffb700 1 -- 172.21.15.160:0/3061918625 <== mgr.14152 v2:172.21.15.87:6800/1189186457 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+28 (secure 0 0 0) 0x7fc3f80ffc00 con 0x7fc3e80b2880 2024-05-08T05:24:33.120 INFO:teuthology.orchestra.run.smithi160.stdout:Scheduled mds.all update... 2024-05-08T05:24:33.122 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-08T05:24:33.122+0000 7fc3ff24e700 1 -- 172.21.15.160:0/3061918625 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7fc3e80b2880 msgr2=0x7fc3e80b4d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:24:33.123 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-08T05:24:33.122+0000 7fc3ff24e700 1 --2- 172.21.15.160:0/3061918625 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7fc3e80b2880 0x7fc3e80b4d40 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fc3f8103470 tx=0x7fc3ec006d20 comp rx=0 tx=0).stop 2024-05-08T05:24:33.123 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-08T05:24:33.122+0000 7fc3ff24e700 1 -- 172.21.15.160:0/3061918625 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc3f8103fb0 msgr2=0x7fc3f81a0d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:24:33.123 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-08T05:24:33.122+0000 7fc3ff24e700 1 --2- 172.21.15.160:0/3061918625 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc3f8103fb0 0x7fc3f81a0d40 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fc3f000b9a0 tx=0x7fc3f000bd60 comp rx=0 tx=0).stop 2024-05-08T05:24:33.123 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-08T05:24:33.122+0000 7fc3ff24e700 1 -- 172.21.15.160:0/3061918625 shutdown_connections 2024-05-08T05:24:33.123 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-08T05:24:33.122+0000 7fc3ff24e700 1 --2- 172.21.15.160:0/3061918625 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7fc3e80b2880 0x7fc3e80b4d40 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:24:33.123 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-08T05:24:33.122+0000 7fc3ff24e700 1 --2- 172.21.15.160:0/3061918625 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc3f8103fb0 0x7fc3f81a0d40 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:24:33.123 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-08T05:24:33.122+0000 7fc3ff24e700 1 --2- 172.21.15.160:0/3061918625 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc3f8102410 0x7fc3f8199780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:24:33.123 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-08T05:24:33.122+0000 7fc3ff24e700 1 --2- 172.21.15.160:0/3061918625 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc3f8103610 0x7fc3f8199cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:24:33.123 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-08T05:24:33.122+0000 7fc3ff24e700 1 -- 172.21.15.160:0/3061918625 >> 172.21.15.160:0/3061918625 conn(0x7fc3f80fd9d0 msgr2=0x7fc3f80ff4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:24:33.123 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-08T05:24:33.122+0000 7fc3ff24e700 1 -- 172.21.15.160:0/3061918625 shutdown_connections 2024-05-08T05:24:33.123 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-08T05:24:33.122+0000 7fc3ff24e700 1 -- 172.21.15.160:0/3061918625 wait complete. 2024-05-08T05:24:33.816 DEBUG:teuthology.orchestra.run.smithi087:mds.a> sudo journalctl -f -n 0 -u ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968@mds.a.service 2024-05-08T05:24:33.821 DEBUG:teuthology.orchestra.run.smithi087:mds.d> sudo journalctl -f -n 0 -u ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968@mds.d.service 2024-05-08T05:24:33.868 DEBUG:teuthology.orchestra.run.smithi087:mds.g> sudo journalctl -f -n 0 -u ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968@mds.g.service 2024-05-08T05:24:33.913 DEBUG:teuthology.orchestra.run.smithi087:mds.j> sudo journalctl -f -n 0 -u ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968@mds.j.service 2024-05-08T05:24:33.960 DEBUG:teuthology.orchestra.run.smithi090:mds.b> sudo journalctl -f -n 0 -u ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968@mds.b.service 2024-05-08T05:24:33.963 DEBUG:teuthology.orchestra.run.smithi090:mds.e> sudo journalctl -f -n 0 -u ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968@mds.e.service 2024-05-08T05:24:34.005 DEBUG:teuthology.orchestra.run.smithi090:mds.h> sudo journalctl -f -n 0 -u ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968@mds.h.service 2024-05-08T05:24:34.048 DEBUG:teuthology.orchestra.run.smithi090:mds.k> sudo journalctl -f -n 0 -u ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968@mds.k.service 2024-05-08T05:24:34.092 DEBUG:teuthology.orchestra.run.smithi160:mds.c> sudo journalctl -f -n 0 -u ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968@mds.c.service 2024-05-08T05:24:34.094 DEBUG:teuthology.orchestra.run.smithi160:mds.f> sudo journalctl -f -n 0 -u ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968@mds.f.service 2024-05-08T05:24:34.137 DEBUG:teuthology.orchestra.run.smithi160:mds.i> sudo journalctl -f -n 0 -u ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968@mds.i.service 2024-05-08T05:24:34.180 DEBUG:teuthology.orchestra.run.smithi160:mds.l> sudo journalctl -f -n 0 -u ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968@mds.l.service 2024-05-08T05:24:34.208 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:24:34 smithi087 ceph-mon[29523]: pgmap v278: 1 pgs: 1 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-08T05:24:34.208 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:24:34 smithi087 ceph-mon[29523]: from='client.24406 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi087=a;smithi087=d;smithi087=g;smithi087=j;smithi090=b;smithi090=e;smithi090=h;smithi090=k;smithi160=c;smithi160=f;smithi160=i;smithi160=l", "target": ["mon-mgr", ""]}]: dispatch 2024-05-08T05:24:34.208 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:24:34 smithi087 ceph-mon[29523]: Saving service mds.all spec with placement smithi087=a;smithi087=d;smithi087=g;smithi087=j;smithi090=b;smithi090=e;smithi090=h;smithi090=k;smithi160=c;smithi160=f;smithi160=i;smithi160=l;count:12 2024-05-08T05:24:34.208 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:24:34 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:24:34.208 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:24:34 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T05:24:34.223 INFO:tasks.cephadm:Setting up CephFS filesystem(s)... 2024-05-08T05:24:34.223 DEBUG:teuthology.orchestra.run.smithi087:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid eeeb813e-0cf9-11ef-bc97-c7b262605968 -- ceph fs dump --format=json 2024-05-08T05:24:34.233 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:24:34 smithi090 ceph-mon[34526]: pgmap v278: 1 pgs: 1 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-08T05:24:34.233 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:24:34 smithi090 ceph-mon[34526]: from='client.24406 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi087=a;smithi087=d;smithi087=g;smithi087=j;smithi090=b;smithi090=e;smithi090=h;smithi090=k;smithi160=c;smithi160=f;smithi160=i;smithi160=l", "target": ["mon-mgr", ""]}]: dispatch 2024-05-08T05:24:34.234 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:24:34 smithi090 ceph-mon[34526]: Saving service mds.all spec with placement smithi087=a;smithi087=d;smithi087=g;smithi087=j;smithi090=b;smithi090=e;smithi090=h;smithi090=k;smithi160=c;smithi160=f;smithi160=i;smithi160=l;count:12 2024-05-08T05:24:34.234 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:24:34 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:24:34.234 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:24:34 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T05:24:34.538 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:24:34 smithi160 ceph-mon[34827]: pgmap v278: 1 pgs: 1 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-08T05:24:34.539 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:24:34 smithi160 ceph-mon[34827]: from='client.24406 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi087=a;smithi087=d;smithi087=g;smithi087=j;smithi090=b;smithi090=e;smithi090=h;smithi090=k;smithi160=c;smithi160=f;smithi160=i;smithi160=l", "target": ["mon-mgr", ""]}]: dispatch 2024-05-08T05:24:34.539 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:24:34 smithi160 ceph-mon[34827]: Saving service mds.all spec with placement smithi087=a;smithi087=d;smithi087=g;smithi087=j;smithi090=b;smithi090=e;smithi090=h;smithi090=k;smithi160=c;smithi160=f;smithi160=i;smithi160=l;count:12 2024-05-08T05:24:34.539 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:24:34 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:24:34.539 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:24:34 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T05:24:34.650 INFO:teuthology.orchestra.run.smithi087.stderr:Inferring config /var/lib/ceph/eeeb813e-0cf9-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T05:24:35.289 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:24:35 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T05:24:35.289 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:24:35 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T05:24:35.289 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:24:35 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:24:35.289 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:24:35 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-08T05:24:35.289 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:24:35 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-08T05:24:35.289 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:24:35 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T05:24:35.289 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:24:35 smithi160 ceph-mon[34827]: Deploying daemon mds.l on smithi160 2024-05-08T05:24:35.459 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:24:35 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T05:24:35.459 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:24:35 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T05:24:35.459 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:24:35 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:24:35.459 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:24:35 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-08T05:24:35.459 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:24:35 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-08T05:24:35.459 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:24:35 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T05:24:35.460 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:24:35 smithi087 ceph-mon[29523]: Deploying daemon mds.l on smithi160 2024-05-08T05:24:35.483 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:24:35 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T05:24:35.484 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:24:35 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T05:24:35.484 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:24:35 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:24:35.484 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:24:35 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-08T05:24:35.484 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:24:35 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-08T05:24:35.484 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:24:35 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T05:24:35.484 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:24:35 smithi090 ceph-mon[34526]: Deploying daemon mds.l on smithi160 2024-05-08T05:24:36.539 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:24:36 smithi160 ceph-mon[34827]: pgmap v279: 1 pgs: 1 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-08T05:24:36.649 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:24:36 smithi087 ceph-mon[29523]: pgmap v279: 1 pgs: 1 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-08T05:24:36.733 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:24:36 smithi090 ceph-mon[34526]: pgmap v279: 1 pgs: 1 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-08T05:24:36.909 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:24:36.908+0000 7f640c800700 1 -- 172.21.15.87:0/1793129741 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6404102530 msgr2=0x7f6404112220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:24:36.909 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:24:36.908+0000 7f640c800700 1 --2- 172.21.15.87:0/1793129741 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6404102530 0x7f6404112220 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f6400009f90 tx=0x7f640000b330 comp rx=0 tx=0).stop 2024-05-08T05:24:36.909 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:24:36.908+0000 7f640c800700 1 -- 172.21.15.87:0/1793129741 shutdown_connections 2024-05-08T05:24:36.909 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:24:36.908+0000 7f640c800700 1 --2- 172.21.15.87:0/1793129741 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6404102530 0x7f6404112220 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:24:36.909 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:24:36.908+0000 7f640c800700 1 --2- 172.21.15.87:0/1793129741 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f64041043b0 0x7f6404104790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:24:36.910 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:24:36.908+0000 7f640c800700 1 --2- 172.21.15.87:0/1793129741 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6404101a90 0x7f6404101f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:24:36.910 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:24:36.908+0000 7f640c800700 1 -- 172.21.15.87:0/1793129741 >> 172.21.15.87:0/1793129741 conn(0x7f6404078a10 msgr2=0x7f64040ffdc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:24:36.910 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:24:36.908+0000 7f640c800700 1 -- 172.21.15.87:0/1793129741 shutdown_connections 2024-05-08T05:24:36.910 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:24:36.908+0000 7f640c800700 1 -- 172.21.15.87:0/1793129741 wait complete. 2024-05-08T05:24:36.910 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:24:36.910+0000 7f640c800700 1 Processor -- start 2024-05-08T05:24:36.911 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:24:36.910+0000 7f640c800700 1 -- start start 2024-05-08T05:24:36.911 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:24:36.910+0000 7f640c800700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6404101a90 0x7f640419bd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:24:36.911 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:24:36.910+0000 7f640c800700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6404102530 0x7f640419c2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:24:36.911 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:24:36.910+0000 7f640c800700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f64041043b0 0x7f64041a0630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:24:36.911 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:24:36.910+0000 7f640c800700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f64041158b0 con 0x7f6404102530 2024-05-08T05:24:36.911 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:24:36.910+0000 7f640c800700 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f6404115730 con 0x7f6404101a90 2024-05-08T05:24:36.911 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:24:36.910+0000 7f640c800700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f6404115a30 con 0x7f64041043b0 2024-05-08T05:24:36.912 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:24:36.911+0000 7f6409400700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6404102530 0x7f640419c2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:24:36.912 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:24:36.911+0000 7f6409e00700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6404101a90 0x7f640419bd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:24:36.913 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:24:36.911+0000 7f6409400700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6404102530 0x7f640419c2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:60120/0 (socket says 172.21.15.87:60120) 2024-05-08T05:24:36.913 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:24:36.911+0000 7f6409400700 1 -- 172.21.15.87:0/2999098846 learned_addr learned my addr 172.21.15.87:0/2999098846 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T05:24:36.913 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:24:36.911+0000 7f640a800700 1 --2- 172.21.15.87:0/2999098846 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f64041043b0 0x7f64041a0630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:24:36.913 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:24:36.911+0000 7f6409e00700 1 -- 172.21.15.87:0/2999098846 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f64041043b0 msgr2=0x7f64041a0630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:24:36.913 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:24:36.911+0000 7f6409e00700 1 --2- 172.21.15.87:0/2999098846 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f64041043b0 0x7f64041a0630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:24:36.913 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:24:36.911+0000 7f6409e00700 1 -- 172.21.15.87:0/2999098846 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6404102530 msgr2=0x7f640419c2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:24:36.913 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:24:36.911+0000 7f6409e00700 1 --2- 172.21.15.87:0/2999098846 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6404102530 0x7f640419c2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:24:36.913 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:24:36.911+0000 7f6409e00700 1 -- 172.21.15.87:0/2999098846 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f64041a0d70 con 0x7f6404101a90 2024-05-08T05:24:36.913 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:24:36.911+0000 7f6409400700 1 --2- 172.21.15.87:0/2999098846 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6404102530 0x7f640419c2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T05:24:36.913 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:24:36.911+0000 7f640a800700 1 --2- 172.21.15.87:0/2999098846 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f64041043b0 0x7f64041a0630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T05:24:36.913 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:24:36.911+0000 7f6409e00700 1 --2- 172.21.15.87:0/2999098846 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6404101a90 0x7f640419bd60 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f63f800e9c0 tx=0x7f63f800ecd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:24:36.913 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:24:36.912+0000 7f63fea00700 1 -- 172.21.15.87:0/2999098846 <== mon.2 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63f8004220 con 0x7f6404101a90 2024-05-08T05:24:36.913 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:24:36.912+0000 7f63fea00700 1 -- 172.21.15.87:0/2999098846 <== mon.2 v2:172.21.15.90:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f63f80043c0 con 0x7f6404101a90 2024-05-08T05:24:36.913 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:24:36.912+0000 7f63fea00700 1 -- 172.21.15.87:0/2999098846 <== mon.2 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63f800cda0 con 0x7f6404101a90 2024-05-08T05:24:36.914 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:24:36.912+0000 7f640c800700 1 -- 172.21.15.87:0/2999098846 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f64041a1060 con 0x7f6404101a90 2024-05-08T05:24:36.914 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:24:36.912+0000 7f640c800700 1 -- 172.21.15.87:0/2999098846 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f64041a88e0 con 0x7f6404101a90 2024-05-08T05:24:36.914 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:24:36.913+0000 7f640c800700 1 -- 172.21.15.87:0/2999098846 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f640406a190 con 0x7f6404101a90 2024-05-08T05:24:36.915 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:24:36.915+0000 7f63fea00700 1 -- 172.21.15.87:0/2999098846 <== mon.2 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 16) ==== 149652+0+0 (secure 0 0 0) 0x7f63f8004750 con 0x7f6404101a90 2024-05-08T05:24:36.917 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:24:36.916+0000 7f63fea00700 1 --2- 172.21.15.87:0/2999098846 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f63ec0b2900 0x7f63ec0b4dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:24:36.917 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:24:36.917+0000 7f63fea00700 1 -- 172.21.15.87:0/2999098846 <== mon.2 v2:172.21.15.90:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 7127+0+0 (secure 0 0 0) 0x7f63f80e1b40 con 0x7f6404101a90 2024-05-08T05:24:36.917 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:24:36.917+0000 7f6409400700 1 --2- 172.21.15.87:0/2999098846 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f63ec0b2900 0x7f63ec0b4dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:24:36.917 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:24:36.917+0000 7f6409400700 1 --2- 172.21.15.87:0/2999098846 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f63ec0b2900 0x7f63ec0b4dc0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f6404101060 tx=0x7f63f4009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:24:36.919 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:24:36.919+0000 7f63fea00700 1 -- 172.21.15.87:0/2999098846 <== mon.2 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f63f80a9c60 con 0x7f6404101a90 2024-05-08T05:24:37.203 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:24:37.202+0000 7f640c800700 1 -- 172.21.15.87:0/2999098846 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f640419d0c0 con 0x7f6404101a90 2024-05-08T05:24:37.204 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:24:37.203+0000 7f63fea00700 1 -- 172.21.15.87:0/2999098846 <== mon.2 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 2 v2) ==== 93+0+1396 (secure 0 0 0) 0x7f63f80a9560 con 0x7f6404101a90 2024-05-08T05:24:37.204 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-05-08T05:24:37.204 INFO:teuthology.orchestra.run.smithi087.stdout:{"epoch":2,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24412,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6833/3339455985","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6832","nonce":3339455985},{"type":"v1","addr":"172.21.15.160:6833","nonce":3339455985}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[]} 2024-05-08T05:24:37.207 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:24:37.206+0000 7f640c800700 1 -- 172.21.15.87:0/2999098846 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f63ec0b2900 msgr2=0x7f63ec0b4dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:24:37.207 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:24:37.206+0000 7f640c800700 1 --2- 172.21.15.87:0/2999098846 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f63ec0b2900 0x7f63ec0b4dc0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f6404101060 tx=0x7f63f4009260 comp rx=0 tx=0).stop 2024-05-08T05:24:37.207 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:24:37.206+0000 7f640c800700 1 -- 172.21.15.87:0/2999098846 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6404101a90 msgr2=0x7f640419bd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:24:37.207 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:24:37.206+0000 7f640c800700 1 --2- 172.21.15.87:0/2999098846 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6404101a90 0x7f640419bd60 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f63f800e9c0 tx=0x7f63f800ecd0 comp rx=0 tx=0).stop 2024-05-08T05:24:37.208 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:24:37.206+0000 7f640c800700 1 -- 172.21.15.87:0/2999098846 shutdown_connections 2024-05-08T05:24:37.208 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:24:37.207+0000 7f640c800700 1 --2- 172.21.15.87:0/2999098846 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f63ec0b2900 0x7f63ec0b4dc0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:24:37.208 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:24:37.207+0000 7f640c800700 1 --2- 172.21.15.87:0/2999098846 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f64041043b0 0x7f64041a0630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:24:37.208 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:24:37.207+0000 7f640c800700 1 --2- 172.21.15.87:0/2999098846 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6404101a90 0x7f640419bd60 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:24:37.208 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:24:37.207+0000 7f640c800700 1 --2- 172.21.15.87:0/2999098846 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6404102530 0x7f640419c2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:24:37.208 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:24:37.207+0000 7f640c800700 1 -- 172.21.15.87:0/2999098846 >> 172.21.15.87:0/2999098846 conn(0x7f6404078a10 msgr2=0x7f64040ff1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:24:37.208 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:24:37.207+0000 7f640c800700 1 -- 172.21.15.87:0/2999098846 shutdown_connections 2024-05-08T05:24:37.208 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:24:37.207+0000 7f640c800700 1 -- 172.21.15.87:0/2999098846 wait complete. 2024-05-08T05:24:37.209 INFO:teuthology.orchestra.run.smithi087.stderr:dumped fsmap epoch 2 2024-05-08T05:24:37.291 INFO:journalctl@ceph.mds.l.smithi160.stdout:May 08 05:24:36 smithi160 systemd[1]: Started Ceph mds.l for eeeb813e-0cf9-11ef-bc97-c7b262605968. 2024-05-08T05:24:37.983 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:24:37 smithi090 ceph-mon[34526]: pgmap v280: 1 pgs: 1 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-08T05:24:37.983 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:24:37 smithi090 ceph-mon[34526]: mds.? [v2:172.21.15.160:6832/3339455985,v1:172.21.15.160:6833/3339455985] up:boot 2024-05-08T05:24:37.983 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:24:37 smithi090 ceph-mon[34526]: fsmap 1 up:standby 2024-05-08T05:24:37.983 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:24:37 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-05-08T05:24:37.983 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:24:37 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:24:37.983 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:24:37 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:24:37.984 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:24:37 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:24:37.984 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:24:37 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-08T05:24:37.984 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:24:37 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-08T05:24:37.984 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:24:37 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T05:24:37.984 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:24:37 smithi090 ceph-mon[34526]: Deploying daemon mds.k on smithi090 2024-05-08T05:24:37.984 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:24:37 smithi090 ceph-mon[34526]: from='client.? 172.21.15.87:0/2999098846' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T05:24:38.209 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:24:37 smithi087 ceph-mon[29523]: pgmap v280: 1 pgs: 1 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-08T05:24:38.209 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:24:37 smithi087 ceph-mon[29523]: mds.? [v2:172.21.15.160:6832/3339455985,v1:172.21.15.160:6833/3339455985] up:boot 2024-05-08T05:24:38.209 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:24:37 smithi087 ceph-mon[29523]: fsmap 1 up:standby 2024-05-08T05:24:38.209 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:24:37 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-05-08T05:24:38.209 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:24:37 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:24:38.209 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:24:37 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:24:38.209 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:24:37 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:24:38.209 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:24:37 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-08T05:24:38.209 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:24:37 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-08T05:24:38.209 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:24:37 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T05:24:38.210 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:24:37 smithi087 ceph-mon[29523]: Deploying daemon mds.k on smithi090 2024-05-08T05:24:38.210 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:24:37 smithi087 ceph-mon[29523]: from='client.? 172.21.15.87:0/2999098846' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T05:24:38.289 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:24:37 smithi160 ceph-mon[34827]: pgmap v280: 1 pgs: 1 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-08T05:24:38.289 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:24:37 smithi160 ceph-mon[34827]: mds.? [v2:172.21.15.160:6832/3339455985,v1:172.21.15.160:6833/3339455985] up:boot 2024-05-08T05:24:38.289 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:24:37 smithi160 ceph-mon[34827]: fsmap 1 up:standby 2024-05-08T05:24:38.289 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:24:37 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-05-08T05:24:38.289 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:24:37 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:24:38.289 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:24:37 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:24:38.289 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:24:37 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:24:38.289 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:24:37 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-08T05:24:38.289 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:24:37 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-08T05:24:38.289 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:24:37 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T05:24:38.289 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:24:37 smithi160 ceph-mon[34827]: Deploying daemon mds.k on smithi090 2024-05-08T05:24:38.290 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:24:37 smithi160 ceph-mon[34827]: from='client.? 172.21.15.87:0/2999098846' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T05:24:39.484 INFO:journalctl@ceph.mds.k.smithi090.stdout:May 08 05:24:39 smithi090 systemd[1]: Starting Ceph mds.k for eeeb813e-0cf9-11ef-bc97-c7b262605968... 2024-05-08T05:24:39.836 INFO:journalctl@ceph.mds.k.smithi090.stdout:May 08 05:24:39 smithi090 podman[64007]: 2024-05-08 05:24:39.48454552 +0000 UTC m=+0.018002470 image pull 352576a2df49fbab3aeeba1effbcb7a94815e8fc1f120a55ddc340b4ee63b8ce quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c 2024-05-08T05:24:39.837 INFO:journalctl@ceph.mds.k.smithi090.stdout:May 08 05:24:39 smithi090 podman[64007]: 2024-05-08 05:24:39.600575308 +0000 UTC m=+0.134032252 container create b0b0b09be1f62859c0ceff8af70608fe46e48ccc8a909f7d71d451b373e85eb1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c, name=ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-mds-k, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, ceph=True, RELEASE=wip-57676-3-bee299f, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240507, CEPH_POINT_RELEASE=) 2024-05-08T05:24:39.837 INFO:journalctl@ceph.mds.k.smithi090.stdout:May 08 05:24:39 smithi090 podman[64007]: 2024-05-08 05:24:39.83688813 +0000 UTC m=+0.370345072 container init b0b0b09be1f62859c0ceff8af70608fe46e48ccc8a909f7d71d451b373e85eb1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c, name=ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-mds-k, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, io.buildah.version=1.33.5, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.build-date=20240507, RELEASE=wip-57676-3-bee299f, ceph=True) 2024-05-08T05:24:40.007 DEBUG:teuthology.orchestra.run.smithi087:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid eeeb813e-0cf9-11ef-bc97-c7b262605968 -- ceph fs dump --format=json 2024-05-08T05:24:40.208 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:24:39 smithi087 ceph-mon[29523]: pgmap v281: 1 pgs: 1 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-08T05:24:40.233 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:24:39 smithi090 ceph-mon[34526]: pgmap v281: 1 pgs: 1 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-08T05:24:40.234 INFO:journalctl@ceph.mds.k.smithi090.stdout:May 08 05:24:39 smithi090 podman[64007]: 2024-05-08 05:24:39.839644303 +0000 UTC m=+0.373101245 container start b0b0b09be1f62859c0ceff8af70608fe46e48ccc8a909f7d71d451b373e85eb1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c, name=ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-mds-k, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, RELEASE=wip-57676-3-bee299f, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.build-date=20240507, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, GIT_CLEAN=True, org.label-schema.license=GPLv2) 2024-05-08T05:24:40.234 INFO:journalctl@ceph.mds.k.smithi090.stdout:May 08 05:24:39 smithi090 ceph-mds[64026]: -- 172.21.15.90:0/2389613715 <== mon.2 v2:172.21.15.90:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x555c5cb1fa40 con 0x555c5caf2c00 2024-05-08T05:24:40.234 INFO:journalctl@ceph.mds.k.smithi090.stdout:May 08 05:24:39 smithi090 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-mds-k[64022]: starting mds.k at 2024-05-08T05:24:40.234 INFO:journalctl@ceph.mds.k.smithi090.stdout:May 08 05:24:39 smithi090 bash[64007]: b0b0b09be1f62859c0ceff8af70608fe46e48ccc8a909f7d71d451b373e85eb1 2024-05-08T05:24:40.234 INFO:journalctl@ceph.mds.k.smithi090.stdout:May 08 05:24:39 smithi090 systemd[1]: Started Ceph mds.k for eeeb813e-0cf9-11ef-bc97-c7b262605968. 2024-05-08T05:24:40.289 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:24:39 smithi160 ceph-mon[34827]: pgmap v281: 1 pgs: 1 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-08T05:24:40.451 INFO:teuthology.orchestra.run.smithi087.stderr:Inferring config /var/lib/ceph/eeeb813e-0cf9-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T05:24:41.209 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:24:40 smithi087 ceph-mon[29523]: mds.? [v2:172.21.15.90:6832/3292166873,v1:172.21.15.90:6833/3292166873] up:boot 2024-05-08T05:24:41.209 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:24:40 smithi087 ceph-mon[29523]: fsmap 2 up:standby 2024-05-08T05:24:41.209 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:24:40 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-05-08T05:24:41.209 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:24:40 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:24:41.209 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:24:40 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:24:41.210 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:24:40 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:24:41.210 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:24:40 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-08T05:24:41.210 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:24:40 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-08T05:24:41.210 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:24:40 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T05:24:41.210 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:24:40 smithi087 ceph-mon[29523]: Deploying daemon mds.j on smithi087 2024-05-08T05:24:41.233 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:24:40 smithi090 ceph-mon[34526]: mds.? [v2:172.21.15.90:6832/3292166873,v1:172.21.15.90:6833/3292166873] up:boot 2024-05-08T05:24:41.233 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:24:40 smithi090 ceph-mon[34526]: fsmap 2 up:standby 2024-05-08T05:24:41.233 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:24:40 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-05-08T05:24:41.233 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:24:40 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:24:41.234 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:24:40 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:24:41.234 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:24:40 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:24:41.234 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:24:40 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-08T05:24:41.234 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:24:40 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-08T05:24:41.234 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:24:40 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T05:24:41.234 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:24:40 smithi090 ceph-mon[34526]: Deploying daemon mds.j on smithi087 2024-05-08T05:24:41.289 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:24:40 smithi160 ceph-mon[34827]: mds.? [v2:172.21.15.90:6832/3292166873,v1:172.21.15.90:6833/3292166873] up:boot 2024-05-08T05:24:41.289 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:24:40 smithi160 ceph-mon[34827]: fsmap 2 up:standby 2024-05-08T05:24:41.289 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:24:40 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-05-08T05:24:41.289 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:24:40 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:24:41.289 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:24:40 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:24:41.289 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:24:40 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:24:41.289 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:24:40 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-08T05:24:41.289 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:24:40 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-08T05:24:41.289 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:24:40 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T05:24:41.289 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:24:40 smithi160 ceph-mon[34827]: Deploying daemon mds.j on smithi087 2024-05-08T05:24:42.258 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:24:42 smithi090 ceph-mon[34526]: pgmap v282: 1 pgs: 1 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-08T05:24:42.300 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:24:42 smithi087 ceph-mon[29523]: pgmap v282: 1 pgs: 1 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-08T05:24:42.538 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:24:42 smithi160 ceph-mon[34827]: pgmap v282: 1 pgs: 1 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-08T05:24:43.128 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:24:42.858+0000 7f2201600700 1 -- 172.21.15.87:0/4005841441 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f21fc0758d0 msgr2=0x7f21fc075cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:24:43.128 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:24:42.858+0000 7f2201600700 1 --2- 172.21.15.87:0/4005841441 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f21fc0758d0 0x7f21fc075cb0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f21ec00b0a0 tx=0x7f21ec00b3b0 comp rx=0 tx=0).stop 2024-05-08T05:24:43.128 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:24:42.858+0000 7f2201600700 1 -- 172.21.15.87:0/4005841441 shutdown_connections 2024-05-08T05:24:43.128 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:24:42.858+0000 7f2201600700 1 --2- 172.21.15.87:0/4005841441 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f21fc10fc10 0x7f21fc112080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:24:43.128 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:24:42.858+0000 7f2201600700 1 --2- 172.21.15.87:0/4005841441 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f21fc0758d0 0x7f21fc075cb0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:24:43.128 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:24:42.858+0000 7f2201600700 1 --2- 172.21.15.87:0/4005841441 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f21fc0761f0 0x7f21fc10f6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:24:43.128 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:24:42.858+0000 7f2201600700 1 -- 172.21.15.87:0/4005841441 >> 172.21.15.87:0/4005841441 conn(0x7f21fc0fef20 msgr2=0x7f21fc101340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:24:43.128 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:24:42.858+0000 7f2201600700 1 -- 172.21.15.87:0/4005841441 shutdown_connections 2024-05-08T05:24:43.129 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:24:42.859+0000 7f2201600700 1 -- 172.21.15.87:0/4005841441 wait complete. 2024-05-08T05:24:43.129 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:24:42.860+0000 7f2201600700 1 Processor -- start 2024-05-08T05:24:43.129 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:24:42.860+0000 7f2201600700 1 -- start start 2024-05-08T05:24:43.129 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:24:42.860+0000 7f2201600700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f21fc0758d0 0x7f21fc1a1a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:24:43.129 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:24:42.860+0000 7f2201600700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f21fc0761f0 0x7f21fc1a1f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:24:43.129 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:24:42.860+0000 7f2201600700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f21fc10fc10 0x7f21fc19bb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:24:43.129 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:24:42.860+0000 7f2201600700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f21fc1157f0 con 0x7f21fc10fc10 2024-05-08T05:24:43.129 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:24:42.860+0000 7f2201600700 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f21fc115670 con 0x7f21fc0758d0 2024-05-08T05:24:43.129 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:24:42.860+0000 7f2201600700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f21fc115970 con 0x7f21fc0761f0 2024-05-08T05:24:43.129 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:24:42.861+0000 7f21fbe00700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f21fc0758d0 0x7f21fc1a1a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:24:43.129 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:24:42.861+0000 7f21fbe00700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f21fc0758d0 0x7f21fc1a1a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.87:58256/0 (socket says 172.21.15.87:58256) 2024-05-08T05:24:43.129 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:24:42.861+0000 7f21fbe00700 1 -- 172.21.15.87:0/810380116 learned_addr learned my addr 172.21.15.87:0/810380116 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T05:24:43.129 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:24:42.861+0000 7f2200c00700 1 --2- 172.21.15.87:0/810380116 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f21fc10fc10 0x7f21fc19bb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:24:43.129 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:24:42.861+0000 7f21f3400700 1 --2- 172.21.15.87:0/810380116 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f21fc0761f0 0x7f21fc1a1f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:24:43.130 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:24:42.861+0000 7f21fbe00700 1 -- 172.21.15.87:0/810380116 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f21fc0761f0 msgr2=0x7f21fc1a1f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:24:43.130 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:24:42.861+0000 7f21fbe00700 1 --2- 172.21.15.87:0/810380116 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f21fc0761f0 0x7f21fc1a1f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:24:43.130 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:24:42.861+0000 7f21fbe00700 1 -- 172.21.15.87:0/810380116 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f21fc10fc10 msgr2=0x7f21fc19bb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:24:43.130 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:24:42.861+0000 7f21fbe00700 1 --2- 172.21.15.87:0/810380116 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f21fc10fc10 0x7f21fc19bb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:24:43.130 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:24:42.861+0000 7f21fbe00700 1 -- 172.21.15.87:0/810380116 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f21fc19c3f0 con 0x7f21fc0758d0 2024-05-08T05:24:43.130 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:24:42.861+0000 7f2200c00700 1 --2- 172.21.15.87:0/810380116 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f21fc10fc10 0x7f21fc19bb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T05:24:43.130 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:24:42.861+0000 7f21f3400700 1 --2- 172.21.15.87:0/810380116 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f21fc0761f0 0x7f21fc1a1f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T05:24:43.130 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:24:42.861+0000 7f21fbe00700 1 --2- 172.21.15.87:0/810380116 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f21fc0758d0 0x7f21fc1a1a40 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f21ec00d010 tx=0x7f21ec004db0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:24:43.130 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:24:42.861+0000 7f21f9600700 1 -- 172.21.15.87:0/810380116 <== mon.2 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21ec021070 con 0x7f21fc0758d0 2024-05-08T05:24:43.130 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:24:42.862+0000 7f21f9600700 1 -- 172.21.15.87:0/810380116 <== mon.2 v2:172.21.15.90:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f21ec007cc0 con 0x7f21fc0758d0 2024-05-08T05:24:43.130 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:24:42.862+0000 7f2201600700 1 -- 172.21.15.87:0/810380116 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f21fc19c680 con 0x7f21fc0758d0 2024-05-08T05:24:43.130 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:24:42.862+0000 7f21f9600700 1 -- 172.21.15.87:0/810380116 <== mon.2 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21ec0047b0 con 0x7f21fc0758d0 2024-05-08T05:24:43.130 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:24:42.862+0000 7f2201600700 1 -- 172.21.15.87:0/810380116 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f21fc1a89c0 con 0x7f21fc0758d0 2024-05-08T05:24:43.130 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:24:42.863+0000 7f2201600700 1 -- 172.21.15.87:0/810380116 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f21fc19c9f0 con 0x7f21fc0758d0 2024-05-08T05:24:43.131 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:24:42.865+0000 7f21f9600700 1 -- 172.21.15.87:0/810380116 <== mon.2 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 16) ==== 149652+0+0 (secure 0 0 0) 0x7f21ec003a00 con 0x7f21fc0758d0 2024-05-08T05:24:43.131 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:24:42.867+0000 7f21f9600700 1 --2- 172.21.15.87:0/810380116 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f21e00b2880 0x7f21e00b4d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:24:43.131 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:24:42.867+0000 7f21f9600700 1 -- 172.21.15.87:0/810380116 <== mon.2 v2:172.21.15.90:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 7127+0+0 (secure 0 0 0) 0x7f21ec00f020 con 0x7f21fc0758d0 2024-05-08T05:24:43.131 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:24:42.867+0000 7f21f3400700 1 --2- 172.21.15.87:0/810380116 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f21e00b2880 0x7f21e00b4d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:24:43.131 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:24:42.867+0000 7f21f3400700 1 --2- 172.21.15.87:0/810380116 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f21e00b2880 0x7f21e00b4d40 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f21fc19d260 tx=0x7f21e4009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:24:43.131 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:24:42.868+0000 7f21f9600700 1 -- 172.21.15.87:0/810380116 <== mon.2 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f21fc19c9f0 con 0x7f21fc0758d0 2024-05-08T05:24:43.159 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:24:43.158+0000 7f2201600700 1 -- 172.21.15.87:0/810380116 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f21fc06a190 con 0x7f21fc0758d0 2024-05-08T05:24:43.159 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:24:43.159+0000 7f21f9600700 1 -- 172.21.15.87:0/810380116 <== mon.2 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) ==== 93+0+2221 (secure 0 0 0) 0x7f21ec02a020 con 0x7f21fc0758d0 2024-05-08T05:24:43.160 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-05-08T05:24:43.160 INFO:teuthology.orchestra.run.smithi087.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24412,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6833/3339455985","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6832","nonce":3339455985},{"type":"v1","addr":"172.21.15.160:6833","nonce":3339455985}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24413,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6833/3292166873","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6832","nonce":3292166873},{"type":"v1","addr":"172.21.15.90:6833","nonce":3292166873}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[]} 2024-05-08T05:24:43.163 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:24:43.162+0000 7f2201600700 1 -- 172.21.15.87:0/810380116 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f21e00b2880 msgr2=0x7f21e00b4d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:24:43.163 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:24:43.162+0000 7f2201600700 1 --2- 172.21.15.87:0/810380116 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f21e00b2880 0x7f21e00b4d40 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f21fc19d260 tx=0x7f21e4009260 comp rx=0 tx=0).stop 2024-05-08T05:24:43.163 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:24:43.162+0000 7f2201600700 1 -- 172.21.15.87:0/810380116 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f21fc0758d0 msgr2=0x7f21fc1a1a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:24:43.163 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:24:43.162+0000 7f2201600700 1 --2- 172.21.15.87:0/810380116 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f21fc0758d0 0x7f21fc1a1a40 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f21ec00d010 tx=0x7f21ec004db0 comp rx=0 tx=0).stop 2024-05-08T05:24:43.163 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:24:43.162+0000 7f2201600700 1 -- 172.21.15.87:0/810380116 shutdown_connections 2024-05-08T05:24:43.163 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:24:43.162+0000 7f2201600700 1 --2- 172.21.15.87:0/810380116 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f21fc10fc10 0x7f21fc19bb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:24:43.163 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:24:43.162+0000 7f2201600700 1 --2- 172.21.15.87:0/810380116 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f21fc0758d0 0x7f21fc1a1a40 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:24:43.163 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:24:43.162+0000 7f2201600700 1 --2- 172.21.15.87:0/810380116 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f21e00b2880 0x7f21e00b4d40 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:24:43.163 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:24:43.162+0000 7f2201600700 1 --2- 172.21.15.87:0/810380116 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f21fc0761f0 0x7f21fc1a1f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:24:43.163 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:24:43.162+0000 7f2201600700 1 -- 172.21.15.87:0/810380116 >> 172.21.15.87:0/810380116 conn(0x7f21fc0fef20 msgr2=0x7f21fc0ffbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:24:43.163 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:24:43.162+0000 7f2201600700 1 -- 172.21.15.87:0/810380116 shutdown_connections 2024-05-08T05:24:43.164 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:24:43.163+0000 7f2201600700 1 -- 172.21.15.87:0/810380116 wait complete. 2024-05-08T05:24:43.164 INFO:teuthology.orchestra.run.smithi087.stderr:dumped fsmap epoch 3 2024-05-08T05:24:44.208 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:24:44 smithi087 ceph-mon[29523]: pgmap v283: 1 pgs: 1 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-08T05:24:44.208 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:24:44 smithi087 ceph-mon[29523]: from='client.? 172.21.15.87:0/810380116' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T05:24:44.483 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:24:44 smithi090 ceph-mon[34526]: pgmap v283: 1 pgs: 1 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-08T05:24:44.483 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:24:44 smithi090 ceph-mon[34526]: from='client.? 172.21.15.87:0/810380116' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T05:24:44.538 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:24:44 smithi160 ceph-mon[34827]: pgmap v283: 1 pgs: 1 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-08T05:24:44.538 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:24:44 smithi160 ceph-mon[34827]: from='client.? 172.21.15.87:0/810380116' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T05:24:45.415 INFO:journalctl@ceph.mds.j.smithi087.stdout:May 08 05:24:45 smithi087 systemd[1]: Starting Ceph mds.j for eeeb813e-0cf9-11ef-bc97-c7b262605968... 2024-05-08T05:24:45.690 INFO:journalctl@ceph.mds.j.smithi087.stdout:May 08 05:24:45 smithi087 podman[70217]: 2024-05-08 05:24:45.319199821 +0000 UTC m=+0.036492490 image pull 352576a2df49fbab3aeeba1effbcb7a94815e8fc1f120a55ddc340b4ee63b8ce quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c 2024-05-08T05:24:45.690 INFO:journalctl@ceph.mds.j.smithi087.stdout:May 08 05:24:45 smithi087 podman[70217]: 2024-05-08 05:24:45.418996499 +0000 UTC m=+0.136289198 container create aa3efd62a6a6b9dba8de6909b42c36edaaef77ffc5f0f72d563673645a266281 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c, name=ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-mds-j, org.label-schema.build-date=20240507, RELEASE=wip-57676-3-bee299f, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image) 2024-05-08T05:24:45.690 INFO:journalctl@ceph.mds.j.smithi087.stdout:May 08 05:24:45 smithi087 podman[70217]: 2024-05-08 05:24:45.689172189 +0000 UTC m=+0.406464895 container init aa3efd62a6a6b9dba8de6909b42c36edaaef77ffc5f0f72d563673645a266281 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c, name=ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-mds-j, GIT_CLEAN=True, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.build-date=20240507, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, ceph=True, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, RELEASE=wip-57676-3-bee299f, CEPH_POINT_RELEASE=) 2024-05-08T05:24:45.907 DEBUG:teuthology.orchestra.run.smithi087:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid eeeb813e-0cf9-11ef-bc97-c7b262605968 -- ceph fs dump --format=json 2024-05-08T05:24:45.958 INFO:journalctl@ceph.mds.j.smithi087.stdout:May 08 05:24:45 smithi087 podman[70217]: 2024-05-08 05:24:45.700147844 +0000 UTC m=+0.417440512 container start aa3efd62a6a6b9dba8de6909b42c36edaaef77ffc5f0f72d563673645a266281 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c, name=ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-mds-j, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240507, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, RELEASE=wip-57676-3-bee299f, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=) 2024-05-08T05:24:45.958 INFO:journalctl@ceph.mds.j.smithi087.stdout:May 08 05:24:45 smithi087 ceph-mds[70236]: -- 172.21.15.87:0/3007796613 <== mon.0 v2:172.21.15.87:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55e387c15a40 con 0x55e387be8800 2024-05-08T05:24:45.958 INFO:journalctl@ceph.mds.j.smithi087.stdout:May 08 05:24:45 smithi087 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-mds-j[70232]: starting mds.j at 2024-05-08T05:24:45.958 INFO:journalctl@ceph.mds.j.smithi087.stdout:May 08 05:24:45 smithi087 bash[70217]: aa3efd62a6a6b9dba8de6909b42c36edaaef77ffc5f0f72d563673645a266281 2024-05-08T05:24:45.959 INFO:journalctl@ceph.mds.j.smithi087.stdout:May 08 05:24:45 smithi087 systemd[1]: Started Ceph mds.j for eeeb813e-0cf9-11ef-bc97-c7b262605968. 2024-05-08T05:24:46.357 INFO:teuthology.orchestra.run.smithi087.stderr:Inferring config /var/lib/ceph/eeeb813e-0cf9-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T05:24:46.458 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:24:46 smithi087 ceph-mon[29523]: pgmap v284: 1 pgs: 1 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-08T05:24:46.458 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:24:46 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:24:46.458 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:24:46 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:24:46.458 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:24:46 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:24:46.458 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:24:46 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-08T05:24:46.458 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:24:46 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-08T05:24:46.459 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:24:46 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T05:24:46.485 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:24:46 smithi090 ceph-mon[34526]: pgmap v284: 1 pgs: 1 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-08T05:24:46.485 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:24:46 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:24:46.485 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:24:46 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:24:46.486 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:24:46 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:24:46.486 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:24:46 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-08T05:24:46.486 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:24:46 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-08T05:24:46.486 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:24:46 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T05:24:46.538 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:24:46 smithi160 ceph-mon[34827]: pgmap v284: 1 pgs: 1 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-08T05:24:46.538 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:24:46 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:24:46.539 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:24:46 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:24:46.539 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:24:46 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:24:46.539 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:24:46 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-08T05:24:46.539 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:24:46 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-08T05:24:46.539 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:24:46 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T05:24:47.348 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:24:47 smithi087 ceph-mon[29523]: Deploying daemon mds.d on smithi087 2024-05-08T05:24:47.348 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:24:47 smithi087 ceph-mon[29523]: mds.? [v2:172.21.15.87:6834/1183985321,v1:172.21.15.87:6835/1183985321] up:boot 2024-05-08T05:24:47.348 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:24:47 smithi087 ceph-mon[29523]: fsmap 3 up:standby 2024-05-08T05:24:47.348 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:24:47 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-05-08T05:24:47.483 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:24:47 smithi090 ceph-mon[34526]: Deploying daemon mds.d on smithi087 2024-05-08T05:24:47.484 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:24:47 smithi090 ceph-mon[34526]: mds.? [v2:172.21.15.87:6834/1183985321,v1:172.21.15.87:6835/1183985321] up:boot 2024-05-08T05:24:47.484 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:24:47 smithi090 ceph-mon[34526]: fsmap 3 up:standby 2024-05-08T05:24:47.484 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:24:47 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-05-08T05:24:47.538 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:24:47 smithi160 ceph-mon[34827]: Deploying daemon mds.d on smithi087 2024-05-08T05:24:47.539 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:24:47 smithi160 ceph-mon[34827]: mds.? [v2:172.21.15.87:6834/1183985321,v1:172.21.15.87:6835/1183985321] up:boot 2024-05-08T05:24:47.539 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:24:47 smithi160 ceph-mon[34827]: fsmap 3 up:standby 2024-05-08T05:24:47.539 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:24:47 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-05-08T05:24:48.148 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:24:48 smithi087 ceph-mon[29523]: pgmap v285: 1 pgs: 1 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-08T05:24:48.483 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:24:48 smithi090 ceph-mon[34526]: pgmap v285: 1 pgs: 1 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-08T05:24:48.538 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:24:48 smithi160 ceph-mon[34827]: pgmap v285: 1 pgs: 1 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-08T05:24:48.678 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:24:48.677+0000 7f4f6b400700 1 -- 172.21.15.87:0/4162996474 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4f6410b6c0 msgr2=0x7f4f6410baa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:24:48.679 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:24:48.677+0000 7f4f6b400700 1 --2- 172.21.15.87:0/4162996474 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4f6410b6c0 0x7f4f6410baa0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f4f58009990 tx=0x7f4f58009ca0 comp rx=0 tx=0).stop 2024-05-08T05:24:48.679 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:24:48.678+0000 7f4f6b400700 1 -- 172.21.15.87:0/4162996474 shutdown_connections 2024-05-08T05:24:48.679 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:24:48.678+0000 7f4f6b400700 1 --2- 172.21.15.87:0/4162996474 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4f64106080 0x7f4f64112590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:24:48.679 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:24:48.678+0000 7f4f6b400700 1 --2- 172.21.15.87:0/4162996474 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4f6410b6c0 0x7f4f6410baa0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:24:48.679 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:24:48.678+0000 7f4f6b400700 1 --2- 172.21.15.87:0/4162996474 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4f641056c0 0x7f4f64105b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:24:48.679 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:24:48.678+0000 7f4f6b400700 1 -- 172.21.15.87:0/4162996474 >> 172.21.15.87:0/4162996474 conn(0x7f4f641011b0 msgr2=0x7f4f641035d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:24:48.679 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:24:48.678+0000 7f4f6b400700 1 -- 172.21.15.87:0/4162996474 shutdown_connections 2024-05-08T05:24:48.679 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:24:48.678+0000 7f4f6b400700 1 -- 172.21.15.87:0/4162996474 wait complete. 2024-05-08T05:24:48.680 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:24:48.680+0000 7f4f6b400700 1 Processor -- start 2024-05-08T05:24:48.680 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:24:48.680+0000 7f4f6b400700 1 -- start start 2024-05-08T05:24:48.682 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:24:48.680+0000 7f4f6b400700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4f641056c0 0x7f4f6419bd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:24:48.682 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:24:48.680+0000 7f4f6b400700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4f64106080 0x7f4f6419c2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:24:48.682 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:24:48.680+0000 7f4f6b400700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4f6410b6c0 0x7f4f641a0660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:24:48.682 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:24:48.681+0000 7f4f6b400700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f4f64115900 con 0x7f4f6410b6c0 2024-05-08T05:24:48.682 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:24:48.681+0000 7f4f6b400700 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f4f64115780 con 0x7f4f641056c0 2024-05-08T05:24:48.682 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:24:48.681+0000 7f4f6b400700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f4f64115a80 con 0x7f4f64106080 2024-05-08T05:24:48.682 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:24:48.681+0000 7f4f68a00700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4f641056c0 0x7f4f6419bd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:24:48.683 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:24:48.681+0000 7f4f68a00700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4f641056c0 0x7f4f6419bd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.87:43796/0 (socket says 172.21.15.87:43796) 2024-05-08T05:24:48.683 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:24:48.681+0000 7f4f68a00700 1 -- 172.21.15.87:0/23914333 learned_addr learned my addr 172.21.15.87:0/23914333 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T05:24:48.683 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:24:48.681+0000 7f4f69400700 1 --2- 172.21.15.87:0/23914333 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4f6410b6c0 0x7f4f641a0660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:24:48.683 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:24:48.681+0000 7f4f63e00700 1 --2- 172.21.15.87:0/23914333 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4f64106080 0x7f4f6419c2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:24:48.683 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:24:48.681+0000 7f4f68a00700 1 -- 172.21.15.87:0/23914333 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4f64106080 msgr2=0x7f4f6419c2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:24:48.683 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:24:48.681+0000 7f4f68a00700 1 --2- 172.21.15.87:0/23914333 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4f64106080 0x7f4f6419c2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:24:48.683 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:24:48.681+0000 7f4f68a00700 1 -- 172.21.15.87:0/23914333 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4f6410b6c0 msgr2=0x7f4f641a0660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:24:48.683 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:24:48.681+0000 7f4f68a00700 1 --2- 172.21.15.87:0/23914333 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4f6410b6c0 0x7f4f641a0660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:24:48.683 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:24:48.681+0000 7f4f68a00700 1 -- 172.21.15.87:0/23914333 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4f641a0da0 con 0x7f4f641056c0 2024-05-08T05:24:48.683 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:24:48.682+0000 7f4f68a00700 1 --2- 172.21.15.87:0/23914333 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4f641056c0 0x7f4f6419bd90 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f4f58005910 tx=0x7f4f5800b670 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:24:48.684 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:24:48.682+0000 7f4f61600700 1 -- 172.21.15.87:0/23914333 <== mon.2 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f58027070 con 0x7f4f641056c0 2024-05-08T05:24:48.684 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:24:48.682+0000 7f4f6b400700 1 -- 172.21.15.87:0/23914333 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4f641a1030 con 0x7f4f641056c0 2024-05-08T05:24:48.684 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:24:48.682+0000 7f4f6b400700 1 -- 172.21.15.87:0/23914333 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4f641a8910 con 0x7f4f641056c0 2024-05-08T05:24:48.684 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:24:48.682+0000 7f4f61600700 1 -- 172.21.15.87:0/23914333 <== mon.2 v2:172.21.15.90:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4f58022470 con 0x7f4f641056c0 2024-05-08T05:24:48.684 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:24:48.682+0000 7f4f61600700 1 -- 172.21.15.87:0/23914333 <== mon.2 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f58017650 con 0x7f4f641056c0 2024-05-08T05:24:48.684 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:24:48.683+0000 7f4f6b400700 1 -- 172.21.15.87:0/23914333 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4f6410dc50 con 0x7f4f641056c0 2024-05-08T05:24:48.686 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:24:48.685+0000 7f4f61600700 1 -- 172.21.15.87:0/23914333 <== mon.2 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 16) ==== 149652+0+0 (secure 0 0 0) 0x7f4f5802a070 con 0x7f4f641056c0 2024-05-08T05:24:48.687 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:24:48.687+0000 7f4f61600700 1 --2- 172.21.15.87:0/23914333 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f4f4c0b2880 0x7f4f4c0b4d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:24:48.687 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:24:48.687+0000 7f4f61600700 1 -- 172.21.15.87:0/23914333 <== mon.2 v2:172.21.15.90:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 7127+0+0 (secure 0 0 0) 0x7f4f580e2ca0 con 0x7f4f641056c0 2024-05-08T05:24:48.687 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:24:48.687+0000 7f4f63e00700 1 --2- 172.21.15.87:0/23914333 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f4f4c0b2880 0x7f4f4c0b4d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:24:48.688 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:24:48.688+0000 7f4f63e00700 1 --2- 172.21.15.87:0/23914333 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f4f4c0b2880 0x7f4f4c0b4d40 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f4f64103850 tx=0x7f4f50009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:24:48.689 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:24:48.689+0000 7f4f61600700 1 -- 172.21.15.87:0/23914333 <== mon.2 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f4f58013070 con 0x7f4f641056c0 2024-05-08T05:24:48.974 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:24:48.974+0000 7f4f6b400700 1 -- 172.21.15.87:0/23914333 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f4f6419d0f0 con 0x7f4f641056c0 2024-05-08T05:24:48.975 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:24:48.975+0000 7f4f61600700 1 -- 172.21.15.87:0/23914333 <== mon.2 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 4 v4) ==== 93+0+3046 (secure 0 0 0) 0x7f4f580aaee0 con 0x7f4f641056c0 2024-05-08T05:24:48.975 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-05-08T05:24:48.975 INFO:teuthology.orchestra.run.smithi087.stdout:{"epoch":4,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14358,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6835/1183985321","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6834","nonce":1183985321},{"type":"v1","addr":"172.21.15.87:6835","nonce":1183985321}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":24412,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6833/3339455985","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6832","nonce":3339455985},{"type":"v1","addr":"172.21.15.160:6833","nonce":3339455985}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24413,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6833/3292166873","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6832","nonce":3292166873},{"type":"v1","addr":"172.21.15.90:6833","nonce":3292166873}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[]} 2024-05-08T05:24:48.978 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:24:48.978+0000 7f4f6b400700 1 -- 172.21.15.87:0/23914333 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f4f4c0b2880 msgr2=0x7f4f4c0b4d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:24:48.979 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:24:48.978+0000 7f4f6b400700 1 --2- 172.21.15.87:0/23914333 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f4f4c0b2880 0x7f4f4c0b4d40 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f4f64103850 tx=0x7f4f50009260 comp rx=0 tx=0).stop 2024-05-08T05:24:48.979 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:24:48.978+0000 7f4f6b400700 1 -- 172.21.15.87:0/23914333 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4f641056c0 msgr2=0x7f4f6419bd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:24:48.979 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:24:48.978+0000 7f4f6b400700 1 --2- 172.21.15.87:0/23914333 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4f641056c0 0x7f4f6419bd90 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f4f58005910 tx=0x7f4f5800b670 comp rx=0 tx=0).stop 2024-05-08T05:24:48.979 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:24:48.978+0000 7f4f6b400700 1 -- 172.21.15.87:0/23914333 shutdown_connections 2024-05-08T05:24:48.979 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:24:48.978+0000 7f4f6b400700 1 --2- 172.21.15.87:0/23914333 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4f6410b6c0 0x7f4f641a0660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:24:48.979 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:24:48.978+0000 7f4f6b400700 1 --2- 172.21.15.87:0/23914333 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4f641056c0 0x7f4f6419bd90 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:24:48.979 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:24:48.978+0000 7f4f6b400700 1 --2- 172.21.15.87:0/23914333 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f4f4c0b2880 0x7f4f4c0b4d40 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:24:48.979 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:24:48.978+0000 7f4f6b400700 1 --2- 172.21.15.87:0/23914333 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4f64106080 0x7f4f6419c2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:24:48.979 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:24:48.978+0000 7f4f6b400700 1 -- 172.21.15.87:0/23914333 >> 172.21.15.87:0/23914333 conn(0x7f4f641011b0 msgr2=0x7f4f64101970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:24:48.979 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:24:48.978+0000 7f4f6b400700 1 -- 172.21.15.87:0/23914333 shutdown_connections 2024-05-08T05:24:48.979 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:24:48.978+0000 7f4f6b400700 1 -- 172.21.15.87:0/23914333 wait complete. 2024-05-08T05:24:48.980 INFO:teuthology.orchestra.run.smithi087.stderr:dumped fsmap epoch 4 2024-05-08T05:24:49.458 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:24:49 smithi087 ceph-mon[29523]: from='client.? 172.21.15.87:0/23914333' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T05:24:49.483 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:24:49 smithi090 ceph-mon[34526]: from='client.? 172.21.15.87:0/23914333' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T05:24:49.538 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:24:49 smithi160 ceph-mon[34827]: from='client.? 172.21.15.87:0/23914333' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T05:24:50.444 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:24:50 smithi087 ceph-mon[29523]: pgmap v286: 1 pgs: 1 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-08T05:24:50.483 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:24:50 smithi090 ceph-mon[34526]: pgmap v286: 1 pgs: 1 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-08T05:24:50.538 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:24:50 smithi160 ceph-mon[34827]: pgmap v286: 1 pgs: 1 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-08T05:24:50.708 INFO:journalctl@ceph.mds.d.smithi087.stdout:May 08 05:24:50 smithi087 systemd[1]: Starting Ceph mds.d for eeeb813e-0cf9-11ef-bc97-c7b262605968... 2024-05-08T05:24:51.208 INFO:journalctl@ceph.mds.d.smithi087.stdout:May 08 05:24:50 smithi087 podman[70679]: 2024-05-08 05:24:50.748555071 +0000 UTC m=+0.032407867 image pull 352576a2df49fbab3aeeba1effbcb7a94815e8fc1f120a55ddc340b4ee63b8ce quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c 2024-05-08T05:24:51.209 INFO:journalctl@ceph.mds.d.smithi087.stdout:May 08 05:24:50 smithi087 podman[70679]: 2024-05-08 05:24:50.869352532 +0000 UTC m=+0.153205364 container create 502d9a8af8b4181cd7550e5ae3e2b697216f26184d0fe3a907d1be7912de12e3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c, name=ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-mds-d, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, ceph=True, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, RELEASE=wip-57676-3-bee299f, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240507, CEPH_POINT_RELEASE=, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-05-08T05:24:51.209 INFO:journalctl@ceph.mds.d.smithi087.stdout:May 08 05:24:51 smithi087 podman[70679]: 2024-05-08 05:24:51.206436606 +0000 UTC m=+0.490289444 container init 502d9a8af8b4181cd7550e5ae3e2b697216f26184d0fe3a907d1be7912de12e3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c, name=ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-mds-d, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-57676-3-bee299f, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, org.label-schema.build-date=20240507, GIT_CLEAN=True, ceph=True, org.label-schema.vendor=CentOS, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=) 2024-05-08T05:24:51.458 INFO:journalctl@ceph.mds.d.smithi087.stdout:May 08 05:24:51 smithi087 podman[70679]: 2024-05-08 05:24:51.218587256 +0000 UTC m=+0.502440059 container start 502d9a8af8b4181cd7550e5ae3e2b697216f26184d0fe3a907d1be7912de12e3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c, name=ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-mds-d, RELEASE=wip-57676-3-bee299f, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, org.label-schema.build-date=20240507, CEPH_POINT_RELEASE=, GIT_CLEAN=True, ceph=True, GIT_BRANCH=HEAD, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image) 2024-05-08T05:24:51.459 INFO:journalctl@ceph.mds.d.smithi087.stdout:May 08 05:24:51 smithi087 ceph-mds[70699]: -- 172.21.15.87:0/2370798861 <== mon.1 v2:172.21.15.160:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55790fbbfa40 con 0x55790fb92800 2024-05-08T05:24:51.459 INFO:journalctl@ceph.mds.d.smithi087.stdout:May 08 05:24:51 smithi087 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-mds-d[70694]: starting mds.d at 2024-05-08T05:24:51.459 INFO:journalctl@ceph.mds.d.smithi087.stdout:May 08 05:24:51 smithi087 bash[70679]: 502d9a8af8b4181cd7550e5ae3e2b697216f26184d0fe3a907d1be7912de12e3 2024-05-08T05:24:51.459 INFO:journalctl@ceph.mds.d.smithi087.stdout:May 08 05:24:51 smithi087 systemd[1]: Started Ceph mds.d for eeeb813e-0cf9-11ef-bc97-c7b262605968. 2024-05-08T05:24:52.237 DEBUG:teuthology.orchestra.run.smithi087:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid eeeb813e-0cf9-11ef-bc97-c7b262605968 -- ceph fs dump --format=json 2024-05-08T05:24:52.685 INFO:teuthology.orchestra.run.smithi087.stderr:Inferring config /var/lib/ceph/eeeb813e-0cf9-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T05:24:52.708 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:24:52 smithi087 ceph-mon[29523]: pgmap v287: 1 pgs: 1 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-08T05:24:52.708 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:24:52 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:24:52.708 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:24:52 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:24:52.708 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:24:52 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:24:52.708 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:24:52 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-08T05:24:52.708 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:24:52 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-08T05:24:52.709 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:24:52 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T05:24:52.709 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:24:52 smithi087 ceph-mon[29523]: Deploying daemon mds.e on smithi090 2024-05-08T05:24:52.709 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:24:52 smithi087 ceph-mon[29523]: mds.? [v2:172.21.15.87:6836/1485824316,v1:172.21.15.87:6837/1485824316] up:boot 2024-05-08T05:24:52.709 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:24:52 smithi087 ceph-mon[29523]: fsmap 4 up:standby 2024-05-08T05:24:52.709 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:24:52 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-05-08T05:24:52.733 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:24:52 smithi090 ceph-mon[34526]: pgmap v287: 1 pgs: 1 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-08T05:24:52.733 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:24:52 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:24:52.733 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:24:52 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:24:52.733 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:24:52 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:24:52.734 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:24:52 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-08T05:24:52.734 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:24:52 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-08T05:24:52.734 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:24:52 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T05:24:52.734 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:24:52 smithi090 ceph-mon[34526]: Deploying daemon mds.e on smithi090 2024-05-08T05:24:52.734 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:24:52 smithi090 ceph-mon[34526]: mds.? [v2:172.21.15.87:6836/1485824316,v1:172.21.15.87:6837/1485824316] up:boot 2024-05-08T05:24:52.734 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:24:52 smithi090 ceph-mon[34526]: fsmap 4 up:standby 2024-05-08T05:24:52.734 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:24:52 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-05-08T05:24:52.788 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:24:52 smithi160 ceph-mon[34827]: pgmap v287: 1 pgs: 1 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-08T05:24:52.789 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:24:52 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:24:52.789 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:24:52 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:24:52.789 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:24:52 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:24:52.789 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:24:52 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-08T05:24:52.789 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:24:52 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-08T05:24:52.789 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:24:52 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T05:24:52.789 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:24:52 smithi160 ceph-mon[34827]: Deploying daemon mds.e on smithi090 2024-05-08T05:24:52.789 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:24:52 smithi160 ceph-mon[34827]: mds.? [v2:172.21.15.87:6836/1485824316,v1:172.21.15.87:6837/1485824316] up:boot 2024-05-08T05:24:52.789 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:24:52 smithi160 ceph-mon[34827]: fsmap 4 up:standby 2024-05-08T05:24:52.789 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:24:52 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-05-08T05:24:53.919 INFO:journalctl@ceph.mds.e.smithi090.stdout:May 08 05:24:53 smithi090 systemd[1]: Starting Ceph mds.e for eeeb813e-0cf9-11ef-bc97-c7b262605968... 2024-05-08T05:24:54.180 INFO:journalctl@ceph.mds.e.smithi090.stdout:May 08 05:24:53 smithi090 podman[64329]: 2024-05-08 05:24:53.918468721 +0000 UTC m=+0.110821225 container create 60ee4ba8a65a4bb70f1305ae240f0b2c418045fc34b0ecebb6c08bb411def2a4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c, name=ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-mds-e, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, ceph=True, org.label-schema.schema-version=1.0, RELEASE=wip-57676-3-bee299f, org.label-schema.build-date=20240507, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5) 2024-05-08T05:24:54.180 INFO:journalctl@ceph.mds.e.smithi090.stdout:May 08 05:24:53 smithi090 podman[64329]: 2024-05-08 05:24:53.825317151 +0000 UTC m=+0.017669650 image pull 352576a2df49fbab3aeeba1effbcb7a94815e8fc1f120a55ddc340b4ee63b8ce quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c 2024-05-08T05:24:54.180 INFO:journalctl@ceph.mds.e.smithi090.stdout:May 08 05:24:54 smithi090 podman[64329]: 2024-05-08 05:24:54.154608866 +0000 UTC m=+0.346961364 container init 60ee4ba8a65a4bb70f1305ae240f0b2c418045fc34b0ecebb6c08bb411def2a4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c, name=ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-mds-e, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, org.label-schema.build-date=20240507, GIT_CLEAN=True, org.label-schema.schema-version=1.0, RELEASE=wip-57676-3-bee299f, io.buildah.version=1.33.5, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504) 2024-05-08T05:24:54.180 INFO:journalctl@ceph.mds.e.smithi090.stdout:May 08 05:24:54 smithi090 podman[64329]: 2024-05-08 05:24:54.15719944 +0000 UTC m=+0.349551939 container start 60ee4ba8a65a4bb70f1305ae240f0b2c418045fc34b0ecebb6c08bb411def2a4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c, name=ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-mds-e, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, RELEASE=wip-57676-3-bee299f, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, GIT_BRANCH=HEAD, org.label-schema.build-date=20240507, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_CLEAN=True) 2024-05-08T05:24:54.180 INFO:journalctl@ceph.mds.e.smithi090.stdout:May 08 05:24:54 smithi090 ceph-mds[64348]: -- 172.21.15.90:0/106412341 <== mon.2 v2:172.21.15.90:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55e1ab385a40 con 0x55e1ab358800 2024-05-08T05:24:54.469 INFO:journalctl@ceph.mds.e.smithi090.stdout:May 08 05:24:54 smithi090 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-mds-e[64344]: starting mds.e at 2024-05-08T05:24:54.469 INFO:journalctl@ceph.mds.e.smithi090.stdout:May 08 05:24:54 smithi090 bash[64329]: 60ee4ba8a65a4bb70f1305ae240f0b2c418045fc34b0ecebb6c08bb411def2a4 2024-05-08T05:24:54.469 INFO:journalctl@ceph.mds.e.smithi090.stdout:May 08 05:24:54 smithi090 systemd[1]: Started Ceph mds.e for eeeb813e-0cf9-11ef-bc97-c7b262605968. 2024-05-08T05:24:54.600 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:24:54 smithi087 ceph-mon[29523]: pgmap v288: 1 pgs: 1 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-08T05:24:54.600 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:24:54 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:24:54.600 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:24:54 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:24:54.600 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:24:54 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:24:54.600 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:24:54 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-08T05:24:54.600 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:24:54 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-08T05:24:54.600 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:24:54 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T05:24:54.733 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:24:54 smithi090 ceph-mon[34526]: pgmap v288: 1 pgs: 1 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-08T05:24:54.734 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:24:54 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:24:54.734 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:24:54 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:24:54.734 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:24:54 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:24:54.734 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:24:54 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-08T05:24:54.734 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:24:54 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-08T05:24:54.734 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:24:54 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T05:24:54.764 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:24:54.763+0000 7fdc92c00700 1 -- 172.21.15.87:0/1053155963 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fdc8c1056c0 msgr2=0x7fdc8c105b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:24:54.764 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:24:54.763+0000 7fdc92c00700 1 --2- 172.21.15.87:0/1053155963 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fdc8c1056c0 0x7fdc8c105b40 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fdc78009990 tx=0x7fdc78009ca0 comp rx=0 tx=0).stop 2024-05-08T05:24:54.764 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:24:54.763+0000 7fdc92c00700 1 -- 172.21.15.87:0/1053155963 shutdown_connections 2024-05-08T05:24:54.765 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:24:54.763+0000 7fdc92c00700 1 --2- 172.21.15.87:0/1053155963 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fdc8c106080 0x7fdc8c112590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:24:54.765 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:24:54.763+0000 7fdc92c00700 1 --2- 172.21.15.87:0/1053155963 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fdc8c10b6c0 0x7fdc8c10baa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:24:54.765 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:24:54.763+0000 7fdc92c00700 1 --2- 172.21.15.87:0/1053155963 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fdc8c1056c0 0x7fdc8c105b40 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:24:54.765 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:24:54.763+0000 7fdc92c00700 1 -- 172.21.15.87:0/1053155963 >> 172.21.15.87:0/1053155963 conn(0x7fdc8c1011b0 msgr2=0x7fdc8c1035d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:24:54.765 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:24:54.764+0000 7fdc92c00700 1 -- 172.21.15.87:0/1053155963 shutdown_connections 2024-05-08T05:24:54.765 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:24:54.764+0000 7fdc92c00700 1 -- 172.21.15.87:0/1053155963 wait complete. 2024-05-08T05:24:54.765 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:24:54.765+0000 7fdc92c00700 1 Processor -- start 2024-05-08T05:24:54.765 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:24:54.765+0000 7fdc92c00700 1 -- start start 2024-05-08T05:24:54.766 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:24:54.766+0000 7fdc92c00700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fdc8c1056c0 0x7fdc8c19bdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:24:54.766 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:24:54.766+0000 7fdc92c00700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fdc8c106080 0x7fdc8c19c300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:24:54.766 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:24:54.766+0000 7fdc92c00700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fdc8c10b6c0 0x7fdc8c1a0690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:24:54.766 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:24:54.766+0000 7fdc92c00700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fdc8c115910 con 0x7fdc8c106080 2024-05-08T05:24:54.766 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:24:54.766+0000 7fdc92c00700 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fdc8c115790 con 0x7fdc8c1056c0 2024-05-08T05:24:54.766 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:24:54.766+0000 7fdc92c00700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7fdc8c115a90 con 0x7fdc8c10b6c0 2024-05-08T05:24:54.767 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:24:54.766+0000 7fdc8b400700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fdc8c106080 0x7fdc8c19c300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:24:54.767 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:24:54.766+0000 7fdc90c00700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fdc8c10b6c0 0x7fdc8c1a0690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:24:54.767 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:24:54.766+0000 7fdc8be00700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fdc8c1056c0 0x7fdc8c19bdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:24:54.768 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:24:54.766+0000 7fdc90c00700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fdc8c10b6c0 0x7fdc8c1a0690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.87:44072/0 (socket says 172.21.15.87:44072) 2024-05-08T05:24:54.768 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:24:54.766+0000 7fdc90c00700 1 -- 172.21.15.87:0/2503452654 learned_addr learned my addr 172.21.15.87:0/2503452654 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T05:24:54.768 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:24:54.766+0000 7fdc90c00700 1 -- 172.21.15.87:0/2503452654 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fdc8c1056c0 msgr2=0x7fdc8c19bdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:24:54.768 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:24:54.766+0000 7fdc90c00700 1 --2- 172.21.15.87:0/2503452654 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fdc8c1056c0 0x7fdc8c19bdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:24:54.768 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:24:54.766+0000 7fdc90c00700 1 -- 172.21.15.87:0/2503452654 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fdc8c106080 msgr2=0x7fdc8c19c300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:24:54.768 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:24:54.766+0000 7fdc90c00700 1 --2- 172.21.15.87:0/2503452654 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fdc8c106080 0x7fdc8c19c300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:24:54.768 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:24:54.766+0000 7fdc90c00700 1 -- 172.21.15.87:0/2503452654 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdc8c1a0dd0 con 0x7fdc8c10b6c0 2024-05-08T05:24:54.768 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:24:54.767+0000 7fdc90c00700 1 --2- 172.21.15.87:0/2503452654 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fdc8c10b6c0 0x7fdc8c1a0690 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fdc8400ef30 tx=0x7fdc8400c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:24:54.768 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:24:54.767+0000 7fdc88c00700 1 -- 172.21.15.87:0/2503452654 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc840092e0 con 0x7fdc8c10b6c0 2024-05-08T05:24:54.768 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:24:54.767+0000 7fdc88c00700 1 -- 172.21.15.87:0/2503452654 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fdc84004bb0 con 0x7fdc8c10b6c0 2024-05-08T05:24:54.768 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:24:54.767+0000 7fdc88c00700 1 -- 172.21.15.87:0/2503452654 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc84004020 con 0x7fdc8c10b6c0 2024-05-08T05:24:54.768 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:24:54.767+0000 7fdc92c00700 1 -- 172.21.15.87:0/2503452654 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdc8c1a1060 con 0x7fdc8c10b6c0 2024-05-08T05:24:54.768 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:24:54.767+0000 7fdc92c00700 1 -- 172.21.15.87:0/2503452654 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdc8c1a8940 con 0x7fdc8c10b6c0 2024-05-08T05:24:54.769 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:24:54.768+0000 7fdc92c00700 1 -- 172.21.15.87:0/2503452654 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdc8c06a190 con 0x7fdc8c10b6c0 2024-05-08T05:24:54.771 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:24:54.770+0000 7fdc88c00700 1 -- 172.21.15.87:0/2503452654 <== mon.1 v2:172.21.15.160:3300/0 4 ==== mgrmap(e 16) ==== 149652+0+0 (secure 0 0 0) 0x7fdc8401b030 con 0x7fdc8c10b6c0 2024-05-08T05:24:54.772 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:24:54.772+0000 7fdc88c00700 1 --2- 172.21.15.87:0/2503452654 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7fdc700b2900 0x7fdc700b4dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:24:54.772 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:24:54.772+0000 7fdc88c00700 1 -- 172.21.15.87:0/2503452654 <== mon.1 v2:172.21.15.160:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 7127+0+0 (secure 0 0 0) 0x7fdc840e19b0 con 0x7fdc8c10b6c0 2024-05-08T05:24:54.772 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:24:54.772+0000 7fdc8be00700 1 --2- 172.21.15.87:0/2503452654 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7fdc700b2900 0x7fdc700b4dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:24:54.773 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:24:54.773+0000 7fdc8be00700 1 --2- 172.21.15.87:0/2503452654 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7fdc700b2900 0x7fdc700b4dc0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fdc7c009be0 tx=0x7fdc7c009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:24:54.774 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:24:54.774+0000 7fdc88c00700 1 -- 172.21.15.87:0/2503452654 <== mon.1 v2:172.21.15.160:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7fdc84022020 con 0x7fdc8c10b6c0 2024-05-08T05:24:54.788 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:24:54 smithi160 ceph-mon[34827]: pgmap v288: 1 pgs: 1 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-08T05:24:54.788 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:24:54 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:24:54.788 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:24:54 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:24:54.789 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:24:54 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:24:54.789 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:24:54 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-08T05:24:54.789 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:24:54 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-08T05:24:54.789 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:24:54 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T05:24:55.056 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:24:55.056+0000 7fdc92c00700 1 -- 172.21.15.87:0/2503452654 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fdc8c19d120 con 0x7fdc8c10b6c0 2024-05-08T05:24:55.057 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:24:55.057+0000 7fdc88c00700 1 -- 172.21.15.87:0/2503452654 <== mon.1 v2:172.21.15.160:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) ==== 93+0+4693 (secure 0 0 0) 0x7fdc84010040 con 0x7fdc8c10b6c0 2024-05-08T05:24:55.058 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-05-08T05:24:55.058 INFO:teuthology.orchestra.run.smithi087.stdout:{"epoch":6,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14358,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6835/1183985321","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6834","nonce":1183985321},{"type":"v1","addr":"172.21.15.87:6835","nonce":1183985321}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14370,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6837/1485824316","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6836","nonce":1485824316},{"type":"v1","addr":"172.21.15.87:6837","nonce":1485824316}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24412,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6833/3339455985","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6832","nonce":3339455985},{"type":"v1","addr":"172.21.15.160:6833","nonce":3339455985}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24413,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6833/3292166873","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6832","nonce":3292166873},{"type":"v1","addr":"172.21.15.90:6833","nonce":3292166873}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24443,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6835/824555459","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6834","nonce":824555459},{"type":"v1","addr":"172.21.15.90:6835","nonce":824555459}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6}],"filesystems":[]} 2024-05-08T05:24:55.061 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:24:55.060+0000 7fdc92c00700 1 -- 172.21.15.87:0/2503452654 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7fdc700b2900 msgr2=0x7fdc700b4dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:24:55.061 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:24:55.060+0000 7fdc92c00700 1 --2- 172.21.15.87:0/2503452654 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7fdc700b2900 0x7fdc700b4dc0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fdc7c009be0 tx=0x7fdc7c009260 comp rx=0 tx=0).stop 2024-05-08T05:24:55.061 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:24:55.060+0000 7fdc92c00700 1 -- 172.21.15.87:0/2503452654 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fdc8c10b6c0 msgr2=0x7fdc8c1a0690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:24:55.061 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:24:55.060+0000 7fdc92c00700 1 --2- 172.21.15.87:0/2503452654 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fdc8c10b6c0 0x7fdc8c1a0690 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fdc8400ef30 tx=0x7fdc8400c3a0 comp rx=0 tx=0).stop 2024-05-08T05:24:55.062 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:24:55.061+0000 7fdc92c00700 1 -- 172.21.15.87:0/2503452654 shutdown_connections 2024-05-08T05:24:55.062 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:24:55.061+0000 7fdc92c00700 1 --2- 172.21.15.87:0/2503452654 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7fdc700b2900 0x7fdc700b4dc0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:24:55.062 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:24:55.061+0000 7fdc92c00700 1 --2- 172.21.15.87:0/2503452654 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fdc8c10b6c0 0x7fdc8c1a0690 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:24:55.062 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:24:55.061+0000 7fdc92c00700 1 --2- 172.21.15.87:0/2503452654 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fdc8c1056c0 0x7fdc8c19bdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:24:55.062 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:24:55.061+0000 7fdc92c00700 1 --2- 172.21.15.87:0/2503452654 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fdc8c106080 0x7fdc8c19c300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:24:55.062 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:24:55.061+0000 7fdc92c00700 1 -- 172.21.15.87:0/2503452654 >> 172.21.15.87:0/2503452654 conn(0x7fdc8c1011b0 msgr2=0x7fdc8c1018e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:24:55.062 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:24:55.061+0000 7fdc92c00700 1 -- 172.21.15.87:0/2503452654 shutdown_connections 2024-05-08T05:24:55.062 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:24:55.061+0000 7fdc92c00700 1 -- 172.21.15.87:0/2503452654 wait complete. 2024-05-08T05:24:55.063 INFO:teuthology.orchestra.run.smithi087.stderr:dumped fsmap epoch 6 2024-05-08T05:24:55.538 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:24:55 smithi160 ceph-mon[34827]: Deploying daemon mds.f on smithi160 2024-05-08T05:24:55.539 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:24:55 smithi160 ceph-mon[34827]: mds.? [v2:172.21.15.90:6834/824555459,v1:172.21.15.90:6835/824555459] up:boot 2024-05-08T05:24:55.539 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:24:55 smithi160 ceph-mon[34827]: fsmap 5 up:standby 2024-05-08T05:24:55.539 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:24:55 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-05-08T05:24:55.539 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:24:55 smithi160 ceph-mon[34827]: from='client.? 172.21.15.87:0/2503452654' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T05:24:55.686 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:24:55 smithi087 ceph-mon[29523]: Deploying daemon mds.f on smithi160 2024-05-08T05:24:55.686 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:24:55 smithi087 ceph-mon[29523]: mds.? [v2:172.21.15.90:6834/824555459,v1:172.21.15.90:6835/824555459] up:boot 2024-05-08T05:24:55.686 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:24:55 smithi087 ceph-mon[29523]: fsmap 5 up:standby 2024-05-08T05:24:55.686 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:24:55 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-05-08T05:24:55.686 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:24:55 smithi087 ceph-mon[29523]: from='client.? 172.21.15.87:0/2503452654' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T05:24:55.983 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:24:55 smithi090 ceph-mon[34526]: Deploying daemon mds.f on smithi160 2024-05-08T05:24:55.983 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:24:55 smithi090 ceph-mon[34526]: mds.? [v2:172.21.15.90:6834/824555459,v1:172.21.15.90:6835/824555459] up:boot 2024-05-08T05:24:55.983 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:24:55 smithi090 ceph-mon[34526]: fsmap 5 up:standby 2024-05-08T05:24:55.983 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:24:55 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-05-08T05:24:55.984 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:24:55 smithi090 ceph-mon[34526]: from='client.? 172.21.15.87:0/2503452654' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T05:24:56.789 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:24:56 smithi160 ceph-mon[34827]: pgmap v289: 1 pgs: 1 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-08T05:24:56.790 INFO:journalctl@ceph.mds.f.smithi160.stdout:May 08 05:24:56 smithi160 systemd[1]: Starting Ceph mds.f for eeeb813e-0cf9-11ef-bc97-c7b262605968... 2024-05-08T05:24:56.959 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:24:56 smithi087 ceph-mon[29523]: pgmap v289: 1 pgs: 1 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-08T05:24:56.983 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:24:56 smithi090 ceph-mon[34526]: pgmap v289: 1 pgs: 1 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-08T05:24:57.077 INFO:journalctl@ceph.mds.f.smithi160.stdout:May 08 05:24:56 smithi160 podman[65141]: 2024-05-08 05:24:56.711835072 +0000 UTC m=+0.017623083 image pull 352576a2df49fbab3aeeba1effbcb7a94815e8fc1f120a55ddc340b4ee63b8ce quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c 2024-05-08T05:24:57.077 INFO:journalctl@ceph.mds.f.smithi160.stdout:May 08 05:24:56 smithi160 podman[65141]: 2024-05-08 05:24:56.81673028 +0000 UTC m=+0.122518266 container create b586ddc7bc7a6d52f749cfba9dcb64d86f1612f86744b6d8043cc4d10f5d21ed (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c, name=ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-mds-f, org.label-schema.build-date=20240507, org.label-schema.schema-version=1.0, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, RELEASE=wip-57676-3-bee299f, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, GIT_CLEAN=True, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=) 2024-05-08T05:24:57.078 INFO:journalctl@ceph.mds.f.smithi160.stdout:May 08 05:24:57 smithi160 podman[65141]: 2024-05-08 05:24:57.077392941 +0000 UTC m=+0.383180932 container init b586ddc7bc7a6d52f749cfba9dcb64d86f1612f86744b6d8043cc4d10f5d21ed (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c, name=ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-mds-f, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240507, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.schema-version=1.0, ceph=True, RELEASE=wip-57676-3-bee299f, org.label-schema.license=GPLv2) 2024-05-08T05:24:57.539 INFO:journalctl@ceph.mds.f.smithi160.stdout:May 08 05:24:57 smithi160 podman[65141]: 2024-05-08 05:24:57.080088364 +0000 UTC m=+0.385876350 container start b586ddc7bc7a6d52f749cfba9dcb64d86f1612f86744b6d8043cc4d10f5d21ed (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c, name=ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-mds-f, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.build-date=20240507, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, RELEASE=wip-57676-3-bee299f) 2024-05-08T05:24:57.539 INFO:journalctl@ceph.mds.f.smithi160.stdout:May 08 05:24:57 smithi160 ceph-mds[65160]: -- 172.21.15.160:0/3201850653 <== mon.1 v2:172.21.15.160:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55ff9df2fa40 con 0x55ff9df03000 2024-05-08T05:24:57.539 INFO:journalctl@ceph.mds.f.smithi160.stdout:May 08 05:24:57 smithi160 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-mds-f[65156]: starting mds.f at 2024-05-08T05:24:57.539 INFO:journalctl@ceph.mds.f.smithi160.stdout:May 08 05:24:57 smithi160 bash[65141]: b586ddc7bc7a6d52f749cfba9dcb64d86f1612f86744b6d8043cc4d10f5d21ed 2024-05-08T05:24:57.539 INFO:journalctl@ceph.mds.f.smithi160.stdout:May 08 05:24:57 smithi160 systemd[1]: Started Ceph mds.f for eeeb813e-0cf9-11ef-bc97-c7b262605968. 2024-05-08T05:24:57.730 DEBUG:teuthology.orchestra.run.smithi087:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid eeeb813e-0cf9-11ef-bc97-c7b262605968 -- ceph fs dump --format=json 2024-05-08T05:24:58.180 INFO:teuthology.orchestra.run.smithi087.stderr:Inferring config /var/lib/ceph/eeeb813e-0cf9-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T05:24:58.516 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:24:58 smithi087 ceph-mon[29523]: pgmap v290: 1 pgs: 1 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-08T05:24:58.516 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:24:58 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:24:58.516 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:24:58 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:24:58.516 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:24:58 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:24:58.516 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:24:58 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-08T05:24:58.516 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:24:58 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-08T05:24:58.516 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:24:58 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T05:24:58.516 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:24:58 smithi087 ceph-mon[29523]: Deploying daemon mds.c on smithi160 2024-05-08T05:24:58.517 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:24:58 smithi087 ceph-mon[29523]: mds.? [v2:172.21.15.160:6834/409648357,v1:172.21.15.160:6835/409648357] up:boot 2024-05-08T05:24:58.517 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:24:58 smithi087 ceph-mon[29523]: fsmap 6 up:standby 2024-05-08T05:24:58.517 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:24:58 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-05-08T05:24:58.539 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:24:58 smithi160 ceph-mon[34827]: pgmap v290: 1 pgs: 1 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-08T05:24:58.539 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:24:58 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:24:58.539 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:24:58 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:24:58.539 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:24:58 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:24:58.539 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:24:58 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-08T05:24:58.539 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:24:58 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-08T05:24:58.539 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:24:58 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T05:24:58.539 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:24:58 smithi160 ceph-mon[34827]: Deploying daemon mds.c on smithi160 2024-05-08T05:24:58.539 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:24:58 smithi160 ceph-mon[34827]: mds.? [v2:172.21.15.160:6834/409648357,v1:172.21.15.160:6835/409648357] up:boot 2024-05-08T05:24:58.539 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:24:58 smithi160 ceph-mon[34827]: fsmap 6 up:standby 2024-05-08T05:24:58.539 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:24:58 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-05-08T05:24:58.733 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:24:58 smithi090 ceph-mon[34526]: pgmap v290: 1 pgs: 1 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-08T05:24:58.734 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:24:58 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:24:58.734 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:24:58 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:24:58.734 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:24:58 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:24:58.734 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:24:58 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-08T05:24:58.734 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:24:58 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-08T05:24:58.734 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:24:58 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T05:24:58.734 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:24:58 smithi090 ceph-mon[34526]: Deploying daemon mds.c on smithi160 2024-05-08T05:24:58.734 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:24:58 smithi090 ceph-mon[34526]: mds.? [v2:172.21.15.160:6834/409648357,v1:172.21.15.160:6835/409648357] up:boot 2024-05-08T05:24:58.734 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:24:58 smithi090 ceph-mon[34526]: fsmap 6 up:standby 2024-05-08T05:24:58.734 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:24:58 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-05-08T05:24:59.789 INFO:journalctl@ceph.mds.c.smithi160.stdout:May 08 05:24:59 smithi160 systemd[1]: Starting Ceph mds.c for eeeb813e-0cf9-11ef-bc97-c7b262605968... 2024-05-08T05:25:00.061 INFO:journalctl@ceph.mds.c.smithi160.stdout:May 08 05:24:59 smithi160 podman[65451]: 2024-05-08 05:24:59.704094808 +0000 UTC m=+0.018098010 image pull 352576a2df49fbab3aeeba1effbcb7a94815e8fc1f120a55ddc340b4ee63b8ce quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c 2024-05-08T05:25:00.061 INFO:journalctl@ceph.mds.c.smithi160.stdout:May 08 05:24:59 smithi160 podman[65451]: 2024-05-08 05:24:59.805492092 +0000 UTC m=+0.119495321 container create 5afd6bd4357abf502453dfd49b176e5abecdd0121045e1d0eaf23ca6c5f48393 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c, name=ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-mds-c, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240507, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, RELEASE=wip-57676-3-bee299f, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2) 2024-05-08T05:25:00.061 INFO:journalctl@ceph.mds.c.smithi160.stdout:May 08 05:25:00 smithi160 podman[65451]: 2024-05-08 05:25:00.035116987 +0000 UTC m=+0.349120173 container init 5afd6bd4357abf502453dfd49b176e5abecdd0121045e1d0eaf23ca6c5f48393 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c, name=ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-mds-c, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.build-date=20240507, RELEASE=wip-57676-3-bee299f, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.vendor=CentOS, GIT_CLEAN=True, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux ) 2024-05-08T05:25:00.061 INFO:journalctl@ceph.mds.c.smithi160.stdout:May 08 05:25:00 smithi160 podman[65451]: 2024-05-08 05:25:00.037793458 +0000 UTC m=+0.351796651 container start 5afd6bd4357abf502453dfd49b176e5abecdd0121045e1d0eaf23ca6c5f48393 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c, name=ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-mds-c, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.build-date=20240507, RELEASE=wip-57676-3-bee299f, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image) 2024-05-08T05:25:00.430 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:00.429+0000 7ff07e200700 1 -- 172.21.15.87:0/1682370894 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff078075ff0 msgr2=0x7ff07810f9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:25:00.430 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:00.429+0000 7ff07e200700 1 --2- 172.21.15.87:0/1682370894 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff078075ff0 0x7ff07810f9d0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7ff064009990 tx=0x7ff064009ca0 comp rx=0 tx=0).stop 2024-05-08T05:25:00.430 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:00.429+0000 7ff07e200700 1 -- 172.21.15.87:0/1682370894 shutdown_connections 2024-05-08T05:25:00.430 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:00.429+0000 7ff07e200700 1 --2- 172.21.15.87:0/1682370894 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff07810ff10 0x7ff078112300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:25:00.430 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:00.429+0000 7ff07e200700 1 --2- 172.21.15.87:0/1682370894 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff0780756d0 0x7ff078075ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:25:00.430 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:00.429+0000 7ff07e200700 1 --2- 172.21.15.87:0/1682370894 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff078075ff0 0x7ff07810f9d0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:25:00.430 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:00.429+0000 7ff07e200700 1 -- 172.21.15.87:0/1682370894 >> 172.21.15.87:0/1682370894 conn(0x7ff07807a660 msgr2=0x7ff07807aa70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:25:00.431 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:00.429+0000 7ff07e200700 1 -- 172.21.15.87:0/1682370894 shutdown_connections 2024-05-08T05:25:00.431 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:00.429+0000 7ff07e200700 1 -- 172.21.15.87:0/1682370894 wait complete. 2024-05-08T05:25:00.432 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:00.430+0000 7ff07e200700 1 Processor -- start 2024-05-08T05:25:00.432 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:00.430+0000 7ff07e200700 1 -- start start 2024-05-08T05:25:00.432 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:00.431+0000 7ff07e200700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff0780756d0 0x7ff07819bdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:25:00.432 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:00.431+0000 7ff07e200700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff078075ff0 0x7ff07819c330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:25:00.432 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:00.431+0000 7ff07e200700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff07810ff10 0x7ff0781a0670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:25:00.432 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:00.431+0000 7ff07e200700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7ff078115880 con 0x7ff078075ff0 2024-05-08T05:25:00.433 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:00.431+0000 7ff07e200700 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7ff078115700 con 0x7ff07810ff10 2024-05-08T05:25:00.433 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:00.431+0000 7ff07e200700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7ff078115a00 con 0x7ff0780756d0 2024-05-08T05:25:00.433 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:00.431+0000 7ff077400700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff0780756d0 0x7ff07819bdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:25:00.433 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:00.431+0000 7ff076a00700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff078075ff0 0x7ff07819c330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:25:00.433 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:00.431+0000 7ff077400700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff0780756d0 0x7ff07819bdf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.87:55898/0 (socket says 172.21.15.87:55898) 2024-05-08T05:25:00.433 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:00.431+0000 7ff077400700 1 -- 172.21.15.87:0/1839025275 learned_addr learned my addr 172.21.15.87:0/1839025275 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T05:25:00.433 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:00.431+0000 7ff077e00700 1 --2- 172.21.15.87:0/1839025275 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff07810ff10 0x7ff0781a0670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:25:00.433 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:00.432+0000 7ff077400700 1 -- 172.21.15.87:0/1839025275 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff07810ff10 msgr2=0x7ff0781a0670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:25:00.433 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:00.432+0000 7ff077400700 1 --2- 172.21.15.87:0/1839025275 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff07810ff10 0x7ff0781a0670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:25:00.433 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:00.432+0000 7ff077400700 1 -- 172.21.15.87:0/1839025275 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff078075ff0 msgr2=0x7ff07819c330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:25:00.433 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:00.432+0000 7ff077400700 1 --2- 172.21.15.87:0/1839025275 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff078075ff0 0x7ff07819c330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:25:00.433 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:00.432+0000 7ff077400700 1 -- 172.21.15.87:0/1839025275 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff0781a0db0 con 0x7ff0780756d0 2024-05-08T05:25:00.433 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:00.432+0000 7ff076a00700 1 --2- 172.21.15.87:0/1839025275 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff078075ff0 0x7ff07819c330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T05:25:00.433 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:00.432+0000 7ff077400700 1 --2- 172.21.15.87:0/1839025275 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff0780756d0 0x7ff07819bdf0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7ff06800e9a0 tx=0x7ff06800ecb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:25:00.434 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:00.432+0000 7ff06fe00700 1 -- 172.21.15.87:0/1839025275 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff06800c9c0 con 0x7ff0780756d0 2024-05-08T05:25:00.434 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:00.432+0000 7ff06fe00700 1 -- 172.21.15.87:0/1839025275 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff06800cb60 con 0x7ff0780756d0 2024-05-08T05:25:00.434 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:00.432+0000 7ff07e200700 1 -- 172.21.15.87:0/1839025275 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff0781a10a0 con 0x7ff0780756d0 2024-05-08T05:25:00.434 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:00.432+0000 7ff06fe00700 1 -- 172.21.15.87:0/1839025275 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff068018680 con 0x7ff0780756d0 2024-05-08T05:25:00.434 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:00.432+0000 7ff07e200700 1 -- 172.21.15.87:0/1839025275 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff0781a8920 con 0x7ff0780756d0 2024-05-08T05:25:00.435 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:00.433+0000 7ff07e200700 1 -- 172.21.15.87:0/1839025275 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff07806a190 con 0x7ff0780756d0 2024-05-08T05:25:00.436 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:00.435+0000 7ff06fe00700 1 -- 172.21.15.87:0/1839025275 <== mon.1 v2:172.21.15.160:3300/0 4 ==== mgrmap(e 16) ==== 149652+0+0 (secure 0 0 0) 0x7ff068010430 con 0x7ff0780756d0 2024-05-08T05:25:00.437 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:00.437+0000 7ff06fe00700 1 --2- 172.21.15.87:0/1839025275 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7ff05c0b2880 0x7ff05c0b4d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:25:00.437 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:00.437+0000 7ff06fe00700 1 -- 172.21.15.87:0/1839025275 <== mon.1 v2:172.21.15.160:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 7127+0+0 (secure 0 0 0) 0x7ff0680e20a0 con 0x7ff0780756d0 2024-05-08T05:25:00.437 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:00.437+0000 7ff076a00700 1 --2- 172.21.15.87:0/1839025275 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7ff05c0b2880 0x7ff05c0b4d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:25:00.438 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:00.438+0000 7ff076a00700 1 --2- 172.21.15.87:0/1839025275 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7ff05c0b2880 0x7ff05c0b4d40 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7ff078103150 tx=0x7ff06401a040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:25:00.441 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:00.441+0000 7ff06fe00700 1 -- 172.21.15.87:0/1839025275 <== mon.1 v2:172.21.15.160:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7ff0680aa1c0 con 0x7ff0780756d0 2024-05-08T05:25:00.538 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:25:00 smithi160 ceph-mon[34827]: pgmap v291: 1 pgs: 1 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-08T05:25:00.539 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:25:00 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:25:00.539 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:25:00 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:25:00.539 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:25:00 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:25:00.539 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:25:00 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-08T05:25:00.539 INFO:journalctl@ceph.mds.c.smithi160.stdout:May 08 05:25:00 smithi160 ceph-mds[65470]: -- 172.21.15.160:0/2424762671 <== mon.1 v2:172.21.15.160:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55c753f9fa40 con 0x55c753f72c00 2024-05-08T05:25:00.539 INFO:journalctl@ceph.mds.c.smithi160.stdout:May 08 05:25:00 smithi160 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-mds-c[65466]: starting mds.c at 2024-05-08T05:25:00.539 INFO:journalctl@ceph.mds.c.smithi160.stdout:May 08 05:25:00 smithi160 bash[65451]: 5afd6bd4357abf502453dfd49b176e5abecdd0121045e1d0eaf23ca6c5f48393 2024-05-08T05:25:00.539 INFO:journalctl@ceph.mds.c.smithi160.stdout:May 08 05:25:00 smithi160 systemd[1]: Started Ceph mds.c for eeeb813e-0cf9-11ef-bc97-c7b262605968. 2024-05-08T05:25:00.709 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:25:00 smithi087 ceph-mon[29523]: pgmap v291: 1 pgs: 1 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-08T05:25:00.709 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:25:00 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:25:00.709 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:25:00 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:25:00.709 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:25:00 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:25:00.709 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:25:00 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-08T05:25:00.725 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:00.725+0000 7ff07e200700 1 -- 172.21.15.87:0/1839025275 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ff07802e510 con 0x7ff0780756d0 2024-05-08T05:25:00.726 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:00.726+0000 7ff06fe00700 1 -- 172.21.15.87:0/1839025275 <== mon.1 v2:172.21.15.160:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+6346 (secure 0 0 0) 0x7ff0680b2240 con 0x7ff0780756d0 2024-05-08T05:25:00.726 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-05-08T05:25:00.727 INFO:teuthology.orchestra.run.smithi087.stdout:{"epoch":8,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14358,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6835/1183985321","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6834","nonce":1183985321},{"type":"v1","addr":"172.21.15.87:6835","nonce":1183985321}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14370,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6837/1485824316","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6836","nonce":1485824316},{"type":"v1","addr":"172.21.15.87:6837","nonce":1485824316}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24412,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6833/3339455985","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6832","nonce":3339455985},{"type":"v1","addr":"172.21.15.160:6833","nonce":3339455985}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24413,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6833/3292166873","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6832","nonce":3292166873},{"type":"v1","addr":"172.21.15.90:6833","nonce":3292166873}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24443,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6835/824555459","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6834","nonce":824555459},{"type":"v1","addr":"172.21.15.90:6835","nonce":824555459}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24463,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6835/409648357","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6834","nonce":409648357},{"type":"v1","addr":"172.21.15.160:6835","nonce":409648357}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24469,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6837/4200018040","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6836","nonce":4200018040},{"type":"v1","addr":"172.21.15.160:6837","nonce":4200018040}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8}],"filesystems":[]} 2024-05-08T05:25:00.730 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:00.729+0000 7ff07e200700 1 -- 172.21.15.87:0/1839025275 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7ff05c0b2880 msgr2=0x7ff05c0b4d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:25:00.730 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:00.729+0000 7ff07e200700 1 --2- 172.21.15.87:0/1839025275 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7ff05c0b2880 0x7ff05c0b4d40 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7ff078103150 tx=0x7ff06401a040 comp rx=0 tx=0).stop 2024-05-08T05:25:00.730 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:00.729+0000 7ff07e200700 1 -- 172.21.15.87:0/1839025275 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff0780756d0 msgr2=0x7ff07819bdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:25:00.730 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:00.729+0000 7ff07e200700 1 --2- 172.21.15.87:0/1839025275 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff0780756d0 0x7ff07819bdf0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7ff06800e9a0 tx=0x7ff06800ecb0 comp rx=0 tx=0).stop 2024-05-08T05:25:00.730 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:00.729+0000 7ff07e200700 1 -- 172.21.15.87:0/1839025275 shutdown_connections 2024-05-08T05:25:00.730 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:00.729+0000 7ff07e200700 1 --2- 172.21.15.87:0/1839025275 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff07810ff10 0x7ff0781a0670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:25:00.730 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:00.729+0000 7ff07e200700 1 --2- 172.21.15.87:0/1839025275 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7ff05c0b2880 0x7ff05c0b4d40 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:25:00.730 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:00.729+0000 7ff07e200700 1 --2- 172.21.15.87:0/1839025275 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff0780756d0 0x7ff07819bdf0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:25:00.730 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:00.729+0000 7ff07e200700 1 --2- 172.21.15.87:0/1839025275 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff078075ff0 0x7ff07819c330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:25:00.730 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:00.729+0000 7ff07e200700 1 -- 172.21.15.87:0/1839025275 >> 172.21.15.87:0/1839025275 conn(0x7ff07807a660 msgr2=0x7ff0781007c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:25:00.730 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:00.729+0000 7ff07e200700 1 -- 172.21.15.87:0/1839025275 shutdown_connections 2024-05-08T05:25:00.731 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:00.729+0000 7ff07e200700 1 -- 172.21.15.87:0/1839025275 wait complete. 2024-05-08T05:25:00.731 INFO:teuthology.orchestra.run.smithi087.stderr:dumped fsmap epoch 8 2024-05-08T05:25:00.733 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:25:00 smithi090 ceph-mon[34526]: pgmap v291: 1 pgs: 1 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-08T05:25:00.733 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:25:00 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:25:00.733 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:25:00 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:25:00.733 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:25:00 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:25:00.733 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:25:00 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-08T05:25:01.458 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:25:01 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-08T05:25:01.459 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:25:01 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T05:25:01.459 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:25:01 smithi087 ceph-mon[29523]: mds.? [v2:172.21.15.160:6836/4200018040,v1:172.21.15.160:6837/4200018040] up:boot 2024-05-08T05:25:01.459 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:25:01 smithi087 ceph-mon[29523]: fsmap 7 up:standby 2024-05-08T05:25:01.459 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:25:01 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-05-08T05:25:01.459 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:25:01 smithi087 ceph-mon[29523]: Deploying daemon mds.h on smithi090 2024-05-08T05:25:01.459 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:25:01 smithi087 ceph-mon[29523]: from='client.? 172.21.15.87:0/1839025275' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T05:25:01.538 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:25:01 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-08T05:25:01.539 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:25:01 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T05:25:01.539 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:25:01 smithi160 ceph-mon[34827]: mds.? [v2:172.21.15.160:6836/4200018040,v1:172.21.15.160:6837/4200018040] up:boot 2024-05-08T05:25:01.539 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:25:01 smithi160 ceph-mon[34827]: fsmap 7 up:standby 2024-05-08T05:25:01.539 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:25:01 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-05-08T05:25:01.539 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:25:01 smithi160 ceph-mon[34827]: Deploying daemon mds.h on smithi090 2024-05-08T05:25:01.539 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:25:01 smithi160 ceph-mon[34827]: from='client.? 172.21.15.87:0/1839025275' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T05:25:01.734 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:25:01 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-08T05:25:01.734 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:25:01 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T05:25:01.734 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:25:01 smithi090 ceph-mon[34526]: mds.? [v2:172.21.15.160:6836/4200018040,v1:172.21.15.160:6837/4200018040] up:boot 2024-05-08T05:25:01.734 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:25:01 smithi090 ceph-mon[34526]: fsmap 7 up:standby 2024-05-08T05:25:01.734 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:25:01 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-05-08T05:25:01.734 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:25:01 smithi090 ceph-mon[34526]: Deploying daemon mds.h on smithi090 2024-05-08T05:25:01.734 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:25:01 smithi090 ceph-mon[34526]: from='client.? 172.21.15.87:0/1839025275' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T05:25:02.484 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:25:02 smithi090 ceph-mon[34526]: pgmap v292: 1 pgs: 1 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-08T05:25:02.484 INFO:journalctl@ceph.mds.h.smithi090.stdout:May 08 05:25:02 smithi090 systemd[1]: Starting Ceph mds.h for eeeb813e-0cf9-11ef-bc97-c7b262605968... 2024-05-08T05:25:02.538 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:25:02 smithi160 ceph-mon[34827]: pgmap v292: 1 pgs: 1 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-08T05:25:02.708 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:25:02 smithi087 ceph-mon[29523]: pgmap v292: 1 pgs: 1 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-08T05:25:02.814 INFO:journalctl@ceph.mds.h.smithi090.stdout:May 08 05:25:02 smithi090 podman[64637]: 2024-05-08 05:25:02.462102807 +0000 UTC m=+0.017723085 image pull 352576a2df49fbab3aeeba1effbcb7a94815e8fc1f120a55ddc340b4ee63b8ce quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c 2024-05-08T05:25:02.814 INFO:journalctl@ceph.mds.h.smithi090.stdout:May 08 05:25:02 smithi090 podman[64637]: 2024-05-08 05:25:02.586093702 +0000 UTC m=+0.141713980 container create 029ff2ccc4fca9ff80c144a9bee81194bae4af007630a001b64edb1593b78239 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c, name=ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-mds-h, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, ceph=True, org.label-schema.build-date=20240507, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , RELEASE=wip-57676-3-bee299f, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504) 2024-05-08T05:25:02.814 INFO:journalctl@ceph.mds.h.smithi090.stdout:May 08 05:25:02 smithi090 podman[64637]: 2024-05-08 05:25:02.814007056 +0000 UTC m=+0.369627335 container init 029ff2ccc4fca9ff80c144a9bee81194bae4af007630a001b64edb1593b78239 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c, name=ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-mds-h, RELEASE=wip-57676-3-bee299f, GIT_BRANCH=HEAD, org.label-schema.build-date=20240507, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS) 2024-05-08T05:25:03.233 INFO:journalctl@ceph.mds.h.smithi090.stdout:May 08 05:25:02 smithi090 podman[64637]: 2024-05-08 05:25:02.816517467 +0000 UTC m=+0.372137749 container start 029ff2ccc4fca9ff80c144a9bee81194bae4af007630a001b64edb1593b78239 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c, name=ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-mds-h, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , RELEASE=wip-57676-3-bee299f, io.buildah.version=1.33.5, org.label-schema.build-date=20240507) 2024-05-08T05:25:03.234 INFO:journalctl@ceph.mds.h.smithi090.stdout:May 08 05:25:02 smithi090 ceph-mds[64655]: -- 172.21.15.90:0/189576309 <== mon.2 v2:172.21.15.90:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x562ee86d1a40 con 0x562ee86a5000 2024-05-08T05:25:03.234 INFO:journalctl@ceph.mds.h.smithi090.stdout:May 08 05:25:02 smithi090 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-mds-h[64651]: starting mds.h at 2024-05-08T05:25:03.234 INFO:journalctl@ceph.mds.h.smithi090.stdout:May 08 05:25:02 smithi090 bash[64637]: 029ff2ccc4fca9ff80c144a9bee81194bae4af007630a001b64edb1593b78239 2024-05-08T05:25:03.234 INFO:journalctl@ceph.mds.h.smithi090.stdout:May 08 05:25:02 smithi090 systemd[1]: Started Ceph mds.h for eeeb813e-0cf9-11ef-bc97-c7b262605968. 2024-05-08T05:25:03.538 DEBUG:teuthology.orchestra.run.smithi087:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid eeeb813e-0cf9-11ef-bc97-c7b262605968 -- ceph fs dump --format=json 2024-05-08T05:25:03.996 INFO:teuthology.orchestra.run.smithi087.stderr:Inferring config /var/lib/ceph/eeeb813e-0cf9-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T05:25:04.233 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:25:03 smithi090 ceph-mon[34526]: pgmap v293: 1 pgs: 1 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-08T05:25:04.233 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:25:03 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:25:04.234 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:25:03 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:25:04.234 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:25:03 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:25:04.234 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:25:03 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-08T05:25:04.234 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:25:03 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-08T05:25:04.234 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:25:03 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T05:25:04.234 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:25:03 smithi090 ceph-mon[34526]: Deploying daemon mds.i on smithi160 2024-05-08T05:25:04.234 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:25:03 smithi090 ceph-mon[34526]: mds.? [v2:172.21.15.90:6836/4221919418,v1:172.21.15.90:6837/4221919418] up:boot 2024-05-08T05:25:04.234 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:25:03 smithi090 ceph-mon[34526]: fsmap 8 up:standby 2024-05-08T05:25:04.234 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:25:03 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-05-08T05:25:04.289 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:25:03 smithi160 ceph-mon[34827]: pgmap v293: 1 pgs: 1 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-08T05:25:04.289 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:25:03 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:25:04.289 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:25:03 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:25:04.289 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:25:03 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:25:04.289 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:25:03 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-08T05:25:04.289 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:25:03 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-08T05:25:04.289 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:25:03 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T05:25:04.289 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:25:03 smithi160 ceph-mon[34827]: Deploying daemon mds.i on smithi160 2024-05-08T05:25:04.289 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:25:03 smithi160 ceph-mon[34827]: mds.? [v2:172.21.15.90:6836/4221919418,v1:172.21.15.90:6837/4221919418] up:boot 2024-05-08T05:25:04.289 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:25:03 smithi160 ceph-mon[34827]: fsmap 8 up:standby 2024-05-08T05:25:04.289 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:25:03 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-05-08T05:25:04.303 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:25:03 smithi087 ceph-mon[29523]: pgmap v293: 1 pgs: 1 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-08T05:25:04.303 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:25:03 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:25:04.304 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:25:03 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:25:04.304 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:25:03 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:25:04.304 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:25:03 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-08T05:25:04.304 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:25:03 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-08T05:25:04.304 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:25:03 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T05:25:04.304 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:25:03 smithi087 ceph-mon[29523]: Deploying daemon mds.i on smithi160 2024-05-08T05:25:04.304 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:25:03 smithi087 ceph-mon[29523]: mds.? [v2:172.21.15.90:6836/4221919418,v1:172.21.15.90:6837/4221919418] up:boot 2024-05-08T05:25:04.304 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:25:03 smithi087 ceph-mon[29523]: fsmap 8 up:standby 2024-05-08T05:25:04.304 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:25:03 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-05-08T05:25:05.505 INFO:journalctl@ceph.mds.i.smithi160.stdout:May 08 05:25:05 smithi160 systemd[1]: Starting Ceph mds.i for eeeb813e-0cf9-11ef-bc97-c7b262605968... 2024-05-08T05:25:05.762 INFO:journalctl@ceph.mds.i.smithi160.stdout:May 08 05:25:05 smithi160 podman[65762]: 2024-05-08 05:25:05.407657512 +0000 UTC m=+0.018251746 image pull 352576a2df49fbab3aeeba1effbcb7a94815e8fc1f120a55ddc340b4ee63b8ce quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c 2024-05-08T05:25:05.762 INFO:journalctl@ceph.mds.i.smithi160.stdout:May 08 05:25:05 smithi160 podman[65762]: 2024-05-08 05:25:05.509993307 +0000 UTC m=+0.120587524 container create 5c35f6636ad12ecd21dddc0cc55304814dff163a7e010ea33dd0bcce4644c9f2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c, name=ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-mds-i, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.build-date=20240507, ceph=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_CLEAN=True, RELEASE=wip-57676-3-bee299f, org.label-schema.vendor=CentOS) 2024-05-08T05:25:06.038 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:25:05 smithi160 ceph-mon[34827]: pgmap v294: 1 pgs: 1 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-08T05:25:06.039 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:25:05 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:25:06.039 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:25:05 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:25:06.039 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:25:05 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:25:06.039 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:25:05 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-08T05:25:06.039 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:25:05 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-08T05:25:06.039 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:25:05 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T05:25:06.039 INFO:journalctl@ceph.mds.i.smithi160.stdout:May 08 05:25:05 smithi160 podman[65762]: 2024-05-08 05:25:05.762330794 +0000 UTC m=+0.372925012 container init 5c35f6636ad12ecd21dddc0cc55304814dff163a7e010ea33dd0bcce4644c9f2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c, name=ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-mds-i, org.label-schema.build-date=20240507, org.label-schema.vendor=CentOS, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, GIT_CLEAN=True, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-57676-3-bee299f, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True) 2024-05-08T05:25:06.040 INFO:journalctl@ceph.mds.i.smithi160.stdout:May 08 05:25:05 smithi160 podman[65762]: 2024-05-08 05:25:05.764921798 +0000 UTC m=+0.375516016 container start 5c35f6636ad12ecd21dddc0cc55304814dff163a7e010ea33dd0bcce4644c9f2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c, name=ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-mds-i, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, org.label-schema.build-date=20240507, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , RELEASE=wip-57676-3-bee299f, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True) 2024-05-08T05:25:06.040 INFO:journalctl@ceph.mds.i.smithi160.stdout:May 08 05:25:05 smithi160 ceph-mds[65782]: -- 172.21.15.160:0/3450333175 <== mon.1 v2:172.21.15.160:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5608444d1a40 con 0x5608444a5000 2024-05-08T05:25:06.040 INFO:journalctl@ceph.mds.i.smithi160.stdout:May 08 05:25:05 smithi160 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-mds-i[65778]: starting mds.i at 2024-05-08T05:25:06.040 INFO:journalctl@ceph.mds.i.smithi160.stdout:May 08 05:25:05 smithi160 bash[65762]: 5c35f6636ad12ecd21dddc0cc55304814dff163a7e010ea33dd0bcce4644c9f2 2024-05-08T05:25:06.040 INFO:journalctl@ceph.mds.i.smithi160.stdout:May 08 05:25:05 smithi160 systemd[1]: Started Ceph mds.i for eeeb813e-0cf9-11ef-bc97-c7b262605968. 2024-05-08T05:25:06.196 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:06.194+0000 7fbc3ea00700 1 -- 172.21.15.87:0/3559192482 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fbc38103750 msgr2=0x7fbc38103b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:25:06.196 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:06.194+0000 7fbc3ea00700 1 --2- 172.21.15.87:0/3559192482 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fbc38103750 0x7fbc38103b30 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fbc280099c0 tx=0x7fbc28009cd0 comp rx=0 tx=0).stop 2024-05-08T05:25:06.197 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:06.194+0000 7fbc3ea00700 1 -- 172.21.15.87:0/3559192482 shutdown_connections 2024-05-08T05:25:06.197 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:06.194+0000 7fbc3ea00700 1 --2- 172.21.15.87:0/3559192482 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fbc38108850 0x7fbc381103d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:25:06.197 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:06.194+0000 7fbc3ea00700 1 --2- 172.21.15.87:0/3559192482 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fbc38103750 0x7fbc38103b30 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:25:06.197 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:06.194+0000 7fbc3ea00700 1 --2- 172.21.15.87:0/3559192482 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fbc38104100 0x7fbc38108120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:25:06.197 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:06.194+0000 7fbc3ea00700 1 -- 172.21.15.87:0/3559192482 >> 172.21.15.87:0/3559192482 conn(0x7fbc3807a600 msgr2=0x7fbc3807aa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:25:06.197 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:06.194+0000 7fbc3ea00700 1 -- 172.21.15.87:0/3559192482 shutdown_connections 2024-05-08T05:25:06.197 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:06.195+0000 7fbc3ea00700 1 -- 172.21.15.87:0/3559192482 wait complete. 2024-05-08T05:25:06.197 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:06.196+0000 7fbc3ea00700 1 Processor -- start 2024-05-08T05:25:06.198 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:06.196+0000 7fbc3ea00700 1 -- start start 2024-05-08T05:25:06.199 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:06.197+0000 7fbc3ea00700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fbc38103750 0x7fbc3819f770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:25:06.199 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:06.197+0000 7fbc3ea00700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fbc38104100 0x7fbc3819fcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:25:06.199 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:06.197+0000 7fbc3ea00700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fbc38108850 0x7fbc38199930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:25:06.199 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:06.197+0000 7fbc3ea00700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fbc38113670 con 0x7fbc38103750 2024-05-08T05:25:06.199 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:06.197+0000 7fbc3ea00700 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fbc381134f0 con 0x7fbc38108850 2024-05-08T05:25:06.199 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:06.197+0000 7fbc3ea00700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7fbc381137f0 con 0x7fbc38104100 2024-05-08T05:25:06.199 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:06.197+0000 7fbc37400700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fbc38104100 0x7fbc3819fcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:25:06.199 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:06.197+0000 7fbc37e00700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fbc38103750 0x7fbc3819f770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:25:06.199 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:06.197+0000 7fbc37400700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fbc38104100 0x7fbc3819fcb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.87:36678/0 (socket says 172.21.15.87:36678) 2024-05-08T05:25:06.199 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:06.197+0000 7fbc37400700 1 -- 172.21.15.87:0/3970555604 learned_addr learned my addr 172.21.15.87:0/3970555604 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T05:25:06.199 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:06.197+0000 7fbc3ca00700 1 --2- 172.21.15.87:0/3970555604 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fbc38108850 0x7fbc38199930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:25:06.201 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:06.198+0000 7fbc37e00700 1 -- 172.21.15.87:0/3970555604 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fbc38104100 msgr2=0x7fbc3819fcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:25:06.201 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:06.198+0000 7fbc37e00700 1 --2- 172.21.15.87:0/3970555604 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fbc38104100 0x7fbc3819fcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:25:06.201 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:06.198+0000 7fbc37e00700 1 -- 172.21.15.87:0/3970555604 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fbc38108850 msgr2=0x7fbc38199930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:25:06.201 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:06.198+0000 7fbc37e00700 1 --2- 172.21.15.87:0/3970555604 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fbc38108850 0x7fbc38199930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:25:06.201 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:06.198+0000 7fbc37e00700 1 -- 172.21.15.87:0/3970555604 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbc3819a090 con 0x7fbc38103750 2024-05-08T05:25:06.201 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:06.198+0000 7fbc37e00700 1 --2- 172.21.15.87:0/3970555604 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fbc38103750 0x7fbc3819f770 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fbc280098e0 tx=0x7fbc280055f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:25:06.201 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:06.198+0000 7fbc34c00700 1 -- 172.21.15.87:0/3970555604 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc28026070 con 0x7fbc38103750 2024-05-08T05:25:06.202 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:06.198+0000 7fbc34c00700 1 -- 172.21.15.87:0/3970555604 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbc2800f460 con 0x7fbc38103750 2024-05-08T05:25:06.202 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:06.199+0000 7fbc3ea00700 1 -- 172.21.15.87:0/3970555604 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbc3819a320 con 0x7fbc38103750 2024-05-08T05:25:06.202 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:06.199+0000 7fbc34c00700 1 -- 172.21.15.87:0/3970555604 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc28009e60 con 0x7fbc38103750 2024-05-08T05:25:06.202 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:06.199+0000 7fbc3ea00700 1 -- 172.21.15.87:0/3970555604 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbc381a6640 con 0x7fbc38103750 2024-05-08T05:25:06.202 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:06.200+0000 7fbc3ea00700 1 -- 172.21.15.87:0/3970555604 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbc38104be0 con 0x7fbc38103750 2024-05-08T05:25:06.203 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:06.202+0000 7fbc34c00700 1 -- 172.21.15.87:0/3970555604 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 16) ==== 149652+0+0 (secure 0 0 0) 0x7fbc28029070 con 0x7fbc38103750 2024-05-08T05:25:06.206 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:06.205+0000 7fbc34c00700 1 --2- 172.21.15.87:0/3970555604 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7fbc1c0b2880 0x7fbc1c0b4d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:25:06.206 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:06.205+0000 7fbc34c00700 1 -- 172.21.15.87:0/3970555604 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 7127+0+0 (secure 0 0 0) 0x7fbc280e24e0 con 0x7fbc38103750 2024-05-08T05:25:06.206 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:06.205+0000 7fbc37400700 1 --2- 172.21.15.87:0/3970555604 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7fbc1c0b2880 0x7fbc1c0b4d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:25:06.207 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:06.206+0000 7fbc37400700 1 --2- 172.21.15.87:0/3970555604 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7fbc1c0b2880 0x7fbc1c0b4d40 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fbc38103080 tx=0x7fbc24009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:25:06.211 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:06.210+0000 7fbc34c00700 1 -- 172.21.15.87:0/3970555604 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7fbc28013070 con 0x7fbc38103750 2024-05-08T05:25:06.459 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:25:05 smithi087 ceph-mon[29523]: pgmap v294: 1 pgs: 1 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-08T05:25:06.459 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:25:05 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:25:06.459 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:25:05 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:25:06.459 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:25:05 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:25:06.459 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:25:05 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-08T05:25:06.459 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:25:05 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-08T05:25:06.459 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:25:05 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T05:25:06.483 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:25:05 smithi090 ceph-mon[34526]: pgmap v294: 1 pgs: 1 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-08T05:25:06.483 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:25:05 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:25:06.483 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:25:05 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:25:06.483 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:25:05 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:25:06.483 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:25:05 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-08T05:25:06.484 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:25:05 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-08T05:25:06.484 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:25:05 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T05:25:06.497 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:06.494+0000 7fbc3ea00700 1 -- 172.21.15.87:0/3970555604 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fbc3802e510 con 0x7fbc38103750 2024-05-08T05:25:06.497 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:06.495+0000 7fbc34c00700 1 -- 172.21.15.87:0/3970555604 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 10 v10) ==== 94+0+7998 (secure 0 0 0) 0x7fbc280aa690 con 0x7fbc38103750 2024-05-08T05:25:06.498 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-05-08T05:25:06.498 INFO:teuthology.orchestra.run.smithi087.stdout:{"epoch":10,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14358,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6835/1183985321","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6834","nonce":1183985321},{"type":"v1","addr":"172.21.15.87:6835","nonce":1183985321}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14370,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6837/1485824316","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6836","nonce":1485824316},{"type":"v1","addr":"172.21.15.87:6837","nonce":1485824316}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24412,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6833/3339455985","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6832","nonce":3339455985},{"type":"v1","addr":"172.21.15.160:6833","nonce":3339455985}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24413,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6833/3292166873","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6832","nonce":3292166873},{"type":"v1","addr":"172.21.15.90:6833","nonce":3292166873}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24443,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6835/824555459","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6834","nonce":824555459},{"type":"v1","addr":"172.21.15.90:6835","nonce":824555459}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24463,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6835/409648357","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6834","nonce":409648357},{"type":"v1","addr":"172.21.15.160:6835","nonce":409648357}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24467,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6837/4221919418","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6836","nonce":4221919418},{"type":"v1","addr":"172.21.15.90:6837","nonce":4221919418}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24469,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6837/4200018040","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6836","nonce":4200018040},{"type":"v1","addr":"172.21.15.160:6837","nonce":4200018040}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24481,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6839/234657686","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6838","nonce":234657686},{"type":"v1","addr":"172.21.15.160:6839","nonce":234657686}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10}],"filesystems":[]} 2024-05-08T05:25:06.500 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:06.498+0000 7fbc3ea00700 1 -- 172.21.15.87:0/3970555604 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7fbc1c0b2880 msgr2=0x7fbc1c0b4d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:25:06.501 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:06.498+0000 7fbc3ea00700 1 --2- 172.21.15.87:0/3970555604 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7fbc1c0b2880 0x7fbc1c0b4d40 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fbc38103080 tx=0x7fbc24009260 comp rx=0 tx=0).stop 2024-05-08T05:25:06.501 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:06.498+0000 7fbc3ea00700 1 -- 172.21.15.87:0/3970555604 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fbc38103750 msgr2=0x7fbc3819f770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:25:06.501 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:06.498+0000 7fbc3ea00700 1 --2- 172.21.15.87:0/3970555604 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fbc38103750 0x7fbc3819f770 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fbc280098e0 tx=0x7fbc280055f0 comp rx=0 tx=0).stop 2024-05-08T05:25:06.501 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:06.498+0000 7fbc3ea00700 1 -- 172.21.15.87:0/3970555604 shutdown_connections 2024-05-08T05:25:06.501 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:06.498+0000 7fbc3ea00700 1 --2- 172.21.15.87:0/3970555604 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fbc38108850 0x7fbc38199930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:25:06.501 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:06.498+0000 7fbc3ea00700 1 --2- 172.21.15.87:0/3970555604 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fbc38103750 0x7fbc3819f770 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:25:06.502 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:06.498+0000 7fbc3ea00700 1 --2- 172.21.15.87:0/3970555604 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7fbc1c0b2880 0x7fbc1c0b4d40 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:25:06.502 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:06.498+0000 7fbc3ea00700 1 --2- 172.21.15.87:0/3970555604 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fbc38104100 0x7fbc3819fcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:25:06.502 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:06.498+0000 7fbc3ea00700 1 -- 172.21.15.87:0/3970555604 >> 172.21.15.87:0/3970555604 conn(0x7fbc3807a600 msgr2=0x7fbc38101690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:25:06.502 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:06.498+0000 7fbc3ea00700 1 -- 172.21.15.87:0/3970555604 shutdown_connections 2024-05-08T05:25:06.502 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:06.499+0000 7fbc3ea00700 1 -- 172.21.15.87:0/3970555604 wait complete. 2024-05-08T05:25:06.503 INFO:teuthology.orchestra.run.smithi087.stderr:dumped fsmap epoch 10 2024-05-08T05:25:07.209 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:25:06 smithi087 ceph-mon[29523]: Deploying daemon mds.g on smithi087 2024-05-08T05:25:07.209 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:25:06 smithi087 ceph-mon[29523]: mds.? [v2:172.21.15.160:6838/234657686,v1:172.21.15.160:6839/234657686] up:boot 2024-05-08T05:25:07.209 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:25:06 smithi087 ceph-mon[29523]: fsmap 9 up:standby 2024-05-08T05:25:07.209 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:25:06 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-05-08T05:25:07.209 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:25:06 smithi087 ceph-mon[29523]: from='client.? 172.21.15.87:0/3970555604' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T05:25:07.289 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:25:06 smithi160 ceph-mon[34827]: Deploying daemon mds.g on smithi087 2024-05-08T05:25:07.289 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:25:06 smithi160 ceph-mon[34827]: mds.? [v2:172.21.15.160:6838/234657686,v1:172.21.15.160:6839/234657686] up:boot 2024-05-08T05:25:07.289 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:25:06 smithi160 ceph-mon[34827]: fsmap 9 up:standby 2024-05-08T05:25:07.289 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:25:06 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-05-08T05:25:07.289 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:25:06 smithi160 ceph-mon[34827]: from='client.? 172.21.15.87:0/3970555604' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T05:25:07.483 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:25:06 smithi090 ceph-mon[34526]: Deploying daemon mds.g on smithi087 2024-05-08T05:25:07.484 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:25:06 smithi090 ceph-mon[34526]: mds.? [v2:172.21.15.160:6838/234657686,v1:172.21.15.160:6839/234657686] up:boot 2024-05-08T05:25:07.484 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:25:06 smithi090 ceph-mon[34526]: fsmap 9 up:standby 2024-05-08T05:25:07.484 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:25:06 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-05-08T05:25:07.484 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:25:06 smithi090 ceph-mon[34526]: from='client.? 172.21.15.87:0/3970555604' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T05:25:08.026 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:25:07 smithi087 ceph-mon[29523]: pgmap v295: 1 pgs: 1 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-08T05:25:08.168 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:25:07 smithi160 ceph-mon[34827]: pgmap v295: 1 pgs: 1 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-08T05:25:08.483 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:25:07 smithi090 ceph-mon[34526]: pgmap v295: 1 pgs: 1 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-08T05:25:09.427 DEBUG:teuthology.orchestra.run.smithi087:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid eeeb813e-0cf9-11ef-bc97-c7b262605968 -- ceph fs dump --format=json 2024-05-08T05:25:09.958 INFO:journalctl@ceph.mds.g.smithi087.stdout:May 08 05:25:09 smithi087 systemd[1]: Starting Ceph mds.g for eeeb813e-0cf9-11ef-bc97-c7b262605968... 2024-05-08T05:25:10.288 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:25:10 smithi160 ceph-mon[34827]: pgmap v296: 1 pgs: 1 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-08T05:25:10.293 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:25:10 smithi087 ceph-mon[29523]: pgmap v296: 1 pgs: 1 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-08T05:25:10.294 INFO:journalctl@ceph.mds.g.smithi087.stdout:May 08 05:25:09 smithi087 podman[71501]: 2024-05-08 05:25:09.884109239 +0000 UTC m=+0.037558426 image pull 352576a2df49fbab3aeeba1effbcb7a94815e8fc1f120a55ddc340b4ee63b8ce quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c 2024-05-08T05:25:10.294 INFO:journalctl@ceph.mds.g.smithi087.stdout:May 08 05:25:09 smithi087 podman[71501]: 2024-05-08 05:25:09.996764517 +0000 UTC m=+0.150213720 container create da5c165e8e9cd054955db744e6759768784db458bf31943b56d316dfe0804124 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c, name=ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-mds-g, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240507, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , RELEASE=wip-57676-3-bee299f, org.label-schema.license=GPLv2, ceph=True, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=) 2024-05-08T05:25:10.294 INFO:journalctl@ceph.mds.g.smithi087.stdout:May 08 05:25:10 smithi087 podman[71501]: 2024-05-08 05:25:10.292995914 +0000 UTC m=+0.446445136 container init da5c165e8e9cd054955db744e6759768784db458bf31943b56d316dfe0804124 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c, name=ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-mds-g, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240507, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-57676-3-bee299f, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, GIT_CLEAN=True, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=) 2024-05-08T05:25:10.397 INFO:teuthology.orchestra.run.smithi087.stderr:Inferring config /var/lib/ceph/eeeb813e-0cf9-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T05:25:10.483 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:25:10 smithi090 ceph-mon[34526]: pgmap v296: 1 pgs: 1 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-08T05:25:10.546 INFO:journalctl@ceph.mds.g.smithi087.stdout:May 08 05:25:10 smithi087 podman[71501]: 2024-05-08 05:25:10.303165572 +0000 UTC m=+0.456614791 container start da5c165e8e9cd054955db744e6759768784db458bf31943b56d316dfe0804124 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c, name=ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-mds-g, ceph=True, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , RELEASE=wip-57676-3-bee299f, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240507, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504) 2024-05-08T05:25:10.546 INFO:journalctl@ceph.mds.g.smithi087.stdout:May 08 05:25:10 smithi087 ceph-mds[71539]: -- 172.21.15.87:0/2944875281 <== mon.2 v2:172.21.15.90:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55cd6c753a40 con 0x55cd6c726c00 2024-05-08T05:25:10.546 INFO:journalctl@ceph.mds.g.smithi087.stdout:May 08 05:25:10 smithi087 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-mds-g[71534]: starting mds.g at 2024-05-08T05:25:10.546 INFO:journalctl@ceph.mds.g.smithi087.stdout:May 08 05:25:10 smithi087 bash[71501]: da5c165e8e9cd054955db744e6759768784db458bf31943b56d316dfe0804124 2024-05-08T05:25:10.546 INFO:journalctl@ceph.mds.g.smithi087.stdout:May 08 05:25:10 smithi087 systemd[1]: Started Ceph mds.g for eeeb813e-0cf9-11ef-bc97-c7b262605968. 2024-05-08T05:25:11.709 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:25:11 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:25:11.709 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:25:11 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:25:11.709 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:25:11 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:25:11.709 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:25:11 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-08T05:25:11.709 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:25:11 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-08T05:25:11.709 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:25:11 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T05:25:11.709 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:25:11 smithi087 ceph-mon[29523]: Deploying daemon mds.a on smithi087 2024-05-08T05:25:11.709 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:25:11 smithi087 ceph-mon[29523]: mds.? [v2:172.21.15.87:6838/2127215876,v1:172.21.15.87:6839/2127215876] up:boot 2024-05-08T05:25:11.709 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:25:11 smithi087 ceph-mon[29523]: fsmap 10 up:standby 2024-05-08T05:25:11.709 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:25:11 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-05-08T05:25:11.733 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:25:11 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:25:11.733 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:25:11 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:25:11.734 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:25:11 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:25:11.734 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:25:11 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-08T05:25:11.734 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:25:11 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-08T05:25:11.734 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:25:11 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T05:25:11.734 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:25:11 smithi090 ceph-mon[34526]: Deploying daemon mds.a on smithi087 2024-05-08T05:25:11.734 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:25:11 smithi090 ceph-mon[34526]: mds.? [v2:172.21.15.87:6838/2127215876,v1:172.21.15.87:6839/2127215876] up:boot 2024-05-08T05:25:11.734 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:25:11 smithi090 ceph-mon[34526]: fsmap 10 up:standby 2024-05-08T05:25:11.734 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:25:11 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-05-08T05:25:11.789 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:25:11 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:25:11.789 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:25:11 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:25:11.789 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:25:11 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:25:11.789 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:25:11 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-08T05:25:11.789 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:25:11 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-08T05:25:11.789 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:25:11 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T05:25:11.789 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:25:11 smithi160 ceph-mon[34827]: Deploying daemon mds.a on smithi087 2024-05-08T05:25:11.789 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:25:11 smithi160 ceph-mon[34827]: mds.? [v2:172.21.15.87:6838/2127215876,v1:172.21.15.87:6839/2127215876] up:boot 2024-05-08T05:25:11.789 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:25:11 smithi160 ceph-mon[34827]: fsmap 10 up:standby 2024-05-08T05:25:11.789 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:25:11 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-05-08T05:25:12.633 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:25:12 smithi087 ceph-mon[29523]: pgmap v297: 1 pgs: 1 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-08T05:25:12.792 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:12.791+0000 7ffab0800700 1 -- 172.21.15.87:0/1103465491 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ffaa810b6c0 msgr2=0x7ffaa810baa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:25:12.793 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:12.791+0000 7ffab0800700 1 --2- 172.21.15.87:0/1103465491 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ffaa810b6c0 0x7ffaa810baa0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7ffa9c009990 tx=0x7ffa9c009ca0 comp rx=0 tx=0).stop 2024-05-08T05:25:12.793 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:12.791+0000 7ffab0800700 1 -- 172.21.15.87:0/1103465491 shutdown_connections 2024-05-08T05:25:12.793 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:12.791+0000 7ffab0800700 1 --2- 172.21.15.87:0/1103465491 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ffaa8106080 0x7ffaa8112590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:25:12.793 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:12.791+0000 7ffab0800700 1 --2- 172.21.15.87:0/1103465491 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ffaa810b6c0 0x7ffaa810baa0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:25:12.793 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:12.791+0000 7ffab0800700 1 --2- 172.21.15.87:0/1103465491 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ffaa81056c0 0x7ffaa8105b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:25:12.793 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:12.791+0000 7ffab0800700 1 -- 172.21.15.87:0/1103465491 >> 172.21.15.87:0/1103465491 conn(0x7ffaa81011b0 msgr2=0x7ffaa81035d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:25:12.793 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:12.791+0000 7ffab0800700 1 -- 172.21.15.87:0/1103465491 shutdown_connections 2024-05-08T05:25:12.793 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:12.791+0000 7ffab0800700 1 -- 172.21.15.87:0/1103465491 wait complete. 2024-05-08T05:25:12.794 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:12.792+0000 7ffab0800700 1 Processor -- start 2024-05-08T05:25:12.794 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:12.792+0000 7ffab0800700 1 -- start start 2024-05-08T05:25:12.794 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:12.793+0000 7ffab0800700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ffaa81056c0 0x7ffaa819bda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:25:12.795 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:12.793+0000 7ffab0800700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ffaa8106080 0x7ffaa819c2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:25:12.795 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:12.793+0000 7ffab0800700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ffaa810b6c0 0x7ffaa81a0670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:25:12.795 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:12.793+0000 7ffab0800700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7ffaa8115910 con 0x7ffaa81056c0 2024-05-08T05:25:12.795 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:12.793+0000 7ffab0800700 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7ffaa8115790 con 0x7ffaa8106080 2024-05-08T05:25:12.795 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:12.793+0000 7ffab0800700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7ffaa8115a90 con 0x7ffaa810b6c0 2024-05-08T05:25:12.795 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:12.793+0000 7ffaade00700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ffaa81056c0 0x7ffaa819bda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:25:12.795 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:12.793+0000 7ffaad400700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ffaa8106080 0x7ffaa819c2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:25:12.795 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:12.793+0000 7ffaad400700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ffaa8106080 0x7ffaa819c2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.87:49554/0 (socket says 172.21.15.87:49554) 2024-05-08T05:25:12.795 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:12.793+0000 7ffaade00700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ffaa81056c0 0x7ffaa819bda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:36948/0 (socket says 172.21.15.87:36948) 2024-05-08T05:25:12.795 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:12.793+0000 7ffaad400700 1 -- 172.21.15.87:0/3272927655 learned_addr learned my addr 172.21.15.87:0/3272927655 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T05:25:12.795 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:12.793+0000 7ffaae800700 1 --2- 172.21.15.87:0/3272927655 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ffaa810b6c0 0x7ffaa81a0670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:25:12.796 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:12.794+0000 7ffaad400700 1 -- 172.21.15.87:0/3272927655 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ffaa810b6c0 msgr2=0x7ffaa81a0670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:25:12.796 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:12.794+0000 7ffaad400700 1 --2- 172.21.15.87:0/3272927655 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ffaa810b6c0 0x7ffaa81a0670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:25:12.797 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:12.794+0000 7ffaad400700 1 -- 172.21.15.87:0/3272927655 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ffaa81056c0 msgr2=0x7ffaa819bda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:25:12.797 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:12.794+0000 7ffaad400700 1 --2- 172.21.15.87:0/3272927655 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ffaa81056c0 0x7ffaa819bda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:25:12.797 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:12.794+0000 7ffaad400700 1 -- 172.21.15.87:0/3272927655 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffaa81a0db0 con 0x7ffaa8106080 2024-05-08T05:25:12.797 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:12.794+0000 7ffaad400700 1 --2- 172.21.15.87:0/3272927655 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ffaa8106080 0x7ffaa819c2e0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7ffa9800e9c0 tx=0x7ffa9800ecd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:25:12.797 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:12.794+0000 7ffaa2a00700 1 -- 172.21.15.87:0/3272927655 <== mon.2 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa9800cbd0 con 0x7ffaa8106080 2024-05-08T05:25:12.797 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:12.794+0000 7ffaa2a00700 1 -- 172.21.15.87:0/3272927655 <== mon.2 v2:172.21.15.90:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ffa9800ee60 con 0x7ffaa8106080 2024-05-08T05:25:12.797 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:12.794+0000 7ffab0800700 1 -- 172.21.15.87:0/3272927655 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffaa81a10a0 con 0x7ffaa8106080 2024-05-08T05:25:12.797 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:12.794+0000 7ffaa2a00700 1 -- 172.21.15.87:0/3272927655 <== mon.2 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa980055c0 con 0x7ffaa8106080 2024-05-08T05:25:12.797 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:12.794+0000 7ffab0800700 1 -- 172.21.15.87:0/3272927655 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffaa81a8920 con 0x7ffaa8106080 2024-05-08T05:25:12.798 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:12.796+0000 7ffab0800700 1 -- 172.21.15.87:0/3272927655 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffaa806a190 con 0x7ffaa8106080 2024-05-08T05:25:12.800 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:12.798+0000 7ffaa2a00700 1 -- 172.21.15.87:0/3272927655 <== mon.2 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 16) ==== 149652+0+0 (secure 0 0 0) 0x7ffa98004750 con 0x7ffaa8106080 2024-05-08T05:25:12.801 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:12.800+0000 7ffaa2a00700 1 --2- 172.21.15.87:0/3272927655 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7ffa900b2900 0x7ffa900b4dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:25:12.801 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:12.800+0000 7ffaa2a00700 1 -- 172.21.15.87:0/3272927655 <== mon.2 v2:172.21.15.90:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 7127+0+0 (secure 0 0 0) 0x7ffa980e1ff0 con 0x7ffaa8106080 2024-05-08T05:25:12.802 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:12.800+0000 7ffaade00700 1 --2- 172.21.15.87:0/3272927655 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7ffa900b2900 0x7ffa900b4dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:25:12.802 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:12.801+0000 7ffaade00700 1 --2- 172.21.15.87:0/3272927655 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7ffa900b2900 0x7ffa900b4dc0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7ffa9c00b2e0 tx=0x7ffa9c005fd0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:25:12.805 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:12.804+0000 7ffaa2a00700 1 -- 172.21.15.87:0/3272927655 <== mon.2 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7ffa980aa130 con 0x7ffaa8106080 2024-05-08T05:25:12.983 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:25:12 smithi090 ceph-mon[34526]: pgmap v297: 1 pgs: 1 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-08T05:25:13.038 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:25:12 smithi160 ceph-mon[34827]: pgmap v297: 1 pgs: 1 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-08T05:25:13.093 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:13.091+0000 7ffab0800700 1 -- 172.21.15.87:0/3272927655 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ffaa802e510 con 0x7ffaa8106080 2024-05-08T05:25:13.094 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:13.092+0000 7ffaa2a00700 1 -- 172.21.15.87:0/3272927655 <== mon.2 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 11 v11) ==== 94+0+8824 (secure 0 0 0) 0x7ffa980a9a30 con 0x7ffaa8106080 2024-05-08T05:25:13.094 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-05-08T05:25:13.094 INFO:teuthology.orchestra.run.smithi087.stdout:{"epoch":11,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14358,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6835/1183985321","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6834","nonce":1183985321},{"type":"v1","addr":"172.21.15.87:6835","nonce":1183985321}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14370,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6837/1485824316","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6836","nonce":1485824316},{"type":"v1","addr":"172.21.15.87:6837","nonce":1485824316}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24412,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6833/3339455985","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6832","nonce":3339455985},{"type":"v1","addr":"172.21.15.160:6833","nonce":3339455985}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24413,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6833/3292166873","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6832","nonce":3292166873},{"type":"v1","addr":"172.21.15.90:6833","nonce":3292166873}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24443,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6835/824555459","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6834","nonce":824555459},{"type":"v1","addr":"172.21.15.90:6835","nonce":824555459}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24463,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6835/409648357","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6834","nonce":409648357},{"type":"v1","addr":"172.21.15.160:6835","nonce":409648357}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24467,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6837/4221919418","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6836","nonce":4221919418},{"type":"v1","addr":"172.21.15.90:6837","nonce":4221919418}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24469,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6837/4200018040","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6836","nonce":4200018040},{"type":"v1","addr":"172.21.15.160:6837","nonce":4200018040}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24481,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6839/234657686","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6838","nonce":234657686},{"type":"v1","addr":"172.21.15.160:6839","nonce":234657686}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":24482,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6839/2127215876","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6838","nonce":2127215876},{"type":"v1","addr":"172.21.15.87:6839","nonce":2127215876}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11}],"filesystems":[]} 2024-05-08T05:25:13.097 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:13.095+0000 7ffab0800700 1 -- 172.21.15.87:0/3272927655 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7ffa900b2900 msgr2=0x7ffa900b4dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:25:13.097 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:13.095+0000 7ffab0800700 1 --2- 172.21.15.87:0/3272927655 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7ffa900b2900 0x7ffa900b4dc0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7ffa9c00b2e0 tx=0x7ffa9c005fd0 comp rx=0 tx=0).stop 2024-05-08T05:25:13.097 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:13.096+0000 7ffab0800700 1 -- 172.21.15.87:0/3272927655 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ffaa8106080 msgr2=0x7ffaa819c2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:25:13.097 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:13.096+0000 7ffab0800700 1 --2- 172.21.15.87:0/3272927655 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ffaa8106080 0x7ffaa819c2e0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7ffa9800e9c0 tx=0x7ffa9800ecd0 comp rx=0 tx=0).stop 2024-05-08T05:25:13.098 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:13.096+0000 7ffab0800700 1 -- 172.21.15.87:0/3272927655 shutdown_connections 2024-05-08T05:25:13.098 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:13.096+0000 7ffab0800700 1 --2- 172.21.15.87:0/3272927655 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7ffa900b2900 0x7ffa900b4dc0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:25:13.098 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:13.096+0000 7ffab0800700 1 --2- 172.21.15.87:0/3272927655 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ffaa810b6c0 0x7ffaa81a0670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:25:13.098 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:13.096+0000 7ffab0800700 1 --2- 172.21.15.87:0/3272927655 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ffaa81056c0 0x7ffaa819bda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:25:13.098 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:13.096+0000 7ffab0800700 1 --2- 172.21.15.87:0/3272927655 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ffaa8106080 0x7ffaa819c2e0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:25:13.098 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:13.096+0000 7ffab0800700 1 -- 172.21.15.87:0/3272927655 >> 172.21.15.87:0/3272927655 conn(0x7ffaa81011b0 msgr2=0x7ffaa8101850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:25:13.098 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:13.096+0000 7ffab0800700 1 -- 172.21.15.87:0/3272927655 shutdown_connections 2024-05-08T05:25:13.098 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:13.096+0000 7ffab0800700 1 -- 172.21.15.87:0/3272927655 wait complete. 2024-05-08T05:25:13.099 INFO:teuthology.orchestra.run.smithi087.stderr:dumped fsmap epoch 11 2024-05-08T05:25:13.959 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:25:13 smithi087 ceph-mon[29523]: from='client.? 172.21.15.87:0/3272927655' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T05:25:13.983 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:25:13 smithi090 ceph-mon[34526]: from='client.? 172.21.15.87:0/3272927655' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T05:25:14.039 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:25:13 smithi160 ceph-mon[34827]: from='client.? 172.21.15.87:0/3272927655' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T05:25:14.708 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:25:14 smithi087 ceph-mon[29523]: pgmap v298: 1 pgs: 1 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-08T05:25:14.983 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:25:14 smithi090 ceph-mon[34526]: pgmap v298: 1 pgs: 1 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-08T05:25:15.020 INFO:journalctl@ceph.mds.a.smithi087.stdout:May 08 05:25:14 smithi087 podman[71926]: 2024-05-08 05:25:14.765484862 +0000 UTC m=+0.142868527 container create 650f7c6a8c2e260dd040430eb75a75a7031fe9abe12fc480fe6ea7f76fb393ef (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c, name=ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-mds-a, org.label-schema.build-date=20240507, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, RELEASE=wip-57676-3-bee299f, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, ceph=True, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image) 2024-05-08T05:25:15.020 INFO:journalctl@ceph.mds.a.smithi087.stdout:May 08 05:25:15 smithi087 podman[71926]: 2024-05-08 05:25:15.018755781 +0000 UTC m=+0.396139470 container init 650f7c6a8c2e260dd040430eb75a75a7031fe9abe12fc480fe6ea7f76fb393ef (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c, name=ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-mds-a, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240507, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-57676-3-bee299f, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, maintainer=Guillaume Abrioux , GIT_CLEAN=True) 2024-05-08T05:25:15.038 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:25:14 smithi160 ceph-mon[34827]: pgmap v298: 1 pgs: 1 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-08T05:25:15.459 INFO:journalctl@ceph.mds.a.smithi087.stdout:May 08 05:25:15 smithi087 podman[71926]: 2024-05-08 05:25:15.029508907 +0000 UTC m=+0.406892605 container start 650f7c6a8c2e260dd040430eb75a75a7031fe9abe12fc480fe6ea7f76fb393ef (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c, name=ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-mds-a, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, RELEASE=wip-57676-3-bee299f, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, ceph=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240507, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504) 2024-05-08T05:25:15.459 INFO:journalctl@ceph.mds.a.smithi087.stdout:May 08 05:25:15 smithi087 ceph-mds[71946]: -- 172.21.15.87:0/1011123665 <== mon.0 v2:172.21.15.87:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5598b30f3a40 con 0x5598b30c7000 2024-05-08T05:25:15.459 INFO:journalctl@ceph.mds.a.smithi087.stdout:May 08 05:25:15 smithi087 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-mds-a[71942]: starting mds.a at 2024-05-08T05:25:15.459 INFO:journalctl@ceph.mds.a.smithi087.stdout:May 08 05:25:15 smithi087 bash[71926]: 650f7c6a8c2e260dd040430eb75a75a7031fe9abe12fc480fe6ea7f76fb393ef 2024-05-08T05:25:15.459 INFO:journalctl@ceph.mds.a.smithi087.stdout:May 08 05:25:15 smithi087 systemd[1]: Started Ceph mds.a for eeeb813e-0cf9-11ef-bc97-c7b262605968. 2024-05-08T05:25:16.483 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:25:16 smithi090 ceph-mon[34526]: pgmap v299: 1 pgs: 1 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-08T05:25:16.484 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:25:16 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:25:16.484 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:25:16 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:25:16.484 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:25:16 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:25:16.484 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:25:16 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-08T05:25:16.484 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:25:16 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-08T05:25:16.484 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:25:16 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T05:25:16.484 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:25:16 smithi090 ceph-mon[34526]: Deploying daemon mds.b on smithi090 2024-05-08T05:25:16.484 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:25:16 smithi090 ceph-mon[34526]: mds.? [v2:172.21.15.87:6840/724277538,v1:172.21.15.87:6841/724277538] up:boot 2024-05-08T05:25:16.484 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:25:16 smithi090 ceph-mon[34526]: fsmap 11 up:standby 2024-05-08T05:25:16.484 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:25:16 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-05-08T05:25:16.489 DEBUG:teuthology.orchestra.run.smithi087:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid eeeb813e-0cf9-11ef-bc97-c7b262605968 -- ceph fs dump --format=json 2024-05-08T05:25:16.539 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:25:16 smithi160 ceph-mon[34827]: pgmap v299: 1 pgs: 1 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-08T05:25:16.539 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:25:16 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:25:16.539 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:25:16 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:25:16.539 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:25:16 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:25:16.539 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:25:16 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-08T05:25:16.539 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:25:16 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-08T05:25:16.540 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:25:16 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T05:25:16.540 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:25:16 smithi160 ceph-mon[34827]: Deploying daemon mds.b on smithi090 2024-05-08T05:25:16.540 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:25:16 smithi160 ceph-mon[34827]: mds.? [v2:172.21.15.87:6840/724277538,v1:172.21.15.87:6841/724277538] up:boot 2024-05-08T05:25:16.540 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:25:16 smithi160 ceph-mon[34827]: fsmap 11 up:standby 2024-05-08T05:25:16.540 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:25:16 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-05-08T05:25:16.570 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:25:16 smithi087 ceph-mon[29523]: pgmap v299: 1 pgs: 1 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-08T05:25:16.570 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:25:16 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:25:16.570 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:25:16 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:25:16.570 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:25:16 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:25:16.570 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:25:16 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-08T05:25:16.571 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:25:16 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-08T05:25:16.571 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:25:16 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T05:25:16.571 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:25:16 smithi087 ceph-mon[29523]: Deploying daemon mds.b on smithi090 2024-05-08T05:25:16.571 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:25:16 smithi087 ceph-mon[29523]: mds.? [v2:172.21.15.87:6840/724277538,v1:172.21.15.87:6841/724277538] up:boot 2024-05-08T05:25:16.571 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:25:16 smithi087 ceph-mon[29523]: fsmap 11 up:standby 2024-05-08T05:25:16.571 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:25:16 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-05-08T05:25:16.944 INFO:teuthology.orchestra.run.smithi087.stderr:Inferring config /var/lib/ceph/eeeb813e-0cf9-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T05:25:17.484 INFO:journalctl@ceph.mds.b.smithi090.stdout:May 08 05:25:17 smithi090 systemd[1]: Starting Ceph mds.b for eeeb813e-0cf9-11ef-bc97-c7b262605968... 2024-05-08T05:25:17.774 INFO:journalctl@ceph.mds.b.smithi090.stdout:May 08 05:25:17 smithi090 podman[64944]: 2024-05-08 05:25:17.520294052 +0000 UTC m=+0.108277409 container create a1364ec0143718cdf48f4d01596946d229e718f826baccd6951e1724aab313a9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c, name=ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-mds-b, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, org.label-schema.license=GPLv2, RELEASE=wip-57676-3-bee299f, GIT_CLEAN=True, org.label-schema.build-date=20240507, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-05-08T05:25:17.775 INFO:journalctl@ceph.mds.b.smithi090.stdout:May 08 05:25:17 smithi090 podman[64944]: 2024-05-08 05:25:17.430708703 +0000 UTC m=+0.018692087 image pull 352576a2df49fbab3aeeba1effbcb7a94815e8fc1f120a55ddc340b4ee63b8ce quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c 2024-05-08T05:25:17.775 INFO:journalctl@ceph.mds.b.smithi090.stdout:May 08 05:25:17 smithi090 podman[64944]: 2024-05-08 05:25:17.74809772 +0000 UTC m=+0.336081070 container init a1364ec0143718cdf48f4d01596946d229e718f826baccd6951e1724aab313a9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c, name=ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-mds-b, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-57676-3-bee299f, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, org.label-schema.build-date=20240507, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.license=GPLv2, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.schema-version=1.0) 2024-05-08T05:25:17.775 INFO:journalctl@ceph.mds.b.smithi090.stdout:May 08 05:25:17 smithi090 podman[64944]: 2024-05-08 05:25:17.75085443 +0000 UTC m=+0.338837781 container start a1364ec0143718cdf48f4d01596946d229e718f826baccd6951e1724aab313a9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c, name=ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-mds-b, ceph=True, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.build-date=20240507, CEPH_POINT_RELEASE=, GIT_CLEAN=True, RELEASE=wip-57676-3-bee299f, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-05-08T05:25:18.085 INFO:journalctl@ceph.mds.b.smithi090.stdout:May 08 05:25:17 smithi090 ceph-mds[64963]: -- 172.21.15.90:0/2474187720 <== mon.2 v2:172.21.15.90:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55bb7fea1a40 con 0x55bb7fe74800 2024-05-08T05:25:18.085 INFO:journalctl@ceph.mds.b.smithi090.stdout:May 08 05:25:17 smithi090 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-mds-b[64959]: starting mds.b at 2024-05-08T05:25:18.085 INFO:journalctl@ceph.mds.b.smithi090.stdout:May 08 05:25:17 smithi090 bash[64944]: a1364ec0143718cdf48f4d01596946d229e718f826baccd6951e1724aab313a9 2024-05-08T05:25:18.085 INFO:journalctl@ceph.mds.b.smithi090.stdout:May 08 05:25:17 smithi090 systemd[1]: Started Ceph mds.b for eeeb813e-0cf9-11ef-bc97-c7b262605968. 2024-05-08T05:25:18.343 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:25:18 smithi090 ceph-mon[34526]: pgmap v300: 1 pgs: 1 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-08T05:25:18.343 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:25:18 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:25:18.343 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:25:18 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:25:18.344 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:25:18 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:25:18.344 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:25:18 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:25:18.344 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:25:18 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:25:18.344 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:25:18 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T05:25:18.456 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:25:18 smithi087 ceph-mon[29523]: pgmap v300: 1 pgs: 1 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-08T05:25:18.456 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:25:18 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:25:18.456 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:25:18 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:25:18.456 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:25:18 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:25:18.456 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:25:18 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:25:18.456 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:25:18 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:25:18.456 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:25:18 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T05:25:18.538 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:25:18 smithi160 ceph-mon[34827]: pgmap v300: 1 pgs: 1 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-08T05:25:18.539 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:25:18 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:25:18.539 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:25:18 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:25:18.539 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:25:18 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:25:18.539 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:25:18 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:25:18.539 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:25:18 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:25:18.539 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:25:18 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T05:25:18.967 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:18.966+0000 7f1169000700 1 -- 172.21.15.87:0/1744179705 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1164104100 msgr2=0x7f1164108120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:25:18.967 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:18.966+0000 7f1169000700 1 --2- 172.21.15.87:0/1744179705 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1164104100 0x7f1164108120 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f11500099c0 tx=0x7f1150009cd0 comp rx=0 tx=0).stop 2024-05-08T05:25:18.967 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:18.966+0000 7f1169000700 1 -- 172.21.15.87:0/1744179705 shutdown_connections 2024-05-08T05:25:18.967 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:18.966+0000 7f1169000700 1 --2- 172.21.15.87:0/1744179705 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1164108850 0x7f11641103d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:25:18.967 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:18.966+0000 7f1169000700 1 --2- 172.21.15.87:0/1744179705 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1164103750 0x7f1164103b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:25:18.967 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:18.966+0000 7f1169000700 1 --2- 172.21.15.87:0/1744179705 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1164104100 0x7f1164108120 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:25:18.967 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:18.966+0000 7f1169000700 1 -- 172.21.15.87:0/1744179705 >> 172.21.15.87:0/1744179705 conn(0x7f116407a600 msgr2=0x7f116407aa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:25:18.967 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:18.966+0000 7f1169000700 1 -- 172.21.15.87:0/1744179705 shutdown_connections 2024-05-08T05:25:18.967 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:18.966+0000 7f1169000700 1 -- 172.21.15.87:0/1744179705 wait complete. 2024-05-08T05:25:18.969 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:18.967+0000 7f1169000700 1 Processor -- start 2024-05-08T05:25:18.969 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:18.967+0000 7f1169000700 1 -- start start 2024-05-08T05:25:18.969 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:18.967+0000 7f1169000700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1164103750 0x7f116419bd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:25:18.969 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:18.967+0000 7f1169000700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1164104100 0x7f116419c270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:25:18.969 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:18.967+0000 7f1169000700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1164108850 0x7f11641a0600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:25:18.970 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:18.967+0000 7f1169000700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f1164113680 con 0x7f1164104100 2024-05-08T05:25:18.970 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:18.967+0000 7f1169000700 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f1164113500 con 0x7f1164103750 2024-05-08T05:25:18.970 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:18.967+0000 7f1169000700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f1164113800 con 0x7f1164108850 2024-05-08T05:25:18.970 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:18.968+0000 7f1161e00700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1164103750 0x7f116419bd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:25:18.970 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:18.968+0000 7f1161e00700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1164103750 0x7f116419bd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.87:43868/0 (socket says 172.21.15.87:43868) 2024-05-08T05:25:18.970 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:18.968+0000 7f1161e00700 1 -- 172.21.15.87:0/1397806696 learned_addr learned my addr 172.21.15.87:0/1397806696 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T05:25:18.970 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:18.968+0000 7f1162800700 1 --2- 172.21.15.87:0/1397806696 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1164108850 0x7f11641a0600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:25:18.970 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:18.968+0000 7f1161400700 1 --2- 172.21.15.87:0/1397806696 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1164104100 0x7f116419c270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:25:18.970 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:18.968+0000 7f1161e00700 1 -- 172.21.15.87:0/1397806696 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1164108850 msgr2=0x7f11641a0600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:25:18.970 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:18.968+0000 7f1161e00700 1 --2- 172.21.15.87:0/1397806696 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1164108850 0x7f11641a0600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:25:18.970 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:18.968+0000 7f1161e00700 1 -- 172.21.15.87:0/1397806696 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1164104100 msgr2=0x7f116419c270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:25:18.970 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:18.968+0000 7f1161e00700 1 --2- 172.21.15.87:0/1397806696 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1164104100 0x7f116419c270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:25:18.970 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:18.968+0000 7f1161e00700 1 -- 172.21.15.87:0/1397806696 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f11641a0d40 con 0x7f1164103750 2024-05-08T05:25:18.971 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:18.968+0000 7f1161400700 1 --2- 172.21.15.87:0/1397806696 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1164104100 0x7f116419c270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T05:25:18.971 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:18.968+0000 7f1161e00700 1 --2- 172.21.15.87:0/1397806696 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1164103750 0x7f116419bd30 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f115400e9c0 tx=0x7f115400ecd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:25:18.971 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:18.969+0000 7f115aa00700 1 -- 172.21.15.87:0/1397806696 <== mon.2 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f115400cbd0 con 0x7f1164103750 2024-05-08T05:25:18.971 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:18.969+0000 7f115aa00700 1 -- 172.21.15.87:0/1397806696 <== mon.2 v2:172.21.15.90:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f115400cd70 con 0x7f1164103750 2024-05-08T05:25:18.971 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:18.969+0000 7f115aa00700 1 -- 172.21.15.87:0/1397806696 <== mon.2 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1154005610 con 0x7f1164103750 2024-05-08T05:25:18.971 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:18.969+0000 7f1169000700 1 -- 172.21.15.87:0/1397806696 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f11641a1030 con 0x7f1164103750 2024-05-08T05:25:18.971 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:18.969+0000 7f1169000700 1 -- 172.21.15.87:0/1397806696 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f11641a88b0 con 0x7f1164103750 2024-05-08T05:25:18.971 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:18.970+0000 7f1169000700 1 -- 172.21.15.87:0/1397806696 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f116406a190 con 0x7f1164103750 2024-05-08T05:25:18.972 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:18.972+0000 7f115aa00700 1 -- 172.21.15.87:0/1397806696 <== mon.2 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 16) ==== 149652+0+0 (secure 0 0 0) 0x7f1154004750 con 0x7f1164103750 2024-05-08T05:25:18.974 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:18.973+0000 7f115aa00700 1 --2- 172.21.15.87:0/1397806696 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f11480b2900 0x7f11480b4dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:25:18.974 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:18.974+0000 7f115aa00700 1 -- 172.21.15.87:0/1397806696 <== mon.2 v2:172.21.15.90:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 7127+0+0 (secure 0 0 0) 0x7f11540e2100 con 0x7f1164103750 2024-05-08T05:25:18.974 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:18.974+0000 7f1161400700 1 --2- 172.21.15.87:0/1397806696 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f11480b2900 0x7f11480b4dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:25:18.974 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:18.974+0000 7f1161400700 1 --2- 172.21.15.87:0/1397806696 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f11480b2900 0x7f11480b4dc0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f1164103480 tx=0x7f1150005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:25:18.978 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:18.977+0000 7f115aa00700 1 -- 172.21.15.87:0/1397806696 <== mon.2 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f11540aa220 con 0x7f1164103750 2024-05-08T05:25:19.281 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:25:19 smithi160 ceph-mon[34827]: mds.? [v2:172.21.15.90:6838/160586017,v1:172.21.15.90:6839/160586017] up:boot 2024-05-08T05:25:19.282 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:25:19 smithi160 ceph-mon[34827]: fsmap 12 up:standby 2024-05-08T05:25:19.282 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:25:19 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-05-08T05:25:19.301 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:19.301+0000 7f1169000700 1 -- 172.21.15.87:0/1397806696 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f11641a8ab0 con 0x7f1164103750 2024-05-08T05:25:19.302 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:19.302+0000 7f115aa00700 1 -- 172.21.15.87:0/1397806696 <== mon.2 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 13 v13) ==== 94+0+10470 (secure 0 0 0) 0x7f11540a9b20 con 0x7f1164103750 2024-05-08T05:25:19.303 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-05-08T05:25:19.303 INFO:teuthology.orchestra.run.smithi087.stdout:{"epoch":13,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14358,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6835/1183985321","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6834","nonce":1183985321},{"type":"v1","addr":"172.21.15.87:6835","nonce":1183985321}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14370,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6837/1485824316","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6836","nonce":1485824316},{"type":"v1","addr":"172.21.15.87:6837","nonce":1485824316}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14409,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6841/724277538","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6840","nonce":724277538},{"type":"v1","addr":"172.21.15.87:6841","nonce":724277538}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24412,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6833/3339455985","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6832","nonce":3339455985},{"type":"v1","addr":"172.21.15.160:6833","nonce":3339455985}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24413,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6833/3292166873","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6832","nonce":3292166873},{"type":"v1","addr":"172.21.15.90:6833","nonce":3292166873}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24443,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6835/824555459","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6834","nonce":824555459},{"type":"v1","addr":"172.21.15.90:6835","nonce":824555459}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24463,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6835/409648357","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6834","nonce":409648357},{"type":"v1","addr":"172.21.15.160:6835","nonce":409648357}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24467,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6837/4221919418","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6836","nonce":4221919418},{"type":"v1","addr":"172.21.15.90:6837","nonce":4221919418}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24469,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6837/4200018040","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6836","nonce":4200018040},{"type":"v1","addr":"172.21.15.160:6837","nonce":4200018040}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24481,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6839/234657686","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6838","nonce":234657686},{"type":"v1","addr":"172.21.15.160:6839","nonce":234657686}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":24482,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6839/2127215876","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6838","nonce":2127215876},{"type":"v1","addr":"172.21.15.87:6839","nonce":2127215876}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":24500,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6839/160586017","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6838","nonce":160586017},{"type":"v1","addr":"172.21.15.90:6839","nonce":160586017}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13}],"filesystems":[]} 2024-05-08T05:25:19.306 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:19.305+0000 7f1169000700 1 -- 172.21.15.87:0/1397806696 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f11480b2900 msgr2=0x7f11480b4dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:25:19.306 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:19.305+0000 7f1169000700 1 --2- 172.21.15.87:0/1397806696 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f11480b2900 0x7f11480b4dc0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f1164103480 tx=0x7f1150005fb0 comp rx=0 tx=0).stop 2024-05-08T05:25:19.306 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:19.305+0000 7f1169000700 1 -- 172.21.15.87:0/1397806696 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1164103750 msgr2=0x7f116419bd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:25:19.306 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:19.305+0000 7f1169000700 1 --2- 172.21.15.87:0/1397806696 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1164103750 0x7f116419bd30 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f115400e9c0 tx=0x7f115400ecd0 comp rx=0 tx=0).stop 2024-05-08T05:25:19.306 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:19.305+0000 7f1169000700 1 -- 172.21.15.87:0/1397806696 shutdown_connections 2024-05-08T05:25:19.306 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:19.305+0000 7f1169000700 1 --2- 172.21.15.87:0/1397806696 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f11480b2900 0x7f11480b4dc0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:25:19.306 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:19.305+0000 7f1169000700 1 --2- 172.21.15.87:0/1397806696 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1164108850 0x7f11641a0600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:25:19.306 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:19.305+0000 7f1169000700 1 --2- 172.21.15.87:0/1397806696 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1164103750 0x7f116419bd30 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:25:19.306 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:19.305+0000 7f1169000700 1 --2- 172.21.15.87:0/1397806696 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1164104100 0x7f116419c270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:25:19.307 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:19.305+0000 7f1169000700 1 -- 172.21.15.87:0/1397806696 >> 172.21.15.87:0/1397806696 conn(0x7f116407a600 msgr2=0x7f1164101920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:25:19.307 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:19.306+0000 7f1169000700 1 -- 172.21.15.87:0/1397806696 shutdown_connections 2024-05-08T05:25:19.307 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:19.306+0000 7f1169000700 1 -- 172.21.15.87:0/1397806696 wait complete. 2024-05-08T05:25:19.307 INFO:teuthology.orchestra.run.smithi087.stderr:dumped fsmap epoch 13 2024-05-08T05:25:19.310 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:25:19 smithi090 ceph-mon[34526]: mds.? [v2:172.21.15.90:6838/160586017,v1:172.21.15.90:6839/160586017] up:boot 2024-05-08T05:25:19.310 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:25:19 smithi090 ceph-mon[34526]: fsmap 12 up:standby 2024-05-08T05:25:19.310 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:25:19 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-05-08T05:25:19.503 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:25:19 smithi087 ceph-mon[29523]: mds.? [v2:172.21.15.90:6838/160586017,v1:172.21.15.90:6839/160586017] up:boot 2024-05-08T05:25:19.503 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:25:19 smithi087 ceph-mon[29523]: fsmap 12 up:standby 2024-05-08T05:25:19.503 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:25:19 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-05-08T05:25:20.539 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:25:20 smithi160 ceph-mon[34827]: pgmap v301: 1 pgs: 1 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-08T05:25:20.539 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:25:20 smithi160 ceph-mon[34827]: from='client.? 172.21.15.87:0/1397806696' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T05:25:20.539 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:25:20 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:25:20.539 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:25:20 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:25:20.539 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:25:20 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:25:20.539 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:25:20 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:25:20.709 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:25:20 smithi087 ceph-mon[29523]: pgmap v301: 1 pgs: 1 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-08T05:25:20.709 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:25:20 smithi087 ceph-mon[29523]: from='client.? 172.21.15.87:0/1397806696' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T05:25:20.709 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:25:20 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:25:20.709 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:25:20 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:25:20.709 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:25:20 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:25:20.709 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:25:20 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:25:20.733 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:25:20 smithi090 ceph-mon[34526]: pgmap v301: 1 pgs: 1 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-08T05:25:20.733 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:25:20 smithi090 ceph-mon[34526]: from='client.? 172.21.15.87:0/1397806696' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T05:25:20.733 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:25:20 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:25:20.734 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:25:20 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:25:20.734 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:25:20 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:25:20.734 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:25:20 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:25:20.882 DEBUG:teuthology.orchestra.run.smithi087:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid eeeb813e-0cf9-11ef-bc97-c7b262605968 -- ceph --format=json-pretty osd lspools 2024-05-08T05:25:21.346 INFO:teuthology.orchestra.run.smithi087.stderr:Inferring config /var/lib/ceph/eeeb813e-0cf9-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T05:25:22.458 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:25:22 smithi087 ceph-mon[29523]: pgmap v302: 1 pgs: 1 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-08T05:25:22.539 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:25:22 smithi160 ceph-mon[34827]: pgmap v302: 1 pgs: 1 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-08T05:25:22.733 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:25:22 smithi090 ceph-mon[34526]: pgmap v302: 1 pgs: 1 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-08T05:25:23.504 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:23.503+0000 7f9989000700 1 -- 172.21.15.87:0/640306963 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f998406b180 msgr2=0x7f998406b600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:25:23.504 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:23.503+0000 7f9989000700 1 --2- 172.21.15.87:0/640306963 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f998406b180 0x7f998406b600 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f9970009990 tx=0x7f9970009ca0 comp rx=0 tx=0).stop 2024-05-08T05:25:23.504 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:23.503+0000 7f9989000700 1 -- 172.21.15.87:0/640306963 shutdown_connections 2024-05-08T05:25:23.504 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:23.503+0000 7f9989000700 1 --2- 172.21.15.87:0/640306963 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f998406bb40 0x7f9984110330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:25:23.504 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:23.503+0000 7f9989000700 1 --2- 172.21.15.87:0/640306963 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9984109510 0x7f99841098f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:25:23.504 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:23.503+0000 7f9989000700 1 --2- 172.21.15.87:0/640306963 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f998406b180 0x7f998406b600 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:25:23.505 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:23.503+0000 7f9989000700 1 -- 172.21.15.87:0/640306963 >> 172.21.15.87:0/640306963 conn(0x7f9984079350 msgr2=0x7f9984079760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:25:23.505 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:23.503+0000 7f9989000700 1 -- 172.21.15.87:0/640306963 shutdown_connections 2024-05-08T05:25:23.505 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:23.503+0000 7f9989000700 1 -- 172.21.15.87:0/640306963 wait complete. 2024-05-08T05:25:23.506 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:23.504+0000 7f9989000700 1 Processor -- start 2024-05-08T05:25:23.506 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:23.505+0000 7f9989000700 1 -- start start 2024-05-08T05:25:23.506 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:23.505+0000 7f9989000700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f998406b180 0x7f998419bd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:25:23.506 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:23.505+0000 7f9989000700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f998406bb40 0x7f998419c2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:25:23.506 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:23.505+0000 7f9989000700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9984109510 0x7f99841a0650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:25:23.506 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:23.505+0000 7f9989000700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f9984113690 con 0x7f9984109510 2024-05-08T05:25:23.506 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:23.505+0000 7f9989000700 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f9984113510 con 0x7f998406bb40 2024-05-08T05:25:23.506 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:23.505+0000 7f9989000700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f9984113810 con 0x7f998406b180 2024-05-08T05:25:23.506 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:23.505+0000 7f9981400700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f998406bb40 0x7f998419c2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:25:23.506 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:23.505+0000 7f9981400700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f998406bb40 0x7f998419c2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.87:43892/0 (socket says 172.21.15.87:43892) 2024-05-08T05:25:23.506 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:23.505+0000 7f9981400700 1 -- 172.21.15.87:0/1079891592 learned_addr learned my addr 172.21.15.87:0/1079891592 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T05:25:23.506 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:23.505+0000 7f9981e00700 1 --2- 172.21.15.87:0/1079891592 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f998406b180 0x7f998419bd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:25:23.506 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:23.505+0000 7f9982800700 1 --2- 172.21.15.87:0/1079891592 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9984109510 0x7f99841a0650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:25:23.507 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:23.506+0000 7f9981400700 1 -- 172.21.15.87:0/1079891592 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f998406b180 msgr2=0x7f998419bd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:25:23.507 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:23.506+0000 7f9981400700 1 --2- 172.21.15.87:0/1079891592 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f998406b180 0x7f998419bd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:25:23.507 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:23.506+0000 7f9981400700 1 -- 172.21.15.87:0/1079891592 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9984109510 msgr2=0x7f99841a0650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:25:23.508 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:23.506+0000 7f9981400700 1 --2- 172.21.15.87:0/1079891592 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9984109510 0x7f99841a0650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:25:23.508 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:23.506+0000 7f9981400700 1 -- 172.21.15.87:0/1079891592 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f99841a0d90 con 0x7f998406bb40 2024-05-08T05:25:23.508 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:23.506+0000 7f9981400700 1 --2- 172.21.15.87:0/1079891592 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f998406bb40 0x7f998419c2c0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f9970005910 tx=0x7f997000b670 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:25:23.508 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:23.506+0000 7f997aa00700 1 -- 172.21.15.87:0/1079891592 <== mon.2 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9970027070 con 0x7f998406bb40 2024-05-08T05:25:23.508 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:23.506+0000 7f9989000700 1 -- 172.21.15.87:0/1079891592 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f99841a1020 con 0x7f998406bb40 2024-05-08T05:25:23.508 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:23.506+0000 7f997aa00700 1 -- 172.21.15.87:0/1079891592 <== mon.2 v2:172.21.15.90:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9970022470 con 0x7f998406bb40 2024-05-08T05:25:23.508 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:23.506+0000 7f997aa00700 1 -- 172.21.15.87:0/1079891592 <== mon.2 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9970017650 con 0x7f998406bb40 2024-05-08T05:25:23.508 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:23.507+0000 7f9989000700 1 -- 172.21.15.87:0/1079891592 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f99841a8900 con 0x7f998406bb40 2024-05-08T05:25:23.508 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:23.508+0000 7f9989000700 1 -- 172.21.15.87:0/1079891592 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f998406a190 con 0x7f998406bb40 2024-05-08T05:25:23.510 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:23.510+0000 7f997aa00700 1 -- 172.21.15.87:0/1079891592 <== mon.2 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 16) ==== 149652+0+0 (secure 0 0 0) 0x7f997002a070 con 0x7f998406bb40 2024-05-08T05:25:23.512 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:23.511+0000 7f997aa00700 1 --2- 172.21.15.87:0/1079891592 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f99680b2880 0x7f99680b4d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:25:23.512 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:23.511+0000 7f997aa00700 1 -- 172.21.15.87:0/1079891592 <== mon.2 v2:172.21.15.90:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 7127+0+0 (secure 0 0 0) 0x7f99700e2ae0 con 0x7f998406bb40 2024-05-08T05:25:23.512 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:23.512+0000 7f9981e00700 1 --2- 172.21.15.87:0/1079891592 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f99680b2880 0x7f99680b4d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:25:23.512 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:23.512+0000 7f9981e00700 1 --2- 172.21.15.87:0/1079891592 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f99680b2880 0x7f99680b4d40 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f9974009680 tx=0x7f9974009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:25:23.514 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:23.514+0000 7f997aa00700 1 -- 172.21.15.87:0/1079891592 <== mon.2 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f9970013070 con 0x7f998406bb40 2024-05-08T05:25:23.760 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:23.760+0000 7f9989000700 1 -- 172.21.15.87:0/1079891592 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7f99841a8ad0 con 0x7f998406bb40 2024-05-08T05:25:23.761 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:23.761+0000 7f997aa00700 1 -- 172.21.15.87:0/1079891592 <== mon.2 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v73) ==== 84+0+65 (secure 0 0 0) 0x7f99700aac90 con 0x7f998406bb40 2024-05-08T05:25:23.761 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-05-08T05:25:23.761 INFO:teuthology.orchestra.run.smithi087.stdout:[ 2024-05-08T05:25:23.761 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-05-08T05:25:23.761 INFO:teuthology.orchestra.run.smithi087.stdout: "poolnum": 1, 2024-05-08T05:25:23.761 INFO:teuthology.orchestra.run.smithi087.stdout: "poolname": ".mgr" 2024-05-08T05:25:23.762 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-05-08T05:25:23.762 INFO:teuthology.orchestra.run.smithi087.stdout:] 2024-05-08T05:25:23.766 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:23.766+0000 7f9989000700 1 -- 172.21.15.87:0/1079891592 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f99680b2880 msgr2=0x7f99680b4d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:25:23.766 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:23.766+0000 7f9989000700 1 --2- 172.21.15.87:0/1079891592 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f99680b2880 0x7f99680b4d40 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f9974009680 tx=0x7f9974009260 comp rx=0 tx=0).stop 2024-05-08T05:25:23.766 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:23.766+0000 7f9989000700 1 -- 172.21.15.87:0/1079891592 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f998406bb40 msgr2=0x7f998419c2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:25:23.766 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:23.766+0000 7f9989000700 1 --2- 172.21.15.87:0/1079891592 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f998406bb40 0x7f998419c2c0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f9970005910 tx=0x7f997000b670 comp rx=0 tx=0).stop 2024-05-08T05:25:23.767 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:23.766+0000 7f9989000700 1 -- 172.21.15.87:0/1079891592 shutdown_connections 2024-05-08T05:25:23.767 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:23.766+0000 7f9989000700 1 --2- 172.21.15.87:0/1079891592 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9984109510 0x7f99841a0650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:25:23.767 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:23.766+0000 7f9989000700 1 --2- 172.21.15.87:0/1079891592 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f99680b2880 0x7f99680b4d40 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:25:23.767 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:23.766+0000 7f9989000700 1 --2- 172.21.15.87:0/1079891592 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f998406b180 0x7f998419bd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:25:23.767 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:23.766+0000 7f9989000700 1 --2- 172.21.15.87:0/1079891592 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f998406bb40 0x7f998419c2c0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:25:23.767 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:23.766+0000 7f9989000700 1 -- 172.21.15.87:0/1079891592 >> 172.21.15.87:0/1079891592 conn(0x7f9984079350 msgr2=0x7f9984100e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:25:23.767 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:23.766+0000 7f9989000700 1 -- 172.21.15.87:0/1079891592 shutdown_connections 2024-05-08T05:25:23.767 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:23.766+0000 7f9989000700 1 -- 172.21.15.87:0/1079891592 wait complete. 2024-05-08T05:25:24.018 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:25:23 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:25:24.019 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:25:23 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:25:24.019 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:25:23 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T05:25:24.019 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:25:23 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T05:25:24.019 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:25:23 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:25:24.019 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:25:23 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:25:24.019 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:25:23 smithi090 ceph-mon[34526]: pgmap v303: 1 pgs: 1 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-08T05:25:24.019 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:25:23 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T05:25:24.038 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:25:23 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:25:24.038 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:25:23 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:25:24.039 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:25:23 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T05:25:24.039 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:25:23 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T05:25:24.039 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:25:23 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:25:24.039 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:25:23 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:25:24.039 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:25:23 smithi160 ceph-mon[34827]: pgmap v303: 1 pgs: 1 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-08T05:25:24.039 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:25:23 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T05:25:24.145 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:25:23 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:25:24.146 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:25:23 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:25:24.146 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:25:23 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T05:25:24.146 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:25:23 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T05:25:24.146 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:25:23 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:25:24.146 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:25:23 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:25:24.146 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:25:23 smithi087 ceph-mon[29523]: pgmap v303: 1 pgs: 1 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-08T05:25:24.146 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:25:23 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T05:25:24.641 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-05-08T05:25:24.641 DEBUG:teuthology.orchestra.run.smithi087:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid eeeb813e-0cf9-11ef-bc97-c7b262605968 -- ceph osd pool create cephfs_metadata --pg_num_min 64 2024-05-08T05:25:24.958 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:25:24 smithi087 ceph-mon[29523]: from='client.? 172.21.15.87:0/1079891592' entity='client.admin' cmd=[{"prefix": "osd lspools", "format": "json-pretty"}]: dispatch 2024-05-08T05:25:24.959 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:25:24 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:25:24.959 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:25:24 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:25:24.959 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:25:24 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:25:24.959 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:25:24 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:25:25.038 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:25:24 smithi160 ceph-mon[34827]: from='client.? 172.21.15.87:0/1079891592' entity='client.admin' cmd=[{"prefix": "osd lspools", "format": "json-pretty"}]: dispatch 2024-05-08T05:25:25.039 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:25:24 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:25:25.039 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:25:24 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:25:25.039 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:25:24 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:25:25.039 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:25:24 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:25:25.233 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:25:24 smithi090 ceph-mon[34526]: from='client.? 172.21.15.87:0/1079891592' entity='client.admin' cmd=[{"prefix": "osd lspools", "format": "json-pretty"}]: dispatch 2024-05-08T05:25:25.234 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:25:24 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:25:25.234 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:25:24 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:25:25.234 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:25:24 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:25:25.234 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:25:24 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:25:25.678 INFO:teuthology.orchestra.run.smithi087.stderr:Inferring config /var/lib/ceph/eeeb813e-0cf9-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T05:25:26.006 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:25:25 smithi087 ceph-mon[29523]: pgmap v304: 1 pgs: 1 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-08T05:25:26.038 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:25:25 smithi160 ceph-mon[34827]: pgmap v304: 1 pgs: 1 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-08T05:25:26.233 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:25:25 smithi090 ceph-mon[34526]: pgmap v304: 1 pgs: 1 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-08T05:25:27.788 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:27.786+0000 7fce20a00700 1 -- 172.21.15.87:0/3032088895 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fce1c076190 msgr2=0x7fce1c10f730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:25:27.788 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:27.786+0000 7fce20a00700 1 --2- 172.21.15.87:0/3032088895 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fce1c076190 0x7fce1c10f730 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fce08009990 tx=0x7fce08009ca0 comp rx=0 tx=0).stop 2024-05-08T05:25:27.788 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:27.786+0000 7fce20a00700 1 -- 172.21.15.87:0/3032088895 shutdown_connections 2024-05-08T05:25:27.788 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:27.786+0000 7fce20a00700 1 --2- 172.21.15.87:0/3032088895 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fce1c10fc70 0x7fce1c112080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:25:27.788 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:27.786+0000 7fce20a00700 1 --2- 172.21.15.87:0/3032088895 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fce1c075870 0x7fce1c075c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:25:27.788 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:27.786+0000 7fce20a00700 1 --2- 172.21.15.87:0/3032088895 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fce1c076190 0x7fce1c10f730 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:25:27.788 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:27.786+0000 7fce20a00700 1 -- 172.21.15.87:0/3032088895 >> 172.21.15.87:0/3032088895 conn(0x7fce1c0fef20 msgr2=0x7fce1c101340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:25:27.788 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:27.786+0000 7fce20a00700 1 -- 172.21.15.87:0/3032088895 shutdown_connections 2024-05-08T05:25:27.788 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:27.786+0000 7fce20a00700 1 -- 172.21.15.87:0/3032088895 wait complete. 2024-05-08T05:25:27.789 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:27.787+0000 7fce20a00700 1 Processor -- start 2024-05-08T05:25:27.789 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:27.788+0000 7fce20a00700 1 -- start start 2024-05-08T05:25:27.790 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:27.788+0000 7fce20a00700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fce1c075870 0x7fce1c1a1930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:25:27.790 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:27.788+0000 7fce20a00700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fce1c076190 0x7fce1c1a1e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:25:27.790 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:27.788+0000 7fce20a00700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fce1c10fc70 0x7fce1c19baf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:25:27.790 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:27.788+0000 7fce20a00700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fce1c115830 con 0x7fce1c075870 2024-05-08T05:25:27.790 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:27.788+0000 7fce20a00700 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fce1c1156b0 con 0x7fce1c076190 2024-05-08T05:25:27.790 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:27.788+0000 7fce20a00700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7fce1c1159b0 con 0x7fce1c10fc70 2024-05-08T05:25:27.790 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:27.788+0000 7fce1a800700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fce1c075870 0x7fce1c1a1930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:25:27.790 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:27.788+0000 7fce19e00700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fce1c076190 0x7fce1c1a1e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:25:27.790 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:27.788+0000 7fce19e00700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fce1c076190 0x7fce1c1a1e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.87:34150/0 (socket says 172.21.15.87:34150) 2024-05-08T05:25:27.791 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:27.788+0000 7fce19e00700 1 -- 172.21.15.87:0/303267687 learned_addr learned my addr 172.21.15.87:0/303267687 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T05:25:27.791 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:27.789+0000 7fce1b200700 1 --2- 172.21.15.87:0/303267687 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fce1c10fc70 0x7fce1c19baf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:25:27.791 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:27.789+0000 7fce19e00700 1 -- 172.21.15.87:0/303267687 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fce1c10fc70 msgr2=0x7fce1c19baf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:25:27.791 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:27.789+0000 7fce19e00700 1 --2- 172.21.15.87:0/303267687 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fce1c10fc70 0x7fce1c19baf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:25:27.791 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:27.789+0000 7fce19e00700 1 -- 172.21.15.87:0/303267687 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fce1c075870 msgr2=0x7fce1c1a1930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:25:27.791 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:27.789+0000 7fce19e00700 1 --2- 172.21.15.87:0/303267687 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fce1c075870 0x7fce1c1a1930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:25:27.791 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:27.789+0000 7fce19e00700 1 -- 172.21.15.87:0/303267687 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fce1c19c250 con 0x7fce1c076190 2024-05-08T05:25:27.791 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:27.789+0000 7fce19e00700 1 --2- 172.21.15.87:0/303267687 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fce1c076190 0x7fce1c1a1e70 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fce08005910 tx=0x7fce0800b670 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:25:27.792 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:27.790+0000 7fce13400700 1 -- 172.21.15.87:0/303267687 <== mon.2 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce08027070 con 0x7fce1c076190 2024-05-08T05:25:27.792 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:27.790+0000 7fce20a00700 1 -- 172.21.15.87:0/303267687 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fce1c19c4e0 con 0x7fce1c076190 2024-05-08T05:25:27.792 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:27.790+0000 7fce13400700 1 -- 172.21.15.87:0/303267687 <== mon.2 v2:172.21.15.90:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fce08022470 con 0x7fce1c076190 2024-05-08T05:25:27.792 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:27.790+0000 7fce13400700 1 -- 172.21.15.87:0/303267687 <== mon.2 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce08017650 con 0x7fce1c076190 2024-05-08T05:25:27.792 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:27.790+0000 7fce20a00700 1 -- 172.21.15.87:0/303267687 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fce1c1a8800 con 0x7fce1c076190 2024-05-08T05:25:27.792 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:27.791+0000 7fce20a00700 1 -- 172.21.15.87:0/303267687 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fce1c06a190 con 0x7fce1c076190 2024-05-08T05:25:27.794 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:27.794+0000 7fce13400700 1 -- 172.21.15.87:0/303267687 <== mon.2 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 16) ==== 149652+0+0 (secure 0 0 0) 0x7fce0802a070 con 0x7fce1c076190 2024-05-08T05:25:27.796 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:27.796+0000 7fce13400700 1 --2- 172.21.15.87:0/303267687 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7fce000b2880 0x7fce000b4d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:25:27.796 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:27.796+0000 7fce13400700 1 -- 172.21.15.87:0/303267687 <== mon.2 v2:172.21.15.90:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 7127+0+0 (secure 0 0 0) 0x7fce080e2d10 con 0x7fce1c076190 2024-05-08T05:25:27.796 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:27.796+0000 7fce1a800700 1 --2- 172.21.15.87:0/303267687 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7fce000b2880 0x7fce000b4d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:25:27.797 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:27.797+0000 7fce1a800700 1 --2- 172.21.15.87:0/303267687 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7fce000b2880 0x7fce000b4d40 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fce0c009da0 tx=0x7fce0c00b040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:25:27.797 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:27.797+0000 7fce13400700 1 -- 172.21.15.87:0/303267687 <== mon.2 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7fce08013070 con 0x7fce1c076190 2024-05-08T05:25:28.043 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:28.042+0000 7fce20a00700 1 -- 172.21.15.87:0/303267687 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7fce1c02e510 con 0x7fce1c076190 2024-05-08T05:25:28.208 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:25:27 smithi087 ceph-mon[29523]: pgmap v305: 1 pgs: 1 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-08T05:25:28.233 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:25:27 smithi090 ceph-mon[34526]: pgmap v305: 1 pgs: 1 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-08T05:25:28.288 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:25:27 smithi160 ceph-mon[34827]: pgmap v305: 1 pgs: 1 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-08T05:25:28.990 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:28.987+0000 7fce13400700 1 -- 172.21.15.87:0/303267687 <== mon.2 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v74) ==== 138+0+0 (secure 0 0 0) 0x7fce080aaec0 con 0x7fce1c076190 2024-05-08T05:25:28.998 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:28.996+0000 7fce20a00700 1 -- 172.21.15.87:0/303267687 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7fce000b2880 msgr2=0x7fce000b4d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:25:28.998 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:28.996+0000 7fce20a00700 1 --2- 172.21.15.87:0/303267687 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7fce000b2880 0x7fce000b4d40 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fce0c009da0 tx=0x7fce0c00b040 comp rx=0 tx=0).stop 2024-05-08T05:25:28.998 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:28.996+0000 7fce20a00700 1 -- 172.21.15.87:0/303267687 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fce1c076190 msgr2=0x7fce1c1a1e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:25:28.998 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:28.996+0000 7fce20a00700 1 --2- 172.21.15.87:0/303267687 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fce1c076190 0x7fce1c1a1e70 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fce08005910 tx=0x7fce0800b670 comp rx=0 tx=0).stop 2024-05-08T05:25:28.998 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:28.997+0000 7fce20a00700 1 -- 172.21.15.87:0/303267687 shutdown_connections 2024-05-08T05:25:28.999 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:28.997+0000 7fce20a00700 1 --2- 172.21.15.87:0/303267687 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7fce000b2880 0x7fce000b4d40 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:25:28.999 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:28.997+0000 7fce20a00700 1 --2- 172.21.15.87:0/303267687 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fce1c10fc70 0x7fce1c19baf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:25:28.999 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:28.997+0000 7fce20a00700 1 --2- 172.21.15.87:0/303267687 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fce1c075870 0x7fce1c1a1930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:25:28.999 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:28.997+0000 7fce20a00700 1 --2- 172.21.15.87:0/303267687 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fce1c076190 0x7fce1c1a1e70 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:25:28.999 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:28.997+0000 7fce20a00700 1 -- 172.21.15.87:0/303267687 >> 172.21.15.87:0/303267687 conn(0x7fce1c0fef20 msgr2=0x7fce1c0ffb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:25:28.999 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:28.998+0000 7fce20a00700 1 -- 172.21.15.87:0/303267687 shutdown_connections 2024-05-08T05:25:28.999 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:28.998+0000 7fce20a00700 1 -- 172.21.15.87:0/303267687 wait complete. 2024-05-08T05:25:29.001 INFO:teuthology.orchestra.run.smithi087.stderr:pool 'cephfs_metadata' created 2024-05-08T05:25:29.209 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:25:28 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:25:29.209 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:25:28 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:25:29.209 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:25:28 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T05:25:29.209 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:25:28 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T05:25:29.209 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:25:28 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:25:29.209 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:25:28 smithi087 ceph-mon[29523]: from='client.? 172.21.15.87:0/303267687' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2024-05-08T05:25:29.209 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:25:28 smithi087 ceph-mon[29523]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2024-05-08T05:25:29.233 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:25:28 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:25:29.234 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:25:28 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:25:29.234 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:25:28 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T05:25:29.234 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:25:28 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T05:25:29.234 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:25:28 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:25:29.234 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:25:28 smithi090 ceph-mon[34526]: from='client.? 172.21.15.87:0/303267687' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2024-05-08T05:25:29.234 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:25:28 smithi090 ceph-mon[34526]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2024-05-08T05:25:29.289 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:25:28 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:25:29.289 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:25:28 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:25:29.289 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:25:28 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T05:25:29.289 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:25:28 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T05:25:29.289 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:25:28 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:25:29.289 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:25:28 smithi160 ceph-mon[34827]: from='client.? 172.21.15.87:0/303267687' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2024-05-08T05:25:29.289 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:25:28 smithi160 ceph-mon[34827]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2024-05-08T05:25:29.813 DEBUG:teuthology.orchestra.run.smithi087:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid eeeb813e-0cf9-11ef-bc97-c7b262605968 -- ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-05-08T05:25:30.268 INFO:teuthology.orchestra.run.smithi087.stderr:Inferring config /var/lib/ceph/eeeb813e-0cf9-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T05:25:30.288 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:25:30 smithi160 ceph-mon[34827]: pgmap v306: 1 pgs: 1 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-08T05:25:30.289 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:25:30 smithi160 ceph-mon[34827]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2024-05-08T05:25:30.289 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:25:30 smithi160 ceph-mon[34827]: osdmap e74: 12 total, 12 up, 12 in 2024-05-08T05:25:30.419 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:25:30 smithi087 ceph-mon[29523]: pgmap v306: 1 pgs: 1 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-08T05:25:30.419 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:25:30 smithi087 ceph-mon[29523]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2024-05-08T05:25:30.419 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:25:30 smithi087 ceph-mon[29523]: osdmap e74: 12 total, 12 up, 12 in 2024-05-08T05:25:30.483 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:25:30 smithi090 ceph-mon[34526]: pgmap v306: 1 pgs: 1 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-08T05:25:30.484 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:25:30 smithi090 ceph-mon[34526]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2024-05-08T05:25:30.484 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:25:30 smithi090 ceph-mon[34526]: osdmap e74: 12 total, 12 up, 12 in 2024-05-08T05:25:31.289 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:25:31 smithi160 ceph-mon[34827]: osdmap e75: 12 total, 12 up, 12 in 2024-05-08T05:25:31.450 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:25:31 smithi087 ceph-mon[29523]: osdmap e75: 12 total, 12 up, 12 in 2024-05-08T05:25:31.483 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:25:31 smithi090 ceph-mon[34526]: osdmap e75: 12 total, 12 up, 12 in 2024-05-08T05:25:32.225 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:32.225+0000 7fb5a9400700 1 -- 172.21.15.87:0/2575939181 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb5a41056c0 msgr2=0x7fb5a4105b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:25:32.226 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:32.225+0000 7fb5a9400700 1 --2- 172.21.15.87:0/2575939181 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb5a41056c0 0x7fb5a4105b40 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fb590009990 tx=0x7fb590009ca0 comp rx=0 tx=0).stop 2024-05-08T05:25:32.226 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:32.225+0000 7fb5a9400700 1 -- 172.21.15.87:0/2575939181 shutdown_connections 2024-05-08T05:25:32.226 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:32.225+0000 7fb5a9400700 1 --2- 172.21.15.87:0/2575939181 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb5a4106080 0x7fb5a4112590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:25:32.226 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:32.225+0000 7fb5a9400700 1 --2- 172.21.15.87:0/2575939181 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb5a410b6c0 0x7fb5a410baa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:25:32.226 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:32.225+0000 7fb5a9400700 1 --2- 172.21.15.87:0/2575939181 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb5a41056c0 0x7fb5a4105b40 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:25:32.226 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:32.225+0000 7fb5a9400700 1 -- 172.21.15.87:0/2575939181 >> 172.21.15.87:0/2575939181 conn(0x7fb5a4101170 msgr2=0x7fb5a4103590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:25:32.226 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:32.225+0000 7fb5a9400700 1 -- 172.21.15.87:0/2575939181 shutdown_connections 2024-05-08T05:25:32.226 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:32.225+0000 7fb5a9400700 1 -- 172.21.15.87:0/2575939181 wait complete. 2024-05-08T05:25:32.227 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:32.226+0000 7fb5a9400700 1 Processor -- start 2024-05-08T05:25:32.227 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:32.226+0000 7fb5a9400700 1 -- start start 2024-05-08T05:25:32.227 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:32.227+0000 7fb5a9400700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb5a41056c0 0x7fb5a419bd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:25:32.227 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:32.227+0000 7fb5a9400700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb5a4106080 0x7fb5a419c2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:25:32.227 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:32.227+0000 7fb5a9400700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb5a410b6c0 0x7fb5a41a0640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:25:32.228 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:32.227+0000 7fb5a9400700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fb5a41158c0 con 0x7fb5a410b6c0 2024-05-08T05:25:32.228 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:32.227+0000 7fb5a9400700 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fb5a4115740 con 0x7fb5a4106080 2024-05-08T05:25:32.228 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:32.227+0000 7fb5a9400700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7fb5a4115a40 con 0x7fb5a41056c0 2024-05-08T05:25:32.229 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:32.227+0000 7fb5a3200700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb5a410b6c0 0x7fb5a41a0640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:25:32.229 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:32.227+0000 7fb5a3200700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb5a410b6c0 0x7fb5a41a0640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:33442/0 (socket says 172.21.15.87:33442) 2024-05-08T05:25:32.229 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:32.227+0000 7fb5a3200700 1 -- 172.21.15.87:0/1127595913 learned_addr learned my addr 172.21.15.87:0/1127595913 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T05:25:32.229 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:32.227+0000 7fb5a1e00700 1 --2- 172.21.15.87:0/1127595913 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb5a4106080 0x7fb5a419c2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:25:32.229 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:32.227+0000 7fb5a2800700 1 --2- 172.21.15.87:0/1127595913 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb5a41056c0 0x7fb5a419bd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:25:32.229 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:32.228+0000 7fb5a3200700 1 -- 172.21.15.87:0/1127595913 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb5a41056c0 msgr2=0x7fb5a419bd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:25:32.229 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:32.228+0000 7fb5a3200700 1 --2- 172.21.15.87:0/1127595913 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb5a41056c0 0x7fb5a419bd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:25:32.229 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:32.228+0000 7fb5a3200700 1 -- 172.21.15.87:0/1127595913 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb5a4106080 msgr2=0x7fb5a419c2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:25:32.229 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:32.228+0000 7fb5a3200700 1 --2- 172.21.15.87:0/1127595913 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb5a4106080 0x7fb5a419c2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:25:32.229 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:32.228+0000 7fb5a3200700 1 -- 172.21.15.87:0/1127595913 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb5a41a0d80 con 0x7fb5a410b6c0 2024-05-08T05:25:32.230 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:32.228+0000 7fb5a2800700 1 --2- 172.21.15.87:0/1127595913 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb5a41056c0 0x7fb5a419bd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T05:25:32.230 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:32.228+0000 7fb5a1e00700 1 --2- 172.21.15.87:0/1127595913 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb5a4106080 0x7fb5a419c2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T05:25:32.230 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:32.228+0000 7fb5a3200700 1 --2- 172.21.15.87:0/1127595913 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb5a410b6c0 0x7fb5a41a0640 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fb59c00c370 tx=0x7fb59c00c680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:25:32.230 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:32.228+0000 7fb59b400700 1 -- 172.21.15.87:0/1127595913 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb59c00ce20 con 0x7fb5a410b6c0 2024-05-08T05:25:32.230 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:32.228+0000 7fb59b400700 1 -- 172.21.15.87:0/1127595913 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb59c0090d0 con 0x7fb5a410b6c0 2024-05-08T05:25:32.230 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:32.228+0000 7fb59b400700 1 -- 172.21.15.87:0/1127595913 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb59c0047c0 con 0x7fb5a410b6c0 2024-05-08T05:25:32.230 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:32.228+0000 7fb5a9400700 1 -- 172.21.15.87:0/1127595913 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb5a41a1010 con 0x7fb5a410b6c0 2024-05-08T05:25:32.230 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:32.229+0000 7fb5a9400700 1 -- 172.21.15.87:0/1127595913 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb5a41a88f0 con 0x7fb5a410b6c0 2024-05-08T05:25:32.230 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:32.230+0000 7fb5a9400700 1 -- 172.21.15.87:0/1127595913 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb5a406a190 con 0x7fb5a410b6c0 2024-05-08T05:25:32.232 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:32.232+0000 7fb59b400700 1 -- 172.21.15.87:0/1127595913 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 16) ==== 149652+0+0 (secure 0 0 0) 0x7fb59c01a020 con 0x7fb5a410b6c0 2024-05-08T05:25:32.234 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:32.234+0000 7fb59b400700 1 --2- 172.21.15.87:0/1127595913 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7fb5880b2900 0x7fb5880b4dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:25:32.234 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:32.234+0000 7fb59b400700 1 -- 172.21.15.87:0/1127595913 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 7497+0+0 (secure 0 0 0) 0x7fb59c0e1f30 con 0x7fb5a410b6c0 2024-05-08T05:25:32.234 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:32.234+0000 7fb5a2800700 1 --2- 172.21.15.87:0/1127595913 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7fb5880b2900 0x7fb5880b4dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:25:32.235 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:32.235+0000 7fb5a2800700 1 --2- 172.21.15.87:0/1127595913 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7fb5880b2900 0x7fb5880b4dc0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fb594009c90 tx=0x7fb594009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:25:32.237 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:32.237+0000 7fb59b400700 1 -- 172.21.15.87:0/1127595913 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7fb59c010040 con 0x7fb5a410b6c0 2024-05-08T05:25:32.288 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:25:32 smithi160 ceph-mon[34827]: pgmap v309: 33 pgs: 4 creating+peering, 1 active+clean, 28 unknown; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-08T05:25:32.289 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:25:32 smithi160 ceph-mon[34827]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-05-08T05:25:32.289 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:25:32 smithi160 ceph-mon[34827]: osdmap e76: 12 total, 12 up, 12 in 2024-05-08T05:25:32.458 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:25:32 smithi087 ceph-mon[29523]: pgmap v309: 33 pgs: 4 creating+peering, 1 active+clean, 28 unknown; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-08T05:25:32.458 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:25:32 smithi087 ceph-mon[29523]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-05-08T05:25:32.458 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:25:32 smithi087 ceph-mon[29523]: osdmap e76: 12 total, 12 up, 12 in 2024-05-08T05:25:32.469 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:32.468+0000 7fb5a9400700 1 -- 172.21.15.87:0/1127595913 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7fb5a402e510 con 0x7fb5a410b6c0 2024-05-08T05:25:32.483 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:25:32 smithi090 ceph-mon[34526]: pgmap v309: 33 pgs: 4 creating+peering, 1 active+clean, 28 unknown; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-08T05:25:32.483 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:25:32 smithi090 ceph-mon[34526]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-05-08T05:25:32.483 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:25:32 smithi090 ceph-mon[34526]: osdmap e76: 12 total, 12 up, 12 in 2024-05-08T05:25:33.025 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:33.024+0000 7fb59b400700 1 -- 172.21.15.87:0/1127595913 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v77) ==== 170+0+0 (secure 0 0 0) 0x7fb59c0a9ee0 con 0x7fb5a410b6c0 2024-05-08T05:25:33.032 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:33.030+0000 7fb5a9400700 1 -- 172.21.15.87:0/1127595913 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7fb5880b2900 msgr2=0x7fb5880b4dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:25:33.032 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:33.030+0000 7fb5a9400700 1 --2- 172.21.15.87:0/1127595913 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7fb5880b2900 0x7fb5880b4dc0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fb594009c90 tx=0x7fb594009260 comp rx=0 tx=0).stop 2024-05-08T05:25:33.033 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:33.030+0000 7fb5a9400700 1 -- 172.21.15.87:0/1127595913 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb5a410b6c0 msgr2=0x7fb5a41a0640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:25:33.033 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:33.030+0000 7fb5a9400700 1 --2- 172.21.15.87:0/1127595913 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb5a410b6c0 0x7fb5a41a0640 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fb59c00c370 tx=0x7fb59c00c680 comp rx=0 tx=0).stop 2024-05-08T05:25:33.033 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:33.031+0000 7fb5a9400700 1 -- 172.21.15.87:0/1127595913 shutdown_connections 2024-05-08T05:25:33.033 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:33.031+0000 7fb5a9400700 1 --2- 172.21.15.87:0/1127595913 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb5a410b6c0 0x7fb5a41a0640 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:25:33.033 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:33.031+0000 7fb5a9400700 1 --2- 172.21.15.87:0/1127595913 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7fb5880b2900 0x7fb5880b4dc0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:25:33.033 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:33.031+0000 7fb5a9400700 1 --2- 172.21.15.87:0/1127595913 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb5a41056c0 0x7fb5a419bd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:25:33.033 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:33.031+0000 7fb5a9400700 1 --2- 172.21.15.87:0/1127595913 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb5a4106080 0x7fb5a419c2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:25:33.033 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:33.031+0000 7fb5a9400700 1 -- 172.21.15.87:0/1127595913 >> 172.21.15.87:0/1127595913 conn(0x7fb5a4101170 msgr2=0x7fb5a41018e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:25:33.033 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:33.033+0000 7fb5a9400700 1 -- 172.21.15.87:0/1127595913 shutdown_connections 2024-05-08T05:25:33.034 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:33.033+0000 7fb5a9400700 1 -- 172.21.15.87:0/1127595913 wait complete. 2024-05-08T05:25:33.037 INFO:teuthology.orchestra.run.smithi087.stderr:pool 'cephfs_data' created 2024-05-08T05:25:33.288 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:25:33 smithi160 ceph-mon[34827]: from='client.? 172.21.15.87:0/1127595913' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2024-05-08T05:25:33.404 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:25:33 smithi087 ceph-mon[29523]: from='client.? 172.21.15.87:0/1127595913' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2024-05-08T05:25:33.483 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:25:33 smithi090 ceph-mon[34526]: from='client.? 172.21.15.87:0/1127595913' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2024-05-08T05:25:33.903 DEBUG:teuthology.orchestra.run.smithi087:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid eeeb813e-0cf9-11ef-bc97-c7b262605968 -- ceph fs new cephfs cephfs_metadata cephfs_data 2024-05-08T05:25:34.208 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:25:34 smithi087 ceph-mon[29523]: pgmap v311: 33 pgs: 4 creating+peering, 20 active+clean, 9 unknown; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-08T05:25:34.208 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:25:34 smithi087 ceph-mon[29523]: from='client.? 172.21.15.87:0/1127595913' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2024-05-08T05:25:34.208 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:25:34 smithi087 ceph-mon[29523]: osdmap e77: 12 total, 12 up, 12 in 2024-05-08T05:25:34.365 INFO:teuthology.orchestra.run.smithi087.stderr:Inferring config /var/lib/ceph/eeeb813e-0cf9-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T05:25:34.483 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:25:34 smithi090 ceph-mon[34526]: pgmap v311: 33 pgs: 4 creating+peering, 20 active+clean, 9 unknown; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-08T05:25:34.483 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:25:34 smithi090 ceph-mon[34526]: from='client.? 172.21.15.87:0/1127595913' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2024-05-08T05:25:34.484 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:25:34 smithi090 ceph-mon[34526]: osdmap e77: 12 total, 12 up, 12 in 2024-05-08T05:25:34.539 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:25:34 smithi160 ceph-mon[34827]: pgmap v311: 33 pgs: 4 creating+peering, 20 active+clean, 9 unknown; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-08T05:25:34.539 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:25:34 smithi160 ceph-mon[34827]: from='client.? 172.21.15.87:0/1127595913' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2024-05-08T05:25:34.539 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:25:34 smithi160 ceph-mon[34827]: osdmap e77: 12 total, 12 up, 12 in 2024-05-08T05:25:35.208 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:25:35 smithi087 ceph-mon[29523]: osdmap e78: 12 total, 12 up, 12 in 2024-05-08T05:25:35.483 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:25:35 smithi090 ceph-mon[34526]: osdmap e78: 12 total, 12 up, 12 in 2024-05-08T05:25:35.538 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:25:35 smithi160 ceph-mon[34827]: osdmap e78: 12 total, 12 up, 12 in 2024-05-08T05:25:36.257 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:25:36 smithi087 ceph-mon[29523]: pgmap v314: 97 pgs: 14 creating+peering, 51 active+clean, 32 unknown; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-08T05:25:36.258 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:25:36 smithi087 ceph-mon[29523]: osdmap e79: 12 total, 12 up, 12 in 2024-05-08T05:25:36.440 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:25:36 smithi160 ceph-mon[34827]: pgmap v314: 97 pgs: 14 creating+peering, 51 active+clean, 32 unknown; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-08T05:25:36.440 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:25:36 smithi160 ceph-mon[34827]: osdmap e79: 12 total, 12 up, 12 in 2024-05-08T05:25:36.483 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:25:36 smithi090 ceph-mon[34526]: pgmap v314: 97 pgs: 14 creating+peering, 51 active+clean, 32 unknown; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-08T05:25:36.483 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:25:36 smithi090 ceph-mon[34526]: osdmap e79: 12 total, 12 up, 12 in 2024-05-08T05:25:36.520 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:36.519+0000 7f56ce400700 1 -- 172.21.15.87:0/2014748108 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f56c8103fd0 msgr2=0x7f56c8108020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:25:36.520 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:36.519+0000 7f56ce400700 1 --2- 172.21.15.87:0/2014748108 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f56c8103fd0 0x7f56c8108020 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f56b40099c0 tx=0x7f56b4009cd0 comp rx=0 tx=0).stop 2024-05-08T05:25:36.520 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:36.519+0000 7f56ce400700 1 -- 172.21.15.87:0/2014748108 shutdown_connections 2024-05-08T05:25:36.520 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:36.519+0000 7f56ce400700 1 --2- 172.21.15.87:0/2014748108 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f56c8108700 0x7f56c81102d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:25:36.520 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:36.519+0000 7f56ce400700 1 --2- 172.21.15.87:0/2014748108 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f56c8103620 0x7f56c8103a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:25:36.520 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:36.519+0000 7f56ce400700 1 --2- 172.21.15.87:0/2014748108 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f56c8103fd0 0x7f56c8108020 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:25:36.520 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:36.519+0000 7f56ce400700 1 -- 172.21.15.87:0/2014748108 >> 172.21.15.87:0/2014748108 conn(0x7f56c80feeb0 msgr2=0x7f56c81012d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:25:36.520 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:36.519+0000 7f56ce400700 1 -- 172.21.15.87:0/2014748108 shutdown_connections 2024-05-08T05:25:36.520 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:36.519+0000 7f56ce400700 1 -- 172.21.15.87:0/2014748108 wait complete. 2024-05-08T05:25:36.521 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:36.520+0000 7f56ce400700 1 Processor -- start 2024-05-08T05:25:36.521 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:36.520+0000 7f56ce400700 1 -- start start 2024-05-08T05:25:36.522 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:36.521+0000 7f56ce400700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f56c8103620 0x7f56c81a1910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:25:36.522 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:36.521+0000 7f56ce400700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f56c8103fd0 0x7f56c81a1e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:25:36.522 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:36.521+0000 7f56ce400700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f56c8108700 0x7f56c819bad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:25:36.522 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:36.521+0000 7f56ce400700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f56c8113590 con 0x7f56c8103620 2024-05-08T05:25:36.522 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:36.521+0000 7f56ce400700 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f56c8113410 con 0x7f56c8108700 2024-05-08T05:25:36.522 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:36.521+0000 7f56ce400700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f56c8113710 con 0x7f56c8103fd0 2024-05-08T05:25:36.522 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:36.521+0000 7f56cd000700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f56c8103620 0x7f56c81a1910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:25:36.522 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:36.521+0000 7f56cd000700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f56c8103620 0x7f56c81a1910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:36800/0 (socket says 172.21.15.87:36800) 2024-05-08T05:25:36.522 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:36.521+0000 7f56cd000700 1 -- 172.21.15.87:0/3813851420 learned_addr learned my addr 172.21.15.87:0/3813851420 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T05:25:36.522 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:36.521+0000 7f56c7e00700 1 --2- 172.21.15.87:0/3813851420 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f56c8103fd0 0x7f56c81a1e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:25:36.522 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:36.521+0000 7f56cda00700 1 --2- 172.21.15.87:0/3813851420 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f56c8108700 0x7f56c819bad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:25:36.523 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:36.522+0000 7f56cd000700 1 -- 172.21.15.87:0/3813851420 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f56c8103fd0 msgr2=0x7f56c81a1e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:25:36.523 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:36.522+0000 7f56cd000700 1 --2- 172.21.15.87:0/3813851420 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f56c8103fd0 0x7f56c81a1e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:25:36.523 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:36.522+0000 7f56cd000700 1 -- 172.21.15.87:0/3813851420 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f56c8108700 msgr2=0x7f56c819bad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:25:36.523 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:36.522+0000 7f56cd000700 1 --2- 172.21.15.87:0/3813851420 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f56c8108700 0x7f56c819bad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:25:36.523 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:36.522+0000 7f56cd000700 1 -- 172.21.15.87:0/3813851420 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f56c819c230 con 0x7f56c8103620 2024-05-08T05:25:36.524 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:36.522+0000 7f56c7e00700 1 --2- 172.21.15.87:0/3813851420 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f56c8103fd0 0x7f56c81a1e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T05:25:36.524 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:36.522+0000 7f56cda00700 1 --2- 172.21.15.87:0/3813851420 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f56c8108700 0x7f56c819bad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T05:25:36.524 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:36.522+0000 7f56cd000700 1 --2- 172.21.15.87:0/3813851420 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f56c8103620 0x7f56c81a1910 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f56bc00eb30 tx=0x7f56bc00ee40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:25:36.524 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:36.522+0000 7f56c5600700 1 -- 172.21.15.87:0/3813851420 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56bc00cc90 con 0x7f56c8103620 2024-05-08T05:25:36.524 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:36.522+0000 7f56ce400700 1 -- 172.21.15.87:0/3813851420 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f56c819c520 con 0x7f56c8103620 2024-05-08T05:25:36.524 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:36.522+0000 7f56c5600700 1 -- 172.21.15.87:0/3813851420 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f56bc0044d0 con 0x7f56c8103620 2024-05-08T05:25:36.524 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:36.522+0000 7f56c5600700 1 -- 172.21.15.87:0/3813851420 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56bc010430 con 0x7f56c8103620 2024-05-08T05:25:36.524 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:36.522+0000 7f56ce400700 1 -- 172.21.15.87:0/3813851420 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f56c81a87e0 con 0x7f56c8103620 2024-05-08T05:25:36.524 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:36.523+0000 7f56ce400700 1 -- 172.21.15.87:0/3813851420 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f56c806a190 con 0x7f56c8103620 2024-05-08T05:25:36.526 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:36.526+0000 7f56c5600700 1 -- 172.21.15.87:0/3813851420 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 16) ==== 149652+0+0 (secure 0 0 0) 0x7f56bc003ea0 con 0x7f56c8103620 2024-05-08T05:25:36.528 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:36.527+0000 7f56c5600700 1 --2- 172.21.15.87:0/3813851420 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f56b00b2880 0x7f56b00b4d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:25:36.528 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:36.528+0000 7f56c5600700 1 -- 172.21.15.87:0/3813851420 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 7879+0+0 (secure 0 0 0) 0x7f56bc0e2470 con 0x7f56c8103620 2024-05-08T05:25:36.528 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:36.528+0000 7f56c7e00700 1 --2- 172.21.15.87:0/3813851420 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f56b00b2880 0x7f56b00b4d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:25:36.529 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:36.529+0000 7f56c7e00700 1 --2- 172.21.15.87:0/3813851420 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f56b00b2880 0x7f56b00b4d40 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f56b4000c00 tx=0x7f56b4005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:25:36.531 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:36.531+0000 7f56c5600700 1 -- 172.21.15.87:0/3813851420 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f56bc0aa2a0 con 0x7f56c8103620 2024-05-08T05:25:36.815 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:36.815+0000 7f56ce400700 1 -- 172.21.15.87:0/3813851420 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7f56c819cfc0 con 0x7f56c8103620 2024-05-08T05:25:37.078 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:37.077+0000 7f56c5600700 1 -- 172.21.15.87:0/3813851420 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v14) ==== 172+0+0 (secure 0 0 0) 0x7f56bc0a9ba0 con 0x7f56c8103620 2024-05-08T05:25:37.082 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:37.081+0000 7f56ce400700 1 -- 172.21.15.87:0/3813851420 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f56b00b2880 msgr2=0x7f56b00b4d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:25:37.082 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:37.081+0000 7f56ce400700 1 --2- 172.21.15.87:0/3813851420 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f56b00b2880 0x7f56b00b4d40 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f56b4000c00 tx=0x7f56b4005fb0 comp rx=0 tx=0).stop 2024-05-08T05:25:37.082 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:37.081+0000 7f56ce400700 1 -- 172.21.15.87:0/3813851420 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f56c8103620 msgr2=0x7f56c81a1910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:25:37.082 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:37.081+0000 7f56ce400700 1 --2- 172.21.15.87:0/3813851420 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f56c8103620 0x7f56c81a1910 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f56bc00eb30 tx=0x7f56bc00ee40 comp rx=0 tx=0).stop 2024-05-08T05:25:37.083 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:37.081+0000 7f56ce400700 1 -- 172.21.15.87:0/3813851420 shutdown_connections 2024-05-08T05:25:37.083 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:37.081+0000 7f56ce400700 1 --2- 172.21.15.87:0/3813851420 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f56c8108700 0x7f56c819bad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:25:37.083 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:37.081+0000 7f56ce400700 1 --2- 172.21.15.87:0/3813851420 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f56c8103620 0x7f56c81a1910 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:25:37.083 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:37.081+0000 7f56ce400700 1 --2- 172.21.15.87:0/3813851420 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f56b00b2880 0x7f56b00b4d40 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:25:37.083 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:37.081+0000 7f56ce400700 1 --2- 172.21.15.87:0/3813851420 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f56c8103fd0 0x7f56c81a1e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:25:37.083 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:37.081+0000 7f56ce400700 1 -- 172.21.15.87:0/3813851420 >> 172.21.15.87:0/3813851420 conn(0x7f56c80feeb0 msgr2=0x7f56c8100180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:25:37.083 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:37.082+0000 7f56ce400700 1 -- 172.21.15.87:0/3813851420 shutdown_connections 2024-05-08T05:25:37.083 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:37.082+0000 7f56ce400700 1 -- 172.21.15.87:0/3813851420 wait complete. 2024-05-08T05:25:37.084 INFO:teuthology.orchestra.run.smithi087.stderr:new fs with metadata pool 2 and data pool 3 2024-05-08T05:25:37.455 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:25:37 smithi087 ceph-mon[29523]: from='client.? 172.21.15.87:0/3813851420' entity='client.admin' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]: dispatch 2024-05-08T05:25:37.455 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:25:37 smithi087 ceph-mon[29523]: daemon mds.b assigned to filesystem cephfs as rank 0 2024-05-08T05:25:37.455 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:25:37 smithi087 ceph-mon[29523]: Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-05-08T05:25:37.483 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:25:37 smithi090 ceph-mon[34526]: from='client.? 172.21.15.87:0/3813851420' entity='client.admin' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]: dispatch 2024-05-08T05:25:37.484 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:25:37 smithi090 ceph-mon[34526]: daemon mds.b assigned to filesystem cephfs as rank 0 2024-05-08T05:25:37.484 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:25:37 smithi090 ceph-mon[34526]: Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-05-08T05:25:37.538 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:25:37 smithi160 ceph-mon[34827]: from='client.? 172.21.15.87:0/3813851420' entity='client.admin' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]: dispatch 2024-05-08T05:25:37.539 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:25:37 smithi160 ceph-mon[34827]: daemon mds.b assigned to filesystem cephfs as rank 0 2024-05-08T05:25:37.539 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:25:37 smithi160 ceph-mon[34827]: Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-05-08T05:25:37.952 DEBUG:teuthology.orchestra.run.smithi087:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid eeeb813e-0cf9-11ef-bc97-c7b262605968 -- ceph osd dump --format=json 2024-05-08T05:25:38.208 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:25:38 smithi087 ceph-mon[29523]: pgmap v316: 97 pgs: 14 creating+peering, 65 active+clean, 18 unknown; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-08T05:25:38.209 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:25:38 smithi087 ceph-mon[29523]: osdmap e80: 12 total, 12 up, 12 in 2024-05-08T05:25:38.209 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:25:38 smithi087 ceph-mon[29523]: from='client.? 172.21.15.87:0/3813851420' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2024-05-08T05:25:38.209 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:25:38 smithi087 ceph-mon[29523]: fsmap cephfs:1 {0=b=up:creating} 11 up:standby 2024-05-08T05:25:38.209 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:25:38 smithi087 ceph-mon[29523]: daemon mds.b is now active in filesystem cephfs as rank 0 2024-05-08T05:25:38.407 INFO:teuthology.orchestra.run.smithi087.stderr:Inferring config /var/lib/ceph/eeeb813e-0cf9-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T05:25:38.483 INFO:journalctl@ceph.mds.b.smithi090.stdout:May 08 05:25:38 smithi090 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-mds-b[64959]: 2024-05-08T05:25:38.244+0000 7ff0dfe9b700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-05-08T05:25:38.484 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:25:38 smithi090 ceph-mon[34526]: pgmap v316: 97 pgs: 14 creating+peering, 65 active+clean, 18 unknown; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-08T05:25:38.484 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:25:38 smithi090 ceph-mon[34526]: osdmap e80: 12 total, 12 up, 12 in 2024-05-08T05:25:38.484 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:25:38 smithi090 ceph-mon[34526]: from='client.? 172.21.15.87:0/3813851420' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2024-05-08T05:25:38.484 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:25:38 smithi090 ceph-mon[34526]: fsmap cephfs:1 {0=b=up:creating} 11 up:standby 2024-05-08T05:25:38.484 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:25:38 smithi090 ceph-mon[34526]: daemon mds.b is now active in filesystem cephfs as rank 0 2024-05-08T05:25:38.539 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:25:38 smithi160 ceph-mon[34827]: pgmap v316: 97 pgs: 14 creating+peering, 65 active+clean, 18 unknown; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-08T05:25:38.539 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:25:38 smithi160 ceph-mon[34827]: osdmap e80: 12 total, 12 up, 12 in 2024-05-08T05:25:38.539 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:25:38 smithi160 ceph-mon[34827]: from='client.? 172.21.15.87:0/3813851420' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2024-05-08T05:25:38.539 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:25:38 smithi160 ceph-mon[34827]: fsmap cephfs:1 {0=b=up:creating} 11 up:standby 2024-05-08T05:25:38.539 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:25:38 smithi160 ceph-mon[34827]: daemon mds.b is now active in filesystem cephfs as rank 0 2024-05-08T05:25:39.382 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:25:39 smithi087 ceph-mon[29523]: mds.? [v2:172.21.15.90:6838/160586017,v1:172.21.15.90:6839/160586017] up:active 2024-05-08T05:25:39.382 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:25:39 smithi087 ceph-mon[29523]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-05-08T05:25:39.382 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:25:39 smithi087 ceph-mon[29523]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-05-08T05:25:39.483 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:25:39 smithi090 ceph-mon[34526]: mds.? [v2:172.21.15.90:6838/160586017,v1:172.21.15.90:6839/160586017] up:active 2024-05-08T05:25:39.484 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:25:39 smithi090 ceph-mon[34526]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-05-08T05:25:39.484 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:25:39 smithi090 ceph-mon[34526]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-05-08T05:25:39.539 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:25:39 smithi160 ceph-mon[34827]: mds.? [v2:172.21.15.90:6838/160586017,v1:172.21.15.90:6839/160586017] up:active 2024-05-08T05:25:39.539 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:25:39 smithi160 ceph-mon[34827]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-05-08T05:25:39.539 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:25:39 smithi160 ceph-mon[34827]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-05-08T05:25:40.371 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:25:40 smithi087 ceph-mon[29523]: pgmap v318: 97 pgs: 97 active+clean; 578 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 873 B/s wr, 2 op/s 2024-05-08T05:25:40.371 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:25:40 smithi087 ceph-mon[29523]: Health check cleared: POOL_APP_NOT_ENABLED (was: 2 pool(s) do not have an application enabled) 2024-05-08T05:25:40.371 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:25:40 smithi087 ceph-mon[29523]: Cluster is now healthy 2024-05-08T05:25:40.483 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:25:40 smithi090 ceph-mon[34526]: pgmap v318: 97 pgs: 97 active+clean; 578 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 873 B/s wr, 2 op/s 2024-05-08T05:25:40.484 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:25:40 smithi090 ceph-mon[34526]: Health check cleared: POOL_APP_NOT_ENABLED (was: 2 pool(s) do not have an application enabled) 2024-05-08T05:25:40.484 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:25:40 smithi090 ceph-mon[34526]: Cluster is now healthy 2024-05-08T05:25:40.537 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:40.536+0000 7f952d000700 1 -- 172.21.15.87:0/1550523116 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9528106080 msgr2=0x7f9528112590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:25:40.537 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:40.536+0000 7f952d000700 1 --2- 172.21.15.87:0/1550523116 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9528106080 0x7f9528112590 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f952000b0a0 tx=0x7f952000b3b0 comp rx=0 tx=0).stop 2024-05-08T05:25:40.537 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:40.536+0000 7f952d000700 1 -- 172.21.15.87:0/1550523116 shutdown_connections 2024-05-08T05:25:40.537 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:40.536+0000 7f952d000700 1 --2- 172.21.15.87:0/1550523116 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9528106080 0x7f9528112590 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:25:40.537 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:40.536+0000 7f952d000700 1 --2- 172.21.15.87:0/1550523116 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f952810b6c0 0x7f952810baa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:25:40.537 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:40.536+0000 7f952d000700 1 --2- 172.21.15.87:0/1550523116 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f95281056c0 0x7f9528105b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:25:40.537 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:40.536+0000 7f952d000700 1 -- 172.21.15.87:0/1550523116 >> 172.21.15.87:0/1550523116 conn(0x7f95281011b0 msgr2=0x7f95281035d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:25:40.537 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:40.536+0000 7f952d000700 1 -- 172.21.15.87:0/1550523116 shutdown_connections 2024-05-08T05:25:40.537 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:40.536+0000 7f952d000700 1 -- 172.21.15.87:0/1550523116 wait complete. 2024-05-08T05:25:40.539 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:40.537+0000 7f952d000700 1 Processor -- start 2024-05-08T05:25:40.539 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:40.537+0000 7f952d000700 1 -- start start 2024-05-08T05:25:40.539 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:40.538+0000 7f952d000700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f95281056c0 0x7f952819bd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:25:40.539 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:40.538+0000 7f952d000700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9528106080 0x7f952819c250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:25:40.539 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:40.538+0000 7f952d000700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f952810b6c0 0x7f95281a05e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:25:40.539 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:40.538+0000 7f952d000700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f9528115900 con 0x7f9528106080 2024-05-08T05:25:40.539 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:40.538+0000 7f952d000700 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f9528115780 con 0x7f95281056c0 2024-05-08T05:25:40.539 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:40.538+0000 7f952d000700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f9528115a80 con 0x7f952810b6c0 2024-05-08T05:25:40.539 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:40.538+0000 7f9525400700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9528106080 0x7f952819c250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:25:40.539 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:40.538+0000 7f9526800700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f952810b6c0 0x7f95281a05e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:25:40.540 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:40.538+0000 7f9525400700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9528106080 0x7f952819c250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:36804/0 (socket says 172.21.15.87:36804) 2024-05-08T05:25:40.540 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:40.538+0000 7f9525400700 1 -- 172.21.15.87:0/2415524481 learned_addr learned my addr 172.21.15.87:0/2415524481 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T05:25:40.540 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:40.538+0000 7f9525e00700 1 --2- 172.21.15.87:0/2415524481 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f95281056c0 0x7f952819bd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:25:40.540 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:40.538+0000 7f9525400700 1 -- 172.21.15.87:0/2415524481 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f952810b6c0 msgr2=0x7f95281a05e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:25:40.540 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:40.538+0000 7f9525400700 1 --2- 172.21.15.87:0/2415524481 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f952810b6c0 0x7f95281a05e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:25:40.540 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:40.538+0000 7f9525400700 1 -- 172.21.15.87:0/2415524481 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f95281056c0 msgr2=0x7f952819bd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:25:40.540 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:40.538+0000 7f9525400700 1 --2- 172.21.15.87:0/2415524481 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f95281056c0 0x7f952819bd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:25:40.540 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:40.538+0000 7f9525400700 1 -- 172.21.15.87:0/2415524481 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f95281a0d20 con 0x7f9528106080 2024-05-08T05:25:40.540 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:40.539+0000 7f9525400700 1 --2- 172.21.15.87:0/2415524481 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9528106080 0x7f952819c250 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f951400e9a0 tx=0x7f951400ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:25:40.541 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:25:40 smithi160 ceph-mon[34827]: pgmap v318: 97 pgs: 97 active+clean; 578 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 873 B/s wr, 2 op/s 2024-05-08T05:25:40.541 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:25:40 smithi160 ceph-mon[34827]: Health check cleared: POOL_APP_NOT_ENABLED (was: 2 pool(s) do not have an application enabled) 2024-05-08T05:25:40.541 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:25:40 smithi160 ceph-mon[34827]: Cluster is now healthy 2024-05-08T05:25:40.541 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:40.539+0000 7f951ea00700 1 -- 172.21.15.87:0/2415524481 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f951400ca10 con 0x7f9528106080 2024-05-08T05:25:40.541 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:40.539+0000 7f951ea00700 1 -- 172.21.15.87:0/2415524481 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f951400cbb0 con 0x7f9528106080 2024-05-08T05:25:40.542 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:40.539+0000 7f951ea00700 1 -- 172.21.15.87:0/2415524481 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9514018680 con 0x7f9528106080 2024-05-08T05:25:40.542 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:40.539+0000 7f952d000700 1 -- 172.21.15.87:0/2415524481 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f95281a1010 con 0x7f9528106080 2024-05-08T05:25:40.542 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:40.539+0000 7f952d000700 1 -- 172.21.15.87:0/2415524481 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f95281a8890 con 0x7f9528106080 2024-05-08T05:25:40.542 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:40.540+0000 7f952d000700 1 -- 172.21.15.87:0/2415524481 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f952806a190 con 0x7f9528106080 2024-05-08T05:25:40.543 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:40.543+0000 7f951ea00700 1 -- 172.21.15.87:0/2415524481 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 16) ==== 149652+0+0 (secure 0 0 0) 0x7f9514010430 con 0x7f9528106080 2024-05-08T05:25:40.545 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:40.545+0000 7f951ea00700 1 --2- 172.21.15.87:0/2415524481 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f950c0b2900 0x7f950c0b4dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:25:40.545 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:40.545+0000 7f951ea00700 1 -- 172.21.15.87:0/2415524481 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 7979+0+0 (secure 0 0 0) 0x7f95140e2590 con 0x7f9528106080 2024-05-08T05:25:40.545 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:40.545+0000 7f9525e00700 1 --2- 172.21.15.87:0/2415524481 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f950c0b2900 0x7f950c0b4dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:25:40.546 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:40.546+0000 7f9525e00700 1 --2- 172.21.15.87:0/2415524481 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f950c0b2900 0x7f950c0b4dc0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f9518009be0 tx=0x7f9518009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:25:40.546 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:40.546+0000 7f951ea00700 1 -- 172.21.15.87:0/2415524481 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f95140aa360 con 0x7f9528106080 2024-05-08T05:25:40.784 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:40.783+0000 7f952d000700 1 -- 172.21.15.87:0/2415524481 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f952802e510 con 0x7f9528106080 2024-05-08T05:25:40.786 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:40.786+0000 7f951ea00700 1 -- 172.21.15.87:0/2415524481 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v80) ==== 74+0+22184 (secure 0 0 0) 0x7f95140b23e0 con 0x7f9528106080 2024-05-08T05:25:40.787 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-05-08T05:25:40.787 INFO:teuthology.orchestra.run.smithi087.stdout:{"epoch":80,"fsid":"eeeb813e-0cf9-11ef-bc97-c7b262605968","created":"2024-05-08T05:16:14.984330+0000","modified":"2024-05-08T05:25:36.816913+0000","last_up_change":"2024-05-08T05:24:22.324501+0000","last_in_change":"2024-05-08T05:24:01.962570+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-08T05:20:08.907941+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-08T05:25:28.054494+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-08T05:25:32.484126+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"f3e25ce0-0762-46fd-83fb-6766a2e9db69","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6802","nonce":2285285644},{"type":"v1","addr":"172.21.15.87:6803","nonce":2285285644}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6804","nonce":2285285644},{"type":"v1","addr":"172.21.15.87:6805","nonce":2285285644}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6808","nonce":2285285644},{"type":"v1","addr":"172.21.15.87:6809","nonce":2285285644}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6806","nonce":2285285644},{"type":"v1","addr":"172.21.15.87:6807","nonce":2285285644}]},"public_addr":"172.21.15.87:6803/2285285644","cluster_addr":"172.21.15.87:6805/2285285644","heartbeat_back_addr":"172.21.15.87:6809/2285285644","heartbeat_front_addr":"172.21.15.87:6807/2285285644","state":["exists","up"]},{"osd":1,"uuid":"b6de5f4c-1d79-41ff-adee-03d8a47ab55e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6800","nonce":1681573998},{"type":"v1","addr":"172.21.15.90:6801","nonce":1681573998}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6802","nonce":1681573998},{"type":"v1","addr":"172.21.15.90:6803","nonce":1681573998}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6806","nonce":1681573998},{"type":"v1","addr":"172.21.15.90:6807","nonce":1681573998}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6804","nonce":1681573998},{"type":"v1","addr":"172.21.15.90:6805","nonce":1681573998}]},"public_addr":"172.21.15.90:6801/1681573998","cluster_addr":"172.21.15.90:6803/1681573998","heartbeat_back_addr":"172.21.15.90:6807/1681573998","heartbeat_front_addr":"172.21.15.90:6805/1681573998","state":["exists","up"]},{"osd":2,"uuid":"ee3a2729-93b2-4985-b84d-165f92cae8e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6800","nonce":2137179096},{"type":"v1","addr":"172.21.15.160:6801","nonce":2137179096}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6802","nonce":2137179096},{"type":"v1","addr":"172.21.15.160:6803","nonce":2137179096}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6806","nonce":2137179096},{"type":"v1","addr":"172.21.15.160:6807","nonce":2137179096}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6804","nonce":2137179096},{"type":"v1","addr":"172.21.15.160:6805","nonce":2137179096}]},"public_addr":"172.21.15.160:6801/2137179096","cluster_addr":"172.21.15.160:6803/2137179096","heartbeat_back_addr":"172.21.15.160:6807/2137179096","heartbeat_front_addr":"172.21.15.160:6805/2137179096","state":["exists","up"]},{"osd":3,"uuid":"fc7bd69f-5a62-4ec6-b95c-c170be46a7d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6810","nonce":2022667023},{"type":"v1","addr":"172.21.15.87:6811","nonce":2022667023}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6812","nonce":2022667023},{"type":"v1","addr":"172.21.15.87:6813","nonce":2022667023}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6816","nonce":2022667023},{"type":"v1","addr":"172.21.15.87:6817","nonce":2022667023}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6814","nonce":2022667023},{"type":"v1","addr":"172.21.15.87:6815","nonce":2022667023}]},"public_addr":"172.21.15.87:6811/2022667023","cluster_addr":"172.21.15.87:6813/2022667023","heartbeat_back_addr":"172.21.15.87:6817/2022667023","heartbeat_front_addr":"172.21.15.87:6815/2022667023","state":["exists","up"]},{"osd":4,"uuid":"a05f7bd1-962a-4f3e-8f70-e7ef4c68bac2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6808","nonce":1371607578},{"type":"v1","addr":"172.21.15.90:6809","nonce":1371607578}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6810","nonce":1371607578},{"type":"v1","addr":"172.21.15.90:6811","nonce":1371607578}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6814","nonce":1371607578},{"type":"v1","addr":"172.21.15.90:6815","nonce":1371607578}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6812","nonce":1371607578},{"type":"v1","addr":"172.21.15.90:6813","nonce":1371607578}]},"public_addr":"172.21.15.90:6809/1371607578","cluster_addr":"172.21.15.90:6811/1371607578","heartbeat_back_addr":"172.21.15.90:6815/1371607578","heartbeat_front_addr":"172.21.15.90:6813/1371607578","state":["exists","up"]},{"osd":5,"uuid":"85e3af08-32ee-4f26-97df-8d54ba928715","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6808","nonce":2190054276},{"type":"v1","addr":"172.21.15.160:6809","nonce":2190054276}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6810","nonce":2190054276},{"type":"v1","addr":"172.21.15.160:6811","nonce":2190054276}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6814","nonce":2190054276},{"type":"v1","addr":"172.21.15.160:6815","nonce":2190054276}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6812","nonce":2190054276},{"type":"v1","addr":"172.21.15.160:6813","nonce":2190054276}]},"public_addr":"172.21.15.160:6809/2190054276","cluster_addr":"172.21.15.160:6811/2190054276","heartbeat_back_addr":"172.21.15.160:6815/2190054276","heartbeat_front_addr":"172.21.15.160:6813/2190054276","state":["exists","up"]},{"osd":6,"uuid":"df4b22a9-6cd8-473e-a17b-a0cb9ad32e98","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":42,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6818","nonce":2863681447},{"type":"v1","addr":"172.21.15.87:6819","nonce":2863681447}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6820","nonce":2863681447},{"type":"v1","addr":"172.21.15.87:6821","nonce":2863681447}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6824","nonce":2863681447},{"type":"v1","addr":"172.21.15.87:6825","nonce":2863681447}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6822","nonce":2863681447},{"type":"v1","addr":"172.21.15.87:6823","nonce":2863681447}]},"public_addr":"172.21.15.87:6819/2863681447","cluster_addr":"172.21.15.87:6821/2863681447","heartbeat_back_addr":"172.21.15.87:6825/2863681447","heartbeat_front_addr":"172.21.15.87:6823/2863681447","state":["exists","up"]},{"osd":7,"uuid":"f6ef3857-0366-4408-932a-a8c8479ba780","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6816","nonce":1964248958},{"type":"v1","addr":"172.21.15.90:6817","nonce":1964248958}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6818","nonce":1964248958},{"type":"v1","addr":"172.21.15.90:6819","nonce":1964248958}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6822","nonce":1964248958},{"type":"v1","addr":"172.21.15.90:6823","nonce":1964248958}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6820","nonce":1964248958},{"type":"v1","addr":"172.21.15.90:6821","nonce":1964248958}]},"public_addr":"172.21.15.90:6817/1964248958","cluster_addr":"172.21.15.90:6819/1964248958","heartbeat_back_addr":"172.21.15.90:6823/1964248958","heartbeat_front_addr":"172.21.15.90:6821/1964248958","state":["exists","up"]},{"osd":8,"uuid":"027dede9-d0be-4fbe-b7b8-02ce88d57f4d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":54,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6816","nonce":927680738},{"type":"v1","addr":"172.21.15.160:6817","nonce":927680738}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6818","nonce":927680738},{"type":"v1","addr":"172.21.15.160:6819","nonce":927680738}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6822","nonce":927680738},{"type":"v1","addr":"172.21.15.160:6823","nonce":927680738}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6820","nonce":927680738},{"type":"v1","addr":"172.21.15.160:6821","nonce":927680738}]},"public_addr":"172.21.15.160:6817/927680738","cluster_addr":"172.21.15.160:6819/927680738","heartbeat_back_addr":"172.21.15.160:6823/927680738","heartbeat_front_addr":"172.21.15.160:6821/927680738","state":["exists","up"]},{"osd":9,"uuid":"bc9e37de-e509-4db6-bd58-b68e2c8e1aff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6826","nonce":3789116749},{"type":"v1","addr":"172.21.15.87:6827","nonce":3789116749}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6828","nonce":3789116749},{"type":"v1","addr":"172.21.15.87:6829","nonce":3789116749}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6832","nonce":3789116749},{"type":"v1","addr":"172.21.15.87:6833","nonce":3789116749}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6830","nonce":3789116749},{"type":"v1","addr":"172.21.15.87:6831","nonce":3789116749}]},"public_addr":"172.21.15.87:6827/3789116749","cluster_addr":"172.21.15.87:6829/3789116749","heartbeat_back_addr":"172.21.15.87:6833/3789116749","heartbeat_front_addr":"172.21.15.87:6831/3789116749","state":["exists","up"]},{"osd":10,"uuid":"43945081-b4c8-4f5d-9301-3540709e69e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":66,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6824","nonce":716529498},{"type":"v1","addr":"172.21.15.90:6825","nonce":716529498}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6826","nonce":716529498},{"type":"v1","addr":"172.21.15.90:6827","nonce":716529498}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6830","nonce":716529498},{"type":"v1","addr":"172.21.15.90:6831","nonce":716529498}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6828","nonce":716529498},{"type":"v1","addr":"172.21.15.90:6829","nonce":716529498}]},"public_addr":"172.21.15.90:6825/716529498","cluster_addr":"172.21.15.90:6827/716529498","heartbeat_back_addr":"172.21.15.90:6831/716529498","heartbeat_front_addr":"172.21.15.90:6829/716529498","state":["exists","up"]},{"osd":11,"uuid":"da23ff5c-3f79-44e3-bca3-d9d5a003c999","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6824","nonce":1842739135},{"type":"v1","addr":"172.21.15.160:6825","nonce":1842739135}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6826","nonce":1842739135},{"type":"v1","addr":"172.21.15.160:6827","nonce":1842739135}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6830","nonce":1842739135},{"type":"v1","addr":"172.21.15.160:6831","nonce":1842739135}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6828","nonce":1842739135},{"type":"v1","addr":"172.21.15.160:6829","nonce":1842739135}]},"public_addr":"172.21.15.160:6825/1842739135","cluster_addr":"172.21.15.160:6827/1842739135","heartbeat_back_addr":"172.21.15.160:6831/1842739135","heartbeat_front_addr":"172.21.15.160:6829/1842739135","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T05:19:15.869398+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T05:19:42.014078+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T05:20:06.430660+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T05:20:38.555519+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T05:21:04.530605+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T05:21:29.545252+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T05:22:03.141982+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T05:22:29.191127+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T05:22:54.502994+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T05:23:27.899000+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T05:23:54.693979+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T05:24:20.307119+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.87:0/4226160503":"2024-05-09T05:17:22.736165+0000","172.21.15.87:0/2773684806":"2024-05-09T05:17:22.736165+0000","172.21.15.87:0/349590592":"2024-05-09T05:17:22.736165+0000","172.21.15.87:6801/2710124295":"2024-05-09T05:17:22.736165+0000","172.21.15.87:6800/1823425617":"2024-05-09T05:16:48.155337+0000","172.21.15.87:0/2393072013":"2024-05-09T05:16:48.155337+0000","172.21.15.87:0/1291525416":"2024-05-09T05:16:48.155337+0000","172.21.15.87:6801/1823425617":"2024-05-09T05:16:48.155337+0000","172.21.15.87:0/3839463573":"2024-05-09T05:16:48.155337+0000","172.21.15.87:6800/2710124295":"2024-05-09T05:17:22.736165+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-08T05:25:40.789 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:40.789+0000 7f952d000700 1 -- 172.21.15.87:0/2415524481 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f950c0b2900 msgr2=0x7f950c0b4dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:25:40.789 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:40.789+0000 7f952d000700 1 --2- 172.21.15.87:0/2415524481 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f950c0b2900 0x7f950c0b4dc0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f9518009be0 tx=0x7f9518009260 comp rx=0 tx=0).stop 2024-05-08T05:25:40.789 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:40.789+0000 7f952d000700 1 -- 172.21.15.87:0/2415524481 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9528106080 msgr2=0x7f952819c250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:25:40.789 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:40.789+0000 7f952d000700 1 --2- 172.21.15.87:0/2415524481 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9528106080 0x7f952819c250 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f951400e9a0 tx=0x7f951400ecb0 comp rx=0 tx=0).stop 2024-05-08T05:25:40.790 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:40.789+0000 7f952d000700 1 -- 172.21.15.87:0/2415524481 shutdown_connections 2024-05-08T05:25:40.790 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:40.789+0000 7f952d000700 1 --2- 172.21.15.87:0/2415524481 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f950c0b2900 0x7f950c0b4dc0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:25:40.790 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:40.789+0000 7f952d000700 1 --2- 172.21.15.87:0/2415524481 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f952810b6c0 0x7f95281a05e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:25:40.790 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:40.789+0000 7f952d000700 1 --2- 172.21.15.87:0/2415524481 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f95281056c0 0x7f952819bd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:25:40.790 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:40.789+0000 7f952d000700 1 --2- 172.21.15.87:0/2415524481 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9528106080 0x7f952819c250 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:25:40.790 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:40.789+0000 7f952d000700 1 -- 172.21.15.87:0/2415524481 >> 172.21.15.87:0/2415524481 conn(0x7f95281011b0 msgr2=0x7f9528101730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:25:40.790 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:40.789+0000 7f952d000700 1 -- 172.21.15.87:0/2415524481 shutdown_connections 2024-05-08T05:25:40.790 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:40.789+0000 7f952d000700 1 -- 172.21.15.87:0/2415524481 wait complete. 2024-05-08T05:25:41.458 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:25:41 smithi087 ceph-mon[29523]: from='client.? 172.21.15.87:0/2415524481' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-08T05:25:41.483 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:25:41 smithi090 ceph-mon[34526]: from='client.? 172.21.15.87:0/2415524481' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-08T05:25:41.535 DEBUG:teuthology.orchestra.run.smithi087:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid eeeb813e-0cf9-11ef-bc97-c7b262605968 -- ceph osd dump --format=json 2024-05-08T05:25:41.538 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:25:41 smithi160 ceph-mon[34827]: from='client.? 172.21.15.87:0/2415524481' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-08T05:25:41.979 INFO:teuthology.orchestra.run.smithi087.stderr:Inferring config /var/lib/ceph/eeeb813e-0cf9-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T05:25:42.437 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:25:42 smithi087 ceph-mon[29523]: pgmap v319: 97 pgs: 97 active+clean; 578 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s wr, 2 op/s 2024-05-08T05:25:42.483 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:25:42 smithi090 ceph-mon[34526]: pgmap v319: 97 pgs: 97 active+clean; 578 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s wr, 2 op/s 2024-05-08T05:25:42.538 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:25:42 smithi160 ceph-mon[34827]: pgmap v319: 97 pgs: 97 active+clean; 578 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s wr, 2 op/s 2024-05-08T05:25:44.082 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:44.077+0000 7fa412a00700 1 -- 172.21.15.87:0/1133333005 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa40c0756d0 msgr2=0x7fa40c075ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:25:44.083 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:44.077+0000 7fa412a00700 1 --2- 172.21.15.87:0/1133333005 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa40c0756d0 0x7fa40c075ab0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fa3fc00b0a0 tx=0x7fa3fc00b3b0 comp rx=0 tx=0).stop 2024-05-08T05:25:44.083 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:44.078+0000 7fa412a00700 1 -- 172.21.15.87:0/1133333005 shutdown_connections 2024-05-08T05:25:44.083 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:44.078+0000 7fa412a00700 1 --2- 172.21.15.87:0/1133333005 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa40c10ff00 0x7fa40c1122f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:25:44.083 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:44.078+0000 7fa412a00700 1 --2- 172.21.15.87:0/1133333005 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa40c0756d0 0x7fa40c075ab0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:25:44.083 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:44.078+0000 7fa412a00700 1 --2- 172.21.15.87:0/1133333005 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa40c075ff0 0x7fa40c10f9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:25:44.083 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:44.078+0000 7fa412a00700 1 -- 172.21.15.87:0/1133333005 >> 172.21.15.87:0/1133333005 conn(0x7fa40c07a600 msgr2=0x7fa40c07aa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:25:44.083 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:44.078+0000 7fa412a00700 1 -- 172.21.15.87:0/1133333005 shutdown_connections 2024-05-08T05:25:44.083 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:44.078+0000 7fa412a00700 1 -- 172.21.15.87:0/1133333005 wait complete. 2024-05-08T05:25:44.085 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:44.079+0000 7fa412a00700 1 Processor -- start 2024-05-08T05:25:44.085 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:44.079+0000 7fa412a00700 1 -- start start 2024-05-08T05:25:44.085 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:44.079+0000 7fa412a00700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa40c0756d0 0x7fa40c1a1940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:25:44.085 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:44.079+0000 7fa412a00700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa40c075ff0 0x7fa40c1a1e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:25:44.085 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:44.079+0000 7fa412a00700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa40c10ff00 0x7fa40c19bb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:25:44.085 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:44.079+0000 7fa412a00700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fa40c115890 con 0x7fa40c0756d0 2024-05-08T05:25:44.086 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:44.079+0000 7fa412a00700 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fa40c115710 con 0x7fa40c10ff00 2024-05-08T05:25:44.086 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:44.079+0000 7fa412a00700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7fa40c115a10 con 0x7fa40c075ff0 2024-05-08T05:25:44.086 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:44.080+0000 7fa40be00700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa40c0756d0 0x7fa40c1a1940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:25:44.086 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:44.080+0000 7fa40be00700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa40c0756d0 0x7fa40c1a1940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:36826/0 (socket says 172.21.15.87:36826) 2024-05-08T05:25:44.086 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:44.080+0000 7fa40be00700 1 -- 172.21.15.87:0/1233559750 learned_addr learned my addr 172.21.15.87:0/1233559750 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T05:25:44.086 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:44.080+0000 7fa403400700 1 --2- 172.21.15.87:0/1233559750 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa40c075ff0 0x7fa40c1a1e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:25:44.086 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:44.080+0000 7fa410a00700 1 --2- 172.21.15.87:0/1233559750 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa40c10ff00 0x7fa40c19bb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:25:44.086 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:44.080+0000 7fa40be00700 1 -- 172.21.15.87:0/1233559750 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa40c075ff0 msgr2=0x7fa40c1a1e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:25:44.086 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:44.080+0000 7fa40be00700 1 --2- 172.21.15.87:0/1233559750 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa40c075ff0 0x7fa40c1a1e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:25:44.087 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:44.080+0000 7fa40be00700 1 -- 172.21.15.87:0/1233559750 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa40c10ff00 msgr2=0x7fa40c19bb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:25:44.087 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:44.080+0000 7fa40be00700 1 --2- 172.21.15.87:0/1233559750 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa40c10ff00 0x7fa40c19bb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:25:44.087 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:44.080+0000 7fa40be00700 1 -- 172.21.15.87:0/1233559750 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa40c19c2b0 con 0x7fa40c0756d0 2024-05-08T05:25:44.087 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:44.080+0000 7fa40be00700 1 --2- 172.21.15.87:0/1233559750 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa40c0756d0 0x7fa40c1a1940 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fa3fc00b070 tx=0x7fa3fc004d00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:25:44.087 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:44.081+0000 7fa409600700 1 -- 172.21.15.87:0/1233559750 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3fc021070 con 0x7fa40c0756d0 2024-05-08T05:25:44.087 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:44.081+0000 7fa409600700 1 -- 172.21.15.87:0/1233559750 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa3fc007e30 con 0x7fa40c0756d0 2024-05-08T05:25:44.087 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:44.081+0000 7fa409600700 1 -- 172.21.15.87:0/1233559750 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3fc0046c0 con 0x7fa40c0756d0 2024-05-08T05:25:44.087 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:44.081+0000 7fa412a00700 1 -- 172.21.15.87:0/1233559750 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa40c19c540 con 0x7fa40c0756d0 2024-05-08T05:25:44.087 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:44.081+0000 7fa412a00700 1 -- 172.21.15.87:0/1233559750 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa40c1a8810 con 0x7fa40c0756d0 2024-05-08T05:25:44.087 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:44.082+0000 7fa412a00700 1 -- 172.21.15.87:0/1233559750 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa40c06a190 con 0x7fa40c0756d0 2024-05-08T05:25:44.087 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:44.084+0000 7fa409600700 1 -- 172.21.15.87:0/1233559750 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 16) ==== 149652+0+0 (secure 0 0 0) 0x7fa3fc007980 con 0x7fa40c0756d0 2024-05-08T05:25:44.088 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:44.086+0000 7fa409600700 1 --2- 172.21.15.87:0/1233559750 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7fa3f00b2900 0x7fa3f00b4dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:25:44.088 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:44.086+0000 7fa409600700 1 -- 172.21.15.87:0/1233559750 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 7979+0+0 (secure 0 0 0) 0x7fa3fc00f020 con 0x7fa40c0756d0 2024-05-08T05:25:44.088 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:44.086+0000 7fa403400700 1 --2- 172.21.15.87:0/1233559750 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7fa3f00b2900 0x7fa3f00b4dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:25:44.088 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:44.087+0000 7fa403400700 1 --2- 172.21.15.87:0/1233559750 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7fa3f00b2900 0x7fa3f00b4dc0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fa40c111a50 tx=0x7fa3f4009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:25:44.089 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:44.089+0000 7fa409600700 1 -- 172.21.15.87:0/1233559750 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7fa3fc02a020 con 0x7fa40c0756d0 2024-05-08T05:25:44.208 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:25:44 smithi087 ceph-mon[29523]: pgmap v320: 97 pgs: 97 active+clean; 579 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s wr, 5 op/s 2024-05-08T05:25:44.322 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:44.321+0000 7fa412a00700 1 -- 172.21.15.87:0/1233559750 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fa40c1a8aa0 con 0x7fa40c0756d0 2024-05-08T05:25:44.324 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:44.324+0000 7fa409600700 1 -- 172.21.15.87:0/1233559750 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v80) ==== 74+0+22184 (secure 0 0 0) 0x7fa3fc0ab7f0 con 0x7fa40c0756d0 2024-05-08T05:25:44.324 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-05-08T05:25:44.325 INFO:teuthology.orchestra.run.smithi087.stdout:{"epoch":80,"fsid":"eeeb813e-0cf9-11ef-bc97-c7b262605968","created":"2024-05-08T05:16:14.984330+0000","modified":"2024-05-08T05:25:36.816913+0000","last_up_change":"2024-05-08T05:24:22.324501+0000","last_in_change":"2024-05-08T05:24:01.962570+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-08T05:20:08.907941+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-08T05:25:28.054494+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-08T05:25:32.484126+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"f3e25ce0-0762-46fd-83fb-6766a2e9db69","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6802","nonce":2285285644},{"type":"v1","addr":"172.21.15.87:6803","nonce":2285285644}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6804","nonce":2285285644},{"type":"v1","addr":"172.21.15.87:6805","nonce":2285285644}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6808","nonce":2285285644},{"type":"v1","addr":"172.21.15.87:6809","nonce":2285285644}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6806","nonce":2285285644},{"type":"v1","addr":"172.21.15.87:6807","nonce":2285285644}]},"public_addr":"172.21.15.87:6803/2285285644","cluster_addr":"172.21.15.87:6805/2285285644","heartbeat_back_addr":"172.21.15.87:6809/2285285644","heartbeat_front_addr":"172.21.15.87:6807/2285285644","state":["exists","up"]},{"osd":1,"uuid":"b6de5f4c-1d79-41ff-adee-03d8a47ab55e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6800","nonce":1681573998},{"type":"v1","addr":"172.21.15.90:6801","nonce":1681573998}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6802","nonce":1681573998},{"type":"v1","addr":"172.21.15.90:6803","nonce":1681573998}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6806","nonce":1681573998},{"type":"v1","addr":"172.21.15.90:6807","nonce":1681573998}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6804","nonce":1681573998},{"type":"v1","addr":"172.21.15.90:6805","nonce":1681573998}]},"public_addr":"172.21.15.90:6801/1681573998","cluster_addr":"172.21.15.90:6803/1681573998","heartbeat_back_addr":"172.21.15.90:6807/1681573998","heartbeat_front_addr":"172.21.15.90:6805/1681573998","state":["exists","up"]},{"osd":2,"uuid":"ee3a2729-93b2-4985-b84d-165f92cae8e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6800","nonce":2137179096},{"type":"v1","addr":"172.21.15.160:6801","nonce":2137179096}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6802","nonce":2137179096},{"type":"v1","addr":"172.21.15.160:6803","nonce":2137179096}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6806","nonce":2137179096},{"type":"v1","addr":"172.21.15.160:6807","nonce":2137179096}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6804","nonce":2137179096},{"type":"v1","addr":"172.21.15.160:6805","nonce":2137179096}]},"public_addr":"172.21.15.160:6801/2137179096","cluster_addr":"172.21.15.160:6803/2137179096","heartbeat_back_addr":"172.21.15.160:6807/2137179096","heartbeat_front_addr":"172.21.15.160:6805/2137179096","state":["exists","up"]},{"osd":3,"uuid":"fc7bd69f-5a62-4ec6-b95c-c170be46a7d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6810","nonce":2022667023},{"type":"v1","addr":"172.21.15.87:6811","nonce":2022667023}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6812","nonce":2022667023},{"type":"v1","addr":"172.21.15.87:6813","nonce":2022667023}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6816","nonce":2022667023},{"type":"v1","addr":"172.21.15.87:6817","nonce":2022667023}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6814","nonce":2022667023},{"type":"v1","addr":"172.21.15.87:6815","nonce":2022667023}]},"public_addr":"172.21.15.87:6811/2022667023","cluster_addr":"172.21.15.87:6813/2022667023","heartbeat_back_addr":"172.21.15.87:6817/2022667023","heartbeat_front_addr":"172.21.15.87:6815/2022667023","state":["exists","up"]},{"osd":4,"uuid":"a05f7bd1-962a-4f3e-8f70-e7ef4c68bac2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6808","nonce":1371607578},{"type":"v1","addr":"172.21.15.90:6809","nonce":1371607578}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6810","nonce":1371607578},{"type":"v1","addr":"172.21.15.90:6811","nonce":1371607578}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6814","nonce":1371607578},{"type":"v1","addr":"172.21.15.90:6815","nonce":1371607578}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6812","nonce":1371607578},{"type":"v1","addr":"172.21.15.90:6813","nonce":1371607578}]},"public_addr":"172.21.15.90:6809/1371607578","cluster_addr":"172.21.15.90:6811/1371607578","heartbeat_back_addr":"172.21.15.90:6815/1371607578","heartbeat_front_addr":"172.21.15.90:6813/1371607578","state":["exists","up"]},{"osd":5,"uuid":"85e3af08-32ee-4f26-97df-8d54ba928715","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6808","nonce":2190054276},{"type":"v1","addr":"172.21.15.160:6809","nonce":2190054276}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6810","nonce":2190054276},{"type":"v1","addr":"172.21.15.160:6811","nonce":2190054276}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6814","nonce":2190054276},{"type":"v1","addr":"172.21.15.160:6815","nonce":2190054276}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6812","nonce":2190054276},{"type":"v1","addr":"172.21.15.160:6813","nonce":2190054276}]},"public_addr":"172.21.15.160:6809/2190054276","cluster_addr":"172.21.15.160:6811/2190054276","heartbeat_back_addr":"172.21.15.160:6815/2190054276","heartbeat_front_addr":"172.21.15.160:6813/2190054276","state":["exists","up"]},{"osd":6,"uuid":"df4b22a9-6cd8-473e-a17b-a0cb9ad32e98","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":42,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6818","nonce":2863681447},{"type":"v1","addr":"172.21.15.87:6819","nonce":2863681447}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6820","nonce":2863681447},{"type":"v1","addr":"172.21.15.87:6821","nonce":2863681447}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6824","nonce":2863681447},{"type":"v1","addr":"172.21.15.87:6825","nonce":2863681447}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6822","nonce":2863681447},{"type":"v1","addr":"172.21.15.87:6823","nonce":2863681447}]},"public_addr":"172.21.15.87:6819/2863681447","cluster_addr":"172.21.15.87:6821/2863681447","heartbeat_back_addr":"172.21.15.87:6825/2863681447","heartbeat_front_addr":"172.21.15.87:6823/2863681447","state":["exists","up"]},{"osd":7,"uuid":"f6ef3857-0366-4408-932a-a8c8479ba780","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6816","nonce":1964248958},{"type":"v1","addr":"172.21.15.90:6817","nonce":1964248958}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6818","nonce":1964248958},{"type":"v1","addr":"172.21.15.90:6819","nonce":1964248958}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6822","nonce":1964248958},{"type":"v1","addr":"172.21.15.90:6823","nonce":1964248958}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6820","nonce":1964248958},{"type":"v1","addr":"172.21.15.90:6821","nonce":1964248958}]},"public_addr":"172.21.15.90:6817/1964248958","cluster_addr":"172.21.15.90:6819/1964248958","heartbeat_back_addr":"172.21.15.90:6823/1964248958","heartbeat_front_addr":"172.21.15.90:6821/1964248958","state":["exists","up"]},{"osd":8,"uuid":"027dede9-d0be-4fbe-b7b8-02ce88d57f4d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":54,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6816","nonce":927680738},{"type":"v1","addr":"172.21.15.160:6817","nonce":927680738}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6818","nonce":927680738},{"type":"v1","addr":"172.21.15.160:6819","nonce":927680738}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6822","nonce":927680738},{"type":"v1","addr":"172.21.15.160:6823","nonce":927680738}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6820","nonce":927680738},{"type":"v1","addr":"172.21.15.160:6821","nonce":927680738}]},"public_addr":"172.21.15.160:6817/927680738","cluster_addr":"172.21.15.160:6819/927680738","heartbeat_back_addr":"172.21.15.160:6823/927680738","heartbeat_front_addr":"172.21.15.160:6821/927680738","state":["exists","up"]},{"osd":9,"uuid":"bc9e37de-e509-4db6-bd58-b68e2c8e1aff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6826","nonce":3789116749},{"type":"v1","addr":"172.21.15.87:6827","nonce":3789116749}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6828","nonce":3789116749},{"type":"v1","addr":"172.21.15.87:6829","nonce":3789116749}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6832","nonce":3789116749},{"type":"v1","addr":"172.21.15.87:6833","nonce":3789116749}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6830","nonce":3789116749},{"type":"v1","addr":"172.21.15.87:6831","nonce":3789116749}]},"public_addr":"172.21.15.87:6827/3789116749","cluster_addr":"172.21.15.87:6829/3789116749","heartbeat_back_addr":"172.21.15.87:6833/3789116749","heartbeat_front_addr":"172.21.15.87:6831/3789116749","state":["exists","up"]},{"osd":10,"uuid":"43945081-b4c8-4f5d-9301-3540709e69e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":66,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6824","nonce":716529498},{"type":"v1","addr":"172.21.15.90:6825","nonce":716529498}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6826","nonce":716529498},{"type":"v1","addr":"172.21.15.90:6827","nonce":716529498}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6830","nonce":716529498},{"type":"v1","addr":"172.21.15.90:6831","nonce":716529498}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6828","nonce":716529498},{"type":"v1","addr":"172.21.15.90:6829","nonce":716529498}]},"public_addr":"172.21.15.90:6825/716529498","cluster_addr":"172.21.15.90:6827/716529498","heartbeat_back_addr":"172.21.15.90:6831/716529498","heartbeat_front_addr":"172.21.15.90:6829/716529498","state":["exists","up"]},{"osd":11,"uuid":"da23ff5c-3f79-44e3-bca3-d9d5a003c999","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6824","nonce":1842739135},{"type":"v1","addr":"172.21.15.160:6825","nonce":1842739135}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6826","nonce":1842739135},{"type":"v1","addr":"172.21.15.160:6827","nonce":1842739135}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6830","nonce":1842739135},{"type":"v1","addr":"172.21.15.160:6831","nonce":1842739135}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6828","nonce":1842739135},{"type":"v1","addr":"172.21.15.160:6829","nonce":1842739135}]},"public_addr":"172.21.15.160:6825/1842739135","cluster_addr":"172.21.15.160:6827/1842739135","heartbeat_back_addr":"172.21.15.160:6831/1842739135","heartbeat_front_addr":"172.21.15.160:6829/1842739135","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T05:19:15.869398+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T05:19:42.014078+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T05:20:06.430660+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T05:20:38.555519+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T05:21:04.530605+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T05:21:29.545252+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T05:22:03.141982+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T05:22:29.191127+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T05:22:54.502994+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T05:23:27.899000+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T05:23:54.693979+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T05:24:20.307119+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.87:0/4226160503":"2024-05-09T05:17:22.736165+0000","172.21.15.87:0/2773684806":"2024-05-09T05:17:22.736165+0000","172.21.15.87:0/349590592":"2024-05-09T05:17:22.736165+0000","172.21.15.87:6801/2710124295":"2024-05-09T05:17:22.736165+0000","172.21.15.87:6800/1823425617":"2024-05-09T05:16:48.155337+0000","172.21.15.87:0/2393072013":"2024-05-09T05:16:48.155337+0000","172.21.15.87:0/1291525416":"2024-05-09T05:16:48.155337+0000","172.21.15.87:6801/1823425617":"2024-05-09T05:16:48.155337+0000","172.21.15.87:0/3839463573":"2024-05-09T05:16:48.155337+0000","172.21.15.87:6800/2710124295":"2024-05-09T05:17:22.736165+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-08T05:25:44.327 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:44.327+0000 7fa412a00700 1 -- 172.21.15.87:0/1233559750 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7fa3f00b2900 msgr2=0x7fa3f00b4dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:25:44.327 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:44.327+0000 7fa412a00700 1 --2- 172.21.15.87:0/1233559750 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7fa3f00b2900 0x7fa3f00b4dc0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fa40c111a50 tx=0x7fa3f4009260 comp rx=0 tx=0).stop 2024-05-08T05:25:44.327 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:44.327+0000 7fa412a00700 1 -- 172.21.15.87:0/1233559750 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa40c0756d0 msgr2=0x7fa40c1a1940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:25:44.327 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:44.327+0000 7fa412a00700 1 --2- 172.21.15.87:0/1233559750 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa40c0756d0 0x7fa40c1a1940 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fa3fc00b070 tx=0x7fa3fc004d00 comp rx=0 tx=0).stop 2024-05-08T05:25:44.328 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:44.327+0000 7fa412a00700 1 -- 172.21.15.87:0/1233559750 shutdown_connections 2024-05-08T05:25:44.328 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:44.327+0000 7fa412a00700 1 --2- 172.21.15.87:0/1233559750 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa40c10ff00 0x7fa40c19bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:25:44.328 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:44.327+0000 7fa412a00700 1 --2- 172.21.15.87:0/1233559750 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa40c0756d0 0x7fa40c1a1940 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:25:44.328 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:44.327+0000 7fa412a00700 1 --2- 172.21.15.87:0/1233559750 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7fa3f00b2900 0x7fa3f00b4dc0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:25:44.328 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:44.327+0000 7fa412a00700 1 --2- 172.21.15.87:0/1233559750 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa40c075ff0 0x7fa40c1a1e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:25:44.328 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:44.327+0000 7fa412a00700 1 -- 172.21.15.87:0/1233559750 >> 172.21.15.87:0/1233559750 conn(0x7fa40c07a600 msgr2=0x7fa40c1006b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:25:44.328 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:44.327+0000 7fa412a00700 1 -- 172.21.15.87:0/1233559750 shutdown_connections 2024-05-08T05:25:44.329 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:44.327+0000 7fa412a00700 1 -- 172.21.15.87:0/1233559750 wait complete. 2024-05-08T05:25:44.483 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:25:44 smithi090 ceph-mon[34526]: pgmap v320: 97 pgs: 97 active+clean; 579 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s wr, 5 op/s 2024-05-08T05:25:44.538 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:25:44 smithi160 ceph-mon[34827]: pgmap v320: 97 pgs: 97 active+clean; 579 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s wr, 5 op/s 2024-05-08T05:25:45.112 DEBUG:teuthology.orchestra.run.smithi087:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid eeeb813e-0cf9-11ef-bc97-c7b262605968 -- ceph fs set cephfs standby_count_wanted 0 2024-05-08T05:25:45.458 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:25:45 smithi087 ceph-mon[29523]: from='client.? 172.21.15.87:0/1233559750' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-08T05:25:45.483 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:25:45 smithi090 ceph-mon[34526]: from='client.? 172.21.15.87:0/1233559750' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-08T05:25:45.539 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:25:45 smithi160 ceph-mon[34827]: from='client.? 172.21.15.87:0/1233559750' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-08T05:25:45.556 INFO:teuthology.orchestra.run.smithi087.stderr:Inferring config /var/lib/ceph/eeeb813e-0cf9-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T05:25:46.385 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:25:46 smithi090 ceph-mon[34526]: pgmap v321: 97 pgs: 97 active+clean; 579 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s wr, 4 op/s 2024-05-08T05:25:46.458 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:25:46 smithi087 ceph-mon[29523]: pgmap v321: 97 pgs: 97 active+clean; 579 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s wr, 4 op/s 2024-05-08T05:25:46.538 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:25:46 smithi160 ceph-mon[34827]: pgmap v321: 97 pgs: 97 active+clean; 579 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s wr, 4 op/s 2024-05-08T05:25:47.639 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:47.637+0000 7fe8a2a00700 1 -- 172.21.15.87:0/1787553322 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe89c103750 msgr2=0x7fe89c103b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:25:47.640 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:47.637+0000 7fe8a2a00700 1 --2- 172.21.15.87:0/1787553322 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe89c103750 0x7fe89c103b30 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fe88c009fc0 tx=0x7fe88c00b330 comp rx=0 tx=0).stop 2024-05-08T05:25:47.640 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:47.637+0000 7fe8a2a00700 1 -- 172.21.15.87:0/1787553322 shutdown_connections 2024-05-08T05:25:47.640 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:47.637+0000 7fe8a2a00700 1 --2- 172.21.15.87:0/1787553322 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe89c108850 0x7fe89c1103d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:25:47.640 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:47.637+0000 7fe8a2a00700 1 --2- 172.21.15.87:0/1787553322 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe89c103750 0x7fe89c103b30 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:25:47.640 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:47.637+0000 7fe8a2a00700 1 --2- 172.21.15.87:0/1787553322 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe89c104100 0x7fe89c108120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:25:47.640 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:47.637+0000 7fe8a2a00700 1 -- 172.21.15.87:0/1787553322 >> 172.21.15.87:0/1787553322 conn(0x7fe89c07a600 msgr2=0x7fe89c07aa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:25:47.640 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:47.637+0000 7fe8a2a00700 1 -- 172.21.15.87:0/1787553322 shutdown_connections 2024-05-08T05:25:47.640 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:47.637+0000 7fe8a2a00700 1 -- 172.21.15.87:0/1787553322 wait complete. 2024-05-08T05:25:47.642 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:47.639+0000 7fe8a2a00700 1 Processor -- start 2024-05-08T05:25:47.642 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:47.639+0000 7fe8a2a00700 1 -- start start 2024-05-08T05:25:47.642 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:47.639+0000 7fe8a2a00700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe89c103750 0x7fe89c0757a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:25:47.642 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:47.639+0000 7fe8a2a00700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe89c104100 0x7fe89c075ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:25:47.642 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:47.639+0000 7fe8a2a00700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe89c108850 0x7fe89c076220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:25:47.643 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:47.639+0000 7fe8a2a00700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fe89c113690 con 0x7fe89c108850 2024-05-08T05:25:47.643 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:47.639+0000 7fe8a2a00700 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fe89c113510 con 0x7fe89c103750 2024-05-08T05:25:47.643 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:47.639+0000 7fe8a2a00700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7fe89c113810 con 0x7fe89c104100 2024-05-08T05:25:47.643 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:47.640+0000 7fe89be00700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe89c103750 0x7fe89c0757a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:25:47.643 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:47.640+0000 7fe89be00700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe89c103750 0x7fe89c0757a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.87:53340/0 (socket says 172.21.15.87:53340) 2024-05-08T05:25:47.643 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:47.640+0000 7fe89be00700 1 -- 172.21.15.87:0/3341739120 learned_addr learned my addr 172.21.15.87:0/3341739120 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T05:25:47.643 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:47.640+0000 7fe8a0a00700 1 --2- 172.21.15.87:0/3341739120 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe89c108850 0x7fe89c076220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:25:47.643 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:47.640+0000 7fe893400700 1 --2- 172.21.15.87:0/3341739120 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe89c104100 0x7fe89c075ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:25:47.643 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:47.640+0000 7fe89be00700 1 -- 172.21.15.87:0/3341739120 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe89c104100 msgr2=0x7fe89c075ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:25:47.643 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:47.640+0000 7fe89be00700 1 --2- 172.21.15.87:0/3341739120 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe89c104100 0x7fe89c075ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:25:47.643 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:47.640+0000 7fe89be00700 1 -- 172.21.15.87:0/3341739120 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe89c108850 msgr2=0x7fe89c076220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:25:47.643 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:47.640+0000 7fe89be00700 1 --2- 172.21.15.87:0/3341739120 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe89c108850 0x7fe89c076220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:25:47.643 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:47.640+0000 7fe89be00700 1 -- 172.21.15.87:0/3341739120 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe89c1a8090 con 0x7fe89c103750 2024-05-08T05:25:47.644 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:47.640+0000 7fe8a0a00700 1 --2- 172.21.15.87:0/3341739120 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe89c108850 0x7fe89c076220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T05:25:47.644 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:47.640+0000 7fe893400700 1 --2- 172.21.15.87:0/3341739120 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe89c104100 0x7fe89c075ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T05:25:47.644 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:47.640+0000 7fe89be00700 1 --2- 172.21.15.87:0/3341739120 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe89c103750 0x7fe89c0757a0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fe88c00ccb0 tx=0x7fe88c004f90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:25:47.644 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:47.641+0000 7fe899600700 1 -- 172.21.15.87:0/3341739120 <== mon.2 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe88c021070 con 0x7fe89c103750 2024-05-08T05:25:47.644 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:47.641+0000 7fe899600700 1 -- 172.21.15.87:0/3341739120 <== mon.2 v2:172.21.15.90:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe88c007b40 con 0x7fe89c103750 2024-05-08T05:25:47.644 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:47.641+0000 7fe8a2a00700 1 -- 172.21.15.87:0/3341739120 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe89c1a8320 con 0x7fe89c103750 2024-05-08T05:25:47.644 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:47.641+0000 7fe899600700 1 -- 172.21.15.87:0/3341739120 <== mon.2 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe88c0052a0 con 0x7fe89c103750 2024-05-08T05:25:47.644 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:47.641+0000 7fe8a2a00700 1 -- 172.21.15.87:0/3341739120 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe89c1a87d0 con 0x7fe89c103750 2024-05-08T05:25:47.644 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:47.642+0000 7fe8a2a00700 1 -- 172.21.15.87:0/3341739120 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe89c10ba90 con 0x7fe89c103750 2024-05-08T05:25:47.645 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:47.644+0000 7fe899600700 1 -- 172.21.15.87:0/3341739120 <== mon.2 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 16) ==== 149652+0+0 (secure 0 0 0) 0x7fe88c024070 con 0x7fe89c103750 2024-05-08T05:25:47.647 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:47.645+0000 7fe899600700 1 --2- 172.21.15.87:0/3341739120 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7fe8800b2880 0x7fe8800b4d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:25:47.647 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:47.646+0000 7fe899600700 1 -- 172.21.15.87:0/3341739120 <== mon.2 v2:172.21.15.90:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 7979+0+0 (secure 0 0 0) 0x7fe88c00f020 con 0x7fe89c103750 2024-05-08T05:25:47.647 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:47.646+0000 7fe893400700 1 --2- 172.21.15.87:0/3341739120 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7fe8800b2880 0x7fe8800b4d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:25:47.647 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:47.646+0000 7fe893400700 1 --2- 172.21.15.87:0/3341739120 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7fe8800b2880 0x7fe8800b4d40 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fe89c103020 tx=0x7fe884009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:25:47.649 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:47.648+0000 7fe899600700 1 -- 172.21.15.87:0/3341739120 <== mon.2 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7fe88c02b020 con 0x7fe89c103750 2024-05-08T05:25:47.928 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:47.926+0000 7fe8a2a00700 1 -- 172.21.15.87:0/3341739120 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7fe89c10b470 con 0x7fe89c103750 2024-05-08T05:25:48.126 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:48.124+0000 7fe899600700 1 -- 172.21.15.87:0/3341739120 <== mon.2 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v17) ==== 118+0+0 (secure 0 0 0) 0x7fe88c0ab8d0 con 0x7fe89c103750 2024-05-08T05:25:48.130 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:48.128+0000 7fe8a2a00700 1 -- 172.21.15.87:0/3341739120 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7fe8800b2880 msgr2=0x7fe8800b4d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:25:48.130 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:48.128+0000 7fe8a2a00700 1 --2- 172.21.15.87:0/3341739120 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7fe8800b2880 0x7fe8800b4d40 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fe89c103020 tx=0x7fe884009260 comp rx=0 tx=0).stop 2024-05-08T05:25:48.130 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:48.128+0000 7fe8a2a00700 1 -- 172.21.15.87:0/3341739120 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe89c103750 msgr2=0x7fe89c0757a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:25:48.130 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:48.128+0000 7fe8a2a00700 1 --2- 172.21.15.87:0/3341739120 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe89c103750 0x7fe89c0757a0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fe88c00ccb0 tx=0x7fe88c004f90 comp rx=0 tx=0).stop 2024-05-08T05:25:48.130 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:48.129+0000 7fe8a2a00700 1 -- 172.21.15.87:0/3341739120 shutdown_connections 2024-05-08T05:25:48.131 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:48.129+0000 7fe8a2a00700 1 --2- 172.21.15.87:0/3341739120 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe89c108850 0x7fe89c076220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:25:48.131 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:48.129+0000 7fe8a2a00700 1 --2- 172.21.15.87:0/3341739120 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe89c103750 0x7fe89c0757a0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:25:48.131 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:48.129+0000 7fe8a2a00700 1 --2- 172.21.15.87:0/3341739120 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7fe8800b2880 0x7fe8800b4d40 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:25:48.131 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:48.129+0000 7fe8a2a00700 1 --2- 172.21.15.87:0/3341739120 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe89c104100 0x7fe89c075ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:25:48.131 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:48.129+0000 7fe8a2a00700 1 -- 172.21.15.87:0/3341739120 >> 172.21.15.87:0/3341739120 conn(0x7fe89c07a600 msgr2=0x7fe89c1099a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:25:48.131 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:48.129+0000 7fe8a2a00700 1 -- 172.21.15.87:0/3341739120 shutdown_connections 2024-05-08T05:25:48.131 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:48.129+0000 7fe8a2a00700 1 -- 172.21.15.87:0/3341739120 wait complete. 2024-05-08T05:25:48.208 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:25:48 smithi087 ceph-mon[29523]: pgmap v322: 97 pgs: 97 active+clean; 579 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s wr, 4 op/s 2024-05-08T05:25:48.209 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:25:48 smithi087 ceph-mon[29523]: from='client.? 172.21.15.87:0/3341739120' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]: dispatch 2024-05-08T05:25:48.209 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:25:48 smithi087 ceph-mon[29523]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]: dispatch 2024-05-08T05:25:48.484 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:25:48 smithi090 ceph-mon[34526]: pgmap v322: 97 pgs: 97 active+clean; 579 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s wr, 4 op/s 2024-05-08T05:25:48.484 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:25:48 smithi090 ceph-mon[34526]: from='client.? 172.21.15.87:0/3341739120' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]: dispatch 2024-05-08T05:25:48.484 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:25:48 smithi090 ceph-mon[34526]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]: dispatch 2024-05-08T05:25:48.538 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:25:48 smithi160 ceph-mon[34827]: pgmap v322: 97 pgs: 97 active+clean; 579 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s wr, 4 op/s 2024-05-08T05:25:48.539 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:25:48 smithi160 ceph-mon[34827]: from='client.? 172.21.15.87:0/3341739120' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]: dispatch 2024-05-08T05:25:48.539 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:25:48 smithi160 ceph-mon[34827]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]: dispatch 2024-05-08T05:25:48.874 DEBUG:tasks.cephfs.filesystem:fs_config: {'max_mds': 3, 'session_timeout': 300, 'standby_replay': True, 'subvols': {'create': 2}} 2024-05-08T05:25:48.875 DEBUG:teuthology.orchestra.run.smithi087:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid eeeb813e-0cf9-11ef-bc97-c7b262605968 -- ceph fs set cephfs max_mds 3 2024-05-08T05:25:49.314 INFO:teuthology.orchestra.run.smithi087.stderr:Inferring config /var/lib/ceph/eeeb813e-0cf9-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T05:25:49.459 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:25:49 smithi087 ceph-mon[29523]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2024-05-08T05:25:49.459 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:25:49 smithi087 ceph-mon[29523]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-05-08T05:25:49.483 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:25:49 smithi090 ceph-mon[34526]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2024-05-08T05:25:49.483 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:25:49 smithi090 ceph-mon[34526]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-05-08T05:25:49.538 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:25:49 smithi160 ceph-mon[34827]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2024-05-08T05:25:49.538 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:25:49 smithi160 ceph-mon[34827]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-05-08T05:25:50.458 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:25:50 smithi087 ceph-mon[29523]: pgmap v323: 97 pgs: 97 active+clean; 579 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s wr, 3 op/s 2024-05-08T05:25:50.483 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:25:50 smithi090 ceph-mon[34526]: pgmap v323: 97 pgs: 97 active+clean; 579 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s wr, 3 op/s 2024-05-08T05:25:50.538 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:25:50 smithi160 ceph-mon[34827]: pgmap v323: 97 pgs: 97 active+clean; 579 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s wr, 3 op/s 2024-05-08T05:25:51.366 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:51.364+0000 7f57fe000700 1 -- 172.21.15.87:0/2643771070 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f57f81099e0 msgr2=0x7f57f8109e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:25:51.366 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:51.364+0000 7f57fe000700 1 --2- 172.21.15.87:0/2643771070 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f57f81099e0 0x7f57f8109e60 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f57e4009990 tx=0x7f57e4009ca0 comp rx=0 tx=0).stop 2024-05-08T05:25:51.367 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:51.364+0000 7f57fe000700 1 -- 172.21.15.87:0/2643771070 shutdown_connections 2024-05-08T05:25:51.367 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:51.364+0000 7f57fe000700 1 --2- 172.21.15.87:0/2643771070 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f57f810a3a0 0x7f57f8116840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:25:51.367 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:51.364+0000 7f57fe000700 1 --2- 172.21.15.87:0/2643771070 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f57f810e8b0 0x7f57f810ec90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:25:51.367 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:51.364+0000 7f57fe000700 1 --2- 172.21.15.87:0/2643771070 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f57f81099e0 0x7f57f8109e60 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:25:51.367 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:51.364+0000 7f57fe000700 1 -- 172.21.15.87:0/2643771070 >> 172.21.15.87:0/2643771070 conn(0x7f57f8079230 msgr2=0x7f57f81082c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:25:51.367 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:51.364+0000 7f57fe000700 1 -- 172.21.15.87:0/2643771070 shutdown_connections 2024-05-08T05:25:51.368 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:51.364+0000 7f57fe000700 1 -- 172.21.15.87:0/2643771070 wait complete. 2024-05-08T05:25:51.370 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:51.365+0000 7f57fe000700 1 Processor -- start 2024-05-08T05:25:51.370 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:51.366+0000 7f57fe000700 1 -- start start 2024-05-08T05:25:51.370 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:51.366+0000 7f57fe000700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f57f81099e0 0x7f57f81a0220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:25:51.370 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:51.366+0000 7f57fe000700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f57f810a3a0 0x7f57f81a0760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:25:51.370 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:51.366+0000 7f57fe000700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f57f810e8b0 0x7f57f81a4aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:25:51.370 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:51.366+0000 7f57fe000700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f57f8119be0 con 0x7f57f810e8b0 2024-05-08T05:25:51.371 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:51.366+0000 7f57fe000700 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f57f8119a60 con 0x7f57f81099e0 2024-05-08T05:25:51.371 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:51.366+0000 7f57fe000700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f57f8119d60 con 0x7f57f810a3a0 2024-05-08T05:25:51.371 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:51.366+0000 7f57fd600700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f57f810e8b0 0x7f57f81a4aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:25:51.371 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:51.366+0000 7f57fcc00700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f57f81099e0 0x7f57f81a0220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:25:51.371 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:51.366+0000 7f57fcc00700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f57f81099e0 0x7f57f81a0220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.87:53372/0 (socket says 172.21.15.87:53372) 2024-05-08T05:25:51.371 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:51.366+0000 7f57fd600700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f57f810e8b0 0x7f57f81a4aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:50434/0 (socket says 172.21.15.87:50434) 2024-05-08T05:25:51.371 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:51.366+0000 7f57fcc00700 1 -- 172.21.15.87:0/1912209161 learned_addr learned my addr 172.21.15.87:0/1912209161 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T05:25:51.371 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:51.367+0000 7f57f7e00700 1 --2- 172.21.15.87:0/1912209161 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f57f810a3a0 0x7f57f81a0760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:25:51.371 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:51.367+0000 7f57fd600700 1 -- 172.21.15.87:0/1912209161 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f57f810a3a0 msgr2=0x7f57f81a0760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:25:51.372 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:51.367+0000 7f57fd600700 1 --2- 172.21.15.87:0/1912209161 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f57f810a3a0 0x7f57f81a0760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:25:51.372 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:51.367+0000 7f57fd600700 1 -- 172.21.15.87:0/1912209161 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f57f81099e0 msgr2=0x7f57f81a0220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:25:51.372 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:51.367+0000 7f57fd600700 1 --2- 172.21.15.87:0/1912209161 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f57f81099e0 0x7f57f81a0220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:25:51.372 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:51.367+0000 7f57fd600700 1 -- 172.21.15.87:0/1912209161 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f57f81a51e0 con 0x7f57f810e8b0 2024-05-08T05:25:51.372 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:51.367+0000 7f57fcc00700 1 --2- 172.21.15.87:0/1912209161 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f57f81099e0 0x7f57f81a0220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T05:25:51.372 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:51.367+0000 7f57fd600700 1 --2- 172.21.15.87:0/1912209161 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f57f810e8b0 0x7f57f81a4aa0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f57f000efc0 tx=0x7f57f000c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:25:51.372 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:51.368+0000 7f57f5600700 1 -- 172.21.15.87:0/1912209161 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57f00092e0 con 0x7f57f810e8b0 2024-05-08T05:25:51.372 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:51.368+0000 7f57f5600700 1 -- 172.21.15.87:0/1912209161 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f57f0004bb0 con 0x7f57f810e8b0 2024-05-08T05:25:51.372 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:51.368+0000 7f57fe000700 1 -- 172.21.15.87:0/1912209161 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f57f81a5470 con 0x7f57f810e8b0 2024-05-08T05:25:51.372 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:51.368+0000 7f57f5600700 1 -- 172.21.15.87:0/1912209161 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57f0004020 con 0x7f57f810e8b0 2024-05-08T05:25:51.372 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:51.368+0000 7f57fe000700 1 -- 172.21.15.87:0/1912209161 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f57f81acd50 con 0x7f57f810e8b0 2024-05-08T05:25:51.373 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:51.369+0000 7f57fe000700 1 -- 172.21.15.87:0/1912209161 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f57f806a190 con 0x7f57f810e8b0 2024-05-08T05:25:51.373 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:51.371+0000 7f57f5600700 1 -- 172.21.15.87:0/1912209161 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 16) ==== 149652+0+0 (secure 0 0 0) 0x7f57f001b030 con 0x7f57f810e8b0 2024-05-08T05:25:51.374 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:51.373+0000 7f57f5600700 1 --2- 172.21.15.87:0/1912209161 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f57e00b2880 0x7f57e00b4d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:25:51.374 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:51.373+0000 7f57f5600700 1 -- 172.21.15.87:0/1912209161 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 7979+0+0 (secure 0 0 0) 0x7f57f00e1c90 con 0x7f57f810e8b0 2024-05-08T05:25:51.374 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:51.373+0000 7f57fcc00700 1 --2- 172.21.15.87:0/1912209161 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f57e00b2880 0x7f57e00b4d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:25:51.375 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:51.374+0000 7f57fcc00700 1 --2- 172.21.15.87:0/1912209161 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f57e00b2880 0x7f57e00b4d40 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f57ec011550 tx=0x7f57ec009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:25:51.379 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:51.378+0000 7f57f5600700 1 -- 172.21.15.87:0/1912209161 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f57f0022020 con 0x7f57f810e8b0 2024-05-08T05:25:51.662 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:51.660+0000 7f57fe000700 1 -- 172.21.15.87:0/1912209161 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"} v 0) -- 0x7f57f802e510 con 0x7f57f810e8b0 2024-05-08T05:25:51.893 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:51.891+0000 7f57f5600700 1 -- 172.21.15.87:0/1912209161 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]=0 v18) ==== 105+0+0 (secure 0 0 0) 0x7f57f0010040 con 0x7f57f810e8b0 2024-05-08T05:25:51.897 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:51.895+0000 7f57fe000700 1 -- 172.21.15.87:0/1912209161 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f57e00b2880 msgr2=0x7f57e00b4d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:25:51.897 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:51.895+0000 7f57fe000700 1 --2- 172.21.15.87:0/1912209161 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f57e00b2880 0x7f57e00b4d40 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f57ec011550 tx=0x7f57ec009260 comp rx=0 tx=0).stop 2024-05-08T05:25:51.897 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:51.895+0000 7f57fe000700 1 -- 172.21.15.87:0/1912209161 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f57f810e8b0 msgr2=0x7f57f81a4aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:25:51.897 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:51.895+0000 7f57fe000700 1 --2- 172.21.15.87:0/1912209161 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f57f810e8b0 0x7f57f81a4aa0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f57f000efc0 tx=0x7f57f000c3a0 comp rx=0 tx=0).stop 2024-05-08T05:25:51.897 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:51.895+0000 7f57fe000700 1 -- 172.21.15.87:0/1912209161 shutdown_connections 2024-05-08T05:25:51.897 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:51.895+0000 7f57fe000700 1 --2- 172.21.15.87:0/1912209161 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f57f810e8b0 0x7f57f81a4aa0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:25:51.898 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:51.895+0000 7f57fe000700 1 --2- 172.21.15.87:0/1912209161 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f57f81099e0 0x7f57f81a0220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:25:51.898 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:51.895+0000 7f57fe000700 1 --2- 172.21.15.87:0/1912209161 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f57e00b2880 0x7f57e00b4d40 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:25:51.898 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:51.895+0000 7f57fe000700 1 --2- 172.21.15.87:0/1912209161 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f57f810a3a0 0x7f57f81a0760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:25:51.898 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:51.895+0000 7f57fe000700 1 -- 172.21.15.87:0/1912209161 >> 172.21.15.87:0/1912209161 conn(0x7f57f8079230 msgr2=0x7f57f8079990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:25:51.898 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:51.896+0000 7f57fe000700 1 -- 172.21.15.87:0/1912209161 shutdown_connections 2024-05-08T05:25:51.898 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:51.896+0000 7f57fe000700 1 -- 172.21.15.87:0/1912209161 wait complete. 2024-05-08T05:25:52.209 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:25:52 smithi087 ceph-mon[29523]: pgmap v324: 97 pgs: 97 active+clean; 579 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s wr, 2 op/s 2024-05-08T05:25:52.209 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:25:52 smithi087 ceph-mon[29523]: from='client.? 172.21.15.87:0/1912209161' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]: dispatch 2024-05-08T05:25:52.209 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:25:52 smithi087 ceph-mon[29523]: daemon mds.g assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2024-05-08T05:25:52.209 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:25:52 smithi087 ceph-mon[29523]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-05-08T05:25:52.209 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:25:52 smithi087 ceph-mon[29523]: from='client.? 172.21.15.87:0/1912209161' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]': finished 2024-05-08T05:25:52.210 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:25:52 smithi087 ceph-mon[29523]: fsmap cephfs:2 {0=b=up:active,1=g=up:creating} 10 up:standby 2024-05-08T05:25:52.210 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:25:52 smithi087 ceph-mon[29523]: daemon mds.g is now active in filesystem cephfs as rank 1 2024-05-08T05:25:52.483 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:25:52 smithi090 ceph-mon[34526]: pgmap v324: 97 pgs: 97 active+clean; 579 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s wr, 2 op/s 2024-05-08T05:25:52.484 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:25:52 smithi090 ceph-mon[34526]: from='client.? 172.21.15.87:0/1912209161' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]: dispatch 2024-05-08T05:25:52.484 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:25:52 smithi090 ceph-mon[34526]: daemon mds.g assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2024-05-08T05:25:52.484 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:25:52 smithi090 ceph-mon[34526]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-05-08T05:25:52.484 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:25:52 smithi090 ceph-mon[34526]: from='client.? 172.21.15.87:0/1912209161' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]': finished 2024-05-08T05:25:52.484 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:25:52 smithi090 ceph-mon[34526]: fsmap cephfs:2 {0=b=up:active,1=g=up:creating} 10 up:standby 2024-05-08T05:25:52.484 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:25:52 smithi090 ceph-mon[34526]: daemon mds.g is now active in filesystem cephfs as rank 1 2024-05-08T05:25:52.538 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:25:52 smithi160 ceph-mon[34827]: pgmap v324: 97 pgs: 97 active+clean; 579 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s wr, 2 op/s 2024-05-08T05:25:52.539 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:25:52 smithi160 ceph-mon[34827]: from='client.? 172.21.15.87:0/1912209161' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]: dispatch 2024-05-08T05:25:52.539 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:25:52 smithi160 ceph-mon[34827]: daemon mds.g assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2024-05-08T05:25:52.539 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:25:52 smithi160 ceph-mon[34827]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-05-08T05:25:52.539 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:25:52 smithi160 ceph-mon[34827]: from='client.? 172.21.15.87:0/1912209161' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]': finished 2024-05-08T05:25:52.539 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:25:52 smithi160 ceph-mon[34827]: fsmap cephfs:2 {0=b=up:active,1=g=up:creating} 10 up:standby 2024-05-08T05:25:52.539 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:25:52 smithi160 ceph-mon[34827]: daemon mds.g is now active in filesystem cephfs as rank 1 2024-05-08T05:25:52.691 DEBUG:teuthology.orchestra.run.smithi087:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid eeeb813e-0cf9-11ef-bc97-c7b262605968 -- ceph fs set cephfs allow_standby_replay true 2024-05-08T05:25:53.130 INFO:teuthology.orchestra.run.smithi087.stderr:Inferring config /var/lib/ceph/eeeb813e-0cf9-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T05:25:54.208 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:25:53 smithi087 ceph-mon[29523]: pgmap v325: 97 pgs: 97 active+clean; 580 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 426 B/s wr, 2 op/s 2024-05-08T05:25:54.209 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:25:53 smithi087 ceph-mon[29523]: mds.? [v2:172.21.15.87:6838/2127215876,v1:172.21.15.87:6839/2127215876] up:active 2024-05-08T05:25:54.209 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:25:53 smithi087 ceph-mon[29523]: daemon mds.i assigned to filesystem cephfs as rank 2 (now has 3 ranks) 2024-05-08T05:25:54.209 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:25:53 smithi087 ceph-mon[29523]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-05-08T05:25:54.209 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:25:53 smithi087 ceph-mon[29523]: Cluster is now healthy 2024-05-08T05:25:54.209 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:25:53 smithi087 ceph-mon[29523]: fsmap cephfs:2 {0=b=up:active,1=g=up:active} 10 up:standby 2024-05-08T05:25:54.209 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:25:53 smithi087 ceph-mon[29523]: fsmap cephfs:3 {0=b=up:active,1=g=up:active,2=i=up:creating} 9 up:standby 2024-05-08T05:25:54.209 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:25:53 smithi087 ceph-mon[29523]: daemon mds.i is now active in filesystem cephfs as rank 2 2024-05-08T05:25:54.233 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:25:53 smithi090 ceph-mon[34526]: pgmap v325: 97 pgs: 97 active+clean; 580 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 426 B/s wr, 2 op/s 2024-05-08T05:25:54.233 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:25:53 smithi090 ceph-mon[34526]: mds.? [v2:172.21.15.87:6838/2127215876,v1:172.21.15.87:6839/2127215876] up:active 2024-05-08T05:25:54.233 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:25:53 smithi090 ceph-mon[34526]: daemon mds.i assigned to filesystem cephfs as rank 2 (now has 3 ranks) 2024-05-08T05:25:54.233 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:25:53 smithi090 ceph-mon[34526]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-05-08T05:25:54.233 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:25:53 smithi090 ceph-mon[34526]: Cluster is now healthy 2024-05-08T05:25:54.233 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:25:53 smithi090 ceph-mon[34526]: fsmap cephfs:2 {0=b=up:active,1=g=up:active} 10 up:standby 2024-05-08T05:25:54.233 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:25:53 smithi090 ceph-mon[34526]: fsmap cephfs:3 {0=b=up:active,1=g=up:active,2=i=up:creating} 9 up:standby 2024-05-08T05:25:54.234 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:25:53 smithi090 ceph-mon[34526]: daemon mds.i is now active in filesystem cephfs as rank 2 2024-05-08T05:25:54.288 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:25:53 smithi160 ceph-mon[34827]: pgmap v325: 97 pgs: 97 active+clean; 580 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 426 B/s wr, 2 op/s 2024-05-08T05:25:54.288 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:25:53 smithi160 ceph-mon[34827]: mds.? [v2:172.21.15.87:6838/2127215876,v1:172.21.15.87:6839/2127215876] up:active 2024-05-08T05:25:54.289 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:25:53 smithi160 ceph-mon[34827]: daemon mds.i assigned to filesystem cephfs as rank 2 (now has 3 ranks) 2024-05-08T05:25:54.289 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:25:53 smithi160 ceph-mon[34827]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-05-08T05:25:54.289 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:25:53 smithi160 ceph-mon[34827]: Cluster is now healthy 2024-05-08T05:25:54.289 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:25:53 smithi160 ceph-mon[34827]: fsmap cephfs:2 {0=b=up:active,1=g=up:active} 10 up:standby 2024-05-08T05:25:54.289 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:25:53 smithi160 ceph-mon[34827]: fsmap cephfs:3 {0=b=up:active,1=g=up:active,2=i=up:creating} 9 up:standby 2024-05-08T05:25:54.289 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:25:53 smithi160 ceph-mon[34827]: daemon mds.i is now active in filesystem cephfs as rank 2 2024-05-08T05:25:54.949 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:25:54 smithi087 ceph-mon[29523]: mds.? [v2:172.21.15.160:6838/234657686,v1:172.21.15.160:6839/234657686] up:active 2024-05-08T05:25:54.949 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:25:54 smithi087 ceph-mon[29523]: fsmap cephfs:3 {0=b=up:active,1=g=up:active,2=i=up:active} 9 up:standby 2024-05-08T05:25:55.233 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:25:54 smithi090 ceph-mon[34526]: mds.? [v2:172.21.15.160:6838/234657686,v1:172.21.15.160:6839/234657686] up:active 2024-05-08T05:25:55.233 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:25:54 smithi090 ceph-mon[34526]: fsmap cephfs:3 {0=b=up:active,1=g=up:active,2=i=up:active} 9 up:standby 2024-05-08T05:25:55.244 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:55.242+0000 7f2f99a00700 1 -- 172.21.15.87:0/2909276869 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2f94114670 msgr2=0x7f2f94116a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:25:55.244 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:55.242+0000 7f2f99a00700 1 --2- 172.21.15.87:0/2909276869 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2f94114670 0x7f2f94116a60 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f2f8c009990 tx=0x7f2f8c009ca0 comp rx=0 tx=0).stop 2024-05-08T05:25:55.244 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:55.242+0000 7f2f99a00700 1 -- 172.21.15.87:0/2909276869 shutdown_connections 2024-05-08T05:25:55.244 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:55.242+0000 7f2f99a00700 1 --2- 172.21.15.87:0/2909276869 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2f94114670 0x7f2f94116a60 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:25:55.244 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:55.242+0000 7f2f99a00700 1 --2- 172.21.15.87:0/2909276869 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2f940756d0 0x7f2f94075ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:25:55.244 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:55.242+0000 7f2f99a00700 1 --2- 172.21.15.87:0/2909276869 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2f94075ff0 0x7f2f94114130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:25:55.244 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:55.242+0000 7f2f99a00700 1 -- 172.21.15.87:0/2909276869 >> 172.21.15.87:0/2909276869 conn(0x7f2f9407a600 msgr2=0x7f2f9407aa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:25:55.244 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:55.242+0000 7f2f99a00700 1 -- 172.21.15.87:0/2909276869 shutdown_connections 2024-05-08T05:25:55.244 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:55.242+0000 7f2f99a00700 1 -- 172.21.15.87:0/2909276869 wait complete. 2024-05-08T05:25:55.245 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:55.243+0000 7f2f99a00700 1 Processor -- start 2024-05-08T05:25:55.245 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:55.243+0000 7f2f99a00700 1 -- start start 2024-05-08T05:25:55.245 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:55.244+0000 7f2f99a00700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2f940756d0 0x7f2f941a0170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:25:55.245 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:55.244+0000 7f2f99a00700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2f94075ff0 0x7f2f941a06b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:25:55.245 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:55.244+0000 7f2f99a00700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2f94114670 0x7f2f941a4a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:25:55.246 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:55.244+0000 7f2f99a00700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f2f94119c80 con 0x7f2f940756d0 2024-05-08T05:25:55.246 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:55.244+0000 7f2f99a00700 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f2f94119b00 con 0x7f2f94075ff0 2024-05-08T05:25:55.246 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:55.244+0000 7f2f99a00700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f2f94119e00 con 0x7f2f94114670 2024-05-08T05:25:55.246 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:55.244+0000 7f2f92a00700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2f940756d0 0x7f2f941a0170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:25:55.246 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:55.244+0000 7f2f92a00700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2f940756d0 0x7f2f941a0170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:50456/0 (socket says 172.21.15.87:50456) 2024-05-08T05:25:55.246 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:55.244+0000 7f2f92a00700 1 -- 172.21.15.87:0/3481549122 learned_addr learned my addr 172.21.15.87:0/3481549122 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T05:25:55.247 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:55.244+0000 7f2f93400700 1 --2- 172.21.15.87:0/3481549122 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2f94114670 0x7f2f941a4a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:25:55.247 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:55.244+0000 7f2f8a000700 1 --2- 172.21.15.87:0/3481549122 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2f94075ff0 0x7f2f941a06b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:25:55.247 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:55.244+0000 7f2f92a00700 1 -- 172.21.15.87:0/3481549122 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2f94114670 msgr2=0x7f2f941a4a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:25:55.247 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:55.244+0000 7f2f92a00700 1 --2- 172.21.15.87:0/3481549122 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2f94114670 0x7f2f941a4a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:25:55.247 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:55.245+0000 7f2f92a00700 1 -- 172.21.15.87:0/3481549122 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2f94075ff0 msgr2=0x7f2f941a06b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:25:55.247 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:55.245+0000 7f2f92a00700 1 --2- 172.21.15.87:0/3481549122 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2f94075ff0 0x7f2f941a06b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:25:55.247 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:55.245+0000 7f2f92a00700 1 -- 172.21.15.87:0/3481549122 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2f941a5180 con 0x7f2f940756d0 2024-05-08T05:25:55.247 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:55.245+0000 7f2f8a000700 1 --2- 172.21.15.87:0/3481549122 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2f94075ff0 0x7f2f941a06b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T05:25:55.248 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:55.245+0000 7f2f92a00700 1 --2- 172.21.15.87:0/3481549122 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2f940756d0 0x7f2f941a0170 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f2f8400c370 tx=0x7f2f8400c680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:25:55.248 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:55.245+0000 7f2f8be00700 1 -- 172.21.15.87:0/3481549122 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f8400cea0 con 0x7f2f940756d0 2024-05-08T05:25:55.248 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:55.245+0000 7f2f99a00700 1 -- 172.21.15.87:0/3481549122 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2f941a5410 con 0x7f2f940756d0 2024-05-08T05:25:55.248 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:55.245+0000 7f2f8be00700 1 -- 172.21.15.87:0/3481549122 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2f840090d0 con 0x7f2f940756d0 2024-05-08T05:25:55.248 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:55.245+0000 7f2f8be00700 1 -- 172.21.15.87:0/3481549122 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f84004770 con 0x7f2f940756d0 2024-05-08T05:25:55.248 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:55.245+0000 7f2f99a00700 1 -- 172.21.15.87:0/3481549122 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2f941accf0 con 0x7f2f940756d0 2024-05-08T05:25:55.248 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:55.246+0000 7f2f99a00700 1 -- 172.21.15.87:0/3481549122 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2f9406a190 con 0x7f2f940756d0 2024-05-08T05:25:55.250 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:55.249+0000 7f2f8be00700 1 -- 172.21.15.87:0/3481549122 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 16) ==== 149652+0+0 (secure 0 0 0) 0x7f2f8401a020 con 0x7f2f940756d0 2024-05-08T05:25:55.251 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:55.250+0000 7f2f8be00700 1 --2- 172.21.15.87:0/3481549122 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f2f780b2880 0x7f2f780b4d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:25:55.252 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:55.250+0000 7f2f8be00700 1 -- 172.21.15.87:0/3481549122 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 7979+0+0 (secure 0 0 0) 0x7f2f840e1b10 con 0x7f2f940756d0 2024-05-08T05:25:55.252 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:55.250+0000 7f2f8a000700 1 --2- 172.21.15.87:0/3481549122 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f2f780b2880 0x7f2f780b4d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:25:55.252 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:55.251+0000 7f2f8a000700 1 --2- 172.21.15.87:0/3481549122 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f2f780b2880 0x7f2f780b4d40 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f2f94110f00 tx=0x7f2f7c009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:25:55.256 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:55.255+0000 7f2f8be00700 1 -- 172.21.15.87:0/3481549122 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f2f84010040 con 0x7f2f940756d0 2024-05-08T05:25:55.288 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:25:54 smithi160 ceph-mon[34827]: mds.? [v2:172.21.15.160:6838/234657686,v1:172.21.15.160:6839/234657686] up:active 2024-05-08T05:25:55.288 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:25:54 smithi160 ceph-mon[34827]: fsmap cephfs:3 {0=b=up:active,1=g=up:active,2=i=up:active} 9 up:standby 2024-05-08T05:25:55.539 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:55.537+0000 7f2f99a00700 1 -- 172.21.15.87:0/3481549122 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"} v 0) -- 0x7f2f941acf80 con 0x7f2f940756d0 2024-05-08T05:25:55.941 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:55.939+0000 7f2f8be00700 1 -- 172.21.15.87:0/3481549122 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]=0 v22) ==== 121+0+0 (secure 0 0 0) 0x7f2f840a98e0 con 0x7f2f940756d0 2024-05-08T05:25:55.945 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:55.943+0000 7f2f99a00700 1 -- 172.21.15.87:0/3481549122 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f2f780b2880 msgr2=0x7f2f780b4d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:25:55.945 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:55.943+0000 7f2f99a00700 1 --2- 172.21.15.87:0/3481549122 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f2f780b2880 0x7f2f780b4d40 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f2f94110f00 tx=0x7f2f7c009260 comp rx=0 tx=0).stop 2024-05-08T05:25:55.945 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:55.943+0000 7f2f99a00700 1 -- 172.21.15.87:0/3481549122 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2f940756d0 msgr2=0x7f2f941a0170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:25:55.945 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:55.943+0000 7f2f99a00700 1 --2- 172.21.15.87:0/3481549122 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2f940756d0 0x7f2f941a0170 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f2f8400c370 tx=0x7f2f8400c680 comp rx=0 tx=0).stop 2024-05-08T05:25:55.945 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:55.944+0000 7f2f99a00700 1 -- 172.21.15.87:0/3481549122 shutdown_connections 2024-05-08T05:25:55.945 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:55.944+0000 7f2f99a00700 1 --2- 172.21.15.87:0/3481549122 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f2f780b2880 0x7f2f780b4d40 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:25:55.945 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:55.944+0000 7f2f99a00700 1 --2- 172.21.15.87:0/3481549122 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2f94114670 0x7f2f941a4a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:25:55.945 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:55.944+0000 7f2f99a00700 1 --2- 172.21.15.87:0/3481549122 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2f940756d0 0x7f2f941a0170 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:25:55.946 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:55.944+0000 7f2f99a00700 1 --2- 172.21.15.87:0/3481549122 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2f94075ff0 0x7f2f941a06b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:25:55.946 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:55.944+0000 7f2f99a00700 1 -- 172.21.15.87:0/3481549122 >> 172.21.15.87:0/3481549122 conn(0x7f2f9407a600 msgr2=0x7f2f94113440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:25:55.946 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:55.944+0000 7f2f99a00700 1 -- 172.21.15.87:0/3481549122 shutdown_connections 2024-05-08T05:25:55.946 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:55.944+0000 7f2f99a00700 1 -- 172.21.15.87:0/3481549122 wait complete. 2024-05-08T05:25:56.208 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:25:55 smithi087 ceph-mon[29523]: pgmap v326: 97 pgs: 97 active+clean; 581 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s wr, 3 op/s 2024-05-08T05:25:56.208 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:25:55 smithi087 ceph-mon[29523]: from='client.? 172.21.15.87:0/3481549122' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2024-05-08T05:25:56.233 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:25:55 smithi090 ceph-mon[34526]: pgmap v326: 97 pgs: 97 active+clean; 581 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s wr, 3 op/s 2024-05-08T05:25:56.233 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:25:55 smithi090 ceph-mon[34526]: from='client.? 172.21.15.87:0/3481549122' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2024-05-08T05:25:56.288 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:25:55 smithi160 ceph-mon[34827]: pgmap v326: 97 pgs: 97 active+clean; 581 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s wr, 3 op/s 2024-05-08T05:25:56.288 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:25:55 smithi160 ceph-mon[34827]: from='client.? 172.21.15.87:0/3481549122' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2024-05-08T05:25:56.662 DEBUG:teuthology.orchestra.run.smithi087:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid eeeb813e-0cf9-11ef-bc97-c7b262605968 -- ceph fs set cephfs session_timeout 300 2024-05-08T05:25:57.082 INFO:teuthology.orchestra.run.smithi087.stderr:Inferring config /var/lib/ceph/eeeb813e-0cf9-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T05:25:57.208 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:25:56 smithi087 ceph-mon[29523]: from='client.? 172.21.15.87:0/3481549122' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-05-08T05:25:57.209 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:25:56 smithi087 ceph-mon[29523]: fsmap cephfs:3 {0=b=up:active,1=g=up:active,2=i=up:active} 9 up:standby 2024-05-08T05:25:57.209 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:25:56 smithi087 ceph-mon[29523]: fsmap cephfs:3 {0=b=up:active,1=g=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-05-08T05:25:57.233 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:25:56 smithi090 ceph-mon[34526]: from='client.? 172.21.15.87:0/3481549122' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-05-08T05:25:57.233 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:25:56 smithi090 ceph-mon[34526]: fsmap cephfs:3 {0=b=up:active,1=g=up:active,2=i=up:active} 9 up:standby 2024-05-08T05:25:57.234 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:25:56 smithi090 ceph-mon[34526]: fsmap cephfs:3 {0=b=up:active,1=g=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-05-08T05:25:57.288 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:25:56 smithi160 ceph-mon[34827]: from='client.? 172.21.15.87:0/3481549122' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-05-08T05:25:57.289 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:25:56 smithi160 ceph-mon[34827]: fsmap cephfs:3 {0=b=up:active,1=g=up:active,2=i=up:active} 9 up:standby 2024-05-08T05:25:57.289 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:25:56 smithi160 ceph-mon[34827]: fsmap cephfs:3 {0=b=up:active,1=g=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-05-08T05:25:58.208 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:25:57 smithi087 ceph-mon[29523]: pgmap v327: 97 pgs: 97 active+clean; 582 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 511 B/s rd, 1.9 KiB/s wr, 6 op/s 2024-05-08T05:25:58.233 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:25:57 smithi090 ceph-mon[34526]: pgmap v327: 97 pgs: 97 active+clean; 582 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 511 B/s rd, 1.9 KiB/s wr, 6 op/s 2024-05-08T05:25:58.289 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:25:57 smithi160 ceph-mon[34827]: pgmap v327: 97 pgs: 97 active+clean; 582 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 511 B/s rd, 1.9 KiB/s wr, 6 op/s 2024-05-08T05:25:59.038 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:59.036+0000 7f267ca00700 1 -- 172.21.15.87:0/2113623630 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f267806bad0 msgr2=0x7f267810fa10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:25:59.038 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:59.036+0000 7f267ca00700 1 --2- 172.21.15.87:0/2113623630 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f267806bad0 0x7f267810fa10 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f2664009990 tx=0x7f2664009ca0 comp rx=0 tx=0).stop 2024-05-08T05:25:59.039 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:59.036+0000 7f267ca00700 1 -- 172.21.15.87:0/2113623630 shutdown_connections 2024-05-08T05:25:59.039 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:59.036+0000 7f267ca00700 1 --2- 172.21.15.87:0/2113623630 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f267810ff50 0x7f2678112340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:25:59.039 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:59.036+0000 7f267ca00700 1 --2- 172.21.15.87:0/2113623630 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f267806b1b0 0x7f267806b590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:25:59.039 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:59.037+0000 7f267ca00700 1 --2- 172.21.15.87:0/2113623630 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f267806bad0 0x7f267810fa10 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:25:59.039 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:59.037+0000 7f267ca00700 1 -- 172.21.15.87:0/2113623630 >> 172.21.15.87:0/2113623630 conn(0x7f2678079350 msgr2=0x7f2678079760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:25:59.039 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:59.037+0000 7f267ca00700 1 -- 172.21.15.87:0/2113623630 shutdown_connections 2024-05-08T05:25:59.039 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:59.037+0000 7f267ca00700 1 -- 172.21.15.87:0/2113623630 wait complete. 2024-05-08T05:25:59.040 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:59.038+0000 7f267ca00700 1 Processor -- start 2024-05-08T05:25:59.040 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:59.038+0000 7f267ca00700 1 -- start start 2024-05-08T05:25:59.040 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:59.038+0000 7f267ca00700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f267806b1b0 0x7f267819bdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:25:59.040 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:59.038+0000 7f267ca00700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f267806bad0 0x7f267819c310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:25:59.040 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:59.038+0000 7f267ca00700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f267810ff50 0x7f26781a06a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:25:59.041 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:59.038+0000 7f267ca00700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f26781158e0 con 0x7f267810ff50 2024-05-08T05:25:59.041 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:59.038+0000 7f267ca00700 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f2678115760 con 0x7f267806b1b0 2024-05-08T05:25:59.041 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:59.038+0000 7f267ca00700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f2678115a60 con 0x7f267806bad0 2024-05-08T05:25:59.041 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:59.038+0000 7f2675e00700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f267806b1b0 0x7f267819bdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:25:59.041 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:59.039+0000 7f2675e00700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f267806b1b0 0x7f267819bdd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.87:56372/0 (socket says 172.21.15.87:56372) 2024-05-08T05:25:59.041 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:59.039+0000 7f2675e00700 1 -- 172.21.15.87:0/3604271553 learned_addr learned my addr 172.21.15.87:0/3604271553 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T05:25:59.041 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:59.039+0000 7f2676800700 1 --2- 172.21.15.87:0/3604271553 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f267810ff50 0x7f26781a06a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:25:59.041 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:59.039+0000 7f2675400700 1 --2- 172.21.15.87:0/3604271553 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f267806bad0 0x7f267819c310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:25:59.041 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:59.039+0000 7f2675e00700 1 -- 172.21.15.87:0/3604271553 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f267806bad0 msgr2=0x7f267819c310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:25:59.041 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:59.039+0000 7f2675e00700 1 --2- 172.21.15.87:0/3604271553 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f267806bad0 0x7f267819c310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:25:59.041 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:59.039+0000 7f2675e00700 1 -- 172.21.15.87:0/3604271553 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f267810ff50 msgr2=0x7f26781a06a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:25:59.041 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:59.039+0000 7f2675e00700 1 --2- 172.21.15.87:0/3604271553 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f267810ff50 0x7f26781a06a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:25:59.041 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:59.039+0000 7f2675e00700 1 -- 172.21.15.87:0/3604271553 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f26781a0de0 con 0x7f267806b1b0 2024-05-08T05:25:59.042 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:59.039+0000 7f2675e00700 1 --2- 172.21.15.87:0/3604271553 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f267806b1b0 0x7f267819bdd0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f266800e9a0 tx=0x7f266800ecb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:25:59.042 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:59.040+0000 7f266ea00700 1 -- 172.21.15.87:0/3604271553 <== mon.2 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f266800ca10 con 0x7f267806b1b0 2024-05-08T05:25:59.042 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:59.040+0000 7f266ea00700 1 -- 172.21.15.87:0/3604271553 <== mon.2 v2:172.21.15.90:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f266800cbb0 con 0x7f267806b1b0 2024-05-08T05:25:59.042 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:59.040+0000 7f266ea00700 1 -- 172.21.15.87:0/3604271553 <== mon.2 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2668018680 con 0x7f267806b1b0 2024-05-08T05:25:59.043 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:59.040+0000 7f267ca00700 1 -- 172.21.15.87:0/3604271553 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f26781a10d0 con 0x7f267806b1b0 2024-05-08T05:25:59.043 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:59.040+0000 7f267ca00700 1 -- 172.21.15.87:0/3604271553 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f26781a8950 con 0x7f267806b1b0 2024-05-08T05:25:59.043 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:59.041+0000 7f267ca00700 1 -- 172.21.15.87:0/3604271553 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f267806a190 con 0x7f267806b1b0 2024-05-08T05:25:59.044 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:59.043+0000 7f266ea00700 1 -- 172.21.15.87:0/3604271553 <== mon.2 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 16) ==== 149652+0+0 (secure 0 0 0) 0x7f2668010430 con 0x7f267806b1b0 2024-05-08T05:25:59.046 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:59.044+0000 7f266ea00700 1 --2- 172.21.15.87:0/3604271553 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f265c0b2900 0x7f265c0b4dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:25:59.046 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:59.045+0000 7f266ea00700 1 -- 172.21.15.87:0/3604271553 <== mon.2 v2:172.21.15.90:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 7979+0+0 (secure 0 0 0) 0x7f26680e2250 con 0x7f267806b1b0 2024-05-08T05:25:59.046 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:59.045+0000 7f2675400700 1 --2- 172.21.15.87:0/3604271553 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f265c0b2900 0x7f265c0b4dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:25:59.046 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:59.045+0000 7f2675400700 1 --2- 172.21.15.87:0/3604271553 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f265c0b2900 0x7f265c0b4dc0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f2678101ec0 tx=0x7f266400b260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:25:59.050 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:59.049+0000 7f266ea00700 1 -- 172.21.15.87:0/3604271553 <== mon.2 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f26680aa020 con 0x7f267806b1b0 2024-05-08T05:25:59.329 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:59.327+0000 7f267ca00700 1 -- 172.21.15.87:0/3604271553 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"} v 0) -- 0x7f267802e6d0 con 0x7f267806b1b0 2024-05-08T05:25:59.974 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:59.972+0000 7f266ea00700 1 -- 172.21.15.87:0/3604271553 <== mon.2 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]=0 v24) ==== 115+0+0 (secure 0 0 0) 0x7f26680b20a0 con 0x7f267806b1b0 2024-05-08T05:25:59.978 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:59.976+0000 7f267ca00700 1 -- 172.21.15.87:0/3604271553 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f265c0b2900 msgr2=0x7f265c0b4dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:25:59.978 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:59.976+0000 7f267ca00700 1 --2- 172.21.15.87:0/3604271553 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f265c0b2900 0x7f265c0b4dc0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f2678101ec0 tx=0x7f266400b260 comp rx=0 tx=0).stop 2024-05-08T05:25:59.978 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:59.976+0000 7f267ca00700 1 -- 172.21.15.87:0/3604271553 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f267806b1b0 msgr2=0x7f267819bdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:25:59.978 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:59.976+0000 7f267ca00700 1 --2- 172.21.15.87:0/3604271553 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f267806b1b0 0x7f267819bdd0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f266800e9a0 tx=0x7f266800ecb0 comp rx=0 tx=0).stop 2024-05-08T05:25:59.978 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:59.976+0000 7f267ca00700 1 -- 172.21.15.87:0/3604271553 shutdown_connections 2024-05-08T05:25:59.978 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:59.976+0000 7f267ca00700 1 --2- 172.21.15.87:0/3604271553 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f267810ff50 0x7f26781a06a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:25:59.978 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:59.976+0000 7f267ca00700 1 --2- 172.21.15.87:0/3604271553 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f267806b1b0 0x7f267819bdd0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:25:59.978 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:59.976+0000 7f267ca00700 1 --2- 172.21.15.87:0/3604271553 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f265c0b2900 0x7f265c0b4dc0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:25:59.978 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:59.976+0000 7f267ca00700 1 --2- 172.21.15.87:0/3604271553 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f267806bad0 0x7f267819c310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:25:59.978 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:59.976+0000 7f267ca00700 1 -- 172.21.15.87:0/3604271553 >> 172.21.15.87:0/3604271553 conn(0x7f2678079350 msgr2=0x7f2678111400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:25:59.978 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:59.976+0000 7f267ca00700 1 -- 172.21.15.87:0/3604271553 shutdown_connections 2024-05-08T05:25:59.978 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:25:59.976+0000 7f267ca00700 1 -- 172.21.15.87:0/3604271553 wait complete. 2024-05-08T05:26:00.233 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:25:59 smithi090 ceph-mon[34526]: pgmap v328: 97 pgs: 97 active+clean; 582 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 2.0 KiB/s wr, 9 op/s 2024-05-08T05:26:00.233 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:25:59 smithi090 ceph-mon[34526]: from='client.? 172.21.15.87:0/3604271553' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]: dispatch 2024-05-08T05:26:00.233 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:25:59 smithi090 ceph-mon[34526]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]: dispatch 2024-05-08T05:26:00.288 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:25:59 smithi160 ceph-mon[34827]: pgmap v328: 97 pgs: 97 active+clean; 582 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 2.0 KiB/s wr, 9 op/s 2024-05-08T05:26:00.289 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:25:59 smithi160 ceph-mon[34827]: from='client.? 172.21.15.87:0/3604271553' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]: dispatch 2024-05-08T05:26:00.289 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:25:59 smithi160 ceph-mon[34827]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]: dispatch 2024-05-08T05:26:00.338 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:25:59 smithi087 ceph-mon[29523]: pgmap v328: 97 pgs: 97 active+clean; 582 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 2.0 KiB/s wr, 9 op/s 2024-05-08T05:26:00.338 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:25:59 smithi087 ceph-mon[29523]: from='client.? 172.21.15.87:0/3604271553' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]: dispatch 2024-05-08T05:26:00.338 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:25:59 smithi087 ceph-mon[29523]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]: dispatch 2024-05-08T05:26:00.648 DEBUG:tasks.cephfs.filesystem:Creating {'create': 2} subvols for filesystem 'cephfs' 2024-05-08T05:26:00.649 DEBUG:teuthology.orchestra.run.smithi087:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid eeeb813e-0cf9-11ef-bc97-c7b262605968 -- ceph fs subvolumegroup create cephfs qa 2024-05-08T05:26:01.101 INFO:teuthology.orchestra.run.smithi087.stderr:Inferring config /var/lib/ceph/eeeb813e-0cf9-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T05:26:01.233 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:26:00 smithi090 ceph-mon[34526]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2024-05-08T05:26:01.234 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:26:00 smithi090 ceph-mon[34526]: fsmap cephfs:3 {0=b=up:active,1=g=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-05-08T05:26:01.250 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:26:00 smithi087 ceph-mon[29523]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2024-05-08T05:26:01.250 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:26:00 smithi087 ceph-mon[29523]: fsmap cephfs:3 {0=b=up:active,1=g=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-05-08T05:26:01.288 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:26:00 smithi160 ceph-mon[34827]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2024-05-08T05:26:01.289 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:26:00 smithi160 ceph-mon[34827]: fsmap cephfs:3 {0=b=up:active,1=g=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-05-08T05:26:02.233 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:26:01 smithi090 ceph-mon[34526]: pgmap v329: 97 pgs: 97 active+clean; 582 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 2.0 KiB/s wr, 9 op/s 2024-05-08T05:26:02.288 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:26:01 smithi160 ceph-mon[34827]: pgmap v329: 97 pgs: 97 active+clean; 582 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 2.0 KiB/s wr, 9 op/s 2024-05-08T05:26:02.297 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:26:01 smithi087 ceph-mon[29523]: pgmap v329: 97 pgs: 97 active+clean; 582 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 2.0 KiB/s wr, 9 op/s 2024-05-08T05:26:03.180 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:03.177+0000 7fd18e200700 1 -- 172.21.15.87:0/2995403729 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd18810ff00 msgr2=0x7fd1881122f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:26:03.180 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:03.177+0000 7fd18e200700 1 --2- 172.21.15.87:0/2995403729 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd18810ff00 0x7fd1881122f0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fd18000b0a0 tx=0x7fd18000b3b0 comp rx=0 tx=0).stop 2024-05-08T05:26:03.181 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:03.177+0000 7fd18e200700 1 -- 172.21.15.87:0/2995403729 shutdown_connections 2024-05-08T05:26:03.181 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:03.177+0000 7fd18e200700 1 --2- 172.21.15.87:0/2995403729 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd18810ff00 0x7fd1881122f0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:26:03.181 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:03.177+0000 7fd18e200700 1 --2- 172.21.15.87:0/2995403729 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd1880756d0 0x7fd188075ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:26:03.181 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:03.177+0000 7fd18e200700 1 --2- 172.21.15.87:0/2995403729 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd188075ff0 0x7fd18810f9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:26:03.181 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:03.177+0000 7fd18e200700 1 -- 172.21.15.87:0/2995403729 >> 172.21.15.87:0/2995403729 conn(0x7fd18807a600 msgr2=0x7fd18807aa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:26:03.181 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:03.178+0000 7fd18e200700 1 -- 172.21.15.87:0/2995403729 shutdown_connections 2024-05-08T05:26:03.181 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:03.178+0000 7fd18e200700 1 -- 172.21.15.87:0/2995403729 wait complete. 2024-05-08T05:26:03.182 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:03.179+0000 7fd18e200700 1 Processor -- start 2024-05-08T05:26:03.182 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:03.179+0000 7fd18e200700 1 -- start start 2024-05-08T05:26:03.185 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:03.179+0000 7fd18e200700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd1880756d0 0x7fd1881a1a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:26:03.185 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:03.179+0000 7fd18e200700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd188075ff0 0x7fd1881a1f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:26:03.185 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:03.179+0000 7fd18e200700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd18810ff00 0x7fd18819bb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:26:03.185 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:03.179+0000 7fd18e200700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fd1881158e0 con 0x7fd1880756d0 2024-05-08T05:26:03.185 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:03.179+0000 7fd18e200700 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fd188115760 con 0x7fd18810ff00 2024-05-08T05:26:03.185 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:03.179+0000 7fd18e200700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7fd188115a60 con 0x7fd188075ff0 2024-05-08T05:26:03.186 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:03.180+0000 7fd187400700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd1880756d0 0x7fd1881a1a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:26:03.186 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:03.180+0000 7fd187400700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd1880756d0 0x7fd1881a1a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:56960/0 (socket says 172.21.15.87:56960) 2024-05-08T05:26:03.186 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:03.180+0000 7fd187400700 1 -- 172.21.15.87:0/2804114623 learned_addr learned my addr 172.21.15.87:0/2804114623 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T05:26:03.186 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:03.180+0000 7fd187e00700 1 --2- 172.21.15.87:0/2804114623 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd18810ff00 0x7fd18819bb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:26:03.186 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:03.180+0000 7fd186a00700 1 --2- 172.21.15.87:0/2804114623 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd188075ff0 0x7fd1881a1f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:26:03.186 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:03.180+0000 7fd187e00700 1 -- 172.21.15.87:0/2804114623 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd188075ff0 msgr2=0x7fd1881a1f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:26:03.187 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:03.180+0000 7fd187e00700 1 --2- 172.21.15.87:0/2804114623 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd188075ff0 0x7fd1881a1f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:26:03.187 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:03.180+0000 7fd187e00700 1 -- 172.21.15.87:0/2804114623 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd1880756d0 msgr2=0x7fd1881a1a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:26:03.187 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:03.180+0000 7fd187e00700 1 --2- 172.21.15.87:0/2804114623 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd1880756d0 0x7fd1881a1a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:26:03.187 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:03.180+0000 7fd187e00700 1 -- 172.21.15.87:0/2804114623 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd18819c440 con 0x7fd18810ff00 2024-05-08T05:26:03.187 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:03.180+0000 7fd187400700 1 --2- 172.21.15.87:0/2804114623 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd1880756d0 0x7fd1881a1a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T05:26:03.187 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:03.181+0000 7fd187e00700 1 --2- 172.21.15.87:0/2804114623 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd18810ff00 0x7fd18819bb60 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fd18000b070 tx=0x7fd180004c80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:26:03.187 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:03.181+0000 7fd17fe00700 1 -- 172.21.15.87:0/2804114623 <== mon.2 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd180021070 con 0x7fd18810ff00 2024-05-08T05:26:03.188 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:03.181+0000 7fd17fe00700 1 -- 172.21.15.87:0/2804114623 <== mon.2 v2:172.21.15.90:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd180007e30 con 0x7fd18810ff00 2024-05-08T05:26:03.188 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:03.181+0000 7fd18e200700 1 -- 172.21.15.87:0/2804114623 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd18819c6d0 con 0x7fd18810ff00 2024-05-08T05:26:03.188 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:03.181+0000 7fd17fe00700 1 -- 172.21.15.87:0/2804114623 <== mon.2 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd180004570 con 0x7fd18810ff00 2024-05-08T05:26:03.188 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:03.181+0000 7fd18e200700 1 -- 172.21.15.87:0/2804114623 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd1881a87f0 con 0x7fd18810ff00 2024-05-08T05:26:03.188 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:03.182+0000 7fd18e200700 1 -- 172.21.15.87:0/2804114623 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd188076d90 con 0x7fd18810ff00 2024-05-08T05:26:03.189 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:03.185+0000 7fd17fe00700 1 -- 172.21.15.87:0/2804114623 <== mon.2 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 16) ==== 149652+0+0 (secure 0 0 0) 0x7fd180004710 con 0x7fd18810ff00 2024-05-08T05:26:03.189 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:03.186+0000 7fd17fe00700 1 --2- 172.21.15.87:0/2804114623 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7fd16c0b2880 0x7fd16c0b4d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:26:03.190 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:03.186+0000 7fd17fe00700 1 -- 172.21.15.87:0/2804114623 <== mon.2 v2:172.21.15.90:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 7979+0+0 (secure 0 0 0) 0x7fd1800e2e40 con 0x7fd18810ff00 2024-05-08T05:26:03.190 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:03.186+0000 7fd187400700 1 --2- 172.21.15.87:0/2804114623 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7fd16c0b2880 0x7fd16c0b4d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:26:03.190 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:03.187+0000 7fd187400700 1 --2- 172.21.15.87:0/2804114623 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7fd16c0b2880 0x7fd16c0b4d40 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fd178011590 tx=0x7fd178009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:26:03.191 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:03.188+0000 7fd17fe00700 1 -- 172.21.15.87:0/2804114623 <== mon.2 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7fd1800aaca0 con 0x7fd18810ff00 2024-05-08T05:26:03.456 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:03.456+0000 7fd18e200700 1 -- 172.21.15.87:0/2804114623 --> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] -- mgr_command(tid 0: {"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}) -- 0x7fd188100d80 con 0x7fd16c0b2880 2024-05-08T05:26:03.494 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:03.493+0000 7fd17fe00700 1 -- 172.21.15.87:0/2804114623 <== mgr.14152 v2:172.21.15.87:6800/1189186457 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7fd188100d80 con 0x7fd16c0b2880 2024-05-08T05:26:03.498 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:03.497+0000 7fd18e200700 1 -- 172.21.15.87:0/2804114623 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7fd16c0b2880 msgr2=0x7fd16c0b4d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:26:03.498 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:03.497+0000 7fd18e200700 1 --2- 172.21.15.87:0/2804114623 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7fd16c0b2880 0x7fd16c0b4d40 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fd178011590 tx=0x7fd178009260 comp rx=0 tx=0).stop 2024-05-08T05:26:03.498 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:03.497+0000 7fd18e200700 1 -- 172.21.15.87:0/2804114623 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd18810ff00 msgr2=0x7fd18819bb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:26:03.498 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:03.497+0000 7fd18e200700 1 --2- 172.21.15.87:0/2804114623 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd18810ff00 0x7fd18819bb60 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fd18000b070 tx=0x7fd180004c80 comp rx=0 tx=0).stop 2024-05-08T05:26:03.498 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:03.497+0000 7fd18e200700 1 -- 172.21.15.87:0/2804114623 shutdown_connections 2024-05-08T05:26:03.499 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:03.497+0000 7fd18e200700 1 --2- 172.21.15.87:0/2804114623 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd18810ff00 0x7fd18819bb60 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:26:03.499 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:03.497+0000 7fd18e200700 1 --2- 172.21.15.87:0/2804114623 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd1880756d0 0x7fd1881a1a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:26:03.499 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:03.497+0000 7fd18e200700 1 --2- 172.21.15.87:0/2804114623 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7fd16c0b2880 0x7fd16c0b4d40 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:26:03.499 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:03.497+0000 7fd18e200700 1 --2- 172.21.15.87:0/2804114623 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd188075ff0 0x7fd1881a1f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:26:03.499 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:03.497+0000 7fd18e200700 1 -- 172.21.15.87:0/2804114623 >> 172.21.15.87:0/2804114623 conn(0x7fd18807a600 msgr2=0x7fd188100670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:26:03.499 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:03.497+0000 7fd18e200700 1 -- 172.21.15.87:0/2804114623 shutdown_connections 2024-05-08T05:26:03.500 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:03.497+0000 7fd18e200700 1 -- 172.21.15.87:0/2804114623 wait complete. 2024-05-08T05:26:03.709 INFO:journalctl@ceph.mgr.x.smithi087.stdout:May 08 05:26:03 smithi087 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-mgr-x[29765]: 2024-05-08T05:26:03.464+0000 7f6d99800700 -1 client.0 error registering admin socket command: (17) File exists 2024-05-08T05:26:03.709 INFO:journalctl@ceph.mgr.x.smithi087.stdout:May 08 05:26:03 smithi087 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-mgr-x[29765]: 2024-05-08T05:26:03.464+0000 7f6d99800700 -1 client.0 error registering admin socket command: (17) File exists 2024-05-08T05:26:03.709 INFO:journalctl@ceph.mgr.x.smithi087.stdout:May 08 05:26:03 smithi087 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-mgr-x[29765]: 2024-05-08T05:26:03.464+0000 7f6d99800700 -1 client.0 error registering admin socket command: (17) File exists 2024-05-08T05:26:03.709 INFO:journalctl@ceph.mgr.x.smithi087.stdout:May 08 05:26:03 smithi087 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-mgr-x[29765]: 2024-05-08T05:26:03.464+0000 7f6d99800700 -1 client.0 error registering admin socket command: (17) File exists 2024-05-08T05:26:03.709 INFO:journalctl@ceph.mgr.x.smithi087.stdout:May 08 05:26:03 smithi087 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-mgr-x[29765]: 2024-05-08T05:26:03.464+0000 7f6d99800700 -1 client.0 error registering admin socket command: (17) File exists 2024-05-08T05:26:04.208 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:26:03 smithi087 ceph-mon[29523]: pgmap v330: 97 pgs: 97 active+clean; 582 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 2.0 KiB/s wr, 10 op/s 2024-05-08T05:26:04.208 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:26:03 smithi087 ceph-mon[29523]: from='client.24572 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-05-08T05:26:04.233 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:26:03 smithi090 ceph-mon[34526]: pgmap v330: 97 pgs: 97 active+clean; 582 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 2.0 KiB/s wr, 10 op/s 2024-05-08T05:26:04.233 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:26:03 smithi090 ceph-mon[34526]: from='client.24572 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-05-08T05:26:04.288 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:26:03 smithi160 ceph-mon[34827]: pgmap v330: 97 pgs: 97 active+clean; 582 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 2.0 KiB/s wr, 10 op/s 2024-05-08T05:26:04.288 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:26:03 smithi160 ceph-mon[34827]: from='client.24572 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-05-08T05:26:04.294 DEBUG:teuthology.orchestra.run.smithi087:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid eeeb813e-0cf9-11ef-bc97-c7b262605968 -- ceph fs subvolume create cephfs sv_0 --group_name qa 2024-05-08T05:26:04.742 INFO:teuthology.orchestra.run.smithi087.stderr:Inferring config /var/lib/ceph/eeeb813e-0cf9-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T05:26:06.140 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:26:06 smithi087 ceph-mon[29523]: pgmap v331: 97 pgs: 97 active+clean; 582 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 1.8 KiB/s wr, 11 op/s 2024-05-08T05:26:06.289 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:26:06 smithi160 ceph-mon[34827]: pgmap v331: 97 pgs: 97 active+clean; 582 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 1.8 KiB/s wr, 11 op/s 2024-05-08T05:26:06.483 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:26:06 smithi090 ceph-mon[34526]: pgmap v331: 97 pgs: 97 active+clean; 582 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 1.8 KiB/s wr, 11 op/s 2024-05-08T05:26:06.887 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:06.886+0000 7f0f3fe00700 1 -- 172.21.15.87:0/2739110904 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0f38104100 msgr2=0x7f0f38108120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:26:06.887 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:06.886+0000 7f0f3fe00700 1 --2- 172.21.15.87:0/2739110904 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0f38104100 0x7f0f38108120 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f0f240098f0 tx=0x7f0f24009c00 comp rx=0 tx=0).stop 2024-05-08T05:26:06.887 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:06.886+0000 7f0f3fe00700 1 -- 172.21.15.87:0/2739110904 shutdown_connections 2024-05-08T05:26:06.888 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:06.887+0000 7f0f3fe00700 1 --2- 172.21.15.87:0/2739110904 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0f38108850 0x7f0f381103d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:26:06.888 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:06.887+0000 7f0f3fe00700 1 --2- 172.21.15.87:0/2739110904 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0f38103750 0x7f0f38103b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:26:06.888 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:06.887+0000 7f0f3fe00700 1 --2- 172.21.15.87:0/2739110904 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0f38104100 0x7f0f38108120 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:26:06.888 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:06.887+0000 7f0f3fe00700 1 -- 172.21.15.87:0/2739110904 >> 172.21.15.87:0/2739110904 conn(0x7f0f3807a600 msgr2=0x7f0f3807aa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:26:06.888 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:06.887+0000 7f0f3fe00700 1 -- 172.21.15.87:0/2739110904 shutdown_connections 2024-05-08T05:26:06.888 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:06.887+0000 7f0f3fe00700 1 -- 172.21.15.87:0/2739110904 wait complete. 2024-05-08T05:26:06.889 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:06.889+0000 7f0f3fe00700 1 Processor -- start 2024-05-08T05:26:06.889 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:06.889+0000 7f0f3fe00700 1 -- start start 2024-05-08T05:26:06.889 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:06.889+0000 7f0f3fe00700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0f38103750 0x7f0f3819bd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:26:06.890 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:06.889+0000 7f0f3fe00700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0f38104100 0x7f0f3819c2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:26:06.890 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:06.889+0000 7f0f3fe00700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0f38108850 0x7f0f381a0660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:26:06.890 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:06.889+0000 7f0f3fe00700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f0f38113680 con 0x7f0f38103750 2024-05-08T05:26:06.890 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:06.889+0000 7f0f3fe00700 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f0f38113500 con 0x7f0f38108850 2024-05-08T05:26:06.890 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:06.889+0000 7f0f3fe00700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f0f38113800 con 0x7f0f38104100 2024-05-08T05:26:06.890 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:06.890+0000 7f0f3d400700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0f38103750 0x7f0f3819bd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:26:06.890 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:06.890+0000 7f0f3ca00700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0f38104100 0x7f0f3819c2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:26:06.891 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:06.890+0000 7f0f3ca00700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0f38104100 0x7f0f3819c2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.87:41224/0 (socket says 172.21.15.87:41224) 2024-05-08T05:26:06.891 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:06.890+0000 7f0f3ca00700 1 -- 172.21.15.87:0/2065787110 learned_addr learned my addr 172.21.15.87:0/2065787110 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T05:26:06.891 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:06.890+0000 7f0f3de00700 1 --2- 172.21.15.87:0/2065787110 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0f38108850 0x7f0f381a0660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:26:06.892 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:06.890+0000 7f0f3ca00700 1 -- 172.21.15.87:0/2065787110 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0f38108850 msgr2=0x7f0f381a0660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:26:06.892 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:06.890+0000 7f0f3ca00700 1 --2- 172.21.15.87:0/2065787110 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0f38108850 0x7f0f381a0660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:26:06.892 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:06.890+0000 7f0f3ca00700 1 -- 172.21.15.87:0/2065787110 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0f38103750 msgr2=0x7f0f3819bd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:26:06.892 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:06.890+0000 7f0f3ca00700 1 --2- 172.21.15.87:0/2065787110 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0f38103750 0x7f0f3819bd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:26:06.892 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:06.890+0000 7f0f3ca00700 1 -- 172.21.15.87:0/2065787110 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0f381a0da0 con 0x7f0f38104100 2024-05-08T05:26:06.892 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:06.890+0000 7f0f3de00700 1 --2- 172.21.15.87:0/2065787110 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0f38108850 0x7f0f381a0660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T05:26:06.892 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:06.890+0000 7f0f3ca00700 1 --2- 172.21.15.87:0/2065787110 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0f38104100 0x7f0f3819c2d0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f0f24009230 tx=0x7f0f2400fa70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:26:06.892 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:06.891+0000 7f0f36000700 1 -- 172.21.15.87:0/2065787110 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f24005140 con 0x7f0f38104100 2024-05-08T05:26:06.892 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:06.891+0000 7f0f36000700 1 -- 172.21.15.87:0/2065787110 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0f2400b560 con 0x7f0f38104100 2024-05-08T05:26:06.892 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:06.891+0000 7f0f3fe00700 1 -- 172.21.15.87:0/2065787110 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0f381a1030 con 0x7f0f38104100 2024-05-08T05:26:06.892 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:06.891+0000 7f0f36000700 1 -- 172.21.15.87:0/2065787110 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f24003ae0 con 0x7f0f38104100 2024-05-08T05:26:06.893 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:06.891+0000 7f0f3fe00700 1 -- 172.21.15.87:0/2065787110 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0f381a8910 con 0x7f0f38104100 2024-05-08T05:26:06.893 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:06.892+0000 7f0f3fe00700 1 -- 172.21.15.87:0/2065787110 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0f3806a190 con 0x7f0f38104100 2024-05-08T05:26:06.894 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:06.894+0000 7f0f36000700 1 -- 172.21.15.87:0/2065787110 <== mon.1 v2:172.21.15.160:3300/0 4 ==== mgrmap(e 17) ==== 149703+0+0 (secure 0 0 0) 0x7f0f24003c80 con 0x7f0f38104100 2024-05-08T05:26:06.896 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:06.895+0000 7f0f36000700 1 --2- 172.21.15.87:0/2065787110 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f0f200b2990 0x7f0f200b4e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:26:06.896 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:06.896+0000 7f0f3d400700 1 --2- 172.21.15.87:0/2065787110 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f0f200b2990 0x7f0f200b4e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:26:06.896 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:06.896+0000 7f0f36000700 1 -- 172.21.15.87:0/2065787110 <== mon.1 v2:172.21.15.160:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 7979+0+0 (secure 0 0 0) 0x7f0f240e3220 con 0x7f0f38104100 2024-05-08T05:26:06.896 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:06.896+0000 7f0f3d400700 1 --2- 172.21.15.87:0/2065787110 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f0f200b2990 0x7f0f200b4e50 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f0f2c009e60 tx=0x7f0f2c00b040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:26:06.900 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:06.900+0000 7f0f36000700 1 -- 172.21.15.87:0/2065787110 <== mon.1 v2:172.21.15.160:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f0f24013030 con 0x7f0f38104100 2024-05-08T05:26:07.180 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:07.179+0000 7f0f3fe00700 1 -- 172.21.15.87:0/2065787110 --> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}) -- 0x7f0f380766e0 con 0x7f0f200b2990 2024-05-08T05:26:07.216 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:07.216+0000 7f0f36000700 1 -- 172.21.15.87:0/2065787110 <== mgr.14152 v2:172.21.15.87:6800/1189186457 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f0f380766e0 con 0x7f0f200b2990 2024-05-08T05:26:07.219 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:07.218+0000 7f0f3fe00700 1 -- 172.21.15.87:0/2065787110 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f0f200b2990 msgr2=0x7f0f200b4e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:26:07.219 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:07.218+0000 7f0f3fe00700 1 --2- 172.21.15.87:0/2065787110 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f0f200b2990 0x7f0f200b4e50 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f0f2c009e60 tx=0x7f0f2c00b040 comp rx=0 tx=0).stop 2024-05-08T05:26:07.219 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:07.219+0000 7f0f3fe00700 1 -- 172.21.15.87:0/2065787110 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0f38104100 msgr2=0x7f0f3819c2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:26:07.219 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:07.219+0000 7f0f3fe00700 1 --2- 172.21.15.87:0/2065787110 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0f38104100 0x7f0f3819c2d0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f0f24009230 tx=0x7f0f2400fa70 comp rx=0 tx=0).stop 2024-05-08T05:26:07.219 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:07.219+0000 7f0f3fe00700 1 -- 172.21.15.87:0/2065787110 shutdown_connections 2024-05-08T05:26:07.220 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:07.219+0000 7f0f3fe00700 1 --2- 172.21.15.87:0/2065787110 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0f38108850 0x7f0f381a0660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:26:07.220 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:07.219+0000 7f0f3fe00700 1 --2- 172.21.15.87:0/2065787110 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0f38103750 0x7f0f3819bd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:26:07.220 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:07.219+0000 7f0f3fe00700 1 --2- 172.21.15.87:0/2065787110 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f0f200b2990 0x7f0f200b4e50 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:26:07.220 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:07.219+0000 7f0f3fe00700 1 --2- 172.21.15.87:0/2065787110 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0f38104100 0x7f0f3819c2d0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:26:07.220 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:07.219+0000 7f0f3fe00700 1 -- 172.21.15.87:0/2065787110 >> 172.21.15.87:0/2065787110 conn(0x7f0f3807a600 msgr2=0x7f0f38101920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:26:07.220 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:07.219+0000 7f0f3fe00700 1 -- 172.21.15.87:0/2065787110 shutdown_connections 2024-05-08T05:26:07.220 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:07.219+0000 7f0f3fe00700 1 -- 172.21.15.87:0/2065787110 wait complete. 2024-05-08T05:26:07.288 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:26:07 smithi160 ceph-mon[34827]: mgrmap e17: x(active, since 8m), standbys: z, y 2024-05-08T05:26:07.458 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:26:07 smithi087 ceph-mon[29523]: mgrmap e17: x(active, since 8m), standbys: z, y 2024-05-08T05:26:07.483 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:26:07 smithi090 ceph-mon[34526]: mgrmap e17: x(active, since 8m), standbys: z, y 2024-05-08T05:26:07.946 DEBUG:teuthology.orchestra.run.smithi087:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid eeeb813e-0cf9-11ef-bc97-c7b262605968 -- ceph fs subvolume getpath cephfs --group_name qa sv_0 2024-05-08T05:26:08.208 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:26:08 smithi087 ceph-mon[29523]: pgmap v332: 97 pgs: 97 active+clean; 582 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 1.1 KiB/s wr, 8 op/s 2024-05-08T05:26:08.208 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:26:08 smithi087 ceph-mon[29523]: from='client.24589 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-05-08T05:26:08.390 INFO:teuthology.orchestra.run.smithi087.stderr:Inferring config /var/lib/ceph/eeeb813e-0cf9-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T05:26:08.483 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:26:08 smithi090 ceph-mon[34526]: pgmap v332: 97 pgs: 97 active+clean; 582 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 1.1 KiB/s wr, 8 op/s 2024-05-08T05:26:08.484 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:26:08 smithi090 ceph-mon[34526]: from='client.24589 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-05-08T05:26:08.539 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:26:08 smithi160 ceph-mon[34827]: pgmap v332: 97 pgs: 97 active+clean; 582 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 1.1 KiB/s wr, 8 op/s 2024-05-08T05:26:08.539 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:26:08 smithi160 ceph-mon[34827]: from='client.24589 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-05-08T05:26:10.193 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:26:10 smithi087 ceph-mon[29523]: pgmap v333: 97 pgs: 97 active+clean; 607 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 2.7 KiB/s wr, 9 op/s 2024-05-08T05:26:10.368 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:10.367+0000 7f498f200700 1 -- 172.21.15.87:0/3261525941 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4988104100 msgr2=0x7f4988108120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:26:10.368 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:10.367+0000 7f498f200700 1 --2- 172.21.15.87:0/3261525941 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4988104100 0x7f4988108120 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f49740099c0 tx=0x7f4974009cd0 comp rx=0 tx=0).stop 2024-05-08T05:26:10.368 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:10.368+0000 7f498f200700 1 -- 172.21.15.87:0/3261525941 shutdown_connections 2024-05-08T05:26:10.369 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:10.368+0000 7f498f200700 1 --2- 172.21.15.87:0/3261525941 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4988108850 0x7f49881103d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:26:10.369 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:10.368+0000 7f498f200700 1 --2- 172.21.15.87:0/3261525941 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4988103750 0x7f4988103b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:26:10.369 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:10.368+0000 7f498f200700 1 --2- 172.21.15.87:0/3261525941 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4988104100 0x7f4988108120 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:26:10.369 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:10.368+0000 7f498f200700 1 -- 172.21.15.87:0/3261525941 >> 172.21.15.87:0/3261525941 conn(0x7f498807a600 msgr2=0x7f498807aa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:26:10.369 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:10.368+0000 7f498f200700 1 -- 172.21.15.87:0/3261525941 shutdown_connections 2024-05-08T05:26:10.369 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:10.368+0000 7f498f200700 1 -- 172.21.15.87:0/3261525941 wait complete. 2024-05-08T05:26:10.370 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:10.369+0000 7f498f200700 1 Processor -- start 2024-05-08T05:26:10.370 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:10.369+0000 7f498f200700 1 -- start start 2024-05-08T05:26:10.370 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:10.369+0000 7f498f200700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4988103750 0x7f498819f710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:26:10.370 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:10.369+0000 7f498f200700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4988104100 0x7f498819fc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:26:10.370 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:10.369+0000 7f498f200700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4988108850 0x7f49881998d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:26:10.370 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:10.369+0000 7f498f200700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f4988113610 con 0x7f4988108850 2024-05-08T05:26:10.370 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:10.369+0000 7f498f200700 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f4988113490 con 0x7f4988104100 2024-05-08T05:26:10.370 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:10.369+0000 7f498f200700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f4988113790 con 0x7f4988103750 2024-05-08T05:26:10.371 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:10.370+0000 7f498d200700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4988108850 0x7f49881998d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:26:10.371 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:10.370+0000 7f4987400700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4988104100 0x7f498819fc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:26:10.371 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:10.370+0000 7f498d200700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4988108850 0x7f49881998d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:46174/0 (socket says 172.21.15.87:46174) 2024-05-08T05:26:10.371 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:10.370+0000 7f4987e00700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4988103750 0x7f498819f710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:26:10.371 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:10.370+0000 7f498d200700 1 -- 172.21.15.87:0/4028581185 learned_addr learned my addr 172.21.15.87:0/4028581185 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T05:26:10.372 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:10.370+0000 7f4987400700 1 -- 172.21.15.87:0/4028581185 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4988103750 msgr2=0x7f498819f710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:26:10.372 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:10.370+0000 7f4987400700 1 --2- 172.21.15.87:0/4028581185 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4988103750 0x7f498819f710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:26:10.372 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:10.370+0000 7f4987400700 1 -- 172.21.15.87:0/4028581185 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4988108850 msgr2=0x7f49881998d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:26:10.372 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:10.370+0000 7f4987400700 1 --2- 172.21.15.87:0/4028581185 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4988108850 0x7f49881998d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:26:10.372 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:10.370+0000 7f4987400700 1 -- 172.21.15.87:0/4028581185 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f498819a030 con 0x7f4988104100 2024-05-08T05:26:10.372 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:10.370+0000 7f498d200700 1 --2- 172.21.15.87:0/4028581185 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4988108850 0x7f49881998d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T05:26:10.372 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:10.370+0000 7f4987400700 1 --2- 172.21.15.87:0/4028581185 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4988104100 0x7f498819fc50 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f4974009f50 tx=0x7f49740057c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:26:10.372 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:10.371+0000 7f4984c00700 1 -- 172.21.15.87:0/4028581185 <== mon.2 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4974027070 con 0x7f4988104100 2024-05-08T05:26:10.372 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:10.371+0000 7f498f200700 1 -- 172.21.15.87:0/4028581185 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f498819a2c0 con 0x7f4988104100 2024-05-08T05:26:10.372 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:10.371+0000 7f4984c00700 1 -- 172.21.15.87:0/4028581185 <== mon.2 v2:172.21.15.90:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4974003f20 con 0x7f4988104100 2024-05-08T05:26:10.372 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:10.371+0000 7f4984c00700 1 -- 172.21.15.87:0/4028581185 <== mon.2 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4974022ba0 con 0x7f4988104100 2024-05-08T05:26:10.372 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:10.371+0000 7f498f200700 1 -- 172.21.15.87:0/4028581185 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f49881a65e0 con 0x7f4988104100 2024-05-08T05:26:10.373 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:10.372+0000 7f498f200700 1 -- 172.21.15.87:0/4028581185 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f498806a190 con 0x7f4988104100 2024-05-08T05:26:10.374 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:10.374+0000 7f4984c00700 1 -- 172.21.15.87:0/4028581185 <== mon.2 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 17) ==== 149703+0+0 (secure 0 0 0) 0x7f497402a070 con 0x7f4988104100 2024-05-08T05:26:10.376 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:10.376+0000 7f4984c00700 1 --2- 172.21.15.87:0/4028581185 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f496c0b2990 0x7f496c0b4e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:26:10.376 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:10.376+0000 7f4984c00700 1 -- 172.21.15.87:0/4028581185 <== mon.2 v2:172.21.15.90:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 7979+0+0 (secure 0 0 0) 0x7f49740e3470 con 0x7f4988104100 2024-05-08T05:26:10.376 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:10.376+0000 7f4987e00700 1 --2- 172.21.15.87:0/4028581185 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f496c0b2990 0x7f496c0b4e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:26:10.377 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:10.377+0000 7f4987e00700 1 --2- 172.21.15.87:0/4028581185 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f496c0b2990 0x7f496c0b4e50 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f498819aa10 tx=0x7f49780073d0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:26:10.378 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:10.378+0000 7f4984c00700 1 -- 172.21.15.87:0/4028581185 <== mon.2 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f4974013070 con 0x7f4988104100 2024-05-08T05:26:10.483 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:26:10 smithi090 ceph-mon[34526]: pgmap v333: 97 pgs: 97 active+clean; 607 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 2.7 KiB/s wr, 9 op/s 2024-05-08T05:26:10.538 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:26:10 smithi160 ceph-mon[34827]: pgmap v333: 97 pgs: 97 active+clean; 607 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 2.7 KiB/s wr, 9 op/s 2024-05-08T05:26:10.645 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:10.645+0000 7f498f200700 1 -- 172.21.15.87:0/4028581185 --> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}) -- 0x7f49880638e0 con 0x7f496c0b2990 2024-05-08T05:26:10.659 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:10.659+0000 7f4984c00700 1 -- 172.21.15.87:0/4028581185 <== mgr.14152 v2:172.21.15.87:6800/1189186457 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+54 (secure 0 0 0) 0x7f49880638e0 con 0x7f496c0b2990 2024-05-08T05:26:10.659 INFO:teuthology.orchestra.run.smithi087.stdout:/volumes/qa/sv_0/c0d0c686-8054-44fb-bfa4-77ce8828fdf2 2024-05-08T05:26:10.663 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:10.662+0000 7f498f200700 1 -- 172.21.15.87:0/4028581185 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f496c0b2990 msgr2=0x7f496c0b4e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:26:10.663 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:10.662+0000 7f498f200700 1 --2- 172.21.15.87:0/4028581185 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f496c0b2990 0x7f496c0b4e50 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f498819aa10 tx=0x7f49780073d0 comp rx=0 tx=0).stop 2024-05-08T05:26:10.663 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:10.662+0000 7f498f200700 1 -- 172.21.15.87:0/4028581185 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4988104100 msgr2=0x7f498819fc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:26:10.663 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:10.662+0000 7f498f200700 1 --2- 172.21.15.87:0/4028581185 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4988104100 0x7f498819fc50 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f4974009f50 tx=0x7f49740057c0 comp rx=0 tx=0).stop 2024-05-08T05:26:10.663 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:10.662+0000 7f498f200700 1 -- 172.21.15.87:0/4028581185 shutdown_connections 2024-05-08T05:26:10.663 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:10.662+0000 7f498f200700 1 --2- 172.21.15.87:0/4028581185 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4988108850 0x7f49881998d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:26:10.663 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:10.662+0000 7f498f200700 1 --2- 172.21.15.87:0/4028581185 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f496c0b2990 0x7f496c0b4e50 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:26:10.663 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:10.662+0000 7f498f200700 1 --2- 172.21.15.87:0/4028581185 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4988103750 0x7f498819f710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:26:10.663 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:10.662+0000 7f498f200700 1 --2- 172.21.15.87:0/4028581185 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4988104100 0x7f498819fc50 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:26:10.663 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:10.662+0000 7f498f200700 1 -- 172.21.15.87:0/4028581185 >> 172.21.15.87:0/4028581185 conn(0x7f498807a600 msgr2=0x7f49881017d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:26:10.663 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:10.662+0000 7f498f200700 1 -- 172.21.15.87:0/4028581185 shutdown_connections 2024-05-08T05:26:10.664 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:10.662+0000 7f498f200700 1 -- 172.21.15.87:0/4028581185 wait complete. 2024-05-08T05:26:11.440 DEBUG:teuthology.orchestra.run.smithi087:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid eeeb813e-0cf9-11ef-bc97-c7b262605968 -- ceph fs subvolume create cephfs sv_1 --group_name qa 2024-05-08T05:26:11.893 INFO:teuthology.orchestra.run.smithi087.stderr:Inferring config /var/lib/ceph/eeeb813e-0cf9-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T05:26:12.332 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:26:12 smithi087 ceph-mon[29523]: from='client.24590 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2024-05-08T05:26:12.332 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:26:12 smithi087 ceph-mon[29523]: pgmap v334: 97 pgs: 97 active+clean; 607 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 2.7 KiB/s wr, 6 op/s 2024-05-08T05:26:12.483 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:26:12 smithi090 ceph-mon[34526]: from='client.24590 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2024-05-08T05:26:12.483 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:26:12 smithi090 ceph-mon[34526]: pgmap v334: 97 pgs: 97 active+clean; 607 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 2.7 KiB/s wr, 6 op/s 2024-05-08T05:26:12.538 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:26:12 smithi160 ceph-mon[34827]: from='client.24590 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2024-05-08T05:26:12.539 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:26:12 smithi160 ceph-mon[34827]: pgmap v334: 97 pgs: 97 active+clean; 607 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 2.7 KiB/s wr, 6 op/s 2024-05-08T05:26:13.879 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:13.878+0000 7f16a0c00700 1 -- 172.21.15.87:0/605318324 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f169c109530 msgr2=0x7f169c109910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:26:13.879 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:13.878+0000 7f16a0c00700 1 --2- 172.21.15.87:0/605318324 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f169c109530 0x7f169c109910 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f168c009990 tx=0x7f168c009ca0 comp rx=0 tx=0).stop 2024-05-08T05:26:13.879 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:13.878+0000 7f16a0c00700 1 -- 172.21.15.87:0/605318324 shutdown_connections 2024-05-08T05:26:13.879 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:13.878+0000 7f16a0c00700 1 --2- 172.21.15.87:0/605318324 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f169c06c530 0x7f169c110350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:26:13.879 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:13.878+0000 7f16a0c00700 1 --2- 172.21.15.87:0/605318324 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f169c109530 0x7f169c109910 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:26:13.880 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:13.878+0000 7f16a0c00700 1 --2- 172.21.15.87:0/605318324 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f169c06bb70 0x7f169c06bff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:26:13.880 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:13.878+0000 7f16a0c00700 1 -- 172.21.15.87:0/605318324 >> 172.21.15.87:0/605318324 conn(0x7f169c079350 msgr2=0x7f169c079760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:26:13.880 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:13.878+0000 7f16a0c00700 1 -- 172.21.15.87:0/605318324 shutdown_connections 2024-05-08T05:26:13.880 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:13.878+0000 7f16a0c00700 1 -- 172.21.15.87:0/605318324 wait complete. 2024-05-08T05:26:13.881 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:13.880+0000 7f16a0c00700 1 Processor -- start 2024-05-08T05:26:13.881 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:13.880+0000 7f16a0c00700 1 -- start start 2024-05-08T05:26:13.881 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:13.880+0000 7f16a0c00700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f169c06bb70 0x7f169c19f7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:26:13.882 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:13.880+0000 7f16a0c00700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f169c06c530 0x7f169c19fd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:26:13.882 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:13.880+0000 7f16a0c00700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f169c109530 0x7f169c1999b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:26:13.882 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:13.880+0000 7f16a0c00700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f169c1136b0 con 0x7f169c06c530 2024-05-08T05:26:13.882 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:13.880+0000 7f16a0c00700 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f169c113530 con 0x7f169c06bb70 2024-05-08T05:26:13.882 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:13.880+0000 7f16a0c00700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f169c113830 con 0x7f169c109530 2024-05-08T05:26:13.882 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:13.880+0000 7f1699400700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f169c06c530 0x7f169c19fd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:26:13.882 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:13.880+0000 7f1699e00700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f169c06bb70 0x7f169c19f7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:26:13.882 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:13.880+0000 7f1699400700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f169c06c530 0x7f169c19fd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:46194/0 (socket says 172.21.15.87:46194) 2024-05-08T05:26:13.882 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:13.880+0000 7f1699400700 1 -- 172.21.15.87:0/1032879919 learned_addr learned my addr 172.21.15.87:0/1032879919 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T05:26:13.882 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:13.881+0000 7f169a800700 1 --2- 172.21.15.87:0/1032879919 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f169c109530 0x7f169c1999b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:26:13.882 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:13.881+0000 7f1699e00700 1 -- 172.21.15.87:0/1032879919 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f169c109530 msgr2=0x7f169c1999b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:26:13.882 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:13.881+0000 7f1699e00700 1 --2- 172.21.15.87:0/1032879919 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f169c109530 0x7f169c1999b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:26:13.882 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:13.881+0000 7f1699e00700 1 -- 172.21.15.87:0/1032879919 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f169c06c530 msgr2=0x7f169c19fd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:26:13.882 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:13.881+0000 7f1699e00700 1 --2- 172.21.15.87:0/1032879919 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f169c06c530 0x7f169c19fd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:26:13.883 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:13.881+0000 7f1699e00700 1 -- 172.21.15.87:0/1032879919 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f169c19a110 con 0x7f169c06bb70 2024-05-08T05:26:13.883 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:13.881+0000 7f1699e00700 1 --2- 172.21.15.87:0/1032879919 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f169c06bb70 0x7f169c19f7f0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f168c000c00 tx=0x7f168c0047b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:26:13.883 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:13.881+0000 7f1692a00700 1 -- 172.21.15.87:0/1032879919 <== mon.2 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f168c026070 con 0x7f169c06bb70 2024-05-08T05:26:13.883 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:13.882+0000 7f1692a00700 1 -- 172.21.15.87:0/1032879919 <== mon.2 v2:172.21.15.90:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f168c021410 con 0x7f169c06bb70 2024-05-08T05:26:13.884 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:13.882+0000 7f16a0c00700 1 -- 172.21.15.87:0/1032879919 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f169c19a3a0 con 0x7f169c06bb70 2024-05-08T05:26:13.884 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:13.882+0000 7f1692a00700 1 -- 172.21.15.87:0/1032879919 <== mon.2 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f168c017650 con 0x7f169c06bb70 2024-05-08T05:26:13.884 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:13.882+0000 7f16a0c00700 1 -- 172.21.15.87:0/1032879919 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f169c1a66c0 con 0x7f169c06bb70 2024-05-08T05:26:13.884 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:13.883+0000 7f16a0c00700 1 -- 172.21.15.87:0/1032879919 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f169c10ba10 con 0x7f169c06bb70 2024-05-08T05:26:13.885 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:13.885+0000 7f1692a00700 1 -- 172.21.15.87:0/1032879919 <== mon.2 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 17) ==== 149703+0+0 (secure 0 0 0) 0x7f168c029070 con 0x7f169c06bb70 2024-05-08T05:26:13.887 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:13.886+0000 7f1692a00700 1 --2- 172.21.15.87:0/1032879919 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f16800b2910 0x7f16800b4dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:26:13.887 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:13.887+0000 7f1692a00700 1 -- 172.21.15.87:0/1032879919 <== mon.2 v2:172.21.15.90:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 7979+0+0 (secure 0 0 0) 0x7f168c0e3710 con 0x7f169c06bb70 2024-05-08T05:26:13.887 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:13.887+0000 7f1699400700 1 --2- 172.21.15.87:0/1032879919 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f16800b2910 0x7f16800b4dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:26:13.888 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:13.887+0000 7f1699400700 1 --2- 172.21.15.87:0/1032879919 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f16800b2910 0x7f16800b4dd0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f1688009680 tx=0x7f1688009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:26:13.889 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:13.889+0000 7f1692a00700 1 -- 172.21.15.87:0/1032879919 <== mon.2 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f168c030070 con 0x7f169c06bb70 2024-05-08T05:26:14.168 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:14.167+0000 7f16a0c00700 1 -- 172.21.15.87:0/1032879919 --> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}) -- 0x7f169c19aee0 con 0x7f16800b2910 2024-05-08T05:26:14.205 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:14.205+0000 7f1692a00700 1 -- 172.21.15.87:0/1032879919 <== mgr.14152 v2:172.21.15.87:6800/1189186457 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f169c19aee0 con 0x7f16800b2910 2024-05-08T05:26:14.209 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:14.208+0000 7f16a0c00700 1 -- 172.21.15.87:0/1032879919 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f16800b2910 msgr2=0x7f16800b4dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:26:14.209 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:14.208+0000 7f16a0c00700 1 --2- 172.21.15.87:0/1032879919 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f16800b2910 0x7f16800b4dd0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f1688009680 tx=0x7f1688009260 comp rx=0 tx=0).stop 2024-05-08T05:26:14.209 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:14.208+0000 7f16a0c00700 1 -- 172.21.15.87:0/1032879919 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f169c06bb70 msgr2=0x7f169c19f7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:26:14.209 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:14.208+0000 7f16a0c00700 1 --2- 172.21.15.87:0/1032879919 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f169c06bb70 0x7f169c19f7f0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f168c000c00 tx=0x7f168c0047b0 comp rx=0 tx=0).stop 2024-05-08T05:26:14.209 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:14.208+0000 7f16a0c00700 1 -- 172.21.15.87:0/1032879919 shutdown_connections 2024-05-08T05:26:14.209 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:14.208+0000 7f16a0c00700 1 --2- 172.21.15.87:0/1032879919 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f16800b2910 0x7f16800b4dd0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:26:14.209 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:14.208+0000 7f16a0c00700 1 --2- 172.21.15.87:0/1032879919 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f169c109530 0x7f169c1999b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:26:14.209 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:14.208+0000 7f16a0c00700 1 --2- 172.21.15.87:0/1032879919 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f169c06bb70 0x7f169c19f7f0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:26:14.209 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:14.208+0000 7f16a0c00700 1 --2- 172.21.15.87:0/1032879919 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f169c06c530 0x7f169c19fd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:26:14.209 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:14.208+0000 7f16a0c00700 1 -- 172.21.15.87:0/1032879919 >> 172.21.15.87:0/1032879919 conn(0x7f169c079350 msgr2=0x7f169c101410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:26:14.209 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:14.208+0000 7f16a0c00700 1 -- 172.21.15.87:0/1032879919 shutdown_connections 2024-05-08T05:26:14.209 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:14.208+0000 7f16a0c00700 1 -- 172.21.15.87:0/1032879919 wait complete. 2024-05-08T05:26:14.458 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:26:14 smithi087 ceph-mon[29523]: pgmap v335: 97 pgs: 97 active+clean; 607 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 2.7 KiB/s wr, 7 op/s 2024-05-08T05:26:14.483 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:26:14 smithi090 ceph-mon[34526]: pgmap v335: 97 pgs: 97 active+clean; 607 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 2.7 KiB/s wr, 7 op/s 2024-05-08T05:26:14.538 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:26:14 smithi160 ceph-mon[34827]: pgmap v335: 97 pgs: 97 active+clean; 607 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 2.7 KiB/s wr, 7 op/s 2024-05-08T05:26:14.963 DEBUG:teuthology.orchestra.run.smithi087:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid eeeb813e-0cf9-11ef-bc97-c7b262605968 -- ceph fs subvolume getpath cephfs --group_name qa sv_1 2024-05-08T05:26:15.208 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:26:15 smithi087 ceph-mon[29523]: from='client.24596 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-05-08T05:26:15.405 INFO:teuthology.orchestra.run.smithi087.stderr:Inferring config /var/lib/ceph/eeeb813e-0cf9-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T05:26:15.483 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:26:15 smithi090 ceph-mon[34526]: from='client.24596 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-05-08T05:26:15.538 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:26:15 smithi160 ceph-mon[34827]: from='client.24596 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-05-08T05:26:16.209 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:26:16 smithi087 ceph-mon[29523]: pgmap v336: 97 pgs: 97 active+clean; 612 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 3.2 KiB/s wr, 8 op/s 2024-05-08T05:26:16.385 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:26:16 smithi090 ceph-mon[34526]: pgmap v336: 97 pgs: 97 active+clean; 612 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 3.2 KiB/s wr, 8 op/s 2024-05-08T05:26:16.538 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:26:16 smithi160 ceph-mon[34827]: pgmap v336: 97 pgs: 97 active+clean; 612 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 3.2 KiB/s wr, 8 op/s 2024-05-08T05:26:17.602 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:17.601+0000 7fed33000700 1 -- 172.21.15.87:0/3071486849 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fed2c103750 msgr2=0x7fed2c103b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:26:17.602 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:17.601+0000 7fed33000700 1 --2- 172.21.15.87:0/3071486849 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fed2c103750 0x7fed2c103b30 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fed1c0099c0 tx=0x7fed1c009cd0 comp rx=0 tx=0).stop 2024-05-08T05:26:17.602 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:17.601+0000 7fed33000700 1 -- 172.21.15.87:0/3071486849 shutdown_connections 2024-05-08T05:26:17.602 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:17.601+0000 7fed33000700 1 --2- 172.21.15.87:0/3071486849 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fed2c108850 0x7fed2c1103d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:26:17.602 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:17.601+0000 7fed33000700 1 --2- 172.21.15.87:0/3071486849 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fed2c103750 0x7fed2c103b30 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:26:17.602 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:17.601+0000 7fed33000700 1 --2- 172.21.15.87:0/3071486849 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fed2c104100 0x7fed2c108120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:26:17.602 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:17.601+0000 7fed33000700 1 -- 172.21.15.87:0/3071486849 >> 172.21.15.87:0/3071486849 conn(0x7fed2c07a600 msgr2=0x7fed2c07aa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:26:17.603 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:17.601+0000 7fed33000700 1 -- 172.21.15.87:0/3071486849 shutdown_connections 2024-05-08T05:26:17.603 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:17.601+0000 7fed33000700 1 -- 172.21.15.87:0/3071486849 wait complete. 2024-05-08T05:26:17.603 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:17.602+0000 7fed33000700 1 Processor -- start 2024-05-08T05:26:17.603 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:17.602+0000 7fed33000700 1 -- start start 2024-05-08T05:26:17.604 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:17.603+0000 7fed33000700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fed2c103750 0x7fed2c0757a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:26:17.604 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:17.603+0000 7fed33000700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fed2c104100 0x7fed2c075ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:26:17.604 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:17.603+0000 7fed33000700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fed2c108850 0x7fed2c076220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:26:17.604 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:17.603+0000 7fed33000700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fed2c113690 con 0x7fed2c108850 2024-05-08T05:26:17.604 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:17.603+0000 7fed33000700 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fed2c113510 con 0x7fed2c103750 2024-05-08T05:26:17.604 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:17.603+0000 7fed33000700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7fed2c113810 con 0x7fed2c104100 2024-05-08T05:26:17.604 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:17.603+0000 7fed2be00700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fed2c103750 0x7fed2c0757a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:26:17.604 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:17.603+0000 7fed2be00700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fed2c103750 0x7fed2c0757a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.87:41752/0 (socket says 172.21.15.87:41752) 2024-05-08T05:26:17.604 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:17.603+0000 7fed2be00700 1 -- 172.21.15.87:0/1910479631 learned_addr learned my addr 172.21.15.87:0/1910479631 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T05:26:17.604 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:17.603+0000 7fed23400700 1 --2- 172.21.15.87:0/1910479631 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fed2c104100 0x7fed2c075ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:26:17.604 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:17.603+0000 7fed31000700 1 --2- 172.21.15.87:0/1910479631 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fed2c108850 0x7fed2c076220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:26:17.605 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:17.604+0000 7fed23400700 1 -- 172.21.15.87:0/1910479631 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fed2c103750 msgr2=0x7fed2c0757a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:26:17.605 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:17.604+0000 7fed23400700 1 --2- 172.21.15.87:0/1910479631 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fed2c103750 0x7fed2c0757a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:26:17.605 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:17.604+0000 7fed23400700 1 -- 172.21.15.87:0/1910479631 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fed2c108850 msgr2=0x7fed2c076220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:26:17.605 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:17.604+0000 7fed23400700 1 --2- 172.21.15.87:0/1910479631 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fed2c108850 0x7fed2c076220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:26:17.605 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:17.604+0000 7fed23400700 1 -- 172.21.15.87:0/1910479631 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fed2c1a8060 con 0x7fed2c104100 2024-05-08T05:26:17.606 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:17.604+0000 7fed23400700 1 --2- 172.21.15.87:0/1910479631 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fed2c104100 0x7fed2c075ce0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fed1400e9f0 tx=0x7fed1400ed00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:26:17.606 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:17.604+0000 7fed29600700 1 -- 172.21.15.87:0/1910479631 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed1400c9c0 con 0x7fed2c104100 2024-05-08T05:26:17.606 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:17.604+0000 7fed29600700 1 -- 172.21.15.87:0/1910479631 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fed1400cb60 con 0x7fed2c104100 2024-05-08T05:26:17.606 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:17.604+0000 7fed33000700 1 -- 172.21.15.87:0/1910479631 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fed2c1a8350 con 0x7fed2c104100 2024-05-08T05:26:17.606 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:17.604+0000 7fed29600700 1 -- 172.21.15.87:0/1910479631 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed14018680 con 0x7fed2c104100 2024-05-08T05:26:17.606 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:17.604+0000 7fed33000700 1 -- 172.21.15.87:0/1910479631 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fed2c1a8890 con 0x7fed2c104100 2024-05-08T05:26:17.606 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:17.606+0000 7fed33000700 1 -- 172.21.15.87:0/1910479631 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fed2c10ba90 con 0x7fed2c104100 2024-05-08T05:26:17.608 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:17.608+0000 7fed29600700 1 -- 172.21.15.87:0/1910479631 <== mon.1 v2:172.21.15.160:3300/0 4 ==== mgrmap(e 17) ==== 149703+0+0 (secure 0 0 0) 0x7fed14010430 con 0x7fed2c104100 2024-05-08T05:26:17.610 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:17.609+0000 7fed29600700 1 --2- 172.21.15.87:0/1910479631 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7fed100b2910 0x7fed100b4dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:26:17.610 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:17.609+0000 7fed29600700 1 -- 172.21.15.87:0/1910479631 <== mon.1 v2:172.21.15.160:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 7979+0+0 (secure 0 0 0) 0x7fed140e2440 con 0x7fed2c104100 2024-05-08T05:26:17.610 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:17.609+0000 7fed2be00700 1 --2- 172.21.15.87:0/1910479631 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7fed100b2910 0x7fed100b4dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:26:17.610 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:17.610+0000 7fed2be00700 1 --2- 172.21.15.87:0/1910479631 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7fed100b2910 0x7fed100b4dd0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fed1c009990 tx=0x7fed1c005ab0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:26:17.613 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:17.613+0000 7fed29600700 1 -- 172.21.15.87:0/1910479631 <== mon.1 v2:172.21.15.160:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7fed140aa0b0 con 0x7fed2c104100 2024-05-08T05:26:17.884 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:17.884+0000 7fed33000700 1 -- 172.21.15.87:0/1910479631 --> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}) -- 0x7fed2c0638e0 con 0x7fed100b2910 2024-05-08T05:26:17.895 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:17.895+0000 7fed29600700 1 -- 172.21.15.87:0/1910479631 <== mgr.14152 v2:172.21.15.87:6800/1189186457 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+54 (secure 0 0 0) 0x7fed2c0638e0 con 0x7fed100b2910 2024-05-08T05:26:17.974 INFO:teuthology.orchestra.run.smithi087.stdout:/volumes/qa/sv_1/9478313c-6fba-4107-b3b2-23d2237bfde7 2024-05-08T05:26:17.974 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:17.898+0000 7fed33000700 1 -- 172.21.15.87:0/1910479631 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7fed100b2910 msgr2=0x7fed100b4dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:26:17.974 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:17.898+0000 7fed33000700 1 --2- 172.21.15.87:0/1910479631 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7fed100b2910 0x7fed100b4dd0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fed1c009990 tx=0x7fed1c005ab0 comp rx=0 tx=0).stop 2024-05-08T05:26:17.974 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:17.898+0000 7fed33000700 1 -- 172.21.15.87:0/1910479631 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fed2c104100 msgr2=0x7fed2c075ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:26:17.974 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:17.898+0000 7fed33000700 1 --2- 172.21.15.87:0/1910479631 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fed2c104100 0x7fed2c075ce0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fed1400e9f0 tx=0x7fed1400ed00 comp rx=0 tx=0).stop 2024-05-08T05:26:17.974 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:17.898+0000 7fed33000700 1 -- 172.21.15.87:0/1910479631 shutdown_connections 2024-05-08T05:26:17.975 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:17.898+0000 7fed33000700 1 --2- 172.21.15.87:0/1910479631 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fed2c108850 0x7fed2c076220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:26:17.975 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:17.898+0000 7fed33000700 1 --2- 172.21.15.87:0/1910479631 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fed2c103750 0x7fed2c0757a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:26:17.975 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:17.898+0000 7fed33000700 1 --2- 172.21.15.87:0/1910479631 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7fed100b2910 0x7fed100b4dd0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:26:17.975 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:17.898+0000 7fed33000700 1 --2- 172.21.15.87:0/1910479631 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fed2c104100 0x7fed2c075ce0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:26:17.975 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:17.898+0000 7fed33000700 1 -- 172.21.15.87:0/1910479631 >> 172.21.15.87:0/1910479631 conn(0x7fed2c07a600 msgr2=0x7fed2c101770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:26:17.975 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:17.898+0000 7fed33000700 1 -- 172.21.15.87:0/1910479631 shutdown_connections 2024-05-08T05:26:17.975 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:17.898+0000 7fed33000700 1 -- 172.21.15.87:0/1910479631 wait complete. 2024-05-08T05:26:18.208 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:26:18 smithi087 ceph-mon[29523]: pgmap v337: 97 pgs: 97 active+clean; 612 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 3.2 KiB/s wr, 7 op/s 2024-05-08T05:26:18.483 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:26:18 smithi090 ceph-mon[34526]: pgmap v337: 97 pgs: 97 active+clean; 612 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 3.2 KiB/s wr, 7 op/s 2024-05-08T05:26:18.538 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:26:18 smithi160 ceph-mon[34827]: pgmap v337: 97 pgs: 97 active+clean; 612 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 3.2 KiB/s wr, 7 op/s 2024-05-08T05:26:18.660 DEBUG:teuthology.orchestra.run.smithi087:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid eeeb813e-0cf9-11ef-bc97-c7b262605968 -- ceph fs dump --format=json 2024-05-08T05:26:19.097 INFO:teuthology.orchestra.run.smithi087.stderr:Inferring config /var/lib/ceph/eeeb813e-0cf9-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T05:26:19.440 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:26:19 smithi087 ceph-mon[29523]: from='client.24607 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-05-08T05:26:19.483 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:26:19 smithi090 ceph-mon[34526]: from='client.24607 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-05-08T05:26:19.538 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:26:19 smithi160 ceph-mon[34827]: from='client.24607 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-05-08T05:26:20.303 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:26:20 smithi087 ceph-mon[29523]: pgmap v338: 97 pgs: 97 active+clean; 634 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 5.2 KiB/s wr, 10 op/s 2024-05-08T05:26:20.483 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:26:20 smithi090 ceph-mon[34526]: pgmap v338: 97 pgs: 97 active+clean; 634 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 5.2 KiB/s wr, 10 op/s 2024-05-08T05:26:20.538 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:26:20 smithi160 ceph-mon[34827]: pgmap v338: 97 pgs: 97 active+clean; 634 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 5.2 KiB/s wr, 10 op/s 2024-05-08T05:26:21.193 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:21.192+0000 7f3cbe800700 1 -- 172.21.15.87:0/4239601847 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3cb81056c0 msgr2=0x7f3cb8105b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:26:21.193 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:21.192+0000 7f3cbe800700 1 --2- 172.21.15.87:0/4239601847 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3cb81056c0 0x7f3cb8105b40 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f3ca4009990 tx=0x7f3ca4009ca0 comp rx=0 tx=0).stop 2024-05-08T05:26:21.193 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:21.192+0000 7f3cbe800700 1 -- 172.21.15.87:0/4239601847 shutdown_connections 2024-05-08T05:26:21.193 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:21.192+0000 7f3cbe800700 1 --2- 172.21.15.87:0/4239601847 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3cb8106080 0x7f3cb8112590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:26:21.194 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:21.192+0000 7f3cbe800700 1 --2- 172.21.15.87:0/4239601847 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3cb810b6c0 0x7f3cb810baa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:26:21.194 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:21.192+0000 7f3cbe800700 1 --2- 172.21.15.87:0/4239601847 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3cb81056c0 0x7f3cb8105b40 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:26:21.194 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:21.192+0000 7f3cbe800700 1 -- 172.21.15.87:0/4239601847 >> 172.21.15.87:0/4239601847 conn(0x7f3cb81011b0 msgr2=0x7f3cb81035d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:26:21.194 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:21.192+0000 7f3cbe800700 1 -- 172.21.15.87:0/4239601847 shutdown_connections 2024-05-08T05:26:21.194 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:21.192+0000 7f3cbe800700 1 -- 172.21.15.87:0/4239601847 wait complete. 2024-05-08T05:26:21.195 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:21.193+0000 7f3cbe800700 1 Processor -- start 2024-05-08T05:26:21.195 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:21.193+0000 7f3cbe800700 1 -- start start 2024-05-08T05:26:21.195 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:21.194+0000 7f3cbe800700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3cb81056c0 0x7f3cb819be00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:26:21.195 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:21.194+0000 7f3cbe800700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3cb8106080 0x7f3cb819c340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:26:21.195 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:21.194+0000 7f3cbe800700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3cb810b6c0 0x7f3cb81a06d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:26:21.196 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:21.194+0000 7f3cbe800700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f3cb8115950 con 0x7f3cb810b6c0 2024-05-08T05:26:21.196 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:21.194+0000 7f3cbe800700 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f3cb81157d0 con 0x7f3cb81056c0 2024-05-08T05:26:21.196 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:21.194+0000 7f3cbe800700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f3cb8115ad0 con 0x7f3cb8106080 2024-05-08T05:26:21.196 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:21.194+0000 7f3cb7e00700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3cb810b6c0 0x7f3cb81a06d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:26:21.196 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:21.194+0000 7f3cb7400700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3cb81056c0 0x7f3cb819be00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:26:21.196 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:21.194+0000 7f3cb7e00700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3cb810b6c0 0x7f3cb81a06d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:60624/0 (socket says 172.21.15.87:60624) 2024-05-08T05:26:21.196 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:21.194+0000 7f3cb7e00700 1 -- 172.21.15.87:0/3250923242 learned_addr learned my addr 172.21.15.87:0/3250923242 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T05:26:21.196 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:21.194+0000 7f3cb6a00700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3cb8106080 0x7f3cb819c340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:26:21.196 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:21.195+0000 7f3cb7400700 1 -- 172.21.15.87:0/3250923242 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3cb8106080 msgr2=0x7f3cb819c340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:26:21.196 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:21.195+0000 7f3cb7400700 1 --2- 172.21.15.87:0/3250923242 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3cb8106080 0x7f3cb819c340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:26:21.196 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:21.195+0000 7f3cb7400700 1 -- 172.21.15.87:0/3250923242 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3cb810b6c0 msgr2=0x7f3cb81a06d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:26:21.196 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:21.195+0000 7f3cb7400700 1 --2- 172.21.15.87:0/3250923242 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3cb810b6c0 0x7f3cb81a06d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:26:21.196 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:21.195+0000 7f3cb7400700 1 -- 172.21.15.87:0/3250923242 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3cb81a0e10 con 0x7f3cb81056c0 2024-05-08T05:26:21.196 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:21.195+0000 7f3cb7400700 1 --2- 172.21.15.87:0/3250923242 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3cb81056c0 0x7f3cb819be00 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f3ca800e9f0 tx=0x7f3ca800ed00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:26:21.197 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:21.195+0000 7f3cafe00700 1 -- 172.21.15.87:0/3250923242 <== mon.2 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ca800c9c0 con 0x7f3cb81056c0 2024-05-08T05:26:21.197 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:21.195+0000 7f3cafe00700 1 -- 172.21.15.87:0/3250923242 <== mon.2 v2:172.21.15.90:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3ca800cb60 con 0x7f3cb81056c0 2024-05-08T05:26:21.197 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:21.195+0000 7f3cafe00700 1 -- 172.21.15.87:0/3250923242 <== mon.2 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ca8018680 con 0x7f3cb81056c0 2024-05-08T05:26:21.197 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:21.196+0000 7f3cbe800700 1 -- 172.21.15.87:0/3250923242 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3cb81a1100 con 0x7f3cb81056c0 2024-05-08T05:26:21.197 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:21.196+0000 7f3cbe800700 1 -- 172.21.15.87:0/3250923242 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3cb81a8980 con 0x7f3cb81056c0 2024-05-08T05:26:21.197 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:21.197+0000 7f3cbe800700 1 -- 172.21.15.87:0/3250923242 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3cb806a190 con 0x7f3cb81056c0 2024-05-08T05:26:21.199 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:21.199+0000 7f3cafe00700 1 -- 172.21.15.87:0/3250923242 <== mon.2 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 17) ==== 149703+0+0 (secure 0 0 0) 0x7f3ca8010430 con 0x7f3cb81056c0 2024-05-08T05:26:21.200 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:21.200+0000 7f3cafe00700 1 --2- 172.21.15.87:0/3250923242 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f3c9c0b2990 0x7f3c9c0b4e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:26:21.201 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:21.201+0000 7f3cafe00700 1 -- 172.21.15.87:0/3250923242 <== mon.2 v2:172.21.15.90:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 7979+0+0 (secure 0 0 0) 0x7f3ca80e2330 con 0x7f3cb81056c0 2024-05-08T05:26:21.201 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:21.201+0000 7f3cb6a00700 1 --2- 172.21.15.87:0/3250923242 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f3c9c0b2990 0x7f3c9c0b4e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:26:21.201 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:21.201+0000 7f3cb6a00700 1 --2- 172.21.15.87:0/3250923242 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f3c9c0b2990 0x7f3c9c0b4e50 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f3cb8103850 tx=0x7f3ca4005fd0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:26:21.205 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:21.204+0000 7f3cafe00700 1 -- 172.21.15.87:0/3250923242 <== mon.2 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f3ca80a9fa0 con 0x7f3cb81056c0 2024-05-08T05:26:21.482 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:21.481+0000 7f3cbe800700 1 -- 172.21.15.87:0/3250923242 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f3cb819d160 con 0x7f3cb81056c0 2024-05-08T05:26:21.483 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:21.483+0000 7f3cafe00700 1 -- 172.21.15.87:0/3250923242 <== mon.2 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) ==== 94+0+11858 (secure 0 0 0) 0x7f3ca80a98a0 con 0x7f3cb81056c0 2024-05-08T05:26:21.483 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-05-08T05:26:21.484 INFO:teuthology.orchestra.run.smithi087.stdout:{"epoch":24,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14358,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6835/1183985321","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6834","nonce":1183985321},{"type":"v1","addr":"172.21.15.87:6835","nonce":1183985321}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14370,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6837/1485824316","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6836","nonce":1485824316},{"type":"v1","addr":"172.21.15.87:6837","nonce":1485824316}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14409,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6841/724277538","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6840","nonce":724277538},{"type":"v1","addr":"172.21.15.87:6841","nonce":724277538}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24412,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6833/3339455985","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6832","nonce":3339455985},{"type":"v1","addr":"172.21.15.160:6833","nonce":3339455985}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24413,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6833/3292166873","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6832","nonce":3292166873},{"type":"v1","addr":"172.21.15.90:6833","nonce":3292166873}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24443,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6835/824555459","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6834","nonce":824555459},{"type":"v1","addr":"172.21.15.90:6835","nonce":824555459}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6}],"filesystems":[{"mdsmap":{"epoch":24,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-05-08T05:25:36.816840+0000","modified":"2024-05-08T05:25:59.331243+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24500,"mds_1":24482,"mds_2":24481},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24463":{"gid":24463,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.160:6835/409648357","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6834","nonce":409648357},{"type":"v1","addr":"172.21.15.160:6835","nonce":409648357}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24467":{"gid":24467,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.90:6837/4221919418","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6836","nonce":4221919418},{"type":"v1","addr":"172.21.15.90:6837","nonce":4221919418}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24469":{"gid":24469,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.160:6837/4200018040","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6836","nonce":4200018040},{"type":"v1","addr":"172.21.15.160:6837","nonce":4200018040}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24481":{"gid":24481,"name":"i","rank":2,"incarnation":20,"state":"up:active","state_seq":13,"addr":"172.21.15.160:6839/234657686","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6838","nonce":234657686},{"type":"v1","addr":"172.21.15.160:6839","nonce":234657686}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24482":{"gid":24482,"name":"g","rank":1,"incarnation":18,"state":"up:active","state_seq":12,"addr":"172.21.15.87:6839/2127215876","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6838","nonce":2127215876},{"type":"v1","addr":"172.21.15.87:6839","nonce":2127215876}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24500":{"gid":24500,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.90:6839/160586017","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6838","nonce":160586017},{"type":"v1","addr":"172.21.15.90:6839","nonce":160586017}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24500,"qdb_cluster":[24482,24500,24481]},"id":1}]} 2024-05-08T05:26:21.487 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:21.486+0000 7f3cbe800700 1 -- 172.21.15.87:0/3250923242 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f3c9c0b2990 msgr2=0x7f3c9c0b4e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:26:21.487 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:21.486+0000 7f3cbe800700 1 --2- 172.21.15.87:0/3250923242 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f3c9c0b2990 0x7f3c9c0b4e50 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f3cb8103850 tx=0x7f3ca4005fd0 comp rx=0 tx=0).stop 2024-05-08T05:26:21.487 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:21.486+0000 7f3cbe800700 1 -- 172.21.15.87:0/3250923242 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3cb81056c0 msgr2=0x7f3cb819be00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:26:21.487 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:21.486+0000 7f3cbe800700 1 --2- 172.21.15.87:0/3250923242 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3cb81056c0 0x7f3cb819be00 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f3ca800e9f0 tx=0x7f3ca800ed00 comp rx=0 tx=0).stop 2024-05-08T05:26:21.487 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:21.486+0000 7f3cbe800700 1 -- 172.21.15.87:0/3250923242 shutdown_connections 2024-05-08T05:26:21.487 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:21.486+0000 7f3cbe800700 1 --2- 172.21.15.87:0/3250923242 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3cb810b6c0 0x7f3cb81a06d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:26:21.487 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:21.486+0000 7f3cbe800700 1 --2- 172.21.15.87:0/3250923242 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3cb81056c0 0x7f3cb819be00 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:26:21.487 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:21.486+0000 7f3cbe800700 1 --2- 172.21.15.87:0/3250923242 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f3c9c0b2990 0x7f3c9c0b4e50 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:26:21.487 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:21.486+0000 7f3cbe800700 1 --2- 172.21.15.87:0/3250923242 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3cb8106080 0x7f3cb819c340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:26:21.488 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:21.486+0000 7f3cbe800700 1 -- 172.21.15.87:0/3250923242 >> 172.21.15.87:0/3250923242 conn(0x7f3cb81011b0 msgr2=0x7f3cb8101a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:26:21.488 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:21.486+0000 7f3cbe800700 1 -- 172.21.15.87:0/3250923242 shutdown_connections 2024-05-08T05:26:21.488 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:21.486+0000 7f3cbe800700 1 -- 172.21.15.87:0/3250923242 wait complete. 2024-05-08T05:26:21.488 INFO:teuthology.orchestra.run.smithi087.stderr:dumped fsmap epoch 24 2024-05-08T05:26:22.208 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:26:22 smithi087 ceph-mon[29523]: pgmap v339: 97 pgs: 97 active+clean; 634 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 2.7 KiB/s wr, 6 op/s 2024-05-08T05:26:22.208 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:26:22 smithi087 ceph-mon[29523]: from='client.? 172.21.15.87:0/3250923242' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T05:26:22.306 DEBUG:teuthology.orchestra.run.smithi087:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid eeeb813e-0cf9-11ef-bc97-c7b262605968 -- ceph osd dump --format=json 2024-05-08T05:26:22.483 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:26:22 smithi090 ceph-mon[34526]: pgmap v339: 97 pgs: 97 active+clean; 634 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 2.7 KiB/s wr, 6 op/s 2024-05-08T05:26:22.483 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:26:22 smithi090 ceph-mon[34526]: from='client.? 172.21.15.87:0/3250923242' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T05:26:22.538 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:26:22 smithi160 ceph-mon[34827]: pgmap v339: 97 pgs: 97 active+clean; 634 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 2.7 KiB/s wr, 6 op/s 2024-05-08T05:26:22.538 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:26:22 smithi160 ceph-mon[34827]: from='client.? 172.21.15.87:0/3250923242' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T05:26:22.748 INFO:teuthology.orchestra.run.smithi087.stderr:Inferring config /var/lib/ceph/eeeb813e-0cf9-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T05:26:23.209 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:26:23 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [2, 11]}]: dispatch 2024-05-08T05:26:23.209 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:26:23 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [2, 4, 8, 11]}]: dispatch 2024-05-08T05:26:23.209 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:26:23 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.0", "id": [4, 8]}]: dispatch 2024-05-08T05:26:23.209 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:26:23 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1", "id": [4, 9]}]: dispatch 2024-05-08T05:26:23.209 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:26:23 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.12", "id": [3, 9]}]: dispatch 2024-05-08T05:26:23.209 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:26:23 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.28", "id": [5, 6]}]: dispatch 2024-05-08T05:26:23.209 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:26:23 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.2c", "id": [4, 9]}]: dispatch 2024-05-08T05:26:23.483 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:26:23 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [2, 11]}]: dispatch 2024-05-08T05:26:23.484 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:26:23 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [2, 4, 8, 11]}]: dispatch 2024-05-08T05:26:23.484 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:26:23 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.0", "id": [4, 8]}]: dispatch 2024-05-08T05:26:23.484 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:26:23 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1", "id": [4, 9]}]: dispatch 2024-05-08T05:26:23.484 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:26:23 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.12", "id": [3, 9]}]: dispatch 2024-05-08T05:26:23.484 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:26:23 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.28", "id": [5, 6]}]: dispatch 2024-05-08T05:26:23.484 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:26:23 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.2c", "id": [4, 9]}]: dispatch 2024-05-08T05:26:23.539 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:26:23 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [2, 11]}]: dispatch 2024-05-08T05:26:23.539 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:26:23 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [2, 4, 8, 11]}]: dispatch 2024-05-08T05:26:23.539 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:26:23 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.0", "id": [4, 8]}]: dispatch 2024-05-08T05:26:23.539 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:26:23 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1", "id": [4, 9]}]: dispatch 2024-05-08T05:26:23.539 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:26:23 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.12", "id": [3, 9]}]: dispatch 2024-05-08T05:26:23.539 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:26:23 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.28", "id": [5, 6]}]: dispatch 2024-05-08T05:26:23.539 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:26:23 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.2c", "id": [4, 9]}]: dispatch 2024-05-08T05:26:24.209 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:26:24 smithi087 ceph-mon[29523]: pgmap v340: 97 pgs: 97 active+clean; 634 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 2.7 KiB/s wr, 7 op/s 2024-05-08T05:26:24.209 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:26:24 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [2, 11]}]': finished 2024-05-08T05:26:24.209 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:26:24 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [2, 4, 8, 11]}]': finished 2024-05-08T05:26:24.209 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:26:24 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.0", "id": [4, 8]}]': finished 2024-05-08T05:26:24.209 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:26:24 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1", "id": [4, 9]}]': finished 2024-05-08T05:26:24.209 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:26:24 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.12", "id": [3, 9]}]': finished 2024-05-08T05:26:24.209 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:26:24 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.28", "id": [5, 6]}]': finished 2024-05-08T05:26:24.209 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:26:24 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.2c", "id": [4, 9]}]': finished 2024-05-08T05:26:24.209 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:26:24 smithi087 ceph-mon[29523]: osdmap e81: 12 total, 12 up, 12 in 2024-05-08T05:26:24.484 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:26:24 smithi090 ceph-mon[34526]: pgmap v340: 97 pgs: 97 active+clean; 634 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 2.7 KiB/s wr, 7 op/s 2024-05-08T05:26:24.484 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:26:24 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [2, 11]}]': finished 2024-05-08T05:26:24.484 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:26:24 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [2, 4, 8, 11]}]': finished 2024-05-08T05:26:24.484 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:26:24 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.0", "id": [4, 8]}]': finished 2024-05-08T05:26:24.484 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:26:24 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1", "id": [4, 9]}]': finished 2024-05-08T05:26:24.484 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:26:24 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.12", "id": [3, 9]}]': finished 2024-05-08T05:26:24.484 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:26:24 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.28", "id": [5, 6]}]': finished 2024-05-08T05:26:24.484 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:26:24 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.2c", "id": [4, 9]}]': finished 2024-05-08T05:26:24.484 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:26:24 smithi090 ceph-mon[34526]: osdmap e81: 12 total, 12 up, 12 in 2024-05-08T05:26:24.539 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:26:24 smithi160 ceph-mon[34827]: pgmap v340: 97 pgs: 97 active+clean; 634 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 2.7 KiB/s wr, 7 op/s 2024-05-08T05:26:24.539 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:26:24 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [2, 11]}]': finished 2024-05-08T05:26:24.539 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:26:24 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [2, 4, 8, 11]}]': finished 2024-05-08T05:26:24.539 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:26:24 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.0", "id": [4, 8]}]': finished 2024-05-08T05:26:24.539 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:26:24 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1", "id": [4, 9]}]': finished 2024-05-08T05:26:24.539 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:26:24 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.12", "id": [3, 9]}]': finished 2024-05-08T05:26:24.539 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:26:24 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.28", "id": [5, 6]}]': finished 2024-05-08T05:26:24.539 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:26:24 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.2c", "id": [4, 9]}]': finished 2024-05-08T05:26:24.539 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:26:24 smithi160 ceph-mon[34827]: osdmap e81: 12 total, 12 up, 12 in 2024-05-08T05:26:24.745 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:24.744+0000 7fd317400700 1 -- 172.21.15.87:0/2534527807 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd310103ef0 msgr2=0x7fd3101103d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:26:24.745 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:24.744+0000 7fd317400700 1 --2- 172.21.15.87:0/2534527807 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd310103ef0 0x7fd3101103d0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fd30800b0a0 tx=0x7fd30800b3b0 comp rx=0 tx=0).stop 2024-05-08T05:26:24.745 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:24.744+0000 7fd317400700 1 -- 172.21.15.87:0/2534527807 shutdown_connections 2024-05-08T05:26:24.745 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:24.744+0000 7fd317400700 1 --2- 172.21.15.87:0/2534527807 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd310103ef0 0x7fd3101103d0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:26:24.745 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:24.744+0000 7fd317400700 1 --2- 172.21.15.87:0/2534527807 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd310108460 0x7fd310108840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:26:24.745 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:24.744+0000 7fd317400700 1 --2- 172.21.15.87:0/2534527807 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd310103550 0x7fd3101039b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:26:24.745 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:24.744+0000 7fd317400700 1 -- 172.21.15.87:0/2534527807 >> 172.21.15.87:0/2534527807 conn(0x7fd31007a600 msgr2=0x7fd31007aa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:26:24.745 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:24.744+0000 7fd317400700 1 -- 172.21.15.87:0/2534527807 shutdown_connections 2024-05-08T05:26:24.746 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:24.744+0000 7fd317400700 1 -- 172.21.15.87:0/2534527807 wait complete. 2024-05-08T05:26:24.746 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:24.746+0000 7fd317400700 1 Processor -- start 2024-05-08T05:26:24.746 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:24.746+0000 7fd317400700 1 -- start start 2024-05-08T05:26:24.747 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:24.746+0000 7fd317400700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd310103550 0x7fd31019bd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:26:24.747 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:24.746+0000 7fd317400700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd310103ef0 0x7fd31019c2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:26:24.747 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:24.746+0000 7fd317400700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd310108460 0x7fd3101a0630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:26:24.747 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:24.746+0000 7fd317400700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fd310113730 con 0x7fd310108460 2024-05-08T05:26:24.747 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:24.746+0000 7fd317400700 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fd3101135b0 con 0x7fd310103ef0 2024-05-08T05:26:24.747 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:24.746+0000 7fd317400700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7fd3101138b0 con 0x7fd310103550 2024-05-08T05:26:24.747 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:24.747+0000 7fd315400700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd310108460 0x7fd3101a0630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:26:24.748 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:24.747+0000 7fd315400700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd310108460 0x7fd3101a0630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:60648/0 (socket says 172.21.15.87:60648) 2024-05-08T05:26:24.748 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:24.747+0000 7fd315400700 1 -- 172.21.15.87:0/1466967954 learned_addr learned my addr 172.21.15.87:0/1466967954 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T05:26:24.748 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:24.747+0000 7fd314a00700 1 --2- 172.21.15.87:0/1466967954 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd310103550 0x7fd31019bd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:26:24.748 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:24.747+0000 7fd30fe00700 1 --2- 172.21.15.87:0/1466967954 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd310103ef0 0x7fd31019c2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:26:24.749 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:24.747+0000 7fd315400700 1 -- 172.21.15.87:0/1466967954 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd310103550 msgr2=0x7fd31019bd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:26:24.749 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:24.747+0000 7fd315400700 1 --2- 172.21.15.87:0/1466967954 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd310103550 0x7fd31019bd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:26:24.749 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:24.747+0000 7fd315400700 1 -- 172.21.15.87:0/1466967954 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd310103ef0 msgr2=0x7fd31019c2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:26:24.749 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:24.747+0000 7fd315400700 1 --2- 172.21.15.87:0/1466967954 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd310103ef0 0x7fd31019c2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:26:24.749 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:24.747+0000 7fd315400700 1 -- 172.21.15.87:0/1466967954 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd3101a0d70 con 0x7fd310108460 2024-05-08T05:26:24.749 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:24.747+0000 7fd314a00700 1 --2- 172.21.15.87:0/1466967954 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd310103550 0x7fd31019bd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T05:26:24.749 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:24.748+0000 7fd315400700 1 --2- 172.21.15.87:0/1466967954 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd310108460 0x7fd3101a0630 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fd30800b070 tx=0x7fd308004c80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:26:24.749 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:24.748+0000 7fd30d600700 1 -- 172.21.15.87:0/1466967954 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd308021070 con 0x7fd310108460 2024-05-08T05:26:24.749 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:24.748+0000 7fd30d600700 1 -- 172.21.15.87:0/1466967954 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd308007e30 con 0x7fd310108460 2024-05-08T05:26:24.749 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:24.748+0000 7fd30d600700 1 -- 172.21.15.87:0/1466967954 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd308004570 con 0x7fd310108460 2024-05-08T05:26:24.749 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:24.748+0000 7fd317400700 1 -- 172.21.15.87:0/1466967954 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd3101a1000 con 0x7fd310108460 2024-05-08T05:26:24.749 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:24.748+0000 7fd317400700 1 -- 172.21.15.87:0/1466967954 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd3101a88e0 con 0x7fd310108460 2024-05-08T05:26:24.750 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:24.749+0000 7fd317400700 1 -- 172.21.15.87:0/1466967954 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd31006a190 con 0x7fd310108460 2024-05-08T05:26:24.752 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:24.752+0000 7fd30d600700 1 -- 172.21.15.87:0/1466967954 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 17) ==== 149703+0+0 (secure 0 0 0) 0x7fd308004710 con 0x7fd310108460 2024-05-08T05:26:24.753 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:24.753+0000 7fd30d600700 1 --2- 172.21.15.87:0/1466967954 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7fd2f80b2990 0x7fd2f80b4e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:26:24.754 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:24.753+0000 7fd30d600700 1 -- 172.21.15.87:0/1466967954 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8190+0+0 (secure 0 0 0) 0x7fd30800f020 con 0x7fd310108460 2024-05-08T05:26:24.754 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:24.753+0000 7fd314a00700 1 --2- 172.21.15.87:0/1466967954 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7fd2f80b2990 0x7fd2f80b4e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:26:24.754 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:24.754+0000 7fd314a00700 1 --2- 172.21.15.87:0/1466967954 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7fd2f80b2990 0x7fd2f80b4e50 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fd310104730 tx=0x7fd304009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:26:24.756 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:24.756+0000 7fd30d600700 1 -- 172.21.15.87:0/1466967954 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7fd30802a020 con 0x7fd310108460 2024-05-08T05:26:24.988 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:24.988+0000 7fd317400700 1 -- 172.21.15.87:0/1466967954 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fd3101a8ab0 con 0x7fd310108460 2024-05-08T05:26:24.992 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:24.992+0000 7fd30d600700 1 -- 172.21.15.87:0/1466967954 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v82) ==== 74+0+22588 (secure 0 0 0) 0x7fd30802e3e0 con 0x7fd310108460 2024-05-08T05:26:24.993 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-05-08T05:26:24.993 INFO:teuthology.orchestra.run.smithi087.stdout:{"epoch":82,"fsid":"eeeb813e-0cf9-11ef-bc97-c7b262605968","created":"2024-05-08T05:16:14.984330+0000","modified":"2024-05-08T05:26:24.106467+0000","last_up_change":"2024-05-08T05:24:22.324501+0000","last_in_change":"2024-05-08T05:24:01.962570+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-08T05:20:08.907941+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-08T05:25:28.054494+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-08T05:25:32.484126+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"f3e25ce0-0762-46fd-83fb-6766a2e9db69","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6802","nonce":2285285644},{"type":"v1","addr":"172.21.15.87:6803","nonce":2285285644}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6804","nonce":2285285644},{"type":"v1","addr":"172.21.15.87:6805","nonce":2285285644}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6808","nonce":2285285644},{"type":"v1","addr":"172.21.15.87:6809","nonce":2285285644}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6806","nonce":2285285644},{"type":"v1","addr":"172.21.15.87:6807","nonce":2285285644}]},"public_addr":"172.21.15.87:6803/2285285644","cluster_addr":"172.21.15.87:6805/2285285644","heartbeat_back_addr":"172.21.15.87:6809/2285285644","heartbeat_front_addr":"172.21.15.87:6807/2285285644","state":["exists","up"]},{"osd":1,"uuid":"b6de5f4c-1d79-41ff-adee-03d8a47ab55e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6800","nonce":1681573998},{"type":"v1","addr":"172.21.15.90:6801","nonce":1681573998}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6802","nonce":1681573998},{"type":"v1","addr":"172.21.15.90:6803","nonce":1681573998}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6806","nonce":1681573998},{"type":"v1","addr":"172.21.15.90:6807","nonce":1681573998}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6804","nonce":1681573998},{"type":"v1","addr":"172.21.15.90:6805","nonce":1681573998}]},"public_addr":"172.21.15.90:6801/1681573998","cluster_addr":"172.21.15.90:6803/1681573998","heartbeat_back_addr":"172.21.15.90:6807/1681573998","heartbeat_front_addr":"172.21.15.90:6805/1681573998","state":["exists","up"]},{"osd":2,"uuid":"ee3a2729-93b2-4985-b84d-165f92cae8e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6800","nonce":2137179096},{"type":"v1","addr":"172.21.15.160:6801","nonce":2137179096}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6802","nonce":2137179096},{"type":"v1","addr":"172.21.15.160:6803","nonce":2137179096}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6806","nonce":2137179096},{"type":"v1","addr":"172.21.15.160:6807","nonce":2137179096}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6804","nonce":2137179096},{"type":"v1","addr":"172.21.15.160:6805","nonce":2137179096}]},"public_addr":"172.21.15.160:6801/2137179096","cluster_addr":"172.21.15.160:6803/2137179096","heartbeat_back_addr":"172.21.15.160:6807/2137179096","heartbeat_front_addr":"172.21.15.160:6805/2137179096","state":["exists","up"]},{"osd":3,"uuid":"fc7bd69f-5a62-4ec6-b95c-c170be46a7d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6810","nonce":2022667023},{"type":"v1","addr":"172.21.15.87:6811","nonce":2022667023}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6812","nonce":2022667023},{"type":"v1","addr":"172.21.15.87:6813","nonce":2022667023}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6816","nonce":2022667023},{"type":"v1","addr":"172.21.15.87:6817","nonce":2022667023}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6814","nonce":2022667023},{"type":"v1","addr":"172.21.15.87:6815","nonce":2022667023}]},"public_addr":"172.21.15.87:6811/2022667023","cluster_addr":"172.21.15.87:6813/2022667023","heartbeat_back_addr":"172.21.15.87:6817/2022667023","heartbeat_front_addr":"172.21.15.87:6815/2022667023","state":["exists","up"]},{"osd":4,"uuid":"a05f7bd1-962a-4f3e-8f70-e7ef4c68bac2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6808","nonce":1371607578},{"type":"v1","addr":"172.21.15.90:6809","nonce":1371607578}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6810","nonce":1371607578},{"type":"v1","addr":"172.21.15.90:6811","nonce":1371607578}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6814","nonce":1371607578},{"type":"v1","addr":"172.21.15.90:6815","nonce":1371607578}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6812","nonce":1371607578},{"type":"v1","addr":"172.21.15.90:6813","nonce":1371607578}]},"public_addr":"172.21.15.90:6809/1371607578","cluster_addr":"172.21.15.90:6811/1371607578","heartbeat_back_addr":"172.21.15.90:6815/1371607578","heartbeat_front_addr":"172.21.15.90:6813/1371607578","state":["exists","up"]},{"osd":5,"uuid":"85e3af08-32ee-4f26-97df-8d54ba928715","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6808","nonce":2190054276},{"type":"v1","addr":"172.21.15.160:6809","nonce":2190054276}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6810","nonce":2190054276},{"type":"v1","addr":"172.21.15.160:6811","nonce":2190054276}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6814","nonce":2190054276},{"type":"v1","addr":"172.21.15.160:6815","nonce":2190054276}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6812","nonce":2190054276},{"type":"v1","addr":"172.21.15.160:6813","nonce":2190054276}]},"public_addr":"172.21.15.160:6809/2190054276","cluster_addr":"172.21.15.160:6811/2190054276","heartbeat_back_addr":"172.21.15.160:6815/2190054276","heartbeat_front_addr":"172.21.15.160:6813/2190054276","state":["exists","up"]},{"osd":6,"uuid":"df4b22a9-6cd8-473e-a17b-a0cb9ad32e98","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":42,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6818","nonce":2863681447},{"type":"v1","addr":"172.21.15.87:6819","nonce":2863681447}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6820","nonce":2863681447},{"type":"v1","addr":"172.21.15.87:6821","nonce":2863681447}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6824","nonce":2863681447},{"type":"v1","addr":"172.21.15.87:6825","nonce":2863681447}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6822","nonce":2863681447},{"type":"v1","addr":"172.21.15.87:6823","nonce":2863681447}]},"public_addr":"172.21.15.87:6819/2863681447","cluster_addr":"172.21.15.87:6821/2863681447","heartbeat_back_addr":"172.21.15.87:6825/2863681447","heartbeat_front_addr":"172.21.15.87:6823/2863681447","state":["exists","up"]},{"osd":7,"uuid":"f6ef3857-0366-4408-932a-a8c8479ba780","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6816","nonce":1964248958},{"type":"v1","addr":"172.21.15.90:6817","nonce":1964248958}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6818","nonce":1964248958},{"type":"v1","addr":"172.21.15.90:6819","nonce":1964248958}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6822","nonce":1964248958},{"type":"v1","addr":"172.21.15.90:6823","nonce":1964248958}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6820","nonce":1964248958},{"type":"v1","addr":"172.21.15.90:6821","nonce":1964248958}]},"public_addr":"172.21.15.90:6817/1964248958","cluster_addr":"172.21.15.90:6819/1964248958","heartbeat_back_addr":"172.21.15.90:6823/1964248958","heartbeat_front_addr":"172.21.15.90:6821/1964248958","state":["exists","up"]},{"osd":8,"uuid":"027dede9-d0be-4fbe-b7b8-02ce88d57f4d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":54,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6816","nonce":927680738},{"type":"v1","addr":"172.21.15.160:6817","nonce":927680738}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6818","nonce":927680738},{"type":"v1","addr":"172.21.15.160:6819","nonce":927680738}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6822","nonce":927680738},{"type":"v1","addr":"172.21.15.160:6823","nonce":927680738}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6820","nonce":927680738},{"type":"v1","addr":"172.21.15.160:6821","nonce":927680738}]},"public_addr":"172.21.15.160:6817/927680738","cluster_addr":"172.21.15.160:6819/927680738","heartbeat_back_addr":"172.21.15.160:6823/927680738","heartbeat_front_addr":"172.21.15.160:6821/927680738","state":["exists","up"]},{"osd":9,"uuid":"bc9e37de-e509-4db6-bd58-b68e2c8e1aff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6826","nonce":3789116749},{"type":"v1","addr":"172.21.15.87:6827","nonce":3789116749}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6828","nonce":3789116749},{"type":"v1","addr":"172.21.15.87:6829","nonce":3789116749}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6832","nonce":3789116749},{"type":"v1","addr":"172.21.15.87:6833","nonce":3789116749}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6830","nonce":3789116749},{"type":"v1","addr":"172.21.15.87:6831","nonce":3789116749}]},"public_addr":"172.21.15.87:6827/3789116749","cluster_addr":"172.21.15.87:6829/3789116749","heartbeat_back_addr":"172.21.15.87:6833/3789116749","heartbeat_front_addr":"172.21.15.87:6831/3789116749","state":["exists","up"]},{"osd":10,"uuid":"43945081-b4c8-4f5d-9301-3540709e69e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":66,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6824","nonce":716529498},{"type":"v1","addr":"172.21.15.90:6825","nonce":716529498}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6826","nonce":716529498},{"type":"v1","addr":"172.21.15.90:6827","nonce":716529498}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6830","nonce":716529498},{"type":"v1","addr":"172.21.15.90:6831","nonce":716529498}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6828","nonce":716529498},{"type":"v1","addr":"172.21.15.90:6829","nonce":716529498}]},"public_addr":"172.21.15.90:6825/716529498","cluster_addr":"172.21.15.90:6827/716529498","heartbeat_back_addr":"172.21.15.90:6831/716529498","heartbeat_front_addr":"172.21.15.90:6829/716529498","state":["exists","up"]},{"osd":11,"uuid":"da23ff5c-3f79-44e3-bca3-d9d5a003c999","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6824","nonce":1842739135},{"type":"v1","addr":"172.21.15.160:6825","nonce":1842739135}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6826","nonce":1842739135},{"type":"v1","addr":"172.21.15.160:6827","nonce":1842739135}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6830","nonce":1842739135},{"type":"v1","addr":"172.21.15.160:6831","nonce":1842739135}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6828","nonce":1842739135},{"type":"v1","addr":"172.21.15.160:6829","nonce":1842739135}]},"public_addr":"172.21.15.160:6825/1842739135","cluster_addr":"172.21.15.160:6827/1842739135","heartbeat_back_addr":"172.21.15.160:6831/1842739135","heartbeat_front_addr":"172.21.15.160:6829/1842739135","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T05:19:15.869398+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T05:19:42.014078+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T05:20:06.430660+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T05:20:38.555519+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T05:21:04.530605+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T05:21:29.545252+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T05:22:03.141982+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T05:22:29.191127+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T05:22:54.502994+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T05:23:27.899000+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T05:23:54.693979+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T05:24:20.307119+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.a","mappings":[{"from":2,"to":11}]},{"pgid":"2.1d","mappings":[{"from":2,"to":4},{"from":8,"to":11}]},{"pgid":"3.0","mappings":[{"from":4,"to":8}]},{"pgid":"3.1","mappings":[{"from":4,"to":9}]},{"pgid":"3.12","mappings":[{"from":3,"to":9}]},{"pgid":"3.28","mappings":[{"from":5,"to":6}]},{"pgid":"3.2c","mappings":[{"from":4,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.87:0/4226160503":"2024-05-09T05:17:22.736165+0000","172.21.15.87:0/2773684806":"2024-05-09T05:17:22.736165+0000","172.21.15.87:0/349590592":"2024-05-09T05:17:22.736165+0000","172.21.15.87:6801/2710124295":"2024-05-09T05:17:22.736165+0000","172.21.15.87:6800/1823425617":"2024-05-09T05:16:48.155337+0000","172.21.15.87:0/2393072013":"2024-05-09T05:16:48.155337+0000","172.21.15.87:0/1291525416":"2024-05-09T05:16:48.155337+0000","172.21.15.87:6801/1823425617":"2024-05-09T05:16:48.155337+0000","172.21.15.87:0/3839463573":"2024-05-09T05:16:48.155337+0000","172.21.15.87:6800/2710124295":"2024-05-09T05:17:22.736165+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-08T05:26:24.996 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:24.995+0000 7fd317400700 1 -- 172.21.15.87:0/1466967954 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7fd2f80b2990 msgr2=0x7fd2f80b4e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:26:24.996 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:24.995+0000 7fd317400700 1 --2- 172.21.15.87:0/1466967954 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7fd2f80b2990 0x7fd2f80b4e50 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fd310104730 tx=0x7fd304009260 comp rx=0 tx=0).stop 2024-05-08T05:26:24.996 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:24.995+0000 7fd317400700 1 -- 172.21.15.87:0/1466967954 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd310108460 msgr2=0x7fd3101a0630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:26:24.996 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:24.995+0000 7fd317400700 1 --2- 172.21.15.87:0/1466967954 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd310108460 0x7fd3101a0630 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fd30800b070 tx=0x7fd308004c80 comp rx=0 tx=0).stop 2024-05-08T05:26:24.996 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:24.995+0000 7fd317400700 1 -- 172.21.15.87:0/1466967954 shutdown_connections 2024-05-08T05:26:24.996 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:24.995+0000 7fd317400700 1 --2- 172.21.15.87:0/1466967954 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd310108460 0x7fd3101a0630 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:26:24.996 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:24.995+0000 7fd317400700 1 --2- 172.21.15.87:0/1466967954 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7fd2f80b2990 0x7fd2f80b4e50 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:26:24.997 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:24.995+0000 7fd317400700 1 --2- 172.21.15.87:0/1466967954 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd310103550 0x7fd31019bd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:26:24.997 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:24.995+0000 7fd317400700 1 --2- 172.21.15.87:0/1466967954 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd310103ef0 0x7fd31019c2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:26:24.997 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:24.995+0000 7fd317400700 1 -- 172.21.15.87:0/1466967954 >> 172.21.15.87:0/1466967954 conn(0x7fd31007a600 msgr2=0x7fd3101013c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:26:24.997 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:24.996+0000 7fd317400700 1 -- 172.21.15.87:0/1466967954 shutdown_connections 2024-05-08T05:26:24.997 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:24.996+0000 7fd317400700 1 -- 172.21.15.87:0/1466967954 wait complete. 2024-05-08T05:26:25.389 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:26:25 smithi087 ceph-mon[29523]: osdmap e82: 12 total, 12 up, 12 in 2024-05-08T05:26:25.389 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:26:25 smithi087 ceph-mon[29523]: from='client.? 172.21.15.87:0/1466967954' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-08T05:26:25.483 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:26:25 smithi090 ceph-mon[34526]: osdmap e82: 12 total, 12 up, 12 in 2024-05-08T05:26:25.483 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:26:25 smithi090 ceph-mon[34526]: from='client.? 172.21.15.87:0/1466967954' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-08T05:26:25.538 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:26:25 smithi160 ceph-mon[34827]: osdmap e82: 12 total, 12 up, 12 in 2024-05-08T05:26:25.538 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:26:25 smithi160 ceph-mon[34827]: from='client.? 172.21.15.87:0/1466967954' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-08T05:26:25.784 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2024-05-08T05:26:25.784 DEBUG:teuthology.orchestra.run.smithi087:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid eeeb813e-0cf9-11ef-bc97-c7b262605968 -- ceph pg dump --format=json 2024-05-08T05:26:26.213 INFO:teuthology.orchestra.run.smithi087.stderr:Inferring config /var/lib/ceph/eeeb813e-0cf9-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T05:26:26.458 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:26:26 smithi087 ceph-mon[29523]: pgmap v343: 97 pgs: 97 active+clean; 638 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 4.0 KiB/s wr, 9 op/s 2024-05-08T05:26:26.483 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:26:26 smithi090 ceph-mon[34526]: pgmap v343: 97 pgs: 97 active+clean; 638 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 4.0 KiB/s wr, 9 op/s 2024-05-08T05:26:26.539 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:26:26 smithi160 ceph-mon[34827]: pgmap v343: 97 pgs: 97 active+clean; 638 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 4.0 KiB/s wr, 9 op/s 2024-05-08T05:26:28.412 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:26:28 smithi087 ceph-mon[29523]: pgmap v344: 97 pgs: 97 active+clean; 638 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 1023 B/s wr, 5 op/s 2024-05-08T05:26:28.413 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:28.412+0000 7f3370200700 1 -- 172.21.15.87:0/3022397418 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3368109510 msgr2=0x7f33681098f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:26:28.413 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:28.412+0000 7f3370200700 1 --2- 172.21.15.87:0/3022397418 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3368109510 0x7f33681098f0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f335c009990 tx=0x7f335c009ca0 comp rx=0 tx=0).stop 2024-05-08T05:26:28.413 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:28.412+0000 7f3370200700 1 -- 172.21.15.87:0/3022397418 shutdown_connections 2024-05-08T05:26:28.413 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:28.412+0000 7f3370200700 1 --2- 172.21.15.87:0/3022397418 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f336806bb40 0x7f3368110330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:26:28.413 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:28.412+0000 7f3370200700 1 --2- 172.21.15.87:0/3022397418 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3368109510 0x7f33681098f0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:26:28.413 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:28.412+0000 7f3370200700 1 --2- 172.21.15.87:0/3022397418 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f336806b180 0x7f336806b600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:26:28.414 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:28.412+0000 7f3370200700 1 -- 172.21.15.87:0/3022397418 >> 172.21.15.87:0/3022397418 conn(0x7f3368079350 msgr2=0x7f3368079760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:26:28.414 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:28.412+0000 7f3370200700 1 -- 172.21.15.87:0/3022397418 shutdown_connections 2024-05-08T05:26:28.414 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:28.412+0000 7f3370200700 1 -- 172.21.15.87:0/3022397418 wait complete. 2024-05-08T05:26:28.414 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:28.413+0000 7f3370200700 1 Processor -- start 2024-05-08T05:26:28.414 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:28.414+0000 7f3370200700 1 -- start start 2024-05-08T05:26:28.415 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:28.414+0000 7f3370200700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f336806b180 0x7f33681a1a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:26:28.415 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:28.414+0000 7f3370200700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f336806bb40 0x7f33681a1fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:26:28.415 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:28.414+0000 7f3370200700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3368109510 0x7f336819bb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:26:28.415 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:28.414+0000 7f3370200700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f3368113620 con 0x7f336806bb40 2024-05-08T05:26:28.415 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:28.414+0000 7f3370200700 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f33681134a0 con 0x7f3368109510 2024-05-08T05:26:28.415 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:28.414+0000 7f3370200700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f33681137a0 con 0x7f336806b180 2024-05-08T05:26:28.416 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:28.414+0000 7f336ce00700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f336806bb40 0x7f33681a1fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:26:28.416 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:28.414+0000 7f336d800700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f336806b180 0x7f33681a1a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:26:28.416 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:28.415+0000 7f336ce00700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f336806bb40 0x7f33681a1fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:44540/0 (socket says 172.21.15.87:44540) 2024-05-08T05:26:28.416 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:28.415+0000 7f336d800700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f336806b180 0x7f33681a1a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.87:54016/0 (socket says 172.21.15.87:54016) 2024-05-08T05:26:28.416 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:28.415+0000 7f336ce00700 1 -- 172.21.15.87:0/4056797721 learned_addr learned my addr 172.21.15.87:0/4056797721 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T05:26:28.416 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:28.415+0000 7f336e200700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3368109510 0x7f336819bb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:26:28.417 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:28.415+0000 7f336e200700 1 -- 172.21.15.87:0/4056797721 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f336806b180 msgr2=0x7f33681a1a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:26:28.417 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:28.415+0000 7f336e200700 1 --2- 172.21.15.87:0/4056797721 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f336806b180 0x7f33681a1a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:26:28.417 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:28.415+0000 7f336e200700 1 -- 172.21.15.87:0/4056797721 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f336806bb40 msgr2=0x7f33681a1fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:26:28.417 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:28.415+0000 7f336e200700 1 --2- 172.21.15.87:0/4056797721 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f336806bb40 0x7f33681a1fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:26:28.417 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:28.415+0000 7f336e200700 1 -- 172.21.15.87:0/4056797721 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f336819c410 con 0x7f3368109510 2024-05-08T05:26:28.417 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:28.415+0000 7f336d800700 1 --2- 172.21.15.87:0/4056797721 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f336806b180 0x7f33681a1a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T05:26:28.417 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:28.415+0000 7f336e200700 1 --2- 172.21.15.87:0/4056797721 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3368109510 0x7f336819bb30 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f336000efc0 tx=0x7f336000c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:26:28.417 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:28.416+0000 7f3366000700 1 -- 172.21.15.87:0/4056797721 <== mon.2 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33600092e0 con 0x7f3368109510 2024-05-08T05:26:28.417 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:28.416+0000 7f3370200700 1 -- 172.21.15.87:0/4056797721 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f336819c6a0 con 0x7f3368109510 2024-05-08T05:26:28.417 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:28.416+0000 7f3366000700 1 -- 172.21.15.87:0/4056797721 <== mon.2 v2:172.21.15.90:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3360004bb0 con 0x7f3368109510 2024-05-08T05:26:28.417 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:28.416+0000 7f3366000700 1 -- 172.21.15.87:0/4056797721 <== mon.2 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3360004020 con 0x7f3368109510 2024-05-08T05:26:28.417 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:28.416+0000 7f3370200700 1 -- 172.21.15.87:0/4056797721 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f33681a89e0 con 0x7f3368109510 2024-05-08T05:26:28.418 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:28.417+0000 7f3370200700 1 -- 172.21.15.87:0/4056797721 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f336819ca10 con 0x7f3368109510 2024-05-08T05:26:28.419 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:28.419+0000 7f3366000700 1 -- 172.21.15.87:0/4056797721 <== mon.2 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 17) ==== 149703+0+0 (secure 0 0 0) 0x7f336001b030 con 0x7f3368109510 2024-05-08T05:26:28.421 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:28.421+0000 7f3366000700 1 --2- 172.21.15.87:0/4056797721 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f33500b2910 0x7f33500b4dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:26:28.421 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:28.421+0000 7f3366000700 1 -- 172.21.15.87:0/4056797721 <== mon.2 v2:172.21.15.90:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8190+0+0 (secure 0 0 0) 0x7f33600e1e30 con 0x7f3368109510 2024-05-08T05:26:28.421 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:28.421+0000 7f336d800700 1 --2- 172.21.15.87:0/4056797721 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f33500b2910 0x7f33500b4dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:26:28.422 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:28.422+0000 7f336d800700 1 --2- 172.21.15.87:0/4056797721 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f33500b2910 0x7f33500b4dd0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f335c0098e0 tx=0x7f335c005960 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:26:28.425 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:28.425+0000 7f3366000700 1 -- 172.21.15.87:0/4056797721 <== mon.2 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f336819ca10 con 0x7f3368109510 2024-05-08T05:26:28.483 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:26:28 smithi090 ceph-mon[34526]: pgmap v344: 97 pgs: 97 active+clean; 638 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 1023 B/s wr, 5 op/s 2024-05-08T05:26:28.538 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:26:28 smithi160 ceph-mon[34827]: pgmap v344: 97 pgs: 97 active+clean; 638 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 1023 B/s wr, 5 op/s 2024-05-08T05:26:28.654 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:28.653+0000 7f3370200700 1 -- 172.21.15.87:0/4056797721 --> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f3368101520 con 0x7f33500b2910 2024-05-08T05:26:28.667 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:28.666+0000 7f3366000700 1 -- 172.21.15.87:0/4056797721 <== mgr.14152 v2:172.21.15.87:6800/1189186457 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258725 (secure 0 0 0) 0x7f335c0652c0 con 0x7f33500b2910 2024-05-08T05:26:28.672 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-05-08T05:26:28.674 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:28.672+0000 7f3370200700 1 -- 172.21.15.87:0/4056797721 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f33500b2910 msgr2=0x7f33500b4dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:26:28.675 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:28.672+0000 7f3370200700 1 --2- 172.21.15.87:0/4056797721 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f33500b2910 0x7f33500b4dd0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f335c0098e0 tx=0x7f335c005960 comp rx=0 tx=0).stop 2024-05-08T05:26:28.675 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:28.673+0000 7f3370200700 1 -- 172.21.15.87:0/4056797721 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3368109510 msgr2=0x7f336819bb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:26:28.675 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:28.673+0000 7f3370200700 1 --2- 172.21.15.87:0/4056797721 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3368109510 0x7f336819bb30 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f336000efc0 tx=0x7f336000c3a0 comp rx=0 tx=0).stop 2024-05-08T05:26:28.675 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:28.673+0000 7f3370200700 1 -- 172.21.15.87:0/4056797721 shutdown_connections 2024-05-08T05:26:28.675 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:28.673+0000 7f3370200700 1 --2- 172.21.15.87:0/4056797721 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3368109510 0x7f336819bb30 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:26:28.675 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:28.673+0000 7f3370200700 1 --2- 172.21.15.87:0/4056797721 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f33500b2910 0x7f33500b4dd0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:26:28.675 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:28.673+0000 7f3370200700 1 --2- 172.21.15.87:0/4056797721 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f336806b180 0x7f33681a1a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:26:28.675 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:28.673+0000 7f3370200700 1 --2- 172.21.15.87:0/4056797721 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f336806bb40 0x7f33681a1fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:26:28.675 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:28.673+0000 7f3370200700 1 -- 172.21.15.87:0/4056797721 >> 172.21.15.87:0/4056797721 conn(0x7f3368079350 msgr2=0x7f3368100e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:26:28.675 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:28.673+0000 7f3370200700 1 -- 172.21.15.87:0/4056797721 shutdown_connections 2024-05-08T05:26:28.675 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:28.673+0000 7f3370200700 1 -- 172.21.15.87:0/4056797721 wait complete. 2024-05-08T05:26:28.676 INFO:teuthology.orchestra.run.smithi087.stderr:dumped all 2024-05-08T05:26:29.426 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:26:29 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T05:26:29.483 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:26:29 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T05:26:29.489 INFO:teuthology.orchestra.run.smithi087.stdout:{"pg_ready":true,"pg_map":{"version":344,"stamp":"2024-05-08T05:26:26.905925+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":653809,"num_objects":64,"num_object_clones":0,"num_object_copies":192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":270,"num_read_kb":228,"num_write":289,"num_write_kb":2260,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":234,"ondisk_log_size":234,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":294,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":369904,"kb_used_data":12396,"kb_used_omap":18,"kb_used_meta":357357,"kb_avail":1124571920,"statfs":{"total":1151940427776,"available":1151561646080,"internally_reserved":0,"allocated":12693504,"data_stored":7097212,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19143,"internal_metadata":365933881},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":4448,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":20,"num_write":12,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.003282"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":14,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T05:25:37.091073+0000","last_change":"2024-05-08T05:25:34.073030+0000","last_active":"2024-05-08T05:25:37.091073+0000","last_peered":"2024-05-08T05:25:37.091073+0000","last_clean":"2024-05-08T05:25:37.091073+0000","last_became_active":"2024-05-08T05:25:34.072593+0000","last_became_peered":"2024-05-08T05:25:34.072593+0000","last_unstale":"2024-05-08T05:25:37.091073+0000","last_undegraded":"2024-05-08T05:25:37.091073+0000","last_fullsized":"2024-05-08T05:25:37.091073+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_clean_scrub_stamp":"2024-05-08T05:25:33.008741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T09:46:17.507034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:26:24.131357+0000","last_change":"2024-05-08T05:25:34.071436+0000","last_active":"2024-05-08T05:26:24.131357+0000","last_peered":"2024-05-08T05:26:24.131357+0000","last_clean":"2024-05-08T05:26:24.131357+0000","last_became_active":"2024-05-08T05:25:34.070985+0000","last_became_peered":"2024-05-08T05:25:34.070985+0000","last_unstale":"2024-05-08T05:26:24.131357+0000","last_undegraded":"2024-05-08T05:26:24.131357+0000","last_fullsized":"2024-05-08T05:26:24.131357+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_clean_scrub_stamp":"2024-05-08T05:25:33.008741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T10:59:01.312978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:26:24.130843+0000","last_change":"2024-05-08T05:25:34.057180+0000","last_active":"2024-05-08T05:26:24.130843+0000","last_peered":"2024-05-08T05:26:24.130843+0000","last_clean":"2024-05-08T05:26:24.130843+0000","last_became_active":"2024-05-08T05:25:34.056775+0000","last_became_peered":"2024-05-08T05:25:34.056775+0000","last_unstale":"2024-05-08T05:26:24.130843+0000","last_undegraded":"2024-05-08T05:26:24.130843+0000","last_fullsized":"2024-05-08T05:26:24.130843+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_clean_scrub_stamp":"2024-05-08T05:25:33.008741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T13:13:34.389793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":18,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-08T05:26:23.111992+0000","last_change":"2024-05-08T05:25:34.053102+0000","last_active":"2024-05-08T05:26:23.111992+0000","last_peered":"2024-05-08T05:26:23.111992+0000","last_clean":"2024-05-08T05:26:23.111992+0000","last_became_active":"2024-05-08T05:25:34.052736+0000","last_became_peered":"2024-05-08T05:25:34.052736+0000","last_unstale":"2024-05-08T05:26:23.111992+0000","last_undegraded":"2024-05-08T05:26:23.111992+0000","last_fullsized":"2024-05-08T05:26:23.111992+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_clean_scrub_stamp":"2024-05-08T05:25:33.008741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T13:05:02.665370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:26:24.116560+0000","last_change":"2024-05-08T05:25:34.070073+0000","last_active":"2024-05-08T05:26:24.116560+0000","last_peered":"2024-05-08T05:26:24.116560+0000","last_clean":"2024-05-08T05:26:24.116560+0000","last_became_active":"2024-05-08T05:25:34.069660+0000","last_became_peered":"2024-05-08T05:25:34.069660+0000","last_unstale":"2024-05-08T05:26:24.116560+0000","last_undegraded":"2024-05-08T05:26:24.116560+0000","last_fullsized":"2024-05-08T05:26:24.116560+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_clean_scrub_stamp":"2024-05-08T05:25:33.008741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T12:37:10.599082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":18,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-08T05:26:23.109610+0000","last_change":"2024-05-08T05:25:34.057928+0000","last_active":"2024-05-08T05:26:23.109610+0000","last_peered":"2024-05-08T05:26:23.109610+0000","last_clean":"2024-05-08T05:26:23.109610+0000","last_became_active":"2024-05-08T05:25:34.057538+0000","last_became_peered":"2024-05-08T05:25:34.057538+0000","last_unstale":"2024-05-08T05:26:23.109610+0000","last_undegraded":"2024-05-08T05:26:23.109610+0000","last_fullsized":"2024-05-08T05:26:23.109610+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_clean_scrub_stamp":"2024-05-08T05:25:33.008741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T12:22:49.920889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":18,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-08T05:26:23.114960+0000","last_change":"2024-05-08T05:25:34.055439+0000","last_active":"2024-05-08T05:26:23.114960+0000","last_peered":"2024-05-08T05:26:23.114960+0000","last_clean":"2024-05-08T05:26:23.114960+0000","last_became_active":"2024-05-08T05:25:34.055002+0000","last_became_peered":"2024-05-08T05:25:34.055002+0000","last_unstale":"2024-05-08T05:26:23.114960+0000","last_undegraded":"2024-05-08T05:26:23.114960+0000","last_fullsized":"2024-05-08T05:26:23.114960+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_clean_scrub_stamp":"2024-05-08T05:25:33.008741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T11:29:00.482681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:26:24.121941+0000","last_change":"2024-05-08T05:25:34.058943+0000","last_active":"2024-05-08T05:26:24.121941+0000","last_peered":"2024-05-08T05:26:24.121941+0000","last_clean":"2024-05-08T05:26:24.121941+0000","last_became_active":"2024-05-08T05:25:34.058200+0000","last_became_peered":"2024-05-08T05:25:34.058200+0000","last_unstale":"2024-05-08T05:26:24.121941+0000","last_undegraded":"2024-05-08T05:26:24.121941+0000","last_fullsized":"2024-05-08T05:26:24.121941+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_clean_scrub_stamp":"2024-05-08T05:25:33.008741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T11:13:23.019489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:26:24.113562+0000","last_change":"2024-05-08T05:25:34.053948+0000","last_active":"2024-05-08T05:26:24.113562+0000","last_peered":"2024-05-08T05:26:24.113562+0000","last_clean":"2024-05-08T05:26:24.113562+0000","last_became_active":"2024-05-08T05:25:34.053601+0000","last_became_peered":"2024-05-08T05:25:34.053601+0000","last_unstale":"2024-05-08T05:26:24.113562+0000","last_undegraded":"2024-05-08T05:26:24.113562+0000","last_fullsized":"2024-05-08T05:26:24.113562+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_clean_scrub_stamp":"2024-05-08T05:25:33.008741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T05:50:44.228628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":18,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-08T05:26:23.110087+0000","last_change":"2024-05-08T05:25:34.053167+0000","last_active":"2024-05-08T05:26:23.110087+0000","last_peered":"2024-05-08T05:26:23.110087+0000","last_clean":"2024-05-08T05:26:23.110087+0000","last_became_active":"2024-05-08T05:25:34.052425+0000","last_became_peered":"2024-05-08T05:25:34.052425+0000","last_unstale":"2024-05-08T05:26:23.110087+0000","last_undegraded":"2024-05-08T05:26:23.110087+0000","last_fullsized":"2024-05-08T05:26:23.110087+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_clean_scrub_stamp":"2024-05-08T05:25:33.008741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T10:56:28.599966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":18,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-08T05:26:23.115159+0000","last_change":"2024-05-08T05:25:34.057677+0000","last_active":"2024-05-08T05:26:23.115159+0000","last_peered":"2024-05-08T05:26:23.115159+0000","last_clean":"2024-05-08T05:26:23.115159+0000","last_became_active":"2024-05-08T05:25:34.054800+0000","last_became_peered":"2024-05-08T05:25:34.054800+0000","last_unstale":"2024-05-08T05:26:23.115159+0000","last_undegraded":"2024-05-08T05:26:23.115159+0000","last_fullsized":"2024-05-08T05:26:23.115159+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_clean_scrub_stamp":"2024-05-08T05:25:33.008741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T07:41:55.836901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":18,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-08T05:26:23.111993+0000","last_change":"2024-05-08T05:25:34.051744+0000","last_active":"2024-05-08T05:26:23.111993+0000","last_peered":"2024-05-08T05:26:23.111993+0000","last_clean":"2024-05-08T05:26:23.111993+0000","last_became_active":"2024-05-08T05:25:34.051395+0000","last_became_peered":"2024-05-08T05:25:34.051395+0000","last_unstale":"2024-05-08T05:26:23.111993+0000","last_undegraded":"2024-05-08T05:26:23.111993+0000","last_fullsized":"2024-05-08T05:26:23.111993+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_clean_scrub_stamp":"2024-05-08T05:25:33.008741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T07:58:52.674899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":16,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T05:25:37.091030+0000","last_change":"2024-05-08T05:25:34.053197+0000","last_active":"2024-05-08T05:25:37.091030+0000","last_peered":"2024-05-08T05:25:37.091030+0000","last_clean":"2024-05-08T05:25:37.091030+0000","last_became_active":"2024-05-08T05:25:34.052331+0000","last_became_peered":"2024-05-08T05:25:34.052331+0000","last_unstale":"2024-05-08T05:25:37.091030+0000","last_undegraded":"2024-05-08T05:25:37.091030+0000","last_fullsized":"2024-05-08T05:25:37.091030+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_clean_scrub_stamp":"2024-05-08T05:25:33.008741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T07:19:12.524722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:26:24.129585+0000","last_change":"2024-05-08T05:25:34.070242+0000","last_active":"2024-05-08T05:26:24.129585+0000","last_peered":"2024-05-08T05:26:24.129585+0000","last_clean":"2024-05-08T05:26:24.129585+0000","last_became_active":"2024-05-08T05:25:34.069580+0000","last_became_peered":"2024-05-08T05:25:34.069580+0000","last_unstale":"2024-05-08T05:26:24.129585+0000","last_undegraded":"2024-05-08T05:26:24.129585+0000","last_fullsized":"2024-05-08T05:26:24.129585+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_clean_scrub_stamp":"2024-05-08T05:25:33.008741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T06:33:25.099470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:26:24.129292+0000","last_change":"2024-05-08T05:25:34.067174+0000","last_active":"2024-05-08T05:26:24.129292+0000","last_peered":"2024-05-08T05:26:24.129292+0000","last_clean":"2024-05-08T05:26:24.129292+0000","last_became_active":"2024-05-08T05:25:34.066811+0000","last_became_peered":"2024-05-08T05:25:34.066811+0000","last_unstale":"2024-05-08T05:26:24.129292+0000","last_undegraded":"2024-05-08T05:26:24.129292+0000","last_fullsized":"2024-05-08T05:26:24.129292+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_clean_scrub_stamp":"2024-05-08T05:25:33.008741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T16:17:57.731620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:26:24.112894+0000","last_change":"2024-05-08T05:25:34.064339+0000","last_active":"2024-05-08T05:26:24.112894+0000","last_peered":"2024-05-08T05:26:24.112894+0000","last_clean":"2024-05-08T05:26:24.112894+0000","last_became_active":"2024-05-08T05:25:34.063994+0000","last_became_peered":"2024-05-08T05:25:34.063994+0000","last_unstale":"2024-05-08T05:26:24.112894+0000","last_undegraded":"2024-05-08T05:26:24.112894+0000","last_fullsized":"2024-05-08T05:26:24.112894+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_clean_scrub_stamp":"2024-05-08T05:25:33.008741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T17:09:34.443411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":14,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T05:25:37.091464+0000","last_change":"2024-05-08T05:25:34.073029+0000","last_active":"2024-05-08T05:25:37.091464+0000","last_peered":"2024-05-08T05:25:37.091464+0000","last_clean":"2024-05-08T05:25:37.091464+0000","last_became_active":"2024-05-08T05:25:34.072491+0000","last_became_peered":"2024-05-08T05:25:34.072491+0000","last_unstale":"2024-05-08T05:25:37.091464+0000","last_undegraded":"2024-05-08T05:25:37.091464+0000","last_fullsized":"2024-05-08T05:25:37.091464+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_clean_scrub_stamp":"2024-05-08T05:25:33.008741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T10:22:25.304349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:26:24.132883+0000","last_change":"2024-05-08T05:25:34.061439+0000","last_active":"2024-05-08T05:26:24.132883+0000","last_peered":"2024-05-08T05:26:24.132883+0000","last_clean":"2024-05-08T05:26:24.132883+0000","last_became_active":"2024-05-08T05:25:34.058275+0000","last_became_peered":"2024-05-08T05:25:34.058275+0000","last_unstale":"2024-05-08T05:26:24.132883+0000","last_undegraded":"2024-05-08T05:26:24.132883+0000","last_fullsized":"2024-05-08T05:26:24.132883+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_clean_scrub_stamp":"2024-05-08T05:25:33.008741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T14:04:32.433114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:26:24.116046+0000","last_change":"2024-05-08T05:25:34.061463+0000","last_active":"2024-05-08T05:26:24.116046+0000","last_peered":"2024-05-08T05:26:24.116046+0000","last_clean":"2024-05-08T05:26:24.116046+0000","last_became_active":"2024-05-08T05:25:34.060891+0000","last_became_peered":"2024-05-08T05:25:34.060891+0000","last_unstale":"2024-05-08T05:26:24.116046+0000","last_undegraded":"2024-05-08T05:26:24.116046+0000","last_fullsized":"2024-05-08T05:26:24.116046+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_clean_scrub_stamp":"2024-05-08T05:25:33.008741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T06:42:17.741180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1f","version":"80'9","reported_seq":36,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:26:24.134504+0000","last_change":"2024-05-08T05:25:30.003956+0000","last_active":"2024-05-08T05:26:24.134504+0000","last_peered":"2024-05-08T05:26:24.134504+0000","last_clean":"2024-05-08T05:26:24.134504+0000","last_became_active":"2024-05-08T05:25:30.003229+0000","last_became_peered":"2024-05-08T05:25:30.003229+0000","last_unstale":"2024-05-08T05:26:24.134504+0000","last_undegraded":"2024-05-08T05:26:24.134504+0000","last_fullsized":"2024-05-08T05:26:24.134504+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:28.970901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:28.970901+0000","last_clean_scrub_stamp":"2024-05-08T05:25:28.970901+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T15:45:15.168997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:26:24.123247+0000","last_change":"2024-05-08T05:25:34.064917+0000","last_active":"2024-05-08T05:26:24.123247+0000","last_peered":"2024-05-08T05:26:24.123247+0000","last_clean":"2024-05-08T05:26:24.123247+0000","last_became_active":"2024-05-08T05:25:34.064567+0000","last_became_peered":"2024-05-08T05:25:34.064567+0000","last_unstale":"2024-05-08T05:26:24.123247+0000","last_undegraded":"2024-05-08T05:26:24.123247+0000","last_fullsized":"2024-05-08T05:26:24.123247+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_clean_scrub_stamp":"2024-05-08T05:25:33.008741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T11:15:53.439313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"80'2","reported_seq":28,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:26:24.123860+0000","last_change":"2024-05-08T05:25:30.358617+0000","last_active":"2024-05-08T05:26:24.123860+0000","last_peered":"2024-05-08T05:26:24.123860+0000","last_clean":"2024-05-08T05:26:24.123860+0000","last_became_active":"2024-05-08T05:25:30.358084+0000","last_became_peered":"2024-05-08T05:25:30.358084+0000","last_unstale":"2024-05-08T05:26:24.123860+0000","last_undegraded":"2024-05-08T05:26:24.123860+0000","last_fullsized":"2024-05-08T05:26:24.123860+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:28.970901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:28.970901+0000","last_clean_scrub_stamp":"2024-05-08T05:25:28.970901+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T16:30:36.151645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:26:24.132465+0000","last_change":"2024-05-08T05:25:34.070189+0000","last_active":"2024-05-08T05:26:24.132465+0000","last_peered":"2024-05-08T05:26:24.132465+0000","last_clean":"2024-05-08T05:26:24.132465+0000","last_became_active":"2024-05-08T05:25:34.067644+0000","last_became_peered":"2024-05-08T05:25:34.067644+0000","last_unstale":"2024-05-08T05:26:24.132465+0000","last_undegraded":"2024-05-08T05:26:24.132465+0000","last_fullsized":"2024-05-08T05:26:24.132465+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_clean_scrub_stamp":"2024-05-08T05:25:33.008741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T07:50:03.938036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"80'4","reported_seq":26,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T05:25:52.914525+0000","last_change":"2024-05-08T05:25:30.003291+0000","last_active":"2024-05-08T05:25:52.914525+0000","last_peered":"2024-05-08T05:25:52.914525+0000","last_clean":"2024-05-08T05:25:52.914525+0000","last_became_active":"2024-05-08T05:25:30.002532+0000","last_became_peered":"2024-05-08T05:25:30.002532+0000","last_unstale":"2024-05-08T05:25:52.914525+0000","last_undegraded":"2024-05-08T05:25:52.914525+0000","last_fullsized":"2024-05-08T05:25:52.914525+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:28.970901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:28.970901+0000","last_clean_scrub_stamp":"2024-05-08T05:25:28.970901+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T12:50:21.058321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:26:24.113103+0000","last_change":"2024-05-08T05:25:34.057034+0000","last_active":"2024-05-08T05:26:24.113103+0000","last_peered":"2024-05-08T05:26:24.113103+0000","last_clean":"2024-05-08T05:26:24.113103+0000","last_became_active":"2024-05-08T05:25:34.056718+0000","last_became_peered":"2024-05-08T05:25:34.056718+0000","last_unstale":"2024-05-08T05:26:24.113103+0000","last_undegraded":"2024-05-08T05:26:24.113103+0000","last_fullsized":"2024-05-08T05:26:24.113103+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_clean_scrub_stamp":"2024-05-08T05:25:33.008741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T15:30:38.786889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1c","version":"80'2","reported_seq":28,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:26:24.115905+0000","last_change":"2024-05-08T05:25:29.998007+0000","last_active":"2024-05-08T05:26:24.115905+0000","last_peered":"2024-05-08T05:26:24.115905+0000","last_clean":"2024-05-08T05:26:24.115905+0000","last_became_active":"2024-05-08T05:25:29.997565+0000","last_became_peered":"2024-05-08T05:25:29.997565+0000","last_unstale":"2024-05-08T05:26:24.115905+0000","last_undegraded":"2024-05-08T05:26:24.115905+0000","last_fullsized":"2024-05-08T05:26:24.115905+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:28.970901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:28.970901+0000","last_clean_scrub_stamp":"2024-05-08T05:25:28.970901+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T13:40:09.620809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":16,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T05:25:37.067564+0000","last_change":"2024-05-08T05:25:34.060136+0000","last_active":"2024-05-08T05:25:37.067564+0000","last_peered":"2024-05-08T05:25:37.067564+0000","last_clean":"2024-05-08T05:25:37.067564+0000","last_became_active":"2024-05-08T05:25:34.059782+0000","last_became_peered":"2024-05-08T05:25:34.059782+0000","last_unstale":"2024-05-08T05:25:37.067564+0000","last_undegraded":"2024-05-08T05:25:37.067564+0000","last_fullsized":"2024-05-08T05:25:37.067564+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_clean_scrub_stamp":"2024-05-08T05:25:33.008741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T17:07:33.509305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"80'6","reported_seq":58,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T05:26:20.996884+0000","last_change":"2024-05-08T05:25:30.001356+0000","last_active":"2024-05-08T05:26:20.996884+0000","last_peered":"2024-05-08T05:26:20.996884+0000","last_clean":"2024-05-08T05:26:20.996884+0000","last_became_active":"2024-05-08T05:25:30.000998+0000","last_became_peered":"2024-05-08T05:25:30.000998+0000","last_unstale":"2024-05-08T05:26:20.996884+0000","last_undegraded":"2024-05-08T05:26:20.996884+0000","last_fullsized":"2024-05-08T05:26:20.996884+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:28.970901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:28.970901+0000","last_clean_scrub_stamp":"2024-05-08T05:25:28.970901+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T10:03:27.279982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1013,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":30,"num_read_kb":3,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:26:24.115505+0000","last_change":"2024-05-08T05:25:34.056548+0000","last_active":"2024-05-08T05:26:24.115505+0000","last_peered":"2024-05-08T05:26:24.115505+0000","last_clean":"2024-05-08T05:26:24.115505+0000","last_became_active":"2024-05-08T05:25:34.056216+0000","last_became_peered":"2024-05-08T05:25:34.056216+0000","last_unstale":"2024-05-08T05:26:24.115505+0000","last_undegraded":"2024-05-08T05:26:24.115505+0000","last_fullsized":"2024-05-08T05:26:24.115505+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_clean_scrub_stamp":"2024-05-08T05:25:33.008741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T14:46:05.056610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1a","version":"80'3","reported_seq":27,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-08T05:26:23.109510+0000","last_change":"2024-05-08T05:25:30.009289+0000","last_active":"2024-05-08T05:26:23.109510+0000","last_peered":"2024-05-08T05:26:23.109510+0000","last_clean":"2024-05-08T05:26:23.109510+0000","last_became_active":"2024-05-08T05:25:30.008856+0000","last_became_peered":"2024-05-08T05:25:30.008856+0000","last_unstale":"2024-05-08T05:26:23.109510+0000","last_undegraded":"2024-05-08T05:26:23.109510+0000","last_fullsized":"2024-05-08T05:26:23.109510+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:28.970901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:28.970901+0000","last_clean_scrub_stamp":"2024-05-08T05:25:28.970901+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T10:49:55.857415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":16,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T05:25:37.067328+0000","last_change":"2024-05-08T05:25:34.062532+0000","last_active":"2024-05-08T05:25:37.067328+0000","last_peered":"2024-05-08T05:25:37.067328+0000","last_clean":"2024-05-08T05:25:37.067328+0000","last_became_active":"2024-05-08T05:25:34.062246+0000","last_became_peered":"2024-05-08T05:25:34.062246+0000","last_unstale":"2024-05-08T05:25:37.067328+0000","last_undegraded":"2024-05-08T05:25:37.067328+0000","last_fullsized":"2024-05-08T05:25:37.067328+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_clean_scrub_stamp":"2024-05-08T05:25:33.008741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T07:35:49.149411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"80'2","reported_seq":24,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T05:25:52.921647+0000","last_change":"2024-05-08T05:25:30.014336+0000","last_active":"2024-05-08T05:25:52.921647+0000","last_peered":"2024-05-08T05:25:52.921647+0000","last_clean":"2024-05-08T05:25:52.921647+0000","last_became_active":"2024-05-08T05:25:30.012147+0000","last_became_peered":"2024-05-08T05:25:30.012147+0000","last_unstale":"2024-05-08T05:25:52.921647+0000","last_undegraded":"2024-05-08T05:25:52.921647+0000","last_fullsized":"2024-05-08T05:25:52.921647+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:28.970901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:28.970901+0000","last_clean_scrub_stamp":"2024-05-08T05:25:28.970901+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T07:48:20.477581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:26:24.120746+0000","last_change":"2024-05-08T05:25:34.058947+0000","last_active":"2024-05-08T05:26:24.120746+0000","last_peered":"2024-05-08T05:26:24.120746+0000","last_clean":"2024-05-08T05:26:24.120746+0000","last_became_active":"2024-05-08T05:25:34.058626+0000","last_became_peered":"2024-05-08T05:25:34.058626+0000","last_unstale":"2024-05-08T05:26:24.120746+0000","last_undegraded":"2024-05-08T05:26:24.120746+0000","last_fullsized":"2024-05-08T05:26:24.120746+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_clean_scrub_stamp":"2024-05-08T05:25:33.008741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T12:55:07.742707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"80'1","reported_seq":23,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T05:25:37.067314+0000","last_change":"2024-05-08T05:25:29.999201+0000","last_active":"2024-05-08T05:25:37.067314+0000","last_peered":"2024-05-08T05:25:37.067314+0000","last_clean":"2024-05-08T05:25:37.067314+0000","last_became_active":"2024-05-08T05:25:29.998819+0000","last_became_peered":"2024-05-08T05:25:29.998819+0000","last_unstale":"2024-05-08T05:25:37.067314+0000","last_undegraded":"2024-05-08T05:25:37.067314+0000","last_fullsized":"2024-05-08T05:25:37.067314+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:28.970901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:28.970901+0000","last_clean_scrub_stamp":"2024-05-08T05:25:28.970901+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T09:00:02.831877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:26:24.130587+0000","last_change":"2024-05-08T05:25:34.063770+0000","last_active":"2024-05-08T05:26:24.130587+0000","last_peered":"2024-05-08T05:26:24.130587+0000","last_clean":"2024-05-08T05:26:24.130587+0000","last_became_active":"2024-05-08T05:25:34.061591+0000","last_became_peered":"2024-05-08T05:25:34.061591+0000","last_unstale":"2024-05-08T05:26:24.130587+0000","last_undegraded":"2024-05-08T05:26:24.130587+0000","last_fullsized":"2024-05-08T05:26:24.130587+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_clean_scrub_stamp":"2024-05-08T05:25:33.008741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T16:51:06.593857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"80'3","reported_seq":55,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-08T05:26:23.109884+0000","last_change":"2024-05-08T05:25:30.005678+0000","last_active":"2024-05-08T05:26:23.109884+0000","last_peered":"2024-05-08T05:26:23.109884+0000","last_clean":"2024-05-08T05:26:23.109884+0000","last_became_active":"2024-05-08T05:25:30.005218+0000","last_became_peered":"2024-05-08T05:25:30.005218+0000","last_unstale":"2024-05-08T05:26:23.109884+0000","last_undegraded":"2024-05-08T05:26:23.109884+0000","last_fullsized":"2024-05-08T05:26:23.109884+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:28.970901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:28.970901+0000","last_clean_scrub_stamp":"2024-05-08T05:25:28.970901+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T11:44:56.720663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":28,"num_read_kb":28,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:26:24.113443+0000","last_change":"2024-05-08T05:25:34.058640+0000","last_active":"2024-05-08T05:26:24.113443+0000","last_peered":"2024-05-08T05:26:24.113443+0000","last_clean":"2024-05-08T05:26:24.113443+0000","last_became_active":"2024-05-08T05:25:34.058332+0000","last_became_peered":"2024-05-08T05:25:34.058332+0000","last_unstale":"2024-05-08T05:26:24.113443+0000","last_undegraded":"2024-05-08T05:26:24.113443+0000","last_fullsized":"2024-05-08T05:26:24.113443+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_clean_scrub_stamp":"2024-05-08T05:25:33.008741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T09:21:44.273684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"80'2","reported_seq":26,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-08T05:26:23.115396+0000","last_change":"2024-05-08T05:25:30.000229+0000","last_active":"2024-05-08T05:26:23.115396+0000","last_peered":"2024-05-08T05:26:23.115396+0000","last_clean":"2024-05-08T05:26:23.115396+0000","last_became_active":"2024-05-08T05:25:29.999888+0000","last_became_peered":"2024-05-08T05:25:29.999888+0000","last_unstale":"2024-05-08T05:26:23.115396+0000","last_undegraded":"2024-05-08T05:26:23.115396+0000","last_fullsized":"2024-05-08T05:26:23.115396+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:28.970901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:28.970901+0000","last_clean_scrub_stamp":"2024-05-08T05:25:28.970901+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T10:28:02.849791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:26:24.132402+0000","last_change":"2024-05-08T05:25:34.069600+0000","last_active":"2024-05-08T05:26:24.132402+0000","last_peered":"2024-05-08T05:26:24.132402+0000","last_clean":"2024-05-08T05:26:24.132402+0000","last_became_active":"2024-05-08T05:25:34.069055+0000","last_became_peered":"2024-05-08T05:25:34.069055+0000","last_unstale":"2024-05-08T05:26:24.132402+0000","last_undegraded":"2024-05-08T05:26:24.132402+0000","last_fullsized":"2024-05-08T05:26:24.132402+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_clean_scrub_stamp":"2024-05-08T05:25:33.008741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T10:22:31.166719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"80'4","reported_seq":27,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T05:25:51.910553+0000","last_change":"2024-05-08T05:25:30.360911+0000","last_active":"2024-05-08T05:25:51.910553+0000","last_peered":"2024-05-08T05:25:51.910553+0000","last_clean":"2024-05-08T05:25:51.910553+0000","last_became_active":"2024-05-08T05:25:30.360544+0000","last_became_peered":"2024-05-08T05:25:30.360544+0000","last_unstale":"2024-05-08T05:25:51.910553+0000","last_undegraded":"2024-05-08T05:25:51.910553+0000","last_fullsized":"2024-05-08T05:25:51.910553+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:28.970901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:28.970901+0000","last_clean_scrub_stamp":"2024-05-08T05:25:28.970901+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T17:03:10.633420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:26:24.113116+0000","last_change":"2024-05-08T05:25:34.058259+0000","last_active":"2024-05-08T05:26:24.113116+0000","last_peered":"2024-05-08T05:26:24.113116+0000","last_clean":"2024-05-08T05:26:24.113116+0000","last_became_active":"2024-05-08T05:25:34.057912+0000","last_became_peered":"2024-05-08T05:25:34.057912+0000","last_unstale":"2024-05-08T05:26:24.113116+0000","last_undegraded":"2024-05-08T05:26:24.113116+0000","last_fullsized":"2024-05-08T05:26:24.113116+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_clean_scrub_stamp":"2024-05-08T05:25:33.008741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T14:58:49.311769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"80'29","reported_seq":117,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-08T05:26:23.109813+0000","last_change":"2024-05-08T05:25:30.001177+0000","last_active":"2024-05-08T05:26:23.109813+0000","last_peered":"2024-05-08T05:26:23.109813+0000","last_clean":"2024-05-08T05:26:23.109813+0000","last_became_active":"2024-05-08T05:25:30.000769+0000","last_became_peered":"2024-05-08T05:25:30.000769+0000","last_unstale":"2024-05-08T05:26:23.109813+0000","last_undegraded":"2024-05-08T05:26:23.109813+0000","last_fullsized":"2024-05-08T05:26:23.109813+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:28.970901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:28.970901+0000","last_clean_scrub_stamp":"2024-05-08T05:25:28.970901+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T14:40:35.540270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58815,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":64,"num_read_kb":89,"num_write":30,"num_write_kb":67,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:26:24.115917+0000","last_change":"2024-05-08T05:25:34.053366+0000","last_active":"2024-05-08T05:26:24.115917+0000","last_peered":"2024-05-08T05:26:24.115917+0000","last_clean":"2024-05-08T05:26:24.115917+0000","last_became_active":"2024-05-08T05:25:34.052485+0000","last_became_peered":"2024-05-08T05:25:34.052485+0000","last_unstale":"2024-05-08T05:26:24.115917+0000","last_undegraded":"2024-05-08T05:26:24.115917+0000","last_fullsized":"2024-05-08T05:26:24.115917+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_clean_scrub_stamp":"2024-05-08T05:25:33.008741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T07:35:05.603319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"80'6","reported_seq":33,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:26:24.115359+0000","last_change":"2024-05-08T05:25:30.010453+0000","last_active":"2024-05-08T05:26:24.115359+0000","last_peered":"2024-05-08T05:26:24.115359+0000","last_clean":"2024-05-08T05:26:24.115359+0000","last_became_active":"2024-05-08T05:25:30.010032+0000","last_became_peered":"2024-05-08T05:25:30.010032+0000","last_unstale":"2024-05-08T05:26:24.115359+0000","last_undegraded":"2024-05-08T05:26:24.115359+0000","last_fullsized":"2024-05-08T05:26:24.115359+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:28.970901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:28.970901+0000","last_clean_scrub_stamp":"2024-05-08T05:25:28.970901+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T16:34:35.052481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":16,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T05:25:37.090144+0000","last_change":"2024-05-08T05:25:34.059629+0000","last_active":"2024-05-08T05:25:37.090144+0000","last_peered":"2024-05-08T05:25:37.090144+0000","last_clean":"2024-05-08T05:25:37.090144+0000","last_became_active":"2024-05-08T05:25:34.059181+0000","last_became_peered":"2024-05-08T05:25:34.059181+0000","last_unstale":"2024-05-08T05:25:37.090144+0000","last_undegraded":"2024-05-08T05:25:37.090144+0000","last_fullsized":"2024-05-08T05:25:37.090144+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_clean_scrub_stamp":"2024-05-08T05:25:33.008741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T09:00:40.479050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"80'3","reported_seq":25,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T05:25:51.911921+0000","last_change":"2024-05-08T05:25:30.009768+0000","last_active":"2024-05-08T05:25:51.911921+0000","last_peered":"2024-05-08T05:25:51.911921+0000","last_clean":"2024-05-08T05:25:51.911921+0000","last_became_active":"2024-05-08T05:25:30.009385+0000","last_became_peered":"2024-05-08T05:25:30.009385+0000","last_unstale":"2024-05-08T05:25:51.911921+0000","last_undegraded":"2024-05-08T05:25:51.911921+0000","last_fullsized":"2024-05-08T05:25:51.911921+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:28.970901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:28.970901+0000","last_clean_scrub_stamp":"2024-05-08T05:25:28.970901+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T07:19:19.556003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":18,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-08T05:26:23.115174+0000","last_change":"2024-05-08T05:25:34.055704+0000","last_active":"2024-05-08T05:26:23.115174+0000","last_peered":"2024-05-08T05:26:23.115174+0000","last_clean":"2024-05-08T05:26:23.115174+0000","last_became_active":"2024-05-08T05:25:34.055339+0000","last_became_peered":"2024-05-08T05:25:34.055339+0000","last_unstale":"2024-05-08T05:26:23.115174+0000","last_undegraded":"2024-05-08T05:26:23.115174+0000","last_fullsized":"2024-05-08T05:26:23.115174+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_clean_scrub_stamp":"2024-05-08T05:25:33.008741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T07:21:52.579094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"80'4","reported_seq":59,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-08T05:26:23.111229+0000","last_change":"2024-05-08T05:25:29.998631+0000","last_active":"2024-05-08T05:26:23.111229+0000","last_peered":"2024-05-08T05:26:23.111229+0000","last_clean":"2024-05-08T05:26:23.111229+0000","last_became_active":"2024-05-08T05:25:29.998216+0000","last_became_peered":"2024-05-08T05:25:29.998216+0000","last_unstale":"2024-05-08T05:26:23.111229+0000","last_undegraded":"2024-05-08T05:26:23.111229+0000","last_fullsized":"2024-05-08T05:26:23.111229+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:28.970901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:28.970901+0000","last_clean_scrub_stamp":"2024-05-08T05:25:28.970901+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T14:16:58.252604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":979,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":32,"num_read_kb":4,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":18,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-08T05:26:23.114878+0000","last_change":"2024-05-08T05:25:34.053216+0000","last_active":"2024-05-08T05:26:23.114878+0000","last_peered":"2024-05-08T05:26:23.114878+0000","last_clean":"2024-05-08T05:26:23.114878+0000","last_became_active":"2024-05-08T05:25:34.052908+0000","last_became_peered":"2024-05-08T05:25:34.052908+0000","last_unstale":"2024-05-08T05:26:23.114878+0000","last_undegraded":"2024-05-08T05:26:23.114878+0000","last_fullsized":"2024-05-08T05:26:23.114878+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_clean_scrub_stamp":"2024-05-08T05:25:33.008741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T13:01:42.574200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"80'15","reported_seq":42,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:26:24.116038+0000","last_change":"2024-05-08T05:25:30.356349+0000","last_active":"2024-05-08T05:26:24.116038+0000","last_peered":"2024-05-08T05:26:24.116038+0000","last_clean":"2024-05-08T05:26:24.116038+0000","last_became_active":"2024-05-08T05:25:30.355892+0000","last_became_peered":"2024-05-08T05:25:30.355892+0000","last_unstale":"2024-05-08T05:26:24.116038+0000","last_undegraded":"2024-05-08T05:26:24.116038+0000","last_fullsized":"2024-05-08T05:26:24.116038+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:28.970901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:28.970901+0000","last_clean_scrub_stamp":"2024-05-08T05:25:28.970901+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T16:54:22.322606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":16,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T05:25:37.067066+0000","last_change":"2024-05-08T05:25:34.062254+0000","last_active":"2024-05-08T05:25:37.067066+0000","last_peered":"2024-05-08T05:25:37.067066+0000","last_clean":"2024-05-08T05:25:37.067066+0000","last_became_active":"2024-05-08T05:25:34.061928+0000","last_became_peered":"2024-05-08T05:25:34.061928+0000","last_unstale":"2024-05-08T05:25:37.067066+0000","last_undegraded":"2024-05-08T05:25:37.067066+0000","last_fullsized":"2024-05-08T05:25:37.067066+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_clean_scrub_stamp":"2024-05-08T05:25:33.008741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T14:58:17.135661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"80'2","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:26:24.116364+0000","last_change":"2024-05-08T05:25:30.001434+0000","last_active":"2024-05-08T05:26:24.116364+0000","last_peered":"2024-05-08T05:26:24.116364+0000","last_clean":"2024-05-08T05:26:24.116364+0000","last_became_active":"2024-05-08T05:25:30.000900+0000","last_became_peered":"2024-05-08T05:25:30.000900+0000","last_unstale":"2024-05-08T05:26:24.116364+0000","last_undegraded":"2024-05-08T05:26:24.116364+0000","last_fullsized":"2024-05-08T05:26:24.116364+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:28.970901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:28.970901+0000","last_clean_scrub_stamp":"2024-05-08T05:25:28.970901+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T11:47:18.031222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":14,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T05:25:37.090991+0000","last_change":"2024-05-08T05:25:34.057101+0000","last_active":"2024-05-08T05:25:37.090991+0000","last_peered":"2024-05-08T05:25:37.090991+0000","last_clean":"2024-05-08T05:25:37.090991+0000","last_became_active":"2024-05-08T05:25:34.056742+0000","last_became_peered":"2024-05-08T05:25:34.056742+0000","last_unstale":"2024-05-08T05:25:37.090991+0000","last_undegraded":"2024-05-08T05:25:37.090991+0000","last_fullsized":"2024-05-08T05:25:37.090991+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_clean_scrub_stamp":"2024-05-08T05:25:33.008741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T14:19:22.997586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:26:24.133808+0000","last_change":"2024-05-08T05:25:30.359474+0000","last_active":"2024-05-08T05:26:24.133808+0000","last_peered":"2024-05-08T05:26:24.133808+0000","last_clean":"2024-05-08T05:26:24.133808+0000","last_became_active":"2024-05-08T05:25:30.358971+0000","last_became_peered":"2024-05-08T05:25:30.358971+0000","last_unstale":"2024-05-08T05:26:24.133808+0000","last_undegraded":"2024-05-08T05:26:24.133808+0000","last_fullsized":"2024-05-08T05:26:24.133808+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:28.970901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:28.970901+0000","last_clean_scrub_stamp":"2024-05-08T05:25:28.970901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T12:51:42.239112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"80'1","reported_seq":19,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-08T05:26:23.109743+0000","last_change":"2024-05-08T05:25:34.061014+0000","last_active":"2024-05-08T05:26:23.109743+0000","last_peered":"2024-05-08T05:26:23.109743+0000","last_clean":"2024-05-08T05:26:23.109743+0000","last_became_active":"2024-05-08T05:25:34.060682+0000","last_became_peered":"2024-05-08T05:25:34.060682+0000","last_unstale":"2024-05-08T05:26:23.109743+0000","last_undegraded":"2024-05-08T05:26:23.109743+0000","last_fullsized":"2024-05-08T05:26:23.109743+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_clean_scrub_stamp":"2024-05-08T05:25:33.008741+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T13:19:48.652257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"80'1","reported_seq":25,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-08T05:26:23.115053+0000","last_change":"2024-05-08T05:25:30.009360+0000","last_active":"2024-05-08T05:26:23.115053+0000","last_peered":"2024-05-08T05:26:23.115053+0000","last_clean":"2024-05-08T05:26:23.115053+0000","last_became_active":"2024-05-08T05:25:30.008806+0000","last_became_peered":"2024-05-08T05:25:30.008806+0000","last_unstale":"2024-05-08T05:26:23.115053+0000","last_undegraded":"2024-05-08T05:26:23.115053+0000","last_fullsized":"2024-05-08T05:26:23.115053+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:28.970901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:28.970901+0000","last_clean_scrub_stamp":"2024-05-08T05:25:28.970901+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T11:19:45.905803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":18,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-08T05:26:23.109565+0000","last_change":"2024-05-08T05:25:34.065415+0000","last_active":"2024-05-08T05:26:23.109565+0000","last_peered":"2024-05-08T05:26:23.109565+0000","last_clean":"2024-05-08T05:26:23.109565+0000","last_became_active":"2024-05-08T05:25:34.065017+0000","last_became_peered":"2024-05-08T05:25:34.065017+0000","last_unstale":"2024-05-08T05:26:23.109565+0000","last_undegraded":"2024-05-08T05:26:23.109565+0000","last_fullsized":"2024-05-08T05:26:23.109565+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_clean_scrub_stamp":"2024-05-08T05:25:33.008741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T14:46:34.518792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":16,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T05:25:37.067507+0000","last_change":"2024-05-08T05:25:34.057807+0000","last_active":"2024-05-08T05:25:37.067507+0000","last_peered":"2024-05-08T05:25:37.067507+0000","last_clean":"2024-05-08T05:25:37.067507+0000","last_became_active":"2024-05-08T05:25:34.057375+0000","last_became_peered":"2024-05-08T05:25:34.057375+0000","last_unstale":"2024-05-08T05:25:37.067507+0000","last_undegraded":"2024-05-08T05:25:37.067507+0000","last_fullsized":"2024-05-08T05:25:37.067507+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_clean_scrub_stamp":"2024-05-08T05:25:33.008741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T15:11:22.255000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"80'4","reported_seq":53,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T05:26:21.014778+0000","last_change":"2024-05-08T05:25:30.356178+0000","last_active":"2024-05-08T05:26:21.014778+0000","last_peered":"2024-05-08T05:26:21.014778+0000","last_clean":"2024-05-08T05:26:21.014778+0000","last_became_active":"2024-05-08T05:25:30.355750+0000","last_became_peered":"2024-05-08T05:25:30.355750+0000","last_unstale":"2024-05-08T05:26:21.014778+0000","last_undegraded":"2024-05-08T05:26:21.014778+0000","last_fullsized":"2024-05-08T05:26:21.014778+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:28.970901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:28.970901+0000","last_clean_scrub_stamp":"2024-05-08T05:25:28.970901+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T05:57:35.174274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":27,"num_read_kb":27,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:26:24.121720+0000","last_change":"2024-05-08T05:25:34.068189+0000","last_active":"2024-05-08T05:26:24.121720+0000","last_peered":"2024-05-08T05:26:24.121720+0000","last_clean":"2024-05-08T05:26:24.121720+0000","last_became_active":"2024-05-08T05:25:34.064398+0000","last_became_peered":"2024-05-08T05:25:34.064398+0000","last_unstale":"2024-05-08T05:26:24.121720+0000","last_undegraded":"2024-05-08T05:26:24.121720+0000","last_fullsized":"2024-05-08T05:26:24.121720+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_clean_scrub_stamp":"2024-05-08T05:25:33.008741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T10:27:31.050126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"80'3","reported_seq":29,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-08T05:26:23.111440+0000","last_change":"2024-05-08T05:25:30.005110+0000","last_active":"2024-05-08T05:26:23.111440+0000","last_peered":"2024-05-08T05:26:23.111440+0000","last_clean":"2024-05-08T05:26:23.111440+0000","last_became_active":"2024-05-08T05:25:30.004703+0000","last_became_peered":"2024-05-08T05:25:30.004703+0000","last_unstale":"2024-05-08T05:26:23.111440+0000","last_undegraded":"2024-05-08T05:26:23.111440+0000","last_fullsized":"2024-05-08T05:26:23.111440+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:28.970901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:28.970901+0000","last_clean_scrub_stamp":"2024-05-08T05:25:28.970901+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T12:49:21.174417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"21'92","reported_seq":98,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-08T05:26:23.114962+0000","last_change":"2024-05-08T05:23:59.731023+0000","last_active":"2024-05-08T05:26:23.114962+0000","last_peered":"2024-05-08T05:26:23.114962+0000","last_clean":"2024-05-08T05:26:23.114962+0000","last_became_active":"2024-05-08T05:23:59.725321+0000","last_became_peered":"2024-05-08T05:23:59.725321+0000","last_unstale":"2024-05-08T05:26:23.114962+0000","last_undegraded":"2024-05-08T05:26:23.114962+0000","last_fullsized":"2024-05-08T05:26:23.114962+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:20:09.357011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:20:09.357011+0000","last_clean_scrub_stamp":"2024-05-08T05:20:09.357011+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T09:50:58.729815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":16,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T05:25:37.087985+0000","last_change":"2024-05-08T05:25:34.048089+0000","last_active":"2024-05-08T05:25:37.087985+0000","last_peered":"2024-05-08T05:25:37.087985+0000","last_clean":"2024-05-08T05:25:37.087985+0000","last_became_active":"2024-05-08T05:25:34.047422+0000","last_became_peered":"2024-05-08T05:25:34.047422+0000","last_unstale":"2024-05-08T05:25:37.087985+0000","last_undegraded":"2024-05-08T05:25:37.087985+0000","last_fullsized":"2024-05-08T05:25:37.087985+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_clean_scrub_stamp":"2024-05-08T05:25:33.008741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T08:48:52.201861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"80'3","reported_seq":27,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-08T05:26:23.115169+0000","last_change":"2024-05-08T05:25:29.999659+0000","last_active":"2024-05-08T05:26:23.115169+0000","last_peered":"2024-05-08T05:26:23.115169+0000","last_clean":"2024-05-08T05:26:23.115169+0000","last_became_active":"2024-05-08T05:25:29.999299+0000","last_became_peered":"2024-05-08T05:25:29.999299+0000","last_unstale":"2024-05-08T05:26:23.115169+0000","last_undegraded":"2024-05-08T05:26:23.115169+0000","last_fullsized":"2024-05-08T05:26:23.115169+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:28.970901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:28.970901+0000","last_clean_scrub_stamp":"2024-05-08T05:25:28.970901+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T11:20:16.513402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"80'1","reported_seq":28,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:26:24.116043+0000","last_change":"2024-05-08T05:25:30.360940+0000","last_active":"2024-05-08T05:26:24.116043+0000","last_peered":"2024-05-08T05:26:24.116043+0000","last_clean":"2024-05-08T05:26:24.116043+0000","last_became_active":"2024-05-08T05:25:30.360507+0000","last_became_peered":"2024-05-08T05:25:30.360507+0000","last_unstale":"2024-05-08T05:26:24.116043+0000","last_undegraded":"2024-05-08T05:26:24.116043+0000","last_fullsized":"2024-05-08T05:26:24.116043+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:28.970901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:28.970901+0000","last_clean_scrub_stamp":"2024-05-08T05:25:28.970901+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T06:49:39.271211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":16,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T05:25:37.090273+0000","last_change":"2024-05-08T05:25:34.056952+0000","last_active":"2024-05-08T05:25:37.090273+0000","last_peered":"2024-05-08T05:25:37.090273+0000","last_clean":"2024-05-08T05:25:37.090273+0000","last_became_active":"2024-05-08T05:25:34.056495+0000","last_became_peered":"2024-05-08T05:25:34.056495+0000","last_unstale":"2024-05-08T05:25:37.090273+0000","last_undegraded":"2024-05-08T05:25:37.090273+0000","last_fullsized":"2024-05-08T05:25:37.090273+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_clean_scrub_stamp":"2024-05-08T05:25:33.008741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T09:35:22.540178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"81'11","reported_seq":37,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:26:24.133014+0000","last_change":"2024-05-08T05:25:30.008967+0000","last_active":"2024-05-08T05:26:24.133014+0000","last_peered":"2024-05-08T05:26:24.133014+0000","last_clean":"2024-05-08T05:26:24.133014+0000","last_became_active":"2024-05-08T05:25:30.007542+0000","last_became_peered":"2024-05-08T05:25:30.007542+0000","last_unstale":"2024-05-08T05:26:24.133014+0000","last_undegraded":"2024-05-08T05:26:24.133014+0000","last_fullsized":"2024-05-08T05:26:24.133014+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:28.970901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:28.970901+0000","last_clean_scrub_stamp":"2024-05-08T05:25:28.970901+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T05:29:30.191842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:26:24.123545+0000","last_change":"2024-05-08T05:25:34.054334+0000","last_active":"2024-05-08T05:26:24.123545+0000","last_peered":"2024-05-08T05:26:24.123545+0000","last_clean":"2024-05-08T05:26:24.123545+0000","last_became_active":"2024-05-08T05:25:34.053989+0000","last_became_peered":"2024-05-08T05:25:34.053989+0000","last_unstale":"2024-05-08T05:26:24.123545+0000","last_undegraded":"2024-05-08T05:26:24.123545+0000","last_fullsized":"2024-05-08T05:26:24.123545+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_clean_scrub_stamp":"2024-05-08T05:25:33.008741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T09:03:25.683445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"80'4","reported_seq":28,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-08T05:26:23.111498+0000","last_change":"2024-05-08T05:25:30.007144+0000","last_active":"2024-05-08T05:26:23.111498+0000","last_peered":"2024-05-08T05:26:23.111498+0000","last_clean":"2024-05-08T05:26:23.111498+0000","last_became_active":"2024-05-08T05:25:30.006878+0000","last_became_peered":"2024-05-08T05:25:30.006878+0000","last_unstale":"2024-05-08T05:26:23.111498+0000","last_undegraded":"2024-05-08T05:26:23.111498+0000","last_fullsized":"2024-05-08T05:26:23.111498+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:28.970901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:28.970901+0000","last_clean_scrub_stamp":"2024-05-08T05:25:28.970901+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T07:06:35.573001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:26:24.131455+0000","last_change":"2024-05-08T05:25:34.073744+0000","last_active":"2024-05-08T05:26:24.131455+0000","last_peered":"2024-05-08T05:26:24.131455+0000","last_clean":"2024-05-08T05:26:24.131455+0000","last_became_active":"2024-05-08T05:25:34.073368+0000","last_became_peered":"2024-05-08T05:25:34.073368+0000","last_unstale":"2024-05-08T05:26:24.131455+0000","last_undegraded":"2024-05-08T05:26:24.131455+0000","last_fullsized":"2024-05-08T05:26:24.131455+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_clean_scrub_stamp":"2024-05-08T05:25:33.008741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T10:43:31.480745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"80'2","reported_seq":28,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:26:24.112913+0000","last_change":"2024-05-08T05:25:30.356584+0000","last_active":"2024-05-08T05:26:24.112913+0000","last_peered":"2024-05-08T05:26:24.112913+0000","last_clean":"2024-05-08T05:26:24.112913+0000","last_became_active":"2024-05-08T05:25:30.356203+0000","last_became_peered":"2024-05-08T05:25:30.356203+0000","last_unstale":"2024-05-08T05:26:24.112913+0000","last_undegraded":"2024-05-08T05:26:24.112913+0000","last_fullsized":"2024-05-08T05:26:24.112913+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:28.970901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:28.970901+0000","last_clean_scrub_stamp":"2024-05-08T05:25:28.970901+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T14:35:21.193856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:26:24.115733+0000","last_change":"2024-05-08T05:25:34.053168+0000","last_active":"2024-05-08T05:26:24.115733+0000","last_peered":"2024-05-08T05:26:24.115733+0000","last_clean":"2024-05-08T05:26:24.115733+0000","last_became_active":"2024-05-08T05:25:34.052875+0000","last_became_peered":"2024-05-08T05:25:34.052875+0000","last_unstale":"2024-05-08T05:26:24.115733+0000","last_undegraded":"2024-05-08T05:26:24.115733+0000","last_fullsized":"2024-05-08T05:26:24.115733+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_clean_scrub_stamp":"2024-05-08T05:25:33.008741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T07:38:40.129212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"80'3","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:26:24.121700+0000","last_change":"2024-05-08T05:25:30.009113+0000","last_active":"2024-05-08T05:26:24.121700+0000","last_peered":"2024-05-08T05:26:24.121700+0000","last_clean":"2024-05-08T05:26:24.121700+0000","last_became_active":"2024-05-08T05:25:30.007605+0000","last_became_peered":"2024-05-08T05:25:30.007605+0000","last_unstale":"2024-05-08T05:26:24.121700+0000","last_undegraded":"2024-05-08T05:26:24.121700+0000","last_fullsized":"2024-05-08T05:26:24.121700+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:28.970901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:28.970901+0000","last_clean_scrub_stamp":"2024-05-08T05:25:28.970901+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T10:06:05.177516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":14,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T05:25:37.090444+0000","last_change":"2024-05-08T05:25:34.072765+0000","last_active":"2024-05-08T05:25:37.090444+0000","last_peered":"2024-05-08T05:25:37.090444+0000","last_clean":"2024-05-08T05:25:37.090444+0000","last_became_active":"2024-05-08T05:25:34.072381+0000","last_became_peered":"2024-05-08T05:25:34.072381+0000","last_unstale":"2024-05-08T05:25:37.090444+0000","last_undegraded":"2024-05-08T05:25:37.090444+0000","last_fullsized":"2024-05-08T05:25:37.090444+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_clean_scrub_stamp":"2024-05-08T05:25:33.008741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T11:55:21.046126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"80'1","reported_seq":23,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T05:25:37.086769+0000","last_change":"2024-05-08T05:25:30.010230+0000","last_active":"2024-05-08T05:25:37.086769+0000","last_peered":"2024-05-08T05:25:37.086769+0000","last_clean":"2024-05-08T05:25:37.086769+0000","last_became_active":"2024-05-08T05:25:30.009852+0000","last_became_peered":"2024-05-08T05:25:30.009852+0000","last_unstale":"2024-05-08T05:25:37.086769+0000","last_undegraded":"2024-05-08T05:25:37.086769+0000","last_fullsized":"2024-05-08T05:25:37.086769+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:28.970901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:28.970901+0000","last_clean_scrub_stamp":"2024-05-08T05:25:28.970901+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T15:25:13.950366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:26:24.122711+0000","last_change":"2024-05-08T05:25:34.071097+0000","last_active":"2024-05-08T05:26:24.122711+0000","last_peered":"2024-05-08T05:26:24.122711+0000","last_clean":"2024-05-08T05:26:24.122711+0000","last_became_active":"2024-05-08T05:25:34.070635+0000","last_became_peered":"2024-05-08T05:25:34.070635+0000","last_unstale":"2024-05-08T05:26:24.122711+0000","last_undegraded":"2024-05-08T05:26:24.122711+0000","last_fullsized":"2024-05-08T05:26:24.122711+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_clean_scrub_stamp":"2024-05-08T05:25:33.008741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T13:33:17.217958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"80'4","reported_seq":31,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:26:24.116671+0000","last_change":"2024-05-08T05:25:30.002043+0000","last_active":"2024-05-08T05:26:24.116671+0000","last_peered":"2024-05-08T05:26:24.116671+0000","last_clean":"2024-05-08T05:26:24.116671+0000","last_became_active":"2024-05-08T05:25:30.001624+0000","last_became_peered":"2024-05-08T05:25:30.001624+0000","last_unstale":"2024-05-08T05:26:24.116671+0000","last_undegraded":"2024-05-08T05:26:24.116671+0000","last_fullsized":"2024-05-08T05:26:24.116671+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:28.970901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:28.970901+0000","last_clean_scrub_stamp":"2024-05-08T05:25:28.970901+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T07:20:34.740005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":18,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-08T05:26:23.115188+0000","last_change":"2024-05-08T05:25:34.057883+0000","last_active":"2024-05-08T05:26:23.115188+0000","last_peered":"2024-05-08T05:26:23.115188+0000","last_clean":"2024-05-08T05:26:23.115188+0000","last_became_active":"2024-05-08T05:25:34.056651+0000","last_became_peered":"2024-05-08T05:25:34.056651+0000","last_unstale":"2024-05-08T05:26:23.115188+0000","last_undegraded":"2024-05-08T05:26:23.115188+0000","last_fullsized":"2024-05-08T05:26:23.115188+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_clean_scrub_stamp":"2024-05-08T05:25:33.008741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T16:52:46.598847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"80'3","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:26:24.116021+0000","last_change":"2024-05-08T05:25:30.356166+0000","last_active":"2024-05-08T05:26:24.116021+0000","last_peered":"2024-05-08T05:26:24.116021+0000","last_clean":"2024-05-08T05:26:24.116021+0000","last_became_active":"2024-05-08T05:25:30.355730+0000","last_became_peered":"2024-05-08T05:25:30.355730+0000","last_unstale":"2024-05-08T05:26:24.116021+0000","last_undegraded":"2024-05-08T05:26:24.116021+0000","last_fullsized":"2024-05-08T05:26:24.116021+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:28.970901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:28.970901+0000","last_clean_scrub_stamp":"2024-05-08T05:25:28.970901+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T05:47:47.743725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":18,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-08T05:26:23.115321+0000","last_change":"2024-05-08T05:25:34.058005+0000","last_active":"2024-05-08T05:26:23.115321+0000","last_peered":"2024-05-08T05:26:23.115321+0000","last_clean":"2024-05-08T05:26:23.115321+0000","last_became_active":"2024-05-08T05:25:34.056319+0000","last_became_peered":"2024-05-08T05:25:34.056319+0000","last_unstale":"2024-05-08T05:26:23.115321+0000","last_undegraded":"2024-05-08T05:26:23.115321+0000","last_fullsized":"2024-05-08T05:26:23.115321+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_clean_scrub_stamp":"2024-05-08T05:25:33.008741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T07:04:22.726450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"80'1","reported_seq":24,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T05:25:37.094840+0000","last_change":"2024-05-08T05:25:30.009641+0000","last_active":"2024-05-08T05:25:37.094840+0000","last_peered":"2024-05-08T05:25:37.094840+0000","last_clean":"2024-05-08T05:25:37.094840+0000","last_became_active":"2024-05-08T05:25:30.009244+0000","last_became_peered":"2024-05-08T05:25:30.009244+0000","last_unstale":"2024-05-08T05:25:37.094840+0000","last_undegraded":"2024-05-08T05:25:37.094840+0000","last_fullsized":"2024-05-08T05:25:37.094840+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:28.970901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:28.970901+0000","last_clean_scrub_stamp":"2024-05-08T05:25:28.970901+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T17:15:50.982103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"80'1","reported_seq":19,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-08T05:26:23.115100+0000","last_change":"2024-05-08T05:25:34.059603+0000","last_active":"2024-05-08T05:26:23.115100+0000","last_peered":"2024-05-08T05:26:23.115100+0000","last_clean":"2024-05-08T05:26:23.115100+0000","last_became_active":"2024-05-08T05:25:34.059260+0000","last_became_peered":"2024-05-08T05:25:34.059260+0000","last_unstale":"2024-05-08T05:26:23.115100+0000","last_undegraded":"2024-05-08T05:26:23.115100+0000","last_fullsized":"2024-05-08T05:26:23.115100+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_clean_scrub_stamp":"2024-05-08T05:25:33.008741+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T07:47:32.723829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"80'2","reported_seq":24,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T05:25:37.096206+0000","last_change":"2024-05-08T05:25:30.013326+0000","last_active":"2024-05-08T05:25:37.096206+0000","last_peered":"2024-05-08T05:25:37.096206+0000","last_clean":"2024-05-08T05:25:37.096206+0000","last_became_active":"2024-05-08T05:25:30.012868+0000","last_became_peered":"2024-05-08T05:25:30.012868+0000","last_unstale":"2024-05-08T05:25:37.096206+0000","last_undegraded":"2024-05-08T05:25:37.096206+0000","last_fullsized":"2024-05-08T05:25:37.096206+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:28.970901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:28.970901+0000","last_clean_scrub_stamp":"2024-05-08T05:25:28.970901+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T14:09:14.210180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":18,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-08T05:26:23.115491+0000","last_change":"2024-05-08T05:25:34.052621+0000","last_active":"2024-05-08T05:26:23.115491+0000","last_peered":"2024-05-08T05:26:23.115491+0000","last_clean":"2024-05-08T05:26:23.115491+0000","last_became_active":"2024-05-08T05:25:34.052289+0000","last_became_peered":"2024-05-08T05:25:34.052289+0000","last_unstale":"2024-05-08T05:26:23.115491+0000","last_undegraded":"2024-05-08T05:26:23.115491+0000","last_fullsized":"2024-05-08T05:26:23.115491+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_clean_scrub_stamp":"2024-05-08T05:25:33.008741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T16:37:19.327915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":14,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T05:25:37.090659+0000","last_change":"2024-05-08T05:25:34.057918+0000","last_active":"2024-05-08T05:25:37.090659+0000","last_peered":"2024-05-08T05:25:37.090659+0000","last_clean":"2024-05-08T05:25:37.090659+0000","last_became_active":"2024-05-08T05:25:34.057455+0000","last_became_peered":"2024-05-08T05:25:34.057455+0000","last_unstale":"2024-05-08T05:25:37.090659+0000","last_undegraded":"2024-05-08T05:25:37.090659+0000","last_fullsized":"2024-05-08T05:25:37.090659+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_clean_scrub_stamp":"2024-05-08T05:25:33.008741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T11:36:49.027414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:26:24.115679+0000","last_change":"2024-05-08T05:25:34.055114+0000","last_active":"2024-05-08T05:26:24.115679+0000","last_peered":"2024-05-08T05:26:24.115679+0000","last_clean":"2024-05-08T05:26:24.115679+0000","last_became_active":"2024-05-08T05:25:34.054448+0000","last_became_peered":"2024-05-08T05:25:34.054448+0000","last_unstale":"2024-05-08T05:26:24.115679+0000","last_undegraded":"2024-05-08T05:26:24.115679+0000","last_fullsized":"2024-05-08T05:26:24.115679+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_clean_scrub_stamp":"2024-05-08T05:25:33.008741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T15:19:54.872779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:26:24.115280+0000","last_change":"2024-05-08T05:25:34.064199+0000","last_active":"2024-05-08T05:26:24.115280+0000","last_peered":"2024-05-08T05:26:24.115280+0000","last_clean":"2024-05-08T05:26:24.115280+0000","last_became_active":"2024-05-08T05:25:34.063888+0000","last_became_peered":"2024-05-08T05:25:34.063888+0000","last_unstale":"2024-05-08T05:26:24.115280+0000","last_undegraded":"2024-05-08T05:26:24.115280+0000","last_fullsized":"2024-05-08T05:26:24.115280+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_clean_scrub_stamp":"2024-05-08T05:25:33.008741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T13:18:15.146769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:26:24.130081+0000","last_change":"2024-05-08T05:25:34.070526+0000","last_active":"2024-05-08T05:26:24.130081+0000","last_peered":"2024-05-08T05:26:24.130081+0000","last_clean":"2024-05-08T05:26:24.130081+0000","last_became_active":"2024-05-08T05:25:34.069890+0000","last_became_peered":"2024-05-08T05:25:34.069890+0000","last_unstale":"2024-05-08T05:26:24.130081+0000","last_undegraded":"2024-05-08T05:26:24.130081+0000","last_fullsized":"2024-05-08T05:26:24.130081+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_clean_scrub_stamp":"2024-05-08T05:25:33.008741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T16:17:56.986221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":16,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T05:25:37.090046+0000","last_change":"2024-05-08T05:25:34.067033+0000","last_active":"2024-05-08T05:25:37.090046+0000","last_peered":"2024-05-08T05:25:37.090046+0000","last_clean":"2024-05-08T05:25:37.090046+0000","last_became_active":"2024-05-08T05:25:34.066492+0000","last_became_peered":"2024-05-08T05:25:34.066492+0000","last_unstale":"2024-05-08T05:25:37.090046+0000","last_undegraded":"2024-05-08T05:25:37.090046+0000","last_fullsized":"2024-05-08T05:25:37.090046+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_clean_scrub_stamp":"2024-05-08T05:25:33.008741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T07:30:10.450504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":14,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T05:25:37.090862+0000","last_change":"2024-05-08T05:25:34.056525+0000","last_active":"2024-05-08T05:25:37.090862+0000","last_peered":"2024-05-08T05:25:37.090862+0000","last_clean":"2024-05-08T05:25:37.090862+0000","last_became_active":"2024-05-08T05:25:34.056190+0000","last_became_peered":"2024-05-08T05:25:34.056190+0000","last_unstale":"2024-05-08T05:25:37.090862+0000","last_undegraded":"2024-05-08T05:25:37.090862+0000","last_fullsized":"2024-05-08T05:25:37.090862+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_clean_scrub_stamp":"2024-05-08T05:25:33.008741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T13:13:57.716642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:26:24.115904+0000","last_change":"2024-05-08T05:25:34.055643+0000","last_active":"2024-05-08T05:26:24.115904+0000","last_peered":"2024-05-08T05:26:24.115904+0000","last_clean":"2024-05-08T05:26:24.115904+0000","last_became_active":"2024-05-08T05:25:34.054886+0000","last_became_peered":"2024-05-08T05:25:34.054886+0000","last_unstale":"2024-05-08T05:26:24.115904+0000","last_undegraded":"2024-05-08T05:26:24.115904+0000","last_fullsized":"2024-05-08T05:26:24.115904+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_clean_scrub_stamp":"2024-05-08T05:25:33.008741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T05:53:41.130484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:26:24.123415+0000","last_change":"2024-05-08T05:25:34.056932+0000","last_active":"2024-05-08T05:26:24.123415+0000","last_peered":"2024-05-08T05:26:24.123415+0000","last_clean":"2024-05-08T05:26:24.123415+0000","last_became_active":"2024-05-08T05:25:34.055473+0000","last_became_peered":"2024-05-08T05:25:34.055473+0000","last_unstale":"2024-05-08T05:26:24.123415+0000","last_undegraded":"2024-05-08T05:26:24.123415+0000","last_fullsized":"2024-05-08T05:26:24.123415+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_clean_scrub_stamp":"2024-05-08T05:25:33.008741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T16:16:13.748056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":16,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T05:25:37.067191+0000","last_change":"2024-05-08T05:25:34.063356+0000","last_active":"2024-05-08T05:25:37.067191+0000","last_peered":"2024-05-08T05:25:37.067191+0000","last_clean":"2024-05-08T05:25:37.067191+0000","last_became_active":"2024-05-08T05:25:34.062976+0000","last_became_peered":"2024-05-08T05:25:34.062976+0000","last_unstale":"2024-05-08T05:25:37.067191+0000","last_undegraded":"2024-05-08T05:25:37.067191+0000","last_fullsized":"2024-05-08T05:25:37.067191+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_clean_scrub_stamp":"2024-05-08T05:25:33.008741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T08:13:56.793190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:26:24.121353+0000","last_change":"2024-05-08T05:25:34.065000+0000","last_active":"2024-05-08T05:26:24.121353+0000","last_peered":"2024-05-08T05:26:24.121353+0000","last_clean":"2024-05-08T05:26:24.121353+0000","last_became_active":"2024-05-08T05:25:34.057748+0000","last_became_peered":"2024-05-08T05:25:34.057748+0000","last_unstale":"2024-05-08T05:26:24.121353+0000","last_undegraded":"2024-05-08T05:26:24.121353+0000","last_fullsized":"2024-05-08T05:26:24.121353+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_clean_scrub_stamp":"2024-05-08T05:25:33.008741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T15:33:41.411507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:26:24.113121+0000","last_change":"2024-05-08T05:25:34.066601+0000","last_active":"2024-05-08T05:26:24.113121+0000","last_peered":"2024-05-08T05:26:24.113121+0000","last_clean":"2024-05-08T05:26:24.113121+0000","last_became_active":"2024-05-08T05:25:34.066226+0000","last_became_peered":"2024-05-08T05:25:34.066226+0000","last_unstale":"2024-05-08T05:26:24.113121+0000","last_undegraded":"2024-05-08T05:26:24.113121+0000","last_fullsized":"2024-05-08T05:26:24.113121+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_clean_scrub_stamp":"2024-05-08T05:25:33.008741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T15:27:54.180580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":16,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T05:25:37.091288+0000","last_change":"2024-05-08T05:25:34.073520+0000","last_active":"2024-05-08T05:25:37.091288+0000","last_peered":"2024-05-08T05:25:37.091288+0000","last_clean":"2024-05-08T05:25:37.091288+0000","last_became_active":"2024-05-08T05:25:34.072250+0000","last_became_peered":"2024-05-08T05:25:34.072250+0000","last_unstale":"2024-05-08T05:25:37.091288+0000","last_undegraded":"2024-05-08T05:25:37.091288+0000","last_fullsized":"2024-05-08T05:25:37.091288+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_clean_scrub_stamp":"2024-05-08T05:25:33.008741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T08:17:36.181338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":14,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T05:25:37.090343+0000","last_change":"2024-05-08T05:25:34.054954+0000","last_active":"2024-05-08T05:25:37.090343+0000","last_peered":"2024-05-08T05:25:37.090343+0000","last_clean":"2024-05-08T05:25:37.090343+0000","last_became_active":"2024-05-08T05:25:34.054366+0000","last_became_peered":"2024-05-08T05:25:34.054366+0000","last_unstale":"2024-05-08T05:25:37.090343+0000","last_undegraded":"2024-05-08T05:25:37.090343+0000","last_fullsized":"2024-05-08T05:25:37.090343+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_clean_scrub_stamp":"2024-05-08T05:25:33.008741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T14:55:08.271668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":192,"acting":192,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":3563520,"data_stored":3542208,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":92,"ondisk_log_size":92,"up":3,"acting":3,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":63207,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":194,"num_read_kb":164,"num_write":164,"num_write_kb":108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":417792,"data_stored":189621,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":140,"ondisk_log_size":140,"up":96,"acting":96,"num_store_stats":12}],"osd_stats":[{"osd":11,"up_from":72,"seq":309237645337,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27860,"kb_used_data":844,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717292,"statfs":{"total":95995035648,"available":95966507008,"internally_reserved":0,"allocated":864256,"data_stored":420041,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":66,"seq":283467841568,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32700,"kb_used_data":1524,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712452,"statfs":{"total":95995035648,"available":95961550848,"internally_reserved":0,"allocated":1560576,"data_stored":1070728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":31914432},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":60,"seq":257698037797,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32064,"kb_used_data":884,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713088,"statfs":{"total":95995035648,"available":95962202112,"internally_reserved":0,"allocated":905216,"data_stored":437292,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":31914432},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":8,"up_from":54,"seq":231928234027,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27904,"kb_used_data":884,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717248,"statfs":{"total":95995035648,"available":95966461952,"internally_reserved":0,"allocated":905216,"data_stored":437212,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":48,"seq":206158430257,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32616,"kb_used_data":1440,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712536,"statfs":{"total":95995035648,"available":95961636864,"internally_reserved":0,"allocated":1474560,"data_stored":1012518,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":42,"seq":180388626486,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36184,"kb_used_data":848,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708968,"statfs":{"total":95995035648,"available":95957983232,"internally_reserved":0,"allocated":868352,"data_stored":419666,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574931,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27956,"kb_used_data":932,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717196,"statfs":{"total":95995035648,"available":95966408704,"internally_reserved":0,"allocated":954368,"data_stored":495289,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738455,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36220,"kb_used_data":880,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708932,"statfs":{"total":95995035648,"available":95957946368,"internally_reserved":0,"allocated":901120,"data_stored":429538,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411405,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27980,"kb_used_data":956,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717172,"statfs":{"total":95995035648,"available":95966384128,"internally_reserved":0,"allocated":978944,"data_stored":497030,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":25,"seq":107374182471,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27908,"kb_used_data":888,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717244,"statfs":{"total":95995035648,"available":95966457856,"internally_reserved":0,"allocated":909312,"data_stored":436992,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":31,"seq":133143986242,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32044,"kb_used_data":864,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713108,"statfs":{"total":95995035648,"available":95962222592,"internally_reserved":0,"allocated":884736,"data_stored":429095,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":36,"seq":154618822716,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28468,"kb_used_data":1452,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716684,"statfs":{"total":95995035648,"available":95965884416,"internally_reserved":0,"allocated":1486848,"data_stored":1011811,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":69632,"data_stored":58815,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":94208,"data_stored":60556,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1035,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1867,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2574,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":60784,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-08T05:26:29.495 DEBUG:teuthology.orchestra.run.smithi087:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid eeeb813e-0cf9-11ef-bc97-c7b262605968 -- ceph pg dump --format=json 2024-05-08T05:26:29.538 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:26:29 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T05:26:30.209 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:26:30 smithi087 ceph-mon[29523]: from='client.24620 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-05-08T05:26:30.209 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:26:30 smithi087 ceph-mon[29523]: pgmap v345: 97 pgs: 97 active+clean; 643 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 1.6 KiB/s wr, 9 op/s; 0 B/s, 1 keys/s, 0 objects/s recovering 2024-05-08T05:26:30.209 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:26:30 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:26:30.209 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:26:30 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:26:30.209 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:26:30 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:26:30.209 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:26:30 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:26:30.483 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:26:30 smithi090 ceph-mon[34526]: from='client.24620 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-05-08T05:26:30.483 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:26:30 smithi090 ceph-mon[34526]: pgmap v345: 97 pgs: 97 active+clean; 643 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 1.6 KiB/s wr, 9 op/s; 0 B/s, 1 keys/s, 0 objects/s recovering 2024-05-08T05:26:30.483 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:26:30 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:26:30.483 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:26:30 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:26:30.483 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:26:30 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:26:30.484 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:26:30 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:26:30.494 INFO:teuthology.orchestra.run.smithi087.stderr:Inferring config /var/lib/ceph/eeeb813e-0cf9-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T05:26:30.539 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:26:30 smithi160 ceph-mon[34827]: from='client.24620 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-05-08T05:26:30.539 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:26:30 smithi160 ceph-mon[34827]: pgmap v345: 97 pgs: 97 active+clean; 643 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 1.6 KiB/s wr, 9 op/s; 0 B/s, 1 keys/s, 0 objects/s recovering 2024-05-08T05:26:30.539 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:26:30 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:26:30.539 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:26:30 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:26:30.539 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:26:30 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:26:30.539 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:26:30 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:26:32.457 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:26:32 smithi087 ceph-mon[29523]: pgmap v346: 97 pgs: 97 active+clean; 643 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 1.5 KiB/s wr, 7 op/s; 0 B/s, 1 keys/s, 0 objects/s recovering 2024-05-08T05:26:32.483 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:26:32 smithi090 ceph-mon[34526]: pgmap v346: 97 pgs: 97 active+clean; 643 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 1.5 KiB/s wr, 7 op/s; 0 B/s, 1 keys/s, 0 objects/s recovering 2024-05-08T05:26:32.539 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:26:32 smithi160 ceph-mon[34827]: pgmap v346: 97 pgs: 97 active+clean; 643 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 1.5 KiB/s wr, 7 op/s; 0 B/s, 1 keys/s, 0 objects/s recovering 2024-05-08T05:26:32.619 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:32.618+0000 7fbc53e00700 1 -- 172.21.15.87:0/2787792281 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fbc4c075ff0 msgr2=0x7fbc4c10f960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:26:32.619 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:32.618+0000 7fbc53e00700 1 --2- 172.21.15.87:0/2787792281 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fbc4c075ff0 0x7fbc4c10f960 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fbc380098f0 tx=0x7fbc38009c00 comp rx=0 tx=0).stop 2024-05-08T05:26:32.619 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:32.618+0000 7fbc53e00700 1 -- 172.21.15.87:0/2787792281 shutdown_connections 2024-05-08T05:26:32.619 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:32.618+0000 7fbc53e00700 1 --2- 172.21.15.87:0/2787792281 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fbc4c10fea0 0x7fbc4c112290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:26:32.619 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:32.618+0000 7fbc53e00700 1 --2- 172.21.15.87:0/2787792281 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fbc4c0756d0 0x7fbc4c075ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:26:32.619 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:32.618+0000 7fbc53e00700 1 --2- 172.21.15.87:0/2787792281 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fbc4c075ff0 0x7fbc4c10f960 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:26:32.619 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:32.618+0000 7fbc53e00700 1 -- 172.21.15.87:0/2787792281 >> 172.21.15.87:0/2787792281 conn(0x7fbc4c07a600 msgr2=0x7fbc4c07aa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:26:32.619 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:32.618+0000 7fbc53e00700 1 -- 172.21.15.87:0/2787792281 shutdown_connections 2024-05-08T05:26:32.619 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:32.618+0000 7fbc53e00700 1 -- 172.21.15.87:0/2787792281 wait complete. 2024-05-08T05:26:32.620 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:32.619+0000 7fbc53e00700 1 Processor -- start 2024-05-08T05:26:32.620 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:32.620+0000 7fbc53e00700 1 -- start start 2024-05-08T05:26:32.621 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:32.620+0000 7fbc53e00700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fbc4c0756d0 0x7fbc4c19bde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:26:32.621 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:32.620+0000 7fbc53e00700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fbc4c075ff0 0x7fbc4c19c320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:26:32.621 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:32.620+0000 7fbc53e00700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fbc4c10fea0 0x7fbc4c1a06b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:26:32.621 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:32.620+0000 7fbc53e00700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fbc4c1158d0 con 0x7fbc4c10fea0 2024-05-08T05:26:32.621 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:32.620+0000 7fbc53e00700 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fbc4c115750 con 0x7fbc4c075ff0 2024-05-08T05:26:32.621 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:32.620+0000 7fbc53e00700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7fbc4c115a50 con 0x7fbc4c0756d0 2024-05-08T05:26:32.622 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:32.621+0000 7fbc50a00700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fbc4c075ff0 0x7fbc4c19c320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:26:32.622 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:32.621+0000 7fbc50a00700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fbc4c075ff0 0x7fbc4c19c320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.87:41496/0 (socket says 172.21.15.87:41496) 2024-05-08T05:26:32.622 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:32.621+0000 7fbc51e00700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fbc4c10fea0 0x7fbc4c1a06b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:26:32.622 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:32.621+0000 7fbc50a00700 1 -- 172.21.15.87:0/2451950426 learned_addr learned my addr 172.21.15.87:0/2451950426 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T05:26:32.622 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:32.621+0000 7fbc51400700 1 --2- 172.21.15.87:0/2451950426 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fbc4c0756d0 0x7fbc4c19bde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:26:32.622 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:32.621+0000 7fbc50a00700 1 -- 172.21.15.87:0/2451950426 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fbc4c0756d0 msgr2=0x7fbc4c19bde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:26:32.622 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:32.621+0000 7fbc50a00700 1 --2- 172.21.15.87:0/2451950426 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fbc4c0756d0 0x7fbc4c19bde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:26:32.622 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:32.621+0000 7fbc50a00700 1 -- 172.21.15.87:0/2451950426 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fbc4c10fea0 msgr2=0x7fbc4c1a06b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:26:32.622 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:32.621+0000 7fbc50a00700 1 --2- 172.21.15.87:0/2451950426 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fbc4c10fea0 0x7fbc4c1a06b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:26:32.622 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:32.621+0000 7fbc50a00700 1 -- 172.21.15.87:0/2451950426 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbc4c1a0df0 con 0x7fbc4c075ff0 2024-05-08T05:26:32.622 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:32.621+0000 7fbc50a00700 1 --2- 172.21.15.87:0/2451950426 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fbc4c075ff0 0x7fbc4c19c320 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fbc38009230 tx=0x7fbc3800fa70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:26:32.623 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:32.622+0000 7fbc4a000700 1 -- 172.21.15.87:0/2451950426 <== mon.2 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc380050c0 con 0x7fbc4c075ff0 2024-05-08T05:26:32.623 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:32.622+0000 7fbc4a000700 1 -- 172.21.15.87:0/2451950426 <== mon.2 v2:172.21.15.90:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbc3800b560 con 0x7fbc4c075ff0 2024-05-08T05:26:32.623 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:32.622+0000 7fbc4a000700 1 -- 172.21.15.87:0/2451950426 <== mon.2 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc38003a00 con 0x7fbc4c075ff0 2024-05-08T05:26:32.623 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:32.622+0000 7fbc53e00700 1 -- 172.21.15.87:0/2451950426 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbc4c1a1080 con 0x7fbc4c075ff0 2024-05-08T05:26:32.623 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:32.622+0000 7fbc53e00700 1 -- 172.21.15.87:0/2451950426 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbc4c1a8960 con 0x7fbc4c075ff0 2024-05-08T05:26:32.624 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:32.623+0000 7fbc53e00700 1 -- 172.21.15.87:0/2451950426 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbc4c076dc0 con 0x7fbc4c075ff0 2024-05-08T05:26:32.625 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:32.625+0000 7fbc4a000700 1 -- 172.21.15.87:0/2451950426 <== mon.2 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 17) ==== 149703+0+0 (secure 0 0 0) 0x7fbc3800b710 con 0x7fbc4c075ff0 2024-05-08T05:26:32.627 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:32.627+0000 7fbc4a000700 1 --2- 172.21.15.87:0/2451950426 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7fbc340b2990 0x7fbc340b4e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:26:32.628 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:32.627+0000 7fbc4a000700 1 -- 172.21.15.87:0/2451950426 <== mon.2 v2:172.21.15.90:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8190+0+0 (secure 0 0 0) 0x7fbc380e3230 con 0x7fbc4c075ff0 2024-05-08T05:26:32.628 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:32.627+0000 7fbc51400700 1 --2- 172.21.15.87:0/2451950426 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7fbc340b2990 0x7fbc340b4e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:26:32.629 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:32.628+0000 7fbc51400700 1 --2- 172.21.15.87:0/2451950426 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7fbc340b2990 0x7fbc340b4e50 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fbc40009750 tx=0x7fbc40009310 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:26:32.631 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:32.631+0000 7fbc4a000700 1 -- 172.21.15.87:0/2451950426 <== mon.2 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7fbc38013030 con 0x7fbc4c075ff0 2024-05-08T05:26:32.865 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:32.865+0000 7fbc53e00700 1 -- 172.21.15.87:0/2451950426 --> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fbc4c0638e0 con 0x7fbc340b2990 2024-05-08T05:26:32.878 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:32.877+0000 7fbc4a000700 1 -- 172.21.15.87:0/2451950426 <== mgr.14152 v2:172.21.15.87:6800/1189186457 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258738 (secure 0 0 0) 0x7fbc4c0638e0 con 0x7fbc340b2990 2024-05-08T05:26:32.882 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-05-08T05:26:32.884 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:32.883+0000 7fbc53e00700 1 -- 172.21.15.87:0/2451950426 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7fbc340b2990 msgr2=0x7fbc340b4e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:26:32.884 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:32.883+0000 7fbc53e00700 1 --2- 172.21.15.87:0/2451950426 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7fbc340b2990 0x7fbc340b4e50 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fbc40009750 tx=0x7fbc40009310 comp rx=0 tx=0).stop 2024-05-08T05:26:32.884 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:32.883+0000 7fbc53e00700 1 -- 172.21.15.87:0/2451950426 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fbc4c075ff0 msgr2=0x7fbc4c19c320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:26:32.884 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:32.883+0000 7fbc53e00700 1 --2- 172.21.15.87:0/2451950426 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fbc4c075ff0 0x7fbc4c19c320 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fbc38009230 tx=0x7fbc3800fa70 comp rx=0 tx=0).stop 2024-05-08T05:26:32.884 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:32.883+0000 7fbc53e00700 1 -- 172.21.15.87:0/2451950426 shutdown_connections 2024-05-08T05:26:32.884 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:32.883+0000 7fbc53e00700 1 --2- 172.21.15.87:0/2451950426 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fbc4c10fea0 0x7fbc4c1a06b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:26:32.884 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:32.883+0000 7fbc53e00700 1 --2- 172.21.15.87:0/2451950426 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7fbc340b2990 0x7fbc340b4e50 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:26:32.884 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:32.883+0000 7fbc53e00700 1 --2- 172.21.15.87:0/2451950426 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fbc4c0756d0 0x7fbc4c19bde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:26:32.884 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:32.883+0000 7fbc53e00700 1 --2- 172.21.15.87:0/2451950426 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fbc4c075ff0 0x7fbc4c19c320 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:26:32.884 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:32.883+0000 7fbc53e00700 1 -- 172.21.15.87:0/2451950426 >> 172.21.15.87:0/2451950426 conn(0x7fbc4c07a600 msgr2=0x7fbc4c100770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:26:32.884 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:32.883+0000 7fbc53e00700 1 -- 172.21.15.87:0/2451950426 shutdown_connections 2024-05-08T05:26:32.884 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:32.883+0000 7fbc53e00700 1 -- 172.21.15.87:0/2451950426 wait complete. 2024-05-08T05:26:32.885 INFO:teuthology.orchestra.run.smithi087.stderr:dumped all 2024-05-08T05:26:33.740 INFO:teuthology.orchestra.run.smithi087.stdout:{"pg_ready":true,"pg_map":{"version":346,"stamp":"2024-05-08T05:26:30.907336+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":658066,"num_objects":64,"num_object_clones":0,"num_object_copies":192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":301,"num_read_kb":248,"num_write":290,"num_write_kb":2265,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":13,"num_bytes_recovered":2951840,"num_keys_recovered":10,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":235,"ondisk_log_size":235,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":370076,"kb_used_data":12552,"kb_used_omap":18,"kb_used_meta":357357,"kb_avail":1124571748,"statfs":{"total":1151940427776,"available":1151561469952,"internally_reserved":0,"allocated":12853248,"data_stored":7211886,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19143,"internal_metadata":365933881},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":8705,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":35,"num_write":7,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":10,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.003138"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":18,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:26:24.113553+0000","last_change":"2024-05-08T05:25:34.073030+0000","last_active":"2024-05-08T05:26:24.113553+0000","last_peered":"2024-05-08T05:26:24.113553+0000","last_clean":"2024-05-08T05:26:24.113553+0000","last_became_active":"2024-05-08T05:25:34.072593+0000","last_became_peered":"2024-05-08T05:25:34.072593+0000","last_unstale":"2024-05-08T05:26:24.113553+0000","last_undegraded":"2024-05-08T05:26:24.113553+0000","last_fullsized":"2024-05-08T05:26:24.113553+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_clean_scrub_stamp":"2024-05-08T05:25:33.008741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T09:46:17.507034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:26:24.131357+0000","last_change":"2024-05-08T05:25:34.071436+0000","last_active":"2024-05-08T05:26:24.131357+0000","last_peered":"2024-05-08T05:26:24.131357+0000","last_clean":"2024-05-08T05:26:24.131357+0000","last_became_active":"2024-05-08T05:25:34.070985+0000","last_became_peered":"2024-05-08T05:25:34.070985+0000","last_unstale":"2024-05-08T05:26:24.131357+0000","last_undegraded":"2024-05-08T05:26:24.131357+0000","last_fullsized":"2024-05-08T05:26:24.131357+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_clean_scrub_stamp":"2024-05-08T05:25:33.008741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T10:59:01.312978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:26:24.130843+0000","last_change":"2024-05-08T05:25:34.057180+0000","last_active":"2024-05-08T05:26:24.130843+0000","last_peered":"2024-05-08T05:26:24.130843+0000","last_clean":"2024-05-08T05:26:24.130843+0000","last_became_active":"2024-05-08T05:25:34.056775+0000","last_became_peered":"2024-05-08T05:25:34.056775+0000","last_unstale":"2024-05-08T05:26:24.130843+0000","last_undegraded":"2024-05-08T05:26:24.130843+0000","last_fullsized":"2024-05-08T05:26:24.130843+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_clean_scrub_stamp":"2024-05-08T05:25:33.008741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T13:13:34.389793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:26:24.127204+0000","last_change":"2024-05-08T05:25:34.053102+0000","last_active":"2024-05-08T05:26:24.127204+0000","last_peered":"2024-05-08T05:26:24.127204+0000","last_clean":"2024-05-08T05:26:24.127204+0000","last_became_active":"2024-05-08T05:25:34.052736+0000","last_became_peered":"2024-05-08T05:25:34.052736+0000","last_unstale":"2024-05-08T05:26:24.127204+0000","last_undegraded":"2024-05-08T05:26:24.127204+0000","last_fullsized":"2024-05-08T05:26:24.127204+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_clean_scrub_stamp":"2024-05-08T05:25:33.008741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T13:05:02.665370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:26:24.116560+0000","last_change":"2024-05-08T05:25:34.070073+0000","last_active":"2024-05-08T05:26:24.116560+0000","last_peered":"2024-05-08T05:26:24.116560+0000","last_clean":"2024-05-08T05:26:24.116560+0000","last_became_active":"2024-05-08T05:25:34.069660+0000","last_became_peered":"2024-05-08T05:25:34.069660+0000","last_unstale":"2024-05-08T05:26:24.116560+0000","last_undegraded":"2024-05-08T05:26:24.116560+0000","last_fullsized":"2024-05-08T05:26:24.116560+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_clean_scrub_stamp":"2024-05-08T05:25:33.008741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T12:37:10.599082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:26:24.127567+0000","last_change":"2024-05-08T05:25:34.057928+0000","last_active":"2024-05-08T05:26:24.127567+0000","last_peered":"2024-05-08T05:26:24.127567+0000","last_clean":"2024-05-08T05:26:24.127567+0000","last_became_active":"2024-05-08T05:25:34.057538+0000","last_became_peered":"2024-05-08T05:25:34.057538+0000","last_unstale":"2024-05-08T05:26:24.127567+0000","last_undegraded":"2024-05-08T05:26:24.127567+0000","last_fullsized":"2024-05-08T05:26:24.127567+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_clean_scrub_stamp":"2024-05-08T05:25:33.008741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T12:22:49.920889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:26:24.115600+0000","last_change":"2024-05-08T05:25:34.055439+0000","last_active":"2024-05-08T05:26:24.115600+0000","last_peered":"2024-05-08T05:26:24.115600+0000","last_clean":"2024-05-08T05:26:24.115600+0000","last_became_active":"2024-05-08T05:25:34.055002+0000","last_became_peered":"2024-05-08T05:25:34.055002+0000","last_unstale":"2024-05-08T05:26:24.115600+0000","last_undegraded":"2024-05-08T05:26:24.115600+0000","last_fullsized":"2024-05-08T05:26:24.115600+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_clean_scrub_stamp":"2024-05-08T05:25:33.008741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T11:29:00.482681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:26:24.121941+0000","last_change":"2024-05-08T05:25:34.058943+0000","last_active":"2024-05-08T05:26:24.121941+0000","last_peered":"2024-05-08T05:26:24.121941+0000","last_clean":"2024-05-08T05:26:24.121941+0000","last_became_active":"2024-05-08T05:25:34.058200+0000","last_became_peered":"2024-05-08T05:25:34.058200+0000","last_unstale":"2024-05-08T05:26:24.121941+0000","last_undegraded":"2024-05-08T05:26:24.121941+0000","last_fullsized":"2024-05-08T05:26:24.121941+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_clean_scrub_stamp":"2024-05-08T05:25:33.008741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T11:13:23.019489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:26:24.113562+0000","last_change":"2024-05-08T05:25:34.053948+0000","last_active":"2024-05-08T05:26:24.113562+0000","last_peered":"2024-05-08T05:26:24.113562+0000","last_clean":"2024-05-08T05:26:24.113562+0000","last_became_active":"2024-05-08T05:25:34.053601+0000","last_became_peered":"2024-05-08T05:25:34.053601+0000","last_unstale":"2024-05-08T05:26:24.113562+0000","last_undegraded":"2024-05-08T05:26:24.113562+0000","last_fullsized":"2024-05-08T05:26:24.113562+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_clean_scrub_stamp":"2024-05-08T05:25:33.008741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T05:50:44.228628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:26:24.127843+0000","last_change":"2024-05-08T05:25:34.053167+0000","last_active":"2024-05-08T05:26:24.127843+0000","last_peered":"2024-05-08T05:26:24.127843+0000","last_clean":"2024-05-08T05:26:24.127843+0000","last_became_active":"2024-05-08T05:25:34.052425+0000","last_became_peered":"2024-05-08T05:25:34.052425+0000","last_unstale":"2024-05-08T05:26:24.127843+0000","last_undegraded":"2024-05-08T05:26:24.127843+0000","last_fullsized":"2024-05-08T05:26:24.127843+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_clean_scrub_stamp":"2024-05-08T05:25:33.008741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T10:56:28.599966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:26:24.115931+0000","last_change":"2024-05-08T05:25:34.057677+0000","last_active":"2024-05-08T05:26:24.115931+0000","last_peered":"2024-05-08T05:26:24.115931+0000","last_clean":"2024-05-08T05:26:24.115931+0000","last_became_active":"2024-05-08T05:25:34.054800+0000","last_became_peered":"2024-05-08T05:25:34.054800+0000","last_unstale":"2024-05-08T05:26:24.115931+0000","last_undegraded":"2024-05-08T05:26:24.115931+0000","last_fullsized":"2024-05-08T05:26:24.115931+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_clean_scrub_stamp":"2024-05-08T05:25:33.008741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T07:41:55.836901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:26:24.127180+0000","last_change":"2024-05-08T05:25:34.051744+0000","last_active":"2024-05-08T05:26:24.127180+0000","last_peered":"2024-05-08T05:26:24.127180+0000","last_clean":"2024-05-08T05:26:24.127180+0000","last_became_active":"2024-05-08T05:25:34.051395+0000","last_became_peered":"2024-05-08T05:25:34.051395+0000","last_unstale":"2024-05-08T05:26:24.127180+0000","last_undegraded":"2024-05-08T05:26:24.127180+0000","last_fullsized":"2024-05-08T05:26:24.127180+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_clean_scrub_stamp":"2024-05-08T05:25:33.008741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T07:58:52.674899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:26:24.115109+0000","last_change":"2024-05-08T05:25:34.053197+0000","last_active":"2024-05-08T05:26:24.115109+0000","last_peered":"2024-05-08T05:26:24.115109+0000","last_clean":"2024-05-08T05:26:24.115109+0000","last_became_active":"2024-05-08T05:25:34.052331+0000","last_became_peered":"2024-05-08T05:25:34.052331+0000","last_unstale":"2024-05-08T05:26:24.115109+0000","last_undegraded":"2024-05-08T05:26:24.115109+0000","last_fullsized":"2024-05-08T05:26:24.115109+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_clean_scrub_stamp":"2024-05-08T05:25:33.008741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T07:19:12.524722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:26:24.129585+0000","last_change":"2024-05-08T05:25:34.070242+0000","last_active":"2024-05-08T05:26:24.129585+0000","last_peered":"2024-05-08T05:26:24.129585+0000","last_clean":"2024-05-08T05:26:24.129585+0000","last_became_active":"2024-05-08T05:25:34.069580+0000","last_became_peered":"2024-05-08T05:25:34.069580+0000","last_unstale":"2024-05-08T05:26:24.129585+0000","last_undegraded":"2024-05-08T05:26:24.129585+0000","last_fullsized":"2024-05-08T05:26:24.129585+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_clean_scrub_stamp":"2024-05-08T05:25:33.008741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T06:33:25.099470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:26:24.129292+0000","last_change":"2024-05-08T05:25:34.067174+0000","last_active":"2024-05-08T05:26:24.129292+0000","last_peered":"2024-05-08T05:26:24.129292+0000","last_clean":"2024-05-08T05:26:24.129292+0000","last_became_active":"2024-05-08T05:25:34.066811+0000","last_became_peered":"2024-05-08T05:25:34.066811+0000","last_unstale":"2024-05-08T05:26:24.129292+0000","last_undegraded":"2024-05-08T05:26:24.129292+0000","last_fullsized":"2024-05-08T05:26:24.129292+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_clean_scrub_stamp":"2024-05-08T05:25:33.008741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T16:17:57.731620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:26:24.112894+0000","last_change":"2024-05-08T05:25:34.064339+0000","last_active":"2024-05-08T05:26:24.112894+0000","last_peered":"2024-05-08T05:26:24.112894+0000","last_clean":"2024-05-08T05:26:24.112894+0000","last_became_active":"2024-05-08T05:25:34.063994+0000","last_became_peered":"2024-05-08T05:25:34.063994+0000","last_unstale":"2024-05-08T05:26:24.112894+0000","last_undegraded":"2024-05-08T05:26:24.112894+0000","last_fullsized":"2024-05-08T05:26:24.112894+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_clean_scrub_stamp":"2024-05-08T05:25:33.008741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T17:09:34.443411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":18,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:26:24.113827+0000","last_change":"2024-05-08T05:25:34.073029+0000","last_active":"2024-05-08T05:26:24.113827+0000","last_peered":"2024-05-08T05:26:24.113827+0000","last_clean":"2024-05-08T05:26:24.113827+0000","last_became_active":"2024-05-08T05:25:34.072491+0000","last_became_peered":"2024-05-08T05:25:34.072491+0000","last_unstale":"2024-05-08T05:26:24.113827+0000","last_undegraded":"2024-05-08T05:26:24.113827+0000","last_fullsized":"2024-05-08T05:26:24.113827+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_clean_scrub_stamp":"2024-05-08T05:25:33.008741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T10:22:25.304349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:26:24.132883+0000","last_change":"2024-05-08T05:25:34.061439+0000","last_active":"2024-05-08T05:26:24.132883+0000","last_peered":"2024-05-08T05:26:24.132883+0000","last_clean":"2024-05-08T05:26:24.132883+0000","last_became_active":"2024-05-08T05:25:34.058275+0000","last_became_peered":"2024-05-08T05:25:34.058275+0000","last_unstale":"2024-05-08T05:26:24.132883+0000","last_undegraded":"2024-05-08T05:26:24.132883+0000","last_fullsized":"2024-05-08T05:26:24.132883+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_clean_scrub_stamp":"2024-05-08T05:25:33.008741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T14:04:32.433114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:26:24.116046+0000","last_change":"2024-05-08T05:25:34.061463+0000","last_active":"2024-05-08T05:26:24.116046+0000","last_peered":"2024-05-08T05:26:24.116046+0000","last_clean":"2024-05-08T05:26:24.116046+0000","last_became_active":"2024-05-08T05:25:34.060891+0000","last_became_peered":"2024-05-08T05:25:34.060891+0000","last_unstale":"2024-05-08T05:26:24.116046+0000","last_undegraded":"2024-05-08T05:26:24.116046+0000","last_fullsized":"2024-05-08T05:26:24.116046+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_clean_scrub_stamp":"2024-05-08T05:25:33.008741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T06:42:17.741180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1f","version":"80'9","reported_seq":36,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:26:24.134504+0000","last_change":"2024-05-08T05:25:30.003956+0000","last_active":"2024-05-08T05:26:24.134504+0000","last_peered":"2024-05-08T05:26:24.134504+0000","last_clean":"2024-05-08T05:26:24.134504+0000","last_became_active":"2024-05-08T05:25:30.003229+0000","last_became_peered":"2024-05-08T05:25:30.003229+0000","last_unstale":"2024-05-08T05:26:24.134504+0000","last_undegraded":"2024-05-08T05:26:24.134504+0000","last_fullsized":"2024-05-08T05:26:24.134504+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:28.970901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:28.970901+0000","last_clean_scrub_stamp":"2024-05-08T05:25:28.970901+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T15:45:15.168997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:26:24.123247+0000","last_change":"2024-05-08T05:25:34.064917+0000","last_active":"2024-05-08T05:26:24.123247+0000","last_peered":"2024-05-08T05:26:24.123247+0000","last_clean":"2024-05-08T05:26:24.123247+0000","last_became_active":"2024-05-08T05:25:34.064567+0000","last_became_peered":"2024-05-08T05:25:34.064567+0000","last_unstale":"2024-05-08T05:26:24.123247+0000","last_undegraded":"2024-05-08T05:26:24.123247+0000","last_fullsized":"2024-05-08T05:26:24.123247+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_clean_scrub_stamp":"2024-05-08T05:25:33.008741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T11:15:53.439313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"80'2","reported_seq":28,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:26:24.123860+0000","last_change":"2024-05-08T05:25:30.358617+0000","last_active":"2024-05-08T05:26:24.123860+0000","last_peered":"2024-05-08T05:26:24.123860+0000","last_clean":"2024-05-08T05:26:24.123860+0000","last_became_active":"2024-05-08T05:25:30.358084+0000","last_became_peered":"2024-05-08T05:25:30.358084+0000","last_unstale":"2024-05-08T05:26:24.123860+0000","last_undegraded":"2024-05-08T05:26:24.123860+0000","last_fullsized":"2024-05-08T05:26:24.123860+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:28.970901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:28.970901+0000","last_clean_scrub_stamp":"2024-05-08T05:25:28.970901+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T16:30:36.151645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:26:24.132465+0000","last_change":"2024-05-08T05:25:34.070189+0000","last_active":"2024-05-08T05:26:24.132465+0000","last_peered":"2024-05-08T05:26:24.132465+0000","last_clean":"2024-05-08T05:26:24.132465+0000","last_became_active":"2024-05-08T05:25:34.067644+0000","last_became_peered":"2024-05-08T05:25:34.067644+0000","last_unstale":"2024-05-08T05:26:24.132465+0000","last_undegraded":"2024-05-08T05:26:24.132465+0000","last_fullsized":"2024-05-08T05:26:24.132465+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_clean_scrub_stamp":"2024-05-08T05:25:33.008741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T07:50:03.938036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"80'4","reported_seq":19,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:26:24.134338+0000","last_change":"2024-05-08T05:26:24.133899+0000","last_active":"2024-05-08T05:26:24.134338+0000","last_peered":"2024-05-08T05:26:24.134338+0000","last_clean":"2024-05-08T05:26:24.134338+0000","last_became_active":"2024-05-08T05:26:24.127975+0000","last_became_peered":"2024-05-08T05:26:24.127975+0000","last_unstale":"2024-05-08T05:26:24.134338+0000","last_undegraded":"2024-05-08T05:26:24.134338+0000","last_fullsized":"2024-05-08T05:26:24.134338+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:28.970901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:28.970901+0000","last_clean_scrub_stamp":"2024-05-08T05:25:28.970901+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T09:52:51.912899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":10,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,7],"acting":[11,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:26:24.113103+0000","last_change":"2024-05-08T05:25:34.057034+0000","last_active":"2024-05-08T05:26:24.113103+0000","last_peered":"2024-05-08T05:26:24.113103+0000","last_clean":"2024-05-08T05:26:24.113103+0000","last_became_active":"2024-05-08T05:25:34.056718+0000","last_became_peered":"2024-05-08T05:25:34.056718+0000","last_unstale":"2024-05-08T05:26:24.113103+0000","last_undegraded":"2024-05-08T05:26:24.113103+0000","last_fullsized":"2024-05-08T05:26:24.113103+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_clean_scrub_stamp":"2024-05-08T05:25:33.008741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T15:30:38.786889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1c","version":"80'2","reported_seq":28,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:26:24.115905+0000","last_change":"2024-05-08T05:25:29.998007+0000","last_active":"2024-05-08T05:26:24.115905+0000","last_peered":"2024-05-08T05:26:24.115905+0000","last_clean":"2024-05-08T05:26:24.115905+0000","last_became_active":"2024-05-08T05:25:29.997565+0000","last_became_peered":"2024-05-08T05:25:29.997565+0000","last_unstale":"2024-05-08T05:26:24.115905+0000","last_undegraded":"2024-05-08T05:26:24.115905+0000","last_fullsized":"2024-05-08T05:26:24.115905+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:28.970901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:28.970901+0000","last_clean_scrub_stamp":"2024-05-08T05:25:28.970901+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T13:40:09.620809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:26:24.118612+0000","last_change":"2024-05-08T05:25:34.060136+0000","last_active":"2024-05-08T05:26:24.118612+0000","last_peered":"2024-05-08T05:26:24.118612+0000","last_clean":"2024-05-08T05:26:24.118612+0000","last_became_active":"2024-05-08T05:25:34.059782+0000","last_became_peered":"2024-05-08T05:25:34.059782+0000","last_unstale":"2024-05-08T05:26:24.118612+0000","last_undegraded":"2024-05-08T05:26:24.118612+0000","last_fullsized":"2024-05-08T05:26:24.118612+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_clean_scrub_stamp":"2024-05-08T05:25:33.008741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T17:07:33.509305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"80'6","reported_seq":67,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:26:26.004801+0000","last_change":"2024-05-08T05:25:30.001356+0000","last_active":"2024-05-08T05:26:26.004801+0000","last_peered":"2024-05-08T05:26:26.004801+0000","last_clean":"2024-05-08T05:26:26.004801+0000","last_became_active":"2024-05-08T05:25:30.000998+0000","last_became_peered":"2024-05-08T05:25:30.000998+0000","last_unstale":"2024-05-08T05:26:26.004801+0000","last_undegraded":"2024-05-08T05:26:26.004801+0000","last_fullsized":"2024-05-08T05:26:26.004801+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:28.970901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:28.970901+0000","last_clean_scrub_stamp":"2024-05-08T05:25:28.970901+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T10:03:27.279982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1013,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":35,"num_read_kb":3,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:26:24.115505+0000","last_change":"2024-05-08T05:25:34.056548+0000","last_active":"2024-05-08T05:26:24.115505+0000","last_peered":"2024-05-08T05:26:24.115505+0000","last_clean":"2024-05-08T05:26:24.115505+0000","last_became_active":"2024-05-08T05:25:34.056216+0000","last_became_peered":"2024-05-08T05:25:34.056216+0000","last_unstale":"2024-05-08T05:26:24.115505+0000","last_undegraded":"2024-05-08T05:26:24.115505+0000","last_fullsized":"2024-05-08T05:26:24.115505+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_clean_scrub_stamp":"2024-05-08T05:25:33.008741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T14:46:05.056610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1a","version":"80'3","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:26:24.127482+0000","last_change":"2024-05-08T05:25:30.009289+0000","last_active":"2024-05-08T05:26:24.127482+0000","last_peered":"2024-05-08T05:26:24.127482+0000","last_clean":"2024-05-08T05:26:24.127482+0000","last_became_active":"2024-05-08T05:25:30.008856+0000","last_became_peered":"2024-05-08T05:25:30.008856+0000","last_unstale":"2024-05-08T05:26:24.127482+0000","last_undegraded":"2024-05-08T05:26:24.127482+0000","last_fullsized":"2024-05-08T05:26:24.127482+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:28.970901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:28.970901+0000","last_clean_scrub_stamp":"2024-05-08T05:25:28.970901+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T10:49:55.857415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:26:24.118317+0000","last_change":"2024-05-08T05:25:34.062532+0000","last_active":"2024-05-08T05:26:24.118317+0000","last_peered":"2024-05-08T05:26:24.118317+0000","last_clean":"2024-05-08T05:26:24.118317+0000","last_became_active":"2024-05-08T05:25:34.062246+0000","last_became_peered":"2024-05-08T05:25:34.062246+0000","last_unstale":"2024-05-08T05:26:24.118317+0000","last_undegraded":"2024-05-08T05:26:24.118317+0000","last_fullsized":"2024-05-08T05:26:24.118317+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_clean_scrub_stamp":"2024-05-08T05:25:33.008741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T07:35:49.149411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"80'2","reported_seq":28,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:26:24.114329+0000","last_change":"2024-05-08T05:25:30.014336+0000","last_active":"2024-05-08T05:26:24.114329+0000","last_peered":"2024-05-08T05:26:24.114329+0000","last_clean":"2024-05-08T05:26:24.114329+0000","last_became_active":"2024-05-08T05:25:30.012147+0000","last_became_peered":"2024-05-08T05:25:30.012147+0000","last_unstale":"2024-05-08T05:26:24.114329+0000","last_undegraded":"2024-05-08T05:26:24.114329+0000","last_fullsized":"2024-05-08T05:26:24.114329+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:28.970901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:28.970901+0000","last_clean_scrub_stamp":"2024-05-08T05:25:28.970901+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T07:48:20.477581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:26:24.120746+0000","last_change":"2024-05-08T05:25:34.058947+0000","last_active":"2024-05-08T05:26:24.120746+0000","last_peered":"2024-05-08T05:26:24.120746+0000","last_clean":"2024-05-08T05:26:24.120746+0000","last_became_active":"2024-05-08T05:25:34.058626+0000","last_became_peered":"2024-05-08T05:25:34.058626+0000","last_unstale":"2024-05-08T05:26:24.120746+0000","last_undegraded":"2024-05-08T05:26:24.120746+0000","last_fullsized":"2024-05-08T05:26:24.120746+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_clean_scrub_stamp":"2024-05-08T05:25:33.008741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T12:55:07.742707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"80'1","reported_seq":27,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:26:24.118080+0000","last_change":"2024-05-08T05:25:29.999201+0000","last_active":"2024-05-08T05:26:24.118080+0000","last_peered":"2024-05-08T05:26:24.118080+0000","last_clean":"2024-05-08T05:26:24.118080+0000","last_became_active":"2024-05-08T05:25:29.998819+0000","last_became_peered":"2024-05-08T05:25:29.998819+0000","last_unstale":"2024-05-08T05:26:24.118080+0000","last_undegraded":"2024-05-08T05:26:24.118080+0000","last_fullsized":"2024-05-08T05:26:24.118080+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:28.970901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:28.970901+0000","last_clean_scrub_stamp":"2024-05-08T05:25:28.970901+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T09:00:02.831877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:26:24.130587+0000","last_change":"2024-05-08T05:25:34.063770+0000","last_active":"2024-05-08T05:26:24.130587+0000","last_peered":"2024-05-08T05:26:24.130587+0000","last_clean":"2024-05-08T05:26:24.130587+0000","last_became_active":"2024-05-08T05:25:34.061591+0000","last_became_peered":"2024-05-08T05:25:34.061591+0000","last_unstale":"2024-05-08T05:26:24.130587+0000","last_undegraded":"2024-05-08T05:26:24.130587+0000","last_fullsized":"2024-05-08T05:26:24.130587+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_clean_scrub_stamp":"2024-05-08T05:25:33.008741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T16:51:06.593857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"80'3","reported_seq":62,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:26:27.005614+0000","last_change":"2024-05-08T05:25:30.005678+0000","last_active":"2024-05-08T05:26:27.005614+0000","last_peered":"2024-05-08T05:26:27.005614+0000","last_clean":"2024-05-08T05:26:27.005614+0000","last_became_active":"2024-05-08T05:25:30.005218+0000","last_became_peered":"2024-05-08T05:25:30.005218+0000","last_unstale":"2024-05-08T05:26:27.005614+0000","last_undegraded":"2024-05-08T05:26:27.005614+0000","last_fullsized":"2024-05-08T05:26:27.005614+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:28.970901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:28.970901+0000","last_clean_scrub_stamp":"2024-05-08T05:25:28.970901+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T11:44:56.720663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":33,"num_read_kb":33,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:26:24.113443+0000","last_change":"2024-05-08T05:25:34.058640+0000","last_active":"2024-05-08T05:26:24.113443+0000","last_peered":"2024-05-08T05:26:24.113443+0000","last_clean":"2024-05-08T05:26:24.113443+0000","last_became_active":"2024-05-08T05:25:34.058332+0000","last_became_peered":"2024-05-08T05:25:34.058332+0000","last_unstale":"2024-05-08T05:26:24.113443+0000","last_undegraded":"2024-05-08T05:26:24.113443+0000","last_fullsized":"2024-05-08T05:26:24.113443+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_clean_scrub_stamp":"2024-05-08T05:25:33.008741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T09:21:44.273684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"80'2","reported_seq":28,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:26:24.115805+0000","last_change":"2024-05-08T05:25:30.000229+0000","last_active":"2024-05-08T05:26:24.115805+0000","last_peered":"2024-05-08T05:26:24.115805+0000","last_clean":"2024-05-08T05:26:24.115805+0000","last_became_active":"2024-05-08T05:25:29.999888+0000","last_became_peered":"2024-05-08T05:25:29.999888+0000","last_unstale":"2024-05-08T05:26:24.115805+0000","last_undegraded":"2024-05-08T05:26:24.115805+0000","last_fullsized":"2024-05-08T05:26:24.115805+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:28.970901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:28.970901+0000","last_clean_scrub_stamp":"2024-05-08T05:25:28.970901+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T10:28:02.849791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:26:24.132402+0000","last_change":"2024-05-08T05:25:34.069600+0000","last_active":"2024-05-08T05:26:24.132402+0000","last_peered":"2024-05-08T05:26:24.132402+0000","last_clean":"2024-05-08T05:26:24.132402+0000","last_became_active":"2024-05-08T05:25:34.069055+0000","last_became_peered":"2024-05-08T05:25:34.069055+0000","last_unstale":"2024-05-08T05:26:24.132402+0000","last_undegraded":"2024-05-08T05:26:24.132402+0000","last_fullsized":"2024-05-08T05:26:24.132402+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_clean_scrub_stamp":"2024-05-08T05:25:33.008741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T10:22:31.166719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"80'4","reported_seq":31,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:26:24.118716+0000","last_change":"2024-05-08T05:25:30.360911+0000","last_active":"2024-05-08T05:26:24.118716+0000","last_peered":"2024-05-08T05:26:24.118716+0000","last_clean":"2024-05-08T05:26:24.118716+0000","last_became_active":"2024-05-08T05:25:30.360544+0000","last_became_peered":"2024-05-08T05:25:30.360544+0000","last_unstale":"2024-05-08T05:26:24.118716+0000","last_undegraded":"2024-05-08T05:26:24.118716+0000","last_fullsized":"2024-05-08T05:26:24.118716+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:28.970901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:28.970901+0000","last_clean_scrub_stamp":"2024-05-08T05:25:28.970901+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T17:03:10.633420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:26:24.113116+0000","last_change":"2024-05-08T05:25:34.058259+0000","last_active":"2024-05-08T05:26:24.113116+0000","last_peered":"2024-05-08T05:26:24.113116+0000","last_clean":"2024-05-08T05:26:24.113116+0000","last_became_active":"2024-05-08T05:25:34.057912+0000","last_became_peered":"2024-05-08T05:25:34.057912+0000","last_unstale":"2024-05-08T05:26:24.113116+0000","last_undegraded":"2024-05-08T05:26:24.113116+0000","last_fullsized":"2024-05-08T05:26:24.113116+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_clean_scrub_stamp":"2024-05-08T05:25:33.008741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T14:58:49.311769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"82'30","reported_seq":131,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:26:28.018163+0000","last_change":"2024-05-08T05:25:30.001177+0000","last_active":"2024-05-08T05:26:28.018163+0000","last_peered":"2024-05-08T05:26:28.018163+0000","last_clean":"2024-05-08T05:26:28.018163+0000","last_became_active":"2024-05-08T05:25:30.000769+0000","last_became_peered":"2024-05-08T05:25:30.000769+0000","last_unstale":"2024-05-08T05:26:28.018163+0000","last_undegraded":"2024-05-08T05:26:28.018163+0000","last_fullsized":"2024-05-08T05:26:28.018163+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:28.970901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:28.970901+0000","last_clean_scrub_stamp":"2024-05-08T05:25:28.970901+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T14:40:35.540270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":63072,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":75,"num_read_kb":99,"num_write":31,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:26:24.115917+0000","last_change":"2024-05-08T05:25:34.053366+0000","last_active":"2024-05-08T05:26:24.115917+0000","last_peered":"2024-05-08T05:26:24.115917+0000","last_clean":"2024-05-08T05:26:24.115917+0000","last_became_active":"2024-05-08T05:25:34.052485+0000","last_became_peered":"2024-05-08T05:25:34.052485+0000","last_unstale":"2024-05-08T05:26:24.115917+0000","last_undegraded":"2024-05-08T05:26:24.115917+0000","last_fullsized":"2024-05-08T05:26:24.115917+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_clean_scrub_stamp":"2024-05-08T05:25:33.008741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T07:35:05.603319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"80'6","reported_seq":33,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:26:24.115359+0000","last_change":"2024-05-08T05:25:30.010453+0000","last_active":"2024-05-08T05:26:24.115359+0000","last_peered":"2024-05-08T05:26:24.115359+0000","last_clean":"2024-05-08T05:26:24.115359+0000","last_became_active":"2024-05-08T05:25:30.010032+0000","last_became_peered":"2024-05-08T05:25:30.010032+0000","last_unstale":"2024-05-08T05:26:24.115359+0000","last_undegraded":"2024-05-08T05:26:24.115359+0000","last_fullsized":"2024-05-08T05:26:24.115359+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:28.970901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:28.970901+0000","last_clean_scrub_stamp":"2024-05-08T05:25:28.970901+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T16:34:35.052481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:26:24.134959+0000","last_change":"2024-05-08T05:26:24.134959+0000","last_active":"2024-05-08T05:26:24.134959+0000","last_peered":"2024-05-08T05:26:24.134959+0000","last_clean":"2024-05-08T05:26:24.134959+0000","last_became_active":"2024-05-08T05:26:24.134487+0000","last_became_peered":"2024-05-08T05:26:24.134487+0000","last_unstale":"2024-05-08T05:26:24.134959+0000","last_undegraded":"2024-05-08T05:26:24.134959+0000","last_fullsized":"2024-05-08T05:26:24.134959+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_clean_scrub_stamp":"2024-05-08T05:25:33.008741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T06:46:55.131407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,9],"acting":[6,7,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"80'3","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:26:24.118139+0000","last_change":"2024-05-08T05:25:30.009768+0000","last_active":"2024-05-08T05:26:24.118139+0000","last_peered":"2024-05-08T05:26:24.118139+0000","last_clean":"2024-05-08T05:26:24.118139+0000","last_became_active":"2024-05-08T05:25:30.009385+0000","last_became_peered":"2024-05-08T05:25:30.009385+0000","last_unstale":"2024-05-08T05:26:24.118139+0000","last_undegraded":"2024-05-08T05:26:24.118139+0000","last_fullsized":"2024-05-08T05:26:24.118139+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:28.970901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:28.970901+0000","last_clean_scrub_stamp":"2024-05-08T05:25:28.970901+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T07:19:19.556003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:26:24.115849+0000","last_change":"2024-05-08T05:25:34.055704+0000","last_active":"2024-05-08T05:26:24.115849+0000","last_peered":"2024-05-08T05:26:24.115849+0000","last_clean":"2024-05-08T05:26:24.115849+0000","last_became_active":"2024-05-08T05:25:34.055339+0000","last_became_peered":"2024-05-08T05:25:34.055339+0000","last_unstale":"2024-05-08T05:26:24.115849+0000","last_undegraded":"2024-05-08T05:26:24.115849+0000","last_fullsized":"2024-05-08T05:26:24.115849+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_clean_scrub_stamp":"2024-05-08T05:25:33.008741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T07:21:52.579094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"80'4","reported_seq":66,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:26:27.029779+0000","last_change":"2024-05-08T05:25:29.998631+0000","last_active":"2024-05-08T05:26:27.029779+0000","last_peered":"2024-05-08T05:26:27.029779+0000","last_clean":"2024-05-08T05:26:27.029779+0000","last_became_active":"2024-05-08T05:25:29.998216+0000","last_became_peered":"2024-05-08T05:25:29.998216+0000","last_unstale":"2024-05-08T05:26:27.029779+0000","last_undegraded":"2024-05-08T05:26:27.029779+0000","last_fullsized":"2024-05-08T05:26:27.029779+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:28.970901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:28.970901+0000","last_clean_scrub_stamp":"2024-05-08T05:25:28.970901+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T14:16:58.252604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":979,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":37,"num_read_kb":4,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:26:24.115502+0000","last_change":"2024-05-08T05:25:34.053216+0000","last_active":"2024-05-08T05:26:24.115502+0000","last_peered":"2024-05-08T05:26:24.115502+0000","last_clean":"2024-05-08T05:26:24.115502+0000","last_became_active":"2024-05-08T05:25:34.052908+0000","last_became_peered":"2024-05-08T05:25:34.052908+0000","last_unstale":"2024-05-08T05:26:24.115502+0000","last_undegraded":"2024-05-08T05:26:24.115502+0000","last_fullsized":"2024-05-08T05:26:24.115502+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_clean_scrub_stamp":"2024-05-08T05:25:33.008741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T13:01:42.574200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"80'15","reported_seq":42,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:26:24.116038+0000","last_change":"2024-05-08T05:25:30.356349+0000","last_active":"2024-05-08T05:26:24.116038+0000","last_peered":"2024-05-08T05:26:24.116038+0000","last_clean":"2024-05-08T05:26:24.116038+0000","last_became_active":"2024-05-08T05:25:30.355892+0000","last_became_peered":"2024-05-08T05:25:30.355892+0000","last_unstale":"2024-05-08T05:26:24.116038+0000","last_undegraded":"2024-05-08T05:26:24.116038+0000","last_fullsized":"2024-05-08T05:26:24.116038+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:28.970901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:28.970901+0000","last_clean_scrub_stamp":"2024-05-08T05:25:28.970901+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T16:54:22.322606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:26:24.117978+0000","last_change":"2024-05-08T05:25:34.062254+0000","last_active":"2024-05-08T05:26:24.117978+0000","last_peered":"2024-05-08T05:26:24.117978+0000","last_clean":"2024-05-08T05:26:24.117978+0000","last_became_active":"2024-05-08T05:25:34.061928+0000","last_became_peered":"2024-05-08T05:25:34.061928+0000","last_unstale":"2024-05-08T05:26:24.117978+0000","last_undegraded":"2024-05-08T05:26:24.117978+0000","last_fullsized":"2024-05-08T05:26:24.117978+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_clean_scrub_stamp":"2024-05-08T05:25:33.008741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T14:58:17.135661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"80'2","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:26:24.116364+0000","last_change":"2024-05-08T05:25:30.001434+0000","last_active":"2024-05-08T05:26:24.116364+0000","last_peered":"2024-05-08T05:26:24.116364+0000","last_clean":"2024-05-08T05:26:24.116364+0000","last_became_active":"2024-05-08T05:25:30.000900+0000","last_became_peered":"2024-05-08T05:25:30.000900+0000","last_unstale":"2024-05-08T05:26:24.116364+0000","last_undegraded":"2024-05-08T05:26:24.116364+0000","last_fullsized":"2024-05-08T05:26:24.116364+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:28.970901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:28.970901+0000","last_clean_scrub_stamp":"2024-05-08T05:25:28.970901+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T11:47:18.031222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":18,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:26:24.113406+0000","last_change":"2024-05-08T05:25:34.057101+0000","last_active":"2024-05-08T05:26:24.113406+0000","last_peered":"2024-05-08T05:26:24.113406+0000","last_clean":"2024-05-08T05:26:24.113406+0000","last_became_active":"2024-05-08T05:25:34.056742+0000","last_became_peered":"2024-05-08T05:25:34.056742+0000","last_unstale":"2024-05-08T05:26:24.113406+0000","last_undegraded":"2024-05-08T05:26:24.113406+0000","last_fullsized":"2024-05-08T05:26:24.113406+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_clean_scrub_stamp":"2024-05-08T05:25:33.008741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T14:19:22.997586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:26:24.133808+0000","last_change":"2024-05-08T05:25:30.359474+0000","last_active":"2024-05-08T05:26:24.133808+0000","last_peered":"2024-05-08T05:26:24.133808+0000","last_clean":"2024-05-08T05:26:24.133808+0000","last_became_active":"2024-05-08T05:25:30.358971+0000","last_became_peered":"2024-05-08T05:25:30.358971+0000","last_unstale":"2024-05-08T05:26:24.133808+0000","last_undegraded":"2024-05-08T05:26:24.133808+0000","last_fullsized":"2024-05-08T05:26:24.133808+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:28.970901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:28.970901+0000","last_clean_scrub_stamp":"2024-05-08T05:25:28.970901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T12:51:42.239112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"80'1","reported_seq":21,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:26:24.127627+0000","last_change":"2024-05-08T05:25:34.061014+0000","last_active":"2024-05-08T05:26:24.127627+0000","last_peered":"2024-05-08T05:26:24.127627+0000","last_clean":"2024-05-08T05:26:24.127627+0000","last_became_active":"2024-05-08T05:25:34.060682+0000","last_became_peered":"2024-05-08T05:25:34.060682+0000","last_unstale":"2024-05-08T05:26:24.127627+0000","last_undegraded":"2024-05-08T05:26:24.127627+0000","last_fullsized":"2024-05-08T05:26:24.127627+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_clean_scrub_stamp":"2024-05-08T05:25:33.008741+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T13:19:48.652257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"80'1","reported_seq":27,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:26:24.116010+0000","last_change":"2024-05-08T05:25:30.009360+0000","last_active":"2024-05-08T05:26:24.116010+0000","last_peered":"2024-05-08T05:26:24.116010+0000","last_clean":"2024-05-08T05:26:24.116010+0000","last_became_active":"2024-05-08T05:25:30.008806+0000","last_became_peered":"2024-05-08T05:25:30.008806+0000","last_unstale":"2024-05-08T05:26:24.116010+0000","last_undegraded":"2024-05-08T05:26:24.116010+0000","last_fullsized":"2024-05-08T05:26:24.116010+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:28.970901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:28.970901+0000","last_clean_scrub_stamp":"2024-05-08T05:25:28.970901+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T11:19:45.905803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:26:24.127616+0000","last_change":"2024-05-08T05:25:34.065415+0000","last_active":"2024-05-08T05:26:24.127616+0000","last_peered":"2024-05-08T05:26:24.127616+0000","last_clean":"2024-05-08T05:26:24.127616+0000","last_became_active":"2024-05-08T05:25:34.065017+0000","last_became_peered":"2024-05-08T05:25:34.065017+0000","last_unstale":"2024-05-08T05:26:24.127616+0000","last_undegraded":"2024-05-08T05:26:24.127616+0000","last_fullsized":"2024-05-08T05:26:24.127616+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_clean_scrub_stamp":"2024-05-08T05:25:33.008741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T14:46:34.518792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:26:24.120480+0000","last_change":"2024-05-08T05:26:24.120480+0000","last_active":"2024-05-08T05:26:24.120480+0000","last_peered":"2024-05-08T05:26:24.120480+0000","last_clean":"2024-05-08T05:26:24.120480+0000","last_became_active":"2024-05-08T05:26:24.120031+0000","last_became_peered":"2024-05-08T05:26:24.120031+0000","last_unstale":"2024-05-08T05:26:24.120480+0000","last_undegraded":"2024-05-08T05:26:24.120480+0000","last_fullsized":"2024-05-08T05:26:24.120480+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_clean_scrub_stamp":"2024-05-08T05:25:33.008741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T09:24:18.149796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,8],"acting":[5,2,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"80'4","reported_seq":62,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:26:26.026641+0000","last_change":"2024-05-08T05:25:30.356178+0000","last_active":"2024-05-08T05:26:26.026641+0000","last_peered":"2024-05-08T05:26:26.026641+0000","last_clean":"2024-05-08T05:26:26.026641+0000","last_became_active":"2024-05-08T05:25:30.355750+0000","last_became_peered":"2024-05-08T05:25:30.355750+0000","last_unstale":"2024-05-08T05:26:26.026641+0000","last_undegraded":"2024-05-08T05:26:26.026641+0000","last_fullsized":"2024-05-08T05:26:26.026641+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:28.970901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:28.970901+0000","last_clean_scrub_stamp":"2024-05-08T05:25:28.970901+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T05:57:35.174274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":32,"num_read_kb":32,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:26:24.121720+0000","last_change":"2024-05-08T05:25:34.068189+0000","last_active":"2024-05-08T05:26:24.121720+0000","last_peered":"2024-05-08T05:26:24.121720+0000","last_clean":"2024-05-08T05:26:24.121720+0000","last_became_active":"2024-05-08T05:25:34.064398+0000","last_became_peered":"2024-05-08T05:25:34.064398+0000","last_unstale":"2024-05-08T05:26:24.121720+0000","last_undegraded":"2024-05-08T05:26:24.121720+0000","last_fullsized":"2024-05-08T05:26:24.121720+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_clean_scrub_stamp":"2024-05-08T05:25:33.008741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T10:27:31.050126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"80'3","reported_seq":31,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:26:24.126746+0000","last_change":"2024-05-08T05:25:30.005110+0000","last_active":"2024-05-08T05:26:24.126746+0000","last_peered":"2024-05-08T05:26:24.126746+0000","last_clean":"2024-05-08T05:26:24.126746+0000","last_became_active":"2024-05-08T05:25:30.004703+0000","last_became_peered":"2024-05-08T05:25:30.004703+0000","last_unstale":"2024-05-08T05:26:24.126746+0000","last_undegraded":"2024-05-08T05:26:24.126746+0000","last_fullsized":"2024-05-08T05:26:24.126746+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:28.970901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:28.970901+0000","last_clean_scrub_stamp":"2024-05-08T05:25:28.970901+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T12:49:21.174417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"21'92","reported_seq":100,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:26:24.115593+0000","last_change":"2024-05-08T05:23:59.731023+0000","last_active":"2024-05-08T05:26:24.115593+0000","last_peered":"2024-05-08T05:26:24.115593+0000","last_clean":"2024-05-08T05:26:24.115593+0000","last_became_active":"2024-05-08T05:23:59.725321+0000","last_became_peered":"2024-05-08T05:23:59.725321+0000","last_unstale":"2024-05-08T05:26:24.115593+0000","last_undegraded":"2024-05-08T05:26:24.115593+0000","last_fullsized":"2024-05-08T05:26:24.115593+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:20:09.357011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:20:09.357011+0000","last_clean_scrub_stamp":"2024-05-08T05:20:09.357011+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T09:50:58.729815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:26:24.131360+0000","last_change":"2024-05-08T05:26:24.131360+0000","last_active":"2024-05-08T05:26:24.131360+0000","last_peered":"2024-05-08T05:26:24.131360+0000","last_clean":"2024-05-08T05:26:24.131360+0000","last_became_active":"2024-05-08T05:26:24.130480+0000","last_became_peered":"2024-05-08T05:26:24.130480+0000","last_unstale":"2024-05-08T05:26:24.131360+0000","last_undegraded":"2024-05-08T05:26:24.131360+0000","last_fullsized":"2024-05-08T05:26:24.131360+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_clean_scrub_stamp":"2024-05-08T05:25:33.008741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T09:26:32.515332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,9,2],"acting":[6,9,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"80'3","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:26:24.115740+0000","last_change":"2024-05-08T05:25:29.999659+0000","last_active":"2024-05-08T05:26:24.115740+0000","last_peered":"2024-05-08T05:26:24.115740+0000","last_clean":"2024-05-08T05:26:24.115740+0000","last_became_active":"2024-05-08T05:25:29.999299+0000","last_became_peered":"2024-05-08T05:25:29.999299+0000","last_unstale":"2024-05-08T05:26:24.115740+0000","last_undegraded":"2024-05-08T05:26:24.115740+0000","last_fullsized":"2024-05-08T05:26:24.115740+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:28.970901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:28.970901+0000","last_clean_scrub_stamp":"2024-05-08T05:25:28.970901+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T11:20:16.513402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"80'1","reported_seq":28,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:26:24.116043+0000","last_change":"2024-05-08T05:25:30.360940+0000","last_active":"2024-05-08T05:26:24.116043+0000","last_peered":"2024-05-08T05:26:24.116043+0000","last_clean":"2024-05-08T05:26:24.116043+0000","last_became_active":"2024-05-08T05:25:30.360507+0000","last_became_peered":"2024-05-08T05:25:30.360507+0000","last_unstale":"2024-05-08T05:26:24.116043+0000","last_undegraded":"2024-05-08T05:26:24.116043+0000","last_fullsized":"2024-05-08T05:26:24.116043+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:28.970901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:28.970901+0000","last_clean_scrub_stamp":"2024-05-08T05:25:28.970901+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T06:49:39.271211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:26:24.116409+0000","last_change":"2024-05-08T05:25:34.056952+0000","last_active":"2024-05-08T05:26:24.116409+0000","last_peered":"2024-05-08T05:26:24.116409+0000","last_clean":"2024-05-08T05:26:24.116409+0000","last_became_active":"2024-05-08T05:25:34.056495+0000","last_became_peered":"2024-05-08T05:25:34.056495+0000","last_unstale":"2024-05-08T05:26:24.116409+0000","last_undegraded":"2024-05-08T05:26:24.116409+0000","last_fullsized":"2024-05-08T05:26:24.116409+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_clean_scrub_stamp":"2024-05-08T05:25:33.008741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T09:35:22.540178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"81'11","reported_seq":37,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:26:24.133014+0000","last_change":"2024-05-08T05:25:30.008967+0000","last_active":"2024-05-08T05:26:24.133014+0000","last_peered":"2024-05-08T05:26:24.133014+0000","last_clean":"2024-05-08T05:26:24.133014+0000","last_became_active":"2024-05-08T05:25:30.007542+0000","last_became_peered":"2024-05-08T05:25:30.007542+0000","last_unstale":"2024-05-08T05:26:24.133014+0000","last_undegraded":"2024-05-08T05:26:24.133014+0000","last_fullsized":"2024-05-08T05:26:24.133014+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:28.970901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:28.970901+0000","last_clean_scrub_stamp":"2024-05-08T05:25:28.970901+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T05:29:30.191842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:26:24.123545+0000","last_change":"2024-05-08T05:25:34.054334+0000","last_active":"2024-05-08T05:26:24.123545+0000","last_peered":"2024-05-08T05:26:24.123545+0000","last_clean":"2024-05-08T05:26:24.123545+0000","last_became_active":"2024-05-08T05:25:34.053989+0000","last_became_peered":"2024-05-08T05:25:34.053989+0000","last_unstale":"2024-05-08T05:26:24.123545+0000","last_undegraded":"2024-05-08T05:26:24.123545+0000","last_fullsized":"2024-05-08T05:26:24.123545+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_clean_scrub_stamp":"2024-05-08T05:25:33.008741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T09:03:25.683445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"80'4","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:26:24.127007+0000","last_change":"2024-05-08T05:25:30.007144+0000","last_active":"2024-05-08T05:26:24.127007+0000","last_peered":"2024-05-08T05:26:24.127007+0000","last_clean":"2024-05-08T05:26:24.127007+0000","last_became_active":"2024-05-08T05:25:30.006878+0000","last_became_peered":"2024-05-08T05:25:30.006878+0000","last_unstale":"2024-05-08T05:26:24.127007+0000","last_undegraded":"2024-05-08T05:26:24.127007+0000","last_fullsized":"2024-05-08T05:26:24.127007+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:28.970901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:28.970901+0000","last_clean_scrub_stamp":"2024-05-08T05:25:28.970901+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T07:06:35.573001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:26:24.131455+0000","last_change":"2024-05-08T05:25:34.073744+0000","last_active":"2024-05-08T05:26:24.131455+0000","last_peered":"2024-05-08T05:26:24.131455+0000","last_clean":"2024-05-08T05:26:24.131455+0000","last_became_active":"2024-05-08T05:25:34.073368+0000","last_became_peered":"2024-05-08T05:25:34.073368+0000","last_unstale":"2024-05-08T05:26:24.131455+0000","last_undegraded":"2024-05-08T05:26:24.131455+0000","last_fullsized":"2024-05-08T05:26:24.131455+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_clean_scrub_stamp":"2024-05-08T05:25:33.008741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T10:43:31.480745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"80'2","reported_seq":28,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:26:24.112913+0000","last_change":"2024-05-08T05:25:30.356584+0000","last_active":"2024-05-08T05:26:24.112913+0000","last_peered":"2024-05-08T05:26:24.112913+0000","last_clean":"2024-05-08T05:26:24.112913+0000","last_became_active":"2024-05-08T05:25:30.356203+0000","last_became_peered":"2024-05-08T05:25:30.356203+0000","last_unstale":"2024-05-08T05:26:24.112913+0000","last_undegraded":"2024-05-08T05:26:24.112913+0000","last_fullsized":"2024-05-08T05:26:24.112913+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:28.970901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:28.970901+0000","last_clean_scrub_stamp":"2024-05-08T05:25:28.970901+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T14:35:21.193856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:26:24.115733+0000","last_change":"2024-05-08T05:25:34.053168+0000","last_active":"2024-05-08T05:26:24.115733+0000","last_peered":"2024-05-08T05:26:24.115733+0000","last_clean":"2024-05-08T05:26:24.115733+0000","last_became_active":"2024-05-08T05:25:34.052875+0000","last_became_peered":"2024-05-08T05:25:34.052875+0000","last_unstale":"2024-05-08T05:26:24.115733+0000","last_undegraded":"2024-05-08T05:26:24.115733+0000","last_fullsized":"2024-05-08T05:26:24.115733+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_clean_scrub_stamp":"2024-05-08T05:25:33.008741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T07:38:40.129212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"80'3","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:26:24.121700+0000","last_change":"2024-05-08T05:25:30.009113+0000","last_active":"2024-05-08T05:26:24.121700+0000","last_peered":"2024-05-08T05:26:24.121700+0000","last_clean":"2024-05-08T05:26:24.121700+0000","last_became_active":"2024-05-08T05:25:30.007605+0000","last_became_peered":"2024-05-08T05:25:30.007605+0000","last_unstale":"2024-05-08T05:26:24.121700+0000","last_undegraded":"2024-05-08T05:26:24.121700+0000","last_fullsized":"2024-05-08T05:26:24.121700+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:28.970901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:28.970901+0000","last_clean_scrub_stamp":"2024-05-08T05:25:28.970901+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T10:06:05.177516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":18,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:26:24.112746+0000","last_change":"2024-05-08T05:25:34.072765+0000","last_active":"2024-05-08T05:26:24.112746+0000","last_peered":"2024-05-08T05:26:24.112746+0000","last_clean":"2024-05-08T05:26:24.112746+0000","last_became_active":"2024-05-08T05:25:34.072381+0000","last_became_peered":"2024-05-08T05:25:34.072381+0000","last_unstale":"2024-05-08T05:26:24.112746+0000","last_undegraded":"2024-05-08T05:26:24.112746+0000","last_fullsized":"2024-05-08T05:26:24.112746+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_clean_scrub_stamp":"2024-05-08T05:25:33.008741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T11:55:21.046126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"80'1","reported_seq":15,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:26:24.125393+0000","last_change":"2024-05-08T05:26:24.124762+0000","last_active":"2024-05-08T05:26:24.125393+0000","last_peered":"2024-05-08T05:26:24.125393+0000","last_clean":"2024-05-08T05:26:24.125393+0000","last_became_active":"2024-05-08T05:26:24.121235+0000","last_became_peered":"2024-05-08T05:26:24.121235+0000","last_unstale":"2024-05-08T05:26:24.125393+0000","last_undegraded":"2024-05-08T05:26:24.125393+0000","last_fullsized":"2024-05-08T05:26:24.125393+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:28.970901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:28.970901+0000","last_clean_scrub_stamp":"2024-05-08T05:25:28.970901+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T16:08:17.650335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,3,8],"acting":[11,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:26:24.122711+0000","last_change":"2024-05-08T05:25:34.071097+0000","last_active":"2024-05-08T05:26:24.122711+0000","last_peered":"2024-05-08T05:26:24.122711+0000","last_clean":"2024-05-08T05:26:24.122711+0000","last_became_active":"2024-05-08T05:25:34.070635+0000","last_became_peered":"2024-05-08T05:25:34.070635+0000","last_unstale":"2024-05-08T05:26:24.122711+0000","last_undegraded":"2024-05-08T05:26:24.122711+0000","last_fullsized":"2024-05-08T05:26:24.122711+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_clean_scrub_stamp":"2024-05-08T05:25:33.008741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T13:33:17.217958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"80'4","reported_seq":31,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:26:24.116671+0000","last_change":"2024-05-08T05:25:30.002043+0000","last_active":"2024-05-08T05:26:24.116671+0000","last_peered":"2024-05-08T05:26:24.116671+0000","last_clean":"2024-05-08T05:26:24.116671+0000","last_became_active":"2024-05-08T05:25:30.001624+0000","last_became_peered":"2024-05-08T05:25:30.001624+0000","last_unstale":"2024-05-08T05:26:24.116671+0000","last_undegraded":"2024-05-08T05:26:24.116671+0000","last_fullsized":"2024-05-08T05:26:24.116671+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:28.970901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:28.970901+0000","last_clean_scrub_stamp":"2024-05-08T05:25:28.970901+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T07:20:34.740005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:26:24.116049+0000","last_change":"2024-05-08T05:25:34.057883+0000","last_active":"2024-05-08T05:26:24.116049+0000","last_peered":"2024-05-08T05:26:24.116049+0000","last_clean":"2024-05-08T05:26:24.116049+0000","last_became_active":"2024-05-08T05:25:34.056651+0000","last_became_peered":"2024-05-08T05:25:34.056651+0000","last_unstale":"2024-05-08T05:26:24.116049+0000","last_undegraded":"2024-05-08T05:26:24.116049+0000","last_fullsized":"2024-05-08T05:26:24.116049+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_clean_scrub_stamp":"2024-05-08T05:25:33.008741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T16:52:46.598847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"80'3","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:26:24.116021+0000","last_change":"2024-05-08T05:25:30.356166+0000","last_active":"2024-05-08T05:26:24.116021+0000","last_peered":"2024-05-08T05:26:24.116021+0000","last_clean":"2024-05-08T05:26:24.116021+0000","last_became_active":"2024-05-08T05:25:30.355730+0000","last_became_peered":"2024-05-08T05:25:30.355730+0000","last_unstale":"2024-05-08T05:26:24.116021+0000","last_undegraded":"2024-05-08T05:26:24.116021+0000","last_fullsized":"2024-05-08T05:26:24.116021+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:28.970901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:28.970901+0000","last_clean_scrub_stamp":"2024-05-08T05:25:28.970901+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T05:47:47.743725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:26:24.116095+0000","last_change":"2024-05-08T05:25:34.058005+0000","last_active":"2024-05-08T05:26:24.116095+0000","last_peered":"2024-05-08T05:26:24.116095+0000","last_clean":"2024-05-08T05:26:24.116095+0000","last_became_active":"2024-05-08T05:25:34.056319+0000","last_became_peered":"2024-05-08T05:25:34.056319+0000","last_unstale":"2024-05-08T05:26:24.116095+0000","last_undegraded":"2024-05-08T05:26:24.116095+0000","last_fullsized":"2024-05-08T05:26:24.116095+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_clean_scrub_stamp":"2024-05-08T05:25:33.008741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T07:04:22.726450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"80'1","reported_seq":28,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:26:24.118569+0000","last_change":"2024-05-08T05:25:30.009641+0000","last_active":"2024-05-08T05:26:24.118569+0000","last_peered":"2024-05-08T05:26:24.118569+0000","last_clean":"2024-05-08T05:26:24.118569+0000","last_became_active":"2024-05-08T05:25:30.009244+0000","last_became_peered":"2024-05-08T05:25:30.009244+0000","last_unstale":"2024-05-08T05:26:24.118569+0000","last_undegraded":"2024-05-08T05:26:24.118569+0000","last_fullsized":"2024-05-08T05:26:24.118569+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:28.970901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:28.970901+0000","last_clean_scrub_stamp":"2024-05-08T05:25:28.970901+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T17:15:50.982103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"80'1","reported_seq":21,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:26:24.115963+0000","last_change":"2024-05-08T05:25:34.059603+0000","last_active":"2024-05-08T05:26:24.115963+0000","last_peered":"2024-05-08T05:26:24.115963+0000","last_clean":"2024-05-08T05:26:24.115963+0000","last_became_active":"2024-05-08T05:25:34.059260+0000","last_became_peered":"2024-05-08T05:25:34.059260+0000","last_unstale":"2024-05-08T05:26:24.115963+0000","last_undegraded":"2024-05-08T05:26:24.115963+0000","last_fullsized":"2024-05-08T05:26:24.115963+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_clean_scrub_stamp":"2024-05-08T05:25:33.008741+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T07:47:32.723829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"80'2","reported_seq":28,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:26:24.116997+0000","last_change":"2024-05-08T05:25:30.013326+0000","last_active":"2024-05-08T05:26:24.116997+0000","last_peered":"2024-05-08T05:26:24.116997+0000","last_clean":"2024-05-08T05:26:24.116997+0000","last_became_active":"2024-05-08T05:25:30.012868+0000","last_became_peered":"2024-05-08T05:25:30.012868+0000","last_unstale":"2024-05-08T05:26:24.116997+0000","last_undegraded":"2024-05-08T05:26:24.116997+0000","last_fullsized":"2024-05-08T05:26:24.116997+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:28.970901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:28.970901+0000","last_clean_scrub_stamp":"2024-05-08T05:25:28.970901+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T14:09:14.210180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:26:24.115985+0000","last_change":"2024-05-08T05:25:34.052621+0000","last_active":"2024-05-08T05:26:24.115985+0000","last_peered":"2024-05-08T05:26:24.115985+0000","last_clean":"2024-05-08T05:26:24.115985+0000","last_became_active":"2024-05-08T05:25:34.052289+0000","last_became_peered":"2024-05-08T05:25:34.052289+0000","last_unstale":"2024-05-08T05:26:24.115985+0000","last_undegraded":"2024-05-08T05:26:24.115985+0000","last_fullsized":"2024-05-08T05:26:24.115985+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_clean_scrub_stamp":"2024-05-08T05:25:33.008741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T16:37:19.327915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":18,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:26:24.112906+0000","last_change":"2024-05-08T05:25:34.057918+0000","last_active":"2024-05-08T05:26:24.112906+0000","last_peered":"2024-05-08T05:26:24.112906+0000","last_clean":"2024-05-08T05:26:24.112906+0000","last_became_active":"2024-05-08T05:25:34.057455+0000","last_became_peered":"2024-05-08T05:25:34.057455+0000","last_unstale":"2024-05-08T05:26:24.112906+0000","last_undegraded":"2024-05-08T05:26:24.112906+0000","last_fullsized":"2024-05-08T05:26:24.112906+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_clean_scrub_stamp":"2024-05-08T05:25:33.008741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T11:36:49.027414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:26:24.115679+0000","last_change":"2024-05-08T05:25:34.055114+0000","last_active":"2024-05-08T05:26:24.115679+0000","last_peered":"2024-05-08T05:26:24.115679+0000","last_clean":"2024-05-08T05:26:24.115679+0000","last_became_active":"2024-05-08T05:25:34.054448+0000","last_became_peered":"2024-05-08T05:25:34.054448+0000","last_unstale":"2024-05-08T05:26:24.115679+0000","last_undegraded":"2024-05-08T05:26:24.115679+0000","last_fullsized":"2024-05-08T05:26:24.115679+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_clean_scrub_stamp":"2024-05-08T05:25:33.008741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T15:19:54.872779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:26:24.115280+0000","last_change":"2024-05-08T05:25:34.064199+0000","last_active":"2024-05-08T05:26:24.115280+0000","last_peered":"2024-05-08T05:26:24.115280+0000","last_clean":"2024-05-08T05:26:24.115280+0000","last_became_active":"2024-05-08T05:25:34.063888+0000","last_became_peered":"2024-05-08T05:25:34.063888+0000","last_unstale":"2024-05-08T05:26:24.115280+0000","last_undegraded":"2024-05-08T05:26:24.115280+0000","last_fullsized":"2024-05-08T05:26:24.115280+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_clean_scrub_stamp":"2024-05-08T05:25:33.008741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T13:18:15.146769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:26:24.130081+0000","last_change":"2024-05-08T05:25:34.070526+0000","last_active":"2024-05-08T05:26:24.130081+0000","last_peered":"2024-05-08T05:26:24.130081+0000","last_clean":"2024-05-08T05:26:24.130081+0000","last_became_active":"2024-05-08T05:25:34.069890+0000","last_became_peered":"2024-05-08T05:25:34.069890+0000","last_unstale":"2024-05-08T05:26:24.130081+0000","last_undegraded":"2024-05-08T05:26:24.130081+0000","last_fullsized":"2024-05-08T05:26:24.130081+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_clean_scrub_stamp":"2024-05-08T05:25:33.008741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T16:17:56.986221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:26:24.116160+0000","last_change":"2024-05-08T05:25:34.067033+0000","last_active":"2024-05-08T05:26:24.116160+0000","last_peered":"2024-05-08T05:26:24.116160+0000","last_clean":"2024-05-08T05:26:24.116160+0000","last_became_active":"2024-05-08T05:25:34.066492+0000","last_became_peered":"2024-05-08T05:25:34.066492+0000","last_unstale":"2024-05-08T05:26:24.116160+0000","last_undegraded":"2024-05-08T05:26:24.116160+0000","last_fullsized":"2024-05-08T05:26:24.116160+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_clean_scrub_stamp":"2024-05-08T05:25:33.008741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T07:30:10.450504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":18,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:26:24.113223+0000","last_change":"2024-05-08T05:25:34.056525+0000","last_active":"2024-05-08T05:26:24.113223+0000","last_peered":"2024-05-08T05:26:24.113223+0000","last_clean":"2024-05-08T05:26:24.113223+0000","last_became_active":"2024-05-08T05:25:34.056190+0000","last_became_peered":"2024-05-08T05:25:34.056190+0000","last_unstale":"2024-05-08T05:26:24.113223+0000","last_undegraded":"2024-05-08T05:26:24.113223+0000","last_fullsized":"2024-05-08T05:26:24.113223+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_clean_scrub_stamp":"2024-05-08T05:25:33.008741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T13:13:57.716642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:26:24.115904+0000","last_change":"2024-05-08T05:25:34.055643+0000","last_active":"2024-05-08T05:26:24.115904+0000","last_peered":"2024-05-08T05:26:24.115904+0000","last_clean":"2024-05-08T05:26:24.115904+0000","last_became_active":"2024-05-08T05:25:34.054886+0000","last_became_peered":"2024-05-08T05:25:34.054886+0000","last_unstale":"2024-05-08T05:26:24.115904+0000","last_undegraded":"2024-05-08T05:26:24.115904+0000","last_fullsized":"2024-05-08T05:26:24.115904+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_clean_scrub_stamp":"2024-05-08T05:25:33.008741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T05:53:41.130484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:26:24.123415+0000","last_change":"2024-05-08T05:25:34.056932+0000","last_active":"2024-05-08T05:26:24.123415+0000","last_peered":"2024-05-08T05:26:24.123415+0000","last_clean":"2024-05-08T05:26:24.123415+0000","last_became_active":"2024-05-08T05:25:34.055473+0000","last_became_peered":"2024-05-08T05:25:34.055473+0000","last_unstale":"2024-05-08T05:26:24.123415+0000","last_undegraded":"2024-05-08T05:26:24.123415+0000","last_fullsized":"2024-05-08T05:26:24.123415+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_clean_scrub_stamp":"2024-05-08T05:25:33.008741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T16:16:13.748056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":11,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:26:24.136945+0000","last_change":"2024-05-08T05:26:24.134794+0000","last_active":"2024-05-08T05:26:24.136945+0000","last_peered":"2024-05-08T05:26:24.136945+0000","last_clean":"2024-05-08T05:26:24.136945+0000","last_became_active":"2024-05-08T05:26:24.133586+0000","last_became_peered":"2024-05-08T05:26:24.133586+0000","last_unstale":"2024-05-08T05:26:24.136945+0000","last_undegraded":"2024-05-08T05:26:24.136945+0000","last_fullsized":"2024-05-08T05:26:24.136945+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_clean_scrub_stamp":"2024-05-08T05:25:33.008741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T15:03:05.432689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,9,3],"acting":[6,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:26:24.121353+0000","last_change":"2024-05-08T05:25:34.065000+0000","last_active":"2024-05-08T05:26:24.121353+0000","last_peered":"2024-05-08T05:26:24.121353+0000","last_clean":"2024-05-08T05:26:24.121353+0000","last_became_active":"2024-05-08T05:25:34.057748+0000","last_became_peered":"2024-05-08T05:25:34.057748+0000","last_unstale":"2024-05-08T05:26:24.121353+0000","last_undegraded":"2024-05-08T05:26:24.121353+0000","last_fullsized":"2024-05-08T05:26:24.121353+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_clean_scrub_stamp":"2024-05-08T05:25:33.008741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T15:33:41.411507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:26:24.113121+0000","last_change":"2024-05-08T05:25:34.066601+0000","last_active":"2024-05-08T05:26:24.113121+0000","last_peered":"2024-05-08T05:26:24.113121+0000","last_clean":"2024-05-08T05:26:24.113121+0000","last_became_active":"2024-05-08T05:25:34.066226+0000","last_became_peered":"2024-05-08T05:25:34.066226+0000","last_unstale":"2024-05-08T05:26:24.113121+0000","last_undegraded":"2024-05-08T05:26:24.113121+0000","last_fullsized":"2024-05-08T05:26:24.113121+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_clean_scrub_stamp":"2024-05-08T05:25:33.008741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T15:27:54.180580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:26:24.115374+0000","last_change":"2024-05-08T05:25:34.073520+0000","last_active":"2024-05-08T05:26:24.115374+0000","last_peered":"2024-05-08T05:26:24.115374+0000","last_clean":"2024-05-08T05:26:24.115374+0000","last_became_active":"2024-05-08T05:25:34.072250+0000","last_became_peered":"2024-05-08T05:25:34.072250+0000","last_unstale":"2024-05-08T05:26:24.115374+0000","last_undegraded":"2024-05-08T05:26:24.115374+0000","last_fullsized":"2024-05-08T05:26:24.115374+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_clean_scrub_stamp":"2024-05-08T05:25:33.008741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T08:17:36.181338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:26:24.134964+0000","last_change":"2024-05-08T05:26:24.134964+0000","last_active":"2024-05-08T05:26:24.134964+0000","last_peered":"2024-05-08T05:26:24.134964+0000","last_clean":"2024-05-08T05:26:24.134964+0000","last_became_active":"2024-05-08T05:26:24.134583+0000","last_became_peered":"2024-05-08T05:26:24.134583+0000","last_unstale":"2024-05-08T05:26:24.134964+0000","last_undegraded":"2024-05-08T05:26:24.134964+0000","last_fullsized":"2024-05-08T05:26:24.134964+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_clean_scrub_stamp":"2024-05-08T05:25:33.008741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T16:09:52.525461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,8],"acting":[11,9,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":192,"acting":192,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":3563520,"data_stored":3542208,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":92,"ondisk_log_size":92,"up":3,"acting":3,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":67464,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":225,"num_read_kb":184,"num_write":165,"num_write_kb":113,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":10,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":430080,"data_stored":202392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":141,"ondisk_log_size":141,"up":96,"acting":96,"num_store_stats":12}],"osd_stats":[{"osd":11,"up_from":72,"seq":309237645338,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27892,"kb_used_data":868,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717260,"statfs":{"total":95995035648,"available":95966474240,"internally_reserved":0,"allocated":888832,"data_stored":437056,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":66,"seq":283467841569,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32728,"kb_used_data":1552,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712424,"statfs":{"total":95995035648,"available":95961522176,"internally_reserved":0,"allocated":1589248,"data_stored":1092000,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":31914432},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":60,"seq":257698037797,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32064,"kb_used_data":884,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713088,"statfs":{"total":95995035648,"available":95962202112,"internally_reserved":0,"allocated":905216,"data_stored":437292,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":31914432},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":8,"up_from":54,"seq":231928234027,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27904,"kb_used_data":884,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717248,"statfs":{"total":95995035648,"available":95966461952,"internally_reserved":0,"allocated":905216,"data_stored":437212,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":48,"seq":206158430258,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32648,"kb_used_data":1464,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712504,"statfs":{"total":95995035648,"available":95961604096,"internally_reserved":0,"allocated":1499136,"data_stored":1029533,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":42,"seq":180388626487,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36212,"kb_used_data":872,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708940,"statfs":{"total":95995035648,"available":95957954560,"internally_reserved":0,"allocated":892928,"data_stored":436681,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574932,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27952,"kb_used_data":936,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717200,"statfs":{"total":95995035648,"available":95966412800,"internally_reserved":0,"allocated":958464,"data_stored":499546,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738456,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36236,"kb_used_data":892,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708916,"statfs":{"total":95995035648,"available":95957929984,"internally_reserved":0,"allocated":913408,"data_stored":437952,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411406,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27976,"kb_used_data":960,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717176,"statfs":{"total":95995035648,"available":95966388224,"internally_reserved":0,"allocated":983040,"data_stored":501287,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":25,"seq":107374182471,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27908,"kb_used_data":888,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717244,"statfs":{"total":95995035648,"available":95966457856,"internally_reserved":0,"allocated":909312,"data_stored":436992,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":31,"seq":133143986243,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32060,"kb_used_data":876,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713092,"statfs":{"total":95995035648,"available":95962206208,"internally_reserved":0,"allocated":897024,"data_stored":437509,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":36,"seq":154618822717,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28496,"kb_used_data":1476,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716656,"statfs":{"total":95995035648,"available":95965855744,"internally_reserved":0,"allocated":1511424,"data_stored":1028826,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":63072,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":64813,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1035,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1867,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2574,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":106496,"data_stored":65041,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-08T05:26:33.744 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2024-05-08T05:26:33.744 INFO:tasks.cephadm:Setting up client nodes... 2024-05-08T05:26:33.745 DEBUG:teuthology.orchestra.run.smithi087:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid eeeb813e-0cf9-11ef-bc97-c7b262605968 -- ceph auth get-or-create client.0 mon 'allow *' osd 'allow *' mds 'allow *' mgr 'allow *' 2024-05-08T05:26:33.958 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:26:33 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:26:33.958 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:26:33 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:26:33.959 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:26:33 smithi087 ceph-mon[29523]: from='client.24626 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-05-08T05:26:33.959 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:26:33 smithi087 ceph-mon[29523]: pgmap v347: 97 pgs: 97 active+clean; 643 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 1.2 KiB/s wr, 7 op/s; 0 B/s, 1 keys/s, 0 objects/s recovering 2024-05-08T05:26:34.210 INFO:teuthology.orchestra.run.smithi087.stderr:Inferring config /var/lib/ceph/eeeb813e-0cf9-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T05:26:34.233 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:26:33 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:26:34.233 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:26:33 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:26:34.234 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:26:33 smithi090 ceph-mon[34526]: from='client.24626 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-05-08T05:26:34.234 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:26:33 smithi090 ceph-mon[34526]: pgmap v347: 97 pgs: 97 active+clean; 643 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 1.2 KiB/s wr, 7 op/s; 0 B/s, 1 keys/s, 0 objects/s recovering 2024-05-08T05:26:34.289 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:26:33 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:26:34.289 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:26:33 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:26:34.289 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:26:33 smithi160 ceph-mon[34827]: from='client.24626 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-05-08T05:26:34.289 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:26:33 smithi160 ceph-mon[34827]: pgmap v347: 97 pgs: 97 active+clean; 643 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 1.2 KiB/s wr, 7 op/s; 0 B/s, 1 keys/s, 0 objects/s recovering 2024-05-08T05:26:34.958 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:26:34 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T05:26:34.958 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:26:34 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T05:26:34.959 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:26:34 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:26:35.233 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:26:34 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T05:26:35.234 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:26:34 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T05:26:35.234 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:26:34 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:26:35.288 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:26:34 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T05:26:35.288 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:26:34 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T05:26:35.289 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:26:34 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:26:35.959 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:26:35 smithi087 ceph-mon[29523]: pgmap v348: 97 pgs: 97 active+clean; 644 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 663 B/s wr, 6 op/s; 0 B/s, 0 keys/s, 0 objects/s recovering 2024-05-08T05:26:36.190 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:26:35 smithi160 ceph-mon[34827]: pgmap v348: 97 pgs: 97 active+clean; 644 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 663 B/s wr, 6 op/s; 0 B/s, 0 keys/s, 0 objects/s recovering 2024-05-08T05:26:36.233 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:26:35 smithi090 ceph-mon[34526]: pgmap v348: 97 pgs: 97 active+clean; 644 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 663 B/s wr, 6 op/s; 0 B/s, 0 keys/s, 0 objects/s recovering 2024-05-08T05:26:36.450 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:36.448+0000 7f5fbe400700 1 -- 172.21.15.87:0/4026539204 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5fb8075f00 msgr2=0x7f5fb8076380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:26:36.450 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:36.448+0000 7f5fbe400700 1 --2- 172.21.15.87:0/4026539204 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5fb8075f00 0x7f5fb8076380 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f5fa4009990 tx=0x7f5fa4009ca0 comp rx=0 tx=0).stop 2024-05-08T05:26:36.450 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:36.448+0000 7f5fbe400700 1 -- 172.21.15.87:0/4026539204 shutdown_connections 2024-05-08T05:26:36.450 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:36.448+0000 7f5fbe400700 1 --2- 172.21.15.87:0/4026539204 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5fb810f950 0x7f5fb8111d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:26:36.450 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:36.448+0000 7f5fbe400700 1 --2- 172.21.15.87:0/4026539204 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5fb80774d0 0x7f5fb8075930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:26:36.450 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:36.448+0000 7f5fbe400700 1 --2- 172.21.15.87:0/4026539204 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5fb8075f00 0x7f5fb8076380 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:26:36.450 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:36.448+0000 7f5fbe400700 1 -- 172.21.15.87:0/4026539204 >> 172.21.15.87:0/4026539204 conn(0x7f5fb80fe910 msgr2=0x7f5fb8100d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:26:36.450 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:36.449+0000 7f5fbe400700 1 -- 172.21.15.87:0/4026539204 shutdown_connections 2024-05-08T05:26:36.451 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:36.449+0000 7f5fbe400700 1 -- 172.21.15.87:0/4026539204 wait complete. 2024-05-08T05:26:36.451 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:36.450+0000 7f5fbe400700 1 Processor -- start 2024-05-08T05:26:36.451 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:36.450+0000 7f5fbe400700 1 -- start start 2024-05-08T05:26:36.452 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:36.450+0000 7f5fbe400700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5fb8075f00 0x7f5fb819fa90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:26:36.452 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:36.450+0000 7f5fbe400700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5fb80774d0 0x7f5fb819ffd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:26:36.452 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:36.450+0000 7f5fbe400700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5fb810f950 0x7f5fb81a7000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:26:36.452 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:36.450+0000 7f5fbe400700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f5fb8115400 con 0x7f5fb810f950 2024-05-08T05:26:36.452 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:36.450+0000 7f5fbe400700 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f5fb8115280 con 0x7f5fb8075f00 2024-05-08T05:26:36.452 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:36.450+0000 7f5fbe400700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f5fb8115580 con 0x7f5fb80774d0 2024-05-08T05:26:36.452 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:36.450+0000 7f5fbd000700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5fb8075f00 0x7f5fb819fa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:26:36.453 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:36.450+0000 7f5fbd000700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5fb8075f00 0x7f5fb819fa90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.87:35346/0 (socket says 172.21.15.87:35346) 2024-05-08T05:26:36.453 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:36.450+0000 7f5fbd000700 1 -- 172.21.15.87:0/3832693482 learned_addr learned my addr 172.21.15.87:0/3832693482 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T05:26:36.453 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:36.451+0000 7f5fbda00700 1 --2- 172.21.15.87:0/3832693482 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5fb810f950 0x7f5fb81a7000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:26:36.453 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:36.451+0000 7f5fb7e00700 1 --2- 172.21.15.87:0/3832693482 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5fb80774d0 0x7f5fb819ffd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:26:36.453 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:36.451+0000 7f5fbd000700 1 -- 172.21.15.87:0/3832693482 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5fb80774d0 msgr2=0x7f5fb819ffd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:26:36.453 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:36.451+0000 7f5fbd000700 1 --2- 172.21.15.87:0/3832693482 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5fb80774d0 0x7f5fb819ffd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:26:36.453 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:36.451+0000 7f5fbd000700 1 -- 172.21.15.87:0/3832693482 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5fb810f950 msgr2=0x7f5fb81a7000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:26:36.453 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:36.451+0000 7f5fbd000700 1 --2- 172.21.15.87:0/3832693482 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5fb810f950 0x7f5fb81a7000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:26:36.453 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:36.451+0000 7f5fbd000700 1 -- 172.21.15.87:0/3832693482 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5fb81a76a0 con 0x7f5fb8075f00 2024-05-08T05:26:36.454 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:36.451+0000 7f5fbd000700 1 --2- 172.21.15.87:0/3832693482 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5fb8075f00 0x7f5fb819fa90 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f5fac00e970 tx=0x7f5fac00ed30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:26:36.454 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:36.451+0000 7f5fb5600700 1 -- 172.21.15.87:0/3832693482 <== mon.2 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5fac00cbd0 con 0x7f5fb8075f00 2024-05-08T05:26:36.454 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:36.452+0000 7f5fbe400700 1 -- 172.21.15.87:0/3832693482 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5fb81a7990 con 0x7f5fb8075f00 2024-05-08T05:26:36.454 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:36.452+0000 7f5fb5600700 1 -- 172.21.15.87:0/3832693482 <== mon.2 v2:172.21.15.90:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5fac00cd70 con 0x7f5fb8075f00 2024-05-08T05:26:36.454 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:36.452+0000 7f5fb5600700 1 -- 172.21.15.87:0/3832693482 <== mon.2 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5fac0055f0 con 0x7f5fb8075f00 2024-05-08T05:26:36.454 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:36.452+0000 7f5fbe400700 1 -- 172.21.15.87:0/3832693482 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5fb81a7ed0 con 0x7f5fb8075f00 2024-05-08T05:26:36.454 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:36.453+0000 7f5fbe400700 1 -- 172.21.15.87:0/3832693482 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5fb8064b00 con 0x7f5fb8075f00 2024-05-08T05:26:36.456 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:36.455+0000 7f5fb5600700 1 -- 172.21.15.87:0/3832693482 <== mon.2 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 17) ==== 149703+0+0 (secure 0 0 0) 0x7f5fac047990 con 0x7f5fb8075f00 2024-05-08T05:26:36.458 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:36.457+0000 7f5fb5600700 1 --2- 172.21.15.87:0/3832693482 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f5fa00b29b0 0x7f5fa00b4e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:26:36.458 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:36.457+0000 7f5fb5600700 1 -- 172.21.15.87:0/3832693482 <== mon.2 v2:172.21.15.90:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8190+0+0 (secure 0 0 0) 0x7f5fac0e2580 con 0x7f5fb8075f00 2024-05-08T05:26:36.458 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:36.457+0000 7f5fb7e00700 1 --2- 172.21.15.87:0/3832693482 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f5fa00b29b0 0x7f5fa00b4e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:26:36.459 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:36.457+0000 7f5fb7e00700 1 --2- 172.21.15.87:0/3832693482 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f5fa00b29b0 0x7f5fa00b4e70 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f5fa400b2e0 tx=0x7f5fa401a040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:26:36.460 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:36.459+0000 7f5fb5600700 1 -- 172.21.15.87:0/3832693482 <== mon.2 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f5fac0aa110 con 0x7f5fb8075f00 2024-05-08T05:26:36.781 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:36.779+0000 7f5fbe400700 1 -- 172.21.15.87:0/3832693482 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} v 0) -- 0x7f5fb802e510 con 0x7f5fb8075f00 2024-05-08T05:26:36.790 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:36.788+0000 7f5fb5600700 1 -- 172.21.15.87:0/3832693482 <== mon.2 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]=0 v32) ==== 170+0+59 (secure 0 0 0) 0x7f5fac0a9a10 con 0x7f5fb8075f00 2024-05-08T05:26:36.790 INFO:teuthology.orchestra.run.smithi087.stdout:[client.0] 2024-05-08T05:26:36.790 INFO:teuthology.orchestra.run.smithi087.stdout: key = AQAMDTtmHkKwLhAAmyL2PMIVt2+sZ5UM45/ihw== 2024-05-08T05:26:36.793 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:36.792+0000 7f5fbe400700 1 -- 172.21.15.87:0/3832693482 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f5fa00b29b0 msgr2=0x7f5fa00b4e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:26:36.793 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:36.792+0000 7f5fbe400700 1 --2- 172.21.15.87:0/3832693482 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f5fa00b29b0 0x7f5fa00b4e70 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f5fa400b2e0 tx=0x7f5fa401a040 comp rx=0 tx=0).stop 2024-05-08T05:26:36.793 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:36.792+0000 7f5fbe400700 1 -- 172.21.15.87:0/3832693482 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5fb8075f00 msgr2=0x7f5fb819fa90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:26:36.793 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:36.792+0000 7f5fbe400700 1 --2- 172.21.15.87:0/3832693482 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5fb8075f00 0x7f5fb819fa90 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f5fac00e970 tx=0x7f5fac00ed30 comp rx=0 tx=0).stop 2024-05-08T05:26:36.793 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:36.792+0000 7f5fbe400700 1 -- 172.21.15.87:0/3832693482 shutdown_connections 2024-05-08T05:26:36.793 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:36.792+0000 7f5fbe400700 1 --2- 172.21.15.87:0/3832693482 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5fb810f950 0x7f5fb81a7000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:26:36.794 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:36.792+0000 7f5fbe400700 1 --2- 172.21.15.87:0/3832693482 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5fb8075f00 0x7f5fb819fa90 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:26:36.794 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:36.792+0000 7f5fbe400700 1 --2- 172.21.15.87:0/3832693482 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f5fa00b29b0 0x7f5fa00b4e70 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:26:36.794 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:36.792+0000 7f5fbe400700 1 --2- 172.21.15.87:0/3832693482 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5fb80774d0 0x7f5fb819ffd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:26:36.794 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:36.792+0000 7f5fbe400700 1 -- 172.21.15.87:0/3832693482 >> 172.21.15.87:0/3832693482 conn(0x7f5fb80fe910 msgr2=0x7f5fb8102cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:26:36.794 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:36.792+0000 7f5fbe400700 1 -- 172.21.15.87:0/3832693482 shutdown_connections 2024-05-08T05:26:36.794 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:36.792+0000 7f5fbe400700 1 -- 172.21.15.87:0/3832693482 wait complete. 2024-05-08T05:26:37.161 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:26:36 smithi087 ceph-mon[29523]: from='client.? 172.21.15.87:0/3832693482' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-05-08T05:26:37.161 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:26:36 smithi087 ceph-mon[29523]: from='client.? ' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-05-08T05:26:37.162 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:26:36 smithi087 ceph-mon[29523]: from='client.? ' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-05-08T05:26:37.233 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:26:36 smithi090 ceph-mon[34526]: from='client.? 172.21.15.87:0/3832693482' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-05-08T05:26:37.233 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:26:36 smithi090 ceph-mon[34526]: from='client.? ' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-05-08T05:26:37.234 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:26:36 smithi090 ceph-mon[34526]: from='client.? ' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-05-08T05:26:37.289 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:26:36 smithi160 ceph-mon[34827]: from='client.? 172.21.15.87:0/3832693482' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-05-08T05:26:37.289 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:26:36 smithi160 ceph-mon[34827]: from='client.? ' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-05-08T05:26:37.289 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:26:36 smithi160 ceph-mon[34827]: from='client.? ' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-05-08T05:26:37.672 DEBUG:teuthology.orchestra.run.smithi087:> set -ex 2024-05-08T05:26:37.672 DEBUG:teuthology.orchestra.run.smithi087:> sudo dd of=/etc/ceph/ceph.client.0.keyring 2024-05-08T05:26:37.672 DEBUG:teuthology.orchestra.run.smithi087:> sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-05-08T05:26:37.791 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-05-08T05:26:37.791 INFO:tasks.cephadm.ceph_manager.ceph:waiting for mgr available 2024-05-08T05:26:37.791 DEBUG:teuthology.orchestra.run.smithi087:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid eeeb813e-0cf9-11ef-bc97-c7b262605968 -- ceph mgr dump --format=json 2024-05-08T05:26:37.900 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:26:37 smithi087 ceph-mon[29523]: pgmap v349: 97 pgs: 97 active+clean; 644 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 597 B/s wr, 5 op/s; 0 B/s, 0 keys/s, 0 objects/s recovering 2024-05-08T05:26:38.233 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:26:37 smithi090 ceph-mon[34526]: pgmap v349: 97 pgs: 97 active+clean; 644 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 597 B/s wr, 5 op/s; 0 B/s, 0 keys/s, 0 objects/s recovering 2024-05-08T05:26:38.272 INFO:teuthology.orchestra.run.smithi087.stderr:Inferring config /var/lib/ceph/eeeb813e-0cf9-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T05:26:38.288 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:26:37 smithi160 ceph-mon[34827]: pgmap v349: 97 pgs: 97 active+clean; 644 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 597 B/s wr, 5 op/s; 0 B/s, 0 keys/s, 0 objects/s recovering 2024-05-08T05:26:40.205 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:26:39 smithi087 ceph-mon[29523]: pgmap v350: 97 pgs: 97 active+clean; 644 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 597 B/s wr, 7 op/s; 0 B/s, 0 keys/s, 0 objects/s recovering 2024-05-08T05:26:40.233 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:26:39 smithi090 ceph-mon[34526]: pgmap v350: 97 pgs: 97 active+clean; 644 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 597 B/s wr, 7 op/s; 0 B/s, 0 keys/s, 0 objects/s recovering 2024-05-08T05:26:40.289 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:26:39 smithi160 ceph-mon[34827]: pgmap v350: 97 pgs: 97 active+clean; 644 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 597 B/s wr, 7 op/s; 0 B/s, 0 keys/s, 0 objects/s recovering 2024-05-08T05:26:40.370 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:40.368+0000 7f66db800700 1 -- 172.21.15.87:0/1816520575 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f66d406ba10 msgr2=0x7f66d406be90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:26:40.370 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:40.368+0000 7f66db800700 1 --2- 172.21.15.87:0/1816520575 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f66d406ba10 0x7f66d406be90 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f66c0009990 tx=0x7f66c0009ca0 comp rx=0 tx=0).stop 2024-05-08T05:26:40.370 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:40.368+0000 7f66db800700 1 -- 172.21.15.87:0/1816520575 shutdown_connections 2024-05-08T05:26:40.370 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:40.368+0000 7f66db800700 1 --2- 172.21.15.87:0/1816520575 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f66d406c3d0 0x7f66d4110320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:26:40.370 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:40.368+0000 7f66db800700 1 --2- 172.21.15.87:0/1816520575 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f66d4109500 0x7f66d41098e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:26:40.370 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:40.368+0000 7f66db800700 1 --2- 172.21.15.87:0/1816520575 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f66d406ba10 0x7f66d406be90 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:26:40.370 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:40.368+0000 7f66db800700 1 -- 172.21.15.87:0/1816520575 >> 172.21.15.87:0/1816520575 conn(0x7f66d4079310 msgr2=0x7f66d4079720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:26:40.370 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:40.368+0000 7f66db800700 1 -- 172.21.15.87:0/1816520575 shutdown_connections 2024-05-08T05:26:40.370 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:40.368+0000 7f66db800700 1 -- 172.21.15.87:0/1816520575 wait complete. 2024-05-08T05:26:40.372 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:40.369+0000 7f66db800700 1 Processor -- start 2024-05-08T05:26:40.372 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:40.369+0000 7f66db800700 1 -- start start 2024-05-08T05:26:40.372 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:40.369+0000 7f66db800700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f66d406ba10 0x7f66d419bde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:26:40.372 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:40.369+0000 7f66db800700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f66d406c3d0 0x7f66d419c320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:26:40.372 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:40.370+0000 7f66db800700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f66d4109500 0x7f66d41a06b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:26:40.372 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:40.370+0000 7f66db800700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f66d4113680 con 0x7f66d406ba10 2024-05-08T05:26:40.372 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:40.370+0000 7f66db800700 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f66d4113500 con 0x7f66d4109500 2024-05-08T05:26:40.372 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:40.370+0000 7f66db800700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f66d4113800 con 0x7f66d406c3d0 2024-05-08T05:26:40.372 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:40.370+0000 7f66d8e00700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f66d406ba10 0x7f66d419bde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:26:40.372 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:40.370+0000 7f66d8e00700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f66d406ba10 0x7f66d419bde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:59802/0 (socket says 172.21.15.87:59802) 2024-05-08T05:26:40.372 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:40.370+0000 7f66d8e00700 1 -- 172.21.15.87:0/2319209451 learned_addr learned my addr 172.21.15.87:0/2319209451 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T05:26:40.373 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:40.370+0000 7f66d3e00700 1 --2- 172.21.15.87:0/2319209451 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f66d406c3d0 0x7f66d419c320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:26:40.373 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:40.370+0000 7f66d9800700 1 --2- 172.21.15.87:0/2319209451 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f66d4109500 0x7f66d41a06b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:26:40.373 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:40.370+0000 7f66d8e00700 1 -- 172.21.15.87:0/2319209451 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f66d406c3d0 msgr2=0x7f66d419c320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:26:40.373 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:40.370+0000 7f66d8e00700 1 --2- 172.21.15.87:0/2319209451 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f66d406c3d0 0x7f66d419c320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:26:40.373 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:40.370+0000 7f66d8e00700 1 -- 172.21.15.87:0/2319209451 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f66d4109500 msgr2=0x7f66d41a06b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:26:40.373 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:40.370+0000 7f66d8e00700 1 --2- 172.21.15.87:0/2319209451 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f66d4109500 0x7f66d41a06b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:26:40.373 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:40.370+0000 7f66d8e00700 1 -- 172.21.15.87:0/2319209451 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f66d41a0df0 con 0x7f66d406ba10 2024-05-08T05:26:40.373 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:40.370+0000 7f66d9800700 1 --2- 172.21.15.87:0/2319209451 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f66d4109500 0x7f66d41a06b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T05:26:40.374 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:40.371+0000 7f66d8e00700 1 --2- 172.21.15.87:0/2319209451 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f66d406ba10 0x7f66d419bde0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f66c800e9a0 tx=0x7f66c800ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:26:40.374 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:40.371+0000 7f66d1600700 1 -- 172.21.15.87:0/2319209451 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66c800cbd0 con 0x7f66d406ba10 2024-05-08T05:26:40.374 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:40.371+0000 7f66d1600700 1 -- 172.21.15.87:0/2319209451 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f66c800cd70 con 0x7f66d406ba10 2024-05-08T05:26:40.375 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:40.371+0000 7f66db800700 1 -- 172.21.15.87:0/2319209451 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f66d41a10e0 con 0x7f66d406ba10 2024-05-08T05:26:40.375 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:40.371+0000 7f66d1600700 1 -- 172.21.15.87:0/2319209451 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66c8018680 con 0x7f66d406ba10 2024-05-08T05:26:40.375 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:40.371+0000 7f66db800700 1 -- 172.21.15.87:0/2319209451 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f66d41a8960 con 0x7f66d406ba10 2024-05-08T05:26:40.375 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:40.372+0000 7f66db800700 1 -- 172.21.15.87:0/2319209451 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f66d406a190 con 0x7f66d406ba10 2024-05-08T05:26:40.376 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:40.375+0000 7f66d1600700 1 -- 172.21.15.87:0/2319209451 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 17) ==== 149703+0+0 (secure 0 0 0) 0x7f66c8010430 con 0x7f66d406ba10 2024-05-08T05:26:40.378 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:40.376+0000 7f66d1600700 1 --2- 172.21.15.87:0/2319209451 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f66bc0b2990 0x7f66bc0b4e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:26:40.378 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:40.376+0000 7f66d1600700 1 -- 172.21.15.87:0/2319209451 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8190+0+0 (secure 0 0 0) 0x7f66c80e2a10 con 0x7f66d406ba10 2024-05-08T05:26:40.378 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:40.376+0000 7f66d3e00700 1 --2- 172.21.15.87:0/2319209451 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f66bc0b2990 0x7f66bc0b4e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:26:40.378 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:40.377+0000 7f66d3e00700 1 --2- 172.21.15.87:0/2319209451 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f66bc0b2990 0x7f66bc0b4e50 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f66d4104480 tx=0x7f66c000b260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:26:40.380 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:40.379+0000 7f66d1600700 1 -- 172.21.15.87:0/2319209451 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f66c80aa5a0 con 0x7f66d406ba10 2024-05-08T05:26:40.675 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:40.674+0000 7f66db800700 1 -- 172.21.15.87:0/2319209451 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) -- 0x7f66d419d140 con 0x7f66d406ba10 2024-05-08T05:26:40.693 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:40.692+0000 7f66d1600700 1 -- 172.21.15.87:0/2319209451 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v17) ==== 74+0+288642 (secure 0 0 0) 0x7f66c80a9ea0 con 0x7f66d406ba10 2024-05-08T05:26:40.703 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-05-08T05:26:40.705 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:40.700+0000 7f66db800700 1 -- 172.21.15.87:0/2319209451 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f66bc0b2990 msgr2=0x7f66bc0b4e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:26:40.705 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:40.700+0000 7f66db800700 1 --2- 172.21.15.87:0/2319209451 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f66bc0b2990 0x7f66bc0b4e50 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f66d4104480 tx=0x7f66c000b260 comp rx=0 tx=0).stop 2024-05-08T05:26:40.705 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:40.700+0000 7f66db800700 1 -- 172.21.15.87:0/2319209451 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f66d406ba10 msgr2=0x7f66d419bde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:26:40.705 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:40.700+0000 7f66db800700 1 --2- 172.21.15.87:0/2319209451 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f66d406ba10 0x7f66d419bde0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f66c800e9a0 tx=0x7f66c800ecb0 comp rx=0 tx=0).stop 2024-05-08T05:26:40.705 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:40.700+0000 7f66db800700 1 -- 172.21.15.87:0/2319209451 shutdown_connections 2024-05-08T05:26:40.705 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:40.700+0000 7f66db800700 1 --2- 172.21.15.87:0/2319209451 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f66d4109500 0x7f66d41a06b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:26:40.705 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:40.700+0000 7f66db800700 1 --2- 172.21.15.87:0/2319209451 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f66d406ba10 0x7f66d419bde0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:26:40.705 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:40.701+0000 7f66db800700 1 --2- 172.21.15.87:0/2319209451 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f66bc0b2990 0x7f66bc0b4e50 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:26:40.705 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:40.701+0000 7f66db800700 1 --2- 172.21.15.87:0/2319209451 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f66d406c3d0 0x7f66d419c320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:26:40.705 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:40.701+0000 7f66db800700 1 -- 172.21.15.87:0/2319209451 >> 172.21.15.87:0/2319209451 conn(0x7f66d4079310 msgr2=0x7f66d4100e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:26:40.706 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:40.701+0000 7f66db800700 1 -- 172.21.15.87:0/2319209451 shutdown_connections 2024-05-08T05:26:40.706 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:40.701+0000 7f66db800700 1 -- 172.21.15.87:0/2319209451 wait complete. 2024-05-08T05:26:41.233 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:26:40 smithi090 ceph-mon[34526]: from='client.? 172.21.15.87:0/2319209451' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-05-08T05:26:41.288 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:26:40 smithi160 ceph-mon[34827]: from='client.? 172.21.15.87:0/2319209451' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-05-08T05:26:41.458 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:26:40 smithi087 ceph-mon[29523]: from='client.? 172.21.15.87:0/2319209451' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-05-08T05:26:41.523 INFO:teuthology.orchestra.run.smithi087.stdout:{"epoch":17,"flags":0,"active_gid":14152,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6800","nonce":1189186457},{"type":"v1","addr":"172.21.15.87:6801","nonce":1189186457}]},"active_addr":"172.21.15.87:6801/1189186457","active_change":"2024-05-08T05:17:22.736489+0000","active_mgr_features":4540701547738038271,"available":true,"standbys":[{"gid":24109,"name":"z","mgr_features":4540701547738038271,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.1","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"smb","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_orchestration":{"name":"update_orchestration","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically update orchestration when smb resources are changed","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]},{"gid":24110,"name":"y","mgr_features":4540701547738038271,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.1","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"smb","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_orchestration":{"name":"update_orchestration","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically update orchestration when smb resources are changed","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["cephadm","dashboard","iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.1","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"smb","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_orchestration":{"name":"update_orchestration","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically update orchestration when smb resources are changed","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{"dashboard":"https://172.21.15.87:8443/"},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":3,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.87:0","nonce":21652332}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.87:0","nonce":1921367406}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.87:0","nonce":895834073}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.87:0","nonce":547500259}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.87:0","nonce":521257220}]}]} 2024-05-08T05:26:41.529 INFO:tasks.cephadm.ceph_manager.ceph:mgr available! 2024-05-08T05:26:41.529 INFO:tasks.cephadm.ceph_manager.ceph:waiting for all up 2024-05-08T05:26:41.530 DEBUG:teuthology.orchestra.run.smithi087:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid eeeb813e-0cf9-11ef-bc97-c7b262605968 -- ceph osd dump --format=json 2024-05-08T05:26:41.977 INFO:teuthology.orchestra.run.smithi087.stderr:Inferring config /var/lib/ceph/eeeb813e-0cf9-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T05:26:42.233 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:26:41 smithi090 ceph-mon[34526]: pgmap v351: 97 pgs: 97 active+clean; 644 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 170 B/s wr, 5 op/s 2024-05-08T05:26:42.282 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:26:41 smithi087 ceph-mon[29523]: pgmap v351: 97 pgs: 97 active+clean; 644 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 170 B/s wr, 5 op/s 2024-05-08T05:26:42.288 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:26:41 smithi160 ceph-mon[34827]: pgmap v351: 97 pgs: 97 active+clean; 644 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 170 B/s wr, 5 op/s 2024-05-08T05:26:43.951 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:43.949+0000 7f7b6b000700 1 -- 172.21.15.87:0/292184266 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7b64108850 msgr2=0x7f7b641103d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:26:43.951 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:43.949+0000 7f7b6b000700 1 --2- 172.21.15.87:0/292184266 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7b64108850 0x7f7b641103d0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f7b5c00b0d0 tx=0x7f7b5c00b3e0 comp rx=0 tx=0).stop 2024-05-08T05:26:43.952 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:43.949+0000 7f7b6b000700 1 -- 172.21.15.87:0/292184266 shutdown_connections 2024-05-08T05:26:43.952 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:43.949+0000 7f7b6b000700 1 --2- 172.21.15.87:0/292184266 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7b64108850 0x7f7b641103d0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:26:43.952 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:43.949+0000 7f7b6b000700 1 --2- 172.21.15.87:0/292184266 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7b64103750 0x7f7b64103b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:26:43.952 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:43.949+0000 7f7b6b000700 1 --2- 172.21.15.87:0/292184266 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7b64104100 0x7f7b64108120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:26:43.952 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:43.949+0000 7f7b6b000700 1 -- 172.21.15.87:0/292184266 >> 172.21.15.87:0/292184266 conn(0x7f7b6407a600 msgr2=0x7f7b6407aa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:26:43.952 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:43.950+0000 7f7b6b000700 1 -- 172.21.15.87:0/292184266 shutdown_connections 2024-05-08T05:26:43.952 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:43.950+0000 7f7b6b000700 1 -- 172.21.15.87:0/292184266 wait complete. 2024-05-08T05:26:43.953 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:43.951+0000 7f7b6b000700 1 Processor -- start 2024-05-08T05:26:43.953 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:43.951+0000 7f7b6b000700 1 -- start start 2024-05-08T05:26:43.954 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:43.952+0000 7f7b6b000700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7b64103750 0x7f7b6419f6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:26:43.954 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:43.952+0000 7f7b6b000700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7b64104100 0x7f7b6419fc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:26:43.954 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:43.952+0000 7f7b6b000700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7b64108850 0x7f7b64199880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:26:43.954 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:43.952+0000 7f7b6b000700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f7b64113640 con 0x7f7b64104100 2024-05-08T05:26:43.955 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:43.952+0000 7f7b6b000700 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f7b641134c0 con 0x7f7b64108850 2024-05-08T05:26:43.955 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:43.952+0000 7f7b6b000700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f7b641137c0 con 0x7f7b64103750 2024-05-08T05:26:43.955 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:43.952+0000 7f7b63400700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7b64104100 0x7f7b6419fc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:26:43.955 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:43.952+0000 7f7b63e00700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7b64103750 0x7f7b6419f6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:26:43.955 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:43.952+0000 7f7b63400700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7b64104100 0x7f7b6419fc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:59824/0 (socket says 172.21.15.87:59824) 2024-05-08T05:26:43.955 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:43.952+0000 7f7b63400700 1 -- 172.21.15.87:0/1970568283 learned_addr learned my addr 172.21.15.87:0/1970568283 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T05:26:43.955 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:43.952+0000 7f7b69000700 1 --2- 172.21.15.87:0/1970568283 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7b64108850 0x7f7b64199880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:26:43.955 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:43.953+0000 7f7b63e00700 1 -- 172.21.15.87:0/1970568283 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7b64108850 msgr2=0x7f7b64199880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:26:43.955 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:43.953+0000 7f7b63e00700 1 --2- 172.21.15.87:0/1970568283 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7b64108850 0x7f7b64199880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:26:43.955 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:43.953+0000 7f7b63e00700 1 -- 172.21.15.87:0/1970568283 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7b64104100 msgr2=0x7f7b6419fc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:26:43.955 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:43.953+0000 7f7b63e00700 1 --2- 172.21.15.87:0/1970568283 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7b64104100 0x7f7b6419fc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:26:43.955 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:43.953+0000 7f7b63e00700 1 -- 172.21.15.87:0/1970568283 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7b64199fe0 con 0x7f7b64103750 2024-05-08T05:26:43.955 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:43.953+0000 7f7b63400700 1 --2- 172.21.15.87:0/1970568283 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7b64104100 0x7f7b6419fc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T05:26:43.955 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:43.953+0000 7f7b63e00700 1 --2- 172.21.15.87:0/1970568283 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7b64103750 0x7f7b6419f6c0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f7b5400e9f0 tx=0x7f7b5400ed00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:26:43.956 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:43.953+0000 7f7b60c00700 1 -- 172.21.15.87:0/1970568283 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b5400c9c0 con 0x7f7b64103750 2024-05-08T05:26:43.956 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:43.953+0000 7f7b60c00700 1 -- 172.21.15.87:0/1970568283 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7b5400cb60 con 0x7f7b64103750 2024-05-08T05:26:43.956 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:43.953+0000 7f7b6b000700 1 -- 172.21.15.87:0/1970568283 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7b6419a2d0 con 0x7f7b64103750 2024-05-08T05:26:43.956 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:43.953+0000 7f7b60c00700 1 -- 172.21.15.87:0/1970568283 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b54018680 con 0x7f7b64103750 2024-05-08T05:26:43.956 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:43.953+0000 7f7b6b000700 1 -- 172.21.15.87:0/1970568283 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7b641a6590 con 0x7f7b64103750 2024-05-08T05:26:43.956 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:43.954+0000 7f7b6b000700 1 -- 172.21.15.87:0/1970568283 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7b6406a190 con 0x7f7b64103750 2024-05-08T05:26:43.958 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:43.957+0000 7f7b60c00700 1 -- 172.21.15.87:0/1970568283 <== mon.1 v2:172.21.15.160:3300/0 4 ==== mgrmap(e 17) ==== 149703+0+0 (secure 0 0 0) 0x7f7b54010430 con 0x7f7b64103750 2024-05-08T05:26:43.959 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:43.958+0000 7f7b60c00700 1 --2- 172.21.15.87:0/1970568283 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f7b480b2990 0x7f7b480b4e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:26:43.960 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:43.958+0000 7f7b60c00700 1 -- 172.21.15.87:0/1970568283 <== mon.1 v2:172.21.15.160:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8190+0+0 (secure 0 0 0) 0x7f7b540e2820 con 0x7f7b64103750 2024-05-08T05:26:43.960 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:43.958+0000 7f7b63400700 1 --2- 172.21.15.87:0/1970568283 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f7b480b2990 0x7f7b480b4e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:26:43.960 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:43.959+0000 7f7b63400700 1 --2- 172.21.15.87:0/1970568283 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f7b480b2990 0x7f7b480b4e50 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f7b641080d0 tx=0x7f7b5000b480 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:26:43.961 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:43.960+0000 7f7b60c00700 1 -- 172.21.15.87:0/1970568283 <== mon.1 v2:172.21.15.160:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f7b540aa3b0 con 0x7f7b64103750 2024-05-08T05:26:44.195 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:44.193+0000 7f7b6b000700 1 -- 172.21.15.87:0/1970568283 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f7b6402e510 con 0x7f7b64103750 2024-05-08T05:26:44.195 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:26:43 smithi087 ceph-mon[29523]: pgmap v352: 97 pgs: 97 active+clean; 644 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 170 B/s wr, 5 op/s 2024-05-08T05:26:44.197 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:44.195+0000 7f7b60c00700 1 -- 172.21.15.87:0/1970568283 <== mon.1 v2:172.21.15.160:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v82) ==== 74+0+22588 (secure 0 0 0) 0x7f7b540b2430 con 0x7f7b64103750 2024-05-08T05:26:44.197 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-05-08T05:26:44.198 INFO:teuthology.orchestra.run.smithi087.stdout:{"epoch":82,"fsid":"eeeb813e-0cf9-11ef-bc97-c7b262605968","created":"2024-05-08T05:16:14.984330+0000","modified":"2024-05-08T05:26:24.106467+0000","last_up_change":"2024-05-08T05:24:22.324501+0000","last_in_change":"2024-05-08T05:24:01.962570+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-08T05:20:08.907941+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-08T05:25:28.054494+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-08T05:25:32.484126+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"f3e25ce0-0762-46fd-83fb-6766a2e9db69","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6802","nonce":2285285644},{"type":"v1","addr":"172.21.15.87:6803","nonce":2285285644}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6804","nonce":2285285644},{"type":"v1","addr":"172.21.15.87:6805","nonce":2285285644}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6808","nonce":2285285644},{"type":"v1","addr":"172.21.15.87:6809","nonce":2285285644}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6806","nonce":2285285644},{"type":"v1","addr":"172.21.15.87:6807","nonce":2285285644}]},"public_addr":"172.21.15.87:6803/2285285644","cluster_addr":"172.21.15.87:6805/2285285644","heartbeat_back_addr":"172.21.15.87:6809/2285285644","heartbeat_front_addr":"172.21.15.87:6807/2285285644","state":["exists","up"]},{"osd":1,"uuid":"b6de5f4c-1d79-41ff-adee-03d8a47ab55e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6800","nonce":1681573998},{"type":"v1","addr":"172.21.15.90:6801","nonce":1681573998}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6802","nonce":1681573998},{"type":"v1","addr":"172.21.15.90:6803","nonce":1681573998}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6806","nonce":1681573998},{"type":"v1","addr":"172.21.15.90:6807","nonce":1681573998}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6804","nonce":1681573998},{"type":"v1","addr":"172.21.15.90:6805","nonce":1681573998}]},"public_addr":"172.21.15.90:6801/1681573998","cluster_addr":"172.21.15.90:6803/1681573998","heartbeat_back_addr":"172.21.15.90:6807/1681573998","heartbeat_front_addr":"172.21.15.90:6805/1681573998","state":["exists","up"]},{"osd":2,"uuid":"ee3a2729-93b2-4985-b84d-165f92cae8e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6800","nonce":2137179096},{"type":"v1","addr":"172.21.15.160:6801","nonce":2137179096}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6802","nonce":2137179096},{"type":"v1","addr":"172.21.15.160:6803","nonce":2137179096}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6806","nonce":2137179096},{"type":"v1","addr":"172.21.15.160:6807","nonce":2137179096}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6804","nonce":2137179096},{"type":"v1","addr":"172.21.15.160:6805","nonce":2137179096}]},"public_addr":"172.21.15.160:6801/2137179096","cluster_addr":"172.21.15.160:6803/2137179096","heartbeat_back_addr":"172.21.15.160:6807/2137179096","heartbeat_front_addr":"172.21.15.160:6805/2137179096","state":["exists","up"]},{"osd":3,"uuid":"fc7bd69f-5a62-4ec6-b95c-c170be46a7d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6810","nonce":2022667023},{"type":"v1","addr":"172.21.15.87:6811","nonce":2022667023}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6812","nonce":2022667023},{"type":"v1","addr":"172.21.15.87:6813","nonce":2022667023}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6816","nonce":2022667023},{"type":"v1","addr":"172.21.15.87:6817","nonce":2022667023}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6814","nonce":2022667023},{"type":"v1","addr":"172.21.15.87:6815","nonce":2022667023}]},"public_addr":"172.21.15.87:6811/2022667023","cluster_addr":"172.21.15.87:6813/2022667023","heartbeat_back_addr":"172.21.15.87:6817/2022667023","heartbeat_front_addr":"172.21.15.87:6815/2022667023","state":["exists","up"]},{"osd":4,"uuid":"a05f7bd1-962a-4f3e-8f70-e7ef4c68bac2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6808","nonce":1371607578},{"type":"v1","addr":"172.21.15.90:6809","nonce":1371607578}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6810","nonce":1371607578},{"type":"v1","addr":"172.21.15.90:6811","nonce":1371607578}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6814","nonce":1371607578},{"type":"v1","addr":"172.21.15.90:6815","nonce":1371607578}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6812","nonce":1371607578},{"type":"v1","addr":"172.21.15.90:6813","nonce":1371607578}]},"public_addr":"172.21.15.90:6809/1371607578","cluster_addr":"172.21.15.90:6811/1371607578","heartbeat_back_addr":"172.21.15.90:6815/1371607578","heartbeat_front_addr":"172.21.15.90:6813/1371607578","state":["exists","up"]},{"osd":5,"uuid":"85e3af08-32ee-4f26-97df-8d54ba928715","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6808","nonce":2190054276},{"type":"v1","addr":"172.21.15.160:6809","nonce":2190054276}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6810","nonce":2190054276},{"type":"v1","addr":"172.21.15.160:6811","nonce":2190054276}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6814","nonce":2190054276},{"type":"v1","addr":"172.21.15.160:6815","nonce":2190054276}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6812","nonce":2190054276},{"type":"v1","addr":"172.21.15.160:6813","nonce":2190054276}]},"public_addr":"172.21.15.160:6809/2190054276","cluster_addr":"172.21.15.160:6811/2190054276","heartbeat_back_addr":"172.21.15.160:6815/2190054276","heartbeat_front_addr":"172.21.15.160:6813/2190054276","state":["exists","up"]},{"osd":6,"uuid":"df4b22a9-6cd8-473e-a17b-a0cb9ad32e98","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":42,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6818","nonce":2863681447},{"type":"v1","addr":"172.21.15.87:6819","nonce":2863681447}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6820","nonce":2863681447},{"type":"v1","addr":"172.21.15.87:6821","nonce":2863681447}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6824","nonce":2863681447},{"type":"v1","addr":"172.21.15.87:6825","nonce":2863681447}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6822","nonce":2863681447},{"type":"v1","addr":"172.21.15.87:6823","nonce":2863681447}]},"public_addr":"172.21.15.87:6819/2863681447","cluster_addr":"172.21.15.87:6821/2863681447","heartbeat_back_addr":"172.21.15.87:6825/2863681447","heartbeat_front_addr":"172.21.15.87:6823/2863681447","state":["exists","up"]},{"osd":7,"uuid":"f6ef3857-0366-4408-932a-a8c8479ba780","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6816","nonce":1964248958},{"type":"v1","addr":"172.21.15.90:6817","nonce":1964248958}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6818","nonce":1964248958},{"type":"v1","addr":"172.21.15.90:6819","nonce":1964248958}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6822","nonce":1964248958},{"type":"v1","addr":"172.21.15.90:6823","nonce":1964248958}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6820","nonce":1964248958},{"type":"v1","addr":"172.21.15.90:6821","nonce":1964248958}]},"public_addr":"172.21.15.90:6817/1964248958","cluster_addr":"172.21.15.90:6819/1964248958","heartbeat_back_addr":"172.21.15.90:6823/1964248958","heartbeat_front_addr":"172.21.15.90:6821/1964248958","state":["exists","up"]},{"osd":8,"uuid":"027dede9-d0be-4fbe-b7b8-02ce88d57f4d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":54,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6816","nonce":927680738},{"type":"v1","addr":"172.21.15.160:6817","nonce":927680738}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6818","nonce":927680738},{"type":"v1","addr":"172.21.15.160:6819","nonce":927680738}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6822","nonce":927680738},{"type":"v1","addr":"172.21.15.160:6823","nonce":927680738}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6820","nonce":927680738},{"type":"v1","addr":"172.21.15.160:6821","nonce":927680738}]},"public_addr":"172.21.15.160:6817/927680738","cluster_addr":"172.21.15.160:6819/927680738","heartbeat_back_addr":"172.21.15.160:6823/927680738","heartbeat_front_addr":"172.21.15.160:6821/927680738","state":["exists","up"]},{"osd":9,"uuid":"bc9e37de-e509-4db6-bd58-b68e2c8e1aff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6826","nonce":3789116749},{"type":"v1","addr":"172.21.15.87:6827","nonce":3789116749}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6828","nonce":3789116749},{"type":"v1","addr":"172.21.15.87:6829","nonce":3789116749}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6832","nonce":3789116749},{"type":"v1","addr":"172.21.15.87:6833","nonce":3789116749}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6830","nonce":3789116749},{"type":"v1","addr":"172.21.15.87:6831","nonce":3789116749}]},"public_addr":"172.21.15.87:6827/3789116749","cluster_addr":"172.21.15.87:6829/3789116749","heartbeat_back_addr":"172.21.15.87:6833/3789116749","heartbeat_front_addr":"172.21.15.87:6831/3789116749","state":["exists","up"]},{"osd":10,"uuid":"43945081-b4c8-4f5d-9301-3540709e69e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":66,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6824","nonce":716529498},{"type":"v1","addr":"172.21.15.90:6825","nonce":716529498}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6826","nonce":716529498},{"type":"v1","addr":"172.21.15.90:6827","nonce":716529498}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6830","nonce":716529498},{"type":"v1","addr":"172.21.15.90:6831","nonce":716529498}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6828","nonce":716529498},{"type":"v1","addr":"172.21.15.90:6829","nonce":716529498}]},"public_addr":"172.21.15.90:6825/716529498","cluster_addr":"172.21.15.90:6827/716529498","heartbeat_back_addr":"172.21.15.90:6831/716529498","heartbeat_front_addr":"172.21.15.90:6829/716529498","state":["exists","up"]},{"osd":11,"uuid":"da23ff5c-3f79-44e3-bca3-d9d5a003c999","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6824","nonce":1842739135},{"type":"v1","addr":"172.21.15.160:6825","nonce":1842739135}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6826","nonce":1842739135},{"type":"v1","addr":"172.21.15.160:6827","nonce":1842739135}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6830","nonce":1842739135},{"type":"v1","addr":"172.21.15.160:6831","nonce":1842739135}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6828","nonce":1842739135},{"type":"v1","addr":"172.21.15.160:6829","nonce":1842739135}]},"public_addr":"172.21.15.160:6825/1842739135","cluster_addr":"172.21.15.160:6827/1842739135","heartbeat_back_addr":"172.21.15.160:6831/1842739135","heartbeat_front_addr":"172.21.15.160:6829/1842739135","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T05:19:15.869398+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T05:19:42.014078+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T05:20:06.430660+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T05:20:38.555519+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T05:21:04.530605+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T05:21:29.545252+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T05:22:03.141982+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T05:22:29.191127+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T05:22:54.502994+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T05:23:27.899000+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T05:23:54.693979+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T05:24:20.307119+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.a","mappings":[{"from":2,"to":11}]},{"pgid":"2.1d","mappings":[{"from":2,"to":4},{"from":8,"to":11}]},{"pgid":"3.0","mappings":[{"from":4,"to":8}]},{"pgid":"3.1","mappings":[{"from":4,"to":9}]},{"pgid":"3.12","mappings":[{"from":3,"to":9}]},{"pgid":"3.28","mappings":[{"from":5,"to":6}]},{"pgid":"3.2c","mappings":[{"from":4,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.87:0/4226160503":"2024-05-09T05:17:22.736165+0000","172.21.15.87:0/2773684806":"2024-05-09T05:17:22.736165+0000","172.21.15.87:0/349590592":"2024-05-09T05:17:22.736165+0000","172.21.15.87:6801/2710124295":"2024-05-09T05:17:22.736165+0000","172.21.15.87:6800/1823425617":"2024-05-09T05:16:48.155337+0000","172.21.15.87:0/2393072013":"2024-05-09T05:16:48.155337+0000","172.21.15.87:0/1291525416":"2024-05-09T05:16:48.155337+0000","172.21.15.87:6801/1823425617":"2024-05-09T05:16:48.155337+0000","172.21.15.87:0/3839463573":"2024-05-09T05:16:48.155337+0000","172.21.15.87:6800/2710124295":"2024-05-09T05:17:22.736165+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-08T05:26:44.200 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:44.199+0000 7f7b6b000700 1 -- 172.21.15.87:0/1970568283 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f7b480b2990 msgr2=0x7f7b480b4e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:26:44.201 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:44.199+0000 7f7b6b000700 1 --2- 172.21.15.87:0/1970568283 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f7b480b2990 0x7f7b480b4e50 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f7b641080d0 tx=0x7f7b5000b480 comp rx=0 tx=0).stop 2024-05-08T05:26:44.201 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:44.199+0000 7f7b6b000700 1 -- 172.21.15.87:0/1970568283 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7b64103750 msgr2=0x7f7b6419f6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:26:44.201 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:44.199+0000 7f7b6b000700 1 --2- 172.21.15.87:0/1970568283 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7b64103750 0x7f7b6419f6c0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f7b5400e9f0 tx=0x7f7b5400ed00 comp rx=0 tx=0).stop 2024-05-08T05:26:44.201 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:44.199+0000 7f7b6b000700 1 -- 172.21.15.87:0/1970568283 shutdown_connections 2024-05-08T05:26:44.201 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:44.199+0000 7f7b6b000700 1 --2- 172.21.15.87:0/1970568283 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7b64108850 0x7f7b64199880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:26:44.201 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:44.199+0000 7f7b6b000700 1 --2- 172.21.15.87:0/1970568283 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f7b480b2990 0x7f7b480b4e50 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:26:44.201 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:44.199+0000 7f7b6b000700 1 --2- 172.21.15.87:0/1970568283 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7b64103750 0x7f7b6419f6c0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:26:44.201 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:44.199+0000 7f7b6b000700 1 --2- 172.21.15.87:0/1970568283 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7b64104100 0x7f7b6419fc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:26:44.201 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:44.199+0000 7f7b6b000700 1 -- 172.21.15.87:0/1970568283 >> 172.21.15.87:0/1970568283 conn(0x7f7b6407a600 msgr2=0x7f7b641014c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:26:44.201 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:44.199+0000 7f7b6b000700 1 -- 172.21.15.87:0/1970568283 shutdown_connections 2024-05-08T05:26:44.201 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:44.199+0000 7f7b6b000700 1 -- 172.21.15.87:0/1970568283 wait complete. 2024-05-08T05:26:44.289 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:26:43 smithi160 ceph-mon[34827]: pgmap v352: 97 pgs: 97 active+clean; 644 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 170 B/s wr, 5 op/s 2024-05-08T05:26:44.483 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:26:43 smithi090 ceph-mon[34526]: pgmap v352: 97 pgs: 97 active+clean; 644 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 170 B/s wr, 5 op/s 2024-05-08T05:26:45.093 INFO:tasks.cephadm.ceph_manager.ceph:all up! 2024-05-08T05:26:45.094 DEBUG:teuthology.orchestra.run.smithi087:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid eeeb813e-0cf9-11ef-bc97-c7b262605968 -- ceph osd dump --format=json 2024-05-08T05:26:45.289 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:26:45 smithi160 ceph-mon[34827]: from='client.? 172.21.15.87:0/1970568283' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-08T05:26:45.458 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:26:44 smithi087 ceph-mon[29523]: from='client.? 172.21.15.87:0/1970568283' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-08T05:26:45.483 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:26:44 smithi090 ceph-mon[34526]: from='client.? 172.21.15.87:0/1970568283' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-08T05:26:45.532 INFO:teuthology.orchestra.run.smithi087.stderr:Inferring config /var/lib/ceph/eeeb813e-0cf9-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T05:26:46.209 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:26:46 smithi087 ceph-mon[29523]: pgmap v353: 97 pgs: 97 active+clean; 644 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 170 B/s wr, 6 op/s 2024-05-08T05:26:46.289 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:26:46 smithi160 ceph-mon[34827]: pgmap v353: 97 pgs: 97 active+clean; 644 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 170 B/s wr, 6 op/s 2024-05-08T05:26:46.385 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:26:46 smithi090 ceph-mon[34526]: pgmap v353: 97 pgs: 97 active+clean; 644 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 170 B/s wr, 6 op/s 2024-05-08T05:26:47.765 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:47.763+0000 7f742d400700 1 -- 172.21.15.87:0/2496108774 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7428109460 msgr2=0x7f7428109840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:26:47.765 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:47.763+0000 7f742d400700 1 --2- 172.21.15.87:0/2496108774 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7428109460 0x7f7428109840 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f741800b0a0 tx=0x7f741800b3b0 comp rx=0 tx=0).stop 2024-05-08T05:26:47.765 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:47.764+0000 7f742d400700 1 -- 172.21.15.87:0/2496108774 shutdown_connections 2024-05-08T05:26:47.766 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:47.764+0000 7f742d400700 1 --2- 172.21.15.87:0/2496108774 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7428103d90 0x7f74281102a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:26:47.766 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:47.764+0000 7f742d400700 1 --2- 172.21.15.87:0/2496108774 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7428109460 0x7f7428109840 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:26:47.766 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:47.764+0000 7f742d400700 1 --2- 172.21.15.87:0/2496108774 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f74281033d0 0x7f7428103850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:26:47.766 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:47.764+0000 7f742d400700 1 -- 172.21.15.87:0/2496108774 >> 172.21.15.87:0/2496108774 conn(0x7f74280fef20 msgr2=0x7f7428101340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:26:47.766 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:47.764+0000 7f742d400700 1 -- 172.21.15.87:0/2496108774 shutdown_connections 2024-05-08T05:26:47.766 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:47.764+0000 7f742d400700 1 -- 172.21.15.87:0/2496108774 wait complete. 2024-05-08T05:26:47.767 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:47.765+0000 7f742d400700 1 Processor -- start 2024-05-08T05:26:47.768 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:47.765+0000 7f742d400700 1 -- start start 2024-05-08T05:26:47.768 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:47.765+0000 7f742d400700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f74281033d0 0x7f74281a1910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:26:47.768 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:47.765+0000 7f742d400700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7428103d90 0x7f74281a1e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:26:47.768 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:47.765+0000 7f742d400700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7428109460 0x7f742819bb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:26:47.768 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:47.765+0000 7f742d400700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f74281135c0 con 0x7f7428103d90 2024-05-08T05:26:47.768 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:47.765+0000 7f742d400700 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f7428113440 con 0x7f7428109460 2024-05-08T05:26:47.768 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:47.765+0000 7f742d400700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f7428113740 con 0x7f74281033d0 2024-05-08T05:26:47.768 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:47.766+0000 7f741f400700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7428103d90 0x7f74281a1e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:26:47.768 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:47.766+0000 7f741f400700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7428103d90 0x7f74281a1e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:34712/0 (socket says 172.21.15.87:34712) 2024-05-08T05:26:47.768 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:47.766+0000 7f741f400700 1 -- 172.21.15.87:0/312036705 learned_addr learned my addr 172.21.15.87:0/312036705 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T05:26:47.768 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:47.766+0000 7f7427e00700 1 --2- 172.21.15.87:0/312036705 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f74281033d0 0x7f74281a1910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:26:47.768 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:47.766+0000 7f742ca00700 1 --2- 172.21.15.87:0/312036705 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7428109460 0x7f742819bb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:26:47.769 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:47.766+0000 7f741f400700 1 -- 172.21.15.87:0/312036705 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f74281033d0 msgr2=0x7f74281a1910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:26:47.769 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:47.766+0000 7f741f400700 1 --2- 172.21.15.87:0/312036705 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f74281033d0 0x7f74281a1910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:26:47.769 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:47.766+0000 7f741f400700 1 -- 172.21.15.87:0/312036705 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7428109460 msgr2=0x7f742819bb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:26:47.769 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:47.766+0000 7f741f400700 1 --2- 172.21.15.87:0/312036705 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7428109460 0x7f742819bb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:26:47.769 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:47.766+0000 7f741f400700 1 -- 172.21.15.87:0/312036705 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f742819c280 con 0x7f7428103d90 2024-05-08T05:26:47.769 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:47.766+0000 7f7427e00700 1 --2- 172.21.15.87:0/312036705 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f74281033d0 0x7f74281a1910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T05:26:47.769 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:47.767+0000 7f741f400700 1 --2- 172.21.15.87:0/312036705 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7428103d90 0x7f74281a1e50 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f741000e9a0 tx=0x7f741000ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:26:47.770 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:47.767+0000 7f7425600700 1 -- 172.21.15.87:0/312036705 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f741000ca10 con 0x7f7428103d90 2024-05-08T05:26:47.770 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:47.767+0000 7f7425600700 1 -- 172.21.15.87:0/312036705 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f741000cbb0 con 0x7f7428103d90 2024-05-08T05:26:47.770 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:47.767+0000 7f742d400700 1 -- 172.21.15.87:0/312036705 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f742819c570 con 0x7f7428103d90 2024-05-08T05:26:47.770 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:47.767+0000 7f7425600700 1 -- 172.21.15.87:0/312036705 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7410018680 con 0x7f7428103d90 2024-05-08T05:26:47.770 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:47.767+0000 7f742d400700 1 -- 172.21.15.87:0/312036705 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f74281a87e0 con 0x7f7428103d90 2024-05-08T05:26:47.770 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:47.768+0000 7f742d400700 1 -- 172.21.15.87:0/312036705 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f742806a190 con 0x7f7428103d90 2024-05-08T05:26:47.772 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:47.770+0000 7f7425600700 1 -- 172.21.15.87:0/312036705 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 17) ==== 149703+0+0 (secure 0 0 0) 0x7f7410010430 con 0x7f7428103d90 2024-05-08T05:26:47.773 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:47.772+0000 7f7425600700 1 --2- 172.21.15.87:0/312036705 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f740c0b2990 0x7f740c0b4e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:26:47.773 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:47.772+0000 7f7425600700 1 -- 172.21.15.87:0/312036705 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8190+0+0 (secure 0 0 0) 0x7f74100e2800 con 0x7f7428103d90 2024-05-08T05:26:47.773 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:47.772+0000 7f7427e00700 1 --2- 172.21.15.87:0/312036705 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f740c0b2990 0x7f740c0b4e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:26:47.774 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:47.773+0000 7f7427e00700 1 --2- 172.21.15.87:0/312036705 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f740c0b2990 0x7f740c0b4e50 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f74180062a0 tx=0x7f7418006210 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:26:47.776 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:47.775+0000 7f7425600700 1 -- 172.21.15.87:0/312036705 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f74100aa390 con 0x7f7428103d90 2024-05-08T05:26:48.013 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:48.012+0000 7f742d400700 1 -- 172.21.15.87:0/312036705 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f74281a8a10 con 0x7f7428103d90 2024-05-08T05:26:48.016 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:48.014+0000 7f7425600700 1 -- 172.21.15.87:0/312036705 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v82) ==== 74+0+22588 (secure 0 0 0) 0x7f74100b2410 con 0x7f7428103d90 2024-05-08T05:26:48.016 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-05-08T05:26:48.016 INFO:teuthology.orchestra.run.smithi087.stdout:{"epoch":82,"fsid":"eeeb813e-0cf9-11ef-bc97-c7b262605968","created":"2024-05-08T05:16:14.984330+0000","modified":"2024-05-08T05:26:24.106467+0000","last_up_change":"2024-05-08T05:24:22.324501+0000","last_in_change":"2024-05-08T05:24:01.962570+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-08T05:20:08.907941+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-08T05:25:28.054494+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-08T05:25:32.484126+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"f3e25ce0-0762-46fd-83fb-6766a2e9db69","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6802","nonce":2285285644},{"type":"v1","addr":"172.21.15.87:6803","nonce":2285285644}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6804","nonce":2285285644},{"type":"v1","addr":"172.21.15.87:6805","nonce":2285285644}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6808","nonce":2285285644},{"type":"v1","addr":"172.21.15.87:6809","nonce":2285285644}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6806","nonce":2285285644},{"type":"v1","addr":"172.21.15.87:6807","nonce":2285285644}]},"public_addr":"172.21.15.87:6803/2285285644","cluster_addr":"172.21.15.87:6805/2285285644","heartbeat_back_addr":"172.21.15.87:6809/2285285644","heartbeat_front_addr":"172.21.15.87:6807/2285285644","state":["exists","up"]},{"osd":1,"uuid":"b6de5f4c-1d79-41ff-adee-03d8a47ab55e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6800","nonce":1681573998},{"type":"v1","addr":"172.21.15.90:6801","nonce":1681573998}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6802","nonce":1681573998},{"type":"v1","addr":"172.21.15.90:6803","nonce":1681573998}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6806","nonce":1681573998},{"type":"v1","addr":"172.21.15.90:6807","nonce":1681573998}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6804","nonce":1681573998},{"type":"v1","addr":"172.21.15.90:6805","nonce":1681573998}]},"public_addr":"172.21.15.90:6801/1681573998","cluster_addr":"172.21.15.90:6803/1681573998","heartbeat_back_addr":"172.21.15.90:6807/1681573998","heartbeat_front_addr":"172.21.15.90:6805/1681573998","state":["exists","up"]},{"osd":2,"uuid":"ee3a2729-93b2-4985-b84d-165f92cae8e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6800","nonce":2137179096},{"type":"v1","addr":"172.21.15.160:6801","nonce":2137179096}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6802","nonce":2137179096},{"type":"v1","addr":"172.21.15.160:6803","nonce":2137179096}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6806","nonce":2137179096},{"type":"v1","addr":"172.21.15.160:6807","nonce":2137179096}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6804","nonce":2137179096},{"type":"v1","addr":"172.21.15.160:6805","nonce":2137179096}]},"public_addr":"172.21.15.160:6801/2137179096","cluster_addr":"172.21.15.160:6803/2137179096","heartbeat_back_addr":"172.21.15.160:6807/2137179096","heartbeat_front_addr":"172.21.15.160:6805/2137179096","state":["exists","up"]},{"osd":3,"uuid":"fc7bd69f-5a62-4ec6-b95c-c170be46a7d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6810","nonce":2022667023},{"type":"v1","addr":"172.21.15.87:6811","nonce":2022667023}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6812","nonce":2022667023},{"type":"v1","addr":"172.21.15.87:6813","nonce":2022667023}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6816","nonce":2022667023},{"type":"v1","addr":"172.21.15.87:6817","nonce":2022667023}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6814","nonce":2022667023},{"type":"v1","addr":"172.21.15.87:6815","nonce":2022667023}]},"public_addr":"172.21.15.87:6811/2022667023","cluster_addr":"172.21.15.87:6813/2022667023","heartbeat_back_addr":"172.21.15.87:6817/2022667023","heartbeat_front_addr":"172.21.15.87:6815/2022667023","state":["exists","up"]},{"osd":4,"uuid":"a05f7bd1-962a-4f3e-8f70-e7ef4c68bac2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6808","nonce":1371607578},{"type":"v1","addr":"172.21.15.90:6809","nonce":1371607578}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6810","nonce":1371607578},{"type":"v1","addr":"172.21.15.90:6811","nonce":1371607578}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6814","nonce":1371607578},{"type":"v1","addr":"172.21.15.90:6815","nonce":1371607578}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6812","nonce":1371607578},{"type":"v1","addr":"172.21.15.90:6813","nonce":1371607578}]},"public_addr":"172.21.15.90:6809/1371607578","cluster_addr":"172.21.15.90:6811/1371607578","heartbeat_back_addr":"172.21.15.90:6815/1371607578","heartbeat_front_addr":"172.21.15.90:6813/1371607578","state":["exists","up"]},{"osd":5,"uuid":"85e3af08-32ee-4f26-97df-8d54ba928715","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6808","nonce":2190054276},{"type":"v1","addr":"172.21.15.160:6809","nonce":2190054276}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6810","nonce":2190054276},{"type":"v1","addr":"172.21.15.160:6811","nonce":2190054276}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6814","nonce":2190054276},{"type":"v1","addr":"172.21.15.160:6815","nonce":2190054276}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6812","nonce":2190054276},{"type":"v1","addr":"172.21.15.160:6813","nonce":2190054276}]},"public_addr":"172.21.15.160:6809/2190054276","cluster_addr":"172.21.15.160:6811/2190054276","heartbeat_back_addr":"172.21.15.160:6815/2190054276","heartbeat_front_addr":"172.21.15.160:6813/2190054276","state":["exists","up"]},{"osd":6,"uuid":"df4b22a9-6cd8-473e-a17b-a0cb9ad32e98","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":42,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6818","nonce":2863681447},{"type":"v1","addr":"172.21.15.87:6819","nonce":2863681447}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6820","nonce":2863681447},{"type":"v1","addr":"172.21.15.87:6821","nonce":2863681447}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6824","nonce":2863681447},{"type":"v1","addr":"172.21.15.87:6825","nonce":2863681447}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6822","nonce":2863681447},{"type":"v1","addr":"172.21.15.87:6823","nonce":2863681447}]},"public_addr":"172.21.15.87:6819/2863681447","cluster_addr":"172.21.15.87:6821/2863681447","heartbeat_back_addr":"172.21.15.87:6825/2863681447","heartbeat_front_addr":"172.21.15.87:6823/2863681447","state":["exists","up"]},{"osd":7,"uuid":"f6ef3857-0366-4408-932a-a8c8479ba780","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6816","nonce":1964248958},{"type":"v1","addr":"172.21.15.90:6817","nonce":1964248958}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6818","nonce":1964248958},{"type":"v1","addr":"172.21.15.90:6819","nonce":1964248958}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6822","nonce":1964248958},{"type":"v1","addr":"172.21.15.90:6823","nonce":1964248958}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6820","nonce":1964248958},{"type":"v1","addr":"172.21.15.90:6821","nonce":1964248958}]},"public_addr":"172.21.15.90:6817/1964248958","cluster_addr":"172.21.15.90:6819/1964248958","heartbeat_back_addr":"172.21.15.90:6823/1964248958","heartbeat_front_addr":"172.21.15.90:6821/1964248958","state":["exists","up"]},{"osd":8,"uuid":"027dede9-d0be-4fbe-b7b8-02ce88d57f4d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":54,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6816","nonce":927680738},{"type":"v1","addr":"172.21.15.160:6817","nonce":927680738}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6818","nonce":927680738},{"type":"v1","addr":"172.21.15.160:6819","nonce":927680738}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6822","nonce":927680738},{"type":"v1","addr":"172.21.15.160:6823","nonce":927680738}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6820","nonce":927680738},{"type":"v1","addr":"172.21.15.160:6821","nonce":927680738}]},"public_addr":"172.21.15.160:6817/927680738","cluster_addr":"172.21.15.160:6819/927680738","heartbeat_back_addr":"172.21.15.160:6823/927680738","heartbeat_front_addr":"172.21.15.160:6821/927680738","state":["exists","up"]},{"osd":9,"uuid":"bc9e37de-e509-4db6-bd58-b68e2c8e1aff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6826","nonce":3789116749},{"type":"v1","addr":"172.21.15.87:6827","nonce":3789116749}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6828","nonce":3789116749},{"type":"v1","addr":"172.21.15.87:6829","nonce":3789116749}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6832","nonce":3789116749},{"type":"v1","addr":"172.21.15.87:6833","nonce":3789116749}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6830","nonce":3789116749},{"type":"v1","addr":"172.21.15.87:6831","nonce":3789116749}]},"public_addr":"172.21.15.87:6827/3789116749","cluster_addr":"172.21.15.87:6829/3789116749","heartbeat_back_addr":"172.21.15.87:6833/3789116749","heartbeat_front_addr":"172.21.15.87:6831/3789116749","state":["exists","up"]},{"osd":10,"uuid":"43945081-b4c8-4f5d-9301-3540709e69e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":66,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6824","nonce":716529498},{"type":"v1","addr":"172.21.15.90:6825","nonce":716529498}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6826","nonce":716529498},{"type":"v1","addr":"172.21.15.90:6827","nonce":716529498}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6830","nonce":716529498},{"type":"v1","addr":"172.21.15.90:6831","nonce":716529498}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6828","nonce":716529498},{"type":"v1","addr":"172.21.15.90:6829","nonce":716529498}]},"public_addr":"172.21.15.90:6825/716529498","cluster_addr":"172.21.15.90:6827/716529498","heartbeat_back_addr":"172.21.15.90:6831/716529498","heartbeat_front_addr":"172.21.15.90:6829/716529498","state":["exists","up"]},{"osd":11,"uuid":"da23ff5c-3f79-44e3-bca3-d9d5a003c999","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6824","nonce":1842739135},{"type":"v1","addr":"172.21.15.160:6825","nonce":1842739135}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6826","nonce":1842739135},{"type":"v1","addr":"172.21.15.160:6827","nonce":1842739135}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6830","nonce":1842739135},{"type":"v1","addr":"172.21.15.160:6831","nonce":1842739135}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6828","nonce":1842739135},{"type":"v1","addr":"172.21.15.160:6829","nonce":1842739135}]},"public_addr":"172.21.15.160:6825/1842739135","cluster_addr":"172.21.15.160:6827/1842739135","heartbeat_back_addr":"172.21.15.160:6831/1842739135","heartbeat_front_addr":"172.21.15.160:6829/1842739135","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T05:19:15.869398+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T05:19:42.014078+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T05:20:06.430660+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T05:20:38.555519+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T05:21:04.530605+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T05:21:29.545252+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T05:22:03.141982+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T05:22:29.191127+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T05:22:54.502994+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T05:23:27.899000+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T05:23:54.693979+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T05:24:20.307119+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.a","mappings":[{"from":2,"to":11}]},{"pgid":"2.1d","mappings":[{"from":2,"to":4},{"from":8,"to":11}]},{"pgid":"3.0","mappings":[{"from":4,"to":8}]},{"pgid":"3.1","mappings":[{"from":4,"to":9}]},{"pgid":"3.12","mappings":[{"from":3,"to":9}]},{"pgid":"3.28","mappings":[{"from":5,"to":6}]},{"pgid":"3.2c","mappings":[{"from":4,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.87:0/4226160503":"2024-05-09T05:17:22.736165+0000","172.21.15.87:0/2773684806":"2024-05-09T05:17:22.736165+0000","172.21.15.87:0/349590592":"2024-05-09T05:17:22.736165+0000","172.21.15.87:6801/2710124295":"2024-05-09T05:17:22.736165+0000","172.21.15.87:6800/1823425617":"2024-05-09T05:16:48.155337+0000","172.21.15.87:0/2393072013":"2024-05-09T05:16:48.155337+0000","172.21.15.87:0/1291525416":"2024-05-09T05:16:48.155337+0000","172.21.15.87:6801/1823425617":"2024-05-09T05:16:48.155337+0000","172.21.15.87:0/3839463573":"2024-05-09T05:16:48.155337+0000","172.21.15.87:6800/2710124295":"2024-05-09T05:17:22.736165+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-08T05:26:48.020 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:48.018+0000 7f742d400700 1 -- 172.21.15.87:0/312036705 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f740c0b2990 msgr2=0x7f740c0b4e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:26:48.020 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:48.018+0000 7f742d400700 1 --2- 172.21.15.87:0/312036705 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f740c0b2990 0x7f740c0b4e50 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f74180062a0 tx=0x7f7418006210 comp rx=0 tx=0).stop 2024-05-08T05:26:48.020 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:48.018+0000 7f742d400700 1 -- 172.21.15.87:0/312036705 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7428103d90 msgr2=0x7f74281a1e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:26:48.020 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:48.018+0000 7f742d400700 1 --2- 172.21.15.87:0/312036705 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7428103d90 0x7f74281a1e50 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f741000e9a0 tx=0x7f741000ecb0 comp rx=0 tx=0).stop 2024-05-08T05:26:48.020 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:48.018+0000 7f742d400700 1 -- 172.21.15.87:0/312036705 shutdown_connections 2024-05-08T05:26:48.020 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:48.018+0000 7f742d400700 1 --2- 172.21.15.87:0/312036705 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7428109460 0x7f742819bb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:26:48.020 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:48.018+0000 7f742d400700 1 --2- 172.21.15.87:0/312036705 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f740c0b2990 0x7f740c0b4e50 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:26:48.020 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:48.018+0000 7f742d400700 1 --2- 172.21.15.87:0/312036705 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f74281033d0 0x7f74281a1910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:26:48.020 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:48.018+0000 7f742d400700 1 --2- 172.21.15.87:0/312036705 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7428103d90 0x7f74281a1e50 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:26:48.020 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:48.018+0000 7f742d400700 1 -- 172.21.15.87:0/312036705 >> 172.21.15.87:0/312036705 conn(0x7f74280fef20 msgr2=0x7f74280ff4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:26:48.020 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:48.018+0000 7f742d400700 1 -- 172.21.15.87:0/312036705 shutdown_connections 2024-05-08T05:26:48.020 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:48.018+0000 7f742d400700 1 -- 172.21.15.87:0/312036705 wait complete. 2024-05-08T05:26:48.289 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:26:48 smithi160 ceph-mon[34827]: pgmap v354: 97 pgs: 97 active+clean; 644 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T05:26:48.392 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:26:48 smithi087 ceph-mon[29523]: pgmap v354: 97 pgs: 97 active+clean; 644 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T05:26:48.483 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:26:48 smithi090 ceph-mon[34526]: pgmap v354: 97 pgs: 97 active+clean; 644 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T05:26:48.880 DEBUG:teuthology.orchestra.run.smithi087:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid eeeb813e-0cf9-11ef-bc97-c7b262605968 -- ceph tell osd.0 flush_pg_stats 2024-05-08T05:26:48.881 DEBUG:teuthology.orchestra.run.smithi087:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid eeeb813e-0cf9-11ef-bc97-c7b262605968 -- ceph tell osd.1 flush_pg_stats 2024-05-08T05:26:48.881 DEBUG:teuthology.orchestra.run.smithi087:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid eeeb813e-0cf9-11ef-bc97-c7b262605968 -- ceph tell osd.2 flush_pg_stats 2024-05-08T05:26:48.882 DEBUG:teuthology.orchestra.run.smithi087:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid eeeb813e-0cf9-11ef-bc97-c7b262605968 -- ceph tell osd.3 flush_pg_stats 2024-05-08T05:26:48.882 DEBUG:teuthology.orchestra.run.smithi087:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid eeeb813e-0cf9-11ef-bc97-c7b262605968 -- ceph tell osd.4 flush_pg_stats 2024-05-08T05:26:48.883 DEBUG:teuthology.orchestra.run.smithi087:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid eeeb813e-0cf9-11ef-bc97-c7b262605968 -- ceph tell osd.5 flush_pg_stats 2024-05-08T05:26:48.883 DEBUG:teuthology.orchestra.run.smithi087:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid eeeb813e-0cf9-11ef-bc97-c7b262605968 -- ceph tell osd.6 flush_pg_stats 2024-05-08T05:26:48.883 DEBUG:teuthology.orchestra.run.smithi087:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid eeeb813e-0cf9-11ef-bc97-c7b262605968 -- ceph tell osd.7 flush_pg_stats 2024-05-08T05:26:48.884 DEBUG:teuthology.orchestra.run.smithi087:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid eeeb813e-0cf9-11ef-bc97-c7b262605968 -- ceph tell osd.8 flush_pg_stats 2024-05-08T05:26:48.884 DEBUG:teuthology.orchestra.run.smithi087:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid eeeb813e-0cf9-11ef-bc97-c7b262605968 -- ceph tell osd.9 flush_pg_stats 2024-05-08T05:26:48.884 DEBUG:teuthology.orchestra.run.smithi087:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid eeeb813e-0cf9-11ef-bc97-c7b262605968 -- ceph tell osd.10 flush_pg_stats 2024-05-08T05:26:48.885 DEBUG:teuthology.orchestra.run.smithi087:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid eeeb813e-0cf9-11ef-bc97-c7b262605968 -- ceph tell osd.11 flush_pg_stats 2024-05-08T05:26:49.058 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:26:49 smithi087 ceph-mon[29523]: from='client.? 172.21.15.87:0/312036705' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-08T05:26:49.289 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:26:49 smithi160 ceph-mon[34827]: from='client.? 172.21.15.87:0/312036705' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-08T05:26:49.483 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:26:49 smithi090 ceph-mon[34526]: from='client.? 172.21.15.87:0/312036705' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-08T05:26:49.859 INFO:teuthology.orchestra.run.smithi087.stderr:Inferring config /var/lib/ceph/eeeb813e-0cf9-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T05:26:49.864 INFO:teuthology.orchestra.run.smithi087.stderr:Inferring config /var/lib/ceph/eeeb813e-0cf9-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T05:26:49.884 INFO:teuthology.orchestra.run.smithi087.stderr:Inferring config /var/lib/ceph/eeeb813e-0cf9-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T05:26:49.992 INFO:teuthology.orchestra.run.smithi087.stderr:Inferring config /var/lib/ceph/eeeb813e-0cf9-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T05:26:50.288 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:26:50 smithi087 ceph-mon[29523]: pgmap v355: 97 pgs: 97 active+clean; 644 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-05-08T05:26:50.288 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:26:50 smithi160 ceph-mon[34827]: pgmap v355: 97 pgs: 97 active+clean; 644 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-05-08T05:26:50.483 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:26:50 smithi090 ceph-mon[34526]: pgmap v355: 97 pgs: 97 active+clean; 644 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-05-08T05:26:51.645 INFO:teuthology.orchestra.run.smithi087.stderr:Inferring config /var/lib/ceph/eeeb813e-0cf9-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T05:26:52.288 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:26:52 smithi160 ceph-mon[34827]: pgmap v356: 97 pgs: 97 active+clean; 644 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T05:26:52.389 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:26:52 smithi087 ceph-mon[29523]: pgmap v356: 97 pgs: 97 active+clean; 644 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T05:26:52.483 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:26:52 smithi090 ceph-mon[34526]: pgmap v356: 97 pgs: 97 active+clean; 644 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T05:26:53.696 INFO:teuthology.orchestra.run.smithi087.stderr:Inferring config /var/lib/ceph/eeeb813e-0cf9-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T05:26:53.696 INFO:teuthology.orchestra.run.smithi087.stderr:Inferring config /var/lib/ceph/eeeb813e-0cf9-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T05:26:54.289 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:26:54 smithi160 ceph-mon[34827]: pgmap v357: 97 pgs: 97 active+clean; 644 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-05-08T05:26:54.458 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:26:54 smithi087 ceph-mon[29523]: pgmap v357: 97 pgs: 97 active+clean; 644 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-05-08T05:26:54.483 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:26:54 smithi090 ceph-mon[34526]: pgmap v357: 97 pgs: 97 active+clean; 644 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-05-08T05:26:55.028 INFO:teuthology.orchestra.run.smithi087.stderr:Inferring config /var/lib/ceph/eeeb813e-0cf9-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T05:26:55.028 INFO:teuthology.orchestra.run.smithi087.stderr:Inferring config /var/lib/ceph/eeeb813e-0cf9-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T05:26:55.029 INFO:teuthology.orchestra.run.smithi087.stderr:Inferring config /var/lib/ceph/eeeb813e-0cf9-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T05:26:55.030 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:55.029+0000 7ff3aa400700 1 -- 172.21.15.87:0/3873755129 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff3a410f9d0 msgr2=0x7ff3a410fdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:26:55.030 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:55.029+0000 7ff3aa400700 1 --2- 172.21.15.87:0/3873755129 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff3a410f9d0 0x7ff3a410fdb0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7ff38c009990 tx=0x7ff38c009ca0 comp rx=0 tx=0).stop 2024-05-08T05:26:55.030 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:55.029+0000 7ff3aa400700 1 -- 172.21.15.87:0/3873755129 shutdown_connections 2024-05-08T05:26:55.030 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:55.029+0000 7ff3aa400700 1 --2- 172.21.15.87:0/3873755129 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff3a410a3a0 0x7ff3a41168a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:26:55.030 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:55.029+0000 7ff3aa400700 1 --2- 172.21.15.87:0/3873755129 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff3a410f9d0 0x7ff3a410fdb0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:26:55.030 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:55.029+0000 7ff3aa400700 1 --2- 172.21.15.87:0/3873755129 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff3a41099e0 0x7ff3a4109e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:26:55.030 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:55.029+0000 7ff3aa400700 1 -- 172.21.15.87:0/3873755129 >> 172.21.15.87:0/3873755129 conn(0x7ff3a40792a0 msgr2=0x7ff3a41082c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:26:55.030 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:55.029+0000 7ff3aa400700 1 -- 172.21.15.87:0/3873755129 shutdown_connections 2024-05-08T05:26:55.030 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:55.029+0000 7ff3aa400700 1 -- 172.21.15.87:0/3873755129 wait complete. 2024-05-08T05:26:55.031 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:55.030+0000 7ff3aa400700 1 Processor -- start 2024-05-08T05:26:55.031 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:55.031+0000 7ff3aa400700 1 -- start start 2024-05-08T05:26:55.031 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:55.031+0000 7ff3aa400700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff3a41099e0 0x7ff3a41a00f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:26:55.031 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:55.031+0000 7ff3aa400700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff3a410a3a0 0x7ff3a41a0630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:26:55.032 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:55.031+0000 7ff3aa400700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff3a410f9d0 0x7ff3a41a49c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:26:55.032 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:55.031+0000 7ff3aa400700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7ff3a4119c20 con 0x7ff3a41099e0 2024-05-08T05:26:55.032 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:55.031+0000 7ff3aa400700 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7ff3a4119aa0 con 0x7ff3a410a3a0 2024-05-08T05:26:55.032 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:55.031+0000 7ff3aa400700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7ff3a4119da0 con 0x7ff3a410f9d0 2024-05-08T05:26:55.032 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:55.032+0000 7ff3a9a00700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff3a410f9d0 0x7ff3a41a49c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:26:55.032 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:55.032+0000 7ff3a9000700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff3a41099e0 0x7ff3a41a00f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:26:55.032 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:55.032+0000 7ff3a9a00700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff3a410f9d0 0x7ff3a41a49c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.87:53630/0 (socket says 172.21.15.87:53630) 2024-05-08T05:26:55.033 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:55.032+0000 7ff3a9a00700 1 -- 172.21.15.87:0/88151979 learned_addr learned my addr 172.21.15.87:0/88151979 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T05:26:55.033 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:55.032+0000 7ff3a9000700 1 -- 172.21.15.87:0/88151979 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff3a410f9d0 msgr2=0x7ff3a41a49c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:26:55.033 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:55.032+0000 7ff3a9000700 1 --2- 172.21.15.87:0/88151979 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff3a410f9d0 0x7ff3a41a49c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:26:55.033 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:55.032+0000 7ff3a9000700 1 -- 172.21.15.87:0/88151979 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff3a410a3a0 msgr2=0x7ff3a41a0630 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-05-08T05:26:55.034 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:55.032+0000 7ff3a9000700 1 --2- 172.21.15.87:0/88151979 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff3a410a3a0 0x7ff3a41a0630 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:26:55.034 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:55.032+0000 7ff3a9000700 1 -- 172.21.15.87:0/88151979 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff3a41a5100 con 0x7ff3a41099e0 2024-05-08T05:26:55.034 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:55.032+0000 7ff3a9a00700 1 --2- 172.21.15.87:0/88151979 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff3a410f9d0 0x7ff3a41a49c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T05:26:55.034 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:55.033+0000 7ff3a9000700 1 --2- 172.21.15.87:0/88151979 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff3a41099e0 0x7ff3a41a00f0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7ff38c000c00 tx=0x7ff38c0047b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:26:55.043 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:55.039+0000 7ff3a1600700 1 -- 172.21.15.87:0/88151979 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff38c00fb10 con 0x7ff3a41099e0 2024-05-08T05:26:55.043 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:55.039+0000 7ff3a1600700 1 -- 172.21.15.87:0/88151979 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff38c004ce0 con 0x7ff3a41099e0 2024-05-08T05:26:55.043 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:55.039+0000 7ff3a1600700 1 -- 172.21.15.87:0/88151979 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff38c005430 con 0x7ff3a41099e0 2024-05-08T05:26:55.043 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:55.039+0000 7ff3aa400700 1 -- 172.21.15.87:0/88151979 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff3a41a5390 con 0x7ff3a41099e0 2024-05-08T05:26:55.043 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:55.039+0000 7ff3aa400700 1 -- 172.21.15.87:0/88151979 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff3a41a57c0 con 0x7ff3a41099e0 2024-05-08T05:26:55.044 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:55.043+0000 7ff3aa400700 1 -- 172.21.15.87:0/88151979 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7ff3a4063bb0 con 0x7ff3a41099e0 2024-05-08T05:26:55.045 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:55.045+0000 7ff3a1600700 1 -- 172.21.15.87:0/88151979 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 17) ==== 149703+0+0 (secure 0 0 0) 0x7ff38c009d10 con 0x7ff3a41099e0 2024-05-08T05:26:55.048 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:55.047+0000 7ff3a1600700 1 --2- 172.21.15.87:0/88151979 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7ff3880b2ae0 0x7ff3880b4fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:26:55.048 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:55.048+0000 7ff3a1600700 1 -- 172.21.15.87:0/88151979 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8190+0+0 (secure 0 0 0) 0x7ff38c0e2e50 con 0x7ff3a41099e0 2024-05-08T05:26:55.049 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:55.048+0000 7ff3a3e00700 1 --2- 172.21.15.87:0/88151979 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7ff3880b2ae0 0x7ff3880b4fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:26:55.049 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:55.048+0000 7ff3a1600700 1 --2- 172.21.15.87:0/88151979 >> [v2:172.21.15.87:6818/2863681447,v1:172.21.15.87:6819/2863681447] conn(0x7ff3880bc5a0 0x7ff3880bea40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:26:55.049 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:55.048+0000 7ff3a1600700 1 -- 172.21.15.87:0/88151979 --> [v2:172.21.15.87:6818/2863681447,v1:172.21.15.87:6819/2863681447] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7ff38c001d30 con 0x7ff3880bc5a0 2024-05-08T05:26:55.049 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:55.048+0000 7ff3a1600700 1 -- 172.21.15.87:0/88151979 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_get_version_reply(handle=1 version=82) ==== 24+0+0 (secure 0 0 0) 0x7ff38c0e54b0 con 0x7ff3a41099e0 2024-05-08T05:26:55.050 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:55.049+0000 7ff3a3e00700 1 --2- 172.21.15.87:0/88151979 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7ff3880b2ae0 0x7ff3880b4fa0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7ff3a4109590 tx=0x7ff394009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:26:55.050 INFO:teuthology.orchestra.run.smithi087.stderr:Inferring config /var/lib/ceph/eeeb813e-0cf9-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T05:26:55.051 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:55.050+0000 7ff3a9a00700 1 --2- 172.21.15.87:0/88151979 >> [v2:172.21.15.87:6818/2863681447,v1:172.21.15.87:6819/2863681447] conn(0x7ff3880bc5a0 0x7ff3880bea40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:26:55.051 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:55.051+0000 7ff3a9a00700 1 --2- 172.21.15.87:0/88151979 >> [v2:172.21.15.87:6818/2863681447,v1:172.21.15.87:6819/2863681447] conn(0x7ff3880bc5a0 0x7ff3880bea40 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:26:55.052 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:55.052+0000 7ff3a1600700 1 -- 172.21.15.87:0/88151979 <== osd.6 v2:172.21.15.87:6818/2863681447 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7ff38c001d30 con 0x7ff3880bc5a0 2024-05-08T05:26:55.075 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:55.074+0000 7ff3aa400700 1 -- 172.21.15.87:0/88151979 --> [v2:172.21.15.87:6818/2863681447,v1:172.21.15.87:6819/2863681447] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7ff3a4064030 con 0x7ff3880bc5a0 2024-05-08T05:26:55.076 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:55.075+0000 7ff3a1600700 1 -- 172.21.15.87:0/88151979 <== osd.6 v2:172.21.15.87:6818/2863681447 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7ff3a4064030 con 0x7ff3880bc5a0 2024-05-08T05:26:55.077 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:55.076+0000 7ff3aa400700 1 -- 172.21.15.87:0/88151979 >> [v2:172.21.15.87:6818/2863681447,v1:172.21.15.87:6819/2863681447] conn(0x7ff3880bc5a0 msgr2=0x7ff3880bea40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:26:55.077 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:55.076+0000 7ff3aa400700 1 --2- 172.21.15.87:0/88151979 >> [v2:172.21.15.87:6818/2863681447,v1:172.21.15.87:6819/2863681447] conn(0x7ff3880bc5a0 0x7ff3880bea40 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:26:55.077 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:55.076+0000 7ff3aa400700 1 -- 172.21.15.87:0/88151979 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7ff3880b2ae0 msgr2=0x7ff3880b4fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:26:55.077 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:55.076+0000 7ff3aa400700 1 --2- 172.21.15.87:0/88151979 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7ff3880b2ae0 0x7ff3880b4fa0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7ff3a4109590 tx=0x7ff394009260 comp rx=0 tx=0).stop 2024-05-08T05:26:55.077 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:55.076+0000 7ff3aa400700 1 -- 172.21.15.87:0/88151979 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff3a41099e0 msgr2=0x7ff3a41a00f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:26:55.077 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:55.076+0000 7ff3aa400700 1 --2- 172.21.15.87:0/88151979 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff3a41099e0 0x7ff3a41a00f0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7ff38c000c00 tx=0x7ff38c0047b0 comp rx=0 tx=0).stop 2024-05-08T05:26:55.077 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:55.077+0000 7ff3a9a00700 1 -- 172.21.15.87:0/88151979 reap_dead start 2024-05-08T05:26:55.077 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:55.077+0000 7ff3aa400700 1 -- 172.21.15.87:0/88151979 shutdown_connections 2024-05-08T05:26:55.077 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:55.077+0000 7ff3aa400700 1 -- 172.21.15.87:0/88151979 >> 172.21.15.87:0/88151979 conn(0x7ff3a40792a0 msgr2=0x7ff3a4079920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:26:55.078 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:55.078+0000 7ff3aa400700 1 -- 172.21.15.87:0/88151979 shutdown_connections 2024-05-08T05:26:55.078 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:55.078+0000 7ff3aa400700 1 -- 172.21.15.87:0/88151979 wait complete. 2024-05-08T05:26:55.617 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:55.616+0000 7fd663a00700 1 -- 172.21.15.87:0/1748776795 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd65c0756d0 msgr2=0x7fd65c075ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:26:55.617 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:55.616+0000 7fd663a00700 1 --2- 172.21.15.87:0/1748776795 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd65c0756d0 0x7fd65c075ab0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fd64c00b0a0 tx=0x7fd64c00b3b0 comp rx=0 tx=0).stop 2024-05-08T05:26:55.617 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:55.616+0000 7fd663a00700 1 -- 172.21.15.87:0/1748776795 shutdown_connections 2024-05-08T05:26:55.617 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:55.616+0000 7fd663a00700 1 --2- 172.21.15.87:0/1748776795 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd65c114670 0x7fd65c116a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:26:55.617 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:55.616+0000 7fd663a00700 1 --2- 172.21.15.87:0/1748776795 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd65c0756d0 0x7fd65c075ab0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:26:55.617 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:55.616+0000 7fd663a00700 1 --2- 172.21.15.87:0/1748776795 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd65c075ff0 0x7fd65c114130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:26:55.617 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:55.616+0000 7fd663a00700 1 -- 172.21.15.87:0/1748776795 >> 172.21.15.87:0/1748776795 conn(0x7fd65c07a650 msgr2=0x7fd65c07aa60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:26:55.617 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:55.616+0000 7fd663a00700 1 -- 172.21.15.87:0/1748776795 shutdown_connections 2024-05-08T05:26:55.617 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:55.616+0000 7fd663a00700 1 -- 172.21.15.87:0/1748776795 wait complete. 2024-05-08T05:26:55.619 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:55.617+0000 7fd663a00700 1 Processor -- start 2024-05-08T05:26:55.619 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:55.617+0000 7fd663a00700 1 -- start start 2024-05-08T05:26:55.619 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:55.617+0000 7fd663a00700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd65c0756d0 0x7fd65c1a01d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:26:55.619 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:55.617+0000 7fd663a00700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd65c075ff0 0x7fd65c1a0710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:26:55.619 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:55.617+0000 7fd663a00700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd65c114670 0x7fd65c1a4aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:26:55.619 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:55.617+0000 7fd663a00700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fd65c119d00 con 0x7fd65c0756d0 2024-05-08T05:26:55.619 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:55.617+0000 7fd663a00700 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fd65c119b80 con 0x7fd65c114670 2024-05-08T05:26:55.619 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:55.617+0000 7fd663a00700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7fd65c119e80 con 0x7fd65c075ff0 2024-05-08T05:26:55.619 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:55.618+0000 7fd661000700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd65c0756d0 0x7fd65c1a01d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:26:55.619 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:55.618+0000 7fd661000700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd65c0756d0 0x7fd65c1a01d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:34756/0 (socket says 172.21.15.87:34756) 2024-05-08T05:26:55.620 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:55.618+0000 7fd661000700 1 -- 172.21.15.87:0/2264946850 learned_addr learned my addr 172.21.15.87:0/2264946850 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T05:26:55.620 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:55.618+0000 7fd653e00700 1 --2- 172.21.15.87:0/2264946850 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd65c075ff0 0x7fd65c1a0710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:26:55.620 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:55.618+0000 7fd661a00700 1 --2- 172.21.15.87:0/2264946850 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd65c114670 0x7fd65c1a4aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:26:55.620 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:55.618+0000 7fd661000700 1 -- 172.21.15.87:0/2264946850 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd65c075ff0 msgr2=0x7fd65c1a0710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:26:55.620 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:55.618+0000 7fd661000700 1 --2- 172.21.15.87:0/2264946850 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd65c075ff0 0x7fd65c1a0710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:26:55.620 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:55.618+0000 7fd661000700 1 -- 172.21.15.87:0/2264946850 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd65c114670 msgr2=0x7fd65c1a4aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:26:55.620 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:55.618+0000 7fd661000700 1 --2- 172.21.15.87:0/2264946850 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd65c114670 0x7fd65c1a4aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:26:55.620 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:55.618+0000 7fd661000700 1 -- 172.21.15.87:0/2264946850 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd65c1a51e0 con 0x7fd65c0756d0 2024-05-08T05:26:55.620 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:55.619+0000 7fd661000700 1 --2- 172.21.15.87:0/2264946850 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd65c0756d0 0x7fd65c1a01d0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fd64c00d010 tx=0x7fd64c004d00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:26:55.621 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:55.619+0000 7fd65a000700 1 -- 172.21.15.87:0/2264946850 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd64c021070 con 0x7fd65c0756d0 2024-05-08T05:26:55.621 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:55.619+0000 7fd663a00700 1 -- 172.21.15.87:0/2264946850 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd65c1a5470 con 0x7fd65c0756d0 2024-05-08T05:26:55.621 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:55.619+0000 7fd65a000700 1 -- 172.21.15.87:0/2264946850 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd64c007e30 con 0x7fd65c0756d0 2024-05-08T05:26:55.621 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:55.619+0000 7fd65a000700 1 -- 172.21.15.87:0/2264946850 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd64c004640 con 0x7fd65c0756d0 2024-05-08T05:26:55.621 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:55.619+0000 7fd663a00700 1 -- 172.21.15.87:0/2264946850 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd65c1acd50 con 0x7fd65c0756d0 2024-05-08T05:26:55.621 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:55.620+0000 7fd663a00700 1 -- 172.21.15.87:0/2264946850 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fd65c113e50 con 0x7fd65c0756d0 2024-05-08T05:26:55.623 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:55.622+0000 7fd65a000700 1 -- 172.21.15.87:0/2264946850 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 17) ==== 149703+0+0 (secure 0 0 0) 0x7fd64c007980 con 0x7fd65c0756d0 2024-05-08T05:26:55.624 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:55.624+0000 7fd65a000700 1 --2- 172.21.15.87:0/2264946850 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7fd6400b2910 0x7fd6400b4dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:26:55.624 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:55.624+0000 7fd65a000700 1 -- 172.21.15.87:0/2264946850 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8190+0+0 (secure 0 0 0) 0x7fd64c00f020 con 0x7fd65c0756d0 2024-05-08T05:26:55.624 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:55.624+0000 7fd653e00700 1 --2- 172.21.15.87:0/2264946850 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7fd6400b2910 0x7fd6400b4dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:26:55.625 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:55.624+0000 7fd65a000700 1 --2- 172.21.15.87:0/2264946850 >> [v2:172.21.15.160:6800/2137179096,v1:172.21.15.160:6801/2137179096] conn(0x7fd6400bc3d0 0x7fd6400be870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:26:55.625 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:55.624+0000 7fd65a000700 1 -- 172.21.15.87:0/2264946850 --> [v2:172.21.15.160:6800/2137179096,v1:172.21.15.160:6801/2137179096] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fd6400bef40 con 0x7fd6400bc3d0 2024-05-08T05:26:55.625 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:55.624+0000 7fd65a000700 1 -- 172.21.15.87:0/2264946850 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_get_version_reply(handle=1 version=82) ==== 24+0+0 (secure 0 0 0) 0x7fd64c0e3dd0 con 0x7fd65c0756d0 2024-05-08T05:26:55.625 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:55.625+0000 7fd661a00700 1 --2- 172.21.15.87:0/2264946850 >> [v2:172.21.15.160:6800/2137179096,v1:172.21.15.160:6801/2137179096] conn(0x7fd6400bc3d0 0x7fd6400be870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:26:55.625 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:55.625+0000 7fd653e00700 1 --2- 172.21.15.87:0/2264946850 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7fd6400b2910 0x7fd6400b4dd0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fd65c110f90 tx=0x7fd644009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:26:55.626 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:55.625+0000 7fd661a00700 1 --2- 172.21.15.87:0/2264946850 >> [v2:172.21.15.160:6800/2137179096,v1:172.21.15.160:6801/2137179096] conn(0x7fd6400bc3d0 0x7fd6400be870 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:26:55.626 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:55.626+0000 7fd65a000700 1 -- 172.21.15.87:0/2264946850 <== osd.2 v2:172.21.15.160:6800/2137179096 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fd6400bef40 con 0x7fd6400bc3d0 2024-05-08T05:26:55.644 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:55.644+0000 7fd663a00700 1 -- 172.21.15.87:0/2264946850 --> [v2:172.21.15.160:6800/2137179096,v1:172.21.15.160:6801/2137179096] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fd65c076df0 con 0x7fd6400bc3d0 2024-05-08T05:26:55.645 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:55.645+0000 7fd65a000700 1 -- 172.21.15.87:0/2264946850 <== osd.2 v2:172.21.15.160:6800/2137179096 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fd65c076df0 con 0x7fd6400bc3d0 2024-05-08T05:26:55.646 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:55.645+0000 7fd663a00700 1 -- 172.21.15.87:0/2264946850 >> [v2:172.21.15.160:6800/2137179096,v1:172.21.15.160:6801/2137179096] conn(0x7fd6400bc3d0 msgr2=0x7fd6400be870 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:26:55.646 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:55.645+0000 7fd663a00700 1 --2- 172.21.15.87:0/2264946850 >> [v2:172.21.15.160:6800/2137179096,v1:172.21.15.160:6801/2137179096] conn(0x7fd6400bc3d0 0x7fd6400be870 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:26:55.646 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:55.646+0000 7fd663a00700 1 -- 172.21.15.87:0/2264946850 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7fd6400b2910 msgr2=0x7fd6400b4dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:26:55.646 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:55.646+0000 7fd663a00700 1 --2- 172.21.15.87:0/2264946850 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7fd6400b2910 0x7fd6400b4dd0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fd65c110f90 tx=0x7fd644009260 comp rx=0 tx=0).stop 2024-05-08T05:26:55.647 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:55.646+0000 7fd663a00700 1 -- 172.21.15.87:0/2264946850 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd65c0756d0 msgr2=0x7fd65c1a01d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:26:55.647 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:55.646+0000 7fd663a00700 1 --2- 172.21.15.87:0/2264946850 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd65c0756d0 0x7fd65c1a01d0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fd64c00d010 tx=0x7fd64c004d00 comp rx=0 tx=0).stop 2024-05-08T05:26:55.647 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:55.646+0000 7fd661a00700 1 -- 172.21.15.87:0/2264946850 reap_dead start 2024-05-08T05:26:55.647 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:55.646+0000 7fd663a00700 1 -- 172.21.15.87:0/2264946850 shutdown_connections 2024-05-08T05:26:55.647 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:55.646+0000 7fd663a00700 1 -- 172.21.15.87:0/2264946850 >> 172.21.15.87:0/2264946850 conn(0x7fd65c07a650 msgr2=0x7fd65c113430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:26:55.647 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:55.646+0000 7fd663a00700 1 -- 172.21.15.87:0/2264946850 shutdown_connections 2024-05-08T05:26:55.647 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:55.646+0000 7fd663a00700 1 -- 172.21.15.87:0/2264946850 wait complete. 2024-05-08T05:26:56.208 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:26:56 smithi087 ceph-mon[29523]: pgmap v358: 97 pgs: 97 active+clean; 644 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-05-08T05:26:56.288 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:26:56 smithi160 ceph-mon[34827]: pgmap v358: 97 pgs: 97 active+clean; 644 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-05-08T05:26:56.483 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:26:56 smithi090 ceph-mon[34526]: pgmap v358: 97 pgs: 97 active+clean; 644 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-05-08T05:26:57.717 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:57.218+0000 7f49d3800700 1 -- 172.21.15.87:0/1467575252 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f49cc0756d0 msgr2=0x7f49cc075ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:26:57.717 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:57.218+0000 7f49d3800700 1 --2- 172.21.15.87:0/1467575252 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f49cc0756d0 0x7f49cc075ab0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f49bc009990 tx=0x7f49bc009ca0 comp rx=0 tx=0).stop 2024-05-08T05:26:57.717 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:57.218+0000 7f49d3800700 1 -- 172.21.15.87:0/1467575252 shutdown_connections 2024-05-08T05:26:57.717 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:57.218+0000 7f49d3800700 1 --2- 172.21.15.87:0/1467575252 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f49cc114670 0x7f49cc116a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:26:57.717 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:57.218+0000 7f49d3800700 1 --2- 172.21.15.87:0/1467575252 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f49cc0756d0 0x7f49cc075ab0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:26:57.717 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:57.218+0000 7f49d3800700 1 --2- 172.21.15.87:0/1467575252 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f49cc075ff0 0x7f49cc114130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:26:57.717 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:57.218+0000 7f49d3800700 1 -- 172.21.15.87:0/1467575252 >> 172.21.15.87:0/1467575252 conn(0x7f49cc07a600 msgr2=0x7f49cc07aa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:26:57.717 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:57.218+0000 7f49d3800700 1 -- 172.21.15.87:0/1467575252 shutdown_connections 2024-05-08T05:26:57.718 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:57.218+0000 7f49d3800700 1 -- 172.21.15.87:0/1467575252 wait complete. 2024-05-08T05:26:57.718 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:57.219+0000 7f49d3800700 1 Processor -- start 2024-05-08T05:26:57.718 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:57.220+0000 7f49d3800700 1 -- start start 2024-05-08T05:26:57.718 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:57.220+0000 7f49d3800700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f49cc0756d0 0x7f49cc1a0260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:26:57.718 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:57.220+0000 7f49d3800700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f49cc075ff0 0x7f49cc1a07a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:26:57.718 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:57.220+0000 7f49d3800700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f49cc114670 0x7f49cc1a4b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:26:57.718 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:57.220+0000 7f49d3800700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f49cc119cb0 con 0x7f49cc114670 2024-05-08T05:26:57.718 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:57.220+0000 7f49d3800700 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f49cc119b30 con 0x7f49cc0756d0 2024-05-08T05:26:57.718 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:57.220+0000 7f49d3800700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f49cc119e30 con 0x7f49cc075ff0 2024-05-08T05:26:57.718 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:57.220+0000 7f49d0e00700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f49cc0756d0 0x7f49cc1a0260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:26:57.718 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:57.220+0000 7f49d0e00700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f49cc0756d0 0x7f49cc1a0260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.87:52602/0 (socket says 172.21.15.87:52602) 2024-05-08T05:26:57.718 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:57.220+0000 7f49d0e00700 1 -- 172.21.15.87:0/3386289358 learned_addr learned my addr 172.21.15.87:0/3386289358 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T05:26:57.718 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:57.220+0000 7f49d1800700 1 --2- 172.21.15.87:0/3386289358 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f49cc114670 0x7f49cc1a4b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:26:57.718 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:57.220+0000 7f49c3e00700 1 --2- 172.21.15.87:0/3386289358 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f49cc075ff0 0x7f49cc1a07a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:26:57.719 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:57.221+0000 7f49d0e00700 1 -- 172.21.15.87:0/3386289358 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f49cc075ff0 msgr2=0x7f49cc1a07a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:26:57.719 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:57.221+0000 7f49d0e00700 1 --2- 172.21.15.87:0/3386289358 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f49cc075ff0 0x7f49cc1a07a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:26:57.719 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:57.221+0000 7f49d0e00700 1 -- 172.21.15.87:0/3386289358 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f49cc114670 msgr2=0x7f49cc1a4b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:26:57.719 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:57.221+0000 7f49d0e00700 1 --2- 172.21.15.87:0/3386289358 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f49cc114670 0x7f49cc1a4b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:26:57.719 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:57.221+0000 7f49d0e00700 1 -- 172.21.15.87:0/3386289358 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f49cc1a5270 con 0x7f49cc0756d0 2024-05-08T05:26:57.719 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:57.221+0000 7f49d0e00700 1 --2- 172.21.15.87:0/3386289358 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f49cc0756d0 0x7f49cc1a0260 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f49bc000c00 tx=0x7f49bc0057c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:26:57.719 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:57.221+0000 7f49ca000700 1 -- 172.21.15.87:0/3386289358 <== mon.2 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49bc027070 con 0x7f49cc0756d0 2024-05-08T05:26:57.719 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:57.221+0000 7f49ca000700 1 -- 172.21.15.87:0/3386289358 <== mon.2 v2:172.21.15.90:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f49bc022470 con 0x7f49cc0756d0 2024-05-08T05:26:57.719 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:57.221+0000 7f49ca000700 1 -- 172.21.15.87:0/3386289358 <== mon.2 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49bc017650 con 0x7f49cc0756d0 2024-05-08T05:26:57.719 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:57.221+0000 7f49d3800700 1 -- 172.21.15.87:0/3386289358 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f49cc1a5500 con 0x7f49cc0756d0 2024-05-08T05:26:57.719 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:57.221+0000 7f49d3800700 1 -- 172.21.15.87:0/3386289358 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f49cc1acde0 con 0x7f49cc0756d0 2024-05-08T05:26:57.719 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:57.222+0000 7f49d3800700 1 -- 172.21.15.87:0/3386289358 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f49cc1a5990 con 0x7f49cc0756d0 2024-05-08T05:26:57.719 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:57.225+0000 7f49ca000700 1 -- 172.21.15.87:0/3386289358 <== mon.2 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 17) ==== 149703+0+0 (secure 0 0 0) 0x7f49bc02a070 con 0x7f49cc0756d0 2024-05-08T05:26:57.719 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:57.226+0000 7f49ca000700 1 --2- 172.21.15.87:0/3386289358 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f49ac0b2910 0x7f49ac0b4dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:26:57.719 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:57.226+0000 7f49ca000700 1 -- 172.21.15.87:0/3386289358 <== mon.2 v2:172.21.15.90:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8190+0+0 (secure 0 0 0) 0x7f49bc0e3350 con 0x7f49cc0756d0 2024-05-08T05:26:57.720 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:57.226+0000 7f49c3e00700 1 --2- 172.21.15.87:0/3386289358 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f49ac0b2910 0x7f49ac0b4dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:26:57.720 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:57.227+0000 7f49ca000700 1 --2- 172.21.15.87:0/3386289358 >> [v2:172.21.15.87:6810/2022667023,v1:172.21.15.87:6811/2022667023] conn(0x7f49ac0bc3d0 0x7f49ac0be870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:26:57.720 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:57.227+0000 7f49ca000700 1 -- 172.21.15.87:0/3386289358 --> [v2:172.21.15.87:6810/2022667023,v1:172.21.15.87:6811/2022667023] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f49bc02ee50 con 0x7f49ac0bc3d0 2024-05-08T05:26:57.720 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:57.227+0000 7f49ca000700 1 -- 172.21.15.87:0/3386289358 <== mon.2 v2:172.21.15.90:3300/0 6 ==== mon_get_version_reply(handle=1 version=82) ==== 24+0+0 (secure 0 0 0) 0x7f49bc0e3700 con 0x7f49cc0756d0 2024-05-08T05:26:57.720 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:57.227+0000 7f49d1800700 1 --2- 172.21.15.87:0/3386289358 >> [v2:172.21.15.87:6810/2022667023,v1:172.21.15.87:6811/2022667023] conn(0x7f49ac0bc3d0 0x7f49ac0be870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:26:57.720 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:57.227+0000 7f49c3e00700 1 --2- 172.21.15.87:0/3386289358 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f49ac0b2910 0x7f49ac0b4dd0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f49cc114570 tx=0x7f49b4009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:26:57.720 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:57.228+0000 7f49d1800700 1 --2- 172.21.15.87:0/3386289358 >> [v2:172.21.15.87:6810/2022667023,v1:172.21.15.87:6811/2022667023] conn(0x7f49ac0bc3d0 0x7f49ac0be870 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:26:57.720 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:57.229+0000 7f49ca000700 1 -- 172.21.15.87:0/3386289358 <== osd.3 v2:172.21.15.87:6810/2022667023 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f49bc02ee50 con 0x7f49ac0bc3d0 2024-05-08T05:26:57.721 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:57.246+0000 7f49d3800700 1 -- 172.21.15.87:0/3386289358 --> [v2:172.21.15.87:6810/2022667023,v1:172.21.15.87:6811/2022667023] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f49cc110d80 con 0x7f49ac0bc3d0 2024-05-08T05:26:57.721 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:57.246+0000 7f49ca000700 1 -- 172.21.15.87:0/3386289358 <== osd.3 v2:172.21.15.87:6810/2022667023 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f49cc110d80 con 0x7f49ac0bc3d0 2024-05-08T05:26:57.721 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:57.247+0000 7f49d3800700 1 -- 172.21.15.87:0/3386289358 >> [v2:172.21.15.87:6810/2022667023,v1:172.21.15.87:6811/2022667023] conn(0x7f49ac0bc3d0 msgr2=0x7f49ac0be870 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:26:57.721 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:57.247+0000 7f49d3800700 1 --2- 172.21.15.87:0/3386289358 >> [v2:172.21.15.87:6810/2022667023,v1:172.21.15.87:6811/2022667023] conn(0x7f49ac0bc3d0 0x7f49ac0be870 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:26:57.721 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:57.247+0000 7f49d3800700 1 -- 172.21.15.87:0/3386289358 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f49ac0b2910 msgr2=0x7f49ac0b4dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:26:57.721 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:57.247+0000 7f49d3800700 1 --2- 172.21.15.87:0/3386289358 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f49ac0b2910 0x7f49ac0b4dd0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f49cc114570 tx=0x7f49b4009260 comp rx=0 tx=0).stop 2024-05-08T05:26:57.721 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:57.247+0000 7f49d3800700 1 -- 172.21.15.87:0/3386289358 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f49cc0756d0 msgr2=0x7f49cc1a0260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:26:57.721 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:57.247+0000 7f49d3800700 1 --2- 172.21.15.87:0/3386289358 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f49cc0756d0 0x7f49cc1a0260 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f49bc000c00 tx=0x7f49bc0057c0 comp rx=0 tx=0).stop 2024-05-08T05:26:57.721 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:57.247+0000 7f49d1800700 1 -- 172.21.15.87:0/3386289358 reap_dead start 2024-05-08T05:26:57.721 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:57.248+0000 7f49d3800700 1 -- 172.21.15.87:0/3386289358 shutdown_connections 2024-05-08T05:26:57.721 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:57.248+0000 7f49d3800700 1 -- 172.21.15.87:0/3386289358 >> 172.21.15.87:0/3386289358 conn(0x7f49cc07a600 msgr2=0x7f49cc110110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:26:57.721 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:57.248+0000 7f49d3800700 1 -- 172.21.15.87:0/3386289358 shutdown_connections 2024-05-08T05:26:57.721 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:26:57.248+0000 7f49d3800700 1 -- 172.21.15.87:0/3386289358 wait complete. 2024-05-08T05:26:58.358 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:26:58 smithi087 ceph-mon[29523]: pgmap v359: 97 pgs: 97 active+clean; 644 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-05-08T05:26:58.483 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:26:58 smithi090 ceph-mon[34526]: pgmap v359: 97 pgs: 97 active+clean; 644 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-05-08T05:26:58.538 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:26:58 smithi160 ceph-mon[34827]: pgmap v359: 97 pgs: 97 active+clean; 644 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-05-08T05:26:59.353 INFO:teuthology.orchestra.run.smithi087.stdout:180388626493 2024-05-08T05:26:59.354 DEBUG:teuthology.orchestra.run.smithi087:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid eeeb813e-0cf9-11ef-bc97-c7b262605968 -- ceph osd last-stat-seq osd.6 2024-05-08T05:27:00.458 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:27:00 smithi087 ceph-mon[29523]: pgmap v360: 97 pgs: 97 active+clean; 644 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-05-08T05:27:00.483 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:27:00 smithi090 ceph-mon[34526]: pgmap v360: 97 pgs: 97 active+clean; 644 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-05-08T05:27:00.538 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:27:00 smithi160 ceph-mon[34827]: pgmap v360: 97 pgs: 97 active+clean; 644 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-05-08T05:27:00.964 INFO:teuthology.orchestra.run.smithi087.stdout:77309411412 2024-05-08T05:27:00.965 DEBUG:teuthology.orchestra.run.smithi087:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid eeeb813e-0cf9-11ef-bc97-c7b262605968 -- ceph osd last-stat-seq osd.2 2024-05-08T05:27:02.167 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:27:02 smithi087 ceph-mon[29523]: pgmap v361: 97 pgs: 97 active+clean; 644 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T05:27:02.483 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:27:02 smithi090 ceph-mon[34526]: pgmap v361: 97 pgs: 97 active+clean; 644 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T05:27:02.538 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:27:02 smithi160 ceph-mon[34827]: pgmap v361: 97 pgs: 97 active+clean; 644 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T05:27:04.119 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:27:04 smithi087 ceph-mon[29523]: pgmap v362: 97 pgs: 97 active+clean; 644 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-05-08T05:27:04.483 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:27:04 smithi090 ceph-mon[34526]: pgmap v362: 97 pgs: 97 active+clean; 644 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-05-08T05:27:04.538 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:27:04 smithi160 ceph-mon[34827]: pgmap v362: 97 pgs: 97 active+clean; 644 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-05-08T05:27:04.736 INFO:teuthology.orchestra.run.smithi087.stdout:107374182478 2024-05-08T05:27:04.736 DEBUG:teuthology.orchestra.run.smithi087:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid eeeb813e-0cf9-11ef-bc97-c7b262605968 -- ceph osd last-stat-seq osd.3 2024-05-08T05:27:04.753 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:04.118+0000 7f0fe8800700 1 -- 172.21.15.87:0/3588630283 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0fe006b180 msgr2=0x7f0fe006b600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:27:04.753 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:04.118+0000 7f0fe8800700 1 --2- 172.21.15.87:0/3588630283 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0fe006b180 0x7f0fe006b600 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f0fd0009990 tx=0x7f0fd0009ca0 comp rx=0 tx=0).stop 2024-05-08T05:27:04.753 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:04.118+0000 7f0fe8800700 1 -- 172.21.15.87:0/3588630283 shutdown_connections 2024-05-08T05:27:04.753 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:04.118+0000 7f0fe8800700 1 --2- 172.21.15.87:0/3588630283 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0fe006bb40 0x7f0fe0110330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:27:04.753 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:04.118+0000 7f0fe8800700 1 --2- 172.21.15.87:0/3588630283 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0fe0109510 0x7f0fe01098f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:27:04.753 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:04.118+0000 7f0fe8800700 1 --2- 172.21.15.87:0/3588630283 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0fe006b180 0x7f0fe006b600 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:27:04.753 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:04.118+0000 7f0fe8800700 1 -- 172.21.15.87:0/3588630283 >> 172.21.15.87:0/3588630283 conn(0x7f0fe0079350 msgr2=0x7f0fe0079760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:27:04.753 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:04.119+0000 7f0fe8800700 1 -- 172.21.15.87:0/3588630283 shutdown_connections 2024-05-08T05:27:04.753 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:04.119+0000 7f0fe8800700 1 -- 172.21.15.87:0/3588630283 wait complete. 2024-05-08T05:27:04.753 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:04.120+0000 7f0fe8800700 1 Processor -- start 2024-05-08T05:27:04.753 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:04.121+0000 7f0fe8800700 1 -- start start 2024-05-08T05:27:04.753 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:04.121+0000 7f0fe8800700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0fe006b180 0x7f0fe019bdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:27:04.754 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:04.121+0000 7f0fe8800700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0fe006bb40 0x7f0fe019c300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:27:04.754 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:04.121+0000 7f0fe8800700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0fe0109510 0x7f0fe01a0690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:27:04.754 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:04.121+0000 7f0fe8800700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f0fe0113670 con 0x7f0fe006b180 2024-05-08T05:27:04.754 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:04.121+0000 7f0fe8800700 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f0fe01134f0 con 0x7f0fe0109510 2024-05-08T05:27:04.754 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:04.121+0000 7f0fe8800700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f0fe01137f0 con 0x7f0fe006bb40 2024-05-08T05:27:04.754 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:04.121+0000 7f0fe5400700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0fe006bb40 0x7f0fe019c300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:27:04.754 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:04.121+0000 7f0fe5e00700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0fe006b180 0x7f0fe019bdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:27:04.754 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:04.121+0000 7f0fe5400700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0fe006bb40 0x7f0fe019c300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.87:49202/0 (socket says 172.21.15.87:49202) 2024-05-08T05:27:04.754 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:04.121+0000 7f0fe6800700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0fe0109510 0x7f0fe01a0690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:27:04.754 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:04.121+0000 7f0fe5400700 1 -- 172.21.15.87:0/2096056692 learned_addr learned my addr 172.21.15.87:0/2096056692 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T05:27:04.754 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:04.122+0000 7f0fe5e00700 1 -- 172.21.15.87:0/2096056692 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0fe006bb40 msgr2=0x7f0fe019c300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:27:04.754 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:04.122+0000 7f0fe5e00700 1 --2- 172.21.15.87:0/2096056692 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0fe006bb40 0x7f0fe019c300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:27:04.754 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:04.122+0000 7f0fe5e00700 1 -- 172.21.15.87:0/2096056692 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0fe0109510 msgr2=0x7f0fe01a0690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:27:04.755 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:04.122+0000 7f0fe5e00700 1 --2- 172.21.15.87:0/2096056692 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0fe0109510 0x7f0fe01a0690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:27:04.755 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:04.122+0000 7f0fe5e00700 1 -- 172.21.15.87:0/2096056692 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0fe01a0dd0 con 0x7f0fe006b180 2024-05-08T05:27:04.755 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:04.122+0000 7f0fe5400700 1 --2- 172.21.15.87:0/2096056692 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0fe006bb40 0x7f0fe019c300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T05:27:04.755 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:04.122+0000 7f0fe6800700 1 --2- 172.21.15.87:0/2096056692 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0fe0109510 0x7f0fe01a0690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T05:27:04.755 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:04.122+0000 7f0fe5e00700 1 --2- 172.21.15.87:0/2096056692 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0fe006b180 0x7f0fe019bdc0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f0fd400e9f0 tx=0x7f0fd400ed00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:27:04.755 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:04.123+0000 7f0fdaa00700 1 -- 172.21.15.87:0/2096056692 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0fd400cb70 con 0x7f0fe006b180 2024-05-08T05:27:04.755 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:04.123+0000 7f0fdaa00700 1 -- 172.21.15.87:0/2096056692 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0fd40044d0 con 0x7f0fe006b180 2024-05-08T05:27:04.755 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:04.123+0000 7f0fdaa00700 1 -- 172.21.15.87:0/2096056692 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0fd4003e00 con 0x7f0fe006b180 2024-05-08T05:27:04.755 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:04.123+0000 7f0fe8800700 1 -- 172.21.15.87:0/2096056692 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0fe01a10c0 con 0x7f0fe006b180 2024-05-08T05:27:04.755 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:04.123+0000 7f0fe8800700 1 -- 172.21.15.87:0/2096056692 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0fe01a8940 con 0x7f0fe006b180 2024-05-08T05:27:04.755 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:04.124+0000 7f0fe8800700 1 -- 172.21.15.87:0/2096056692 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f0fe010f0e0 con 0x7f0fe006b180 2024-05-08T05:27:04.755 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:04.127+0000 7f0fdaa00700 1 -- 172.21.15.87:0/2096056692 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 17) ==== 149703+0+0 (secure 0 0 0) 0x7f0fd4003fa0 con 0x7f0fe006b180 2024-05-08T05:27:04.755 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:04.128+0000 7f0fdaa00700 1 --2- 172.21.15.87:0/2096056692 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f0fc80b2990 0x7f0fc80b4e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:27:04.755 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:04.128+0000 7f0fdaa00700 1 -- 172.21.15.87:0/2096056692 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8190+0+0 (secure 0 0 0) 0x7f0fd40e28e0 con 0x7f0fe006b180 2024-05-08T05:27:04.756 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:04.129+0000 7f0fe5400700 1 --2- 172.21.15.87:0/2096056692 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f0fc80b2990 0x7f0fc80b4e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:27:04.756 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:04.129+0000 7f0fdaa00700 1 --2- 172.21.15.87:0/2096056692 >> [v2:172.21.15.90:6800/1681573998,v1:172.21.15.90:6801/1681573998] conn(0x7f0fc80bc450 0x7f0fc80be8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:27:04.756 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:04.129+0000 7f0fdaa00700 1 -- 172.21.15.87:0/2096056692 --> [v2:172.21.15.90:6800/1681573998,v1:172.21.15.90:6801/1681573998] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f0fd4017e50 con 0x7f0fc80bc450 2024-05-08T05:27:04.756 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:04.129+0000 7f0fdaa00700 1 -- 172.21.15.87:0/2096056692 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_get_version_reply(handle=1 version=82) ==== 24+0+0 (secure 0 0 0) 0x7f0fd40e2c90 con 0x7f0fe006b180 2024-05-08T05:27:04.756 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:04.129+0000 7f0fe6800700 1 --2- 172.21.15.87:0/2096056692 >> [v2:172.21.15.90:6800/1681573998,v1:172.21.15.90:6801/1681573998] conn(0x7f0fc80bc450 0x7f0fc80be8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:27:04.756 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:04.130+0000 7f0fe5400700 1 --2- 172.21.15.87:0/2096056692 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f0fc80b2990 0x7f0fc80b4e50 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f0fe01044d0 tx=0x7f0fd001a040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:27:04.756 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:04.130+0000 7f0fe6800700 1 --2- 172.21.15.87:0/2096056692 >> [v2:172.21.15.90:6800/1681573998,v1:172.21.15.90:6801/1681573998] conn(0x7f0fc80bc450 0x7f0fc80be8f0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:27:04.756 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:04.131+0000 7f0fdaa00700 1 -- 172.21.15.87:0/2096056692 <== osd.1 v2:172.21.15.90:6800/1681573998 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f0fd4017e50 con 0x7f0fc80bc450 2024-05-08T05:27:04.756 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:04.153+0000 7f0fe8800700 1 -- 172.21.15.87:0/2096056692 --> [v2:172.21.15.90:6800/1681573998,v1:172.21.15.90:6801/1681573998] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f0fe0104bd0 con 0x7f0fc80bc450 2024-05-08T05:27:04.757 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:04.154+0000 7f0fdaa00700 1 -- 172.21.15.87:0/2096056692 <== osd.1 v2:172.21.15.90:6800/1681573998 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f0fe0104bd0 con 0x7f0fc80bc450 2024-05-08T05:27:04.757 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:04.154+0000 7f0fe8800700 1 -- 172.21.15.87:0/2096056692 >> [v2:172.21.15.90:6800/1681573998,v1:172.21.15.90:6801/1681573998] conn(0x7f0fc80bc450 msgr2=0x7f0fc80be8f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:27:04.757 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:04.154+0000 7f0fe8800700 1 --2- 172.21.15.87:0/2096056692 >> [v2:172.21.15.90:6800/1681573998,v1:172.21.15.90:6801/1681573998] conn(0x7f0fc80bc450 0x7f0fc80be8f0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:27:04.757 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:04.154+0000 7f0fe8800700 1 -- 172.21.15.87:0/2096056692 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f0fc80b2990 msgr2=0x7f0fc80b4e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:27:04.757 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:04.154+0000 7f0fe8800700 1 --2- 172.21.15.87:0/2096056692 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f0fc80b2990 0x7f0fc80b4e50 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f0fe01044d0 tx=0x7f0fd001a040 comp rx=0 tx=0).stop 2024-05-08T05:27:04.757 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:04.154+0000 7f0fe8800700 1 -- 172.21.15.87:0/2096056692 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0fe006b180 msgr2=0x7f0fe019bdc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:27:04.757 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:04.154+0000 7f0fe8800700 1 --2- 172.21.15.87:0/2096056692 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0fe006b180 0x7f0fe019bdc0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f0fd400e9f0 tx=0x7f0fd400ed00 comp rx=0 tx=0).stop 2024-05-08T05:27:04.757 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:04.155+0000 7f0fe6800700 1 -- 172.21.15.87:0/2096056692 reap_dead start 2024-05-08T05:27:04.757 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:04.155+0000 7f0fe8800700 1 -- 172.21.15.87:0/2096056692 shutdown_connections 2024-05-08T05:27:04.757 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:04.155+0000 7f0fe8800700 1 -- 172.21.15.87:0/2096056692 >> 172.21.15.87:0/2096056692 conn(0x7f0fe0079350 msgr2=0x7f0fe010e680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:27:04.757 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:04.155+0000 7f0fe8800700 1 -- 172.21.15.87:0/2096056692 shutdown_connections 2024-05-08T05:27:04.757 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:04.155+0000 7f0fe8800700 1 -- 172.21.15.87:0/2096056692 wait complete. 2024-05-08T05:27:05.849 INFO:teuthology.orchestra.run.smithi087.stderr:Inferring config /var/lib/ceph/eeeb813e-0cf9-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T05:27:06.193 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:27:06 smithi087 ceph-mon[29523]: pgmap v363: 97 pgs: 97 active+clean; 644 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-05-08T05:27:06.296 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:06.214+0000 7ff505400700 1 -- 172.21.15.87:0/3028296164 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff500109510 msgr2=0x7ff5001098f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:27:06.296 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:06.214+0000 7ff505400700 1 --2- 172.21.15.87:0/3028296164 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff500109510 0x7ff5001098f0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7ff4f0009990 tx=0x7ff4f0009ca0 comp rx=0 tx=0).stop 2024-05-08T05:27:06.296 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:06.215+0000 7ff505400700 1 -- 172.21.15.87:0/3028296164 shutdown_connections 2024-05-08T05:27:06.296 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:06.215+0000 7ff505400700 1 --2- 172.21.15.87:0/3028296164 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff50006bb40 0x7ff500110330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:27:06.296 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:06.215+0000 7ff505400700 1 --2- 172.21.15.87:0/3028296164 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff500109510 0x7ff5001098f0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:27:06.297 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:06.215+0000 7ff505400700 1 --2- 172.21.15.87:0/3028296164 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff50006b180 0x7ff50006b600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:27:06.297 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:06.215+0000 7ff505400700 1 -- 172.21.15.87:0/3028296164 >> 172.21.15.87:0/3028296164 conn(0x7ff500079350 msgr2=0x7ff500079760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:27:06.297 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:06.215+0000 7ff505400700 1 -- 172.21.15.87:0/3028296164 shutdown_connections 2024-05-08T05:27:06.297 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:06.215+0000 7ff505400700 1 -- 172.21.15.87:0/3028296164 wait complete. 2024-05-08T05:27:06.297 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:06.216+0000 7ff505400700 1 Processor -- start 2024-05-08T05:27:06.297 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:06.216+0000 7ff505400700 1 -- start start 2024-05-08T05:27:06.297 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:06.217+0000 7ff505400700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff50006b180 0x7ff500102470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:27:06.297 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:06.217+0000 7ff505400700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff50006bb40 0x7ff5001029b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:27:06.297 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:06.217+0000 7ff505400700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff500109510 0x7ff500102ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:27:06.297 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:06.217+0000 7ff505400700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7ff500113670 con 0x7ff500109510 2024-05-08T05:27:06.297 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:06.217+0000 7ff505400700 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7ff5001134f0 con 0x7ff50006b180 2024-05-08T05:27:06.297 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:06.217+0000 7ff505400700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7ff5001137f0 con 0x7ff50006bb40 2024-05-08T05:27:06.297 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:06.217+0000 7ff4fde00700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff50006bb40 0x7ff5001029b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:27:06.297 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:06.217+0000 7ff4ff200700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff500109510 0x7ff500102ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:27:06.298 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:06.217+0000 7ff4fde00700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff50006bb40 0x7ff5001029b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.87:40086/0 (socket says 172.21.15.87:40086) 2024-05-08T05:27:06.298 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:06.217+0000 7ff4fde00700 1 -- 172.21.15.87:0/2217227410 learned_addr learned my addr 172.21.15.87:0/2217227410 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T05:27:06.298 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:06.217+0000 7ff4fe800700 1 --2- 172.21.15.87:0/2217227410 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff50006b180 0x7ff500102470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:27:06.298 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:06.218+0000 7ff4fde00700 1 -- 172.21.15.87:0/2217227410 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff50006b180 msgr2=0x7ff500102470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:27:06.298 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:06.218+0000 7ff4fde00700 1 --2- 172.21.15.87:0/2217227410 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff50006b180 0x7ff500102470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:27:06.298 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:06.218+0000 7ff4fde00700 1 -- 172.21.15.87:0/2217227410 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff500109510 msgr2=0x7ff500102ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:27:06.298 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:06.218+0000 7ff4fde00700 1 --2- 172.21.15.87:0/2217227410 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff500109510 0x7ff500102ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:27:06.298 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:06.218+0000 7ff4fde00700 1 -- 172.21.15.87:0/2217227410 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff5001a80c0 con 0x7ff50006bb40 2024-05-08T05:27:06.298 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:06.218+0000 7ff4ff200700 1 --2- 172.21.15.87:0/2217227410 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff500109510 0x7ff500102ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T05:27:06.298 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:06.218+0000 7ff4fde00700 1 --2- 172.21.15.87:0/2217227410 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff50006bb40 0x7ff5001029b0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7ff4ec00eb30 tx=0x7ff4ec00ee40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:27:06.298 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:06.218+0000 7ff4f7400700 1 -- 172.21.15.87:0/2217227410 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4ec00cbd0 con 0x7ff50006bb40 2024-05-08T05:27:06.298 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:06.218+0000 7ff505400700 1 -- 172.21.15.87:0/2217227410 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff5001a83b0 con 0x7ff50006bb40 2024-05-08T05:27:06.298 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:06.218+0000 7ff4f7400700 1 -- 172.21.15.87:0/2217227410 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff4ec0044d0 con 0x7ff50006bb40 2024-05-08T05:27:06.298 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:06.218+0000 7ff4f7400700 1 -- 172.21.15.87:0/2217227410 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4ec003e30 con 0x7ff50006bb40 2024-05-08T05:27:06.299 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:06.218+0000 7ff505400700 1 -- 172.21.15.87:0/2217227410 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff5001a8940 con 0x7ff50006bb40 2024-05-08T05:27:06.299 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:06.219+0000 7ff505400700 1 -- 172.21.15.87:0/2217227410 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7ff500063bb0 con 0x7ff50006bb40 2024-05-08T05:27:06.299 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:06.223+0000 7ff4f7400700 1 -- 172.21.15.87:0/2217227410 <== mon.1 v2:172.21.15.160:3300/0 4 ==== mgrmap(e 17) ==== 149703+0+0 (secure 0 0 0) 0x7ff4ec004000 con 0x7ff50006bb40 2024-05-08T05:27:06.299 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:06.224+0000 7ff4f7400700 1 --2- 172.21.15.87:0/2217227410 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7ff4e40b2910 0x7ff4e40b4dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:27:06.299 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:06.224+0000 7ff4f7400700 1 -- 172.21.15.87:0/2217227410 <== mon.1 v2:172.21.15.160:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8190+0+0 (secure 0 0 0) 0x7ff4ec0e2bd0 con 0x7ff50006bb40 2024-05-08T05:27:06.299 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:06.224+0000 7ff4fe800700 1 --2- 172.21.15.87:0/2217227410 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7ff4e40b2910 0x7ff4e40b4dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:27:06.299 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:06.225+0000 7ff4f7400700 1 --2- 172.21.15.87:0/2217227410 >> [v2:172.21.15.90:6816/1964248958,v1:172.21.15.90:6817/1964248958] conn(0x7ff4e40bc300 0x7ff4e40be7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:27:06.299 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:06.225+0000 7ff4f7400700 1 -- 172.21.15.87:0/2217227410 --> [v2:172.21.15.90:6816/1964248958,v1:172.21.15.90:6817/1964248958] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7ff4ec022e50 con 0x7ff4e40bc300 2024-05-08T05:27:06.299 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:06.225+0000 7ff4f7400700 1 -- 172.21.15.87:0/2217227410 <== mon.1 v2:172.21.15.160:3300/0 6 ==== mon_get_version_reply(handle=1 version=82) ==== 24+0+0 (secure 0 0 0) 0x7ff4ec0e2f80 con 0x7ff50006bb40 2024-05-08T05:27:06.300 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:06.225+0000 7ff4ff200700 1 --2- 172.21.15.87:0/2217227410 >> [v2:172.21.15.90:6816/1964248958,v1:172.21.15.90:6817/1964248958] conn(0x7ff4e40bc300 0x7ff4e40be7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:27:06.300 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:06.225+0000 7ff4fe800700 1 --2- 172.21.15.87:0/2217227410 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7ff4e40b2910 0x7ff4e40b4dd0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7ff4f0006010 tx=0x7ff4f000b260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:27:06.300 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:06.226+0000 7ff4ff200700 1 --2- 172.21.15.87:0/2217227410 >> [v2:172.21.15.90:6816/1964248958,v1:172.21.15.90:6817/1964248958] conn(0x7ff4e40bc300 0x7ff4e40be7a0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:27:06.300 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:06.227+0000 7ff4f7400700 1 -- 172.21.15.87:0/2217227410 <== osd.7 v2:172.21.15.90:6816/1964248958 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7ff4ec022e50 con 0x7ff4e40bc300 2024-05-08T05:27:06.300 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:06.245+0000 7ff505400700 1 -- 172.21.15.87:0/2217227410 --> [v2:172.21.15.90:6816/1964248958,v1:172.21.15.90:6817/1964248958] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7ff500063fb0 con 0x7ff4e40bc300 2024-05-08T05:27:06.300 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:06.245+0000 7ff4f7400700 1 -- 172.21.15.87:0/2217227410 <== osd.7 v2:172.21.15.90:6816/1964248958 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7ff500063fb0 con 0x7ff4e40bc300 2024-05-08T05:27:06.300 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:06.246+0000 7ff505400700 1 -- 172.21.15.87:0/2217227410 >> [v2:172.21.15.90:6816/1964248958,v1:172.21.15.90:6817/1964248958] conn(0x7ff4e40bc300 msgr2=0x7ff4e40be7a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:27:06.300 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:06.246+0000 7ff505400700 1 --2- 172.21.15.87:0/2217227410 >> [v2:172.21.15.90:6816/1964248958,v1:172.21.15.90:6817/1964248958] conn(0x7ff4e40bc300 0x7ff4e40be7a0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:27:06.300 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:06.246+0000 7ff505400700 1 -- 172.21.15.87:0/2217227410 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7ff4e40b2910 msgr2=0x7ff4e40b4dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:27:06.300 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:06.246+0000 7ff505400700 1 --2- 172.21.15.87:0/2217227410 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7ff4e40b2910 0x7ff4e40b4dd0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7ff4f0006010 tx=0x7ff4f000b260 comp rx=0 tx=0).stop 2024-05-08T05:27:06.301 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:06.246+0000 7ff505400700 1 -- 172.21.15.87:0/2217227410 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff50006bb40 msgr2=0x7ff5001029b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:27:06.301 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:06.246+0000 7ff505400700 1 --2- 172.21.15.87:0/2217227410 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff50006bb40 0x7ff5001029b0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7ff4ec00eb30 tx=0x7ff4ec00ee40 comp rx=0 tx=0).stop 2024-05-08T05:27:06.301 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:06.246+0000 7ff4ff200700 1 -- 172.21.15.87:0/2217227410 reap_dead start 2024-05-08T05:27:06.301 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:06.246+0000 7ff505400700 1 -- 172.21.15.87:0/2217227410 shutdown_connections 2024-05-08T05:27:06.301 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:06.246+0000 7ff505400700 1 -- 172.21.15.87:0/2217227410 >> 172.21.15.87:0/2217227410 conn(0x7ff500079350 msgr2=0x7ff500101110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:27:06.301 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:06.246+0000 7ff505400700 1 -- 172.21.15.87:0/2217227410 shutdown_connections 2024-05-08T05:27:06.301 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:06.246+0000 7ff505400700 1 -- 172.21.15.87:0/2217227410 wait complete. 2024-05-08T05:27:06.341 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:27:06 smithi160 ceph-mon[34827]: pgmap v363: 97 pgs: 97 active+clean; 644 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-05-08T05:27:06.483 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:27:06 smithi090 ceph-mon[34526]: pgmap v363: 97 pgs: 97 active+clean; 644 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-05-08T05:27:06.732 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:06.731+0000 7fc6a1600700 1 -- 172.21.15.87:0/4200236683 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc69c10fb60 msgr2=0x7fc69c10ff40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:27:06.732 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:06.731+0000 7fc6a1600700 1 --2- 172.21.15.87:0/4200236683 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc69c10fb60 0x7fc69c10ff40 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fc68c0098f0 tx=0x7fc68c009c00 comp rx=0 tx=0).stop 2024-05-08T05:27:06.732 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:06.731+0000 7fc6a1600700 1 -- 172.21.15.87:0/4200236683 shutdown_connections 2024-05-08T05:27:06.732 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:06.731+0000 7fc6a1600700 1 --2- 172.21.15.87:0/4200236683 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc69c10a490 0x7fc69c1169a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:27:06.732 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:06.731+0000 7fc6a1600700 1 --2- 172.21.15.87:0/4200236683 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc69c10fb60 0x7fc69c10ff40 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:27:06.732 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:06.731+0000 7fc6a1600700 1 --2- 172.21.15.87:0/4200236683 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc69c109ad0 0x7fc69c109f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:27:06.732 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:06.731+0000 7fc6a1600700 1 -- 172.21.15.87:0/4200236683 >> 172.21.15.87:0/4200236683 conn(0x7fc69c076c70 msgr2=0x7fc69c079090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:27:06.732 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:06.731+0000 7fc6a1600700 1 -- 172.21.15.87:0/4200236683 shutdown_connections 2024-05-08T05:27:06.733 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:06.731+0000 7fc6a1600700 1 -- 172.21.15.87:0/4200236683 wait complete. 2024-05-08T05:27:06.733 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:06.733+0000 7fc6a1600700 1 Processor -- start 2024-05-08T05:27:06.733 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:06.733+0000 7fc6a1600700 1 -- start start 2024-05-08T05:27:06.734 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:06.733+0000 7fc6a1600700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc69c109ad0 0x7fc69c1a01f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:27:06.734 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:06.733+0000 7fc6a1600700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc69c10a490 0x7fc69c1a0730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:27:06.734 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:06.733+0000 7fc6a1600700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc69c10fb60 0x7fc69c1a4ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:27:06.734 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:06.733+0000 7fc6a1600700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fc69c119d20 con 0x7fc69c10fb60 2024-05-08T05:27:06.734 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:06.733+0000 7fc6a1600700 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fc69c119ba0 con 0x7fc69c10a490 2024-05-08T05:27:06.734 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:06.733+0000 7fc6a1600700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7fc69c119ea0 con 0x7fc69c109ad0 2024-05-08T05:27:06.735 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:06.734+0000 7fc69b400700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc69c10fb60 0x7fc69c1a4ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:27:06.735 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:06.734+0000 7fc69b400700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc69c10fb60 0x7fc69c1a4ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:52394/0 (socket says 172.21.15.87:52394) 2024-05-08T05:27:06.736 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:06.734+0000 7fc69b400700 1 -- 172.21.15.87:0/1808082665 learned_addr learned my addr 172.21.15.87:0/1808082665 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T05:27:06.736 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:06.734+0000 7fc69a000700 1 --2- 172.21.15.87:0/1808082665 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc69c10a490 0x7fc69c1a0730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:27:06.736 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:06.734+0000 7fc69aa00700 1 --2- 172.21.15.87:0/1808082665 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc69c109ad0 0x7fc69c1a01f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:27:06.736 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:06.734+0000 7fc69b400700 1 -- 172.21.15.87:0/1808082665 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc69c109ad0 msgr2=0x7fc69c1a01f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:27:06.736 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:06.734+0000 7fc69b400700 1 --2- 172.21.15.87:0/1808082665 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc69c109ad0 0x7fc69c1a01f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:27:06.736 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:06.734+0000 7fc69b400700 1 -- 172.21.15.87:0/1808082665 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc69c10a490 msgr2=0x7fc69c1a0730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:27:06.736 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:06.734+0000 7fc69b400700 1 --2- 172.21.15.87:0/1808082665 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc69c10a490 0x7fc69c1a0730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:27:06.736 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:06.734+0000 7fc69b400700 1 -- 172.21.15.87:0/1808082665 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc69c1a5200 con 0x7fc69c10fb60 2024-05-08T05:27:06.736 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:06.734+0000 7fc69a000700 1 --2- 172.21.15.87:0/1808082665 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc69c10a490 0x7fc69c1a0730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T05:27:06.736 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:06.734+0000 7fc69aa00700 1 --2- 172.21.15.87:0/1808082665 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc69c109ad0 0x7fc69c1a01f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T05:27:06.736 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:06.735+0000 7fc69b400700 1 --2- 172.21.15.87:0/1808082665 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc69c10fb60 0x7fc69c1a4ac0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fc69400c110 tx=0x7fc69400c420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:27:06.736 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:06.735+0000 7fc693400700 1 -- 172.21.15.87:0/1808082665 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6940093a0 con 0x7fc69c10fb60 2024-05-08T05:27:06.736 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:06.735+0000 7fc693400700 1 -- 172.21.15.87:0/1808082665 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc694004bb0 con 0x7fc69c10fb60 2024-05-08T05:27:06.736 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:06.735+0000 7fc6a1600700 1 -- 172.21.15.87:0/1808082665 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc69c1a5490 con 0x7fc69c10fb60 2024-05-08T05:27:06.737 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:06.735+0000 7fc693400700 1 -- 172.21.15.87:0/1808082665 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc694007c20 con 0x7fc69c10fb60 2024-05-08T05:27:06.737 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:06.735+0000 7fc6a1600700 1 -- 172.21.15.87:0/1808082665 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc69c1acd70 con 0x7fc69c10fb60 2024-05-08T05:27:06.737 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:06.736+0000 7fc6a1600700 1 -- 172.21.15.87:0/1808082665 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fc69c063c30 con 0x7fc69c10fb60 2024-05-08T05:27:06.739 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:06.739+0000 7fc693400700 1 -- 172.21.15.87:0/1808082665 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 17) ==== 149703+0+0 (secure 0 0 0) 0x7fc69401a020 con 0x7fc69c10fb60 2024-05-08T05:27:06.741 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:06.740+0000 7fc693400700 1 --2- 172.21.15.87:0/1808082665 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7fc6800b2910 0x7fc6800b4dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:27:06.741 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:06.740+0000 7fc693400700 1 -- 172.21.15.87:0/1808082665 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8190+0+0 (secure 0 0 0) 0x7fc6940e2760 con 0x7fc69c10fb60 2024-05-08T05:27:06.741 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:06.740+0000 7fc69aa00700 1 --2- 172.21.15.87:0/1808082665 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7fc6800b2910 0x7fc6800b4dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:27:06.741 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:06.741+0000 7fc693400700 1 --2- 172.21.15.87:0/1808082665 >> [v2:172.21.15.160:6808/2190054276,v1:172.21.15.160:6809/2190054276] conn(0x7fc6800bc3d0 0x7fc6800be870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:27:06.741 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:06.741+0000 7fc693400700 1 -- 172.21.15.87:0/1808082665 --> [v2:172.21.15.160:6808/2190054276,v1:172.21.15.160:6809/2190054276] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fc6800bef40 con 0x7fc6800bc3d0 2024-05-08T05:27:06.741 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:06.741+0000 7fc693400700 1 -- 172.21.15.87:0/1808082665 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_get_version_reply(handle=1 version=82) ==== 24+0+0 (secure 0 0 0) 0x7fc6940e2b10 con 0x7fc69c10fb60 2024-05-08T05:27:06.742 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:06.741+0000 7fc69a000700 1 --2- 172.21.15.87:0/1808082665 >> [v2:172.21.15.160:6808/2190054276,v1:172.21.15.160:6809/2190054276] conn(0x7fc6800bc3d0 0x7fc6800be870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:27:06.742 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:06.741+0000 7fc69aa00700 1 --2- 172.21.15.87:0/1808082665 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7fc6800b2910 0x7fc6800b4dd0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fc68c0098c0 tx=0x7fc68c019040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:27:06.742 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:06.742+0000 7fc69a000700 1 --2- 172.21.15.87:0/1808082665 >> [v2:172.21.15.160:6808/2190054276,v1:172.21.15.160:6809/2190054276] conn(0x7fc6800bc3d0 0x7fc6800be870 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:27:06.743 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:06.743+0000 7fc693400700 1 -- 172.21.15.87:0/1808082665 <== osd.5 v2:172.21.15.160:6808/2190054276 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fc6800bef40 con 0x7fc6800bc3d0 2024-05-08T05:27:06.761 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:06.760+0000 7fc6a1600700 1 -- 172.21.15.87:0/1808082665 --> [v2:172.21.15.160:6808/2190054276,v1:172.21.15.160:6809/2190054276] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fc69c0640b0 con 0x7fc6800bc3d0 2024-05-08T05:27:06.761 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:06.761+0000 7fc693400700 1 -- 172.21.15.87:0/1808082665 <== osd.5 v2:172.21.15.160:6808/2190054276 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7fc69c0640b0 con 0x7fc6800bc3d0 2024-05-08T05:27:06.762 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:06.761+0000 7fc6a1600700 1 -- 172.21.15.87:0/1808082665 >> [v2:172.21.15.160:6808/2190054276,v1:172.21.15.160:6809/2190054276] conn(0x7fc6800bc3d0 msgr2=0x7fc6800be870 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:27:06.762 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:06.762+0000 7fc6a1600700 1 --2- 172.21.15.87:0/1808082665 >> [v2:172.21.15.160:6808/2190054276,v1:172.21.15.160:6809/2190054276] conn(0x7fc6800bc3d0 0x7fc6800be870 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:27:06.762 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:06.762+0000 7fc6a1600700 1 -- 172.21.15.87:0/1808082665 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7fc6800b2910 msgr2=0x7fc6800b4dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:27:06.763 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:06.762+0000 7fc6a1600700 1 --2- 172.21.15.87:0/1808082665 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7fc6800b2910 0x7fc6800b4dd0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fc68c0098c0 tx=0x7fc68c019040 comp rx=0 tx=0).stop 2024-05-08T05:27:06.763 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:06.762+0000 7fc6a1600700 1 -- 172.21.15.87:0/1808082665 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc69c10fb60 msgr2=0x7fc69c1a4ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:27:06.763 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:06.762+0000 7fc6a1600700 1 --2- 172.21.15.87:0/1808082665 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc69c10fb60 0x7fc69c1a4ac0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fc69400c110 tx=0x7fc69400c420 comp rx=0 tx=0).stop 2024-05-08T05:27:06.763 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:06.762+0000 7fc69b400700 1 -- 172.21.15.87:0/1808082665 reap_dead start 2024-05-08T05:27:06.763 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:06.762+0000 7fc6a1600700 1 -- 172.21.15.87:0/1808082665 shutdown_connections 2024-05-08T05:27:06.763 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:06.762+0000 7fc6a1600700 1 -- 172.21.15.87:0/1808082665 >> 172.21.15.87:0/1808082665 conn(0x7fc69c076c70 msgr2=0x7fc69c077460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:27:06.763 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:06.762+0000 7fc6a1600700 1 -- 172.21.15.87:0/1808082665 shutdown_connections 2024-05-08T05:27:06.763 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:06.762+0000 7fc6a1600700 1 -- 172.21.15.87:0/1808082665 wait complete. 2024-05-08T05:27:07.966 INFO:teuthology.orchestra.run.smithi087.stdout:55834574939 2024-05-08T05:27:07.967 DEBUG:teuthology.orchestra.run.smithi087:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid eeeb813e-0cf9-11ef-bc97-c7b262605968 -- ceph osd last-stat-seq osd.1 2024-05-08T05:27:08.254 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:07.854+0000 7f2976c00700 1 -- 172.21.15.87:0/2636208311 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f29701020c0 msgr2=0x7f29701024a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:27:08.254 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:07.854+0000 7f2976c00700 1 --2- 172.21.15.87:0/2636208311 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f29701020c0 0x7f29701024a0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f296000aaa0 tx=0x7f296000adb0 comp rx=0 tx=0).stop 2024-05-08T05:27:08.254 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:07.855+0000 7f2976c00700 1 -- 172.21.15.87:0/2636208311 shutdown_connections 2024-05-08T05:27:08.254 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:07.855+0000 7f2976c00700 1 --2- 172.21.15.87:0/2636208311 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2970106f60 0x7f297010eaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:27:08.254 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:07.855+0000 7f2976c00700 1 --2- 172.21.15.87:0/2636208311 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f29701020c0 0x7f29701024a0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:27:08.254 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:07.855+0000 7f2976c00700 1 --2- 172.21.15.87:0/2636208311 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2970102a70 0x7f2970106830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:27:08.254 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:07.855+0000 7f2976c00700 1 -- 172.21.15.87:0/2636208311 >> 172.21.15.87:0/2636208311 conn(0x7f29700776c0 msgr2=0x7f2970077ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:27:08.254 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:07.855+0000 7f2976c00700 1 -- 172.21.15.87:0/2636208311 shutdown_connections 2024-05-08T05:27:08.254 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:07.855+0000 7f2976c00700 1 -- 172.21.15.87:0/2636208311 wait complete. 2024-05-08T05:27:08.254 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:07.856+0000 7f2976c00700 1 Processor -- start 2024-05-08T05:27:08.255 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:07.856+0000 7f2976c00700 1 -- start start 2024-05-08T05:27:08.255 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:07.856+0000 7f2976c00700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f29701020c0 0x7f297019bdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:27:08.255 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:07.856+0000 7f2976c00700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2970102a70 0x7f297019c330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:27:08.255 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:07.856+0000 7f2976c00700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2970106f60 0x7f29701a0670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:27:08.255 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:07.856+0000 7f2976c00700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f2970111570 con 0x7f2970102a70 2024-05-08T05:27:08.255 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:07.856+0000 7f2976c00700 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f29701113f0 con 0x7f29701020c0 2024-05-08T05:27:08.255 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:07.856+0000 7f2976c00700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f29701116f0 con 0x7f2970106f60 2024-05-08T05:27:08.255 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:07.857+0000 7f296f400700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2970102a70 0x7f297019c330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:27:08.255 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:07.857+0000 7f296f400700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2970102a70 0x7f297019c330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:52418/0 (socket says 172.21.15.87:52418) 2024-05-08T05:27:08.255 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:07.857+0000 7f296f400700 1 -- 172.21.15.87:0/1873248964 learned_addr learned my addr 172.21.15.87:0/1873248964 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T05:27:08.255 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:07.857+0000 7f296fe00700 1 --2- 172.21.15.87:0/1873248964 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f29701020c0 0x7f297019bdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:27:08.255 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:07.857+0000 7f2974c00700 1 --2- 172.21.15.87:0/1873248964 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2970106f60 0x7f29701a0670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:27:08.255 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:07.857+0000 7f296f400700 1 -- 172.21.15.87:0/1873248964 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2970106f60 msgr2=0x7f29701a0670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:27:08.256 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:07.857+0000 7f296f400700 1 --2- 172.21.15.87:0/1873248964 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2970106f60 0x7f29701a0670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:27:08.256 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:07.857+0000 7f296f400700 1 -- 172.21.15.87:0/1873248964 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f29701020c0 msgr2=0x7f297019bdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:27:08.256 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:07.857+0000 7f296f400700 1 --2- 172.21.15.87:0/1873248964 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f29701020c0 0x7f297019bdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:27:08.256 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:07.857+0000 7f296f400700 1 -- 172.21.15.87:0/1873248964 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f29701a0db0 con 0x7f2970102a70 2024-05-08T05:27:08.256 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:07.857+0000 7f296fe00700 1 --2- 172.21.15.87:0/1873248964 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f29701020c0 0x7f297019bdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T05:27:08.256 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:07.857+0000 7f296f400700 1 --2- 172.21.15.87:0/1873248964 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2970102a70 0x7f297019c330 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f295c00e9c0 tx=0x7f295c00ecd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:27:08.256 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:07.858+0000 7f296cc00700 1 -- 172.21.15.87:0/1873248964 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f295c004a30 con 0x7f2970102a70 2024-05-08T05:27:08.256 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:07.858+0000 7f2976c00700 1 -- 172.21.15.87:0/1873248964 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f29701a10a0 con 0x7f2970102a70 2024-05-08T05:27:08.256 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:07.858+0000 7f296cc00700 1 -- 172.21.15.87:0/1873248964 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f295c00cc70 con 0x7f2970102a70 2024-05-08T05:27:08.256 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:07.858+0000 7f296cc00700 1 -- 172.21.15.87:0/1873248964 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f295c005500 con 0x7f2970102a70 2024-05-08T05:27:08.256 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:07.858+0000 7f2976c00700 1 -- 172.21.15.87:0/1873248964 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f29701a8920 con 0x7f2970102a70 2024-05-08T05:27:08.256 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:07.859+0000 7f2976c00700 1 -- 172.21.15.87:0/1873248964 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f2970063c30 con 0x7f2970102a70 2024-05-08T05:27:08.256 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:07.862+0000 7f296cc00700 1 -- 172.21.15.87:0/1873248964 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 17) ==== 149703+0+0 (secure 0 0 0) 0x7f295c004bd0 con 0x7f2970102a70 2024-05-08T05:27:08.256 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:07.864+0000 7f296cc00700 1 --2- 172.21.15.87:0/1873248964 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f29540b2910 0x7f29540b4dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:27:08.256 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:07.864+0000 7f296cc00700 1 -- 172.21.15.87:0/1873248964 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8190+0+0 (secure 0 0 0) 0x7f295c0e26f0 con 0x7f2970102a70 2024-05-08T05:27:08.257 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:07.864+0000 7f296fe00700 1 --2- 172.21.15.87:0/1873248964 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f29540b2910 0x7f29540b4dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:27:08.257 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:07.864+0000 7f296cc00700 1 --2- 172.21.15.87:0/1873248964 >> [v2:172.21.15.160:6816/927680738,v1:172.21.15.160:6817/927680738] conn(0x7f29540bc3d0 0x7f29540be870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:27:08.257 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:07.864+0000 7f296cc00700 1 -- 172.21.15.87:0/1873248964 --> [v2:172.21.15.160:6816/927680738,v1:172.21.15.160:6817/927680738] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f29540bef40 con 0x7f29540bc3d0 2024-05-08T05:27:08.257 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:07.864+0000 7f296cc00700 1 -- 172.21.15.87:0/1873248964 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_get_version_reply(handle=1 version=82) ==== 24+0+0 (secure 0 0 0) 0x7f295c0e2aa0 con 0x7f2970102a70 2024-05-08T05:27:08.257 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:07.865+0000 7f2974c00700 1 --2- 172.21.15.87:0/1873248964 >> [v2:172.21.15.160:6816/927680738,v1:172.21.15.160:6817/927680738] conn(0x7f29540bc3d0 0x7f29540be870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:27:08.257 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:07.865+0000 7f296fe00700 1 --2- 172.21.15.87:0/1873248964 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f29540b2910 0x7f29540b4dd0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f2960006010 tx=0x7f296000c650 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:27:08.257 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:07.865+0000 7f2974c00700 1 --2- 172.21.15.87:0/1873248964 >> [v2:172.21.15.160:6816/927680738,v1:172.21.15.160:6817/927680738] conn(0x7f29540bc3d0 0x7f29540be870 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.8 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:27:08.257 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:07.866+0000 7f296cc00700 1 -- 172.21.15.87:0/1873248964 <== osd.8 v2:172.21.15.160:6816/927680738 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f29540bef40 con 0x7f29540bc3d0 2024-05-08T05:27:08.257 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:07.884+0000 7f2976c00700 1 -- 172.21.15.87:0/1873248964 --> [v2:172.21.15.160:6816/927680738,v1:172.21.15.160:6817/927680738] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f29700640b0 con 0x7f29540bc3d0 2024-05-08T05:27:08.258 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:07.885+0000 7f296cc00700 1 -- 172.21.15.87:0/1873248964 <== osd.8 v2:172.21.15.160:6816/927680738 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f29700640b0 con 0x7f29540bc3d0 2024-05-08T05:27:08.258 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:07.886+0000 7f2976c00700 1 -- 172.21.15.87:0/1873248964 >> [v2:172.21.15.160:6816/927680738,v1:172.21.15.160:6817/927680738] conn(0x7f29540bc3d0 msgr2=0x7f29540be870 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:27:08.258 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:07.886+0000 7f2976c00700 1 --2- 172.21.15.87:0/1873248964 >> [v2:172.21.15.160:6816/927680738,v1:172.21.15.160:6817/927680738] conn(0x7f29540bc3d0 0x7f29540be870 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:27:08.258 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:07.886+0000 7f2976c00700 1 -- 172.21.15.87:0/1873248964 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f29540b2910 msgr2=0x7f29540b4dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:27:08.258 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:07.886+0000 7f2976c00700 1 --2- 172.21.15.87:0/1873248964 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f29540b2910 0x7f29540b4dd0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f2960006010 tx=0x7f296000c650 comp rx=0 tx=0).stop 2024-05-08T05:27:08.258 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:07.886+0000 7f2976c00700 1 -- 172.21.15.87:0/1873248964 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2970102a70 msgr2=0x7f297019c330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:27:08.258 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:07.886+0000 7f2976c00700 1 --2- 172.21.15.87:0/1873248964 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2970102a70 0x7f297019c330 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f295c00e9c0 tx=0x7f295c00ecd0 comp rx=0 tx=0).stop 2024-05-08T05:27:08.258 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:07.886+0000 7f2974c00700 1 -- 172.21.15.87:0/1873248964 reap_dead start 2024-05-08T05:27:08.259 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:07.886+0000 7f2976c00700 1 -- 172.21.15.87:0/1873248964 shutdown_connections 2024-05-08T05:27:08.259 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:07.886+0000 7f2976c00700 1 -- 172.21.15.87:0/1873248964 >> 172.21.15.87:0/1873248964 conn(0x7f29700776c0 msgr2=0x7f2970100510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:27:08.259 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:07.887+0000 7f2976c00700 1 -- 172.21.15.87:0/1873248964 shutdown_connections 2024-05-08T05:27:08.259 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:07.887+0000 7f2976c00700 1 -- 172.21.15.87:0/1873248964 wait complete. 2024-05-08T05:27:08.259 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:27:08 smithi087 ceph-mon[29523]: pgmap v364: 97 pgs: 97 active+clean; 644 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-05-08T05:27:08.483 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:27:08 smithi090 ceph-mon[34526]: pgmap v364: 97 pgs: 97 active+clean; 644 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-05-08T05:27:08.538 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:27:08 smithi160 ceph-mon[34827]: pgmap v364: 97 pgs: 97 active+clean; 644 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-05-08T05:27:09.435 INFO:teuthology.orchestra.run.smithi087.stdout:231928234036 2024-05-08T05:27:09.435 DEBUG:teuthology.orchestra.run.smithi087:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid eeeb813e-0cf9-11ef-bc97-c7b262605968 -- ceph osd last-stat-seq osd.8 2024-05-08T05:27:10.323 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:27:10 smithi087 ceph-mon[29523]: pgmap v365: 97 pgs: 97 active+clean; 644 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 7 op/s 2024-05-08T05:27:10.483 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:27:10 smithi090 ceph-mon[34526]: pgmap v365: 97 pgs: 97 active+clean; 644 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 7 op/s 2024-05-08T05:27:10.538 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:27:10 smithi160 ceph-mon[34827]: pgmap v365: 97 pgs: 97 active+clean; 644 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 7 op/s 2024-05-08T05:27:10.618 INFO:teuthology.orchestra.run.smithi087.stdout:206158430266 2024-05-08T05:27:10.619 DEBUG:teuthology.orchestra.run.smithi087:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid eeeb813e-0cf9-11ef-bc97-c7b262605968 -- ceph osd last-stat-seq osd.7 2024-05-08T05:27:10.703 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:10.313+0000 7f07b8400700 1 -- 172.21.15.87:0/1284809591 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f07b010a490 msgr2=0x7f07b01169a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:27:10.703 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:10.313+0000 7f07b8400700 1 --2- 172.21.15.87:0/1284809591 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f07b010a490 0x7f07b01169a0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f07a8009990 tx=0x7f07a8009ca0 comp rx=0 tx=0).stop 2024-05-08T05:27:10.703 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:10.313+0000 7f07b8400700 1 -- 172.21.15.87:0/1284809591 shutdown_connections 2024-05-08T05:27:10.703 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:10.313+0000 7f07b8400700 1 --2- 172.21.15.87:0/1284809591 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f07b010a490 0x7f07b01169a0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:27:10.703 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:10.313+0000 7f07b8400700 1 --2- 172.21.15.87:0/1284809591 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f07b010fb60 0x7f07b010ff40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:27:10.703 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:10.313+0000 7f07b8400700 1 --2- 172.21.15.87:0/1284809591 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f07b0109ad0 0x7f07b0109f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:27:10.703 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:10.314+0000 7f07b8400700 1 -- 172.21.15.87:0/1284809591 >> 172.21.15.87:0/1284809591 conn(0x7f07b0076c70 msgr2=0x7f07b01082c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:27:10.704 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:10.314+0000 7f07b8400700 1 -- 172.21.15.87:0/1284809591 shutdown_connections 2024-05-08T05:27:10.704 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:10.314+0000 7f07b8400700 1 -- 172.21.15.87:0/1284809591 wait complete. 2024-05-08T05:27:10.704 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:10.315+0000 7f07b8400700 1 Processor -- start 2024-05-08T05:27:10.704 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:10.315+0000 7f07b8400700 1 -- start start 2024-05-08T05:27:10.704 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:10.315+0000 7f07b8400700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f07b0109ad0 0x7f07b01a0150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:27:10.704 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:10.315+0000 7f07b8400700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f07b010a490 0x7f07b01a0690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:27:10.704 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:10.315+0000 7f07b8400700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f07b010fb60 0x7f07b01a4a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:27:10.704 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:10.315+0000 7f07b8400700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f07b0119d00 con 0x7f07b010fb60 2024-05-08T05:27:10.704 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:10.315+0000 7f07b8400700 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f07b0119b80 con 0x7f07b010a490 2024-05-08T05:27:10.704 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:10.315+0000 7f07b8400700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f07b0119e80 con 0x7f07b0109ad0 2024-05-08T05:27:10.704 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:10.316+0000 7f07b6400700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f07b010fb60 0x7f07b01a4a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:27:10.704 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:10.316+0000 7f07b5a00700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f07b0109ad0 0x7f07b01a0150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:27:10.704 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:10.316+0000 7f07b6400700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f07b010fb60 0x7f07b01a4a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:52444/0 (socket says 172.21.15.87:52444) 2024-05-08T05:27:10.704 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:10.316+0000 7f07b6400700 1 -- 172.21.15.87:0/930272598 learned_addr learned my addr 172.21.15.87:0/930272598 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T05:27:10.705 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:10.316+0000 7f07b5000700 1 --2- 172.21.15.87:0/930272598 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f07b010a490 0x7f07b01a0690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:27:10.705 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:10.316+0000 7f07b5a00700 1 -- 172.21.15.87:0/930272598 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f07b010a490 msgr2=0x7f07b01a0690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:27:10.705 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:10.316+0000 7f07b5a00700 1 --2- 172.21.15.87:0/930272598 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f07b010a490 0x7f07b01a0690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:27:10.705 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:10.316+0000 7f07b5a00700 1 -- 172.21.15.87:0/930272598 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f07b010fb60 msgr2=0x7f07b01a4a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:27:10.705 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:10.316+0000 7f07b5a00700 1 --2- 172.21.15.87:0/930272598 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f07b010fb60 0x7f07b01a4a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:27:10.705 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:10.316+0000 7f07b5a00700 1 -- 172.21.15.87:0/930272598 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f07b01a5160 con 0x7f07b0109ad0 2024-05-08T05:27:10.705 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:10.316+0000 7f07b6400700 1 --2- 172.21.15.87:0/930272598 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f07b010fb60 0x7f07b01a4a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T05:27:10.705 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:10.316+0000 7f07b5a00700 1 --2- 172.21.15.87:0/930272598 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f07b0109ad0 0x7f07b01a0150 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f07a400ef10 tx=0x7f07a400c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:27:10.705 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:10.317+0000 7f07ae000700 1 -- 172.21.15.87:0/930272598 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07a400c9c0 con 0x7f07b0109ad0 2024-05-08T05:27:10.705 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:10.317+0000 7f07ae000700 1 -- 172.21.15.87:0/930272598 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f07a4019070 con 0x7f07b0109ad0 2024-05-08T05:27:10.705 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:10.317+0000 7f07ae000700 1 -- 172.21.15.87:0/930272598 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07a4014480 con 0x7f07b0109ad0 2024-05-08T05:27:10.705 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:10.317+0000 7f07b8400700 1 -- 172.21.15.87:0/930272598 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f07b01a53f0 con 0x7f07b0109ad0 2024-05-08T05:27:10.705 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:10.317+0000 7f07b8400700 1 -- 172.21.15.87:0/930272598 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f07b01accd0 con 0x7f07b0109ad0 2024-05-08T05:27:10.706 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:10.318+0000 7f07b8400700 1 -- 172.21.15.87:0/930272598 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f07b0063c30 con 0x7f07b0109ad0 2024-05-08T05:27:10.706 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:10.320+0000 7f07ae000700 1 -- 172.21.15.87:0/930272598 <== mon.1 v2:172.21.15.160:3300/0 4 ==== mgrmap(e 17) ==== 149703+0+0 (secure 0 0 0) 0x7f07a4012050 con 0x7f07b0109ad0 2024-05-08T05:27:10.706 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:10.321+0000 7f07ae000700 1 --2- 172.21.15.87:0/930272598 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f07980b2910 0x7f07980b4dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:27:10.706 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:10.322+0000 7f07ae000700 1 -- 172.21.15.87:0/930272598 <== mon.1 v2:172.21.15.160:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8190+0+0 (secure 0 0 0) 0x7f07a40e2d90 con 0x7f07b0109ad0 2024-05-08T05:27:10.706 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:10.322+0000 7f07b5000700 1 --2- 172.21.15.87:0/930272598 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f07980b2910 0x7f07980b4dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:27:10.706 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:10.322+0000 7f07ae000700 1 --2- 172.21.15.87:0/930272598 >> [v2:172.21.15.160:6824/1842739135,v1:172.21.15.160:6825/1842739135] conn(0x7f07980bc3d0 0x7f07980be870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:27:10.706 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:10.322+0000 7f07ae000700 1 -- 172.21.15.87:0/930272598 --> [v2:172.21.15.160:6824/1842739135,v1:172.21.15.160:6825/1842739135] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f07a401fe50 con 0x7f07980bc3d0 2024-05-08T05:27:10.706 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:10.322+0000 7f07ae000700 1 -- 172.21.15.87:0/930272598 <== mon.1 v2:172.21.15.160:3300/0 6 ==== mon_get_version_reply(handle=1 version=82) ==== 24+0+0 (secure 0 0 0) 0x7f07a40e3140 con 0x7f07b0109ad0 2024-05-08T05:27:10.706 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:10.323+0000 7f07b5000700 1 --2- 172.21.15.87:0/930272598 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f07980b2910 0x7f07980b4dd0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f079c009680 tx=0x7f079c009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:27:10.706 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:10.323+0000 7f07b6400700 1 --2- 172.21.15.87:0/930272598 >> [v2:172.21.15.160:6824/1842739135,v1:172.21.15.160:6825/1842739135] conn(0x7f07980bc3d0 0x7f07980be870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:27:10.706 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:10.323+0000 7f07b6400700 1 --2- 172.21.15.87:0/930272598 >> [v2:172.21.15.160:6824/1842739135,v1:172.21.15.160:6825/1842739135] conn(0x7f07980bc3d0 0x7f07980be870 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.11 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:27:10.706 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:10.324+0000 7f07ae000700 1 -- 172.21.15.87:0/930272598 <== osd.11 v2:172.21.15.160:6824/1842739135 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f07a401fe50 con 0x7f07980bc3d0 2024-05-08T05:27:10.707 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:10.342+0000 7f07b8400700 1 -- 172.21.15.87:0/930272598 --> [v2:172.21.15.160:6824/1842739135,v1:172.21.15.160:6825/1842739135] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f07b00640b0 con 0x7f07980bc3d0 2024-05-08T05:27:10.707 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:10.342+0000 7f07ae000700 1 -- 172.21.15.87:0/930272598 <== osd.11 v2:172.21.15.160:6824/1842739135 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f07b00640b0 con 0x7f07980bc3d0 2024-05-08T05:27:10.707 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:10.343+0000 7f07b8400700 1 -- 172.21.15.87:0/930272598 >> [v2:172.21.15.160:6824/1842739135,v1:172.21.15.160:6825/1842739135] conn(0x7f07980bc3d0 msgr2=0x7f07980be870 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:27:10.707 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:10.343+0000 7f07b8400700 1 --2- 172.21.15.87:0/930272598 >> [v2:172.21.15.160:6824/1842739135,v1:172.21.15.160:6825/1842739135] conn(0x7f07980bc3d0 0x7f07980be870 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:27:10.707 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:10.343+0000 7f07b8400700 1 -- 172.21.15.87:0/930272598 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f07980b2910 msgr2=0x7f07980b4dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:27:10.707 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:10.343+0000 7f07b8400700 1 --2- 172.21.15.87:0/930272598 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f07980b2910 0x7f07980b4dd0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f079c009680 tx=0x7f079c009260 comp rx=0 tx=0).stop 2024-05-08T05:27:10.707 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:10.343+0000 7f07b8400700 1 -- 172.21.15.87:0/930272598 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f07b0109ad0 msgr2=0x7f07b01a0150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:27:10.707 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:10.343+0000 7f07b8400700 1 --2- 172.21.15.87:0/930272598 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f07b0109ad0 0x7f07b01a0150 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f07a400ef10 tx=0x7f07a400c3a0 comp rx=0 tx=0).stop 2024-05-08T05:27:10.707 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:10.343+0000 7f07b6400700 1 -- 172.21.15.87:0/930272598 reap_dead start 2024-05-08T05:27:10.708 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:10.343+0000 7f07b8400700 1 -- 172.21.15.87:0/930272598 shutdown_connections 2024-05-08T05:27:10.708 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:10.343+0000 7f07b8400700 1 -- 172.21.15.87:0/930272598 >> 172.21.15.87:0/930272598 conn(0x7f07b0076c70 msgr2=0x7f07b00771f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:27:10.708 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:10.343+0000 7f07b8400700 1 -- 172.21.15.87:0/930272598 shutdown_connections 2024-05-08T05:27:10.708 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:10.343+0000 7f07b8400700 1 -- 172.21.15.87:0/930272598 wait complete. 2024-05-08T05:27:11.633 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:11.632+0000 7f0592400700 1 -- 172.21.15.87:0/2125208570 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f058c104100 msgr2=0x7f058c108120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:27:11.633 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:11.632+0000 7f0592400700 1 --2- 172.21.15.87:0/2125208570 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f058c104100 0x7f058c108120 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f0574009920 tx=0x7f0574009c30 comp rx=0 tx=0).stop 2024-05-08T05:27:11.633 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:11.632+0000 7f0592400700 1 -- 172.21.15.87:0/2125208570 shutdown_connections 2024-05-08T05:27:11.633 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:11.632+0000 7f0592400700 1 --2- 172.21.15.87:0/2125208570 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f058c108850 0x7f058c1103d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:27:11.634 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:11.632+0000 7f0592400700 1 --2- 172.21.15.87:0/2125208570 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f058c103750 0x7f058c103b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:27:11.634 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:11.632+0000 7f0592400700 1 --2- 172.21.15.87:0/2125208570 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f058c104100 0x7f058c108120 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:27:11.634 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:11.633+0000 7f0592400700 1 -- 172.21.15.87:0/2125208570 >> 172.21.15.87:0/2125208570 conn(0x7f058c07a600 msgr2=0x7f058c07aa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:27:11.634 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:11.633+0000 7f0592400700 1 -- 172.21.15.87:0/2125208570 shutdown_connections 2024-05-08T05:27:11.634 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:11.633+0000 7f0592400700 1 -- 172.21.15.87:0/2125208570 wait complete. 2024-05-08T05:27:11.634 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:11.634+0000 7f0592400700 1 Processor -- start 2024-05-08T05:27:11.634 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:11.634+0000 7f0592400700 1 -- start start 2024-05-08T05:27:11.635 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:11.635+0000 7f0592400700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f058c103750 0x7f058c19f830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:27:11.635 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:11.635+0000 7f0592400700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f058c104100 0x7f058c19fd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:27:11.635 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:11.635+0000 7f0592400700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f058c108850 0x7f058c1999f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:27:11.635 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:11.635+0000 7f0592400700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f058c113630 con 0x7f058c108850 2024-05-08T05:27:11.635 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:11.635+0000 7f0592400700 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f058c1134b0 con 0x7f058c103750 2024-05-08T05:27:11.635 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:11.635+0000 7f0592400700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f058c1137b0 con 0x7f058c104100 2024-05-08T05:27:11.636 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:11.635+0000 7f058be00700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f058c108850 0x7f058c1999f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:27:11.636 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:11.635+0000 7f058b400700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f058c103750 0x7f058c19f830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:27:11.636 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:11.635+0000 7f058be00700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f058c108850 0x7f058c1999f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:52474/0 (socket says 172.21.15.87:52474) 2024-05-08T05:27:11.636 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:11.635+0000 7f058be00700 1 -- 172.21.15.87:0/3673147524 learned_addr learned my addr 172.21.15.87:0/3673147524 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T05:27:11.636 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:11.635+0000 7f0583e00700 1 --2- 172.21.15.87:0/3673147524 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f058c104100 0x7f058c19fd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:27:11.637 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:11.636+0000 7f058b400700 1 -- 172.21.15.87:0/3673147524 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f058c104100 msgr2=0x7f058c19fd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:27:11.637 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:11.636+0000 7f058b400700 1 --2- 172.21.15.87:0/3673147524 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f058c104100 0x7f058c19fd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:27:11.637 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:11.636+0000 7f058b400700 1 -- 172.21.15.87:0/3673147524 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f058c108850 msgr2=0x7f058c1999f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:27:11.637 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:11.636+0000 7f058b400700 1 --2- 172.21.15.87:0/3673147524 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f058c108850 0x7f058c1999f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:27:11.637 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:11.636+0000 7f058b400700 1 -- 172.21.15.87:0/3673147524 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f058c19a150 con 0x7f058c103750 2024-05-08T05:27:11.637 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:11.636+0000 7f058be00700 1 --2- 172.21.15.87:0/3673147524 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f058c108850 0x7f058c1999f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T05:27:11.637 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:11.636+0000 7f058b400700 1 --2- 172.21.15.87:0/3673147524 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f058c103750 0x7f058c19f830 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f057c00eb90 tx=0x7f057c00eea0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:27:11.638 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:11.636+0000 7f0588c00700 1 -- 172.21.15.87:0/3673147524 <== mon.2 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f057c00cc90 con 0x7f058c103750 2024-05-08T05:27:11.638 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:11.636+0000 7f0588c00700 1 -- 172.21.15.87:0/3673147524 <== mon.2 v2:172.21.15.90:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f057c00ce30 con 0x7f058c103750 2024-05-08T05:27:11.638 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:11.636+0000 7f0592400700 1 -- 172.21.15.87:0/3673147524 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f058c19a440 con 0x7f058c103750 2024-05-08T05:27:11.638 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:11.636+0000 7f0588c00700 1 -- 172.21.15.87:0/3673147524 <== mon.2 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f057c010430 con 0x7f058c103750 2024-05-08T05:27:11.638 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:11.637+0000 7f0592400700 1 -- 172.21.15.87:0/3673147524 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f058c1a6700 con 0x7f058c103750 2024-05-08T05:27:11.638 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:11.637+0000 7f0592400700 1 -- 172.21.15.87:0/3673147524 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f058c063c30 con 0x7f058c103750 2024-05-08T05:27:11.640 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:11.640+0000 7f0588c00700 1 -- 172.21.15.87:0/3673147524 <== mon.2 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 17) ==== 149703+0+0 (secure 0 0 0) 0x7f057c003ef0 con 0x7f058c103750 2024-05-08T05:27:11.642 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:11.641+0000 7f0588c00700 1 --2- 172.21.15.87:0/3673147524 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f05700b2990 0x7f05700b4e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:27:11.642 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:11.642+0000 7f0588c00700 1 -- 172.21.15.87:0/3673147524 <== mon.2 v2:172.21.15.90:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8190+0+0 (secure 0 0 0) 0x7f057c0e28d0 con 0x7f058c103750 2024-05-08T05:27:11.642 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:11.642+0000 7f0583e00700 1 --2- 172.21.15.87:0/3673147524 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f05700b2990 0x7f05700b4e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:27:11.642 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:11.642+0000 7f0588c00700 1 --2- 172.21.15.87:0/3673147524 >> [v2:172.21.15.87:6826/3789116749,v1:172.21.15.87:6827/3789116749] conn(0x7f05700bc380 0x7f05700be820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:27:11.642 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:11.642+0000 7f0588c00700 1 -- 172.21.15.87:0/3673147524 --> [v2:172.21.15.87:6826/3789116749,v1:172.21.15.87:6827/3789116749] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f057c00e1a0 con 0x7f05700bc380 2024-05-08T05:27:11.642 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:11.642+0000 7f0588c00700 1 -- 172.21.15.87:0/3673147524 <== mon.2 v2:172.21.15.90:3300/0 6 ==== mon_get_version_reply(handle=1 version=82) ==== 24+0+0 (secure 0 0 0) 0x7f057c0e2c80 con 0x7f058c103750 2024-05-08T05:27:11.642 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:11.642+0000 7f058be00700 1 --2- 172.21.15.87:0/3673147524 >> [v2:172.21.15.87:6826/3789116749,v1:172.21.15.87:6827/3789116749] conn(0x7f05700bc380 0x7f05700be820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:27:11.643 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:11.643+0000 7f0583e00700 1 --2- 172.21.15.87:0/3673147524 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f05700b2990 0x7f05700b4e50 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f058c1030c0 tx=0x7f0574019040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:27:11.643 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:11.643+0000 7f058be00700 1 --2- 172.21.15.87:0/3673147524 >> [v2:172.21.15.87:6826/3789116749,v1:172.21.15.87:6827/3789116749] conn(0x7f05700bc380 0x7f05700be820 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.9 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:27:11.644 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:11.644+0000 7f0588c00700 1 -- 172.21.15.87:0/3673147524 <== osd.9 v2:172.21.15.87:6826/3789116749 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f057c00e1a0 con 0x7f05700bc380 2024-05-08T05:27:11.662 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:11.661+0000 7f0592400700 1 -- 172.21.15.87:0/3673147524 --> [v2:172.21.15.87:6826/3789116749,v1:172.21.15.87:6827/3789116749] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f058c064030 con 0x7f05700bc380 2024-05-08T05:27:11.662 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:11.662+0000 7f0588c00700 1 -- 172.21.15.87:0/3673147524 <== osd.9 v2:172.21.15.87:6826/3789116749 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f058c064030 con 0x7f05700bc380 2024-05-08T05:27:11.663 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:11.663+0000 7f0592400700 1 -- 172.21.15.87:0/3673147524 >> [v2:172.21.15.87:6826/3789116749,v1:172.21.15.87:6827/3789116749] conn(0x7f05700bc380 msgr2=0x7f05700be820 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:27:11.663 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:11.663+0000 7f0592400700 1 --2- 172.21.15.87:0/3673147524 >> [v2:172.21.15.87:6826/3789116749,v1:172.21.15.87:6827/3789116749] conn(0x7f05700bc380 0x7f05700be820 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:27:11.663 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:11.663+0000 7f0592400700 1 -- 172.21.15.87:0/3673147524 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f05700b2990 msgr2=0x7f05700b4e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:27:11.663 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:11.663+0000 7f0592400700 1 --2- 172.21.15.87:0/3673147524 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f05700b2990 0x7f05700b4e50 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f058c1030c0 tx=0x7f0574019040 comp rx=0 tx=0).stop 2024-05-08T05:27:11.663 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:11.663+0000 7f0592400700 1 -- 172.21.15.87:0/3673147524 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f058c103750 msgr2=0x7f058c19f830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:27:11.663 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:11.663+0000 7f0592400700 1 --2- 172.21.15.87:0/3673147524 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f058c103750 0x7f058c19f830 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f057c00eb90 tx=0x7f057c00eea0 comp rx=0 tx=0).stop 2024-05-08T05:27:11.663 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:11.663+0000 7f058be00700 1 -- 172.21.15.87:0/3673147524 reap_dead start 2024-05-08T05:27:11.664 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:11.663+0000 7f0592400700 1 -- 172.21.15.87:0/3673147524 shutdown_connections 2024-05-08T05:27:11.664 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:11.663+0000 7f0592400700 1 -- 172.21.15.87:0/3673147524 >> 172.21.15.87:0/3673147524 conn(0x7f058c07a600 msgr2=0x7f058c1018d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:27:11.664 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:11.663+0000 7f0592400700 1 -- 172.21.15.87:0/3673147524 shutdown_connections 2024-05-08T05:27:11.664 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:11.663+0000 7f0592400700 1 -- 172.21.15.87:0/3673147524 wait complete. 2024-05-08T05:27:12.279 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:27:12 smithi087 ceph-mon[29523]: pgmap v366: 97 pgs: 97 active+clean; 644 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T05:27:12.483 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:27:12 smithi090 ceph-mon[34526]: pgmap v366: 97 pgs: 97 active+clean; 644 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T05:27:12.538 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:27:12 smithi160 ceph-mon[34827]: pgmap v366: 97 pgs: 97 active+clean; 644 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T05:27:13.159 INFO:teuthology.orchestra.run.smithi087.stdout:309237645347 2024-05-08T05:27:13.160 DEBUG:teuthology.orchestra.run.smithi087:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid eeeb813e-0cf9-11ef-bc97-c7b262605968 -- ceph osd last-stat-seq osd.11 2024-05-08T05:27:14.085 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:13.967+0000 7f72f6600700 1 -- 172.21.15.87:0/2704118797 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f72f0104100 msgr2=0x7f72f0108120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:27:14.086 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:13.967+0000 7f72f6600700 1 --2- 172.21.15.87:0/2704118797 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f72f0104100 0x7f72f0108120 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f72dc009990 tx=0x7f72dc009ca0 comp rx=0 tx=0).stop 2024-05-08T05:27:14.086 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:13.967+0000 7f72f6600700 1 -- 172.21.15.87:0/2704118797 shutdown_connections 2024-05-08T05:27:14.086 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:13.967+0000 7f72f6600700 1 --2- 172.21.15.87:0/2704118797 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f72f0108850 0x7f72f01103d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:27:14.086 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:13.967+0000 7f72f6600700 1 --2- 172.21.15.87:0/2704118797 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f72f0103750 0x7f72f0103b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:27:14.086 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:13.967+0000 7f72f6600700 1 --2- 172.21.15.87:0/2704118797 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f72f0104100 0x7f72f0108120 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:27:14.086 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:13.967+0000 7f72f6600700 1 -- 172.21.15.87:0/2704118797 >> 172.21.15.87:0/2704118797 conn(0x7f72f007a600 msgr2=0x7f72f007aa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:27:14.086 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:13.967+0000 7f72f6600700 1 -- 172.21.15.87:0/2704118797 shutdown_connections 2024-05-08T05:27:14.086 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:13.967+0000 7f72f6600700 1 -- 172.21.15.87:0/2704118797 wait complete. 2024-05-08T05:27:14.086 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:13.968+0000 7f72f6600700 1 Processor -- start 2024-05-08T05:27:14.086 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:13.968+0000 7f72f6600700 1 -- start start 2024-05-08T05:27:14.086 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:13.969+0000 7f72f6600700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f72f0103750 0x7f72f019f760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:27:14.086 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:13.969+0000 7f72f6600700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f72f0104100 0x7f72f019fca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:27:14.087 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:13.969+0000 7f72f6600700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f72f0108850 0x7f72f0199920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:27:14.087 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:13.969+0000 7f72f6600700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f72f0113660 con 0x7f72f0104100 2024-05-08T05:27:14.087 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:13.969+0000 7f72f6600700 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f72f01134e0 con 0x7f72f0103750 2024-05-08T05:27:14.087 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:13.969+0000 7f72f6600700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f72f01137e0 con 0x7f72f0108850 2024-05-08T05:27:14.087 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:13.969+0000 7f72eea00700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f72f0104100 0x7f72f019fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:27:14.087 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:13.969+0000 7f72ef400700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f72f0103750 0x7f72f019f760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:27:14.087 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:13.969+0000 7f72eea00700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f72f0104100 0x7f72f019fca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:52490/0 (socket says 172.21.15.87:52490) 2024-05-08T05:27:14.087 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:13.969+0000 7f72eea00700 1 -- 172.21.15.87:0/3326821778 learned_addr learned my addr 172.21.15.87:0/3326821778 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T05:27:14.087 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:13.969+0000 7f72efe00700 1 --2- 172.21.15.87:0/3326821778 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f72f0108850 0x7f72f0199920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:27:14.087 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:13.970+0000 7f72eea00700 1 -- 172.21.15.87:0/3326821778 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f72f0108850 msgr2=0x7f72f0199920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:27:14.087 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:13.970+0000 7f72eea00700 1 --2- 172.21.15.87:0/3326821778 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f72f0108850 0x7f72f0199920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:27:14.087 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:13.970+0000 7f72eea00700 1 -- 172.21.15.87:0/3326821778 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f72f0103750 msgr2=0x7f72f019f760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:27:14.087 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:13.970+0000 7f72eea00700 1 --2- 172.21.15.87:0/3326821778 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f72f0103750 0x7f72f019f760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:27:14.087 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:13.970+0000 7f72eea00700 1 -- 172.21.15.87:0/3326821778 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f72f019a080 con 0x7f72f0104100 2024-05-08T05:27:14.087 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:13.970+0000 7f72eea00700 1 --2- 172.21.15.87:0/3326821778 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f72f0104100 0x7f72f019fca0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f72dc005910 tx=0x7f72dc00bfc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:27:14.088 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:13.971+0000 7f72e7e00700 1 -- 172.21.15.87:0/3326821778 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72dc027070 con 0x7f72f0104100 2024-05-08T05:27:14.088 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:13.971+0000 7f72e7e00700 1 -- 172.21.15.87:0/3326821778 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f72dc00b610 con 0x7f72f0104100 2024-05-08T05:27:14.088 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:13.971+0000 7f72f6600700 1 -- 172.21.15.87:0/3326821778 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f72f019a310 con 0x7f72f0104100 2024-05-08T05:27:14.088 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:13.971+0000 7f72e7e00700 1 -- 172.21.15.87:0/3326821778 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72dc0173f0 con 0x7f72f0104100 2024-05-08T05:27:14.088 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:13.971+0000 7f72f6600700 1 -- 172.21.15.87:0/3326821778 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f72f01a6630 con 0x7f72f0104100 2024-05-08T05:27:14.088 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:13.972+0000 7f72f6600700 1 -- 172.21.15.87:0/3326821778 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f72f0063bb0 con 0x7f72f0104100 2024-05-08T05:27:14.088 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:13.976+0000 7f72e7e00700 1 -- 172.21.15.87:0/3326821778 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 17) ==== 149703+0+0 (secure 0 0 0) 0x7f72dc02a070 con 0x7f72f0104100 2024-05-08T05:27:14.088 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:13.977+0000 7f72e7e00700 1 --2- 172.21.15.87:0/3326821778 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f72d40b2910 0x7f72d40b4dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:27:14.089 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:13.978+0000 7f72e7e00700 1 -- 172.21.15.87:0/3326821778 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8190+0+0 (secure 0 0 0) 0x7f72dc0e38c0 con 0x7f72f0104100 2024-05-08T05:27:14.089 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:13.978+0000 7f72ef400700 1 --2- 172.21.15.87:0/3326821778 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f72d40b2910 0x7f72d40b4dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:27:14.089 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:13.978+0000 7f72e7e00700 1 --2- 172.21.15.87:0/3326821778 >> [v2:172.21.15.90:6808/1371607578,v1:172.21.15.90:6809/1371607578] conn(0x7f72d40bc3d0 0x7f72d40be870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:27:14.089 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:13.978+0000 7f72e7e00700 1 -- 172.21.15.87:0/3326821778 --> [v2:172.21.15.90:6808/1371607578,v1:172.21.15.90:6809/1371607578] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f72dc007e80 con 0x7f72d40bc3d0 2024-05-08T05:27:14.089 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:13.978+0000 7f72e7e00700 1 -- 172.21.15.87:0/3326821778 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_get_version_reply(handle=1 version=82) ==== 24+0+0 (secure 0 0 0) 0x7f72dc0e3d10 con 0x7f72f0104100 2024-05-08T05:27:14.089 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:13.978+0000 7f72efe00700 1 --2- 172.21.15.87:0/3326821778 >> [v2:172.21.15.90:6808/1371607578,v1:172.21.15.90:6809/1371607578] conn(0x7f72d40bc3d0 0x7f72d40be870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:27:14.089 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:13.978+0000 7f72ef400700 1 --2- 172.21.15.87:0/3326821778 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f72d40b2910 0x7f72d40b4dd0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f72f019aa60 tx=0x7f72e0009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:27:14.089 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:13.979+0000 7f72efe00700 1 --2- 172.21.15.87:0/3326821778 >> [v2:172.21.15.90:6808/1371607578,v1:172.21.15.90:6809/1371607578] conn(0x7f72d40bc3d0 0x7f72d40be870 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:27:14.089 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:13.980+0000 7f72e7e00700 1 -- 172.21.15.87:0/3326821778 <== osd.4 v2:172.21.15.90:6808/1371607578 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f72dc007e80 con 0x7f72d40bc3d0 2024-05-08T05:27:14.089 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:13.998+0000 7f72f6600700 1 -- 172.21.15.87:0/3326821778 --> [v2:172.21.15.90:6808/1371607578,v1:172.21.15.90:6809/1371607578] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f72f0064030 con 0x7f72d40bc3d0 2024-05-08T05:27:14.089 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:13.998+0000 7f72e7e00700 1 -- 172.21.15.87:0/3326821778 <== osd.4 v2:172.21.15.90:6808/1371607578 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f72f0064030 con 0x7f72d40bc3d0 2024-05-08T05:27:14.089 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:13.999+0000 7f72f6600700 1 -- 172.21.15.87:0/3326821778 >> [v2:172.21.15.90:6808/1371607578,v1:172.21.15.90:6809/1371607578] conn(0x7f72d40bc3d0 msgr2=0x7f72d40be870 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:27:14.089 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:13.999+0000 7f72f6600700 1 --2- 172.21.15.87:0/3326821778 >> [v2:172.21.15.90:6808/1371607578,v1:172.21.15.90:6809/1371607578] conn(0x7f72d40bc3d0 0x7f72d40be870 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:27:14.089 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:13.999+0000 7f72f6600700 1 -- 172.21.15.87:0/3326821778 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f72d40b2910 msgr2=0x7f72d40b4dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:27:14.089 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:13.999+0000 7f72f6600700 1 --2- 172.21.15.87:0/3326821778 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f72d40b2910 0x7f72d40b4dd0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f72f019aa60 tx=0x7f72e0009260 comp rx=0 tx=0).stop 2024-05-08T05:27:14.089 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:13.999+0000 7f72f6600700 1 -- 172.21.15.87:0/3326821778 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f72f0104100 msgr2=0x7f72f019fca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:27:14.090 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:13.999+0000 7f72f6600700 1 --2- 172.21.15.87:0/3326821778 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f72f0104100 0x7f72f019fca0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f72dc005910 tx=0x7f72dc00bfc0 comp rx=0 tx=0).stop 2024-05-08T05:27:14.090 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:13.999+0000 7f72efe00700 1 -- 172.21.15.87:0/3326821778 reap_dead start 2024-05-08T05:27:14.090 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:13.999+0000 7f72f6600700 1 -- 172.21.15.87:0/3326821778 shutdown_connections 2024-05-08T05:27:14.090 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:13.999+0000 7f72f6600700 1 -- 172.21.15.87:0/3326821778 >> 172.21.15.87:0/3326821778 conn(0x7f72f007a600 msgr2=0x7f72f0101890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:27:14.090 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:13.999+0000 7f72f6600700 1 -- 172.21.15.87:0/3326821778 shutdown_connections 2024-05-08T05:27:14.090 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:13.999+0000 7f72f6600700 1 -- 172.21.15.87:0/3326821778 wait complete. 2024-05-08T05:27:14.458 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:27:14 smithi087 ceph-mon[29523]: pgmap v367: 97 pgs: 97 active+clean; 644 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-05-08T05:27:14.483 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:27:14 smithi090 ceph-mon[34526]: pgmap v367: 97 pgs: 97 active+clean; 644 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-05-08T05:27:14.539 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:27:14 smithi160 ceph-mon[34827]: pgmap v367: 97 pgs: 97 active+clean; 644 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-05-08T05:27:14.654 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:14.076+0000 7f97a3200700 1 -- 172.21.15.87:0/1747346685 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f979c114670 msgr2=0x7f979c116a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:27:14.654 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:14.076+0000 7f97a3200700 1 --2- 172.21.15.87:0/1747346685 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f979c114670 0x7f979c116a60 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f9794009f90 tx=0x7f979400b330 comp rx=0 tx=0).stop 2024-05-08T05:27:14.654 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:14.076+0000 7f97a3200700 1 -- 172.21.15.87:0/1747346685 shutdown_connections 2024-05-08T05:27:14.654 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:14.076+0000 7f97a3200700 1 --2- 172.21.15.87:0/1747346685 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f979c114670 0x7f979c116a60 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:27:14.654 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:14.076+0000 7f97a3200700 1 --2- 172.21.15.87:0/1747346685 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f979c0756d0 0x7f979c075ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:27:14.654 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:14.076+0000 7f97a3200700 1 --2- 172.21.15.87:0/1747346685 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f979c075ff0 0x7f979c114130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:27:14.654 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:14.076+0000 7f97a3200700 1 -- 172.21.15.87:0/1747346685 >> 172.21.15.87:0/1747346685 conn(0x7f979c07a600 msgr2=0x7f979c07aa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:27:14.654 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:14.076+0000 7f97a3200700 1 -- 172.21.15.87:0/1747346685 shutdown_connections 2024-05-08T05:27:14.654 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:14.076+0000 7f97a3200700 1 -- 172.21.15.87:0/1747346685 wait complete. 2024-05-08T05:27:14.654 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:14.077+0000 7f97a3200700 1 Processor -- start 2024-05-08T05:27:14.654 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:14.078+0000 7f97a3200700 1 -- start start 2024-05-08T05:27:14.655 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:14.078+0000 7f97a3200700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f979c0756d0 0x7f979c1a0190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:27:14.655 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:14.078+0000 7f97a3200700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f979c075ff0 0x7f979c1a06d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:27:14.655 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:14.078+0000 7f97a3200700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f979c114670 0x7f979c1a4a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:27:14.655 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:14.078+0000 7f97a3200700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f979c119ca0 con 0x7f979c114670 2024-05-08T05:27:14.655 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:14.078+0000 7f97a3200700 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f979c119b20 con 0x7f979c0756d0 2024-05-08T05:27:14.655 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:14.078+0000 7f97a3200700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f979c119e20 con 0x7f979c075ff0 2024-05-08T05:27:14.655 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:14.078+0000 7f97a1200700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f979c114670 0x7f979c1a4a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:27:14.655 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:14.078+0000 7f979be00700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f979c0756d0 0x7f979c1a0190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:27:14.655 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:14.078+0000 7f979be00700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f979c0756d0 0x7f979c1a0190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.87:49438/0 (socket says 172.21.15.87:49438) 2024-05-08T05:27:14.655 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:14.078+0000 7f979be00700 1 -- 172.21.15.87:0/751179076 learned_addr learned my addr 172.21.15.87:0/751179076 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T05:27:14.655 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:14.078+0000 7f979b400700 1 --2- 172.21.15.87:0/751179076 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f979c075ff0 0x7f979c1a06d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:27:14.655 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:14.079+0000 7f97a1200700 1 -- 172.21.15.87:0/751179076 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f979c075ff0 msgr2=0x7f979c1a06d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:27:14.655 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:14.079+0000 7f97a1200700 1 --2- 172.21.15.87:0/751179076 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f979c075ff0 0x7f979c1a06d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:27:14.655 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:14.079+0000 7f97a1200700 1 -- 172.21.15.87:0/751179076 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f979c0756d0 msgr2=0x7f979c1a0190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:27:14.656 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:14.079+0000 7f97a1200700 1 --2- 172.21.15.87:0/751179076 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f979c0756d0 0x7f979c1a0190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:27:14.656 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:14.079+0000 7f97a1200700 1 -- 172.21.15.87:0/751179076 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f979c1a51a0 con 0x7f979c114670 2024-05-08T05:27:14.656 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:14.079+0000 7f979b400700 1 --2- 172.21.15.87:0/751179076 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f979c075ff0 0x7f979c1a06d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T05:27:14.656 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:14.079+0000 7f97a1200700 1 --2- 172.21.15.87:0/751179076 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f979c114670 0x7f979c1a4a60 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f979400b6c0 tx=0x7f979400cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:27:14.656 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:14.079+0000 7f9798c00700 1 -- 172.21.15.87:0/751179076 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9794021070 con 0x7f979c114670 2024-05-08T05:27:14.656 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:14.080+0000 7f9798c00700 1 -- 172.21.15.87:0/751179076 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9794007ac0 con 0x7f979c114670 2024-05-08T05:27:14.656 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:14.080+0000 7f97a3200700 1 -- 172.21.15.87:0/751179076 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f979c1a5430 con 0x7f979c114670 2024-05-08T05:27:14.656 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:14.080+0000 7f9798c00700 1 -- 172.21.15.87:0/751179076 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9794005040 con 0x7f979c114670 2024-05-08T05:27:14.656 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:14.080+0000 7f97a3200700 1 -- 172.21.15.87:0/751179076 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f979c1acd10 con 0x7f979c114670 2024-05-08T05:27:14.656 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:14.081+0000 7f97a3200700 1 -- 172.21.15.87:0/751179076 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f979c063c30 con 0x7f979c114670 2024-05-08T05:27:14.656 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:14.087+0000 7f9798c00700 1 -- 172.21.15.87:0/751179076 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 17) ==== 149703+0+0 (secure 0 0 0) 0x7f9794024070 con 0x7f979c114670 2024-05-08T05:27:14.656 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:14.088+0000 7f9798c00700 1 --2- 172.21.15.87:0/751179076 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f97800b2990 0x7f97800b4e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:27:14.656 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:14.089+0000 7f9798c00700 1 -- 172.21.15.87:0/751179076 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8190+0+0 (secure 0 0 0) 0x7f979400f020 con 0x7f979c114670 2024-05-08T05:27:14.656 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:14.089+0000 7f979be00700 1 --2- 172.21.15.87:0/751179076 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f97800b2990 0x7f97800b4e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:27:14.657 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:14.089+0000 7f9798c00700 1 --2- 172.21.15.87:0/751179076 >> [v2:172.21.15.90:6824/716529498,v1:172.21.15.90:6825/716529498] conn(0x7f97800bc450 0x7f97800be8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:27:14.657 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:14.089+0000 7f9798c00700 1 -- 172.21.15.87:0/751179076 --> [v2:172.21.15.90:6824/716529498,v1:172.21.15.90:6825/716529498] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f97800befc0 con 0x7f97800bc450 2024-05-08T05:27:14.657 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:14.089+0000 7f9798c00700 1 -- 172.21.15.87:0/751179076 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_get_version_reply(handle=1 version=82) ==== 24+0+0 (secure 0 0 0) 0x7f97940e3bb0 con 0x7f979c114670 2024-05-08T05:27:14.657 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:14.089+0000 7f979be00700 1 --2- 172.21.15.87:0/751179076 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f97800b2990 0x7f97800b4e50 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f978c009d60 tx=0x7f978c009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:27:14.657 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:14.089+0000 7f979b400700 1 --2- 172.21.15.87:0/751179076 >> [v2:172.21.15.90:6824/716529498,v1:172.21.15.90:6825/716529498] conn(0x7f97800bc450 0x7f97800be8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:27:14.657 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:14.090+0000 7f979b400700 1 --2- 172.21.15.87:0/751179076 >> [v2:172.21.15.90:6824/716529498,v1:172.21.15.90:6825/716529498] conn(0x7f97800bc450 0x7f97800be8f0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.10 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:27:14.657 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:14.091+0000 7f9798c00700 1 -- 172.21.15.87:0/751179076 <== osd.10 v2:172.21.15.90:6824/716529498 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f97800befc0 con 0x7f97800bc450 2024-05-08T05:27:14.657 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:14.109+0000 7f97a3200700 1 -- 172.21.15.87:0/751179076 --> [v2:172.21.15.90:6824/716529498,v1:172.21.15.90:6825/716529498] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f979c064030 con 0x7f97800bc450 2024-05-08T05:27:14.657 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:14.110+0000 7f9798c00700 1 -- 172.21.15.87:0/751179076 <== osd.10 v2:172.21.15.90:6824/716529498 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f979c064030 con 0x7f97800bc450 2024-05-08T05:27:14.657 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:14.110+0000 7f97a3200700 1 -- 172.21.15.87:0/751179076 >> [v2:172.21.15.90:6824/716529498,v1:172.21.15.90:6825/716529498] conn(0x7f97800bc450 msgr2=0x7f97800be8f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:27:14.658 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:14.110+0000 7f97a3200700 1 --2- 172.21.15.87:0/751179076 >> [v2:172.21.15.90:6824/716529498,v1:172.21.15.90:6825/716529498] conn(0x7f97800bc450 0x7f97800be8f0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:27:14.658 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:14.110+0000 7f97a3200700 1 -- 172.21.15.87:0/751179076 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f97800b2990 msgr2=0x7f97800b4e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:27:14.658 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:14.110+0000 7f97a3200700 1 --2- 172.21.15.87:0/751179076 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f97800b2990 0x7f97800b4e50 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f978c009d60 tx=0x7f978c009260 comp rx=0 tx=0).stop 2024-05-08T05:27:14.658 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:14.110+0000 7f97a3200700 1 -- 172.21.15.87:0/751179076 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f979c114670 msgr2=0x7f979c1a4a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:27:14.658 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:14.110+0000 7f97a3200700 1 --2- 172.21.15.87:0/751179076 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f979c114670 0x7f979c1a4a60 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f979400b6c0 tx=0x7f979400cc30 comp rx=0 tx=0).stop 2024-05-08T05:27:14.658 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:14.111+0000 7f97a1200700 1 -- 172.21.15.87:0/751179076 reap_dead start 2024-05-08T05:27:14.658 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:14.111+0000 7f97a3200700 1 -- 172.21.15.87:0/751179076 shutdown_connections 2024-05-08T05:27:14.658 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:14.111+0000 7f97a3200700 1 -- 172.21.15.87:0/751179076 >> 172.21.15.87:0/751179076 conn(0x7f979c07a600 msgr2=0x7f979c111570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:27:14.658 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:14.111+0000 7f97a3200700 1 -- 172.21.15.87:0/751179076 shutdown_connections 2024-05-08T05:27:14.658 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:14.111+0000 7f97a3200700 1 -- 172.21.15.87:0/751179076 wait complete. 2024-05-08T05:27:15.053 INFO:teuthology.orchestra.run.smithi087.stdout:257698037807 2024-05-08T05:27:15.053 DEBUG:teuthology.orchestra.run.smithi087:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid eeeb813e-0cf9-11ef-bc97-c7b262605968 -- ceph osd last-stat-seq osd.9 2024-05-08T05:27:15.376 INFO:teuthology.orchestra.run.smithi087.stdout:154618822725 2024-05-08T05:27:15.376 DEBUG:teuthology.orchestra.run.smithi087:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid eeeb813e-0cf9-11ef-bc97-c7b262605968 -- ceph osd last-stat-seq osd.5 2024-05-08T05:27:15.993 INFO:teuthology.orchestra.run.smithi087.stdout:283467841579 2024-05-08T05:27:15.994 DEBUG:teuthology.orchestra.run.smithi087:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid eeeb813e-0cf9-11ef-bc97-c7b262605968 -- ceph osd last-stat-seq osd.10 2024-05-08T05:27:16.259 INFO:teuthology.orchestra.run.smithi087.stderr:Inferring config /var/lib/ceph/eeeb813e-0cf9-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T05:27:16.259 INFO:teuthology.orchestra.run.smithi087.stderr:Inferring config /var/lib/ceph/eeeb813e-0cf9-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T05:27:16.378 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:27:16 smithi087 ceph-mon[29523]: pgmap v368: 97 pgs: 97 active+clean; 644 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 6 op/s 2024-05-08T05:27:16.483 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:27:16 smithi090 ceph-mon[34526]: pgmap v368: 97 pgs: 97 active+clean; 644 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 6 op/s 2024-05-08T05:27:16.538 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:27:16 smithi160 ceph-mon[34827]: pgmap v368: 97 pgs: 97 active+clean; 644 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 6 op/s 2024-05-08T05:27:16.802 INFO:teuthology.orchestra.run.smithi087.stderr:Inferring config /var/lib/ceph/eeeb813e-0cf9-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T05:27:16.802 INFO:teuthology.orchestra.run.smithi087.stderr:Inferring config /var/lib/ceph/eeeb813e-0cf9-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T05:27:16.836 INFO:teuthology.orchestra.run.smithi087.stdout:133143986253 2024-05-08T05:27:16.836 DEBUG:teuthology.orchestra.run.smithi087:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid eeeb813e-0cf9-11ef-bc97-c7b262605968 -- ceph osd last-stat-seq osd.4 2024-05-08T05:27:16.970 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:16.640+0000 7f5cf3200700 1 -- 172.21.15.87:0/1774047664 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5cec109ad0 msgr2=0x7f5cec109f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:27:16.970 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:16.640+0000 7f5cf3200700 1 --2- 172.21.15.87:0/1774047664 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5cec109ad0 0x7f5cec109f50 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f5cd80098f0 tx=0x7f5cd8009c00 comp rx=0 tx=0).stop 2024-05-08T05:27:16.970 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:16.640+0000 7f5cf3200700 1 -- 172.21.15.87:0/1774047664 shutdown_connections 2024-05-08T05:27:16.970 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:16.640+0000 7f5cf3200700 1 --2- 172.21.15.87:0/1774047664 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5cec10a490 0x7f5cec1169a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:27:16.970 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:16.640+0000 7f5cf3200700 1 --2- 172.21.15.87:0/1774047664 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5cec10fb60 0x7f5cec10ff40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:27:16.970 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:16.640+0000 7f5cf3200700 1 --2- 172.21.15.87:0/1774047664 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5cec109ad0 0x7f5cec109f50 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:27:16.971 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:16.640+0000 7f5cf3200700 1 -- 172.21.15.87:0/1774047664 >> 172.21.15.87:0/1774047664 conn(0x7f5cec076c70 msgr2=0x7f5cec1082c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:27:16.971 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:16.640+0000 7f5cf3200700 1 -- 172.21.15.87:0/1774047664 shutdown_connections 2024-05-08T05:27:16.971 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:16.640+0000 7f5cf3200700 1 -- 172.21.15.87:0/1774047664 wait complete. 2024-05-08T05:27:16.971 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:16.642+0000 7f5cf3200700 1 Processor -- start 2024-05-08T05:27:16.971 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:16.642+0000 7f5cf3200700 1 -- start start 2024-05-08T05:27:16.971 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:16.642+0000 7f5cf3200700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5cec109ad0 0x7f5cec1a0220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:27:16.971 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:16.643+0000 7f5cf3200700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5cec10a490 0x7f5cec1a0760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:27:16.971 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:16.643+0000 7f5cf3200700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5cec10fb60 0x7f5cec1a4af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:27:16.971 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:16.643+0000 7f5cf3200700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f5cec119cd0 con 0x7f5cec109ad0 2024-05-08T05:27:16.971 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:16.643+0000 7f5cf3200700 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f5cec119b50 con 0x7f5cec10fb60 2024-05-08T05:27:16.971 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:16.643+0000 7f5cf3200700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f5cec119e50 con 0x7f5cec10a490 2024-05-08T05:27:16.971 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:16.643+0000 7f5cebe00700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5cec109ad0 0x7f5cec1a0220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:27:16.971 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:16.643+0000 7f5cebe00700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5cec109ad0 0x7f5cec1a0220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:41672/0 (socket says 172.21.15.87:41672) 2024-05-08T05:27:16.971 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:16.643+0000 7f5ceb400700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5cec10a490 0x7f5cec1a0760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:27:16.972 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:16.643+0000 7f5cebe00700 1 -- 172.21.15.87:0/504348148 learned_addr learned my addr 172.21.15.87:0/504348148 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T05:27:16.972 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:16.643+0000 7f5cf1200700 1 --2- 172.21.15.87:0/504348148 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5cec10fb60 0x7f5cec1a4af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:27:16.972 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:16.643+0000 7f5cebe00700 1 -- 172.21.15.87:0/504348148 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5cec10a490 msgr2=0x7f5cec1a0760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:27:16.972 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:16.643+0000 7f5cebe00700 1 --2- 172.21.15.87:0/504348148 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5cec10a490 0x7f5cec1a0760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:27:16.972 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:16.643+0000 7f5cebe00700 1 -- 172.21.15.87:0/504348148 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5cec10fb60 msgr2=0x7f5cec1a4af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:27:16.972 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:16.643+0000 7f5cebe00700 1 --2- 172.21.15.87:0/504348148 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5cec10fb60 0x7f5cec1a4af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:27:16.972 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:16.643+0000 7f5cebe00700 1 -- 172.21.15.87:0/504348148 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5cec1a5230 con 0x7f5cec109ad0 2024-05-08T05:27:16.972 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:16.644+0000 7f5cebe00700 1 --2- 172.21.15.87:0/504348148 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5cec109ad0 0x7f5cec1a0220 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f5cdc00e9a0 tx=0x7f5cdc00ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:27:16.972 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:16.644+0000 7f5ce8c00700 1 -- 172.21.15.87:0/504348148 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5cdc00ca10 con 0x7f5cec109ad0 2024-05-08T05:27:16.972 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:16.644+0000 7f5cf3200700 1 -- 172.21.15.87:0/504348148 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5cec1a5520 con 0x7f5cec109ad0 2024-05-08T05:27:16.972 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:16.644+0000 7f5ce8c00700 1 -- 172.21.15.87:0/504348148 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5cdc00cbb0 con 0x7f5cec109ad0 2024-05-08T05:27:16.972 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:16.644+0000 7f5ce8c00700 1 -- 172.21.15.87:0/504348148 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5cdc018680 con 0x7f5cec109ad0 2024-05-08T05:27:16.972 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:16.644+0000 7f5cf3200700 1 -- 172.21.15.87:0/504348148 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5cec1acda0 con 0x7f5cec109ad0 2024-05-08T05:27:16.972 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:16.645+0000 7f5cf3200700 1 -- 172.21.15.87:0/504348148 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f5cec063bb0 con 0x7f5cec109ad0 2024-05-08T05:27:16.972 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:16.648+0000 7f5ce8c00700 1 -- 172.21.15.87:0/504348148 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 17) ==== 149703+0+0 (secure 0 0 0) 0x7f5cdc010430 con 0x7f5cec109ad0 2024-05-08T05:27:16.973 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:16.649+0000 7f5ce8c00700 1 --2- 172.21.15.87:0/504348148 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f5cd00b2990 0x7f5cd00b4e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:27:16.973 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:16.649+0000 7f5ce8c00700 1 -- 172.21.15.87:0/504348148 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8190+0+0 (secure 0 0 0) 0x7f5cdc0e2a70 con 0x7f5cec109ad0 2024-05-08T05:27:16.973 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:16.650+0000 7f5ceb400700 1 --2- 172.21.15.87:0/504348148 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f5cd00b2990 0x7f5cd00b4e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:27:16.973 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:16.650+0000 7f5ce8c00700 1 --2- 172.21.15.87:0/504348148 >> [v2:172.21.15.87:6802/2285285644,v1:172.21.15.87:6803/2285285644] conn(0x7f5cd00bc450 0x7f5cd00be8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:27:16.973 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:16.650+0000 7f5ce8c00700 1 -- 172.21.15.87:0/504348148 --> [v2:172.21.15.87:6802/2285285644,v1:172.21.15.87:6803/2285285644] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f5cdc024e70 con 0x7f5cd00bc450 2024-05-08T05:27:16.973 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:16.650+0000 7f5ce8c00700 1 -- 172.21.15.87:0/504348148 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_get_version_reply(handle=1 version=82) ==== 24+0+0 (secure 0 0 0) 0x7f5cdc0e2e20 con 0x7f5cec109ad0 2024-05-08T05:27:16.973 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:16.650+0000 7f5cf1200700 1 --2- 172.21.15.87:0/504348148 >> [v2:172.21.15.87:6802/2285285644,v1:172.21.15.87:6803/2285285644] conn(0x7f5cd00bc450 0x7f5cd00be8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:27:16.973 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:16.650+0000 7f5ceb400700 1 --2- 172.21.15.87:0/504348148 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f5cd00b2990 0x7f5cd00b4e50 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f5cd8009fd0 tx=0x7f5cd8019040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:27:16.973 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:16.651+0000 7f5cf1200700 1 --2- 172.21.15.87:0/504348148 >> [v2:172.21.15.87:6802/2285285644,v1:172.21.15.87:6803/2285285644] conn(0x7f5cd00bc450 0x7f5cd00be8f0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:27:16.973 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:16.652+0000 7f5ce8c00700 1 -- 172.21.15.87:0/504348148 <== osd.0 v2:172.21.15.87:6802/2285285644 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f5cdc024e70 con 0x7f5cd00bc450 2024-05-08T05:27:16.973 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:16.670+0000 7f5cf3200700 1 -- 172.21.15.87:0/504348148 --> [v2:172.21.15.87:6802/2285285644,v1:172.21.15.87:6803/2285285644] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f5cec063fb0 con 0x7f5cd00bc450 2024-05-08T05:27:16.973 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:16.670+0000 7f5ce8c00700 1 -- 172.21.15.87:0/504348148 <== osd.0 v2:172.21.15.87:6802/2285285644 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f5cec063fb0 con 0x7f5cd00bc450 2024-05-08T05:27:16.974 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:16.670+0000 7f5cf3200700 1 -- 172.21.15.87:0/504348148 >> [v2:172.21.15.87:6802/2285285644,v1:172.21.15.87:6803/2285285644] conn(0x7f5cd00bc450 msgr2=0x7f5cd00be8f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:27:16.974 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:16.670+0000 7f5cf3200700 1 --2- 172.21.15.87:0/504348148 >> [v2:172.21.15.87:6802/2285285644,v1:172.21.15.87:6803/2285285644] conn(0x7f5cd00bc450 0x7f5cd00be8f0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:27:16.974 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:16.671+0000 7f5cf3200700 1 -- 172.21.15.87:0/504348148 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f5cd00b2990 msgr2=0x7f5cd00b4e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:27:16.974 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:16.671+0000 7f5cf3200700 1 --2- 172.21.15.87:0/504348148 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f5cd00b2990 0x7f5cd00b4e50 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f5cd8009fd0 tx=0x7f5cd8019040 comp rx=0 tx=0).stop 2024-05-08T05:27:16.974 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:16.671+0000 7f5cf3200700 1 -- 172.21.15.87:0/504348148 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5cec109ad0 msgr2=0x7f5cec1a0220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:27:16.974 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:16.671+0000 7f5cf3200700 1 --2- 172.21.15.87:0/504348148 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5cec109ad0 0x7f5cec1a0220 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f5cdc00e9a0 tx=0x7f5cdc00ecb0 comp rx=0 tx=0).stop 2024-05-08T05:27:16.974 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:16.671+0000 7f5cf1200700 1 -- 172.21.15.87:0/504348148 reap_dead start 2024-05-08T05:27:16.974 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:16.671+0000 7f5cf3200700 1 -- 172.21.15.87:0/504348148 shutdown_connections 2024-05-08T05:27:16.974 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:16.671+0000 7f5cf3200700 1 -- 172.21.15.87:0/504348148 >> 172.21.15.87:0/504348148 conn(0x7f5cec076c70 msgr2=0x7f5cec077350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:27:16.974 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:16.671+0000 7f5cf3200700 1 -- 172.21.15.87:0/504348148 shutdown_connections 2024-05-08T05:27:16.975 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:16.671+0000 7f5cf3200700 1 -- 172.21.15.87:0/504348148 wait complete. 2024-05-08T05:27:17.822 INFO:teuthology.orchestra.run.smithi087.stdout:34359738466 2024-05-08T05:27:17.822 DEBUG:teuthology.orchestra.run.smithi087:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid eeeb813e-0cf9-11ef-bc97-c7b262605968 -- ceph osd last-stat-seq osd.0 2024-05-08T05:27:18.295 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:27:18 smithi087 ceph-mon[29523]: pgmap v369: 97 pgs: 97 active+clean; 644 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-05-08T05:27:18.483 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:27:18 smithi090 ceph-mon[34526]: pgmap v369: 97 pgs: 97 active+clean; 644 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-05-08T05:27:18.539 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:27:18 smithi160 ceph-mon[34827]: pgmap v369: 97 pgs: 97 active+clean; 644 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-05-08T05:27:19.692 INFO:teuthology.orchestra.run.smithi087.stderr:Inferring config /var/lib/ceph/eeeb813e-0cf9-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T05:27:19.703 INFO:teuthology.orchestra.run.smithi087.stderr:Inferring config /var/lib/ceph/eeeb813e-0cf9-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T05:27:19.703 INFO:teuthology.orchestra.run.smithi087.stderr:Inferring config /var/lib/ceph/eeeb813e-0cf9-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T05:27:19.709 INFO:teuthology.orchestra.run.smithi087.stderr:Inferring config /var/lib/ceph/eeeb813e-0cf9-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T05:27:20.208 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:27:20 smithi087 ceph-mon[29523]: pgmap v370: 97 pgs: 97 active+clean; 644 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-05-08T05:27:20.483 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:27:20 smithi090 ceph-mon[34526]: pgmap v370: 97 pgs: 97 active+clean; 644 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-05-08T05:27:20.538 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:27:20 smithi160 ceph-mon[34827]: pgmap v370: 97 pgs: 97 active+clean; 644 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-05-08T05:27:22.282 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:27:22 smithi087 ceph-mon[29523]: pgmap v371: 97 pgs: 97 active+clean; 644 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T05:27:22.483 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:27:22 smithi090 ceph-mon[34526]: pgmap v371: 97 pgs: 97 active+clean; 644 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T05:27:22.538 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:27:22 smithi160 ceph-mon[34827]: pgmap v371: 97 pgs: 97 active+clean; 644 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T05:27:23.062 INFO:teuthology.orchestra.run.smithi087.stderr:Inferring config /var/lib/ceph/eeeb813e-0cf9-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T05:27:23.832 INFO:teuthology.orchestra.run.smithi087.stderr:Inferring config /var/lib/ceph/eeeb813e-0cf9-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T05:27:23.852 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:23.850+0000 7fe9efe00700 1 -- 172.21.15.87:0/2258838832 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe9f0104590 msgr2=0x7fe9f0104970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:27:23.852 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:23.850+0000 7fe9efe00700 1 --2- 172.21.15.87:0/2258838832 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe9f0104590 0x7fe9f0104970 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fe9e00098f0 tx=0x7fe9e0009c00 comp rx=0 tx=0).stop 2024-05-08T05:27:23.852 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:23.850+0000 7fe9efe00700 1 -- 172.21.15.87:0/2258838832 shutdown_connections 2024-05-08T05:27:23.852 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:23.850+0000 7fe9efe00700 1 --2- 172.21.15.87:0/2258838832 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe9f010d9c0 0x7fe9f010fe80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:27:23.852 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:23.850+0000 7fe9efe00700 1 --2- 172.21.15.87:0/2258838832 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe9f0104590 0x7fe9f0104970 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:27:23.852 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:23.850+0000 7fe9efe00700 1 --2- 172.21.15.87:0/2258838832 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe9f0104eb0 0x7fe9f010d3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:27:23.852 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:23.850+0000 7fe9efe00700 1 -- 172.21.15.87:0/2258838832 >> 172.21.15.87:0/2258838832 conn(0x7fe9f00fddc0 msgr2=0x7fe9f01001e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:27:23.852 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:23.850+0000 7fe9efe00700 1 -- 172.21.15.87:0/2258838832 shutdown_connections 2024-05-08T05:27:23.853 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:23.851+0000 7fe9efe00700 1 -- 172.21.15.87:0/2258838832 wait complete. 2024-05-08T05:27:23.853 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:23.852+0000 7fe9efe00700 1 Processor -- start 2024-05-08T05:27:23.853 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:23.852+0000 7fe9efe00700 1 -- start start 2024-05-08T05:27:23.853 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:23.852+0000 7fe9efe00700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe9f0104590 0x7fe9f01a1a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:27:23.854 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:23.852+0000 7fe9efe00700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe9f0104eb0 0x7fe9f01a1fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:27:23.854 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:23.852+0000 7fe9efe00700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe9f010d9c0 0x7fe9f019bb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:27:23.854 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:23.852+0000 7fe9efe00700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fe9f01135b0 con 0x7fe9f0104590 2024-05-08T05:27:23.854 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:23.852+0000 7fe9efe00700 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fe9f0113430 con 0x7fe9f0104eb0 2024-05-08T05:27:23.854 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:23.852+0000 7fe9efe00700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7fe9f0113730 con 0x7fe9f010d9c0 2024-05-08T05:27:23.855 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:23.853+0000 7fe9eea00700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe9f0104590 0x7fe9f01a1a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:27:23.855 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:23.853+0000 7fe9eea00700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe9f0104590 0x7fe9f01a1a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:41714/0 (socket says 172.21.15.87:41714) 2024-05-08T05:27:23.855 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:23.853+0000 7fe9eea00700 1 -- 172.21.15.87:0/3997622472 learned_addr learned my addr 172.21.15.87:0/3997622472 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T05:27:23.855 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:23.853+0000 7fe9ee000700 1 --2- 172.21.15.87:0/3997622472 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe9f0104eb0 0x7fe9f01a1fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:27:23.855 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:23.853+0000 7fe9ef400700 1 --2- 172.21.15.87:0/3997622472 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe9f010d9c0 0x7fe9f019bb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:27:23.855 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:23.853+0000 7fe9ee000700 1 -- 172.21.15.87:0/3997622472 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe9f010d9c0 msgr2=0x7fe9f019bb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:27:23.855 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:23.853+0000 7fe9ee000700 1 --2- 172.21.15.87:0/3997622472 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe9f010d9c0 0x7fe9f019bb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:27:23.855 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:23.853+0000 7fe9ee000700 1 -- 172.21.15.87:0/3997622472 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe9f0104590 msgr2=0x7fe9f01a1a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:27:23.856 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:23.853+0000 7fe9ee000700 1 --2- 172.21.15.87:0/3997622472 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe9f0104590 0x7fe9f01a1a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:27:23.856 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:23.853+0000 7fe9ee000700 1 -- 172.21.15.87:0/3997622472 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe9f019c410 con 0x7fe9f0104eb0 2024-05-08T05:27:23.856 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:23.853+0000 7fe9eea00700 1 --2- 172.21.15.87:0/3997622472 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe9f0104590 0x7fe9f01a1a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T05:27:23.856 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:23.853+0000 7fe9ef400700 1 --2- 172.21.15.87:0/3997622472 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe9f010d9c0 0x7fe9f019bb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T05:27:23.856 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:23.854+0000 7fe9ee000700 1 --2- 172.21.15.87:0/3997622472 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe9f0104eb0 0x7fe9f01a1fa0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fe9dc00e9c0 tx=0x7fe9dc00ecd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:27:23.856 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:23.854+0000 7fe9e7400700 1 -- 172.21.15.87:0/3997622472 <== mon.2 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9dc00c9c0 con 0x7fe9f0104eb0 2024-05-08T05:27:23.856 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:23.854+0000 7fe9e7400700 1 -- 172.21.15.87:0/3997622472 <== mon.2 v2:172.21.15.90:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe9dc00cb60 con 0x7fe9f0104eb0 2024-05-08T05:27:23.856 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:23.854+0000 7fe9e7400700 1 -- 172.21.15.87:0/3997622472 <== mon.2 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9dc018680 con 0x7fe9f0104eb0 2024-05-08T05:27:23.857 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:23.854+0000 7fe9efe00700 1 -- 172.21.15.87:0/3997622472 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe9f019c700 con 0x7fe9f0104eb0 2024-05-08T05:27:23.857 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:23.854+0000 7fe9efe00700 1 -- 172.21.15.87:0/3997622472 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe9f01a89e0 con 0x7fe9f0104eb0 2024-05-08T05:27:23.857 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:23.856+0000 7fe9efe00700 1 -- 172.21.15.87:0/3997622472 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe9f006ba60 con 0x7fe9f0104eb0 2024-05-08T05:27:23.863 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:23.862+0000 7fe9e7400700 1 -- 172.21.15.87:0/3997622472 <== mon.2 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 17) ==== 149703+0+0 (secure 0 0 0) 0x7fe9dc010430 con 0x7fe9f0104eb0 2024-05-08T05:27:23.866 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:23.864+0000 7fe9e7400700 1 --2- 172.21.15.87:0/3997622472 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7fe9d40b2a60 0x7fe9d40b4f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:27:23.866 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:23.864+0000 7fe9e7400700 1 -- 172.21.15.87:0/3997622472 <== mon.2 v2:172.21.15.90:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8190+0+0 (secure 0 0 0) 0x7fe9dc0e27f0 con 0x7fe9f0104eb0 2024-05-08T05:27:23.866 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:23.864+0000 7fe9eea00700 1 --2- 172.21.15.87:0/3997622472 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7fe9d40b2a60 0x7fe9d40b4f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:27:23.866 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:23.865+0000 7fe9e7400700 1 -- 172.21.15.87:0/3997622472 <== mon.2 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7fe9dc0e2c70 con 0x7fe9f0104eb0 2024-05-08T05:27:23.867 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:23.865+0000 7fe9eea00700 1 --2- 172.21.15.87:0/3997622472 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7fe9d40b2a60 0x7fe9d40b4f20 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fe9e0009680 tx=0x7fe9e0019040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:27:24.118 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:24.116+0000 7fe9e7400700 1 -- 172.21.15.87:0/3997622472 <== mon.2 v2:172.21.15.90:3300/0 7 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7fe9dc0a5f90 con 0x7fe9f0104eb0 2024-05-08T05:27:24.195 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:24.192+0000 7fe9efe00700 1 -- 172.21.15.87:0/3997622472 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7fe9f019cff0 con 0x7fe9f0104eb0 2024-05-08T05:27:24.195 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:24.193+0000 7fe9e7400700 1 -- 172.21.15.87:0/3997622472 <== mon.2 v2:172.21.15.90:3300/0 8 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7fe9dc074b80 con 0x7fe9f0104eb0 2024-05-08T05:27:24.195 INFO:teuthology.orchestra.run.smithi087.stdout:180388626499 2024-05-08T05:27:24.198 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:24.196+0000 7fe9efe00700 1 -- 172.21.15.87:0/3997622472 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7fe9d40b2a60 msgr2=0x7fe9d40b4f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:27:24.198 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:24.196+0000 7fe9efe00700 1 --2- 172.21.15.87:0/3997622472 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7fe9d40b2a60 0x7fe9d40b4f20 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fe9e0009680 tx=0x7fe9e0019040 comp rx=0 tx=0).stop 2024-05-08T05:27:24.199 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:24.197+0000 7fe9efe00700 1 -- 172.21.15.87:0/3997622472 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe9f0104eb0 msgr2=0x7fe9f01a1fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:27:24.199 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:24.197+0000 7fe9efe00700 1 --2- 172.21.15.87:0/3997622472 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe9f0104eb0 0x7fe9f01a1fa0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fe9dc00e9c0 tx=0x7fe9dc00ecd0 comp rx=0 tx=0).stop 2024-05-08T05:27:24.199 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:24.197+0000 7fe9efe00700 1 -- 172.21.15.87:0/3997622472 shutdown_connections 2024-05-08T05:27:24.199 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:24.197+0000 7fe9efe00700 1 --2- 172.21.15.87:0/3997622472 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7fe9d40b2a60 0x7fe9d40b4f20 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:27:24.199 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:24.197+0000 7fe9efe00700 1 --2- 172.21.15.87:0/3997622472 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe9f010d9c0 0x7fe9f019bb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:27:24.199 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:24.197+0000 7fe9efe00700 1 --2- 172.21.15.87:0/3997622472 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe9f0104590 0x7fe9f01a1a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:27:24.199 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:24.197+0000 7fe9efe00700 1 --2- 172.21.15.87:0/3997622472 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe9f0104eb0 0x7fe9f01a1fa0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:27:24.199 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:24.197+0000 7fe9efe00700 1 -- 172.21.15.87:0/3997622472 >> 172.21.15.87:0/3997622472 conn(0x7fe9f00fddc0 msgr2=0x7fe9f010ed00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:27:24.199 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:24.197+0000 7fe9efe00700 1 -- 172.21.15.87:0/3997622472 shutdown_connections 2024-05-08T05:27:24.199 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:24.197+0000 7fe9efe00700 1 -- 172.21.15.87:0/3997622472 wait complete. 2024-05-08T05:27:24.350 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:27:24 smithi087 ceph-mon[29523]: pgmap v372: 97 pgs: 97 active+clean; 644 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-05-08T05:27:24.350 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:27:24 smithi087 ceph-mon[29523]: from='client.? 172.21.15.87:0/583694591' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-05-08T05:27:24.483 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:27:24 smithi090 ceph-mon[34526]: pgmap v372: 97 pgs: 97 active+clean; 644 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-05-08T05:27:24.530 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:27:24 smithi090 ceph-mon[34526]: from='client.? 172.21.15.87:0/583694591' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-05-08T05:27:24.538 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:27:24 smithi160 ceph-mon[34827]: pgmap v372: 97 pgs: 97 active+clean; 644 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-05-08T05:27:24.539 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:27:24 smithi160 ceph-mon[34827]: from='client.? 172.21.15.87:0/583694591' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-05-08T05:27:25.321 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:27:25 smithi087 ceph-mon[29523]: mgrmap e18: x(active, since 10m), standbys: z, y 2024-05-08T05:27:25.322 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:27:25 smithi087 ceph-mon[29523]: from='client.? 172.21.15.87:0/3997622472' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2024-05-08T05:27:25.484 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:27:25 smithi090 ceph-mon[34526]: mgrmap e18: x(active, since 10m), standbys: z, y 2024-05-08T05:27:25.484 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:27:25 smithi090 ceph-mon[34526]: from='client.? 172.21.15.87:0/3997622472' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2024-05-08T05:27:25.538 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:27:25 smithi160 ceph-mon[34827]: mgrmap e18: x(active, since 10m), standbys: z, y 2024-05-08T05:27:25.538 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:27:25 smithi160 ceph-mon[34827]: from='client.? 172.21.15.87:0/3997622472' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2024-05-08T05:27:25.880 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:23.712+0000 7fa306a00700 1 -- 172.21.15.87:0/3257090079 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa3001056c0 msgr2=0x7fa300105b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:27:25.881 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:23.712+0000 7fa306a00700 1 --2- 172.21.15.87:0/3257090079 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa3001056c0 0x7fa300105b40 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fa2ec009990 tx=0x7fa2ec009ca0 comp rx=0 tx=0).stop 2024-05-08T05:27:25.881 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:23.712+0000 7fa306a00700 1 -- 172.21.15.87:0/3257090079 shutdown_connections 2024-05-08T05:27:25.881 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:23.712+0000 7fa306a00700 1 --2- 172.21.15.87:0/3257090079 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa300106080 0x7fa300112590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:27:25.881 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:23.712+0000 7fa306a00700 1 --2- 172.21.15.87:0/3257090079 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa30010b6c0 0x7fa30010baa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:27:25.881 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:23.712+0000 7fa306a00700 1 --2- 172.21.15.87:0/3257090079 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa3001056c0 0x7fa300105b40 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:27:25.881 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:23.712+0000 7fa306a00700 1 -- 172.21.15.87:0/3257090079 >> 172.21.15.87:0/3257090079 conn(0x7fa3001011b0 msgr2=0x7fa3001035d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:27:25.881 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:23.712+0000 7fa306a00700 1 -- 172.21.15.87:0/3257090079 shutdown_connections 2024-05-08T05:27:25.881 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:23.713+0000 7fa306a00700 1 -- 172.21.15.87:0/3257090079 wait complete. 2024-05-08T05:27:25.881 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:23.713+0000 7fa306a00700 1 Processor -- start 2024-05-08T05:27:25.881 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:23.714+0000 7fa306a00700 1 -- start start 2024-05-08T05:27:25.881 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:23.714+0000 7fa306a00700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa3001056c0 0x7fa30019bd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:27:25.881 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:23.714+0000 7fa306a00700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa300106080 0x7fa30019c2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:27:25.881 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:23.714+0000 7fa306a00700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa30010b6c0 0x7fa3001a0650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:27:25.882 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:23.714+0000 7fa306a00700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fa300115910 con 0x7fa3001056c0 2024-05-08T05:27:25.882 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:23.714+0000 7fa306a00700 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fa300115790 con 0x7fa30010b6c0 2024-05-08T05:27:25.882 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:23.714+0000 7fa306a00700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7fa300115a90 con 0x7fa300106080 2024-05-08T05:27:25.882 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:23.714+0000 7fa2ffe00700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa3001056c0 0x7fa30019bd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:27:25.882 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:23.715+0000 7fa304a00700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa30010b6c0 0x7fa3001a0650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:27:25.882 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:23.715+0000 7fa2ffe00700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa3001056c0 0x7fa30019bd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:41692/0 (socket says 172.21.15.87:41692) 2024-05-08T05:27:25.882 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:23.715+0000 7fa2ffe00700 1 -- 172.21.15.87:0/583694591 learned_addr learned my addr 172.21.15.87:0/583694591 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T05:27:25.882 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:23.715+0000 7fa2ff400700 1 --2- 172.21.15.87:0/583694591 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa300106080 0x7fa30019c2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:27:25.882 INFO:teuthology.orchestra.run.smithi087.stdout:77309411417 2024-05-08T05:27:25.883 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:23.715+0000 7fa304a00700 1 -- 172.21.15.87:0/583694591 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa300106080 msgr2=0x7fa30019c2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:27:25.883 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:23.715+0000 7fa304a00700 1 --2- 172.21.15.87:0/583694591 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa300106080 0x7fa30019c2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:27:25.883 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:23.715+0000 7fa304a00700 1 -- 172.21.15.87:0/583694591 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa3001056c0 msgr2=0x7fa30019bd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:27:25.883 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:23.715+0000 7fa304a00700 1 --2- 172.21.15.87:0/583694591 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa3001056c0 0x7fa30019bd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:27:25.884 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:23.715+0000 7fa304a00700 1 -- 172.21.15.87:0/583694591 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa3001a0d90 con 0x7fa30010b6c0 2024-05-08T05:27:25.884 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:23.715+0000 7fa2ff400700 1 --2- 172.21.15.87:0/583694591 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa300106080 0x7fa30019c2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T05:27:25.884 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:23.715+0000 7fa2ffe00700 1 --2- 172.21.15.87:0/583694591 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa3001056c0 0x7fa30019bd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T05:27:25.884 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:23.715+0000 7fa304a00700 1 --2- 172.21.15.87:0/583694591 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa30010b6c0 0x7fa3001a0650 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fa2f800efc0 tx=0x7fa2f800c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:27:25.884 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:23.716+0000 7fa2fcc00700 1 -- 172.21.15.87:0/583694591 <== mon.2 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2f80092e0 con 0x7fa30010b6c0 2024-05-08T05:27:25.884 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:23.716+0000 7fa2fcc00700 1 -- 172.21.15.87:0/583694591 <== mon.2 v2:172.21.15.90:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa2f8004bb0 con 0x7fa30010b6c0 2024-05-08T05:27:25.884 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:23.716+0000 7fa306a00700 1 -- 172.21.15.87:0/583694591 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa3001a1020 con 0x7fa30010b6c0 2024-05-08T05:27:25.884 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:23.716+0000 7fa2fcc00700 1 -- 172.21.15.87:0/583694591 <== mon.2 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2f8004020 con 0x7fa30010b6c0 2024-05-08T05:27:25.885 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:23.716+0000 7fa306a00700 1 -- 172.21.15.87:0/583694591 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa3001a8900 con 0x7fa30010b6c0 2024-05-08T05:27:25.885 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:23.717+0000 7fa306a00700 1 -- 172.21.15.87:0/583694591 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa30006a190 con 0x7fa30010b6c0 2024-05-08T05:27:25.885 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:23.719+0000 7fa2fcc00700 1 -- 172.21.15.87:0/583694591 <== mon.2 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 17) ==== 149703+0+0 (secure 0 0 0) 0x7fa2f801b030 con 0x7fa30010b6c0 2024-05-08T05:27:25.885 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:23.721+0000 7fa2fcc00700 1 --2- 172.21.15.87:0/583694591 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7fa2e40b2990 0x7fa2e40b4e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:27:25.885 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:23.721+0000 7fa2fcc00700 1 -- 172.21.15.87:0/583694591 <== mon.2 v2:172.21.15.90:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8190+0+0 (secure 0 0 0) 0x7fa2f80e27d0 con 0x7fa30010b6c0 2024-05-08T05:27:25.885 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:23.721+0000 7fa2ffe00700 1 --2- 172.21.15.87:0/583694591 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7fa2e40b2990 0x7fa2e40b4e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:27:25.885 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:23.722+0000 7fa2ffe00700 1 --2- 172.21.15.87:0/583694591 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7fa2e40b2990 0x7fa2e40b4e50 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fa2f0009680 tx=0x7fa2f0009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:27:25.885 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:23.723+0000 7fa2fcc00700 1 -- 172.21.15.87:0/583694591 <== mon.2 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7fa2f8022020 con 0x7fa30010b6c0 2024-05-08T05:27:25.885 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:24.025+0000 7fa306a00700 1 -- 172.21.15.87:0/583694591 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7fa30019d0e0 con 0x7fa30010b6c0 2024-05-08T05:27:25.885 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:24.026+0000 7fa2fcc00700 1 -- 172.21.15.87:0/583694591 <== mon.2 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fa2f8010040 con 0x7fa30010b6c0 2024-05-08T05:27:25.885 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:24.029+0000 7fa306a00700 1 -- 172.21.15.87:0/583694591 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7fa2e40b2990 msgr2=0x7fa2e40b4e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:27:25.885 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:24.029+0000 7fa306a00700 1 --2- 172.21.15.87:0/583694591 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7fa2e40b2990 0x7fa2e40b4e50 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fa2f0009680 tx=0x7fa2f0009260 comp rx=0 tx=0).stop 2024-05-08T05:27:25.885 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:24.029+0000 7fa306a00700 1 -- 172.21.15.87:0/583694591 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa30010b6c0 msgr2=0x7fa3001a0650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:27:25.885 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:24.029+0000 7fa306a00700 1 --2- 172.21.15.87:0/583694591 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa30010b6c0 0x7fa3001a0650 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fa2f800efc0 tx=0x7fa2f800c3a0 comp rx=0 tx=0).stop 2024-05-08T05:27:25.885 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:24.029+0000 7fa306a00700 1 -- 172.21.15.87:0/583694591 shutdown_connections 2024-05-08T05:27:25.886 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:24.029+0000 7fa306a00700 1 --2- 172.21.15.87:0/583694591 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa30010b6c0 0x7fa3001a0650 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:27:25.886 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:24.029+0000 7fa306a00700 1 --2- 172.21.15.87:0/583694591 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa3001056c0 0x7fa30019bd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:27:25.886 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:24.029+0000 7fa306a00700 1 --2- 172.21.15.87:0/583694591 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7fa2e40b2990 0x7fa2e40b4e50 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:27:25.886 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:24.029+0000 7fa306a00700 1 --2- 172.21.15.87:0/583694591 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa300106080 0x7fa30019c2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:27:25.886 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:24.029+0000 7fa306a00700 1 -- 172.21.15.87:0/583694591 >> 172.21.15.87:0/583694591 conn(0x7fa3001011b0 msgr2=0x7fa300101800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:27:25.886 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:24.029+0000 7fa306a00700 1 -- 172.21.15.87:0/583694591 shutdown_connections 2024-05-08T05:27:25.886 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:24.029+0000 7fa306a00700 1 -- 172.21.15.87:0/583694591 wait complete. 2024-05-08T05:27:26.458 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:27:26 smithi087 ceph-mon[29523]: pgmap v373: 97 pgs: 97 active+clean; 644 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 426 B/s wr, 7 op/s 2024-05-08T05:27:26.483 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:27:26 smithi090 ceph-mon[34526]: pgmap v373: 97 pgs: 97 active+clean; 644 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 426 B/s wr, 7 op/s 2024-05-08T05:27:26.538 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:27:26 smithi160 ceph-mon[34827]: pgmap v373: 97 pgs: 97 active+clean; 644 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 426 B/s wr, 7 op/s 2024-05-08T05:27:28.459 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:27:28 smithi087 ceph-mon[29523]: pgmap v374: 97 pgs: 97 active+clean; 644 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 426 B/s wr, 5 op/s 2024-05-08T05:27:28.483 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:27:28 smithi090 ceph-mon[34526]: pgmap v374: 97 pgs: 97 active+clean; 644 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 426 B/s wr, 5 op/s 2024-05-08T05:27:28.539 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:27:28 smithi160 ceph-mon[34827]: pgmap v374: 97 pgs: 97 active+clean; 644 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 426 B/s wr, 5 op/s 2024-05-08T05:27:29.833 INFO:tasks.cephadm.ceph_manager.ceph:need seq 77309411412 got 77309411417 for osd.2 2024-05-08T05:27:29.834 DEBUG:teuthology.parallel:result is None 2024-05-08T05:27:30.109 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:30.056+0000 7f1f89200700 1 -- 172.21.15.87:0/2334547768 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1f8410fb60 msgr2=0x7f1f8410ff40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:27:30.109 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:30.056+0000 7f1f89200700 1 --2- 172.21.15.87:0/2334547768 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1f8410fb60 0x7f1f8410ff40 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f1f74009990 tx=0x7f1f74009ca0 comp rx=0 tx=0).stop 2024-05-08T05:27:30.109 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:30.056+0000 7f1f89200700 1 -- 172.21.15.87:0/2334547768 shutdown_connections 2024-05-08T05:27:30.109 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:30.056+0000 7f1f89200700 1 --2- 172.21.15.87:0/2334547768 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1f8410a490 0x7f1f841169a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:27:30.109 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:30.056+0000 7f1f89200700 1 --2- 172.21.15.87:0/2334547768 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1f8410fb60 0x7f1f8410ff40 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:27:30.109 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:30.056+0000 7f1f89200700 1 --2- 172.21.15.87:0/2334547768 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1f84109ad0 0x7f1f84109f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:27:30.109 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:30.056+0000 7f1f89200700 1 -- 172.21.15.87:0/2334547768 >> 172.21.15.87:0/2334547768 conn(0x7f1f84076c70 msgr2=0x7f1f841082c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:27:30.109 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:30.057+0000 7f1f89200700 1 -- 172.21.15.87:0/2334547768 shutdown_connections 2024-05-08T05:27:30.110 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:30.057+0000 7f1f89200700 1 -- 172.21.15.87:0/2334547768 wait complete. 2024-05-08T05:27:30.110 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:30.058+0000 7f1f89200700 1 Processor -- start 2024-05-08T05:27:30.110 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:30.058+0000 7f1f89200700 1 -- start start 2024-05-08T05:27:30.110 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:30.058+0000 7f1f89200700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1f84109ad0 0x7f1f841a01b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:27:30.110 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:30.058+0000 7f1f89200700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1f8410a490 0x7f1f841a06f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:27:30.110 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:30.058+0000 7f1f89200700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1f8410fb60 0x7f1f841a4a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:27:30.110 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:30.058+0000 7f1f89200700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f1f84119d20 con 0x7f1f8410a490 2024-05-08T05:27:30.110 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:30.058+0000 7f1f89200700 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f1f84119ba0 con 0x7f1f84109ad0 2024-05-08T05:27:30.110 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:30.058+0000 7f1f89200700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f1f84119ea0 con 0x7f1f8410fb60 2024-05-08T05:27:30.110 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:30.058+0000 7f1f81e00700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1f84109ad0 0x7f1f841a01b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:27:30.110 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:30.058+0000 7f1f81e00700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1f84109ad0 0x7f1f841a01b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.87:37476/0 (socket says 172.21.15.87:37476) 2024-05-08T05:27:30.110 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:30.058+0000 7f1f81e00700 1 -- 172.21.15.87:0/2933041844 learned_addr learned my addr 172.21.15.87:0/2933041844 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T05:27:30.111 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:30.058+0000 7f1f81400700 1 --2- 172.21.15.87:0/2933041844 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1f8410a490 0x7f1f841a06f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:27:30.111 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:30.059+0000 7f1f82800700 1 --2- 172.21.15.87:0/2933041844 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1f8410fb60 0x7f1f841a4a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:27:30.111 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:30.059+0000 7f1f81e00700 1 -- 172.21.15.87:0/2933041844 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1f8410fb60 msgr2=0x7f1f841a4a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:27:30.111 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:30.059+0000 7f1f81e00700 1 --2- 172.21.15.87:0/2933041844 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1f8410fb60 0x7f1f841a4a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:27:30.111 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:30.059+0000 7f1f81e00700 1 -- 172.21.15.87:0/2933041844 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1f8410a490 msgr2=0x7f1f841a06f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:27:30.111 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:30.059+0000 7f1f81e00700 1 --2- 172.21.15.87:0/2933041844 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1f8410a490 0x7f1f841a06f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:27:30.111 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:30.059+0000 7f1f81e00700 1 -- 172.21.15.87:0/2933041844 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1f841a51c0 con 0x7f1f84109ad0 2024-05-08T05:27:30.111 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:30.059+0000 7f1f81e00700 1 --2- 172.21.15.87:0/2933041844 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1f84109ad0 0x7f1f841a01b0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f1f740047b0 tx=0x7f1f74009550 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:27:30.111 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:30.059+0000 7f1f7aa00700 1 -- 172.21.15.87:0/2933041844 <== mon.2 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f74027070 con 0x7f1f84109ad0 2024-05-08T05:27:30.111 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:30.060+0000 7f1f89200700 1 -- 172.21.15.87:0/2933041844 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1f841a5450 con 0x7f1f84109ad0 2024-05-08T05:27:30.111 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:30.060+0000 7f1f7aa00700 1 -- 172.21.15.87:0/2933041844 <== mon.2 v2:172.21.15.90:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1f74022470 con 0x7f1f84109ad0 2024-05-08T05:27:30.111 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:30.060+0000 7f1f7aa00700 1 -- 172.21.15.87:0/2933041844 <== mon.2 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f74017650 con 0x7f1f84109ad0 2024-05-08T05:27:30.111 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:30.060+0000 7f1f89200700 1 -- 172.21.15.87:0/2933041844 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1f841acd30 con 0x7f1f84109ad0 2024-05-08T05:27:30.111 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:30.061+0000 7f1f89200700 1 -- 172.21.15.87:0/2933041844 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1f8410b1d0 con 0x7f1f84109ad0 2024-05-08T05:27:30.111 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:30.063+0000 7f1f7aa00700 1 -- 172.21.15.87:0/2933041844 <== mon.2 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7f1f7402a070 con 0x7f1f84109ad0 2024-05-08T05:27:30.112 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:30.065+0000 7f1f7aa00700 1 --2- 172.21.15.87:0/2933041844 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f1f680b2880 0x7f1f680b4d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:27:30.112 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:30.065+0000 7f1f7aa00700 1 -- 172.21.15.87:0/2933041844 <== mon.2 v2:172.21.15.90:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8190+0+0 (secure 0 0 0) 0x7f1f740e3720 con 0x7f1f84109ad0 2024-05-08T05:27:30.112 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:30.065+0000 7f1f81400700 1 --2- 172.21.15.87:0/2933041844 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f1f680b2880 0x7f1f680b4d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:27:30.112 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:30.066+0000 7f1f81400700 1 --2- 172.21.15.87:0/2933041844 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f1f680b2880 0x7f1f680b4d40 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f1f84078c00 tx=0x7f1f70009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:27:30.112 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:30.067+0000 7f1f7aa00700 1 -- 172.21.15.87:0/2933041844 <== mon.2 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f1f74031070 con 0x7f1f84109ad0 2024-05-08T05:27:30.319 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:30.317+0000 7f1f89200700 1 -- 172.21.15.87:0/2933041844 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7f1f841a1510 con 0x7f1f84109ad0 2024-05-08T05:27:30.319 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:27:30 smithi087 ceph-mon[29523]: pgmap v375: 97 pgs: 97 active+clean; 644 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 597 B/s wr, 8 op/s 2024-05-08T05:27:30.320 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:30.318+0000 7f1f7aa00700 1 -- 172.21.15.87:0/2933041844 <== mon.2 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f1f74013070 con 0x7f1f84109ad0 2024-05-08T05:27:30.320 INFO:teuthology.orchestra.run.smithi087.stdout:154618822730 2024-05-08T05:27:30.323 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:30.321+0000 7f1f89200700 1 -- 172.21.15.87:0/2933041844 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f1f680b2880 msgr2=0x7f1f680b4d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:27:30.323 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:30.321+0000 7f1f89200700 1 --2- 172.21.15.87:0/2933041844 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f1f680b2880 0x7f1f680b4d40 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f1f84078c00 tx=0x7f1f70009260 comp rx=0 tx=0).stop 2024-05-08T05:27:30.323 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:30.321+0000 7f1f89200700 1 -- 172.21.15.87:0/2933041844 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1f84109ad0 msgr2=0x7f1f841a01b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:27:30.323 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:30.321+0000 7f1f89200700 1 --2- 172.21.15.87:0/2933041844 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1f84109ad0 0x7f1f841a01b0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f1f740047b0 tx=0x7f1f74009550 comp rx=0 tx=0).stop 2024-05-08T05:27:30.323 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:30.321+0000 7f1f89200700 1 -- 172.21.15.87:0/2933041844 shutdown_connections 2024-05-08T05:27:30.323 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:30.321+0000 7f1f89200700 1 --2- 172.21.15.87:0/2933041844 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f1f680b2880 0x7f1f680b4d40 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:27:30.323 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:30.321+0000 7f1f89200700 1 --2- 172.21.15.87:0/2933041844 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1f8410fb60 0x7f1f841a4a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:27:30.323 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:30.321+0000 7f1f89200700 1 --2- 172.21.15.87:0/2933041844 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1f84109ad0 0x7f1f841a01b0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:27:30.323 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:30.321+0000 7f1f89200700 1 --2- 172.21.15.87:0/2933041844 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1f8410a490 0x7f1f841a06f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:27:30.323 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:30.321+0000 7f1f89200700 1 -- 172.21.15.87:0/2933041844 >> 172.21.15.87:0/2933041844 conn(0x7f1f84076c70 msgr2=0x7f1f84077290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:27:30.323 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:30.321+0000 7f1f89200700 1 -- 172.21.15.87:0/2933041844 shutdown_connections 2024-05-08T05:27:30.323 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:30.321+0000 7f1f89200700 1 -- 172.21.15.87:0/2933041844 wait complete. 2024-05-08T05:27:30.483 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:27:30 smithi090 ceph-mon[34526]: pgmap v375: 97 pgs: 97 active+clean; 644 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 597 B/s wr, 8 op/s 2024-05-08T05:27:30.539 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:27:30 smithi160 ceph-mon[34827]: pgmap v375: 97 pgs: 97 active+clean; 644 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 597 B/s wr, 8 op/s 2024-05-08T05:27:30.704 INFO:tasks.cephadm.ceph_manager.ceph:need seq 180388626493 got 180388626499 for osd.6 2024-05-08T05:27:30.704 DEBUG:teuthology.parallel:result is None 2024-05-08T05:27:31.401 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:27:31 smithi087 ceph-mon[29523]: from='client.? 172.21.15.87:0/2933041844' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-05-08T05:27:31.402 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:27:31 smithi087 ceph-mon[29523]: from='client.? 172.21.15.87:0/4263006939' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 11}]: dispatch 2024-05-08T05:27:31.468 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:30.512+0000 7f9113e00700 1 -- 172.21.15.87:0/1895502421 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f911410e8b0 msgr2=0x7f911410ec90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:27:31.468 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:30.512+0000 7f9113e00700 1 --2- 172.21.15.87:0/1895502421 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f911410e8b0 0x7f911410ec90 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f9104009990 tx=0x7f9104009ca0 comp rx=0 tx=0).stop 2024-05-08T05:27:31.468 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:30.512+0000 7f9113e00700 1 -- 172.21.15.87:0/1895502421 shutdown_connections 2024-05-08T05:27:31.468 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:30.512+0000 7f9113e00700 1 --2- 172.21.15.87:0/1895502421 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f911410a3a0 0x7f9114116840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:27:31.468 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:30.512+0000 7f9113e00700 1 --2- 172.21.15.87:0/1895502421 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f911410e8b0 0x7f911410ec90 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:27:31.468 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:30.512+0000 7f9113e00700 1 --2- 172.21.15.87:0/1895502421 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f91141099e0 0x7f9114109e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:27:31.469 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:30.512+0000 7f9113e00700 1 -- 172.21.15.87:0/1895502421 >> 172.21.15.87:0/1895502421 conn(0x7f9114079230 msgr2=0x7f91141082c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:27:31.469 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:30.513+0000 7f9113e00700 1 -- 172.21.15.87:0/1895502421 shutdown_connections 2024-05-08T05:27:31.469 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:30.513+0000 7f9113e00700 1 -- 172.21.15.87:0/1895502421 wait complete. 2024-05-08T05:27:31.469 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:30.514+0000 7f9113e00700 1 Processor -- start 2024-05-08T05:27:31.469 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:30.514+0000 7f9113e00700 1 -- start start 2024-05-08T05:27:31.469 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:30.514+0000 7f9113e00700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f91141099e0 0x7f91141a00e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:27:31.469 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:30.514+0000 7f9113e00700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f911410a3a0 0x7f91141a0620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:27:31.469 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:30.514+0000 7f9113e00700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f911410e8b0 0x7f91141a49b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:27:31.469 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:30.514+0000 7f9113e00700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f9114119bf0 con 0x7f911410a3a0 2024-05-08T05:27:31.470 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:30.514+0000 7f9113e00700 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f9114119a70 con 0x7f911410e8b0 2024-05-08T05:27:31.470 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:30.514+0000 7f9113e00700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f9114119d70 con 0x7f91141099e0 2024-05-08T05:27:31.470 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:30.515+0000 7f9112000700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f911410a3a0 0x7f91141a0620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:27:31.470 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:30.515+0000 7f9113400700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f911410e8b0 0x7f91141a49b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:27:31.470 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:30.515+0000 7f9112a00700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f91141099e0 0x7f91141a00e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:27:31.470 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:30.515+0000 7f9112000700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f911410a3a0 0x7f91141a0620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:35132/0 (socket says 172.21.15.87:35132) 2024-05-08T05:27:31.470 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:30.515+0000 7f9112000700 1 -- 172.21.15.87:0/4263006939 learned_addr learned my addr 172.21.15.87:0/4263006939 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T05:27:31.470 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:30.515+0000 7f9112a00700 1 -- 172.21.15.87:0/4263006939 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f911410e8b0 msgr2=0x7f91141a49b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:27:31.470 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:30.515+0000 7f9112a00700 1 --2- 172.21.15.87:0/4263006939 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f911410e8b0 0x7f91141a49b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:27:31.471 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:30.515+0000 7f9112a00700 1 -- 172.21.15.87:0/4263006939 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f911410a3a0 msgr2=0x7f91141a0620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:27:31.471 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:30.515+0000 7f9112a00700 1 --2- 172.21.15.87:0/4263006939 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f911410a3a0 0x7f91141a0620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:27:31.471 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:30.515+0000 7f9112a00700 1 -- 172.21.15.87:0/4263006939 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f91141a50f0 con 0x7f91141099e0 2024-05-08T05:27:31.471 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:30.515+0000 7f9112a00700 1 --2- 172.21.15.87:0/4263006939 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f91141099e0 0x7f91141a00e0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f9104000c00 tx=0x7f91040047b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:27:31.471 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:30.516+0000 7f910b400700 1 -- 172.21.15.87:0/4263006939 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9104026070 con 0x7f91141099e0 2024-05-08T05:27:31.471 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:30.516+0000 7f9113e00700 1 -- 172.21.15.87:0/4263006939 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f91141a5380 con 0x7f91141099e0 2024-05-08T05:27:31.471 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:30.516+0000 7f910b400700 1 -- 172.21.15.87:0/4263006939 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9104021410 con 0x7f91141099e0 2024-05-08T05:27:31.471 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:30.516+0000 7f910b400700 1 -- 172.21.15.87:0/4263006939 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9104017650 con 0x7f91141099e0 2024-05-08T05:27:31.471 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:30.516+0000 7f9113e00700 1 -- 172.21.15.87:0/4263006939 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f91141acc60 con 0x7f91141099e0 2024-05-08T05:27:31.471 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:30.517+0000 7f9113e00700 1 -- 172.21.15.87:0/4263006939 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f911406a190 con 0x7f91141099e0 2024-05-08T05:27:31.472 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:30.519+0000 7f910b400700 1 -- 172.21.15.87:0/4263006939 <== mon.1 v2:172.21.15.160:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7f9104029070 con 0x7f91141099e0 2024-05-08T05:27:31.472 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:30.521+0000 7f910b400700 1 --2- 172.21.15.87:0/4263006939 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f90f80b2880 0x7f90f80b4d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:27:31.472 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:30.521+0000 7f910b400700 1 -- 172.21.15.87:0/4263006939 <== mon.1 v2:172.21.15.160:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8190+0+0 (secure 0 0 0) 0x7f91040e36f0 con 0x7f91141099e0 2024-05-08T05:27:31.472 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:30.521+0000 7f9112000700 1 --2- 172.21.15.87:0/4263006939 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f90f80b2880 0x7f90f80b4d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:27:31.472 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:30.521+0000 7f9112000700 1 --2- 172.21.15.87:0/4263006939 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f90f80b2880 0x7f90f80b4d40 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f9114109510 tx=0x7f910000b480 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:27:31.472 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:30.523+0000 7f910b400700 1 -- 172.21.15.87:0/4263006939 <== mon.1 v2:172.21.15.160:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f9104030070 con 0x7f91141099e0 2024-05-08T05:27:31.472 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:30.760+0000 7f9113e00700 1 -- 172.21.15.87:0/4263006939 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 11} v 0) -- 0x7f911402e510 con 0x7f91141099e0 2024-05-08T05:27:31.472 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:30.761+0000 7f910b400700 1 -- 172.21.15.87:0/4263006939 <== mon.1 v2:172.21.15.160:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 11}]=0 v0) ==== 75+0+13 (secure 0 0 0) 0x7f9104013070 con 0x7f91141099e0 2024-05-08T05:27:31.473 INFO:teuthology.orchestra.run.smithi087.stdout:309237645351 2024-05-08T05:27:31.473 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:30.764+0000 7f9113e00700 1 -- 172.21.15.87:0/4263006939 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f90f80b2880 msgr2=0x7f90f80b4d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:27:31.473 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:30.764+0000 7f9113e00700 1 --2- 172.21.15.87:0/4263006939 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f90f80b2880 0x7f90f80b4d40 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f9114109510 tx=0x7f910000b480 comp rx=0 tx=0).stop 2024-05-08T05:27:31.473 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:30.764+0000 7f9113e00700 1 -- 172.21.15.87:0/4263006939 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f91141099e0 msgr2=0x7f91141a00e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:27:31.474 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:30.764+0000 7f9113e00700 1 --2- 172.21.15.87:0/4263006939 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f91141099e0 0x7f91141a00e0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f9104000c00 tx=0x7f91040047b0 comp rx=0 tx=0).stop 2024-05-08T05:27:31.474 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:30.765+0000 7f9113e00700 1 -- 172.21.15.87:0/4263006939 shutdown_connections 2024-05-08T05:27:31.474 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:30.765+0000 7f9113e00700 1 --2- 172.21.15.87:0/4263006939 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f911410e8b0 0x7f91141a49b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:27:31.474 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:30.765+0000 7f9113e00700 1 --2- 172.21.15.87:0/4263006939 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f90f80b2880 0x7f90f80b4d40 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:27:31.474 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:30.765+0000 7f9113e00700 1 --2- 172.21.15.87:0/4263006939 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f91141099e0 0x7f91141a00e0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:27:31.474 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:30.765+0000 7f9113e00700 1 --2- 172.21.15.87:0/4263006939 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f911410a3a0 0x7f91141a0620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:27:31.474 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:30.765+0000 7f9113e00700 1 -- 172.21.15.87:0/4263006939 >> 172.21.15.87:0/4263006939 conn(0x7f9114079230 msgr2=0x7f9114079850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:27:31.474 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:30.765+0000 7f9113e00700 1 -- 172.21.15.87:0/4263006939 shutdown_connections 2024-05-08T05:27:31.474 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:30.765+0000 7f9113e00700 1 -- 172.21.15.87:0/4263006939 wait complete. 2024-05-08T05:27:31.483 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:27:31 smithi090 ceph-mon[34526]: from='client.? 172.21.15.87:0/2933041844' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-05-08T05:27:31.483 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:27:31 smithi090 ceph-mon[34526]: from='client.? 172.21.15.87:0/4263006939' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 11}]: dispatch 2024-05-08T05:27:31.538 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:27:31 smithi160 ceph-mon[34827]: from='client.? 172.21.15.87:0/2933041844' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-05-08T05:27:31.539 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:27:31 smithi160 ceph-mon[34827]: from='client.? 172.21.15.87:0/4263006939' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 11}]: dispatch 2024-05-08T05:27:32.208 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:27:32 smithi087 ceph-mon[29523]: pgmap v376: 97 pgs: 97 active+clean; 644 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 597 B/s wr, 5 op/s 2024-05-08T05:27:32.449 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:32.434+0000 7faee4600700 1 -- 172.21.15.87:0/4076009670 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7faedc06bf80 msgr2=0x7faedc06c3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:27:32.450 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:32.434+0000 7faee4600700 1 --2- 172.21.15.87:0/4076009670 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7faedc06bf80 0x7faedc06c3e0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7faec8009990 tx=0x7faec8009ca0 comp rx=0 tx=0).stop 2024-05-08T05:27:32.450 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:32.435+0000 7faee4600700 1 -- 172.21.15.87:0/4076009670 shutdown_connections 2024-05-08T05:27:32.450 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:32.435+0000 7faee4600700 1 --2- 172.21.15.87:0/4076009670 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7faedc105ed0 0x7faedc106360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:27:32.450 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:32.435+0000 7faee4600700 1 --2- 172.21.15.87:0/4076009670 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7faedc1083c0 0x7faedc06ba40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:27:32.450 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:32.435+0000 7faee4600700 1 --2- 172.21.15.87:0/4076009670 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7faedc06bf80 0x7faedc06c3e0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:27:32.450 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:32.435+0000 7faee4600700 1 -- 172.21.15.87:0/4076009670 >> 172.21.15.87:0/4076009670 conn(0x7faedc079310 msgr2=0x7faedc079720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:27:32.450 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:32.435+0000 7faee4600700 1 -- 172.21.15.87:0/4076009670 shutdown_connections 2024-05-08T05:27:32.450 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:32.435+0000 7faee4600700 1 -- 172.21.15.87:0/4076009670 wait complete. 2024-05-08T05:27:32.450 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:32.436+0000 7faee4600700 1 Processor -- start 2024-05-08T05:27:32.450 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:32.436+0000 7faee4600700 1 -- start start 2024-05-08T05:27:32.450 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:32.436+0000 7faee4600700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7faedc06bf80 0x7faedc1a0230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:27:32.451 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:32.436+0000 7faee4600700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7faedc105ed0 0x7faedc1a0770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:27:32.451 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:32.436+0000 7faee4600700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7faedc1083c0 0x7faedc1a4b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:27:32.451 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:32.436+0000 7faee4600700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7faedc119c60 con 0x7faedc1083c0 2024-05-08T05:27:32.451 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:32.436+0000 7faee4600700 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7faedc119ae0 con 0x7faedc06bf80 2024-05-08T05:27:32.451 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:32.436+0000 7faee4600700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7faedc119de0 con 0x7faedc105ed0 2024-05-08T05:27:32.451 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:32.437+0000 7faee1200700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7faedc105ed0 0x7faedc1a0770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:27:32.451 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:32.437+0000 7faee2600700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7faedc1083c0 0x7faedc1a4b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:27:32.451 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:32.437+0000 7faee1200700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7faedc105ed0 0x7faedc1a0770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.87:57654/0 (socket says 172.21.15.87:57654) 2024-05-08T05:27:32.451 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:32.437+0000 7faee1200700 1 -- 172.21.15.87:0/1366532382 learned_addr learned my addr 172.21.15.87:0/1366532382 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T05:27:32.451 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:32.437+0000 7faee1c00700 1 --2- 172.21.15.87:0/1366532382 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7faedc06bf80 0x7faedc1a0230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:27:32.451 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:32.437+0000 7faee1200700 1 -- 172.21.15.87:0/1366532382 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7faedc06bf80 msgr2=0x7faedc1a0230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:27:32.451 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:32.437+0000 7faee1200700 1 --2- 172.21.15.87:0/1366532382 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7faedc06bf80 0x7faedc1a0230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:27:32.451 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:32.437+0000 7faee1200700 1 -- 172.21.15.87:0/1366532382 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7faedc1083c0 msgr2=0x7faedc1a4b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:27:32.451 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:32.437+0000 7faee1200700 1 --2- 172.21.15.87:0/1366532382 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7faedc1083c0 0x7faedc1a4b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:27:32.451 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:32.437+0000 7faee1200700 1 -- 172.21.15.87:0/1366532382 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faedc1a5240 con 0x7faedc105ed0 2024-05-08T05:27:32.452 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:32.437+0000 7faee2600700 1 --2- 172.21.15.87:0/1366532382 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7faedc1083c0 0x7faedc1a4b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T05:27:32.452 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:32.437+0000 7faee1200700 1 --2- 172.21.15.87:0/1366532382 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7faedc105ed0 0x7faedc1a0770 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7faec8005910 tx=0x7faec800b670 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:27:32.452 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:32.438+0000 7faeda000700 1 -- 172.21.15.87:0/1366532382 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faec8027070 con 0x7faedc105ed0 2024-05-08T05:27:32.452 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:32.438+0000 7faeda000700 1 -- 172.21.15.87:0/1366532382 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7faec8022470 con 0x7faedc105ed0 2024-05-08T05:27:32.452 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:32.438+0000 7faeda000700 1 -- 172.21.15.87:0/1366532382 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faec8017650 con 0x7faedc105ed0 2024-05-08T05:27:32.452 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:32.438+0000 7faee4600700 1 -- 172.21.15.87:0/1366532382 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faedc1a54d0 con 0x7faedc105ed0 2024-05-08T05:27:32.452 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:32.438+0000 7faee4600700 1 -- 172.21.15.87:0/1366532382 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faedc1acdb0 con 0x7faedc105ed0 2024-05-08T05:27:32.452 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:32.439+0000 7faee4600700 1 -- 172.21.15.87:0/1366532382 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faedc06a190 con 0x7faedc105ed0 2024-05-08T05:27:32.452 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:32.441+0000 7faeda000700 1 -- 172.21.15.87:0/1366532382 <== mon.1 v2:172.21.15.160:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7faec802a070 con 0x7faedc105ed0 2024-05-08T05:27:32.452 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:32.443+0000 7faeda000700 1 --2- 172.21.15.87:0/1366532382 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7faec40b2900 0x7faec40b4dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:27:32.452 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:32.443+0000 7faeda000700 1 -- 172.21.15.87:0/1366532382 <== mon.1 v2:172.21.15.160:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8190+0+0 (secure 0 0 0) 0x7faec80e30c0 con 0x7faedc105ed0 2024-05-08T05:27:32.452 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:32.443+0000 7faee1c00700 1 --2- 172.21.15.87:0/1366532382 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7faec40b2900 0x7faec40b4dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:27:32.452 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:32.444+0000 7faee1c00700 1 --2- 172.21.15.87:0/1366532382 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7faec40b2900 0x7faec40b4dc0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7faed0009be0 tx=0x7faed0009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:27:32.452 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:32.445+0000 7faeda000700 1 -- 172.21.15.87:0/1366532382 <== mon.1 v2:172.21.15.160:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7faec8013070 con 0x7faedc105ed0 2024-05-08T05:27:32.483 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:27:32 smithi090 ceph-mon[34526]: pgmap v376: 97 pgs: 97 active+clean; 644 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 597 B/s wr, 5 op/s 2024-05-08T05:27:32.538 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:27:32 smithi160 ceph-mon[34827]: pgmap v376: 97 pgs: 97 active+clean; 644 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 597 B/s wr, 5 op/s 2024-05-08T05:27:32.686 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:32.684+0000 7faee4600700 1 -- 172.21.15.87:0/1366532382 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 8} v 0) -- 0x7faedc1acf80 con 0x7faedc105ed0 2024-05-08T05:27:32.686 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:32.685+0000 7faeda000700 1 -- 172.21.15.87:0/1366532382 <== mon.1 v2:172.21.15.160:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 8}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7faec80aae40 con 0x7faedc105ed0 2024-05-08T05:27:32.687 INFO:teuthology.orchestra.run.smithi087.stdout:231928234040 2024-05-08T05:27:32.689 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:32.688+0000 7faee4600700 1 -- 172.21.15.87:0/1366532382 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7faec40b2900 msgr2=0x7faec40b4dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:27:32.690 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:32.688+0000 7faee4600700 1 --2- 172.21.15.87:0/1366532382 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7faec40b2900 0x7faec40b4dc0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7faed0009be0 tx=0x7faed0009260 comp rx=0 tx=0).stop 2024-05-08T05:27:32.690 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:32.688+0000 7faee4600700 1 -- 172.21.15.87:0/1366532382 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7faedc105ed0 msgr2=0x7faedc1a0770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:27:32.690 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:32.688+0000 7faee4600700 1 --2- 172.21.15.87:0/1366532382 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7faedc105ed0 0x7faedc1a0770 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7faec8005910 tx=0x7faec800b670 comp rx=0 tx=0).stop 2024-05-08T05:27:32.690 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:32.689+0000 7faee4600700 1 -- 172.21.15.87:0/1366532382 shutdown_connections 2024-05-08T05:27:32.690 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:32.689+0000 7faee4600700 1 --2- 172.21.15.87:0/1366532382 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7faedc1083c0 0x7faedc1a4b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:27:32.690 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:32.689+0000 7faee4600700 1 --2- 172.21.15.87:0/1366532382 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7faedc06bf80 0x7faedc1a0230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:27:32.691 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:32.689+0000 7faee4600700 1 --2- 172.21.15.87:0/1366532382 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7faec40b2900 0x7faec40b4dc0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:27:32.691 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:32.689+0000 7faee4600700 1 --2- 172.21.15.87:0/1366532382 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7faedc105ed0 0x7faedc1a0770 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:27:32.691 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:32.689+0000 7faee4600700 1 -- 172.21.15.87:0/1366532382 >> 172.21.15.87:0/1366532382 conn(0x7faedc079310 msgr2=0x7faedc104eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:27:32.691 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:32.689+0000 7faee4600700 1 -- 172.21.15.87:0/1366532382 shutdown_connections 2024-05-08T05:27:32.691 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:32.689+0000 7faee4600700 1 -- 172.21.15.87:0/1366532382 wait complete. 2024-05-08T05:27:32.712 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:32.710+0000 7fb6c3e00700 1 -- 172.21.15.87:0/897549449 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb6bc108410 msgr2=0x7fb6bc1087f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:27:32.712 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:32.710+0000 7fb6c3e00700 1 --2- 172.21.15.87:0/897549449 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb6bc108410 0x7fb6bc1087f0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fb6b0009990 tx=0x7fb6b0009ca0 comp rx=0 tx=0).stop 2024-05-08T05:27:32.712 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:32.710+0000 7fb6c3e00700 1 -- 172.21.15.87:0/897549449 shutdown_connections 2024-05-08T05:27:32.712 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:32.710+0000 7fb6c3e00700 1 --2- 172.21.15.87:0/897549449 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb6bc102d60 0x7fb6bc10f250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:27:32.712 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:32.710+0000 7fb6c3e00700 1 --2- 172.21.15.87:0/897549449 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb6bc108410 0x7fb6bc1087f0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:27:32.712 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:32.710+0000 7fb6c3e00700 1 --2- 172.21.15.87:0/897549449 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb6bc1023a0 0x7fb6bc102820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:27:32.712 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:32.710+0000 7fb6c3e00700 1 -- 172.21.15.87:0/897549449 >> 172.21.15.87:0/897549449 conn(0x7fb6bc079350 msgr2=0x7fb6bc079760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:27:32.712 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:32.710+0000 7fb6c3e00700 1 -- 172.21.15.87:0/897549449 shutdown_connections 2024-05-08T05:27:32.712 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:32.710+0000 7fb6c3e00700 1 -- 172.21.15.87:0/897549449 wait complete. 2024-05-08T05:27:32.713 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:32.712+0000 7fb6c3e00700 1 Processor -- start 2024-05-08T05:27:32.713 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:32.712+0000 7fb6c3e00700 1 -- start start 2024-05-08T05:27:32.713 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:32.712+0000 7fb6c3e00700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb6bc1023a0 0x7fb6bc19f840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:27:32.713 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:32.712+0000 7fb6c3e00700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb6bc102d60 0x7fb6bc19fd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:27:32.713 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:32.712+0000 7fb6c3e00700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb6bc108410 0x7fb6bc199a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:27:32.714 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:32.712+0000 7fb6c3e00700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fb6bc1125b0 con 0x7fb6bc1023a0 2024-05-08T05:27:32.714 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:32.712+0000 7fb6c3e00700 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fb6bc112430 con 0x7fb6bc108410 2024-05-08T05:27:32.714 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:32.712+0000 7fb6c3e00700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7fb6bc112730 con 0x7fb6bc102d60 2024-05-08T05:27:32.715 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:32.712+0000 7fb6c1400700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb6bc1023a0 0x7fb6bc19f840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:27:32.715 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:32.713+0000 7fb6c1e00700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb6bc108410 0x7fb6bc199a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:27:32.715 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:32.713+0000 7fb6c1e00700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb6bc108410 0x7fb6bc199a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.87:37520/0 (socket says 172.21.15.87:37520) 2024-05-08T05:27:32.715 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:32.713+0000 7fb6c1400700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb6bc1023a0 0x7fb6bc19f840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:35164/0 (socket says 172.21.15.87:35164) 2024-05-08T05:27:32.715 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:32.713+0000 7fb6c1e00700 1 -- 172.21.15.87:0/3272990701 learned_addr learned my addr 172.21.15.87:0/3272990701 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T05:27:32.715 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:32.713+0000 7fb6c0a00700 1 --2- 172.21.15.87:0/3272990701 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb6bc102d60 0x7fb6bc19fd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:27:32.715 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:32.713+0000 7fb6c1400700 1 -- 172.21.15.87:0/3272990701 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb6bc102d60 msgr2=0x7fb6bc19fd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:27:32.715 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:32.713+0000 7fb6c1400700 1 --2- 172.21.15.87:0/3272990701 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb6bc102d60 0x7fb6bc19fd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:27:32.715 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:32.713+0000 7fb6c1400700 1 -- 172.21.15.87:0/3272990701 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb6bc108410 msgr2=0x7fb6bc199a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:27:32.715 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:32.713+0000 7fb6c1400700 1 --2- 172.21.15.87:0/3272990701 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb6bc108410 0x7fb6bc199a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:27:32.715 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:32.713+0000 7fb6c1400700 1 -- 172.21.15.87:0/3272990701 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb6bc19a160 con 0x7fb6bc1023a0 2024-05-08T05:27:32.715 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:32.713+0000 7fb6c1e00700 1 --2- 172.21.15.87:0/3272990701 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb6bc108410 0x7fb6bc199a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T05:27:32.715 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:32.713+0000 7fb6c0a00700 1 --2- 172.21.15.87:0/3272990701 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb6bc102d60 0x7fb6bc19fd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T05:27:32.715 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:32.713+0000 7fb6c1400700 1 --2- 172.21.15.87:0/3272990701 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb6bc1023a0 0x7fb6bc19f840 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fb6b00098e0 tx=0x7fb6b00047b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:27:32.716 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:32.714+0000 7fb6ba000700 1 -- 172.21.15.87:0/3272990701 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6b000fad0 con 0x7fb6bc1023a0 2024-05-08T05:27:32.716 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:32.714+0000 7fb6ba000700 1 -- 172.21.15.87:0/3272990701 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb6b0004ce0 con 0x7fb6bc1023a0 2024-05-08T05:27:32.716 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:32.714+0000 7fb6c3e00700 1 -- 172.21.15.87:0/3272990701 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb6bc19a3f0 con 0x7fb6bc1023a0 2024-05-08T05:27:32.716 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:32.714+0000 7fb6ba000700 1 -- 172.21.15.87:0/3272990701 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6b00053e0 con 0x7fb6bc1023a0 2024-05-08T05:27:32.716 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:32.714+0000 7fb6c3e00700 1 -- 172.21.15.87:0/3272990701 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb6bc1a6710 con 0x7fb6bc1023a0 2024-05-08T05:27:32.716 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:32.715+0000 7fb6c3e00700 1 -- 172.21.15.87:0/3272990701 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb6bc06a190 con 0x7fb6bc1023a0 2024-05-08T05:27:32.718 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:32.717+0000 7fb6ba000700 1 -- 172.21.15.87:0/3272990701 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7fb6b0009d10 con 0x7fb6bc1023a0 2024-05-08T05:27:32.720 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:32.719+0000 7fb6ba000700 1 --2- 172.21.15.87:0/3272990701 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7fb6a40b2880 0x7fb6a40b4d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:27:32.721 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:32.719+0000 7fb6ba000700 1 -- 172.21.15.87:0/3272990701 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8190+0+0 (secure 0 0 0) 0x7fb6b00e2d10 con 0x7fb6bc1023a0 2024-05-08T05:27:32.721 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:32.719+0000 7fb6c0a00700 1 --2- 172.21.15.87:0/3272990701 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7fb6a40b2880 0x7fb6a40b4d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:27:32.721 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:32.720+0000 7fb6c0a00700 1 --2- 172.21.15.87:0/3272990701 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7fb6a40b2880 0x7fb6a40b4d40 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fb6bc0798e0 tx=0x7fb6a8009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:27:32.726 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:32.725+0000 7fb6ba000700 1 -- 172.21.15.87:0/3272990701 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7fb6b00e8020 con 0x7fb6bc1023a0 2024-05-08T05:27:32.980 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:32.978+0000 7fb6c3e00700 1 -- 172.21.15.87:0/3272990701 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7fb6bc1a68e0 con 0x7fb6bc1023a0 2024-05-08T05:27:32.981 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:32.979+0000 7fb6ba000700 1 -- 172.21.15.87:0/3272990701 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7fb6b0013070 con 0x7fb6bc1023a0 2024-05-08T05:27:32.981 INFO:teuthology.orchestra.run.smithi087.stdout:107374182484 2024-05-08T05:27:32.984 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:32.982+0000 7fb6c3e00700 1 -- 172.21.15.87:0/3272990701 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7fb6a40b2880 msgr2=0x7fb6a40b4d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:27:32.985 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:32.982+0000 7fb6c3e00700 1 --2- 172.21.15.87:0/3272990701 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7fb6a40b2880 0x7fb6a40b4d40 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fb6bc0798e0 tx=0x7fb6a8009260 comp rx=0 tx=0).stop 2024-05-08T05:27:32.985 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:32.982+0000 7fb6c3e00700 1 -- 172.21.15.87:0/3272990701 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb6bc1023a0 msgr2=0x7fb6bc19f840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:27:32.985 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:32.982+0000 7fb6c3e00700 1 --2- 172.21.15.87:0/3272990701 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb6bc1023a0 0x7fb6bc19f840 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fb6b00098e0 tx=0x7fb6b00047b0 comp rx=0 tx=0).stop 2024-05-08T05:27:32.985 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:32.982+0000 7fb6c3e00700 1 -- 172.21.15.87:0/3272990701 shutdown_connections 2024-05-08T05:27:32.985 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:32.982+0000 7fb6c3e00700 1 --2- 172.21.15.87:0/3272990701 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb6bc108410 0x7fb6bc199a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:27:32.985 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:32.982+0000 7fb6c3e00700 1 --2- 172.21.15.87:0/3272990701 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb6bc1023a0 0x7fb6bc19f840 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:27:32.985 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:32.982+0000 7fb6c3e00700 1 --2- 172.21.15.87:0/3272990701 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7fb6a40b2880 0x7fb6a40b4d40 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:27:32.985 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:32.982+0000 7fb6c3e00700 1 --2- 172.21.15.87:0/3272990701 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb6bc102d60 0x7fb6bc19fd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:27:32.985 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:32.982+0000 7fb6c3e00700 1 -- 172.21.15.87:0/3272990701 >> 172.21.15.87:0/3272990701 conn(0x7fb6bc079350 msgr2=0x7fb6bc06b320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:27:32.985 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:32.983+0000 7fb6c3e00700 1 -- 172.21.15.87:0/3272990701 shutdown_connections 2024-05-08T05:27:32.985 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:32.983+0000 7fb6c3e00700 1 -- 172.21.15.87:0/3272990701 wait complete. 2024-05-08T05:27:33.272 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:27:33 smithi087 ceph-mon[29523]: from='client.? 172.21.15.87:0/1366532382' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 8}]: dispatch 2024-05-08T05:27:33.272 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:27:33 smithi087 ceph-mon[29523]: from='client.? 172.21.15.87:0/3272990701' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-05-08T05:27:33.483 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:27:33 smithi090 ceph-mon[34526]: from='client.? 172.21.15.87:0/1366532382' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 8}]: dispatch 2024-05-08T05:27:33.484 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:27:33 smithi090 ceph-mon[34526]: from='client.? 172.21.15.87:0/3272990701' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-05-08T05:27:33.538 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:27:33 smithi160 ceph-mon[34827]: from='client.? 172.21.15.87:0/1366532382' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 8}]: dispatch 2024-05-08T05:27:33.539 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:27:33 smithi160 ceph-mon[34827]: from='client.? 172.21.15.87:0/3272990701' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-05-08T05:27:34.278 INFO:tasks.cephadm.ceph_manager.ceph:need seq 309237645347 got 309237645351 for osd.11 2024-05-08T05:27:34.279 DEBUG:teuthology.parallel:result is None 2024-05-08T05:27:34.458 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:27:34 smithi087 ceph-mon[29523]: pgmap v377: 97 pgs: 97 active+clean; 644 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 597 B/s wr, 6 op/s 2024-05-08T05:27:34.458 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:27:34 smithi087 ceph-mon[29523]: from='client.? 172.21.15.87:0/842849225' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2024-05-08T05:27:34.483 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:27:34 smithi090 ceph-mon[34526]: pgmap v377: 97 pgs: 97 active+clean; 644 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 597 B/s wr, 6 op/s 2024-05-08T05:27:34.483 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:27:34 smithi090 ceph-mon[34526]: from='client.? 172.21.15.87:0/842849225' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2024-05-08T05:27:34.538 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:27:34 smithi160 ceph-mon[34827]: pgmap v377: 97 pgs: 97 active+clean; 644 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 597 B/s wr, 6 op/s 2024-05-08T05:27:34.539 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:27:34 smithi160 ceph-mon[34827]: from='client.? 172.21.15.87:0/842849225' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2024-05-08T05:27:34.630 INFO:tasks.cephadm.ceph_manager.ceph:need seq 154618822725 got 154618822730 for osd.5 2024-05-08T05:27:34.630 DEBUG:teuthology.parallel:result is None 2024-05-08T05:27:34.781 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:33.609+0000 7fd9d8a00700 1 -- 172.21.15.87:0/3062161389 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd9d410b6a0 msgr2=0x7fd9d410ba80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:27:34.782 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:33.609+0000 7fd9d8a00700 1 --2- 172.21.15.87:0/3062161389 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd9d410b6a0 0x7fd9d410ba80 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fd9c4009990 tx=0x7fd9c4009ca0 comp rx=0 tx=0).stop 2024-05-08T05:27:34.782 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:33.609+0000 7fd9d8a00700 1 -- 172.21.15.87:0/3062161389 shutdown_connections 2024-05-08T05:27:34.782 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:33.609+0000 7fd9d8a00700 1 --2- 172.21.15.87:0/3062161389 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd9d4106060 0x7fd9d4112570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:27:34.782 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:33.609+0000 7fd9d8a00700 1 --2- 172.21.15.87:0/3062161389 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd9d410b6a0 0x7fd9d410ba80 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:27:34.782 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:33.609+0000 7fd9d8a00700 1 --2- 172.21.15.87:0/3062161389 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd9d41056a0 0x7fd9d4105b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:27:34.782 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:33.609+0000 7fd9d8a00700 1 -- 172.21.15.87:0/3062161389 >> 172.21.15.87:0/3062161389 conn(0x7fd9d41011b0 msgr2=0x7fd9d41035d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:27:34.782 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:33.610+0000 7fd9d8a00700 1 -- 172.21.15.87:0/3062161389 shutdown_connections 2024-05-08T05:27:34.782 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:33.610+0000 7fd9d8a00700 1 -- 172.21.15.87:0/3062161389 wait complete. 2024-05-08T05:27:34.782 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:33.611+0000 7fd9d8a00700 1 Processor -- start 2024-05-08T05:27:34.782 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:33.611+0000 7fd9d8a00700 1 -- start start 2024-05-08T05:27:34.782 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:33.611+0000 7fd9d8a00700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd9d41056a0 0x7fd9d419bd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:27:34.783 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:33.611+0000 7fd9d8a00700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd9d4106060 0x7fd9d419c290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:27:34.783 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:33.612+0000 7fd9d8a00700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd9d410b6a0 0x7fd9d41a0620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:27:34.783 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:33.612+0000 7fd9d8a00700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fd9d41158e0 con 0x7fd9d41056a0 2024-05-08T05:27:34.783 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:33.612+0000 7fd9d8a00700 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fd9d4115760 con 0x7fd9d410b6a0 2024-05-08T05:27:34.783 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:33.612+0000 7fd9d8a00700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7fd9d4115a60 con 0x7fd9d4106060 2024-05-08T05:27:34.783 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:33.612+0000 7fd9d1e00700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd9d41056a0 0x7fd9d419bd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:27:34.783 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:33.612+0000 7fd9d1e00700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd9d41056a0 0x7fd9d419bd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:35178/0 (socket says 172.21.15.87:35178) 2024-05-08T05:27:34.783 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:33.612+0000 7fd9d1e00700 1 -- 172.21.15.87:0/842849225 learned_addr learned my addr 172.21.15.87:0/842849225 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T05:27:34.783 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:33.612+0000 7fd9d1400700 1 --2- 172.21.15.87:0/842849225 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd9d4106060 0x7fd9d419c290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:27:34.783 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:33.612+0000 7fd9d2800700 1 --2- 172.21.15.87:0/842849225 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd9d410b6a0 0x7fd9d41a0620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:27:34.783 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:33.612+0000 7fd9d1e00700 1 -- 172.21.15.87:0/842849225 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd9d4106060 msgr2=0x7fd9d419c290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:27:34.783 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:33.612+0000 7fd9d1e00700 1 --2- 172.21.15.87:0/842849225 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd9d4106060 0x7fd9d419c290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:27:34.783 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:33.612+0000 7fd9d1e00700 1 -- 172.21.15.87:0/842849225 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd9d410b6a0 msgr2=0x7fd9d41a0620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:27:34.784 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:33.612+0000 7fd9d1e00700 1 --2- 172.21.15.87:0/842849225 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd9d410b6a0 0x7fd9d41a0620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:27:34.784 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:33.612+0000 7fd9d1e00700 1 -- 172.21.15.87:0/842849225 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd9d41a0d60 con 0x7fd9d41056a0 2024-05-08T05:27:34.784 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:33.612+0000 7fd9d2800700 1 --2- 172.21.15.87:0/842849225 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd9d410b6a0 0x7fd9d41a0620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T05:27:34.784 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:33.613+0000 7fd9d1e00700 1 --2- 172.21.15.87:0/842849225 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd9d41056a0 0x7fd9d419bd50 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fd9c40057c0 tx=0x7fd9c4009580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:27:34.784 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:33.613+0000 7fd9caa00700 1 -- 172.21.15.87:0/842849225 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9c4026070 con 0x7fd9d41056a0 2024-05-08T05:27:34.784 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:33.613+0000 7fd9caa00700 1 -- 172.21.15.87:0/842849225 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd9c4021410 con 0x7fd9d41056a0 2024-05-08T05:27:34.784 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:33.613+0000 7fd9caa00700 1 -- 172.21.15.87:0/842849225 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9c4017650 con 0x7fd9d41056a0 2024-05-08T05:27:34.784 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:33.613+0000 7fd9d8a00700 1 -- 172.21.15.87:0/842849225 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd9d41a0ff0 con 0x7fd9d41056a0 2024-05-08T05:27:34.784 INFO:teuthology.orchestra.run.smithi087.stdout:206158430271 2024-05-08T05:27:34.785 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:33.613+0000 7fd9d8a00700 1 -- 172.21.15.87:0/842849225 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd9d41a88d0 con 0x7fd9d41056a0 2024-05-08T05:27:34.785 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:33.614+0000 7fd9d8a00700 1 -- 172.21.15.87:0/842849225 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd9d406a190 con 0x7fd9d41056a0 2024-05-08T05:27:34.785 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:33.616+0000 7fd9caa00700 1 -- 172.21.15.87:0/842849225 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7fd9c4029070 con 0x7fd9d41056a0 2024-05-08T05:27:34.785 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:33.618+0000 7fd9caa00700 1 --2- 172.21.15.87:0/842849225 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7fd9b80b2900 0x7fd9b80b4dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:27:34.785 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:33.618+0000 7fd9caa00700 1 -- 172.21.15.87:0/842849225 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8190+0+0 (secure 0 0 0) 0x7fd9c40e2f40 con 0x7fd9d41056a0 2024-05-08T05:27:34.785 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:33.618+0000 7fd9d1400700 1 --2- 172.21.15.87:0/842849225 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7fd9b80b2900 0x7fd9b80b4dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:27:34.785 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:33.619+0000 7fd9d1400700 1 --2- 172.21.15.87:0/842849225 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7fd9b80b2900 0x7fd9b80b4dc0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fd9c0009680 tx=0x7fd9c0009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:27:34.785 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:33.622+0000 7fd9caa00700 1 -- 172.21.15.87:0/842849225 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7fd9c4013070 con 0x7fd9d41056a0 2024-05-08T05:27:34.785 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:33.862+0000 7fd9d8a00700 1 -- 172.21.15.87:0/842849225 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7fd9d402e510 con 0x7fd9d41056a0 2024-05-08T05:27:34.785 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:33.863+0000 7fd9caa00700 1 -- 172.21.15.87:0/842849225 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7fd9c40aad50 con 0x7fd9d41056a0 2024-05-08T05:27:34.785 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:33.866+0000 7fd9d8a00700 1 -- 172.21.15.87:0/842849225 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7fd9b80b2900 msgr2=0x7fd9b80b4dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:27:34.785 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:33.866+0000 7fd9d8a00700 1 --2- 172.21.15.87:0/842849225 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7fd9b80b2900 0x7fd9b80b4dc0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fd9c0009680 tx=0x7fd9c0009260 comp rx=0 tx=0).stop 2024-05-08T05:27:34.786 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:33.866+0000 7fd9d8a00700 1 -- 172.21.15.87:0/842849225 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd9d41056a0 msgr2=0x7fd9d419bd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:27:34.786 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:33.866+0000 7fd9d8a00700 1 --2- 172.21.15.87:0/842849225 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd9d41056a0 0x7fd9d419bd50 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fd9c40057c0 tx=0x7fd9c4009580 comp rx=0 tx=0).stop 2024-05-08T05:27:34.786 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:33.866+0000 7fd9d8a00700 1 -- 172.21.15.87:0/842849225 shutdown_connections 2024-05-08T05:27:34.786 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:33.866+0000 7fd9d8a00700 1 --2- 172.21.15.87:0/842849225 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd9d410b6a0 0x7fd9d41a0620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:27:34.786 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:33.866+0000 7fd9d8a00700 1 --2- 172.21.15.87:0/842849225 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd9d41056a0 0x7fd9d419bd50 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:27:34.786 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:33.866+0000 7fd9d8a00700 1 --2- 172.21.15.87:0/842849225 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7fd9b80b2900 0x7fd9b80b4dc0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:27:34.786 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:33.866+0000 7fd9d8a00700 1 --2- 172.21.15.87:0/842849225 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd9d4106060 0x7fd9d419c290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:27:34.786 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:33.866+0000 7fd9d8a00700 1 -- 172.21.15.87:0/842849225 >> 172.21.15.87:0/842849225 conn(0x7fd9d41011b0 msgr2=0x7fd9d41018b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:27:34.786 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:33.867+0000 7fd9d8a00700 1 -- 172.21.15.87:0/842849225 shutdown_connections 2024-05-08T05:27:34.786 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:33.867+0000 7fd9d8a00700 1 -- 172.21.15.87:0/842849225 wait complete. 2024-05-08T05:27:35.402 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:27:35 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T05:27:35.459 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:27:35 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T05:27:35.460 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:27:35 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T05:27:35.893 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:35.892+0000 7fc6dce00700 1 -- 172.21.15.87:0/3689841826 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc6d80756d0 msgr2=0x7fc6d8075ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:27:35.893 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:35.892+0000 7fc6dce00700 1 --2- 172.21.15.87:0/3689841826 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc6d80756d0 0x7fc6d8075ab0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fc6c8009990 tx=0x7fc6c8009ca0 comp rx=0 tx=0).stop 2024-05-08T05:27:35.893 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:35.892+0000 7fc6dce00700 1 -- 172.21.15.87:0/3689841826 shutdown_connections 2024-05-08T05:27:35.893 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:35.892+0000 7fc6dce00700 1 --2- 172.21.15.87:0/3689841826 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc6d810fea0 0x7fc6d8112290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:27:35.893 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:35.892+0000 7fc6dce00700 1 --2- 172.21.15.87:0/3689841826 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc6d80756d0 0x7fc6d8075ab0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:27:35.893 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:35.892+0000 7fc6dce00700 1 --2- 172.21.15.87:0/3689841826 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc6d8075ff0 0x7fc6d810f960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:27:35.893 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:35.892+0000 7fc6dce00700 1 -- 172.21.15.87:0/3689841826 >> 172.21.15.87:0/3689841826 conn(0x7fc6d807a650 msgr2=0x7fc6d807aa60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:27:35.893 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:35.892+0000 7fc6dce00700 1 -- 172.21.15.87:0/3689841826 shutdown_connections 2024-05-08T05:27:35.893 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:35.892+0000 7fc6dce00700 1 -- 172.21.15.87:0/3689841826 wait complete. 2024-05-08T05:27:35.894 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:35.893+0000 7fc6dce00700 1 Processor -- start 2024-05-08T05:27:35.894 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:35.894+0000 7fc6dce00700 1 -- start start 2024-05-08T05:27:35.894 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:35.894+0000 7fc6dce00700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc6d80756d0 0x7fc6d819be00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:27:35.894 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:35.894+0000 7fc6dce00700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc6d8075ff0 0x7fc6d819c340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:27:35.895 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:35.894+0000 7fc6dce00700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc6d810fea0 0x7fc6d81a06d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:27:35.895 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:35.894+0000 7fc6dce00700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fc6d81158f0 con 0x7fc6d810fea0 2024-05-08T05:27:35.895 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:35.894+0000 7fc6dce00700 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fc6d8115770 con 0x7fc6d80756d0 2024-05-08T05:27:35.895 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:35.894+0000 7fc6dce00700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7fc6d8115a70 con 0x7fc6d8075ff0 2024-05-08T05:27:35.895 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:35.894+0000 7fc6d5e00700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc6d80756d0 0x7fc6d819be00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:27:35.896 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:35.894+0000 7fc6d5400700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc6d8075ff0 0x7fc6d819c340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:27:35.896 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:35.894+0000 7fc6d5e00700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc6d80756d0 0x7fc6d819be00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.87:53870/0 (socket says 172.21.15.87:53870) 2024-05-08T05:27:35.896 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:35.894+0000 7fc6d5e00700 1 -- 172.21.15.87:0/3685459612 learned_addr learned my addr 172.21.15.87:0/3685459612 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T05:27:35.896 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:35.895+0000 7fc6d6800700 1 --2- 172.21.15.87:0/3685459612 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc6d810fea0 0x7fc6d81a06d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:27:35.896 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:35.895+0000 7fc6d5e00700 1 -- 172.21.15.87:0/3685459612 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc6d8075ff0 msgr2=0x7fc6d819c340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:27:35.896 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:35.895+0000 7fc6d5e00700 1 --2- 172.21.15.87:0/3685459612 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc6d8075ff0 0x7fc6d819c340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:27:35.896 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:35.895+0000 7fc6d5e00700 1 -- 172.21.15.87:0/3685459612 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc6d810fea0 msgr2=0x7fc6d81a06d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:27:35.896 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:35.895+0000 7fc6d5e00700 1 --2- 172.21.15.87:0/3685459612 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc6d810fea0 0x7fc6d81a06d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:27:35.896 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:35.895+0000 7fc6d5e00700 1 -- 172.21.15.87:0/3685459612 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc6d81a0e10 con 0x7fc6d80756d0 2024-05-08T05:27:35.896 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:35.895+0000 7fc6d5400700 1 --2- 172.21.15.87:0/3685459612 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc6d8075ff0 0x7fc6d819c340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T05:27:35.896 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:35.895+0000 7fc6d6800700 1 --2- 172.21.15.87:0/3685459612 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc6d810fea0 0x7fc6d81a06d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T05:27:35.896 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:35.895+0000 7fc6d5e00700 1 --2- 172.21.15.87:0/3685459612 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc6d80756d0 0x7fc6d819be00 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fc6c8000c00 tx=0x7fc6c80057c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:27:35.897 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:35.895+0000 7fc6cea00700 1 -- 172.21.15.87:0/3685459612 <== mon.2 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6c8027070 con 0x7fc6d80756d0 2024-05-08T05:27:35.897 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:35.896+0000 7fc6cea00700 1 -- 172.21.15.87:0/3685459612 <== mon.2 v2:172.21.15.90:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc6c8022470 con 0x7fc6d80756d0 2024-05-08T05:27:35.897 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:35.896+0000 7fc6dce00700 1 -- 172.21.15.87:0/3685459612 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc6d81a10a0 con 0x7fc6d80756d0 2024-05-08T05:27:35.897 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:35.896+0000 7fc6cea00700 1 -- 172.21.15.87:0/3685459612 <== mon.2 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6c8017650 con 0x7fc6d80756d0 2024-05-08T05:27:35.897 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:35.896+0000 7fc6dce00700 1 -- 172.21.15.87:0/3685459612 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc6d81a8980 con 0x7fc6d80756d0 2024-05-08T05:27:35.897 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:35.897+0000 7fc6dce00700 1 -- 172.21.15.87:0/3685459612 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc6d806a190 con 0x7fc6d80756d0 2024-05-08T05:27:35.899 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:35.899+0000 7fc6cea00700 1 -- 172.21.15.87:0/3685459612 <== mon.2 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7fc6c802a070 con 0x7fc6d80756d0 2024-05-08T05:27:35.900 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:35.900+0000 7fc6cea00700 1 --2- 172.21.15.87:0/3685459612 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7fc6bc0b2880 0x7fc6bc0b4d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:27:35.901 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:35.901+0000 7fc6d5400700 1 --2- 172.21.15.87:0/3685459612 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7fc6bc0b2880 0x7fc6bc0b4d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:27:35.901 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:35.901+0000 7fc6cea00700 1 -- 172.21.15.87:0/3685459612 <== mon.2 v2:172.21.15.90:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8190+0+0 (secure 0 0 0) 0x7fc6c80e2ff0 con 0x7fc6d80756d0 2024-05-08T05:27:35.901 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:35.901+0000 7fc6d5400700 1 --2- 172.21.15.87:0/3685459612 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7fc6bc0b2880 0x7fc6bc0b4d40 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fc6d8103000 tx=0x7fc6c40073d0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:27:35.905 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:35.905+0000 7fc6cea00700 1 -- 172.21.15.87:0/3685459612 <== mon.2 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7fc6c8013070 con 0x7fc6d80756d0 2024-05-08T05:27:36.175 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:36.173+0000 7fc6dce00700 1 -- 172.21.15.87:0/3685459612 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7fc6d802e510 con 0x7fc6d80756d0 2024-05-08T05:27:36.175 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:36.174+0000 7fc6cea00700 1 -- 172.21.15.87:0/3685459612 <== mon.2 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fc6c80aad70 con 0x7fc6d80756d0 2024-05-08T05:27:36.175 INFO:teuthology.orchestra.run.smithi087.stdout:34359738470 2024-05-08T05:27:36.178 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:36.178+0000 7fc6dce00700 1 -- 172.21.15.87:0/3685459612 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7fc6bc0b2880 msgr2=0x7fc6bc0b4d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:27:36.179 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:36.178+0000 7fc6dce00700 1 --2- 172.21.15.87:0/3685459612 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7fc6bc0b2880 0x7fc6bc0b4d40 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fc6d8103000 tx=0x7fc6c40073d0 comp rx=0 tx=0).stop 2024-05-08T05:27:36.179 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:36.178+0000 7fc6dce00700 1 -- 172.21.15.87:0/3685459612 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc6d80756d0 msgr2=0x7fc6d819be00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:27:36.179 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:36.178+0000 7fc6dce00700 1 --2- 172.21.15.87:0/3685459612 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc6d80756d0 0x7fc6d819be00 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fc6c8000c00 tx=0x7fc6c80057c0 comp rx=0 tx=0).stop 2024-05-08T05:27:36.179 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:36.178+0000 7fc6dce00700 1 -- 172.21.15.87:0/3685459612 shutdown_connections 2024-05-08T05:27:36.179 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:36.178+0000 7fc6dce00700 1 --2- 172.21.15.87:0/3685459612 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc6d810fea0 0x7fc6d81a06d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:27:36.179 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:36.178+0000 7fc6dce00700 1 --2- 172.21.15.87:0/3685459612 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc6d80756d0 0x7fc6d819be00 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:27:36.179 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:36.178+0000 7fc6dce00700 1 --2- 172.21.15.87:0/3685459612 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7fc6bc0b2880 0x7fc6bc0b4d40 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:27:36.179 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:36.178+0000 7fc6dce00700 1 --2- 172.21.15.87:0/3685459612 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc6d8075ff0 0x7fc6d819c340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:27:36.179 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:36.178+0000 7fc6dce00700 1 -- 172.21.15.87:0/3685459612 >> 172.21.15.87:0/3685459612 conn(0x7fc6d807a650 msgr2=0x7fc6d81006b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:27:36.179 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:36.178+0000 7fc6dce00700 1 -- 172.21.15.87:0/3685459612 shutdown_connections 2024-05-08T05:27:36.179 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:36.178+0000 7fc6dce00700 1 -- 172.21.15.87:0/3685459612 wait complete. 2024-05-08T05:27:36.541 INFO:tasks.cephadm.ceph_manager.ceph:need seq 206158430266 got 206158430271 for osd.7 2024-05-08T05:27:36.541 DEBUG:teuthology.parallel:result is None 2024-05-08T05:27:36.737 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:27:36 smithi087 ceph-mon[29523]: pgmap v378: 97 pgs: 97 active+clean; 644 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 597 B/s wr, 7 op/s 2024-05-08T05:27:36.738 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:27:36 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:27:36.738 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:27:36 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:27:36.738 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:27:36 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:27:36.738 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:27:36 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:27:36.738 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:27:36 smithi087 ceph-mon[29523]: from='client.? 172.21.15.87:0/3685459612' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-05-08T05:27:36.738 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:27:36 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:27:36.738 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:27:36 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:27:36.983 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:27:36 smithi090 ceph-mon[34526]: pgmap v378: 97 pgs: 97 active+clean; 644 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 597 B/s wr, 7 op/s 2024-05-08T05:27:36.984 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:27:36 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:27:36.984 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:27:36 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:27:36.984 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:27:36 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:27:36.984 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:27:36 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:27:36.984 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:27:36 smithi090 ceph-mon[34526]: from='client.? 172.21.15.87:0/3685459612' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-05-08T05:27:36.984 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:27:36 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:27:36.984 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:27:36 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:27:37.038 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:27:36 smithi160 ceph-mon[34827]: pgmap v378: 97 pgs: 97 active+clean; 644 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 597 B/s wr, 7 op/s 2024-05-08T05:27:37.038 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:27:36 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:27:37.039 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:27:36 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:27:37.039 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:27:36 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:27:37.039 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:27:36 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:27:37.039 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:27:36 smithi160 ceph-mon[34827]: from='client.? 172.21.15.87:0/3685459612' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-05-08T05:27:37.039 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:27:36 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:27:37.039 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:27:36 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:27:37.107 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:37.106+0000 7fd032c00700 1 -- 172.21.15.87:0/1084273828 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd02c108850 msgr2=0x7fd02c1103d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:27:37.107 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:37.106+0000 7fd032c00700 1 --2- 172.21.15.87:0/1084273828 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd02c108850 0x7fd02c1103d0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fd024009fc0 tx=0x7fd02400b330 comp rx=0 tx=0).stop 2024-05-08T05:27:37.107 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:37.106+0000 7fd032c00700 1 -- 172.21.15.87:0/1084273828 shutdown_connections 2024-05-08T05:27:37.107 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:37.106+0000 7fd032c00700 1 --2- 172.21.15.87:0/1084273828 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd02c108850 0x7fd02c1103d0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:27:37.107 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:37.106+0000 7fd032c00700 1 --2- 172.21.15.87:0/1084273828 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd02c103750 0x7fd02c103b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:27:37.107 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:37.106+0000 7fd032c00700 1 --2- 172.21.15.87:0/1084273828 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd02c104100 0x7fd02c108120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:27:37.107 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:37.106+0000 7fd032c00700 1 -- 172.21.15.87:0/1084273828 >> 172.21.15.87:0/1084273828 conn(0x7fd02c07a600 msgr2=0x7fd02c07aa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:27:37.107 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:37.106+0000 7fd032c00700 1 -- 172.21.15.87:0/1084273828 shutdown_connections 2024-05-08T05:27:37.108 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:37.106+0000 7fd032c00700 1 -- 172.21.15.87:0/1084273828 wait complete. 2024-05-08T05:27:37.109 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:37.107+0000 7fd032c00700 1 Processor -- start 2024-05-08T05:27:37.109 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:37.107+0000 7fd032c00700 1 -- start start 2024-05-08T05:27:37.109 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:37.108+0000 7fd032c00700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd02c103750 0x7fd02c0757a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:27:37.109 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:37.108+0000 7fd032c00700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd02c104100 0x7fd02c075ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:27:37.109 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:37.108+0000 7fd032c00700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd02c108850 0x7fd02c076220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:27:37.109 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:37.108+0000 7fd032c00700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fd02c113690 con 0x7fd02c104100 2024-05-08T05:27:37.109 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:37.108+0000 7fd032c00700 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fd02c113510 con 0x7fd02c108850 2024-05-08T05:27:37.110 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:37.108+0000 7fd032c00700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7fd02c113810 con 0x7fd02c103750 2024-05-08T05:27:37.110 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:37.108+0000 7fd02be00700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd02c103750 0x7fd02c0757a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:27:37.110 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:37.108+0000 7fd02b400700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd02c104100 0x7fd02c075ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:27:37.110 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:37.108+0000 7fd02be00700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd02c103750 0x7fd02c0757a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.87:39654/0 (socket says 172.21.15.87:39654) 2024-05-08T05:27:37.110 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:37.108+0000 7fd02be00700 1 -- 172.21.15.87:0/3116099963 learned_addr learned my addr 172.21.15.87:0/3116099963 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T05:27:37.110 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:37.108+0000 7fd030c00700 1 --2- 172.21.15.87:0/3116099963 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd02c108850 0x7fd02c076220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:27:37.110 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:37.109+0000 7fd030c00700 1 -- 172.21.15.87:0/3116099963 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd02c103750 msgr2=0x7fd02c0757a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:27:37.110 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:37.109+0000 7fd030c00700 1 --2- 172.21.15.87:0/3116099963 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd02c103750 0x7fd02c0757a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:27:37.110 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:37.109+0000 7fd030c00700 1 -- 172.21.15.87:0/3116099963 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd02c104100 msgr2=0x7fd02c075ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:27:37.110 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:37.109+0000 7fd030c00700 1 --2- 172.21.15.87:0/3116099963 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd02c104100 0x7fd02c075ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:27:37.110 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:37.109+0000 7fd030c00700 1 -- 172.21.15.87:0/3116099963 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd02c1a8030 con 0x7fd02c108850 2024-05-08T05:27:37.110 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:37.109+0000 7fd030c00700 1 --2- 172.21.15.87:0/3116099963 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd02c108850 0x7fd02c076220 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fd02400b6c0 tx=0x7fd02400cc30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:27:37.111 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:37.109+0000 7fd028c00700 1 -- 172.21.15.87:0/3116099963 <== mon.2 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd024021070 con 0x7fd02c108850 2024-05-08T05:27:37.111 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:37.109+0000 7fd028c00700 1 -- 172.21.15.87:0/3116099963 <== mon.2 v2:172.21.15.90:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd024007ac0 con 0x7fd02c108850 2024-05-08T05:27:37.111 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:37.109+0000 7fd028c00700 1 -- 172.21.15.87:0/3116099963 <== mon.2 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd024005040 con 0x7fd02c108850 2024-05-08T05:27:37.111 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:37.109+0000 7fd032c00700 1 -- 172.21.15.87:0/3116099963 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd02c1a82c0 con 0x7fd02c108850 2024-05-08T05:27:37.111 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:37.109+0000 7fd032c00700 1 -- 172.21.15.87:0/3116099963 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd02c1a8720 con 0x7fd02c108850 2024-05-08T05:27:37.112 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:37.111+0000 7fd032c00700 1 -- 172.21.15.87:0/3116099963 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd02c06a190 con 0x7fd02c108850 2024-05-08T05:27:37.113 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:37.113+0000 7fd028c00700 1 -- 172.21.15.87:0/3116099963 <== mon.2 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7fd024024070 con 0x7fd02c108850 2024-05-08T05:27:37.115 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:37.114+0000 7fd028c00700 1 --2- 172.21.15.87:0/3116099963 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7fd0100b2900 0x7fd0100b4dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:27:37.115 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:37.115+0000 7fd028c00700 1 -- 172.21.15.87:0/3116099963 <== mon.2 v2:172.21.15.90:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8190+0+0 (secure 0 0 0) 0x7fd02400f020 con 0x7fd02c108850 2024-05-08T05:27:37.115 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:37.115+0000 7fd02be00700 1 --2- 172.21.15.87:0/3116099963 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7fd0100b2900 0x7fd0100b4dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:27:37.115 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:37.115+0000 7fd02be00700 1 --2- 172.21.15.87:0/3116099963 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7fd0100b2900 0x7fd0100b4dc0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fd01c005950 tx=0x7fd01c009310 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:27:37.118 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:37.118+0000 7fd028c00700 1 -- 172.21.15.87:0/3116099963 <== mon.2 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7fd02402b020 con 0x7fd02c108850 2024-05-08T05:27:37.357 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:37.356+0000 7fd032c00700 1 -- 172.21.15.87:0/3116099963 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7fd02c02e6d0 con 0x7fd02c108850 2024-05-08T05:27:37.357 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:37.357+0000 7fd028c00700 1 -- 172.21.15.87:0/3116099963 <== mon.2 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fd0240ab1c0 con 0x7fd02c108850 2024-05-08T05:27:37.357 INFO:teuthology.orchestra.run.smithi087.stdout:55834574946 2024-05-08T05:27:37.361 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:37.360+0000 7fd032c00700 1 -- 172.21.15.87:0/3116099963 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7fd0100b2900 msgr2=0x7fd0100b4dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:27:37.361 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:37.360+0000 7fd032c00700 1 --2- 172.21.15.87:0/3116099963 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7fd0100b2900 0x7fd0100b4dc0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fd01c005950 tx=0x7fd01c009310 comp rx=0 tx=0).stop 2024-05-08T05:27:37.361 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:37.360+0000 7fd032c00700 1 -- 172.21.15.87:0/3116099963 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd02c108850 msgr2=0x7fd02c076220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:27:37.361 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:37.360+0000 7fd032c00700 1 --2- 172.21.15.87:0/3116099963 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd02c108850 0x7fd02c076220 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fd02400b6c0 tx=0x7fd02400cc30 comp rx=0 tx=0).stop 2024-05-08T05:27:37.361 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:37.360+0000 7fd032c00700 1 -- 172.21.15.87:0/3116099963 shutdown_connections 2024-05-08T05:27:37.361 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:37.360+0000 7fd032c00700 1 --2- 172.21.15.87:0/3116099963 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd02c108850 0x7fd02c076220 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:27:37.361 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:37.360+0000 7fd032c00700 1 --2- 172.21.15.87:0/3116099963 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7fd0100b2900 0x7fd0100b4dc0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:27:37.361 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:37.360+0000 7fd032c00700 1 --2- 172.21.15.87:0/3116099963 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd02c103750 0x7fd02c0757a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:27:37.361 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:37.360+0000 7fd032c00700 1 --2- 172.21.15.87:0/3116099963 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd02c104100 0x7fd02c075ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:27:37.361 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:37.360+0000 7fd032c00700 1 -- 172.21.15.87:0/3116099963 >> 172.21.15.87:0/3116099963 conn(0x7fd02c07a600 msgr2=0x7fd02c101740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:27:37.361 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:37.360+0000 7fd032c00700 1 -- 172.21.15.87:0/3116099963 shutdown_connections 2024-05-08T05:27:37.362 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:37.360+0000 7fd032c00700 1 -- 172.21.15.87:0/3116099963 wait complete. 2024-05-08T05:27:37.477 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:36.998+0000 7f08d4e00700 1 -- 172.21.15.87:0/150934695 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f08d0109460 msgr2=0x7f08d0109840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:27:37.477 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:36.998+0000 7f08d4e00700 1 --2- 172.21.15.87:0/150934695 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f08d0109460 0x7f08d0109840 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f08c0009990 tx=0x7f08c0009ca0 comp rx=0 tx=0).stop 2024-05-08T05:27:37.477 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:36.998+0000 7f08d4e00700 1 -- 172.21.15.87:0/150934695 shutdown_connections 2024-05-08T05:27:37.477 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:36.998+0000 7f08d4e00700 1 --2- 172.21.15.87:0/150934695 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f08d0103d90 0x7f08d01102a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:27:37.477 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:36.998+0000 7f08d4e00700 1 --2- 172.21.15.87:0/150934695 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f08d0109460 0x7f08d0109840 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:27:37.477 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:36.998+0000 7f08d4e00700 1 --2- 172.21.15.87:0/150934695 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f08d01033d0 0x7f08d0103850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:27:37.477 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:36.998+0000 7f08d4e00700 1 -- 172.21.15.87:0/150934695 >> 172.21.15.87:0/150934695 conn(0x7f08d00fef20 msgr2=0x7f08d0101340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:27:37.477 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:36.998+0000 7f08d4e00700 1 -- 172.21.15.87:0/150934695 shutdown_connections 2024-05-08T05:27:37.477 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:36.998+0000 7f08d4e00700 1 -- 172.21.15.87:0/150934695 wait complete. 2024-05-08T05:27:37.477 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:37.000+0000 7f08d4e00700 1 Processor -- start 2024-05-08T05:27:37.477 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:37.000+0000 7f08d4e00700 1 -- start start 2024-05-08T05:27:37.478 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:37.001+0000 7f08d4e00700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f08d01033d0 0x7f08d019f6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:27:37.478 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:37.001+0000 7f08d4e00700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f08d0103d90 0x7f08d019fbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:27:37.478 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:37.001+0000 7f08d4e00700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f08d0109460 0x7f08d0199870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:27:37.478 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:37.001+0000 7f08d4e00700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f08d0113570 con 0x7f08d01033d0 2024-05-08T05:27:37.478 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:37.001+0000 7f08d4e00700 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f08d01133f0 con 0x7f08d0103d90 2024-05-08T05:27:37.478 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:37.001+0000 7f08d4e00700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f08d01136f0 con 0x7f08d0109460 2024-05-08T05:27:37.478 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:37.001+0000 7f08cf400700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f08d01033d0 0x7f08d019f6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:27:37.478 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:37.001+0000 7f08cf400700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f08d01033d0 0x7f08d019f6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:34438/0 (socket says 172.21.15.87:34438) 2024-05-08T05:27:37.478 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:37.001+0000 7f08cf400700 1 -- 172.21.15.87:0/2245057092 learned_addr learned my addr 172.21.15.87:0/2245057092 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T05:27:37.478 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:37.001+0000 7f08cfe00700 1 --2- 172.21.15.87:0/2245057092 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f08d0109460 0x7f08d0199870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:27:37.478 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:37.001+0000 7f08cea00700 1 --2- 172.21.15.87:0/2245057092 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f08d0103d90 0x7f08d019fbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:27:37.478 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:37.001+0000 7f08cf400700 1 -- 172.21.15.87:0/2245057092 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f08d0109460 msgr2=0x7f08d0199870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:27:37.478 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:37.001+0000 7f08cf400700 1 --2- 172.21.15.87:0/2245057092 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f08d0109460 0x7f08d0199870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:27:37.479 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:37.001+0000 7f08cf400700 1 -- 172.21.15.87:0/2245057092 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f08d0103d90 msgr2=0x7f08d019fbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:27:37.479 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:37.001+0000 7f08cf400700 1 --2- 172.21.15.87:0/2245057092 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f08d0103d90 0x7f08d019fbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:27:37.479 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:37.001+0000 7f08cf400700 1 -- 172.21.15.87:0/2245057092 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f08d0199fd0 con 0x7f08d01033d0 2024-05-08T05:27:37.480 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:37.002+0000 7f08cf400700 1 --2- 172.21.15.87:0/2245057092 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f08d01033d0 0x7f08d019f6b0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f08c00057f0 tx=0x7f08c000bfd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:27:37.480 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:37.002+0000 7f08c7e00700 1 -- 172.21.15.87:0/2245057092 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08c0026070 con 0x7f08d01033d0 2024-05-08T05:27:37.480 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:37.002+0000 7f08c7e00700 1 -- 172.21.15.87:0/2245057092 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f08c0021410 con 0x7f08d01033d0 2024-05-08T05:27:37.480 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:37.002+0000 7f08d4e00700 1 -- 172.21.15.87:0/2245057092 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f08d019a260 con 0x7f08d01033d0 2024-05-08T05:27:37.480 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:37.002+0000 7f08c7e00700 1 -- 172.21.15.87:0/2245057092 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08c0017650 con 0x7f08d01033d0 2024-05-08T05:27:37.480 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:37.002+0000 7f08d4e00700 1 -- 172.21.15.87:0/2245057092 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f08d01a6580 con 0x7f08d01033d0 2024-05-08T05:27:37.481 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:37.003+0000 7f08d4e00700 1 -- 172.21.15.87:0/2245057092 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f08d010b960 con 0x7f08d01033d0 2024-05-08T05:27:37.481 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:37.007+0000 7f08c7e00700 1 -- 172.21.15.87:0/2245057092 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7f08c0029070 con 0x7f08d01033d0 2024-05-08T05:27:37.481 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:37.009+0000 7f08c7e00700 1 --2- 172.21.15.87:0/2245057092 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f08b40b2900 0x7f08b40b4dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:27:37.481 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:37.009+0000 7f08c7e00700 1 -- 172.21.15.87:0/2245057092 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8190+0+0 (secure 0 0 0) 0x7f08c00e2ff0 con 0x7f08d01033d0 2024-05-08T05:27:37.481 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:37.009+0000 7f08cea00700 1 --2- 172.21.15.87:0/2245057092 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f08b40b2900 0x7f08b40b4dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:27:37.481 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:37.009+0000 7f08cea00700 1 --2- 172.21.15.87:0/2245057092 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f08b40b2900 0x7f08b40b4dc0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f08d01015a0 tx=0x7f08bc009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:27:37.481 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:37.012+0000 7f08c7e00700 1 -- 172.21.15.87:0/2245057092 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f08c0030080 con 0x7f08d01033d0 2024-05-08T05:27:37.481 INFO:teuthology.orchestra.run.smithi087.stdout:257698037811 2024-05-08T05:27:37.482 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:37.277+0000 7f08d4e00700 1 -- 172.21.15.87:0/2245057092 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 9} v 0) -- 0x7f08d019ada0 con 0x7f08d01033d0 2024-05-08T05:27:37.482 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:37.278+0000 7f08c7e00700 1 -- 172.21.15.87:0/2245057092 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 9}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f08c0013070 con 0x7f08d01033d0 2024-05-08T05:27:37.482 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:37.281+0000 7f08d4e00700 1 -- 172.21.15.87:0/2245057092 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f08b40b2900 msgr2=0x7f08b40b4dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:27:37.482 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:37.281+0000 7f08d4e00700 1 --2- 172.21.15.87:0/2245057092 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f08b40b2900 0x7f08b40b4dc0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f08d01015a0 tx=0x7f08bc009260 comp rx=0 tx=0).stop 2024-05-08T05:27:37.482 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:37.281+0000 7f08d4e00700 1 -- 172.21.15.87:0/2245057092 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f08d01033d0 msgr2=0x7f08d019f6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:27:37.482 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:37.281+0000 7f08d4e00700 1 --2- 172.21.15.87:0/2245057092 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f08d01033d0 0x7f08d019f6b0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f08c00057f0 tx=0x7f08c000bfd0 comp rx=0 tx=0).stop 2024-05-08T05:27:37.482 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:37.281+0000 7f08d4e00700 1 -- 172.21.15.87:0/2245057092 shutdown_connections 2024-05-08T05:27:37.482 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:37.281+0000 7f08d4e00700 1 --2- 172.21.15.87:0/2245057092 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f08b40b2900 0x7f08b40b4dc0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:27:37.482 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:37.281+0000 7f08d4e00700 1 --2- 172.21.15.87:0/2245057092 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f08d0109460 0x7f08d0199870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:27:37.482 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:37.281+0000 7f08d4e00700 1 --2- 172.21.15.87:0/2245057092 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f08d01033d0 0x7f08d019f6b0 secure :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f08c00057f0 tx=0x7f08c000bfd0 comp rx=0 tx=0).stop 2024-05-08T05:27:37.483 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:37.281+0000 7f08d4e00700 1 --2- 172.21.15.87:0/2245057092 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f08d0103d90 0x7f08d019fbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:27:37.483 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:37.281+0000 7f08d4e00700 1 -- 172.21.15.87:0/2245057092 >> 172.21.15.87:0/2245057092 conn(0x7f08d00fef20 msgr2=0x7f08d00ff730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:27:37.483 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:37.282+0000 7f08d4e00700 1 -- 172.21.15.87:0/2245057092 shutdown_connections 2024-05-08T05:27:37.483 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:37.282+0000 7f08d4e00700 1 -- 172.21.15.87:0/2245057092 wait complete. 2024-05-08T05:27:37.878 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:27:37 smithi087 ceph-mon[29523]: from='client.? 172.21.15.87:0/2245057092' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 9}]: dispatch 2024-05-08T05:27:37.878 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:27:37 smithi087 ceph-mon[29523]: from='client.? 172.21.15.87:0/3116099963' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-05-08T05:27:37.983 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:27:37 smithi090 ceph-mon[34526]: from='client.? 172.21.15.87:0/2245057092' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 9}]: dispatch 2024-05-08T05:27:37.983 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:27:37 smithi090 ceph-mon[34526]: from='client.? 172.21.15.87:0/3116099963' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-05-08T05:27:38.038 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:27:37 smithi160 ceph-mon[34827]: from='client.? 172.21.15.87:0/2245057092' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 9}]: dispatch 2024-05-08T05:27:38.039 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:27:37 smithi160 ceph-mon[34827]: from='client.? 172.21.15.87:0/3116099963' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-05-08T05:27:38.116 INFO:tasks.cephadm.ceph_manager.ceph:need seq 34359738466 got 34359738470 for osd.0 2024-05-08T05:27:38.116 DEBUG:teuthology.parallel:result is None 2024-05-08T05:27:38.564 INFO:tasks.cephadm.ceph_manager.ceph:need seq 231928234036 got 231928234040 for osd.8 2024-05-08T05:27:38.564 DEBUG:teuthology.parallel:result is None 2024-05-08T05:27:38.958 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:27:38 smithi087 ceph-mon[29523]: pgmap v379: 97 pgs: 97 active+clean; 644 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 170 B/s wr, 5 op/s 2024-05-08T05:27:38.983 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:27:38 smithi090 ceph-mon[34526]: pgmap v379: 97 pgs: 97 active+clean; 644 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 170 B/s wr, 5 op/s 2024-05-08T05:27:39.038 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:27:38 smithi160 ceph-mon[34827]: pgmap v379: 97 pgs: 97 active+clean; 644 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 170 B/s wr, 5 op/s 2024-05-08T05:27:39.154 INFO:teuthology.orchestra.run.smithi087.stderr:Inferring config /var/lib/ceph/eeeb813e-0cf9-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T05:27:39.511 INFO:tasks.cephadm.ceph_manager.ceph:need seq 55834574939 got 55834574946 for osd.1 2024-05-08T05:27:39.511 DEBUG:teuthology.parallel:result is None 2024-05-08T05:27:39.933 INFO:tasks.cephadm.ceph_manager.ceph:need seq 107374182478 got 107374182484 for osd.3 2024-05-08T05:27:39.933 DEBUG:teuthology.parallel:result is None 2024-05-08T05:27:40.433 INFO:teuthology.orchestra.run.smithi087.stderr:Inferring config /var/lib/ceph/eeeb813e-0cf9-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T05:27:40.461 INFO:tasks.cephadm.ceph_manager.ceph:need seq 257698037807 got 257698037811 for osd.9 2024-05-08T05:27:40.461 DEBUG:teuthology.parallel:result is None 2024-05-08T05:27:40.666 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:27:40 smithi087 ceph-mon[29523]: pgmap v380: 97 pgs: 97 active+clean; 644 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 170 B/s wr, 7 op/s 2024-05-08T05:27:40.983 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:27:40 smithi090 ceph-mon[34526]: pgmap v380: 97 pgs: 97 active+clean; 644 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 170 B/s wr, 7 op/s 2024-05-08T05:27:41.038 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:27:40 smithi160 ceph-mon[34827]: pgmap v380: 97 pgs: 97 active+clean; 644 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 170 B/s wr, 7 op/s 2024-05-08T05:27:42.855 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:42.854+0000 7f7f53000700 1 -- 172.21.15.87:0/2099220289 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7f4c10e8b0 msgr2=0x7f7f4c10ec90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:27:42.856 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:42.854+0000 7f7f53000700 1 --2- 172.21.15.87:0/2099220289 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7f4c10e8b0 0x7f7f4c10ec90 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f7f40009990 tx=0x7f7f40009ca0 comp rx=0 tx=0).stop 2024-05-08T05:27:42.856 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:42.855+0000 7f7f53000700 1 -- 172.21.15.87:0/2099220289 shutdown_connections 2024-05-08T05:27:42.856 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:42.855+0000 7f7f53000700 1 --2- 172.21.15.87:0/2099220289 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7f4c10a3a0 0x7f7f4c116840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:27:42.856 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:42.855+0000 7f7f53000700 1 --2- 172.21.15.87:0/2099220289 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7f4c10e8b0 0x7f7f4c10ec90 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:27:42.856 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:42.855+0000 7f7f53000700 1 --2- 172.21.15.87:0/2099220289 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7f4c1099e0 0x7f7f4c109e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:27:42.856 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:42.855+0000 7f7f53000700 1 -- 172.21.15.87:0/2099220289 >> 172.21.15.87:0/2099220289 conn(0x7f7f4c079230 msgr2=0x7f7f4c1082c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:27:42.856 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:42.855+0000 7f7f53000700 1 -- 172.21.15.87:0/2099220289 shutdown_connections 2024-05-08T05:27:42.856 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:27:42 smithi087 ceph-mon[29523]: pgmap v381: 97 pgs: 97 active+clean; 644 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T05:27:42.858 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:42.855+0000 7f7f53000700 1 -- 172.21.15.87:0/2099220289 wait complete. 2024-05-08T05:27:42.859 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:42.856+0000 7f7f53000700 1 Processor -- start 2024-05-08T05:27:42.859 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:42.856+0000 7f7f53000700 1 -- start start 2024-05-08T05:27:42.859 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:42.856+0000 7f7f53000700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7f4c1099e0 0x7f7f4c1a0190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:27:42.859 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:42.856+0000 7f7f53000700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7f4c10a3a0 0x7f7f4c1a06d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:27:42.859 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:42.856+0000 7f7f53000700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7f4c10e8b0 0x7f7f4c1a4a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:27:42.859 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:42.856+0000 7f7f53000700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f7f4c119bd0 con 0x7f7f4c10a3a0 2024-05-08T05:27:42.859 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:42.856+0000 7f7f53000700 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f7f4c119a50 con 0x7f7f4c10e8b0 2024-05-08T05:27:42.859 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:42.856+0000 7f7f53000700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f7f4c119d50 con 0x7f7f4c1099e0 2024-05-08T05:27:42.859 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:42.857+0000 7f7f51200700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7f4c10a3a0 0x7f7f4c1a06d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:27:42.859 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:42.857+0000 7f7f51200700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7f4c10a3a0 0x7f7f4c1a06d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:34488/0 (socket says 172.21.15.87:34488) 2024-05-08T05:27:42.859 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:42.857+0000 7f7f51c00700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7f4c1099e0 0x7f7f4c1a0190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:27:42.859 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:42.857+0000 7f7f51200700 1 -- 172.21.15.87:0/584421672 learned_addr learned my addr 172.21.15.87:0/584421672 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T05:27:42.859 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:42.857+0000 7f7f52600700 1 --2- 172.21.15.87:0/584421672 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7f4c10e8b0 0x7f7f4c1a4a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:27:42.860 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:42.857+0000 7f7f51200700 1 -- 172.21.15.87:0/584421672 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7f4c1099e0 msgr2=0x7f7f4c1a0190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:27:42.860 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:42.857+0000 7f7f51200700 1 --2- 172.21.15.87:0/584421672 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7f4c1099e0 0x7f7f4c1a0190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:27:42.860 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:42.857+0000 7f7f51200700 1 -- 172.21.15.87:0/584421672 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7f4c10e8b0 msgr2=0x7f7f4c1a4a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:27:42.860 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:42.857+0000 7f7f51200700 1 --2- 172.21.15.87:0/584421672 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7f4c10e8b0 0x7f7f4c1a4a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:27:42.860 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:42.857+0000 7f7f51200700 1 -- 172.21.15.87:0/584421672 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7f4c1a51a0 con 0x7f7f4c10a3a0 2024-05-08T05:27:42.860 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:42.857+0000 7f7f52600700 1 --2- 172.21.15.87:0/584421672 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7f4c10e8b0 0x7f7f4c1a4a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T05:27:42.860 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:42.858+0000 7f7f51200700 1 --2- 172.21.15.87:0/584421672 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7f4c10a3a0 0x7f7f4c1a06d0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f7f3800e9a0 tx=0x7f7f3800ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:27:42.860 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:42.858+0000 7f7f4a000700 1 -- 172.21.15.87:0/584421672 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f3800c9c0 con 0x7f7f4c10a3a0 2024-05-08T05:27:42.860 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:42.858+0000 7f7f4a000700 1 -- 172.21.15.87:0/584421672 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7f3800cb60 con 0x7f7f4c10a3a0 2024-05-08T05:27:42.860 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:42.858+0000 7f7f53000700 1 -- 172.21.15.87:0/584421672 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7f4c1a5490 con 0x7f7f4c10a3a0 2024-05-08T05:27:42.860 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:42.858+0000 7f7f4a000700 1 -- 172.21.15.87:0/584421672 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f38018680 con 0x7f7f4c10a3a0 2024-05-08T05:27:42.860 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:42.858+0000 7f7f53000700 1 -- 172.21.15.87:0/584421672 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7f4c1acd10 con 0x7f7f4c10a3a0 2024-05-08T05:27:42.861 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:42.859+0000 7f7f53000700 1 -- 172.21.15.87:0/584421672 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7f4c06a190 con 0x7f7f4c10a3a0 2024-05-08T05:27:42.862 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:42.862+0000 7f7f4a000700 1 -- 172.21.15.87:0/584421672 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7f7f38010430 con 0x7f7f4c10a3a0 2024-05-08T05:27:42.864 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:42.864+0000 7f7f4a000700 1 --2- 172.21.15.87:0/584421672 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f7f340b2880 0x7f7f340b4d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:27:42.865 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:42.865+0000 7f7f51c00700 1 --2- 172.21.15.87:0/584421672 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f7f340b2880 0x7f7f340b4d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:27:42.865 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:42.865+0000 7f7f4a000700 1 -- 172.21.15.87:0/584421672 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8190+0+0 (secure 0 0 0) 0x7f7f380e2820 con 0x7f7f4c10a3a0 2024-05-08T05:27:42.865 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:42.865+0000 7f7f51c00700 1 --2- 172.21.15.87:0/584421672 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f7f340b2880 0x7f7f340b4d40 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f7f40006010 tx=0x7f7f4000b260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:27:42.868 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:42.868+0000 7f7f4a000700 1 -- 172.21.15.87:0/584421672 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f7f380aa510 con 0x7f7f4c10a3a0 2024-05-08T05:27:42.983 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:27:42 smithi090 ceph-mon[34526]: pgmap v381: 97 pgs: 97 active+clean; 644 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T05:27:43.039 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:27:42 smithi160 ceph-mon[34827]: pgmap v381: 97 pgs: 97 active+clean; 644 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T05:27:43.105 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:43.105+0000 7f7f53000700 1 -- 172.21.15.87:0/584421672 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7f7f4c02e510 con 0x7f7f4c10a3a0 2024-05-08T05:27:43.106 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:43.105+0000 7f7f4a000700 1 -- 172.21.15.87:0/584421672 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f7f380a9e10 con 0x7f7f4c10a3a0 2024-05-08T05:27:43.106 INFO:teuthology.orchestra.run.smithi087.stdout:133143986258 2024-05-08T05:27:43.109 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:43.108+0000 7f7f53000700 1 -- 172.21.15.87:0/584421672 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f7f340b2880 msgr2=0x7f7f340b4d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:27:43.109 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:43.108+0000 7f7f53000700 1 --2- 172.21.15.87:0/584421672 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f7f340b2880 0x7f7f340b4d40 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f7f40006010 tx=0x7f7f4000b260 comp rx=0 tx=0).stop 2024-05-08T05:27:43.109 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:43.108+0000 7f7f53000700 1 -- 172.21.15.87:0/584421672 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7f4c10a3a0 msgr2=0x7f7f4c1a06d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:27:43.109 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:43.108+0000 7f7f53000700 1 --2- 172.21.15.87:0/584421672 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7f4c10a3a0 0x7f7f4c1a06d0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f7f3800e9a0 tx=0x7f7f3800ecb0 comp rx=0 tx=0).stop 2024-05-08T05:27:43.109 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:43.109+0000 7f7f53000700 1 -- 172.21.15.87:0/584421672 shutdown_connections 2024-05-08T05:27:43.110 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:43.109+0000 7f7f53000700 1 --2- 172.21.15.87:0/584421672 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7f4c10e8b0 0x7f7f4c1a4a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:27:43.110 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:43.109+0000 7f7f53000700 1 --2- 172.21.15.87:0/584421672 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f7f340b2880 0x7f7f340b4d40 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:27:43.110 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:43.109+0000 7f7f53000700 1 --2- 172.21.15.87:0/584421672 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7f4c1099e0 0x7f7f4c1a0190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:27:43.110 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:43.109+0000 7f7f53000700 1 --2- 172.21.15.87:0/584421672 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7f4c10a3a0 0x7f7f4c1a06d0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:27:43.110 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:43.109+0000 7f7f53000700 1 -- 172.21.15.87:0/584421672 >> 172.21.15.87:0/584421672 conn(0x7f7f4c079230 msgr2=0x7f7f4c079950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:27:43.110 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:43.109+0000 7f7f53000700 1 -- 172.21.15.87:0/584421672 shutdown_connections 2024-05-08T05:27:43.110 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:43.109+0000 7f7f53000700 1 -- 172.21.15.87:0/584421672 wait complete. 2024-05-08T05:27:43.915 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:27:43 smithi087 ceph-mon[29523]: from='client.? 172.21.15.87:0/584421672' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-05-08T05:27:43.977 INFO:tasks.cephadm.ceph_manager.ceph:need seq 133143986253 got 133143986258 for osd.4 2024-05-08T05:27:43.978 DEBUG:teuthology.parallel:result is None 2024-05-08T05:27:43.983 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:27:43 smithi090 ceph-mon[34526]: from='client.? 172.21.15.87:0/584421672' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-05-08T05:27:44.038 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:27:43 smithi160 ceph-mon[34827]: from='client.? 172.21.15.87:0/584421672' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-05-08T05:27:44.896 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:27:44 smithi087 ceph-mon[29523]: pgmap v382: 97 pgs: 97 active+clean; 644 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-05-08T05:27:44.983 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:27:44 smithi090 ceph-mon[34526]: pgmap v382: 97 pgs: 97 active+clean; 644 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-05-08T05:27:45.038 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:27:44 smithi160 ceph-mon[34827]: pgmap v382: 97 pgs: 97 active+clean; 644 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-05-08T05:27:45.053 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:45.053+0000 7f8cd4e00700 1 -- 172.21.15.87:0/544388622 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8cd00756d0 msgr2=0x7f8cd0075ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:27:45.054 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:45.053+0000 7f8cd4e00700 1 --2- 172.21.15.87:0/544388622 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8cd00756d0 0x7f8cd0075ab0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f8cc00098f0 tx=0x7f8cc0009c00 comp rx=0 tx=0).stop 2024-05-08T05:27:45.054 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:45.053+0000 7f8cd4e00700 1 -- 172.21.15.87:0/544388622 shutdown_connections 2024-05-08T05:27:45.054 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:45.053+0000 7f8cd4e00700 1 --2- 172.21.15.87:0/544388622 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8cd010fea0 0x7f8cd0112290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:27:45.054 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:45.053+0000 7f8cd4e00700 1 --2- 172.21.15.87:0/544388622 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8cd00756d0 0x7f8cd0075ab0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:27:45.054 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:45.053+0000 7f8cd4e00700 1 --2- 172.21.15.87:0/544388622 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f8cd0075ff0 0x7f8cd010f960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:27:45.054 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:45.053+0000 7f8cd4e00700 1 -- 172.21.15.87:0/544388622 >> 172.21.15.87:0/544388622 conn(0x7f8cd007a600 msgr2=0x7f8cd007aa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:27:45.054 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:45.053+0000 7f8cd4e00700 1 -- 172.21.15.87:0/544388622 shutdown_connections 2024-05-08T05:27:45.054 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:45.053+0000 7f8cd4e00700 1 -- 172.21.15.87:0/544388622 wait complete. 2024-05-08T05:27:45.055 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:45.054+0000 7f8cd4e00700 1 Processor -- start 2024-05-08T05:27:45.055 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:45.054+0000 7f8cd4e00700 1 -- start start 2024-05-08T05:27:45.055 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:45.055+0000 7f8cd4e00700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f8cd00756d0 0x7f8cd019bd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:27:45.055 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:45.055+0000 7f8cd4e00700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8cd0075ff0 0x7f8cd019c2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:27:45.056 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:45.055+0000 7f8cd4e00700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8cd010fea0 0x7f8cd01a0610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:27:45.056 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:45.055+0000 7f8cd4e00700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f8cd0115880 con 0x7f8cd0075ff0 2024-05-08T05:27:45.056 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:45.055+0000 7f8cd4e00700 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f8cd0115700 con 0x7f8cd010fea0 2024-05-08T05:27:45.056 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:45.055+0000 7f8cd4e00700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f8cd0115a00 con 0x7f8cd00756d0 2024-05-08T05:27:45.056 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:45.055+0000 7f8ccde00700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f8cd00756d0 0x7f8cd019bd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:27:45.056 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:45.055+0000 7f8ccde00700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f8cd00756d0 0x7f8cd019bd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.87:39700/0 (socket says 172.21.15.87:39700) 2024-05-08T05:27:45.056 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:45.055+0000 7f8ccde00700 1 -- 172.21.15.87:0/698302099 learned_addr learned my addr 172.21.15.87:0/698302099 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T05:27:45.056 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:45.055+0000 7f8cce800700 1 --2- 172.21.15.87:0/698302099 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8cd010fea0 0x7f8cd01a0610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:27:45.057 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:45.056+0000 7f8ccde00700 1 -- 172.21.15.87:0/698302099 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8cd010fea0 msgr2=0x7f8cd01a0610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:27:45.057 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:45.056+0000 7f8ccde00700 1 --2- 172.21.15.87:0/698302099 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8cd010fea0 0x7f8cd01a0610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:27:45.057 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:45.056+0000 7f8ccde00700 1 -- 172.21.15.87:0/698302099 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8cd0075ff0 msgr2=0x7f8cd019c2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:27:45.057 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:45.056+0000 7f8ccde00700 1 --2- 172.21.15.87:0/698302099 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8cd0075ff0 0x7f8cd019c2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:27:45.057 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:45.056+0000 7f8ccde00700 1 -- 172.21.15.87:0/698302099 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8cd01a0d50 con 0x7f8cd00756d0 2024-05-08T05:27:45.057 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:45.056+0000 7f8cce800700 1 --2- 172.21.15.87:0/698302099 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8cd010fea0 0x7f8cd01a0610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T05:27:45.057 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:45.056+0000 7f8ccde00700 1 --2- 172.21.15.87:0/698302099 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f8cd00756d0 0x7f8cd019bd90 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f8cc0009230 tx=0x7f8cc0005040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:27:45.057 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:45.056+0000 7f8cc6a00700 1 -- 172.21.15.87:0/698302099 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8cc0027070 con 0x7f8cd00756d0 2024-05-08T05:27:45.058 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:45.056+0000 7f8cc6a00700 1 -- 172.21.15.87:0/698302099 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8cc000b560 con 0x7f8cd00756d0 2024-05-08T05:27:45.058 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:45.056+0000 7f8cd4e00700 1 -- 172.21.15.87:0/698302099 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8cd01a0fe0 con 0x7f8cd00756d0 2024-05-08T05:27:45.058 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:45.057+0000 7f8cc6a00700 1 -- 172.21.15.87:0/698302099 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8cc0004b00 con 0x7f8cd00756d0 2024-05-08T05:27:45.058 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:45.057+0000 7f8cd4e00700 1 -- 172.21.15.87:0/698302099 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8cd01a88c0 con 0x7f8cd00756d0 2024-05-08T05:27:45.058 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:45.058+0000 7f8cd4e00700 1 -- 172.21.15.87:0/698302099 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8cd006a190 con 0x7f8cd00756d0 2024-05-08T05:27:45.060 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:45.060+0000 7f8cc6a00700 1 -- 172.21.15.87:0/698302099 <== mon.1 v2:172.21.15.160:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7f8cc002a070 con 0x7f8cd00756d0 2024-05-08T05:27:45.062 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:45.061+0000 7f8cc6a00700 1 --2- 172.21.15.87:0/698302099 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f8cb40b2900 0x7f8cb40b4dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:27:45.062 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:45.062+0000 7f8cc6a00700 1 -- 172.21.15.87:0/698302099 <== mon.1 v2:172.21.15.160:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8190+0+0 (secure 0 0 0) 0x7f8cc00e3450 con 0x7f8cd00756d0 2024-05-08T05:27:45.062 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:45.062+0000 7f8ccd400700 1 --2- 172.21.15.87:0/698302099 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f8cb40b2900 0x7f8cb40b4dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:27:45.063 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:45.063+0000 7f8ccd400700 1 --2- 172.21.15.87:0/698302099 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f8cb40b2900 0x7f8cb40b4dc0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f8cd0111b60 tx=0x7f8cbc0096f0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:27:45.064 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:45.064+0000 7f8cc6a00700 1 -- 172.21.15.87:0/698302099 <== mon.1 v2:172.21.15.160:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f8cc0031070 con 0x7f8cd00756d0 2024-05-08T05:27:45.315 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:45.314+0000 7f8cd4e00700 1 -- 172.21.15.87:0/698302099 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 10} v 0) -- 0x7f8cd002e510 con 0x7f8cd00756d0 2024-05-08T05:27:45.315 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:45.315+0000 7f8cc6a00700 1 -- 172.21.15.87:0/698302099 <== mon.1 v2:172.21.15.160:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 10}]=0 v0) ==== 75+0+13 (secure 0 0 0) 0x7f8cc0013030 con 0x7f8cd00756d0 2024-05-08T05:27:45.316 INFO:teuthology.orchestra.run.smithi087.stdout:283467841584 2024-05-08T05:27:45.319 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:45.318+0000 7f8cd4e00700 1 -- 172.21.15.87:0/698302099 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f8cb40b2900 msgr2=0x7f8cb40b4dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:27:45.319 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:45.318+0000 7f8cd4e00700 1 --2- 172.21.15.87:0/698302099 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f8cb40b2900 0x7f8cb40b4dc0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f8cd0111b60 tx=0x7f8cbc0096f0 comp rx=0 tx=0).stop 2024-05-08T05:27:45.319 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:45.318+0000 7f8cd4e00700 1 -- 172.21.15.87:0/698302099 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f8cd00756d0 msgr2=0x7f8cd019bd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:27:45.319 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:45.318+0000 7f8cd4e00700 1 --2- 172.21.15.87:0/698302099 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f8cd00756d0 0x7f8cd019bd90 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f8cc0009230 tx=0x7f8cc0005040 comp rx=0 tx=0).stop 2024-05-08T05:27:45.319 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:45.318+0000 7f8cd4e00700 1 -- 172.21.15.87:0/698302099 shutdown_connections 2024-05-08T05:27:45.319 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:45.318+0000 7f8cd4e00700 1 --2- 172.21.15.87:0/698302099 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8cd010fea0 0x7f8cd01a0610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:27:45.319 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:45.318+0000 7f8cd4e00700 1 --2- 172.21.15.87:0/698302099 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f8cb40b2900 0x7f8cb40b4dc0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:27:45.319 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:45.318+0000 7f8cd4e00700 1 --2- 172.21.15.87:0/698302099 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f8cd00756d0 0x7f8cd019bd90 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:27:45.320 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:45.318+0000 7f8cd4e00700 1 --2- 172.21.15.87:0/698302099 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8cd0075ff0 0x7f8cd019c2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:27:45.320 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:45.318+0000 7f8cd4e00700 1 -- 172.21.15.87:0/698302099 >> 172.21.15.87:0/698302099 conn(0x7f8cd007a600 msgr2=0x7f8cd01006b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:27:45.320 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:45.318+0000 7f8cd4e00700 1 -- 172.21.15.87:0/698302099 shutdown_connections 2024-05-08T05:27:45.320 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:45.318+0000 7f8cd4e00700 1 -- 172.21.15.87:0/698302099 wait complete. 2024-05-08T05:27:46.144 INFO:tasks.cephadm.ceph_manager.ceph:need seq 283467841579 got 283467841584 for osd.10 2024-05-08T05:27:46.144 DEBUG:teuthology.parallel:result is None 2024-05-08T05:27:46.144 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2024-05-08T05:27:46.145 DEBUG:teuthology.orchestra.run.smithi087:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid eeeb813e-0cf9-11ef-bc97-c7b262605968 -- ceph pg dump --format=json 2024-05-08T05:27:46.458 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:27:46 smithi087 ceph-mon[29523]: pgmap v383: 97 pgs: 97 active+clean; 644 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-05-08T05:27:46.458 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:27:46 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:27:46.458 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:27:46 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:27:46.458 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:27:46 smithi087 ceph-mon[29523]: from='client.? 172.21.15.87:0/698302099' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 10}]: dispatch 2024-05-08T05:27:46.483 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:27:46 smithi090 ceph-mon[34526]: pgmap v383: 97 pgs: 97 active+clean; 644 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-05-08T05:27:46.483 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:27:46 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:27:46.483 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:27:46 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:27:46.484 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:27:46 smithi090 ceph-mon[34526]: from='client.? 172.21.15.87:0/698302099' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 10}]: dispatch 2024-05-08T05:27:46.538 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:27:46 smithi160 ceph-mon[34827]: pgmap v383: 97 pgs: 97 active+clean; 644 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-05-08T05:27:46.538 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:27:46 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:27:46.538 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:27:46 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:27:46.539 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:27:46 smithi160 ceph-mon[34827]: from='client.? 172.21.15.87:0/698302099' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 10}]: dispatch 2024-05-08T05:27:46.594 INFO:teuthology.orchestra.run.smithi087.stderr:Inferring config /var/lib/ceph/eeeb813e-0cf9-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T05:27:47.459 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:27:47 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T05:27:47.459 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:27:47 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T05:27:47.459 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:27:47 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:27:47.483 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:27:47 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T05:27:47.484 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:27:47 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T05:27:47.484 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:27:47 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:27:47.539 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:27:47 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T05:27:47.539 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:27:47 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T05:27:47.539 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:27:47 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:27:48.589 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:48.588+0000 7f4c3d000700 1 -- 172.21.15.87:0/3343548765 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4c38106080 msgr2=0x7f4c38112590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:27:48.589 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:48.588+0000 7f4c3d000700 1 --2- 172.21.15.87:0/3343548765 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4c38106080 0x7f4c38112590 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f4c3000b0a0 tx=0x7f4c3000b3b0 comp rx=0 tx=0).stop 2024-05-08T05:27:48.589 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:48.588+0000 7f4c3d000700 1 -- 172.21.15.87:0/3343548765 shutdown_connections 2024-05-08T05:27:48.590 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:48.588+0000 7f4c3d000700 1 --2- 172.21.15.87:0/3343548765 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4c38106080 0x7f4c38112590 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:27:48.590 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:48.588+0000 7f4c3d000700 1 --2- 172.21.15.87:0/3343548765 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4c3810b6c0 0x7f4c3810baa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:27:48.590 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:48.588+0000 7f4c3d000700 1 --2- 172.21.15.87:0/3343548765 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4c381056c0 0x7f4c38105b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:27:48.590 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:48.588+0000 7f4c3d000700 1 -- 172.21.15.87:0/3343548765 >> 172.21.15.87:0/3343548765 conn(0x7f4c381011b0 msgr2=0x7f4c381035d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:27:48.590 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:48.588+0000 7f4c3d000700 1 -- 172.21.15.87:0/3343548765 shutdown_connections 2024-05-08T05:27:48.590 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:48.588+0000 7f4c3d000700 1 -- 172.21.15.87:0/3343548765 wait complete. 2024-05-08T05:27:48.590 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:48.589+0000 7f4c3d000700 1 Processor -- start 2024-05-08T05:27:48.590 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:48.589+0000 7f4c3d000700 1 -- start start 2024-05-08T05:27:48.591 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:48.590+0000 7f4c3d000700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4c381056c0 0x7f4c381a1930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:27:48.592 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:48.590+0000 7f4c3d000700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4c38106080 0x7f4c381a1e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:27:48.592 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:48.590+0000 7f4c3d000700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4c3810b6c0 0x7f4c3819bb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:27:48.592 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:48.590+0000 7f4c3d000700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f4c38115900 con 0x7f4c381056c0 2024-05-08T05:27:48.592 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:48.590+0000 7f4c3d000700 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f4c38115780 con 0x7f4c38106080 2024-05-08T05:27:48.592 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:48.590+0000 7f4c3d000700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f4c38115a80 con 0x7f4c3810b6c0 2024-05-08T05:27:48.592 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:48.590+0000 7f4c35e00700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4c381056c0 0x7f4c381a1930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:27:48.592 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:48.590+0000 7f4c35e00700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4c381056c0 0x7f4c381a1930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:37396/0 (socket says 172.21.15.87:37396) 2024-05-08T05:27:48.592 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:48.590+0000 7f4c35e00700 1 -- 172.21.15.87:0/2832527722 learned_addr learned my addr 172.21.15.87:0/2832527722 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T05:27:48.592 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:48.590+0000 7f4c35400700 1 --2- 172.21.15.87:0/2832527722 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4c38106080 0x7f4c381a1e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:27:48.592 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:48.590+0000 7f4c36800700 1 --2- 172.21.15.87:0/2832527722 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4c3810b6c0 0x7f4c3819bb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:27:48.592 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:48.590+0000 7f4c35e00700 1 -- 172.21.15.87:0/2832527722 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4c3810b6c0 msgr2=0x7f4c3819bb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:27:48.592 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:48.590+0000 7f4c35e00700 1 --2- 172.21.15.87:0/2832527722 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4c3810b6c0 0x7f4c3819bb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:27:48.592 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:48.590+0000 7f4c35e00700 1 -- 172.21.15.87:0/2832527722 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4c38106080 msgr2=0x7f4c381a1e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:27:48.593 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:48.590+0000 7f4c35e00700 1 --2- 172.21.15.87:0/2832527722 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4c38106080 0x7f4c381a1e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:27:48.593 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:48.591+0000 7f4c35e00700 1 -- 172.21.15.87:0/2832527722 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4c3819c2a0 con 0x7f4c381056c0 2024-05-08T05:27:48.593 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:48.591+0000 7f4c35e00700 1 --2- 172.21.15.87:0/2832527722 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4c381056c0 0x7f4c381a1930 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f4c2800d980 tx=0x7f4c2800dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:27:48.593 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:48.591+0000 7f4c2ea00700 1 -- 172.21.15.87:0/2832527722 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c28016070 con 0x7f4c381056c0 2024-05-08T05:27:48.593 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:48.591+0000 7f4c2ea00700 1 -- 172.21.15.87:0/2832527722 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4c28004830 con 0x7f4c381056c0 2024-05-08T05:27:48.593 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:48.591+0000 7f4c2ea00700 1 -- 172.21.15.87:0/2832527722 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c28005540 con 0x7f4c381056c0 2024-05-08T05:27:48.593 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:48.591+0000 7f4c3d000700 1 -- 172.21.15.87:0/2832527722 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4c3819c590 con 0x7f4c381056c0 2024-05-08T05:27:48.593 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:48.591+0000 7f4c3d000700 1 -- 172.21.15.87:0/2832527722 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4c381a8800 con 0x7f4c381056c0 2024-05-08T05:27:48.594 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:48.592+0000 7f4c3d000700 1 -- 172.21.15.87:0/2832527722 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4c3806a190 con 0x7f4c381056c0 2024-05-08T05:27:48.595 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:48.595+0000 7f4c2ea00700 1 -- 172.21.15.87:0/2832527722 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7f4c28004220 con 0x7f4c381056c0 2024-05-08T05:27:48.597 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:48.597+0000 7f4c2ea00700 1 --2- 172.21.15.87:0/2832527722 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f4c1c0b2900 0x7f4c1c0b4dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:27:48.598 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:48.597+0000 7f4c2ea00700 1 -- 172.21.15.87:0/2832527722 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8190+0+0 (secure 0 0 0) 0x7f4c280e1f20 con 0x7f4c381056c0 2024-05-08T05:27:48.598 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:48.597+0000 7f4c35400700 1 --2- 172.21.15.87:0/2832527722 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f4c1c0b2900 0x7f4c1c0b4dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:27:48.598 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:48.598+0000 7f4c35400700 1 --2- 172.21.15.87:0/2832527722 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f4c1c0b2900 0x7f4c1c0b4dc0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f4c38103860 tx=0x7f4c24009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:27:48.602 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:48.602+0000 7f4c2ea00700 1 -- 172.21.15.87:0/2832527722 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f4c2801f020 con 0x7f4c381056c0 2024-05-08T05:27:48.708 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:27:48 smithi087 ceph-mon[29523]: pgmap v384: 97 pgs: 97 active+clean; 644 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T05:27:48.826 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:48.825+0000 7f4c3d000700 1 -- 172.21.15.87:0/2832527722 --> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f4c380638e0 con 0x7f4c1c0b2900 2024-05-08T05:27:48.840 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:48.839+0000 7f4c2ea00700 1 -- 172.21.15.87:0/2832527722 <== mgr.14152 v2:172.21.15.87:6800/1189186457 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258804 (secure 0 0 0) 0x7f4c380638e0 con 0x7f4c1c0b2900 2024-05-08T05:27:48.841 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-05-08T05:27:48.847 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:48.846+0000 7f4c3d000700 1 -- 172.21.15.87:0/2832527722 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f4c1c0b2900 msgr2=0x7f4c1c0b4dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:27:48.847 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:48.846+0000 7f4c3d000700 1 --2- 172.21.15.87:0/2832527722 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f4c1c0b2900 0x7f4c1c0b4dc0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f4c38103860 tx=0x7f4c24009260 comp rx=0 tx=0).stop 2024-05-08T05:27:48.847 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:48.846+0000 7f4c3d000700 1 -- 172.21.15.87:0/2832527722 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4c381056c0 msgr2=0x7f4c381a1930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:27:48.847 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:48.846+0000 7f4c3d000700 1 --2- 172.21.15.87:0/2832527722 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4c381056c0 0x7f4c381a1930 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f4c2800d980 tx=0x7f4c2800dc90 comp rx=0 tx=0).stop 2024-05-08T05:27:48.848 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:48.846+0000 7f4c3d000700 1 -- 172.21.15.87:0/2832527722 shutdown_connections 2024-05-08T05:27:48.848 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:48.846+0000 7f4c3d000700 1 --2- 172.21.15.87:0/2832527722 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f4c1c0b2900 0x7f4c1c0b4dc0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:27:48.848 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:48.846+0000 7f4c3d000700 1 --2- 172.21.15.87:0/2832527722 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4c3810b6c0 0x7f4c3819bb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:27:48.848 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:48.846+0000 7f4c3d000700 1 --2- 172.21.15.87:0/2832527722 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4c381056c0 0x7f4c381a1930 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:27:48.848 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:48.846+0000 7f4c3d000700 1 --2- 172.21.15.87:0/2832527722 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4c38106080 0x7f4c381a1e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:27:48.848 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:48.846+0000 7f4c3d000700 1 -- 172.21.15.87:0/2832527722 >> 172.21.15.87:0/2832527722 conn(0x7f4c381011b0 msgr2=0x7f4c381019e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:27:48.848 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:48.846+0000 7f4c3d000700 1 -- 172.21.15.87:0/2832527722 shutdown_connections 2024-05-08T05:27:48.848 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:48.846+0000 7f4c3d000700 1 -- 172.21.15.87:0/2832527722 wait complete. 2024-05-08T05:27:48.848 INFO:teuthology.orchestra.run.smithi087.stderr:dumped all 2024-05-08T05:27:48.983 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:27:48 smithi090 ceph-mon[34526]: pgmap v384: 97 pgs: 97 active+clean; 644 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T05:27:49.038 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:27:48 smithi160 ceph-mon[34827]: pgmap v384: 97 pgs: 97 active+clean; 644 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T05:27:49.624 INFO:teuthology.orchestra.run.smithi087.stdout:{"pg_ready":true,"pg_map":{"version":384,"stamp":"2024-05-08T05:27:46.940648+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":659735,"num_objects":64,"num_object_clones":0,"num_object_copies":192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":755,"num_read_kb":478,"num_write":300,"num_write_kb":2274,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":13,"num_bytes_recovered":2951840,"num_keys_recovered":10,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":744,"ondisk_log_size":744,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":382504,"kb_used_data":12552,"kb_used_omap":18,"kb_used_meta":369837,"kb_avail":1124559320,"statfs":{"total":1151940427776,"available":1151548743680,"internally_reserved":0,"allocated":12853248,"data_stored":7216893,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19143,"internal_metadata":378713401},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":60,"num_read_kb":30,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005036"},"pg_stats":[{"pgid":"3.3f","version":"82'8","reported_seq":27,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:27:22.911792+0000","last_change":"2024-05-08T05:25:34.073030+0000","last_active":"2024-05-08T05:27:22.911792+0000","last_peered":"2024-05-08T05:27:22.911792+0000","last_clean":"2024-05-08T05:27:22.911792+0000","last_became_active":"2024-05-08T05:25:34.072593+0000","last_became_peered":"2024-05-08T05:25:34.072593+0000","last_unstale":"2024-05-08T05:27:22.911792+0000","last_undegraded":"2024-05-08T05:27:22.911792+0000","last_fullsized":"2024-05-08T05:27:22.911792+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_clean_scrub_stamp":"2024-05-08T05:25:33.008741+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T09:46:17.507034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"82'4","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:27:22.908973+0000","last_change":"2024-05-08T05:25:34.071436+0000","last_active":"2024-05-08T05:27:22.908973+0000","last_peered":"2024-05-08T05:27:22.908973+0000","last_clean":"2024-05-08T05:27:22.908973+0000","last_became_active":"2024-05-08T05:25:34.070985+0000","last_became_peered":"2024-05-08T05:25:34.070985+0000","last_unstale":"2024-05-08T05:27:22.908973+0000","last_undegraded":"2024-05-08T05:27:22.908973+0000","last_fullsized":"2024-05-08T05:27:22.908973+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_clean_scrub_stamp":"2024-05-08T05:25:33.008741+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T10:59:01.312978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"82'7","reported_seq":28,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:27:22.916059+0000","last_change":"2024-05-08T05:25:34.057180+0000","last_active":"2024-05-08T05:27:22.916059+0000","last_peered":"2024-05-08T05:27:22.916059+0000","last_clean":"2024-05-08T05:27:22.916059+0000","last_became_active":"2024-05-08T05:25:34.056775+0000","last_became_peered":"2024-05-08T05:25:34.056775+0000","last_unstale":"2024-05-08T05:27:22.916059+0000","last_undegraded":"2024-05-08T05:27:22.916059+0000","last_fullsized":"2024-05-08T05:27:22.916059+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_clean_scrub_stamp":"2024-05-08T05:25:33.008741+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T13:13:34.389793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"82'8","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:27:22.898318+0000","last_change":"2024-05-08T05:25:34.053102+0000","last_active":"2024-05-08T05:27:22.898318+0000","last_peered":"2024-05-08T05:27:22.898318+0000","last_clean":"2024-05-08T05:27:22.898318+0000","last_became_active":"2024-05-08T05:25:34.052736+0000","last_became_peered":"2024-05-08T05:25:34.052736+0000","last_unstale":"2024-05-08T05:27:22.898318+0000","last_undegraded":"2024-05-08T05:27:22.898318+0000","last_fullsized":"2024-05-08T05:27:22.898318+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_clean_scrub_stamp":"2024-05-08T05:25:33.008741+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T13:05:02.665370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"82'4","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:27:22.900360+0000","last_change":"2024-05-08T05:25:34.070073+0000","last_active":"2024-05-08T05:27:22.900360+0000","last_peered":"2024-05-08T05:27:22.900360+0000","last_clean":"2024-05-08T05:27:22.900360+0000","last_became_active":"2024-05-08T05:25:34.069660+0000","last_became_peered":"2024-05-08T05:25:34.069660+0000","last_unstale":"2024-05-08T05:27:22.900360+0000","last_undegraded":"2024-05-08T05:27:22.900360+0000","last_fullsized":"2024-05-08T05:27:22.900360+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_clean_scrub_stamp":"2024-05-08T05:25:33.008741+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T12:37:10.599082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"82'6","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:27:22.897742+0000","last_change":"2024-05-08T05:25:34.057928+0000","last_active":"2024-05-08T05:27:22.897742+0000","last_peered":"2024-05-08T05:27:22.897742+0000","last_clean":"2024-05-08T05:27:22.897742+0000","last_became_active":"2024-05-08T05:25:34.057538+0000","last_became_peered":"2024-05-08T05:25:34.057538+0000","last_unstale":"2024-05-08T05:27:22.897742+0000","last_undegraded":"2024-05-08T05:27:22.897742+0000","last_fullsized":"2024-05-08T05:27:22.897742+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_clean_scrub_stamp":"2024-05-08T05:25:33.008741+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T12:22:49.920889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"82'5","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:27:22.899885+0000","last_change":"2024-05-08T05:25:34.055439+0000","last_active":"2024-05-08T05:27:22.899885+0000","last_peered":"2024-05-08T05:27:22.899885+0000","last_clean":"2024-05-08T05:27:22.899885+0000","last_became_active":"2024-05-08T05:25:34.055002+0000","last_became_peered":"2024-05-08T05:25:34.055002+0000","last_unstale":"2024-05-08T05:27:22.899885+0000","last_undegraded":"2024-05-08T05:27:22.899885+0000","last_fullsized":"2024-05-08T05:27:22.899885+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_clean_scrub_stamp":"2024-05-08T05:25:33.008741+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T11:29:00.482681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"82'9","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:27:22.912670+0000","last_change":"2024-05-08T05:25:34.058943+0000","last_active":"2024-05-08T05:27:22.912670+0000","last_peered":"2024-05-08T05:27:22.912670+0000","last_clean":"2024-05-08T05:27:22.912670+0000","last_became_active":"2024-05-08T05:25:34.058200+0000","last_became_peered":"2024-05-08T05:25:34.058200+0000","last_unstale":"2024-05-08T05:27:22.912670+0000","last_undegraded":"2024-05-08T05:27:22.912670+0000","last_fullsized":"2024-05-08T05:27:22.912670+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_clean_scrub_stamp":"2024-05-08T05:25:33.008741+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T11:13:23.019489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"82'11","reported_seq":31,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:27:22.905443+0000","last_change":"2024-05-08T05:25:34.053948+0000","last_active":"2024-05-08T05:27:22.905443+0000","last_peered":"2024-05-08T05:27:22.905443+0000","last_clean":"2024-05-08T05:27:22.905443+0000","last_became_active":"2024-05-08T05:25:34.053601+0000","last_became_peered":"2024-05-08T05:25:34.053601+0000","last_unstale":"2024-05-08T05:27:22.905443+0000","last_undegraded":"2024-05-08T05:27:22.905443+0000","last_fullsized":"2024-05-08T05:27:22.905443+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_clean_scrub_stamp":"2024-05-08T05:25:33.008741+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T05:50:44.228628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"82'16","reported_seq":36,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:27:22.898605+0000","last_change":"2024-05-08T05:25:34.053167+0000","last_active":"2024-05-08T05:27:22.898605+0000","last_peered":"2024-05-08T05:27:22.898605+0000","last_clean":"2024-05-08T05:27:22.898605+0000","last_became_active":"2024-05-08T05:25:34.052425+0000","last_became_peered":"2024-05-08T05:25:34.052425+0000","last_unstale":"2024-05-08T05:27:22.898605+0000","last_undegraded":"2024-05-08T05:27:22.898605+0000","last_fullsized":"2024-05-08T05:27:22.898605+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_clean_scrub_stamp":"2024-05-08T05:25:33.008741+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T10:56:28.599966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"82'6","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:27:22.905148+0000","last_change":"2024-05-08T05:25:34.057677+0000","last_active":"2024-05-08T05:27:22.905148+0000","last_peered":"2024-05-08T05:27:22.905148+0000","last_clean":"2024-05-08T05:27:22.905148+0000","last_became_active":"2024-05-08T05:25:34.054800+0000","last_became_peered":"2024-05-08T05:25:34.054800+0000","last_unstale":"2024-05-08T05:27:22.905148+0000","last_undegraded":"2024-05-08T05:27:22.905148+0000","last_fullsized":"2024-05-08T05:27:22.905148+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_clean_scrub_stamp":"2024-05-08T05:25:33.008741+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T07:41:55.836901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"82'7","reported_seq":27,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:27:22.896350+0000","last_change":"2024-05-08T05:25:34.051744+0000","last_active":"2024-05-08T05:27:22.896350+0000","last_peered":"2024-05-08T05:27:22.896350+0000","last_clean":"2024-05-08T05:27:22.896350+0000","last_became_active":"2024-05-08T05:25:34.051395+0000","last_became_peered":"2024-05-08T05:25:34.051395+0000","last_unstale":"2024-05-08T05:27:22.896350+0000","last_undegraded":"2024-05-08T05:27:22.896350+0000","last_fullsized":"2024-05-08T05:27:22.896350+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_clean_scrub_stamp":"2024-05-08T05:25:33.008741+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T07:58:52.674899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"82'10","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:27:22.913129+0000","last_change":"2024-05-08T05:25:34.053197+0000","last_active":"2024-05-08T05:27:22.913129+0000","last_peered":"2024-05-08T05:27:22.913129+0000","last_clean":"2024-05-08T05:27:22.913129+0000","last_became_active":"2024-05-08T05:25:34.052331+0000","last_became_peered":"2024-05-08T05:25:34.052331+0000","last_unstale":"2024-05-08T05:27:22.913129+0000","last_undegraded":"2024-05-08T05:27:22.913129+0000","last_fullsized":"2024-05-08T05:27:22.913129+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_clean_scrub_stamp":"2024-05-08T05:25:33.008741+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T07:19:12.524722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"82'7","reported_seq":27,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:27:22.900593+0000","last_change":"2024-05-08T05:25:34.070242+0000","last_active":"2024-05-08T05:27:22.900593+0000","last_peered":"2024-05-08T05:27:22.900593+0000","last_clean":"2024-05-08T05:27:22.900593+0000","last_became_active":"2024-05-08T05:25:34.069580+0000","last_became_peered":"2024-05-08T05:25:34.069580+0000","last_unstale":"2024-05-08T05:27:22.900593+0000","last_undegraded":"2024-05-08T05:27:22.900593+0000","last_fullsized":"2024-05-08T05:27:22.900593+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_clean_scrub_stamp":"2024-05-08T05:25:33.008741+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T06:33:25.099470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"82'7","reported_seq":27,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:27:22.908263+0000","last_change":"2024-05-08T05:25:34.067174+0000","last_active":"2024-05-08T05:27:22.908263+0000","last_peered":"2024-05-08T05:27:22.908263+0000","last_clean":"2024-05-08T05:27:22.908263+0000","last_became_active":"2024-05-08T05:25:34.066811+0000","last_became_peered":"2024-05-08T05:25:34.066811+0000","last_unstale":"2024-05-08T05:27:22.908263+0000","last_undegraded":"2024-05-08T05:27:22.908263+0000","last_fullsized":"2024-05-08T05:27:22.908263+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_clean_scrub_stamp":"2024-05-08T05:25:33.008741+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T16:17:57.731620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"82'9","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:27:22.918664+0000","last_change":"2024-05-08T05:25:34.064339+0000","last_active":"2024-05-08T05:27:22.918664+0000","last_peered":"2024-05-08T05:27:22.918664+0000","last_clean":"2024-05-08T05:27:22.918664+0000","last_became_active":"2024-05-08T05:25:34.063994+0000","last_became_peered":"2024-05-08T05:25:34.063994+0000","last_unstale":"2024-05-08T05:27:22.918664+0000","last_undegraded":"2024-05-08T05:27:22.918664+0000","last_fullsized":"2024-05-08T05:27:22.918664+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_clean_scrub_stamp":"2024-05-08T05:25:33.008741+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T17:09:34.443411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"82'8","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:27:22.911647+0000","last_change":"2024-05-08T05:25:34.073029+0000","last_active":"2024-05-08T05:27:22.911647+0000","last_peered":"2024-05-08T05:27:22.911647+0000","last_clean":"2024-05-08T05:27:22.911647+0000","last_became_active":"2024-05-08T05:25:34.072491+0000","last_became_peered":"2024-05-08T05:25:34.072491+0000","last_unstale":"2024-05-08T05:27:22.911647+0000","last_undegraded":"2024-05-08T05:27:22.911647+0000","last_fullsized":"2024-05-08T05:27:22.911647+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_clean_scrub_stamp":"2024-05-08T05:25:33.008741+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T10:22:25.304349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"82'10","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:27:22.897233+0000","last_change":"2024-05-08T05:25:34.061439+0000","last_active":"2024-05-08T05:27:22.897233+0000","last_peered":"2024-05-08T05:27:22.897233+0000","last_clean":"2024-05-08T05:27:22.897233+0000","last_became_active":"2024-05-08T05:25:34.058275+0000","last_became_peered":"2024-05-08T05:25:34.058275+0000","last_unstale":"2024-05-08T05:27:22.897233+0000","last_undegraded":"2024-05-08T05:27:22.897233+0000","last_fullsized":"2024-05-08T05:27:22.897233+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_clean_scrub_stamp":"2024-05-08T05:25:33.008741+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T14:04:32.433114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"82'7","reported_seq":27,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:27:22.902949+0000","last_change":"2024-05-08T05:25:34.061463+0000","last_active":"2024-05-08T05:27:22.902949+0000","last_peered":"2024-05-08T05:27:22.902949+0000","last_clean":"2024-05-08T05:27:22.902949+0000","last_became_active":"2024-05-08T05:25:34.060891+0000","last_became_peered":"2024-05-08T05:25:34.060891+0000","last_unstale":"2024-05-08T05:27:22.902949+0000","last_undegraded":"2024-05-08T05:27:22.902949+0000","last_fullsized":"2024-05-08T05:27:22.902949+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_clean_scrub_stamp":"2024-05-08T05:25:33.008741+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T06:42:17.741180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1f","version":"80'9","reported_seq":37,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:26:24.134584+0000","last_change":"2024-05-08T05:25:30.003956+0000","last_active":"2024-05-08T05:26:24.134584+0000","last_peered":"2024-05-08T05:26:24.134584+0000","last_clean":"2024-05-08T05:26:24.134584+0000","last_became_active":"2024-05-08T05:25:30.003229+0000","last_became_peered":"2024-05-08T05:25:30.003229+0000","last_unstale":"2024-05-08T05:26:24.134584+0000","last_undegraded":"2024-05-08T05:26:24.134584+0000","last_fullsized":"2024-05-08T05:26:24.134584+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:28.970901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:28.970901+0000","last_clean_scrub_stamp":"2024-05-08T05:25:28.970901+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T15:45:15.168997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"82'5","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:27:22.894722+0000","last_change":"2024-05-08T05:25:34.064917+0000","last_active":"2024-05-08T05:27:22.894722+0000","last_peered":"2024-05-08T05:27:22.894722+0000","last_clean":"2024-05-08T05:27:22.894722+0000","last_became_active":"2024-05-08T05:25:34.064567+0000","last_became_peered":"2024-05-08T05:25:34.064567+0000","last_unstale":"2024-05-08T05:27:22.894722+0000","last_undegraded":"2024-05-08T05:27:22.894722+0000","last_fullsized":"2024-05-08T05:27:22.894722+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_clean_scrub_stamp":"2024-05-08T05:25:33.008741+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T11:15:53.439313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"80'2","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:26:24.124003+0000","last_change":"2024-05-08T05:25:30.358617+0000","last_active":"2024-05-08T05:26:24.124003+0000","last_peered":"2024-05-08T05:26:24.124003+0000","last_clean":"2024-05-08T05:26:24.124003+0000","last_became_active":"2024-05-08T05:25:30.358084+0000","last_became_peered":"2024-05-08T05:25:30.358084+0000","last_unstale":"2024-05-08T05:26:24.124003+0000","last_undegraded":"2024-05-08T05:26:24.124003+0000","last_fullsized":"2024-05-08T05:26:24.124003+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:28.970901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:28.970901+0000","last_clean_scrub_stamp":"2024-05-08T05:25:28.970901+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T16:30:36.151645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"82'6","reported_seq":27,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:27:22.915154+0000","last_change":"2024-05-08T05:25:34.070189+0000","last_active":"2024-05-08T05:27:22.915154+0000","last_peered":"2024-05-08T05:27:22.915154+0000","last_clean":"2024-05-08T05:27:22.915154+0000","last_became_active":"2024-05-08T05:25:34.067644+0000","last_became_peered":"2024-05-08T05:25:34.067644+0000","last_unstale":"2024-05-08T05:27:22.915154+0000","last_undegraded":"2024-05-08T05:27:22.915154+0000","last_fullsized":"2024-05-08T05:27:22.915154+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_clean_scrub_stamp":"2024-05-08T05:25:33.008741+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T07:50:03.938036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"80'4","reported_seq":19,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:26:24.134338+0000","last_change":"2024-05-08T05:26:24.133899+0000","last_active":"2024-05-08T05:26:24.134338+0000","last_peered":"2024-05-08T05:26:24.134338+0000","last_clean":"2024-05-08T05:26:24.134338+0000","last_became_active":"2024-05-08T05:26:24.127975+0000","last_became_peered":"2024-05-08T05:26:24.127975+0000","last_unstale":"2024-05-08T05:26:24.134338+0000","last_undegraded":"2024-05-08T05:26:24.134338+0000","last_fullsized":"2024-05-08T05:26:24.134338+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:28.970901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:28.970901+0000","last_clean_scrub_stamp":"2024-05-08T05:25:28.970901+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T09:52:51.912899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":10,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,7],"acting":[11,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1c","version":"82'9","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:27:22.908502+0000","last_change":"2024-05-08T05:25:34.057034+0000","last_active":"2024-05-08T05:27:22.908502+0000","last_peered":"2024-05-08T05:27:22.908502+0000","last_clean":"2024-05-08T05:27:22.908502+0000","last_became_active":"2024-05-08T05:25:34.056718+0000","last_became_peered":"2024-05-08T05:25:34.056718+0000","last_unstale":"2024-05-08T05:27:22.908502+0000","last_undegraded":"2024-05-08T05:27:22.908502+0000","last_fullsized":"2024-05-08T05:27:22.908502+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_clean_scrub_stamp":"2024-05-08T05:25:33.008741+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T15:30:38.786889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1c","version":"80'2","reported_seq":28,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:26:24.115905+0000","last_change":"2024-05-08T05:25:29.998007+0000","last_active":"2024-05-08T05:26:24.115905+0000","last_peered":"2024-05-08T05:26:24.115905+0000","last_clean":"2024-05-08T05:26:24.115905+0000","last_became_active":"2024-05-08T05:25:29.997565+0000","last_became_peered":"2024-05-08T05:25:29.997565+0000","last_unstale":"2024-05-08T05:26:24.115905+0000","last_undegraded":"2024-05-08T05:26:24.115905+0000","last_fullsized":"2024-05-08T05:26:24.115905+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:28.970901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:28.970901+0000","last_clean_scrub_stamp":"2024-05-08T05:25:28.970901+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T13:40:09.620809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"82'15","reported_seq":35,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:27:22.904900+0000","last_change":"2024-05-08T05:25:34.060136+0000","last_active":"2024-05-08T05:27:22.904900+0000","last_peered":"2024-05-08T05:27:22.904900+0000","last_clean":"2024-05-08T05:27:22.904900+0000","last_became_active":"2024-05-08T05:25:34.059782+0000","last_became_peered":"2024-05-08T05:25:34.059782+0000","last_unstale":"2024-05-08T05:27:22.904900+0000","last_undegraded":"2024-05-08T05:27:22.904900+0000","last_fullsized":"2024-05-08T05:27:22.904900+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_clean_scrub_stamp":"2024-05-08T05:25:33.008741+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T17:07:33.509305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"82'7","reported_seq":144,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:27:41.117341+0000","last_change":"2024-05-08T05:25:30.001356+0000","last_active":"2024-05-08T05:27:41.117341+0000","last_peered":"2024-05-08T05:27:41.117341+0000","last_clean":"2024-05-08T05:27:41.117341+0000","last_became_active":"2024-05-08T05:25:30.000998+0000","last_became_peered":"2024-05-08T05:25:30.000998+0000","last_unstale":"2024-05-08T05:27:41.117341+0000","last_undegraded":"2024-05-08T05:27:41.117341+0000","last_fullsized":"2024-05-08T05:27:41.117341+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:28.970901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:28.970901+0000","last_clean_scrub_stamp":"2024-05-08T05:25:28.970901+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T10:03:27.279982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1154,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":111,"num_read_kb":4,"num_write":4,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"82'7","reported_seq":27,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:27:22.881072+0000","last_change":"2024-05-08T05:25:34.056548+0000","last_active":"2024-05-08T05:27:22.881072+0000","last_peered":"2024-05-08T05:27:22.881072+0000","last_clean":"2024-05-08T05:27:22.881072+0000","last_became_active":"2024-05-08T05:25:34.056216+0000","last_became_peered":"2024-05-08T05:25:34.056216+0000","last_unstale":"2024-05-08T05:27:22.881072+0000","last_undegraded":"2024-05-08T05:27:22.881072+0000","last_fullsized":"2024-05-08T05:27:22.881072+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_clean_scrub_stamp":"2024-05-08T05:25:33.008741+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T14:46:05.056610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1a","version":"80'3","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:26:24.127482+0000","last_change":"2024-05-08T05:25:30.009289+0000","last_active":"2024-05-08T05:26:24.127482+0000","last_peered":"2024-05-08T05:26:24.127482+0000","last_clean":"2024-05-08T05:26:24.127482+0000","last_became_active":"2024-05-08T05:25:30.008856+0000","last_became_peered":"2024-05-08T05:25:30.008856+0000","last_unstale":"2024-05-08T05:26:24.127482+0000","last_undegraded":"2024-05-08T05:26:24.127482+0000","last_fullsized":"2024-05-08T05:26:24.127482+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:28.970901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:28.970901+0000","last_clean_scrub_stamp":"2024-05-08T05:25:28.970901+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T10:49:55.857415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"82'8","reported_seq":28,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:27:22.902679+0000","last_change":"2024-05-08T05:25:34.062532+0000","last_active":"2024-05-08T05:27:22.902679+0000","last_peered":"2024-05-08T05:27:22.902679+0000","last_clean":"2024-05-08T05:27:22.902679+0000","last_became_active":"2024-05-08T05:25:34.062246+0000","last_became_peered":"2024-05-08T05:25:34.062246+0000","last_unstale":"2024-05-08T05:27:22.902679+0000","last_undegraded":"2024-05-08T05:27:22.902679+0000","last_fullsized":"2024-05-08T05:27:22.902679+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_clean_scrub_stamp":"2024-05-08T05:25:33.008741+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T07:35:49.149411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"80'2","reported_seq":28,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:26:24.114329+0000","last_change":"2024-05-08T05:25:30.014336+0000","last_active":"2024-05-08T05:26:24.114329+0000","last_peered":"2024-05-08T05:26:24.114329+0000","last_clean":"2024-05-08T05:26:24.114329+0000","last_became_active":"2024-05-08T05:25:30.012147+0000","last_became_peered":"2024-05-08T05:25:30.012147+0000","last_unstale":"2024-05-08T05:26:24.114329+0000","last_undegraded":"2024-05-08T05:26:24.114329+0000","last_fullsized":"2024-05-08T05:26:24.114329+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:28.970901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:28.970901+0000","last_clean_scrub_stamp":"2024-05-08T05:25:28.970901+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T07:48:20.477581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"82'8","reported_seq":28,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:27:22.913219+0000","last_change":"2024-05-08T05:25:34.058947+0000","last_active":"2024-05-08T05:27:22.913219+0000","last_peered":"2024-05-08T05:27:22.913219+0000","last_clean":"2024-05-08T05:27:22.913219+0000","last_became_active":"2024-05-08T05:25:34.058626+0000","last_became_peered":"2024-05-08T05:25:34.058626+0000","last_unstale":"2024-05-08T05:27:22.913219+0000","last_undegraded":"2024-05-08T05:27:22.913219+0000","last_fullsized":"2024-05-08T05:27:22.913219+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_clean_scrub_stamp":"2024-05-08T05:25:33.008741+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T12:55:07.742707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"80'1","reported_seq":27,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:26:24.118080+0000","last_change":"2024-05-08T05:25:29.999201+0000","last_active":"2024-05-08T05:26:24.118080+0000","last_peered":"2024-05-08T05:26:24.118080+0000","last_clean":"2024-05-08T05:26:24.118080+0000","last_became_active":"2024-05-08T05:25:29.998819+0000","last_became_peered":"2024-05-08T05:25:29.998819+0000","last_unstale":"2024-05-08T05:26:24.118080+0000","last_undegraded":"2024-05-08T05:26:24.118080+0000","last_fullsized":"2024-05-08T05:26:24.118080+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:28.970901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:28.970901+0000","last_clean_scrub_stamp":"2024-05-08T05:25:28.970901+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T09:00:02.831877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"82'11","reported_seq":31,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:27:22.906332+0000","last_change":"2024-05-08T05:25:34.063770+0000","last_active":"2024-05-08T05:27:22.906332+0000","last_peered":"2024-05-08T05:27:22.906332+0000","last_clean":"2024-05-08T05:27:22.906332+0000","last_became_active":"2024-05-08T05:25:34.061591+0000","last_became_peered":"2024-05-08T05:25:34.061591+0000","last_unstale":"2024-05-08T05:27:22.906332+0000","last_undegraded":"2024-05-08T05:27:22.906332+0000","last_fullsized":"2024-05-08T05:27:22.906332+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_clean_scrub_stamp":"2024-05-08T05:25:33.008741+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T16:51:06.593857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"82'4","reported_seq":138,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:27:42.118155+0000","last_change":"2024-05-08T05:25:30.005678+0000","last_active":"2024-05-08T05:27:42.118155+0000","last_peered":"2024-05-08T05:27:42.118155+0000","last_clean":"2024-05-08T05:27:42.118155+0000","last_became_active":"2024-05-08T05:25:30.005218+0000","last_became_peered":"2024-05-08T05:25:30.005218+0000","last_unstale":"2024-05-08T05:27:42.118155+0000","last_undegraded":"2024-05-08T05:27:42.118155+0000","last_fullsized":"2024-05-08T05:27:42.118155+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:28.970901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:28.970901+0000","last_clean_scrub_stamp":"2024-05-08T05:25:28.970901+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T11:44:56.720663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":108,"num_read_kb":108,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"82'10","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:27:22.901804+0000","last_change":"2024-05-08T05:25:34.058640+0000","last_active":"2024-05-08T05:27:22.901804+0000","last_peered":"2024-05-08T05:27:22.901804+0000","last_clean":"2024-05-08T05:27:22.901804+0000","last_became_active":"2024-05-08T05:25:34.058332+0000","last_became_peered":"2024-05-08T05:25:34.058332+0000","last_unstale":"2024-05-08T05:27:22.901804+0000","last_undegraded":"2024-05-08T05:27:22.901804+0000","last_fullsized":"2024-05-08T05:27:22.901804+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_clean_scrub_stamp":"2024-05-08T05:25:33.008741+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T09:21:44.273684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"80'2","reported_seq":28,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:26:24.115805+0000","last_change":"2024-05-08T05:25:30.000229+0000","last_active":"2024-05-08T05:26:24.115805+0000","last_peered":"2024-05-08T05:26:24.115805+0000","last_clean":"2024-05-08T05:26:24.115805+0000","last_became_active":"2024-05-08T05:25:29.999888+0000","last_became_peered":"2024-05-08T05:25:29.999888+0000","last_unstale":"2024-05-08T05:26:24.115805+0000","last_undegraded":"2024-05-08T05:26:24.115805+0000","last_fullsized":"2024-05-08T05:26:24.115805+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:28.970901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:28.970901+0000","last_clean_scrub_stamp":"2024-05-08T05:25:28.970901+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T10:28:02.849791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"82'9","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:27:22.918555+0000","last_change":"2024-05-08T05:25:34.069600+0000","last_active":"2024-05-08T05:27:22.918555+0000","last_peered":"2024-05-08T05:27:22.918555+0000","last_clean":"2024-05-08T05:27:22.918555+0000","last_became_active":"2024-05-08T05:25:34.069055+0000","last_became_peered":"2024-05-08T05:25:34.069055+0000","last_unstale":"2024-05-08T05:27:22.918555+0000","last_undegraded":"2024-05-08T05:27:22.918555+0000","last_fullsized":"2024-05-08T05:27:22.918555+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_clean_scrub_stamp":"2024-05-08T05:25:33.008741+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T10:22:31.166719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"80'4","reported_seq":31,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:26:24.118716+0000","last_change":"2024-05-08T05:25:30.360911+0000","last_active":"2024-05-08T05:26:24.118716+0000","last_peered":"2024-05-08T05:26:24.118716+0000","last_clean":"2024-05-08T05:26:24.118716+0000","last_became_active":"2024-05-08T05:25:30.360544+0000","last_became_peered":"2024-05-08T05:25:30.360544+0000","last_unstale":"2024-05-08T05:26:24.118716+0000","last_undegraded":"2024-05-08T05:26:24.118716+0000","last_fullsized":"2024-05-08T05:26:24.118716+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:28.970901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:28.970901+0000","last_clean_scrub_stamp":"2024-05-08T05:25:28.970901+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T17:03:10.633420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"82'11","reported_seq":31,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:27:22.903094+0000","last_change":"2024-05-08T05:25:34.058259+0000","last_active":"2024-05-08T05:27:22.903094+0000","last_peered":"2024-05-08T05:27:22.903094+0000","last_clean":"2024-05-08T05:27:22.903094+0000","last_became_active":"2024-05-08T05:25:34.057912+0000","last_became_peered":"2024-05-08T05:25:34.057912+0000","last_unstale":"2024-05-08T05:27:22.903094+0000","last_undegraded":"2024-05-08T05:27:22.903094+0000","last_fullsized":"2024-05-08T05:27:22.903094+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_clean_scrub_stamp":"2024-05-08T05:25:33.008741+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T14:58:49.311769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"82'34","reported_seq":287,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:27:43.132262+0000","last_change":"2024-05-08T05:25:30.001177+0000","last_active":"2024-05-08T05:27:43.132262+0000","last_peered":"2024-05-08T05:27:43.132262+0000","last_clean":"2024-05-08T05:27:43.132262+0000","last_became_active":"2024-05-08T05:25:30.000769+0000","last_became_peered":"2024-05-08T05:25:30.000769+0000","last_unstale":"2024-05-08T05:27:43.132262+0000","last_undegraded":"2024-05-08T05:27:43.132262+0000","last_fullsized":"2024-05-08T05:27:43.132262+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:28.970901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:28.970901+0000","last_clean_scrub_stamp":"2024-05-08T05:25:28.970901+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T14:40:35.540270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":64459,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":227,"num_read_kb":177,"num_write":35,"num_write_kb":77,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"82'6","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:27:22.888584+0000","last_change":"2024-05-08T05:25:34.053366+0000","last_active":"2024-05-08T05:27:22.888584+0000","last_peered":"2024-05-08T05:27:22.888584+0000","last_clean":"2024-05-08T05:27:22.888584+0000","last_became_active":"2024-05-08T05:25:34.052485+0000","last_became_peered":"2024-05-08T05:25:34.052485+0000","last_unstale":"2024-05-08T05:27:22.888584+0000","last_undegraded":"2024-05-08T05:27:22.888584+0000","last_fullsized":"2024-05-08T05:27:22.888584+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_clean_scrub_stamp":"2024-05-08T05:25:33.008741+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T07:35:05.603319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"80'6","reported_seq":33,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:26:24.115359+0000","last_change":"2024-05-08T05:25:30.010453+0000","last_active":"2024-05-08T05:26:24.115359+0000","last_peered":"2024-05-08T05:26:24.115359+0000","last_clean":"2024-05-08T05:26:24.115359+0000","last_became_active":"2024-05-08T05:25:30.010032+0000","last_became_peered":"2024-05-08T05:25:30.010032+0000","last_unstale":"2024-05-08T05:26:24.115359+0000","last_undegraded":"2024-05-08T05:26:24.115359+0000","last_fullsized":"2024-05-08T05:26:24.115359+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:28.970901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:28.970901+0000","last_clean_scrub_stamp":"2024-05-08T05:25:28.970901+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T16:34:35.052481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"82'9","reported_seq":35,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:27:22.904250+0000","last_change":"2024-05-08T05:26:24.134959+0000","last_active":"2024-05-08T05:27:22.904250+0000","last_peered":"2024-05-08T05:27:22.904250+0000","last_clean":"2024-05-08T05:27:22.904250+0000","last_became_active":"2024-05-08T05:26:24.134487+0000","last_became_peered":"2024-05-08T05:26:24.134487+0000","last_unstale":"2024-05-08T05:27:22.904250+0000","last_undegraded":"2024-05-08T05:27:22.904250+0000","last_fullsized":"2024-05-08T05:27:22.904250+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_clean_scrub_stamp":"2024-05-08T05:25:33.008741+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T06:46:55.131407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,9],"acting":[6,7,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"80'3","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:26:24.118139+0000","last_change":"2024-05-08T05:25:30.009768+0000","last_active":"2024-05-08T05:26:24.118139+0000","last_peered":"2024-05-08T05:26:24.118139+0000","last_clean":"2024-05-08T05:26:24.118139+0000","last_became_active":"2024-05-08T05:25:30.009385+0000","last_became_peered":"2024-05-08T05:25:30.009385+0000","last_unstale":"2024-05-08T05:26:24.118139+0000","last_undegraded":"2024-05-08T05:26:24.118139+0000","last_fullsized":"2024-05-08T05:26:24.118139+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:28.970901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:28.970901+0000","last_clean_scrub_stamp":"2024-05-08T05:25:28.970901+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T07:19:19.556003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"82'15","reported_seq":35,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:27:22.912009+0000","last_change":"2024-05-08T05:25:34.055704+0000","last_active":"2024-05-08T05:27:22.912009+0000","last_peered":"2024-05-08T05:27:22.912009+0000","last_clean":"2024-05-08T05:27:22.912009+0000","last_became_active":"2024-05-08T05:25:34.055339+0000","last_became_peered":"2024-05-08T05:25:34.055339+0000","last_unstale":"2024-05-08T05:27:22.912009+0000","last_undegraded":"2024-05-08T05:27:22.912009+0000","last_fullsized":"2024-05-08T05:27:22.912009+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_clean_scrub_stamp":"2024-05-08T05:25:33.008741+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T07:21:52.579094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"82'5","reported_seq":143,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:27:42.191385+0000","last_change":"2024-05-08T05:25:29.998631+0000","last_active":"2024-05-08T05:27:42.191385+0000","last_peered":"2024-05-08T05:27:42.191385+0000","last_clean":"2024-05-08T05:27:42.191385+0000","last_became_active":"2024-05-08T05:25:29.998216+0000","last_became_peered":"2024-05-08T05:25:29.998216+0000","last_unstale":"2024-05-08T05:27:42.191385+0000","last_undegraded":"2024-05-08T05:27:42.191385+0000","last_fullsized":"2024-05-08T05:27:42.191385+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:28.970901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:28.970901+0000","last_clean_scrub_stamp":"2024-05-08T05:25:28.970901+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T14:16:58.252604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1120,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":113,"num_read_kb":5,"num_write":4,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"82'6","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:27:22.888051+0000","last_change":"2024-05-08T05:25:34.053216+0000","last_active":"2024-05-08T05:27:22.888051+0000","last_peered":"2024-05-08T05:27:22.888051+0000","last_clean":"2024-05-08T05:27:22.888051+0000","last_became_active":"2024-05-08T05:25:34.052908+0000","last_became_peered":"2024-05-08T05:25:34.052908+0000","last_unstale":"2024-05-08T05:27:22.888051+0000","last_undegraded":"2024-05-08T05:27:22.888051+0000","last_fullsized":"2024-05-08T05:27:22.888051+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_clean_scrub_stamp":"2024-05-08T05:25:33.008741+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T13:01:42.574200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"80'15","reported_seq":42,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:26:24.116038+0000","last_change":"2024-05-08T05:25:30.356349+0000","last_active":"2024-05-08T05:26:24.116038+0000","last_peered":"2024-05-08T05:26:24.116038+0000","last_clean":"2024-05-08T05:26:24.116038+0000","last_became_active":"2024-05-08T05:25:30.355892+0000","last_became_peered":"2024-05-08T05:25:30.355892+0000","last_unstale":"2024-05-08T05:26:24.116038+0000","last_undegraded":"2024-05-08T05:26:24.116038+0000","last_fullsized":"2024-05-08T05:26:24.116038+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:28.970901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:28.970901+0000","last_clean_scrub_stamp":"2024-05-08T05:25:28.970901+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T16:54:22.322606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"82'6","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:27:22.896840+0000","last_change":"2024-05-08T05:25:34.062254+0000","last_active":"2024-05-08T05:27:22.896840+0000","last_peered":"2024-05-08T05:27:22.896840+0000","last_clean":"2024-05-08T05:27:22.896840+0000","last_became_active":"2024-05-08T05:25:34.061928+0000","last_became_peered":"2024-05-08T05:25:34.061928+0000","last_unstale":"2024-05-08T05:27:22.896840+0000","last_undegraded":"2024-05-08T05:27:22.896840+0000","last_fullsized":"2024-05-08T05:27:22.896840+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_clean_scrub_stamp":"2024-05-08T05:25:33.008741+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T14:58:17.135661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"80'2","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:26:24.116424+0000","last_change":"2024-05-08T05:25:30.001434+0000","last_active":"2024-05-08T05:26:24.116424+0000","last_peered":"2024-05-08T05:26:24.116424+0000","last_clean":"2024-05-08T05:26:24.116424+0000","last_became_active":"2024-05-08T05:25:30.000900+0000","last_became_peered":"2024-05-08T05:25:30.000900+0000","last_unstale":"2024-05-08T05:26:24.116424+0000","last_undegraded":"2024-05-08T05:26:24.116424+0000","last_fullsized":"2024-05-08T05:26:24.116424+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:28.970901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:28.970901+0000","last_clean_scrub_stamp":"2024-05-08T05:25:28.970901+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T11:47:18.031222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"82'5","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:27:22.888849+0000","last_change":"2024-05-08T05:25:34.057101+0000","last_active":"2024-05-08T05:27:22.888849+0000","last_peered":"2024-05-08T05:27:22.888849+0000","last_clean":"2024-05-08T05:27:22.888849+0000","last_became_active":"2024-05-08T05:25:34.056742+0000","last_became_peered":"2024-05-08T05:25:34.056742+0000","last_unstale":"2024-05-08T05:27:22.888849+0000","last_undegraded":"2024-05-08T05:27:22.888849+0000","last_fullsized":"2024-05-08T05:27:22.888849+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_clean_scrub_stamp":"2024-05-08T05:25:33.008741+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T14:19:22.997586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":27,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:26:24.133876+0000","last_change":"2024-05-08T05:25:30.359474+0000","last_active":"2024-05-08T05:26:24.133876+0000","last_peered":"2024-05-08T05:26:24.133876+0000","last_clean":"2024-05-08T05:26:24.133876+0000","last_became_active":"2024-05-08T05:25:30.358971+0000","last_became_peered":"2024-05-08T05:25:30.358971+0000","last_unstale":"2024-05-08T05:26:24.133876+0000","last_undegraded":"2024-05-08T05:26:24.133876+0000","last_fullsized":"2024-05-08T05:26:24.133876+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:28.970901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:28.970901+0000","last_clean_scrub_stamp":"2024-05-08T05:25:28.970901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T12:51:42.239112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"82'5","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:27:22.909599+0000","last_change":"2024-05-08T05:25:34.061014+0000","last_active":"2024-05-08T05:27:22.909599+0000","last_peered":"2024-05-08T05:27:22.909599+0000","last_clean":"2024-05-08T05:27:22.909599+0000","last_became_active":"2024-05-08T05:25:34.060682+0000","last_became_peered":"2024-05-08T05:25:34.060682+0000","last_unstale":"2024-05-08T05:27:22.909599+0000","last_undegraded":"2024-05-08T05:27:22.909599+0000","last_fullsized":"2024-05-08T05:27:22.909599+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_clean_scrub_stamp":"2024-05-08T05:25:33.008741+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T13:19:48.652257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"80'1","reported_seq":28,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:26:24.116079+0000","last_change":"2024-05-08T05:25:30.009360+0000","last_active":"2024-05-08T05:26:24.116079+0000","last_peered":"2024-05-08T05:26:24.116079+0000","last_clean":"2024-05-08T05:26:24.116079+0000","last_became_active":"2024-05-08T05:25:30.008806+0000","last_became_peered":"2024-05-08T05:25:30.008806+0000","last_unstale":"2024-05-08T05:26:24.116079+0000","last_undegraded":"2024-05-08T05:26:24.116079+0000","last_fullsized":"2024-05-08T05:26:24.116079+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:28.970901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:28.970901+0000","last_clean_scrub_stamp":"2024-05-08T05:25:28.970901+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T11:19:45.905803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"82'7","reported_seq":28,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:27:22.902064+0000","last_change":"2024-05-08T05:25:34.065415+0000","last_active":"2024-05-08T05:27:22.902064+0000","last_peered":"2024-05-08T05:27:22.902064+0000","last_clean":"2024-05-08T05:27:22.902064+0000","last_became_active":"2024-05-08T05:25:34.065017+0000","last_became_peered":"2024-05-08T05:25:34.065017+0000","last_unstale":"2024-05-08T05:27:22.902064+0000","last_undegraded":"2024-05-08T05:27:22.902064+0000","last_fullsized":"2024-05-08T05:27:22.902064+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_clean_scrub_stamp":"2024-05-08T05:25:33.008741+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T14:46:34.518792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.0","version":"82'8","reported_seq":35,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:27:22.887996+0000","last_change":"2024-05-08T05:26:24.120480+0000","last_active":"2024-05-08T05:27:22.887996+0000","last_peered":"2024-05-08T05:27:22.887996+0000","last_clean":"2024-05-08T05:27:22.887996+0000","last_became_active":"2024-05-08T05:26:24.120031+0000","last_became_peered":"2024-05-08T05:26:24.120031+0000","last_unstale":"2024-05-08T05:27:22.887996+0000","last_undegraded":"2024-05-08T05:27:22.887996+0000","last_fullsized":"2024-05-08T05:27:22.887996+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_clean_scrub_stamp":"2024-05-08T05:25:33.008741+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T09:24:18.149796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,8],"acting":[5,2,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"82'5","reported_seq":139,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:27:41.188035+0000","last_change":"2024-05-08T05:25:30.356178+0000","last_active":"2024-05-08T05:27:41.188035+0000","last_peered":"2024-05-08T05:27:41.188035+0000","last_clean":"2024-05-08T05:27:41.188035+0000","last_became_active":"2024-05-08T05:25:30.355750+0000","last_became_peered":"2024-05-08T05:25:30.355750+0000","last_unstale":"2024-05-08T05:27:41.188035+0000","last_undegraded":"2024-05-08T05:27:41.188035+0000","last_fullsized":"2024-05-08T05:27:41.188035+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:28.970901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:28.970901+0000","last_clean_scrub_stamp":"2024-05-08T05:25:28.970901+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T05:57:35.174274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":107,"num_read_kb":107,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"82'8","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:27:22.906527+0000","last_change":"2024-05-08T05:25:34.068189+0000","last_active":"2024-05-08T05:27:22.906527+0000","last_peered":"2024-05-08T05:27:22.906527+0000","last_clean":"2024-05-08T05:27:22.906527+0000","last_became_active":"2024-05-08T05:25:34.064398+0000","last_became_peered":"2024-05-08T05:25:34.064398+0000","last_unstale":"2024-05-08T05:27:22.906527+0000","last_undegraded":"2024-05-08T05:27:22.906527+0000","last_fullsized":"2024-05-08T05:27:22.906527+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_clean_scrub_stamp":"2024-05-08T05:25:33.008741+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T10:27:31.050126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"80'3","reported_seq":32,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:26:24.126812+0000","last_change":"2024-05-08T05:25:30.005110+0000","last_active":"2024-05-08T05:26:24.126812+0000","last_peered":"2024-05-08T05:26:24.126812+0000","last_clean":"2024-05-08T05:26:24.126812+0000","last_became_active":"2024-05-08T05:25:30.004703+0000","last_became_peered":"2024-05-08T05:25:30.004703+0000","last_unstale":"2024-05-08T05:26:24.126812+0000","last_undegraded":"2024-05-08T05:26:24.126812+0000","last_fullsized":"2024-05-08T05:26:24.126812+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:28.970901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:28.970901+0000","last_clean_scrub_stamp":"2024-05-08T05:25:28.970901+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T12:49:21.174417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"21'92","reported_seq":101,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:26:24.115653+0000","last_change":"2024-05-08T05:23:59.731023+0000","last_active":"2024-05-08T05:26:24.115653+0000","last_peered":"2024-05-08T05:26:24.115653+0000","last_clean":"2024-05-08T05:26:24.115653+0000","last_became_active":"2024-05-08T05:23:59.725321+0000","last_became_peered":"2024-05-08T05:23:59.725321+0000","last_unstale":"2024-05-08T05:26:24.115653+0000","last_undegraded":"2024-05-08T05:26:24.115653+0000","last_fullsized":"2024-05-08T05:26:24.115653+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:20:09.357011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:20:09.357011+0000","last_clean_scrub_stamp":"2024-05-08T05:20:09.357011+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T09:50:58.729815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"82'5","reported_seq":32,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:27:22.899430+0000","last_change":"2024-05-08T05:26:24.131360+0000","last_active":"2024-05-08T05:27:22.899430+0000","last_peered":"2024-05-08T05:27:22.899430+0000","last_clean":"2024-05-08T05:27:22.899430+0000","last_became_active":"2024-05-08T05:26:24.130480+0000","last_became_peered":"2024-05-08T05:26:24.130480+0000","last_unstale":"2024-05-08T05:27:22.899430+0000","last_undegraded":"2024-05-08T05:27:22.899430+0000","last_fullsized":"2024-05-08T05:27:22.899430+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_clean_scrub_stamp":"2024-05-08T05:25:33.008741+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T09:26:32.515332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,9,2],"acting":[6,9,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"80'3","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:26:24.115792+0000","last_change":"2024-05-08T05:25:29.999659+0000","last_active":"2024-05-08T05:26:24.115792+0000","last_peered":"2024-05-08T05:26:24.115792+0000","last_clean":"2024-05-08T05:26:24.115792+0000","last_became_active":"2024-05-08T05:25:29.999299+0000","last_became_peered":"2024-05-08T05:25:29.999299+0000","last_unstale":"2024-05-08T05:26:24.115792+0000","last_undegraded":"2024-05-08T05:26:24.115792+0000","last_fullsized":"2024-05-08T05:26:24.115792+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:28.970901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:28.970901+0000","last_clean_scrub_stamp":"2024-05-08T05:25:28.970901+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T11:20:16.513402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"80'1","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:26:24.116094+0000","last_change":"2024-05-08T05:25:30.360940+0000","last_active":"2024-05-08T05:26:24.116094+0000","last_peered":"2024-05-08T05:26:24.116094+0000","last_clean":"2024-05-08T05:26:24.116094+0000","last_became_active":"2024-05-08T05:25:30.360507+0000","last_became_peered":"2024-05-08T05:25:30.360507+0000","last_unstale":"2024-05-08T05:26:24.116094+0000","last_undegraded":"2024-05-08T05:26:24.116094+0000","last_fullsized":"2024-05-08T05:26:24.116094+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:28.970901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:28.970901+0000","last_clean_scrub_stamp":"2024-05-08T05:25:28.970901+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T06:49:39.271211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"82'9","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:27:22.902224+0000","last_change":"2024-05-08T05:25:34.056952+0000","last_active":"2024-05-08T05:27:22.902224+0000","last_peered":"2024-05-08T05:27:22.902224+0000","last_clean":"2024-05-08T05:27:22.902224+0000","last_became_active":"2024-05-08T05:25:34.056495+0000","last_became_peered":"2024-05-08T05:25:34.056495+0000","last_unstale":"2024-05-08T05:27:22.902224+0000","last_undegraded":"2024-05-08T05:27:22.902224+0000","last_fullsized":"2024-05-08T05:27:22.902224+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_clean_scrub_stamp":"2024-05-08T05:25:33.008741+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T09:35:22.540178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"82'12","reported_seq":39,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:27:23.101526+0000","last_change":"2024-05-08T05:25:30.008967+0000","last_active":"2024-05-08T05:27:23.101526+0000","last_peered":"2024-05-08T05:27:23.101526+0000","last_clean":"2024-05-08T05:27:23.101526+0000","last_became_active":"2024-05-08T05:25:30.007542+0000","last_became_peered":"2024-05-08T05:25:30.007542+0000","last_unstale":"2024-05-08T05:27:23.101526+0000","last_undegraded":"2024-05-08T05:27:23.101526+0000","last_fullsized":"2024-05-08T05:27:23.101526+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:28.970901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:28.970901+0000","last_clean_scrub_stamp":"2024-05-08T05:25:28.970901+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T05:29:30.191842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"82'5","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:27:22.902209+0000","last_change":"2024-05-08T05:25:34.054334+0000","last_active":"2024-05-08T05:27:22.902209+0000","last_peered":"2024-05-08T05:27:22.902209+0000","last_clean":"2024-05-08T05:27:22.902209+0000","last_became_active":"2024-05-08T05:25:34.053989+0000","last_became_peered":"2024-05-08T05:25:34.053989+0000","last_unstale":"2024-05-08T05:27:22.902209+0000","last_undegraded":"2024-05-08T05:27:22.902209+0000","last_fullsized":"2024-05-08T05:27:22.902209+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_clean_scrub_stamp":"2024-05-08T05:25:33.008741+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T09:03:25.683445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"80'4","reported_seq":31,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:26:24.127039+0000","last_change":"2024-05-08T05:25:30.007144+0000","last_active":"2024-05-08T05:26:24.127039+0000","last_peered":"2024-05-08T05:26:24.127039+0000","last_clean":"2024-05-08T05:26:24.127039+0000","last_became_active":"2024-05-08T05:25:30.006878+0000","last_became_peered":"2024-05-08T05:25:30.006878+0000","last_unstale":"2024-05-08T05:26:24.127039+0000","last_undegraded":"2024-05-08T05:26:24.127039+0000","last_fullsized":"2024-05-08T05:26:24.127039+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:28.970901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:28.970901+0000","last_clean_scrub_stamp":"2024-05-08T05:25:28.970901+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T07:06:35.573001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"82'7","reported_seq":28,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:27:22.914063+0000","last_change":"2024-05-08T05:25:34.073744+0000","last_active":"2024-05-08T05:27:22.914063+0000","last_peered":"2024-05-08T05:27:22.914063+0000","last_clean":"2024-05-08T05:27:22.914063+0000","last_became_active":"2024-05-08T05:25:34.073368+0000","last_became_peered":"2024-05-08T05:25:34.073368+0000","last_unstale":"2024-05-08T05:27:22.914063+0000","last_undegraded":"2024-05-08T05:27:22.914063+0000","last_fullsized":"2024-05-08T05:27:22.914063+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_clean_scrub_stamp":"2024-05-08T05:25:33.008741+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T10:43:31.480745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"80'2","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:26:24.112998+0000","last_change":"2024-05-08T05:25:30.356584+0000","last_active":"2024-05-08T05:26:24.112998+0000","last_peered":"2024-05-08T05:26:24.112998+0000","last_clean":"2024-05-08T05:26:24.112998+0000","last_became_active":"2024-05-08T05:25:30.356203+0000","last_became_peered":"2024-05-08T05:25:30.356203+0000","last_unstale":"2024-05-08T05:26:24.112998+0000","last_undegraded":"2024-05-08T05:26:24.112998+0000","last_fullsized":"2024-05-08T05:26:24.112998+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:28.970901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:28.970901+0000","last_clean_scrub_stamp":"2024-05-08T05:25:28.970901+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T14:35:21.193856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"82'2","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:27:22.887903+0000","last_change":"2024-05-08T05:25:34.053168+0000","last_active":"2024-05-08T05:27:22.887903+0000","last_peered":"2024-05-08T05:27:22.887903+0000","last_clean":"2024-05-08T05:27:22.887903+0000","last_became_active":"2024-05-08T05:25:34.052875+0000","last_became_peered":"2024-05-08T05:25:34.052875+0000","last_unstale":"2024-05-08T05:27:22.887903+0000","last_undegraded":"2024-05-08T05:27:22.887903+0000","last_fullsized":"2024-05-08T05:27:22.887903+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_clean_scrub_stamp":"2024-05-08T05:25:33.008741+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T07:38:40.129212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"80'3","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:26:24.121861+0000","last_change":"2024-05-08T05:25:30.009113+0000","last_active":"2024-05-08T05:26:24.121861+0000","last_peered":"2024-05-08T05:26:24.121861+0000","last_clean":"2024-05-08T05:26:24.121861+0000","last_became_active":"2024-05-08T05:25:30.007605+0000","last_became_peered":"2024-05-08T05:25:30.007605+0000","last_unstale":"2024-05-08T05:26:24.121861+0000","last_undegraded":"2024-05-08T05:26:24.121861+0000","last_fullsized":"2024-05-08T05:26:24.121861+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:28.970901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:28.970901+0000","last_clean_scrub_stamp":"2024-05-08T05:25:28.970901+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T10:06:05.177516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"82'9","reported_seq":27,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:27:22.911254+0000","last_change":"2024-05-08T05:25:34.072765+0000","last_active":"2024-05-08T05:27:22.911254+0000","last_peered":"2024-05-08T05:27:22.911254+0000","last_clean":"2024-05-08T05:27:22.911254+0000","last_became_active":"2024-05-08T05:25:34.072381+0000","last_became_peered":"2024-05-08T05:25:34.072381+0000","last_unstale":"2024-05-08T05:27:22.911254+0000","last_undegraded":"2024-05-08T05:27:22.911254+0000","last_fullsized":"2024-05-08T05:27:22.911254+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_clean_scrub_stamp":"2024-05-08T05:25:33.008741+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T11:55:21.046126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"80'1","reported_seq":15,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:26:24.125393+0000","last_change":"2024-05-08T05:26:24.124762+0000","last_active":"2024-05-08T05:26:24.125393+0000","last_peered":"2024-05-08T05:26:24.125393+0000","last_clean":"2024-05-08T05:26:24.125393+0000","last_became_active":"2024-05-08T05:26:24.121235+0000","last_became_peered":"2024-05-08T05:26:24.121235+0000","last_unstale":"2024-05-08T05:26:24.125393+0000","last_undegraded":"2024-05-08T05:26:24.125393+0000","last_fullsized":"2024-05-08T05:26:24.125393+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:28.970901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:28.970901+0000","last_clean_scrub_stamp":"2024-05-08T05:25:28.970901+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T16:08:17.650335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,3,8],"acting":[11,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.b","version":"82'8","reported_seq":28,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:27:22.911392+0000","last_change":"2024-05-08T05:25:34.071097+0000","last_active":"2024-05-08T05:27:22.911392+0000","last_peered":"2024-05-08T05:27:22.911392+0000","last_clean":"2024-05-08T05:27:22.911392+0000","last_became_active":"2024-05-08T05:25:34.070635+0000","last_became_peered":"2024-05-08T05:25:34.070635+0000","last_unstale":"2024-05-08T05:27:22.911392+0000","last_undegraded":"2024-05-08T05:27:22.911392+0000","last_fullsized":"2024-05-08T05:27:22.911392+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_clean_scrub_stamp":"2024-05-08T05:25:33.008741+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T13:33:17.217958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"80'4","reported_seq":32,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:26:24.116727+0000","last_change":"2024-05-08T05:25:30.002043+0000","last_active":"2024-05-08T05:26:24.116727+0000","last_peered":"2024-05-08T05:26:24.116727+0000","last_clean":"2024-05-08T05:26:24.116727+0000","last_became_active":"2024-05-08T05:25:30.001624+0000","last_became_peered":"2024-05-08T05:25:30.001624+0000","last_unstale":"2024-05-08T05:26:24.116727+0000","last_undegraded":"2024-05-08T05:26:24.116727+0000","last_fullsized":"2024-05-08T05:26:24.116727+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:28.970901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:28.970901+0000","last_clean_scrub_stamp":"2024-05-08T05:25:28.970901+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T07:20:34.740005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"82'5","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:27:22.910044+0000","last_change":"2024-05-08T05:25:34.057883+0000","last_active":"2024-05-08T05:27:22.910044+0000","last_peered":"2024-05-08T05:27:22.910044+0000","last_clean":"2024-05-08T05:27:22.910044+0000","last_became_active":"2024-05-08T05:25:34.056651+0000","last_became_peered":"2024-05-08T05:25:34.056651+0000","last_unstale":"2024-05-08T05:27:22.910044+0000","last_undegraded":"2024-05-08T05:27:22.910044+0000","last_fullsized":"2024-05-08T05:27:22.910044+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_clean_scrub_stamp":"2024-05-08T05:25:33.008741+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T16:52:46.598847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"80'3","reported_seq":31,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:26:24.116077+0000","last_change":"2024-05-08T05:25:30.356166+0000","last_active":"2024-05-08T05:26:24.116077+0000","last_peered":"2024-05-08T05:26:24.116077+0000","last_clean":"2024-05-08T05:26:24.116077+0000","last_became_active":"2024-05-08T05:25:30.355730+0000","last_became_peered":"2024-05-08T05:25:30.355730+0000","last_unstale":"2024-05-08T05:26:24.116077+0000","last_undegraded":"2024-05-08T05:26:24.116077+0000","last_fullsized":"2024-05-08T05:26:24.116077+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:28.970901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:28.970901+0000","last_clean_scrub_stamp":"2024-05-08T05:25:28.970901+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T05:47:47.743725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"82'7","reported_seq":27,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:27:22.905116+0000","last_change":"2024-05-08T05:25:34.058005+0000","last_active":"2024-05-08T05:27:22.905116+0000","last_peered":"2024-05-08T05:27:22.905116+0000","last_clean":"2024-05-08T05:27:22.905116+0000","last_became_active":"2024-05-08T05:25:34.056319+0000","last_became_peered":"2024-05-08T05:25:34.056319+0000","last_unstale":"2024-05-08T05:27:22.905116+0000","last_undegraded":"2024-05-08T05:27:22.905116+0000","last_fullsized":"2024-05-08T05:27:22.905116+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_clean_scrub_stamp":"2024-05-08T05:25:33.008741+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T07:04:22.726450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"80'1","reported_seq":28,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:26:24.118569+0000","last_change":"2024-05-08T05:25:30.009641+0000","last_active":"2024-05-08T05:26:24.118569+0000","last_peered":"2024-05-08T05:26:24.118569+0000","last_clean":"2024-05-08T05:26:24.118569+0000","last_became_active":"2024-05-08T05:25:30.009244+0000","last_became_peered":"2024-05-08T05:25:30.009244+0000","last_unstale":"2024-05-08T05:26:24.118569+0000","last_undegraded":"2024-05-08T05:26:24.118569+0000","last_fullsized":"2024-05-08T05:26:24.118569+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:28.970901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:28.970901+0000","last_clean_scrub_stamp":"2024-05-08T05:25:28.970901+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T17:15:50.982103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"82'7","reported_seq":27,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:27:22.909137+0000","last_change":"2024-05-08T05:25:34.059603+0000","last_active":"2024-05-08T05:27:22.909137+0000","last_peered":"2024-05-08T05:27:22.909137+0000","last_clean":"2024-05-08T05:27:22.909137+0000","last_became_active":"2024-05-08T05:25:34.059260+0000","last_became_peered":"2024-05-08T05:25:34.059260+0000","last_unstale":"2024-05-08T05:27:22.909137+0000","last_undegraded":"2024-05-08T05:27:22.909137+0000","last_fullsized":"2024-05-08T05:27:22.909137+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_clean_scrub_stamp":"2024-05-08T05:25:33.008741+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T07:47:32.723829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"80'2","reported_seq":28,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:26:24.116997+0000","last_change":"2024-05-08T05:25:30.013326+0000","last_active":"2024-05-08T05:26:24.116997+0000","last_peered":"2024-05-08T05:26:24.116997+0000","last_clean":"2024-05-08T05:26:24.116997+0000","last_became_active":"2024-05-08T05:25:30.012868+0000","last_became_peered":"2024-05-08T05:25:30.012868+0000","last_unstale":"2024-05-08T05:26:24.116997+0000","last_undegraded":"2024-05-08T05:26:24.116997+0000","last_fullsized":"2024-05-08T05:26:24.116997+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:28.970901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:28.970901+0000","last_clean_scrub_stamp":"2024-05-08T05:25:28.970901+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T14:09:14.210180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"82'9","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:27:22.890895+0000","last_change":"2024-05-08T05:25:34.052621+0000","last_active":"2024-05-08T05:27:22.890895+0000","last_peered":"2024-05-08T05:27:22.890895+0000","last_clean":"2024-05-08T05:27:22.890895+0000","last_became_active":"2024-05-08T05:25:34.052289+0000","last_became_peered":"2024-05-08T05:25:34.052289+0000","last_unstale":"2024-05-08T05:27:22.890895+0000","last_undegraded":"2024-05-08T05:27:22.890895+0000","last_fullsized":"2024-05-08T05:27:22.890895+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_clean_scrub_stamp":"2024-05-08T05:25:33.008741+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T16:37:19.327915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"82'9","reported_seq":28,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:27:22.890913+0000","last_change":"2024-05-08T05:25:34.057918+0000","last_active":"2024-05-08T05:27:22.890913+0000","last_peered":"2024-05-08T05:27:22.890913+0000","last_clean":"2024-05-08T05:27:22.890913+0000","last_became_active":"2024-05-08T05:25:34.057455+0000","last_became_peered":"2024-05-08T05:25:34.057455+0000","last_unstale":"2024-05-08T05:27:22.890913+0000","last_undegraded":"2024-05-08T05:27:22.890913+0000","last_fullsized":"2024-05-08T05:27:22.890913+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_clean_scrub_stamp":"2024-05-08T05:25:33.008741+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T11:36:49.027414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"82'12","reported_seq":33,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:27:22.903184+0000","last_change":"2024-05-08T05:25:34.055114+0000","last_active":"2024-05-08T05:27:22.903184+0000","last_peered":"2024-05-08T05:27:22.903184+0000","last_clean":"2024-05-08T05:27:22.903184+0000","last_became_active":"2024-05-08T05:25:34.054448+0000","last_became_peered":"2024-05-08T05:25:34.054448+0000","last_unstale":"2024-05-08T05:27:22.903184+0000","last_undegraded":"2024-05-08T05:27:22.903184+0000","last_fullsized":"2024-05-08T05:27:22.903184+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_clean_scrub_stamp":"2024-05-08T05:25:33.008741+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T15:19:54.872779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"82'8","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:27:22.915661+0000","last_change":"2024-05-08T05:25:34.064199+0000","last_active":"2024-05-08T05:27:22.915661+0000","last_peered":"2024-05-08T05:27:22.915661+0000","last_clean":"2024-05-08T05:27:22.915661+0000","last_became_active":"2024-05-08T05:25:34.063888+0000","last_became_peered":"2024-05-08T05:25:34.063888+0000","last_unstale":"2024-05-08T05:27:22.915661+0000","last_undegraded":"2024-05-08T05:27:22.915661+0000","last_fullsized":"2024-05-08T05:27:22.915661+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_clean_scrub_stamp":"2024-05-08T05:25:33.008741+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T13:18:15.146769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"82'7","reported_seq":28,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:27:22.918372+0000","last_change":"2024-05-08T05:25:34.070526+0000","last_active":"2024-05-08T05:27:22.918372+0000","last_peered":"2024-05-08T05:27:22.918372+0000","last_clean":"2024-05-08T05:27:22.918372+0000","last_became_active":"2024-05-08T05:25:34.069890+0000","last_became_peered":"2024-05-08T05:25:34.069890+0000","last_unstale":"2024-05-08T05:27:22.918372+0000","last_undegraded":"2024-05-08T05:27:22.918372+0000","last_fullsized":"2024-05-08T05:27:22.918372+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_clean_scrub_stamp":"2024-05-08T05:25:33.008741+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T16:17:56.986221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"82'4","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:27:22.915811+0000","last_change":"2024-05-08T05:25:34.067033+0000","last_active":"2024-05-08T05:27:22.915811+0000","last_peered":"2024-05-08T05:27:22.915811+0000","last_clean":"2024-05-08T05:27:22.915811+0000","last_became_active":"2024-05-08T05:25:34.066492+0000","last_became_peered":"2024-05-08T05:25:34.066492+0000","last_unstale":"2024-05-08T05:27:22.915811+0000","last_undegraded":"2024-05-08T05:27:22.915811+0000","last_fullsized":"2024-05-08T05:27:22.915811+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_clean_scrub_stamp":"2024-05-08T05:25:33.008741+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T07:30:10.450504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"82'6","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:27:22.888258+0000","last_change":"2024-05-08T05:25:34.056525+0000","last_active":"2024-05-08T05:27:22.888258+0000","last_peered":"2024-05-08T05:27:22.888258+0000","last_clean":"2024-05-08T05:27:22.888258+0000","last_became_active":"2024-05-08T05:25:34.056190+0000","last_became_peered":"2024-05-08T05:25:34.056190+0000","last_unstale":"2024-05-08T05:27:22.888258+0000","last_undegraded":"2024-05-08T05:27:22.888258+0000","last_fullsized":"2024-05-08T05:27:22.888258+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_clean_scrub_stamp":"2024-05-08T05:25:33.008741+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T13:13:57.716642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"82'15","reported_seq":36,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:27:22.905265+0000","last_change":"2024-05-08T05:25:34.055643+0000","last_active":"2024-05-08T05:27:22.905265+0000","last_peered":"2024-05-08T05:27:22.905265+0000","last_clean":"2024-05-08T05:27:22.905265+0000","last_became_active":"2024-05-08T05:25:34.054886+0000","last_became_peered":"2024-05-08T05:25:34.054886+0000","last_unstale":"2024-05-08T05:27:22.905265+0000","last_undegraded":"2024-05-08T05:27:22.905265+0000","last_fullsized":"2024-05-08T05:27:22.905265+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_clean_scrub_stamp":"2024-05-08T05:25:33.008741+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T05:53:41.130484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"82'2","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:27:22.908627+0000","last_change":"2024-05-08T05:25:34.056932+0000","last_active":"2024-05-08T05:27:22.908627+0000","last_peered":"2024-05-08T05:27:22.908627+0000","last_clean":"2024-05-08T05:27:22.908627+0000","last_became_active":"2024-05-08T05:25:34.055473+0000","last_became_peered":"2024-05-08T05:25:34.055473+0000","last_unstale":"2024-05-08T05:27:22.908627+0000","last_undegraded":"2024-05-08T05:27:22.908627+0000","last_fullsized":"2024-05-08T05:27:22.908627+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_clean_scrub_stamp":"2024-05-08T05:25:33.008741+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T16:16:13.748056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"82'6","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:27:22.911787+0000","last_change":"2024-05-08T05:26:24.134794+0000","last_active":"2024-05-08T05:27:22.911787+0000","last_peered":"2024-05-08T05:27:22.911787+0000","last_clean":"2024-05-08T05:27:22.911787+0000","last_became_active":"2024-05-08T05:26:24.133586+0000","last_became_peered":"2024-05-08T05:26:24.133586+0000","last_unstale":"2024-05-08T05:27:22.911787+0000","last_undegraded":"2024-05-08T05:27:22.911787+0000","last_fullsized":"2024-05-08T05:27:22.911787+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_clean_scrub_stamp":"2024-05-08T05:25:33.008741+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T15:03:05.432689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,9,3],"acting":[6,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.29","version":"82'8","reported_seq":28,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:27:22.907538+0000","last_change":"2024-05-08T05:25:34.065000+0000","last_active":"2024-05-08T05:27:22.907538+0000","last_peered":"2024-05-08T05:27:22.907538+0000","last_clean":"2024-05-08T05:27:22.907538+0000","last_became_active":"2024-05-08T05:25:34.057748+0000","last_became_peered":"2024-05-08T05:25:34.057748+0000","last_unstale":"2024-05-08T05:27:22.907538+0000","last_undegraded":"2024-05-08T05:27:22.907538+0000","last_fullsized":"2024-05-08T05:27:22.907538+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_clean_scrub_stamp":"2024-05-08T05:25:33.008741+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T15:33:41.411507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"82'10","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:27:22.910847+0000","last_change":"2024-05-08T05:25:34.066601+0000","last_active":"2024-05-08T05:27:22.910847+0000","last_peered":"2024-05-08T05:27:22.910847+0000","last_clean":"2024-05-08T05:27:22.910847+0000","last_became_active":"2024-05-08T05:25:34.066226+0000","last_became_peered":"2024-05-08T05:25:34.066226+0000","last_unstale":"2024-05-08T05:27:22.910847+0000","last_undegraded":"2024-05-08T05:27:22.910847+0000","last_fullsized":"2024-05-08T05:27:22.910847+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_clean_scrub_stamp":"2024-05-08T05:25:33.008741+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T15:27:54.180580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"82'11","reported_seq":31,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:27:22.918983+0000","last_change":"2024-05-08T05:25:34.073520+0000","last_active":"2024-05-08T05:27:22.918983+0000","last_peered":"2024-05-08T05:27:22.918983+0000","last_clean":"2024-05-08T05:27:22.918983+0000","last_became_active":"2024-05-08T05:25:34.072250+0000","last_became_peered":"2024-05-08T05:25:34.072250+0000","last_unstale":"2024-05-08T05:27:22.918983+0000","last_undegraded":"2024-05-08T05:27:22.918983+0000","last_fullsized":"2024-05-08T05:27:22.918983+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_clean_scrub_stamp":"2024-05-08T05:25:33.008741+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T08:17:36.181338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"82'8","reported_seq":32,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:27:22.894971+0000","last_change":"2024-05-08T05:26:24.134964+0000","last_active":"2024-05-08T05:27:22.894971+0000","last_peered":"2024-05-08T05:27:22.894971+0000","last_clean":"2024-05-08T05:27:22.894971+0000","last_became_active":"2024-05-08T05:26:24.134583+0000","last_became_peered":"2024-05-08T05:26:24.134583+0000","last_unstale":"2024-05-08T05:27:22.894971+0000","last_undegraded":"2024-05-08T05:27:22.894971+0000","last_fullsized":"2024-05-08T05:27:22.894971+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_clean_scrub_stamp":"2024-05-08T05:25:33.008741+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T16:09:52.525461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,8],"acting":[11,9,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":502,"ondisk_log_size":502,"up":192,"acting":192,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":3563520,"data_stored":3542208,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":92,"ondisk_log_size":92,"up":3,"acting":3,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":69133,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":679,"num_read_kb":414,"num_write":175,"num_write_kb":122,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":10,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":430080,"data_stored":207399,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":150,"ondisk_log_size":150,"up":96,"acting":96,"num_store_stats":12}],"osd_stats":[{"osd":11,"up_from":72,"seq":309237645354,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27884,"kb_used_data":868,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717268,"statfs":{"total":95995035648,"available":95966482432,"internally_reserved":0,"allocated":888832,"data_stored":437056,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":66,"seq":283467841585,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36888,"kb_used_data":1552,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708264,"statfs":{"total":95995035648,"available":95957262336,"internally_reserved":0,"allocated":1589248,"data_stored":1093528,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":36174272},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":60,"seq":257698037814,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32060,"kb_used_data":884,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713092,"statfs":{"total":95995035648,"available":95962206208,"internally_reserved":0,"allocated":905216,"data_stored":437292,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":31914432},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":54,"seq":231928234044,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27900,"kb_used_data":884,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717252,"statfs":{"total":95995035648,"available":95966466048,"internally_reserved":0,"allocated":905216,"data_stored":437212,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":48,"seq":206158430274,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36800,"kb_used_data":1464,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708352,"statfs":{"total":95995035648,"available":95957352448,"internally_reserved":0,"allocated":1499136,"data_stored":1029815,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":36174282},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":42,"seq":180388626503,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36208,"kb_used_data":872,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708944,"statfs":{"total":95995035648,"available":95957958656,"internally_reserved":0,"allocated":892928,"data_stored":436681,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574948,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27952,"kb_used_data":936,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717200,"statfs":{"total":95995035648,"available":95966412800,"internally_reserved":0,"allocated":958464,"data_stored":500933,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738472,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36228,"kb_used_data":892,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708924,"statfs":{"total":95995035648,"available":95957938176,"internally_reserved":0,"allocated":913408,"data_stored":437952,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411422,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27976,"kb_used_data":960,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717176,"statfs":{"total":95995035648,"available":95966388224,"internally_reserved":0,"allocated":983040,"data_stored":502815,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":25,"seq":107374182488,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27904,"kb_used_data":888,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717248,"statfs":{"total":95995035648,"available":95966461952,"internally_reserved":0,"allocated":909312,"data_stored":436992,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":31,"seq":133143986259,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36212,"kb_used_data":876,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708940,"statfs":{"total":95995035648,"available":95957954560,"internally_reserved":0,"allocated":897024,"data_stored":437650,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":36,"seq":154618822733,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28492,"kb_used_data":1476,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716660,"statfs":{"total":95995035648,"available":95965859840,"internally_reserved":0,"allocated":1511424,"data_stored":1028967,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":64459,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":66341,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1176,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":2008,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2856,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":106496,"data_stored":66569,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-08T05:27:49.629 DEBUG:teuthology.orchestra.run.smithi087:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid eeeb813e-0cf9-11ef-bc97-c7b262605968 -- ceph pg dump --format=json 2024-05-08T05:27:50.121 INFO:teuthology.orchestra.run.smithi087.stderr:Inferring config /var/lib/ceph/eeeb813e-0cf9-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T05:27:50.958 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:27:50 smithi087 ceph-mon[29523]: from='client.14700 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-05-08T05:27:50.959 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:27:50 smithi087 ceph-mon[29523]: pgmap v385: 97 pgs: 97 active+clean; 644 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-05-08T05:27:50.983 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:27:50 smithi090 ceph-mon[34526]: from='client.14700 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-05-08T05:27:50.983 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:27:50 smithi090 ceph-mon[34526]: pgmap v385: 97 pgs: 97 active+clean; 644 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-05-08T05:27:51.039 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:27:50 smithi160 ceph-mon[34827]: from='client.14700 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-05-08T05:27:51.039 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:27:50 smithi160 ceph-mon[34827]: pgmap v385: 97 pgs: 97 active+clean; 644 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-05-08T05:27:52.164 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:52.163+0000 7f08bc600700 1 -- 172.21.15.87:0/508093444 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f08b4108850 msgr2=0x7f08b41103d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:27:52.164 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:52.163+0000 7f08bc600700 1 --2- 172.21.15.87:0/508093444 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f08b4108850 0x7f08b41103d0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f08ac00b0d0 tx=0x7f08ac00b3e0 comp rx=0 tx=0).stop 2024-05-08T05:27:52.165 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:52.163+0000 7f08bc600700 1 -- 172.21.15.87:0/508093444 shutdown_connections 2024-05-08T05:27:52.165 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:52.163+0000 7f08bc600700 1 --2- 172.21.15.87:0/508093444 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f08b4108850 0x7f08b41103d0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:27:52.165 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:52.163+0000 7f08bc600700 1 --2- 172.21.15.87:0/508093444 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f08b4103750 0x7f08b4103b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:27:52.165 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:52.163+0000 7f08bc600700 1 --2- 172.21.15.87:0/508093444 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f08b4104100 0x7f08b4108120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:27:52.165 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:52.163+0000 7f08bc600700 1 -- 172.21.15.87:0/508093444 >> 172.21.15.87:0/508093444 conn(0x7f08b407a600 msgr2=0x7f08b407aa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:27:52.165 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:52.163+0000 7f08bc600700 1 -- 172.21.15.87:0/508093444 shutdown_connections 2024-05-08T05:27:52.165 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:52.163+0000 7f08bc600700 1 -- 172.21.15.87:0/508093444 wait complete. 2024-05-08T05:27:52.166 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:52.164+0000 7f08bc600700 1 Processor -- start 2024-05-08T05:27:52.166 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:52.165+0000 7f08bc600700 1 -- start start 2024-05-08T05:27:52.167 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:52.165+0000 7f08bc600700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f08b4103750 0x7f08b41a1900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:27:52.167 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:52.165+0000 7f08bc600700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f08b4104100 0x7f08b41a1e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:27:52.167 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:52.165+0000 7f08bc600700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f08b4108850 0x7f08b419beb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:27:52.167 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:52.165+0000 7f08bc600700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f08b4075fd0 con 0x7f08b4104100 2024-05-08T05:27:52.167 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:52.165+0000 7f08bc600700 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f08b4075e50 con 0x7f08b4103750 2024-05-08T05:27:52.167 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:52.165+0000 7f08bc600700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f08b4076150 con 0x7f08b4108850 2024-05-08T05:27:52.167 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:52.165+0000 7f08b9200700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f08b4104100 0x7f08b41a1e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:27:52.167 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:52.165+0000 7f08ba600700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f08b4108850 0x7f08b419beb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:27:52.167 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:52.165+0000 7f08b9c00700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f08b4103750 0x7f08b41a1900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:27:52.167 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:52.165+0000 7f08b9200700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f08b4104100 0x7f08b41a1e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:37406/0 (socket says 172.21.15.87:37406) 2024-05-08T05:27:52.167 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:52.165+0000 7f08b9200700 1 -- 172.21.15.87:0/315992629 learned_addr learned my addr 172.21.15.87:0/315992629 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T05:27:52.167 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:52.166+0000 7f08ba600700 1 -- 172.21.15.87:0/315992629 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f08b4103750 msgr2=0x7f08b41a1900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:27:52.167 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:52.166+0000 7f08ba600700 1 --2- 172.21.15.87:0/315992629 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f08b4103750 0x7f08b41a1900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:27:52.167 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:52.166+0000 7f08ba600700 1 -- 172.21.15.87:0/315992629 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f08b4104100 msgr2=0x7f08b41a1e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:27:52.167 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:52.166+0000 7f08ba600700 1 --2- 172.21.15.87:0/315992629 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f08b4104100 0x7f08b41a1e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:27:52.168 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:52.166+0000 7f08ba600700 1 -- 172.21.15.87:0/315992629 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f08b419c610 con 0x7f08b4108850 2024-05-08T05:27:52.168 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:52.166+0000 7f08b9c00700 1 --2- 172.21.15.87:0/315992629 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f08b4103750 0x7f08b41a1900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T05:27:52.168 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:52.166+0000 7f08ba600700 1 --2- 172.21.15.87:0/315992629 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f08b4108850 0x7f08b419beb0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f08ac00b770 tx=0x7f08ac007980 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:27:52.168 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:52.166+0000 7f08b2000700 1 -- 172.21.15.87:0/315992629 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08ac01f070 con 0x7f08b4108850 2024-05-08T05:27:52.168 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:52.167+0000 7f08bc600700 1 -- 172.21.15.87:0/315992629 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f08b419c8a0 con 0x7f08b4108850 2024-05-08T05:27:52.168 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:52.167+0000 7f08b2000700 1 -- 172.21.15.87:0/315992629 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f08ac007dc0 con 0x7f08b4108850 2024-05-08T05:27:52.168 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:52.167+0000 7f08b2000700 1 -- 172.21.15.87:0/315992629 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08ac01b430 con 0x7f08b4108850 2024-05-08T05:27:52.169 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:52.167+0000 7f08bc600700 1 -- 172.21.15.87:0/315992629 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f08b41a87d0 con 0x7f08b4108850 2024-05-08T05:27:52.169 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:52.168+0000 7f08bc600700 1 -- 172.21.15.87:0/315992629 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f08b406a190 con 0x7f08b4108850 2024-05-08T05:27:52.170 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:52.170+0000 7f08b2000700 1 -- 172.21.15.87:0/315992629 <== mon.1 v2:172.21.15.160:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7f08ac022070 con 0x7f08b4108850 2024-05-08T05:27:52.173 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:52.171+0000 7f08b2000700 1 --2- 172.21.15.87:0/315992629 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f089c0b2900 0x7f089c0b4dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:27:52.173 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:52.172+0000 7f08b2000700 1 -- 172.21.15.87:0/315992629 <== mon.1 v2:172.21.15.160:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8190+0+0 (secure 0 0 0) 0x7f08ac00f020 con 0x7f08b4108850 2024-05-08T05:27:52.173 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:52.172+0000 7f08b9c00700 1 --2- 172.21.15.87:0/315992629 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f089c0b2900 0x7f089c0b4dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:27:52.173 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:52.172+0000 7f08b9c00700 1 --2- 172.21.15.87:0/315992629 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f089c0b2900 0x7f089c0b4dc0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f08b4110650 tx=0x7f08a8009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:27:52.174 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:52.174+0000 7f08b2000700 1 -- 172.21.15.87:0/315992629 <== mon.1 v2:172.21.15.160:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f08ac029020 con 0x7f08b4108850 2024-05-08T05:27:52.401 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:52.400+0000 7f08bc600700 1 -- 172.21.15.87:0/315992629 --> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f08b4102c40 con 0x7f089c0b2900 2024-05-08T05:27:52.415 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:52.414+0000 7f08b2000700 1 -- 172.21.15.87:0/315992629 <== mgr.14152 v2:172.21.15.87:6800/1189186457 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258804 (secure 0 0 0) 0x7f08b4102c40 con 0x7f089c0b2900 2024-05-08T05:27:52.420 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-05-08T05:27:52.422 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:52.421+0000 7f08bc600700 1 -- 172.21.15.87:0/315992629 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f089c0b2900 msgr2=0x7f089c0b4dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:27:52.422 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:52.421+0000 7f08bc600700 1 --2- 172.21.15.87:0/315992629 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f089c0b2900 0x7f089c0b4dc0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f08b4110650 tx=0x7f08a8009260 comp rx=0 tx=0).stop 2024-05-08T05:27:52.422 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:52.421+0000 7f08bc600700 1 -- 172.21.15.87:0/315992629 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f08b4108850 msgr2=0x7f08b419beb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:27:52.422 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:52.421+0000 7f08bc600700 1 --2- 172.21.15.87:0/315992629 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f08b4108850 0x7f08b419beb0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f08ac00b770 tx=0x7f08ac007980 comp rx=0 tx=0).stop 2024-05-08T05:27:52.422 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:52.422+0000 7f08bc600700 1 -- 172.21.15.87:0/315992629 shutdown_connections 2024-05-08T05:27:52.423 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:52.422+0000 7f08bc600700 1 --2- 172.21.15.87:0/315992629 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f089c0b2900 0x7f089c0b4dc0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:27:52.423 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:52.422+0000 7f08bc600700 1 --2- 172.21.15.87:0/315992629 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f08b4108850 0x7f08b419beb0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:27:52.423 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:52.422+0000 7f08bc600700 1 --2- 172.21.15.87:0/315992629 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f08b4103750 0x7f08b41a1900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:27:52.423 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:52.422+0000 7f08bc600700 1 --2- 172.21.15.87:0/315992629 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f08b4104100 0x7f08b41a1e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:27:52.423 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:52.422+0000 7f08bc600700 1 -- 172.21.15.87:0/315992629 >> 172.21.15.87:0/315992629 conn(0x7f08b407a600 msgr2=0x7f08b4107070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:27:52.423 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:52.422+0000 7f08bc600700 1 -- 172.21.15.87:0/315992629 shutdown_connections 2024-05-08T05:27:52.423 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:52.422+0000 7f08bc600700 1 -- 172.21.15.87:0/315992629 wait complete. 2024-05-08T05:27:52.423 INFO:teuthology.orchestra.run.smithi087.stderr:dumped all 2024-05-08T05:27:52.708 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:27:52 smithi087 ceph-mon[29523]: pgmap v386: 97 pgs: 97 active+clean; 644 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-05-08T05:27:52.983 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:27:52 smithi090 ceph-mon[34526]: pgmap v386: 97 pgs: 97 active+clean; 644 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-05-08T05:27:53.038 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:27:52 smithi160 ceph-mon[34827]: pgmap v386: 97 pgs: 97 active+clean; 644 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-05-08T05:27:53.234 INFO:teuthology.orchestra.run.smithi087.stdout:{"pg_ready":true,"pg_map":{"version":386,"stamp":"2024-05-08T05:27:50.942154+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":659735,"num_objects":64,"num_object_clones":0,"num_object_copies":192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":784,"num_read_kb":492,"num_write":300,"num_write_kb":2274,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":13,"num_bytes_recovered":2951840,"num_keys_recovered":10,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":744,"ondisk_log_size":744,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":382504,"kb_used_data":12552,"kb_used_omap":18,"kb_used_meta":369837,"kb_avail":1124559320,"statfs":{"total":1151940427776,"available":1151548743680,"internally_reserved":0,"allocated":12853248,"data_stored":7216893,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19143,"internal_metadata":378713401},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":59,"num_read_kb":29,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004605"},"pg_stats":[{"pgid":"3.3f","version":"82'8","reported_seq":27,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:27:22.911792+0000","last_change":"2024-05-08T05:25:34.073030+0000","last_active":"2024-05-08T05:27:22.911792+0000","last_peered":"2024-05-08T05:27:22.911792+0000","last_clean":"2024-05-08T05:27:22.911792+0000","last_became_active":"2024-05-08T05:25:34.072593+0000","last_became_peered":"2024-05-08T05:25:34.072593+0000","last_unstale":"2024-05-08T05:27:22.911792+0000","last_undegraded":"2024-05-08T05:27:22.911792+0000","last_fullsized":"2024-05-08T05:27:22.911792+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_clean_scrub_stamp":"2024-05-08T05:25:33.008741+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T09:46:17.507034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"82'4","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:27:22.908973+0000","last_change":"2024-05-08T05:25:34.071436+0000","last_active":"2024-05-08T05:27:22.908973+0000","last_peered":"2024-05-08T05:27:22.908973+0000","last_clean":"2024-05-08T05:27:22.908973+0000","last_became_active":"2024-05-08T05:25:34.070985+0000","last_became_peered":"2024-05-08T05:25:34.070985+0000","last_unstale":"2024-05-08T05:27:22.908973+0000","last_undegraded":"2024-05-08T05:27:22.908973+0000","last_fullsized":"2024-05-08T05:27:22.908973+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_clean_scrub_stamp":"2024-05-08T05:25:33.008741+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T10:59:01.312978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"82'7","reported_seq":28,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:27:22.916059+0000","last_change":"2024-05-08T05:25:34.057180+0000","last_active":"2024-05-08T05:27:22.916059+0000","last_peered":"2024-05-08T05:27:22.916059+0000","last_clean":"2024-05-08T05:27:22.916059+0000","last_became_active":"2024-05-08T05:25:34.056775+0000","last_became_peered":"2024-05-08T05:25:34.056775+0000","last_unstale":"2024-05-08T05:27:22.916059+0000","last_undegraded":"2024-05-08T05:27:22.916059+0000","last_fullsized":"2024-05-08T05:27:22.916059+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_clean_scrub_stamp":"2024-05-08T05:25:33.008741+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T13:13:34.389793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"82'8","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:27:22.898318+0000","last_change":"2024-05-08T05:25:34.053102+0000","last_active":"2024-05-08T05:27:22.898318+0000","last_peered":"2024-05-08T05:27:22.898318+0000","last_clean":"2024-05-08T05:27:22.898318+0000","last_became_active":"2024-05-08T05:25:34.052736+0000","last_became_peered":"2024-05-08T05:25:34.052736+0000","last_unstale":"2024-05-08T05:27:22.898318+0000","last_undegraded":"2024-05-08T05:27:22.898318+0000","last_fullsized":"2024-05-08T05:27:22.898318+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_clean_scrub_stamp":"2024-05-08T05:25:33.008741+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T13:05:02.665370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"82'4","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:27:22.900360+0000","last_change":"2024-05-08T05:25:34.070073+0000","last_active":"2024-05-08T05:27:22.900360+0000","last_peered":"2024-05-08T05:27:22.900360+0000","last_clean":"2024-05-08T05:27:22.900360+0000","last_became_active":"2024-05-08T05:25:34.069660+0000","last_became_peered":"2024-05-08T05:25:34.069660+0000","last_unstale":"2024-05-08T05:27:22.900360+0000","last_undegraded":"2024-05-08T05:27:22.900360+0000","last_fullsized":"2024-05-08T05:27:22.900360+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_clean_scrub_stamp":"2024-05-08T05:25:33.008741+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T12:37:10.599082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"82'6","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:27:22.897742+0000","last_change":"2024-05-08T05:25:34.057928+0000","last_active":"2024-05-08T05:27:22.897742+0000","last_peered":"2024-05-08T05:27:22.897742+0000","last_clean":"2024-05-08T05:27:22.897742+0000","last_became_active":"2024-05-08T05:25:34.057538+0000","last_became_peered":"2024-05-08T05:25:34.057538+0000","last_unstale":"2024-05-08T05:27:22.897742+0000","last_undegraded":"2024-05-08T05:27:22.897742+0000","last_fullsized":"2024-05-08T05:27:22.897742+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_clean_scrub_stamp":"2024-05-08T05:25:33.008741+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T12:22:49.920889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"82'5","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:27:22.899885+0000","last_change":"2024-05-08T05:25:34.055439+0000","last_active":"2024-05-08T05:27:22.899885+0000","last_peered":"2024-05-08T05:27:22.899885+0000","last_clean":"2024-05-08T05:27:22.899885+0000","last_became_active":"2024-05-08T05:25:34.055002+0000","last_became_peered":"2024-05-08T05:25:34.055002+0000","last_unstale":"2024-05-08T05:27:22.899885+0000","last_undegraded":"2024-05-08T05:27:22.899885+0000","last_fullsized":"2024-05-08T05:27:22.899885+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_clean_scrub_stamp":"2024-05-08T05:25:33.008741+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T11:29:00.482681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"82'9","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:27:22.912670+0000","last_change":"2024-05-08T05:25:34.058943+0000","last_active":"2024-05-08T05:27:22.912670+0000","last_peered":"2024-05-08T05:27:22.912670+0000","last_clean":"2024-05-08T05:27:22.912670+0000","last_became_active":"2024-05-08T05:25:34.058200+0000","last_became_peered":"2024-05-08T05:25:34.058200+0000","last_unstale":"2024-05-08T05:27:22.912670+0000","last_undegraded":"2024-05-08T05:27:22.912670+0000","last_fullsized":"2024-05-08T05:27:22.912670+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_clean_scrub_stamp":"2024-05-08T05:25:33.008741+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T11:13:23.019489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"82'11","reported_seq":31,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:27:22.905443+0000","last_change":"2024-05-08T05:25:34.053948+0000","last_active":"2024-05-08T05:27:22.905443+0000","last_peered":"2024-05-08T05:27:22.905443+0000","last_clean":"2024-05-08T05:27:22.905443+0000","last_became_active":"2024-05-08T05:25:34.053601+0000","last_became_peered":"2024-05-08T05:25:34.053601+0000","last_unstale":"2024-05-08T05:27:22.905443+0000","last_undegraded":"2024-05-08T05:27:22.905443+0000","last_fullsized":"2024-05-08T05:27:22.905443+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_clean_scrub_stamp":"2024-05-08T05:25:33.008741+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T05:50:44.228628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"82'16","reported_seq":36,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:27:22.898605+0000","last_change":"2024-05-08T05:25:34.053167+0000","last_active":"2024-05-08T05:27:22.898605+0000","last_peered":"2024-05-08T05:27:22.898605+0000","last_clean":"2024-05-08T05:27:22.898605+0000","last_became_active":"2024-05-08T05:25:34.052425+0000","last_became_peered":"2024-05-08T05:25:34.052425+0000","last_unstale":"2024-05-08T05:27:22.898605+0000","last_undegraded":"2024-05-08T05:27:22.898605+0000","last_fullsized":"2024-05-08T05:27:22.898605+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_clean_scrub_stamp":"2024-05-08T05:25:33.008741+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T10:56:28.599966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"82'6","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:27:22.905148+0000","last_change":"2024-05-08T05:25:34.057677+0000","last_active":"2024-05-08T05:27:22.905148+0000","last_peered":"2024-05-08T05:27:22.905148+0000","last_clean":"2024-05-08T05:27:22.905148+0000","last_became_active":"2024-05-08T05:25:34.054800+0000","last_became_peered":"2024-05-08T05:25:34.054800+0000","last_unstale":"2024-05-08T05:27:22.905148+0000","last_undegraded":"2024-05-08T05:27:22.905148+0000","last_fullsized":"2024-05-08T05:27:22.905148+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_clean_scrub_stamp":"2024-05-08T05:25:33.008741+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T07:41:55.836901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"82'7","reported_seq":27,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:27:22.896350+0000","last_change":"2024-05-08T05:25:34.051744+0000","last_active":"2024-05-08T05:27:22.896350+0000","last_peered":"2024-05-08T05:27:22.896350+0000","last_clean":"2024-05-08T05:27:22.896350+0000","last_became_active":"2024-05-08T05:25:34.051395+0000","last_became_peered":"2024-05-08T05:25:34.051395+0000","last_unstale":"2024-05-08T05:27:22.896350+0000","last_undegraded":"2024-05-08T05:27:22.896350+0000","last_fullsized":"2024-05-08T05:27:22.896350+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_clean_scrub_stamp":"2024-05-08T05:25:33.008741+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T07:58:52.674899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"82'10","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:27:22.913129+0000","last_change":"2024-05-08T05:25:34.053197+0000","last_active":"2024-05-08T05:27:22.913129+0000","last_peered":"2024-05-08T05:27:22.913129+0000","last_clean":"2024-05-08T05:27:22.913129+0000","last_became_active":"2024-05-08T05:25:34.052331+0000","last_became_peered":"2024-05-08T05:25:34.052331+0000","last_unstale":"2024-05-08T05:27:22.913129+0000","last_undegraded":"2024-05-08T05:27:22.913129+0000","last_fullsized":"2024-05-08T05:27:22.913129+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_clean_scrub_stamp":"2024-05-08T05:25:33.008741+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T07:19:12.524722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"82'7","reported_seq":27,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:27:22.900593+0000","last_change":"2024-05-08T05:25:34.070242+0000","last_active":"2024-05-08T05:27:22.900593+0000","last_peered":"2024-05-08T05:27:22.900593+0000","last_clean":"2024-05-08T05:27:22.900593+0000","last_became_active":"2024-05-08T05:25:34.069580+0000","last_became_peered":"2024-05-08T05:25:34.069580+0000","last_unstale":"2024-05-08T05:27:22.900593+0000","last_undegraded":"2024-05-08T05:27:22.900593+0000","last_fullsized":"2024-05-08T05:27:22.900593+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_clean_scrub_stamp":"2024-05-08T05:25:33.008741+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T06:33:25.099470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"82'7","reported_seq":27,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:27:22.908263+0000","last_change":"2024-05-08T05:25:34.067174+0000","last_active":"2024-05-08T05:27:22.908263+0000","last_peered":"2024-05-08T05:27:22.908263+0000","last_clean":"2024-05-08T05:27:22.908263+0000","last_became_active":"2024-05-08T05:25:34.066811+0000","last_became_peered":"2024-05-08T05:25:34.066811+0000","last_unstale":"2024-05-08T05:27:22.908263+0000","last_undegraded":"2024-05-08T05:27:22.908263+0000","last_fullsized":"2024-05-08T05:27:22.908263+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_clean_scrub_stamp":"2024-05-08T05:25:33.008741+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T16:17:57.731620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"82'9","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:27:22.918664+0000","last_change":"2024-05-08T05:25:34.064339+0000","last_active":"2024-05-08T05:27:22.918664+0000","last_peered":"2024-05-08T05:27:22.918664+0000","last_clean":"2024-05-08T05:27:22.918664+0000","last_became_active":"2024-05-08T05:25:34.063994+0000","last_became_peered":"2024-05-08T05:25:34.063994+0000","last_unstale":"2024-05-08T05:27:22.918664+0000","last_undegraded":"2024-05-08T05:27:22.918664+0000","last_fullsized":"2024-05-08T05:27:22.918664+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_clean_scrub_stamp":"2024-05-08T05:25:33.008741+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T17:09:34.443411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"82'8","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:27:22.911647+0000","last_change":"2024-05-08T05:25:34.073029+0000","last_active":"2024-05-08T05:27:22.911647+0000","last_peered":"2024-05-08T05:27:22.911647+0000","last_clean":"2024-05-08T05:27:22.911647+0000","last_became_active":"2024-05-08T05:25:34.072491+0000","last_became_peered":"2024-05-08T05:25:34.072491+0000","last_unstale":"2024-05-08T05:27:22.911647+0000","last_undegraded":"2024-05-08T05:27:22.911647+0000","last_fullsized":"2024-05-08T05:27:22.911647+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_clean_scrub_stamp":"2024-05-08T05:25:33.008741+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T10:22:25.304349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"82'10","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:27:22.897233+0000","last_change":"2024-05-08T05:25:34.061439+0000","last_active":"2024-05-08T05:27:22.897233+0000","last_peered":"2024-05-08T05:27:22.897233+0000","last_clean":"2024-05-08T05:27:22.897233+0000","last_became_active":"2024-05-08T05:25:34.058275+0000","last_became_peered":"2024-05-08T05:25:34.058275+0000","last_unstale":"2024-05-08T05:27:22.897233+0000","last_undegraded":"2024-05-08T05:27:22.897233+0000","last_fullsized":"2024-05-08T05:27:22.897233+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_clean_scrub_stamp":"2024-05-08T05:25:33.008741+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T14:04:32.433114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"82'7","reported_seq":28,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:27:22.903102+0000","last_change":"2024-05-08T05:25:34.061463+0000","last_active":"2024-05-08T05:27:22.903102+0000","last_peered":"2024-05-08T05:27:22.903102+0000","last_clean":"2024-05-08T05:27:22.903102+0000","last_became_active":"2024-05-08T05:25:34.060891+0000","last_became_peered":"2024-05-08T05:25:34.060891+0000","last_unstale":"2024-05-08T05:27:22.903102+0000","last_undegraded":"2024-05-08T05:27:22.903102+0000","last_fullsized":"2024-05-08T05:27:22.903102+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_clean_scrub_stamp":"2024-05-08T05:25:33.008741+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T06:42:17.741180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1f","version":"80'9","reported_seq":37,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:26:24.134584+0000","last_change":"2024-05-08T05:25:30.003956+0000","last_active":"2024-05-08T05:26:24.134584+0000","last_peered":"2024-05-08T05:26:24.134584+0000","last_clean":"2024-05-08T05:26:24.134584+0000","last_became_active":"2024-05-08T05:25:30.003229+0000","last_became_peered":"2024-05-08T05:25:30.003229+0000","last_unstale":"2024-05-08T05:26:24.134584+0000","last_undegraded":"2024-05-08T05:26:24.134584+0000","last_fullsized":"2024-05-08T05:26:24.134584+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:28.970901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:28.970901+0000","last_clean_scrub_stamp":"2024-05-08T05:25:28.970901+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T15:45:15.168997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"82'5","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:27:22.894722+0000","last_change":"2024-05-08T05:25:34.064917+0000","last_active":"2024-05-08T05:27:22.894722+0000","last_peered":"2024-05-08T05:27:22.894722+0000","last_clean":"2024-05-08T05:27:22.894722+0000","last_became_active":"2024-05-08T05:25:34.064567+0000","last_became_peered":"2024-05-08T05:25:34.064567+0000","last_unstale":"2024-05-08T05:27:22.894722+0000","last_undegraded":"2024-05-08T05:27:22.894722+0000","last_fullsized":"2024-05-08T05:27:22.894722+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_clean_scrub_stamp":"2024-05-08T05:25:33.008741+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T11:15:53.439313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"80'2","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:26:24.124003+0000","last_change":"2024-05-08T05:25:30.358617+0000","last_active":"2024-05-08T05:26:24.124003+0000","last_peered":"2024-05-08T05:26:24.124003+0000","last_clean":"2024-05-08T05:26:24.124003+0000","last_became_active":"2024-05-08T05:25:30.358084+0000","last_became_peered":"2024-05-08T05:25:30.358084+0000","last_unstale":"2024-05-08T05:26:24.124003+0000","last_undegraded":"2024-05-08T05:26:24.124003+0000","last_fullsized":"2024-05-08T05:26:24.124003+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:28.970901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:28.970901+0000","last_clean_scrub_stamp":"2024-05-08T05:25:28.970901+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T16:30:36.151645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"82'6","reported_seq":27,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:27:22.915154+0000","last_change":"2024-05-08T05:25:34.070189+0000","last_active":"2024-05-08T05:27:22.915154+0000","last_peered":"2024-05-08T05:27:22.915154+0000","last_clean":"2024-05-08T05:27:22.915154+0000","last_became_active":"2024-05-08T05:25:34.067644+0000","last_became_peered":"2024-05-08T05:25:34.067644+0000","last_unstale":"2024-05-08T05:27:22.915154+0000","last_undegraded":"2024-05-08T05:27:22.915154+0000","last_fullsized":"2024-05-08T05:27:22.915154+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_clean_scrub_stamp":"2024-05-08T05:25:33.008741+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T07:50:03.938036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"80'4","reported_seq":19,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:26:24.134338+0000","last_change":"2024-05-08T05:26:24.133899+0000","last_active":"2024-05-08T05:26:24.134338+0000","last_peered":"2024-05-08T05:26:24.134338+0000","last_clean":"2024-05-08T05:26:24.134338+0000","last_became_active":"2024-05-08T05:26:24.127975+0000","last_became_peered":"2024-05-08T05:26:24.127975+0000","last_unstale":"2024-05-08T05:26:24.134338+0000","last_undegraded":"2024-05-08T05:26:24.134338+0000","last_fullsized":"2024-05-08T05:26:24.134338+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:28.970901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:28.970901+0000","last_clean_scrub_stamp":"2024-05-08T05:25:28.970901+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T09:52:51.912899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":10,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,7],"acting":[11,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1c","version":"82'9","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:27:22.908502+0000","last_change":"2024-05-08T05:25:34.057034+0000","last_active":"2024-05-08T05:27:22.908502+0000","last_peered":"2024-05-08T05:27:22.908502+0000","last_clean":"2024-05-08T05:27:22.908502+0000","last_became_active":"2024-05-08T05:25:34.056718+0000","last_became_peered":"2024-05-08T05:25:34.056718+0000","last_unstale":"2024-05-08T05:27:22.908502+0000","last_undegraded":"2024-05-08T05:27:22.908502+0000","last_fullsized":"2024-05-08T05:27:22.908502+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_clean_scrub_stamp":"2024-05-08T05:25:33.008741+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T15:30:38.786889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1c","version":"80'2","reported_seq":28,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:26:24.115905+0000","last_change":"2024-05-08T05:25:29.998007+0000","last_active":"2024-05-08T05:26:24.115905+0000","last_peered":"2024-05-08T05:26:24.115905+0000","last_clean":"2024-05-08T05:26:24.115905+0000","last_became_active":"2024-05-08T05:25:29.997565+0000","last_became_peered":"2024-05-08T05:25:29.997565+0000","last_unstale":"2024-05-08T05:26:24.115905+0000","last_undegraded":"2024-05-08T05:26:24.115905+0000","last_fullsized":"2024-05-08T05:26:24.115905+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:28.970901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:28.970901+0000","last_clean_scrub_stamp":"2024-05-08T05:25:28.970901+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T13:40:09.620809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"82'15","reported_seq":35,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:27:22.904900+0000","last_change":"2024-05-08T05:25:34.060136+0000","last_active":"2024-05-08T05:27:22.904900+0000","last_peered":"2024-05-08T05:27:22.904900+0000","last_clean":"2024-05-08T05:27:22.904900+0000","last_became_active":"2024-05-08T05:25:34.059782+0000","last_became_peered":"2024-05-08T05:25:34.059782+0000","last_unstale":"2024-05-08T05:27:22.904900+0000","last_undegraded":"2024-05-08T05:27:22.904900+0000","last_fullsized":"2024-05-08T05:27:22.904900+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_clean_scrub_stamp":"2024-05-08T05:25:33.008741+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T17:07:33.509305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"82'7","reported_seq":149,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:27:46.125606+0000","last_change":"2024-05-08T05:25:30.001356+0000","last_active":"2024-05-08T05:27:46.125606+0000","last_peered":"2024-05-08T05:27:46.125606+0000","last_clean":"2024-05-08T05:27:46.125606+0000","last_became_active":"2024-05-08T05:25:30.000998+0000","last_became_peered":"2024-05-08T05:25:30.000998+0000","last_unstale":"2024-05-08T05:27:46.125606+0000","last_undegraded":"2024-05-08T05:27:46.125606+0000","last_fullsized":"2024-05-08T05:27:46.125606+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:28.970901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:28.970901+0000","last_clean_scrub_stamp":"2024-05-08T05:25:28.970901+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T10:03:27.279982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1154,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":4,"num_write":4,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"82'7","reported_seq":27,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:27:22.881072+0000","last_change":"2024-05-08T05:25:34.056548+0000","last_active":"2024-05-08T05:27:22.881072+0000","last_peered":"2024-05-08T05:27:22.881072+0000","last_clean":"2024-05-08T05:27:22.881072+0000","last_became_active":"2024-05-08T05:25:34.056216+0000","last_became_peered":"2024-05-08T05:25:34.056216+0000","last_unstale":"2024-05-08T05:27:22.881072+0000","last_undegraded":"2024-05-08T05:27:22.881072+0000","last_fullsized":"2024-05-08T05:27:22.881072+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_clean_scrub_stamp":"2024-05-08T05:25:33.008741+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T14:46:05.056610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1a","version":"80'3","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:26:24.127482+0000","last_change":"2024-05-08T05:25:30.009289+0000","last_active":"2024-05-08T05:26:24.127482+0000","last_peered":"2024-05-08T05:26:24.127482+0000","last_clean":"2024-05-08T05:26:24.127482+0000","last_became_active":"2024-05-08T05:25:30.008856+0000","last_became_peered":"2024-05-08T05:25:30.008856+0000","last_unstale":"2024-05-08T05:26:24.127482+0000","last_undegraded":"2024-05-08T05:26:24.127482+0000","last_fullsized":"2024-05-08T05:26:24.127482+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:28.970901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:28.970901+0000","last_clean_scrub_stamp":"2024-05-08T05:25:28.970901+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T10:49:55.857415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"82'8","reported_seq":28,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:27:22.902679+0000","last_change":"2024-05-08T05:25:34.062532+0000","last_active":"2024-05-08T05:27:22.902679+0000","last_peered":"2024-05-08T05:27:22.902679+0000","last_clean":"2024-05-08T05:27:22.902679+0000","last_became_active":"2024-05-08T05:25:34.062246+0000","last_became_peered":"2024-05-08T05:25:34.062246+0000","last_unstale":"2024-05-08T05:27:22.902679+0000","last_undegraded":"2024-05-08T05:27:22.902679+0000","last_fullsized":"2024-05-08T05:27:22.902679+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_clean_scrub_stamp":"2024-05-08T05:25:33.008741+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T07:35:49.149411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"80'2","reported_seq":28,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:26:24.114329+0000","last_change":"2024-05-08T05:25:30.014336+0000","last_active":"2024-05-08T05:26:24.114329+0000","last_peered":"2024-05-08T05:26:24.114329+0000","last_clean":"2024-05-08T05:26:24.114329+0000","last_became_active":"2024-05-08T05:25:30.012147+0000","last_became_peered":"2024-05-08T05:25:30.012147+0000","last_unstale":"2024-05-08T05:26:24.114329+0000","last_undegraded":"2024-05-08T05:26:24.114329+0000","last_fullsized":"2024-05-08T05:26:24.114329+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:28.970901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:28.970901+0000","last_clean_scrub_stamp":"2024-05-08T05:25:28.970901+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T07:48:20.477581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"82'8","reported_seq":28,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:27:22.913219+0000","last_change":"2024-05-08T05:25:34.058947+0000","last_active":"2024-05-08T05:27:22.913219+0000","last_peered":"2024-05-08T05:27:22.913219+0000","last_clean":"2024-05-08T05:27:22.913219+0000","last_became_active":"2024-05-08T05:25:34.058626+0000","last_became_peered":"2024-05-08T05:25:34.058626+0000","last_unstale":"2024-05-08T05:27:22.913219+0000","last_undegraded":"2024-05-08T05:27:22.913219+0000","last_fullsized":"2024-05-08T05:27:22.913219+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_clean_scrub_stamp":"2024-05-08T05:25:33.008741+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T12:55:07.742707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"80'1","reported_seq":27,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:26:24.118080+0000","last_change":"2024-05-08T05:25:29.999201+0000","last_active":"2024-05-08T05:26:24.118080+0000","last_peered":"2024-05-08T05:26:24.118080+0000","last_clean":"2024-05-08T05:26:24.118080+0000","last_became_active":"2024-05-08T05:25:29.998819+0000","last_became_peered":"2024-05-08T05:25:29.998819+0000","last_unstale":"2024-05-08T05:26:24.118080+0000","last_undegraded":"2024-05-08T05:26:24.118080+0000","last_fullsized":"2024-05-08T05:26:24.118080+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:28.970901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:28.970901+0000","last_clean_scrub_stamp":"2024-05-08T05:25:28.970901+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T09:00:02.831877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"82'11","reported_seq":31,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:27:22.906332+0000","last_change":"2024-05-08T05:25:34.063770+0000","last_active":"2024-05-08T05:27:22.906332+0000","last_peered":"2024-05-08T05:27:22.906332+0000","last_clean":"2024-05-08T05:27:22.906332+0000","last_became_active":"2024-05-08T05:25:34.061591+0000","last_became_peered":"2024-05-08T05:25:34.061591+0000","last_unstale":"2024-05-08T05:27:22.906332+0000","last_undegraded":"2024-05-08T05:27:22.906332+0000","last_fullsized":"2024-05-08T05:27:22.906332+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_clean_scrub_stamp":"2024-05-08T05:25:33.008741+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T16:51:06.593857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"82'4","reported_seq":143,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:27:47.126393+0000","last_change":"2024-05-08T05:25:30.005678+0000","last_active":"2024-05-08T05:27:47.126393+0000","last_peered":"2024-05-08T05:27:47.126393+0000","last_clean":"2024-05-08T05:27:47.126393+0000","last_became_active":"2024-05-08T05:25:30.005218+0000","last_became_peered":"2024-05-08T05:25:30.005218+0000","last_unstale":"2024-05-08T05:27:47.126393+0000","last_undegraded":"2024-05-08T05:27:47.126393+0000","last_fullsized":"2024-05-08T05:27:47.126393+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:28.970901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:28.970901+0000","last_clean_scrub_stamp":"2024-05-08T05:25:28.970901+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T11:44:56.720663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":113,"num_read_kb":113,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"82'10","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:27:22.901804+0000","last_change":"2024-05-08T05:25:34.058640+0000","last_active":"2024-05-08T05:27:22.901804+0000","last_peered":"2024-05-08T05:27:22.901804+0000","last_clean":"2024-05-08T05:27:22.901804+0000","last_became_active":"2024-05-08T05:25:34.058332+0000","last_became_peered":"2024-05-08T05:25:34.058332+0000","last_unstale":"2024-05-08T05:27:22.901804+0000","last_undegraded":"2024-05-08T05:27:22.901804+0000","last_fullsized":"2024-05-08T05:27:22.901804+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_clean_scrub_stamp":"2024-05-08T05:25:33.008741+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T09:21:44.273684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"80'2","reported_seq":28,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:26:24.115805+0000","last_change":"2024-05-08T05:25:30.000229+0000","last_active":"2024-05-08T05:26:24.115805+0000","last_peered":"2024-05-08T05:26:24.115805+0000","last_clean":"2024-05-08T05:26:24.115805+0000","last_became_active":"2024-05-08T05:25:29.999888+0000","last_became_peered":"2024-05-08T05:25:29.999888+0000","last_unstale":"2024-05-08T05:26:24.115805+0000","last_undegraded":"2024-05-08T05:26:24.115805+0000","last_fullsized":"2024-05-08T05:26:24.115805+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:28.970901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:28.970901+0000","last_clean_scrub_stamp":"2024-05-08T05:25:28.970901+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T10:28:02.849791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"82'9","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:27:22.918555+0000","last_change":"2024-05-08T05:25:34.069600+0000","last_active":"2024-05-08T05:27:22.918555+0000","last_peered":"2024-05-08T05:27:22.918555+0000","last_clean":"2024-05-08T05:27:22.918555+0000","last_became_active":"2024-05-08T05:25:34.069055+0000","last_became_peered":"2024-05-08T05:25:34.069055+0000","last_unstale":"2024-05-08T05:27:22.918555+0000","last_undegraded":"2024-05-08T05:27:22.918555+0000","last_fullsized":"2024-05-08T05:27:22.918555+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_clean_scrub_stamp":"2024-05-08T05:25:33.008741+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T10:22:31.166719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"80'4","reported_seq":31,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:26:24.118716+0000","last_change":"2024-05-08T05:25:30.360911+0000","last_active":"2024-05-08T05:26:24.118716+0000","last_peered":"2024-05-08T05:26:24.118716+0000","last_clean":"2024-05-08T05:26:24.118716+0000","last_became_active":"2024-05-08T05:25:30.360544+0000","last_became_peered":"2024-05-08T05:25:30.360544+0000","last_unstale":"2024-05-08T05:26:24.118716+0000","last_undegraded":"2024-05-08T05:26:24.118716+0000","last_fullsized":"2024-05-08T05:26:24.118716+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:28.970901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:28.970901+0000","last_clean_scrub_stamp":"2024-05-08T05:25:28.970901+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T17:03:10.633420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"82'11","reported_seq":31,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:27:22.903094+0000","last_change":"2024-05-08T05:25:34.058259+0000","last_active":"2024-05-08T05:27:22.903094+0000","last_peered":"2024-05-08T05:27:22.903094+0000","last_clean":"2024-05-08T05:27:22.903094+0000","last_became_active":"2024-05-08T05:25:34.057912+0000","last_became_peered":"2024-05-08T05:25:34.057912+0000","last_unstale":"2024-05-08T05:27:22.903094+0000","last_undegraded":"2024-05-08T05:27:22.903094+0000","last_fullsized":"2024-05-08T05:27:22.903094+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_clean_scrub_stamp":"2024-05-08T05:25:33.008741+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T14:58:49.311769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"82'34","reported_seq":297,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:27:48.139470+0000","last_change":"2024-05-08T05:25:30.001177+0000","last_active":"2024-05-08T05:27:48.139470+0000","last_peered":"2024-05-08T05:27:48.139470+0000","last_clean":"2024-05-08T05:27:48.139470+0000","last_became_active":"2024-05-08T05:25:30.000769+0000","last_became_peered":"2024-05-08T05:25:30.000769+0000","last_unstale":"2024-05-08T05:27:48.139470+0000","last_undegraded":"2024-05-08T05:27:48.139470+0000","last_fullsized":"2024-05-08T05:27:48.139470+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:28.970901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:28.970901+0000","last_clean_scrub_stamp":"2024-05-08T05:25:28.970901+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T14:40:35.540270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":64459,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":237,"num_read_kb":182,"num_write":35,"num_write_kb":77,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"82'6","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:27:22.888584+0000","last_change":"2024-05-08T05:25:34.053366+0000","last_active":"2024-05-08T05:27:22.888584+0000","last_peered":"2024-05-08T05:27:22.888584+0000","last_clean":"2024-05-08T05:27:22.888584+0000","last_became_active":"2024-05-08T05:25:34.052485+0000","last_became_peered":"2024-05-08T05:25:34.052485+0000","last_unstale":"2024-05-08T05:27:22.888584+0000","last_undegraded":"2024-05-08T05:27:22.888584+0000","last_fullsized":"2024-05-08T05:27:22.888584+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_clean_scrub_stamp":"2024-05-08T05:25:33.008741+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T07:35:05.603319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"80'6","reported_seq":34,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:26:24.115427+0000","last_change":"2024-05-08T05:25:30.010453+0000","last_active":"2024-05-08T05:26:24.115427+0000","last_peered":"2024-05-08T05:26:24.115427+0000","last_clean":"2024-05-08T05:26:24.115427+0000","last_became_active":"2024-05-08T05:25:30.010032+0000","last_became_peered":"2024-05-08T05:25:30.010032+0000","last_unstale":"2024-05-08T05:26:24.115427+0000","last_undegraded":"2024-05-08T05:26:24.115427+0000","last_fullsized":"2024-05-08T05:26:24.115427+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:28.970901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:28.970901+0000","last_clean_scrub_stamp":"2024-05-08T05:25:28.970901+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T16:34:35.052481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"82'9","reported_seq":35,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:27:22.904250+0000","last_change":"2024-05-08T05:26:24.134959+0000","last_active":"2024-05-08T05:27:22.904250+0000","last_peered":"2024-05-08T05:27:22.904250+0000","last_clean":"2024-05-08T05:27:22.904250+0000","last_became_active":"2024-05-08T05:26:24.134487+0000","last_became_peered":"2024-05-08T05:26:24.134487+0000","last_unstale":"2024-05-08T05:27:22.904250+0000","last_undegraded":"2024-05-08T05:27:22.904250+0000","last_fullsized":"2024-05-08T05:27:22.904250+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_clean_scrub_stamp":"2024-05-08T05:25:33.008741+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T06:46:55.131407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,9],"acting":[6,7,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"80'3","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:26:24.118139+0000","last_change":"2024-05-08T05:25:30.009768+0000","last_active":"2024-05-08T05:26:24.118139+0000","last_peered":"2024-05-08T05:26:24.118139+0000","last_clean":"2024-05-08T05:26:24.118139+0000","last_became_active":"2024-05-08T05:25:30.009385+0000","last_became_peered":"2024-05-08T05:25:30.009385+0000","last_unstale":"2024-05-08T05:26:24.118139+0000","last_undegraded":"2024-05-08T05:26:24.118139+0000","last_fullsized":"2024-05-08T05:26:24.118139+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:28.970901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:28.970901+0000","last_clean_scrub_stamp":"2024-05-08T05:25:28.970901+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T07:19:19.556003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"82'15","reported_seq":35,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:27:22.912009+0000","last_change":"2024-05-08T05:25:34.055704+0000","last_active":"2024-05-08T05:27:22.912009+0000","last_peered":"2024-05-08T05:27:22.912009+0000","last_clean":"2024-05-08T05:27:22.912009+0000","last_became_active":"2024-05-08T05:25:34.055339+0000","last_became_peered":"2024-05-08T05:25:34.055339+0000","last_unstale":"2024-05-08T05:27:22.912009+0000","last_undegraded":"2024-05-08T05:27:22.912009+0000","last_fullsized":"2024-05-08T05:27:22.912009+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_clean_scrub_stamp":"2024-05-08T05:25:33.008741+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T07:21:52.579094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"82'5","reported_seq":148,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:27:47.202110+0000","last_change":"2024-05-08T05:25:29.998631+0000","last_active":"2024-05-08T05:27:47.202110+0000","last_peered":"2024-05-08T05:27:47.202110+0000","last_clean":"2024-05-08T05:27:47.202110+0000","last_became_active":"2024-05-08T05:25:29.998216+0000","last_became_peered":"2024-05-08T05:25:29.998216+0000","last_unstale":"2024-05-08T05:27:47.202110+0000","last_undegraded":"2024-05-08T05:27:47.202110+0000","last_fullsized":"2024-05-08T05:27:47.202110+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:28.970901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:28.970901+0000","last_clean_scrub_stamp":"2024-05-08T05:25:28.970901+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T14:16:58.252604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1120,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":118,"num_read_kb":5,"num_write":4,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"82'6","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:27:22.888051+0000","last_change":"2024-05-08T05:25:34.053216+0000","last_active":"2024-05-08T05:27:22.888051+0000","last_peered":"2024-05-08T05:27:22.888051+0000","last_clean":"2024-05-08T05:27:22.888051+0000","last_became_active":"2024-05-08T05:25:34.052908+0000","last_became_peered":"2024-05-08T05:25:34.052908+0000","last_unstale":"2024-05-08T05:27:22.888051+0000","last_undegraded":"2024-05-08T05:27:22.888051+0000","last_fullsized":"2024-05-08T05:27:22.888051+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_clean_scrub_stamp":"2024-05-08T05:25:33.008741+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T13:01:42.574200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"80'15","reported_seq":42,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:26:24.116038+0000","last_change":"2024-05-08T05:25:30.356349+0000","last_active":"2024-05-08T05:26:24.116038+0000","last_peered":"2024-05-08T05:26:24.116038+0000","last_clean":"2024-05-08T05:26:24.116038+0000","last_became_active":"2024-05-08T05:25:30.355892+0000","last_became_peered":"2024-05-08T05:25:30.355892+0000","last_unstale":"2024-05-08T05:26:24.116038+0000","last_undegraded":"2024-05-08T05:26:24.116038+0000","last_fullsized":"2024-05-08T05:26:24.116038+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:28.970901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:28.970901+0000","last_clean_scrub_stamp":"2024-05-08T05:25:28.970901+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T16:54:22.322606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"82'6","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:27:22.896840+0000","last_change":"2024-05-08T05:25:34.062254+0000","last_active":"2024-05-08T05:27:22.896840+0000","last_peered":"2024-05-08T05:27:22.896840+0000","last_clean":"2024-05-08T05:27:22.896840+0000","last_became_active":"2024-05-08T05:25:34.061928+0000","last_became_peered":"2024-05-08T05:25:34.061928+0000","last_unstale":"2024-05-08T05:27:22.896840+0000","last_undegraded":"2024-05-08T05:27:22.896840+0000","last_fullsized":"2024-05-08T05:27:22.896840+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_clean_scrub_stamp":"2024-05-08T05:25:33.008741+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T14:58:17.135661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"80'2","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:26:24.116424+0000","last_change":"2024-05-08T05:25:30.001434+0000","last_active":"2024-05-08T05:26:24.116424+0000","last_peered":"2024-05-08T05:26:24.116424+0000","last_clean":"2024-05-08T05:26:24.116424+0000","last_became_active":"2024-05-08T05:25:30.000900+0000","last_became_peered":"2024-05-08T05:25:30.000900+0000","last_unstale":"2024-05-08T05:26:24.116424+0000","last_undegraded":"2024-05-08T05:26:24.116424+0000","last_fullsized":"2024-05-08T05:26:24.116424+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:28.970901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:28.970901+0000","last_clean_scrub_stamp":"2024-05-08T05:25:28.970901+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T11:47:18.031222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"82'5","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:27:22.888849+0000","last_change":"2024-05-08T05:25:34.057101+0000","last_active":"2024-05-08T05:27:22.888849+0000","last_peered":"2024-05-08T05:27:22.888849+0000","last_clean":"2024-05-08T05:27:22.888849+0000","last_became_active":"2024-05-08T05:25:34.056742+0000","last_became_peered":"2024-05-08T05:25:34.056742+0000","last_unstale":"2024-05-08T05:27:22.888849+0000","last_undegraded":"2024-05-08T05:27:22.888849+0000","last_fullsized":"2024-05-08T05:27:22.888849+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_clean_scrub_stamp":"2024-05-08T05:25:33.008741+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T14:19:22.997586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":27,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:26:24.133876+0000","last_change":"2024-05-08T05:25:30.359474+0000","last_active":"2024-05-08T05:26:24.133876+0000","last_peered":"2024-05-08T05:26:24.133876+0000","last_clean":"2024-05-08T05:26:24.133876+0000","last_became_active":"2024-05-08T05:25:30.358971+0000","last_became_peered":"2024-05-08T05:25:30.358971+0000","last_unstale":"2024-05-08T05:26:24.133876+0000","last_undegraded":"2024-05-08T05:26:24.133876+0000","last_fullsized":"2024-05-08T05:26:24.133876+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:28.970901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:28.970901+0000","last_clean_scrub_stamp":"2024-05-08T05:25:28.970901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T12:51:42.239112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"82'5","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:27:22.909599+0000","last_change":"2024-05-08T05:25:34.061014+0000","last_active":"2024-05-08T05:27:22.909599+0000","last_peered":"2024-05-08T05:27:22.909599+0000","last_clean":"2024-05-08T05:27:22.909599+0000","last_became_active":"2024-05-08T05:25:34.060682+0000","last_became_peered":"2024-05-08T05:25:34.060682+0000","last_unstale":"2024-05-08T05:27:22.909599+0000","last_undegraded":"2024-05-08T05:27:22.909599+0000","last_fullsized":"2024-05-08T05:27:22.909599+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_clean_scrub_stamp":"2024-05-08T05:25:33.008741+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T13:19:48.652257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"80'1","reported_seq":28,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:26:24.116079+0000","last_change":"2024-05-08T05:25:30.009360+0000","last_active":"2024-05-08T05:26:24.116079+0000","last_peered":"2024-05-08T05:26:24.116079+0000","last_clean":"2024-05-08T05:26:24.116079+0000","last_became_active":"2024-05-08T05:25:30.008806+0000","last_became_peered":"2024-05-08T05:25:30.008806+0000","last_unstale":"2024-05-08T05:26:24.116079+0000","last_undegraded":"2024-05-08T05:26:24.116079+0000","last_fullsized":"2024-05-08T05:26:24.116079+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:28.970901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:28.970901+0000","last_clean_scrub_stamp":"2024-05-08T05:25:28.970901+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T11:19:45.905803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"82'7","reported_seq":28,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:27:22.902064+0000","last_change":"2024-05-08T05:25:34.065415+0000","last_active":"2024-05-08T05:27:22.902064+0000","last_peered":"2024-05-08T05:27:22.902064+0000","last_clean":"2024-05-08T05:27:22.902064+0000","last_became_active":"2024-05-08T05:25:34.065017+0000","last_became_peered":"2024-05-08T05:25:34.065017+0000","last_unstale":"2024-05-08T05:27:22.902064+0000","last_undegraded":"2024-05-08T05:27:22.902064+0000","last_fullsized":"2024-05-08T05:27:22.902064+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_clean_scrub_stamp":"2024-05-08T05:25:33.008741+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T14:46:34.518792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.0","version":"82'8","reported_seq":35,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:27:22.887996+0000","last_change":"2024-05-08T05:26:24.120480+0000","last_active":"2024-05-08T05:27:22.887996+0000","last_peered":"2024-05-08T05:27:22.887996+0000","last_clean":"2024-05-08T05:27:22.887996+0000","last_became_active":"2024-05-08T05:26:24.120031+0000","last_became_peered":"2024-05-08T05:26:24.120031+0000","last_unstale":"2024-05-08T05:27:22.887996+0000","last_undegraded":"2024-05-08T05:27:22.887996+0000","last_fullsized":"2024-05-08T05:27:22.887996+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_clean_scrub_stamp":"2024-05-08T05:25:33.008741+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T09:24:18.149796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,8],"acting":[5,2,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"82'5","reported_seq":143,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:27:45.197395+0000","last_change":"2024-05-08T05:25:30.356178+0000","last_active":"2024-05-08T05:27:45.197395+0000","last_peered":"2024-05-08T05:27:45.197395+0000","last_clean":"2024-05-08T05:27:45.197395+0000","last_became_active":"2024-05-08T05:25:30.355750+0000","last_became_peered":"2024-05-08T05:25:30.355750+0000","last_unstale":"2024-05-08T05:27:45.197395+0000","last_undegraded":"2024-05-08T05:27:45.197395+0000","last_fullsized":"2024-05-08T05:27:45.197395+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:28.970901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:28.970901+0000","last_clean_scrub_stamp":"2024-05-08T05:25:28.970901+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T05:57:35.174274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":111,"num_read_kb":111,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"82'8","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:27:22.906527+0000","last_change":"2024-05-08T05:25:34.068189+0000","last_active":"2024-05-08T05:27:22.906527+0000","last_peered":"2024-05-08T05:27:22.906527+0000","last_clean":"2024-05-08T05:27:22.906527+0000","last_became_active":"2024-05-08T05:25:34.064398+0000","last_became_peered":"2024-05-08T05:25:34.064398+0000","last_unstale":"2024-05-08T05:27:22.906527+0000","last_undegraded":"2024-05-08T05:27:22.906527+0000","last_fullsized":"2024-05-08T05:27:22.906527+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_clean_scrub_stamp":"2024-05-08T05:25:33.008741+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T10:27:31.050126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"80'3","reported_seq":32,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:26:24.126812+0000","last_change":"2024-05-08T05:25:30.005110+0000","last_active":"2024-05-08T05:26:24.126812+0000","last_peered":"2024-05-08T05:26:24.126812+0000","last_clean":"2024-05-08T05:26:24.126812+0000","last_became_active":"2024-05-08T05:25:30.004703+0000","last_became_peered":"2024-05-08T05:25:30.004703+0000","last_unstale":"2024-05-08T05:26:24.126812+0000","last_undegraded":"2024-05-08T05:26:24.126812+0000","last_fullsized":"2024-05-08T05:26:24.126812+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:28.970901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:28.970901+0000","last_clean_scrub_stamp":"2024-05-08T05:25:28.970901+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T12:49:21.174417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"21'92","reported_seq":101,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:26:24.115653+0000","last_change":"2024-05-08T05:23:59.731023+0000","last_active":"2024-05-08T05:26:24.115653+0000","last_peered":"2024-05-08T05:26:24.115653+0000","last_clean":"2024-05-08T05:26:24.115653+0000","last_became_active":"2024-05-08T05:23:59.725321+0000","last_became_peered":"2024-05-08T05:23:59.725321+0000","last_unstale":"2024-05-08T05:26:24.115653+0000","last_undegraded":"2024-05-08T05:26:24.115653+0000","last_fullsized":"2024-05-08T05:26:24.115653+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:20:09.357011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:20:09.357011+0000","last_clean_scrub_stamp":"2024-05-08T05:20:09.357011+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T09:50:58.729815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"82'5","reported_seq":32,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:27:22.899430+0000","last_change":"2024-05-08T05:26:24.131360+0000","last_active":"2024-05-08T05:27:22.899430+0000","last_peered":"2024-05-08T05:27:22.899430+0000","last_clean":"2024-05-08T05:27:22.899430+0000","last_became_active":"2024-05-08T05:26:24.130480+0000","last_became_peered":"2024-05-08T05:26:24.130480+0000","last_unstale":"2024-05-08T05:27:22.899430+0000","last_undegraded":"2024-05-08T05:27:22.899430+0000","last_fullsized":"2024-05-08T05:27:22.899430+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_clean_scrub_stamp":"2024-05-08T05:25:33.008741+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T09:26:32.515332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,9,2],"acting":[6,9,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"80'3","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:26:24.115792+0000","last_change":"2024-05-08T05:25:29.999659+0000","last_active":"2024-05-08T05:26:24.115792+0000","last_peered":"2024-05-08T05:26:24.115792+0000","last_clean":"2024-05-08T05:26:24.115792+0000","last_became_active":"2024-05-08T05:25:29.999299+0000","last_became_peered":"2024-05-08T05:25:29.999299+0000","last_unstale":"2024-05-08T05:26:24.115792+0000","last_undegraded":"2024-05-08T05:26:24.115792+0000","last_fullsized":"2024-05-08T05:26:24.115792+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:28.970901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:28.970901+0000","last_clean_scrub_stamp":"2024-05-08T05:25:28.970901+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T11:20:16.513402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"80'1","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:26:24.116094+0000","last_change":"2024-05-08T05:25:30.360940+0000","last_active":"2024-05-08T05:26:24.116094+0000","last_peered":"2024-05-08T05:26:24.116094+0000","last_clean":"2024-05-08T05:26:24.116094+0000","last_became_active":"2024-05-08T05:25:30.360507+0000","last_became_peered":"2024-05-08T05:25:30.360507+0000","last_unstale":"2024-05-08T05:26:24.116094+0000","last_undegraded":"2024-05-08T05:26:24.116094+0000","last_fullsized":"2024-05-08T05:26:24.116094+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:28.970901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:28.970901+0000","last_clean_scrub_stamp":"2024-05-08T05:25:28.970901+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T06:49:39.271211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"82'9","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:27:22.902224+0000","last_change":"2024-05-08T05:25:34.056952+0000","last_active":"2024-05-08T05:27:22.902224+0000","last_peered":"2024-05-08T05:27:22.902224+0000","last_clean":"2024-05-08T05:27:22.902224+0000","last_became_active":"2024-05-08T05:25:34.056495+0000","last_became_peered":"2024-05-08T05:25:34.056495+0000","last_unstale":"2024-05-08T05:27:22.902224+0000","last_undegraded":"2024-05-08T05:27:22.902224+0000","last_fullsized":"2024-05-08T05:27:22.902224+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_clean_scrub_stamp":"2024-05-08T05:25:33.008741+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T09:35:22.540178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"82'12","reported_seq":39,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:27:23.101526+0000","last_change":"2024-05-08T05:25:30.008967+0000","last_active":"2024-05-08T05:27:23.101526+0000","last_peered":"2024-05-08T05:27:23.101526+0000","last_clean":"2024-05-08T05:27:23.101526+0000","last_became_active":"2024-05-08T05:25:30.007542+0000","last_became_peered":"2024-05-08T05:25:30.007542+0000","last_unstale":"2024-05-08T05:27:23.101526+0000","last_undegraded":"2024-05-08T05:27:23.101526+0000","last_fullsized":"2024-05-08T05:27:23.101526+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:28.970901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:28.970901+0000","last_clean_scrub_stamp":"2024-05-08T05:25:28.970901+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T05:29:30.191842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"82'5","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:27:22.902209+0000","last_change":"2024-05-08T05:25:34.054334+0000","last_active":"2024-05-08T05:27:22.902209+0000","last_peered":"2024-05-08T05:27:22.902209+0000","last_clean":"2024-05-08T05:27:22.902209+0000","last_became_active":"2024-05-08T05:25:34.053989+0000","last_became_peered":"2024-05-08T05:25:34.053989+0000","last_unstale":"2024-05-08T05:27:22.902209+0000","last_undegraded":"2024-05-08T05:27:22.902209+0000","last_fullsized":"2024-05-08T05:27:22.902209+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_clean_scrub_stamp":"2024-05-08T05:25:33.008741+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T09:03:25.683445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"80'4","reported_seq":31,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:26:24.127039+0000","last_change":"2024-05-08T05:25:30.007144+0000","last_active":"2024-05-08T05:26:24.127039+0000","last_peered":"2024-05-08T05:26:24.127039+0000","last_clean":"2024-05-08T05:26:24.127039+0000","last_became_active":"2024-05-08T05:25:30.006878+0000","last_became_peered":"2024-05-08T05:25:30.006878+0000","last_unstale":"2024-05-08T05:26:24.127039+0000","last_undegraded":"2024-05-08T05:26:24.127039+0000","last_fullsized":"2024-05-08T05:26:24.127039+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:28.970901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:28.970901+0000","last_clean_scrub_stamp":"2024-05-08T05:25:28.970901+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T07:06:35.573001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"82'7","reported_seq":28,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:27:22.914063+0000","last_change":"2024-05-08T05:25:34.073744+0000","last_active":"2024-05-08T05:27:22.914063+0000","last_peered":"2024-05-08T05:27:22.914063+0000","last_clean":"2024-05-08T05:27:22.914063+0000","last_became_active":"2024-05-08T05:25:34.073368+0000","last_became_peered":"2024-05-08T05:25:34.073368+0000","last_unstale":"2024-05-08T05:27:22.914063+0000","last_undegraded":"2024-05-08T05:27:22.914063+0000","last_fullsized":"2024-05-08T05:27:22.914063+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_clean_scrub_stamp":"2024-05-08T05:25:33.008741+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T10:43:31.480745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"80'2","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:26:24.112998+0000","last_change":"2024-05-08T05:25:30.356584+0000","last_active":"2024-05-08T05:26:24.112998+0000","last_peered":"2024-05-08T05:26:24.112998+0000","last_clean":"2024-05-08T05:26:24.112998+0000","last_became_active":"2024-05-08T05:25:30.356203+0000","last_became_peered":"2024-05-08T05:25:30.356203+0000","last_unstale":"2024-05-08T05:26:24.112998+0000","last_undegraded":"2024-05-08T05:26:24.112998+0000","last_fullsized":"2024-05-08T05:26:24.112998+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:28.970901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:28.970901+0000","last_clean_scrub_stamp":"2024-05-08T05:25:28.970901+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T14:35:21.193856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"82'2","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:27:22.887903+0000","last_change":"2024-05-08T05:25:34.053168+0000","last_active":"2024-05-08T05:27:22.887903+0000","last_peered":"2024-05-08T05:27:22.887903+0000","last_clean":"2024-05-08T05:27:22.887903+0000","last_became_active":"2024-05-08T05:25:34.052875+0000","last_became_peered":"2024-05-08T05:25:34.052875+0000","last_unstale":"2024-05-08T05:27:22.887903+0000","last_undegraded":"2024-05-08T05:27:22.887903+0000","last_fullsized":"2024-05-08T05:27:22.887903+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_clean_scrub_stamp":"2024-05-08T05:25:33.008741+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T07:38:40.129212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"80'3","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:26:24.121861+0000","last_change":"2024-05-08T05:25:30.009113+0000","last_active":"2024-05-08T05:26:24.121861+0000","last_peered":"2024-05-08T05:26:24.121861+0000","last_clean":"2024-05-08T05:26:24.121861+0000","last_became_active":"2024-05-08T05:25:30.007605+0000","last_became_peered":"2024-05-08T05:25:30.007605+0000","last_unstale":"2024-05-08T05:26:24.121861+0000","last_undegraded":"2024-05-08T05:26:24.121861+0000","last_fullsized":"2024-05-08T05:26:24.121861+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:28.970901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:28.970901+0000","last_clean_scrub_stamp":"2024-05-08T05:25:28.970901+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T10:06:05.177516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"82'9","reported_seq":28,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:27:22.911359+0000","last_change":"2024-05-08T05:25:34.072765+0000","last_active":"2024-05-08T05:27:22.911359+0000","last_peered":"2024-05-08T05:27:22.911359+0000","last_clean":"2024-05-08T05:27:22.911359+0000","last_became_active":"2024-05-08T05:25:34.072381+0000","last_became_peered":"2024-05-08T05:25:34.072381+0000","last_unstale":"2024-05-08T05:27:22.911359+0000","last_undegraded":"2024-05-08T05:27:22.911359+0000","last_fullsized":"2024-05-08T05:27:22.911359+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_clean_scrub_stamp":"2024-05-08T05:25:33.008741+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T11:55:21.046126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"80'1","reported_seq":15,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:26:24.125393+0000","last_change":"2024-05-08T05:26:24.124762+0000","last_active":"2024-05-08T05:26:24.125393+0000","last_peered":"2024-05-08T05:26:24.125393+0000","last_clean":"2024-05-08T05:26:24.125393+0000","last_became_active":"2024-05-08T05:26:24.121235+0000","last_became_peered":"2024-05-08T05:26:24.121235+0000","last_unstale":"2024-05-08T05:26:24.125393+0000","last_undegraded":"2024-05-08T05:26:24.125393+0000","last_fullsized":"2024-05-08T05:26:24.125393+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:28.970901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:28.970901+0000","last_clean_scrub_stamp":"2024-05-08T05:25:28.970901+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T16:08:17.650335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,3,8],"acting":[11,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.b","version":"82'8","reported_seq":28,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:27:22.911392+0000","last_change":"2024-05-08T05:25:34.071097+0000","last_active":"2024-05-08T05:27:22.911392+0000","last_peered":"2024-05-08T05:27:22.911392+0000","last_clean":"2024-05-08T05:27:22.911392+0000","last_became_active":"2024-05-08T05:25:34.070635+0000","last_became_peered":"2024-05-08T05:25:34.070635+0000","last_unstale":"2024-05-08T05:27:22.911392+0000","last_undegraded":"2024-05-08T05:27:22.911392+0000","last_fullsized":"2024-05-08T05:27:22.911392+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_clean_scrub_stamp":"2024-05-08T05:25:33.008741+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T13:33:17.217958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"80'4","reported_seq":32,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:26:24.116727+0000","last_change":"2024-05-08T05:25:30.002043+0000","last_active":"2024-05-08T05:26:24.116727+0000","last_peered":"2024-05-08T05:26:24.116727+0000","last_clean":"2024-05-08T05:26:24.116727+0000","last_became_active":"2024-05-08T05:25:30.001624+0000","last_became_peered":"2024-05-08T05:25:30.001624+0000","last_unstale":"2024-05-08T05:26:24.116727+0000","last_undegraded":"2024-05-08T05:26:24.116727+0000","last_fullsized":"2024-05-08T05:26:24.116727+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:28.970901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:28.970901+0000","last_clean_scrub_stamp":"2024-05-08T05:25:28.970901+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T07:20:34.740005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"82'5","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:27:22.910044+0000","last_change":"2024-05-08T05:25:34.057883+0000","last_active":"2024-05-08T05:27:22.910044+0000","last_peered":"2024-05-08T05:27:22.910044+0000","last_clean":"2024-05-08T05:27:22.910044+0000","last_became_active":"2024-05-08T05:25:34.056651+0000","last_became_peered":"2024-05-08T05:25:34.056651+0000","last_unstale":"2024-05-08T05:27:22.910044+0000","last_undegraded":"2024-05-08T05:27:22.910044+0000","last_fullsized":"2024-05-08T05:27:22.910044+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_clean_scrub_stamp":"2024-05-08T05:25:33.008741+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T16:52:46.598847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"80'3","reported_seq":31,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:26:24.116077+0000","last_change":"2024-05-08T05:25:30.356166+0000","last_active":"2024-05-08T05:26:24.116077+0000","last_peered":"2024-05-08T05:26:24.116077+0000","last_clean":"2024-05-08T05:26:24.116077+0000","last_became_active":"2024-05-08T05:25:30.355730+0000","last_became_peered":"2024-05-08T05:25:30.355730+0000","last_unstale":"2024-05-08T05:26:24.116077+0000","last_undegraded":"2024-05-08T05:26:24.116077+0000","last_fullsized":"2024-05-08T05:26:24.116077+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:28.970901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:28.970901+0000","last_clean_scrub_stamp":"2024-05-08T05:25:28.970901+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T05:47:47.743725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"82'7","reported_seq":28,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:27:22.905417+0000","last_change":"2024-05-08T05:25:34.058005+0000","last_active":"2024-05-08T05:27:22.905417+0000","last_peered":"2024-05-08T05:27:22.905417+0000","last_clean":"2024-05-08T05:27:22.905417+0000","last_became_active":"2024-05-08T05:25:34.056319+0000","last_became_peered":"2024-05-08T05:25:34.056319+0000","last_unstale":"2024-05-08T05:27:22.905417+0000","last_undegraded":"2024-05-08T05:27:22.905417+0000","last_fullsized":"2024-05-08T05:27:22.905417+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_clean_scrub_stamp":"2024-05-08T05:25:33.008741+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T07:04:22.726450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"80'1","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:26:24.118635+0000","last_change":"2024-05-08T05:25:30.009641+0000","last_active":"2024-05-08T05:26:24.118635+0000","last_peered":"2024-05-08T05:26:24.118635+0000","last_clean":"2024-05-08T05:26:24.118635+0000","last_became_active":"2024-05-08T05:25:30.009244+0000","last_became_peered":"2024-05-08T05:25:30.009244+0000","last_unstale":"2024-05-08T05:26:24.118635+0000","last_undegraded":"2024-05-08T05:26:24.118635+0000","last_fullsized":"2024-05-08T05:26:24.118635+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:28.970901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:28.970901+0000","last_clean_scrub_stamp":"2024-05-08T05:25:28.970901+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T17:15:50.982103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"82'7","reported_seq":28,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:27:22.909297+0000","last_change":"2024-05-08T05:25:34.059603+0000","last_active":"2024-05-08T05:27:22.909297+0000","last_peered":"2024-05-08T05:27:22.909297+0000","last_clean":"2024-05-08T05:27:22.909297+0000","last_became_active":"2024-05-08T05:25:34.059260+0000","last_became_peered":"2024-05-08T05:25:34.059260+0000","last_unstale":"2024-05-08T05:27:22.909297+0000","last_undegraded":"2024-05-08T05:27:22.909297+0000","last_fullsized":"2024-05-08T05:27:22.909297+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_clean_scrub_stamp":"2024-05-08T05:25:33.008741+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T07:47:32.723829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"80'2","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:26:24.117157+0000","last_change":"2024-05-08T05:25:30.013326+0000","last_active":"2024-05-08T05:26:24.117157+0000","last_peered":"2024-05-08T05:26:24.117157+0000","last_clean":"2024-05-08T05:26:24.117157+0000","last_became_active":"2024-05-08T05:25:30.012868+0000","last_became_peered":"2024-05-08T05:25:30.012868+0000","last_unstale":"2024-05-08T05:26:24.117157+0000","last_undegraded":"2024-05-08T05:26:24.117157+0000","last_fullsized":"2024-05-08T05:26:24.117157+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:28.970901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:28.970901+0000","last_clean_scrub_stamp":"2024-05-08T05:25:28.970901+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T14:09:14.210180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"82'9","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:27:22.891022+0000","last_change":"2024-05-08T05:25:34.052621+0000","last_active":"2024-05-08T05:27:22.891022+0000","last_peered":"2024-05-08T05:27:22.891022+0000","last_clean":"2024-05-08T05:27:22.891022+0000","last_became_active":"2024-05-08T05:25:34.052289+0000","last_became_peered":"2024-05-08T05:25:34.052289+0000","last_unstale":"2024-05-08T05:27:22.891022+0000","last_undegraded":"2024-05-08T05:27:22.891022+0000","last_fullsized":"2024-05-08T05:27:22.891022+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_clean_scrub_stamp":"2024-05-08T05:25:33.008741+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T16:37:19.327915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"82'9","reported_seq":28,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:27:22.890913+0000","last_change":"2024-05-08T05:25:34.057918+0000","last_active":"2024-05-08T05:27:22.890913+0000","last_peered":"2024-05-08T05:27:22.890913+0000","last_clean":"2024-05-08T05:27:22.890913+0000","last_became_active":"2024-05-08T05:25:34.057455+0000","last_became_peered":"2024-05-08T05:25:34.057455+0000","last_unstale":"2024-05-08T05:27:22.890913+0000","last_undegraded":"2024-05-08T05:27:22.890913+0000","last_fullsized":"2024-05-08T05:27:22.890913+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_clean_scrub_stamp":"2024-05-08T05:25:33.008741+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T11:36:49.027414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"82'12","reported_seq":33,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:27:22.903184+0000","last_change":"2024-05-08T05:25:34.055114+0000","last_active":"2024-05-08T05:27:22.903184+0000","last_peered":"2024-05-08T05:27:22.903184+0000","last_clean":"2024-05-08T05:27:22.903184+0000","last_became_active":"2024-05-08T05:25:34.054448+0000","last_became_peered":"2024-05-08T05:25:34.054448+0000","last_unstale":"2024-05-08T05:27:22.903184+0000","last_undegraded":"2024-05-08T05:27:22.903184+0000","last_fullsized":"2024-05-08T05:27:22.903184+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_clean_scrub_stamp":"2024-05-08T05:25:33.008741+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T15:19:54.872779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"82'8","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:27:22.915661+0000","last_change":"2024-05-08T05:25:34.064199+0000","last_active":"2024-05-08T05:27:22.915661+0000","last_peered":"2024-05-08T05:27:22.915661+0000","last_clean":"2024-05-08T05:27:22.915661+0000","last_became_active":"2024-05-08T05:25:34.063888+0000","last_became_peered":"2024-05-08T05:25:34.063888+0000","last_unstale":"2024-05-08T05:27:22.915661+0000","last_undegraded":"2024-05-08T05:27:22.915661+0000","last_fullsized":"2024-05-08T05:27:22.915661+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_clean_scrub_stamp":"2024-05-08T05:25:33.008741+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T13:18:15.146769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"82'7","reported_seq":28,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:27:22.918372+0000","last_change":"2024-05-08T05:25:34.070526+0000","last_active":"2024-05-08T05:27:22.918372+0000","last_peered":"2024-05-08T05:27:22.918372+0000","last_clean":"2024-05-08T05:27:22.918372+0000","last_became_active":"2024-05-08T05:25:34.069890+0000","last_became_peered":"2024-05-08T05:25:34.069890+0000","last_unstale":"2024-05-08T05:27:22.918372+0000","last_undegraded":"2024-05-08T05:27:22.918372+0000","last_fullsized":"2024-05-08T05:27:22.918372+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_clean_scrub_stamp":"2024-05-08T05:25:33.008741+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T16:17:56.986221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"82'4","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:27:22.916202+0000","last_change":"2024-05-08T05:25:34.067033+0000","last_active":"2024-05-08T05:27:22.916202+0000","last_peered":"2024-05-08T05:27:22.916202+0000","last_clean":"2024-05-08T05:27:22.916202+0000","last_became_active":"2024-05-08T05:25:34.066492+0000","last_became_peered":"2024-05-08T05:25:34.066492+0000","last_unstale":"2024-05-08T05:27:22.916202+0000","last_undegraded":"2024-05-08T05:27:22.916202+0000","last_fullsized":"2024-05-08T05:27:22.916202+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_clean_scrub_stamp":"2024-05-08T05:25:33.008741+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T07:30:10.450504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"82'6","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:27:22.888388+0000","last_change":"2024-05-08T05:25:34.056525+0000","last_active":"2024-05-08T05:27:22.888388+0000","last_peered":"2024-05-08T05:27:22.888388+0000","last_clean":"2024-05-08T05:27:22.888388+0000","last_became_active":"2024-05-08T05:25:34.056190+0000","last_became_peered":"2024-05-08T05:25:34.056190+0000","last_unstale":"2024-05-08T05:27:22.888388+0000","last_undegraded":"2024-05-08T05:27:22.888388+0000","last_fullsized":"2024-05-08T05:27:22.888388+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_clean_scrub_stamp":"2024-05-08T05:25:33.008741+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T13:13:57.716642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"82'15","reported_seq":36,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:27:22.905265+0000","last_change":"2024-05-08T05:25:34.055643+0000","last_active":"2024-05-08T05:27:22.905265+0000","last_peered":"2024-05-08T05:27:22.905265+0000","last_clean":"2024-05-08T05:27:22.905265+0000","last_became_active":"2024-05-08T05:25:34.054886+0000","last_became_peered":"2024-05-08T05:25:34.054886+0000","last_unstale":"2024-05-08T05:27:22.905265+0000","last_undegraded":"2024-05-08T05:27:22.905265+0000","last_fullsized":"2024-05-08T05:27:22.905265+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_clean_scrub_stamp":"2024-05-08T05:25:33.008741+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T05:53:41.130484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"82'2","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:27:22.908627+0000","last_change":"2024-05-08T05:25:34.056932+0000","last_active":"2024-05-08T05:27:22.908627+0000","last_peered":"2024-05-08T05:27:22.908627+0000","last_clean":"2024-05-08T05:27:22.908627+0000","last_became_active":"2024-05-08T05:25:34.055473+0000","last_became_peered":"2024-05-08T05:25:34.055473+0000","last_unstale":"2024-05-08T05:27:22.908627+0000","last_undegraded":"2024-05-08T05:27:22.908627+0000","last_fullsized":"2024-05-08T05:27:22.908627+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_clean_scrub_stamp":"2024-05-08T05:25:33.008741+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T16:16:13.748056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"82'6","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:27:22.911787+0000","last_change":"2024-05-08T05:26:24.134794+0000","last_active":"2024-05-08T05:27:22.911787+0000","last_peered":"2024-05-08T05:27:22.911787+0000","last_clean":"2024-05-08T05:27:22.911787+0000","last_became_active":"2024-05-08T05:26:24.133586+0000","last_became_peered":"2024-05-08T05:26:24.133586+0000","last_unstale":"2024-05-08T05:27:22.911787+0000","last_undegraded":"2024-05-08T05:27:22.911787+0000","last_fullsized":"2024-05-08T05:27:22.911787+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_clean_scrub_stamp":"2024-05-08T05:25:33.008741+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T15:03:05.432689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,9,3],"acting":[6,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.29","version":"82'8","reported_seq":28,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:27:22.907538+0000","last_change":"2024-05-08T05:25:34.065000+0000","last_active":"2024-05-08T05:27:22.907538+0000","last_peered":"2024-05-08T05:27:22.907538+0000","last_clean":"2024-05-08T05:27:22.907538+0000","last_became_active":"2024-05-08T05:25:34.057748+0000","last_became_peered":"2024-05-08T05:25:34.057748+0000","last_unstale":"2024-05-08T05:27:22.907538+0000","last_undegraded":"2024-05-08T05:27:22.907538+0000","last_fullsized":"2024-05-08T05:27:22.907538+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_clean_scrub_stamp":"2024-05-08T05:25:33.008741+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T15:33:41.411507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"82'10","reported_seq":31,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:27:22.910969+0000","last_change":"2024-05-08T05:25:34.066601+0000","last_active":"2024-05-08T05:27:22.910969+0000","last_peered":"2024-05-08T05:27:22.910969+0000","last_clean":"2024-05-08T05:27:22.910969+0000","last_became_active":"2024-05-08T05:25:34.066226+0000","last_became_peered":"2024-05-08T05:25:34.066226+0000","last_unstale":"2024-05-08T05:27:22.910969+0000","last_undegraded":"2024-05-08T05:27:22.910969+0000","last_fullsized":"2024-05-08T05:27:22.910969+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_clean_scrub_stamp":"2024-05-08T05:25:33.008741+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T15:27:54.180580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"82'11","reported_seq":31,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:27:22.918983+0000","last_change":"2024-05-08T05:25:34.073520+0000","last_active":"2024-05-08T05:27:22.918983+0000","last_peered":"2024-05-08T05:27:22.918983+0000","last_clean":"2024-05-08T05:27:22.918983+0000","last_became_active":"2024-05-08T05:25:34.072250+0000","last_became_peered":"2024-05-08T05:25:34.072250+0000","last_unstale":"2024-05-08T05:27:22.918983+0000","last_undegraded":"2024-05-08T05:27:22.918983+0000","last_fullsized":"2024-05-08T05:27:22.918983+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_clean_scrub_stamp":"2024-05-08T05:25:33.008741+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T08:17:36.181338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"82'8","reported_seq":32,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:27:22.894971+0000","last_change":"2024-05-08T05:26:24.134964+0000","last_active":"2024-05-08T05:27:22.894971+0000","last_peered":"2024-05-08T05:27:22.894971+0000","last_clean":"2024-05-08T05:27:22.894971+0000","last_became_active":"2024-05-08T05:26:24.134583+0000","last_became_peered":"2024-05-08T05:26:24.134583+0000","last_unstale":"2024-05-08T05:27:22.894971+0000","last_undegraded":"2024-05-08T05:27:22.894971+0000","last_fullsized":"2024-05-08T05:27:22.894971+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_clean_scrub_stamp":"2024-05-08T05:25:33.008741+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T16:09:52.525461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,8],"acting":[11,9,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":502,"ondisk_log_size":502,"up":192,"acting":192,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":3563520,"data_stored":3542208,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":92,"ondisk_log_size":92,"up":3,"acting":3,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":69133,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":708,"num_read_kb":428,"num_write":175,"num_write_kb":122,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":10,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":430080,"data_stored":207399,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":150,"ondisk_log_size":150,"up":96,"acting":96,"num_store_stats":12}],"osd_stats":[{"osd":11,"up_from":72,"seq":309237645355,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27884,"kb_used_data":868,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717268,"statfs":{"total":95995035648,"available":95966482432,"internally_reserved":0,"allocated":888832,"data_stored":437056,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":66,"seq":283467841586,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36888,"kb_used_data":1552,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708264,"statfs":{"total":95995035648,"available":95957262336,"internally_reserved":0,"allocated":1589248,"data_stored":1093528,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":36174272},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":60,"seq":257698037814,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32060,"kb_used_data":884,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713092,"statfs":{"total":95995035648,"available":95962206208,"internally_reserved":0,"allocated":905216,"data_stored":437292,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":31914432},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":54,"seq":231928234044,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27900,"kb_used_data":884,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717252,"statfs":{"total":95995035648,"available":95966466048,"internally_reserved":0,"allocated":905216,"data_stored":437212,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":48,"seq":206158430275,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36800,"kb_used_data":1464,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708352,"statfs":{"total":95995035648,"available":95957352448,"internally_reserved":0,"allocated":1499136,"data_stored":1029815,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":36174282},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":42,"seq":180388626504,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36208,"kb_used_data":872,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708944,"statfs":{"total":95995035648,"available":95957958656,"internally_reserved":0,"allocated":892928,"data_stored":436681,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574949,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27952,"kb_used_data":936,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717200,"statfs":{"total":95995035648,"available":95966412800,"internally_reserved":0,"allocated":958464,"data_stored":500933,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738473,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36228,"kb_used_data":892,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708924,"statfs":{"total":95995035648,"available":95957938176,"internally_reserved":0,"allocated":913408,"data_stored":437952,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411423,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27976,"kb_used_data":960,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717176,"statfs":{"total":95995035648,"available":95966388224,"internally_reserved":0,"allocated":983040,"data_stored":502815,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":25,"seq":107374182488,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27904,"kb_used_data":888,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717248,"statfs":{"total":95995035648,"available":95966461952,"internally_reserved":0,"allocated":909312,"data_stored":436992,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":31,"seq":133143986260,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36212,"kb_used_data":876,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708940,"statfs":{"total":95995035648,"available":95957954560,"internally_reserved":0,"allocated":897024,"data_stored":437650,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":36,"seq":154618822734,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28492,"kb_used_data":1476,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716660,"statfs":{"total":95995035648,"available":95965859840,"internally_reserved":0,"allocated":1511424,"data_stored":1028967,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":64459,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":66341,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1176,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":2008,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2856,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":106496,"data_stored":66569,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-08T05:27:53.238 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2024-05-08T05:27:53.238 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-05-08T05:27:53.238 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy 2024-05-08T05:27:53.238 DEBUG:teuthology.orchestra.run.smithi087:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid eeeb813e-0cf9-11ef-bc97-c7b262605968 -- ceph health --format=json 2024-05-08T05:27:53.718 INFO:teuthology.orchestra.run.smithi087.stderr:Inferring config /var/lib/ceph/eeeb813e-0cf9-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T05:27:53.864 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:27:53 smithi087 ceph-mon[29523]: from='client.24805 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-05-08T05:27:53.983 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:27:53 smithi090 ceph-mon[34526]: from='client.24805 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-05-08T05:27:54.038 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:27:53 smithi160 ceph-mon[34827]: from='client.24805 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-05-08T05:27:54.851 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:27:54 smithi087 ceph-mon[29523]: pgmap v387: 97 pgs: 97 active+clean; 644 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s 2024-05-08T05:27:54.983 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:27:54 smithi090 ceph-mon[34526]: pgmap v387: 97 pgs: 97 active+clean; 644 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s 2024-05-08T05:27:55.039 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:27:54 smithi160 ceph-mon[34827]: pgmap v387: 97 pgs: 97 active+clean; 644 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s 2024-05-08T05:27:55.829 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:55.828+0000 7f8f0e400700 1 -- 172.21.15.87:0/2465372093 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8f08108850 msgr2=0x7f8f081103d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:27:55.829 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:55.828+0000 7f8f0e400700 1 --2- 172.21.15.87:0/2465372093 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8f08108850 0x7f8f081103d0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f8f0000b0d0 tx=0x7f8f0000b3e0 comp rx=0 tx=0).stop 2024-05-08T05:27:55.829 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:55.828+0000 7f8f0e400700 1 -- 172.21.15.87:0/2465372093 shutdown_connections 2024-05-08T05:27:55.829 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:55.828+0000 7f8f0e400700 1 --2- 172.21.15.87:0/2465372093 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8f08108850 0x7f8f081103d0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:27:55.830 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:55.828+0000 7f8f0e400700 1 --2- 172.21.15.87:0/2465372093 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8f08103750 0x7f8f08103b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:27:55.830 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:55.828+0000 7f8f0e400700 1 --2- 172.21.15.87:0/2465372093 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f8f08104100 0x7f8f08108120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:27:55.830 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:55.828+0000 7f8f0e400700 1 -- 172.21.15.87:0/2465372093 >> 172.21.15.87:0/2465372093 conn(0x7f8f0807a600 msgr2=0x7f8f0807aa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:27:55.830 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:55.828+0000 7f8f0e400700 1 -- 172.21.15.87:0/2465372093 shutdown_connections 2024-05-08T05:27:55.830 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:55.828+0000 7f8f0e400700 1 -- 172.21.15.87:0/2465372093 wait complete. 2024-05-08T05:27:55.831 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:55.829+0000 7f8f0e400700 1 Processor -- start 2024-05-08T05:27:55.831 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:55.829+0000 7f8f0e400700 1 -- start start 2024-05-08T05:27:55.831 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:55.830+0000 7f8f0e400700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f8f08103750 0x7f8f081a1a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:27:55.831 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:55.830+0000 7f8f0e400700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8f08104100 0x7f8f081a1f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:27:55.831 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:55.830+0000 7f8f0e400700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8f08108850 0x7f8f0819bb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:27:55.832 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:55.830+0000 7f8f0e400700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f8f08113620 con 0x7f8f08108850 2024-05-08T05:27:55.832 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:55.830+0000 7f8f0e400700 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f8f081134a0 con 0x7f8f08104100 2024-05-08T05:27:55.832 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:55.830+0000 7f8f0e400700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f8f081137a0 con 0x7f8f08103750 2024-05-08T05:27:55.832 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:55.830+0000 7f8effe00700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8f08104100 0x7f8f081a1f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:27:55.832 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:55.830+0000 7f8f07e00700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8f08108850 0x7f8f0819bb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:27:55.832 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:55.830+0000 7f8effe00700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8f08104100 0x7f8f081a1f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.87:36978/0 (socket says 172.21.15.87:36978) 2024-05-08T05:27:55.832 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:55.830+0000 7f8f07400700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f8f08103750 0x7f8f081a1a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:27:55.832 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:55.830+0000 7f8effe00700 1 -- 172.21.15.87:0/2374805959 learned_addr learned my addr 172.21.15.87:0/2374805959 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T05:27:55.832 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:55.831+0000 7f8effe00700 1 -- 172.21.15.87:0/2374805959 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f8f08103750 msgr2=0x7f8f081a1a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:27:55.832 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:55.831+0000 7f8effe00700 1 --2- 172.21.15.87:0/2374805959 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f8f08103750 0x7f8f081a1a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:27:55.832 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:55.831+0000 7f8effe00700 1 -- 172.21.15.87:0/2374805959 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8f08108850 msgr2=0x7f8f0819bb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:27:55.832 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:55.831+0000 7f8effe00700 1 --2- 172.21.15.87:0/2374805959 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8f08108850 0x7f8f0819bb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:27:55.832 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:55.831+0000 7f8effe00700 1 -- 172.21.15.87:0/2374805959 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8f0819c440 con 0x7f8f08104100 2024-05-08T05:27:55.832 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:55.831+0000 7f8effe00700 1 --2- 172.21.15.87:0/2374805959 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8f08104100 0x7f8f081a1f80 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f8ef000d980 tx=0x7f8ef000dc90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:27:55.833 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:55.831+0000 7f8f04c00700 1 -- 172.21.15.87:0/2374805959 <== mon.2 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ef0016070 con 0x7f8f08104100 2024-05-08T05:27:55.833 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:55.831+0000 7f8f04c00700 1 -- 172.21.15.87:0/2374805959 <== mon.2 v2:172.21.15.90:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8ef0004830 con 0x7f8f08104100 2024-05-08T05:27:55.833 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:55.831+0000 7f8f0e400700 1 -- 172.21.15.87:0/2374805959 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8f0819c730 con 0x7f8f08104100 2024-05-08T05:27:55.833 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:55.832+0000 7f8f04c00700 1 -- 172.21.15.87:0/2374805959 <== mon.2 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ef0005540 con 0x7f8f08104100 2024-05-08T05:27:55.833 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:55.832+0000 7f8f0e400700 1 -- 172.21.15.87:0/2374805959 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8f081a89c0 con 0x7f8f08104100 2024-05-08T05:27:55.833 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:55.833+0000 7f8f0e400700 1 -- 172.21.15.87:0/2374805959 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8f08104be0 con 0x7f8f08104100 2024-05-08T05:27:55.835 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:55.835+0000 7f8f04c00700 1 -- 172.21.15.87:0/2374805959 <== mon.2 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7f8ef0004220 con 0x7f8f08104100 2024-05-08T05:27:55.836 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:55.836+0000 7f8f04c00700 1 --2- 172.21.15.87:0/2374805959 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f8eec0b2880 0x7f8eec0b4d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:27:55.837 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:55.836+0000 7f8f04c00700 1 -- 172.21.15.87:0/2374805959 <== mon.2 v2:172.21.15.90:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8190+0+0 (secure 0 0 0) 0x7f8ef00e1f70 con 0x7f8f08104100 2024-05-08T05:27:55.837 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:55.837+0000 7f8f07400700 1 --2- 172.21.15.87:0/2374805959 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f8eec0b2880 0x7f8eec0b4d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:27:55.837 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:55.837+0000 7f8f07400700 1 --2- 172.21.15.87:0/2374805959 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f8eec0b2880 0x7f8eec0b4d40 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f8ef8005950 tx=0x7f8ef800b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:27:55.841 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:55.841+0000 7f8f04c00700 1 -- 172.21.15.87:0/2374805959 <== mon.2 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f8ef001f020 con 0x7f8f08104100 2024-05-08T05:27:56.125 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:56.124+0000 7f8f0e400700 1 -- 172.21.15.87:0/2374805959 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f8f081a8b90 con 0x7f8f08104100 2024-05-08T05:27:56.125 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:56.125+0000 7f8f04c00700 1 -- 172.21.15.87:0/2374805959 <== mon.2 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+46 (secure 0 0 0) 0x7f8ef00a9c60 con 0x7f8f08104100 2024-05-08T05:27:56.126 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-05-08T05:27:56.126 INFO:teuthology.orchestra.run.smithi087.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-05-08T05:27:56.128 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:56.128+0000 7f8f0e400700 1 -- 172.21.15.87:0/2374805959 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f8eec0b2880 msgr2=0x7f8eec0b4d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:27:56.129 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:56.128+0000 7f8f0e400700 1 --2- 172.21.15.87:0/2374805959 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f8eec0b2880 0x7f8eec0b4d40 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f8ef8005950 tx=0x7f8ef800b410 comp rx=0 tx=0).stop 2024-05-08T05:27:56.129 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:56.128+0000 7f8f0e400700 1 -- 172.21.15.87:0/2374805959 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8f08104100 msgr2=0x7f8f081a1f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:27:56.129 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:56.128+0000 7f8f0e400700 1 --2- 172.21.15.87:0/2374805959 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8f08104100 0x7f8f081a1f80 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f8ef000d980 tx=0x7f8ef000dc90 comp rx=0 tx=0).stop 2024-05-08T05:27:56.129 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:56.128+0000 7f8f0e400700 1 -- 172.21.15.87:0/2374805959 shutdown_connections 2024-05-08T05:27:56.129 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:56.128+0000 7f8f0e400700 1 --2- 172.21.15.87:0/2374805959 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8f08108850 0x7f8f0819bb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:27:56.130 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:56.128+0000 7f8f0e400700 1 --2- 172.21.15.87:0/2374805959 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f8eec0b2880 0x7f8eec0b4d40 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:27:56.130 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:56.128+0000 7f8f0e400700 1 --2- 172.21.15.87:0/2374805959 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f8f08103750 0x7f8f081a1a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:27:56.130 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:56.128+0000 7f8f0e400700 1 --2- 172.21.15.87:0/2374805959 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8f08104100 0x7f8f081a1f80 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:27:56.130 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:56.128+0000 7f8f0e400700 1 -- 172.21.15.87:0/2374805959 >> 172.21.15.87:0/2374805959 conn(0x7f8f0807a600 msgr2=0x7f8f08101740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:27:56.130 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:56.129+0000 7f8f0e400700 1 -- 172.21.15.87:0/2374805959 shutdown_connections 2024-05-08T05:27:56.130 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:56.129+0000 7f8f0e400700 1 -- 172.21.15.87:0/2374805959 wait complete. 2024-05-08T05:27:56.913 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:27:56 smithi087 ceph-mon[29523]: pgmap v388: 97 pgs: 97 active+clean; 644 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 6 op/s 2024-05-08T05:27:56.913 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:27:56 smithi087 ceph-mon[29523]: from='client.? 172.21.15.87:0/2374805959' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-05-08T05:27:56.976 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy done 2024-05-08T05:27:56.976 DEBUG:teuthology.orchestra.run.smithi087:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid eeeb813e-0cf9-11ef-bc97-c7b262605968 -- ceph fs dump --format=json 2024-05-08T05:27:56.983 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:27:56 smithi090 ceph-mon[34526]: pgmap v388: 97 pgs: 97 active+clean; 644 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 6 op/s 2024-05-08T05:27:56.983 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:27:56 smithi090 ceph-mon[34526]: from='client.? 172.21.15.87:0/2374805959' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-05-08T05:27:57.038 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:27:56 smithi160 ceph-mon[34827]: pgmap v388: 97 pgs: 97 active+clean; 644 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 6 op/s 2024-05-08T05:27:57.039 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:27:56 smithi160 ceph-mon[34827]: from='client.? 172.21.15.87:0/2374805959' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-05-08T05:27:57.430 INFO:teuthology.orchestra.run.smithi087.stderr:Inferring config /var/lib/ceph/eeeb813e-0cf9-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T05:27:58.710 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:27:58 smithi087 ceph-mon[29523]: pgmap v389: 97 pgs: 97 active+clean; 644 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-05-08T05:27:58.983 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:27:58 smithi090 ceph-mon[34526]: pgmap v389: 97 pgs: 97 active+clean; 644 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-05-08T05:27:59.038 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:27:58 smithi160 ceph-mon[34827]: pgmap v389: 97 pgs: 97 active+clean; 644 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-05-08T05:27:59.677 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:59.675+0000 7f074e600700 1 -- 172.21.15.87:0/1102670559 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0748104100 msgr2=0x7f0748108120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:27:59.677 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:59.675+0000 7f074e600700 1 --2- 172.21.15.87:0/1102670559 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0748104100 0x7f0748108120 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f0730009920 tx=0x7f0730009c30 comp rx=0 tx=0).stop 2024-05-08T05:27:59.677 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:59.675+0000 7f074e600700 1 -- 172.21.15.87:0/1102670559 shutdown_connections 2024-05-08T05:27:59.677 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:59.675+0000 7f074e600700 1 --2- 172.21.15.87:0/1102670559 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0748108850 0x7f07481103d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:27:59.677 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:59.675+0000 7f074e600700 1 --2- 172.21.15.87:0/1102670559 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0748103750 0x7f0748103b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:27:59.677 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:59.675+0000 7f074e600700 1 --2- 172.21.15.87:0/1102670559 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0748104100 0x7f0748108120 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:27:59.677 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:59.675+0000 7f074e600700 1 -- 172.21.15.87:0/1102670559 >> 172.21.15.87:0/1102670559 conn(0x7f074807a600 msgr2=0x7f074807aa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:27:59.677 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:59.676+0000 7f074e600700 1 -- 172.21.15.87:0/1102670559 shutdown_connections 2024-05-08T05:27:59.678 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:59.676+0000 7f074e600700 1 -- 172.21.15.87:0/1102670559 wait complete. 2024-05-08T05:27:59.678 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:59.677+0000 7f074e600700 1 Processor -- start 2024-05-08T05:27:59.679 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:59.677+0000 7f074e600700 1 -- start start 2024-05-08T05:27:59.679 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:59.677+0000 7f074e600700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0748103750 0x7f074819f7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:27:59.679 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:59.677+0000 7f074e600700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0748104100 0x7f074819fd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:27:59.680 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:59.677+0000 7f074e600700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0748108850 0x7f07481999a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:27:59.680 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:59.677+0000 7f074e600700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f0748113660 con 0x7f0748103750 2024-05-08T05:27:59.680 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:59.677+0000 7f074e600700 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f07481134e0 con 0x7f0748104100 2024-05-08T05:27:59.680 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:59.677+0000 7f074e600700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f07481137e0 con 0x7f0748108850 2024-05-08T05:27:59.680 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:59.677+0000 7f0747400700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0748103750 0x7f074819f7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:27:59.680 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:59.678+0000 7f0747400700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0748103750 0x7f074819f7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:33252/0 (socket says 172.21.15.87:33252) 2024-05-08T05:27:59.680 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:59.678+0000 7f0747400700 1 -- 172.21.15.87:0/3070252831 learned_addr learned my addr 172.21.15.87:0/3070252831 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T05:27:59.680 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:59.678+0000 7f073ea00700 1 --2- 172.21.15.87:0/3070252831 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0748104100 0x7f074819fd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:27:59.680 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:59.678+0000 7f0747e00700 1 --2- 172.21.15.87:0/3070252831 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0748108850 0x7f07481999a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:27:59.680 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:59.678+0000 7f0747400700 1 -- 172.21.15.87:0/3070252831 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0748108850 msgr2=0x7f07481999a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:27:59.680 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:59.678+0000 7f0747400700 1 --2- 172.21.15.87:0/3070252831 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0748108850 0x7f07481999a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:27:59.680 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:59.678+0000 7f0747400700 1 -- 172.21.15.87:0/3070252831 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0748104100 msgr2=0x7f074819fd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:27:59.680 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:59.678+0000 7f0747400700 1 --2- 172.21.15.87:0/3070252831 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0748104100 0x7f074819fd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:27:59.681 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:59.678+0000 7f0747400700 1 -- 172.21.15.87:0/3070252831 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f074819a100 con 0x7f0748103750 2024-05-08T05:27:59.681 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:59.678+0000 7f073ea00700 1 --2- 172.21.15.87:0/3070252831 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0748104100 0x7f074819fd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T05:27:59.681 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:59.678+0000 7f0747e00700 1 --2- 172.21.15.87:0/3070252831 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0748108850 0x7f07481999a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T05:27:59.681 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:59.678+0000 7f0747400700 1 --2- 172.21.15.87:0/3070252831 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0748103750 0x7f074819f7e0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f073800c370 tx=0x7f073800c680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:27:59.681 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:59.679+0000 7f0744c00700 1 -- 172.21.15.87:0/3070252831 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f073800cea0 con 0x7f0748103750 2024-05-08T05:27:59.681 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:59.679+0000 7f0744c00700 1 -- 172.21.15.87:0/3070252831 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f07380090d0 con 0x7f0748103750 2024-05-08T05:27:59.681 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:59.679+0000 7f074e600700 1 -- 172.21.15.87:0/3070252831 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f074819a390 con 0x7f0748103750 2024-05-08T05:27:59.681 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:59.679+0000 7f0744c00700 1 -- 172.21.15.87:0/3070252831 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0738004770 con 0x7f0748103750 2024-05-08T05:27:59.681 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:59.679+0000 7f074e600700 1 -- 172.21.15.87:0/3070252831 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f07481a66b0 con 0x7f0748103750 2024-05-08T05:27:59.681 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:59.680+0000 7f074e600700 1 -- 172.21.15.87:0/3070252831 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f074806a190 con 0x7f0748103750 2024-05-08T05:27:59.682 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:59.682+0000 7f0744c00700 1 -- 172.21.15.87:0/3070252831 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7f073801a020 con 0x7f0748103750 2024-05-08T05:27:59.684 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:59.684+0000 7f0744c00700 1 --2- 172.21.15.87:0/3070252831 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f072c0b2900 0x7f072c0b4dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:27:59.684 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:59.684+0000 7f0744c00700 1 -- 172.21.15.87:0/3070252831 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8190+0+0 (secure 0 0 0) 0x7f07380e2290 con 0x7f0748103750 2024-05-08T05:27:59.684 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:59.684+0000 7f073ea00700 1 --2- 172.21.15.87:0/3070252831 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f072c0b2900 0x7f072c0b4dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:27:59.685 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:59.685+0000 7f073ea00700 1 --2- 172.21.15.87:0/3070252831 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f072c0b2900 0x7f072c0b4dc0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f07481030f0 tx=0x7f0730019040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:27:59.686 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:59.686+0000 7f0744c00700 1 -- 172.21.15.87:0/3070252831 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f0738010040 con 0x7f0748103750 2024-05-08T05:27:59.969 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:59.968+0000 7f074e600700 1 -- 172.21.15.87:0/3070252831 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f074802e510 con 0x7f0748103750 2024-05-08T05:27:59.970 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:59.970+0000 7f0744c00700 1 -- 172.21.15.87:0/3070252831 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) ==== 94+0+11858 (secure 0 0 0) 0x7f07380a9f80 con 0x7f0748103750 2024-05-08T05:27:59.970 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-05-08T05:27:59.971 INFO:teuthology.orchestra.run.smithi087.stdout:{"epoch":24,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14358,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6835/1183985321","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6834","nonce":1183985321},{"type":"v1","addr":"172.21.15.87:6835","nonce":1183985321}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14370,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6837/1485824316","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6836","nonce":1485824316},{"type":"v1","addr":"172.21.15.87:6837","nonce":1485824316}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14409,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6841/724277538","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6840","nonce":724277538},{"type":"v1","addr":"172.21.15.87:6841","nonce":724277538}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24412,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6833/3339455985","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6832","nonce":3339455985},{"type":"v1","addr":"172.21.15.160:6833","nonce":3339455985}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24413,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6833/3292166873","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6832","nonce":3292166873},{"type":"v1","addr":"172.21.15.90:6833","nonce":3292166873}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24443,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6835/824555459","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6834","nonce":824555459},{"type":"v1","addr":"172.21.15.90:6835","nonce":824555459}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6}],"filesystems":[{"mdsmap":{"epoch":24,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-05-08T05:25:36.816840+0000","modified":"2024-05-08T05:25:59.331243+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24500,"mds_1":24482,"mds_2":24481},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24463":{"gid":24463,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.160:6835/409648357","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6834","nonce":409648357},{"type":"v1","addr":"172.21.15.160:6835","nonce":409648357}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24467":{"gid":24467,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.90:6837/4221919418","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6836","nonce":4221919418},{"type":"v1","addr":"172.21.15.90:6837","nonce":4221919418}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24469":{"gid":24469,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.160:6837/4200018040","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6836","nonce":4200018040},{"type":"v1","addr":"172.21.15.160:6837","nonce":4200018040}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24481":{"gid":24481,"name":"i","rank":2,"incarnation":20,"state":"up:active","state_seq":13,"addr":"172.21.15.160:6839/234657686","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6838","nonce":234657686},{"type":"v1","addr":"172.21.15.160:6839","nonce":234657686}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24482":{"gid":24482,"name":"g","rank":1,"incarnation":18,"state":"up:active","state_seq":12,"addr":"172.21.15.87:6839/2127215876","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6838","nonce":2127215876},{"type":"v1","addr":"172.21.15.87:6839","nonce":2127215876}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24500":{"gid":24500,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.90:6839/160586017","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6838","nonce":160586017},{"type":"v1","addr":"172.21.15.90:6839","nonce":160586017}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24500,"qdb_cluster":[24482,24500,24481]},"id":1}]} 2024-05-08T05:27:59.973 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:59.972+0000 7f074e600700 1 -- 172.21.15.87:0/3070252831 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f072c0b2900 msgr2=0x7f072c0b4dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:27:59.973 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:59.972+0000 7f074e600700 1 --2- 172.21.15.87:0/3070252831 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f072c0b2900 0x7f072c0b4dc0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f07481030f0 tx=0x7f0730019040 comp rx=0 tx=0).stop 2024-05-08T05:27:59.973 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:59.973+0000 7f074e600700 1 -- 172.21.15.87:0/3070252831 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0748103750 msgr2=0x7f074819f7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:27:59.973 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:59.973+0000 7f074e600700 1 --2- 172.21.15.87:0/3070252831 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0748103750 0x7f074819f7e0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f073800c370 tx=0x7f073800c680 comp rx=0 tx=0).stop 2024-05-08T05:27:59.973 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:59.973+0000 7f074e600700 1 -- 172.21.15.87:0/3070252831 shutdown_connections 2024-05-08T05:27:59.974 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:59.973+0000 7f074e600700 1 --2- 172.21.15.87:0/3070252831 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f072c0b2900 0x7f072c0b4dc0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:27:59.974 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:59.973+0000 7f074e600700 1 --2- 172.21.15.87:0/3070252831 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0748108850 0x7f07481999a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:27:59.974 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:59.973+0000 7f074e600700 1 --2- 172.21.15.87:0/3070252831 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0748103750 0x7f074819f7e0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:27:59.974 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:59.973+0000 7f074e600700 1 --2- 172.21.15.87:0/3070252831 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0748104100 0x7f074819fd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:27:59.974 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:59.973+0000 7f074e600700 1 -- 172.21.15.87:0/3070252831 >> 172.21.15.87:0/3070252831 conn(0x7f074807a600 msgr2=0x7f07481017e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:27:59.974 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:59.973+0000 7f074e600700 1 -- 172.21.15.87:0/3070252831 shutdown_connections 2024-05-08T05:27:59.974 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:27:59.973+0000 7f074e600700 1 -- 172.21.15.87:0/3070252831 wait complete. 2024-05-08T05:27:59.975 INFO:teuthology.orchestra.run.smithi087.stderr:dumped fsmap epoch 24 2024-05-08T05:28:00.805 DEBUG:teuthology.orchestra.run.smithi087:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid eeeb813e-0cf9-11ef-bc97-c7b262605968 -- ceph fs dump --format=json 2024-05-08T05:28:00.875 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:28:00 smithi087 ceph-mon[29523]: pgmap v390: 97 pgs: 97 active+clean; 644 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-05-08T05:28:00.875 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:28:00 smithi087 ceph-mon[29523]: from='client.? 172.21.15.87:0/3070252831' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T05:28:00.983 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:28:00 smithi090 ceph-mon[34526]: pgmap v390: 97 pgs: 97 active+clean; 644 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-05-08T05:28:00.984 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:28:00 smithi090 ceph-mon[34526]: from='client.? 172.21.15.87:0/3070252831' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T05:28:01.038 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:28:00 smithi160 ceph-mon[34827]: pgmap v390: 97 pgs: 97 active+clean; 644 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-05-08T05:28:01.039 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:28:00 smithi160 ceph-mon[34827]: from='client.? 172.21.15.87:0/3070252831' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T05:28:01.249 INFO:teuthology.orchestra.run.smithi087.stderr:Inferring config /var/lib/ceph/eeeb813e-0cf9-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T05:28:02.943 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:28:02 smithi087 ceph-mon[29523]: pgmap v391: 97 pgs: 97 active+clean; 644 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T05:28:02.983 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:28:02 smithi090 ceph-mon[34526]: pgmap v391: 97 pgs: 97 active+clean; 644 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T05:28:03.038 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:28:02 smithi160 ceph-mon[34827]: pgmap v391: 97 pgs: 97 active+clean; 644 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T05:28:03.468 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:03.467+0000 7f3855600700 1 -- 172.21.15.87:0/2454852833 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f385010fc10 msgr2=0x7f3850112080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:28:03.468 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:03.467+0000 7f3855600700 1 --2- 172.21.15.87:0/2454852833 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f385010fc10 0x7f3850112080 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f384800b0a0 tx=0x7f384800b3b0 comp rx=0 tx=0).stop 2024-05-08T05:28:03.468 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:03.467+0000 7f3855600700 1 -- 172.21.15.87:0/2454852833 shutdown_connections 2024-05-08T05:28:03.468 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:03.467+0000 7f3855600700 1 --2- 172.21.15.87:0/2454852833 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f385010fc10 0x7f3850112080 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:28:03.468 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:03.467+0000 7f3855600700 1 --2- 172.21.15.87:0/2454852833 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f38500758d0 0x7f3850075cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:28:03.468 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:03.467+0000 7f3855600700 1 --2- 172.21.15.87:0/2454852833 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f38500761f0 0x7f385010f6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:28:03.468 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:03.467+0000 7f3855600700 1 -- 172.21.15.87:0/2454852833 >> 172.21.15.87:0/2454852833 conn(0x7f38500fef20 msgr2=0x7f3850101340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:28:03.468 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:03.467+0000 7f3855600700 1 -- 172.21.15.87:0/2454852833 shutdown_connections 2024-05-08T05:28:03.468 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:03.467+0000 7f3855600700 1 -- 172.21.15.87:0/2454852833 wait complete. 2024-05-08T05:28:03.470 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:03.468+0000 7f3855600700 1 Processor -- start 2024-05-08T05:28:03.470 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:03.468+0000 7f3855600700 1 -- start start 2024-05-08T05:28:03.470 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:03.469+0000 7f3855600700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f38500758d0 0x7f38501a1880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:28:03.470 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:03.469+0000 7f3855600700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f38500761f0 0x7f38501a1dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:28:03.470 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:03.469+0000 7f3855600700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f385010fc10 0x7f385019ba40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:28:03.470 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:03.469+0000 7f3855600700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f38501157e0 con 0x7f38500758d0 2024-05-08T05:28:03.470 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:03.469+0000 7f3855600700 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f3850115660 con 0x7f385010fc10 2024-05-08T05:28:03.470 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:03.469+0000 7f3855600700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f3850115960 con 0x7f38500761f0 2024-05-08T05:28:03.470 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:03.469+0000 7f384fe00700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f38500758d0 0x7f38501a1880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:28:03.470 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:03.469+0000 7f384fe00700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f38500758d0 0x7f38501a1880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:33260/0 (socket says 172.21.15.87:33260) 2024-05-08T05:28:03.471 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:03.469+0000 7f384f400700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f38500761f0 0x7f38501a1dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:28:03.471 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:03.469+0000 7f384fe00700 1 -- 172.21.15.87:0/567583956 learned_addr learned my addr 172.21.15.87:0/567583956 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T05:28:03.471 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:03.469+0000 7f3854c00700 1 --2- 172.21.15.87:0/567583956 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f385010fc10 0x7f385019ba40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:28:03.471 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:03.470+0000 7f384fe00700 1 -- 172.21.15.87:0/567583956 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f38500761f0 msgr2=0x7f38501a1dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:28:03.471 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:03.470+0000 7f384fe00700 1 --2- 172.21.15.87:0/567583956 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f38500761f0 0x7f38501a1dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:28:03.471 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:03.470+0000 7f384fe00700 1 -- 172.21.15.87:0/567583956 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f385010fc10 msgr2=0x7f385019ba40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:28:03.471 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:03.470+0000 7f384fe00700 1 --2- 172.21.15.87:0/567583956 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f385010fc10 0x7f385019ba40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:28:03.471 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:03.470+0000 7f384fe00700 1 -- 172.21.15.87:0/567583956 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f385019c1a0 con 0x7f38500758d0 2024-05-08T05:28:03.471 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:03.470+0000 7f3854c00700 1 --2- 172.21.15.87:0/567583956 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f385010fc10 0x7f385019ba40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T05:28:03.472 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:03.470+0000 7f384fe00700 1 --2- 172.21.15.87:0/567583956 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f38500758d0 0x7f38501a1880 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f384000e9a0 tx=0x7f384000ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:28:03.472 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:03.470+0000 7f384cc00700 1 -- 172.21.15.87:0/567583956 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f384000ca10 con 0x7f38500758d0 2024-05-08T05:28:03.472 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:03.470+0000 7f3855600700 1 -- 172.21.15.87:0/567583956 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f385019c490 con 0x7f38500758d0 2024-05-08T05:28:03.472 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:03.470+0000 7f384cc00700 1 -- 172.21.15.87:0/567583956 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f384000cbb0 con 0x7f38500758d0 2024-05-08T05:28:03.472 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:03.470+0000 7f384cc00700 1 -- 172.21.15.87:0/567583956 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3840018680 con 0x7f38500758d0 2024-05-08T05:28:03.472 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:03.470+0000 7f3855600700 1 -- 172.21.15.87:0/567583956 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f38501a8750 con 0x7f38500758d0 2024-05-08T05:28:03.472 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:03.472+0000 7f3855600700 1 -- 172.21.15.87:0/567583956 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f385006a190 con 0x7f38500758d0 2024-05-08T05:28:03.474 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:03.474+0000 7f384cc00700 1 -- 172.21.15.87:0/567583956 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7f3840010430 con 0x7f38500758d0 2024-05-08T05:28:03.475 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:03.475+0000 7f384cc00700 1 --2- 172.21.15.87:0/567583956 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f38340b2880 0x7f38340b4d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:28:03.476 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:03.476+0000 7f384cc00700 1 -- 172.21.15.87:0/567583956 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8190+0+0 (secure 0 0 0) 0x7f38400e2390 con 0x7f38500758d0 2024-05-08T05:28:03.476 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:03.476+0000 7f384f400700 1 --2- 172.21.15.87:0/567583956 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f38340b2880 0x7f38340b4d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:28:03.476 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:03.476+0000 7f384f400700 1 --2- 172.21.15.87:0/567583956 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f38340b2880 0x7f38340b4d40 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f3850110ec0 tx=0x7f383c009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:28:03.480 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:03.480+0000 7f384cc00700 1 -- 172.21.15.87:0/567583956 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f38400aa080 con 0x7f38500758d0 2024-05-08T05:28:03.760 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:03.760+0000 7f3855600700 1 -- 172.21.15.87:0/567583956 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f385002e510 con 0x7f38500758d0 2024-05-08T05:28:03.762 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:03.762+0000 7f384cc00700 1 -- 172.21.15.87:0/567583956 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) ==== 94+0+11858 (secure 0 0 0) 0x7f38400b2100 con 0x7f38500758d0 2024-05-08T05:28:03.763 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-05-08T05:28:03.763 INFO:teuthology.orchestra.run.smithi087.stdout:{"epoch":24,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14358,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6835/1183985321","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6834","nonce":1183985321},{"type":"v1","addr":"172.21.15.87:6835","nonce":1183985321}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14370,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6837/1485824316","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6836","nonce":1485824316},{"type":"v1","addr":"172.21.15.87:6837","nonce":1485824316}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14409,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6841/724277538","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6840","nonce":724277538},{"type":"v1","addr":"172.21.15.87:6841","nonce":724277538}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24412,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6833/3339455985","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6832","nonce":3339455985},{"type":"v1","addr":"172.21.15.160:6833","nonce":3339455985}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24413,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6833/3292166873","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6832","nonce":3292166873},{"type":"v1","addr":"172.21.15.90:6833","nonce":3292166873}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24443,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6835/824555459","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6834","nonce":824555459},{"type":"v1","addr":"172.21.15.90:6835","nonce":824555459}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6}],"filesystems":[{"mdsmap":{"epoch":24,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-05-08T05:25:36.816840+0000","modified":"2024-05-08T05:25:59.331243+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24500,"mds_1":24482,"mds_2":24481},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24463":{"gid":24463,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.160:6835/409648357","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6834","nonce":409648357},{"type":"v1","addr":"172.21.15.160:6835","nonce":409648357}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24467":{"gid":24467,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.90:6837/4221919418","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6836","nonce":4221919418},{"type":"v1","addr":"172.21.15.90:6837","nonce":4221919418}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24469":{"gid":24469,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.160:6837/4200018040","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6836","nonce":4200018040},{"type":"v1","addr":"172.21.15.160:6837","nonce":4200018040}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24481":{"gid":24481,"name":"i","rank":2,"incarnation":20,"state":"up:active","state_seq":13,"addr":"172.21.15.160:6839/234657686","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6838","nonce":234657686},{"type":"v1","addr":"172.21.15.160:6839","nonce":234657686}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24482":{"gid":24482,"name":"g","rank":1,"incarnation":18,"state":"up:active","state_seq":12,"addr":"172.21.15.87:6839/2127215876","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6838","nonce":2127215876},{"type":"v1","addr":"172.21.15.87:6839","nonce":2127215876}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24500":{"gid":24500,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.90:6839/160586017","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6838","nonce":160586017},{"type":"v1","addr":"172.21.15.90:6839","nonce":160586017}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24500,"qdb_cluster":[24482,24500,24481]},"id":1}]} 2024-05-08T05:28:03.766 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:03.765+0000 7f3855600700 1 -- 172.21.15.87:0/567583956 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f38340b2880 msgr2=0x7f38340b4d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:28:03.766 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:03.765+0000 7f3855600700 1 --2- 172.21.15.87:0/567583956 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f38340b2880 0x7f38340b4d40 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f3850110ec0 tx=0x7f383c009260 comp rx=0 tx=0).stop 2024-05-08T05:28:03.766 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:03.765+0000 7f3855600700 1 -- 172.21.15.87:0/567583956 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f38500758d0 msgr2=0x7f38501a1880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:28:03.766 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:03.765+0000 7f3855600700 1 --2- 172.21.15.87:0/567583956 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f38500758d0 0x7f38501a1880 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f384000e9a0 tx=0x7f384000ecb0 comp rx=0 tx=0).stop 2024-05-08T05:28:03.766 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:03.765+0000 7f3855600700 1 -- 172.21.15.87:0/567583956 shutdown_connections 2024-05-08T05:28:03.766 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:03.765+0000 7f3855600700 1 --2- 172.21.15.87:0/567583956 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f385010fc10 0x7f385019ba40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:28:03.766 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:03.765+0000 7f3855600700 1 --2- 172.21.15.87:0/567583956 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f38500758d0 0x7f38501a1880 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:28:03.766 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:03.765+0000 7f3855600700 1 --2- 172.21.15.87:0/567583956 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f38340b2880 0x7f38340b4d40 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:28:03.766 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:03.765+0000 7f3855600700 1 --2- 172.21.15.87:0/567583956 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f38500761f0 0x7f38501a1dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:28:03.766 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:03.765+0000 7f3855600700 1 -- 172.21.15.87:0/567583956 >> 172.21.15.87:0/567583956 conn(0x7f38500fef20 msgr2=0x7f38500ffbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:28:03.766 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:03.765+0000 7f3855600700 1 -- 172.21.15.87:0/567583956 shutdown_connections 2024-05-08T05:28:03.766 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:03.765+0000 7f3855600700 1 -- 172.21.15.87:0/567583956 wait complete. 2024-05-08T05:28:03.767 INFO:teuthology.orchestra.run.smithi087.stderr:dumped fsmap epoch 24 2024-05-08T05:28:04.482 DEBUG:teuthology.orchestra.run.smithi087:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid eeeb813e-0cf9-11ef-bc97-c7b262605968 -- ceph osd dump --format=json 2024-05-08T05:28:04.708 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:28:04 smithi087 ceph-mon[29523]: pgmap v392: 97 pgs: 97 active+clean; 644 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-05-08T05:28:04.708 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:28:04 smithi087 ceph-mon[29523]: from='client.? 172.21.15.87:0/567583956' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T05:28:04.942 INFO:teuthology.orchestra.run.smithi087.stderr:Inferring config /var/lib/ceph/eeeb813e-0cf9-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T05:28:04.983 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:28:04 smithi090 ceph-mon[34526]: pgmap v392: 97 pgs: 97 active+clean; 644 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-05-08T05:28:04.984 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:28:04 smithi090 ceph-mon[34526]: from='client.? 172.21.15.87:0/567583956' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T05:28:05.038 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:28:04 smithi160 ceph-mon[34827]: pgmap v392: 97 pgs: 97 active+clean; 644 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-05-08T05:28:05.039 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:28:04 smithi160 ceph-mon[34827]: from='client.? 172.21.15.87:0/567583956' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T05:28:06.882 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:28:06 smithi087 ceph-mon[29523]: pgmap v393: 97 pgs: 97 active+clean; 644 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-05-08T05:28:06.983 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:28:06 smithi090 ceph-mon[34526]: pgmap v393: 97 pgs: 97 active+clean; 644 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-05-08T05:28:07.038 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:28:06 smithi160 ceph-mon[34827]: pgmap v393: 97 pgs: 97 active+clean; 644 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-05-08T05:28:07.047 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:07.045+0000 7f2356e00700 1 -- 172.21.15.87:0/3855520957 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f23501056c0 msgr2=0x7f2350105b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:28:07.047 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:07.045+0000 7f2356e00700 1 --2- 172.21.15.87:0/3855520957 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f23501056c0 0x7f2350105b40 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f233c009990 tx=0x7f233c009ca0 comp rx=0 tx=0).stop 2024-05-08T05:28:07.048 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:07.046+0000 7f2356e00700 1 -- 172.21.15.87:0/3855520957 shutdown_connections 2024-05-08T05:28:07.048 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:07.046+0000 7f2356e00700 1 --2- 172.21.15.87:0/3855520957 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2350106080 0x7f2350112590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:28:07.048 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:07.046+0000 7f2356e00700 1 --2- 172.21.15.87:0/3855520957 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f235010b6c0 0x7f235010baa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:28:07.048 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:07.046+0000 7f2356e00700 1 --2- 172.21.15.87:0/3855520957 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f23501056c0 0x7f2350105b40 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:28:07.048 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:07.046+0000 7f2356e00700 1 -- 172.21.15.87:0/3855520957 >> 172.21.15.87:0/3855520957 conn(0x7f23501011b0 msgr2=0x7f23501035d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:28:07.048 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:07.046+0000 7f2356e00700 1 -- 172.21.15.87:0/3855520957 shutdown_connections 2024-05-08T05:28:07.048 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:07.046+0000 7f2356e00700 1 -- 172.21.15.87:0/3855520957 wait complete. 2024-05-08T05:28:07.049 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:07.048+0000 7f2356e00700 1 Processor -- start 2024-05-08T05:28:07.049 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:07.048+0000 7f2356e00700 1 -- start start 2024-05-08T05:28:07.050 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:07.048+0000 7f2356e00700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f23501056c0 0x7f235019bdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:28:07.050 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:07.048+0000 7f2356e00700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2350106080 0x7f235019c300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:28:07.050 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:07.048+0000 7f2356e00700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f235010b6c0 0x7f23501a0690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:28:07.050 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:07.048+0000 7f2356e00700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f2350115950 con 0x7f2350106080 2024-05-08T05:28:07.050 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:07.048+0000 7f2356e00700 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f23501157d0 con 0x7f235010b6c0 2024-05-08T05:28:07.050 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:07.048+0000 7f2356e00700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f2350115ad0 con 0x7f23501056c0 2024-05-08T05:28:07.050 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:07.049+0000 7f234fe00700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f23501056c0 0x7f235019bdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:28:07.050 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:07.049+0000 7f234fe00700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f23501056c0 0x7f235019bdc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.87:35214/0 (socket says 172.21.15.87:35214) 2024-05-08T05:28:07.050 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:07.049+0000 7f234fe00700 1 -- 172.21.15.87:0/3504756259 learned_addr learned my addr 172.21.15.87:0/3504756259 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T05:28:07.051 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:07.049+0000 7f2354e00700 1 --2- 172.21.15.87:0/3504756259 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f235010b6c0 0x7f23501a0690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:28:07.051 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:07.049+0000 7f234f400700 1 --2- 172.21.15.87:0/3504756259 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2350106080 0x7f235019c300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:28:07.052 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:07.049+0000 7f2354e00700 1 -- 172.21.15.87:0/3504756259 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f23501056c0 msgr2=0x7f235019bdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:28:07.052 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:07.049+0000 7f2354e00700 1 --2- 172.21.15.87:0/3504756259 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f23501056c0 0x7f235019bdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:28:07.052 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:07.049+0000 7f2354e00700 1 -- 172.21.15.87:0/3504756259 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2350106080 msgr2=0x7f235019c300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:28:07.052 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:07.049+0000 7f2354e00700 1 --2- 172.21.15.87:0/3504756259 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2350106080 0x7f235019c300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:28:07.052 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:07.049+0000 7f2354e00700 1 -- 172.21.15.87:0/3504756259 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f23501a0dd0 con 0x7f235010b6c0 2024-05-08T05:28:07.052 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:07.049+0000 7f234f400700 1 --2- 172.21.15.87:0/3504756259 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2350106080 0x7f235019c300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T05:28:07.052 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:07.049+0000 7f234fe00700 1 --2- 172.21.15.87:0/3504756259 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f23501056c0 0x7f235019bdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T05:28:07.052 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:07.050+0000 7f2354e00700 1 --2- 172.21.15.87:0/3504756259 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f235010b6c0 0x7f23501a0690 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f234800efc0 tx=0x7f234800c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:28:07.052 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:07.050+0000 7f234cc00700 1 -- 172.21.15.87:0/3504756259 <== mon.2 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23480092e0 con 0x7f235010b6c0 2024-05-08T05:28:07.052 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:07.050+0000 7f234cc00700 1 -- 172.21.15.87:0/3504756259 <== mon.2 v2:172.21.15.90:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2348004bb0 con 0x7f235010b6c0 2024-05-08T05:28:07.052 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:07.050+0000 7f2356e00700 1 -- 172.21.15.87:0/3504756259 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f23501a1060 con 0x7f235010b6c0 2024-05-08T05:28:07.053 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:07.050+0000 7f234cc00700 1 -- 172.21.15.87:0/3504756259 <== mon.2 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2348004020 con 0x7f235010b6c0 2024-05-08T05:28:07.053 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:07.050+0000 7f2356e00700 1 -- 172.21.15.87:0/3504756259 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f23501a8940 con 0x7f235010b6c0 2024-05-08T05:28:07.053 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:07.051+0000 7f2356e00700 1 -- 172.21.15.87:0/3504756259 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f235010dc50 con 0x7f235010b6c0 2024-05-08T05:28:07.054 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:07.053+0000 7f234cc00700 1 -- 172.21.15.87:0/3504756259 <== mon.2 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7f234801b030 con 0x7f235010b6c0 2024-05-08T05:28:07.056 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:07.055+0000 7f234cc00700 1 --2- 172.21.15.87:0/3504756259 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f23340b2880 0x7f23340b4d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:28:07.056 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:07.055+0000 7f234cc00700 1 -- 172.21.15.87:0/3504756259 <== mon.2 v2:172.21.15.90:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8190+0+0 (secure 0 0 0) 0x7f23480e2700 con 0x7f235010b6c0 2024-05-08T05:28:07.056 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:07.055+0000 7f234fe00700 1 --2- 172.21.15.87:0/3504756259 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f23340b2880 0x7f23340b4d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:28:07.057 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:07.056+0000 7f234fe00700 1 --2- 172.21.15.87:0/3504756259 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f23340b2880 0x7f23340b4d40 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f2340011550 tx=0x7f2340009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:28:07.058 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:07.057+0000 7f234cc00700 1 -- 172.21.15.87:0/3504756259 <== mon.2 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f2348022020 con 0x7f235010b6c0 2024-05-08T05:28:07.297 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:07.295+0000 7f2356e00700 1 -- 172.21.15.87:0/3504756259 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f235019d120 con 0x7f235010b6c0 2024-05-08T05:28:07.298 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:07.297+0000 7f234cc00700 1 -- 172.21.15.87:0/3504756259 <== mon.2 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v82) ==== 74+0+22588 (secure 0 0 0) 0x7f2348010040 con 0x7f235010b6c0 2024-05-08T05:28:07.299 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-05-08T05:28:07.299 INFO:teuthology.orchestra.run.smithi087.stdout:{"epoch":82,"fsid":"eeeb813e-0cf9-11ef-bc97-c7b262605968","created":"2024-05-08T05:16:14.984330+0000","modified":"2024-05-08T05:26:24.106467+0000","last_up_change":"2024-05-08T05:24:22.324501+0000","last_in_change":"2024-05-08T05:24:01.962570+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-08T05:20:08.907941+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-08T05:25:28.054494+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-08T05:25:32.484126+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"f3e25ce0-0762-46fd-83fb-6766a2e9db69","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6802","nonce":2285285644},{"type":"v1","addr":"172.21.15.87:6803","nonce":2285285644}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6804","nonce":2285285644},{"type":"v1","addr":"172.21.15.87:6805","nonce":2285285644}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6808","nonce":2285285644},{"type":"v1","addr":"172.21.15.87:6809","nonce":2285285644}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6806","nonce":2285285644},{"type":"v1","addr":"172.21.15.87:6807","nonce":2285285644}]},"public_addr":"172.21.15.87:6803/2285285644","cluster_addr":"172.21.15.87:6805/2285285644","heartbeat_back_addr":"172.21.15.87:6809/2285285644","heartbeat_front_addr":"172.21.15.87:6807/2285285644","state":["exists","up"]},{"osd":1,"uuid":"b6de5f4c-1d79-41ff-adee-03d8a47ab55e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6800","nonce":1681573998},{"type":"v1","addr":"172.21.15.90:6801","nonce":1681573998}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6802","nonce":1681573998},{"type":"v1","addr":"172.21.15.90:6803","nonce":1681573998}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6806","nonce":1681573998},{"type":"v1","addr":"172.21.15.90:6807","nonce":1681573998}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6804","nonce":1681573998},{"type":"v1","addr":"172.21.15.90:6805","nonce":1681573998}]},"public_addr":"172.21.15.90:6801/1681573998","cluster_addr":"172.21.15.90:6803/1681573998","heartbeat_back_addr":"172.21.15.90:6807/1681573998","heartbeat_front_addr":"172.21.15.90:6805/1681573998","state":["exists","up"]},{"osd":2,"uuid":"ee3a2729-93b2-4985-b84d-165f92cae8e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6800","nonce":2137179096},{"type":"v1","addr":"172.21.15.160:6801","nonce":2137179096}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6802","nonce":2137179096},{"type":"v1","addr":"172.21.15.160:6803","nonce":2137179096}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6806","nonce":2137179096},{"type":"v1","addr":"172.21.15.160:6807","nonce":2137179096}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6804","nonce":2137179096},{"type":"v1","addr":"172.21.15.160:6805","nonce":2137179096}]},"public_addr":"172.21.15.160:6801/2137179096","cluster_addr":"172.21.15.160:6803/2137179096","heartbeat_back_addr":"172.21.15.160:6807/2137179096","heartbeat_front_addr":"172.21.15.160:6805/2137179096","state":["exists","up"]},{"osd":3,"uuid":"fc7bd69f-5a62-4ec6-b95c-c170be46a7d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6810","nonce":2022667023},{"type":"v1","addr":"172.21.15.87:6811","nonce":2022667023}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6812","nonce":2022667023},{"type":"v1","addr":"172.21.15.87:6813","nonce":2022667023}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6816","nonce":2022667023},{"type":"v1","addr":"172.21.15.87:6817","nonce":2022667023}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6814","nonce":2022667023},{"type":"v1","addr":"172.21.15.87:6815","nonce":2022667023}]},"public_addr":"172.21.15.87:6811/2022667023","cluster_addr":"172.21.15.87:6813/2022667023","heartbeat_back_addr":"172.21.15.87:6817/2022667023","heartbeat_front_addr":"172.21.15.87:6815/2022667023","state":["exists","up"]},{"osd":4,"uuid":"a05f7bd1-962a-4f3e-8f70-e7ef4c68bac2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6808","nonce":1371607578},{"type":"v1","addr":"172.21.15.90:6809","nonce":1371607578}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6810","nonce":1371607578},{"type":"v1","addr":"172.21.15.90:6811","nonce":1371607578}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6814","nonce":1371607578},{"type":"v1","addr":"172.21.15.90:6815","nonce":1371607578}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6812","nonce":1371607578},{"type":"v1","addr":"172.21.15.90:6813","nonce":1371607578}]},"public_addr":"172.21.15.90:6809/1371607578","cluster_addr":"172.21.15.90:6811/1371607578","heartbeat_back_addr":"172.21.15.90:6815/1371607578","heartbeat_front_addr":"172.21.15.90:6813/1371607578","state":["exists","up"]},{"osd":5,"uuid":"85e3af08-32ee-4f26-97df-8d54ba928715","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6808","nonce":2190054276},{"type":"v1","addr":"172.21.15.160:6809","nonce":2190054276}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6810","nonce":2190054276},{"type":"v1","addr":"172.21.15.160:6811","nonce":2190054276}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6814","nonce":2190054276},{"type":"v1","addr":"172.21.15.160:6815","nonce":2190054276}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6812","nonce":2190054276},{"type":"v1","addr":"172.21.15.160:6813","nonce":2190054276}]},"public_addr":"172.21.15.160:6809/2190054276","cluster_addr":"172.21.15.160:6811/2190054276","heartbeat_back_addr":"172.21.15.160:6815/2190054276","heartbeat_front_addr":"172.21.15.160:6813/2190054276","state":["exists","up"]},{"osd":6,"uuid":"df4b22a9-6cd8-473e-a17b-a0cb9ad32e98","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":42,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6818","nonce":2863681447},{"type":"v1","addr":"172.21.15.87:6819","nonce":2863681447}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6820","nonce":2863681447},{"type":"v1","addr":"172.21.15.87:6821","nonce":2863681447}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6824","nonce":2863681447},{"type":"v1","addr":"172.21.15.87:6825","nonce":2863681447}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6822","nonce":2863681447},{"type":"v1","addr":"172.21.15.87:6823","nonce":2863681447}]},"public_addr":"172.21.15.87:6819/2863681447","cluster_addr":"172.21.15.87:6821/2863681447","heartbeat_back_addr":"172.21.15.87:6825/2863681447","heartbeat_front_addr":"172.21.15.87:6823/2863681447","state":["exists","up"]},{"osd":7,"uuid":"f6ef3857-0366-4408-932a-a8c8479ba780","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6816","nonce":1964248958},{"type":"v1","addr":"172.21.15.90:6817","nonce":1964248958}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6818","nonce":1964248958},{"type":"v1","addr":"172.21.15.90:6819","nonce":1964248958}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6822","nonce":1964248958},{"type":"v1","addr":"172.21.15.90:6823","nonce":1964248958}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6820","nonce":1964248958},{"type":"v1","addr":"172.21.15.90:6821","nonce":1964248958}]},"public_addr":"172.21.15.90:6817/1964248958","cluster_addr":"172.21.15.90:6819/1964248958","heartbeat_back_addr":"172.21.15.90:6823/1964248958","heartbeat_front_addr":"172.21.15.90:6821/1964248958","state":["exists","up"]},{"osd":8,"uuid":"027dede9-d0be-4fbe-b7b8-02ce88d57f4d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":54,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6816","nonce":927680738},{"type":"v1","addr":"172.21.15.160:6817","nonce":927680738}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6818","nonce":927680738},{"type":"v1","addr":"172.21.15.160:6819","nonce":927680738}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6822","nonce":927680738},{"type":"v1","addr":"172.21.15.160:6823","nonce":927680738}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6820","nonce":927680738},{"type":"v1","addr":"172.21.15.160:6821","nonce":927680738}]},"public_addr":"172.21.15.160:6817/927680738","cluster_addr":"172.21.15.160:6819/927680738","heartbeat_back_addr":"172.21.15.160:6823/927680738","heartbeat_front_addr":"172.21.15.160:6821/927680738","state":["exists","up"]},{"osd":9,"uuid":"bc9e37de-e509-4db6-bd58-b68e2c8e1aff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6826","nonce":3789116749},{"type":"v1","addr":"172.21.15.87:6827","nonce":3789116749}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6828","nonce":3789116749},{"type":"v1","addr":"172.21.15.87:6829","nonce":3789116749}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6832","nonce":3789116749},{"type":"v1","addr":"172.21.15.87:6833","nonce":3789116749}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6830","nonce":3789116749},{"type":"v1","addr":"172.21.15.87:6831","nonce":3789116749}]},"public_addr":"172.21.15.87:6827/3789116749","cluster_addr":"172.21.15.87:6829/3789116749","heartbeat_back_addr":"172.21.15.87:6833/3789116749","heartbeat_front_addr":"172.21.15.87:6831/3789116749","state":["exists","up"]},{"osd":10,"uuid":"43945081-b4c8-4f5d-9301-3540709e69e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":66,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6824","nonce":716529498},{"type":"v1","addr":"172.21.15.90:6825","nonce":716529498}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6826","nonce":716529498},{"type":"v1","addr":"172.21.15.90:6827","nonce":716529498}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6830","nonce":716529498},{"type":"v1","addr":"172.21.15.90:6831","nonce":716529498}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6828","nonce":716529498},{"type":"v1","addr":"172.21.15.90:6829","nonce":716529498}]},"public_addr":"172.21.15.90:6825/716529498","cluster_addr":"172.21.15.90:6827/716529498","heartbeat_back_addr":"172.21.15.90:6831/716529498","heartbeat_front_addr":"172.21.15.90:6829/716529498","state":["exists","up"]},{"osd":11,"uuid":"da23ff5c-3f79-44e3-bca3-d9d5a003c999","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6824","nonce":1842739135},{"type":"v1","addr":"172.21.15.160:6825","nonce":1842739135}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6826","nonce":1842739135},{"type":"v1","addr":"172.21.15.160:6827","nonce":1842739135}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6830","nonce":1842739135},{"type":"v1","addr":"172.21.15.160:6831","nonce":1842739135}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6828","nonce":1842739135},{"type":"v1","addr":"172.21.15.160:6829","nonce":1842739135}]},"public_addr":"172.21.15.160:6825/1842739135","cluster_addr":"172.21.15.160:6827/1842739135","heartbeat_back_addr":"172.21.15.160:6831/1842739135","heartbeat_front_addr":"172.21.15.160:6829/1842739135","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T05:19:15.869398+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T05:19:42.014078+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T05:20:06.430660+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T05:20:38.555519+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T05:21:04.530605+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T05:21:29.545252+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T05:22:03.141982+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T05:22:29.191127+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T05:22:54.502994+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T05:23:27.899000+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T05:23:54.693979+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T05:24:20.307119+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.a","mappings":[{"from":2,"to":11}]},{"pgid":"2.1d","mappings":[{"from":2,"to":4},{"from":8,"to":11}]},{"pgid":"3.0","mappings":[{"from":4,"to":8}]},{"pgid":"3.1","mappings":[{"from":4,"to":9}]},{"pgid":"3.12","mappings":[{"from":3,"to":9}]},{"pgid":"3.28","mappings":[{"from":5,"to":6}]},{"pgid":"3.2c","mappings":[{"from":4,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.87:0/4226160503":"2024-05-09T05:17:22.736165+0000","172.21.15.87:0/2773684806":"2024-05-09T05:17:22.736165+0000","172.21.15.87:0/349590592":"2024-05-09T05:17:22.736165+0000","172.21.15.87:6801/2710124295":"2024-05-09T05:17:22.736165+0000","172.21.15.87:6800/1823425617":"2024-05-09T05:16:48.155337+0000","172.21.15.87:0/2393072013":"2024-05-09T05:16:48.155337+0000","172.21.15.87:0/1291525416":"2024-05-09T05:16:48.155337+0000","172.21.15.87:6801/1823425617":"2024-05-09T05:16:48.155337+0000","172.21.15.87:0/3839463573":"2024-05-09T05:16:48.155337+0000","172.21.15.87:6800/2710124295":"2024-05-09T05:17:22.736165+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-08T05:28:07.302 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:07.300+0000 7f2356e00700 1 -- 172.21.15.87:0/3504756259 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f23340b2880 msgr2=0x7f23340b4d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:28:07.302 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:07.300+0000 7f2356e00700 1 --2- 172.21.15.87:0/3504756259 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f23340b2880 0x7f23340b4d40 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f2340011550 tx=0x7f2340009260 comp rx=0 tx=0).stop 2024-05-08T05:28:07.302 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:07.301+0000 7f2356e00700 1 -- 172.21.15.87:0/3504756259 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f235010b6c0 msgr2=0x7f23501a0690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:28:07.302 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:07.301+0000 7f2356e00700 1 --2- 172.21.15.87:0/3504756259 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f235010b6c0 0x7f23501a0690 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f234800efc0 tx=0x7f234800c3a0 comp rx=0 tx=0).stop 2024-05-08T05:28:07.302 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:07.301+0000 7f2356e00700 1 -- 172.21.15.87:0/3504756259 shutdown_connections 2024-05-08T05:28:07.303 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:07.301+0000 7f2356e00700 1 --2- 172.21.15.87:0/3504756259 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f235010b6c0 0x7f23501a0690 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:28:07.303 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:07.301+0000 7f2356e00700 1 --2- 172.21.15.87:0/3504756259 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f23340b2880 0x7f23340b4d40 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:28:07.303 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:07.301+0000 7f2356e00700 1 --2- 172.21.15.87:0/3504756259 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f23501056c0 0x7f235019bdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:28:07.303 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:07.301+0000 7f2356e00700 1 --2- 172.21.15.87:0/3504756259 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2350106080 0x7f235019c300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:28:07.303 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:07.301+0000 7f2356e00700 1 -- 172.21.15.87:0/3504756259 >> 172.21.15.87:0/3504756259 conn(0x7f23501011b0 msgr2=0x7f23501019f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:28:07.303 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:07.301+0000 7f2356e00700 1 -- 172.21.15.87:0/3504756259 shutdown_connections 2024-05-08T05:28:07.303 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:07.301+0000 7f2356e00700 1 -- 172.21.15.87:0/3504756259 wait complete. 2024-05-08T05:28:07.958 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:28:07 smithi087 ceph-mon[29523]: from='client.? 172.21.15.87:0/3504756259' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-08T05:28:07.983 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:28:07 smithi090 ceph-mon[34526]: from='client.? 172.21.15.87:0/3504756259' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-08T05:28:08.039 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:28:07 smithi160 ceph-mon[34827]: from='client.? 172.21.15.87:0/3504756259' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-08T05:28:08.103 DEBUG:teuthology.orchestra.run.smithi087:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid eeeb813e-0cf9-11ef-bc97-c7b262605968 -- ceph fs dump --format=json 2024-05-08T05:28:08.545 INFO:teuthology.orchestra.run.smithi087.stderr:Inferring config /var/lib/ceph/eeeb813e-0cf9-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T05:28:08.896 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:28:08 smithi087 ceph-mon[29523]: pgmap v394: 97 pgs: 97 active+clean; 644 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T05:28:08.983 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:28:08 smithi090 ceph-mon[34526]: pgmap v394: 97 pgs: 97 active+clean; 644 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T05:28:09.039 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:28:08 smithi160 ceph-mon[34827]: pgmap v394: 97 pgs: 97 active+clean; 644 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T05:28:10.664 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:10.662+0000 7f3298c00700 1 -- 172.21.15.87:0/381176069 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3294106080 msgr2=0x7f3294112590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:28:10.664 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:10.662+0000 7f3298c00700 1 --2- 172.21.15.87:0/381176069 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3294106080 0x7f3294112590 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f328c009f90 tx=0x7f328c00b330 comp rx=0 tx=0).stop 2024-05-08T05:28:10.664 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:10.662+0000 7f3298c00700 1 -- 172.21.15.87:0/381176069 shutdown_connections 2024-05-08T05:28:10.665 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:10.662+0000 7f3298c00700 1 --2- 172.21.15.87:0/381176069 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3294106080 0x7f3294112590 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:28:10.665 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:10.662+0000 7f3298c00700 1 --2- 172.21.15.87:0/381176069 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f329410b6c0 0x7f329410baa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:28:10.665 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:10.662+0000 7f3298c00700 1 --2- 172.21.15.87:0/381176069 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f32941056c0 0x7f3294105b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:28:10.665 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:10.662+0000 7f3298c00700 1 -- 172.21.15.87:0/381176069 >> 172.21.15.87:0/381176069 conn(0x7f32941011b0 msgr2=0x7f32941035d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:28:10.665 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:10.662+0000 7f3298c00700 1 -- 172.21.15.87:0/381176069 shutdown_connections 2024-05-08T05:28:10.665 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:10.662+0000 7f3298c00700 1 -- 172.21.15.87:0/381176069 wait complete. 2024-05-08T05:28:10.667 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:10.663+0000 7f3298c00700 1 Processor -- start 2024-05-08T05:28:10.667 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:10.664+0000 7f3298c00700 1 -- start start 2024-05-08T05:28:10.667 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:10.664+0000 7f3298c00700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f32941056c0 0x7f329419bd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:28:10.667 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:10.664+0000 7f3298c00700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3294106080 0x7f329419c250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:28:10.667 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:10.664+0000 7f3298c00700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f329410b6c0 0x7f32941a05e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:28:10.667 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:10.664+0000 7f3298c00700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f3294115900 con 0x7f329410b6c0 2024-05-08T05:28:10.667 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:10.664+0000 7f3298c00700 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f3294115780 con 0x7f3294106080 2024-05-08T05:28:10.667 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:10.664+0000 7f3298c00700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f3294115a80 con 0x7f32941056c0 2024-05-08T05:28:10.667 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:10.664+0000 7f3292800700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f329410b6c0 0x7f32941a05e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:28:10.667 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:10.664+0000 7f3291e00700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f32941056c0 0x7f329419bd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:28:10.667 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:10.664+0000 7f3289400700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3294106080 0x7f329419c250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:28:10.667 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:10.664+0000 7f3289400700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3294106080 0x7f329419c250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.87:45424/0 (socket says 172.21.15.87:45424) 2024-05-08T05:28:10.668 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:10.664+0000 7f3291e00700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f32941056c0 0x7f329419bd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.87:35230/0 (socket says 172.21.15.87:35230) 2024-05-08T05:28:10.668 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:10.664+0000 7f3289400700 1 -- 172.21.15.87:0/4071949595 learned_addr learned my addr 172.21.15.87:0/4071949595 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T05:28:10.668 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:10.665+0000 7f3289400700 1 -- 172.21.15.87:0/4071949595 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f32941056c0 msgr2=0x7f329419bd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:28:10.668 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:10.665+0000 7f3289400700 1 --2- 172.21.15.87:0/4071949595 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f32941056c0 0x7f329419bd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:28:10.668 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:10.665+0000 7f3289400700 1 -- 172.21.15.87:0/4071949595 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f329410b6c0 msgr2=0x7f32941a05e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:28:10.668 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:10.665+0000 7f3289400700 1 --2- 172.21.15.87:0/4071949595 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f329410b6c0 0x7f32941a05e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:28:10.668 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:10.665+0000 7f3289400700 1 -- 172.21.15.87:0/4071949595 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f32941a0d20 con 0x7f3294106080 2024-05-08T05:28:10.668 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:10.665+0000 7f3291e00700 1 --2- 172.21.15.87:0/4071949595 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f32941056c0 0x7f329419bd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T05:28:10.668 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:10.665+0000 7f3289400700 1 --2- 172.21.15.87:0/4071949595 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3294106080 0x7f329419c250 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f327c00ec10 tx=0x7f327c00ef20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:28:10.668 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:10.665+0000 7f328b400700 1 -- 172.21.15.87:0/4071949595 <== mon.2 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f327c00cc90 con 0x7f3294106080 2024-05-08T05:28:10.668 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:10.665+0000 7f328b400700 1 -- 172.21.15.87:0/4071949595 <== mon.2 v2:172.21.15.90:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f327c00ce30 con 0x7f3294106080 2024-05-08T05:28:10.668 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:10.665+0000 7f3298c00700 1 -- 172.21.15.87:0/4071949595 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f32941a1010 con 0x7f3294106080 2024-05-08T05:28:10.668 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:10.665+0000 7f328b400700 1 -- 172.21.15.87:0/4071949595 <== mon.2 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f327c010430 con 0x7f3294106080 2024-05-08T05:28:10.668 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:10.666+0000 7f3298c00700 1 -- 172.21.15.87:0/4071949595 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f32941a8890 con 0x7f3294106080 2024-05-08T05:28:10.669 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:10.667+0000 7f3298c00700 1 -- 172.21.15.87:0/4071949595 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f329406a190 con 0x7f3294106080 2024-05-08T05:28:10.670 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:10.669+0000 7f328b400700 1 -- 172.21.15.87:0/4071949595 <== mon.2 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7f327c004000 con 0x7f3294106080 2024-05-08T05:28:10.672 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:10.670+0000 7f328b400700 1 --2- 172.21.15.87:0/4071949595 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f32740b2880 0x7f32740b4d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:28:10.672 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:10.670+0000 7f328b400700 1 -- 172.21.15.87:0/4071949595 <== mon.2 v2:172.21.15.90:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8190+0+0 (secure 0 0 0) 0x7f327c0e24e0 con 0x7f3294106080 2024-05-08T05:28:10.672 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:10.671+0000 7f3291e00700 1 --2- 172.21.15.87:0/4071949595 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f32740b2880 0x7f32740b4d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:28:10.672 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:10.671+0000 7f3291e00700 1 --2- 172.21.15.87:0/4071949595 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f32740b2880 0x7f32740b4d40 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f3284009fd0 tx=0x7f3284009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:28:10.676 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:10.675+0000 7f328b400700 1 -- 172.21.15.87:0/4071949595 <== mon.2 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f327c0aa1d0 con 0x7f3294106080 2024-05-08T05:28:10.958 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:28:10 smithi087 ceph-mon[29523]: pgmap v395: 97 pgs: 97 active+clean; 644 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-05-08T05:28:10.959 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:10.957+0000 7f3298c00700 1 -- 172.21.15.87:0/4071949595 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f329419d0a0 con 0x7f3294106080 2024-05-08T05:28:10.959 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:10.958+0000 7f328b400700 1 -- 172.21.15.87:0/4071949595 <== mon.2 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) ==== 94+0+11858 (secure 0 0 0) 0x7f329419d0a0 con 0x7f3294106080 2024-05-08T05:28:10.960 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-05-08T05:28:10.960 INFO:teuthology.orchestra.run.smithi087.stdout:{"epoch":24,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14358,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6835/1183985321","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6834","nonce":1183985321},{"type":"v1","addr":"172.21.15.87:6835","nonce":1183985321}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14370,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6837/1485824316","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6836","nonce":1485824316},{"type":"v1","addr":"172.21.15.87:6837","nonce":1485824316}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14409,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6841/724277538","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6840","nonce":724277538},{"type":"v1","addr":"172.21.15.87:6841","nonce":724277538}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24412,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6833/3339455985","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6832","nonce":3339455985},{"type":"v1","addr":"172.21.15.160:6833","nonce":3339455985}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24413,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6833/3292166873","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6832","nonce":3292166873},{"type":"v1","addr":"172.21.15.90:6833","nonce":3292166873}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24443,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6835/824555459","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6834","nonce":824555459},{"type":"v1","addr":"172.21.15.90:6835","nonce":824555459}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6}],"filesystems":[{"mdsmap":{"epoch":24,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-05-08T05:25:36.816840+0000","modified":"2024-05-08T05:25:59.331243+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24500,"mds_1":24482,"mds_2":24481},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24463":{"gid":24463,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.160:6835/409648357","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6834","nonce":409648357},{"type":"v1","addr":"172.21.15.160:6835","nonce":409648357}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24467":{"gid":24467,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.90:6837/4221919418","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6836","nonce":4221919418},{"type":"v1","addr":"172.21.15.90:6837","nonce":4221919418}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24469":{"gid":24469,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.160:6837/4200018040","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6836","nonce":4200018040},{"type":"v1","addr":"172.21.15.160:6837","nonce":4200018040}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24481":{"gid":24481,"name":"i","rank":2,"incarnation":20,"state":"up:active","state_seq":13,"addr":"172.21.15.160:6839/234657686","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6838","nonce":234657686},{"type":"v1","addr":"172.21.15.160:6839","nonce":234657686}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24482":{"gid":24482,"name":"g","rank":1,"incarnation":18,"state":"up:active","state_seq":12,"addr":"172.21.15.87:6839/2127215876","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6838","nonce":2127215876},{"type":"v1","addr":"172.21.15.87:6839","nonce":2127215876}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24500":{"gid":24500,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.90:6839/160586017","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6838","nonce":160586017},{"type":"v1","addr":"172.21.15.90:6839","nonce":160586017}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24500,"qdb_cluster":[24482,24500,24481]},"id":1}]} 2024-05-08T05:28:10.963 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:10.961+0000 7f3298c00700 1 -- 172.21.15.87:0/4071949595 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f32740b2880 msgr2=0x7f32740b4d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:28:10.963 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:10.961+0000 7f3298c00700 1 --2- 172.21.15.87:0/4071949595 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f32740b2880 0x7f32740b4d40 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f3284009fd0 tx=0x7f3284009260 comp rx=0 tx=0).stop 2024-05-08T05:28:10.963 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:10.961+0000 7f3298c00700 1 -- 172.21.15.87:0/4071949595 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3294106080 msgr2=0x7f329419c250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:28:10.963 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:10.961+0000 7f3298c00700 1 --2- 172.21.15.87:0/4071949595 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3294106080 0x7f329419c250 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f327c00ec10 tx=0x7f327c00ef20 comp rx=0 tx=0).stop 2024-05-08T05:28:10.963 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:10.961+0000 7f3298c00700 1 -- 172.21.15.87:0/4071949595 shutdown_connections 2024-05-08T05:28:10.963 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:10.961+0000 7f3298c00700 1 --2- 172.21.15.87:0/4071949595 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f329410b6c0 0x7f32941a05e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:28:10.963 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:10.961+0000 7f3298c00700 1 --2- 172.21.15.87:0/4071949595 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f32740b2880 0x7f32740b4d40 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:28:10.963 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:10.961+0000 7f3298c00700 1 --2- 172.21.15.87:0/4071949595 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f32941056c0 0x7f329419bd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:28:10.963 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:10.961+0000 7f3298c00700 1 --2- 172.21.15.87:0/4071949595 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3294106080 0x7f329419c250 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:28:10.963 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:10.961+0000 7f3298c00700 1 -- 172.21.15.87:0/4071949595 >> 172.21.15.87:0/4071949595 conn(0x7f32941011b0 msgr2=0x7f3294101750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:28:10.963 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:10.962+0000 7f3298c00700 1 -- 172.21.15.87:0/4071949595 shutdown_connections 2024-05-08T05:28:10.963 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:10.962+0000 7f3298c00700 1 -- 172.21.15.87:0/4071949595 wait complete. 2024-05-08T05:28:10.964 INFO:teuthology.orchestra.run.smithi087.stderr:dumped fsmap epoch 24 2024-05-08T05:28:10.983 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:28:10 smithi090 ceph-mon[34526]: pgmap v395: 97 pgs: 97 active+clean; 644 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-05-08T05:28:11.038 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:28:10 smithi160 ceph-mon[34827]: pgmap v395: 97 pgs: 97 active+clean; 644 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-05-08T05:28:11.762 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 24, 'flags': 50, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': True, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 32, 'explicitly_allowed_features': 32, 'created': '2024-05-08T05:25:36.816840+0000', 'modified': '2024-05-08T05:25:59.331243+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 3, 'in': [0, 1, 2], 'up': {'mds_0': 24500, 'mds_1': 24482, 'mds_2': 24481}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_24463': {'gid': 24463, 'name': 'f', 'rank': 2, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.160:6835/409648357', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.160:6834', 'nonce': 409648357}, {'type': 'v1', 'addr': '172.21.15.160:6835', 'nonce': 409648357}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24467': {'gid': 24467, 'name': 'h', 'rank': 1, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.90:6837/4221919418', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.90:6836', 'nonce': 4221919418}, {'type': 'v1', 'addr': '172.21.15.90:6837', 'nonce': 4221919418}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24469': {'gid': 24469, 'name': 'c', 'rank': 0, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.160:6837/4200018040', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.160:6836', 'nonce': 4200018040}, {'type': 'v1', 'addr': '172.21.15.160:6837', 'nonce': 4200018040}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24481': {'gid': 24481, 'name': 'i', 'rank': 2, 'incarnation': 20, 'state': 'up:active', 'state_seq': 13, 'addr': '172.21.15.160:6839/234657686', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.160:6838', 'nonce': 234657686}, {'type': 'v1', 'addr': '172.21.15.160:6839', 'nonce': 234657686}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24482': {'gid': 24482, 'name': 'g', 'rank': 1, 'incarnation': 18, 'state': 'up:active', 'state_seq': 12, 'addr': '172.21.15.87:6839/2127215876', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.87:6838', 'nonce': 2127215876}, {'type': 'v1', 'addr': '172.21.15.87:6839', 'nonce': 2127215876}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24500': {'gid': 24500, 'name': 'b', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 6, 'addr': '172.21.15.90:6839/160586017', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.90:6838', 'nonce': 160586017}, {'type': 'v1', 'addr': '172.21.15.90:6839', 'nonce': 160586017}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 24500, 'qdb_cluster': [24482, 24500, 24481]} 2024-05-08T05:28:11.762 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 3/3 2024-05-08T05:28:11.763 DEBUG:teuthology.orchestra.run.smithi087:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid eeeb813e-0cf9-11ef-bc97-c7b262605968 -- ceph tell mds.i status 2024-05-08T05:28:11.958 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:28:11 smithi087 ceph-mon[29523]: from='client.? 172.21.15.87:0/4071949595' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T05:28:11.983 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:28:11 smithi090 ceph-mon[34526]: from='client.? 172.21.15.87:0/4071949595' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T05:28:12.038 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:28:11 smithi160 ceph-mon[34827]: from='client.? 172.21.15.87:0/4071949595' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T05:28:12.209 INFO:teuthology.orchestra.run.smithi087.stderr:Inferring config /var/lib/ceph/eeeb813e-0cf9-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T05:28:12.958 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:28:12 smithi087 ceph-mon[29523]: pgmap v396: 97 pgs: 97 active+clean; 644 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T05:28:12.983 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:28:12 smithi090 ceph-mon[34526]: pgmap v396: 97 pgs: 97 active+clean; 644 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T05:28:13.039 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:28:12 smithi160 ceph-mon[34827]: pgmap v396: 97 pgs: 97 active+clean; 644 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T05:28:14.352 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:14.350+0000 7f6dae800700 1 -- 172.21.15.87:0/819217637 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6da8105690 msgr2=0x7f6da8105b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:28:14.352 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:14.350+0000 7f6dae800700 1 --2- 172.21.15.87:0/819217637 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6da8105690 0x7f6da8105b10 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f6d94009990 tx=0x7f6d94009ca0 comp rx=0 tx=0).stop 2024-05-08T05:28:14.353 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:14.350+0000 7f6dae800700 1 -- 172.21.15.87:0/819217637 shutdown_connections 2024-05-08T05:28:14.353 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:14.350+0000 7f6dae800700 1 --2- 172.21.15.87:0/819217637 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6da8106050 0x7f6da8112560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:28:14.353 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:14.350+0000 7f6dae800700 1 --2- 172.21.15.87:0/819217637 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6da810b690 0x7f6da810ba70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:28:14.353 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:14.350+0000 7f6dae800700 1 --2- 172.21.15.87:0/819217637 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6da8105690 0x7f6da8105b10 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:28:14.353 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:14.350+0000 7f6dae800700 1 -- 172.21.15.87:0/819217637 >> 172.21.15.87:0/819217637 conn(0x7f6da8101180 msgr2=0x7f6da81035a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:28:14.353 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:14.350+0000 7f6dae800700 1 -- 172.21.15.87:0/819217637 shutdown_connections 2024-05-08T05:28:14.353 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:14.350+0000 7f6dae800700 1 -- 172.21.15.87:0/819217637 wait complete. 2024-05-08T05:28:14.354 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:14.351+0000 7f6dae800700 1 Processor -- start 2024-05-08T05:28:14.354 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:14.352+0000 7f6dae800700 1 -- start start 2024-05-08T05:28:14.354 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:14.352+0000 7f6dae800700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6da8105690 0x7f6da819bd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:28:14.354 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:14.352+0000 7f6dae800700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6da8106050 0x7f6da819c2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:28:14.354 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:14.352+0000 7f6dae800700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6da810b690 0x7f6da81a0640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:28:14.354 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:14.352+0000 7f6dae800700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f6da81158c0 con 0x7f6da810b690 2024-05-08T05:28:14.354 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:14.352+0000 7f6dae800700 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f6da8115740 con 0x7f6da8105690 2024-05-08T05:28:14.355 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:14.352+0000 7f6dae800700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f6da8115a40 con 0x7f6da8106050 2024-05-08T05:28:14.355 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:14.352+0000 7f6da7400700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6da8105690 0x7f6da819bd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:28:14.355 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:14.352+0000 7f6da7e00700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6da810b690 0x7f6da81a0640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:28:14.355 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:14.352+0000 7f6da7400700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6da8105690 0x7f6da819bd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.87:45454/0 (socket says 172.21.15.87:45454) 2024-05-08T05:28:14.355 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:14.352+0000 7f6da7400700 1 -- 172.21.15.87:0/615088307 learned_addr learned my addr 172.21.15.87:0/615088307 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T05:28:14.355 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:14.353+0000 7f6da6a00700 1 --2- 172.21.15.87:0/615088307 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6da8106050 0x7f6da819c2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:28:14.356 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:14.353+0000 7f6da7400700 1 -- 172.21.15.87:0/615088307 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6da8106050 msgr2=0x7f6da819c2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:28:14.356 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:14.353+0000 7f6da7400700 1 --2- 172.21.15.87:0/615088307 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6da8106050 0x7f6da819c2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:28:14.356 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:14.353+0000 7f6da7400700 1 -- 172.21.15.87:0/615088307 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6da810b690 msgr2=0x7f6da81a0640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:28:14.356 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:14.353+0000 7f6da7400700 1 --2- 172.21.15.87:0/615088307 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6da810b690 0x7f6da81a0640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:28:14.356 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:14.353+0000 7f6da7400700 1 -- 172.21.15.87:0/615088307 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6da81a0d80 con 0x7f6da8105690 2024-05-08T05:28:14.356 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:14.353+0000 7f6da7e00700 1 --2- 172.21.15.87:0/615088307 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6da810b690 0x7f6da81a0640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T05:28:14.356 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:14.353+0000 7f6da7400700 1 --2- 172.21.15.87:0/615088307 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6da8105690 0x7f6da819bd70 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f6d9800e9a0 tx=0x7f6d9800ecb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:28:14.356 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:14.353+0000 7f6d9fe00700 1 -- 172.21.15.87:0/615088307 <== mon.2 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d9800ca10 con 0x7f6da8105690 2024-05-08T05:28:14.356 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:14.354+0000 7f6d9fe00700 1 -- 172.21.15.87:0/615088307 <== mon.2 v2:172.21.15.90:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6d9800cbb0 con 0x7f6da8105690 2024-05-08T05:28:14.356 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:14.354+0000 7f6dae800700 1 -- 172.21.15.87:0/615088307 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6da81a1070 con 0x7f6da8105690 2024-05-08T05:28:14.356 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:14.354+0000 7f6d9fe00700 1 -- 172.21.15.87:0/615088307 <== mon.2 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d98018680 con 0x7f6da8105690 2024-05-08T05:28:14.357 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:14.354+0000 7f6dae800700 1 -- 172.21.15.87:0/615088307 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6da81a88f0 con 0x7f6da8105690 2024-05-08T05:28:14.358 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:14.357+0000 7f6d9fe00700 1 -- 172.21.15.87:0/615088307 <== mon.2 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7f6d98010430 con 0x7f6da8105690 2024-05-08T05:28:14.359 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:14.358+0000 7f6db9124b80 1 Processor -- start 2024-05-08T05:28:14.360 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:14.359+0000 7f6db9124b80 1 -- start start 2024-05-08T05:28:14.361 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:14.359+0000 7f6db9124b80 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x561ea7417010 0x561ea74173f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:28:14.361 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:14.359+0000 7f6db9124b80 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x561ea7417930 0x561ea741b440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:28:14.361 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:14.359+0000 7f6db9124b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x561ea741b980 0x561ea741bde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:28:14.361 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:14.359+0000 7f6db9124b80 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x561ea73699d0 con 0x561ea7417010 2024-05-08T05:28:14.361 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:14.359+0000 7f6db9124b80 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x561ea7307710 con 0x561ea7417930 2024-05-08T05:28:14.361 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:14.359+0000 7f6db9124b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x561ea7365990 con 0x561ea741b980 2024-05-08T05:28:14.361 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:14.359+0000 7f6da7e00700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x561ea7417010 0x561ea74173f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:28:14.361 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:14.359+0000 7f6da7e00700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x561ea7417010 0x561ea74173f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:44094/0 (socket says 172.21.15.87:44094) 2024-05-08T05:28:14.361 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:14.359+0000 7f6da7e00700 1 -- 172.21.15.87:0/3257626399 learned_addr learned my addr 172.21.15.87:0/3257626399 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T05:28:14.361 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:14.359+0000 7f6da7400700 1 --2- 172.21.15.87:0/3257626399 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x561ea7417930 0x561ea741b440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:28:14.361 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:14.359+0000 7f6da6a00700 1 --2- 172.21.15.87:0/3257626399 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x561ea741b980 0x561ea741bde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:28:14.362 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:14.360+0000 7f6d9fe00700 1 --2- 172.21.15.87:0/615088307 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f6d8c0b2880 0x7f6d8c0b4d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:28:14.363 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:14.360+0000 7f6da7e00700 1 -- 172.21.15.87:0/3257626399 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x561ea741b980 msgr2=0x561ea741bde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:28:14.363 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:14.360+0000 7f6da7e00700 1 --2- 172.21.15.87:0/3257626399 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x561ea741b980 0x561ea741bde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:28:14.363 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:14.360+0000 7f6da7e00700 1 -- 172.21.15.87:0/3257626399 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x561ea7417930 msgr2=0x561ea741b440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:28:14.363 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:14.360+0000 7f6d9fe00700 1 -- 172.21.15.87:0/615088307 <== mon.2 v2:172.21.15.90:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8190+0+0 (secure 0 0 0) 0x7f6d980e2350 con 0x7f6da8105690 2024-05-08T05:28:14.363 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:14.360+0000 7f6da7e00700 1 --2- 172.21.15.87:0/3257626399 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x561ea7417930 0x561ea741b440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:28:14.363 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:14.360+0000 7f6da7e00700 1 -- 172.21.15.87:0/3257626399 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561ea72b6880 con 0x561ea7417010 2024-05-08T05:28:14.363 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:14.360+0000 7f6da7400700 1 --2- 172.21.15.87:0/3257626399 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x561ea7417930 0x561ea741b440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T05:28:14.363 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:14.360+0000 7f6da7e00700 1 --2- 172.21.15.87:0/615088307 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f6d8c0b2880 0x7f6d8c0b4d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:28:14.363 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:14.360+0000 7f6da7e00700 1 --2- 172.21.15.87:0/3257626399 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x561ea7417010 0x561ea74173f0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f6da0009520 tx=0x7f6da0004320 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fa9fb678ac8e7d31 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:28:14.363 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:14.361+0000 7f6d9cc00700 1 -- 172.21.15.87:0/3257626399 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6da001c040 con 0x561ea7417010 2024-05-08T05:28:14.363 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:14.361+0000 7f6d9cc00700 1 -- 172.21.15.87:0/3257626399 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6da000eba0 con 0x561ea7417010 2024-05-08T05:28:14.363 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:14.361+0000 7f6d9cc00700 1 -- 172.21.15.87:0/3257626399 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6da0018820 con 0x561ea7417010 2024-05-08T05:28:14.363 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:14.362+0000 7f6db9124b80 1 -- 172.21.15.87:0/3257626399 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x561ea7417010 msgr2=0x561ea74173f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:28:14.364 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:14.362+0000 7f6db9124b80 1 --2- 172.21.15.87:0/3257626399 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x561ea7417010 0x561ea74173f0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f6da0009520 tx=0x7f6da0004320 comp rx=0 tx=0).stop 2024-05-08T05:28:14.364 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:14.362+0000 7f6da7e00700 1 --2- 172.21.15.87:0/615088307 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f6d8c0b2880 0x7f6d8c0b4d40 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f6da0022000 tx=0x7f6da001f000 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:28:14.366 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:14.362+0000 7f6db9124b80 1 -- 172.21.15.87:0/3257626399 shutdown_connections 2024-05-08T05:28:14.366 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:14.362+0000 7f6db9124b80 1 --2- 172.21.15.87:0/3257626399 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x561ea741b980 0x561ea741bde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:28:14.366 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:14.362+0000 7f6db9124b80 1 --2- 172.21.15.87:0/3257626399 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x561ea7417010 0x561ea74173f0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:28:14.366 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:14.362+0000 7f6db9124b80 1 --2- 172.21.15.87:0/3257626399 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x561ea7417930 0x561ea741b440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:28:14.366 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:14.362+0000 7f6db9124b80 1 -- 172.21.15.87:0/3257626399 >> 172.21.15.87:0/3257626399 conn(0x561ea7345b10 msgr2=0x561ea7411750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:28:14.366 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:14.362+0000 7f6db9124b80 1 -- 172.21.15.87:0/3257626399 shutdown_connections 2024-05-08T05:28:14.366 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:14.362+0000 7f6db9124b80 1 -- 172.21.15.87:0/3257626399 wait complete. 2024-05-08T05:28:14.366 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:14.362+0000 7f6db9124b80 1 -- start start 2024-05-08T05:28:14.366 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:14.363+0000 7f6db9124b80 1 Processor -- start 2024-05-08T05:28:14.366 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:14.363+0000 7f6db9124b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x561ea7417010 0x561ea7422db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:28:14.366 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:14.363+0000 7f6db9124b80 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x561ea7417930 0x561ea7420150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:28:14.366 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:14.363+0000 7f6db9124b80 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x561ea741b980 0x561ea7420690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:28:14.367 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:14.363+0000 7f6db9124b80 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x561ea7423b90 con 0x561ea7417930 2024-05-08T05:28:14.367 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:14.363+0000 7f6db9124b80 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x561ea72cfad0 con 0x561ea741b980 2024-05-08T05:28:14.367 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:14.363+0000 7f6db9124b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x561ea7423d10 con 0x561ea7417010 2024-05-08T05:28:14.367 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:14.363+0000 7f6db9124b80 10 client.0 _ll_register_callbacks cb 0x561ea7310c20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T05:28:14.367 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:14.363+0000 7f6da6a00700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x561ea7417930 0x561ea7420150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:28:14.367 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:14.363+0000 7f6da7e00700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x561ea741b980 0x561ea7420690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:28:14.367 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:14.364+0000 7f6da6a00700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x561ea7417930 0x561ea7420150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:44096/0 (socket says 172.21.15.87:44096) 2024-05-08T05:28:14.367 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:14.364+0000 7f6da6a00700 1 -- 172.21.15.87:0/3308466788 learned_addr learned my addr 172.21.15.87:0/3308466788 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T05:28:14.367 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:14.364+0000 7f6da7400700 1 --2- 172.21.15.87:0/3308466788 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x561ea7417010 0x561ea7422db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:28:14.367 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:14.364+0000 7f6da7e00700 1 -- 172.21.15.87:0/3308466788 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x561ea7417010 msgr2=0x561ea7422db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:28:14.367 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:14.364+0000 7f6da7e00700 1 --2- 172.21.15.87:0/3308466788 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x561ea7417010 0x561ea7422db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:28:14.367 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:14.364+0000 7f6da7e00700 1 -- 172.21.15.87:0/3308466788 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x561ea7417930 msgr2=0x561ea7420150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:28:14.367 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:14.364+0000 7f6da7e00700 1 --2- 172.21.15.87:0/3308466788 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x561ea7417930 0x561ea7420150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:28:14.367 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:14.364+0000 7f6da7e00700 1 -- 172.21.15.87:0/3308466788 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561ea732f3d0 con 0x561ea741b980 2024-05-08T05:28:14.367 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:14.364+0000 7f6da7e00700 1 --2- 172.21.15.87:0/3308466788 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x561ea741b980 0x561ea7420690 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f6da00184c0 tx=0x7f6da0018ee0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=41af7ec34a99b757 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:28:14.368 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:14.364+0000 7f6d91600700 10 client.0 ms_handle_connect on v2:172.21.15.90:3300/0 2024-05-08T05:28:14.368 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:14.364+0000 7f6d91600700 1 -- 172.21.15.87:0/3308466788 <== mon.2 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6da002f070 con 0x561ea741b980 2024-05-08T05:28:14.368 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:14.365+0000 7f6d91600700 1 -- 172.21.15.87:0/3308466788 <== mon.2 v2:172.21.15.90:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8190+0+0 (secure 0 0 0) 0x7f6da0018520 con 0x561ea741b980 2024-05-08T05:28:14.368 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:14.365+0000 7f6db9124b80 1 -- 172.21.15.87:0/3308466788 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6da000eba0 con 0x561ea741b980 2024-05-08T05:28:14.370 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:14.365+0000 7f6d91600700 1 -- 172.21.15.87:0/3308466788 <== mon.2 v2:172.21.15.90:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f6da003b050 con 0x561ea741b980 2024-05-08T05:28:14.370 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:14.365+0000 7f6db9124b80 10 client.24842 fetch_fsmap learned FSMap version 24 2024-05-08T05:28:14.370 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:14.365+0000 7f6db9124b80 1 -- 172.21.15.87:0/3308466788 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x561ea742e3b0 con 0x561ea741b980 2024-05-08T05:28:14.370 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:14.365+0000 7f6d91600700 1 -- 172.21.15.87:0/3308466788 <== mon.2 v2:172.21.15.90:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6da000eba0 con 0x561ea741b980 2024-05-08T05:28:14.370 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:14.365+0000 7f6d91600700 1 -- 172.21.15.87:0/3308466788 <== mon.2 v2:172.21.15.90:3300/0 5 ==== fsmap(e 24) ==== 8338+0+0 (secure 0 0 0) 0x7f6da002a040 con 0x561ea741b980 2024-05-08T05:28:14.370 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:14.365+0000 7f6db9124b80 10 client.24842 fetch_fsmap finished waiting for FSMap version 24 2024-05-08T05:28:14.370 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:14.365+0000 7f6db9124b80 10 client.24842 resolve_mds: resolved name 'i' to daemon mds.i 2024-05-08T05:28:14.370 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:14.366+0000 7f6db9124b80 20 client.24842 populate_metadata read hostname 'smithi087' 2024-05-08T05:28:14.370 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:14.366+0000 7f6db9124b80 1 --2- 172.21.15.87:0/3308466788 >> [v2:172.21.15.160:6838/234657686,v1:172.21.15.160:6839/234657686] conn(0x561ea7430640 0x561ea7431ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:28:14.370 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:14.366+0000 7f6db9124b80 4 client.24842 mds_command: new command op to 24481 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-08T05:28:14.370 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:14.366+0000 7f6db9124b80 1 -- 172.21.15.87:0/3308466788 --> [v2:172.21.15.160:6838/234657686,v1:172.21.15.160:6839/234657686] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x561ea73e4050 con 0x561ea7430640 2024-05-08T05:28:14.370 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:14.366+0000 7f6da7400700 1 --2- 172.21.15.87:0/3308466788 >> [v2:172.21.15.160:6838/234657686,v1:172.21.15.160:6839/234657686] conn(0x561ea7430640 0x561ea7431ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:28:14.371 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:14.366+0000 7f6da7400700 1 --2- 172.21.15.87:0/3308466788 >> [v2:172.21.15.160:6838/234657686,v1:172.21.15.160:6839/234657686] conn(0x561ea7430640 0x561ea7431ab0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=8e32891cf6c7d6c9 server_cookie=3316887fcc5dacb4 in_seq=0 out_seq=0 2024-05-08T05:28:14.371 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:14.366+0000 7f6d91600700 10 client.24842 ms_handle_connect on v2:172.21.15.160:6838/234657686 2024-05-08T05:28:14.371 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:14.367+0000 7f6d91600700 1 -- 172.21.15.87:0/3308466788 <== mds.2 v2:172.21.15.160:6838/234657686 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x561ea73e4050 con 0x561ea7430640 2024-05-08T05:28:14.371 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:14.367+0000 7f6d91600700 10 client.24842 handle_command_reply: tid=0 2024-05-08T05:28:14.371 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:14.367+0000 7f6db9124b80 1 client.24842 shutdown 2024-05-08T05:28:14.371 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:14.367+0000 7f6db9124b80 1 -- 172.21.15.87:0/3308466788 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x561ea741b980 msgr2=0x561ea7420690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:28:14.371 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:14.367+0000 7f6db9124b80 1 --2- 172.21.15.87:0/3308466788 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x561ea741b980 0x561ea7420690 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f6da00184c0 tx=0x7f6da0018ee0 comp rx=0 tx=0).stop 2024-05-08T05:28:14.371 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:14.368+0000 7f6db9124b80 1 -- 172.21.15.87:0/3308466788 shutdown_connections 2024-05-08T05:28:14.371 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:14.368+0000 7f6db9124b80 1 --2- 172.21.15.87:0/3308466788 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x561ea741b980 0x561ea7420690 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:28:14.371 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:14.368+0000 7f6db9124b80 1 --2- 172.21.15.87:0/3308466788 >> [v2:172.21.15.160:6838/234657686,v1:172.21.15.160:6839/234657686] conn(0x561ea7430640 0x561ea7431ab0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:28:14.371 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:14.368+0000 7f6db9124b80 1 --2- 172.21.15.87:0/3308466788 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x561ea7417010 0x561ea7422db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:28:14.371 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:14.368+0000 7f6d91600700 0 client.24842 ms_handle_reset on v2:172.21.15.160:6838/234657686 2024-05-08T05:28:14.371 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:14.368+0000 7f6db9124b80 1 --2- 172.21.15.87:0/3308466788 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x561ea7417930 0x561ea7420150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:28:14.371 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:14.368+0000 7f6db9124b80 1 -- 172.21.15.87:0/3308466788 >> 172.21.15.87:0/3308466788 conn(0x561ea7345b10 msgr2=0x561ea740c260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:28:14.372 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:14.368+0000 7f6db9124b80 1 -- 172.21.15.87:0/3308466788 shutdown_connections 2024-05-08T05:28:14.372 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:14.368+0000 7f6db9124b80 1 -- 172.21.15.87:0/3308466788 wait complete. 2024-05-08T05:28:14.372 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:14.368+0000 7f6db9124b80 20 client.24842 trim_cache size 0 max 16384 2024-05-08T05:28:14.394 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:14.392+0000 7f6db9124b80 1 Processor -- start 2024-05-08T05:28:14.394 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:14.392+0000 7f6db9124b80 1 -- start start 2024-05-08T05:28:14.394 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:14.392+0000 7f6db9124b80 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x561ea7417010 0x561ea740b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:28:14.394 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:14.392+0000 7f6db9124b80 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x561ea7417930 0x561ea740bf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:28:14.394 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:14.393+0000 7f6db9124b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x561ea741b980 0x561ea740c450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:28:14.394 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:14.393+0000 7f6db9124b80 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x561ea742fdf0 con 0x561ea7417010 2024-05-08T05:28:14.394 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:14.393+0000 7f6db9124b80 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x561ea74304c0 con 0x561ea7417930 2024-05-08T05:28:14.394 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:14.393+0000 7f6db9124b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x561ea7430b90 con 0x561ea741b980 2024-05-08T05:28:14.394 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:14.393+0000 7f6da7400700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x561ea7417010 0x561ea740b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:28:14.394 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:14.393+0000 7f6da7400700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x561ea7417010 0x561ea740b9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:44098/0 (socket says 172.21.15.87:44098) 2024-05-08T05:28:14.395 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:14.393+0000 7f6da7400700 1 -- 172.21.15.87:0/2084178676 learned_addr learned my addr 172.21.15.87:0/2084178676 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T05:28:14.395 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:14.393+0000 7f6da6a00700 1 --2- 172.21.15.87:0/2084178676 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x561ea7417930 0x561ea740bf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:28:14.395 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:14.393+0000 7f6da7e00700 1 --2- 172.21.15.87:0/2084178676 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x561ea741b980 0x561ea740c450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:28:14.396 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:14.393+0000 7f6da7400700 1 -- 172.21.15.87:0/2084178676 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x561ea741b980 msgr2=0x561ea740c450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:28:14.396 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:14.393+0000 7f6da7400700 1 --2- 172.21.15.87:0/2084178676 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x561ea741b980 0x561ea740c450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:28:14.396 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:14.393+0000 7f6da7400700 1 -- 172.21.15.87:0/2084178676 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x561ea7417930 msgr2=0x561ea740bf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:28:14.396 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:14.393+0000 7f6da7400700 1 --2- 172.21.15.87:0/2084178676 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x561ea7417930 0x561ea740bf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:28:14.396 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:14.393+0000 7f6da7400700 1 -- 172.21.15.87:0/2084178676 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561ea740e3a0 con 0x561ea7417010 2024-05-08T05:28:14.396 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:14.393+0000 7f6da7e00700 1 --2- 172.21.15.87:0/2084178676 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x561ea741b980 0x561ea740c450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T05:28:14.396 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:14.394+0000 7f6da7400700 1 --2- 172.21.15.87:0/2084178676 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x561ea7417010 0x561ea740b9d0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f6d980a59c0 tx=0x7f6d980dfcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=42679cde373a3cf server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:28:14.396 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:14.394+0000 7f6d93e00700 1 -- 172.21.15.87:0/2084178676 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d980a50d0 con 0x561ea7417010 2024-05-08T05:28:14.396 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:14.394+0000 7f6d93e00700 1 -- 172.21.15.87:0/2084178676 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6d980b20e0 con 0x561ea7417010 2024-05-08T05:28:14.396 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:14.394+0000 7f6d93e00700 1 -- 172.21.15.87:0/2084178676 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d980b27a0 con 0x561ea7417010 2024-05-08T05:28:14.398 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:14.395+0000 7f6db9124b80 1 -- 172.21.15.87:0/2084178676 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x561ea7417010 msgr2=0x561ea740b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:28:14.398 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:14.395+0000 7f6db9124b80 1 --2- 172.21.15.87:0/2084178676 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x561ea7417010 0x561ea740b9d0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f6d980a59c0 tx=0x7f6d980dfcf0 comp rx=0 tx=0).stop 2024-05-08T05:28:14.398 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:14.395+0000 7f6db9124b80 1 -- 172.21.15.87:0/2084178676 shutdown_connections 2024-05-08T05:28:14.398 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:14.395+0000 7f6db9124b80 1 --2- 172.21.15.87:0/2084178676 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x561ea741b980 0x561ea740c450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:28:14.398 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:14.395+0000 7f6db9124b80 1 --2- 172.21.15.87:0/2084178676 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x561ea7417010 0x561ea740b9d0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:28:14.398 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:14.395+0000 7f6db9124b80 1 --2- 172.21.15.87:0/2084178676 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x561ea7417930 0x561ea740bf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:28:14.398 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:14.395+0000 7f6db9124b80 1 -- 172.21.15.87:0/2084178676 >> 172.21.15.87:0/2084178676 conn(0x561ea7345b10 msgr2=0x561ea740b250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:28:14.399 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:14.395+0000 7f6db9124b80 1 -- 172.21.15.87:0/2084178676 shutdown_connections 2024-05-08T05:28:14.399 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:14.395+0000 7f6db9124b80 1 -- 172.21.15.87:0/2084178676 wait complete. 2024-05-08T05:28:14.399 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:14.395+0000 7f6db9124b80 1 -- start start 2024-05-08T05:28:14.399 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:14.395+0000 7f6db9124b80 1 Processor -- start 2024-05-08T05:28:14.399 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:14.396+0000 7f6db9124b80 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x561ea7417010 0x561ea743b010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:28:14.399 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:14.396+0000 7f6db9124b80 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x561ea7417930 0x561ea743b550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:28:14.399 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:14.396+0000 7f6db9124b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x561ea741b980 0x561ea74374c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:28:14.399 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:14.396+0000 7f6db9124b80 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x561ea7431930 con 0x561ea7417930 2024-05-08T05:28:14.399 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:14.396+0000 7f6db9124b80 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x561ea7431260 con 0x561ea7417010 2024-05-08T05:28:14.399 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:14.396+0000 7f6db9124b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x561ea7432000 con 0x561ea741b980 2024-05-08T05:28:14.399 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:14.396+0000 7f6db9124b80 10 client.0 _ll_register_callbacks cb 0x561ea7310c20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T05:28:14.399 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:14.396+0000 7f6da6a00700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x561ea7417930 0x561ea743b550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:28:14.399 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:14.396+0000 7f6da6a00700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x561ea7417930 0x561ea743b550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:44100/0 (socket says 172.21.15.87:44100) 2024-05-08T05:28:14.399 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:14.396+0000 7f6da6a00700 1 -- 172.21.15.87:0/1410720519 learned_addr learned my addr 172.21.15.87:0/1410720519 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T05:28:14.399 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:14.396+0000 7f6da7400700 1 --2- 172.21.15.87:0/1410720519 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x561ea7417010 0x561ea743b010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:28:14.400 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:14.396+0000 7f6da7e00700 1 --2- 172.21.15.87:0/1410720519 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x561ea741b980 0x561ea74374c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:28:14.400 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:14.397+0000 7f6da6a00700 1 -- 172.21.15.87:0/1410720519 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x561ea741b980 msgr2=0x561ea74374c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:28:14.400 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:14.397+0000 7f6da6a00700 1 --2- 172.21.15.87:0/1410720519 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x561ea741b980 0x561ea74374c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:28:14.400 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:14.397+0000 7f6da6a00700 1 -- 172.21.15.87:0/1410720519 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x561ea7417010 msgr2=0x561ea743b010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:28:14.400 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:14.397+0000 7f6da6a00700 1 --2- 172.21.15.87:0/1410720519 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x561ea7417010 0x561ea743b010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:28:14.400 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:14.397+0000 7f6da6a00700 1 -- 172.21.15.87:0/1410720519 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561ea7432a10 con 0x561ea7417930 2024-05-08T05:28:14.400 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:14.397+0000 7f6da7400700 1 --2- 172.21.15.87:0/1410720519 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x561ea7417010 0x561ea743b010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T05:28:14.402 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:14.397+0000 7f6da6a00700 1 --2- 172.21.15.87:0/1410720519 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x561ea7417930 0x561ea743b550 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x561ea7421720 tx=0x7f6d940057b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=52368248a86e1d62 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:28:14.402 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:14.397+0000 7f6d91600700 10 client.0 ms_handle_connect on v2:172.21.15.87:3300/0 2024-05-08T05:28:14.402 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:14.397+0000 7f6d91600700 1 -- 172.21.15.87:0/1410720519 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d94029070 con 0x561ea7417930 2024-05-08T05:28:14.402 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:14.398+0000 7f6d91600700 1 -- 172.21.15.87:0/1410720519 <== mon.0 v2:172.21.15.87:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8190+0+0 (secure 0 0 0) 0x7f6d9400bc70 con 0x561ea7417930 2024-05-08T05:28:14.402 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:14.398+0000 7f6db9124b80 1 -- 172.21.15.87:0/1410720519 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x561ea73773b0 con 0x561ea7417930 2024-05-08T05:28:14.403 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:14.398+0000 7f6d91600700 1 -- 172.21.15.87:0/1410720519 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f6d94035050 con 0x561ea7417930 2024-05-08T05:28:14.403 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:14.398+0000 7f6db9124b80 10 client.14754 fetch_fsmap learned FSMap version 24 2024-05-08T05:28:14.403 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:14.398+0000 7f6db9124b80 1 -- 172.21.15.87:0/1410720519 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x561ea74a4d40 con 0x561ea7417930 2024-05-08T05:28:14.403 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:14.398+0000 7f6d91600700 1 -- 172.21.15.87:0/1410720519 <== mon.0 v2:172.21.15.87:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x561ea73773b0 con 0x561ea7417930 2024-05-08T05:28:14.403 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:14.398+0000 7f6d91600700 1 -- 172.21.15.87:0/1410720519 <== mon.0 v2:172.21.15.87:3300/0 5 ==== fsmap(e 24) ==== 8338+0+0 (secure 0 0 0) 0x7f6d9400f730 con 0x561ea7417930 2024-05-08T05:28:14.403 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:14.398+0000 7f6db9124b80 10 client.14754 fetch_fsmap finished waiting for FSMap version 24 2024-05-08T05:28:14.403 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:14.398+0000 7f6db9124b80 10 client.14754 resolve_mds: resolved name 'i' to daemon mds.i 2024-05-08T05:28:14.403 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:14.398+0000 7f6db9124b80 20 client.14754 populate_metadata read hostname 'smithi087' 2024-05-08T05:28:14.403 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:14.398+0000 7f6db9124b80 1 --2- 172.21.15.87:0/1410720519 >> [v2:172.21.15.160:6838/234657686,v1:172.21.15.160:6839/234657686] conn(0x561ea74a9950 0x561ea74a8660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:28:14.403 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:14.398+0000 7f6db9124b80 4 client.14754 mds_command: new command op to 24481 tid=0 multi_id=0 [{"prefix": "status"}] 2024-05-08T05:28:14.403 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:14.398+0000 7f6db9124b80 1 -- 172.21.15.87:0/1410720519 --> [v2:172.21.15.160:6838/234657686,v1:172.21.15.160:6839/234657686] -- command(tid 0: {"prefix": "status"}) -- 0x561ea7371450 con 0x561ea74a9950 2024-05-08T05:28:14.403 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:14.399+0000 7f6da7400700 1 --2- 172.21.15.87:0/1410720519 >> [v2:172.21.15.160:6838/234657686,v1:172.21.15.160:6839/234657686] conn(0x561ea74a9950 0x561ea74a8660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:28:14.403 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:14.399+0000 7f6da7400700 1 --2- 172.21.15.87:0/1410720519 >> [v2:172.21.15.160:6838/234657686,v1:172.21.15.160:6839/234657686] conn(0x561ea74a9950 0x561ea74a8660 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=e585387384692974 server_cookie=8ca196e956f177cb in_seq=0 out_seq=0 2024-05-08T05:28:14.404 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:14.399+0000 7f6d91600700 10 client.14754 ms_handle_connect on v2:172.21.15.160:6838/234657686 2024-05-08T05:28:14.404 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:14.399+0000 7f6d91600700 1 -- 172.21.15.87:0/1410720519 <== mds.2 v2:172.21.15.160:6838/234657686 1 ==== command_reply(tid 0: 0 ) ==== 8+0+327 (crc 0 0 0) 0x561ea7371450 con 0x561ea74a9950 2024-05-08T05:28:14.404 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:14.399+0000 7f6d91600700 10 client.14754 handle_command_reply: tid=0 2024-05-08T05:28:14.404 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:14.400+0000 7f6db9124b80 1 client.14754 shutdown 2024-05-08T05:28:14.404 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:14.400+0000 7f6db9124b80 1 -- 172.21.15.87:0/1410720519 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x561ea7417930 msgr2=0x561ea743b550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:28:14.404 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:14.400+0000 7f6db9124b80 1 --2- 172.21.15.87:0/1410720519 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x561ea7417930 0x561ea743b550 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x561ea7421720 tx=0x7f6d940057b0 comp rx=0 tx=0).stop 2024-05-08T05:28:14.404 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:14.400+0000 7f6db9124b80 1 -- 172.21.15.87:0/1410720519 shutdown_connections 2024-05-08T05:28:14.404 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:14.400+0000 7f6db9124b80 1 --2- 172.21.15.87:0/1410720519 >> [v2:172.21.15.160:6838/234657686,v1:172.21.15.160:6839/234657686] conn(0x561ea74a9950 0x561ea74a8660 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:28:14.404 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:14.400+0000 7f6db9124b80 1 --2- 172.21.15.87:0/1410720519 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x561ea741b980 0x561ea74374c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:28:14.404 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:14.400+0000 7f6db9124b80 1 --2- 172.21.15.87:0/1410720519 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x561ea7417010 0x561ea743b010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:28:14.404 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:14.400+0000 7f6db9124b80 1 --2- 172.21.15.87:0/1410720519 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x561ea7417930 0x561ea743b550 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:28:14.404 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:14.400+0000 7f6d91600700 0 client.14754 ms_handle_reset on v2:172.21.15.160:6838/234657686 2024-05-08T05:28:14.404 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:14.400+0000 7f6db9124b80 1 -- 172.21.15.87:0/1410720519 >> 172.21.15.87:0/1410720519 conn(0x561ea7345b10 msgr2=0x561ea740b9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:28:14.404 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:14.400+0000 7f6db9124b80 1 -- 172.21.15.87:0/1410720519 shutdown_connections 2024-05-08T05:28:14.405 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:14.400+0000 7f6db9124b80 1 -- 172.21.15.87:0/1410720519 wait complete. 2024-05-08T05:28:14.405 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:14.400+0000 7f6db9124b80 20 client.14754 trim_cache size 0 max 16384 2024-05-08T05:28:14.405 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-05-08T05:28:14.405 INFO:teuthology.orchestra.run.smithi087.stdout: "cluster_fsid": "eeeb813e-0cf9-11ef-bc97-c7b262605968", 2024-05-08T05:28:14.405 INFO:teuthology.orchestra.run.smithi087.stdout: "whoami": 2, 2024-05-08T05:28:14.405 INFO:teuthology.orchestra.run.smithi087.stdout: "id": 24481, 2024-05-08T05:28:14.405 INFO:teuthology.orchestra.run.smithi087.stdout: "want_state": "up:active", 2024-05-08T05:28:14.405 INFO:teuthology.orchestra.run.smithi087.stdout: "state": "up:active", 2024-05-08T05:28:14.405 INFO:teuthology.orchestra.run.smithi087.stdout: "fs_name": "cephfs", 2024-05-08T05:28:14.405 INFO:teuthology.orchestra.run.smithi087.stdout: "rank_uptime": 141.49440925900001, 2024-05-08T05:28:14.405 INFO:teuthology.orchestra.run.smithi087.stdout: "mdsmap_epoch": 24, 2024-05-08T05:28:14.406 INFO:teuthology.orchestra.run.smithi087.stdout: "osdmap_epoch": 82, 2024-05-08T05:28:14.406 INFO:teuthology.orchestra.run.smithi087.stdout: "osdmap_epoch_barrier": 80, 2024-05-08T05:28:14.406 INFO:teuthology.orchestra.run.smithi087.stdout: "uptime": 188.610427907 2024-05-08T05:28:14.406 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-05-08T05:28:14.406 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:14.401+0000 7f6dae800700 1 -- 172.21.15.87:0/615088307 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f6d8c0b2880 msgr2=0x7f6d8c0b4d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:28:14.407 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:14.401+0000 7f6dae800700 1 --2- 172.21.15.87:0/615088307 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f6d8c0b2880 0x7f6d8c0b4d40 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f6da0022000 tx=0x7f6da001f000 comp rx=0 tx=0).stop 2024-05-08T05:28:14.407 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:14.401+0000 7f6dae800700 1 -- 172.21.15.87:0/615088307 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6da8105690 msgr2=0x7f6da819bd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:28:14.407 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:14.401+0000 7f6dae800700 1 --2- 172.21.15.87:0/615088307 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6da8105690 0x7f6da819bd70 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f6d9800e9a0 tx=0x7f6d9800ecb0 comp rx=0 tx=0).stop 2024-05-08T05:28:14.407 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:14.401+0000 7f6dae800700 1 -- 172.21.15.87:0/615088307 shutdown_connections 2024-05-08T05:28:14.407 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:14.401+0000 7f6dae800700 1 --2- 172.21.15.87:0/615088307 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6da810b690 0x7f6da81a0640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:28:14.407 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:14.401+0000 7f6dae800700 1 --2- 172.21.15.87:0/615088307 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6da8105690 0x7f6da819bd70 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:28:14.407 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:14.401+0000 7f6dae800700 1 --2- 172.21.15.87:0/615088307 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f6d8c0b2880 0x7f6d8c0b4d40 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:28:14.407 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:14.401+0000 7f6dae800700 1 --2- 172.21.15.87:0/615088307 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6da8106050 0x7f6da819c2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:28:14.407 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:14.401+0000 7f6dae800700 1 -- 172.21.15.87:0/615088307 >> 172.21.15.87:0/615088307 conn(0x7f6da8101180 msgr2=0x7f6da8101810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:28:14.407 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:14.401+0000 7f6dae800700 1 -- 172.21.15.87:0/615088307 shutdown_connections 2024-05-08T05:28:14.407 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:14.401+0000 7f6dae800700 1 -- 172.21.15.87:0/615088307 wait complete. 2024-05-08T05:28:14.822 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:28:14 smithi087 ceph-mon[29523]: pgmap v397: 97 pgs: 97 active+clean; 644 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-05-08T05:28:14.983 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:28:14 smithi090 ceph-mon[34526]: pgmap v397: 97 pgs: 97 active+clean; 644 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-05-08T05:28:15.038 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:28:14 smithi160 ceph-mon[34827]: pgmap v397: 97 pgs: 97 active+clean; 644 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-05-08T05:28:15.227 DEBUG:teuthology.orchestra.run.smithi087:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid eeeb813e-0cf9-11ef-bc97-c7b262605968 -- ceph tell mds.g status 2024-05-08T05:28:15.673 INFO:teuthology.orchestra.run.smithi087.stderr:Inferring config /var/lib/ceph/eeeb813e-0cf9-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T05:28:16.958 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:28:16 smithi087 ceph-mon[29523]: pgmap v398: 97 pgs: 97 active+clean; 644 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-05-08T05:28:16.983 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:28:16 smithi090 ceph-mon[34526]: pgmap v398: 97 pgs: 97 active+clean; 644 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-05-08T05:28:17.038 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:28:16 smithi160 ceph-mon[34827]: pgmap v398: 97 pgs: 97 active+clean; 644 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-05-08T05:28:17.878 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:17.876+0000 7fe156a00700 1 -- 172.21.15.87:0/710453339 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe15010fb60 msgr2=0x7fe15010ff40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:28:17.878 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:17.876+0000 7fe156a00700 1 --2- 172.21.15.87:0/710453339 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe15010fb60 0x7fe15010ff40 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fe140009990 tx=0x7fe140009ca0 comp rx=0 tx=0).stop 2024-05-08T05:28:17.878 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:17.876+0000 7fe156a00700 1 -- 172.21.15.87:0/710453339 shutdown_connections 2024-05-08T05:28:17.878 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:17.876+0000 7fe156a00700 1 --2- 172.21.15.87:0/710453339 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe15010a490 0x7fe1501169a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:28:17.878 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:17.876+0000 7fe156a00700 1 --2- 172.21.15.87:0/710453339 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe15010fb60 0x7fe15010ff40 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:28:17.878 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:17.876+0000 7fe156a00700 1 --2- 172.21.15.87:0/710453339 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe150109ad0 0x7fe150109f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:28:17.878 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:17.876+0000 7fe156a00700 1 -- 172.21.15.87:0/710453339 >> 172.21.15.87:0/710453339 conn(0x7fe150076c70 msgr2=0x7fe150079090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:28:17.878 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:17.876+0000 7fe156a00700 1 -- 172.21.15.87:0/710453339 shutdown_connections 2024-05-08T05:28:17.878 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:17.876+0000 7fe156a00700 1 -- 172.21.15.87:0/710453339 wait complete. 2024-05-08T05:28:17.879 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:17.877+0000 7fe156a00700 1 Processor -- start 2024-05-08T05:28:17.879 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:17.877+0000 7fe156a00700 1 -- start start 2024-05-08T05:28:17.879 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:17.878+0000 7fe156a00700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe150109ad0 0x7fe1501a0190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:28:17.880 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:17.878+0000 7fe156a00700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe15010a490 0x7fe1501a06d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:28:17.880 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:17.878+0000 7fe156a00700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe15010fb60 0x7fe1501a4a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:28:17.880 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:17.878+0000 7fe156a00700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fe150119d20 con 0x7fe15010a490 2024-05-08T05:28:17.880 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:17.878+0000 7fe156a00700 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fe150119ba0 con 0x7fe150109ad0 2024-05-08T05:28:17.880 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:17.878+0000 7fe156a00700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7fe150119ea0 con 0x7fe15010fb60 2024-05-08T05:28:17.880 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:17.878+0000 7fe14fe00700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe150109ad0 0x7fe1501a0190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:28:17.880 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:17.878+0000 7fe14fe00700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe150109ad0 0x7fe1501a0190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.87:43196/0 (socket says 172.21.15.87:43196) 2024-05-08T05:28:17.880 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:17.878+0000 7fe14fe00700 1 -- 172.21.15.87:0/2881076004 learned_addr learned my addr 172.21.15.87:0/2881076004 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T05:28:17.880 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:17.878+0000 7fe14f400700 1 --2- 172.21.15.87:0/2881076004 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe15010a490 0x7fe1501a06d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:28:17.881 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:17.878+0000 7fe154a00700 1 --2- 172.21.15.87:0/2881076004 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe15010fb60 0x7fe1501a4a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:28:17.881 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:17.879+0000 7fe14fe00700 1 -- 172.21.15.87:0/2881076004 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe15010fb60 msgr2=0x7fe1501a4a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:28:17.881 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:17.879+0000 7fe14fe00700 1 --2- 172.21.15.87:0/2881076004 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe15010fb60 0x7fe1501a4a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:28:17.882 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:17.879+0000 7fe14fe00700 1 -- 172.21.15.87:0/2881076004 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe15010a490 msgr2=0x7fe1501a06d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:28:17.882 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:17.879+0000 7fe14fe00700 1 --2- 172.21.15.87:0/2881076004 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe15010a490 0x7fe1501a06d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:28:17.882 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:17.879+0000 7fe14fe00700 1 -- 172.21.15.87:0/2881076004 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe1501a51a0 con 0x7fe150109ad0 2024-05-08T05:28:17.882 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:17.879+0000 7fe14fe00700 1 --2- 172.21.15.87:0/2881076004 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe150109ad0 0x7fe1501a0190 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fe140005910 tx=0x7fe14000b670 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:28:17.882 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:17.879+0000 7fe14cc00700 1 -- 172.21.15.87:0/2881076004 <== mon.2 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe140027070 con 0x7fe150109ad0 2024-05-08T05:28:17.882 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:17.879+0000 7fe14cc00700 1 -- 172.21.15.87:0/2881076004 <== mon.2 v2:172.21.15.90:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe140022470 con 0x7fe150109ad0 2024-05-08T05:28:17.882 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:17.879+0000 7fe14cc00700 1 -- 172.21.15.87:0/2881076004 <== mon.2 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe140017650 con 0x7fe150109ad0 2024-05-08T05:28:17.882 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:17.879+0000 7fe156a00700 1 -- 172.21.15.87:0/2881076004 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe1501a5430 con 0x7fe150109ad0 2024-05-08T05:28:17.882 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:17.880+0000 7fe156a00700 1 -- 172.21.15.87:0/2881076004 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe1501acd10 con 0x7fe150109ad0 2024-05-08T05:28:17.884 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:17.883+0000 7fe14cc00700 1 -- 172.21.15.87:0/2881076004 <== mon.2 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7fe14002a070 con 0x7fe150109ad0 2024-05-08T05:28:17.886 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:17.885+0000 7fe161341b80 1 Processor -- start 2024-05-08T05:28:17.886 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:17.885+0000 7fe161341b80 1 -- start start 2024-05-08T05:28:17.886 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:17.885+0000 7fe161341b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55a79d06c010 0x55a79d06c3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:28:17.887 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:17.885+0000 7fe161341b80 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55a79d06c930 0x55a79d070440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:28:17.888 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:17.885+0000 7fe161341b80 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a79d070980 0x55a79d070de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:28:17.888 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:17.885+0000 7fe161341b80 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x55a79cfbe9d0 con 0x55a79d070980 2024-05-08T05:28:17.888 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:17.885+0000 7fe161341b80 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x55a79cf5c710 con 0x55a79d06c930 2024-05-08T05:28:17.888 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:17.885+0000 7fe161341b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x55a79cfba990 con 0x55a79d06c010 2024-05-08T05:28:17.888 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:17.886+0000 7fe14cc00700 1 --2- 172.21.15.87:0/2881076004 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7fe1340b2880 0x7fe1340b4d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:28:17.888 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:17.886+0000 7fe14f400700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a79d070980 0x55a79d070de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:28:17.888 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:17.886+0000 7fe14f400700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a79d070980 0x55a79d070de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:44432/0 (socket says 172.21.15.87:44432) 2024-05-08T05:28:17.888 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:17.886+0000 7fe154a00700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55a79d06c010 0x55a79d06c3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:28:17.888 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:17.886+0000 7fe14f400700 1 -- 172.21.15.87:0/3896706263 learned_addr learned my addr 172.21.15.87:0/3896706263 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T05:28:17.889 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:17.886+0000 7fe14cc00700 1 -- 172.21.15.87:0/2881076004 <== mon.2 v2:172.21.15.90:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8190+0+0 (secure 0 0 0) 0x7fe1400e2fa0 con 0x7fe150109ad0 2024-05-08T05:28:17.889 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:17.886+0000 7fe14fe00700 1 --2- 172.21.15.87:0/3896706263 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55a79d06c930 0x55a79d070440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:28:17.889 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:17.886+0000 7fe154a00700 1 --2- 172.21.15.87:0/2881076004 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7fe1340b2880 0x7fe1340b4d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:28:17.889 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:17.886+0000 7fe14f400700 1 -- 172.21.15.87:0/3896706263 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55a79d06c010 msgr2=0x55a79d06c3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:28:17.889 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:17.886+0000 7fe14f400700 1 --2- 172.21.15.87:0/3896706263 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55a79d06c010 0x55a79d06c3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:28:17.889 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:17.886+0000 7fe14f400700 1 -- 172.21.15.87:0/3896706263 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55a79d06c930 msgr2=0x55a79d070440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:28:17.889 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:17.886+0000 7fe14f400700 1 --2- 172.21.15.87:0/3896706263 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55a79d06c930 0x55a79d070440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:28:17.889 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:17.886+0000 7fe14f400700 1 -- 172.21.15.87:0/3896706263 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a79cf0b880 con 0x55a79d070980 2024-05-08T05:28:17.889 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:17.887+0000 7fe14fe00700 1 --2- 172.21.15.87:0/3896706263 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55a79d06c930 0x55a79d070440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T05:28:17.889 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:17.887+0000 7fe14f400700 1 --2- 172.21.15.87:0/3896706263 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a79d070980 0x55a79d070de0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fe13c007c90 tx=0x7fe13c0103d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c11f9277fb16d3a0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:28:17.890 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:17.887+0000 7fe154a00700 1 --2- 172.21.15.87:0/2881076004 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7fe1340b2880 0x7fe1340b4d40 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fe148009550 tx=0x7fe14800b040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:28:17.890 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:17.887+0000 7fe145600700 1 -- 172.21.15.87:0/3896706263 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe13c010cb0 con 0x55a79d070980 2024-05-08T05:28:17.891 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:17.887+0000 7fe145600700 1 -- 172.21.15.87:0/3896706263 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe13c015070 con 0x55a79d070980 2024-05-08T05:28:17.891 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:17.887+0000 7fe145600700 1 -- 172.21.15.87:0/3896706263 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe13c003d90 con 0x55a79d070980 2024-05-08T05:28:17.891 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:17.888+0000 7fe161341b80 1 -- 172.21.15.87:0/3896706263 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a79d070980 msgr2=0x55a79d070de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:28:17.891 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:17.888+0000 7fe161341b80 1 --2- 172.21.15.87:0/3896706263 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a79d070980 0x55a79d070de0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fe13c007c90 tx=0x7fe13c0103d0 comp rx=0 tx=0).stop 2024-05-08T05:28:17.891 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:17.888+0000 7fe161341b80 1 -- 172.21.15.87:0/3896706263 shutdown_connections 2024-05-08T05:28:17.891 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:17.888+0000 7fe161341b80 1 --2- 172.21.15.87:0/3896706263 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a79d070980 0x55a79d070de0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:28:17.891 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:17.888+0000 7fe161341b80 1 --2- 172.21.15.87:0/3896706263 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55a79d06c010 0x55a79d06c3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:28:17.891 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:17.888+0000 7fe161341b80 1 --2- 172.21.15.87:0/3896706263 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55a79d06c930 0x55a79d070440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:28:17.891 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:17.888+0000 7fe161341b80 1 -- 172.21.15.87:0/3896706263 >> 172.21.15.87:0/3896706263 conn(0x55a79cf9ab10 msgr2=0x55a79d066750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:28:17.891 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:17.888+0000 7fe161341b80 1 -- 172.21.15.87:0/3896706263 shutdown_connections 2024-05-08T05:28:17.891 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:17.888+0000 7fe161341b80 1 -- 172.21.15.87:0/3896706263 wait complete. 2024-05-08T05:28:17.891 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:17.889+0000 7fe161341b80 1 -- start start 2024-05-08T05:28:17.891 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:17.889+0000 7fe161341b80 1 Processor -- start 2024-05-08T05:28:17.893 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:17.890+0000 7fe161341b80 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55a79d06c010 0x55a79d077df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:28:17.893 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:17.890+0000 7fe161341b80 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a79d06c930 0x55a79d075190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:28:17.893 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:17.890+0000 7fe161341b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55a79d070980 0x55a79d0756d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:28:17.893 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:17.890+0000 7fe161341b80 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x55a79d078b90 con 0x55a79d06c930 2024-05-08T05:28:17.893 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:17.890+0000 7fe161341b80 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x55a79cf24ad0 con 0x55a79d06c010 2024-05-08T05:28:17.893 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:17.890+0000 7fe161341b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x55a79d078d10 con 0x55a79d070980 2024-05-08T05:28:17.893 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:17.890+0000 7fe161341b80 10 client.0 _ll_register_callbacks cb 0x55a79cf65c20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T05:28:17.893 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:17.890+0000 7fe14f400700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a79d06c930 0x55a79d075190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:28:17.893 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:17.890+0000 7fe14f400700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a79d06c930 0x55a79d075190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:44442/0 (socket says 172.21.15.87:44442) 2024-05-08T05:28:17.893 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:17.890+0000 7fe14f400700 1 -- 172.21.15.87:0/1900025047 learned_addr learned my addr 172.21.15.87:0/1900025047 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T05:28:17.894 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:17.890+0000 7fe14fe00700 1 --2- 172.21.15.87:0/1900025047 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55a79d06c010 0x55a79d077df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:28:17.894 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:17.890+0000 7fe154a00700 1 --2- 172.21.15.87:0/1900025047 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55a79d070980 0x55a79d0756d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:28:17.894 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:17.890+0000 7fe14f400700 1 -- 172.21.15.87:0/1900025047 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55a79d070980 msgr2=0x55a79d0756d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:28:17.894 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:17.890+0000 7fe14f400700 1 --2- 172.21.15.87:0/1900025047 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55a79d070980 0x55a79d0756d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:28:17.894 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:17.890+0000 7fe14f400700 1 -- 172.21.15.87:0/1900025047 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55a79d06c010 msgr2=0x55a79d077df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:28:17.894 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:17.890+0000 7fe14f400700 1 --2- 172.21.15.87:0/1900025047 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55a79d06c010 0x55a79d077df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:28:17.894 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:17.890+0000 7fe14f400700 1 -- 172.21.15.87:0/1900025047 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a79cf843d0 con 0x55a79d06c930 2024-05-08T05:28:17.894 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:17.891+0000 7fe14f400700 1 --2- 172.21.15.87:0/1900025047 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a79d06c930 0x55a79d075190 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fe13c0038b0 tx=0x7fe13c005810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fa9cb5da225f33dd server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:28:17.894 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:17.891+0000 7fe13a000700 10 client.0 ms_handle_connect on v2:172.21.15.87:3300/0 2024-05-08T05:28:17.894 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:17.891+0000 7fe13a000700 1 -- 172.21.15.87:0/1900025047 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe13c028060 con 0x55a79d06c930 2024-05-08T05:28:17.894 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:17.891+0000 7fe13a000700 1 -- 172.21.15.87:0/1900025047 <== mon.0 v2:172.21.15.87:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8190+0+0 (secure 0 0 0) 0x7fe13c003a10 con 0x55a79d06c930 2024-05-08T05:28:17.894 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:17.891+0000 7fe161341b80 1 -- 172.21.15.87:0/1900025047 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe13c015070 con 0x55a79d06c930 2024-05-08T05:28:17.894 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:17.892+0000 7fe13a000700 1 -- 172.21.15.87:0/1900025047 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fe13c003c10 con 0x55a79d06c930 2024-05-08T05:28:17.894 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:17.892+0000 7fe161341b80 10 client.14766 fetch_fsmap learned FSMap version 24 2024-05-08T05:28:17.895 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:17.892+0000 7fe161341b80 1 -- 172.21.15.87:0/1900025047 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55a79d083420 con 0x55a79d06c930 2024-05-08T05:28:17.895 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:17.892+0000 7fe13a000700 1 -- 172.21.15.87:0/1900025047 <== mon.0 v2:172.21.15.87:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe13c015070 con 0x55a79d06c930 2024-05-08T05:28:17.896 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:17.892+0000 7fe13a000700 1 -- 172.21.15.87:0/1900025047 <== mon.0 v2:172.21.15.87:3300/0 5 ==== fsmap(e 24) ==== 8338+0+0 (secure 0 0 0) 0x7fe13c01a810 con 0x55a79d06c930 2024-05-08T05:28:17.896 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:17.892+0000 7fe161341b80 10 client.14766 fetch_fsmap finished waiting for FSMap version 24 2024-05-08T05:28:17.896 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:17.892+0000 7fe161341b80 10 client.14766 resolve_mds: resolved name 'g' to daemon mds.g 2024-05-08T05:28:17.896 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:17.892+0000 7fe161341b80 20 client.14766 populate_metadata read hostname 'smithi087' 2024-05-08T05:28:17.896 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:17.892+0000 7fe161341b80 1 --2- 172.21.15.87:0/1900025047 >> [v2:172.21.15.87:6838/2127215876,v1:172.21.15.87:6839/2127215876] conn(0x55a79d085660 0x55a79d086ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:28:17.897 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:17.892+0000 7fe161341b80 4 client.14766 mds_command: new command op to 24482 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-08T05:28:17.897 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:17.892+0000 7fe161341b80 1 -- 172.21.15.87:0/1900025047 --> [v2:172.21.15.87:6838/2127215876,v1:172.21.15.87:6839/2127215876] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a79d039050 con 0x55a79d085660 2024-05-08T05:28:17.897 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:17.893+0000 7fe14fe00700 1 --2- 172.21.15.87:0/1900025047 >> [v2:172.21.15.87:6838/2127215876,v1:172.21.15.87:6839/2127215876] conn(0x55a79d085660 0x55a79d086ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:28:17.897 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:17.893+0000 7fe14fe00700 1 --2- 172.21.15.87:0/1900025047 >> [v2:172.21.15.87:6838/2127215876,v1:172.21.15.87:6839/2127215876] conn(0x55a79d085660 0x55a79d086ad0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=8213ce0cbc2c4615 server_cookie=a25b9a01ce4bfca9 in_seq=0 out_seq=0 2024-05-08T05:28:17.897 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:17.893+0000 7fe13a000700 10 client.14766 ms_handle_connect on v2:172.21.15.87:6838/2127215876 2024-05-08T05:28:17.897 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:17.894+0000 7fe13a000700 1 -- 172.21.15.87:0/1900025047 <== mds.1 v2:172.21.15.87:6838/2127215876 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55a79d039050 con 0x55a79d085660 2024-05-08T05:28:17.897 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:17.894+0000 7fe13a000700 10 client.14766 handle_command_reply: tid=0 2024-05-08T05:28:17.897 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:17.894+0000 7fe161341b80 1 client.14766 shutdown 2024-05-08T05:28:17.897 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:17.894+0000 7fe161341b80 1 -- 172.21.15.87:0/1900025047 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a79d06c930 msgr2=0x55a79d075190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:28:17.897 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:17.894+0000 7fe161341b80 1 --2- 172.21.15.87:0/1900025047 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a79d06c930 0x55a79d075190 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fe13c0038b0 tx=0x7fe13c005810 comp rx=0 tx=0).stop 2024-05-08T05:28:17.897 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:17.894+0000 7fe161341b80 1 -- 172.21.15.87:0/1900025047 shutdown_connections 2024-05-08T05:28:17.897 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:17.894+0000 7fe161341b80 1 --2- 172.21.15.87:0/1900025047 >> [v2:172.21.15.87:6838/2127215876,v1:172.21.15.87:6839/2127215876] conn(0x55a79d085660 0x55a79d086ad0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:28:17.897 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:17.894+0000 7fe161341b80 1 --2- 172.21.15.87:0/1900025047 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55a79d070980 0x55a79d0756d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:28:17.897 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:17.894+0000 7fe161341b80 1 --2- 172.21.15.87:0/1900025047 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55a79d06c010 0x55a79d077df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:28:17.897 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:17.894+0000 7fe13a000700 0 client.14766 ms_handle_reset on v2:172.21.15.87:6838/2127215876 2024-05-08T05:28:17.898 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:17.894+0000 7fe161341b80 1 --2- 172.21.15.87:0/1900025047 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a79d06c930 0x55a79d075190 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:28:17.898 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:17.894+0000 7fe161341b80 1 -- 172.21.15.87:0/1900025047 >> 172.21.15.87:0/1900025047 conn(0x55a79cf9ab10 msgr2=0x55a79d061260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:28:17.898 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:17.895+0000 7fe161341b80 1 -- 172.21.15.87:0/1900025047 shutdown_connections 2024-05-08T05:28:17.898 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:17.895+0000 7fe161341b80 1 -- 172.21.15.87:0/1900025047 wait complete. 2024-05-08T05:28:17.898 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:17.895+0000 7fe161341b80 20 client.14766 trim_cache size 0 max 16384 2024-05-08T05:28:17.918 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:17.917+0000 7fe161341b80 1 Processor -- start 2024-05-08T05:28:17.918 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:17.917+0000 7fe161341b80 1 -- start start 2024-05-08T05:28:17.919 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:17.917+0000 7fe161341b80 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55a79d078150 0x55a79d074310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:28:17.919 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:17.917+0000 7fe161341b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55a79cf9ab10 0x55a79d0610e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:28:17.919 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:17.917+0000 7fe161341b80 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a79d06c010 0x55a79d06e270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:28:17.919 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:17.917+0000 7fe161341b80 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x55a79d084e10 con 0x55a79d06c010 2024-05-08T05:28:17.919 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:17.917+0000 7fe161341b80 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x55a79d0854e0 con 0x55a79d078150 2024-05-08T05:28:17.919 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:17.917+0000 7fe161341b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x55a79d085bb0 con 0x55a79cf9ab10 2024-05-08T05:28:17.920 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:17.918+0000 7fe154a00700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a79d06c010 0x55a79d06e270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:28:17.920 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:17.918+0000 7fe14f400700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55a79cf9ab10 0x55a79d0610e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:28:17.920 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:17.918+0000 7fe14f400700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55a79cf9ab10 0x55a79d0610e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.87:40676/0 (socket says 172.21.15.87:40676) 2024-05-08T05:28:17.920 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:17.918+0000 7fe154a00700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a79d06c010 0x55a79d06e270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:44456/0 (socket says 172.21.15.87:44456) 2024-05-08T05:28:17.920 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:17.918+0000 7fe14f400700 1 -- 172.21.15.87:0/1037209520 learned_addr learned my addr 172.21.15.87:0/1037209520 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T05:28:17.920 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:17.918+0000 7fe14fe00700 1 --2- 172.21.15.87:0/1037209520 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55a79d078150 0x55a79d074310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:28:17.921 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:17.918+0000 7fe14fe00700 1 -- 172.21.15.87:0/1037209520 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55a79cf9ab10 msgr2=0x55a79d0610e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:28:17.921 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:17.918+0000 7fe14fe00700 1 --2- 172.21.15.87:0/1037209520 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55a79cf9ab10 0x55a79d0610e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:28:17.921 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:17.918+0000 7fe14fe00700 1 -- 172.21.15.87:0/1037209520 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a79d06c010 msgr2=0x55a79d06e270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:28:17.921 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:17.918+0000 7fe14fe00700 1 --2- 172.21.15.87:0/1037209520 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a79d06c010 0x55a79d06e270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:28:17.921 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:17.918+0000 7fe14fe00700 1 -- 172.21.15.87:0/1037209520 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a79d084c40 con 0x55a79d078150 2024-05-08T05:28:17.922 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:17.918+0000 7fe14f400700 1 --2- 172.21.15.87:0/1037209520 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55a79cf9ab10 0x55a79d0610e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T05:28:17.922 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:17.919+0000 7fe14fe00700 1 --2- 172.21.15.87:0/1037209520 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55a79d078150 0x55a79d074310 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fe1400a66a0 tx=0x7fe14001a040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=edcde8cf1baafee6 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:28:17.922 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:17.919+0000 7fe144c00700 1 -- 172.21.15.87:0/1037209520 <== mon.2 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1400c3070 con 0x55a79d078150 2024-05-08T05:28:17.922 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:17.919+0000 7fe144c00700 1 -- 172.21.15.87:0/1037209520 <== mon.2 v2:172.21.15.90:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe1400aa620 con 0x55a79d078150 2024-05-08T05:28:17.922 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:17.919+0000 7fe144c00700 1 -- 172.21.15.87:0/1037209520 <== mon.2 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1400a6a40 con 0x55a79d078150 2024-05-08T05:28:17.922 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:17.920+0000 7fe161341b80 1 -- 172.21.15.87:0/1037209520 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55a79d078150 msgr2=0x55a79d074310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:28:17.922 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:17.920+0000 7fe161341b80 1 --2- 172.21.15.87:0/1037209520 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55a79d078150 0x55a79d074310 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fe1400a66a0 tx=0x7fe14001a040 comp rx=0 tx=0).stop 2024-05-08T05:28:17.922 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:17.920+0000 7fe161341b80 1 -- 172.21.15.87:0/1037209520 shutdown_connections 2024-05-08T05:28:17.922 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:17.920+0000 7fe161341b80 1 --2- 172.21.15.87:0/1037209520 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a79d06c010 0x55a79d06e270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:28:17.922 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:17.920+0000 7fe161341b80 1 --2- 172.21.15.87:0/1037209520 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55a79d078150 0x55a79d074310 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:28:17.922 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:17.920+0000 7fe161341b80 1 --2- 172.21.15.87:0/1037209520 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55a79cf9ab10 0x55a79d0610e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:28:17.922 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:17.920+0000 7fe161341b80 1 -- 172.21.15.87:0/1037209520 >> 172.21.15.87:0/1037209520 conn(0x55a79d0605c0 msgr2=0x55a79d0609d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:28:17.922 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:17.920+0000 7fe161341b80 1 -- 172.21.15.87:0/1037209520 shutdown_connections 2024-05-08T05:28:17.922 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:17.920+0000 7fe161341b80 1 -- 172.21.15.87:0/1037209520 wait complete. 2024-05-08T05:28:17.925 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:17.920+0000 7fe161341b80 1 -- start start 2024-05-08T05:28:17.925 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:17.921+0000 7fe161341b80 1 Processor -- start 2024-05-08T05:28:17.925 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:17.921+0000 7fe161341b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55a79cf9ab10 0x55a79d08ff50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:28:17.925 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:17.921+0000 7fe161341b80 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a79d06c010 0x55a79d090490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:28:17.925 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:17.921+0000 7fe161341b80 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55a79d078150 0x55a79d088ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:28:17.925 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:17.921+0000 7fe161341b80 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x55a79d086950 con 0x55a79d06c010 2024-05-08T05:28:17.925 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:17.921+0000 7fe161341b80 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x55a79d086280 con 0x55a79d078150 2024-05-08T05:28:17.925 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:17.921+0000 7fe161341b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x55a79d087020 con 0x55a79cf9ab10 2024-05-08T05:28:17.926 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:17.921+0000 7fe161341b80 10 client.0 _ll_register_callbacks cb 0x55a79cf65c20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T05:28:17.926 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:17.921+0000 7fe14f400700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a79d06c010 0x55a79d090490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:28:17.926 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:17.921+0000 7fe14f400700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a79d06c010 0x55a79d090490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:44460/0 (socket says 172.21.15.87:44460) 2024-05-08T05:28:17.926 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:17.921+0000 7fe14f400700 1 -- 172.21.15.87:0/840522213 learned_addr learned my addr 172.21.15.87:0/840522213 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T05:28:17.926 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:17.921+0000 7fe14fe00700 1 --2- 172.21.15.87:0/840522213 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55a79cf9ab10 0x55a79d08ff50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:28:17.926 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:17.921+0000 7fe154a00700 1 --2- 172.21.15.87:0/840522213 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55a79d078150 0x55a79d088ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:28:17.926 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:17.922+0000 7fe14f400700 1 -- 172.21.15.87:0/840522213 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55a79cf9ab10 msgr2=0x55a79d08ff50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:28:17.926 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:17.922+0000 7fe14f400700 1 --2- 172.21.15.87:0/840522213 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55a79cf9ab10 0x55a79d08ff50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:28:17.926 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:17.922+0000 7fe14f400700 1 -- 172.21.15.87:0/840522213 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55a79d078150 msgr2=0x55a79d088ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:28:17.926 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:17.922+0000 7fe14f400700 1 --2- 172.21.15.87:0/840522213 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55a79d078150 0x55a79d088ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:28:17.926 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:17.922+0000 7fe14f400700 1 -- 172.21.15.87:0/840522213 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a79d089710 con 0x55a79d06c010 2024-05-08T05:28:17.926 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:17.922+0000 7fe14fe00700 1 --2- 172.21.15.87:0/840522213 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55a79cf9ab10 0x55a79d08ff50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T05:28:17.926 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:17.922+0000 7fe154a00700 1 --2- 172.21.15.87:0/840522213 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55a79d078150 0x55a79d088ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T05:28:17.927 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:17.922+0000 7fe14f400700 1 --2- 172.21.15.87:0/840522213 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a79d06c010 0x55a79d090490 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x55a79d076640 tx=0x7fe13c010fd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2a4525dc9a5d75e5 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:28:17.927 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:17.922+0000 7fe13a000700 10 client.0 ms_handle_connect on v2:172.21.15.87:3300/0 2024-05-08T05:28:17.927 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:17.922+0000 7fe13a000700 1 -- 172.21.15.87:0/840522213 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe13c028030 con 0x55a79d06c010 2024-05-08T05:28:17.927 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:17.922+0000 7fe13a000700 1 -- 172.21.15.87:0/840522213 <== mon.0 v2:172.21.15.87:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8190+0+0 (secure 0 0 0) 0x7fe13c003db0 con 0x55a79d06c010 2024-05-08T05:28:17.927 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:17.923+0000 7fe161341b80 1 -- 172.21.15.87:0/840522213 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe1400aa620 con 0x55a79d06c010 2024-05-08T05:28:17.927 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:17.923+0000 7fe13a000700 1 -- 172.21.15.87:0/840522213 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fe13c03e050 con 0x55a79d06c010 2024-05-08T05:28:17.927 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:17.923+0000 7fe161341b80 10 client.14772 fetch_fsmap learned FSMap version 24 2024-05-08T05:28:17.927 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:17.923+0000 7fe161341b80 1 -- 172.21.15.87:0/840522213 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55a79d0f15f0 con 0x55a79d06c010 2024-05-08T05:28:17.927 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:17.923+0000 7fe13a000700 1 -- 172.21.15.87:0/840522213 <== mon.0 v2:172.21.15.87:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe1400aa620 con 0x55a79d06c010 2024-05-08T05:28:17.927 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:17.923+0000 7fe13a000700 1 -- 172.21.15.87:0/840522213 <== mon.0 v2:172.21.15.87:3300/0 5 ==== fsmap(e 24) ==== 8338+0+0 (secure 0 0 0) 0x7fe13c011670 con 0x55a79d06c010 2024-05-08T05:28:17.927 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:17.923+0000 7fe161341b80 10 client.14772 fetch_fsmap finished waiting for FSMap version 24 2024-05-08T05:28:17.927 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:17.923+0000 7fe161341b80 10 client.14772 resolve_mds: resolved name 'g' to daemon mds.g 2024-05-08T05:28:17.927 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:17.923+0000 7fe161341b80 20 client.14772 populate_metadata read hostname 'smithi087' 2024-05-08T05:28:17.927 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:17.923+0000 7fe161341b80 1 --2- 172.21.15.87:0/840522213 >> [v2:172.21.15.87:6838/2127215876,v1:172.21.15.87:6839/2127215876] conn(0x55a79d06c930 0x55a79d0f4e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:28:17.927 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:17.923+0000 7fe161341b80 4 client.14772 mds_command: new command op to 24482 tid=0 multi_id=0 [{"prefix": "status"}] 2024-05-08T05:28:17.928 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:17.923+0000 7fe161341b80 1 -- 172.21.15.87:0/840522213 --> [v2:172.21.15.87:6838/2127215876,v1:172.21.15.87:6839/2127215876] -- command(tid 0: {"prefix": "status"}) -- 0x55a79cfcc3b0 con 0x55a79d06c930 2024-05-08T05:28:17.928 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:17.924+0000 7fe14fe00700 1 --2- 172.21.15.87:0/840522213 >> [v2:172.21.15.87:6838/2127215876,v1:172.21.15.87:6839/2127215876] conn(0x55a79d06c930 0x55a79d0f4e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:28:17.929 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:17.924+0000 7fe13a000700 10 client.14772 ms_handle_connect on v2:172.21.15.87:6838/2127215876 2024-05-08T05:28:17.929 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:17.924+0000 7fe14fe00700 1 --2- 172.21.15.87:0/840522213 >> [v2:172.21.15.87:6838/2127215876,v1:172.21.15.87:6839/2127215876] conn(0x55a79d06c930 0x55a79d0f4e80 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=fa02d8b239b9cdaf server_cookie=fbd6e627c3ea1c5 in_seq=0 out_seq=0 2024-05-08T05:28:17.929 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:17.924+0000 7fe13a000700 1 -- 172.21.15.87:0/840522213 <== mds.1 v2:172.21.15.87:6838/2127215876 1 ==== command_reply(tid 0: 0 ) ==== 8+0+327 (crc 0 0 0) 0x55a79cfcc3b0 con 0x55a79d06c930 2024-05-08T05:28:17.929 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:17.924+0000 7fe13a000700 10 client.14772 handle_command_reply: tid=0 2024-05-08T05:28:17.929 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:17.924+0000 7fe161341b80 1 client.14772 shutdown 2024-05-08T05:28:17.929 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:17.925+0000 7fe161341b80 1 -- 172.21.15.87:0/840522213 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a79d06c010 msgr2=0x55a79d090490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:28:17.929 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:17.925+0000 7fe161341b80 1 --2- 172.21.15.87:0/840522213 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a79d06c010 0x55a79d090490 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x55a79d076640 tx=0x7fe13c010fd0 comp rx=0 tx=0).stop 2024-05-08T05:28:17.929 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:17.925+0000 7fe161341b80 1 -- 172.21.15.87:0/840522213 shutdown_connections 2024-05-08T05:28:17.929 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:17.925+0000 7fe161341b80 1 --2- 172.21.15.87:0/840522213 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55a79d078150 0x55a79d088ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:28:17.929 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:17.925+0000 7fe161341b80 1 --2- 172.21.15.87:0/840522213 >> [v2:172.21.15.87:6838/2127215876,v1:172.21.15.87:6839/2127215876] conn(0x55a79d06c930 0x55a79d0f4e80 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:28:17.929 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:17.925+0000 7fe161341b80 1 --2- 172.21.15.87:0/840522213 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55a79cf9ab10 0x55a79d08ff50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:28:17.930 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:17.925+0000 7fe161341b80 1 --2- 172.21.15.87:0/840522213 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a79d06c010 0x55a79d090490 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:28:17.930 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:17.925+0000 7fe161341b80 1 -- 172.21.15.87:0/840522213 >> 172.21.15.87:0/840522213 conn(0x55a79d0605c0 msgr2=0x55a79d06ae20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:28:17.930 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:17.925+0000 7fe13a000700 0 client.14772 ms_handle_reset on v2:172.21.15.87:6838/2127215876 2024-05-08T05:28:17.930 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:17.925+0000 7fe161341b80 1 -- 172.21.15.87:0/840522213 shutdown_connections 2024-05-08T05:28:17.930 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:17.925+0000 7fe161341b80 1 -- 172.21.15.87:0/840522213 wait complete. 2024-05-08T05:28:17.930 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:17.925+0000 7fe161341b80 20 client.14772 trim_cache size 0 max 16384 2024-05-08T05:28:17.930 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-05-08T05:28:17.930 INFO:teuthology.orchestra.run.smithi087.stdout: "cluster_fsid": "eeeb813e-0cf9-11ef-bc97-c7b262605968", 2024-05-08T05:28:17.930 INFO:teuthology.orchestra.run.smithi087.stdout: "whoami": 1, 2024-05-08T05:28:17.931 INFO:teuthology.orchestra.run.smithi087.stdout: "id": 24482, 2024-05-08T05:28:17.931 INFO:teuthology.orchestra.run.smithi087.stdout: "want_state": "up:active", 2024-05-08T05:28:17.931 INFO:teuthology.orchestra.run.smithi087.stdout: "state": "up:active", 2024-05-08T05:28:17.931 INFO:teuthology.orchestra.run.smithi087.stdout: "fs_name": "cephfs", 2024-05-08T05:28:17.931 INFO:teuthology.orchestra.run.smithi087.stdout: "rank_uptime": 146.03021714799999, 2024-05-08T05:28:17.931 INFO:teuthology.orchestra.run.smithi087.stdout: "mdsmap_epoch": 24, 2024-05-08T05:28:17.931 INFO:teuthology.orchestra.run.smithi087.stdout: "osdmap_epoch": 82, 2024-05-08T05:28:17.931 INFO:teuthology.orchestra.run.smithi087.stdout: "osdmap_epoch_barrier": 80, 2024-05-08T05:28:17.931 INFO:teuthology.orchestra.run.smithi087.stdout: "uptime": 187.571373486 2024-05-08T05:28:17.931 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-05-08T05:28:17.932 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:17.926+0000 7fe156a00700 1 -- 172.21.15.87:0/2881076004 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7fe1340b2880 msgr2=0x7fe1340b4d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:28:17.932 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:17.926+0000 7fe156a00700 1 --2- 172.21.15.87:0/2881076004 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7fe1340b2880 0x7fe1340b4d40 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fe148009550 tx=0x7fe14800b040 comp rx=0 tx=0).stop 2024-05-08T05:28:17.932 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:17.926+0000 7fe156a00700 1 -- 172.21.15.87:0/2881076004 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe150109ad0 msgr2=0x7fe1501a0190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:28:17.932 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:17.926+0000 7fe156a00700 1 --2- 172.21.15.87:0/2881076004 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe150109ad0 0x7fe1501a0190 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fe140005910 tx=0x7fe14000b670 comp rx=0 tx=0).stop 2024-05-08T05:28:17.932 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:17.926+0000 7fe156a00700 1 -- 172.21.15.87:0/2881076004 shutdown_connections 2024-05-08T05:28:17.932 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:17.926+0000 7fe156a00700 1 --2- 172.21.15.87:0/2881076004 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7fe1340b2880 0x7fe1340b4d40 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:28:17.932 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:17.926+0000 7fe156a00700 1 --2- 172.21.15.87:0/2881076004 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe15010fb60 0x7fe1501a4a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:28:17.932 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:17.926+0000 7fe156a00700 1 --2- 172.21.15.87:0/2881076004 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe150109ad0 0x7fe1501a0190 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:28:17.932 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:17.926+0000 7fe156a00700 1 --2- 172.21.15.87:0/2881076004 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe15010a490 0x7fe1501a06d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:28:17.932 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:17.926+0000 7fe156a00700 1 -- 172.21.15.87:0/2881076004 >> 172.21.15.87:0/2881076004 conn(0x7fe150076c70 msgr2=0x7fe1500773b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:28:17.932 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:17.926+0000 7fe156a00700 1 -- 172.21.15.87:0/2881076004 shutdown_connections 2024-05-08T05:28:17.932 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:17.926+0000 7fe156a00700 1 -- 172.21.15.87:0/2881076004 wait complete. 2024-05-08T05:28:18.884 DEBUG:teuthology.orchestra.run.smithi087:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid eeeb813e-0cf9-11ef-bc97-c7b262605968 -- ceph tell mds.b status 2024-05-08T05:28:18.958 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:28:18 smithi087 ceph-mon[29523]: pgmap v399: 97 pgs: 97 active+clean; 644 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T05:28:18.983 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:28:18 smithi090 ceph-mon[34526]: pgmap v399: 97 pgs: 97 active+clean; 644 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T05:28:19.038 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:28:18 smithi160 ceph-mon[34827]: pgmap v399: 97 pgs: 97 active+clean; 644 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T05:28:19.325 INFO:teuthology.orchestra.run.smithi087.stderr:Inferring config /var/lib/ceph/eeeb813e-0cf9-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T05:28:19.782 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:28:19 smithi087 ceph-mon[29523]: pgmap v400: 97 pgs: 97 active+clean; 644 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-05-08T05:28:19.983 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:28:19 smithi090 ceph-mon[34526]: pgmap v400: 97 pgs: 97 active+clean; 644 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-05-08T05:28:20.039 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:28:19 smithi160 ceph-mon[34827]: pgmap v400: 97 pgs: 97 active+clean; 644 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-05-08T05:28:21.266 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:21.265+0000 7faf25e00700 1 -- 172.21.15.87:0/3747530097 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7faf2010a490 msgr2=0x7faf201169a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:28:21.266 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:21.265+0000 7faf25e00700 1 --2- 172.21.15.87:0/3747530097 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7faf2010a490 0x7faf201169a0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7faf1800b0a0 tx=0x7faf1800b3b0 comp rx=0 tx=0).stop 2024-05-08T05:28:21.267 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:21.265+0000 7faf25e00700 1 -- 172.21.15.87:0/3747530097 shutdown_connections 2024-05-08T05:28:21.267 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:21.265+0000 7faf25e00700 1 --2- 172.21.15.87:0/3747530097 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7faf2010a490 0x7faf201169a0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:28:21.267 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:21.265+0000 7faf25e00700 1 --2- 172.21.15.87:0/3747530097 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7faf2010fb60 0x7faf2010ff40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:28:21.267 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:21.265+0000 7faf25e00700 1 --2- 172.21.15.87:0/3747530097 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7faf20109ad0 0x7faf20109f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:28:21.267 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:21.265+0000 7faf25e00700 1 -- 172.21.15.87:0/3747530097 >> 172.21.15.87:0/3747530097 conn(0x7faf20076c70 msgr2=0x7faf201082c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:28:21.267 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:21.265+0000 7faf25e00700 1 -- 172.21.15.87:0/3747530097 shutdown_connections 2024-05-08T05:28:21.267 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:21.265+0000 7faf25e00700 1 -- 172.21.15.87:0/3747530097 wait complete. 2024-05-08T05:28:21.268 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:21.267+0000 7faf25e00700 1 Processor -- start 2024-05-08T05:28:21.268 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:21.267+0000 7faf25e00700 1 -- start start 2024-05-08T05:28:21.268 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:21.267+0000 7faf25e00700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7faf20109ad0 0x7faf201a01b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:28:21.268 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:21.267+0000 7faf25e00700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7faf2010a490 0x7faf201a06f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:28:21.268 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:21.267+0000 7faf25e00700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7faf2010fb60 0x7faf201a4a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:28:21.268 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:21.267+0000 7faf25e00700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7faf20119d60 con 0x7faf20109ad0 2024-05-08T05:28:21.269 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:21.267+0000 7faf25e00700 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7faf20119be0 con 0x7faf2010fb60 2024-05-08T05:28:21.269 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:21.267+0000 7faf25e00700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7faf20119ee0 con 0x7faf2010a490 2024-05-08T05:28:21.269 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:21.267+0000 7faf1ea00700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7faf20109ad0 0x7faf201a01b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:28:21.269 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:21.268+0000 7faf1ea00700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7faf20109ad0 0x7faf201a01b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:44484/0 (socket says 172.21.15.87:44484) 2024-05-08T05:28:21.269 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:21.268+0000 7faf1ea00700 1 -- 172.21.15.87:0/2790326094 learned_addr learned my addr 172.21.15.87:0/2790326094 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T05:28:21.269 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:21.268+0000 7faf1f400700 1 --2- 172.21.15.87:0/2790326094 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7faf2010fb60 0x7faf201a4a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:28:21.269 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:21.268+0000 7faf1e000700 1 --2- 172.21.15.87:0/2790326094 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7faf2010a490 0x7faf201a06f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:28:21.269 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:21.268+0000 7faf1ea00700 1 -- 172.21.15.87:0/2790326094 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7faf2010a490 msgr2=0x7faf201a06f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:28:21.269 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:21.268+0000 7faf1ea00700 1 --2- 172.21.15.87:0/2790326094 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7faf2010a490 0x7faf201a06f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:28:21.269 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:21.268+0000 7faf1ea00700 1 -- 172.21.15.87:0/2790326094 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7faf2010fb60 msgr2=0x7faf201a4a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:28:21.269 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:21.268+0000 7faf1ea00700 1 --2- 172.21.15.87:0/2790326094 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7faf2010fb60 0x7faf201a4a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:28:21.269 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:21.268+0000 7faf1ea00700 1 -- 172.21.15.87:0/2790326094 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faf201a5170 con 0x7faf20109ad0 2024-05-08T05:28:21.269 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:21.268+0000 7faf1f400700 1 --2- 172.21.15.87:0/2790326094 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7faf2010fb60 0x7faf201a4a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T05:28:21.270 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:21.268+0000 7faf1ea00700 1 --2- 172.21.15.87:0/2790326094 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7faf20109ad0 0x7faf201a01b0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7faf1000e9c0 tx=0x7faf1000ecd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:28:21.270 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:21.269+0000 7faf24a00700 1 -- 172.21.15.87:0/2790326094 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf1000cbd0 con 0x7faf20109ad0 2024-05-08T05:28:21.270 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:21.269+0000 7faf24a00700 1 -- 172.21.15.87:0/2790326094 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7faf1000ee60 con 0x7faf20109ad0 2024-05-08T05:28:21.270 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:21.269+0000 7faf25e00700 1 -- 172.21.15.87:0/2790326094 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faf201a5460 con 0x7faf20109ad0 2024-05-08T05:28:21.270 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:21.269+0000 7faf24a00700 1 -- 172.21.15.87:0/2790326094 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf100055c0 con 0x7faf20109ad0 2024-05-08T05:28:21.271 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:21.269+0000 7faf25e00700 1 -- 172.21.15.87:0/2790326094 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faf201acce0 con 0x7faf20109ad0 2024-05-08T05:28:21.273 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:21.273+0000 7faf24a00700 1 -- 172.21.15.87:0/2790326094 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7faf10004750 con 0x7faf20109ad0 2024-05-08T05:28:21.274 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:21.274+0000 7faf3072eb80 1 Processor -- start 2024-05-08T05:28:21.274 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:21.274+0000 7faf3072eb80 1 -- start start 2024-05-08T05:28:21.275 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:21.274+0000 7faf24a00700 1 --2- 172.21.15.87:0/2790326094 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7faf040b2900 0x7faf040b4dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:28:21.275 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:21.274+0000 7faf3072eb80 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55942af81b70 0x55942af81f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:28:21.275 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:21.274+0000 7faf3072eb80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55942af82490 0x55942af7c280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:28:21.275 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:21.274+0000 7faf3072eb80 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55942af7c8a0 0x55942af7cd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:28:21.275 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:21.274+0000 7faf3072eb80 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x55942aece9d0 con 0x55942af7c8a0 2024-05-08T05:28:21.275 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:21.274+0000 7faf3072eb80 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x55942ae6c710 con 0x55942af81b70 2024-05-08T05:28:21.275 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:21.274+0000 7faf3072eb80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x55942aeca990 con 0x55942af82490 2024-05-08T05:28:21.275 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:21.274+0000 7faf24a00700 1 -- 172.21.15.87:0/2790326094 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8190+0+0 (secure 0 0 0) 0x7faf100e23c0 con 0x7faf20109ad0 2024-05-08T05:28:21.275 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:21.275+0000 7faf1ea00700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55942af81b70 0x55942af81f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:28:21.275 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:21.275+0000 7faf1ea00700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55942af81b70 0x55942af81f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.87:43244/0 (socket says 172.21.15.87:43244) 2024-05-08T05:28:21.275 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:21.275+0000 7faf1ea00700 1 -- 172.21.15.87:0/184716796 learned_addr learned my addr 172.21.15.87:0/184716796 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T05:28:21.275 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:21.275+0000 7faf1f400700 1 --2- 172.21.15.87:0/2790326094 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7faf040b2900 0x7faf040b4dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:28:21.276 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:21.275+0000 7faf1e000700 1 --2- 172.21.15.87:0/184716796 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55942af82490 0x55942af7c280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:28:21.276 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:21.275+0000 7faf1ea00700 1 -- 172.21.15.87:0/184716796 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55942af82490 msgr2=0x55942af7c280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:28:21.276 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:21.275+0000 7faf1ea00700 1 --2- 172.21.15.87:0/184716796 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55942af82490 0x55942af7c280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:28:21.276 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:21.275+0000 7faf1ea00700 1 -- 172.21.15.87:0/184716796 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55942af7c8a0 msgr2=0x55942af7cd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:28:21.277 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:21.275+0000 7faf1ea00700 1 --2- 172.21.15.87:0/184716796 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55942af7c8a0 0x55942af7cd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:28:21.277 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:21.275+0000 7faf1ea00700 1 -- 172.21.15.87:0/184716796 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55942ae1b880 con 0x55942af81b70 2024-05-08T05:28:21.277 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:21.275+0000 7faf1ea00700 1 --2- 172.21.15.87:0/184716796 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55942af81b70 0x55942af81f50 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7faf100a9940 tx=0x7faf100a93a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7970357705cd1e35 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:28:21.277 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:21.276+0000 7faf1f400700 1 --2- 172.21.15.87:0/2790326094 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7faf040b2900 0x7faf040b4dc0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7faf1800b780 tx=0x7faf18006000 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:28:21.277 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:21.276+0000 7faf14c00700 1 -- 172.21.15.87:0/184716796 <== mon.2 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf100c35d0 con 0x55942af81b70 2024-05-08T05:28:21.277 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:21.276+0000 7faf14c00700 1 -- 172.21.15.87:0/184716796 <== mon.2 v2:172.21.15.90:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7faf100b2150 con 0x55942af81b70 2024-05-08T05:28:21.277 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:21.276+0000 7faf14c00700 1 -- 172.21.15.87:0/184716796 <== mon.2 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf100c2300 con 0x55942af81b70 2024-05-08T05:28:21.277 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:21.276+0000 7faf3072eb80 1 -- 172.21.15.87:0/184716796 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55942af81b70 msgr2=0x55942af81f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:28:21.277 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:21.276+0000 7faf3072eb80 1 --2- 172.21.15.87:0/184716796 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55942af81b70 0x55942af81f50 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7faf100a9940 tx=0x7faf100a93a0 comp rx=0 tx=0).stop 2024-05-08T05:28:21.278 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:21.277+0000 7faf3072eb80 1 -- 172.21.15.87:0/184716796 shutdown_connections 2024-05-08T05:28:21.278 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:21.277+0000 7faf3072eb80 1 --2- 172.21.15.87:0/184716796 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55942af7c8a0 0x55942af7cd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:28:21.278 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:21.277+0000 7faf3072eb80 1 --2- 172.21.15.87:0/184716796 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55942af81b70 0x55942af81f50 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:28:21.278 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:21.277+0000 7faf3072eb80 1 --2- 172.21.15.87:0/184716796 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55942af82490 0x55942af7c280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:28:21.279 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:21.277+0000 7faf3072eb80 1 -- 172.21.15.87:0/184716796 >> 172.21.15.87:0/184716796 conn(0x55942aef4680 msgr2=0x55942af76ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:28:21.279 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:21.277+0000 7faf3072eb80 1 -- 172.21.15.87:0/184716796 shutdown_connections 2024-05-08T05:28:21.279 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:21.277+0000 7faf3072eb80 1 -- 172.21.15.87:0/184716796 wait complete. 2024-05-08T05:28:21.279 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:21.277+0000 7faf3072eb80 1 -- start start 2024-05-08T05:28:21.279 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:21.277+0000 7faf3072eb80 1 Processor -- start 2024-05-08T05:28:21.279 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:21.278+0000 7faf3072eb80 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55942af7c8a0 0x55942af88230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:28:21.279 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:21.278+0000 7faf3072eb80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55942af81b70 0x55942af855d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:28:21.279 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:21.278+0000 7faf3072eb80 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55942af82490 0x55942af85b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:28:21.279 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:21.278+0000 7faf3072eb80 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x55942af88ed0 con 0x55942af7c8a0 2024-05-08T05:28:21.279 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:21.278+0000 7faf3072eb80 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x55942ae34ad0 con 0x55942af82490 2024-05-08T05:28:21.279 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:21.278+0000 7faf3072eb80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x55942af89050 con 0x55942af81b70 2024-05-08T05:28:21.279 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:21.278+0000 7faf3072eb80 10 client.0 _ll_register_callbacks cb 0x55942ae75c20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T05:28:21.279 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:21.278+0000 7faf1ea00700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55942af7c8a0 0x55942af88230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:28:21.281 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:21.278+0000 7faf1ea00700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55942af7c8a0 0x55942af88230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:44498/0 (socket says 172.21.15.87:44498) 2024-05-08T05:28:21.281 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:21.278+0000 7faf1ea00700 1 -- 172.21.15.87:0/2863766173 learned_addr learned my addr 172.21.15.87:0/2863766173 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T05:28:21.281 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:21.278+0000 7faf1e000700 1 --2- 172.21.15.87:0/2863766173 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55942af81b70 0x55942af855d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:28:21.281 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:21.278+0000 7faf1f400700 1 --2- 172.21.15.87:0/2863766173 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55942af82490 0x55942af85b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:28:21.281 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:21.279+0000 7faf1ea00700 1 -- 172.21.15.87:0/2863766173 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55942af81b70 msgr2=0x55942af855d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:28:21.281 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:21.279+0000 7faf1ea00700 1 --2- 172.21.15.87:0/2863766173 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55942af81b70 0x55942af855d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:28:21.281 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:21.279+0000 7faf1ea00700 1 -- 172.21.15.87:0/2863766173 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55942af82490 msgr2=0x55942af85b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:28:21.282 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:21.279+0000 7faf1ea00700 1 --2- 172.21.15.87:0/2863766173 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55942af82490 0x55942af85b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:28:21.282 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:21.279+0000 7faf1ea00700 1 -- 172.21.15.87:0/2863766173 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55942ae943d0 con 0x55942af7c8a0 2024-05-08T05:28:21.282 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:21.279+0000 7faf1ea00700 1 --2- 172.21.15.87:0/2863766173 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55942af7c8a0 0x55942af88230 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7faf10009fd0 tx=0x7faf100b25b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=92a34a6d724bee1c server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:28:21.282 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:21.279+0000 7faf09600700 10 client.0 ms_handle_connect on v2:172.21.15.87:3300/0 2024-05-08T05:28:21.282 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:21.279+0000 7faf09600700 1 -- 172.21.15.87:0/2863766173 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf100c9070 con 0x55942af7c8a0 2024-05-08T05:28:21.282 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:21.279+0000 7faf09600700 1 -- 172.21.15.87:0/2863766173 <== mon.0 v2:172.21.15.87:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8190+0+0 (secure 0 0 0) 0x7faf100a5fa0 con 0x55942af7c8a0 2024-05-08T05:28:21.282 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:21.279+0000 7faf3072eb80 1 -- 172.21.15.87:0/2863766173 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55942af490f0 con 0x55942af7c8a0 2024-05-08T05:28:21.282 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:21.280+0000 7faf09600700 1 -- 172.21.15.87:0/2863766173 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7faf100a5140 con 0x55942af7c8a0 2024-05-08T05:28:21.282 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:21.280+0000 7faf3072eb80 10 client.14781 fetch_fsmap learned FSMap version 24 2024-05-08T05:28:21.282 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:21.280+0000 7faf3072eb80 1 -- 172.21.15.87:0/2863766173 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55942af93800 con 0x55942af7c8a0 2024-05-08T05:28:21.282 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:21.280+0000 7faf09600700 1 -- 172.21.15.87:0/2863766173 <== mon.0 v2:172.21.15.87:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x55942af490f0 con 0x55942af7c8a0 2024-05-08T05:28:21.282 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:21.280+0000 7faf09600700 1 -- 172.21.15.87:0/2863766173 <== mon.0 v2:172.21.15.87:3300/0 5 ==== fsmap(e 24) ==== 8338+0+0 (secure 0 0 0) 0x7faf100aace0 con 0x55942af7c8a0 2024-05-08T05:28:21.282 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:21.281+0000 7faf3072eb80 10 client.14781 fetch_fsmap finished waiting for FSMap version 24 2024-05-08T05:28:21.282 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:21.281+0000 7faf3072eb80 10 client.14781 resolve_mds: resolved name 'b' to daemon mds.b 2024-05-08T05:28:21.282 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:21.281+0000 7faf3072eb80 20 client.14781 populate_metadata read hostname 'smithi087' 2024-05-08T05:28:21.282 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:21.281+0000 7faf3072eb80 1 --2- 172.21.15.87:0/2863766173 >> [v2:172.21.15.90:6838/160586017,v1:172.21.15.90:6839/160586017] conn(0x55942af95930 0x55942af96da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:28:21.283 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:21.281+0000 7faf3072eb80 4 client.14781 mds_command: new command op to 24500 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-08T05:28:21.283 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:21.281+0000 7faf3072eb80 1 -- 172.21.15.87:0/2863766173 --> [v2:172.21.15.90:6838/160586017,v1:172.21.15.90:6839/160586017] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55942aedc3b0 con 0x55942af95930 2024-05-08T05:28:21.283 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:21.281+0000 7faf1e000700 1 --2- 172.21.15.87:0/2863766173 >> [v2:172.21.15.90:6838/160586017,v1:172.21.15.90:6839/160586017] conn(0x55942af95930 0x55942af96da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:28:21.284 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:21.282+0000 7faf1e000700 1 --2- 172.21.15.87:0/2863766173 >> [v2:172.21.15.90:6838/160586017,v1:172.21.15.90:6839/160586017] conn(0x55942af95930 0x55942af96da0 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=616bacc8c28c37a1 server_cookie=14c0fbe640b01b12 in_seq=0 out_seq=0 2024-05-08T05:28:21.284 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:21.282+0000 7faf09600700 10 client.14781 ms_handle_connect on v2:172.21.15.90:6838/160586017 2024-05-08T05:28:21.284 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:21.282+0000 7faf09600700 1 -- 172.21.15.87:0/2863766173 <== mds.0 v2:172.21.15.90:6838/160586017 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55942aedc3b0 con 0x55942af95930 2024-05-08T05:28:21.284 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:21.282+0000 7faf09600700 10 client.14781 handle_command_reply: tid=0 2024-05-08T05:28:21.284 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:21.282+0000 7faf3072eb80 1 client.14781 shutdown 2024-05-08T05:28:21.284 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:21.283+0000 7faf3072eb80 1 -- 172.21.15.87:0/2863766173 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55942af7c8a0 msgr2=0x55942af88230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:28:21.284 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:21.283+0000 7faf3072eb80 1 --2- 172.21.15.87:0/2863766173 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55942af7c8a0 0x55942af88230 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7faf10009fd0 tx=0x7faf100b25b0 comp rx=0 tx=0).stop 2024-05-08T05:28:21.284 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:21.283+0000 7faf3072eb80 1 -- 172.21.15.87:0/2863766173 shutdown_connections 2024-05-08T05:28:21.284 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:21.283+0000 7faf3072eb80 1 --2- 172.21.15.87:0/2863766173 >> [v2:172.21.15.90:6838/160586017,v1:172.21.15.90:6839/160586017] conn(0x55942af95930 0x55942af96da0 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:28:21.284 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:21.283+0000 7faf3072eb80 1 --2- 172.21.15.87:0/2863766173 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55942af82490 0x55942af85b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:28:21.284 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:21.283+0000 7faf3072eb80 1 --2- 172.21.15.87:0/2863766173 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55942af7c8a0 0x55942af88230 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:28:21.284 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:21.283+0000 7faf3072eb80 1 --2- 172.21.15.87:0/2863766173 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55942af81b70 0x55942af855d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:28:21.284 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:21.283+0000 7faf09600700 0 client.14781 ms_handle_reset on v2:172.21.15.90:6838/160586017 2024-05-08T05:28:21.285 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:21.283+0000 7faf3072eb80 1 -- 172.21.15.87:0/2863766173 >> 172.21.15.87:0/2863766173 conn(0x55942aef4680 msgr2=0x55942af76140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:28:21.285 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:21.283+0000 7faf3072eb80 1 -- 172.21.15.87:0/2863766173 shutdown_connections 2024-05-08T05:28:21.285 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:21.283+0000 7faf3072eb80 1 -- 172.21.15.87:0/2863766173 wait complete. 2024-05-08T05:28:21.285 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:21.283+0000 7faf3072eb80 20 client.14781 trim_cache size 0 max 16384 2024-05-08T05:28:21.307 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:21.306+0000 7faf3072eb80 1 Processor -- start 2024-05-08T05:28:21.307 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:21.306+0000 7faf3072eb80 1 -- start start 2024-05-08T05:28:21.308 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:21.307+0000 7faf3072eb80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55942af7c8a0 0x55942af7c280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:28:21.308 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:21.307+0000 7faf3072eb80 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55942af81b70 0x55942af84530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:28:21.308 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:21.307+0000 7faf3072eb80 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55942af82490 0x55942af83150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:28:21.308 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:21.307+0000 7faf3072eb80 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x55942af950e0 con 0x55942af81b70 2024-05-08T05:28:21.308 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:21.307+0000 7faf3072eb80 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x55942af957b0 con 0x55942af82490 2024-05-08T05:28:21.308 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:21.307+0000 7faf3072eb80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x55942af95e80 con 0x55942af7c8a0 2024-05-08T05:28:21.308 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:21.307+0000 7faf1e000700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55942af81b70 0x55942af84530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:28:21.308 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:21.307+0000 7faf1e000700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55942af81b70 0x55942af84530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:44514/0 (socket says 172.21.15.87:44514) 2024-05-08T05:28:21.308 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:21.307+0000 7faf1e000700 1 -- 172.21.15.87:0/1088392886 learned_addr learned my addr 172.21.15.87:0/1088392886 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T05:28:21.308 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:21.307+0000 7faf1ea00700 1 --2- 172.21.15.87:0/1088392886 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55942af7c8a0 0x55942af7c280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:28:21.308 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:21.307+0000 7faf1f400700 1 --2- 172.21.15.87:0/1088392886 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55942af82490 0x55942af83150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:28:21.309 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:21.308+0000 7faf1e000700 1 -- 172.21.15.87:0/1088392886 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55942af7c8a0 msgr2=0x55942af7c280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:28:21.309 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:21.308+0000 7faf1e000700 1 --2- 172.21.15.87:0/1088392886 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55942af7c8a0 0x55942af7c280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:28:21.309 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:21.308+0000 7faf1e000700 1 -- 172.21.15.87:0/1088392886 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55942af82490 msgr2=0x55942af83150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:28:21.309 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:21.308+0000 7faf1e000700 1 --2- 172.21.15.87:0/1088392886 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55942af82490 0x55942af83150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:28:21.309 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:21.308+0000 7faf1e000700 1 -- 172.21.15.87:0/1088392886 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55942af6f1b0 con 0x55942af81b70 2024-05-08T05:28:21.309 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:21.308+0000 7faf1ea00700 1 --2- 172.21.15.87:0/1088392886 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55942af7c8a0 0x55942af7c280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T05:28:21.309 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:21.308+0000 7faf1f400700 1 --2- 172.21.15.87:0/1088392886 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55942af82490 0x55942af83150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T05:28:21.313 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:21.308+0000 7faf1e000700 1 --2- 172.21.15.87:0/1088392886 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55942af81b70 0x55942af84530 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x55942af86ba0 tx=0x7faf0c009260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a35aa1ef1912d0d6 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:28:21.313 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:21.308+0000 7faf0be00700 1 -- 172.21.15.87:0/1088392886 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf0c011c70 con 0x55942af81b70 2024-05-08T05:28:21.313 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:21.308+0000 7faf0be00700 1 -- 172.21.15.87:0/1088392886 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7faf0c024020 con 0x55942af81b70 2024-05-08T05:28:21.313 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:21.308+0000 7faf0be00700 1 -- 172.21.15.87:0/1088392886 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf0c01e620 con 0x55942af81b70 2024-05-08T05:28:21.313 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:21.309+0000 7faf3072eb80 1 -- 172.21.15.87:0/1088392886 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55942af81b70 msgr2=0x55942af84530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:28:21.313 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:21.309+0000 7faf3072eb80 1 --2- 172.21.15.87:0/1088392886 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55942af81b70 0x55942af84530 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x55942af86ba0 tx=0x7faf0c009260 comp rx=0 tx=0).stop 2024-05-08T05:28:21.313 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:21.309+0000 7faf3072eb80 1 -- 172.21.15.87:0/1088392886 shutdown_connections 2024-05-08T05:28:21.313 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:21.309+0000 7faf3072eb80 1 --2- 172.21.15.87:0/1088392886 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55942af82490 0x55942af83150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:28:21.313 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:21.309+0000 7faf3072eb80 1 --2- 172.21.15.87:0/1088392886 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55942af7c8a0 0x55942af7c280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:28:21.313 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:21.309+0000 7faf3072eb80 1 --2- 172.21.15.87:0/1088392886 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55942af81b70 0x55942af84530 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:28:21.313 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:21.309+0000 7faf3072eb80 1 -- 172.21.15.87:0/1088392886 >> 172.21.15.87:0/1088392886 conn(0x55942aef4680 msgr2=0x55942af80730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:28:21.314 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:21.309+0000 7faf3072eb80 1 -- 172.21.15.87:0/1088392886 shutdown_connections 2024-05-08T05:28:21.314 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:21.309+0000 7faf3072eb80 1 -- 172.21.15.87:0/1088392886 wait complete. 2024-05-08T05:28:21.314 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:21.310+0000 7faf3072eb80 1 -- start start 2024-05-08T05:28:21.314 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:21.310+0000 7faf3072eb80 1 Processor -- start 2024-05-08T05:28:21.314 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:21.310+0000 7faf3072eb80 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55942af7c8a0 0x55942afa0810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:28:21.314 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:21.310+0000 7faf3072eb80 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55942af81b70 0x55942af75c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:28:21.314 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:21.310+0000 7faf3072eb80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55942af82490 0x55942af761d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:28:21.314 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:21.310+0000 7faf3072eb80 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x55942af96c20 con 0x55942af81b70 2024-05-08T05:28:21.314 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:21.310+0000 7faf3072eb80 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x55942af96550 con 0x55942af7c8a0 2024-05-08T05:28:21.314 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:21.310+0000 7faf3072eb80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x55942af972f0 con 0x55942af82490 2024-05-08T05:28:21.314 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:21.310+0000 7faf3072eb80 10 client.0 _ll_register_callbacks cb 0x55942ae75c20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T05:28:21.314 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:21.311+0000 7faf1e000700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55942af81b70 0x55942af75c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:28:21.314 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:21.311+0000 7faf1ea00700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55942af7c8a0 0x55942afa0810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:28:21.314 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:21.311+0000 7faf1e000700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55942af81b70 0x55942af75c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:44528/0 (socket says 172.21.15.87:44528) 2024-05-08T05:28:21.315 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:21.311+0000 7faf1e000700 1 -- 172.21.15.87:0/3843139798 learned_addr learned my addr 172.21.15.87:0/3843139798 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T05:28:21.315 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:21.311+0000 7faf1f400700 1 --2- 172.21.15.87:0/3843139798 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55942af82490 0x55942af761d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:28:21.315 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:21.311+0000 7faf1ea00700 1 -- 172.21.15.87:0/3843139798 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55942af82490 msgr2=0x55942af761d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:28:21.315 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:21.311+0000 7faf1ea00700 1 --2- 172.21.15.87:0/3843139798 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55942af82490 0x55942af761d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:28:21.315 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:21.311+0000 7faf1ea00700 1 -- 172.21.15.87:0/3843139798 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55942af81b70 msgr2=0x55942af75c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:28:21.315 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:21.311+0000 7faf1ea00700 1 --2- 172.21.15.87:0/3843139798 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55942af81b70 0x55942af75c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:28:21.315 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:21.311+0000 7faf1ea00700 1 -- 172.21.15.87:0/3843139798 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55942af76a10 con 0x55942af7c8a0 2024-05-08T05:28:21.315 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:21.311+0000 7faf1e000700 1 --2- 172.21.15.87:0/3843139798 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55942af81b70 0x55942af75c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T05:28:21.315 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:21.311+0000 7faf1ea00700 1 --2- 172.21.15.87:0/3843139798 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55942af7c8a0 0x55942afa0810 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7faf100a6c20 tx=0x7faf100a91d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=17b7f4dafd793249 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:28:21.315 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:21.311+0000 7faf09600700 10 client.0 ms_handle_connect on v2:172.21.15.90:3300/0 2024-05-08T05:28:21.315 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:21.312+0000 7faf09600700 1 -- 172.21.15.87:0/3843139798 <== mon.2 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf100c9070 con 0x55942af7c8a0 2024-05-08T05:28:21.315 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:21.312+0000 7faf09600700 1 -- 172.21.15.87:0/3843139798 <== mon.2 v2:172.21.15.90:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8190+0+0 (secure 0 0 0) 0x7faf100912c0 con 0x55942af7c8a0 2024-05-08T05:28:21.315 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:21.312+0000 7faf3072eb80 1 -- 172.21.15.87:0/3843139798 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7faf0c024020 con 0x55942af7c8a0 2024-05-08T05:28:21.315 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:21.312+0000 7faf09600700 1 -- 172.21.15.87:0/3843139798 <== mon.2 v2:172.21.15.90:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7faf100a5870 con 0x55942af7c8a0 2024-05-08T05:28:21.316 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:21.312+0000 7faf3072eb80 10 client.24884 fetch_fsmap learned FSMap version 24 2024-05-08T05:28:21.316 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:21.312+0000 7faf3072eb80 1 -- 172.21.15.87:0/3843139798 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55942b000e60 con 0x55942af7c8a0 2024-05-08T05:28:21.316 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:21.312+0000 7faf09600700 1 -- 172.21.15.87:0/3843139798 <== mon.2 v2:172.21.15.90:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7faf0c024020 con 0x55942af7c8a0 2024-05-08T05:28:21.316 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:21.312+0000 7faf09600700 1 -- 172.21.15.87:0/3843139798 <== mon.2 v2:172.21.15.90:3300/0 5 ==== fsmap(e 24) ==== 8338+0+0 (secure 0 0 0) 0x7faf100aace0 con 0x55942af7c8a0 2024-05-08T05:28:21.316 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:21.312+0000 7faf3072eb80 10 client.24884 fetch_fsmap finished waiting for FSMap version 24 2024-05-08T05:28:21.316 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:21.312+0000 7faf3072eb80 10 client.24884 resolve_mds: resolved name 'b' to daemon mds.b 2024-05-08T05:28:21.316 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:21.312+0000 7faf3072eb80 20 client.24884 populate_metadata read hostname 'smithi087' 2024-05-08T05:28:21.316 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:21.312+0000 7faf3072eb80 1 --2- 172.21.15.87:0/3843139798 >> [v2:172.21.15.90:6838/160586017,v1:172.21.15.90:6839/160586017] conn(0x55942b0056d0 0x55942b0043e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:28:21.316 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:21.312+0000 7faf3072eb80 4 client.24884 mds_command: new command op to 24500 tid=0 multi_id=0 [{"prefix": "status"}] 2024-05-08T05:28:21.316 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:21.312+0000 7faf3072eb80 1 -- 172.21.15.87:0/3843139798 --> [v2:172.21.15.90:6838/160586017,v1:172.21.15.90:6839/160586017] -- command(tid 0: {"prefix": "status"}) -- 0x55942aed6450 con 0x55942b0056d0 2024-05-08T05:28:21.317 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:21.313+0000 7faf1e000700 1 --2- 172.21.15.87:0/3843139798 >> [v2:172.21.15.90:6838/160586017,v1:172.21.15.90:6839/160586017] conn(0x55942b0056d0 0x55942b0043e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:28:21.318 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:21.313+0000 7faf1e000700 1 --2- 172.21.15.87:0/3843139798 >> [v2:172.21.15.90:6838/160586017,v1:172.21.15.90:6839/160586017] conn(0x55942b0056d0 0x55942b0043e0 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=da26163e0c67982d server_cookie=2a43faad00eeb25 in_seq=0 out_seq=0 2024-05-08T05:28:21.318 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:21.313+0000 7faf09600700 10 client.24884 ms_handle_connect on v2:172.21.15.90:6838/160586017 2024-05-08T05:28:21.318 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:21.314+0000 7faf09600700 1 -- 172.21.15.87:0/3843139798 <== mds.0 v2:172.21.15.90:6838/160586017 1 ==== command_reply(tid 0: 0 ) ==== 8+0+327 (crc 0 0 0) 0x55942aed6450 con 0x55942b0056d0 2024-05-08T05:28:21.318 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:21.314+0000 7faf09600700 10 client.24884 handle_command_reply: tid=0 2024-05-08T05:28:21.318 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:21.314+0000 7faf3072eb80 1 client.24884 shutdown 2024-05-08T05:28:21.318 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:21.314+0000 7faf3072eb80 1 -- 172.21.15.87:0/3843139798 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55942af7c8a0 msgr2=0x55942afa0810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:28:21.318 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:21.314+0000 7faf3072eb80 1 --2- 172.21.15.87:0/3843139798 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55942af7c8a0 0x55942afa0810 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7faf100a6c20 tx=0x7faf100a91d0 comp rx=0 tx=0).stop 2024-05-08T05:28:21.318 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:21.314+0000 7faf3072eb80 1 -- 172.21.15.87:0/3843139798 shutdown_connections 2024-05-08T05:28:21.318 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:21.314+0000 7faf3072eb80 1 --2- 172.21.15.87:0/3843139798 >> [v2:172.21.15.90:6838/160586017,v1:172.21.15.90:6839/160586017] conn(0x55942b0056d0 0x55942b0043e0 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:28:21.318 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:21.314+0000 7faf3072eb80 1 --2- 172.21.15.87:0/3843139798 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55942af82490 0x55942af761d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:28:21.318 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:21.314+0000 7faf3072eb80 1 --2- 172.21.15.87:0/3843139798 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55942af7c8a0 0x55942afa0810 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:28:21.318 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:21.314+0000 7faf3072eb80 1 --2- 172.21.15.87:0/3843139798 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55942af81b70 0x55942af75c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:28:21.318 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:21.314+0000 7faf3072eb80 1 -- 172.21.15.87:0/3843139798 >> 172.21.15.87:0/3843139798 conn(0x55942aef4680 msgr2=0x55942af80730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:28:21.318 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:21.314+0000 7faf09600700 0 client.24884 ms_handle_reset on v2:172.21.15.90:6838/160586017 2024-05-08T05:28:21.319 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:21.314+0000 7faf3072eb80 1 -- 172.21.15.87:0/3843139798 shutdown_connections 2024-05-08T05:28:21.319 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:21.314+0000 7faf3072eb80 1 -- 172.21.15.87:0/3843139798 wait complete. 2024-05-08T05:28:21.319 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:21.314+0000 7faf3072eb80 20 client.24884 trim_cache size 0 max 16384 2024-05-08T05:28:21.319 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-05-08T05:28:21.319 INFO:teuthology.orchestra.run.smithi087.stdout: "cluster_fsid": "eeeb813e-0cf9-11ef-bc97-c7b262605968", 2024-05-08T05:28:21.319 INFO:teuthology.orchestra.run.smithi087.stdout: "whoami": 0, 2024-05-08T05:28:21.319 INFO:teuthology.orchestra.run.smithi087.stdout: "id": 24500, 2024-05-08T05:28:21.319 INFO:teuthology.orchestra.run.smithi087.stdout: "want_state": "up:active", 2024-05-08T05:28:21.319 INFO:teuthology.orchestra.run.smithi087.stdout: "state": "up:active", 2024-05-08T05:28:21.320 INFO:teuthology.orchestra.run.smithi087.stdout: "fs_name": "cephfs", 2024-05-08T05:28:21.320 INFO:teuthology.orchestra.run.smithi087.stdout: "rank_uptime": 164.234312477, 2024-05-08T05:28:21.320 INFO:teuthology.orchestra.run.smithi087.stdout: "mdsmap_epoch": 24, 2024-05-08T05:28:21.320 INFO:teuthology.orchestra.run.smithi087.stdout: "osdmap_epoch": 82, 2024-05-08T05:28:21.320 INFO:teuthology.orchestra.run.smithi087.stdout: "osdmap_epoch_barrier": 80, 2024-05-08T05:28:21.320 INFO:teuthology.orchestra.run.smithi087.stdout: "uptime": 183.53666741000001 2024-05-08T05:28:21.320 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-05-08T05:28:21.321 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:21.315+0000 7faf25e00700 1 -- 172.21.15.87:0/2790326094 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7faf040b2900 msgr2=0x7faf040b4dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:28:21.321 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:21.315+0000 7faf25e00700 1 --2- 172.21.15.87:0/2790326094 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7faf040b2900 0x7faf040b4dc0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7faf1800b780 tx=0x7faf18006000 comp rx=0 tx=0).stop 2024-05-08T05:28:21.321 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:21.315+0000 7faf25e00700 1 -- 172.21.15.87:0/2790326094 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7faf20109ad0 msgr2=0x7faf201a01b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:28:21.321 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:21.315+0000 7faf25e00700 1 --2- 172.21.15.87:0/2790326094 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7faf20109ad0 0x7faf201a01b0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7faf1000e9c0 tx=0x7faf1000ecd0 comp rx=0 tx=0).stop 2024-05-08T05:28:21.321 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:21.315+0000 7faf25e00700 1 -- 172.21.15.87:0/2790326094 shutdown_connections 2024-05-08T05:28:21.321 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:21.315+0000 7faf25e00700 1 --2- 172.21.15.87:0/2790326094 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7faf2010fb60 0x7faf201a4a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:28:21.321 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:21.315+0000 7faf25e00700 1 --2- 172.21.15.87:0/2790326094 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7faf20109ad0 0x7faf201a01b0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:28:21.321 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:21.315+0000 7faf25e00700 1 --2- 172.21.15.87:0/2790326094 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7faf040b2900 0x7faf040b4dc0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:28:21.321 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:21.315+0000 7faf25e00700 1 --2- 172.21.15.87:0/2790326094 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7faf2010a490 0x7faf201a06f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:28:21.321 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:21.315+0000 7faf25e00700 1 -- 172.21.15.87:0/2790326094 >> 172.21.15.87:0/2790326094 conn(0x7faf20076c70 msgr2=0x7faf20077230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:28:21.321 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:21.315+0000 7faf25e00700 1 -- 172.21.15.87:0/2790326094 shutdown_connections 2024-05-08T05:28:21.321 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:21.315+0000 7faf25e00700 1 -- 172.21.15.87:0/2790326094 wait complete. 2024-05-08T05:28:22.171 INFO:tasks.cephadm:Setup complete, yielding 2024-05-08T05:28:22.171 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-05-08T05:28:22.182 INFO:tasks.cephadm:Running commands on role mon.a host ubuntu@smithi087.front.sepia.ceph.com 2024-05-08T05:28:22.182 DEBUG:teuthology.orchestra.run.smithi087:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid eeeb813e-0cf9-11ef-bc97-c7b262605968 -- bash -c 'ceph orch status' 2024-05-08T05:28:22.289 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:28:22 smithi160 ceph-mon[34827]: pgmap v401: 97 pgs: 97 active+clean; 644 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T05:28:22.458 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:28:22 smithi087 ceph-mon[29523]: pgmap v401: 97 pgs: 97 active+clean; 644 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T05:28:22.483 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:28:22 smithi090 ceph-mon[34526]: pgmap v401: 97 pgs: 97 active+clean; 644 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T05:28:22.610 INFO:teuthology.orchestra.run.smithi087.stderr:Inferring config /var/lib/ceph/eeeb813e-0cf9-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T05:28:24.208 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:28:24 smithi087 ceph-mon[29523]: pgmap v402: 97 pgs: 97 active+clean; 644 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-05-08T05:28:24.290 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:28:24 smithi160 ceph-mon[34827]: pgmap v402: 97 pgs: 97 active+clean; 644 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-05-08T05:28:24.483 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:28:24 smithi090 ceph-mon[34526]: pgmap v402: 97 pgs: 97 active+clean; 644 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-05-08T05:28:24.744 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:24.743+0000 7f5566e00700 1 -- 172.21.15.87:0/862798156 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f556010b6e0 msgr2=0x7f5560111f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:28:24.745 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:24.743+0000 7f5566e00700 1 --2- 172.21.15.87:0/862798156 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f556010b6e0 0x7f5560111f90 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f55580099c0 tx=0x7f5558009cd0 comp rx=0 tx=0).stop 2024-05-08T05:28:24.745 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:24.744+0000 7f5566e00700 1 -- 172.21.15.87:0/862798156 shutdown_connections 2024-05-08T05:28:24.745 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:24.744+0000 7f5566e00700 1 --2- 172.21.15.87:0/862798156 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f556010b6e0 0x7f5560111f90 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:28:24.745 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:24.744+0000 7f5566e00700 1 --2- 172.21.15.87:0/862798156 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5560109b40 0x7f5560109f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:28:24.745 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:24.744+0000 7f5566e00700 1 --2- 172.21.15.87:0/862798156 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f556010ad40 0x7f556010b1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:28:24.745 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:24.744+0000 7f5566e00700 1 -- 172.21.15.87:0/862798156 >> 172.21.15.87:0/862798156 conn(0x7f5560078b10 msgr2=0x7f556007af50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:28:24.745 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:24.744+0000 7f5566e00700 1 -- 172.21.15.87:0/862798156 shutdown_connections 2024-05-08T05:28:24.745 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:24.744+0000 7f5566e00700 1 -- 172.21.15.87:0/862798156 wait complete. 2024-05-08T05:28:24.746 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:24.745+0000 7f5566e00700 1 Processor -- start 2024-05-08T05:28:24.746 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:24.745+0000 7f5566e00700 1 -- start start 2024-05-08T05:28:24.746 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:24.745+0000 7f5566e00700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5560109b40 0x7f556019fbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:28:24.746 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:24.745+0000 7f5566e00700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f556010ad40 0x7f55601a00f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:28:24.746 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:24.746+0000 7f5566e00700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f556010b6e0 0x7f55601a7170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:28:24.746 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:24.746+0000 7f5566e00700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f55601155c0 con 0x7f556010ad40 2024-05-08T05:28:24.747 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:24.746+0000 7f5566e00700 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f5560115440 con 0x7f5560109b40 2024-05-08T05:28:24.747 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:24.746+0000 7f5566e00700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f5560115740 con 0x7f556010b6e0 2024-05-08T05:28:24.747 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:24.746+0000 7f5557400700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f556010ad40 0x7f55601a00f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:28:24.747 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:24.746+0000 7f5557400700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f556010ad40 0x7f55601a00f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:44546/0 (socket says 172.21.15.87:44546) 2024-05-08T05:28:24.747 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:24.746+0000 7f5557400700 1 -- 172.21.15.87:0/1928558898 learned_addr learned my addr 172.21.15.87:0/1928558898 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T05:28:24.747 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:24.746+0000 7f5564e00700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f556010b6e0 0x7f55601a7170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:28:24.747 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:24.746+0000 7f555fe00700 1 --2- 172.21.15.87:0/1928558898 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5560109b40 0x7f556019fbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:28:24.748 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:24.746+0000 7f5557400700 1 -- 172.21.15.87:0/1928558898 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f556010b6e0 msgr2=0x7f55601a7170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:28:24.748 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:24.746+0000 7f5557400700 1 --2- 172.21.15.87:0/1928558898 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f556010b6e0 0x7f55601a7170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:28:24.748 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:24.746+0000 7f5557400700 1 -- 172.21.15.87:0/1928558898 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5560109b40 msgr2=0x7f556019fbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:28:24.748 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:24.746+0000 7f5557400700 1 --2- 172.21.15.87:0/1928558898 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5560109b40 0x7f556019fbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:28:24.748 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:24.746+0000 7f5557400700 1 -- 172.21.15.87:0/1928558898 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f55601a7810 con 0x7f556010ad40 2024-05-08T05:28:24.748 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:24.746+0000 7f5564e00700 1 --2- 172.21.15.87:0/1928558898 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f556010b6e0 0x7f55601a7170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T05:28:24.749 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:24.747+0000 7f5557400700 1 --2- 172.21.15.87:0/1928558898 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f556010ad40 0x7f55601a00f0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f554800e9d0 tx=0x7f554800ece0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:28:24.749 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:24.747+0000 7f555d600700 1 -- 172.21.15.87:0/1928558898 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f554800cbd0 con 0x7f556010ad40 2024-05-08T05:28:24.749 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:24.747+0000 7f555d600700 1 -- 172.21.15.87:0/1928558898 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f554800ee70 con 0x7f556010ad40 2024-05-08T05:28:24.749 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:24.747+0000 7f5566e00700 1 -- 172.21.15.87:0/1928558898 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f55601a7b00 con 0x7f556010ad40 2024-05-08T05:28:24.749 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:24.747+0000 7f555d600700 1 -- 172.21.15.87:0/1928558898 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5548018680 con 0x7f556010ad40 2024-05-08T05:28:24.749 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:24.747+0000 7f5566e00700 1 -- 172.21.15.87:0/1928558898 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f55601a8090 con 0x7f556010ad40 2024-05-08T05:28:24.749 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:24.749+0000 7f5566e00700 1 -- 172.21.15.87:0/1928558898 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f556006a190 con 0x7f556010ad40 2024-05-08T05:28:24.751 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:24.751+0000 7f555d600700 1 -- 172.21.15.87:0/1928558898 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7f5548010430 con 0x7f556010ad40 2024-05-08T05:28:24.752 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:24.752+0000 7f555d600700 1 --2- 172.21.15.87:0/1928558898 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f55440b2900 0x7f55440b4dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:28:24.752 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:24.752+0000 7f555d600700 1 -- 172.21.15.87:0/1928558898 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8190+0+0 (secure 0 0 0) 0x7f55480e23d0 con 0x7f556010ad40 2024-05-08T05:28:24.752 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:24.752+0000 7f555fe00700 1 --2- 172.21.15.87:0/1928558898 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f55440b2900 0x7f55440b4dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:28:24.753 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:24.753+0000 7f555fe00700 1 --2- 172.21.15.87:0/1928558898 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f55440b2900 0x7f55440b4dc0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f556010aba0 tx=0x7f555000b040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:28:24.757 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:24.757+0000 7f555d600700 1 -- 172.21.15.87:0/1928558898 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f55480aa0c0 con 0x7f556010ad40 2024-05-08T05:28:25.008 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:25.008+0000 7f5566e00700 1 -- 172.21.15.87:0/1928558898 --> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] -- mgr_command(tid 0: {"prefix": "orch status", "target": ["mon-mgr", ""]}) -- 0x7f55600638e0 con 0x7f55440b2900 2024-05-08T05:28:25.010 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:25.010+0000 7f555d600700 1 -- 172.21.15.87:0/1928558898 <== mgr.14152 v2:172.21.15.87:6800/1189186457 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+43 (secure 0 0 0) 0x7f55600638e0 con 0x7f55440b2900 2024-05-08T05:28:25.010 INFO:teuthology.orchestra.run.smithi087.stdout:Backend: cephadm 2024-05-08T05:28:25.010 INFO:teuthology.orchestra.run.smithi087.stdout:Available: Yes 2024-05-08T05:28:25.010 INFO:teuthology.orchestra.run.smithi087.stdout:Paused: No 2024-05-08T05:28:25.013 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:25.013+0000 7f5566e00700 1 -- 172.21.15.87:0/1928558898 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f55440b2900 msgr2=0x7f55440b4dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:28:25.013 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:25.013+0000 7f5566e00700 1 --2- 172.21.15.87:0/1928558898 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f55440b2900 0x7f55440b4dc0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f556010aba0 tx=0x7f555000b040 comp rx=0 tx=0).stop 2024-05-08T05:28:25.013 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:25.013+0000 7f5566e00700 1 -- 172.21.15.87:0/1928558898 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f556010ad40 msgr2=0x7f55601a00f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:28:25.013 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:25.013+0000 7f5566e00700 1 --2- 172.21.15.87:0/1928558898 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f556010ad40 0x7f55601a00f0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f554800e9d0 tx=0x7f554800ece0 comp rx=0 tx=0).stop 2024-05-08T05:28:25.014 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:25.013+0000 7f5566e00700 1 -- 172.21.15.87:0/1928558898 shutdown_connections 2024-05-08T05:28:25.014 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:25.013+0000 7f5566e00700 1 --2- 172.21.15.87:0/1928558898 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f55440b2900 0x7f55440b4dc0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:28:25.014 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:25.013+0000 7f5566e00700 1 --2- 172.21.15.87:0/1928558898 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f556010b6e0 0x7f55601a7170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:28:25.014 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:25.013+0000 7f5566e00700 1 --2- 172.21.15.87:0/1928558898 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5560109b40 0x7f556019fbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:28:25.014 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:25.013+0000 7f5566e00700 1 --2- 172.21.15.87:0/1928558898 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f556010ad40 0x7f55601a00f0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:28:25.014 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:25.013+0000 7f5566e00700 1 -- 172.21.15.87:0/1928558898 >> 172.21.15.87:0/1928558898 conn(0x7f5560078b10 msgr2=0x7f556010e040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:28:25.014 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:25.013+0000 7f5566e00700 1 -- 172.21.15.87:0/1928558898 shutdown_connections 2024-05-08T05:28:25.014 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:25.014+0000 7f5566e00700 1 -- 172.21.15.87:0/1928558898 wait complete. 2024-05-08T05:28:25.876 DEBUG:teuthology.orchestra.run.smithi087:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid eeeb813e-0cf9-11ef-bc97-c7b262605968 -- bash -c 'ceph orch ps' 2024-05-08T05:28:26.289 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:28:26 smithi160 ceph-mon[34827]: pgmap v403: 97 pgs: 97 active+clean; 644 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-05-08T05:28:26.289 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:28:26 smithi160 ceph-mon[34827]: from='client.14793 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-08T05:28:26.303 INFO:teuthology.orchestra.run.smithi087.stderr:Inferring config /var/lib/ceph/eeeb813e-0cf9-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T05:28:26.448 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:28:26 smithi087 ceph-mon[29523]: pgmap v403: 97 pgs: 97 active+clean; 644 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-05-08T05:28:26.448 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:28:26 smithi087 ceph-mon[29523]: from='client.14793 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-08T05:28:26.483 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:28:26 smithi090 ceph-mon[34526]: pgmap v403: 97 pgs: 97 active+clean; 644 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-05-08T05:28:26.483 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:28:26 smithi090 ceph-mon[34526]: from='client.14793 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-08T05:28:28.208 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:28:28 smithi087 ceph-mon[29523]: pgmap v404: 97 pgs: 97 active+clean; 644 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T05:28:28.288 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:28:28 smithi160 ceph-mon[34827]: pgmap v404: 97 pgs: 97 active+clean; 644 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T05:28:28.461 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:28.460+0000 7f1cc2800700 1 -- 172.21.15.87:0/1006932233 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1cbc103500 msgr2=0x7f1cbc103920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:28:28.461 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:28.460+0000 7f1cc2800700 1 --2- 172.21.15.87:0/1006932233 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1cbc103500 0x7f1cbc103920 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f1cac0098f0 tx=0x7f1cac009c00 comp rx=0 tx=0).stop 2024-05-08T05:28:28.461 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:28.460+0000 7f1cc2800700 1 -- 172.21.15.87:0/1006932233 shutdown_connections 2024-05-08T05:28:28.461 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:28.460+0000 7f1cc2800700 1 --2- 172.21.15.87:0/1006932233 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1cbc1050a0 0x7f1cbc10b950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:28:28.461 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:28.460+0000 7f1cc2800700 1 --2- 172.21.15.87:0/1006932233 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1cbc103500 0x7f1cbc103920 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:28:28.462 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:28.460+0000 7f1cc2800700 1 --2- 172.21.15.87:0/1006932233 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1cbc104700 0x7f1cbc104b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:28:28.462 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:28.460+0000 7f1cc2800700 1 -- 172.21.15.87:0/1006932233 >> 172.21.15.87:0/1006932233 conn(0x7f1cbc0feaa0 msgr2=0x7f1cbc100ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:28:28.462 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:28.460+0000 7f1cc2800700 1 -- 172.21.15.87:0/1006932233 shutdown_connections 2024-05-08T05:28:28.462 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:28.460+0000 7f1cc2800700 1 -- 172.21.15.87:0/1006932233 wait complete. 2024-05-08T05:28:28.464 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:28.461+0000 7f1cc2800700 1 Processor -- start 2024-05-08T05:28:28.464 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:28.462+0000 7f1cc2800700 1 -- start start 2024-05-08T05:28:28.464 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:28.462+0000 7f1cc2800700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1cbc103500 0x7f1cbc19b920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:28:28.464 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:28.462+0000 7f1cc2800700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1cbc104700 0x7f1cbc19be60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:28:28.464 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:28.462+0000 7f1cc2800700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1cbc1050a0 0x7f1cbc1a2ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:28:28.464 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:28.462+0000 7f1cc2800700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f1cbc10efd0 con 0x7f1cbc1050a0 2024-05-08T05:28:28.464 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:28.462+0000 7f1cc2800700 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f1cbc10ee50 con 0x7f1cbc104700 2024-05-08T05:28:28.464 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:28.462+0000 7f1cc2800700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f1cbc10f150 con 0x7f1cbc103500 2024-05-08T05:28:28.464 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:28.462+0000 7f1cbb400700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1cbc103500 0x7f1cbc19b920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:28:28.464 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:28.462+0000 7f1cbb400700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1cbc103500 0x7f1cbc19b920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.87:42112/0 (socket says 172.21.15.87:42112) 2024-05-08T05:28:28.464 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:28.462+0000 7f1cbbe00700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1cbc1050a0 0x7f1cbc1a2ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:28:28.464 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:28.462+0000 7f1cbb400700 1 -- 172.21.15.87:0/1216555196 learned_addr learned my addr 172.21.15.87:0/1216555196 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T05:28:28.465 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:28.462+0000 7f1cbaa00700 1 --2- 172.21.15.87:0/1216555196 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1cbc104700 0x7f1cbc19be60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:28:28.465 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:28.463+0000 7f1cbb400700 1 -- 172.21.15.87:0/1216555196 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1cbc104700 msgr2=0x7f1cbc19be60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:28:28.465 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:28.463+0000 7f1cbb400700 1 --2- 172.21.15.87:0/1216555196 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1cbc104700 0x7f1cbc19be60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:28:28.465 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:28.463+0000 7f1cbb400700 1 -- 172.21.15.87:0/1216555196 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1cbc1050a0 msgr2=0x7f1cbc1a2ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:28:28.465 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:28.463+0000 7f1cbb400700 1 --2- 172.21.15.87:0/1216555196 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1cbc1050a0 0x7f1cbc1a2ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:28:28.465 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:28.463+0000 7f1cbb400700 1 -- 172.21.15.87:0/1216555196 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1cbc1a3580 con 0x7f1cbc103500 2024-05-08T05:28:28.465 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:28.463+0000 7f1cbb400700 1 --2- 172.21.15.87:0/1216555196 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1cbc103500 0x7f1cbc19b920 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f1cac009230 tx=0x7f1cac005270 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:28:28.465 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:28.463+0000 7f1cb3e00700 1 -- 172.21.15.87:0/1216555196 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1cac025070 con 0x7f1cbc103500 2024-05-08T05:28:28.465 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:28.463+0000 7f1cb3e00700 1 -- 172.21.15.87:0/1216555196 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1cac005620 con 0x7f1cbc103500 2024-05-08T05:28:28.465 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:28.463+0000 7f1cc2800700 1 -- 172.21.15.87:0/1216555196 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1cbc1a3810 con 0x7f1cbc103500 2024-05-08T05:28:28.465 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:28.463+0000 7f1cb3e00700 1 -- 172.21.15.87:0/1216555196 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1cac003b50 con 0x7f1cbc103500 2024-05-08T05:28:28.465 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:28.463+0000 7f1cc2800700 1 -- 172.21.15.87:0/1216555196 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1cbc1a3c60 con 0x7f1cbc103500 2024-05-08T05:28:28.466 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:28.464+0000 7f1cc2800700 1 -- 172.21.15.87:0/1216555196 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1cbc06a190 con 0x7f1cbc103500 2024-05-08T05:28:28.467 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:28.467+0000 7f1cb3e00700 1 -- 172.21.15.87:0/1216555196 <== mon.1 v2:172.21.15.160:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7f1cac028070 con 0x7f1cbc103500 2024-05-08T05:28:28.469 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:28.468+0000 7f1cb3e00700 1 --2- 172.21.15.87:0/1216555196 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f1ca00b2880 0x7f1ca00b4d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:28:28.469 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:28.469+0000 7f1cb3e00700 1 -- 172.21.15.87:0/1216555196 <== mon.1 v2:172.21.15.160:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8190+0+0 (secure 0 0 0) 0x7f1cac0e2e60 con 0x7f1cbc103500 2024-05-08T05:28:28.469 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:28.469+0000 7f1cbaa00700 1 --2- 172.21.15.87:0/1216555196 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f1ca00b2880 0x7f1ca00b4d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:28:28.469 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:28.469+0000 7f1cbaa00700 1 --2- 172.21.15.87:0/1216555196 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f1ca00b2880 0x7f1ca00b4d40 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f1ca8009680 tx=0x7f1ca8009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:28:28.471 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:28.470+0000 7f1cb3e00700 1 -- 172.21.15.87:0/1216555196 <== mon.1 v2:172.21.15.160:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f1cac02f020 con 0x7f1cbc103500 2024-05-08T05:28:28.483 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:28:28 smithi090 ceph-mon[34526]: pgmap v404: 97 pgs: 97 active+clean; 644 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T05:28:28.716 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:28.716+0000 7f1cc2800700 1 -- 172.21.15.87:0/1216555196 --> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7f1cbc10b5f0 con 0x7f1ca00b2880 2024-05-08T05:28:28.757 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:28.756+0000 7f1cb3e00700 1 -- 172.21.15.87:0/1216555196 <== mgr.14152 v2:172.21.15.87:6800/1189186457 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+4123 (secure 0 0 0) 0x7f1cbc10b5f0 con 0x7f1ca00b2880 2024-05-08T05:28:28.757 INFO:teuthology.orchestra.run.smithi087.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-05-08T05:28:28.757 INFO:teuthology.orchestra.run.smithi087.stdout:mds.a smithi087 running (3m) 43s ago 3m 13.2M - 19.0.0-3538-gbee299f4 352576a2df49 650f7c6a8c2e 2024-05-08T05:28:28.757 INFO:teuthology.orchestra.run.smithi087.stdout:mds.b smithi090 running (3m) 52s ago 3m 28.8M - 19.0.0-3538-gbee299f4 352576a2df49 a1364ec01437 2024-05-08T05:28:28.757 INFO:teuthology.orchestra.run.smithi087.stdout:mds.c smithi160 running (3m) 52s ago 3m 20.5M - 19.0.0-3538-gbee299f4 352576a2df49 5afd6bd4357a 2024-05-08T05:28:28.758 INFO:teuthology.orchestra.run.smithi087.stdout:mds.d smithi087 running (3m) 43s ago 3m 13.3M - 19.0.0-3538-gbee299f4 352576a2df49 502d9a8af8b4 2024-05-08T05:28:28.758 INFO:teuthology.orchestra.run.smithi087.stdout:mds.e smithi090 running (3m) 52s ago 3m 15.0M - 19.0.0-3538-gbee299f4 352576a2df49 60ee4ba8a65a 2024-05-08T05:28:28.758 INFO:teuthology.orchestra.run.smithi087.stdout:mds.f smithi160 running (3m) 52s ago 3m 18.3M - 19.0.0-3538-gbee299f4 352576a2df49 b586ddc7bc7a 2024-05-08T05:28:28.758 INFO:teuthology.orchestra.run.smithi087.stdout:mds.g smithi087 running (3m) 43s ago 3m 18.8M - 19.0.0-3538-gbee299f4 352576a2df49 da5c165e8e9c 2024-05-08T05:28:28.758 INFO:teuthology.orchestra.run.smithi087.stdout:mds.h smithi090 running (3m) 52s ago 3m 20.8M - 19.0.0-3538-gbee299f4 352576a2df49 029ff2ccc4fc 2024-05-08T05:28:28.758 INFO:teuthology.orchestra.run.smithi087.stdout:mds.i smithi160 running (3m) 52s ago 3m 21.3M - 19.0.0-3538-gbee299f4 352576a2df49 5c35f6636ad1 2024-05-08T05:28:28.758 INFO:teuthology.orchestra.run.smithi087.stdout:mds.j smithi087 running (3m) 43s ago 3m 13.4M - 19.0.0-3538-gbee299f4 352576a2df49 aa3efd62a6a6 2024-05-08T05:28:28.758 INFO:teuthology.orchestra.run.smithi087.stdout:mds.k smithi090 running (3m) 52s ago 3m 13.9M - 19.0.0-3538-gbee299f4 352576a2df49 b0b0b09be1f6 2024-05-08T05:28:28.758 INFO:teuthology.orchestra.run.smithi087.stdout:mds.l smithi160 running (3m) 52s ago 3m 14.8M - 19.0.0-3538-gbee299f4 352576a2df49 a62338cea060 2024-05-08T05:28:28.758 INFO:teuthology.orchestra.run.smithi087.stdout:mgr.x smithi087 *:9283,8765 running (12m) 43s ago 12m 531M - 19.0.0-3538-gbee299f4 352576a2df49 5f6ec6edab8d 2024-05-08T05:28:28.758 INFO:teuthology.orchestra.run.smithi087.stdout:mgr.y smithi090 *:8443,8765 running (9m) 52s ago 9m 470M - 19.0.0-3538-gbee299f4 352576a2df49 3bdf571c19ca 2024-05-08T05:28:28.758 INFO:teuthology.orchestra.run.smithi087.stdout:mgr.z smithi160 *:8443,8765 running (9m) 52s ago 9m 469M - 19.0.0-3538-gbee299f4 352576a2df49 e76bf39dc4c4 2024-05-08T05:28:28.758 INFO:teuthology.orchestra.run.smithi087.stdout:mon.a smithi087 running (12m) 43s ago 12m 50.4M 2048M 19.0.0-3538-gbee299f4 352576a2df49 a734a965374b 2024-05-08T05:28:28.759 INFO:teuthology.orchestra.run.smithi087.stdout:mon.b smithi090 running (10m) 52s ago 10m 43.2M 2048M 19.0.0-3538-gbee299f4 352576a2df49 aa13368ec9bc 2024-05-08T05:28:28.759 INFO:teuthology.orchestra.run.smithi087.stdout:mon.c smithi160 running (10m) 52s ago 10m 43.6M 2048M 19.0.0-3538-gbee299f4 352576a2df49 fa092eda2d2b 2024-05-08T05:28:28.759 INFO:teuthology.orchestra.run.smithi087.stdout:osd.0 smithi087 running (9m) 43s ago 9m 55.2M 4272M 19.0.0-3538-gbee299f4 352576a2df49 8bd16d592244 2024-05-08T05:28:28.759 INFO:teuthology.orchestra.run.smithi087.stdout:osd.1 smithi090 running (8m) 52s ago 8m 52.7M 4272M 19.0.0-3538-gbee299f4 352576a2df49 1e0283141b4e 2024-05-08T05:28:28.759 INFO:teuthology.orchestra.run.smithi087.stdout:osd.2 smithi160 running (8m) 52s ago 8m 53.5M 4272M 19.0.0-3538-gbee299f4 352576a2df49 2d51adbd9866 2024-05-08T05:28:28.759 INFO:teuthology.orchestra.run.smithi087.stdout:osd.3 smithi087 running (7m) 43s ago 7m 46.7M 4272M 19.0.0-3538-gbee299f4 352576a2df49 7ab6c382333b 2024-05-08T05:28:28.759 INFO:teuthology.orchestra.run.smithi087.stdout:osd.4 smithi090 running (7m) 52s ago 7m 57.6M 4272M 19.0.0-3538-gbee299f4 352576a2df49 35582fe80c2c 2024-05-08T05:28:28.759 INFO:teuthology.orchestra.run.smithi087.stdout:osd.5 smithi160 running (7m) 52s ago 7m 47.7M 4272M 19.0.0-3538-gbee299f4 352576a2df49 6ba6725224e9 2024-05-08T05:28:28.759 INFO:teuthology.orchestra.run.smithi087.stdout:osd.6 smithi087 running (6m) 43s ago 6m 53.2M 4272M 19.0.0-3538-gbee299f4 352576a2df49 352140cdcac6 2024-05-08T05:28:28.759 INFO:teuthology.orchestra.run.smithi087.stdout:osd.7 smithi090 running (6m) 52s ago 6m 56.0M 4272M 19.0.0-3538-gbee299f4 352576a2df49 0fca968170c4 2024-05-08T05:28:28.759 INFO:teuthology.orchestra.run.smithi087.stdout:osd.8 smithi160 running (5m) 52s ago 5m 47.9M 4272M 19.0.0-3538-gbee299f4 352576a2df49 34b574c6dd3d 2024-05-08T05:28:28.759 INFO:teuthology.orchestra.run.smithi087.stdout:osd.9 smithi087 running (5m) 43s ago 5m 52.0M 4272M 19.0.0-3538-gbee299f4 352576a2df49 8d848a9644a9 2024-05-08T05:28:28.759 INFO:teuthology.orchestra.run.smithi087.stdout:osd.10 smithi090 running (4m) 52s ago 4m 55.0M 4272M 19.0.0-3538-gbee299f4 352576a2df49 057a4c6a287c 2024-05-08T05:28:28.759 INFO:teuthology.orchestra.run.smithi087.stdout:osd.11 smithi160 running (4m) 52s ago 4m 45.2M 4272M 19.0.0-3538-gbee299f4 352576a2df49 b35307ac1264 2024-05-08T05:28:28.760 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:28.759+0000 7f1cc2800700 1 -- 172.21.15.87:0/1216555196 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f1ca00b2880 msgr2=0x7f1ca00b4d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:28:28.760 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:28.760+0000 7f1cc2800700 1 --2- 172.21.15.87:0/1216555196 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f1ca00b2880 0x7f1ca00b4d40 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f1ca8009680 tx=0x7f1ca8009260 comp rx=0 tx=0).stop 2024-05-08T05:28:28.761 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:28.760+0000 7f1cc2800700 1 -- 172.21.15.87:0/1216555196 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1cbc103500 msgr2=0x7f1cbc19b920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:28:28.761 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:28.760+0000 7f1cc2800700 1 --2- 172.21.15.87:0/1216555196 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1cbc103500 0x7f1cbc19b920 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f1cac009230 tx=0x7f1cac005270 comp rx=0 tx=0).stop 2024-05-08T05:28:28.761 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:28.760+0000 7f1cc2800700 1 -- 172.21.15.87:0/1216555196 shutdown_connections 2024-05-08T05:28:28.761 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:28.760+0000 7f1cc2800700 1 --2- 172.21.15.87:0/1216555196 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1cbc1050a0 0x7f1cbc1a2ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:28:28.761 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:28.760+0000 7f1cc2800700 1 --2- 172.21.15.87:0/1216555196 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f1ca00b2880 0x7f1ca00b4d40 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:28:28.761 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:28.760+0000 7f1cc2800700 1 --2- 172.21.15.87:0/1216555196 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1cbc103500 0x7f1cbc19b920 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:28:28.761 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:28.760+0000 7f1cc2800700 1 --2- 172.21.15.87:0/1216555196 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1cbc104700 0x7f1cbc19be60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:28:28.761 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:28.760+0000 7f1cc2800700 1 -- 172.21.15.87:0/1216555196 >> 172.21.15.87:0/1216555196 conn(0x7f1cbc0feaa0 msgr2=0x7f1cbc109ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:28:28.761 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:28.760+0000 7f1cc2800700 1 -- 172.21.15.87:0/1216555196 shutdown_connections 2024-05-08T05:28:28.761 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:28.761+0000 7f1cc2800700 1 -- 172.21.15.87:0/1216555196 wait complete. 2024-05-08T05:28:29.730 DEBUG:teuthology.orchestra.run.smithi087:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid eeeb813e-0cf9-11ef-bc97-c7b262605968 -- bash -c 'ceph orch ls' 2024-05-08T05:28:30.167 INFO:teuthology.orchestra.run.smithi087.stderr:Inferring config /var/lib/ceph/eeeb813e-0cf9-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T05:28:30.289 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:28:30 smithi160 ceph-mon[34827]: from='client.24901 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-05-08T05:28:30.289 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:28:30 smithi160 ceph-mon[34827]: pgmap v405: 97 pgs: 97 active+clean; 644 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-05-08T05:28:30.318 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:28:30 smithi087 ceph-mon[29523]: from='client.24901 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-05-08T05:28:30.318 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:28:30 smithi087 ceph-mon[29523]: pgmap v405: 97 pgs: 97 active+clean; 644 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-05-08T05:28:30.483 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:28:30 smithi090 ceph-mon[34526]: from='client.24901 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-05-08T05:28:30.483 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:28:30 smithi090 ceph-mon[34526]: pgmap v405: 97 pgs: 97 active+clean; 644 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-05-08T05:28:32.171 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:32.170+0000 7f9997e00700 1 -- 172.21.15.87:0/233144624 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9998106840 msgr2=0x7f9998106ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:28:32.172 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:32.170+0000 7f9997e00700 1 --2- 172.21.15.87:0/233144624 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9998106840 0x7f9998106ca0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f99840099c0 tx=0x7f9984009cd0 comp rx=0 tx=0).stop 2024-05-08T05:28:32.172 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:32.170+0000 7f9997e00700 1 -- 172.21.15.87:0/233144624 shutdown_connections 2024-05-08T05:28:32.172 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:32.170+0000 7f9997e00700 1 --2- 172.21.15.87:0/233144624 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f99981071e0 0x7f999810da90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:28:32.172 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:32.170+0000 7f9997e00700 1 --2- 172.21.15.87:0/233144624 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f9998105640 0x7f9998105a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:28:32.172 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:32.170+0000 7f9997e00700 1 --2- 172.21.15.87:0/233144624 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9998106840 0x7f9998106ca0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:28:32.172 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:32.170+0000 7f9997e00700 1 -- 172.21.15.87:0/233144624 >> 172.21.15.87:0/233144624 conn(0x7f9998100be0 msgr2=0x7f9998103020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:28:32.172 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:32.170+0000 7f9997e00700 1 -- 172.21.15.87:0/233144624 shutdown_connections 2024-05-08T05:28:32.172 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:32.170+0000 7f9997e00700 1 -- 172.21.15.87:0/233144624 wait complete. 2024-05-08T05:28:32.172 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:32.171+0000 7f9997e00700 1 Processor -- start 2024-05-08T05:28:32.173 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:32.171+0000 7f9997e00700 1 -- start start 2024-05-08T05:28:32.174 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:32.172+0000 7f9997e00700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f9998105640 0x7f999819b790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:28:32.174 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:32.172+0000 7f9997e00700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9998106840 0x7f999819bcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:28:32.175 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:32.172+0000 7f9997e00700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f99981071e0 0x7f99981a2d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:28:32.175 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:32.172+0000 7f9997e00700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f9998111110 con 0x7f9998106840 2024-05-08T05:28:32.175 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:32.172+0000 7f9997e00700 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f9998110f90 con 0x7f99981071e0 2024-05-08T05:28:32.175 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:32.172+0000 7f9997e00700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f9998111290 con 0x7f9998105640 2024-05-08T05:28:32.175 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:32.172+0000 7f9996000700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9998106840 0x7f999819bcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:28:32.175 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:32.172+0000 7f9996000700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9998106840 0x7f999819bcd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:34390/0 (socket says 172.21.15.87:34390) 2024-05-08T05:28:32.175 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:32.172+0000 7f9996a00700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f9998105640 0x7f999819b790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:28:32.175 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:32.172+0000 7f9996000700 1 -- 172.21.15.87:0/2484821916 learned_addr learned my addr 172.21.15.87:0/2484821916 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T05:28:32.175 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:32.172+0000 7f9997400700 1 --2- 172.21.15.87:0/2484821916 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f99981071e0 0x7f99981a2d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:28:32.175 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:32.172+0000 7f9996000700 1 -- 172.21.15.87:0/2484821916 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f9998105640 msgr2=0x7f999819b790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:28:32.175 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:32.172+0000 7f9996000700 1 --2- 172.21.15.87:0/2484821916 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f9998105640 0x7f999819b790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:28:32.175 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:32.172+0000 7f9996000700 1 -- 172.21.15.87:0/2484821916 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f99981071e0 msgr2=0x7f99981a2d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:28:32.175 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:32.172+0000 7f9996000700 1 --2- 172.21.15.87:0/2484821916 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f99981071e0 0x7f99981a2d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:28:32.176 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:32.172+0000 7f9996000700 1 -- 172.21.15.87:0/2484821916 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f99981a33f0 con 0x7f9998106840 2024-05-08T05:28:32.176 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:32.172+0000 7f9996a00700 1 --2- 172.21.15.87:0/2484821916 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f9998105640 0x7f999819b790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T05:28:32.176 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:32.173+0000 7f9996000700 1 --2- 172.21.15.87:0/2484821916 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9998106840 0x7f999819bcd0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f9984005910 tx=0x7f9984003e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:28:32.176 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:32.173+0000 7f998f400700 1 -- 172.21.15.87:0/2484821916 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9984009e60 con 0x7f9998106840 2024-05-08T05:28:32.176 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:32.173+0000 7f998f400700 1 -- 172.21.15.87:0/2484821916 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f998400be50 con 0x7f9998106840 2024-05-08T05:28:32.176 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:32.173+0000 7f998f400700 1 -- 172.21.15.87:0/2484821916 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f998400fd90 con 0x7f9998106840 2024-05-08T05:28:32.176 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:32.173+0000 7f9997e00700 1 -- 172.21.15.87:0/2484821916 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f99981a3680 con 0x7f9998106840 2024-05-08T05:28:32.176 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:32.173+0000 7f9997e00700 1 -- 172.21.15.87:0/2484821916 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f99981a3a80 con 0x7f9998106840 2024-05-08T05:28:32.176 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:32.174+0000 7f9997e00700 1 -- 172.21.15.87:0/2484821916 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f999806a190 con 0x7f9998106840 2024-05-08T05:28:32.177 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:32.177+0000 7f998f400700 1 -- 172.21.15.87:0/2484821916 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7f998400f4f0 con 0x7f9998106840 2024-05-08T05:28:32.179 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:32.179+0000 7f998f400700 1 --2- 172.21.15.87:0/2484821916 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f997c0b2900 0x7f997c0b4dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:28:32.180 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:32.179+0000 7f998f400700 1 -- 172.21.15.87:0/2484821916 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8190+0+0 (secure 0 0 0) 0x7f99840e3020 con 0x7f9998106840 2024-05-08T05:28:32.180 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:32.180+0000 7f9996a00700 1 --2- 172.21.15.87:0/2484821916 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f997c0b2900 0x7f997c0b4dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:28:32.180 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:32.180+0000 7f9996a00700 1 --2- 172.21.15.87:0/2484821916 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f997c0b2900 0x7f997c0b4dc0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f99981066a0 tx=0x7f9988009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:28:32.182 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:32.182+0000 7f998f400700 1 -- 172.21.15.87:0/2484821916 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f9984013070 con 0x7f9998106840 2024-05-08T05:28:32.288 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:28:32 smithi160 ceph-mon[34827]: pgmap v406: 97 pgs: 97 active+clean; 644 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T05:28:32.424 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:32.424+0000 7f9997e00700 1 -- 172.21.15.87:0/2484821916 --> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] -- mgr_command(tid 0: {"prefix": "orch ls", "target": ["mon-mgr", ""]}) -- 0x7f99980638e0 con 0x7f997c0b2900 2024-05-08T05:28:32.425 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:28:32 smithi087 ceph-mon[29523]: pgmap v406: 97 pgs: 97 active+clean; 644 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T05:28:32.441 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:32.440+0000 7f998f400700 1 -- 172.21.15.87:0/2484821916 <== mgr.14152 v2:172.21.15.87:6800/1189186457 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+980 (secure 0 0 0) 0x7f99980638e0 con 0x7f997c0b2900 2024-05-08T05:28:32.441 INFO:teuthology.orchestra.run.smithi087.stdout:NAME PORTS RUNNING REFRESHED AGE PLACEMENT 2024-05-08T05:28:32.441 INFO:teuthology.orchestra.run.smithi087.stdout:mds.all 12/12 56s ago 3m smithi087=a;smithi087=d;smithi087=g;smithi087=j;smithi090=b;smithi090=e;smithi090=h;smithi090=k;smithi160=c;smithi160=f;smithi160=i;smithi160=l;count:12 2024-05-08T05:28:32.441 INFO:teuthology.orchestra.run.smithi087.stdout:mgr 3/3 56s ago 9m smithi087=x;smithi090=y;smithi160=z;count:3 2024-05-08T05:28:32.441 INFO:teuthology.orchestra.run.smithi087.stdout:mon 3/3 56s ago 10m smithi087:172.21.15.87=a;smithi090:172.21.15.90=b;smithi160:172.21.15.160=c;count:3 2024-05-08T05:28:32.441 INFO:teuthology.orchestra.run.smithi087.stdout:osd 12 56s ago - 2024-05-08T05:28:32.444 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:32.443+0000 7f9997e00700 1 -- 172.21.15.87:0/2484821916 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f997c0b2900 msgr2=0x7f997c0b4dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:28:32.444 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:32.443+0000 7f9997e00700 1 --2- 172.21.15.87:0/2484821916 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f997c0b2900 0x7f997c0b4dc0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f99981066a0 tx=0x7f9988009260 comp rx=0 tx=0).stop 2024-05-08T05:28:32.444 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:32.443+0000 7f9997e00700 1 -- 172.21.15.87:0/2484821916 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9998106840 msgr2=0x7f999819bcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:28:32.444 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:32.443+0000 7f9997e00700 1 --2- 172.21.15.87:0/2484821916 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9998106840 0x7f999819bcd0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f9984005910 tx=0x7f9984003e60 comp rx=0 tx=0).stop 2024-05-08T05:28:32.444 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:32.444+0000 7f9997e00700 1 -- 172.21.15.87:0/2484821916 shutdown_connections 2024-05-08T05:28:32.445 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:32.444+0000 7f9997e00700 1 --2- 172.21.15.87:0/2484821916 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f99981071e0 0x7f99981a2d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:28:32.445 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:32.444+0000 7f9997e00700 1 --2- 172.21.15.87:0/2484821916 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f997c0b2900 0x7f997c0b4dc0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:28:32.445 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:32.444+0000 7f9997e00700 1 --2- 172.21.15.87:0/2484821916 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f9998105640 0x7f999819b790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:28:32.445 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:32.444+0000 7f9997e00700 1 --2- 172.21.15.87:0/2484821916 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9998106840 0x7f999819bcd0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:28:32.445 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:32.444+0000 7f9997e00700 1 -- 172.21.15.87:0/2484821916 >> 172.21.15.87:0/2484821916 conn(0x7f9998100be0 msgr2=0x7f9998109bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:28:32.445 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:32.444+0000 7f9997e00700 1 -- 172.21.15.87:0/2484821916 shutdown_connections 2024-05-08T05:28:32.445 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:32.444+0000 7f9997e00700 1 -- 172.21.15.87:0/2484821916 wait complete. 2024-05-08T05:28:32.483 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:28:32 smithi090 ceph-mon[34526]: pgmap v406: 97 pgs: 97 active+clean; 644 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T05:28:33.308 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:28:33 smithi087 ceph-mon[29523]: from='client.14805 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-05-08T05:28:33.312 DEBUG:teuthology.orchestra.run.smithi087:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid eeeb813e-0cf9-11ef-bc97-c7b262605968 -- bash -c 'ceph orch host ls' 2024-05-08T05:28:33.483 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:28:33 smithi090 ceph-mon[34526]: from='client.14805 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-05-08T05:28:33.538 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:28:33 smithi160 ceph-mon[34827]: from='client.14805 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-05-08T05:28:33.771 INFO:teuthology.orchestra.run.smithi087.stderr:Inferring config /var/lib/ceph/eeeb813e-0cf9-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T05:28:34.193 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:28:34 smithi087 ceph-mon[29523]: pgmap v407: 97 pgs: 97 active+clean; 644 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-05-08T05:28:34.483 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:28:34 smithi090 ceph-mon[34526]: pgmap v407: 97 pgs: 97 active+clean; 644 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-05-08T05:28:34.538 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:28:34 smithi160 ceph-mon[34827]: pgmap v407: 97 pgs: 97 active+clean; 644 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-05-08T05:28:35.855 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:35.854+0000 7efe36000700 1 -- 172.21.15.87:0/186998071 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7efe3010ad40 msgr2=0x7efe3010b1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:28:35.855 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:35.854+0000 7efe36000700 1 --2- 172.21.15.87:0/186998071 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7efe3010ad40 0x7efe3010b1a0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7efe180099c0 tx=0x7efe18009cd0 comp rx=0 tx=0).stop 2024-05-08T05:28:35.856 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:35.854+0000 7efe36000700 1 -- 172.21.15.87:0/186998071 shutdown_connections 2024-05-08T05:28:35.856 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:35.854+0000 7efe36000700 1 --2- 172.21.15.87:0/186998071 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7efe3010b6e0 0x7efe30111f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:28:35.856 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:35.854+0000 7efe36000700 1 --2- 172.21.15.87:0/186998071 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7efe30109b40 0x7efe30109f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:28:35.856 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:35.854+0000 7efe36000700 1 --2- 172.21.15.87:0/186998071 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7efe3010ad40 0x7efe3010b1a0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:28:35.856 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:35.854+0000 7efe36000700 1 -- 172.21.15.87:0/186998071 >> 172.21.15.87:0/186998071 conn(0x7efe30078b10 msgr2=0x7efe3007af50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:28:35.856 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:35.855+0000 7efe36000700 1 -- 172.21.15.87:0/186998071 shutdown_connections 2024-05-08T05:28:35.856 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:35.855+0000 7efe36000700 1 -- 172.21.15.87:0/186998071 wait complete. 2024-05-08T05:28:35.858 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:35.856+0000 7efe36000700 1 Processor -- start 2024-05-08T05:28:35.858 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:35.856+0000 7efe36000700 1 -- start start 2024-05-08T05:28:35.858 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:35.856+0000 7efe36000700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7efe30109b40 0x7efe3019fc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:28:35.858 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:35.856+0000 7efe36000700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7efe3010ad40 0x7efe301a0170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:28:35.859 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:35.856+0000 7efe36000700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7efe3010b6e0 0x7efe301a71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:28:35.859 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:35.856+0000 7efe36000700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7efe30115630 con 0x7efe3010ad40 2024-05-08T05:28:35.859 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:35.856+0000 7efe36000700 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7efe301154b0 con 0x7efe30109b40 2024-05-08T05:28:35.859 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:35.856+0000 7efe36000700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7efe301157b0 con 0x7efe3010b6e0 2024-05-08T05:28:35.859 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:35.856+0000 7efe27e00700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7efe3010ad40 0x7efe301a0170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:28:35.859 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:35.856+0000 7efe27e00700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7efe3010ad40 0x7efe301a0170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:39424/0 (socket says 172.21.15.87:39424) 2024-05-08T05:28:35.859 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:35.856+0000 7efe27e00700 1 -- 172.21.15.87:0/4149366569 learned_addr learned my addr 172.21.15.87:0/4149366569 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T05:28:35.859 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:35.856+0000 7efe2f400700 1 --2- 172.21.15.87:0/4149366569 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7efe30109b40 0x7efe3019fc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:28:35.859 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:35.857+0000 7efe2fe00700 1 --2- 172.21.15.87:0/4149366569 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7efe3010b6e0 0x7efe301a71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:28:35.859 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:35.857+0000 7efe27e00700 1 -- 172.21.15.87:0/4149366569 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7efe3010b6e0 msgr2=0x7efe301a71b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:28:35.859 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:35.857+0000 7efe27e00700 1 --2- 172.21.15.87:0/4149366569 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7efe3010b6e0 0x7efe301a71b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:28:35.859 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:35.857+0000 7efe27e00700 1 -- 172.21.15.87:0/4149366569 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7efe30109b40 msgr2=0x7efe3019fc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:28:35.859 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:35.857+0000 7efe27e00700 1 --2- 172.21.15.87:0/4149366569 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7efe30109b40 0x7efe3019fc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:28:35.860 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:35.857+0000 7efe27e00700 1 -- 172.21.15.87:0/4149366569 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efe301a7880 con 0x7efe3010ad40 2024-05-08T05:28:35.860 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:35.857+0000 7efe2f400700 1 --2- 172.21.15.87:0/4149366569 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7efe30109b40 0x7efe3019fc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T05:28:35.860 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:35.857+0000 7efe27e00700 1 --2- 172.21.15.87:0/4149366569 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7efe3010ad40 0x7efe301a0170 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7efe180036f0 tx=0x7efe18003e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:28:35.860 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:35.857+0000 7efe2cc00700 1 -- 172.21.15.87:0/4149366569 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe18009e60 con 0x7efe3010ad40 2024-05-08T05:28:35.860 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:35.858+0000 7efe2cc00700 1 -- 172.21.15.87:0/4149366569 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7efe1800be50 con 0x7efe3010ad40 2024-05-08T05:28:35.860 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:35.858+0000 7efe36000700 1 -- 172.21.15.87:0/4149366569 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efe301a7b10 con 0x7efe3010ad40 2024-05-08T05:28:35.860 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:35.858+0000 7efe2cc00700 1 -- 172.21.15.87:0/4149366569 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe1800fda0 con 0x7efe3010ad40 2024-05-08T05:28:35.860 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:35.858+0000 7efe36000700 1 -- 172.21.15.87:0/4149366569 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efe301a7fc0 con 0x7efe3010ad40 2024-05-08T05:28:35.860 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:35.859+0000 7efe36000700 1 -- 172.21.15.87:0/4149366569 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efe3006a190 con 0x7efe3010ad40 2024-05-08T05:28:35.861 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:35.861+0000 7efe2cc00700 1 -- 172.21.15.87:0/4149366569 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7efe1800f460 con 0x7efe3010ad40 2024-05-08T05:28:35.864 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:35.864+0000 7efe2cc00700 1 --2- 172.21.15.87:0/4149366569 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7efe140b2900 0x7efe140b4dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:28:35.864 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:35.864+0000 7efe2cc00700 1 -- 172.21.15.87:0/4149366569 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8190+0+0 (secure 0 0 0) 0x7efe180e3050 con 0x7efe3010ad40 2024-05-08T05:28:35.864 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:35.864+0000 7efe2f400700 1 --2- 172.21.15.87:0/4149366569 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7efe140b2900 0x7efe140b4dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:28:35.865 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:35.865+0000 7efe2f400700 1 --2- 172.21.15.87:0/4149366569 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7efe140b2900 0x7efe140b4dc0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7efe20009680 tx=0x7efe20009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:28:35.867 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:35.866+0000 7efe2cc00700 1 -- 172.21.15.87:0/4149366569 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7efe18013070 con 0x7efe3010ad40 2024-05-08T05:28:36.110 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:36.109+0000 7efe36000700 1 -- 172.21.15.87:0/4149366569 --> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""]}) -- 0x7efe300638e0 con 0x7efe140b2900 2024-05-08T05:28:36.113 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:36.113+0000 7efe2cc00700 1 -- 172.21.15.87:0/4149366569 <== mgr.14152 v2:172.21.15.87:6800/1189186457 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+191 (secure 0 0 0) 0x7efe300638e0 con 0x7efe140b2900 2024-05-08T05:28:36.113 INFO:teuthology.orchestra.run.smithi087.stdout:HOST ADDR LABELS STATUS 2024-05-08T05:28:36.113 INFO:teuthology.orchestra.run.smithi087.stdout:smithi087 172.21.15.87 2024-05-08T05:28:36.113 INFO:teuthology.orchestra.run.smithi087.stdout:smithi090 172.21.15.90 2024-05-08T05:28:36.113 INFO:teuthology.orchestra.run.smithi087.stdout:smithi160 172.21.15.160 2024-05-08T05:28:36.113 INFO:teuthology.orchestra.run.smithi087.stdout:3 hosts in cluster 2024-05-08T05:28:36.117 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:36.116+0000 7efe36000700 1 -- 172.21.15.87:0/4149366569 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7efe140b2900 msgr2=0x7efe140b4dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:28:36.117 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:36.116+0000 7efe36000700 1 --2- 172.21.15.87:0/4149366569 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7efe140b2900 0x7efe140b4dc0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7efe20009680 tx=0x7efe20009260 comp rx=0 tx=0).stop 2024-05-08T05:28:36.117 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:36.116+0000 7efe36000700 1 -- 172.21.15.87:0/4149366569 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7efe3010ad40 msgr2=0x7efe301a0170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:28:36.117 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:36.116+0000 7efe36000700 1 --2- 172.21.15.87:0/4149366569 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7efe3010ad40 0x7efe301a0170 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7efe180036f0 tx=0x7efe18003e60 comp rx=0 tx=0).stop 2024-05-08T05:28:36.117 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:36.116+0000 7efe36000700 1 -- 172.21.15.87:0/4149366569 shutdown_connections 2024-05-08T05:28:36.117 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:36.116+0000 7efe36000700 1 --2- 172.21.15.87:0/4149366569 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7efe140b2900 0x7efe140b4dc0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:28:36.118 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:36.116+0000 7efe36000700 1 --2- 172.21.15.87:0/4149366569 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7efe3010b6e0 0x7efe301a71b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:28:36.118 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:36.116+0000 7efe36000700 1 --2- 172.21.15.87:0/4149366569 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7efe30109b40 0x7efe3019fc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:28:36.118 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:36.116+0000 7efe36000700 1 --2- 172.21.15.87:0/4149366569 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7efe3010ad40 0x7efe301a0170 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:28:36.118 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:36.116+0000 7efe36000700 1 -- 172.21.15.87:0/4149366569 >> 172.21.15.87:0/4149366569 conn(0x7efe30078b10 msgr2=0x7efe3010dfe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:28:36.118 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:36.117+0000 7efe36000700 1 -- 172.21.15.87:0/4149366569 shutdown_connections 2024-05-08T05:28:36.118 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:36.117+0000 7efe36000700 1 -- 172.21.15.87:0/4149366569 wait complete. 2024-05-08T05:28:36.341 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:28:36 smithi160 ceph-mon[34827]: pgmap v408: 97 pgs: 97 active+clean; 644 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-05-08T05:28:36.458 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:28:36 smithi087 ceph-mon[29523]: pgmap v408: 97 pgs: 97 active+clean; 644 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-05-08T05:28:36.483 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:28:36 smithi090 ceph-mon[34526]: pgmap v408: 97 pgs: 97 active+clean; 644 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-05-08T05:28:36.892 DEBUG:teuthology.orchestra.run.smithi087:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid eeeb813e-0cf9-11ef-bc97-c7b262605968 -- bash -c 'ceph orch device ls' 2024-05-08T05:28:37.208 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:28:37 smithi087 ceph-mon[29523]: from='client.14811 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-05-08T05:28:37.344 INFO:teuthology.orchestra.run.smithi087.stderr:Inferring config /var/lib/ceph/eeeb813e-0cf9-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T05:28:37.483 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:28:37 smithi090 ceph-mon[34526]: from='client.14811 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-05-08T05:28:37.538 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:28:37 smithi160 ceph-mon[34827]: from='client.14811 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-05-08T05:28:38.323 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:28:38 smithi087 ceph-mon[29523]: pgmap v409: 97 pgs: 97 active+clean; 644 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T05:28:38.483 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:28:38 smithi090 ceph-mon[34526]: pgmap v409: 97 pgs: 97 active+clean; 644 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T05:28:38.539 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:28:38 smithi160 ceph-mon[34827]: pgmap v409: 97 pgs: 97 active+clean; 644 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T05:28:39.519 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:39.518+0000 7f74bd800700 1 -- 172.21.15.87:0/2724791404 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f74b8104700 msgr2=0x7f74b8104b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:28:39.519 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:39.518+0000 7f74bd800700 1 --2- 172.21.15.87:0/2724791404 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f74b8104700 0x7f74b8104b60 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f74a00099c0 tx=0x7f74a0009cd0 comp rx=0 tx=0).stop 2024-05-08T05:28:39.519 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:39.518+0000 7f74bd800700 1 -- 172.21.15.87:0/2724791404 shutdown_connections 2024-05-08T05:28:39.519 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:39.518+0000 7f74bd800700 1 --2- 172.21.15.87:0/2724791404 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f74b81050a0 0x7f74b810b950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:28:39.519 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:39.518+0000 7f74bd800700 1 --2- 172.21.15.87:0/2724791404 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f74b8103500 0x7f74b8103920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:28:39.519 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:39.518+0000 7f74bd800700 1 --2- 172.21.15.87:0/2724791404 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f74b8104700 0x7f74b8104b60 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:28:39.519 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:39.518+0000 7f74bd800700 1 -- 172.21.15.87:0/2724791404 >> 172.21.15.87:0/2724791404 conn(0x7f74b80feaa0 msgr2=0x7f74b8100ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:28:39.519 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:39.518+0000 7f74bd800700 1 -- 172.21.15.87:0/2724791404 shutdown_connections 2024-05-08T05:28:39.519 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:39.518+0000 7f74bd800700 1 -- 172.21.15.87:0/2724791404 wait complete. 2024-05-08T05:28:39.521 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:39.519+0000 7f74bd800700 1 Processor -- start 2024-05-08T05:28:39.521 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:39.519+0000 7f74bd800700 1 -- start start 2024-05-08T05:28:39.521 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:39.520+0000 7f74bd800700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f74b8103500 0x7f74b819b890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:28:39.521 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:39.520+0000 7f74bd800700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f74b8104700 0x7f74b819bdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:28:39.521 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:39.520+0000 7f74bd800700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f74b81050a0 0x7f74b81a2e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:28:39.521 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:39.520+0000 7f74bd800700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f74b810efc0 con 0x7f74b8103500 2024-05-08T05:28:39.521 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:39.520+0000 7f74bd800700 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f74b810ee40 con 0x7f74b81050a0 2024-05-08T05:28:39.521 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:39.520+0000 7f74bd800700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f74b810f140 con 0x7f74b8104700 2024-05-08T05:28:39.522 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:39.520+0000 7f74b6a00700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f74b8103500 0x7f74b819b890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:28:39.522 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:39.520+0000 7f74afe00700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f74b8104700 0x7f74b819bdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:28:39.522 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:39.520+0000 7f74b6a00700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f74b8103500 0x7f74b819b890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:39434/0 (socket says 172.21.15.87:39434) 2024-05-08T05:28:39.522 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:39.520+0000 7f74b6a00700 1 -- 172.21.15.87:0/804800798 learned_addr learned my addr 172.21.15.87:0/804800798 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T05:28:39.522 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:39.520+0000 7f74b7400700 1 --2- 172.21.15.87:0/804800798 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f74b81050a0 0x7f74b81a2e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:28:39.522 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:39.520+0000 7f74afe00700 1 -- 172.21.15.87:0/804800798 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f74b81050a0 msgr2=0x7f74b81a2e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:28:39.522 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:39.520+0000 7f74afe00700 1 --2- 172.21.15.87:0/804800798 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f74b81050a0 0x7f74b81a2e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:28:39.522 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:39.520+0000 7f74afe00700 1 -- 172.21.15.87:0/804800798 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f74b8103500 msgr2=0x7f74b819b890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:28:39.522 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:39.520+0000 7f74afe00700 1 --2- 172.21.15.87:0/804800798 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f74b8103500 0x7f74b819b890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:28:39.522 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:39.520+0000 7f74afe00700 1 -- 172.21.15.87:0/804800798 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f74b81a34f0 con 0x7f74b8104700 2024-05-08T05:28:39.522 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:39.521+0000 7f74afe00700 1 --2- 172.21.15.87:0/804800798 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f74b8104700 0x7f74b819bdd0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f74a00099c0 tx=0x7f74a0003af0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:28:39.523 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:39.521+0000 7f74af400700 1 -- 172.21.15.87:0/804800798 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74a0009e60 con 0x7f74b8104700 2024-05-08T05:28:39.523 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:39.521+0000 7f74af400700 1 -- 172.21.15.87:0/804800798 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f74a0005570 con 0x7f74b8104700 2024-05-08T05:28:39.523 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:39.521+0000 7f74bd800700 1 -- 172.21.15.87:0/804800798 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f74b81a3780 con 0x7f74b8104700 2024-05-08T05:28:39.523 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:39.521+0000 7f74af400700 1 -- 172.21.15.87:0/804800798 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74a000fda0 con 0x7f74b8104700 2024-05-08T05:28:39.523 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:39.521+0000 7f74bd800700 1 -- 172.21.15.87:0/804800798 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f74b81a3bd0 con 0x7f74b8104700 2024-05-08T05:28:39.524 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:39.522+0000 7f74bd800700 1 -- 172.21.15.87:0/804800798 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f74b806a190 con 0x7f74b8104700 2024-05-08T05:28:39.525 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:39.525+0000 7f74af400700 1 -- 172.21.15.87:0/804800798 <== mon.1 v2:172.21.15.160:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7f74a000f460 con 0x7f74b8104700 2024-05-08T05:28:39.526 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:39.526+0000 7f74af400700 1 --2- 172.21.15.87:0/804800798 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f749c0b2880 0x7f749c0b4d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:28:39.526 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:39.526+0000 7f74af400700 1 -- 172.21.15.87:0/804800798 <== mon.1 v2:172.21.15.160:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8190+0+0 (secure 0 0 0) 0x7f74a00e3050 con 0x7f74b8104700 2024-05-08T05:28:39.527 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:39.526+0000 7f74b6a00700 1 --2- 172.21.15.87:0/804800798 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f749c0b2880 0x7f749c0b4d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:28:39.527 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:39.527+0000 7f74b6a00700 1 --2- 172.21.15.87:0/804800798 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f749c0b2880 0x7f749c0b4d40 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f74a8005950 tx=0x7f74a8009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:28:39.528 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:39.528+0000 7f74af400700 1 -- 172.21.15.87:0/804800798 <== mon.1 v2:172.21.15.160:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f74a0013070 con 0x7f74b8104700 2024-05-08T05:28:39.770 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:39.770+0000 7f74bd800700 1 -- 172.21.15.87:0/804800798 --> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] -- mgr_command(tid 0: {"prefix": "orch device ls", "target": ["mon-mgr", ""]}) -- 0x7f74b810b5f0 con 0x7f749c0b2880 2024-05-08T05:28:39.776 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:39.776+0000 7f74af400700 1 -- 172.21.15.87:0/804800798 <== mgr.14152 v2:172.21.15.87:6800/1189186457 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+532 (secure 0 0 0) 0x7f74b810b5f0 con 0x7f749c0b2880 2024-05-08T05:28:39.777 INFO:teuthology.orchestra.run.smithi087.stdout:HOST PATH TYPE DEVICE ID SIZE AVAILABLE REFRESHED REJECT REASONS 2024-05-08T05:28:39.777 INFO:teuthology.orchestra.run.smithi087.stdout:smithi087 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_PHFT620400NQ400BGN 372G No 5m ago Has a FileSystem, LVM detected 2024-05-08T05:28:39.777 INFO:teuthology.orchestra.run.smithi087.stdout:smithi090 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_PHFT620400UK400BGN 372G No 4m ago Has a FileSystem, LVM detected 2024-05-08T05:28:39.777 INFO:teuthology.orchestra.run.smithi087.stdout:smithi160 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_CVFT623300JY400BGN 372G No 4m ago Has a FileSystem, LVM detected 2024-05-08T05:28:39.780 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:39.780+0000 7f74bd800700 1 -- 172.21.15.87:0/804800798 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f749c0b2880 msgr2=0x7f749c0b4d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:28:39.780 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:39.780+0000 7f74bd800700 1 --2- 172.21.15.87:0/804800798 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f749c0b2880 0x7f749c0b4d40 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f74a8005950 tx=0x7f74a8009260 comp rx=0 tx=0).stop 2024-05-08T05:28:39.780 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:39.780+0000 7f74bd800700 1 -- 172.21.15.87:0/804800798 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f74b8104700 msgr2=0x7f74b819bdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:28:39.780 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:39.780+0000 7f74bd800700 1 --2- 172.21.15.87:0/804800798 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f74b8104700 0x7f74b819bdd0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f74a00099c0 tx=0x7f74a0003af0 comp rx=0 tx=0).stop 2024-05-08T05:28:39.781 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:39.780+0000 7f74bd800700 1 -- 172.21.15.87:0/804800798 shutdown_connections 2024-05-08T05:28:39.781 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:39.780+0000 7f74bd800700 1 --2- 172.21.15.87:0/804800798 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f74b81050a0 0x7f74b81a2e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:28:39.781 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:39.780+0000 7f74bd800700 1 --2- 172.21.15.87:0/804800798 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f74b8103500 0x7f74b819b890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:28:39.781 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:39.780+0000 7f74bd800700 1 --2- 172.21.15.87:0/804800798 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f749c0b2880 0x7f749c0b4d40 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:28:39.781 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:39.780+0000 7f74bd800700 1 --2- 172.21.15.87:0/804800798 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f74b8104700 0x7f74b819bdd0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:28:39.781 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:39.780+0000 7f74bd800700 1 -- 172.21.15.87:0/804800798 >> 172.21.15.87:0/804800798 conn(0x7f74b80feaa0 msgr2=0x7f74b8109ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:28:39.781 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:39.780+0000 7f74bd800700 1 -- 172.21.15.87:0/804800798 shutdown_connections 2024-05-08T05:28:39.781 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:39.780+0000 7f74bd800700 1 -- 172.21.15.87:0/804800798 wait complete. 2024-05-08T05:28:40.458 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:28:40 smithi087 ceph-mon[29523]: pgmap v410: 97 pgs: 97 active+clean; 644 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-05-08T05:28:40.483 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:28:40 smithi090 ceph-mon[34526]: pgmap v410: 97 pgs: 97 active+clean; 644 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-05-08T05:28:40.539 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:28:40 smithi160 ceph-mon[34827]: pgmap v410: 97 pgs: 97 active+clean; 644 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-05-08T05:28:40.580 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-05-08T05:28:40.590 INFO:tasks.cephadm:Running commands on role mon.a host ubuntu@smithi087.front.sepia.ceph.com 2024-05-08T05:28:40.590 DEBUG:teuthology.orchestra.run.smithi087:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid eeeb813e-0cf9-11ef-bc97-c7b262605968 -- bash -c 'ceph fs dump' 2024-05-08T05:28:41.025 INFO:teuthology.orchestra.run.smithi087.stderr:Inferring config /var/lib/ceph/eeeb813e-0cf9-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T05:28:41.337 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:28:41 smithi087 ceph-mon[29523]: from='client.24919 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-05-08T05:28:41.483 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:28:41 smithi090 ceph-mon[34526]: from='client.24919 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-05-08T05:28:41.538 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:28:41 smithi160 ceph-mon[34827]: from='client.24919 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-05-08T05:28:42.210 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:28:42 smithi087 ceph-mon[29523]: pgmap v411: 97 pgs: 97 active+clean; 644 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T05:28:42.483 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:28:42 smithi090 ceph-mon[34526]: pgmap v411: 97 pgs: 97 active+clean; 644 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T05:28:42.538 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:28:42 smithi160 ceph-mon[34827]: pgmap v411: 97 pgs: 97 active+clean; 644 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T05:28:43.007 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:43.006+0000 7f87d8000700 1 -- 172.21.15.87:0/2810941011 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f87d0075ea0 msgr2=0x7f87d0076320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:28:43.007 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:43.006+0000 7f87d8000700 1 --2- 172.21.15.87:0/2810941011 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f87d0075ea0 0x7f87d0076320 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f87bc009990 tx=0x7f87bc009ca0 comp rx=0 tx=0).stop 2024-05-08T05:28:43.007 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:43.006+0000 7f87d8000700 1 -- 172.21.15.87:0/2810941011 shutdown_connections 2024-05-08T05:28:43.008 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:43.006+0000 7f87d8000700 1 --2- 172.21.15.87:0/2810941011 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f87d010b430 0x7f87d010d8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:28:43.008 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:43.006+0000 7f87d8000700 1 --2- 172.21.15.87:0/2810941011 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f87d0077470 0x7f87d00758d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:28:43.008 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:43.006+0000 7f87d8000700 1 --2- 172.21.15.87:0/2810941011 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f87d0075ea0 0x7f87d0076320 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:28:43.008 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:43.006+0000 7f87d8000700 1 -- 172.21.15.87:0/2810941011 >> 172.21.15.87:0/2810941011 conn(0x7f87d00feaf0 msgr2=0x7f87d0100f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:28:43.008 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:43.006+0000 7f87d8000700 1 -- 172.21.15.87:0/2810941011 shutdown_connections 2024-05-08T05:28:43.008 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:43.007+0000 7f87d8000700 1 -- 172.21.15.87:0/2810941011 wait complete. 2024-05-08T05:28:43.009 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:43.008+0000 7f87d8000700 1 Processor -- start 2024-05-08T05:28:43.009 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:43.008+0000 7f87d8000700 1 -- start start 2024-05-08T05:28:43.009 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:43.008+0000 7f87d8000700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f87d0075ea0 0x7f87d019b810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:28:43.009 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:43.008+0000 7f87d8000700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f87d0077470 0x7f87d019bd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:28:43.009 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:43.008+0000 7f87d8000700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f87d010b430 0x7f87d01a2dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:28:43.009 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:43.008+0000 7f87d8000700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f87d01111f0 con 0x7f87d0077470 2024-05-08T05:28:43.009 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:43.008+0000 7f87d8000700 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f87d0111070 con 0x7f87d010b430 2024-05-08T05:28:43.009 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:43.008+0000 7f87d8000700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f87d0111370 con 0x7f87d0075ea0 2024-05-08T05:28:43.009 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:43.008+0000 7f87d5600700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f87d0075ea0 0x7f87d019b810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:28:43.009 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:43.008+0000 7f87d6000700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f87d010b430 0x7f87d01a2dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:28:43.009 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:43.008+0000 7f87d4c00700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f87d0077470 0x7f87d019bd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:28:43.009 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:43.008+0000 7f87d6000700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f87d010b430 0x7f87d01a2dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.87:35540/0 (socket says 172.21.15.87:35540) 2024-05-08T05:28:43.010 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:43.008+0000 7f87d5600700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f87d0075ea0 0x7f87d019b810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.87:38288/0 (socket says 172.21.15.87:38288) 2024-05-08T05:28:43.010 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:43.008+0000 7f87d6000700 1 -- 172.21.15.87:0/933648960 learned_addr learned my addr 172.21.15.87:0/933648960 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T05:28:43.011 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:43.009+0000 7f87d6000700 1 -- 172.21.15.87:0/933648960 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f87d0075ea0 msgr2=0x7f87d019b810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:28:43.011 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:43.009+0000 7f87d6000700 1 --2- 172.21.15.87:0/933648960 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f87d0075ea0 0x7f87d019b810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:28:43.011 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:43.009+0000 7f87d6000700 1 -- 172.21.15.87:0/933648960 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f87d0077470 msgr2=0x7f87d019bd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:28:43.011 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:43.009+0000 7f87d6000700 1 --2- 172.21.15.87:0/933648960 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f87d0077470 0x7f87d019bd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:28:43.011 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:43.009+0000 7f87d6000700 1 -- 172.21.15.87:0/933648960 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f87d01a3470 con 0x7f87d010b430 2024-05-08T05:28:43.011 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:43.009+0000 7f87d6000700 1 --2- 172.21.15.87:0/933648960 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f87d010b430 0x7f87d01a2dd0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f87c800ef30 tx=0x7f87c800c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:28:43.011 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:43.009+0000 7f87ce000700 1 -- 172.21.15.87:0/933648960 <== mon.2 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87c80092e0 con 0x7f87d010b430 2024-05-08T05:28:43.011 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:43.010+0000 7f87ce000700 1 -- 172.21.15.87:0/933648960 <== mon.2 v2:172.21.15.90:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f87c8004bb0 con 0x7f87d010b430 2024-05-08T05:28:43.011 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:43.010+0000 7f87d8000700 1 -- 172.21.15.87:0/933648960 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f87d01a3700 con 0x7f87d010b430 2024-05-08T05:28:43.011 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:43.010+0000 7f87ce000700 1 -- 172.21.15.87:0/933648960 <== mon.2 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87c8004020 con 0x7f87d010b430 2024-05-08T05:28:43.011 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:43.010+0000 7f87d8000700 1 -- 172.21.15.87:0/933648960 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f87d01a3c40 con 0x7f87d010b430 2024-05-08T05:28:43.012 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:43.011+0000 7f87d8000700 1 -- 172.21.15.87:0/933648960 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f87d006a190 con 0x7f87d010b430 2024-05-08T05:28:43.013 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:43.013+0000 7f87ce000700 1 -- 172.21.15.87:0/933648960 <== mon.2 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7f87c801b030 con 0x7f87d010b430 2024-05-08T05:28:43.014 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:43.014+0000 7f87ce000700 1 --2- 172.21.15.87:0/933648960 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f87b80b2880 0x7f87b80b4d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:28:43.015 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:43.015+0000 7f87ce000700 1 -- 172.21.15.87:0/933648960 <== mon.2 v2:172.21.15.90:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8190+0+0 (secure 0 0 0) 0x7f87c80e2620 con 0x7f87d010b430 2024-05-08T05:28:43.015 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:43.015+0000 7f87d5600700 1 --2- 172.21.15.87:0/933648960 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f87b80b2880 0x7f87b80b4d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:28:43.015 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:43.015+0000 7f87d5600700 1 --2- 172.21.15.87:0/933648960 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f87b80b2880 0x7f87b80b4d40 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f87c4009c60 tx=0x7f87c4009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:28:43.017 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:43.017+0000 7f87ce000700 1 -- 172.21.15.87:0/933648960 <== mon.2 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f87c8022020 con 0x7f87d010b430 2024-05-08T05:28:43.297 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:43.296+0000 7f87d8000700 1 -- 172.21.15.87:0/933648960 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "fs dump"} v 0) -- 0x7f87d00640b0 con 0x7f87d010b430 2024-05-08T05:28:43.297 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:43.297+0000 7f87ce000700 1 -- 172.21.15.87:0/933648960 <== mon.2 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 24 v24) ==== 76+0+3042 (secure 0 0 0) 0x7f87c8010040 con 0x7f87d010b430 2024-05-08T05:28:43.299 INFO:teuthology.orchestra.run.smithi087.stdout:e24 2024-05-08T05:28:43.299 INFO:teuthology.orchestra.run.smithi087.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-05-08T05:28:43.299 INFO:teuthology.orchestra.run.smithi087.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-05-08T05:28:43.299 INFO:teuthology.orchestra.run.smithi087.stdout:legacy client fscid: 1 2024-05-08T05:28:43.299 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-05-08T05:28:43.299 INFO:teuthology.orchestra.run.smithi087.stdout:Filesystem 'cephfs' (1) 2024-05-08T05:28:43.299 INFO:teuthology.orchestra.run.smithi087.stdout:fs_name cephfs 2024-05-08T05:28:43.299 INFO:teuthology.orchestra.run.smithi087.stdout:epoch 24 2024-05-08T05:28:43.299 INFO:teuthology.orchestra.run.smithi087.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-05-08T05:28:43.299 INFO:teuthology.orchestra.run.smithi087.stdout:created 2024-05-08T05:25:36.816840+0000 2024-05-08T05:28:43.299 INFO:teuthology.orchestra.run.smithi087.stdout:modified 2024-05-08T05:25:59.331243+0000 2024-05-08T05:28:43.300 INFO:teuthology.orchestra.run.smithi087.stdout:tableserver 0 2024-05-08T05:28:43.300 INFO:teuthology.orchestra.run.smithi087.stdout:root 0 2024-05-08T05:28:43.300 INFO:teuthology.orchestra.run.smithi087.stdout:session_timeout 300 2024-05-08T05:28:43.300 INFO:teuthology.orchestra.run.smithi087.stdout:session_autoclose 300 2024-05-08T05:28:43.300 INFO:teuthology.orchestra.run.smithi087.stdout:max_file_size 1099511627776 2024-05-08T05:28:43.300 INFO:teuthology.orchestra.run.smithi087.stdout:max_xattr_size 65536 2024-05-08T05:28:43.300 INFO:teuthology.orchestra.run.smithi087.stdout:required_client_features {} 2024-05-08T05:28:43.300 INFO:teuthology.orchestra.run.smithi087.stdout:last_failure 0 2024-05-08T05:28:43.300 INFO:teuthology.orchestra.run.smithi087.stdout:last_failure_osd_epoch 0 2024-05-08T05:28:43.300 INFO:teuthology.orchestra.run.smithi087.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-05-08T05:28:43.300 INFO:teuthology.orchestra.run.smithi087.stdout:max_mds 3 2024-05-08T05:28:43.300 INFO:teuthology.orchestra.run.smithi087.stdout:in 0,1,2 2024-05-08T05:28:43.301 INFO:teuthology.orchestra.run.smithi087.stdout:up {0=24500,1=24482,2=24481} 2024-05-08T05:28:43.301 INFO:teuthology.orchestra.run.smithi087.stdout:failed 2024-05-08T05:28:43.301 INFO:teuthology.orchestra.run.smithi087.stdout:damaged 2024-05-08T05:28:43.301 INFO:teuthology.orchestra.run.smithi087.stdout:stopped 2024-05-08T05:28:43.301 INFO:teuthology.orchestra.run.smithi087.stdout:data_pools [3] 2024-05-08T05:28:43.301 INFO:teuthology.orchestra.run.smithi087.stdout:metadata_pool 2 2024-05-08T05:28:43.301 INFO:teuthology.orchestra.run.smithi087.stdout:inline_data disabled 2024-05-08T05:28:43.301 INFO:teuthology.orchestra.run.smithi087.stdout:balancer 2024-05-08T05:28:43.301 INFO:teuthology.orchestra.run.smithi087.stdout:bal_rank_mask -1 2024-05-08T05:28:43.301 INFO:teuthology.orchestra.run.smithi087.stdout:standby_count_wanted 0 2024-05-08T05:28:43.301 INFO:teuthology.orchestra.run.smithi087.stdout:qdb_cluster leader: 24500 members: 24482,24500,24481 2024-05-08T05:28:43.301 INFO:teuthology.orchestra.run.smithi087.stdout:[mds.b{0:24500} state up:active seq 6 addr [v2:172.21.15.90:6838/160586017,v1:172.21.15.90:6839/160586017] compat {c=[1],r=[1],i=[1fff]}] 2024-05-08T05:28:43.301 INFO:teuthology.orchestra.run.smithi087.stdout:[mds.c{0:24469} state up:standby-replay seq 1 addr [v2:172.21.15.160:6836/4200018040,v1:172.21.15.160:6837/4200018040] compat {c=[1],r=[1],i=[1fff]}] 2024-05-08T05:28:43.301 INFO:teuthology.orchestra.run.smithi087.stdout:[mds.g{1:24482} state up:active seq 12 addr [v2:172.21.15.87:6838/2127215876,v1:172.21.15.87:6839/2127215876] compat {c=[1],r=[1],i=[1fff]}] 2024-05-08T05:28:43.301 INFO:teuthology.orchestra.run.smithi087.stdout:[mds.h{1:24467} state up:standby-replay seq 1 addr [v2:172.21.15.90:6836/4221919418,v1:172.21.15.90:6837/4221919418] compat {c=[1],r=[1],i=[1fff]}] 2024-05-08T05:28:43.302 INFO:teuthology.orchestra.run.smithi087.stdout:[mds.i{2:24481} state up:active seq 13 addr [v2:172.21.15.160:6838/234657686,v1:172.21.15.160:6839/234657686] compat {c=[1],r=[1],i=[1fff]}] 2024-05-08T05:28:43.302 INFO:teuthology.orchestra.run.smithi087.stdout:[mds.f{2:24463} state up:standby-replay seq 1 addr [v2:172.21.15.160:6834/409648357,v1:172.21.15.160:6835/409648357] compat {c=[1],r=[1],i=[1fff]}] 2024-05-08T05:28:43.302 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-05-08T05:28:43.302 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-05-08T05:28:43.302 INFO:teuthology.orchestra.run.smithi087.stdout:Standby daemons: 2024-05-08T05:28:43.302 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-05-08T05:28:43.302 INFO:teuthology.orchestra.run.smithi087.stdout:[mds.j{-1:14358} state up:standby seq 1 addr [v2:172.21.15.87:6834/1183985321,v1:172.21.15.87:6835/1183985321] compat {c=[1],r=[1],i=[1fff]}] 2024-05-08T05:28:43.302 INFO:teuthology.orchestra.run.smithi087.stdout:[mds.d{-1:14370} state up:standby seq 1 addr [v2:172.21.15.87:6836/1485824316,v1:172.21.15.87:6837/1485824316] compat {c=[1],r=[1],i=[1fff]}] 2024-05-08T05:28:43.302 INFO:teuthology.orchestra.run.smithi087.stdout:[mds.a{-1:14409} state up:standby seq 1 addr [v2:172.21.15.87:6840/724277538,v1:172.21.15.87:6841/724277538] compat {c=[1],r=[1],i=[1fff]}] 2024-05-08T05:28:43.302 INFO:teuthology.orchestra.run.smithi087.stdout:[mds.l{-1:24412} state up:standby seq 1 addr [v2:172.21.15.160:6832/3339455985,v1:172.21.15.160:6833/3339455985] compat {c=[1],r=[1],i=[1fff]}] 2024-05-08T05:28:43.302 INFO:teuthology.orchestra.run.smithi087.stdout:[mds.k{-1:24413} state up:standby seq 1 addr [v2:172.21.15.90:6832/3292166873,v1:172.21.15.90:6833/3292166873] compat {c=[1],r=[1],i=[1fff]}] 2024-05-08T05:28:43.302 INFO:teuthology.orchestra.run.smithi087.stdout:[mds.e{-1:24443} state up:standby seq 1 addr [v2:172.21.15.90:6834/824555459,v1:172.21.15.90:6835/824555459] compat {c=[1],r=[1],i=[1fff]}] 2024-05-08T05:28:43.303 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:43.300+0000 7f87d8000700 1 -- 172.21.15.87:0/933648960 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f87b80b2880 msgr2=0x7f87b80b4d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:28:43.303 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:43.300+0000 7f87d8000700 1 --2- 172.21.15.87:0/933648960 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f87b80b2880 0x7f87b80b4d40 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f87c4009c60 tx=0x7f87c4009260 comp rx=0 tx=0).stop 2024-05-08T05:28:43.303 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:43.300+0000 7f87d8000700 1 -- 172.21.15.87:0/933648960 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f87d010b430 msgr2=0x7f87d01a2dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:28:43.303 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:43.300+0000 7f87d8000700 1 --2- 172.21.15.87:0/933648960 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f87d010b430 0x7f87d01a2dd0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f87c800ef30 tx=0x7f87c800c3a0 comp rx=0 tx=0).stop 2024-05-08T05:28:43.303 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:43.300+0000 7f87d8000700 1 -- 172.21.15.87:0/933648960 shutdown_connections 2024-05-08T05:28:43.303 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:43.300+0000 7f87d8000700 1 --2- 172.21.15.87:0/933648960 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f87d010b430 0x7f87d01a2dd0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:28:43.303 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:43.300+0000 7f87d8000700 1 --2- 172.21.15.87:0/933648960 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f87b80b2880 0x7f87b80b4d40 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:28:43.304 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:43.300+0000 7f87d8000700 1 --2- 172.21.15.87:0/933648960 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f87d0075ea0 0x7f87d019b810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:28:43.304 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:43.300+0000 7f87d8000700 1 --2- 172.21.15.87:0/933648960 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f87d0077470 0x7f87d019bd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:28:43.304 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:43.300+0000 7f87d8000700 1 -- 172.21.15.87:0/933648960 >> 172.21.15.87:0/933648960 conn(0x7f87d00feaf0 msgr2=0x7f87d0107380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:28:43.304 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:43.300+0000 7f87d8000700 1 -- 172.21.15.87:0/933648960 shutdown_connections 2024-05-08T05:28:43.304 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:43.301+0000 7f87d8000700 1 -- 172.21.15.87:0/933648960 wait complete. 2024-05-08T05:28:43.304 INFO:teuthology.orchestra.run.smithi087.stderr:dumped fsmap epoch 24 2024-05-08T05:28:44.084 DEBUG:teuthology.orchestra.run.smithi087:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid eeeb813e-0cf9-11ef-bc97-c7b262605968 -- bash -c 'ceph osd dump' 2024-05-08T05:28:44.458 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:28:44 smithi087 ceph-mon[29523]: pgmap v412: 97 pgs: 97 active+clean; 644 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-05-08T05:28:44.458 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:28:44 smithi087 ceph-mon[29523]: from='client.? 172.21.15.87:0/933648960' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-05-08T05:28:44.483 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:28:44 smithi090 ceph-mon[34526]: pgmap v412: 97 pgs: 97 active+clean; 644 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-05-08T05:28:44.483 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:28:44 smithi090 ceph-mon[34526]: from='client.? 172.21.15.87:0/933648960' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-05-08T05:28:44.525 INFO:teuthology.orchestra.run.smithi087.stderr:Inferring config /var/lib/ceph/eeeb813e-0cf9-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T05:28:44.538 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:28:44 smithi160 ceph-mon[34827]: pgmap v412: 97 pgs: 97 active+clean; 644 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-05-08T05:28:44.538 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:28:44 smithi160 ceph-mon[34827]: from='client.? 172.21.15.87:0/933648960' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-05-08T05:28:46.208 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:28:46 smithi087 ceph-mon[29523]: pgmap v413: 97 pgs: 97 active+clean; 644 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-05-08T05:28:46.430 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:46.429+0000 7fba69200700 1 -- 172.21.15.87:0/614264165 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fba6410fa20 msgr2=0x7fba64111e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:28:46.430 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:46.429+0000 7fba69200700 1 --2- 172.21.15.87:0/614264165 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fba6410fa20 0x7fba64111e10 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fba5c00b0a0 tx=0x7fba5c00b3b0 comp rx=0 tx=0).stop 2024-05-08T05:28:46.430 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:46.429+0000 7fba69200700 1 -- 172.21.15.87:0/614264165 shutdown_connections 2024-05-08T05:28:46.431 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:46.429+0000 7fba69200700 1 --2- 172.21.15.87:0/614264165 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fba6410fa20 0x7fba64111e10 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:28:46.431 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:46.429+0000 7fba69200700 1 --2- 172.21.15.87:0/614264165 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fba640774d0 0x7fba64075930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:28:46.431 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:46.429+0000 7fba69200700 1 --2- 172.21.15.87:0/614264165 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fba64075f00 0x7fba64076380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:28:46.431 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:46.429+0000 7fba69200700 1 -- 172.21.15.87:0/614264165 >> 172.21.15.87:0/614264165 conn(0x7fba640fe9e0 msgr2=0x7fba64100e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:28:46.431 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:46.429+0000 7fba69200700 1 -- 172.21.15.87:0/614264165 shutdown_connections 2024-05-08T05:28:46.431 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:46.429+0000 7fba69200700 1 -- 172.21.15.87:0/614264165 wait complete. 2024-05-08T05:28:46.431 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:46.430+0000 7fba69200700 1 Processor -- start 2024-05-08T05:28:46.431 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:46.430+0000 7fba69200700 1 -- start start 2024-05-08T05:28:46.433 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:46.430+0000 7fba69200700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fba64075f00 0x7fba6419fb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:28:46.433 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:46.430+0000 7fba69200700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fba640774d0 0x7fba641a00c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:28:46.433 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:46.430+0000 7fba69200700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fba6410fa20 0x7fba641a7140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:28:46.433 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:46.430+0000 7fba69200700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fba64115540 con 0x7fba6410fa20 2024-05-08T05:28:46.433 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:46.430+0000 7fba69200700 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fba641153c0 con 0x7fba640774d0 2024-05-08T05:28:46.433 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:46.430+0000 7fba69200700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7fba641156c0 con 0x7fba64075f00 2024-05-08T05:28:46.433 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:46.431+0000 7fba63e00700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fba6410fa20 0x7fba641a7140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:28:46.433 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:46.431+0000 7fba63400700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fba64075f00 0x7fba6419fb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:28:46.433 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:46.431+0000 7fba62a00700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fba640774d0 0x7fba641a00c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:28:46.434 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:46.431+0000 7fba63e00700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fba6410fa20 0x7fba641a7140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:46326/0 (socket says 172.21.15.87:46326) 2024-05-08T05:28:46.434 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:46.431+0000 7fba63e00700 1 -- 172.21.15.87:0/1224179601 learned_addr learned my addr 172.21.15.87:0/1224179601 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T05:28:46.434 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:46.431+0000 7fba62a00700 1 -- 172.21.15.87:0/1224179601 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fba64075f00 msgr2=0x7fba6419fb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:28:46.434 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:46.431+0000 7fba62a00700 1 --2- 172.21.15.87:0/1224179601 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fba64075f00 0x7fba6419fb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:28:46.434 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:46.431+0000 7fba62a00700 1 -- 172.21.15.87:0/1224179601 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fba6410fa20 msgr2=0x7fba641a7140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:28:46.434 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:46.431+0000 7fba62a00700 1 --2- 172.21.15.87:0/1224179601 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fba6410fa20 0x7fba641a7140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:28:46.434 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:46.431+0000 7fba62a00700 1 -- 172.21.15.87:0/1224179601 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fba641a77e0 con 0x7fba640774d0 2024-05-08T05:28:46.434 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:46.432+0000 7fba62a00700 1 --2- 172.21.15.87:0/1224179601 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fba640774d0 0x7fba641a00c0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fba5000e9c0 tx=0x7fba5000ecd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:28:46.434 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:46.432+0000 7fba5be00700 1 -- 172.21.15.87:0/1224179601 <== mon.2 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba50004220 con 0x7fba640774d0 2024-05-08T05:28:46.434 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:46.432+0000 7fba69200700 1 -- 172.21.15.87:0/1224179601 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fba641a7ad0 con 0x7fba640774d0 2024-05-08T05:28:46.434 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:46.432+0000 7fba5be00700 1 -- 172.21.15.87:0/1224179601 <== mon.2 v2:172.21.15.90:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fba500043c0 con 0x7fba640774d0 2024-05-08T05:28:46.434 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:46.432+0000 7fba5be00700 1 -- 172.21.15.87:0/1224179601 <== mon.2 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba50003c30 con 0x7fba640774d0 2024-05-08T05:28:46.435 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:46.432+0000 7fba69200700 1 -- 172.21.15.87:0/1224179601 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fba641a8060 con 0x7fba640774d0 2024-05-08T05:28:46.435 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:46.433+0000 7fba69200700 1 -- 172.21.15.87:0/1224179601 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fba6406a190 con 0x7fba640774d0 2024-05-08T05:28:46.436 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:46.436+0000 7fba5be00700 1 -- 172.21.15.87:0/1224179601 <== mon.2 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7fba5000c7c0 con 0x7fba640774d0 2024-05-08T05:28:46.438 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:46.438+0000 7fba5be00700 1 --2- 172.21.15.87:0/1224179601 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7fba480b2880 0x7fba480b4d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:28:46.438 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:46.438+0000 7fba5be00700 1 -- 172.21.15.87:0/1224179601 <== mon.2 v2:172.21.15.90:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8190+0+0 (secure 0 0 0) 0x7fba500e24f0 con 0x7fba640774d0 2024-05-08T05:28:46.438 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:46.438+0000 7fba63400700 1 --2- 172.21.15.87:0/1224179601 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7fba480b2880 0x7fba480b4d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:28:46.439 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:46.439+0000 7fba63400700 1 --2- 172.21.15.87:0/1224179601 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7fba480b2880 0x7fba480b4d40 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fba640778b0 tx=0x7fba54009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:28:46.439 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:46.439+0000 7fba5be00700 1 -- 172.21.15.87:0/1224179601 <== mon.2 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7fba500aa270 con 0x7fba640774d0 2024-05-08T05:28:46.483 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:28:46 smithi090 ceph-mon[34526]: pgmap v413: 97 pgs: 97 active+clean; 644 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-05-08T05:28:46.539 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:28:46 smithi160 ceph-mon[34827]: pgmap v413: 97 pgs: 97 active+clean; 644 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-05-08T05:28:46.669 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:46.669+0000 7fba69200700 1 -- 172.21.15.87:0/1224179601 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "osd dump"} v 0) -- 0x7fba6402e510 con 0x7fba640774d0 2024-05-08T05:28:46.670 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:46.670+0000 7fba5be00700 1 -- 172.21.15.87:0/1224179601 <== mon.2 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump"}]=0 v82) ==== 56+0+5250 (secure 0 0 0) 0x7fba500a9b70 con 0x7fba640774d0 2024-05-08T05:28:46.671 INFO:teuthology.orchestra.run.smithi087.stdout:epoch 82 2024-05-08T05:28:46.671 INFO:teuthology.orchestra.run.smithi087.stdout:fsid eeeb813e-0cf9-11ef-bc97-c7b262605968 2024-05-08T05:28:46.671 INFO:teuthology.orchestra.run.smithi087.stdout:created 2024-05-08T05:16:14.984330+0000 2024-05-08T05:28:46.672 INFO:teuthology.orchestra.run.smithi087.stdout:modified 2024-05-08T05:26:24.106467+0000 2024-05-08T05:28:46.672 INFO:teuthology.orchestra.run.smithi087.stdout:flags sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit 2024-05-08T05:28:46.672 INFO:teuthology.orchestra.run.smithi087.stdout:crush_version 26 2024-05-08T05:28:46.672 INFO:teuthology.orchestra.run.smithi087.stdout:full_ratio 0.95 2024-05-08T05:28:46.672 INFO:teuthology.orchestra.run.smithi087.stdout:backfillfull_ratio 0.9 2024-05-08T05:28:46.672 INFO:teuthology.orchestra.run.smithi087.stdout:nearfull_ratio 0.85 2024-05-08T05:28:46.672 INFO:teuthology.orchestra.run.smithi087.stdout:require_min_compat_client luminous 2024-05-08T05:28:46.672 INFO:teuthology.orchestra.run.smithi087.stdout:min_compat_client luminous 2024-05-08T05:28:46.672 INFO:teuthology.orchestra.run.smithi087.stdout:require_osd_release squid 2024-05-08T05:28:46.672 INFO:teuthology.orchestra.run.smithi087.stdout:stretch_mode_enabled false 2024-05-08T05:28:46.672 INFO:teuthology.orchestra.run.smithi087.stdout:pool 1 '.mgr' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 1 pgp_num 1 autoscale_mode off last_change 21 flags hashpspool stripe_width 0 pg_num_max 32 pg_num_min 1 application mgr read_balance_score 12.00 2024-05-08T05:28:46.672 INFO:teuthology.orchestra.run.smithi087.stdout:pool 2 'cephfs_metadata' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 32 pgp_num 32 autoscale_mode off last_change 80 flags hashpspool stripe_width 0 pg_autoscale_bias 4 pg_num_min 16 recovery_priority 5 application cephfs read_balance_score 1.88 2024-05-08T05:28:46.672 INFO:teuthology.orchestra.run.smithi087.stdout:pool 3 'cephfs_data' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 64 pgp_num 64 autoscale_mode off last_change 80 flags hashpspool stripe_width 0 pg_num_min 64 target_size_ratio 0.9 application cephfs read_balance_score 1.50 2024-05-08T05:28:46.672 INFO:teuthology.orchestra.run.smithi087.stdout:max_osd 12 2024-05-08T05:28:46.673 INFO:teuthology.orchestra.run.smithi087.stdout:osd.0 up in weight 1 up_from 8 up_thru 77 down_at 0 last_clean_interval [0,0) [v2:172.21.15.87:6802/2285285644,v1:172.21.15.87:6803/2285285644] [v2:172.21.15.87:6804/2285285644,v1:172.21.15.87:6805/2285285644] exists,up f3e25ce0-0762-46fd-83fb-6766a2e9db69 2024-05-08T05:28:46.673 INFO:teuthology.orchestra.run.smithi087.stdout:osd.1 up in weight 1 up_from 13 up_thru 77 down_at 0 last_clean_interval [0,0) [v2:172.21.15.90:6800/1681573998,v1:172.21.15.90:6801/1681573998] [v2:172.21.15.90:6802/1681573998,v1:172.21.15.90:6803/1681573998] exists,up b6de5f4c-1d79-41ff-adee-03d8a47ab55e 2024-05-08T05:28:46.673 INFO:teuthology.orchestra.run.smithi087.stdout:osd.2 up in weight 1 up_from 18 up_thru 77 down_at 0 last_clean_interval [0,0) [v2:172.21.15.160:6800/2137179096,v1:172.21.15.160:6801/2137179096] [v2:172.21.15.160:6802/2137179096,v1:172.21.15.160:6803/2137179096] exists,up ee3a2729-93b2-4985-b84d-165f92cae8e1 2024-05-08T05:28:46.673 INFO:teuthology.orchestra.run.smithi087.stdout:osd.3 up in weight 1 up_from 25 up_thru 77 down_at 0 last_clean_interval [0,0) [v2:172.21.15.87:6810/2022667023,v1:172.21.15.87:6811/2022667023] [v2:172.21.15.87:6812/2022667023,v1:172.21.15.87:6813/2022667023] exists,up fc7bd69f-5a62-4ec6-b95c-c170be46a7d3 2024-05-08T05:28:46.673 INFO:teuthology.orchestra.run.smithi087.stdout:osd.4 up in weight 1 up_from 31 up_thru 77 down_at 0 last_clean_interval [0,0) [v2:172.21.15.90:6808/1371607578,v1:172.21.15.90:6809/1371607578] [v2:172.21.15.90:6810/1371607578,v1:172.21.15.90:6811/1371607578] exists,up a05f7bd1-962a-4f3e-8f70-e7ef4c68bac2 2024-05-08T05:28:46.673 INFO:teuthology.orchestra.run.smithi087.stdout:osd.5 up in weight 1 up_from 36 up_thru 81 down_at 0 last_clean_interval [0,0) [v2:172.21.15.160:6808/2190054276,v1:172.21.15.160:6809/2190054276] [v2:172.21.15.160:6810/2190054276,v1:172.21.15.160:6811/2190054276] exists,up 85e3af08-32ee-4f26-97df-8d54ba928715 2024-05-08T05:28:46.673 INFO:teuthology.orchestra.run.smithi087.stdout:osd.6 up in weight 1 up_from 42 up_thru 81 down_at 0 last_clean_interval [0,0) [v2:172.21.15.87:6818/2863681447,v1:172.21.15.87:6819/2863681447] [v2:172.21.15.87:6820/2863681447,v1:172.21.15.87:6821/2863681447] exists,up df4b22a9-6cd8-473e-a17b-a0cb9ad32e98 2024-05-08T05:28:46.673 INFO:teuthology.orchestra.run.smithi087.stdout:osd.7 up in weight 1 up_from 48 up_thru 77 down_at 0 last_clean_interval [0,0) [v2:172.21.15.90:6816/1964248958,v1:172.21.15.90:6817/1964248958] [v2:172.21.15.90:6818/1964248958,v1:172.21.15.90:6819/1964248958] exists,up f6ef3857-0366-4408-932a-a8c8479ba780 2024-05-08T05:28:46.673 INFO:teuthology.orchestra.run.smithi087.stdout:osd.8 up in weight 1 up_from 54 up_thru 77 down_at 0 last_clean_interval [0,0) [v2:172.21.15.160:6816/927680738,v1:172.21.15.160:6817/927680738] [v2:172.21.15.160:6818/927680738,v1:172.21.15.160:6819/927680738] exists,up 027dede9-d0be-4fbe-b7b8-02ce88d57f4d 2024-05-08T05:28:46.673 INFO:teuthology.orchestra.run.smithi087.stdout:osd.9 up in weight 1 up_from 60 up_thru 77 down_at 0 last_clean_interval [0,0) [v2:172.21.15.87:6826/3789116749,v1:172.21.15.87:6827/3789116749] [v2:172.21.15.87:6828/3789116749,v1:172.21.15.87:6829/3789116749] exists,up bc9e37de-e509-4db6-bd58-b68e2c8e1aff 2024-05-08T05:28:46.673 INFO:teuthology.orchestra.run.smithi087.stdout:osd.10 up in weight 1 up_from 66 up_thru 77 down_at 0 last_clean_interval [0,0) [v2:172.21.15.90:6824/716529498,v1:172.21.15.90:6825/716529498] [v2:172.21.15.90:6826/716529498,v1:172.21.15.90:6827/716529498] exists,up 43945081-b4c8-4f5d-9301-3540709e69e4 2024-05-08T05:28:46.673 INFO:teuthology.orchestra.run.smithi087.stdout:osd.11 up in weight 1 up_from 72 up_thru 81 down_at 0 last_clean_interval [0,0) [v2:172.21.15.160:6824/1842739135,v1:172.21.15.160:6825/1842739135] [v2:172.21.15.160:6826/1842739135,v1:172.21.15.160:6827/1842739135] exists,up da23ff5c-3f79-44e3-bca3-d9d5a003c999 2024-05-08T05:28:46.674 INFO:teuthology.orchestra.run.smithi087.stdout:pg_upmap_items 2.a [2,11] 2024-05-08T05:28:46.674 INFO:teuthology.orchestra.run.smithi087.stdout:pg_upmap_items 2.1d [2,4,8,11] 2024-05-08T05:28:46.674 INFO:teuthology.orchestra.run.smithi087.stdout:pg_upmap_items 3.0 [4,8] 2024-05-08T05:28:46.674 INFO:teuthology.orchestra.run.smithi087.stdout:pg_upmap_items 3.1 [4,9] 2024-05-08T05:28:46.674 INFO:teuthology.orchestra.run.smithi087.stdout:pg_upmap_items 3.12 [3,9] 2024-05-08T05:28:46.674 INFO:teuthology.orchestra.run.smithi087.stdout:pg_upmap_items 3.28 [5,6] 2024-05-08T05:28:46.674 INFO:teuthology.orchestra.run.smithi087.stdout:pg_upmap_items 3.2c [4,9] 2024-05-08T05:28:46.674 INFO:teuthology.orchestra.run.smithi087.stdout:blocklist 172.21.15.87:0/4226160503 expires 2024-05-09T05:17:22.736165+0000 2024-05-08T05:28:46.674 INFO:teuthology.orchestra.run.smithi087.stdout:blocklist 172.21.15.87:0/2773684806 expires 2024-05-09T05:17:22.736165+0000 2024-05-08T05:28:46.674 INFO:teuthology.orchestra.run.smithi087.stdout:blocklist 172.21.15.87:0/349590592 expires 2024-05-09T05:17:22.736165+0000 2024-05-08T05:28:46.674 INFO:teuthology.orchestra.run.smithi087.stdout:blocklist 172.21.15.87:6801/2710124295 expires 2024-05-09T05:17:22.736165+0000 2024-05-08T05:28:46.674 INFO:teuthology.orchestra.run.smithi087.stdout:blocklist 172.21.15.87:6800/1823425617 expires 2024-05-09T05:16:48.155337+0000 2024-05-08T05:28:46.674 INFO:teuthology.orchestra.run.smithi087.stdout:blocklist 172.21.15.87:0/2393072013 expires 2024-05-09T05:16:48.155337+0000 2024-05-08T05:28:46.675 INFO:teuthology.orchestra.run.smithi087.stdout:blocklist 172.21.15.87:0/1291525416 expires 2024-05-09T05:16:48.155337+0000 2024-05-08T05:28:46.675 INFO:teuthology.orchestra.run.smithi087.stdout:blocklist 172.21.15.87:6801/1823425617 expires 2024-05-09T05:16:48.155337+0000 2024-05-08T05:28:46.675 INFO:teuthology.orchestra.run.smithi087.stdout:blocklist 172.21.15.87:0/3839463573 expires 2024-05-09T05:16:48.155337+0000 2024-05-08T05:28:46.675 INFO:teuthology.orchestra.run.smithi087.stdout:blocklist 172.21.15.87:6800/2710124295 expires 2024-05-09T05:17:22.736165+0000 2024-05-08T05:28:46.675 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:46.673+0000 7fba69200700 1 -- 172.21.15.87:0/1224179601 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7fba480b2880 msgr2=0x7fba480b4d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:28:46.676 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:46.673+0000 7fba69200700 1 --2- 172.21.15.87:0/1224179601 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7fba480b2880 0x7fba480b4d40 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fba640778b0 tx=0x7fba54009260 comp rx=0 tx=0).stop 2024-05-08T05:28:46.676 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:46.673+0000 7fba69200700 1 -- 172.21.15.87:0/1224179601 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fba640774d0 msgr2=0x7fba641a00c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:28:46.676 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:46.673+0000 7fba69200700 1 --2- 172.21.15.87:0/1224179601 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fba640774d0 0x7fba641a00c0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fba5000e9c0 tx=0x7fba5000ecd0 comp rx=0 tx=0).stop 2024-05-08T05:28:46.676 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:46.673+0000 7fba69200700 1 -- 172.21.15.87:0/1224179601 shutdown_connections 2024-05-08T05:28:46.676 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:46.673+0000 7fba69200700 1 --2- 172.21.15.87:0/1224179601 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fba6410fa20 0x7fba641a7140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:28:46.676 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:46.673+0000 7fba69200700 1 --2- 172.21.15.87:0/1224179601 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7fba480b2880 0x7fba480b4d40 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:28:46.676 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:46.673+0000 7fba69200700 1 --2- 172.21.15.87:0/1224179601 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fba64075f00 0x7fba6419fb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:28:46.676 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:46.673+0000 7fba69200700 1 --2- 172.21.15.87:0/1224179601 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fba640774d0 0x7fba641a00c0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:28:46.676 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:46.673+0000 7fba69200700 1 -- 172.21.15.87:0/1224179601 >> 172.21.15.87:0/1224179601 conn(0x7fba640fe9e0 msgr2=0x7fba64102dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:28:46.676 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:46.674+0000 7fba69200700 1 -- 172.21.15.87:0/1224179601 shutdown_connections 2024-05-08T05:28:46.676 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:46.674+0000 7fba69200700 1 -- 172.21.15.87:0/1224179601 wait complete. 2024-05-08T05:28:47.331 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:28:47 smithi087 ceph-mon[29523]: from='client.? 172.21.15.87:0/1224179601' entity='client.admin' cmd=[{"prefix": "osd dump"}]: dispatch 2024-05-08T05:28:47.331 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:28:47 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T05:28:47.398 INFO:teuthology.run_tasks:Running task fs.ready... 2024-05-08T05:28:47.410 DEBUG:teuthology.orchestra.run.smithi087:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid eeeb813e-0cf9-11ef-bc97-c7b262605968 -- ceph fs dump --format=json 2024-05-08T05:28:47.483 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:28:47 smithi090 ceph-mon[34526]: from='client.? 172.21.15.87:0/1224179601' entity='client.admin' cmd=[{"prefix": "osd dump"}]: dispatch 2024-05-08T05:28:47.483 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:28:47 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T05:28:47.538 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:28:47 smithi160 ceph-mon[34827]: from='client.? 172.21.15.87:0/1224179601' entity='client.admin' cmd=[{"prefix": "osd dump"}]: dispatch 2024-05-08T05:28:47.539 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:28:47 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T05:28:47.889 INFO:teuthology.orchestra.run.smithi087.stderr:Inferring config /var/lib/ceph/eeeb813e-0cf9-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T05:28:48.708 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:28:48 smithi087 ceph-mon[29523]: pgmap v414: 97 pgs: 97 active+clean; 644 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T05:28:48.708 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:28:48 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:28:48.709 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:28:48 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:28:48.709 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:28:48 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:28:48.709 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:28:48 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:28:48.709 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:28:48 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T05:28:48.709 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:28:48 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T05:28:48.709 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:28:48 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:28:48.733 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:28:48 smithi090 ceph-mon[34526]: pgmap v414: 97 pgs: 97 active+clean; 644 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T05:28:48.734 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:28:48 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:28:48.734 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:28:48 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:28:48.734 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:28:48 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:28:48.734 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:28:48 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:28:48.734 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:28:48 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T05:28:48.734 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:28:48 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T05:28:48.735 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:28:48 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:28:48.789 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:28:48 smithi160 ceph-mon[34827]: pgmap v414: 97 pgs: 97 active+clean; 644 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T05:28:48.789 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:28:48 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:28:48.789 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:28:48 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:28:48.789 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:28:48 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:28:48.789 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:28:48 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:28:48.789 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:28:48 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T05:28:48.789 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:28:48 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T05:28:48.789 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:28:48 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:28:50.017 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:50.014+0000 7f3606600700 1 -- 172.21.15.87:0/2191396336 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3600109510 msgr2=0x7f36001098f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:28:50.018 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:50.014+0000 7f3606600700 1 --2- 172.21.15.87:0/2191396336 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3600109510 0x7f36001098f0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f35f0009990 tx=0x7f35f0009ca0 comp rx=0 tx=0).stop 2024-05-08T05:28:50.018 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:50.014+0000 7f3606600700 1 -- 172.21.15.87:0/2191396336 shutdown_connections 2024-05-08T05:28:50.018 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:50.014+0000 7f3606600700 1 --2- 172.21.15.87:0/2191396336 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f360006bb40 0x7f3600110330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:28:50.018 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:50.014+0000 7f3606600700 1 --2- 172.21.15.87:0/2191396336 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3600109510 0x7f36001098f0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:28:50.018 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:50.014+0000 7f3606600700 1 --2- 172.21.15.87:0/2191396336 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f360006b180 0x7f360006b600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:28:50.018 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:50.014+0000 7f3606600700 1 -- 172.21.15.87:0/2191396336 >> 172.21.15.87:0/2191396336 conn(0x7f3600079350 msgr2=0x7f3600079760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:28:50.018 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:50.015+0000 7f3606600700 1 -- 172.21.15.87:0/2191396336 shutdown_connections 2024-05-08T05:28:50.018 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:50.015+0000 7f3606600700 1 -- 172.21.15.87:0/2191396336 wait complete. 2024-05-08T05:28:50.018 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:50.016+0000 7f3606600700 1 Processor -- start 2024-05-08T05:28:50.018 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:50.016+0000 7f3606600700 1 -- start start 2024-05-08T05:28:50.018 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:50.016+0000 7f3606600700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f360006b180 0x7f360019f820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:28:50.018 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:50.016+0000 7f3606600700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f360006bb40 0x7f360019fd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:28:50.018 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:50.016+0000 7f3606600700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3600109510 0x7f36001999e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:28:50.019 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:50.016+0000 7f3606600700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f36001136e0 con 0x7f360006bb40 2024-05-08T05:28:50.019 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:50.016+0000 7f3606600700 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f3600113560 con 0x7f360006b180 2024-05-08T05:28:50.019 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:50.016+0000 7f3606600700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f3600113860 con 0x7f3600109510 2024-05-08T05:28:50.020 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:50.017+0000 7f35ff400700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f360006b180 0x7f360019f820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:28:50.020 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:50.017+0000 7f35fea00700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f360006bb40 0x7f360019fd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:28:50.020 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:50.017+0000 7f35ff400700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f360006b180 0x7f360019f820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.87:44998/0 (socket says 172.21.15.87:44998) 2024-05-08T05:28:50.020 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:50.017+0000 7f35ff400700 1 -- 172.21.15.87:0/2118843442 learned_addr learned my addr 172.21.15.87:0/2118843442 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T05:28:50.020 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:50.017+0000 7f35ffe00700 1 --2- 172.21.15.87:0/2118843442 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3600109510 0x7f36001999e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:28:50.020 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:50.017+0000 7f35ff400700 1 -- 172.21.15.87:0/2118843442 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3600109510 msgr2=0x7f36001999e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:28:50.020 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:50.017+0000 7f35ff400700 1 --2- 172.21.15.87:0/2118843442 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3600109510 0x7f36001999e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:28:50.020 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:50.017+0000 7f35ff400700 1 -- 172.21.15.87:0/2118843442 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f360006bb40 msgr2=0x7f360019fd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:28:50.020 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:50.017+0000 7f35ff400700 1 --2- 172.21.15.87:0/2118843442 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f360006bb40 0x7f360019fd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:28:50.020 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:50.017+0000 7f35ff400700 1 -- 172.21.15.87:0/2118843442 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f360019a140 con 0x7f360006b180 2024-05-08T05:28:50.021 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:50.017+0000 7f35fea00700 1 --2- 172.21.15.87:0/2118843442 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f360006bb40 0x7f360019fd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T05:28:50.021 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:50.017+0000 7f35ff400700 1 --2- 172.21.15.87:0/2118843442 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f360006b180 0x7f360019f820 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f35f0005910 tx=0x7f35f00047b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:28:50.021 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:50.018+0000 7f35f7e00700 1 -- 172.21.15.87:0/2118843442 <== mon.2 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35f0026070 con 0x7f360006b180 2024-05-08T05:28:50.021 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:50.018+0000 7f35f7e00700 1 -- 172.21.15.87:0/2118843442 <== mon.2 v2:172.21.15.90:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f35f0021410 con 0x7f360006b180 2024-05-08T05:28:50.021 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:50.018+0000 7f3606600700 1 -- 172.21.15.87:0/2118843442 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f360019a3d0 con 0x7f360006b180 2024-05-08T05:28:50.021 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:50.018+0000 7f35f7e00700 1 -- 172.21.15.87:0/2118843442 <== mon.2 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35f0017650 con 0x7f360006b180 2024-05-08T05:28:50.021 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:50.018+0000 7f3606600700 1 -- 172.21.15.87:0/2118843442 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f36001023a0 con 0x7f360006b180 2024-05-08T05:28:50.021 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:50.019+0000 7f3606600700 1 -- 172.21.15.87:0/2118843442 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f360010b9f0 con 0x7f360006b180 2024-05-08T05:28:50.022 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:50.021+0000 7f35f7e00700 1 -- 172.21.15.87:0/2118843442 <== mon.2 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7f35f0029070 con 0x7f360006b180 2024-05-08T05:28:50.024 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:50.023+0000 7f35f7e00700 1 --2- 172.21.15.87:0/2118843442 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f35e40b2940 0x7f35e40b4e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:28:50.024 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:50.023+0000 7f35f7e00700 1 -- 172.21.15.87:0/2118843442 <== mon.2 v2:172.21.15.90:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8190+0+0 (secure 0 0 0) 0x7f35f00e2d70 con 0x7f360006b180 2024-05-08T05:28:50.024 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:50.023+0000 7f35fea00700 1 --2- 172.21.15.87:0/2118843442 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f35e40b2940 0x7f35e40b4e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:28:50.025 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:50.024+0000 7f35fea00700 1 --2- 172.21.15.87:0/2118843442 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f35e40b2940 0x7f35e40b4e00 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f36000799a0 tx=0x7f35ec009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:28:50.029 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:50.028+0000 7f35f7e00700 1 -- 172.21.15.87:0/2118843442 <== mon.2 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f35f0013070 con 0x7f360006b180 2024-05-08T05:28:50.310 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:50.309+0000 7f3606600700 1 -- 172.21.15.87:0/2118843442 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f360006a190 con 0x7f360006b180 2024-05-08T05:28:50.312 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:50.310+0000 7f35f7e00700 1 -- 172.21.15.87:0/2118843442 <== mon.2 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) ==== 94+0+11858 (secure 0 0 0) 0x7f35f00aaaf0 con 0x7f360006b180 2024-05-08T05:28:50.312 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-05-08T05:28:50.312 INFO:teuthology.orchestra.run.smithi087.stdout:{"epoch":24,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14358,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6835/1183985321","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6834","nonce":1183985321},{"type":"v1","addr":"172.21.15.87:6835","nonce":1183985321}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14370,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6837/1485824316","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6836","nonce":1485824316},{"type":"v1","addr":"172.21.15.87:6837","nonce":1485824316}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14409,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6841/724277538","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6840","nonce":724277538},{"type":"v1","addr":"172.21.15.87:6841","nonce":724277538}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24412,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6833/3339455985","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6832","nonce":3339455985},{"type":"v1","addr":"172.21.15.160:6833","nonce":3339455985}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24413,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6833/3292166873","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6832","nonce":3292166873},{"type":"v1","addr":"172.21.15.90:6833","nonce":3292166873}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24443,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6835/824555459","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6834","nonce":824555459},{"type":"v1","addr":"172.21.15.90:6835","nonce":824555459}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6}],"filesystems":[{"mdsmap":{"epoch":24,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-05-08T05:25:36.816840+0000","modified":"2024-05-08T05:25:59.331243+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24500,"mds_1":24482,"mds_2":24481},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24463":{"gid":24463,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.160:6835/409648357","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6834","nonce":409648357},{"type":"v1","addr":"172.21.15.160:6835","nonce":409648357}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24467":{"gid":24467,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.90:6837/4221919418","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6836","nonce":4221919418},{"type":"v1","addr":"172.21.15.90:6837","nonce":4221919418}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24469":{"gid":24469,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.160:6837/4200018040","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6836","nonce":4200018040},{"type":"v1","addr":"172.21.15.160:6837","nonce":4200018040}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24481":{"gid":24481,"name":"i","rank":2,"incarnation":20,"state":"up:active","state_seq":13,"addr":"172.21.15.160:6839/234657686","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6838","nonce":234657686},{"type":"v1","addr":"172.21.15.160:6839","nonce":234657686}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24482":{"gid":24482,"name":"g","rank":1,"incarnation":18,"state":"up:active","state_seq":12,"addr":"172.21.15.87:6839/2127215876","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6838","nonce":2127215876},{"type":"v1","addr":"172.21.15.87:6839","nonce":2127215876}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24500":{"gid":24500,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.90:6839/160586017","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6838","nonce":160586017},{"type":"v1","addr":"172.21.15.90:6839","nonce":160586017}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24500,"qdb_cluster":[24482,24500,24481]},"id":1}]} 2024-05-08T05:28:50.316 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:50.314+0000 7f3606600700 1 -- 172.21.15.87:0/2118843442 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f35e40b2940 msgr2=0x7f35e40b4e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:28:50.316 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:50.314+0000 7f3606600700 1 --2- 172.21.15.87:0/2118843442 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f35e40b2940 0x7f35e40b4e00 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f36000799a0 tx=0x7f35ec009260 comp rx=0 tx=0).stop 2024-05-08T05:28:50.316 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:50.314+0000 7f3606600700 1 -- 172.21.15.87:0/2118843442 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f360006b180 msgr2=0x7f360019f820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:28:50.316 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:50.314+0000 7f3606600700 1 --2- 172.21.15.87:0/2118843442 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f360006b180 0x7f360019f820 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f35f0005910 tx=0x7f35f00047b0 comp rx=0 tx=0).stop 2024-05-08T05:28:50.316 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:50.314+0000 7f3606600700 1 -- 172.21.15.87:0/2118843442 shutdown_connections 2024-05-08T05:28:50.316 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:50.314+0000 7f3606600700 1 --2- 172.21.15.87:0/2118843442 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f35e40b2940 0x7f35e40b4e00 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:28:50.317 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:50.314+0000 7f3606600700 1 --2- 172.21.15.87:0/2118843442 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3600109510 0x7f36001999e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:28:50.317 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:50.314+0000 7f3606600700 1 --2- 172.21.15.87:0/2118843442 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f360006b180 0x7f360019f820 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:28:50.317 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:50.314+0000 7f3606600700 1 --2- 172.21.15.87:0/2118843442 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f360006bb40 0x7f360019fd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:28:50.317 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:50.315+0000 7f3606600700 1 -- 172.21.15.87:0/2118843442 >> 172.21.15.87:0/2118843442 conn(0x7f3600079350 msgr2=0x7f3600101000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:28:50.317 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:50.315+0000 7f3606600700 1 -- 172.21.15.87:0/2118843442 shutdown_connections 2024-05-08T05:28:50.317 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:50.315+0000 7f3606600700 1 -- 172.21.15.87:0/2118843442 wait complete. 2024-05-08T05:28:50.317 INFO:teuthology.orchestra.run.smithi087.stderr:dumped fsmap epoch 24 2024-05-08T05:28:50.685 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:28:50 smithi087 ceph-mon[29523]: pgmap v415: 97 pgs: 97 active+clean; 644 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-05-08T05:28:50.685 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:28:50 smithi087 ceph-mon[29523]: from='client.? 172.21.15.87:0/2118843442' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T05:28:50.733 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:28:50 smithi090 ceph-mon[34526]: pgmap v415: 97 pgs: 97 active+clean; 644 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-05-08T05:28:50.733 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:28:50 smithi090 ceph-mon[34526]: from='client.? 172.21.15.87:0/2118843442' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T05:28:50.788 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:28:50 smithi160 ceph-mon[34827]: pgmap v415: 97 pgs: 97 active+clean; 644 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-05-08T05:28:50.789 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:28:50 smithi160 ceph-mon[34827]: from='client.? 172.21.15.87:0/2118843442' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T05:28:51.089 DEBUG:teuthology.orchestra.run.smithi087:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid eeeb813e-0cf9-11ef-bc97-c7b262605968 -- ceph fs dump --format=json 2024-05-08T05:28:51.543 INFO:teuthology.orchestra.run.smithi087.stderr:Inferring config /var/lib/ceph/eeeb813e-0cf9-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T05:28:52.707 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:28:52 smithi087 ceph-mon[29523]: pgmap v416: 97 pgs: 97 active+clean; 644 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T05:28:52.733 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:28:52 smithi090 ceph-mon[34526]: pgmap v416: 97 pgs: 97 active+clean; 644 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T05:28:52.788 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:28:52 smithi160 ceph-mon[34827]: pgmap v416: 97 pgs: 97 active+clean; 644 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T05:28:53.497 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:53.495+0000 7f55fca00700 1 -- 172.21.15.87:0/2933551509 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f55f8106070 msgr2=0x7f55f8112580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:28:53.497 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:53.495+0000 7f55fca00700 1 --2- 172.21.15.87:0/2933551509 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f55f8106070 0x7f55f8112580 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f55f000b0a0 tx=0x7f55f000b3b0 comp rx=0 tx=0).stop 2024-05-08T05:28:53.498 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:53.495+0000 7f55fca00700 1 -- 172.21.15.87:0/2933551509 shutdown_connections 2024-05-08T05:28:53.498 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:53.495+0000 7f55fca00700 1 --2- 172.21.15.87:0/2933551509 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f55f8106070 0x7f55f8112580 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:28:53.498 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:53.495+0000 7f55fca00700 1 --2- 172.21.15.87:0/2933551509 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f55f810b6b0 0x7f55f810ba90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:28:53.498 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:53.495+0000 7f55fca00700 1 --2- 172.21.15.87:0/2933551509 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f55f81056b0 0x7f55f8105b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:28:53.498 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:53.495+0000 7f55fca00700 1 -- 172.21.15.87:0/2933551509 >> 172.21.15.87:0/2933551509 conn(0x7f55f81011e0 msgr2=0x7f55f8103600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:28:53.498 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:53.496+0000 7f55fca00700 1 -- 172.21.15.87:0/2933551509 shutdown_connections 2024-05-08T05:28:53.498 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:53.496+0000 7f55fca00700 1 -- 172.21.15.87:0/2933551509 wait complete. 2024-05-08T05:28:53.500 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:53.497+0000 7f55fca00700 1 Processor -- start 2024-05-08T05:28:53.500 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:53.497+0000 7f55fca00700 1 -- start start 2024-05-08T05:28:53.500 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:53.497+0000 7f55fca00700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f55f81056b0 0x7f55f819bd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:28:53.500 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:53.497+0000 7f55fca00700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f55f8106070 0x7f55f819c2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:28:53.500 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:53.497+0000 7f55fca00700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f55f810b6b0 0x7f55f81a0650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:28:53.500 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:53.497+0000 7f55fca00700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f55f81158b0 con 0x7f55f81056b0 2024-05-08T05:28:53.500 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:53.497+0000 7f55fca00700 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f55f8115730 con 0x7f55f8106070 2024-05-08T05:28:53.500 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:53.497+0000 7f55fca00700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f55f8115a30 con 0x7f55f810b6b0 2024-05-08T05:28:53.501 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:53.497+0000 7f55f5e00700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f55f81056b0 0x7f55f819bd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:28:53.501 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:53.497+0000 7f55f5e00700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f55f81056b0 0x7f55f819bd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:46366/0 (socket says 172.21.15.87:46366) 2024-05-08T05:28:53.501 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:53.497+0000 7f55f5e00700 1 -- 172.21.15.87:0/1412890830 learned_addr learned my addr 172.21.15.87:0/1412890830 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T05:28:53.501 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:53.498+0000 7f55f5400700 1 --2- 172.21.15.87:0/1412890830 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f55f8106070 0x7f55f819c2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:28:53.501 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:53.498+0000 7f55f6800700 1 --2- 172.21.15.87:0/1412890830 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f55f810b6b0 0x7f55f81a0650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:28:53.501 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:53.498+0000 7f55f5400700 1 -- 172.21.15.87:0/1412890830 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f55f810b6b0 msgr2=0x7f55f81a0650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:28:53.501 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:53.498+0000 7f55f5400700 1 --2- 172.21.15.87:0/1412890830 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f55f810b6b0 0x7f55f81a0650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:28:53.501 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:53.498+0000 7f55f5400700 1 -- 172.21.15.87:0/1412890830 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f55f81056b0 msgr2=0x7f55f819bd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:28:53.501 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:53.498+0000 7f55f5400700 1 --2- 172.21.15.87:0/1412890830 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f55f81056b0 0x7f55f819bd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:28:53.501 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:53.498+0000 7f55f5400700 1 -- 172.21.15.87:0/1412890830 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f55f81a0d90 con 0x7f55f8106070 2024-05-08T05:28:53.501 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:53.498+0000 7f55f5e00700 1 --2- 172.21.15.87:0/1412890830 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f55f81056b0 0x7f55f819bd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T05:28:53.501 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:53.498+0000 7f55f5400700 1 --2- 172.21.15.87:0/1412890830 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f55f8106070 0x7f55f819c2c0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f55e400e9f0 tx=0x7f55e400ed00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:28:53.501 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:53.498+0000 7f55eea00700 1 -- 172.21.15.87:0/1412890830 <== mon.2 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55e4004220 con 0x7f55f8106070 2024-05-08T05:28:53.501 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:53.499+0000 7f55fca00700 1 -- 172.21.15.87:0/1412890830 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f55f81a1080 con 0x7f55f8106070 2024-05-08T05:28:53.501 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:53.499+0000 7f55eea00700 1 -- 172.21.15.87:0/1412890830 <== mon.2 v2:172.21.15.90:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f55e40043c0 con 0x7f55f8106070 2024-05-08T05:28:53.502 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:53.499+0000 7f55eea00700 1 -- 172.21.15.87:0/1412890830 <== mon.2 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55e4005020 con 0x7f55f8106070 2024-05-08T05:28:53.502 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:53.499+0000 7f55fca00700 1 -- 172.21.15.87:0/1412890830 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f55f81a8900 con 0x7f55f8106070 2024-05-08T05:28:53.502 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:53.500+0000 7f55fca00700 1 -- 172.21.15.87:0/1412890830 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f55f806a190 con 0x7f55f8106070 2024-05-08T05:28:53.504 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:53.503+0000 7f55eea00700 1 -- 172.21.15.87:0/1412890830 <== mon.2 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7f55e4004750 con 0x7f55f8106070 2024-05-08T05:28:53.505 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:53.504+0000 7f55eea00700 1 --2- 172.21.15.87:0/1412890830 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f55dc0b2880 0x7f55dc0b4d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:28:53.506 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:53.504+0000 7f55eea00700 1 -- 172.21.15.87:0/1412890830 <== mon.2 v2:172.21.15.90:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8190+0+0 (secure 0 0 0) 0x7f55e40e2250 con 0x7f55f8106070 2024-05-08T05:28:53.506 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:53.504+0000 7f55f5e00700 1 --2- 172.21.15.87:0/1412890830 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f55dc0b2880 0x7f55dc0b4d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:28:53.506 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:53.505+0000 7f55f5e00700 1 --2- 172.21.15.87:0/1412890830 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f55dc0b2880 0x7f55dc0b4d40 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f55e8011550 tx=0x7f55e8009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:28:53.506 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:53.505+0000 7f55eea00700 1 -- 172.21.15.87:0/1412890830 <== mon.2 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f55e40a9fd0 con 0x7f55f8106070 2024-05-08T05:28:53.793 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:53.791+0000 7f55fca00700 1 -- 172.21.15.87:0/1412890830 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f55f819d110 con 0x7f55f8106070 2024-05-08T05:28:53.794 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:53.792+0000 7f55eea00700 1 -- 172.21.15.87:0/1412890830 <== mon.2 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) ==== 94+0+11858 (secure 0 0 0) 0x7f55f819d110 con 0x7f55f8106070 2024-05-08T05:28:53.794 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-05-08T05:28:53.794 INFO:teuthology.orchestra.run.smithi087.stdout:{"epoch":24,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14358,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6835/1183985321","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6834","nonce":1183985321},{"type":"v1","addr":"172.21.15.87:6835","nonce":1183985321}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14370,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6837/1485824316","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6836","nonce":1485824316},{"type":"v1","addr":"172.21.15.87:6837","nonce":1485824316}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14409,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6841/724277538","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6840","nonce":724277538},{"type":"v1","addr":"172.21.15.87:6841","nonce":724277538}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24412,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6833/3339455985","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6832","nonce":3339455985},{"type":"v1","addr":"172.21.15.160:6833","nonce":3339455985}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24413,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6833/3292166873","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6832","nonce":3292166873},{"type":"v1","addr":"172.21.15.90:6833","nonce":3292166873}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24443,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6835/824555459","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6834","nonce":824555459},{"type":"v1","addr":"172.21.15.90:6835","nonce":824555459}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6}],"filesystems":[{"mdsmap":{"epoch":24,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-05-08T05:25:36.816840+0000","modified":"2024-05-08T05:25:59.331243+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24500,"mds_1":24482,"mds_2":24481},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24463":{"gid":24463,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.160:6835/409648357","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6834","nonce":409648357},{"type":"v1","addr":"172.21.15.160:6835","nonce":409648357}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24467":{"gid":24467,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.90:6837/4221919418","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6836","nonce":4221919418},{"type":"v1","addr":"172.21.15.90:6837","nonce":4221919418}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24469":{"gid":24469,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.160:6837/4200018040","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6836","nonce":4200018040},{"type":"v1","addr":"172.21.15.160:6837","nonce":4200018040}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24481":{"gid":24481,"name":"i","rank":2,"incarnation":20,"state":"up:active","state_seq":13,"addr":"172.21.15.160:6839/234657686","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6838","nonce":234657686},{"type":"v1","addr":"172.21.15.160:6839","nonce":234657686}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24482":{"gid":24482,"name":"g","rank":1,"incarnation":18,"state":"up:active","state_seq":12,"addr":"172.21.15.87:6839/2127215876","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6838","nonce":2127215876},{"type":"v1","addr":"172.21.15.87:6839","nonce":2127215876}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24500":{"gid":24500,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.90:6839/160586017","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6838","nonce":160586017},{"type":"v1","addr":"172.21.15.90:6839","nonce":160586017}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24500,"qdb_cluster":[24482,24500,24481]},"id":1}]} 2024-05-08T05:28:53.798 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:53.796+0000 7f55fca00700 1 -- 172.21.15.87:0/1412890830 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f55dc0b2880 msgr2=0x7f55dc0b4d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:28:53.798 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:53.796+0000 7f55fca00700 1 --2- 172.21.15.87:0/1412890830 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f55dc0b2880 0x7f55dc0b4d40 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f55e8011550 tx=0x7f55e8009260 comp rx=0 tx=0).stop 2024-05-08T05:28:53.798 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:53.796+0000 7f55fca00700 1 -- 172.21.15.87:0/1412890830 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f55f8106070 msgr2=0x7f55f819c2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:28:53.798 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:53.796+0000 7f55fca00700 1 --2- 172.21.15.87:0/1412890830 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f55f8106070 0x7f55f819c2c0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f55e400e9f0 tx=0x7f55e400ed00 comp rx=0 tx=0).stop 2024-05-08T05:28:53.798 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:53.796+0000 7f55fca00700 1 -- 172.21.15.87:0/1412890830 shutdown_connections 2024-05-08T05:28:53.798 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:53.796+0000 7f55fca00700 1 --2- 172.21.15.87:0/1412890830 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f55dc0b2880 0x7f55dc0b4d40 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:28:53.798 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:53.796+0000 7f55fca00700 1 --2- 172.21.15.87:0/1412890830 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f55f810b6b0 0x7f55f81a0650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:28:53.798 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:53.796+0000 7f55fca00700 1 --2- 172.21.15.87:0/1412890830 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f55f81056b0 0x7f55f819bd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:28:53.798 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:53.796+0000 7f55fca00700 1 --2- 172.21.15.87:0/1412890830 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f55f8106070 0x7f55f819c2c0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:28:53.798 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:53.796+0000 7f55fca00700 1 -- 172.21.15.87:0/1412890830 >> 172.21.15.87:0/1412890830 conn(0x7f55f81011e0 msgr2=0x7f55f8101780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:28:53.798 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:53.796+0000 7f55fca00700 1 -- 172.21.15.87:0/1412890830 shutdown_connections 2024-05-08T05:28:53.799 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:53.797+0000 7f55fca00700 1 -- 172.21.15.87:0/1412890830 wait complete. 2024-05-08T05:28:53.799 INFO:teuthology.orchestra.run.smithi087.stderr:dumped fsmap epoch 24 2024-05-08T05:28:54.458 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:28:54 smithi087 ceph-mon[29523]: pgmap v417: 97 pgs: 97 active+clean; 644 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-05-08T05:28:54.459 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:28:54 smithi087 ceph-mon[29523]: from='client.? 172.21.15.87:0/1412890830' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T05:28:54.575 DEBUG:teuthology.orchestra.run.smithi087:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid eeeb813e-0cf9-11ef-bc97-c7b262605968 -- ceph osd dump --format=json 2024-05-08T05:28:54.733 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:28:54 smithi090 ceph-mon[34526]: pgmap v417: 97 pgs: 97 active+clean; 644 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-05-08T05:28:54.733 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:28:54 smithi090 ceph-mon[34526]: from='client.? 172.21.15.87:0/1412890830' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T05:28:54.788 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:28:54 smithi160 ceph-mon[34827]: pgmap v417: 97 pgs: 97 active+clean; 644 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-05-08T05:28:54.789 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:28:54 smithi160 ceph-mon[34827]: from='client.? 172.21.15.87:0/1412890830' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T05:28:55.031 INFO:teuthology.orchestra.run.smithi087.stderr:Inferring config /var/lib/ceph/eeeb813e-0cf9-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T05:28:56.651 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:28:56 smithi087 ceph-mon[29523]: pgmap v418: 97 pgs: 97 active+clean; 644 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-05-08T05:28:56.733 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:28:56 smithi090 ceph-mon[34526]: pgmap v418: 97 pgs: 97 active+clean; 644 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-05-08T05:28:56.788 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:28:56 smithi160 ceph-mon[34827]: pgmap v418: 97 pgs: 97 active+clean; 644 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-05-08T05:28:57.113 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:57.111+0000 7fcf5be00700 1 -- 172.21.15.87:0/412227185 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcf54108850 msgr2=0x7fcf541103d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:28:57.113 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:57.111+0000 7fcf5be00700 1 --2- 172.21.15.87:0/412227185 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcf54108850 0x7fcf541103d0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fcf4c00b0d0 tx=0x7fcf4c00b3e0 comp rx=0 tx=0).stop 2024-05-08T05:28:57.113 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:57.111+0000 7fcf5be00700 1 -- 172.21.15.87:0/412227185 shutdown_connections 2024-05-08T05:28:57.113 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:57.111+0000 7fcf5be00700 1 --2- 172.21.15.87:0/412227185 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcf54108850 0x7fcf541103d0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:28:57.114 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:57.111+0000 7fcf5be00700 1 --2- 172.21.15.87:0/412227185 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fcf54103750 0x7fcf54103b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:28:57.114 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:57.111+0000 7fcf5be00700 1 --2- 172.21.15.87:0/412227185 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fcf54104100 0x7fcf54108120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:28:57.114 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:57.111+0000 7fcf5be00700 1 -- 172.21.15.87:0/412227185 >> 172.21.15.87:0/412227185 conn(0x7fcf5407a600 msgr2=0x7fcf5407aa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:28:57.114 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:57.111+0000 7fcf5be00700 1 -- 172.21.15.87:0/412227185 shutdown_connections 2024-05-08T05:28:57.114 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:57.111+0000 7fcf5be00700 1 -- 172.21.15.87:0/412227185 wait complete. 2024-05-08T05:28:57.115 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:57.112+0000 7fcf5be00700 1 Processor -- start 2024-05-08T05:28:57.115 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:57.112+0000 7fcf5be00700 1 -- start start 2024-05-08T05:28:57.115 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:57.113+0000 7fcf5be00700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fcf54103750 0x7fcf540757a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:28:57.115 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:57.113+0000 7fcf5be00700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcf54104100 0x7fcf54075ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:28:57.115 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:57.113+0000 7fcf5be00700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fcf54108850 0x7fcf54076220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:28:57.116 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:57.113+0000 7fcf5be00700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fcf54113690 con 0x7fcf54104100 2024-05-08T05:28:57.116 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:57.113+0000 7fcf5be00700 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fcf54113510 con 0x7fcf54103750 2024-05-08T05:28:57.116 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:57.113+0000 7fcf5be00700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7fcf54113810 con 0x7fcf54108850 2024-05-08T05:28:57.116 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:57.113+0000 7fcf58a00700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcf54104100 0x7fcf54075ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:28:57.116 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:57.113+0000 7fcf59400700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fcf54103750 0x7fcf540757a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:28:57.116 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:57.113+0000 7fcf58a00700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcf54104100 0x7fcf54075ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:35670/0 (socket says 172.21.15.87:35670) 2024-05-08T05:28:57.116 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:57.113+0000 7fcf58a00700 1 -- 172.21.15.87:0/1597169644 learned_addr learned my addr 172.21.15.87:0/1597169644 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T05:28:57.116 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:57.113+0000 7fcf59e00700 1 --2- 172.21.15.87:0/1597169644 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fcf54108850 0x7fcf54076220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:28:57.116 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:57.114+0000 7fcf59400700 1 -- 172.21.15.87:0/1597169644 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fcf54108850 msgr2=0x7fcf54076220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:28:57.116 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:57.114+0000 7fcf59400700 1 --2- 172.21.15.87:0/1597169644 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fcf54108850 0x7fcf54076220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:28:57.116 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:57.114+0000 7fcf59400700 1 -- 172.21.15.87:0/1597169644 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcf54104100 msgr2=0x7fcf54075ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:28:57.116 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:57.114+0000 7fcf59400700 1 --2- 172.21.15.87:0/1597169644 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcf54104100 0x7fcf54075ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:28:57.116 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:57.114+0000 7fcf59400700 1 -- 172.21.15.87:0/1597169644 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcf541a7ff0 con 0x7fcf54103750 2024-05-08T05:28:57.116 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:57.114+0000 7fcf59e00700 1 --2- 172.21.15.87:0/1597169644 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fcf54108850 0x7fcf54076220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T05:28:57.117 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:57.114+0000 7fcf59400700 1 --2- 172.21.15.87:0/1597169644 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fcf54103750 0x7fcf540757a0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fcf4800e9f0 tx=0x7fcf4800ed00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:28:57.117 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:57.114+0000 7fcf52000700 1 -- 172.21.15.87:0/1597169644 <== mon.2 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf4800cbd0 con 0x7fcf54103750 2024-05-08T05:28:57.117 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:57.114+0000 7fcf5be00700 1 -- 172.21.15.87:0/1597169644 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcf541a82e0 con 0x7fcf54103750 2024-05-08T05:28:57.117 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:57.114+0000 7fcf52000700 1 -- 172.21.15.87:0/1597169644 <== mon.2 v2:172.21.15.90:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fcf4800cd70 con 0x7fcf54103750 2024-05-08T05:28:57.118 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:57.114+0000 7fcf52000700 1 -- 172.21.15.87:0/1597169644 <== mon.2 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf48018680 con 0x7fcf54103750 2024-05-08T05:28:57.118 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:57.115+0000 7fcf5be00700 1 -- 172.21.15.87:0/1597169644 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcf541a8870 con 0x7fcf54103750 2024-05-08T05:28:57.118 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:57.115+0000 7fcf5be00700 1 -- 172.21.15.87:0/1597169644 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcf5406a190 con 0x7fcf54103750 2024-05-08T05:28:57.119 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:57.118+0000 7fcf52000700 1 -- 172.21.15.87:0/1597169644 <== mon.2 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7fcf48010430 con 0x7fcf54103750 2024-05-08T05:28:57.121 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:57.119+0000 7fcf52000700 1 --2- 172.21.15.87:0/1597169644 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7fcf3c0b2900 0x7fcf3c0b4dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:28:57.121 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:57.120+0000 7fcf52000700 1 -- 172.21.15.87:0/1597169644 <== mon.2 v2:172.21.15.90:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8190+0+0 (secure 0 0 0) 0x7fcf480e2570 con 0x7fcf54103750 2024-05-08T05:28:57.122 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:57.120+0000 7fcf58a00700 1 --2- 172.21.15.87:0/1597169644 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7fcf3c0b2900 0x7fcf3c0b4dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:28:57.122 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:57.120+0000 7fcf58a00700 1 --2- 172.21.15.87:0/1597169644 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7fcf3c0b2900 0x7fcf3c0b4dc0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fcf54103010 tx=0x7fcf40009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:28:57.123 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:57.121+0000 7fcf52000700 1 -- 172.21.15.87:0/1597169644 <== mon.2 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7fcf480aa260 con 0x7fcf54103750 2024-05-08T05:28:57.354 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:57.352+0000 7fcf5be00700 1 -- 172.21.15.87:0/1597169644 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fcf5402e6d0 con 0x7fcf54103750 2024-05-08T05:28:57.356 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:57.354+0000 7fcf52000700 1 -- 172.21.15.87:0/1597169644 <== mon.2 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v82) ==== 74+0+22588 (secure 0 0 0) 0x7fcf480a9b60 con 0x7fcf54103750 2024-05-08T05:28:57.357 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-05-08T05:28:57.357 INFO:teuthology.orchestra.run.smithi087.stdout:{"epoch":82,"fsid":"eeeb813e-0cf9-11ef-bc97-c7b262605968","created":"2024-05-08T05:16:14.984330+0000","modified":"2024-05-08T05:26:24.106467+0000","last_up_change":"2024-05-08T05:24:22.324501+0000","last_in_change":"2024-05-08T05:24:01.962570+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-08T05:20:08.907941+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-08T05:25:28.054494+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-08T05:25:32.484126+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"f3e25ce0-0762-46fd-83fb-6766a2e9db69","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6802","nonce":2285285644},{"type":"v1","addr":"172.21.15.87:6803","nonce":2285285644}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6804","nonce":2285285644},{"type":"v1","addr":"172.21.15.87:6805","nonce":2285285644}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6808","nonce":2285285644},{"type":"v1","addr":"172.21.15.87:6809","nonce":2285285644}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6806","nonce":2285285644},{"type":"v1","addr":"172.21.15.87:6807","nonce":2285285644}]},"public_addr":"172.21.15.87:6803/2285285644","cluster_addr":"172.21.15.87:6805/2285285644","heartbeat_back_addr":"172.21.15.87:6809/2285285644","heartbeat_front_addr":"172.21.15.87:6807/2285285644","state":["exists","up"]},{"osd":1,"uuid":"b6de5f4c-1d79-41ff-adee-03d8a47ab55e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6800","nonce":1681573998},{"type":"v1","addr":"172.21.15.90:6801","nonce":1681573998}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6802","nonce":1681573998},{"type":"v1","addr":"172.21.15.90:6803","nonce":1681573998}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6806","nonce":1681573998},{"type":"v1","addr":"172.21.15.90:6807","nonce":1681573998}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6804","nonce":1681573998},{"type":"v1","addr":"172.21.15.90:6805","nonce":1681573998}]},"public_addr":"172.21.15.90:6801/1681573998","cluster_addr":"172.21.15.90:6803/1681573998","heartbeat_back_addr":"172.21.15.90:6807/1681573998","heartbeat_front_addr":"172.21.15.90:6805/1681573998","state":["exists","up"]},{"osd":2,"uuid":"ee3a2729-93b2-4985-b84d-165f92cae8e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6800","nonce":2137179096},{"type":"v1","addr":"172.21.15.160:6801","nonce":2137179096}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6802","nonce":2137179096},{"type":"v1","addr":"172.21.15.160:6803","nonce":2137179096}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6806","nonce":2137179096},{"type":"v1","addr":"172.21.15.160:6807","nonce":2137179096}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6804","nonce":2137179096},{"type":"v1","addr":"172.21.15.160:6805","nonce":2137179096}]},"public_addr":"172.21.15.160:6801/2137179096","cluster_addr":"172.21.15.160:6803/2137179096","heartbeat_back_addr":"172.21.15.160:6807/2137179096","heartbeat_front_addr":"172.21.15.160:6805/2137179096","state":["exists","up"]},{"osd":3,"uuid":"fc7bd69f-5a62-4ec6-b95c-c170be46a7d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6810","nonce":2022667023},{"type":"v1","addr":"172.21.15.87:6811","nonce":2022667023}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6812","nonce":2022667023},{"type":"v1","addr":"172.21.15.87:6813","nonce":2022667023}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6816","nonce":2022667023},{"type":"v1","addr":"172.21.15.87:6817","nonce":2022667023}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6814","nonce":2022667023},{"type":"v1","addr":"172.21.15.87:6815","nonce":2022667023}]},"public_addr":"172.21.15.87:6811/2022667023","cluster_addr":"172.21.15.87:6813/2022667023","heartbeat_back_addr":"172.21.15.87:6817/2022667023","heartbeat_front_addr":"172.21.15.87:6815/2022667023","state":["exists","up"]},{"osd":4,"uuid":"a05f7bd1-962a-4f3e-8f70-e7ef4c68bac2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6808","nonce":1371607578},{"type":"v1","addr":"172.21.15.90:6809","nonce":1371607578}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6810","nonce":1371607578},{"type":"v1","addr":"172.21.15.90:6811","nonce":1371607578}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6814","nonce":1371607578},{"type":"v1","addr":"172.21.15.90:6815","nonce":1371607578}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6812","nonce":1371607578},{"type":"v1","addr":"172.21.15.90:6813","nonce":1371607578}]},"public_addr":"172.21.15.90:6809/1371607578","cluster_addr":"172.21.15.90:6811/1371607578","heartbeat_back_addr":"172.21.15.90:6815/1371607578","heartbeat_front_addr":"172.21.15.90:6813/1371607578","state":["exists","up"]},{"osd":5,"uuid":"85e3af08-32ee-4f26-97df-8d54ba928715","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6808","nonce":2190054276},{"type":"v1","addr":"172.21.15.160:6809","nonce":2190054276}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6810","nonce":2190054276},{"type":"v1","addr":"172.21.15.160:6811","nonce":2190054276}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6814","nonce":2190054276},{"type":"v1","addr":"172.21.15.160:6815","nonce":2190054276}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6812","nonce":2190054276},{"type":"v1","addr":"172.21.15.160:6813","nonce":2190054276}]},"public_addr":"172.21.15.160:6809/2190054276","cluster_addr":"172.21.15.160:6811/2190054276","heartbeat_back_addr":"172.21.15.160:6815/2190054276","heartbeat_front_addr":"172.21.15.160:6813/2190054276","state":["exists","up"]},{"osd":6,"uuid":"df4b22a9-6cd8-473e-a17b-a0cb9ad32e98","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":42,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6818","nonce":2863681447},{"type":"v1","addr":"172.21.15.87:6819","nonce":2863681447}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6820","nonce":2863681447},{"type":"v1","addr":"172.21.15.87:6821","nonce":2863681447}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6824","nonce":2863681447},{"type":"v1","addr":"172.21.15.87:6825","nonce":2863681447}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6822","nonce":2863681447},{"type":"v1","addr":"172.21.15.87:6823","nonce":2863681447}]},"public_addr":"172.21.15.87:6819/2863681447","cluster_addr":"172.21.15.87:6821/2863681447","heartbeat_back_addr":"172.21.15.87:6825/2863681447","heartbeat_front_addr":"172.21.15.87:6823/2863681447","state":["exists","up"]},{"osd":7,"uuid":"f6ef3857-0366-4408-932a-a8c8479ba780","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6816","nonce":1964248958},{"type":"v1","addr":"172.21.15.90:6817","nonce":1964248958}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6818","nonce":1964248958},{"type":"v1","addr":"172.21.15.90:6819","nonce":1964248958}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6822","nonce":1964248958},{"type":"v1","addr":"172.21.15.90:6823","nonce":1964248958}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6820","nonce":1964248958},{"type":"v1","addr":"172.21.15.90:6821","nonce":1964248958}]},"public_addr":"172.21.15.90:6817/1964248958","cluster_addr":"172.21.15.90:6819/1964248958","heartbeat_back_addr":"172.21.15.90:6823/1964248958","heartbeat_front_addr":"172.21.15.90:6821/1964248958","state":["exists","up"]},{"osd":8,"uuid":"027dede9-d0be-4fbe-b7b8-02ce88d57f4d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":54,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6816","nonce":927680738},{"type":"v1","addr":"172.21.15.160:6817","nonce":927680738}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6818","nonce":927680738},{"type":"v1","addr":"172.21.15.160:6819","nonce":927680738}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6822","nonce":927680738},{"type":"v1","addr":"172.21.15.160:6823","nonce":927680738}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6820","nonce":927680738},{"type":"v1","addr":"172.21.15.160:6821","nonce":927680738}]},"public_addr":"172.21.15.160:6817/927680738","cluster_addr":"172.21.15.160:6819/927680738","heartbeat_back_addr":"172.21.15.160:6823/927680738","heartbeat_front_addr":"172.21.15.160:6821/927680738","state":["exists","up"]},{"osd":9,"uuid":"bc9e37de-e509-4db6-bd58-b68e2c8e1aff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6826","nonce":3789116749},{"type":"v1","addr":"172.21.15.87:6827","nonce":3789116749}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6828","nonce":3789116749},{"type":"v1","addr":"172.21.15.87:6829","nonce":3789116749}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6832","nonce":3789116749},{"type":"v1","addr":"172.21.15.87:6833","nonce":3789116749}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6830","nonce":3789116749},{"type":"v1","addr":"172.21.15.87:6831","nonce":3789116749}]},"public_addr":"172.21.15.87:6827/3789116749","cluster_addr":"172.21.15.87:6829/3789116749","heartbeat_back_addr":"172.21.15.87:6833/3789116749","heartbeat_front_addr":"172.21.15.87:6831/3789116749","state":["exists","up"]},{"osd":10,"uuid":"43945081-b4c8-4f5d-9301-3540709e69e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":66,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6824","nonce":716529498},{"type":"v1","addr":"172.21.15.90:6825","nonce":716529498}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6826","nonce":716529498},{"type":"v1","addr":"172.21.15.90:6827","nonce":716529498}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6830","nonce":716529498},{"type":"v1","addr":"172.21.15.90:6831","nonce":716529498}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6828","nonce":716529498},{"type":"v1","addr":"172.21.15.90:6829","nonce":716529498}]},"public_addr":"172.21.15.90:6825/716529498","cluster_addr":"172.21.15.90:6827/716529498","heartbeat_back_addr":"172.21.15.90:6831/716529498","heartbeat_front_addr":"172.21.15.90:6829/716529498","state":["exists","up"]},{"osd":11,"uuid":"da23ff5c-3f79-44e3-bca3-d9d5a003c999","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6824","nonce":1842739135},{"type":"v1","addr":"172.21.15.160:6825","nonce":1842739135}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6826","nonce":1842739135},{"type":"v1","addr":"172.21.15.160:6827","nonce":1842739135}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6830","nonce":1842739135},{"type":"v1","addr":"172.21.15.160:6831","nonce":1842739135}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6828","nonce":1842739135},{"type":"v1","addr":"172.21.15.160:6829","nonce":1842739135}]},"public_addr":"172.21.15.160:6825/1842739135","cluster_addr":"172.21.15.160:6827/1842739135","heartbeat_back_addr":"172.21.15.160:6831/1842739135","heartbeat_front_addr":"172.21.15.160:6829/1842739135","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T05:19:15.869398+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T05:19:42.014078+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T05:20:06.430660+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T05:20:38.555519+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T05:21:04.530605+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T05:21:29.545252+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T05:22:03.141982+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T05:22:29.191127+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T05:22:54.502994+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T05:23:27.899000+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T05:23:54.693979+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T05:24:20.307119+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.a","mappings":[{"from":2,"to":11}]},{"pgid":"2.1d","mappings":[{"from":2,"to":4},{"from":8,"to":11}]},{"pgid":"3.0","mappings":[{"from":4,"to":8}]},{"pgid":"3.1","mappings":[{"from":4,"to":9}]},{"pgid":"3.12","mappings":[{"from":3,"to":9}]},{"pgid":"3.28","mappings":[{"from":5,"to":6}]},{"pgid":"3.2c","mappings":[{"from":4,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.87:0/4226160503":"2024-05-09T05:17:22.736165+0000","172.21.15.87:0/2773684806":"2024-05-09T05:17:22.736165+0000","172.21.15.87:0/349590592":"2024-05-09T05:17:22.736165+0000","172.21.15.87:6801/2710124295":"2024-05-09T05:17:22.736165+0000","172.21.15.87:6800/1823425617":"2024-05-09T05:16:48.155337+0000","172.21.15.87:0/2393072013":"2024-05-09T05:16:48.155337+0000","172.21.15.87:0/1291525416":"2024-05-09T05:16:48.155337+0000","172.21.15.87:6801/1823425617":"2024-05-09T05:16:48.155337+0000","172.21.15.87:0/3839463573":"2024-05-09T05:16:48.155337+0000","172.21.15.87:6800/2710124295":"2024-05-09T05:17:22.736165+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-08T05:28:57.359 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:57.357+0000 7fcf5be00700 1 -- 172.21.15.87:0/1597169644 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7fcf3c0b2900 msgr2=0x7fcf3c0b4dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:28:57.359 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:57.357+0000 7fcf5be00700 1 --2- 172.21.15.87:0/1597169644 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7fcf3c0b2900 0x7fcf3c0b4dc0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fcf54103010 tx=0x7fcf40009260 comp rx=0 tx=0).stop 2024-05-08T05:28:57.359 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:57.357+0000 7fcf5be00700 1 -- 172.21.15.87:0/1597169644 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fcf54103750 msgr2=0x7fcf540757a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:28:57.359 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:57.357+0000 7fcf5be00700 1 --2- 172.21.15.87:0/1597169644 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fcf54103750 0x7fcf540757a0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fcf4800e9f0 tx=0x7fcf4800ed00 comp rx=0 tx=0).stop 2024-05-08T05:28:57.359 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:57.357+0000 7fcf5be00700 1 -- 172.21.15.87:0/1597169644 shutdown_connections 2024-05-08T05:28:57.360 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:57.357+0000 7fcf5be00700 1 --2- 172.21.15.87:0/1597169644 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7fcf3c0b2900 0x7fcf3c0b4dc0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:28:57.360 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:57.357+0000 7fcf5be00700 1 --2- 172.21.15.87:0/1597169644 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fcf54108850 0x7fcf54076220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:28:57.360 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:57.357+0000 7fcf5be00700 1 --2- 172.21.15.87:0/1597169644 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fcf54103750 0x7fcf540757a0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:28:57.360 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:57.358+0000 7fcf5be00700 1 --2- 172.21.15.87:0/1597169644 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcf54104100 0x7fcf54075ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:28:57.360 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:57.358+0000 7fcf5be00700 1 -- 172.21.15.87:0/1597169644 >> 172.21.15.87:0/1597169644 conn(0x7fcf5407a600 msgr2=0x7fcf54101720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:28:57.360 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:57.358+0000 7fcf5be00700 1 -- 172.21.15.87:0/1597169644 shutdown_connections 2024-05-08T05:28:57.360 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:28:57.358+0000 7fcf5be00700 1 -- 172.21.15.87:0/1597169644 wait complete. 2024-05-08T05:28:57.708 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:28:57 smithi087 ceph-mon[29523]: from='client.? 172.21.15.87:0/1597169644' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-08T05:28:57.733 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:28:57 smithi090 ceph-mon[34526]: from='client.? 172.21.15.87:0/1597169644' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-08T05:28:57.788 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:28:57 smithi160 ceph-mon[34827]: from='client.? 172.21.15.87:0/1597169644' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-08T05:28:58.196 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 24, 'flags': 50, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': True, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 32, 'explicitly_allowed_features': 32, 'created': '2024-05-08T05:25:36.816840+0000', 'modified': '2024-05-08T05:25:59.331243+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 3, 'in': [0, 1, 2], 'up': {'mds_0': 24500, 'mds_1': 24482, 'mds_2': 24481}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_24463': {'gid': 24463, 'name': 'f', 'rank': 2, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.160:6835/409648357', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.160:6834', 'nonce': 409648357}, {'type': 'v1', 'addr': '172.21.15.160:6835', 'nonce': 409648357}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24467': {'gid': 24467, 'name': 'h', 'rank': 1, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.90:6837/4221919418', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.90:6836', 'nonce': 4221919418}, {'type': 'v1', 'addr': '172.21.15.90:6837', 'nonce': 4221919418}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24469': {'gid': 24469, 'name': 'c', 'rank': 0, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.160:6837/4200018040', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.160:6836', 'nonce': 4200018040}, {'type': 'v1', 'addr': '172.21.15.160:6837', 'nonce': 4200018040}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24481': {'gid': 24481, 'name': 'i', 'rank': 2, 'incarnation': 20, 'state': 'up:active', 'state_seq': 13, 'addr': '172.21.15.160:6839/234657686', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.160:6838', 'nonce': 234657686}, {'type': 'v1', 'addr': '172.21.15.160:6839', 'nonce': 234657686}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24482': {'gid': 24482, 'name': 'g', 'rank': 1, 'incarnation': 18, 'state': 'up:active', 'state_seq': 12, 'addr': '172.21.15.87:6839/2127215876', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.87:6838', 'nonce': 2127215876}, {'type': 'v1', 'addr': '172.21.15.87:6839', 'nonce': 2127215876}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24500': {'gid': 24500, 'name': 'b', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 6, 'addr': '172.21.15.90:6839/160586017', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.90:6838', 'nonce': 160586017}, {'type': 'v1', 'addr': '172.21.15.90:6839', 'nonce': 160586017}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 24500, 'qdb_cluster': [24482, 24500, 24481]} 2024-05-08T05:28:58.197 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 3/3 2024-05-08T05:28:58.197 DEBUG:teuthology.orchestra.run.smithi087:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid eeeb813e-0cf9-11ef-bc97-c7b262605968 -- ceph tell mds.i status 2024-05-08T05:28:58.458 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:28:58 smithi087 ceph-mon[29523]: pgmap v419: 97 pgs: 97 active+clean; 644 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T05:28:58.635 INFO:teuthology.orchestra.run.smithi087.stderr:Inferring config /var/lib/ceph/eeeb813e-0cf9-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T05:28:58.733 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:28:58 smithi090 ceph-mon[34526]: pgmap v419: 97 pgs: 97 active+clean; 644 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T05:28:58.789 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:28:58 smithi160 ceph-mon[34827]: pgmap v419: 97 pgs: 97 active+clean; 644 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T05:29:00.611 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:00.609+0000 7f843ae00700 1 -- 172.21.15.87:0/1385257157 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8434106080 msgr2=0x7f8434112590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:29:00.611 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:00.609+0000 7f843ae00700 1 --2- 172.21.15.87:0/1385257157 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8434106080 0x7f8434112590 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f842c009f90 tx=0x7f842c00b330 comp rx=0 tx=0).stop 2024-05-08T05:29:00.612 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:00.609+0000 7f843ae00700 1 -- 172.21.15.87:0/1385257157 shutdown_connections 2024-05-08T05:29:00.612 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:00.609+0000 7f843ae00700 1 --2- 172.21.15.87:0/1385257157 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8434106080 0x7f8434112590 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:29:00.612 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:00.609+0000 7f843ae00700 1 --2- 172.21.15.87:0/1385257157 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f843410b6c0 0x7f843410baa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:29:00.612 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:00.609+0000 7f843ae00700 1 --2- 172.21.15.87:0/1385257157 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f84341056c0 0x7f8434105b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:29:00.612 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:00.609+0000 7f843ae00700 1 -- 172.21.15.87:0/1385257157 >> 172.21.15.87:0/1385257157 conn(0x7f84341011b0 msgr2=0x7f84341035d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:29:00.612 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:00.609+0000 7f843ae00700 1 -- 172.21.15.87:0/1385257157 shutdown_connections 2024-05-08T05:29:00.612 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:00.609+0000 7f843ae00700 1 -- 172.21.15.87:0/1385257157 wait complete. 2024-05-08T05:29:00.612 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:00.610+0000 7f843ae00700 1 Processor -- start 2024-05-08T05:29:00.612 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:00.610+0000 7f843ae00700 1 -- start start 2024-05-08T05:29:00.614 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:00.611+0000 7f843ae00700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f84341056c0 0x7f843419bd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:29:00.614 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:00.611+0000 7f843ae00700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f8434106080 0x7f843419c250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:29:00.614 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:00.611+0000 7f843ae00700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f843410b6c0 0x7f84341a05e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:29:00.614 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:00.611+0000 7f843ae00700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f8434115900 con 0x7f84341056c0 2024-05-08T05:29:00.614 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:00.611+0000 7f843ae00700 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f8434115780 con 0x7f843410b6c0 2024-05-08T05:29:00.614 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:00.611+0000 7f843ae00700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f8434115a80 con 0x7f8434106080 2024-05-08T05:29:00.614 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:00.611+0000 7f8433e00700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f84341056c0 0x7f843419bd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:29:00.614 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:00.611+0000 7f8433e00700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f84341056c0 0x7f843419bd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:35680/0 (socket says 172.21.15.87:35680) 2024-05-08T05:29:00.614 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:00.611+0000 7f8433e00700 1 -- 172.21.15.87:0/1393323931 learned_addr learned my addr 172.21.15.87:0/1393323931 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T05:29:00.614 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:00.611+0000 7f842be00700 1 --2- 172.21.15.87:0/1393323931 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f8434106080 0x7f843419c250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:29:00.614 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:00.611+0000 7f8438e00700 1 --2- 172.21.15.87:0/1393323931 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f843410b6c0 0x7f84341a05e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:29:00.614 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:00.611+0000 7f8433e00700 1 -- 172.21.15.87:0/1393323931 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f8434106080 msgr2=0x7f843419c250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:29:00.615 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:00.611+0000 7f8433e00700 1 --2- 172.21.15.87:0/1393323931 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f8434106080 0x7f843419c250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:29:00.615 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:00.611+0000 7f8433e00700 1 -- 172.21.15.87:0/1393323931 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f843410b6c0 msgr2=0x7f84341a05e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:29:00.615 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:00.611+0000 7f8433e00700 1 --2- 172.21.15.87:0/1393323931 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f843410b6c0 0x7f84341a05e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:29:00.615 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:00.611+0000 7f8433e00700 1 -- 172.21.15.87:0/1393323931 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f84341a0d20 con 0x7f84341056c0 2024-05-08T05:29:00.615 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:00.611+0000 7f8438e00700 1 --2- 172.21.15.87:0/1393323931 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f843410b6c0 0x7f84341a05e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T05:29:00.615 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:00.612+0000 7f8433e00700 1 --2- 172.21.15.87:0/1393323931 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f84341056c0 0x7f843419bd10 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f842400e9c0 tx=0x7f842400ecd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:29:00.615 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:00.612+0000 7f8431600700 1 -- 172.21.15.87:0/1393323931 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8424004a30 con 0x7f84341056c0 2024-05-08T05:29:00.615 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:00.612+0000 7f8431600700 1 -- 172.21.15.87:0/1393323931 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f842400cc70 con 0x7f84341056c0 2024-05-08T05:29:00.615 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:00.612+0000 7f843ae00700 1 -- 172.21.15.87:0/1393323931 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f84341a1010 con 0x7f84341056c0 2024-05-08T05:29:00.615 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:00.612+0000 7f8431600700 1 -- 172.21.15.87:0/1393323931 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8424005490 con 0x7f84341056c0 2024-05-08T05:29:00.615 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:00.612+0000 7f843ae00700 1 -- 172.21.15.87:0/1393323931 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f84341a8890 con 0x7f84341056c0 2024-05-08T05:29:00.617 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:00.616+0000 7f8431600700 1 -- 172.21.15.87:0/1393323931 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7f8424004bd0 con 0x7f84341056c0 2024-05-08T05:29:00.618 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:00.617+0000 7f8445881b80 1 Processor -- start 2024-05-08T05:29:00.619 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:00.618+0000 7f8445881b80 1 -- start start 2024-05-08T05:29:00.619 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:00.618+0000 7f8445881b80 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x558071fc1010 0x558071fc13f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:29:00.619 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:00.618+0000 7f8445881b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x558071fc1930 0x558071fc5440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:29:00.619 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:00.618+0000 7f8445881b80 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x558071fc5980 0x558071fc5de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:29:00.619 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:00.618+0000 7f8445881b80 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x558071f139d0 con 0x558071fc1010 2024-05-08T05:29:00.620 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:00.618+0000 7f8445881b80 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x558071eb1710 con 0x558071fc5980 2024-05-08T05:29:00.620 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:00.618+0000 7f8445881b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x558071f0f990 con 0x558071fc1930 2024-05-08T05:29:00.620 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:00.618+0000 7f8431600700 1 --2- 172.21.15.87:0/1393323931 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f84180b2880 0x7f84180b4d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:29:00.621 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:00.618+0000 7f8438e00700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x558071fc1010 0x558071fc13f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:29:00.621 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:00.618+0000 7f8431600700 1 -- 172.21.15.87:0/1393323931 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8190+0+0 (secure 0 0 0) 0x7f84240e22b0 con 0x7f84341056c0 2024-05-08T05:29:00.621 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:00.619+0000 7f8438e00700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x558071fc1010 0x558071fc13f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:35694/0 (socket says 172.21.15.87:35694) 2024-05-08T05:29:00.621 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:00.619+0000 7f8438e00700 1 -- 172.21.15.87:0/1149788609 learned_addr learned my addr 172.21.15.87:0/1149788609 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T05:29:00.621 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:00.619+0000 7f8433e00700 1 --2- 172.21.15.87:0/1149788609 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x558071fc1930 0x558071fc5440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:29:00.621 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:00.619+0000 7f8438e00700 1 --2- 172.21.15.87:0/1393323931 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f84180b2880 0x7f84180b4d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:29:00.621 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:00.619+0000 7f842be00700 1 --2- 172.21.15.87:0/1149788609 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x558071fc5980 0x558071fc5de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:29:00.621 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:00.619+0000 7f8433e00700 1 -- 172.21.15.87:0/1149788609 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x558071fc5980 msgr2=0x558071fc5de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:29:00.621 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:00.619+0000 7f8433e00700 1 --2- 172.21.15.87:0/1149788609 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x558071fc5980 0x558071fc5de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:29:00.621 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:00.619+0000 7f8433e00700 1 -- 172.21.15.87:0/1149788609 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x558071fc1010 msgr2=0x558071fc13f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:29:00.622 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:00.619+0000 7f8433e00700 1 --2- 172.21.15.87:0/1149788609 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x558071fc1010 0x558071fc13f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:29:00.622 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:00.619+0000 7f8433e00700 1 -- 172.21.15.87:0/1149788609 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558071e60880 con 0x558071fc1930 2024-05-08T05:29:00.622 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:00.619+0000 7f8433e00700 1 --2- 172.21.15.87:0/1149788609 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x558071fc1930 0x558071fc5440 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f84240a95a0 tx=0x7f84240a5870 comp rx=0 tx=0).ready entity=mon.1 client_cookie=38f3778b8c8dae8a server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:29:00.622 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:00.619+0000 7f8438e00700 1 --2- 172.21.15.87:0/1393323931 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f84180b2880 0x7f84180b4d40 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f842c00bd50 tx=0x7f842c009700 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:29:00.622 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:00.620+0000 7f8429600700 1 -- 172.21.15.87:0/1149788609 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f842400ce20 con 0x558071fc1930 2024-05-08T05:29:00.622 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:00.620+0000 7f8429600700 1 -- 172.21.15.87:0/1149788609 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8424005650 con 0x558071fc1930 2024-05-08T05:29:00.622 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:00.620+0000 7f8429600700 1 -- 172.21.15.87:0/1149788609 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84240b2700 con 0x558071fc1930 2024-05-08T05:29:00.624 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:00.620+0000 7f8445881b80 1 -- 172.21.15.87:0/1149788609 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x558071fc1930 msgr2=0x558071fc5440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:29:00.624 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:00.620+0000 7f8445881b80 1 --2- 172.21.15.87:0/1149788609 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x558071fc1930 0x558071fc5440 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f84240a95a0 tx=0x7f84240a5870 comp rx=0 tx=0).stop 2024-05-08T05:29:00.624 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:00.621+0000 7f8445881b80 1 -- 172.21.15.87:0/1149788609 shutdown_connections 2024-05-08T05:29:00.624 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:00.621+0000 7f8445881b80 1 --2- 172.21.15.87:0/1149788609 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x558071fc5980 0x558071fc5de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:29:00.624 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:00.621+0000 7f8445881b80 1 --2- 172.21.15.87:0/1149788609 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x558071fc1010 0x558071fc13f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:29:00.624 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:00.621+0000 7f8445881b80 1 --2- 172.21.15.87:0/1149788609 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x558071fc1930 0x558071fc5440 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:29:00.624 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:00.621+0000 7f8445881b80 1 -- 172.21.15.87:0/1149788609 >> 172.21.15.87:0/1149788609 conn(0x558071eefb10 msgr2=0x558071fbb750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:29:00.624 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:00.621+0000 7f8445881b80 1 -- 172.21.15.87:0/1149788609 shutdown_connections 2024-05-08T05:29:00.624 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:00.621+0000 7f8445881b80 1 -- 172.21.15.87:0/1149788609 wait complete. 2024-05-08T05:29:00.624 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:00.621+0000 7f8445881b80 1 -- start start 2024-05-08T05:29:00.624 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:00.621+0000 7f8445881b80 1 Processor -- start 2024-05-08T05:29:00.624 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:00.622+0000 7f8445881b80 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x558071fc1010 0x558071fccdf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:29:00.624 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:00.622+0000 7f8445881b80 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x558071fc1930 0x558071fca190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:29:00.624 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:00.622+0000 7f8445881b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x558071fc5980 0x558071fca6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:29:00.625 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:00.622+0000 7f8445881b80 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x558071fcdb90 con 0x558071fc1930 2024-05-08T05:29:00.625 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:00.622+0000 7f8445881b80 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x558071e79ad0 con 0x558071fc1010 2024-05-08T05:29:00.625 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:00.622+0000 7f8445881b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x558071fcdd10 con 0x558071fc5980 2024-05-08T05:29:00.625 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:00.622+0000 7f8445881b80 10 client.0 _ll_register_callbacks cb 0x558071ebac20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T05:29:00.625 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:00.622+0000 7f842be00700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x558071fc1930 0x558071fca190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:29:00.625 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:00.622+0000 7f842be00700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x558071fc1930 0x558071fca190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:35710/0 (socket says 172.21.15.87:35710) 2024-05-08T05:29:00.625 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:00.622+0000 7f842be00700 1 -- 172.21.15.87:0/3496763489 learned_addr learned my addr 172.21.15.87:0/3496763489 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T05:29:00.625 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:00.622+0000 7f8438e00700 1 --2- 172.21.15.87:0/3496763489 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x558071fc5980 0x558071fca6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:29:00.625 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:00.622+0000 7f8433e00700 1 --2- 172.21.15.87:0/3496763489 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x558071fc1010 0x558071fccdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:29:00.626 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:00.623+0000 7f842be00700 1 -- 172.21.15.87:0/3496763489 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x558071fc5980 msgr2=0x558071fca6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:29:00.626 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:00.623+0000 7f842be00700 1 --2- 172.21.15.87:0/3496763489 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x558071fc5980 0x558071fca6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:29:00.626 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:00.623+0000 7f842be00700 1 -- 172.21.15.87:0/3496763489 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x558071fc1010 msgr2=0x558071fccdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:29:00.626 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:00.623+0000 7f842be00700 1 --2- 172.21.15.87:0/3496763489 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x558071fc1010 0x558071fccdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:29:00.626 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:00.623+0000 7f842be00700 1 -- 172.21.15.87:0/3496763489 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558071ed93d0 con 0x558071fc1930 2024-05-08T05:29:00.626 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:00.623+0000 7f8433e00700 1 --2- 172.21.15.87:0/3496763489 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x558071fc1010 0x558071fccdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T05:29:00.627 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:00.623+0000 7f842be00700 1 --2- 172.21.15.87:0/3496763489 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x558071fc1930 0x558071fca190 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f841c0117c0 tx=0x7f841c011ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3e4c0980ead8857d server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:29:00.627 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:00.623+0000 7f8422000700 10 client.0 ms_handle_connect on v2:172.21.15.87:3300/0 2024-05-08T05:29:00.627 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:00.623+0000 7f8422000700 1 -- 172.21.15.87:0/3496763489 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f841c01f060 con 0x558071fc1930 2024-05-08T05:29:00.627 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:00.624+0000 7f8422000700 1 -- 172.21.15.87:0/3496763489 <== mon.0 v2:172.21.15.87:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8190+0+0 (secure 0 0 0) 0x7f841c00f750 con 0x558071fc1930 2024-05-08T05:29:00.627 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:00.624+0000 7f8445881b80 1 -- 172.21.15.87:0/3496763489 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x558071f8e050 con 0x558071fc1930 2024-05-08T05:29:00.627 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:29:00 smithi087 ceph-mon[29523]: pgmap v420: 97 pgs: 97 active+clean; 644 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-05-08T05:29:00.629 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:00.624+0000 7f8422000700 1 -- 172.21.15.87:0/3496763489 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f841c00f950 con 0x558071fc1930 2024-05-08T05:29:00.629 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:00.624+0000 7f8445881b80 10 client.14859 fetch_fsmap learned FSMap version 24 2024-05-08T05:29:00.629 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:00.624+0000 7f8445881b80 1 -- 172.21.15.87:0/3496763489 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x558071fd8450 con 0x558071fc1930 2024-05-08T05:29:00.629 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:00.624+0000 7f8422000700 1 -- 172.21.15.87:0/3496763489 <== mon.0 v2:172.21.15.87:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x558071f8e050 con 0x558071fc1930 2024-05-08T05:29:00.629 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:00.625+0000 7f8422000700 1 -- 172.21.15.87:0/3496763489 <== mon.0 v2:172.21.15.87:3300/0 5 ==== fsmap(e 24) ==== 8338+0+0 (secure 0 0 0) 0x7f841c019070 con 0x558071fc1930 2024-05-08T05:29:00.629 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:00.625+0000 7f8445881b80 10 client.14859 fetch_fsmap finished waiting for FSMap version 24 2024-05-08T05:29:00.629 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:00.625+0000 7f8445881b80 10 client.14859 resolve_mds: resolved name 'i' to daemon mds.i 2024-05-08T05:29:00.629 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:00.625+0000 7f8445881b80 20 client.14859 populate_metadata read hostname 'smithi087' 2024-05-08T05:29:00.629 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:00.625+0000 7f8445881b80 1 --2- 172.21.15.87:0/3496763489 >> [v2:172.21.15.160:6838/234657686,v1:172.21.15.160:6839/234657686] conn(0x558071fdaaa0 0x558071fdbf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:29:00.629 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:00.625+0000 7f8445881b80 4 client.14859 mds_command: new command op to 24481 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-08T05:29:00.629 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:00.625+0000 7f8445881b80 1 -- 172.21.15.87:0/3496763489 --> [v2:172.21.15.160:6838/234657686,v1:172.21.15.160:6839/234657686] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x558071f213b0 con 0x558071fdaaa0 2024-05-08T05:29:00.630 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:00.625+0000 7f8433e00700 1 --2- 172.21.15.87:0/3496763489 >> [v2:172.21.15.160:6838/234657686,v1:172.21.15.160:6839/234657686] conn(0x558071fdaaa0 0x558071fdbf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:29:00.630 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:00.626+0000 7f8433e00700 1 --2- 172.21.15.87:0/3496763489 >> [v2:172.21.15.160:6838/234657686,v1:172.21.15.160:6839/234657686] conn(0x558071fdaaa0 0x558071fdbf10 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=9c659abd338f9c0 server_cookie=740e29014b155e39 in_seq=0 out_seq=0 2024-05-08T05:29:00.630 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:00.626+0000 7f8422000700 10 client.14859 ms_handle_connect on v2:172.21.15.160:6838/234657686 2024-05-08T05:29:00.630 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:00.627+0000 7f8422000700 1 -- 172.21.15.87:0/3496763489 <== mds.2 v2:172.21.15.160:6838/234657686 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x558071f213b0 con 0x558071fdaaa0 2024-05-08T05:29:00.630 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:00.627+0000 7f8422000700 10 client.14859 handle_command_reply: tid=0 2024-05-08T05:29:00.630 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:00.627+0000 7f8445881b80 1 client.14859 shutdown 2024-05-08T05:29:00.630 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:00.627+0000 7f8445881b80 1 -- 172.21.15.87:0/3496763489 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x558071fc1930 msgr2=0x558071fca190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:29:00.630 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:00.627+0000 7f8445881b80 1 --2- 172.21.15.87:0/3496763489 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x558071fc1930 0x558071fca190 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f841c0117c0 tx=0x7f841c011ad0 comp rx=0 tx=0).stop 2024-05-08T05:29:00.630 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:00.627+0000 7f8445881b80 1 -- 172.21.15.87:0/3496763489 shutdown_connections 2024-05-08T05:29:00.630 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:00.627+0000 7f8445881b80 1 --2- 172.21.15.87:0/3496763489 >> [v2:172.21.15.160:6838/234657686,v1:172.21.15.160:6839/234657686] conn(0x558071fdaaa0 0x558071fdbf10 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:29:00.630 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:00.627+0000 7f8445881b80 1 --2- 172.21.15.87:0/3496763489 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x558071fc5980 0x558071fca6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:29:00.630 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:00.627+0000 7f8445881b80 1 --2- 172.21.15.87:0/3496763489 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x558071fc1010 0x558071fccdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:29:00.630 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:00.627+0000 7f8445881b80 1 --2- 172.21.15.87:0/3496763489 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x558071fc1930 0x558071fca190 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:29:00.631 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:00.627+0000 7f8422000700 0 client.14859 ms_handle_reset on v2:172.21.15.160:6838/234657686 2024-05-08T05:29:00.631 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:00.627+0000 7f8445881b80 1 -- 172.21.15.87:0/3496763489 >> 172.21.15.87:0/3496763489 conn(0x558071eefb10 msgr2=0x558071fb6260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:29:00.631 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:00.627+0000 7f8445881b80 1 -- 172.21.15.87:0/3496763489 shutdown_connections 2024-05-08T05:29:00.631 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:00.627+0000 7f8445881b80 1 -- 172.21.15.87:0/3496763489 wait complete. 2024-05-08T05:29:00.631 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:00.628+0000 7f8445881b80 20 client.14859 trim_cache size 0 max 16384 2024-05-08T05:29:00.652 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:00.650+0000 7f8445881b80 1 Processor -- start 2024-05-08T05:29:00.652 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:00.650+0000 7f8445881b80 1 -- start start 2024-05-08T05:29:00.652 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:00.651+0000 7f8445881b80 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x558071fc1010 0x558071fb60e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:29:00.652 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:00.651+0000 7f8445881b80 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x558071fc1930 0x558071fbfe20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:29:00.652 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:00.651+0000 7f8445881b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x558071fc5980 0x558071fc0360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:29:00.652 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:00.651+0000 7f8445881b80 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x558071fda250 con 0x558071fc1930 2024-05-08T05:29:00.652 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:00.651+0000 7f8445881b80 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x558071fda920 con 0x558071fc1010 2024-05-08T05:29:00.652 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:00.651+0000 7f8445881b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x558071fdaff0 con 0x558071fc5980 2024-05-08T05:29:00.653 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:00.651+0000 7f842be00700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x558071fc1930 0x558071fbfe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:29:00.653 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:00.651+0000 7f842be00700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x558071fc1930 0x558071fbfe20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:35712/0 (socket says 172.21.15.87:35712) 2024-05-08T05:29:00.653 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:00.651+0000 7f842be00700 1 -- 172.21.15.87:0/3079523729 learned_addr learned my addr 172.21.15.87:0/3079523729 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T05:29:00.653 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:00.651+0000 7f8433e00700 1 --2- 172.21.15.87:0/3079523729 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x558071fc1010 0x558071fb60e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:29:00.653 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:00.651+0000 7f8438e00700 1 --2- 172.21.15.87:0/3079523729 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x558071fc5980 0x558071fc0360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:29:00.654 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:00.651+0000 7f842be00700 1 -- 172.21.15.87:0/3079523729 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x558071fc5980 msgr2=0x558071fc0360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:29:00.654 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:00.651+0000 7f842be00700 1 --2- 172.21.15.87:0/3079523729 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x558071fc5980 0x558071fc0360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:29:00.654 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:00.651+0000 7f842be00700 1 -- 172.21.15.87:0/3079523729 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x558071fc1010 msgr2=0x558071fb60e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:29:00.654 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:00.651+0000 7f842be00700 1 --2- 172.21.15.87:0/3079523729 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x558071fc1010 0x558071fb60e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:29:00.654 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:00.651+0000 7f842be00700 1 -- 172.21.15.87:0/3079523729 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558071fbc970 con 0x558071fc1930 2024-05-08T05:29:00.654 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:00.652+0000 7f842be00700 1 --2- 172.21.15.87:0/3079523729 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x558071fc1930 0x558071fbfe20 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f841c011790 tx=0x7f841c0096d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac87687029983e89 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:29:00.654 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:00.652+0000 7f8428c00700 1 -- 172.21.15.87:0/3079523729 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f841c02a070 con 0x558071fc1930 2024-05-08T05:29:00.654 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:00.652+0000 7f8428c00700 1 -- 172.21.15.87:0/3079523729 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f841c00f750 con 0x558071fc1930 2024-05-08T05:29:00.654 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:00.652+0000 7f8428c00700 1 -- 172.21.15.87:0/3079523729 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f841c004930 con 0x558071fc1930 2024-05-08T05:29:00.655 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:00.653+0000 7f8445881b80 1 -- 172.21.15.87:0/3079523729 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x558071fc1930 msgr2=0x558071fbfe20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:29:00.655 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:00.653+0000 7f8445881b80 1 --2- 172.21.15.87:0/3079523729 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x558071fc1930 0x558071fbfe20 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f841c011790 tx=0x7f841c0096d0 comp rx=0 tx=0).stop 2024-05-08T05:29:00.655 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:00.653+0000 7f8445881b80 1 -- 172.21.15.87:0/3079523729 shutdown_connections 2024-05-08T05:29:00.655 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:00.653+0000 7f8445881b80 1 --2- 172.21.15.87:0/3079523729 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x558071fc5980 0x558071fc0360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:29:00.655 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:00.653+0000 7f8445881b80 1 --2- 172.21.15.87:0/3079523729 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x558071fc1010 0x558071fb60e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:29:00.655 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:00.653+0000 7f8445881b80 1 --2- 172.21.15.87:0/3079523729 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x558071fc1930 0x558071fbfe20 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:29:00.655 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:00.653+0000 7f8445881b80 1 -- 172.21.15.87:0/3079523729 >> 172.21.15.87:0/3079523729 conn(0x558071eefb10 msgr2=0x558071fb59d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:29:00.655 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:00.653+0000 7f8445881b80 1 -- 172.21.15.87:0/3079523729 shutdown_connections 2024-05-08T05:29:00.655 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:00.653+0000 7f8445881b80 1 -- 172.21.15.87:0/3079523729 wait complete. 2024-05-08T05:29:00.656 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:00.654+0000 7f8445881b80 1 -- start start 2024-05-08T05:29:00.656 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:00.654+0000 7f8445881b80 1 Processor -- start 2024-05-08T05:29:00.656 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:00.655+0000 7f8445881b80 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x558071fc1010 0x558071fdf070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:29:00.657 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:00.655+0000 7f8445881b80 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x558071fc1930 0x558071fdf5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:29:00.657 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:00.655+0000 7f8445881b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x558071fc5980 0x558071fdfaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:29:00.657 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:00.655+0000 7f8445881b80 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x558071fdbd90 con 0x558071fc1930 2024-05-08T05:29:00.657 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:00.655+0000 7f8445881b80 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x558071fdb6c0 con 0x558071fc1010 2024-05-08T05:29:00.657 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:00.655+0000 7f8445881b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x558071fdc460 con 0x558071fc5980 2024-05-08T05:29:00.657 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:00.655+0000 7f8445881b80 10 client.0 _ll_register_callbacks cb 0x558071fcd480 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T05:29:00.657 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:00.655+0000 7f842be00700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x558071fc1930 0x558071fdf5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:29:00.657 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:00.655+0000 7f8438e00700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x558071fc5980 0x558071fdfaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:29:00.657 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:00.655+0000 7f8438e00700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x558071fc5980 0x558071fdfaf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.87:53078/0 (socket says 172.21.15.87:53078) 2024-05-08T05:29:00.657 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:00.655+0000 7f8438e00700 1 -- 172.21.15.87:0/4133182883 learned_addr learned my addr 172.21.15.87:0/4133182883 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T05:29:00.657 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:00.655+0000 7f842be00700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x558071fc1930 0x558071fdf5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:35724/0 (socket says 172.21.15.87:35724) 2024-05-08T05:29:00.657 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:00.655+0000 7f8433e00700 1 --2- 172.21.15.87:0/4133182883 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x558071fc1010 0x558071fdf070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:29:00.660 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:00.655+0000 7f8438e00700 1 -- 172.21.15.87:0/4133182883 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x558071fc1010 msgr2=0x558071fdf070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:29:00.660 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:00.655+0000 7f8438e00700 1 --2- 172.21.15.87:0/4133182883 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x558071fc1010 0x558071fdf070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:29:00.660 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:00.655+0000 7f8438e00700 1 -- 172.21.15.87:0/4133182883 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x558071fc1930 msgr2=0x558071fdf5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:29:00.660 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:00.655+0000 7f8438e00700 1 --2- 172.21.15.87:0/4133182883 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x558071fc1930 0x558071fdf5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:29:00.660 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:00.655+0000 7f8438e00700 1 -- 172.21.15.87:0/4133182883 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558071fe3a40 con 0x558071fc5980 2024-05-08T05:29:00.660 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:00.656+0000 7f8438e00700 1 --2- 172.21.15.87:0/4133182883 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x558071fc5980 0x558071fdfaf0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f842c007b50 tx=0x7f842c009920 comp rx=0 tx=0).ready entity=mon.1 client_cookie=883b5709beb35c87 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:29:00.660 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:00.656+0000 7f8422000700 10 client.0 ms_handle_connect on v2:172.21.15.160:3300/0 2024-05-08T05:29:00.660 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:00.656+0000 7f8422000700 1 -- 172.21.15.87:0/4133182883 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f842c034030 con 0x558071fc5980 2024-05-08T05:29:00.660 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:00.656+0000 7f8445881b80 1 -- 172.21.15.87:0/4133182883 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f841c00f750 con 0x558071fc5980 2024-05-08T05:29:00.660 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:00.656+0000 7f8422000700 1 -- 172.21.15.87:0/4133182883 <== mon.1 v2:172.21.15.160:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8190+0+0 (secure 0 0 0) 0x7f842c030470 con 0x558071fc5980 2024-05-08T05:29:00.660 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:00.656+0000 7f8422000700 1 -- 172.21.15.87:0/4133182883 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f842c00be60 con 0x558071fc5980 2024-05-08T05:29:00.661 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:00.656+0000 7f8445881b80 10 client.24967 fetch_fsmap learned FSMap version 24 2024-05-08T05:29:00.661 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:00.656+0000 7f8445881b80 1 -- 172.21.15.87:0/4133182883 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55807204ec80 con 0x558071fc5980 2024-05-08T05:29:00.661 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:00.657+0000 7f8422000700 1 -- 172.21.15.87:0/4133182883 <== mon.1 v2:172.21.15.160:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f841c00f750 con 0x558071fc5980 2024-05-08T05:29:00.661 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:00.657+0000 7f8422000700 1 -- 172.21.15.87:0/4133182883 <== mon.1 v2:172.21.15.160:3300/0 5 ==== fsmap(e 24) ==== 8338+0+0 (secure 0 0 0) 0x7f842c011070 con 0x558071fc5980 2024-05-08T05:29:00.661 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:00.657+0000 7f8445881b80 10 client.24967 fetch_fsmap finished waiting for FSMap version 24 2024-05-08T05:29:00.661 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:00.657+0000 7f8445881b80 10 client.24967 resolve_mds: resolved name 'i' to daemon mds.i 2024-05-08T05:29:00.661 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:00.657+0000 7f8445881b80 20 client.24967 populate_metadata read hostname 'smithi087' 2024-05-08T05:29:00.661 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:00.657+0000 7f8445881b80 1 --2- 172.21.15.87:0/4133182883 >> [v2:172.21.15.160:6838/234657686,v1:172.21.15.160:6839/234657686] conn(0x558072053910 0x558072052620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:29:00.661 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:00.657+0000 7f8445881b80 4 client.24967 mds_command: new command op to 24481 tid=0 multi_id=0 [{"prefix": "status"}] 2024-05-08T05:29:00.661 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:00.657+0000 7f8445881b80 1 -- 172.21.15.87:0/4133182883 --> [v2:172.21.15.160:6838/234657686,v1:172.21.15.160:6839/234657686] -- command(tid 0: {"prefix": "status"}) -- 0x558071f1b450 con 0x558072053910 2024-05-08T05:29:00.661 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:00.657+0000 7f8433e00700 1 --2- 172.21.15.87:0/4133182883 >> [v2:172.21.15.160:6838/234657686,v1:172.21.15.160:6839/234657686] conn(0x558072053910 0x558072052620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:29:00.661 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:00.658+0000 7f8422000700 10 client.24967 ms_handle_connect on v2:172.21.15.160:6838/234657686 2024-05-08T05:29:00.661 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:00.658+0000 7f8433e00700 1 --2- 172.21.15.87:0/4133182883 >> [v2:172.21.15.160:6838/234657686,v1:172.21.15.160:6839/234657686] conn(0x558072053910 0x558072052620 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=e647e266d9a5a379 server_cookie=4d1c9c1b6e288825 in_seq=0 out_seq=0 2024-05-08T05:29:00.661 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:00.658+0000 7f8422000700 1 -- 172.21.15.87:0/4133182883 <== mds.2 v2:172.21.15.160:6838/234657686 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x558071f1b450 con 0x558072053910 2024-05-08T05:29:00.661 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:00.658+0000 7f8422000700 10 client.24967 handle_command_reply: tid=0 2024-05-08T05:29:00.661 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:00.658+0000 7f8445881b80 1 client.24967 shutdown 2024-05-08T05:29:00.662 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:00.658+0000 7f8445881b80 1 -- 172.21.15.87:0/4133182883 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x558071fc5980 msgr2=0x558071fdfaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:29:00.662 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:00.658+0000 7f8445881b80 1 --2- 172.21.15.87:0/4133182883 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x558071fc5980 0x558071fdfaf0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f842c007b50 tx=0x7f842c009920 comp rx=0 tx=0).stop 2024-05-08T05:29:00.662 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:00.658+0000 7f8445881b80 1 -- 172.21.15.87:0/4133182883 shutdown_connections 2024-05-08T05:29:00.662 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:00.658+0000 7f8445881b80 1 --2- 172.21.15.87:0/4133182883 >> [v2:172.21.15.160:6838/234657686,v1:172.21.15.160:6839/234657686] conn(0x558072053910 0x558072052620 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:29:00.662 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:00.658+0000 7f8445881b80 1 --2- 172.21.15.87:0/4133182883 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x558071fc5980 0x558071fdfaf0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:29:00.662 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:00.658+0000 7f8445881b80 1 --2- 172.21.15.87:0/4133182883 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x558071fc1010 0x558071fdf070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:29:00.662 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:00.658+0000 7f8422000700 0 client.24967 ms_handle_reset on v2:172.21.15.160:6838/234657686 2024-05-08T05:29:00.662 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:00.658+0000 7f8445881b80 1 --2- 172.21.15.87:0/4133182883 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x558071fc1930 0x558071fdf5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:29:00.662 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:00.658+0000 7f8445881b80 1 -- 172.21.15.87:0/4133182883 >> 172.21.15.87:0/4133182883 conn(0x558071eefb10 msgr2=0x558071fc86e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:29:00.662 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:00.658+0000 7f8445881b80 1 -- 172.21.15.87:0/4133182883 shutdown_connections 2024-05-08T05:29:00.662 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:00.658+0000 7f8445881b80 1 -- 172.21.15.87:0/4133182883 wait complete. 2024-05-08T05:29:00.662 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:00.659+0000 7f8445881b80 20 client.24967 trim_cache size 0 max 16384 2024-05-08T05:29:00.663 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-05-08T05:29:00.663 INFO:teuthology.orchestra.run.smithi087.stdout: "cluster_fsid": "eeeb813e-0cf9-11ef-bc97-c7b262605968", 2024-05-08T05:29:00.663 INFO:teuthology.orchestra.run.smithi087.stdout: "whoami": 2, 2024-05-08T05:29:00.663 INFO:teuthology.orchestra.run.smithi087.stdout: "id": 24481, 2024-05-08T05:29:00.663 INFO:teuthology.orchestra.run.smithi087.stdout: "want_state": "up:active", 2024-05-08T05:29:00.663 INFO:teuthology.orchestra.run.smithi087.stdout: "state": "up:active", 2024-05-08T05:29:00.663 INFO:teuthology.orchestra.run.smithi087.stdout: "fs_name": "cephfs", 2024-05-08T05:29:00.663 INFO:teuthology.orchestra.run.smithi087.stdout: "rank_uptime": 187.75291245599999, 2024-05-08T05:29:00.663 INFO:teuthology.orchestra.run.smithi087.stdout: "mdsmap_epoch": 24, 2024-05-08T05:29:00.663 INFO:teuthology.orchestra.run.smithi087.stdout: "osdmap_epoch": 82, 2024-05-08T05:29:00.663 INFO:teuthology.orchestra.run.smithi087.stdout: "osdmap_epoch_barrier": 80, 2024-05-08T05:29:00.663 INFO:teuthology.orchestra.run.smithi087.stdout: "uptime": 234.86893400599999 2024-05-08T05:29:00.664 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-05-08T05:29:00.664 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:00.659+0000 7f843ae00700 1 -- 172.21.15.87:0/1393323931 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f84180b2880 msgr2=0x7f84180b4d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:29:00.664 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:00.659+0000 7f843ae00700 1 --2- 172.21.15.87:0/1393323931 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f84180b2880 0x7f84180b4d40 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f842c00bd50 tx=0x7f842c009700 comp rx=0 tx=0).stop 2024-05-08T05:29:00.664 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:00.659+0000 7f843ae00700 1 -- 172.21.15.87:0/1393323931 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f84341056c0 msgr2=0x7f843419bd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:29:00.664 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:00.659+0000 7f843ae00700 1 --2- 172.21.15.87:0/1393323931 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f84341056c0 0x7f843419bd10 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f842400e9c0 tx=0x7f842400ecd0 comp rx=0 tx=0).stop 2024-05-08T05:29:00.664 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:00.660+0000 7f843ae00700 1 -- 172.21.15.87:0/1393323931 shutdown_connections 2024-05-08T05:29:00.664 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:00.660+0000 7f843ae00700 1 --2- 172.21.15.87:0/1393323931 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f843410b6c0 0x7f84341a05e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:29:00.665 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:00.660+0000 7f843ae00700 1 --2- 172.21.15.87:0/1393323931 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f84341056c0 0x7f843419bd10 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:29:00.665 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:00.660+0000 7f843ae00700 1 --2- 172.21.15.87:0/1393323931 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f84180b2880 0x7f84180b4d40 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:29:00.665 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:00.660+0000 7f843ae00700 1 --2- 172.21.15.87:0/1393323931 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f8434106080 0x7f843419c250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:29:00.665 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:00.660+0000 7f843ae00700 1 -- 172.21.15.87:0/1393323931 >> 172.21.15.87:0/1393323931 conn(0x7f84341011b0 msgr2=0x7f84341016d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:29:00.665 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:00.660+0000 7f843ae00700 1 -- 172.21.15.87:0/1393323931 shutdown_connections 2024-05-08T05:29:00.665 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:00.660+0000 7f843ae00700 1 -- 172.21.15.87:0/1393323931 wait complete. 2024-05-08T05:29:00.733 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:29:00 smithi090 ceph-mon[34526]: pgmap v420: 97 pgs: 97 active+clean; 644 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-05-08T05:29:00.788 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:29:00 smithi160 ceph-mon[34827]: pgmap v420: 97 pgs: 97 active+clean; 644 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-05-08T05:29:01.442 DEBUG:teuthology.orchestra.run.smithi087:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid eeeb813e-0cf9-11ef-bc97-c7b262605968 -- ceph tell mds.g status 2024-05-08T05:29:01.876 INFO:teuthology.orchestra.run.smithi087.stderr:Inferring config /var/lib/ceph/eeeb813e-0cf9-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T05:29:02.708 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:29:02 smithi087 ceph-mon[29523]: pgmap v421: 97 pgs: 97 active+clean; 644 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T05:29:02.733 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:29:02 smithi090 ceph-mon[34526]: pgmap v421: 97 pgs: 97 active+clean; 644 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T05:29:02.788 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:29:02 smithi160 ceph-mon[34827]: pgmap v421: 97 pgs: 97 active+clean; 644 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T05:29:04.026 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:04.024+0000 7f06fec00700 1 -- 172.21.15.87:0/2557233065 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f06f8105690 msgr2=0x7f06f8105b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:29:04.026 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:04.024+0000 7f06fec00700 1 --2- 172.21.15.87:0/2557233065 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f06f8105690 0x7f06f8105b10 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f06e40098f0 tx=0x7f06e4009c00 comp rx=0 tx=0).stop 2024-05-08T05:29:04.026 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:04.024+0000 7f06fec00700 1 -- 172.21.15.87:0/2557233065 shutdown_connections 2024-05-08T05:29:04.026 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:04.024+0000 7f06fec00700 1 --2- 172.21.15.87:0/2557233065 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f06f8106050 0x7f06f8112560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:29:04.026 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:04.024+0000 7f06fec00700 1 --2- 172.21.15.87:0/2557233065 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f06f810b690 0x7f06f810ba70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:29:04.026 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:04.024+0000 7f06fec00700 1 --2- 172.21.15.87:0/2557233065 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f06f8105690 0x7f06f8105b10 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:29:04.027 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:04.024+0000 7f06fec00700 1 -- 172.21.15.87:0/2557233065 >> 172.21.15.87:0/2557233065 conn(0x7f06f8101180 msgr2=0x7f06f81035a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:29:04.027 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:04.024+0000 7f06fec00700 1 -- 172.21.15.87:0/2557233065 shutdown_connections 2024-05-08T05:29:04.027 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:04.024+0000 7f06fec00700 1 -- 172.21.15.87:0/2557233065 wait complete. 2024-05-08T05:29:04.028 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:04.026+0000 7f06fec00700 1 Processor -- start 2024-05-08T05:29:04.028 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:04.026+0000 7f06fec00700 1 -- start start 2024-05-08T05:29:04.028 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:04.026+0000 7f06fec00700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f06f8105690 0x7f06f819bdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:29:04.028 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:04.026+0000 7f06fec00700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f06f8106050 0x7f06f819c310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:29:04.028 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:04.026+0000 7f06fec00700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f06f810b690 0x7f06f81a06a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:29:04.028 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:04.026+0000 7f06fec00700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f06f8115920 con 0x7f06f810b690 2024-05-08T05:29:04.028 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:04.026+0000 7f06fec00700 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f06f81157a0 con 0x7f06f8105690 2024-05-08T05:29:04.028 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:04.026+0000 7f06fec00700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f06f8115aa0 con 0x7f06f8106050 2024-05-08T05:29:04.029 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:04.027+0000 7f06fcc00700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f06f810b690 0x7f06f81a06a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:29:04.029 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:04.027+0000 7f06f7400700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f06f8106050 0x7f06f819c310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:29:04.029 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:04.027+0000 7f06f7e00700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f06f8105690 0x7f06f819bdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:29:04.029 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:04.027+0000 7f06fcc00700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f06f810b690 0x7f06f81a06a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:35746/0 (socket says 172.21.15.87:35746) 2024-05-08T05:29:04.030 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:04.027+0000 7f06fcc00700 1 -- 172.21.15.87:0/1445337070 learned_addr learned my addr 172.21.15.87:0/1445337070 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T05:29:04.030 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:04.027+0000 7f06f7400700 1 -- 172.21.15.87:0/1445337070 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f06f8105690 msgr2=0x7f06f819bdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:29:04.030 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:04.027+0000 7f06f7400700 1 --2- 172.21.15.87:0/1445337070 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f06f8105690 0x7f06f819bdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:29:04.030 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:04.027+0000 7f06f7400700 1 -- 172.21.15.87:0/1445337070 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f06f810b690 msgr2=0x7f06f81a06a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:29:04.030 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:04.027+0000 7f06f7400700 1 --2- 172.21.15.87:0/1445337070 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f06f810b690 0x7f06f81a06a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:29:04.030 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:04.027+0000 7f06f7400700 1 -- 172.21.15.87:0/1445337070 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f06f81a0de0 con 0x7f06f8106050 2024-05-08T05:29:04.030 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:04.028+0000 7f06f7400700 1 --2- 172.21.15.87:0/1445337070 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f06f8106050 0x7f06f819c310 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f06e400c010 tx=0x7f06e400fa00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:29:04.030 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:04.028+0000 7f06f4c00700 1 -- 172.21.15.87:0/1445337070 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06e40050c0 con 0x7f06f8106050 2024-05-08T05:29:04.030 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:04.028+0000 7f06f4c00700 1 -- 172.21.15.87:0/1445337070 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f06e400b560 con 0x7f06f8106050 2024-05-08T05:29:04.030 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:04.028+0000 7f06fec00700 1 -- 172.21.15.87:0/1445337070 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f06f81a1070 con 0x7f06f8106050 2024-05-08T05:29:04.030 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:04.028+0000 7f06f4c00700 1 -- 172.21.15.87:0/1445337070 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06e4003a00 con 0x7f06f8106050 2024-05-08T05:29:04.030 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:04.028+0000 7f06fec00700 1 -- 172.21.15.87:0/1445337070 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f06f81a8950 con 0x7f06f8106050 2024-05-08T05:29:04.035 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:04.034+0000 7f0709494b80 1 Processor -- start 2024-05-08T05:29:04.035 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:04.034+0000 7f06f4c00700 1 -- 172.21.15.87:0/1445337070 <== mon.1 v2:172.21.15.160:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7f06e400b710 con 0x7f06f8106050 2024-05-08T05:29:04.036 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:04.034+0000 7f0709494b80 1 -- start start 2024-05-08T05:29:04.036 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:04.035+0000 7f0709494b80 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55c154cf5010 0x55c154cf53f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:29:04.036 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:04.035+0000 7f0709494b80 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55c154cf5930 0x55c154cf9440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:29:04.036 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:04.035+0000 7f0709494b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55c154cf9980 0x55c154cf9de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:29:04.036 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:04.035+0000 7f0709494b80 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x55c154c479d0 con 0x55c154cf5010 2024-05-08T05:29:04.036 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:04.035+0000 7f0709494b80 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x55c154be5710 con 0x55c154cf5930 2024-05-08T05:29:04.036 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:04.035+0000 7f0709494b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x55c154c43990 con 0x55c154cf9980 2024-05-08T05:29:04.037 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:04.035+0000 7f06fcc00700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55c154cf5010 0x55c154cf53f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:29:04.037 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:04.035+0000 7f06fcc00700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55c154cf5010 0x55c154cf53f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:35760/0 (socket says 172.21.15.87:35760) 2024-05-08T05:29:04.037 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:04.035+0000 7f06fcc00700 1 -- 172.21.15.87:0/947468482 learned_addr learned my addr 172.21.15.87:0/947468482 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T05:29:04.037 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:04.035+0000 7f06f7e00700 1 --2- 172.21.15.87:0/947468482 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55c154cf5930 0x55c154cf9440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:29:04.038 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:04.035+0000 7f06f7400700 1 --2- 172.21.15.87:0/947468482 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55c154cf9980 0x55c154cf9de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:29:04.038 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:04.036+0000 7f06fcc00700 1 -- 172.21.15.87:0/947468482 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55c154cf9980 msgr2=0x55c154cf9de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:29:04.038 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:04.036+0000 7f06fcc00700 1 --2- 172.21.15.87:0/947468482 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55c154cf9980 0x55c154cf9de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:29:04.038 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:04.036+0000 7f06fcc00700 1 -- 172.21.15.87:0/947468482 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55c154cf5930 msgr2=0x55c154cf9440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:29:04.038 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:04.036+0000 7f06fcc00700 1 --2- 172.21.15.87:0/947468482 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55c154cf5930 0x55c154cf9440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:29:04.038 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:04.036+0000 7f06fcc00700 1 -- 172.21.15.87:0/947468482 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c154b94880 con 0x55c154cf5010 2024-05-08T05:29:04.038 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:04.036+0000 7f06f7e00700 1 --2- 172.21.15.87:0/947468482 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55c154cf5930 0x55c154cf9440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T05:29:04.038 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:04.036+0000 7f06fcc00700 1 --2- 172.21.15.87:0/947468482 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55c154cf5010 0x55c154cf53f0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f06f000c5e0 tx=0x7f06f00099e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7dee236d42f90f92 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:29:04.038 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:04.036+0000 7f06f4c00700 1 --2- 172.21.15.87:0/1445337070 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f06dc0b2900 0x7f06dc0b4dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:29:04.039 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:04.036+0000 7f06f4c00700 1 -- 172.21.15.87:0/1445337070 <== mon.1 v2:172.21.15.160:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8190+0+0 (secure 0 0 0) 0x7f06e40e2f50 con 0x7f06f8106050 2024-05-08T05:29:04.040 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:04.036+0000 7f06ed600700 1 -- 172.21.15.87:0/947468482 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06f0019020 con 0x55c154cf5010 2024-05-08T05:29:04.040 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:04.036+0000 7f06f7e00700 1 --2- 172.21.15.87:0/1445337070 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f06dc0b2900 0x7f06dc0b4dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:29:04.040 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:04.037+0000 7f06ed600700 1 -- 172.21.15.87:0/947468482 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f06f0007a70 con 0x55c154cf5010 2024-05-08T05:29:04.040 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:04.037+0000 7f06ed600700 1 -- 172.21.15.87:0/947468482 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06f0015990 con 0x55c154cf5010 2024-05-08T05:29:04.040 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:04.037+0000 7f06f7e00700 1 --2- 172.21.15.87:0/1445337070 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f06dc0b2900 0x7f06dc0b4dc0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f06e8009f80 tx=0x7f06e8009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:29:04.040 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:04.037+0000 7f0709494b80 1 -- 172.21.15.87:0/947468482 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55c154cf5010 msgr2=0x55c154cf53f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:29:04.040 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:04.037+0000 7f0709494b80 1 --2- 172.21.15.87:0/947468482 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55c154cf5010 0x55c154cf53f0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f06f000c5e0 tx=0x7f06f00099e0 comp rx=0 tx=0).stop 2024-05-08T05:29:04.040 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:04.038+0000 7f0709494b80 1 -- 172.21.15.87:0/947468482 shutdown_connections 2024-05-08T05:29:04.040 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:04.038+0000 7f0709494b80 1 --2- 172.21.15.87:0/947468482 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55c154cf9980 0x55c154cf9de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:29:04.040 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:04.038+0000 7f0709494b80 1 --2- 172.21.15.87:0/947468482 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55c154cf5010 0x55c154cf53f0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:29:04.040 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:04.038+0000 7f0709494b80 1 --2- 172.21.15.87:0/947468482 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55c154cf5930 0x55c154cf9440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:29:04.040 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:04.038+0000 7f0709494b80 1 -- 172.21.15.87:0/947468482 >> 172.21.15.87:0/947468482 conn(0x55c154c23b10 msgr2=0x55c154cef750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:29:04.040 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:04.038+0000 7f0709494b80 1 -- 172.21.15.87:0/947468482 shutdown_connections 2024-05-08T05:29:04.040 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:04.038+0000 7f0709494b80 1 -- 172.21.15.87:0/947468482 wait complete. 2024-05-08T05:29:04.041 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:04.038+0000 7f0709494b80 1 -- start start 2024-05-08T05:29:04.041 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:04.039+0000 7f0709494b80 1 Processor -- start 2024-05-08T05:29:04.043 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:04.039+0000 7f0709494b80 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55c154cf5010 0x55c154d00e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:29:04.043 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:04.039+0000 7f0709494b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55c154cf5930 0x55c154cfe1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:29:04.043 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:04.039+0000 7f0709494b80 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55c154cf9980 0x55c154cfe6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:29:04.043 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:04.039+0000 7f0709494b80 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x55c154d01b90 con 0x55c154cf9980 2024-05-08T05:29:04.043 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:04.039+0000 7f0709494b80 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x55c154badad0 con 0x55c154cf5010 2024-05-08T05:29:04.043 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:04.039+0000 7f0709494b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x55c154d01d10 con 0x55c154cf5930 2024-05-08T05:29:04.044 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:04.039+0000 7f0709494b80 10 client.0 _ll_register_callbacks cb 0x55c154beec20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T05:29:04.044 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:04.039+0000 7f06f7e00700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55c154cf5010 0x55c154d00e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:29:04.044 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:04.039+0000 7f06fcc00700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55c154cf9980 0x55c154cfe6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:29:04.044 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:04.039+0000 7f06f7e00700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55c154cf5010 0x55c154d00e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.87:40774/0 (socket says 172.21.15.87:40774) 2024-05-08T05:29:04.044 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:04.039+0000 7f06f7e00700 1 -- 172.21.15.87:0/2742699989 learned_addr learned my addr 172.21.15.87:0/2742699989 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T05:29:04.044 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:04.040+0000 7f06f7400700 1 --2- 172.21.15.87:0/2742699989 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55c154cf5930 0x55c154cfe1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:29:04.044 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:04.040+0000 7f06f7e00700 1 -- 172.21.15.87:0/2742699989 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55c154cf5930 msgr2=0x55c154cfe1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:29:04.044 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:04.040+0000 7f06f7e00700 1 --2- 172.21.15.87:0/2742699989 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55c154cf5930 0x55c154cfe1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:29:04.044 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:04.040+0000 7f06f7e00700 1 -- 172.21.15.87:0/2742699989 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55c154cf9980 msgr2=0x55c154cfe6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:29:04.044 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:04.040+0000 7f06f7e00700 1 --2- 172.21.15.87:0/2742699989 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55c154cf9980 0x55c154cfe6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:29:04.044 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:04.040+0000 7f06f7e00700 1 -- 172.21.15.87:0/2742699989 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c154c0d3d0 con 0x55c154cf5010 2024-05-08T05:29:04.044 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:04.040+0000 7f06f7400700 1 --2- 172.21.15.87:0/2742699989 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55c154cf5930 0x55c154cfe1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T05:29:04.044 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:04.040+0000 7f06fcc00700 1 --2- 172.21.15.87:0/2742699989 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55c154cf9980 0x55c154cfe6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T05:29:04.044 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:04.040+0000 7f06f7e00700 1 --2- 172.21.15.87:0/2742699989 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55c154cf5010 0x55c154d00e00 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f06e8004620 tx=0x7f06e80047c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1ae8bc2bdf9145f9 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:29:04.045 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:04.040+0000 7f06e2000700 10 client.0 ms_handle_connect on v2:172.21.15.90:3300/0 2024-05-08T05:29:04.045 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:04.041+0000 7f06e2000700 1 -- 172.21.15.87:0/2742699989 <== mon.2 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06e802c060 con 0x55c154cf5010 2024-05-08T05:29:04.045 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:04.041+0000 7f06e2000700 1 -- 172.21.15.87:0/2742699989 <== mon.2 v2:172.21.15.90:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8190+0+0 (secure 0 0 0) 0x7f06e8012d60 con 0x55c154cf5010 2024-05-08T05:29:04.045 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:04.041+0000 7f0709494b80 1 -- 172.21.15.87:0/2742699989 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f06f0007a70 con 0x55c154cf5010 2024-05-08T05:29:04.045 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:04.041+0000 7f06e2000700 1 -- 172.21.15.87:0/2742699989 <== mon.2 v2:172.21.15.90:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f06e801d440 con 0x55c154cf5010 2024-05-08T05:29:04.045 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:04.041+0000 7f0709494b80 10 client.24974 fetch_fsmap learned FSMap version 24 2024-05-08T05:29:04.045 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:04.041+0000 7f0709494b80 1 -- 172.21.15.87:0/2742699989 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55c154d0c4a0 con 0x55c154cf5010 2024-05-08T05:29:04.045 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:04.041+0000 7f06e2000700 1 -- 172.21.15.87:0/2742699989 <== mon.2 v2:172.21.15.90:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f06f0007a70 con 0x55c154cf5010 2024-05-08T05:29:04.045 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:04.042+0000 7f06e2000700 1 -- 172.21.15.87:0/2742699989 <== mon.2 v2:172.21.15.90:3300/0 5 ==== fsmap(e 24) ==== 8338+0+0 (secure 0 0 0) 0x7f06e8026030 con 0x55c154cf5010 2024-05-08T05:29:04.045 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:04.042+0000 7f0709494b80 10 client.24974 fetch_fsmap finished waiting for FSMap version 24 2024-05-08T05:29:04.045 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:04.042+0000 7f0709494b80 10 client.24974 resolve_mds: resolved name 'g' to daemon mds.g 2024-05-08T05:29:04.045 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:04.042+0000 7f0709494b80 20 client.24974 populate_metadata read hostname 'smithi087' 2024-05-08T05:29:04.045 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:04.042+0000 7f0709494b80 1 --2- 172.21.15.87:0/2742699989 >> [v2:172.21.15.87:6838/2127215876,v1:172.21.15.87:6839/2127215876] conn(0x55c154d0ea60 0x55c154d0fed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:29:04.045 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:04.042+0000 7f0709494b80 4 client.24974 mds_command: new command op to 24482 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-08T05:29:04.045 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:04.042+0000 7f0709494b80 1 -- 172.21.15.87:0/2742699989 --> [v2:172.21.15.87:6838/2127215876,v1:172.21.15.87:6839/2127215876] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c154cc2050 con 0x55c154d0ea60 2024-05-08T05:29:04.046 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:04.042+0000 7f06f7400700 1 --2- 172.21.15.87:0/2742699989 >> [v2:172.21.15.87:6838/2127215876,v1:172.21.15.87:6839/2127215876] conn(0x55c154d0ea60 0x55c154d0fed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:29:04.047 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:04.043+0000 7f06e2000700 10 client.24974 ms_handle_connect on v2:172.21.15.87:6838/2127215876 2024-05-08T05:29:04.047 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:04.043+0000 7f06f7400700 1 --2- 172.21.15.87:0/2742699989 >> [v2:172.21.15.87:6838/2127215876,v1:172.21.15.87:6839/2127215876] conn(0x55c154d0ea60 0x55c154d0fed0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=f54bcc0a31562849 server_cookie=15bc9daacd346c61 in_seq=0 out_seq=0 2024-05-08T05:29:04.047 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:04.044+0000 7f06e2000700 1 -- 172.21.15.87:0/2742699989 <== mds.1 v2:172.21.15.87:6838/2127215876 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55c154cc2050 con 0x55c154d0ea60 2024-05-08T05:29:04.047 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:04.044+0000 7f06e2000700 10 client.24974 handle_command_reply: tid=0 2024-05-08T05:29:04.047 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:04.044+0000 7f0709494b80 1 client.24974 shutdown 2024-05-08T05:29:04.047 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:04.044+0000 7f0709494b80 1 -- 172.21.15.87:0/2742699989 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55c154cf5010 msgr2=0x55c154d00e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:29:04.047 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:04.044+0000 7f0709494b80 1 --2- 172.21.15.87:0/2742699989 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55c154cf5010 0x55c154d00e00 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f06e8004620 tx=0x7f06e80047c0 comp rx=0 tx=0).stop 2024-05-08T05:29:04.047 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:04.044+0000 7f0709494b80 1 -- 172.21.15.87:0/2742699989 shutdown_connections 2024-05-08T05:29:04.047 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:04.044+0000 7f0709494b80 1 --2- 172.21.15.87:0/2742699989 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55c154cf9980 0x55c154cfe6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:29:04.047 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:04.044+0000 7f0709494b80 1 --2- 172.21.15.87:0/2742699989 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55c154cf5010 0x55c154d00e00 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:29:04.048 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:04.044+0000 7f0709494b80 1 --2- 172.21.15.87:0/2742699989 >> [v2:172.21.15.87:6838/2127215876,v1:172.21.15.87:6839/2127215876] conn(0x55c154d0ea60 0x55c154d0fed0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:29:04.048 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:04.044+0000 7f0709494b80 1 --2- 172.21.15.87:0/2742699989 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55c154cf5930 0x55c154cfe1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:29:04.048 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:04.044+0000 7f0709494b80 1 -- 172.21.15.87:0/2742699989 >> 172.21.15.87:0/2742699989 conn(0x55c154c23b10 msgr2=0x55c154cea260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:29:04.048 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:04.044+0000 7f06e2000700 0 client.24974 ms_handle_reset on v2:172.21.15.87:6838/2127215876 2024-05-08T05:29:04.048 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:04.044+0000 7f0709494b80 1 -- 172.21.15.87:0/2742699989 shutdown_connections 2024-05-08T05:29:04.048 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:04.044+0000 7f0709494b80 1 -- 172.21.15.87:0/2742699989 wait complete. 2024-05-08T05:29:04.048 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:04.044+0000 7f0709494b80 20 client.24974 trim_cache size 0 max 16384 2024-05-08T05:29:04.068 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:04.067+0000 7f0709494b80 1 Processor -- start 2024-05-08T05:29:04.068 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:04.067+0000 7f0709494b80 1 -- start start 2024-05-08T05:29:04.069 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:04.067+0000 7f0709494b80 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55c154cf5010 0x55c154cf3e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:29:04.069 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:04.067+0000 7f0709494b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55c154cf5930 0x55c154cf4360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:29:04.069 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:04.067+0000 7f0709494b80 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55c154cf9980 0x55c154cf48a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:29:04.069 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:04.067+0000 7f0709494b80 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x55c154d0e210 con 0x55c154cf9980 2024-05-08T05:29:04.069 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:04.067+0000 7f0709494b80 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x55c154d0e8e0 con 0x55c154cf5010 2024-05-08T05:29:04.069 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:04.067+0000 7f0709494b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x55c154d0efb0 con 0x55c154cf5930 2024-05-08T05:29:04.069 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:04.068+0000 7f06f7400700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55c154cf5930 0x55c154cf4360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:29:04.069 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:04.068+0000 7f06fcc00700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55c154cf9980 0x55c154cf48a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:29:04.069 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:04.068+0000 7f06f7400700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55c154cf5930 0x55c154cf4360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.87:53096/0 (socket says 172.21.15.87:53096) 2024-05-08T05:29:04.070 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:04.068+0000 7f06f7400700 1 -- 172.21.15.87:0/1301038209 learned_addr learned my addr 172.21.15.87:0/1301038209 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T05:29:04.070 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:04.068+0000 7f06f7e00700 1 --2- 172.21.15.87:0/1301038209 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55c154cf5010 0x55c154cf3e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:29:04.071 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:04.068+0000 7f06f7400700 1 -- 172.21.15.87:0/1301038209 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55c154cf5010 msgr2=0x55c154cf3e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:29:04.071 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:04.068+0000 7f06f7400700 1 --2- 172.21.15.87:0/1301038209 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55c154cf5010 0x55c154cf3e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:29:04.071 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:04.068+0000 7f06f7400700 1 -- 172.21.15.87:0/1301038209 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55c154cf9980 msgr2=0x55c154cf48a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:29:04.071 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:04.068+0000 7f06f7400700 1 --2- 172.21.15.87:0/1301038209 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55c154cf9980 0x55c154cf48a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:29:04.071 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:04.068+0000 7f06f7400700 1 -- 172.21.15.87:0/1301038209 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c154cec3a0 con 0x55c154cf5930 2024-05-08T05:29:04.071 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:04.068+0000 7f06f7400700 1 --2- 172.21.15.87:0/1301038209 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55c154cf5930 0x55c154cf4360 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f06e40aa2d0 tx=0x7f06e40e6990 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6d12c3f2a1b373b9 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:29:04.071 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:04.069+0000 7f06ecc00700 1 -- 172.21.15.87:0/1301038209 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06e40a6490 con 0x55c154cf5930 2024-05-08T05:29:04.072 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:04.069+0000 7f06ecc00700 1 -- 172.21.15.87:0/1301038209 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f06e40aa0e0 con 0x55c154cf5930 2024-05-08T05:29:04.072 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:04.069+0000 7f06ecc00700 1 -- 172.21.15.87:0/1301038209 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06e40a9d40 con 0x55c154cf5930 2024-05-08T05:29:04.072 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:04.069+0000 7f0709494b80 1 -- 172.21.15.87:0/1301038209 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55c154cf5930 msgr2=0x55c154cf4360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:29:04.072 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:04.069+0000 7f0709494b80 1 --2- 172.21.15.87:0/1301038209 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55c154cf5930 0x55c154cf4360 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f06e40aa2d0 tx=0x7f06e40e6990 comp rx=0 tx=0).stop 2024-05-08T05:29:04.072 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:04.069+0000 7f0709494b80 1 -- 172.21.15.87:0/1301038209 shutdown_connections 2024-05-08T05:29:04.072 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:04.069+0000 7f0709494b80 1 --2- 172.21.15.87:0/1301038209 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55c154cf9980 0x55c154cf48a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:29:04.072 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:04.069+0000 7f0709494b80 1 --2- 172.21.15.87:0/1301038209 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55c154cf5010 0x55c154cf3e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:29:04.072 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:04.069+0000 7f0709494b80 1 --2- 172.21.15.87:0/1301038209 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55c154cf5930 0x55c154cf4360 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:29:04.072 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:04.069+0000 7f0709494b80 1 -- 172.21.15.87:0/1301038209 >> 172.21.15.87:0/1301038209 conn(0x55c154c23b10 msgr2=0x55c154cea260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:29:04.072 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:04.069+0000 7f0709494b80 1 -- 172.21.15.87:0/1301038209 shutdown_connections 2024-05-08T05:29:04.072 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:04.070+0000 7f0709494b80 1 -- 172.21.15.87:0/1301038209 wait complete. 2024-05-08T05:29:04.072 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:04.070+0000 7f0709494b80 1 -- start start 2024-05-08T05:29:04.072 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:04.070+0000 7f0709494b80 1 Processor -- start 2024-05-08T05:29:04.074 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:04.070+0000 7f0709494b80 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55c154cf5010 0x55c154d19480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:29:04.075 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:04.070+0000 7f0709494b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55c154cf5930 0x55c154d199c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:29:04.075 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:04.071+0000 7f0709494b80 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55c154cf9980 0x55c154d139f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:29:04.075 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:04.071+0000 7f0709494b80 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x55c154d0fd50 con 0x55c154cf9980 2024-05-08T05:29:04.075 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:04.071+0000 7f0709494b80 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x55c154d0f680 con 0x55c154cf5010 2024-05-08T05:29:04.075 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:04.071+0000 7f0709494b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x55c154d10420 con 0x55c154cf5930 2024-05-08T05:29:04.075 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:04.071+0000 7f0709494b80 10 client.0 _ll_register_callbacks cb 0x55c154beec20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T05:29:04.075 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:04.071+0000 7f06f7400700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55c154cf5930 0x55c154d199c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:29:04.075 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:04.071+0000 7f06f7400700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55c154cf5930 0x55c154d199c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.87:53110/0 (socket says 172.21.15.87:53110) 2024-05-08T05:29:04.075 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:04.071+0000 7f06fcc00700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55c154cf9980 0x55c154d139f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:29:04.075 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:04.071+0000 7f06f7400700 1 -- 172.21.15.87:0/2741530874 learned_addr learned my addr 172.21.15.87:0/2741530874 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T05:29:04.075 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:04.071+0000 7f06f7e00700 1 --2- 172.21.15.87:0/2741530874 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55c154cf5010 0x55c154d19480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:29:04.075 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:04.071+0000 7f06f7400700 1 -- 172.21.15.87:0/2741530874 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55c154cf5010 msgr2=0x55c154d19480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:29:04.075 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:04.071+0000 7f06f7400700 1 --2- 172.21.15.87:0/2741530874 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55c154cf5010 0x55c154d19480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:29:04.076 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:04.071+0000 7f06f7400700 1 -- 172.21.15.87:0/2741530874 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55c154cf9980 msgr2=0x55c154d139f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:29:04.076 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:04.071+0000 7f06f7400700 1 --2- 172.21.15.87:0/2741530874 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55c154cf9980 0x55c154d139f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:29:04.076 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:04.071+0000 7f06f7400700 1 -- 172.21.15.87:0/2741530874 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c154d14230 con 0x55c154cf5930 2024-05-08T05:29:04.076 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:04.071+0000 7f06f7e00700 1 --2- 172.21.15.87:0/2741530874 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55c154cf5010 0x55c154d19480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T05:29:04.076 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:04.071+0000 7f06fcc00700 1 --2- 172.21.15.87:0/2741530874 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55c154cf9980 0x55c154d139f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T05:29:04.076 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:04.072+0000 7f06f7400700 1 --2- 172.21.15.87:0/2741530874 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55c154cf5930 0x55c154d199c0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f06e4000c00 tx=0x7f06e40b34a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ad27ab8fda45066e server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:29:04.076 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:04.072+0000 7f06e2000700 10 client.0 ms_handle_connect on v2:172.21.15.160:3300/0 2024-05-08T05:29:04.076 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:04.072+0000 7f06e2000700 1 -- 172.21.15.87:0/2741530874 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06e40a9f20 con 0x55c154cf5930 2024-05-08T05:29:04.076 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:04.072+0000 7f06e2000700 1 -- 172.21.15.87:0/2741530874 <== mon.1 v2:172.21.15.160:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8190+0+0 (secure 0 0 0) 0x7f06e40a6860 con 0x55c154cf5930 2024-05-08T05:29:04.076 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:04.072+0000 7f0709494b80 1 -- 172.21.15.87:0/2741530874 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f06e40aa0e0 con 0x55c154cf5930 2024-05-08T05:29:04.076 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:04.072+0000 7f06e2000700 1 -- 172.21.15.87:0/2741530874 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f06e40aa3a0 con 0x55c154cf5930 2024-05-08T05:29:04.076 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:04.072+0000 7f0709494b80 10 client.24985 fetch_fsmap learned FSMap version 24 2024-05-08T05:29:04.076 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:04.072+0000 7f0709494b80 1 -- 172.21.15.87:0/2741530874 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55c154d7ab30 con 0x55c154cf5930 2024-05-08T05:29:04.077 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:04.072+0000 7f06e2000700 1 -- 172.21.15.87:0/2741530874 <== mon.1 v2:172.21.15.160:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f06e40aa0e0 con 0x55c154cf5930 2024-05-08T05:29:04.077 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:04.072+0000 7f06e2000700 1 -- 172.21.15.87:0/2741530874 <== mon.1 v2:172.21.15.160:3300/0 5 ==== fsmap(e 24) ==== 8338+0+0 (secure 0 0 0) 0x7f06e4084ce0 con 0x55c154cf5930 2024-05-08T05:29:04.077 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:04.072+0000 7f0709494b80 10 client.24985 fetch_fsmap finished waiting for FSMap version 24 2024-05-08T05:29:04.077 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:04.073+0000 7f0709494b80 10 client.24985 resolve_mds: resolved name 'g' to daemon mds.g 2024-05-08T05:29:04.077 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:04.073+0000 7f0709494b80 20 client.24985 populate_metadata read hostname 'smithi087' 2024-05-08T05:29:04.077 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:04.073+0000 7f0709494b80 1 --2- 172.21.15.87:0/2741530874 >> [v2:172.21.15.87:6838/2127215876,v1:172.21.15.87:6839/2127215876] conn(0x55c154d7f3a0 0x55c154d7e0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:29:04.077 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:04.073+0000 7f0709494b80 4 client.24985 mds_command: new command op to 24482 tid=0 multi_id=0 [{"prefix": "status"}] 2024-05-08T05:29:04.077 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:04.073+0000 7f0709494b80 1 -- 172.21.15.87:0/2741530874 --> [v2:172.21.15.87:6838/2127215876,v1:172.21.15.87:6839/2127215876] -- command(tid 0: {"prefix": "status"}) -- 0x55c154c553b0 con 0x55c154d7f3a0 2024-05-08T05:29:04.077 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:04.073+0000 7f06f7e00700 1 --2- 172.21.15.87:0/2741530874 >> [v2:172.21.15.87:6838/2127215876,v1:172.21.15.87:6839/2127215876] conn(0x55c154d7f3a0 0x55c154d7e0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:29:04.077 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:04.073+0000 7f06f7e00700 1 --2- 172.21.15.87:0/2741530874 >> [v2:172.21.15.87:6838/2127215876,v1:172.21.15.87:6839/2127215876] conn(0x55c154d7f3a0 0x55c154d7e0b0 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=648efe86bd9615c5 server_cookie=25e5ceb70d361012 in_seq=0 out_seq=0 2024-05-08T05:29:04.077 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:04.073+0000 7f06e2000700 10 client.24985 ms_handle_connect on v2:172.21.15.87:6838/2127215876 2024-05-08T05:29:04.078 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:04.074+0000 7f06e2000700 1 -- 172.21.15.87:0/2741530874 <== mds.1 v2:172.21.15.87:6838/2127215876 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x55c154c553b0 con 0x55c154d7f3a0 2024-05-08T05:29:04.078 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:04.074+0000 7f06e2000700 10 client.24985 handle_command_reply: tid=0 2024-05-08T05:29:04.078 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:04.074+0000 7f0709494b80 1 client.24985 shutdown 2024-05-08T05:29:04.078 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:04.074+0000 7f0709494b80 1 -- 172.21.15.87:0/2741530874 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55c154cf5930 msgr2=0x55c154d199c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:29:04.078 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:04.074+0000 7f0709494b80 1 --2- 172.21.15.87:0/2741530874 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55c154cf5930 0x55c154d199c0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f06e4000c00 tx=0x7f06e40b34a0 comp rx=0 tx=0).stop 2024-05-08T05:29:04.079 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:04.074+0000 7f0709494b80 1 -- 172.21.15.87:0/2741530874 shutdown_connections 2024-05-08T05:29:04.079 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:04.074+0000 7f0709494b80 1 --2- 172.21.15.87:0/2741530874 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55c154cf9980 0x55c154d139f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:29:04.079 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:04.074+0000 7f0709494b80 1 --2- 172.21.15.87:0/2741530874 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55c154cf5010 0x55c154d19480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:29:04.079 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:04.074+0000 7f0709494b80 1 --2- 172.21.15.87:0/2741530874 >> [v2:172.21.15.87:6838/2127215876,v1:172.21.15.87:6839/2127215876] conn(0x55c154d7f3a0 0x55c154d7e0b0 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:29:04.079 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:04.074+0000 7f0709494b80 1 --2- 172.21.15.87:0/2741530874 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55c154cf5930 0x55c154d199c0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:29:04.079 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:04.074+0000 7f0709494b80 1 -- 172.21.15.87:0/2741530874 >> 172.21.15.87:0/2741530874 conn(0x55c154c23b10 msgr2=0x55c154cf3e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:29:04.079 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:04.074+0000 7f06e2000700 0 client.24985 ms_handle_reset on v2:172.21.15.87:6838/2127215876 2024-05-08T05:29:04.079 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:04.074+0000 7f0709494b80 1 -- 172.21.15.87:0/2741530874 shutdown_connections 2024-05-08T05:29:04.079 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:04.075+0000 7f0709494b80 1 -- 172.21.15.87:0/2741530874 wait complete. 2024-05-08T05:29:04.079 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:04.075+0000 7f0709494b80 20 client.24985 trim_cache size 0 max 16384 2024-05-08T05:29:04.079 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-05-08T05:29:04.080 INFO:teuthology.orchestra.run.smithi087.stdout: "cluster_fsid": "eeeb813e-0cf9-11ef-bc97-c7b262605968", 2024-05-08T05:29:04.080 INFO:teuthology.orchestra.run.smithi087.stdout: "whoami": 1, 2024-05-08T05:29:04.080 INFO:teuthology.orchestra.run.smithi087.stdout: "id": 24482, 2024-05-08T05:29:04.080 INFO:teuthology.orchestra.run.smithi087.stdout: "want_state": "up:active", 2024-05-08T05:29:04.080 INFO:teuthology.orchestra.run.smithi087.stdout: "state": "up:active", 2024-05-08T05:29:04.080 INFO:teuthology.orchestra.run.smithi087.stdout: "fs_name": "cephfs", 2024-05-08T05:29:04.080 INFO:teuthology.orchestra.run.smithi087.stdout: "rank_uptime": 192.17943522499999, 2024-05-08T05:29:04.080 INFO:teuthology.orchestra.run.smithi087.stdout: "mdsmap_epoch": 24, 2024-05-08T05:29:04.080 INFO:teuthology.orchestra.run.smithi087.stdout: "osdmap_epoch": 82, 2024-05-08T05:29:04.080 INFO:teuthology.orchestra.run.smithi087.stdout: "osdmap_epoch_barrier": 80, 2024-05-08T05:29:04.080 INFO:teuthology.orchestra.run.smithi087.stdout: "uptime": 233.72059495400001 2024-05-08T05:29:04.080 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-05-08T05:29:04.081 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:04.076+0000 7f06fec00700 1 -- 172.21.15.87:0/1445337070 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f06dc0b2900 msgr2=0x7f06dc0b4dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:29:04.081 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:04.076+0000 7f06fec00700 1 --2- 172.21.15.87:0/1445337070 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f06dc0b2900 0x7f06dc0b4dc0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f06e8009f80 tx=0x7f06e8009260 comp rx=0 tx=0).stop 2024-05-08T05:29:04.081 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:04.076+0000 7f06fec00700 1 -- 172.21.15.87:0/1445337070 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f06f8106050 msgr2=0x7f06f819c310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:29:04.081 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:04.076+0000 7f06fec00700 1 --2- 172.21.15.87:0/1445337070 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f06f8106050 0x7f06f819c310 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f06e400c010 tx=0x7f06e400fa00 comp rx=0 tx=0).stop 2024-05-08T05:29:04.081 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:04.076+0000 7f06fec00700 1 -- 172.21.15.87:0/1445337070 shutdown_connections 2024-05-08T05:29:04.081 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:04.076+0000 7f06fec00700 1 --2- 172.21.15.87:0/1445337070 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f06f810b690 0x7f06f81a06a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:29:04.081 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:04.076+0000 7f06fec00700 1 --2- 172.21.15.87:0/1445337070 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f06f8105690 0x7f06f819bdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:29:04.081 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:04.076+0000 7f06fec00700 1 --2- 172.21.15.87:0/1445337070 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f06dc0b2900 0x7f06dc0b4dc0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:29:04.081 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:04.076+0000 7f06fec00700 1 --2- 172.21.15.87:0/1445337070 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f06f8106050 0x7f06f819c310 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:29:04.082 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:04.076+0000 7f06fec00700 1 -- 172.21.15.87:0/1445337070 >> 172.21.15.87:0/1445337070 conn(0x7f06f8101180 msgr2=0x7f06f8101920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:29:04.082 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:04.076+0000 7f06fec00700 1 -- 172.21.15.87:0/1445337070 shutdown_connections 2024-05-08T05:29:04.082 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:04.076+0000 7f06fec00700 1 -- 172.21.15.87:0/1445337070 wait complete. 2024-05-08T05:29:04.708 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:29:04 smithi087 ceph-mon[29523]: pgmap v422: 97 pgs: 97 active+clean; 644 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-05-08T05:29:04.733 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:29:04 smithi090 ceph-mon[34526]: pgmap v422: 97 pgs: 97 active+clean; 644 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-05-08T05:29:04.788 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:29:04 smithi160 ceph-mon[34827]: pgmap v422: 97 pgs: 97 active+clean; 644 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-05-08T05:29:04.870 DEBUG:teuthology.orchestra.run.smithi087:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid eeeb813e-0cf9-11ef-bc97-c7b262605968 -- ceph tell mds.b status 2024-05-08T05:29:05.326 INFO:teuthology.orchestra.run.smithi087.stderr:Inferring config /var/lib/ceph/eeeb813e-0cf9-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T05:29:06.602 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:29:06 smithi087 ceph-mon[29523]: pgmap v423: 97 pgs: 97 active+clean; 644 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-05-08T05:29:06.733 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:29:06 smithi090 ceph-mon[34526]: pgmap v423: 97 pgs: 97 active+clean; 644 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-05-08T05:29:06.788 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:29:06 smithi160 ceph-mon[34827]: pgmap v423: 97 pgs: 97 active+clean; 644 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-05-08T05:29:07.355 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:07.353+0000 7fc648800700 1 -- 172.21.15.87:0/2055500518 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc64010a490 msgr2=0x7fc6401169a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:29:07.355 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:07.353+0000 7fc648800700 1 --2- 172.21.15.87:0/2055500518 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc64010a490 0x7fc6401169a0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fc63c00b0a0 tx=0x7fc63c00b3b0 comp rx=0 tx=0).stop 2024-05-08T05:29:07.355 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:07.353+0000 7fc648800700 1 -- 172.21.15.87:0/2055500518 shutdown_connections 2024-05-08T05:29:07.355 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:07.353+0000 7fc648800700 1 --2- 172.21.15.87:0/2055500518 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc64010a490 0x7fc6401169a0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:29:07.355 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:07.353+0000 7fc648800700 1 --2- 172.21.15.87:0/2055500518 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc64010fb60 0x7fc64010ff40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:29:07.355 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:07.353+0000 7fc648800700 1 --2- 172.21.15.87:0/2055500518 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc640109ad0 0x7fc640109f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:29:07.355 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:07.353+0000 7fc648800700 1 -- 172.21.15.87:0/2055500518 >> 172.21.15.87:0/2055500518 conn(0x7fc640076c70 msgr2=0x7fc6401082c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:29:07.356 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:07.353+0000 7fc648800700 1 -- 172.21.15.87:0/2055500518 shutdown_connections 2024-05-08T05:29:07.356 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:07.353+0000 7fc648800700 1 -- 172.21.15.87:0/2055500518 wait complete. 2024-05-08T05:29:07.356 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:07.354+0000 7fc648800700 1 Processor -- start 2024-05-08T05:29:07.356 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:07.355+0000 7fc648800700 1 -- start start 2024-05-08T05:29:07.357 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:07.355+0000 7fc648800700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc640109ad0 0x7fc6401a00e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:29:07.357 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:07.355+0000 7fc648800700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc64010a490 0x7fc6401a0620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:29:07.358 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:07.355+0000 7fc648800700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc64010fb60 0x7fc6401a49b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:29:07.358 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:07.355+0000 7fc648800700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fc640119cd0 con 0x7fc640109ad0 2024-05-08T05:29:07.358 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:07.355+0000 7fc648800700 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fc640119b50 con 0x7fc64010fb60 2024-05-08T05:29:07.358 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:07.355+0000 7fc648800700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7fc640119e50 con 0x7fc64010a490 2024-05-08T05:29:07.358 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:07.355+0000 7fc645e00700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc640109ad0 0x7fc6401a00e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:29:07.358 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:07.355+0000 7fc645e00700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc640109ad0 0x7fc6401a00e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:53136/0 (socket says 172.21.15.87:53136) 2024-05-08T05:29:07.358 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:07.355+0000 7fc645e00700 1 -- 172.21.15.87:0/1317917602 learned_addr learned my addr 172.21.15.87:0/1317917602 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T05:29:07.358 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:07.355+0000 7fc645400700 1 --2- 172.21.15.87:0/1317917602 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc64010a490 0x7fc6401a0620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:29:07.358 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:07.355+0000 7fc646800700 1 --2- 172.21.15.87:0/1317917602 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc64010fb60 0x7fc6401a49b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:29:07.358 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:07.356+0000 7fc645400700 1 -- 172.21.15.87:0/1317917602 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc64010fb60 msgr2=0x7fc6401a49b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:29:07.358 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:07.356+0000 7fc645400700 1 --2- 172.21.15.87:0/1317917602 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc64010fb60 0x7fc6401a49b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:29:07.358 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:07.356+0000 7fc645400700 1 -- 172.21.15.87:0/1317917602 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc640109ad0 msgr2=0x7fc6401a00e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:29:07.358 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:07.356+0000 7fc645400700 1 --2- 172.21.15.87:0/1317917602 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc640109ad0 0x7fc6401a00e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:29:07.359 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:07.356+0000 7fc645400700 1 -- 172.21.15.87:0/1317917602 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc6401a50f0 con 0x7fc64010a490 2024-05-08T05:29:07.359 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:07.356+0000 7fc645e00700 1 --2- 172.21.15.87:0/1317917602 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc640109ad0 0x7fc6401a00e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T05:29:07.359 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:07.356+0000 7fc645400700 1 --2- 172.21.15.87:0/1317917602 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc64010a490 0x7fc6401a0620 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fc63000e9f0 tx=0x7fc63000ed00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:29:07.359 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:07.356+0000 7fc63aa00700 1 -- 172.21.15.87:0/1317917602 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc630004220 con 0x7fc64010a490 2024-05-08T05:29:07.359 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:07.356+0000 7fc63aa00700 1 -- 172.21.15.87:0/1317917602 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc6300043c0 con 0x7fc64010a490 2024-05-08T05:29:07.359 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:07.356+0000 7fc648800700 1 -- 172.21.15.87:0/1317917602 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc6401a53e0 con 0x7fc64010a490 2024-05-08T05:29:07.359 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:07.356+0000 7fc63aa00700 1 -- 172.21.15.87:0/1317917602 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc630005020 con 0x7fc64010a490 2024-05-08T05:29:07.359 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:07.356+0000 7fc648800700 1 -- 172.21.15.87:0/1317917602 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc6401acc60 con 0x7fc64010a490 2024-05-08T05:29:07.361 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:07.361+0000 7fc63aa00700 1 -- 172.21.15.87:0/1317917602 <== mon.1 v2:172.21.15.160:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7fc630004750 con 0x7fc64010a490 2024-05-08T05:29:07.361 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:07.361+0000 7fc6530cab80 1 Processor -- start 2024-05-08T05:29:07.361 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:07.361+0000 7fc6530cab80 1 -- start start 2024-05-08T05:29:07.362 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:07.362+0000 7fc6530cab80 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55aa4ef9bb70 0x55aa4ef9bf50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:29:07.362 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:07.362+0000 7fc6530cab80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55aa4ef9c490 0x55aa4ef96280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:29:07.362 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:07.362+0000 7fc6530cab80 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55aa4ef968a0 0x55aa4ef96d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:29:07.362 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:07.362+0000 7fc6530cab80 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x55aa4eee89d0 con 0x55aa4ef9bb70 2024-05-08T05:29:07.362 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:07.362+0000 7fc6530cab80 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x55aa4ee86710 con 0x55aa4ef968a0 2024-05-08T05:29:07.362 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:07.362+0000 7fc6530cab80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x55aa4eee4990 con 0x55aa4ef9c490 2024-05-08T05:29:07.364 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:07.362+0000 7fc646800700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55aa4ef9bb70 0x55aa4ef9bf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:29:07.364 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:07.362+0000 7fc646800700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55aa4ef9bb70 0x55aa4ef9bf50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:53138/0 (socket says 172.21.15.87:53138) 2024-05-08T05:29:07.364 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:07.362+0000 7fc646800700 1 -- 172.21.15.87:0/2646925569 learned_addr learned my addr 172.21.15.87:0/2646925569 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T05:29:07.364 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:07.362+0000 7fc645e00700 1 --2- 172.21.15.87:0/2646925569 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55aa4ef9c490 0x55aa4ef96280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:29:07.364 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:07.362+0000 7fc645400700 1 --2- 172.21.15.87:0/2646925569 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55aa4ef968a0 0x55aa4ef96d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:29:07.364 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:07.363+0000 7fc645e00700 1 -- 172.21.15.87:0/2646925569 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55aa4ef968a0 msgr2=0x55aa4ef96d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:29:07.364 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:07.363+0000 7fc645e00700 1 --2- 172.21.15.87:0/2646925569 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55aa4ef968a0 0x55aa4ef96d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:29:07.364 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:07.363+0000 7fc645e00700 1 -- 172.21.15.87:0/2646925569 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55aa4ef9bb70 msgr2=0x55aa4ef9bf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:29:07.364 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:07.363+0000 7fc645e00700 1 --2- 172.21.15.87:0/2646925569 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55aa4ef9bb70 0x55aa4ef9bf50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:29:07.364 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:07.363+0000 7fc645e00700 1 -- 172.21.15.87:0/2646925569 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55aa4ee35880 con 0x55aa4ef9c490 2024-05-08T05:29:07.364 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:07.363+0000 7fc646800700 1 --2- 172.21.15.87:0/2646925569 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55aa4ef9bb70 0x55aa4ef9bf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T05:29:07.364 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:07.363+0000 7fc645e00700 1 --2- 172.21.15.87:0/2646925569 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55aa4ef9c490 0x55aa4ef96280 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fc6340114c0 tx=0x7fc6340117d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=515c114a21773771 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:29:07.365 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:07.363+0000 7fc63aa00700 1 --2- 172.21.15.87:0/1317917602 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7fc6280b2880 0x7fc6280b4d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:29:07.365 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:07.363+0000 7fc62f400700 1 -- 172.21.15.87:0/2646925569 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc634004230 con 0x55aa4ef9c490 2024-05-08T05:29:07.365 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:07.363+0000 7fc62f400700 1 -- 172.21.15.87:0/2646925569 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc634011e50 con 0x55aa4ef9c490 2024-05-08T05:29:07.365 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:07.363+0000 7fc62f400700 1 -- 172.21.15.87:0/2646925569 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc63400e890 con 0x55aa4ef9c490 2024-05-08T05:29:07.365 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:07.364+0000 7fc63aa00700 1 -- 172.21.15.87:0/1317917602 <== mon.1 v2:172.21.15.160:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8190+0+0 (secure 0 0 0) 0x7fc6300e21c0 con 0x7fc64010a490 2024-05-08T05:29:07.365 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:07.364+0000 7fc646800700 1 --2- 172.21.15.87:0/1317917602 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7fc6280b2880 0x7fc6280b4d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:29:07.366 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:07.365+0000 7fc6530cab80 1 -- 172.21.15.87:0/2646925569 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55aa4ef9c490 msgr2=0x55aa4ef96280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:29:07.366 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:07.365+0000 7fc646800700 1 --2- 172.21.15.87:0/1317917602 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7fc6280b2880 0x7fc6280b4d40 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fc63c015000 tx=0x7fc63c00b720 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:29:07.366 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:07.365+0000 7fc6530cab80 1 --2- 172.21.15.87:0/2646925569 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55aa4ef9c490 0x55aa4ef96280 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fc6340114c0 tx=0x7fc6340117d0 comp rx=0 tx=0).stop 2024-05-08T05:29:07.366 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:07.365+0000 7fc6530cab80 1 -- 172.21.15.87:0/2646925569 shutdown_connections 2024-05-08T05:29:07.366 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:07.365+0000 7fc6530cab80 1 --2- 172.21.15.87:0/2646925569 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55aa4ef968a0 0x55aa4ef96d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:29:07.366 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:07.365+0000 7fc6530cab80 1 --2- 172.21.15.87:0/2646925569 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55aa4ef9bb70 0x55aa4ef9bf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:29:07.366 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:07.365+0000 7fc6530cab80 1 --2- 172.21.15.87:0/2646925569 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55aa4ef9c490 0x55aa4ef96280 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:29:07.366 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:07.365+0000 7fc6530cab80 1 -- 172.21.15.87:0/2646925569 >> 172.21.15.87:0/2646925569 conn(0x55aa4ef0e680 msgr2=0x55aa4ef90ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:29:07.366 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:07.365+0000 7fc6530cab80 1 -- 172.21.15.87:0/2646925569 shutdown_connections 2024-05-08T05:29:07.366 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:07.365+0000 7fc6530cab80 1 -- 172.21.15.87:0/2646925569 wait complete. 2024-05-08T05:29:07.366 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:07.365+0000 7fc6530cab80 1 -- start start 2024-05-08T05:29:07.367 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:07.366+0000 7fc6530cab80 1 Processor -- start 2024-05-08T05:29:07.368 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:07.366+0000 7fc6530cab80 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55aa4ef968a0 0x55aa4efa20f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:29:07.368 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:07.366+0000 7fc6530cab80 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55aa4ef9bb70 0x55aa4ef9f490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:29:07.368 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:07.366+0000 7fc6530cab80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55aa4ef9c490 0x55aa4ef9f9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:29:07.368 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:07.366+0000 7fc6530cab80 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x55aa4efa2ed0 con 0x55aa4ef968a0 2024-05-08T05:29:07.368 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:07.366+0000 7fc6530cab80 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x55aa4ee4ead0 con 0x55aa4ef9bb70 2024-05-08T05:29:07.368 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:07.366+0000 7fc6530cab80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x55aa4efa3050 con 0x55aa4ef9c490 2024-05-08T05:29:07.368 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:07.366+0000 7fc6530cab80 10 client.0 _ll_register_callbacks cb 0x55aa4ee8fc20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T05:29:07.368 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:07.367+0000 7fc645e00700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55aa4ef968a0 0x55aa4efa20f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:29:07.369 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:07.367+0000 7fc645e00700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55aa4ef968a0 0x55aa4efa20f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:53154/0 (socket says 172.21.15.87:53154) 2024-05-08T05:29:07.369 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:07.367+0000 7fc645400700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55aa4ef9bb70 0x55aa4ef9f490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:29:07.369 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:07.367+0000 7fc645e00700 1 -- 172.21.15.87:0/1840145939 learned_addr learned my addr 172.21.15.87:0/1840145939 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T05:29:07.369 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:07.367+0000 7fc646800700 1 --2- 172.21.15.87:0/1840145939 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55aa4ef9c490 0x55aa4ef9f9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:29:07.369 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:07.367+0000 7fc645400700 1 -- 172.21.15.87:0/1840145939 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55aa4ef9c490 msgr2=0x55aa4ef9f9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:29:07.369 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:07.367+0000 7fc645400700 1 --2- 172.21.15.87:0/1840145939 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55aa4ef9c490 0x55aa4ef9f9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:29:07.369 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:07.367+0000 7fc645400700 1 -- 172.21.15.87:0/1840145939 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55aa4ef968a0 msgr2=0x55aa4efa20f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:29:07.369 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:07.367+0000 7fc645400700 1 --2- 172.21.15.87:0/1840145939 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55aa4ef968a0 0x55aa4efa20f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:29:07.369 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:07.367+0000 7fc645400700 1 -- 172.21.15.87:0/1840145939 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55aa4eeae3d0 con 0x55aa4ef9bb70 2024-05-08T05:29:07.369 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:07.367+0000 7fc645400700 1 --2- 172.21.15.87:0/1840145939 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55aa4ef9bb70 0x55aa4ef9f490 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fc6300dfc60 tx=0x7fc63000c860 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c52b04d081e97081 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:29:07.369 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:07.367+0000 7fc623e00700 10 client.0 ms_handle_connect on v2:172.21.15.90:3300/0 2024-05-08T05:29:07.369 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:07.368+0000 7fc623e00700 1 -- 172.21.15.87:0/1840145939 <== mon.2 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc63001c070 con 0x55aa4ef9bb70 2024-05-08T05:29:07.369 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:07.368+0000 7fc623e00700 1 -- 172.21.15.87:0/1840145939 <== mon.2 v2:172.21.15.90:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8190+0+0 (secure 0 0 0) 0x7fc6300dfda0 con 0x55aa4ef9bb70 2024-05-08T05:29:07.369 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:07.368+0000 7fc6530cab80 1 -- 172.21.15.87:0/1840145939 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc634011e50 con 0x55aa4ef9bb70 2024-05-08T05:29:07.369 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:07.368+0000 7fc623e00700 1 -- 172.21.15.87:0/1840145939 <== mon.2 v2:172.21.15.90:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fc6300a8f20 con 0x55aa4ef9bb70 2024-05-08T05:29:07.370 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:07.368+0000 7fc6530cab80 10 client.24992 fetch_fsmap learned FSMap version 24 2024-05-08T05:29:07.370 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:07.368+0000 7fc6530cab80 1 -- 172.21.15.87:0/1840145939 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55aa4efad760 con 0x55aa4ef9bb70 2024-05-08T05:29:07.371 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:07.368+0000 7fc623e00700 1 -- 172.21.15.87:0/1840145939 <== mon.2 v2:172.21.15.90:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc634011e50 con 0x55aa4ef9bb70 2024-05-08T05:29:07.371 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:07.368+0000 7fc623e00700 1 -- 172.21.15.87:0/1840145939 <== mon.2 v2:172.21.15.90:3300/0 5 ==== fsmap(e 24) ==== 8338+0+0 (secure 0 0 0) 0x7fc6300a9a10 con 0x55aa4ef9bb70 2024-05-08T05:29:07.371 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:07.369+0000 7fc6530cab80 10 client.24992 fetch_fsmap finished waiting for FSMap version 24 2024-05-08T05:29:07.372 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:07.369+0000 7fc6530cab80 10 client.24992 resolve_mds: resolved name 'b' to daemon mds.b 2024-05-08T05:29:07.372 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:07.369+0000 7fc6530cab80 20 client.24992 populate_metadata read hostname 'smithi087' 2024-05-08T05:29:07.372 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:07.369+0000 7fc6530cab80 1 --2- 172.21.15.87:0/1840145939 >> [v2:172.21.15.90:6838/160586017,v1:172.21.15.90:6839/160586017] conn(0x55aa4efafd10 0x55aa4efb1180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:29:07.372 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:07.369+0000 7fc6530cab80 4 client.24992 mds_command: new command op to 24500 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-08T05:29:07.372 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:07.369+0000 7fc6530cab80 1 -- 172.21.15.87:0/1840145939 --> [v2:172.21.15.90:6838/160586017,v1:172.21.15.90:6839/160586017] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55aa4ef630f0 con 0x55aa4efafd10 2024-05-08T05:29:07.372 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:07.369+0000 7fc645e00700 1 --2- 172.21.15.87:0/1840145939 >> [v2:172.21.15.90:6838/160586017,v1:172.21.15.90:6839/160586017] conn(0x55aa4efafd10 0x55aa4efb1180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:29:07.372 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:07.370+0000 7fc645e00700 1 --2- 172.21.15.87:0/1840145939 >> [v2:172.21.15.90:6838/160586017,v1:172.21.15.90:6839/160586017] conn(0x55aa4efafd10 0x55aa4efb1180 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6e2c461500aaba53 server_cookie=bd3cd611d523e681 in_seq=0 out_seq=0 2024-05-08T05:29:07.372 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:07.370+0000 7fc623e00700 10 client.24992 ms_handle_connect on v2:172.21.15.90:6838/160586017 2024-05-08T05:29:07.372 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:07.370+0000 7fc623e00700 1 -- 172.21.15.87:0/1840145939 <== mds.0 v2:172.21.15.90:6838/160586017 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55aa4ef630f0 con 0x55aa4efafd10 2024-05-08T05:29:07.372 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:07.370+0000 7fc623e00700 10 client.24992 handle_command_reply: tid=0 2024-05-08T05:29:07.372 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:07.370+0000 7fc6530cab80 1 client.24992 shutdown 2024-05-08T05:29:07.372 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:07.371+0000 7fc6530cab80 1 -- 172.21.15.87:0/1840145939 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55aa4ef9bb70 msgr2=0x55aa4ef9f490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:29:07.372 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:07.371+0000 7fc6530cab80 1 --2- 172.21.15.87:0/1840145939 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55aa4ef9bb70 0x55aa4ef9f490 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fc6300dfc60 tx=0x7fc63000c860 comp rx=0 tx=0).stop 2024-05-08T05:29:07.372 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:07.371+0000 7fc6530cab80 1 -- 172.21.15.87:0/1840145939 shutdown_connections 2024-05-08T05:29:07.373 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:07.371+0000 7fc6530cab80 1 --2- 172.21.15.87:0/1840145939 >> [v2:172.21.15.90:6838/160586017,v1:172.21.15.90:6839/160586017] conn(0x55aa4efafd10 0x55aa4efb1180 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:29:07.373 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:07.371+0000 7fc6530cab80 1 --2- 172.21.15.87:0/1840145939 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55aa4ef9c490 0x55aa4ef9f9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:29:07.373 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:07.371+0000 7fc6530cab80 1 --2- 172.21.15.87:0/1840145939 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55aa4ef968a0 0x55aa4efa20f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:29:07.373 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:07.371+0000 7fc6530cab80 1 --2- 172.21.15.87:0/1840145939 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55aa4ef9bb70 0x55aa4ef9f490 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:29:07.373 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:07.371+0000 7fc623e00700 0 client.24992 ms_handle_reset on v2:172.21.15.90:6838/160586017 2024-05-08T05:29:07.373 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:07.371+0000 7fc6530cab80 1 -- 172.21.15.87:0/1840145939 >> 172.21.15.87:0/1840145939 conn(0x55aa4ef0e680 msgr2=0x55aa4ef90140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:29:07.373 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:07.371+0000 7fc6530cab80 1 -- 172.21.15.87:0/1840145939 shutdown_connections 2024-05-08T05:29:07.373 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:07.371+0000 7fc6530cab80 1 -- 172.21.15.87:0/1840145939 wait complete. 2024-05-08T05:29:07.373 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:07.371+0000 7fc6530cab80 20 client.24992 trim_cache size 0 max 16384 2024-05-08T05:29:07.395 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:07.395+0000 7fc6530cab80 1 Processor -- start 2024-05-08T05:29:07.395 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:07.395+0000 7fc6530cab80 1 -- start start 2024-05-08T05:29:07.396 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:07.395+0000 7fc6530cab80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55aa4ef968a0 0x55aa4ef908c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:29:07.396 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:07.395+0000 7fc6530cab80 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55aa4ef9bb70 0x55aa4ef9c870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:29:07.396 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:07.395+0000 7fc6530cab80 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55aa4ef9c490 0x55aa4ef9cdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:29:07.396 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:07.395+0000 7fc6530cab80 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x55aa4efaf4c0 con 0x55aa4ef9bb70 2024-05-08T05:29:07.396 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:07.395+0000 7fc6530cab80 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x55aa4efafb90 con 0x55aa4ef9c490 2024-05-08T05:29:07.396 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:07.395+0000 7fc6530cab80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x55aa4efb0260 con 0x55aa4ef968a0 2024-05-08T05:29:07.396 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:07.395+0000 7fc646800700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55aa4ef9c490 0x55aa4ef9cdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:29:07.396 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:07.395+0000 7fc645e00700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55aa4ef968a0 0x55aa4ef908c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:29:07.396 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:07.395+0000 7fc646800700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55aa4ef9c490 0x55aa4ef9cdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.87:51808/0 (socket says 172.21.15.87:51808) 2024-05-08T05:29:07.396 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:07.396+0000 7fc646800700 1 -- 172.21.15.87:0/1171457593 learned_addr learned my addr 172.21.15.87:0/1171457593 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T05:29:07.397 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:07.396+0000 7fc645400700 1 --2- 172.21.15.87:0/1171457593 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55aa4ef9bb70 0x55aa4ef9c870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:29:07.397 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:07.396+0000 7fc646800700 1 -- 172.21.15.87:0/1171457593 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55aa4ef968a0 msgr2=0x55aa4ef908c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:29:07.397 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:07.396+0000 7fc646800700 1 --2- 172.21.15.87:0/1171457593 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55aa4ef968a0 0x55aa4ef908c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:29:07.398 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:07.396+0000 7fc646800700 1 -- 172.21.15.87:0/1171457593 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55aa4ef9bb70 msgr2=0x55aa4ef9c870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:29:07.398 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:07.396+0000 7fc646800700 1 --2- 172.21.15.87:0/1171457593 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55aa4ef9bb70 0x55aa4ef9c870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:29:07.398 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:07.396+0000 7fc646800700 1 -- 172.21.15.87:0/1171457593 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55aa4ef9da00 con 0x55aa4ef9c490 2024-05-08T05:29:07.398 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:07.396+0000 7fc645400700 1 --2- 172.21.15.87:0/1171457593 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55aa4ef9bb70 0x55aa4ef9c870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T05:29:07.398 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:07.396+0000 7fc645e00700 1 --2- 172.21.15.87:0/1171457593 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55aa4ef968a0 0x55aa4ef908c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T05:29:07.398 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:07.396+0000 7fc646800700 1 --2- 172.21.15.87:0/1171457593 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55aa4ef9c490 0x55aa4ef9cdb0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fc63c00b0a0 tx=0x7fc63c01f000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5fee611fb69cdc40 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:29:07.398 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:07.397+0000 7fc62ea00700 1 -- 172.21.15.87:0/1171457593 <== mon.2 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc63c023070 con 0x55aa4ef9c490 2024-05-08T05:29:07.398 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:07.397+0000 7fc62ea00700 1 -- 172.21.15.87:0/1171457593 <== mon.2 v2:172.21.15.90:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc63c003d80 con 0x55aa4ef9c490 2024-05-08T05:29:07.398 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:07.397+0000 7fc62ea00700 1 -- 172.21.15.87:0/1171457593 <== mon.2 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc63c033870 con 0x55aa4ef9c490 2024-05-08T05:29:07.401 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:07.398+0000 7fc6530cab80 1 -- 172.21.15.87:0/1171457593 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55aa4ef9c490 msgr2=0x55aa4ef9cdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:29:07.401 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:07.398+0000 7fc6530cab80 1 --2- 172.21.15.87:0/1171457593 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55aa4ef9c490 0x55aa4ef9cdb0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fc63c00b0a0 tx=0x7fc63c01f000 comp rx=0 tx=0).stop 2024-05-08T05:29:07.401 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:07.398+0000 7fc6530cab80 1 -- 172.21.15.87:0/1171457593 shutdown_connections 2024-05-08T05:29:07.401 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:07.398+0000 7fc6530cab80 1 --2- 172.21.15.87:0/1171457593 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55aa4ef9c490 0x55aa4ef9cdb0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:29:07.401 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:07.398+0000 7fc6530cab80 1 --2- 172.21.15.87:0/1171457593 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55aa4ef968a0 0x55aa4ef908c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:29:07.401 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:07.398+0000 7fc6530cab80 1 --2- 172.21.15.87:0/1171457593 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55aa4ef9bb70 0x55aa4ef9c870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:29:07.401 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:07.398+0000 7fc6530cab80 1 -- 172.21.15.87:0/1171457593 >> 172.21.15.87:0/1171457593 conn(0x55aa4ef0e680 msgr2=0x55aa4ef9dd80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:29:07.401 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:07.398+0000 7fc6530cab80 1 -- 172.21.15.87:0/1171457593 shutdown_connections 2024-05-08T05:29:07.401 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:07.398+0000 7fc6530cab80 1 -- 172.21.15.87:0/1171457593 wait complete. 2024-05-08T05:29:07.401 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:07.398+0000 7fc6530cab80 1 -- start start 2024-05-08T05:29:07.401 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:07.398+0000 7fc6530cab80 1 Processor -- start 2024-05-08T05:29:07.402 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:07.399+0000 7fc6530cab80 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55aa4ef968a0 0x55aa4efba600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:29:07.402 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:07.399+0000 7fc6530cab80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55aa4ef9bb70 0x55aa4efbab40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:29:07.402 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:07.399+0000 7fc6530cab80 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55aa4ef9c490 0x55aa4efb55b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:29:07.402 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:07.399+0000 7fc6530cab80 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x55aa4efb1000 con 0x55aa4ef968a0 2024-05-08T05:29:07.402 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:07.399+0000 7fc6530cab80 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x55aa4efb0930 con 0x55aa4ef9c490 2024-05-08T05:29:07.402 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:07.399+0000 7fc6530cab80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x55aa4efb16d0 con 0x55aa4ef9bb70 2024-05-08T05:29:07.402 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:07.399+0000 7fc6530cab80 10 client.0 _ll_register_callbacks cb 0x55aa4ee8fc20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T05:29:07.402 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:07.399+0000 7fc645e00700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55aa4ef968a0 0x55aa4efba600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:29:07.402 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:07.399+0000 7fc645e00700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55aa4ef968a0 0x55aa4efba600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:53174/0 (socket says 172.21.15.87:53174) 2024-05-08T05:29:07.402 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:07.399+0000 7fc645e00700 1 -- 172.21.15.87:0/994180063 learned_addr learned my addr 172.21.15.87:0/994180063 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T05:29:07.402 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:07.399+0000 7fc646800700 1 --2- 172.21.15.87:0/994180063 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55aa4ef9c490 0x55aa4efb55b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:29:07.402 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:07.399+0000 7fc645400700 1 --2- 172.21.15.87:0/994180063 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55aa4ef9bb70 0x55aa4efbab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:29:07.402 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:07.400+0000 7fc645e00700 1 -- 172.21.15.87:0/994180063 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55aa4ef9bb70 msgr2=0x55aa4efbab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:29:07.402 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:07.400+0000 7fc645e00700 1 --2- 172.21.15.87:0/994180063 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55aa4ef9bb70 0x55aa4efbab40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:29:07.403 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:07.400+0000 7fc645e00700 1 -- 172.21.15.87:0/994180063 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55aa4ef9c490 msgr2=0x55aa4efb55b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:29:07.403 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:07.400+0000 7fc645e00700 1 --2- 172.21.15.87:0/994180063 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55aa4ef9c490 0x55aa4efb55b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:29:07.403 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:07.400+0000 7fc645e00700 1 -- 172.21.15.87:0/994180063 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55aa4efb5df0 con 0x55aa4ef968a0 2024-05-08T05:29:07.403 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:07.400+0000 7fc645e00700 1 --2- 172.21.15.87:0/994180063 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55aa4ef968a0 0x55aa4efba600 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fc634000c00 tx=0x7fc634005b00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ea3a420084a1180a server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:29:07.403 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:07.400+0000 7fc623e00700 10 client.0 ms_handle_connect on v2:172.21.15.87:3300/0 2024-05-08T05:29:07.403 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:07.400+0000 7fc623e00700 1 -- 172.21.15.87:0/994180063 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc634005040 con 0x55aa4ef968a0 2024-05-08T05:29:07.403 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:07.400+0000 7fc623e00700 1 -- 172.21.15.87:0/994180063 <== mon.0 v2:172.21.15.87:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8190+0+0 (secure 0 0 0) 0x7fc6340051e0 con 0x55aa4ef968a0 2024-05-08T05:29:07.403 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:07.400+0000 7fc6530cab80 1 -- 172.21.15.87:0/994180063 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc63c003d80 con 0x55aa4ef968a0 2024-05-08T05:29:07.403 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:07.401+0000 7fc623e00700 1 -- 172.21.15.87:0/994180063 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fc634005400 con 0x55aa4ef968a0 2024-05-08T05:29:07.403 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:07.401+0000 7fc6530cab80 10 client.14901 fetch_fsmap learned FSMap version 24 2024-05-08T05:29:07.403 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:07.401+0000 7fc6530cab80 1 -- 172.21.15.87:0/994180063 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55aa4f01bc60 con 0x55aa4ef968a0 2024-05-08T05:29:07.405 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:07.401+0000 7fc623e00700 1 -- 172.21.15.87:0/994180063 <== mon.0 v2:172.21.15.87:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc63c003d80 con 0x55aa4ef968a0 2024-05-08T05:29:07.405 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:07.401+0000 7fc623e00700 1 -- 172.21.15.87:0/994180063 <== mon.0 v2:172.21.15.87:3300/0 5 ==== fsmap(e 24) ==== 8338+0+0 (secure 0 0 0) 0x7fc63402bce0 con 0x55aa4ef968a0 2024-05-08T05:29:07.405 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:07.401+0000 7fc6530cab80 10 client.14901 fetch_fsmap finished waiting for FSMap version 24 2024-05-08T05:29:07.405 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:07.401+0000 7fc6530cab80 10 client.14901 resolve_mds: resolved name 'b' to daemon mds.b 2024-05-08T05:29:07.405 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:07.401+0000 7fc6530cab80 20 client.14901 populate_metadata read hostname 'smithi087' 2024-05-08T05:29:07.405 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:07.401+0000 7fc6530cab80 1 --2- 172.21.15.87:0/994180063 >> [v2:172.21.15.90:6838/160586017,v1:172.21.15.90:6839/160586017] conn(0x55aa4f020620 0x55aa4f01f330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:29:07.405 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:07.401+0000 7fc6530cab80 4 client.14901 mds_command: new command op to 24500 tid=0 multi_id=0 [{"prefix": "status"}] 2024-05-08T05:29:07.405 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:07.401+0000 7fc6530cab80 1 -- 172.21.15.87:0/994180063 --> [v2:172.21.15.90:6838/160586017,v1:172.21.15.90:6839/160586017] -- command(tid 0: {"prefix": "status"}) -- 0x55aa4eef63b0 con 0x55aa4f020620 2024-05-08T05:29:07.405 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:07.402+0000 7fc645400700 1 --2- 172.21.15.87:0/994180063 >> [v2:172.21.15.90:6838/160586017,v1:172.21.15.90:6839/160586017] conn(0x55aa4f020620 0x55aa4f01f330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:29:07.406 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:07.402+0000 7fc645400700 1 --2- 172.21.15.87:0/994180063 >> [v2:172.21.15.90:6838/160586017,v1:172.21.15.90:6839/160586017] conn(0x55aa4f020620 0x55aa4f01f330 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cde68dd9ff3ef2b5 server_cookie=a11f6db7283d0e5c in_seq=0 out_seq=0 2024-05-08T05:29:07.406 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:07.402+0000 7fc623e00700 10 client.14901 ms_handle_connect on v2:172.21.15.90:6838/160586017 2024-05-08T05:29:07.406 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:07.403+0000 7fc623e00700 1 -- 172.21.15.87:0/994180063 <== mds.0 v2:172.21.15.90:6838/160586017 1 ==== command_reply(tid 0: 0 ) ==== 8+0+327 (crc 0 0 0) 0x55aa4eef63b0 con 0x55aa4f020620 2024-05-08T05:29:07.406 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:07.403+0000 7fc623e00700 10 client.14901 handle_command_reply: tid=0 2024-05-08T05:29:07.406 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:07.403+0000 7fc6530cab80 1 client.14901 shutdown 2024-05-08T05:29:07.406 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:07.403+0000 7fc6530cab80 1 -- 172.21.15.87:0/994180063 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55aa4ef968a0 msgr2=0x55aa4efba600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:29:07.406 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:07.403+0000 7fc6530cab80 1 --2- 172.21.15.87:0/994180063 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55aa4ef968a0 0x55aa4efba600 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fc634000c00 tx=0x7fc634005b00 comp rx=0 tx=0).stop 2024-05-08T05:29:07.406 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:07.403+0000 7fc6530cab80 1 -- 172.21.15.87:0/994180063 shutdown_connections 2024-05-08T05:29:07.406 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:07.403+0000 7fc6530cab80 1 --2- 172.21.15.87:0/994180063 >> [v2:172.21.15.90:6838/160586017,v1:172.21.15.90:6839/160586017] conn(0x55aa4f020620 0x55aa4f01f330 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:29:07.406 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:07.403+0000 7fc6530cab80 1 --2- 172.21.15.87:0/994180063 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55aa4ef9c490 0x55aa4efb55b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:29:07.406 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:07.403+0000 7fc6530cab80 1 --2- 172.21.15.87:0/994180063 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55aa4ef968a0 0x55aa4efba600 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:29:07.406 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:07.403+0000 7fc6530cab80 1 --2- 172.21.15.87:0/994180063 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55aa4ef9bb70 0x55aa4efbab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:29:07.406 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:07.403+0000 7fc6530cab80 1 -- 172.21.15.87:0/994180063 >> 172.21.15.87:0/994180063 conn(0x55aa4ef0e680 msgr2=0x55aa4ef9c870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:29:07.406 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:07.403+0000 7fc623e00700 0 client.14901 ms_handle_reset on v2:172.21.15.90:6838/160586017 2024-05-08T05:29:07.407 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:07.403+0000 7fc6530cab80 1 -- 172.21.15.87:0/994180063 shutdown_connections 2024-05-08T05:29:07.407 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:07.403+0000 7fc6530cab80 1 -- 172.21.15.87:0/994180063 wait complete. 2024-05-08T05:29:07.407 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:07.403+0000 7fc6530cab80 20 client.14901 trim_cache size 0 max 16384 2024-05-08T05:29:07.407 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-05-08T05:29:07.407 INFO:teuthology.orchestra.run.smithi087.stdout: "cluster_fsid": "eeeb813e-0cf9-11ef-bc97-c7b262605968", 2024-05-08T05:29:07.407 INFO:teuthology.orchestra.run.smithi087.stdout: "whoami": 0, 2024-05-08T05:29:07.407 INFO:teuthology.orchestra.run.smithi087.stdout: "id": 24500, 2024-05-08T05:29:07.407 INFO:teuthology.orchestra.run.smithi087.stdout: "want_state": "up:active", 2024-05-08T05:29:07.407 INFO:teuthology.orchestra.run.smithi087.stdout: "state": "up:active", 2024-05-08T05:29:07.407 INFO:teuthology.orchestra.run.smithi087.stdout: "fs_name": "cephfs", 2024-05-08T05:29:07.407 INFO:teuthology.orchestra.run.smithi087.stdout: "rank_uptime": 210.323347934, 2024-05-08T05:29:07.408 INFO:teuthology.orchestra.run.smithi087.stdout: "mdsmap_epoch": 24, 2024-05-08T05:29:07.408 INFO:teuthology.orchestra.run.smithi087.stdout: "osdmap_epoch": 82, 2024-05-08T05:29:07.408 INFO:teuthology.orchestra.run.smithi087.stdout: "osdmap_epoch_barrier": 80, 2024-05-08T05:29:07.408 INFO:teuthology.orchestra.run.smithi087.stdout: "uptime": 229.62570166399999 2024-05-08T05:29:07.408 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-05-08T05:29:07.408 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:07.404+0000 7fc648800700 1 -- 172.21.15.87:0/1317917602 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7fc6280b2880 msgr2=0x7fc6280b4d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:29:07.409 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:07.404+0000 7fc648800700 1 --2- 172.21.15.87:0/1317917602 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7fc6280b2880 0x7fc6280b4d40 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fc63c015000 tx=0x7fc63c00b720 comp rx=0 tx=0).stop 2024-05-08T05:29:07.409 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:07.404+0000 7fc648800700 1 -- 172.21.15.87:0/1317917602 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc64010a490 msgr2=0x7fc6401a0620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:29:07.409 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:07.404+0000 7fc648800700 1 --2- 172.21.15.87:0/1317917602 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc64010a490 0x7fc6401a0620 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fc63000e9f0 tx=0x7fc63000ed00 comp rx=0 tx=0).stop 2024-05-08T05:29:07.409 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:07.404+0000 7fc648800700 1 -- 172.21.15.87:0/1317917602 shutdown_connections 2024-05-08T05:29:07.409 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:07.404+0000 7fc648800700 1 --2- 172.21.15.87:0/1317917602 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc64010fb60 0x7fc6401a49b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:29:07.409 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:07.404+0000 7fc648800700 1 --2- 172.21.15.87:0/1317917602 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc640109ad0 0x7fc6401a00e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:29:07.409 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:07.404+0000 7fc648800700 1 --2- 172.21.15.87:0/1317917602 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7fc6280b2880 0x7fc6280b4d40 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:29:07.409 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:07.404+0000 7fc648800700 1 --2- 172.21.15.87:0/1317917602 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc64010a490 0x7fc6401a0620 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:29:07.409 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:07.404+0000 7fc648800700 1 -- 172.21.15.87:0/1317917602 >> 172.21.15.87:0/1317917602 conn(0x7fc640076c70 msgr2=0x7fc640077230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:29:07.410 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:07.404+0000 7fc648800700 1 -- 172.21.15.87:0/1317917602 shutdown_connections 2024-05-08T05:29:07.410 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:07.404+0000 7fc648800700 1 -- 172.21.15.87:0/1317917602 wait complete. 2024-05-08T05:29:08.352 INFO:teuthology.run_tasks:Running task sequential... 2024-05-08T05:29:08.361 INFO:teuthology.task.sequential:In sequential, running task sequential... 2024-05-08T05:29:08.361 INFO:teuthology.task.sequential:In sequential, running task print... 2024-05-08T05:29:08.362 INFO:teuthology.task.print:Enabling mgr modules 2024-05-08T05:29:08.362 INFO:teuthology.run_tasks:Running task kclient... 2024-05-08T05:29:08.422 INFO:tasks.kclient:Mounting kernel clients... 2024-05-08T05:29:08.422 INFO:tasks.kclient:config is {'client.0': {}} 2024-05-08T05:29:08.423 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T05:29:08.423 DEBUG:teuthology.orchestra.run.smithi087:> ip netns list 2024-05-08T05:29:08.482 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T05:29:08.482 DEBUG:teuthology.orchestra.run.smithi087:> sudo ip link delete ceph-brx 2024-05-08T05:29:08.552 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:29:08 smithi087 ceph-mon[29523]: pgmap v424: 97 pgs: 97 active+clean; 644 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T05:29:08.572 INFO:teuthology.orchestra.run.smithi087.stderr:Cannot find device "ceph-brx" 2024-05-08T05:29:08.576 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-08T05:29:08.576 INFO:tasks.kclient:client.0 config is {'mntopts': ['ms_mode=crc', 'wsync'], 'syntax': 'v2', 'mount_subvol_num': 1} 2024-05-08T05:29:08.577 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-05-08T05:29:08.577 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-05-08T05:29:08.577 DEBUG:teuthology.orchestra.run.smithi087:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid eeeb813e-0cf9-11ef-bc97-c7b262605968 -- ceph fs ls 2024-05-08T05:29:08.733 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:29:08 smithi090 ceph-mon[34526]: pgmap v424: 97 pgs: 97 active+clean; 644 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T05:29:08.788 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:29:08 smithi160 ceph-mon[34827]: pgmap v424: 97 pgs: 97 active+clean; 644 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T05:29:09.022 INFO:teuthology.orchestra.run.smithi087.stderr:Inferring config /var/lib/ceph/eeeb813e-0cf9-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T05:29:10.688 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:29:10 smithi087 ceph-mon[29523]: pgmap v425: 97 pgs: 97 active+clean; 644 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-05-08T05:29:10.733 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:29:10 smithi090 ceph-mon[34526]: pgmap v425: 97 pgs: 97 active+clean; 644 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-05-08T05:29:10.789 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:29:10 smithi160 ceph-mon[34827]: pgmap v425: 97 pgs: 97 active+clean; 644 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-05-08T05:29:11.172 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:11.171+0000 7fb7a3e00700 1 -- 172.21.15.87:0/1156429011 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb79c103550 msgr2=0x7fb79c1039b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:29:11.172 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:11.171+0000 7fb7a3e00700 1 --2- 172.21.15.87:0/1156429011 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb79c103550 0x7fb79c1039b0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fb788009990 tx=0x7fb788009ca0 comp rx=0 tx=0).stop 2024-05-08T05:29:11.172 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:11.171+0000 7fb7a3e00700 1 -- 172.21.15.87:0/1156429011 shutdown_connections 2024-05-08T05:29:11.172 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:11.171+0000 7fb7a3e00700 1 --2- 172.21.15.87:0/1156429011 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb79c103ef0 0x7fb79c1103d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:29:11.172 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:11.171+0000 7fb7a3e00700 1 --2- 172.21.15.87:0/1156429011 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb79c108460 0x7fb79c108840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:29:11.172 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:11.171+0000 7fb7a3e00700 1 --2- 172.21.15.87:0/1156429011 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb79c103550 0x7fb79c1039b0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:29:11.172 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:11.171+0000 7fb7a3e00700 1 -- 172.21.15.87:0/1156429011 >> 172.21.15.87:0/1156429011 conn(0x7fb79c07a600 msgr2=0x7fb79c07aa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:29:11.172 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:11.171+0000 7fb7a3e00700 1 -- 172.21.15.87:0/1156429011 shutdown_connections 2024-05-08T05:29:11.173 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:11.171+0000 7fb7a3e00700 1 -- 172.21.15.87:0/1156429011 wait complete. 2024-05-08T05:29:11.173 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:11.173+0000 7fb7a3e00700 1 Processor -- start 2024-05-08T05:29:11.173 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:11.173+0000 7fb7a3e00700 1 -- start start 2024-05-08T05:29:11.174 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:11.173+0000 7fb7a3e00700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb79c103550 0x7fb79c0757a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:29:11.174 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:11.173+0000 7fb7a3e00700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb79c103ef0 0x7fb79c075ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:29:11.174 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:11.173+0000 7fb7a3e00700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb79c108460 0x7fb79c076220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:29:11.174 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:11.173+0000 7fb7a3e00700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fb79c1136a0 con 0x7fb79c103550 2024-05-08T05:29:11.174 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:11.173+0000 7fb7a3e00700 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fb79c113520 con 0x7fb79c103ef0 2024-05-08T05:29:11.174 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:11.173+0000 7fb7a3e00700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7fb79c113820 con 0x7fb79c108460 2024-05-08T05:29:11.175 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:11.174+0000 7fb7a1400700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb79c103550 0x7fb79c0757a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:29:11.175 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:11.174+0000 7fb7a1400700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb79c103550 0x7fb79c0757a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:53186/0 (socket says 172.21.15.87:53186) 2024-05-08T05:29:11.175 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:11.174+0000 7fb7a1400700 1 -- 172.21.15.87:0/3280888944 learned_addr learned my addr 172.21.15.87:0/3280888944 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T05:29:11.175 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:11.174+0000 7fb7a1e00700 1 --2- 172.21.15.87:0/3280888944 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb79c108460 0x7fb79c076220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:29:11.175 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:11.174+0000 7fb7a0a00700 1 --2- 172.21.15.87:0/3280888944 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb79c103ef0 0x7fb79c075ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:29:11.175 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:11.174+0000 7fb7a1400700 1 -- 172.21.15.87:0/3280888944 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb79c108460 msgr2=0x7fb79c076220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:29:11.176 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:11.174+0000 7fb7a1400700 1 --2- 172.21.15.87:0/3280888944 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb79c108460 0x7fb79c076220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:29:11.176 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:11.174+0000 7fb7a1400700 1 -- 172.21.15.87:0/3280888944 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb79c103ef0 msgr2=0x7fb79c075ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:29:11.176 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:11.174+0000 7fb7a1400700 1 --2- 172.21.15.87:0/3280888944 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb79c103ef0 0x7fb79c075ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:29:11.176 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:11.174+0000 7fb7a1400700 1 -- 172.21.15.87:0/3280888944 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb79c1a8070 con 0x7fb79c103550 2024-05-08T05:29:11.176 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:11.174+0000 7fb7a0a00700 1 --2- 172.21.15.87:0/3280888944 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb79c103ef0 0x7fb79c075ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T05:29:11.176 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:11.175+0000 7fb7a1400700 1 --2- 172.21.15.87:0/3280888944 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb79c103550 0x7fb79c0757a0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fb79000d980 tx=0x7fb79000dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:29:11.176 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:11.175+0000 7fb79a000700 1 -- 172.21.15.87:0/3280888944 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb790016070 con 0x7fb79c103550 2024-05-08T05:29:11.176 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:11.175+0000 7fb79a000700 1 -- 172.21.15.87:0/3280888944 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb79000fd40 con 0x7fb79c103550 2024-05-08T05:29:11.176 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:11.175+0000 7fb7a3e00700 1 -- 172.21.15.87:0/3280888944 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb79c1a8360 con 0x7fb79c103550 2024-05-08T05:29:11.176 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:11.175+0000 7fb79a000700 1 -- 172.21.15.87:0/3280888944 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb790019360 con 0x7fb79c103550 2024-05-08T05:29:11.177 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:11.175+0000 7fb7a3e00700 1 -- 172.21.15.87:0/3280888944 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb79c1a8870 con 0x7fb79c103550 2024-05-08T05:29:11.177 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:11.176+0000 7fb7a3e00700 1 -- 172.21.15.87:0/3280888944 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb79c06a190 con 0x7fb79c103550 2024-05-08T05:29:11.179 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:11.179+0000 7fb79a000700 1 -- 172.21.15.87:0/3280888944 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7fb790019070 con 0x7fb79c103550 2024-05-08T05:29:11.182 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:11.181+0000 7fb79a000700 1 --2- 172.21.15.87:0/3280888944 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7fb7840b2880 0x7fb7840b4d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:29:11.183 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:11.181+0000 7fb79a000700 1 -- 172.21.15.87:0/3280888944 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8190+0+0 (secure 0 0 0) 0x7fb7900e2130 con 0x7fb79c103550 2024-05-08T05:29:11.183 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:11.181+0000 7fb7a0a00700 1 --2- 172.21.15.87:0/3280888944 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7fb7840b2880 0x7fb7840b4d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:29:11.183 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:11.182+0000 7fb7a0a00700 1 --2- 172.21.15.87:0/3280888944 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7fb7840b2880 0x7fb7840b4d40 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fb78800b5c0 tx=0x7fb788005960 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:29:11.183 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:11.183+0000 7fb79a000700 1 -- 172.21.15.87:0/3280888944 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7fb7900a9e20 con 0x7fb79c103550 2024-05-08T05:29:11.481 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:11.480+0000 7fb7a3e00700 1 -- 172.21.15.87:0/3280888944 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7fb79c02e510 con 0x7fb79c103550 2024-05-08T05:29:11.481 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:11.481+0000 7fb79a000700 1 -- 172.21.15.87:0/3280888944 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v24) ==== 53+0+73 (secure 0 0 0) 0x7fb7900a9720 con 0x7fb79c103550 2024-05-08T05:29:11.482 INFO:teuthology.orchestra.run.smithi087.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-05-08T05:29:11.484 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:11.484+0000 7fb7a3e00700 1 -- 172.21.15.87:0/3280888944 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7fb7840b2880 msgr2=0x7fb7840b4d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:29:11.485 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:11.484+0000 7fb7a3e00700 1 --2- 172.21.15.87:0/3280888944 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7fb7840b2880 0x7fb7840b4d40 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fb78800b5c0 tx=0x7fb788005960 comp rx=0 tx=0).stop 2024-05-08T05:29:11.485 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:11.484+0000 7fb7a3e00700 1 -- 172.21.15.87:0/3280888944 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb79c103550 msgr2=0x7fb79c0757a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:29:11.485 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:11.484+0000 7fb7a3e00700 1 --2- 172.21.15.87:0/3280888944 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb79c103550 0x7fb79c0757a0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fb79000d980 tx=0x7fb79000dc90 comp rx=0 tx=0).stop 2024-05-08T05:29:11.485 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:11.484+0000 7fb7a3e00700 1 -- 172.21.15.87:0/3280888944 shutdown_connections 2024-05-08T05:29:11.485 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:11.484+0000 7fb7a3e00700 1 --2- 172.21.15.87:0/3280888944 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7fb7840b2880 0x7fb7840b4d40 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:29:11.485 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:11.484+0000 7fb7a3e00700 1 --2- 172.21.15.87:0/3280888944 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb79c108460 0x7fb79c076220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:29:11.485 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:11.484+0000 7fb7a3e00700 1 --2- 172.21.15.87:0/3280888944 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb79c103550 0x7fb79c0757a0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:29:11.486 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:11.484+0000 7fb7a3e00700 1 --2- 172.21.15.87:0/3280888944 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb79c103ef0 0x7fb79c075ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:29:11.486 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:11.484+0000 7fb7a3e00700 1 -- 172.21.15.87:0/3280888944 >> 172.21.15.87:0/3280888944 conn(0x7fb79c07a600 msgr2=0x7fb79c1015a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:29:11.486 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:11.484+0000 7fb7a3e00700 1 -- 172.21.15.87:0/3280888944 shutdown_connections 2024-05-08T05:29:11.486 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:11.484+0000 7fb7a3e00700 1 -- 172.21.15.87:0/3280888944 wait complete. 2024-05-08T05:29:12.268 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-05-08T05:29:12.268 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-05-08T05:29:12.268 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi087.front.sepia.ceph.com 2024-05-08T05:29:12.268 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-05-08T05:29:12.268 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-05-08T05:29:12.269 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-05-08T05:29:12.269 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-05-08T05:29:12.269 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-05-08T05:29:12.269 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2024-05-08T05:29:12.269 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T05:29:12.269 DEBUG:teuthology.orchestra.run.smithi087:> ip addr 2024-05-08T05:29:12.325 INFO:teuthology.orchestra.run.smithi087.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-05-08T05:29:12.325 INFO:teuthology.orchestra.run.smithi087.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-05-08T05:29:12.325 INFO:teuthology.orchestra.run.smithi087.stdout: inet 127.0.0.1/8 scope host lo 2024-05-08T05:29:12.325 INFO:teuthology.orchestra.run.smithi087.stdout: valid_lft forever preferred_lft forever 2024-05-08T05:29:12.325 INFO:teuthology.orchestra.run.smithi087.stdout: inet6 ::1/128 scope host 2024-05-08T05:29:12.325 INFO:teuthology.orchestra.run.smithi087.stdout: valid_lft forever preferred_lft forever 2024-05-08T05:29:12.326 INFO:teuthology.orchestra.run.smithi087.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-08T05:29:12.326 INFO:teuthology.orchestra.run.smithi087.stdout: link/ether 0c:c4:7a:d8:da:fc brd ff:ff:ff:ff:ff:ff 2024-05-08T05:29:12.326 INFO:teuthology.orchestra.run.smithi087.stdout: altname enp7s0f0 2024-05-08T05:29:12.326 INFO:teuthology.orchestra.run.smithi087.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-08T05:29:12.326 INFO:teuthology.orchestra.run.smithi087.stdout: link/ether 0c:c4:7a:d8:da:fd brd ff:ff:ff:ff:ff:ff 2024-05-08T05:29:12.326 INFO:teuthology.orchestra.run.smithi087.stdout: altname enp7s0f1 2024-05-08T05:29:12.326 INFO:teuthology.orchestra.run.smithi087.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-08T05:29:12.326 INFO:teuthology.orchestra.run.smithi087.stdout: link/ether 0c:c4:7a:8f:d5:f4 brd ff:ff:ff:ff:ff:ff 2024-05-08T05:29:12.326 INFO:teuthology.orchestra.run.smithi087.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-05-08T05:29:12.326 INFO:teuthology.orchestra.run.smithi087.stdout: link/ether 0c:c4:7a:8f:d5:f5 brd ff:ff:ff:ff:ff:ff 2024-05-08T05:29:12.326 INFO:teuthology.orchestra.run.smithi087.stdout: inet 172.21.15.87/20 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-05-08T05:29:12.326 INFO:teuthology.orchestra.run.smithi087.stdout: valid_lft 41875sec preferred_lft 41875sec 2024-05-08T05:29:12.326 INFO:teuthology.orchestra.run.smithi087.stdout: inet6 fe80::ec4:7aff:fe8f:d5f5/64 scope link 2024-05-08T05:29:12.327 INFO:teuthology.orchestra.run.smithi087.stdout: valid_lft forever preferred_lft forever 2024-05-08T05:29:12.328 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-05-08T05:29:12.328 DEBUG:teuthology.orchestra.run.smithi087:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-08T05:29:12.328 DEBUG:teuthology.orchestra.run.smithi087:> set -e 2024-05-08T05:29:12.328 DEBUG:teuthology.orchestra.run.smithi087:> sudo ip link add name ceph-brx type bridge 2024-05-08T05:29:12.329 DEBUG:teuthology.orchestra.run.smithi087:> sudo ip addr flush dev ceph-brx 2024-05-08T05:29:12.329 DEBUG:teuthology.orchestra.run.smithi087:> sudo ip link set ceph-brx up 2024-05-08T05:29:12.329 DEBUG:teuthology.orchestra.run.smithi087:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-05-08T05:29:12.329 DEBUG:teuthology.orchestra.run.smithi087:> ') 2024-05-08T05:29:12.434 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:12 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-08T05:29:12.462 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:29:12 smithi087 ceph-mon[29523]: pgmap v426: 97 pgs: 97 active+clean; 644 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T05:29:12.462 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:29:12 smithi087 ceph-mon[29523]: from='client.? 172.21.15.87:0/3280888944' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-05-08T05:29:12.733 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:29:12 smithi090 ceph-mon[34526]: pgmap v426: 97 pgs: 97 active+clean; 644 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T05:29:12.734 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:29:12 smithi090 ceph-mon[34526]: from='client.? 172.21.15.87:0/3280888944' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-05-08T05:29:12.788 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:29:12 smithi160 ceph-mon[34827]: pgmap v426: 97 pgs: 97 active+clean; 644 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T05:29:12.789 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:29:12 smithi160 ceph-mon[34827]: from='client.? 172.21.15.87:0/3280888944' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-05-08T05:29:12.809 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:12 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-08T05:29:12.820 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T05:29:12.820 DEBUG:teuthology.orchestra.run.smithi087:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-05-08T05:29:12.886 INFO:teuthology.orchestra.run.smithi087.stdout:1 2024-05-08T05:29:12.890 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T05:29:12.890 DEBUG:teuthology.orchestra.run.smithi087:> route 2024-05-08T05:29:12.943 INFO:teuthology.orchestra.run.smithi087.stdout:Kernel IP routing table 2024-05-08T05:29:12.944 INFO:teuthology.orchestra.run.smithi087.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-05-08T05:29:12.944 INFO:teuthology.orchestra.run.smithi087.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-05-08T05:29:12.944 INFO:teuthology.orchestra.run.smithi087.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-05-08T05:29:12.944 INFO:teuthology.orchestra.run.smithi087.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-05-08T05:29:12.945 DEBUG:teuthology.orchestra.run.smithi087:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-08T05:29:12.945 DEBUG:teuthology.orchestra.run.smithi087:> set -e 2024-05-08T05:29:12.946 DEBUG:teuthology.orchestra.run.smithi087:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-05-08T05:29:12.946 DEBUG:teuthology.orchestra.run.smithi087:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-05-08T05:29:12.946 DEBUG:teuthology.orchestra.run.smithi087:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-05-08T05:29:12.946 DEBUG:teuthology.orchestra.run.smithi087:> ') 2024-05-08T05:29:13.046 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:13 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-08T05:29:13.645 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:13 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-08T05:29:13.655 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T05:29:13.655 DEBUG:teuthology.orchestra.run.smithi087:> ip netns list 2024-05-08T05:29:13.708 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T05:29:13.708 DEBUG:teuthology.orchestra.run.smithi087:> ip netns list-id 2024-05-08T05:29:13.757 DEBUG:teuthology.orchestra.run.smithi087:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-08T05:29:13.757 DEBUG:teuthology.orchestra.run.smithi087:> set -e 2024-05-08T05:29:13.757 DEBUG:teuthology.orchestra.run.smithi087:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2024-05-08T05:29:13.757 DEBUG:teuthology.orchestra.run.smithi087:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2024-05-08T05:29:13.757 DEBUG:teuthology.orchestra.run.smithi087:> ') 2024-05-08T05:29:13.861 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:13 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-08T05:29:13.932 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:13 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-08T05:29:13.941 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2024-05-08T05:29:13.941 DEBUG:teuthology.orchestra.run.smithi087:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-08T05:29:13.942 DEBUG:teuthology.orchestra.run.smithi087:> set -e 2024-05-08T05:29:13.942 DEBUG:teuthology.orchestra.run.smithi087:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2024-05-08T05:29:13.942 DEBUG:teuthology.orchestra.run.smithi087:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-05-08T05:29:13.942 DEBUG:teuthology.orchestra.run.smithi087:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2024-05-08T05:29:13.942 DEBUG:teuthology.orchestra.run.smithi087:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2024-05-08T05:29:13.942 DEBUG:teuthology.orchestra.run.smithi087:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2024-05-08T05:29:13.942 DEBUG:teuthology.orchestra.run.smithi087:> ') 2024-05-08T05:29:14.041 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:14 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-08T05:29:14.233 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:14 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-08T05:29:14.243 DEBUG:teuthology.orchestra.run.smithi087:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-08T05:29:14.243 DEBUG:teuthology.orchestra.run.smithi087:> set -e 2024-05-08T05:29:14.243 DEBUG:teuthology.orchestra.run.smithi087:> sudo ip link set brx.0 up 2024-05-08T05:29:14.243 DEBUG:teuthology.orchestra.run.smithi087:> sudo ip link set dev brx.0 master ceph-brx 2024-05-08T05:29:14.243 DEBUG:teuthology.orchestra.run.smithi087:> ') 2024-05-08T05:29:14.339 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:14 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-08T05:29:14.409 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:29:14 smithi087 ceph-mon[29523]: pgmap v427: 97 pgs: 97 active+clean; 644 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-05-08T05:29:14.434 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:14 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-08T05:29:14.443 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-05-08T05:29:14.443 DEBUG:teuthology.orchestra.run.smithi087:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-05-08T05:29:14.484 INFO:teuthology.orchestra.run.smithi087.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-05-08T05:29:14.484 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-05-08T05:29:14.484 DEBUG:teuthology.orchestra.run.smithi087:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-05-08T05:29:14.580 WARNING:tasks.cephfs.mount:You cannot specify both: cephfs_mntpt and mount_subvol_num 2024-05-08T05:29:14.580 INFO:tasks.cephfs.mount:Mounting subvol 1 for now 2024-05-08T05:29:14.580 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/volumes/qa/sv_1/9478313c-6fba-4107-b3b2-23d2237bfde7 2024-05-08T05:29:14.580 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T05:29:14.581 DEBUG:teuthology.orchestra.run.smithi087:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/volumes/qa/sv_1/9478313c-6fba-4107-b3b2-23d2237bfde7 /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,ms_mode=crc,wsync,nofallback 2024-05-08T05:29:14.733 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:29:14 smithi090 ceph-mon[34526]: pgmap v427: 97 pgs: 97 active+clean; 644 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-05-08T05:29:14.734 INFO:teuthology.orchestra.run.smithi087.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,ms_mode=crc,wsync,nofallback 2024-05-08T05:29:14.734 INFO:teuthology.orchestra.run.smithi087.stdout:mount.ceph: options "norequire_active_mds,norbytes,ms_mode=crc,wsync". 2024-05-08T05:29:14.788 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:29:14 smithi160 ceph-mon[34827]: pgmap v427: 97 pgs: 97 active+clean; 644 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-05-08T05:29:15.460 INFO:teuthology.orchestra.run.smithi087.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,ms_mode=crc,wsync,nofallback 2024-05-08T05:29:15.460 INFO:teuthology.orchestra.run.smithi087.stdout:mount.ceph: options "norequire_active_mds,norbytes,ms_mode=crc,wsync". 2024-05-08T05:29:15.460 INFO:teuthology.orchestra.run.smithi087.stdout:mount.ceph: resolved to: "172.21.15.87:3300,172.21.15.90:3300,172.21.15.160:3300" 2024-05-08T05:29:15.460 INFO:teuthology.orchestra.run.smithi087.stdout:mount.ceph: trying mount with new device syntax: 0@eeeb813e-0cf9-11ef-bc97-c7b262605968.cephfs=/volumes/qa/sv_1/9478313c-6fba-4107-b3b2-23d2237bfde7 2024-05-08T05:29:15.461 INFO:teuthology.orchestra.run.smithi087.stdout:mount.ceph: options "norequire_active_mds,norbytes,ms_mode=crc,wsync,name=0,key=0,mon_addr=172.21.15.87:3300/172.21.15.90:3300/172.21.15.160:3300" will pass to kernel 2024-05-08T05:29:15.465 INFO:teuthology.orchestra.run.smithi087.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-05-08T05:29:15.466 INFO:teuthology.orchestra.run.smithi087.stdout: You just mounted a file system that supports labels which does not 2024-05-08T05:29:15.466 INFO:teuthology.orchestra.run.smithi087.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-05-08T05:29:15.466 INFO:teuthology.orchestra.run.smithi087.stdout: applications will generate AVC messages and not be allowed access to 2024-05-08T05:29:15.466 INFO:teuthology.orchestra.run.smithi087.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-05-08T05:29:15.470 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-05-08T05:29:15.471 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T05:29:15.471 DEBUG:teuthology.orchestra.run.smithi087:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-05-08T05:29:15.554 DEBUG:teuthology.orchestra.run.smithi087:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-05-08T05:29:15.665 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:15 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-05-08T05:29:15.670 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:15 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-08T05:29:15.679 INFO:teuthology.orchestra.run.smithi087.stdout:client25007 2024-05-08T05:29:15.680 DEBUG:teuthology.orchestra.run.smithi087:> set -ex 2024-05-08T05:29:15.680 DEBUG:teuthology.orchestra.run.smithi087:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-08T05:29:15.729 DEBUG:teuthology.orchestra.run.smithi087:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-05-08T05:29:15.879 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:15 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-05-08T05:29:15.883 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:15 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-08T05:29:15.893 INFO:teuthology.orchestra.run.smithi087.stdout:client25007 2024-05-08T05:29:15.893 DEBUG:teuthology.orchestra.run.smithi087:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-05-08T05:29:15.998 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:15 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-05-08T05:29:16.003 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:16 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-08T05:29:16.012 INFO:teuthology.orchestra.run.smithi087.stdout:client25007 2024-05-08T05:29:16.013 DEBUG:teuthology.orchestra.run.smithi087:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=300 -- bash -c 'sudo dd if=/sys/kernel/debug/ceph/eeeb813e-0cf9-11ef-bc97-c7b262605968.client25007/status') 2024-05-08T05:29:16.108 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:16 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-08T05:29:16.138 INFO:teuthology.orchestra.run.smithi087.stdout:instance: client.25007 (3)172.21.15.87:0/3967559321 2024-05-08T05:29:16.139 INFO:teuthology.orchestra.run.smithi087.stdout:blocklisted: false 2024-05-08T05:29:16.139 INFO:teuthology.orchestra.run.smithi087.stderr:0+1 records in 2024-05-08T05:29:16.139 INFO:teuthology.orchestra.run.smithi087.stderr:0+1 records out 2024-05-08T05:29:16.139 INFO:teuthology.orchestra.run.smithi087.stderr:71 bytes copied, 7.678e-05 s, 925 kB/s 2024-05-08T05:29:16.141 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:16 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-08T05:29:16.151 INFO:teuthology.run_tasks:Running task exec... 2024-05-08T05:29:16.162 INFO:teuthology.task.exec:Executing custom commands... 2024-05-08T05:29:16.163 INFO:teuthology.task.exec:Running commands on role mon.a host ubuntu@smithi087.front.sepia.ceph.com 2024-05-08T05:29:16.163 DEBUG:teuthology.orchestra.run.smithi087:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs set cephfs balance_automate true' 2024-05-08T05:29:16.361 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:16.359+0000 7f308f200640 1 -- 172.21.15.87:0/1218843597 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3090104480 msgr2=0x7f309010ad10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:29:16.361 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:16.359+0000 7f308f200640 1 --2- 172.21.15.87:0/1218843597 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3090104480 0x7f309010ad10 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f3088009be0 tx=0x7f308802a6c0 comp rx=0 tx=0).stop 2024-05-08T05:29:16.361 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:16.359+0000 7f308f200640 1 -- 172.21.15.87:0/1218843597 shutdown_connections 2024-05-08T05:29:16.361 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:16.359+0000 7f308f200640 1 --2- 172.21.15.87:0/1218843597 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3090104480 0x7f309010ad10 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:29:16.361 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:16.359+0000 7f308f200640 1 --2- 172.21.15.87:0/1218843597 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3090103ac0 0x7f3090103f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:29:16.361 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:16.359+0000 7f308f200640 1 --2- 172.21.15.87:0/1218843597 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f30901028d0 0x7f3090102cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:29:16.361 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:16.359+0000 7f308f200640 1 -- 172.21.15.87:0/1218843597 >> 172.21.15.87:0/1218843597 conn(0x7f30900fde40 msgr2=0x7f3090100280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:29:16.362 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:16.359+0000 7f308f200640 1 -- 172.21.15.87:0/1218843597 shutdown_connections 2024-05-08T05:29:16.362 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:16.359+0000 7f308f200640 1 -- 172.21.15.87:0/1218843597 wait complete. 2024-05-08T05:29:16.362 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:16.360+0000 7f308f200640 1 Processor -- start 2024-05-08T05:29:16.362 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:16.360+0000 7f308f200640 1 -- start start 2024-05-08T05:29:16.364 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:16.361+0000 7f308f200640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f30901028d0 0x7f309019abd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:29:16.364 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:16.361+0000 7f308f200640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3090103ac0 0x7f309019b110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:29:16.364 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:16.361+0000 7f308f200640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3090104480 0x7f30901a2180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:29:16.365 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:16.361+0000 7f308f200640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f309010e370 con 0x7f3090103ac0 2024-05-08T05:29:16.365 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:16.361+0000 7f308f200640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f309010e1f0 con 0x7f3090104480 2024-05-08T05:29:16.365 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:16.361+0000 7f308f200640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f309010e4f0 con 0x7f30901028d0 2024-05-08T05:29:16.365 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:16.361+0000 7f3085400640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3090103ac0 0x7f309019b110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:29:16.365 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:16.361+0000 7f308de00640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f30901028d0 0x7f309019abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:29:16.365 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:16.361+0000 7f308de00640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f30901028d0 0x7f309019abd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.87:60224/0 (socket says 172.21.15.87:60224) 2024-05-08T05:29:16.365 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:16.361+0000 7f308de00640 1 -- 172.21.15.87:0/34553740 learned_addr learned my addr 172.21.15.87:0/34553740 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T05:29:16.365 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:16.361+0000 7f308e800640 1 --2- 172.21.15.87:0/34553740 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3090104480 0x7f30901a2180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:29:16.365 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:16.362+0000 7f308de00640 1 -- 172.21.15.87:0/34553740 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3090104480 msgr2=0x7f30901a2180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:29:16.365 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:16.362+0000 7f308de00640 1 --2- 172.21.15.87:0/34553740 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3090104480 0x7f30901a2180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:29:16.365 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:16.362+0000 7f308de00640 1 -- 172.21.15.87:0/34553740 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3090103ac0 msgr2=0x7f309019b110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:29:16.366 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:16.362+0000 7f308de00640 1 --2- 172.21.15.87:0/34553740 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3090103ac0 0x7f309019b110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:29:16.366 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:16.362+0000 7f308de00640 1 -- 172.21.15.87:0/34553740 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f30901a27f0 con 0x7f30901028d0 2024-05-08T05:29:16.366 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:16.362+0000 7f308de00640 1 --2- 172.21.15.87:0/34553740 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f30901028d0 0x7f309019abd0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f308000e9c0 tx=0x7f308000ee80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:29:16.366 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:16.362+0000 7f3087400640 1 -- 172.21.15.87:0/34553740 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f308000cd80 con 0x7f30901028d0 2024-05-08T05:29:16.366 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:16.362+0000 7f3087400640 1 -- 172.21.15.87:0/34553740 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f30800035f0 con 0x7f30901028d0 2024-05-08T05:29:16.366 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:16.362+0000 7f3087400640 1 -- 172.21.15.87:0/34553740 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3080010690 con 0x7f30901028d0 2024-05-08T05:29:16.366 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:16.362+0000 7f308f200640 1 -- 172.21.15.87:0/34553740 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f30901a2ae0 con 0x7f30901028d0 2024-05-08T05:29:16.366 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:16.362+0000 7f308f200640 1 -- 172.21.15.87:0/34553740 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f30901a2fe0 con 0x7f30901028d0 2024-05-08T05:29:16.366 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:16.363+0000 7f308f200640 1 -- 172.21.15.87:0/34553740 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3090050f90 con 0x7f30901028d0 2024-05-08T05:29:16.367 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:16.366+0000 7f3087400640 1 -- 172.21.15.87:0/34553740 <== mon.1 v2:172.21.15.160:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7f30800037a0 con 0x7f30901028d0 2024-05-08T05:29:16.367 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:16.367+0000 7f3087400640 1 --2- 172.21.15.87:0/34553740 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f30740b2860 0x7f30740b4d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:29:16.367 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:16.367+0000 7f3087400640 1 -- 172.21.15.87:0/34553740 <== mon.1 v2:172.21.15.160:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8190+0+0 (secure 0 0 0) 0x7f30800e2600 con 0x7f30901028d0 2024-05-08T05:29:16.368 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:16.367+0000 7f3085400640 1 --2- 172.21.15.87:0/34553740 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f30740b2860 0x7f30740b4d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:29:16.368 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:16.368+0000 7f3085400640 1 --2- 172.21.15.87:0/34553740 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f30740b2860 0x7f30740b4d20 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f309019c0e0 tx=0x7f3078009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:29:16.372 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:16.372+0000 7f3087400640 1 -- 172.21.15.87:0/34553740 <== mon.1 v2:172.21.15.160:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f30800aa2f0 con 0x7f30901028d0 2024-05-08T05:29:16.621 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:16.621+0000 7f308f200640 1 -- 172.21.15.87:0/34553740 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"} v 0) -- 0x7f30901a32c0 con 0x7f30901028d0 2024-05-08T05:29:16.708 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:29:16 smithi087 ceph-mon[29523]: pgmap v428: 97 pgs: 97 active+clean; 644 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-05-08T05:29:16.733 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:29:16 smithi090 ceph-mon[34526]: pgmap v428: 97 pgs: 97 active+clean; 644 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-05-08T05:29:16.789 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:29:16 smithi160 ceph-mon[34827]: pgmap v428: 97 pgs: 97 active+clean; 644 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-05-08T05:29:17.427 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:17.427+0000 7f3087400640 1 -- 172.21.15.87:0/34553740 <== mon.1 v2:172.21.15.160:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]=0 v25) ==== 117+0+0 (secure 0 0 0) 0x7f30800a9bf0 con 0x7f30901028d0 2024-05-08T05:29:17.432 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:17.430+0000 7f308f200640 1 -- 172.21.15.87:0/34553740 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f30740b2860 msgr2=0x7f30740b4d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:29:17.432 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:17.430+0000 7f308f200640 1 --2- 172.21.15.87:0/34553740 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f30740b2860 0x7f30740b4d20 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f309019c0e0 tx=0x7f3078009260 comp rx=0 tx=0).stop 2024-05-08T05:29:17.432 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:17.430+0000 7f308f200640 1 -- 172.21.15.87:0/34553740 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f30901028d0 msgr2=0x7f309019abd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:29:17.432 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:17.430+0000 7f308f200640 1 --2- 172.21.15.87:0/34553740 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f30901028d0 0x7f309019abd0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f308000e9c0 tx=0x7f308000ee80 comp rx=0 tx=0).stop 2024-05-08T05:29:17.432 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:17.430+0000 7f308f200640 1 -- 172.21.15.87:0/34553740 shutdown_connections 2024-05-08T05:29:17.432 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:17.430+0000 7f308f200640 1 --2- 172.21.15.87:0/34553740 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f30740b2860 0x7f30740b4d20 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:29:17.433 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:17.430+0000 7f308f200640 1 --2- 172.21.15.87:0/34553740 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3090104480 0x7f30901a2180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:29:17.433 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:17.430+0000 7f308f200640 1 --2- 172.21.15.87:0/34553740 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3090103ac0 0x7f309019b110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:29:17.433 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:17.430+0000 7f308f200640 1 --2- 172.21.15.87:0/34553740 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f30901028d0 0x7f309019abd0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:29:17.433 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:17.430+0000 7f308f200640 1 -- 172.21.15.87:0/34553740 >> 172.21.15.87:0/34553740 conn(0x7f30900fde40 msgr2=0x7f3090074be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:29:17.433 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:17.431+0000 7f308f200640 1 -- 172.21.15.87:0/34553740 shutdown_connections 2024-05-08T05:29:17.434 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:17.431+0000 7f308f200640 1 -- 172.21.15.87:0/34553740 wait complete. 2024-05-08T05:29:17.454 INFO:teuthology.run_tasks:Running task check-counter... 2024-05-08T05:29:17.465 INFO:teuthology.run_tasks:Running task fwd_scrub... 2024-05-08T05:29:17.509 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-08T05:29:17.708 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:29:17 smithi087 ceph-mon[29523]: from='client.? 172.21.15.87:0/34553740' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]: dispatch 2024-05-08T05:29:17.709 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:29:17 smithi087 ceph-mon[29523]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]: dispatch 2024-05-08T05:29:17.719 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:17.719+0000 7fb855e00640 1 -- 172.21.15.87:0/1508443112 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb85010a940 msgr2=0x7fb850111260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:29:17.719 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:17.719+0000 7fb855e00640 1 --2- 172.21.15.87:0/1508443112 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb85010a940 0x7fb850111260 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fb848009ca0 tx=0x7fb84802a8c0 comp rx=0 tx=0).stop 2024-05-08T05:29:17.719 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:17.719+0000 7fb855e00640 1 -- 172.21.15.87:0/1508443112 shutdown_connections 2024-05-08T05:29:17.720 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:17.719+0000 7fb855e00640 1 --2- 172.21.15.87:0/1508443112 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb85010a940 0x7fb850111260 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:29:17.720 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:17.719+0000 7fb855e00640 1 --2- 172.21.15.87:0/1508443112 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb850109f80 0x7fb85010a400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:29:17.720 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:17.719+0000 7fb855e00640 1 --2- 172.21.15.87:0/1508443112 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb850108e30 0x7fb850109250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:29:17.720 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:17.719+0000 7fb855e00640 1 -- 172.21.15.87:0/1508443112 >> 172.21.15.87:0/1508443112 conn(0x7fb850077df0 msgr2=0x7fb85007a210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:29:17.720 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:17.719+0000 7fb855e00640 1 -- 172.21.15.87:0/1508443112 shutdown_connections 2024-05-08T05:29:17.720 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:17.719+0000 7fb855e00640 1 -- 172.21.15.87:0/1508443112 wait complete. 2024-05-08T05:29:17.722 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:17.720+0000 7fb855e00640 1 Processor -- start 2024-05-08T05:29:17.722 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:17.720+0000 7fb855e00640 1 -- start start 2024-05-08T05:29:17.722 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:17.720+0000 7fb855e00640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb850108e30 0x7fb85019eff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:29:17.722 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:17.720+0000 7fb855e00640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb850109f80 0x7fb85019f530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:29:17.722 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:17.720+0000 7fb855e00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb85010a940 0x7fb8501a65a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:29:17.722 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:17.720+0000 7fb855e00640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fb850114980 con 0x7fb850109f80 2024-05-08T05:29:17.723 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:17.720+0000 7fb855e00640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fb850114800 con 0x7fb85010a940 2024-05-08T05:29:17.723 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:17.720+0000 7fb855e00640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7fb850114b00 con 0x7fb850108e30 2024-05-08T05:29:17.723 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:17.721+0000 7fb847e00640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb850109f80 0x7fb85019f530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:29:17.723 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:17.721+0000 7fb855400640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb85010a940 0x7fb8501a65a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:29:17.723 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:17.721+0000 7fb847e00640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb850109f80 0x7fb85019f530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:42810/0 (socket says 172.21.15.87:42810) 2024-05-08T05:29:17.723 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:17.721+0000 7fb854a00640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb850108e30 0x7fb85019eff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:29:17.723 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:17.721+0000 7fb847e00640 1 -- 172.21.15.87:0/3983991678 learned_addr learned my addr 172.21.15.87:0/3983991678 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T05:29:17.723 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:17.721+0000 7fb855400640 1 -- 172.21.15.87:0/3983991678 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb850108e30 msgr2=0x7fb85019eff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:29:17.723 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:17.721+0000 7fb855400640 1 --2- 172.21.15.87:0/3983991678 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb850108e30 0x7fb85019eff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:29:17.723 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:17.721+0000 7fb855400640 1 -- 172.21.15.87:0/3983991678 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb850109f80 msgr2=0x7fb85019f530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:29:17.723 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:17.721+0000 7fb855400640 1 --2- 172.21.15.87:0/3983991678 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb850109f80 0x7fb85019f530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:29:17.723 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:17.721+0000 7fb855400640 1 -- 172.21.15.87:0/3983991678 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb8501a6c10 con 0x7fb85010a940 2024-05-08T05:29:17.723 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:17.721+0000 7fb854a00640 1 --2- 172.21.15.87:0/3983991678 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb850108e30 0x7fb85019eff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T05:29:17.724 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:17.722+0000 7fb855400640 1 --2- 172.21.15.87:0/3983991678 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb85010a940 0x7fb8501a65a0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fb848031a20 tx=0x7fb8480317a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:29:17.724 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:17.722+0000 7fb84e000640 1 -- 172.21.15.87:0/3983991678 <== mon.2 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb848003c30 con 0x7fb85010a940 2024-05-08T05:29:17.724 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:17.722+0000 7fb855e00640 1 -- 172.21.15.87:0/3983991678 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb8501a6ea0 con 0x7fb85010a940 2024-05-08T05:29:17.724 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:17.722+0000 7fb84e000640 1 -- 172.21.15.87:0/3983991678 <== mon.2 v2:172.21.15.90:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb848003dd0 con 0x7fb85010a940 2024-05-08T05:29:17.724 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:17.722+0000 7fb84e000640 1 -- 172.21.15.87:0/3983991678 <== mon.2 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb84802fb60 con 0x7fb85010a940 2024-05-08T05:29:17.724 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:17.722+0000 7fb855e00640 1 -- 172.21.15.87:0/3983991678 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb8501a73b0 con 0x7fb85010a940 2024-05-08T05:29:17.724 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:17.723+0000 7fb855e00640 1 -- 172.21.15.87:0/3983991678 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb850110140 con 0x7fb85010a940 2024-05-08T05:29:17.725 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:17.725+0000 7fb84e000640 1 -- 172.21.15.87:0/3983991678 <== mon.2 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7fb84802fd00 con 0x7fb85010a940 2024-05-08T05:29:17.727 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:17.727+0000 7fb84e000640 1 --2- 172.21.15.87:0/3983991678 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7fb8300b2870 0x7fb8300b4d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:29:17.727 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:17.727+0000 7fb84e000640 1 -- 172.21.15.87:0/3983991678 <== mon.2 v2:172.21.15.90:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8190+0+0 (secure 0 0 0) 0x7fb8481037b0 con 0x7fb85010a940 2024-05-08T05:29:17.727 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:17.727+0000 7fb854a00640 1 --2- 172.21.15.87:0/3983991678 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7fb8300b2870 0x7fb8300b4d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:29:17.728 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:17.728+0000 7fb854a00640 1 --2- 172.21.15.87:0/3983991678 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7fb8300b2870 0x7fb8300b4d30 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fb840009fc0 tx=0x7fb840005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:29:17.729 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:17.729+0000 7fb84e000640 1 -- 172.21.15.87:0/3983991678 <== mon.2 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7fb8480cb530 con 0x7fb85010a940 2024-05-08T05:29:17.733 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:29:17 smithi090 ceph-mon[34526]: from='client.? 172.21.15.87:0/34553740' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]: dispatch 2024-05-08T05:29:17.733 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:29:17 smithi090 ceph-mon[34526]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]: dispatch 2024-05-08T05:29:17.788 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:29:17 smithi160 ceph-mon[34827]: from='client.? 172.21.15.87:0/34553740' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]: dispatch 2024-05-08T05:29:17.788 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:29:17 smithi160 ceph-mon[34827]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]: dispatch 2024-05-08T05:29:17.939 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:17.938+0000 7fb855e00640 1 -- 172.21.15.87:0/3983991678 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fb85002dda0 con 0x7fb85010a940 2024-05-08T05:29:17.941 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:17.940+0000 7fb84e000640 1 -- 172.21.15.87:0/3983991678 <== mon.2 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v82) ==== 74+0+22588 (secure 0 0 0) 0x7fb8480cae30 con 0x7fb85010a940 2024-05-08T05:29:17.941 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-05-08T05:29:17.942 INFO:teuthology.orchestra.run.smithi087.stdout:{"epoch":82,"fsid":"eeeb813e-0cf9-11ef-bc97-c7b262605968","created":"2024-05-08T05:16:14.984330+0000","modified":"2024-05-08T05:26:24.106467+0000","last_up_change":"2024-05-08T05:24:22.324501+0000","last_in_change":"2024-05-08T05:24:01.962570+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-08T05:20:08.907941+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-08T05:25:28.054494+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-08T05:25:32.484126+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"f3e25ce0-0762-46fd-83fb-6766a2e9db69","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6802","nonce":2285285644},{"type":"v1","addr":"172.21.15.87:6803","nonce":2285285644}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6804","nonce":2285285644},{"type":"v1","addr":"172.21.15.87:6805","nonce":2285285644}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6808","nonce":2285285644},{"type":"v1","addr":"172.21.15.87:6809","nonce":2285285644}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6806","nonce":2285285644},{"type":"v1","addr":"172.21.15.87:6807","nonce":2285285644}]},"public_addr":"172.21.15.87:6803/2285285644","cluster_addr":"172.21.15.87:6805/2285285644","heartbeat_back_addr":"172.21.15.87:6809/2285285644","heartbeat_front_addr":"172.21.15.87:6807/2285285644","state":["exists","up"]},{"osd":1,"uuid":"b6de5f4c-1d79-41ff-adee-03d8a47ab55e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6800","nonce":1681573998},{"type":"v1","addr":"172.21.15.90:6801","nonce":1681573998}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6802","nonce":1681573998},{"type":"v1","addr":"172.21.15.90:6803","nonce":1681573998}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6806","nonce":1681573998},{"type":"v1","addr":"172.21.15.90:6807","nonce":1681573998}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6804","nonce":1681573998},{"type":"v1","addr":"172.21.15.90:6805","nonce":1681573998}]},"public_addr":"172.21.15.90:6801/1681573998","cluster_addr":"172.21.15.90:6803/1681573998","heartbeat_back_addr":"172.21.15.90:6807/1681573998","heartbeat_front_addr":"172.21.15.90:6805/1681573998","state":["exists","up"]},{"osd":2,"uuid":"ee3a2729-93b2-4985-b84d-165f92cae8e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6800","nonce":2137179096},{"type":"v1","addr":"172.21.15.160:6801","nonce":2137179096}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6802","nonce":2137179096},{"type":"v1","addr":"172.21.15.160:6803","nonce":2137179096}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6806","nonce":2137179096},{"type":"v1","addr":"172.21.15.160:6807","nonce":2137179096}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6804","nonce":2137179096},{"type":"v1","addr":"172.21.15.160:6805","nonce":2137179096}]},"public_addr":"172.21.15.160:6801/2137179096","cluster_addr":"172.21.15.160:6803/2137179096","heartbeat_back_addr":"172.21.15.160:6807/2137179096","heartbeat_front_addr":"172.21.15.160:6805/2137179096","state":["exists","up"]},{"osd":3,"uuid":"fc7bd69f-5a62-4ec6-b95c-c170be46a7d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6810","nonce":2022667023},{"type":"v1","addr":"172.21.15.87:6811","nonce":2022667023}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6812","nonce":2022667023},{"type":"v1","addr":"172.21.15.87:6813","nonce":2022667023}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6816","nonce":2022667023},{"type":"v1","addr":"172.21.15.87:6817","nonce":2022667023}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6814","nonce":2022667023},{"type":"v1","addr":"172.21.15.87:6815","nonce":2022667023}]},"public_addr":"172.21.15.87:6811/2022667023","cluster_addr":"172.21.15.87:6813/2022667023","heartbeat_back_addr":"172.21.15.87:6817/2022667023","heartbeat_front_addr":"172.21.15.87:6815/2022667023","state":["exists","up"]},{"osd":4,"uuid":"a05f7bd1-962a-4f3e-8f70-e7ef4c68bac2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6808","nonce":1371607578},{"type":"v1","addr":"172.21.15.90:6809","nonce":1371607578}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6810","nonce":1371607578},{"type":"v1","addr":"172.21.15.90:6811","nonce":1371607578}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6814","nonce":1371607578},{"type":"v1","addr":"172.21.15.90:6815","nonce":1371607578}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6812","nonce":1371607578},{"type":"v1","addr":"172.21.15.90:6813","nonce":1371607578}]},"public_addr":"172.21.15.90:6809/1371607578","cluster_addr":"172.21.15.90:6811/1371607578","heartbeat_back_addr":"172.21.15.90:6815/1371607578","heartbeat_front_addr":"172.21.15.90:6813/1371607578","state":["exists","up"]},{"osd":5,"uuid":"85e3af08-32ee-4f26-97df-8d54ba928715","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6808","nonce":2190054276},{"type":"v1","addr":"172.21.15.160:6809","nonce":2190054276}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6810","nonce":2190054276},{"type":"v1","addr":"172.21.15.160:6811","nonce":2190054276}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6814","nonce":2190054276},{"type":"v1","addr":"172.21.15.160:6815","nonce":2190054276}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6812","nonce":2190054276},{"type":"v1","addr":"172.21.15.160:6813","nonce":2190054276}]},"public_addr":"172.21.15.160:6809/2190054276","cluster_addr":"172.21.15.160:6811/2190054276","heartbeat_back_addr":"172.21.15.160:6815/2190054276","heartbeat_front_addr":"172.21.15.160:6813/2190054276","state":["exists","up"]},{"osd":6,"uuid":"df4b22a9-6cd8-473e-a17b-a0cb9ad32e98","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":42,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6818","nonce":2863681447},{"type":"v1","addr":"172.21.15.87:6819","nonce":2863681447}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6820","nonce":2863681447},{"type":"v1","addr":"172.21.15.87:6821","nonce":2863681447}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6824","nonce":2863681447},{"type":"v1","addr":"172.21.15.87:6825","nonce":2863681447}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6822","nonce":2863681447},{"type":"v1","addr":"172.21.15.87:6823","nonce":2863681447}]},"public_addr":"172.21.15.87:6819/2863681447","cluster_addr":"172.21.15.87:6821/2863681447","heartbeat_back_addr":"172.21.15.87:6825/2863681447","heartbeat_front_addr":"172.21.15.87:6823/2863681447","state":["exists","up"]},{"osd":7,"uuid":"f6ef3857-0366-4408-932a-a8c8479ba780","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6816","nonce":1964248958},{"type":"v1","addr":"172.21.15.90:6817","nonce":1964248958}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6818","nonce":1964248958},{"type":"v1","addr":"172.21.15.90:6819","nonce":1964248958}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6822","nonce":1964248958},{"type":"v1","addr":"172.21.15.90:6823","nonce":1964248958}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6820","nonce":1964248958},{"type":"v1","addr":"172.21.15.90:6821","nonce":1964248958}]},"public_addr":"172.21.15.90:6817/1964248958","cluster_addr":"172.21.15.90:6819/1964248958","heartbeat_back_addr":"172.21.15.90:6823/1964248958","heartbeat_front_addr":"172.21.15.90:6821/1964248958","state":["exists","up"]},{"osd":8,"uuid":"027dede9-d0be-4fbe-b7b8-02ce88d57f4d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":54,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6816","nonce":927680738},{"type":"v1","addr":"172.21.15.160:6817","nonce":927680738}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6818","nonce":927680738},{"type":"v1","addr":"172.21.15.160:6819","nonce":927680738}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6822","nonce":927680738},{"type":"v1","addr":"172.21.15.160:6823","nonce":927680738}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6820","nonce":927680738},{"type":"v1","addr":"172.21.15.160:6821","nonce":927680738}]},"public_addr":"172.21.15.160:6817/927680738","cluster_addr":"172.21.15.160:6819/927680738","heartbeat_back_addr":"172.21.15.160:6823/927680738","heartbeat_front_addr":"172.21.15.160:6821/927680738","state":["exists","up"]},{"osd":9,"uuid":"bc9e37de-e509-4db6-bd58-b68e2c8e1aff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6826","nonce":3789116749},{"type":"v1","addr":"172.21.15.87:6827","nonce":3789116749}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6828","nonce":3789116749},{"type":"v1","addr":"172.21.15.87:6829","nonce":3789116749}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6832","nonce":3789116749},{"type":"v1","addr":"172.21.15.87:6833","nonce":3789116749}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6830","nonce":3789116749},{"type":"v1","addr":"172.21.15.87:6831","nonce":3789116749}]},"public_addr":"172.21.15.87:6827/3789116749","cluster_addr":"172.21.15.87:6829/3789116749","heartbeat_back_addr":"172.21.15.87:6833/3789116749","heartbeat_front_addr":"172.21.15.87:6831/3789116749","state":["exists","up"]},{"osd":10,"uuid":"43945081-b4c8-4f5d-9301-3540709e69e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":66,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6824","nonce":716529498},{"type":"v1","addr":"172.21.15.90:6825","nonce":716529498}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6826","nonce":716529498},{"type":"v1","addr":"172.21.15.90:6827","nonce":716529498}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6830","nonce":716529498},{"type":"v1","addr":"172.21.15.90:6831","nonce":716529498}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6828","nonce":716529498},{"type":"v1","addr":"172.21.15.90:6829","nonce":716529498}]},"public_addr":"172.21.15.90:6825/716529498","cluster_addr":"172.21.15.90:6827/716529498","heartbeat_back_addr":"172.21.15.90:6831/716529498","heartbeat_front_addr":"172.21.15.90:6829/716529498","state":["exists","up"]},{"osd":11,"uuid":"da23ff5c-3f79-44e3-bca3-d9d5a003c999","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6824","nonce":1842739135},{"type":"v1","addr":"172.21.15.160:6825","nonce":1842739135}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6826","nonce":1842739135},{"type":"v1","addr":"172.21.15.160:6827","nonce":1842739135}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6830","nonce":1842739135},{"type":"v1","addr":"172.21.15.160:6831","nonce":1842739135}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6828","nonce":1842739135},{"type":"v1","addr":"172.21.15.160:6829","nonce":1842739135}]},"public_addr":"172.21.15.160:6825/1842739135","cluster_addr":"172.21.15.160:6827/1842739135","heartbeat_back_addr":"172.21.15.160:6831/1842739135","heartbeat_front_addr":"172.21.15.160:6829/1842739135","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T05:19:15.869398+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T05:19:42.014078+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T05:20:06.430660+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T05:20:38.555519+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T05:21:04.530605+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T05:21:29.545252+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T05:22:03.141982+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T05:22:29.191127+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T05:22:54.502994+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T05:23:27.899000+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T05:23:54.693979+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T05:24:20.307119+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.a","mappings":[{"from":2,"to":11}]},{"pgid":"2.1d","mappings":[{"from":2,"to":4},{"from":8,"to":11}]},{"pgid":"3.0","mappings":[{"from":4,"to":8}]},{"pgid":"3.1","mappings":[{"from":4,"to":9}]},{"pgid":"3.12","mappings":[{"from":3,"to":9}]},{"pgid":"3.28","mappings":[{"from":5,"to":6}]},{"pgid":"3.2c","mappings":[{"from":4,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.87:0/4226160503":"2024-05-09T05:17:22.736165+0000","172.21.15.87:0/2773684806":"2024-05-09T05:17:22.736165+0000","172.21.15.87:0/349590592":"2024-05-09T05:17:22.736165+0000","172.21.15.87:6801/2710124295":"2024-05-09T05:17:22.736165+0000","172.21.15.87:6800/1823425617":"2024-05-09T05:16:48.155337+0000","172.21.15.87:0/2393072013":"2024-05-09T05:16:48.155337+0000","172.21.15.87:0/1291525416":"2024-05-09T05:16:48.155337+0000","172.21.15.87:6801/1823425617":"2024-05-09T05:16:48.155337+0000","172.21.15.87:0/3839463573":"2024-05-09T05:16:48.155337+0000","172.21.15.87:6800/2710124295":"2024-05-09T05:17:22.736165+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-08T05:29:17.944 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:17.943+0000 7fb855e00640 1 -- 172.21.15.87:0/3983991678 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7fb8300b2870 msgr2=0x7fb8300b4d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:29:17.944 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:17.943+0000 7fb855e00640 1 --2- 172.21.15.87:0/3983991678 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7fb8300b2870 0x7fb8300b4d30 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fb840009fc0 tx=0x7fb840005f90 comp rx=0 tx=0).stop 2024-05-08T05:29:17.944 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:17.943+0000 7fb855e00640 1 -- 172.21.15.87:0/3983991678 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb85010a940 msgr2=0x7fb8501a65a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:29:17.944 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:17.943+0000 7fb855e00640 1 --2- 172.21.15.87:0/3983991678 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb85010a940 0x7fb8501a65a0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fb848031a20 tx=0x7fb8480317a0 comp rx=0 tx=0).stop 2024-05-08T05:29:17.944 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:17.943+0000 7fb855e00640 1 -- 172.21.15.87:0/3983991678 shutdown_connections 2024-05-08T05:29:17.944 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:17.943+0000 7fb855e00640 1 --2- 172.21.15.87:0/3983991678 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7fb8300b2870 0x7fb8300b4d30 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:29:17.945 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:17.943+0000 7fb855e00640 1 --2- 172.21.15.87:0/3983991678 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb85010a940 0x7fb8501a65a0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:29:17.945 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:17.943+0000 7fb855e00640 1 --2- 172.21.15.87:0/3983991678 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb850109f80 0x7fb85019f530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:29:17.945 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:17.943+0000 7fb855e00640 1 --2- 172.21.15.87:0/3983991678 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb850108e30 0x7fb85019eff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:29:17.945 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:17.944+0000 7fb855e00640 1 -- 172.21.15.87:0/3983991678 >> 172.21.15.87:0/3983991678 conn(0x7fb850077df0 msgr2=0x7fb85010d310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:29:17.945 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:17.944+0000 7fb855e00640 1 -- 172.21.15.87:0/3983991678 shutdown_connections 2024-05-08T05:29:17.945 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:17.944+0000 7fb855e00640 1 -- 172.21.15.87:0/3983991678 wait complete. 2024-05-08T05:29:17.964 INFO:tasks.fwd_scrub.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-05-08T05:20:08.907941+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-05-08T05:25:28.054494+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '80', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-05-08T05:25:32.484126+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '80', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-05-08T05:29:17.965 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-05-08T05:29:18.178 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:18.177+0000 7f7e99a00640 1 -- 172.21.15.87:0/325835837 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7e94108ea0 msgr2=0x7f7e941092c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:29:18.178 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:18.177+0000 7f7e99a00640 1 --2- 172.21.15.87:0/325835837 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7e94108ea0 0x7f7e941092c0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f7e84009900 tx=0x7f7e8402a3f0 comp rx=0 tx=0).stop 2024-05-08T05:29:18.178 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:18.177+0000 7f7e99a00640 1 -- 172.21.15.87:0/325835837 shutdown_connections 2024-05-08T05:29:18.178 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:18.177+0000 7f7e99a00640 1 --2- 172.21.15.87:0/325835837 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7e9410aa40 0x7f7e94111360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:29:18.178 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:18.177+0000 7f7e99a00640 1 --2- 172.21.15.87:0/325835837 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7e9410a080 0x7f7e9410a500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:29:18.178 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:18.177+0000 7f7e99a00640 1 --2- 172.21.15.87:0/325835837 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7e94108ea0 0x7f7e941092c0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:29:18.179 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:18.177+0000 7f7e99a00640 1 -- 172.21.15.87:0/325835837 >> 172.21.15.87:0/325835837 conn(0x7f7e94077e80 msgr2=0x7f7e9407a2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:29:18.179 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:18.177+0000 7f7e99a00640 1 -- 172.21.15.87:0/325835837 shutdown_connections 2024-05-08T05:29:18.179 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:18.178+0000 7f7e99a00640 1 -- 172.21.15.87:0/325835837 wait complete. 2024-05-08T05:29:18.181 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:18.178+0000 7f7e99a00640 1 Processor -- start 2024-05-08T05:29:18.181 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:18.179+0000 7f7e99a00640 1 -- start start 2024-05-08T05:29:18.181 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:18.179+0000 7f7e99a00640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7e94108ea0 0x7f7e9419f130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:29:18.181 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:18.179+0000 7f7e99a00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7e9410a080 0x7f7e9419f670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:29:18.181 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:18.179+0000 7f7e99a00640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7e9410aa40 0x7f7e941a66e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:29:18.181 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:18.179+0000 7f7e99a00640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f7e94114a90 con 0x7f7e9410aa40 2024-05-08T05:29:18.181 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:18.179+0000 7f7e99a00640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f7e94114910 con 0x7f7e9410a080 2024-05-08T05:29:18.182 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:18.179+0000 7f7e99a00640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f7e94114c10 con 0x7f7e94108ea0 2024-05-08T05:29:18.182 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:18.179+0000 7f7e99000640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7e9410aa40 0x7f7e941a66e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:29:18.182 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:18.179+0000 7f7e93400640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7e9410a080 0x7f7e9419f670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:29:18.182 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:18.179+0000 7f7e93e00640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7e94108ea0 0x7f7e9419f130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:29:18.182 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:18.179+0000 7f7e93400640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7e9410a080 0x7f7e9419f670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.87:52766/0 (socket says 172.21.15.87:52766) 2024-05-08T05:29:18.182 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:18.179+0000 7f7e93400640 1 -- 172.21.15.87:0/1763184411 learned_addr learned my addr 172.21.15.87:0/1763184411 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T05:29:18.182 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:18.180+0000 7f7e93e00640 1 -- 172.21.15.87:0/1763184411 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7e9410a080 msgr2=0x7f7e9419f670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:29:18.182 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:18.180+0000 7f7e93e00640 1 --2- 172.21.15.87:0/1763184411 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7e9410a080 0x7f7e9419f670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:29:18.182 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:18.180+0000 7f7e93e00640 1 -- 172.21.15.87:0/1763184411 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7e9410aa40 msgr2=0x7f7e941a66e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:29:18.182 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:18.180+0000 7f7e93e00640 1 --2- 172.21.15.87:0/1763184411 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7e9410aa40 0x7f7e941a66e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:29:18.182 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:18.180+0000 7f7e93e00640 1 -- 172.21.15.87:0/1763184411 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7e941a6d50 con 0x7f7e94108ea0 2024-05-08T05:29:18.182 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:18.180+0000 7f7e93400640 1 --2- 172.21.15.87:0/1763184411 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7e9410a080 0x7f7e9419f670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T05:29:18.182 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:18.180+0000 7f7e99000640 1 --2- 172.21.15.87:0/1763184411 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7e9410aa40 0x7f7e941a66e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T05:29:18.182 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:18.180+0000 7f7e93e00640 1 --2- 172.21.15.87:0/1763184411 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7e94108ea0 0x7f7e9419f130 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f7e8402a910 tx=0x7f7e84003c10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:29:18.183 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:18.180+0000 7f7e90c00640 1 -- 172.21.15.87:0/1763184411 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e8403f070 con 0x7f7e94108ea0 2024-05-08T05:29:18.183 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:18.180+0000 7f7e90c00640 1 -- 172.21.15.87:0/1763184411 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7e84031c50 con 0x7f7e94108ea0 2024-05-08T05:29:18.183 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:18.180+0000 7f7e99a00640 1 -- 172.21.15.87:0/1763184411 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7e941a6fe0 con 0x7f7e94108ea0 2024-05-08T05:29:18.183 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:18.180+0000 7f7e90c00640 1 -- 172.21.15.87:0/1763184411 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e84035030 con 0x7f7e94108ea0 2024-05-08T05:29:18.183 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:18.181+0000 7f7e99a00640 1 -- 172.21.15.87:0/1763184411 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7e941a73e0 con 0x7f7e94108ea0 2024-05-08T05:29:18.183 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:18.182+0000 7f7e99a00640 1 -- 172.21.15.87:0/1763184411 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7e94110240 con 0x7f7e94108ea0 2024-05-08T05:29:18.184 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:18.184+0000 7f7e90c00640 1 -- 172.21.15.87:0/1763184411 <== mon.1 v2:172.21.15.160:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7f7e84042070 con 0x7f7e94108ea0 2024-05-08T05:29:18.186 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:18.185+0000 7f7e90c00640 1 --2- 172.21.15.87:0/1763184411 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f7e780b27f0 0x7f7e780b4cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:29:18.186 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:18.186+0000 7f7e90c00640 1 -- 172.21.15.87:0/1763184411 <== mon.1 v2:172.21.15.160:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8190+0+0 (secure 0 0 0) 0x7f7e84103210 con 0x7f7e94108ea0 2024-05-08T05:29:18.186 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:18.186+0000 7f7e93400640 1 --2- 172.21.15.87:0/1763184411 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f7e780b27f0 0x7f7e780b4cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:29:18.186 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:18.186+0000 7f7e93400640 1 --2- 172.21.15.87:0/1763184411 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f7e780b27f0 0x7f7e780b4cb0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f7e941a0640 tx=0x7f7e80005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:29:18.188 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:18.188+0000 7f7e90c00640 1 -- 172.21.15.87:0/1763184411 <== mon.1 v2:172.21.15.160:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f7e840ca8b0 con 0x7f7e94108ea0 2024-05-08T05:29:18.398 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:18.397+0000 7f7e99a00640 1 -- 172.21.15.87:0/1763184411 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f7e9402dce0 con 0x7f7e94108ea0 2024-05-08T05:29:18.399 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:18.398+0000 7f7e90c00640 1 -- 172.21.15.87:0/1763184411 <== mon.1 v2:172.21.15.160:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v82) ==== 93+0+10 (secure 0 0 0) 0x7f7e840cebb0 con 0x7f7e94108ea0 2024-05-08T05:29:18.399 INFO:teuthology.orchestra.run.smithi087.stdout:pg_num: 1 2024-05-08T05:29:18.402 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:18.401+0000 7f7e99a00640 1 -- 172.21.15.87:0/1763184411 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f7e780b27f0 msgr2=0x7f7e780b4cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:29:18.402 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:18.401+0000 7f7e99a00640 1 --2- 172.21.15.87:0/1763184411 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f7e780b27f0 0x7f7e780b4cb0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f7e941a0640 tx=0x7f7e80005f90 comp rx=0 tx=0).stop 2024-05-08T05:29:18.402 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:18.401+0000 7f7e99a00640 1 -- 172.21.15.87:0/1763184411 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7e94108ea0 msgr2=0x7f7e9419f130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:29:18.402 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:18.401+0000 7f7e99a00640 1 --2- 172.21.15.87:0/1763184411 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7e94108ea0 0x7f7e9419f130 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f7e8402a910 tx=0x7f7e84003c10 comp rx=0 tx=0).stop 2024-05-08T05:29:18.402 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:18.401+0000 7f7e99a00640 1 -- 172.21.15.87:0/1763184411 shutdown_connections 2024-05-08T05:29:18.402 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:18.401+0000 7f7e99a00640 1 --2- 172.21.15.87:0/1763184411 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f7e780b27f0 0x7f7e780b4cb0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:29:18.402 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:18.401+0000 7f7e99a00640 1 --2- 172.21.15.87:0/1763184411 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7e9410aa40 0x7f7e941a66e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:29:18.402 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:18.401+0000 7f7e99a00640 1 --2- 172.21.15.87:0/1763184411 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7e9410a080 0x7f7e9419f670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:29:18.402 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:18.401+0000 7f7e99a00640 1 --2- 172.21.15.87:0/1763184411 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7e94108ea0 0x7f7e9419f130 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:29:18.402 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:18.401+0000 7f7e99a00640 1 -- 172.21.15.87:0/1763184411 >> 172.21.15.87:0/1763184411 conn(0x7f7e94077e80 msgr2=0x7f7e9410d410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:29:18.402 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:18.401+0000 7f7e99a00640 1 -- 172.21.15.87:0/1763184411 shutdown_connections 2024-05-08T05:29:18.403 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:18.402+0000 7f7e99a00640 1 -- 172.21.15.87:0/1763184411 wait complete. 2024-05-08T05:29:18.422 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-05-08T05:29:18.621 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:18.620+0000 7f3032c00640 1 -- 172.21.15.87:0/4102842832 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f302c104af0 msgr2=0x7f302c104f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:29:18.621 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:18.620+0000 7f3032c00640 1 --2- 172.21.15.87:0/4102842832 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f302c104af0 0x7f302c104f10 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f3020009860 tx=0x7f302002a340 comp rx=0 tx=0).stop 2024-05-08T05:29:18.621 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:18.620+0000 7f3032c00640 1 -- 172.21.15.87:0/4102842832 shutdown_connections 2024-05-08T05:29:18.621 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:18.620+0000 7f3032c00640 1 --2- 172.21.15.87:0/4102842832 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f302c1066a0 0x7f302c10cf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:29:18.621 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:18.620+0000 7f3032c00640 1 --2- 172.21.15.87:0/4102842832 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f302c105ce0 0x7f302c106160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:29:18.621 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:18.620+0000 7f3032c00640 1 --2- 172.21.15.87:0/4102842832 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f302c104af0 0x7f302c104f10 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:29:18.621 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:18.620+0000 7f3032c00640 1 -- 172.21.15.87:0/4102842832 >> 172.21.15.87:0/4102842832 conn(0x7f302c100060 msgr2=0x7f302c1024a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:29:18.621 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:18.620+0000 7f3032c00640 1 -- 172.21.15.87:0/4102842832 shutdown_connections 2024-05-08T05:29:18.621 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:18.620+0000 7f3032c00640 1 -- 172.21.15.87:0/4102842832 wait complete. 2024-05-08T05:29:18.623 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:18.621+0000 7f3032c00640 1 Processor -- start 2024-05-08T05:29:18.623 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:18.621+0000 7f3032c00640 1 -- start start 2024-05-08T05:29:18.623 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:18.622+0000 7f3032c00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f302c104af0 0x7f302c19ad50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:29:18.624 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:18.622+0000 7f3032c00640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f302c105ce0 0x7f302c19b290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:29:18.624 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:18.622+0000 7f3032c00640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f302c1066a0 0x7f302c1a2300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:29:18.624 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:18.622+0000 7f3032c00640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f302c1105f0 con 0x7f302c1066a0 2024-05-08T05:29:18.624 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:18.622+0000 7f3032c00640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f302c110470 con 0x7f302c104af0 2024-05-08T05:29:18.624 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:18.622+0000 7f3032c00640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f302c110770 con 0x7f302c105ce0 2024-05-08T05:29:18.624 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:18.622+0000 7f3030e00640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f302c105ce0 0x7f302c19b290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:29:18.624 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:18.622+0000 7f3032200640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f302c1066a0 0x7f302c1a2300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:29:18.624 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:18.622+0000 7f3030e00640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f302c105ce0 0x7f302c19b290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.87:60270/0 (socket says 172.21.15.87:60270) 2024-05-08T05:29:18.624 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:18.622+0000 7f3030e00640 1 -- 172.21.15.87:0/1454456411 learned_addr learned my addr 172.21.15.87:0/1454456411 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T05:29:18.624 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:18.622+0000 7f3031800640 1 --2- 172.21.15.87:0/1454456411 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f302c104af0 0x7f302c19ad50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:29:18.624 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:18.622+0000 7f3030e00640 1 -- 172.21.15.87:0/1454456411 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f302c104af0 msgr2=0x7f302c19ad50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:29:18.624 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:18.622+0000 7f3030e00640 1 --2- 172.21.15.87:0/1454456411 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f302c104af0 0x7f302c19ad50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:29:18.624 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:18.622+0000 7f3030e00640 1 -- 172.21.15.87:0/1454456411 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f302c1066a0 msgr2=0x7f302c1a2300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:29:18.624 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:18.622+0000 7f3030e00640 1 --2- 172.21.15.87:0/1454456411 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f302c1066a0 0x7f302c1a2300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:29:18.624 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:18.622+0000 7f3030e00640 1 -- 172.21.15.87:0/1454456411 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f302c1a2970 con 0x7f302c105ce0 2024-05-08T05:29:18.625 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:18.623+0000 7f3030e00640 1 --2- 172.21.15.87:0/1454456411 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f302c105ce0 0x7f302c19b290 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f301800e9c0 tx=0x7f301800edc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:29:18.625 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:18.623+0000 7f302a000640 1 -- 172.21.15.87:0/1454456411 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f301800ccc0 con 0x7f302c105ce0 2024-05-08T05:29:18.625 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:18.623+0000 7f302a000640 1 -- 172.21.15.87:0/1454456411 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f30180054d0 con 0x7f302c105ce0 2024-05-08T05:29:18.625 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:18.623+0000 7f3032c00640 1 -- 172.21.15.87:0/1454456411 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f302c1a2c60 con 0x7f302c105ce0 2024-05-08T05:29:18.625 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:18.623+0000 7f302a000640 1 -- 172.21.15.87:0/1454456411 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3018010430 con 0x7f302c105ce0 2024-05-08T05:29:18.625 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:18.623+0000 7f3032c00640 1 -- 172.21.15.87:0/1454456411 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f302c1a31b0 con 0x7f302c105ce0 2024-05-08T05:29:18.625 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:18.624+0000 7f3032c00640 1 -- 172.21.15.87:0/1454456411 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f302c10bf00 con 0x7f302c105ce0 2024-05-08T05:29:18.626 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:18.626+0000 7f302a000640 1 -- 172.21.15.87:0/1454456411 <== mon.1 v2:172.21.15.160:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7f3018004f20 con 0x7f302c105ce0 2024-05-08T05:29:18.628 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:18.628+0000 7f302a000640 1 --2- 172.21.15.87:0/1454456411 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f30140b2870 0x7f30140b4d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:29:18.628 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:18.628+0000 7f302a000640 1 -- 172.21.15.87:0/1454456411 <== mon.1 v2:172.21.15.160:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8190+0+0 (secure 0 0 0) 0x7f30180e2610 con 0x7f302c105ce0 2024-05-08T05:29:18.628 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:18.628+0000 7f3031800640 1 --2- 172.21.15.87:0/1454456411 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f30140b2870 0x7f30140b4d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:29:18.629 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:18.629+0000 7f3031800640 1 --2- 172.21.15.87:0/1454456411 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f30140b2870 0x7f30140b4d30 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f3020009830 tx=0x7f3020030450 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:29:18.632 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:18.632+0000 7f302a000640 1 -- 172.21.15.87:0/1454456411 <== mon.1 v2:172.21.15.160:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f30180aa360 con 0x7f302c105ce0 2024-05-08T05:29:18.708 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:29:18 smithi087 ceph-mon[29523]: pgmap v429: 97 pgs: 97 active+clean; 644 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 85 B/s wr, 5 op/s 2024-05-08T05:29:18.708 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:29:18 smithi087 ceph-mon[29523]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]': finished 2024-05-08T05:29:18.708 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:29:18 smithi087 ceph-mon[29523]: fsmap cephfs:3 {0=b=up:active,1=g=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-05-08T05:29:18.708 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:29:18 smithi087 ceph-mon[29523]: from='client.? 172.21.15.87:0/3983991678' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-08T05:29:18.709 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:29:18 smithi087 ceph-mon[29523]: from='client.? 172.21.15.87:0/1763184411' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-05-08T05:29:18.733 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:29:18 smithi090 ceph-mon[34526]: pgmap v429: 97 pgs: 97 active+clean; 644 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 85 B/s wr, 5 op/s 2024-05-08T05:29:18.733 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:29:18 smithi090 ceph-mon[34526]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]': finished 2024-05-08T05:29:18.733 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:29:18 smithi090 ceph-mon[34526]: fsmap cephfs:3 {0=b=up:active,1=g=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-05-08T05:29:18.734 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:29:18 smithi090 ceph-mon[34526]: from='client.? 172.21.15.87:0/3983991678' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-08T05:29:18.734 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:29:18 smithi090 ceph-mon[34526]: from='client.? 172.21.15.87:0/1763184411' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-05-08T05:29:18.789 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:29:18 smithi160 ceph-mon[34827]: pgmap v429: 97 pgs: 97 active+clean; 644 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 85 B/s wr, 5 op/s 2024-05-08T05:29:18.789 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:29:18 smithi160 ceph-mon[34827]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]': finished 2024-05-08T05:29:18.789 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:29:18 smithi160 ceph-mon[34827]: fsmap cephfs:3 {0=b=up:active,1=g=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-05-08T05:29:18.789 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:29:18 smithi160 ceph-mon[34827]: from='client.? 172.21.15.87:0/3983991678' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-08T05:29:18.789 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:29:18 smithi160 ceph-mon[34827]: from='client.? 172.21.15.87:0/1763184411' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-05-08T05:29:18.839 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:18.839+0000 7f3032c00640 1 -- 172.21.15.87:0/1454456411 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f302c0635b0 con 0x7f302c105ce0 2024-05-08T05:29:18.840 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:18.840+0000 7f302a000640 1 -- 172.21.15.87:0/1454456411 <== mon.1 v2:172.21.15.160:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v82) ==== 104+0+11 (secure 0 0 0) 0x7f30180a9c60 con 0x7f302c105ce0 2024-05-08T05:29:18.840 INFO:teuthology.orchestra.run.smithi087.stdout:pg_num: 32 2024-05-08T05:29:18.843 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:18.842+0000 7f3032c00640 1 -- 172.21.15.87:0/1454456411 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f30140b2870 msgr2=0x7f30140b4d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:29:18.843 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:18.842+0000 7f3032c00640 1 --2- 172.21.15.87:0/1454456411 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f30140b2870 0x7f30140b4d30 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f3020009830 tx=0x7f3020030450 comp rx=0 tx=0).stop 2024-05-08T05:29:18.843 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:18.842+0000 7f3032c00640 1 -- 172.21.15.87:0/1454456411 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f302c105ce0 msgr2=0x7f302c19b290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:29:18.843 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:18.842+0000 7f3032c00640 1 --2- 172.21.15.87:0/1454456411 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f302c105ce0 0x7f302c19b290 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f301800e9c0 tx=0x7f301800edc0 comp rx=0 tx=0).stop 2024-05-08T05:29:18.843 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:18.842+0000 7f3032c00640 1 -- 172.21.15.87:0/1454456411 shutdown_connections 2024-05-08T05:29:18.843 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:18.842+0000 7f3032c00640 1 --2- 172.21.15.87:0/1454456411 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f30140b2870 0x7f30140b4d30 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:29:18.843 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:18.842+0000 7f3032c00640 1 --2- 172.21.15.87:0/1454456411 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f302c1066a0 0x7f302c1a2300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:29:18.843 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:18.842+0000 7f3032c00640 1 --2- 172.21.15.87:0/1454456411 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f302c105ce0 0x7f302c19b290 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:29:18.844 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:18.842+0000 7f3032c00640 1 --2- 172.21.15.87:0/1454456411 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f302c104af0 0x7f302c19ad50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:29:18.844 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:18.842+0000 7f3032c00640 1 -- 172.21.15.87:0/1454456411 >> 172.21.15.87:0/1454456411 conn(0x7f302c100060 msgr2=0x7f302c1090d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:29:18.844 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:18.843+0000 7f3032c00640 1 -- 172.21.15.87:0/1454456411 shutdown_connections 2024-05-08T05:29:18.844 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:18.843+0000 7f3032c00640 1 -- 172.21.15.87:0/1454456411 wait complete. 2024-05-08T05:29:18.862 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-05-08T05:29:19.071 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:19.070+0000 7f196b000640 1 -- 172.21.15.87:0/4194279527 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f196410efc0 msgr2=0x7f19641113b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:29:19.071 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:19.070+0000 7f196b000640 1 --2- 172.21.15.87:0/4194279527 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f196410efc0 0x7f19641113b0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f195c009c10 tx=0x7f195c02a6e0 comp rx=0 tx=0).stop 2024-05-08T05:29:19.071 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:19.070+0000 7f196b000640 1 -- 172.21.15.87:0/4194279527 shutdown_connections 2024-05-08T05:29:19.071 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:19.070+0000 7f196b000640 1 --2- 172.21.15.87:0/4194279527 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f196410efc0 0x7f19641113b0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:29:19.071 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:19.070+0000 7f196b000640 1 --2- 172.21.15.87:0/4194279527 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1964075410 0x7f1964075890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:29:19.071 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:19.070+0000 7f196b000640 1 --2- 172.21.15.87:0/4194279527 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f19640769f0 0x7f1964074e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:29:19.071 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:19.070+0000 7f196b000640 1 -- 172.21.15.87:0/4194279527 >> 172.21.15.87:0/4194279527 conn(0x7f19640fdf60 msgr2=0x7f19641003a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:29:19.072 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:19.070+0000 7f196b000640 1 -- 172.21.15.87:0/4194279527 shutdown_connections 2024-05-08T05:29:19.072 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:19.070+0000 7f196b000640 1 -- 172.21.15.87:0/4194279527 wait complete. 2024-05-08T05:29:19.074 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:19.071+0000 7f196b000640 1 Processor -- start 2024-05-08T05:29:19.074 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:19.072+0000 7f196b000640 1 -- start start 2024-05-08T05:29:19.074 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:19.072+0000 7f196b000640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1964075410 0x7f196419f250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:29:19.074 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:19.072+0000 7f196b000640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f19640769f0 0x7f196419f790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:29:19.074 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:19.072+0000 7f196b000640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f196410efc0 0x7f19641a6800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:29:19.074 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:19.072+0000 7f196b000640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f1964114af0 con 0x7f19640769f0 2024-05-08T05:29:19.074 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:19.072+0000 7f196b000640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f1964114970 con 0x7f196410efc0 2024-05-08T05:29:19.074 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:19.072+0000 7f196b000640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f1964114c70 con 0x7f1964075410 2024-05-08T05:29:19.074 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:19.072+0000 7f195be00640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f19640769f0 0x7f196419f790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:29:19.074 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:19.072+0000 7f195be00640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f19640769f0 0x7f196419f790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:42860/0 (socket says 172.21.15.87:42860) 2024-05-08T05:29:19.075 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:19.072+0000 7f195be00640 1 -- 172.21.15.87:0/2759906070 learned_addr learned my addr 172.21.15.87:0/2759906070 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T05:29:19.075 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:19.072+0000 7f1963e00640 1 --2- 172.21.15.87:0/2759906070 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1964075410 0x7f196419f250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:29:19.075 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:19.072+0000 7f1969000640 1 --2- 172.21.15.87:0/2759906070 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f196410efc0 0x7f19641a6800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:29:19.075 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:19.073+0000 7f195be00640 1 -- 172.21.15.87:0/2759906070 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1964075410 msgr2=0x7f196419f250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:29:19.075 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:19.073+0000 7f195be00640 1 --2- 172.21.15.87:0/2759906070 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1964075410 0x7f196419f250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:29:19.075 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:19.073+0000 7f195be00640 1 -- 172.21.15.87:0/2759906070 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f196410efc0 msgr2=0x7f19641a6800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:29:19.075 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:19.073+0000 7f195be00640 1 --2- 172.21.15.87:0/2759906070 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f196410efc0 0x7f19641a6800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:29:19.075 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:19.073+0000 7f195be00640 1 -- 172.21.15.87:0/2759906070 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f19641a6e70 con 0x7f19640769f0 2024-05-08T05:29:19.075 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:19.073+0000 7f1963e00640 1 --2- 172.21.15.87:0/2759906070 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1964075410 0x7f196419f250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T05:29:19.075 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:19.073+0000 7f195be00640 1 --2- 172.21.15.87:0/2759906070 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f19640769f0 0x7f196419f790 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f194c00e9c0 tx=0x7f194c00ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:29:19.075 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:19.073+0000 7f1961600640 1 -- 172.21.15.87:0/2759906070 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f194c00ccc0 con 0x7f19640769f0 2024-05-08T05:29:19.076 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:19.073+0000 7f1961600640 1 -- 172.21.15.87:0/2759906070 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f194c0054d0 con 0x7f19640769f0 2024-05-08T05:29:19.076 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:19.073+0000 7f196b000640 1 -- 172.21.15.87:0/2759906070 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f19641a7160 con 0x7f19640769f0 2024-05-08T05:29:19.076 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:19.073+0000 7f1961600640 1 -- 172.21.15.87:0/2759906070 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f194c010430 con 0x7f19640769f0 2024-05-08T05:29:19.076 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:19.073+0000 7f196b000640 1 -- 172.21.15.87:0/2759906070 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f19641a76b0 con 0x7f19640769f0 2024-05-08T05:29:19.076 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:19.075+0000 7f196b000640 1 -- 172.21.15.87:0/2759906070 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1964105190 con 0x7f19640769f0 2024-05-08T05:29:19.077 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:19.077+0000 7f1961600640 1 -- 172.21.15.87:0/2759906070 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7f194c004f80 con 0x7f19640769f0 2024-05-08T05:29:19.078 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:19.078+0000 7f1961600640 1 --2- 172.21.15.87:0/2759906070 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f19480b27f0 0x7f19480b4cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:29:19.079 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:19.079+0000 7f1961600640 1 -- 172.21.15.87:0/2759906070 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8190+0+0 (secure 0 0 0) 0x7f194c0e2630 con 0x7f19640769f0 2024-05-08T05:29:19.079 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:19.079+0000 7f1963e00640 1 --2- 172.21.15.87:0/2759906070 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f19480b27f0 0x7f19480b4cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:29:19.079 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:19.079+0000 7f1963e00640 1 --2- 172.21.15.87:0/2759906070 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f19480b27f0 0x7f19480b4cb0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f1954009fc0 tx=0x7f1954005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:29:19.083 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:19.083+0000 7f1961600640 1 -- 172.21.15.87:0/2759906070 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f194c0aa320 con 0x7f19640769f0 2024-05-08T05:29:19.294 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:19.293+0000 7f196b000640 1 -- 172.21.15.87:0/2759906070 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f19640635b0 con 0x7f19640769f0 2024-05-08T05:29:19.294 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:19.294+0000 7f1961600640 1 -- 172.21.15.87:0/2759906070 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v82) ==== 100+0+11 (secure 0 0 0) 0x7f194c0a9c20 con 0x7f19640769f0 2024-05-08T05:29:19.295 INFO:teuthology.orchestra.run.smithi087.stdout:pg_num: 64 2024-05-08T05:29:19.297 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:19.297+0000 7f196b000640 1 -- 172.21.15.87:0/2759906070 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f19480b27f0 msgr2=0x7f19480b4cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:29:19.298 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:19.297+0000 7f196b000640 1 --2- 172.21.15.87:0/2759906070 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f19480b27f0 0x7f19480b4cb0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f1954009fc0 tx=0x7f1954005f90 comp rx=0 tx=0).stop 2024-05-08T05:29:19.298 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:19.297+0000 7f196b000640 1 -- 172.21.15.87:0/2759906070 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f19640769f0 msgr2=0x7f196419f790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:29:19.298 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:19.297+0000 7f196b000640 1 --2- 172.21.15.87:0/2759906070 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f19640769f0 0x7f196419f790 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f194c00e9c0 tx=0x7f194c00ee80 comp rx=0 tx=0).stop 2024-05-08T05:29:19.298 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:19.297+0000 7f196b000640 1 -- 172.21.15.87:0/2759906070 shutdown_connections 2024-05-08T05:29:19.298 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:19.297+0000 7f196b000640 1 --2- 172.21.15.87:0/2759906070 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f19480b27f0 0x7f19480b4cb0 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:29:19.298 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:19.297+0000 7f196b000640 1 --2- 172.21.15.87:0/2759906070 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f196410efc0 0x7f19641a6800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:29:19.298 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:19.297+0000 7f196b000640 1 --2- 172.21.15.87:0/2759906070 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f19640769f0 0x7f196419f790 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:29:19.298 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:19.297+0000 7f196b000640 1 --2- 172.21.15.87:0/2759906070 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1964075410 0x7f196419f250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:29:19.298 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:19.297+0000 7f196b000640 1 -- 172.21.15.87:0/2759906070 >> 172.21.15.87:0/2759906070 conn(0x7f19640fdf60 msgr2=0x7f1964102360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:29:19.298 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:19.297+0000 7f196b000640 1 -- 172.21.15.87:0/2759906070 shutdown_connections 2024-05-08T05:29:19.298 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:19.297+0000 7f196b000640 1 -- 172.21.15.87:0/2759906070 wait complete. 2024-05-08T05:29:19.317 INFO:tasks.fwd_scrub:Wait for all MDSs to reach steady state... 2024-05-08T05:29:19.318 DEBUG:teuthology.orchestra.run.smithi087:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid eeeb813e-0cf9-11ef-bc97-c7b262605968 -- ceph fs dump --format=json 2024-05-08T05:29:19.708 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:29:19 smithi087 ceph-mon[29523]: from='client.? 172.21.15.87:0/1454456411' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-05-08T05:29:19.708 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:29:19 smithi087 ceph-mon[29523]: from='client.? 172.21.15.87:0/2759906070' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-05-08T05:29:19.733 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:29:19 smithi090 ceph-mon[34526]: from='client.? 172.21.15.87:0/1454456411' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-05-08T05:29:19.733 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:29:19 smithi090 ceph-mon[34526]: from='client.? 172.21.15.87:0/2759906070' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-05-08T05:29:19.769 INFO:teuthology.orchestra.run.smithi087.stderr:Inferring config /var/lib/ceph/eeeb813e-0cf9-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T05:29:19.788 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:29:19 smithi160 ceph-mon[34827]: from='client.? 172.21.15.87:0/1454456411' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-05-08T05:29:19.789 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:29:19 smithi160 ceph-mon[34827]: from='client.? 172.21.15.87:0/2759906070' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-05-08T05:29:20.709 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:29:20 smithi087 ceph-mon[29523]: pgmap v430: 97 pgs: 97 active+clean; 650 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 938 B/s wr, 8 op/s 2024-05-08T05:29:20.733 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:29:20 smithi090 ceph-mon[34526]: pgmap v430: 97 pgs: 97 active+clean; 650 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 938 B/s wr, 8 op/s 2024-05-08T05:29:20.788 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:29:20 smithi160 ceph-mon[34827]: pgmap v430: 97 pgs: 97 active+clean; 650 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 938 B/s wr, 8 op/s 2024-05-08T05:29:21.945 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:21.944+0000 7f5ba4000700 1 -- 172.21.15.87:0/1614013705 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5b9c10a490 msgr2=0x7f5b9c1169a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:29:21.945 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:21.944+0000 7f5ba4000700 1 --2- 172.21.15.87:0/1614013705 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5b9c10a490 0x7f5b9c1169a0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f5b9400b0a0 tx=0x7f5b9400b3b0 comp rx=0 tx=0).stop 2024-05-08T05:29:21.945 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:21.944+0000 7f5ba4000700 1 -- 172.21.15.87:0/1614013705 shutdown_connections 2024-05-08T05:29:21.945 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:21.944+0000 7f5ba4000700 1 --2- 172.21.15.87:0/1614013705 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5b9c10a490 0x7f5b9c1169a0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:29:21.945 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:21.944+0000 7f5ba4000700 1 --2- 172.21.15.87:0/1614013705 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5b9c10fb60 0x7f5b9c10ff40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:29:21.946 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:21.944+0000 7f5ba4000700 1 --2- 172.21.15.87:0/1614013705 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5b9c109ad0 0x7f5b9c109f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:29:21.946 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:21.944+0000 7f5ba4000700 1 -- 172.21.15.87:0/1614013705 >> 172.21.15.87:0/1614013705 conn(0x7f5b9c076c70 msgr2=0x7f5b9c1082c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:29:21.946 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:21.944+0000 7f5ba4000700 1 -- 172.21.15.87:0/1614013705 shutdown_connections 2024-05-08T05:29:21.946 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:21.944+0000 7f5ba4000700 1 -- 172.21.15.87:0/1614013705 wait complete. 2024-05-08T05:29:21.947 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:21.946+0000 7f5ba4000700 1 Processor -- start 2024-05-08T05:29:21.947 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:21.946+0000 7f5ba4000700 1 -- start start 2024-05-08T05:29:21.948 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:21.946+0000 7f5ba4000700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5b9c109ad0 0x7f5b9c1a01b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:29:21.948 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:21.946+0000 7f5ba4000700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5b9c10a490 0x7f5b9c1a06f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:29:21.948 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:21.946+0000 7f5ba4000700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5b9c10fb60 0x7f5b9c1a4a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:29:21.948 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:21.946+0000 7f5ba4000700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f5b9c119d20 con 0x7f5b9c10fb60 2024-05-08T05:29:21.948 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:21.946+0000 7f5ba4000700 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f5b9c119ba0 con 0x7f5b9c10a490 2024-05-08T05:29:21.948 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:21.946+0000 7f5ba4000700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f5b9c119ea0 con 0x7f5b9c109ad0 2024-05-08T05:29:21.948 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:21.946+0000 7f5ba2000700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5b9c10fb60 0x7f5b9c1a4a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:29:21.948 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:21.947+0000 7f5ba0c00700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5b9c10a490 0x7f5b9c1a06f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:29:21.948 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:21.947+0000 7f5ba2000700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5b9c10fb60 0x7f5b9c1a4a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:42878/0 (socket says 172.21.15.87:42878) 2024-05-08T05:29:21.948 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:21.947+0000 7f5ba2000700 1 -- 172.21.15.87:0/3851031781 learned_addr learned my addr 172.21.15.87:0/3851031781 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T05:29:21.948 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:21.947+0000 7f5ba1600700 1 --2- 172.21.15.87:0/3851031781 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5b9c109ad0 0x7f5b9c1a01b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:29:21.948 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:21.947+0000 7f5ba2000700 1 -- 172.21.15.87:0/3851031781 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5b9c109ad0 msgr2=0x7f5b9c1a01b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:29:21.949 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:21.947+0000 7f5ba2000700 1 --2- 172.21.15.87:0/3851031781 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5b9c109ad0 0x7f5b9c1a01b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:29:21.949 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:21.947+0000 7f5ba2000700 1 -- 172.21.15.87:0/3851031781 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5b9c10a490 msgr2=0x7f5b9c1a06f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:29:21.949 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:21.947+0000 7f5ba2000700 1 --2- 172.21.15.87:0/3851031781 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5b9c10a490 0x7f5b9c1a06f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:29:21.949 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:21.947+0000 7f5ba2000700 1 -- 172.21.15.87:0/3851031781 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5b9c1a51c0 con 0x7f5b9c10fb60 2024-05-08T05:29:21.949 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:21.947+0000 7f5ba2000700 1 --2- 172.21.15.87:0/3851031781 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5b9c10fb60 0x7f5b9c1a4a80 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f5b9400b070 tx=0x7f5b94009c90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:29:21.950 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:21.948+0000 7f5b9a000700 1 -- 172.21.15.87:0/3851031781 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b94021070 con 0x7f5b9c10fb60 2024-05-08T05:29:21.950 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:21.948+0000 7f5b9a000700 1 -- 172.21.15.87:0/3851031781 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5b94004e40 con 0x7f5b9c10fb60 2024-05-08T05:29:21.950 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:21.948+0000 7f5ba4000700 1 -- 172.21.15.87:0/3851031781 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5b9c1a5450 con 0x7f5b9c10fb60 2024-05-08T05:29:21.950 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:21.948+0000 7f5b9a000700 1 -- 172.21.15.87:0/3851031781 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b94004630 con 0x7f5b9c10fb60 2024-05-08T05:29:21.950 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:21.948+0000 7f5ba4000700 1 -- 172.21.15.87:0/3851031781 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5b9c1acd30 con 0x7f5b9c10fb60 2024-05-08T05:29:21.950 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:21.949+0000 7f5ba4000700 1 -- 172.21.15.87:0/3851031781 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5b9c10b1d0 con 0x7f5b9c10fb60 2024-05-08T05:29:21.951 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:21.951+0000 7f5b9a000700 1 -- 172.21.15.87:0/3851031781 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7f5b94007980 con 0x7f5b9c10fb60 2024-05-08T05:29:21.953 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:21.953+0000 7f5b9a000700 1 --2- 172.21.15.87:0/3851031781 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f5b840b2880 0x7f5b840b4d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:29:21.953 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:21.953+0000 7f5b9a000700 1 -- 172.21.15.87:0/3851031781 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8190+0+0 (secure 0 0 0) 0x7f5b940e2ff0 con 0x7f5b9c10fb60 2024-05-08T05:29:21.953 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:21.953+0000 7f5ba1600700 1 --2- 172.21.15.87:0/3851031781 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f5b840b2880 0x7f5b840b4d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:29:21.954 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:21.954+0000 7f5ba1600700 1 --2- 172.21.15.87:0/3851031781 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f5b840b2880 0x7f5b840b4d40 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f5b90009680 tx=0x7f5b90009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:29:21.956 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:21.956+0000 7f5b9a000700 1 -- 172.21.15.87:0/3851031781 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f5b940aad70 con 0x7f5b9c10fb60 2024-05-08T05:29:22.239 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:22.239+0000 7f5ba4000700 1 -- 172.21.15.87:0/3851031781 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f5b9c02e510 con 0x7f5b9c10fb60 2024-05-08T05:29:22.241 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:22.240+0000 7f5b9a000700 1 -- 172.21.15.87:0/3851031781 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) ==== 94+0+11858 (secure 0 0 0) 0x7f5b940aa670 con 0x7f5b9c10fb60 2024-05-08T05:29:22.241 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-05-08T05:29:22.241 INFO:teuthology.orchestra.run.smithi087.stdout:{"epoch":25,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14358,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6835/1183985321","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6834","nonce":1183985321},{"type":"v1","addr":"172.21.15.87:6835","nonce":1183985321}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14370,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6837/1485824316","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6836","nonce":1485824316},{"type":"v1","addr":"172.21.15.87:6837","nonce":1485824316}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14409,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6841/724277538","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6840","nonce":724277538},{"type":"v1","addr":"172.21.15.87:6841","nonce":724277538}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24412,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6833/3339455985","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6832","nonce":3339455985},{"type":"v1","addr":"172.21.15.160:6833","nonce":3339455985}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24413,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6833/3292166873","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6832","nonce":3292166873},{"type":"v1","addr":"172.21.15.90:6833","nonce":3292166873}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24443,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6835/824555459","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6834","nonce":824555459},{"type":"v1","addr":"172.21.15.90:6835","nonce":824555459}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6}],"filesystems":[{"mdsmap":{"epoch":25,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-05-08T05:25:36.816840+0000","modified":"2024-05-08T05:29:16.624018+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24500,"mds_1":24482,"mds_2":24481},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24463":{"gid":24463,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.160:6835/409648357","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6834","nonce":409648357},{"type":"v1","addr":"172.21.15.160:6835","nonce":409648357}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24467":{"gid":24467,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.90:6837/4221919418","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6836","nonce":4221919418},{"type":"v1","addr":"172.21.15.90:6837","nonce":4221919418}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24469":{"gid":24469,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.160:6837/4200018040","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6836","nonce":4200018040},{"type":"v1","addr":"172.21.15.160:6837","nonce":4200018040}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24481":{"gid":24481,"name":"i","rank":2,"incarnation":20,"state":"up:active","state_seq":13,"addr":"172.21.15.160:6839/234657686","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6838","nonce":234657686},{"type":"v1","addr":"172.21.15.160:6839","nonce":234657686}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24482":{"gid":24482,"name":"g","rank":1,"incarnation":18,"state":"up:active","state_seq":12,"addr":"172.21.15.87:6839/2127215876","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6838","nonce":2127215876},{"type":"v1","addr":"172.21.15.87:6839","nonce":2127215876}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24500":{"gid":24500,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.90:6839/160586017","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6838","nonce":160586017},{"type":"v1","addr":"172.21.15.90:6839","nonce":160586017}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24500,"qdb_cluster":[24481,24482,24500]},"id":1}]} 2024-05-08T05:29:22.244 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:22.244+0000 7f5ba4000700 1 -- 172.21.15.87:0/3851031781 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f5b840b2880 msgr2=0x7f5b840b4d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:29:22.244 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:22.244+0000 7f5ba4000700 1 --2- 172.21.15.87:0/3851031781 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f5b840b2880 0x7f5b840b4d40 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f5b90009680 tx=0x7f5b90009260 comp rx=0 tx=0).stop 2024-05-08T05:29:22.244 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:22.244+0000 7f5ba4000700 1 -- 172.21.15.87:0/3851031781 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5b9c10fb60 msgr2=0x7f5b9c1a4a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:29:22.244 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:22.244+0000 7f5ba4000700 1 --2- 172.21.15.87:0/3851031781 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5b9c10fb60 0x7f5b9c1a4a80 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f5b9400b070 tx=0x7f5b94009c90 comp rx=0 tx=0).stop 2024-05-08T05:29:22.245 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:22.244+0000 7f5ba4000700 1 -- 172.21.15.87:0/3851031781 shutdown_connections 2024-05-08T05:29:22.245 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:22.244+0000 7f5ba4000700 1 --2- 172.21.15.87:0/3851031781 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5b9c10fb60 0x7f5b9c1a4a80 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:29:22.245 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:22.244+0000 7f5ba4000700 1 --2- 172.21.15.87:0/3851031781 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f5b840b2880 0x7f5b840b4d40 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:29:22.245 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:22.244+0000 7f5ba4000700 1 --2- 172.21.15.87:0/3851031781 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5b9c109ad0 0x7f5b9c1a01b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:29:22.246 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:22.244+0000 7f5ba4000700 1 --2- 172.21.15.87:0/3851031781 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5b9c10a490 0x7f5b9c1a06f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:29:22.246 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:22.244+0000 7f5ba4000700 1 -- 172.21.15.87:0/3851031781 >> 172.21.15.87:0/3851031781 conn(0x7f5b9c076c70 msgr2=0x7f5b9c077250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:29:22.246 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:22.244+0000 7f5ba4000700 1 -- 172.21.15.87:0/3851031781 shutdown_connections 2024-05-08T05:29:22.246 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:22.244+0000 7f5ba4000700 1 -- 172.21.15.87:0/3851031781 wait complete. 2024-05-08T05:29:22.246 INFO:teuthology.orchestra.run.smithi087.stderr:dumped fsmap epoch 25 2024-05-08T05:29:22.624 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:29:22 smithi087 ceph-mon[29523]: pgmap v431: 97 pgs: 97 active+clean; 650 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 938 B/s wr, 5 op/s 2024-05-08T05:29:22.624 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:29:22 smithi087 ceph-mon[29523]: from='client.? 172.21.15.87:0/3851031781' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T05:29:22.733 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:29:22 smithi090 ceph-mon[34526]: pgmap v431: 97 pgs: 97 active+clean; 650 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 938 B/s wr, 5 op/s 2024-05-08T05:29:22.733 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:29:22 smithi090 ceph-mon[34526]: from='client.? 172.21.15.87:0/3851031781' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T05:29:22.789 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:29:22 smithi160 ceph-mon[34827]: pgmap v431: 97 pgs: 97 active+clean; 650 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 938 B/s wr, 5 op/s 2024-05-08T05:29:22.789 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:29:22 smithi160 ceph-mon[34827]: from='client.? 172.21.15.87:0/3851031781' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T05:29:23.181 INFO:tasks.fwd_scrub:Ready to start scrub thrashing 2024-05-08T05:29:23.181 INFO:tasks.fwd_scrub.ceph_manager:waiting for clean 2024-05-08T05:29:23.181 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-08T05:29:23.388 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:23.387+0000 7f2ac3200640 1 -- 172.21.15.87:0/1388426276 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2abc0753b0 msgr2=0x7f2abc075810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:29:23.388 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:23.387+0000 7f2ac3200640 1 --2- 172.21.15.87:0/1388426276 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2abc0753b0 0x7f2abc075810 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f2aa8009900 tx=0x7f2aa802a480 comp rx=0 tx=0).stop 2024-05-08T05:29:23.388 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:23.387+0000 7f2ac3200640 1 -- 172.21.15.87:0/1388426276 shutdown_connections 2024-05-08T05:29:23.388 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:23.387+0000 7f2ac3200640 1 --2- 172.21.15.87:0/1388426276 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2abc10a6b0 0x7f2abc10cb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:29:23.388 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:23.387+0000 7f2ac3200640 1 --2- 172.21.15.87:0/1388426276 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2abc0753b0 0x7f2abc075810 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:29:23.388 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:23.387+0000 7f2ac3200640 1 --2- 172.21.15.87:0/1388426276 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2abc076990 0x7f2abc074de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:29:23.388 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:23.387+0000 7f2ac3200640 1 -- 172.21.15.87:0/1388426276 >> 172.21.15.87:0/1388426276 conn(0x7f2abc0fdd90 msgr2=0x7f2abc1001d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:29:23.388 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:23.387+0000 7f2ac3200640 1 -- 172.21.15.87:0/1388426276 shutdown_connections 2024-05-08T05:29:23.388 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:23.387+0000 7f2ac3200640 1 -- 172.21.15.87:0/1388426276 wait complete. 2024-05-08T05:29:23.390 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:23.388+0000 7f2ac3200640 1 Processor -- start 2024-05-08T05:29:23.390 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:23.388+0000 7f2ac3200640 1 -- start start 2024-05-08T05:29:23.390 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:23.389+0000 7f2ac3200640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2abc0753b0 0x7f2abc19acd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:29:23.391 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:23.389+0000 7f2ac3200640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2abc076990 0x7f2abc19b210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:29:23.391 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:23.389+0000 7f2ac3200640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2abc10a6b0 0x7f2abc1a21f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:29:23.391 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:23.389+0000 7f2ac3200640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f2abc110550 con 0x7f2abc10a6b0 2024-05-08T05:29:23.391 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:23.389+0000 7f2ac3200640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f2abc1103d0 con 0x7f2abc0753b0 2024-05-08T05:29:23.391 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:23.389+0000 7f2ac3200640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f2abc1106d0 con 0x7f2abc076990 2024-05-08T05:29:23.391 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:23.389+0000 7f2ac2800640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2abc10a6b0 0x7f2abc1a21f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:29:23.391 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:23.389+0000 7f2ac2800640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2abc10a6b0 0x7f2abc1a21f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:42892/0 (socket says 172.21.15.87:42892) 2024-05-08T05:29:23.391 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:23.389+0000 7f2ac2800640 1 -- 172.21.15.87:0/139536855 learned_addr learned my addr 172.21.15.87:0/139536855 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T05:29:23.391 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:23.389+0000 7f2ac1e00640 1 --2- 172.21.15.87:0/139536855 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2abc0753b0 0x7f2abc19acd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:29:23.391 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:23.389+0000 7f2ac1400640 1 --2- 172.21.15.87:0/139536855 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2abc076990 0x7f2abc19b210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:29:23.391 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:23.389+0000 7f2ac2800640 1 -- 172.21.15.87:0/139536855 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2abc076990 msgr2=0x7f2abc19b210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:29:23.391 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:23.389+0000 7f2ac2800640 1 --2- 172.21.15.87:0/139536855 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2abc076990 0x7f2abc19b210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:29:23.391 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:23.389+0000 7f2ac2800640 1 -- 172.21.15.87:0/139536855 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2abc0753b0 msgr2=0x7f2abc19acd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:29:23.392 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:23.389+0000 7f2ac2800640 1 --2- 172.21.15.87:0/139536855 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2abc0753b0 0x7f2abc19acd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:29:23.392 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:23.389+0000 7f2ac2800640 1 -- 172.21.15.87:0/139536855 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2abc1a2890 con 0x7f2abc10a6b0 2024-05-08T05:29:23.392 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:23.390+0000 7f2ac2800640 1 --2- 172.21.15.87:0/139536855 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2abc10a6b0 0x7f2abc1a21f0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f2ab800eb10 tx=0x7f2ab800c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:29:23.392 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:23.390+0000 7f2ab6a00640 1 -- 172.21.15.87:0/139536855 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ab8004b20 con 0x7f2abc10a6b0 2024-05-08T05:29:23.392 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:23.390+0000 7f2ab6a00640 1 -- 172.21.15.87:0/139536855 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2ab8004cc0 con 0x7f2abc10a6b0 2024-05-08T05:29:23.392 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:23.390+0000 7f2ac3200640 1 -- 172.21.15.87:0/139536855 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2abc1a2b80 con 0x7f2abc10a6b0 2024-05-08T05:29:23.392 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:23.390+0000 7f2ab6a00640 1 -- 172.21.15.87:0/139536855 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ab8010670 con 0x7f2abc10a6b0 2024-05-08T05:29:23.392 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:23.390+0000 7f2ac3200640 1 -- 172.21.15.87:0/139536855 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2abc1a3120 con 0x7f2abc10a6b0 2024-05-08T05:29:23.392 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:23.391+0000 7f2ac3200640 1 -- 172.21.15.87:0/139536855 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2abc109470 con 0x7f2abc10a6b0 2024-05-08T05:29:23.393 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:23.393+0000 7f2ab6a00640 1 -- 172.21.15.87:0/139536855 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7f2ab8005020 con 0x7f2abc10a6b0 2024-05-08T05:29:23.396 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:23.396+0000 7f2ab6a00640 1 --2- 172.21.15.87:0/139536855 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f2aa40b2870 0x7f2aa40b4d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:29:23.396 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:23.396+0000 7f2ab6a00640 1 -- 172.21.15.87:0/139536855 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8190+0+0 (secure 0 0 0) 0x7f2ab80e2780 con 0x7f2abc10a6b0 2024-05-08T05:29:23.396 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:23.396+0000 7f2ac1e00640 1 --2- 172.21.15.87:0/139536855 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f2aa40b2870 0x7f2aa40b4d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:29:23.397 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:23.397+0000 7f2ac1e00640 1 --2- 172.21.15.87:0/139536855 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f2aa40b2870 0x7f2aa40b4d30 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f2abc19c150 tx=0x7f2ab0005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:29:23.401 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:23.401+0000 7f2ab6a00640 1 -- 172.21.15.87:0/139536855 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f2ab80aa470 con 0x7f2abc10a6b0 2024-05-08T05:29:23.607 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:23.607+0000 7f2ac3200640 1 -- 172.21.15.87:0/139536855 --> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f2abc062df0 con 0x7f2aa40b2870 2024-05-08T05:29:23.631 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:23.630+0000 7f2ab6a00640 1 -- 172.21.15.87:0/139536855 <== mgr.14152 v2:172.21.15.87:6800/1189186457 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258811 (secure 0 0 0) 0x7f2abc062df0 con 0x7f2aa40b2870 2024-05-08T05:29:23.635 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-05-08T05:29:23.637 INFO:teuthology.orchestra.run.smithi087.stderr:dumped all 2024-05-08T05:29:23.639 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:23.635+0000 7f2ac3200640 1 -- 172.21.15.87:0/139536855 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f2aa40b2870 msgr2=0x7f2aa40b4d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:29:23.639 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:23.635+0000 7f2ac3200640 1 --2- 172.21.15.87:0/139536855 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f2aa40b2870 0x7f2aa40b4d30 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f2abc19c150 tx=0x7f2ab0005f90 comp rx=0 tx=0).stop 2024-05-08T05:29:23.639 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:23.635+0000 7f2ac3200640 1 -- 172.21.15.87:0/139536855 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2abc10a6b0 msgr2=0x7f2abc1a21f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:29:23.639 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:23.635+0000 7f2ac3200640 1 --2- 172.21.15.87:0/139536855 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2abc10a6b0 0x7f2abc1a21f0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f2ab800eb10 tx=0x7f2ab800c2d0 comp rx=0 tx=0).stop 2024-05-08T05:29:23.639 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:23.635+0000 7f2ac3200640 1 -- 172.21.15.87:0/139536855 shutdown_connections 2024-05-08T05:29:23.639 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:23.635+0000 7f2ac3200640 1 --2- 172.21.15.87:0/139536855 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f2aa40b2870 0x7f2aa40b4d30 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:29:23.639 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:23.635+0000 7f2ac3200640 1 --2- 172.21.15.87:0/139536855 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2abc10a6b0 0x7f2abc1a21f0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:29:23.639 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:23.635+0000 7f2ac3200640 1 --2- 172.21.15.87:0/139536855 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2abc076990 0x7f2abc19b210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:29:23.639 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:23.635+0000 7f2ac3200640 1 --2- 172.21.15.87:0/139536855 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2abc0753b0 0x7f2abc19acd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:29:23.639 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:23.635+0000 7f2ac3200640 1 -- 172.21.15.87:0/139536855 >> 172.21.15.87:0/139536855 conn(0x7f2abc0fdd90 msgr2=0x7f2abc106640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:29:23.640 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:23.636+0000 7f2ac3200640 1 -- 172.21.15.87:0/139536855 shutdown_connections 2024-05-08T05:29:23.640 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:23.636+0000 7f2ac3200640 1 -- 172.21.15.87:0/139536855 wait complete. 2024-05-08T05:29:23.657 INFO:teuthology.orchestra.run.smithi087.stdout:{"pg_ready":true,"pg_map":{"version":432,"stamp":"2024-05-08T05:29:22.981824+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":665728,"num_objects":64,"num_object_clones":0,"num_object_copies":192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":1337,"num_read_kb":775,"num_write":307,"num_write_kb":2285,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":13,"num_bytes_recovered":2951840,"num_keys_recovered":10,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":750,"ondisk_log_size":750,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":382512,"kb_used_data":12560,"kb_used_omap":18,"kb_used_meta":369837,"kb_avail":1124559312,"statfs":{"total":1151940427776,"available":1151548735488,"internally_reserved":0,"allocated":12861440,"data_stored":7229499,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19143,"internal_metadata":378713401},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":5993,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":73,"num_read_kb":43,"num_write":7,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005065"},"pg_stats":[{"pgid":"3.3f","version":"82'8","reported_seq":27,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:27:22.911792+0000","last_change":"2024-05-08T05:25:34.073030+0000","last_active":"2024-05-08T05:27:22.911792+0000","last_peered":"2024-05-08T05:27:22.911792+0000","last_clean":"2024-05-08T05:27:22.911792+0000","last_became_active":"2024-05-08T05:25:34.072593+0000","last_became_peered":"2024-05-08T05:25:34.072593+0000","last_unstale":"2024-05-08T05:27:22.911792+0000","last_undegraded":"2024-05-08T05:27:22.911792+0000","last_fullsized":"2024-05-08T05:27:22.911792+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_clean_scrub_stamp":"2024-05-08T05:25:33.008741+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T09:46:17.507034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"82'4","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:27:22.908973+0000","last_change":"2024-05-08T05:25:34.071436+0000","last_active":"2024-05-08T05:27:22.908973+0000","last_peered":"2024-05-08T05:27:22.908973+0000","last_clean":"2024-05-08T05:27:22.908973+0000","last_became_active":"2024-05-08T05:25:34.070985+0000","last_became_peered":"2024-05-08T05:25:34.070985+0000","last_unstale":"2024-05-08T05:27:22.908973+0000","last_undegraded":"2024-05-08T05:27:22.908973+0000","last_fullsized":"2024-05-08T05:27:22.908973+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_clean_scrub_stamp":"2024-05-08T05:25:33.008741+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T10:59:01.312978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"82'7","reported_seq":28,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:27:22.916059+0000","last_change":"2024-05-08T05:25:34.057180+0000","last_active":"2024-05-08T05:27:22.916059+0000","last_peered":"2024-05-08T05:27:22.916059+0000","last_clean":"2024-05-08T05:27:22.916059+0000","last_became_active":"2024-05-08T05:25:34.056775+0000","last_became_peered":"2024-05-08T05:25:34.056775+0000","last_unstale":"2024-05-08T05:27:22.916059+0000","last_undegraded":"2024-05-08T05:27:22.916059+0000","last_fullsized":"2024-05-08T05:27:22.916059+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_clean_scrub_stamp":"2024-05-08T05:25:33.008741+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T13:13:34.389793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"82'8","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:27:22.898318+0000","last_change":"2024-05-08T05:25:34.053102+0000","last_active":"2024-05-08T05:27:22.898318+0000","last_peered":"2024-05-08T05:27:22.898318+0000","last_clean":"2024-05-08T05:27:22.898318+0000","last_became_active":"2024-05-08T05:25:34.052736+0000","last_became_peered":"2024-05-08T05:25:34.052736+0000","last_unstale":"2024-05-08T05:27:22.898318+0000","last_undegraded":"2024-05-08T05:27:22.898318+0000","last_fullsized":"2024-05-08T05:27:22.898318+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_clean_scrub_stamp":"2024-05-08T05:25:33.008741+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T13:05:02.665370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"82'4","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:27:22.900518+0000","last_change":"2024-05-08T05:25:34.070073+0000","last_active":"2024-05-08T05:27:22.900518+0000","last_peered":"2024-05-08T05:27:22.900518+0000","last_clean":"2024-05-08T05:27:22.900518+0000","last_became_active":"2024-05-08T05:25:34.069660+0000","last_became_peered":"2024-05-08T05:25:34.069660+0000","last_unstale":"2024-05-08T05:27:22.900518+0000","last_undegraded":"2024-05-08T05:27:22.900518+0000","last_fullsized":"2024-05-08T05:27:22.900518+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_clean_scrub_stamp":"2024-05-08T05:25:33.008741+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T12:37:10.599082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"82'6","reported_seq":27,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:27:22.899161+0000","last_change":"2024-05-08T05:25:34.057928+0000","last_active":"2024-05-08T05:27:22.899161+0000","last_peered":"2024-05-08T05:27:22.899161+0000","last_clean":"2024-05-08T05:27:22.899161+0000","last_became_active":"2024-05-08T05:25:34.057538+0000","last_became_peered":"2024-05-08T05:25:34.057538+0000","last_unstale":"2024-05-08T05:27:22.899161+0000","last_undegraded":"2024-05-08T05:27:22.899161+0000","last_fullsized":"2024-05-08T05:27:22.899161+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_clean_scrub_stamp":"2024-05-08T05:25:33.008741+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T12:22:49.920889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"82'5","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:27:22.900100+0000","last_change":"2024-05-08T05:25:34.055439+0000","last_active":"2024-05-08T05:27:22.900100+0000","last_peered":"2024-05-08T05:27:22.900100+0000","last_clean":"2024-05-08T05:27:22.900100+0000","last_became_active":"2024-05-08T05:25:34.055002+0000","last_became_peered":"2024-05-08T05:25:34.055002+0000","last_unstale":"2024-05-08T05:27:22.900100+0000","last_undegraded":"2024-05-08T05:27:22.900100+0000","last_fullsized":"2024-05-08T05:27:22.900100+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_clean_scrub_stamp":"2024-05-08T05:25:33.008741+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T11:29:00.482681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"82'9","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:27:22.913447+0000","last_change":"2024-05-08T05:25:34.058943+0000","last_active":"2024-05-08T05:27:22.913447+0000","last_peered":"2024-05-08T05:27:22.913447+0000","last_clean":"2024-05-08T05:27:22.913447+0000","last_became_active":"2024-05-08T05:25:34.058200+0000","last_became_peered":"2024-05-08T05:25:34.058200+0000","last_unstale":"2024-05-08T05:27:22.913447+0000","last_undegraded":"2024-05-08T05:27:22.913447+0000","last_fullsized":"2024-05-08T05:27:22.913447+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_clean_scrub_stamp":"2024-05-08T05:25:33.008741+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T11:13:23.019489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"82'11","reported_seq":32,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:27:22.905575+0000","last_change":"2024-05-08T05:25:34.053948+0000","last_active":"2024-05-08T05:27:22.905575+0000","last_peered":"2024-05-08T05:27:22.905575+0000","last_clean":"2024-05-08T05:27:22.905575+0000","last_became_active":"2024-05-08T05:25:34.053601+0000","last_became_peered":"2024-05-08T05:25:34.053601+0000","last_unstale":"2024-05-08T05:27:22.905575+0000","last_undegraded":"2024-05-08T05:27:22.905575+0000","last_fullsized":"2024-05-08T05:27:22.905575+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_clean_scrub_stamp":"2024-05-08T05:25:33.008741+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T05:50:44.228628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"82'16","reported_seq":37,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:27:22.899056+0000","last_change":"2024-05-08T05:25:34.053167+0000","last_active":"2024-05-08T05:27:22.899056+0000","last_peered":"2024-05-08T05:27:22.899056+0000","last_clean":"2024-05-08T05:27:22.899056+0000","last_became_active":"2024-05-08T05:25:34.052425+0000","last_became_peered":"2024-05-08T05:25:34.052425+0000","last_unstale":"2024-05-08T05:27:22.899056+0000","last_undegraded":"2024-05-08T05:27:22.899056+0000","last_fullsized":"2024-05-08T05:27:22.899056+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_clean_scrub_stamp":"2024-05-08T05:25:33.008741+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T10:56:28.599966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"82'6","reported_seq":27,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:27:22.905304+0000","last_change":"2024-05-08T05:25:34.057677+0000","last_active":"2024-05-08T05:27:22.905304+0000","last_peered":"2024-05-08T05:27:22.905304+0000","last_clean":"2024-05-08T05:27:22.905304+0000","last_became_active":"2024-05-08T05:25:34.054800+0000","last_became_peered":"2024-05-08T05:25:34.054800+0000","last_unstale":"2024-05-08T05:27:22.905304+0000","last_undegraded":"2024-05-08T05:27:22.905304+0000","last_fullsized":"2024-05-08T05:27:22.905304+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_clean_scrub_stamp":"2024-05-08T05:25:33.008741+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T07:41:55.836901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"82'7","reported_seq":28,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:27:22.898468+0000","last_change":"2024-05-08T05:25:34.051744+0000","last_active":"2024-05-08T05:27:22.898468+0000","last_peered":"2024-05-08T05:27:22.898468+0000","last_clean":"2024-05-08T05:27:22.898468+0000","last_became_active":"2024-05-08T05:25:34.051395+0000","last_became_peered":"2024-05-08T05:25:34.051395+0000","last_unstale":"2024-05-08T05:27:22.898468+0000","last_undegraded":"2024-05-08T05:27:22.898468+0000","last_fullsized":"2024-05-08T05:27:22.898468+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_clean_scrub_stamp":"2024-05-08T05:25:33.008741+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T07:58:52.674899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"82'10","reported_seq":31,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:27:22.913323+0000","last_change":"2024-05-08T05:25:34.053197+0000","last_active":"2024-05-08T05:27:22.913323+0000","last_peered":"2024-05-08T05:27:22.913323+0000","last_clean":"2024-05-08T05:27:22.913323+0000","last_became_active":"2024-05-08T05:25:34.052331+0000","last_became_peered":"2024-05-08T05:25:34.052331+0000","last_unstale":"2024-05-08T05:27:22.913323+0000","last_undegraded":"2024-05-08T05:27:22.913323+0000","last_fullsized":"2024-05-08T05:27:22.913323+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_clean_scrub_stamp":"2024-05-08T05:25:33.008741+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T07:19:12.524722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"82'7","reported_seq":28,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:27:22.907958+0000","last_change":"2024-05-08T05:25:34.070242+0000","last_active":"2024-05-08T05:27:22.907958+0000","last_peered":"2024-05-08T05:27:22.907958+0000","last_clean":"2024-05-08T05:27:22.907958+0000","last_became_active":"2024-05-08T05:25:34.069580+0000","last_became_peered":"2024-05-08T05:25:34.069580+0000","last_unstale":"2024-05-08T05:27:22.907958+0000","last_undegraded":"2024-05-08T05:27:22.907958+0000","last_fullsized":"2024-05-08T05:27:22.907958+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_clean_scrub_stamp":"2024-05-08T05:25:33.008741+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T06:33:25.099470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"82'7","reported_seq":28,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:27:22.908516+0000","last_change":"2024-05-08T05:25:34.067174+0000","last_active":"2024-05-08T05:27:22.908516+0000","last_peered":"2024-05-08T05:27:22.908516+0000","last_clean":"2024-05-08T05:27:22.908516+0000","last_became_active":"2024-05-08T05:25:34.066811+0000","last_became_peered":"2024-05-08T05:25:34.066811+0000","last_unstale":"2024-05-08T05:27:22.908516+0000","last_undegraded":"2024-05-08T05:27:22.908516+0000","last_fullsized":"2024-05-08T05:27:22.908516+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_clean_scrub_stamp":"2024-05-08T05:25:33.008741+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T16:17:57.731620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"82'9","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:27:22.918765+0000","last_change":"2024-05-08T05:25:34.064339+0000","last_active":"2024-05-08T05:27:22.918765+0000","last_peered":"2024-05-08T05:27:22.918765+0000","last_clean":"2024-05-08T05:27:22.918765+0000","last_became_active":"2024-05-08T05:25:34.063994+0000","last_became_peered":"2024-05-08T05:25:34.063994+0000","last_unstale":"2024-05-08T05:27:22.918765+0000","last_undegraded":"2024-05-08T05:27:22.918765+0000","last_fullsized":"2024-05-08T05:27:22.918765+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_clean_scrub_stamp":"2024-05-08T05:25:33.008741+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T17:09:34.443411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"82'8","reported_seq":27,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:27:22.911757+0000","last_change":"2024-05-08T05:25:34.073029+0000","last_active":"2024-05-08T05:27:22.911757+0000","last_peered":"2024-05-08T05:27:22.911757+0000","last_clean":"2024-05-08T05:27:22.911757+0000","last_became_active":"2024-05-08T05:25:34.072491+0000","last_became_peered":"2024-05-08T05:25:34.072491+0000","last_unstale":"2024-05-08T05:27:22.911757+0000","last_undegraded":"2024-05-08T05:27:22.911757+0000","last_fullsized":"2024-05-08T05:27:22.911757+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_clean_scrub_stamp":"2024-05-08T05:25:33.008741+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T10:22:25.304349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"82'10","reported_seq":31,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:27:22.898481+0000","last_change":"2024-05-08T05:25:34.061439+0000","last_active":"2024-05-08T05:27:22.898481+0000","last_peered":"2024-05-08T05:27:22.898481+0000","last_clean":"2024-05-08T05:27:22.898481+0000","last_became_active":"2024-05-08T05:25:34.058275+0000","last_became_peered":"2024-05-08T05:25:34.058275+0000","last_unstale":"2024-05-08T05:27:22.898481+0000","last_undegraded":"2024-05-08T05:27:22.898481+0000","last_fullsized":"2024-05-08T05:27:22.898481+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_clean_scrub_stamp":"2024-05-08T05:25:33.008741+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T14:04:32.433114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"82'7","reported_seq":28,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:27:22.903102+0000","last_change":"2024-05-08T05:25:34.061463+0000","last_active":"2024-05-08T05:27:22.903102+0000","last_peered":"2024-05-08T05:27:22.903102+0000","last_clean":"2024-05-08T05:27:22.903102+0000","last_became_active":"2024-05-08T05:25:34.060891+0000","last_became_peered":"2024-05-08T05:25:34.060891+0000","last_unstale":"2024-05-08T05:27:22.903102+0000","last_undegraded":"2024-05-08T05:27:22.903102+0000","last_fullsized":"2024-05-08T05:27:22.903102+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_clean_scrub_stamp":"2024-05-08T05:25:33.008741+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T06:42:17.741180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1f","version":"80'9","reported_seq":37,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:26:24.134584+0000","last_change":"2024-05-08T05:25:30.003956+0000","last_active":"2024-05-08T05:26:24.134584+0000","last_peered":"2024-05-08T05:26:24.134584+0000","last_clean":"2024-05-08T05:26:24.134584+0000","last_became_active":"2024-05-08T05:25:30.003229+0000","last_became_peered":"2024-05-08T05:25:30.003229+0000","last_unstale":"2024-05-08T05:26:24.134584+0000","last_undegraded":"2024-05-08T05:26:24.134584+0000","last_fullsized":"2024-05-08T05:26:24.134584+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:28.970901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:28.970901+0000","last_clean_scrub_stamp":"2024-05-08T05:25:28.970901+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T15:45:15.168997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"82'5","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:27:22.894722+0000","last_change":"2024-05-08T05:25:34.064917+0000","last_active":"2024-05-08T05:27:22.894722+0000","last_peered":"2024-05-08T05:27:22.894722+0000","last_clean":"2024-05-08T05:27:22.894722+0000","last_became_active":"2024-05-08T05:25:34.064567+0000","last_became_peered":"2024-05-08T05:25:34.064567+0000","last_unstale":"2024-05-08T05:27:22.894722+0000","last_undegraded":"2024-05-08T05:27:22.894722+0000","last_fullsized":"2024-05-08T05:27:22.894722+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_clean_scrub_stamp":"2024-05-08T05:25:33.008741+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T11:15:53.439313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"80'2","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:26:24.124003+0000","last_change":"2024-05-08T05:25:30.358617+0000","last_active":"2024-05-08T05:26:24.124003+0000","last_peered":"2024-05-08T05:26:24.124003+0000","last_clean":"2024-05-08T05:26:24.124003+0000","last_became_active":"2024-05-08T05:25:30.358084+0000","last_became_peered":"2024-05-08T05:25:30.358084+0000","last_unstale":"2024-05-08T05:26:24.124003+0000","last_undegraded":"2024-05-08T05:26:24.124003+0000","last_fullsized":"2024-05-08T05:26:24.124003+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:28.970901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:28.970901+0000","last_clean_scrub_stamp":"2024-05-08T05:25:28.970901+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T16:30:36.151645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"82'6","reported_seq":27,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:27:22.915154+0000","last_change":"2024-05-08T05:25:34.070189+0000","last_active":"2024-05-08T05:27:22.915154+0000","last_peered":"2024-05-08T05:27:22.915154+0000","last_clean":"2024-05-08T05:27:22.915154+0000","last_became_active":"2024-05-08T05:25:34.067644+0000","last_became_peered":"2024-05-08T05:25:34.067644+0000","last_unstale":"2024-05-08T05:27:22.915154+0000","last_undegraded":"2024-05-08T05:27:22.915154+0000","last_fullsized":"2024-05-08T05:27:22.915154+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_clean_scrub_stamp":"2024-05-08T05:25:33.008741+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T07:50:03.938036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"80'4","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:26:27.357651+0000","last_change":"2024-05-08T05:26:24.133899+0000","last_active":"2024-05-08T05:26:27.357651+0000","last_peered":"2024-05-08T05:26:27.357651+0000","last_clean":"2024-05-08T05:26:27.357651+0000","last_became_active":"2024-05-08T05:26:24.127975+0000","last_became_peered":"2024-05-08T05:26:24.127975+0000","last_unstale":"2024-05-08T05:26:27.357651+0000","last_undegraded":"2024-05-08T05:26:27.357651+0000","last_fullsized":"2024-05-08T05:26:27.357651+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:28.970901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:28.970901+0000","last_clean_scrub_stamp":"2024-05-08T05:25:28.970901+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T09:52:51.912899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":10,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,7],"acting":[11,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1c","version":"82'9","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:27:22.908643+0000","last_change":"2024-05-08T05:25:34.057034+0000","last_active":"2024-05-08T05:27:22.908643+0000","last_peered":"2024-05-08T05:27:22.908643+0000","last_clean":"2024-05-08T05:27:22.908643+0000","last_became_active":"2024-05-08T05:25:34.056718+0000","last_became_peered":"2024-05-08T05:25:34.056718+0000","last_unstale":"2024-05-08T05:27:22.908643+0000","last_undegraded":"2024-05-08T05:27:22.908643+0000","last_fullsized":"2024-05-08T05:27:22.908643+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_clean_scrub_stamp":"2024-05-08T05:25:33.008741+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T15:30:38.786889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1c","version":"80'2","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:26:24.115973+0000","last_change":"2024-05-08T05:25:29.998007+0000","last_active":"2024-05-08T05:26:24.115973+0000","last_peered":"2024-05-08T05:26:24.115973+0000","last_clean":"2024-05-08T05:26:24.115973+0000","last_became_active":"2024-05-08T05:25:29.997565+0000","last_became_peered":"2024-05-08T05:25:29.997565+0000","last_unstale":"2024-05-08T05:26:24.115973+0000","last_undegraded":"2024-05-08T05:26:24.115973+0000","last_fullsized":"2024-05-08T05:26:24.115973+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:28.970901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:28.970901+0000","last_clean_scrub_stamp":"2024-05-08T05:25:28.970901+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T13:40:09.620809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"82'15","reported_seq":36,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:27:22.905074+0000","last_change":"2024-05-08T05:25:34.060136+0000","last_active":"2024-05-08T05:27:22.905074+0000","last_peered":"2024-05-08T05:27:22.905074+0000","last_clean":"2024-05-08T05:27:22.905074+0000","last_became_active":"2024-05-08T05:25:34.059782+0000","last_became_peered":"2024-05-08T05:25:34.059782+0000","last_unstale":"2024-05-08T05:27:22.905074+0000","last_undegraded":"2024-05-08T05:27:22.905074+0000","last_fullsized":"2024-05-08T05:27:22.905074+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_clean_scrub_stamp":"2024-05-08T05:25:33.008741+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T17:07:33.509305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"82'7","reported_seq":245,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:29:21.275937+0000","last_change":"2024-05-08T05:25:30.001356+0000","last_active":"2024-05-08T05:29:21.275937+0000","last_peered":"2024-05-08T05:29:21.275937+0000","last_clean":"2024-05-08T05:29:21.275937+0000","last_became_active":"2024-05-08T05:25:30.000998+0000","last_became_peered":"2024-05-08T05:25:30.000998+0000","last_unstale":"2024-05-08T05:29:21.275937+0000","last_undegraded":"2024-05-08T05:29:21.275937+0000","last_fullsized":"2024-05-08T05:29:21.275937+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:28.970901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:28.970901+0000","last_clean_scrub_stamp":"2024-05-08T05:25:28.970901+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T10:03:27.279982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1154,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":211,"num_read_kb":4,"num_write":4,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"82'7","reported_seq":28,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:27:22.881387+0000","last_change":"2024-05-08T05:25:34.056548+0000","last_active":"2024-05-08T05:27:22.881387+0000","last_peered":"2024-05-08T05:27:22.881387+0000","last_clean":"2024-05-08T05:27:22.881387+0000","last_became_active":"2024-05-08T05:25:34.056216+0000","last_became_peered":"2024-05-08T05:25:34.056216+0000","last_unstale":"2024-05-08T05:27:22.881387+0000","last_undegraded":"2024-05-08T05:27:22.881387+0000","last_fullsized":"2024-05-08T05:27:22.881387+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_clean_scrub_stamp":"2024-05-08T05:25:33.008741+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T14:46:05.056610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1a","version":"80'3","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:26:24.127545+0000","last_change":"2024-05-08T05:25:30.009289+0000","last_active":"2024-05-08T05:26:24.127545+0000","last_peered":"2024-05-08T05:26:24.127545+0000","last_clean":"2024-05-08T05:26:24.127545+0000","last_became_active":"2024-05-08T05:25:30.008856+0000","last_became_peered":"2024-05-08T05:25:30.008856+0000","last_unstale":"2024-05-08T05:26:24.127545+0000","last_undegraded":"2024-05-08T05:26:24.127545+0000","last_fullsized":"2024-05-08T05:26:24.127545+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:28.970901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:28.970901+0000","last_clean_scrub_stamp":"2024-05-08T05:25:28.970901+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T10:49:55.857415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"82'8","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:27:22.902854+0000","last_change":"2024-05-08T05:25:34.062532+0000","last_active":"2024-05-08T05:27:22.902854+0000","last_peered":"2024-05-08T05:27:22.902854+0000","last_clean":"2024-05-08T05:27:22.902854+0000","last_became_active":"2024-05-08T05:25:34.062246+0000","last_became_peered":"2024-05-08T05:25:34.062246+0000","last_unstale":"2024-05-08T05:27:22.902854+0000","last_undegraded":"2024-05-08T05:27:22.902854+0000","last_fullsized":"2024-05-08T05:27:22.902854+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_clean_scrub_stamp":"2024-05-08T05:25:33.008741+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T07:35:49.149411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"80'2","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:26:24.114481+0000","last_change":"2024-05-08T05:25:30.014336+0000","last_active":"2024-05-08T05:26:24.114481+0000","last_peered":"2024-05-08T05:26:24.114481+0000","last_clean":"2024-05-08T05:26:24.114481+0000","last_became_active":"2024-05-08T05:25:30.012147+0000","last_became_peered":"2024-05-08T05:25:30.012147+0000","last_unstale":"2024-05-08T05:26:24.114481+0000","last_undegraded":"2024-05-08T05:26:24.114481+0000","last_fullsized":"2024-05-08T05:26:24.114481+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:28.970901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:28.970901+0000","last_clean_scrub_stamp":"2024-05-08T05:25:28.970901+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T07:48:20.477581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"82'8","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:27:22.913329+0000","last_change":"2024-05-08T05:25:34.058947+0000","last_active":"2024-05-08T05:27:22.913329+0000","last_peered":"2024-05-08T05:27:22.913329+0000","last_clean":"2024-05-08T05:27:22.913329+0000","last_became_active":"2024-05-08T05:25:34.058626+0000","last_became_peered":"2024-05-08T05:25:34.058626+0000","last_unstale":"2024-05-08T05:27:22.913329+0000","last_undegraded":"2024-05-08T05:27:22.913329+0000","last_fullsized":"2024-05-08T05:27:22.913329+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_clean_scrub_stamp":"2024-05-08T05:25:33.008741+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T12:55:07.742707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"80'1","reported_seq":28,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:26:24.118168+0000","last_change":"2024-05-08T05:25:29.999201+0000","last_active":"2024-05-08T05:26:24.118168+0000","last_peered":"2024-05-08T05:26:24.118168+0000","last_clean":"2024-05-08T05:26:24.118168+0000","last_became_active":"2024-05-08T05:25:29.998819+0000","last_became_peered":"2024-05-08T05:25:29.998819+0000","last_unstale":"2024-05-08T05:26:24.118168+0000","last_undegraded":"2024-05-08T05:26:24.118168+0000","last_fullsized":"2024-05-08T05:26:24.118168+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:28.970901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:28.970901+0000","last_clean_scrub_stamp":"2024-05-08T05:25:28.970901+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T09:00:02.831877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"82'11","reported_seq":32,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:27:22.906445+0000","last_change":"2024-05-08T05:25:34.063770+0000","last_active":"2024-05-08T05:27:22.906445+0000","last_peered":"2024-05-08T05:27:22.906445+0000","last_clean":"2024-05-08T05:27:22.906445+0000","last_became_active":"2024-05-08T05:25:34.061591+0000","last_became_peered":"2024-05-08T05:25:34.061591+0000","last_unstale":"2024-05-08T05:27:22.906445+0000","last_undegraded":"2024-05-08T05:27:22.906445+0000","last_fullsized":"2024-05-08T05:27:22.906445+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_clean_scrub_stamp":"2024-05-08T05:25:33.008741+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T16:51:06.593857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"82'4","reported_seq":234,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:29:17.268696+0000","last_change":"2024-05-08T05:25:30.005678+0000","last_active":"2024-05-08T05:29:17.268696+0000","last_peered":"2024-05-08T05:29:17.268696+0000","last_clean":"2024-05-08T05:29:17.268696+0000","last_became_active":"2024-05-08T05:25:30.005218+0000","last_became_peered":"2024-05-08T05:25:30.005218+0000","last_unstale":"2024-05-08T05:29:17.268696+0000","last_undegraded":"2024-05-08T05:29:17.268696+0000","last_fullsized":"2024-05-08T05:29:17.268696+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:28.970901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:28.970901+0000","last_clean_scrub_stamp":"2024-05-08T05:25:28.970901+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T11:44:56.720663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":203,"num_read_kb":203,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"82'10","reported_seq":31,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:27:22.901986+0000","last_change":"2024-05-08T05:25:34.058640+0000","last_active":"2024-05-08T05:27:22.901986+0000","last_peered":"2024-05-08T05:27:22.901986+0000","last_clean":"2024-05-08T05:27:22.901986+0000","last_became_active":"2024-05-08T05:25:34.058332+0000","last_became_peered":"2024-05-08T05:25:34.058332+0000","last_unstale":"2024-05-08T05:27:22.901986+0000","last_undegraded":"2024-05-08T05:27:22.901986+0000","last_fullsized":"2024-05-08T05:27:22.901986+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_clean_scrub_stamp":"2024-05-08T05:25:33.008741+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T09:21:44.273684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"80'2","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:26:24.115870+0000","last_change":"2024-05-08T05:25:30.000229+0000","last_active":"2024-05-08T05:26:24.115870+0000","last_peered":"2024-05-08T05:26:24.115870+0000","last_clean":"2024-05-08T05:26:24.115870+0000","last_became_active":"2024-05-08T05:25:29.999888+0000","last_became_peered":"2024-05-08T05:25:29.999888+0000","last_unstale":"2024-05-08T05:26:24.115870+0000","last_undegraded":"2024-05-08T05:26:24.115870+0000","last_fullsized":"2024-05-08T05:26:24.115870+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:28.970901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:28.970901+0000","last_clean_scrub_stamp":"2024-05-08T05:25:28.970901+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T10:28:02.849791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"82'9","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:27:22.918728+0000","last_change":"2024-05-08T05:25:34.069600+0000","last_active":"2024-05-08T05:27:22.918728+0000","last_peered":"2024-05-08T05:27:22.918728+0000","last_clean":"2024-05-08T05:27:22.918728+0000","last_became_active":"2024-05-08T05:25:34.069055+0000","last_became_peered":"2024-05-08T05:25:34.069055+0000","last_unstale":"2024-05-08T05:27:22.918728+0000","last_undegraded":"2024-05-08T05:27:22.918728+0000","last_fullsized":"2024-05-08T05:27:22.918728+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_clean_scrub_stamp":"2024-05-08T05:25:33.008741+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T10:22:31.166719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"80'4","reported_seq":32,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:26:24.118776+0000","last_change":"2024-05-08T05:25:30.360911+0000","last_active":"2024-05-08T05:26:24.118776+0000","last_peered":"2024-05-08T05:26:24.118776+0000","last_clean":"2024-05-08T05:26:24.118776+0000","last_became_active":"2024-05-08T05:25:30.360544+0000","last_became_peered":"2024-05-08T05:25:30.360544+0000","last_unstale":"2024-05-08T05:26:24.118776+0000","last_undegraded":"2024-05-08T05:26:24.118776+0000","last_fullsized":"2024-05-08T05:26:24.118776+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:28.970901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:28.970901+0000","last_clean_scrub_stamp":"2024-05-08T05:25:28.970901+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T17:03:10.633420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"82'11","reported_seq":32,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:27:22.903262+0000","last_change":"2024-05-08T05:25:34.058259+0000","last_active":"2024-05-08T05:27:22.903262+0000","last_peered":"2024-05-08T05:27:22.903262+0000","last_clean":"2024-05-08T05:27:22.903262+0000","last_became_active":"2024-05-08T05:25:34.057912+0000","last_became_peered":"2024-05-08T05:25:34.057912+0000","last_unstale":"2024-05-08T05:27:22.903262+0000","last_undegraded":"2024-05-08T05:27:22.903262+0000","last_fullsized":"2024-05-08T05:27:22.903262+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_clean_scrub_stamp":"2024-05-08T05:25:33.008741+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T14:58:49.311769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"82'37","reported_seq":483,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:29:18.279757+0000","last_change":"2024-05-08T05:25:30.001177+0000","last_active":"2024-05-08T05:29:18.279757+0000","last_peered":"2024-05-08T05:29:18.279757+0000","last_clean":"2024-05-08T05:29:18.279757+0000","last_became_active":"2024-05-08T05:25:30.000769+0000","last_became_peered":"2024-05-08T05:25:30.000769+0000","last_unstale":"2024-05-08T05:29:18.279757+0000","last_undegraded":"2024-05-08T05:29:18.279757+0000","last_fullsized":"2024-05-08T05:29:18.279757+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:28.970901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:28.970901+0000","last_clean_scrub_stamp":"2024-05-08T05:25:28.970901+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T14:40:35.540270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70142,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":419,"num_read_kb":279,"num_write":38,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"82'6","reported_seq":27,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:27:22.888709+0000","last_change":"2024-05-08T05:25:34.053366+0000","last_active":"2024-05-08T05:27:22.888709+0000","last_peered":"2024-05-08T05:27:22.888709+0000","last_clean":"2024-05-08T05:27:22.888709+0000","last_became_active":"2024-05-08T05:25:34.052485+0000","last_became_peered":"2024-05-08T05:25:34.052485+0000","last_unstale":"2024-05-08T05:27:22.888709+0000","last_undegraded":"2024-05-08T05:27:22.888709+0000","last_fullsized":"2024-05-08T05:27:22.888709+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_clean_scrub_stamp":"2024-05-08T05:25:33.008741+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T07:35:05.603319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"80'6","reported_seq":34,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:26:24.115427+0000","last_change":"2024-05-08T05:25:30.010453+0000","last_active":"2024-05-08T05:26:24.115427+0000","last_peered":"2024-05-08T05:26:24.115427+0000","last_clean":"2024-05-08T05:26:24.115427+0000","last_became_active":"2024-05-08T05:25:30.010032+0000","last_became_peered":"2024-05-08T05:25:30.010032+0000","last_unstale":"2024-05-08T05:26:24.115427+0000","last_undegraded":"2024-05-08T05:26:24.115427+0000","last_fullsized":"2024-05-08T05:26:24.115427+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:28.970901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:28.970901+0000","last_clean_scrub_stamp":"2024-05-08T05:25:28.970901+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T16:34:35.052481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"82'9","reported_seq":36,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:27:22.904364+0000","last_change":"2024-05-08T05:26:24.134959+0000","last_active":"2024-05-08T05:27:22.904364+0000","last_peered":"2024-05-08T05:27:22.904364+0000","last_clean":"2024-05-08T05:27:22.904364+0000","last_became_active":"2024-05-08T05:26:24.134487+0000","last_became_peered":"2024-05-08T05:26:24.134487+0000","last_unstale":"2024-05-08T05:27:22.904364+0000","last_undegraded":"2024-05-08T05:27:22.904364+0000","last_fullsized":"2024-05-08T05:27:22.904364+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_clean_scrub_stamp":"2024-05-08T05:25:33.008741+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T06:46:55.131407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,9],"acting":[6,7,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"80'3","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:26:24.118218+0000","last_change":"2024-05-08T05:25:30.009768+0000","last_active":"2024-05-08T05:26:24.118218+0000","last_peered":"2024-05-08T05:26:24.118218+0000","last_clean":"2024-05-08T05:26:24.118218+0000","last_became_active":"2024-05-08T05:25:30.009385+0000","last_became_peered":"2024-05-08T05:25:30.009385+0000","last_unstale":"2024-05-08T05:26:24.118218+0000","last_undegraded":"2024-05-08T05:26:24.118218+0000","last_fullsized":"2024-05-08T05:26:24.118218+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:28.970901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:28.970901+0000","last_clean_scrub_stamp":"2024-05-08T05:25:28.970901+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T07:19:19.556003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"82'15","reported_seq":36,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:27:22.912117+0000","last_change":"2024-05-08T05:25:34.055704+0000","last_active":"2024-05-08T05:27:22.912117+0000","last_peered":"2024-05-08T05:27:22.912117+0000","last_clean":"2024-05-08T05:27:22.912117+0000","last_became_active":"2024-05-08T05:25:34.055339+0000","last_became_peered":"2024-05-08T05:25:34.055339+0000","last_unstale":"2024-05-08T05:27:22.912117+0000","last_undegraded":"2024-05-08T05:27:22.912117+0000","last_fullsized":"2024-05-08T05:27:22.912117+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_clean_scrub_stamp":"2024-05-08T05:25:33.008741+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T07:21:52.579094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"82'6","reported_seq":241,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:29:17.408189+0000","last_change":"2024-05-08T05:25:29.998631+0000","last_active":"2024-05-08T05:29:17.408189+0000","last_peered":"2024-05-08T05:29:17.408189+0000","last_clean":"2024-05-08T05:29:17.408189+0000","last_became_active":"2024-05-08T05:25:29.998216+0000","last_became_peered":"2024-05-08T05:25:29.998216+0000","last_unstale":"2024-05-08T05:29:17.408189+0000","last_undegraded":"2024-05-08T05:29:17.408189+0000","last_fullsized":"2024-05-08T05:29:17.408189+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:28.970901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:28.970901+0000","last_clean_scrub_stamp":"2024-05-08T05:25:28.970901+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T14:16:58.252604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1430,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":209,"num_read_kb":6,"num_write":5,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"82'6","reported_seq":27,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:27:22.890182+0000","last_change":"2024-05-08T05:25:34.053216+0000","last_active":"2024-05-08T05:27:22.890182+0000","last_peered":"2024-05-08T05:27:22.890182+0000","last_clean":"2024-05-08T05:27:22.890182+0000","last_became_active":"2024-05-08T05:25:34.052908+0000","last_became_peered":"2024-05-08T05:25:34.052908+0000","last_unstale":"2024-05-08T05:27:22.890182+0000","last_undegraded":"2024-05-08T05:27:22.890182+0000","last_fullsized":"2024-05-08T05:27:22.890182+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_clean_scrub_stamp":"2024-05-08T05:25:33.008741+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T13:01:42.574200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"80'15","reported_seq":43,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:26:24.116096+0000","last_change":"2024-05-08T05:25:30.356349+0000","last_active":"2024-05-08T05:26:24.116096+0000","last_peered":"2024-05-08T05:26:24.116096+0000","last_clean":"2024-05-08T05:26:24.116096+0000","last_became_active":"2024-05-08T05:25:30.355892+0000","last_became_peered":"2024-05-08T05:25:30.355892+0000","last_unstale":"2024-05-08T05:26:24.116096+0000","last_undegraded":"2024-05-08T05:26:24.116096+0000","last_fullsized":"2024-05-08T05:26:24.116096+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:28.970901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:28.970901+0000","last_clean_scrub_stamp":"2024-05-08T05:25:28.970901+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T16:54:22.322606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"82'6","reported_seq":27,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:27:22.904730+0000","last_change":"2024-05-08T05:25:34.062254+0000","last_active":"2024-05-08T05:27:22.904730+0000","last_peered":"2024-05-08T05:27:22.904730+0000","last_clean":"2024-05-08T05:27:22.904730+0000","last_became_active":"2024-05-08T05:25:34.061928+0000","last_became_peered":"2024-05-08T05:25:34.061928+0000","last_unstale":"2024-05-08T05:27:22.904730+0000","last_undegraded":"2024-05-08T05:27:22.904730+0000","last_fullsized":"2024-05-08T05:27:22.904730+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_clean_scrub_stamp":"2024-05-08T05:25:33.008741+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T14:58:17.135661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"80'2","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:26:24.116424+0000","last_change":"2024-05-08T05:25:30.001434+0000","last_active":"2024-05-08T05:26:24.116424+0000","last_peered":"2024-05-08T05:26:24.116424+0000","last_clean":"2024-05-08T05:26:24.116424+0000","last_became_active":"2024-05-08T05:25:30.000900+0000","last_became_peered":"2024-05-08T05:25:30.000900+0000","last_unstale":"2024-05-08T05:26:24.116424+0000","last_undegraded":"2024-05-08T05:26:24.116424+0000","last_fullsized":"2024-05-08T05:26:24.116424+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:28.970901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:28.970901+0000","last_clean_scrub_stamp":"2024-05-08T05:25:28.970901+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T11:47:18.031222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"82'5","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:27:22.889034+0000","last_change":"2024-05-08T05:25:34.057101+0000","last_active":"2024-05-08T05:27:22.889034+0000","last_peered":"2024-05-08T05:27:22.889034+0000","last_clean":"2024-05-08T05:27:22.889034+0000","last_became_active":"2024-05-08T05:25:34.056742+0000","last_became_peered":"2024-05-08T05:25:34.056742+0000","last_unstale":"2024-05-08T05:27:22.889034+0000","last_undegraded":"2024-05-08T05:27:22.889034+0000","last_fullsized":"2024-05-08T05:27:22.889034+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_clean_scrub_stamp":"2024-05-08T05:25:33.008741+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T14:19:22.997586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":27,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:26:24.133876+0000","last_change":"2024-05-08T05:25:30.359474+0000","last_active":"2024-05-08T05:26:24.133876+0000","last_peered":"2024-05-08T05:26:24.133876+0000","last_clean":"2024-05-08T05:26:24.133876+0000","last_became_active":"2024-05-08T05:25:30.358971+0000","last_became_peered":"2024-05-08T05:25:30.358971+0000","last_unstale":"2024-05-08T05:26:24.133876+0000","last_undegraded":"2024-05-08T05:26:24.133876+0000","last_fullsized":"2024-05-08T05:26:24.133876+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:28.970901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:28.970901+0000","last_clean_scrub_stamp":"2024-05-08T05:25:28.970901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T12:51:42.239112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"82'5","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:27:22.909599+0000","last_change":"2024-05-08T05:25:34.061014+0000","last_active":"2024-05-08T05:27:22.909599+0000","last_peered":"2024-05-08T05:27:22.909599+0000","last_clean":"2024-05-08T05:27:22.909599+0000","last_became_active":"2024-05-08T05:25:34.060682+0000","last_became_peered":"2024-05-08T05:25:34.060682+0000","last_unstale":"2024-05-08T05:27:22.909599+0000","last_undegraded":"2024-05-08T05:27:22.909599+0000","last_fullsized":"2024-05-08T05:27:22.909599+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_clean_scrub_stamp":"2024-05-08T05:25:33.008741+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T13:19:48.652257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"80'1","reported_seq":28,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:26:24.116079+0000","last_change":"2024-05-08T05:25:30.009360+0000","last_active":"2024-05-08T05:26:24.116079+0000","last_peered":"2024-05-08T05:26:24.116079+0000","last_clean":"2024-05-08T05:26:24.116079+0000","last_became_active":"2024-05-08T05:25:30.008806+0000","last_became_peered":"2024-05-08T05:25:30.008806+0000","last_unstale":"2024-05-08T05:26:24.116079+0000","last_undegraded":"2024-05-08T05:26:24.116079+0000","last_fullsized":"2024-05-08T05:26:24.116079+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:28.970901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:28.970901+0000","last_clean_scrub_stamp":"2024-05-08T05:25:28.970901+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T11:19:45.905803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"82'7","reported_seq":28,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:27:22.902064+0000","last_change":"2024-05-08T05:25:34.065415+0000","last_active":"2024-05-08T05:27:22.902064+0000","last_peered":"2024-05-08T05:27:22.902064+0000","last_clean":"2024-05-08T05:27:22.902064+0000","last_became_active":"2024-05-08T05:25:34.065017+0000","last_became_peered":"2024-05-08T05:25:34.065017+0000","last_unstale":"2024-05-08T05:27:22.902064+0000","last_undegraded":"2024-05-08T05:27:22.902064+0000","last_fullsized":"2024-05-08T05:27:22.902064+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_clean_scrub_stamp":"2024-05-08T05:25:33.008741+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T14:46:34.518792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.0","version":"82'8","reported_seq":35,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:27:22.887996+0000","last_change":"2024-05-08T05:26:24.120480+0000","last_active":"2024-05-08T05:27:22.887996+0000","last_peered":"2024-05-08T05:27:22.887996+0000","last_clean":"2024-05-08T05:27:22.887996+0000","last_became_active":"2024-05-08T05:26:24.120031+0000","last_became_peered":"2024-05-08T05:26:24.120031+0000","last_unstale":"2024-05-08T05:27:22.887996+0000","last_undegraded":"2024-05-08T05:27:22.887996+0000","last_fullsized":"2024-05-08T05:27:22.887996+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_clean_scrub_stamp":"2024-05-08T05:25:33.008741+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T09:24:18.149796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,8],"acting":[5,2,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"82'6","reported_seq":239,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:29:20.413787+0000","last_change":"2024-05-08T05:25:30.356178+0000","last_active":"2024-05-08T05:29:20.413787+0000","last_peered":"2024-05-08T05:29:20.413787+0000","last_clean":"2024-05-08T05:29:20.413787+0000","last_became_active":"2024-05-08T05:25:30.355750+0000","last_became_peered":"2024-05-08T05:25:30.355750+0000","last_unstale":"2024-05-08T05:29:20.413787+0000","last_undegraded":"2024-05-08T05:29:20.413787+0000","last_fullsized":"2024-05-08T05:29:20.413787+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:28.970901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:28.970901+0000","last_clean_scrub_stamp":"2024-05-08T05:25:28.970901+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T05:57:35.174274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":206,"num_read_kb":206,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"82'8","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:27:22.906527+0000","last_change":"2024-05-08T05:25:34.068189+0000","last_active":"2024-05-08T05:27:22.906527+0000","last_peered":"2024-05-08T05:27:22.906527+0000","last_clean":"2024-05-08T05:27:22.906527+0000","last_became_active":"2024-05-08T05:25:34.064398+0000","last_became_peered":"2024-05-08T05:25:34.064398+0000","last_unstale":"2024-05-08T05:27:22.906527+0000","last_undegraded":"2024-05-08T05:27:22.906527+0000","last_fullsized":"2024-05-08T05:27:22.906527+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_clean_scrub_stamp":"2024-05-08T05:25:33.008741+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T10:27:31.050126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"80'3","reported_seq":32,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:26:24.126812+0000","last_change":"2024-05-08T05:25:30.005110+0000","last_active":"2024-05-08T05:26:24.126812+0000","last_peered":"2024-05-08T05:26:24.126812+0000","last_clean":"2024-05-08T05:26:24.126812+0000","last_became_active":"2024-05-08T05:25:30.004703+0000","last_became_peered":"2024-05-08T05:25:30.004703+0000","last_unstale":"2024-05-08T05:26:24.126812+0000","last_undegraded":"2024-05-08T05:26:24.126812+0000","last_fullsized":"2024-05-08T05:26:24.126812+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:28.970901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:28.970901+0000","last_clean_scrub_stamp":"2024-05-08T05:25:28.970901+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T12:49:21.174417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"21'92","reported_seq":102,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:26:38.132162+0000","last_change":"2024-05-08T05:23:59.731023+0000","last_active":"2024-05-08T05:26:38.132162+0000","last_peered":"2024-05-08T05:26:38.132162+0000","last_clean":"2024-05-08T05:26:38.132162+0000","last_became_active":"2024-05-08T05:23:59.725321+0000","last_became_peered":"2024-05-08T05:23:59.725321+0000","last_unstale":"2024-05-08T05:26:38.132162+0000","last_undegraded":"2024-05-08T05:26:38.132162+0000","last_fullsized":"2024-05-08T05:26:38.132162+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:20:09.357011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:20:09.357011+0000","last_clean_scrub_stamp":"2024-05-08T05:20:09.357011+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T09:50:58.729815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"82'5","reported_seq":32,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:27:22.899430+0000","last_change":"2024-05-08T05:26:24.131360+0000","last_active":"2024-05-08T05:27:22.899430+0000","last_peered":"2024-05-08T05:27:22.899430+0000","last_clean":"2024-05-08T05:27:22.899430+0000","last_became_active":"2024-05-08T05:26:24.130480+0000","last_became_peered":"2024-05-08T05:26:24.130480+0000","last_unstale":"2024-05-08T05:27:22.899430+0000","last_undegraded":"2024-05-08T05:27:22.899430+0000","last_fullsized":"2024-05-08T05:27:22.899430+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_clean_scrub_stamp":"2024-05-08T05:25:33.008741+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T09:26:32.515332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,9,2],"acting":[6,9,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"80'3","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:26:24.115792+0000","last_change":"2024-05-08T05:25:29.999659+0000","last_active":"2024-05-08T05:26:24.115792+0000","last_peered":"2024-05-08T05:26:24.115792+0000","last_clean":"2024-05-08T05:26:24.115792+0000","last_became_active":"2024-05-08T05:25:29.999299+0000","last_became_peered":"2024-05-08T05:25:29.999299+0000","last_unstale":"2024-05-08T05:26:24.115792+0000","last_undegraded":"2024-05-08T05:26:24.115792+0000","last_fullsized":"2024-05-08T05:26:24.115792+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:28.970901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:28.970901+0000","last_clean_scrub_stamp":"2024-05-08T05:25:28.970901+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T11:20:16.513402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"80'1","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:26:24.116094+0000","last_change":"2024-05-08T05:25:30.360940+0000","last_active":"2024-05-08T05:26:24.116094+0000","last_peered":"2024-05-08T05:26:24.116094+0000","last_clean":"2024-05-08T05:26:24.116094+0000","last_became_active":"2024-05-08T05:25:30.360507+0000","last_became_peered":"2024-05-08T05:25:30.360507+0000","last_unstale":"2024-05-08T05:26:24.116094+0000","last_undegraded":"2024-05-08T05:26:24.116094+0000","last_fullsized":"2024-05-08T05:26:24.116094+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:28.970901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:28.970901+0000","last_clean_scrub_stamp":"2024-05-08T05:25:28.970901+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T06:49:39.271211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"82'9","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:27:22.902224+0000","last_change":"2024-05-08T05:25:34.056952+0000","last_active":"2024-05-08T05:27:22.902224+0000","last_peered":"2024-05-08T05:27:22.902224+0000","last_clean":"2024-05-08T05:27:22.902224+0000","last_became_active":"2024-05-08T05:25:34.056495+0000","last_became_peered":"2024-05-08T05:25:34.056495+0000","last_unstale":"2024-05-08T05:27:22.902224+0000","last_undegraded":"2024-05-08T05:27:22.902224+0000","last_fullsized":"2024-05-08T05:27:22.902224+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_clean_scrub_stamp":"2024-05-08T05:25:33.008741+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T09:35:22.540178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"82'13","reported_seq":40,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:27:41.531532+0000","last_change":"2024-05-08T05:25:30.008967+0000","last_active":"2024-05-08T05:27:41.531532+0000","last_peered":"2024-05-08T05:27:41.531532+0000","last_clean":"2024-05-08T05:27:41.531532+0000","last_became_active":"2024-05-08T05:25:30.007542+0000","last_became_peered":"2024-05-08T05:25:30.007542+0000","last_unstale":"2024-05-08T05:27:41.531532+0000","last_undegraded":"2024-05-08T05:27:41.531532+0000","last_fullsized":"2024-05-08T05:27:41.531532+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:28.970901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:28.970901+0000","last_clean_scrub_stamp":"2024-05-08T05:25:28.970901+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T05:29:30.191842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"82'5","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:27:22.902209+0000","last_change":"2024-05-08T05:25:34.054334+0000","last_active":"2024-05-08T05:27:22.902209+0000","last_peered":"2024-05-08T05:27:22.902209+0000","last_clean":"2024-05-08T05:27:22.902209+0000","last_became_active":"2024-05-08T05:25:34.053989+0000","last_became_peered":"2024-05-08T05:25:34.053989+0000","last_unstale":"2024-05-08T05:27:22.902209+0000","last_undegraded":"2024-05-08T05:27:22.902209+0000","last_fullsized":"2024-05-08T05:27:22.902209+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_clean_scrub_stamp":"2024-05-08T05:25:33.008741+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T09:03:25.683445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"80'4","reported_seq":31,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:26:24.127039+0000","last_change":"2024-05-08T05:25:30.007144+0000","last_active":"2024-05-08T05:26:24.127039+0000","last_peered":"2024-05-08T05:26:24.127039+0000","last_clean":"2024-05-08T05:26:24.127039+0000","last_became_active":"2024-05-08T05:25:30.006878+0000","last_became_peered":"2024-05-08T05:25:30.006878+0000","last_unstale":"2024-05-08T05:26:24.127039+0000","last_undegraded":"2024-05-08T05:26:24.127039+0000","last_fullsized":"2024-05-08T05:26:24.127039+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:28.970901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:28.970901+0000","last_clean_scrub_stamp":"2024-05-08T05:25:28.970901+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T07:06:35.573001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"82'7","reported_seq":28,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:27:22.914063+0000","last_change":"2024-05-08T05:25:34.073744+0000","last_active":"2024-05-08T05:27:22.914063+0000","last_peered":"2024-05-08T05:27:22.914063+0000","last_clean":"2024-05-08T05:27:22.914063+0000","last_became_active":"2024-05-08T05:25:34.073368+0000","last_became_peered":"2024-05-08T05:25:34.073368+0000","last_unstale":"2024-05-08T05:27:22.914063+0000","last_undegraded":"2024-05-08T05:27:22.914063+0000","last_fullsized":"2024-05-08T05:27:22.914063+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_clean_scrub_stamp":"2024-05-08T05:25:33.008741+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T10:43:31.480745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"80'2","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:26:24.112998+0000","last_change":"2024-05-08T05:25:30.356584+0000","last_active":"2024-05-08T05:26:24.112998+0000","last_peered":"2024-05-08T05:26:24.112998+0000","last_clean":"2024-05-08T05:26:24.112998+0000","last_became_active":"2024-05-08T05:25:30.356203+0000","last_became_peered":"2024-05-08T05:25:30.356203+0000","last_unstale":"2024-05-08T05:26:24.112998+0000","last_undegraded":"2024-05-08T05:26:24.112998+0000","last_fullsized":"2024-05-08T05:26:24.112998+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:28.970901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:28.970901+0000","last_clean_scrub_stamp":"2024-05-08T05:25:28.970901+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T14:35:21.193856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"82'2","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:27:22.887903+0000","last_change":"2024-05-08T05:25:34.053168+0000","last_active":"2024-05-08T05:27:22.887903+0000","last_peered":"2024-05-08T05:27:22.887903+0000","last_clean":"2024-05-08T05:27:22.887903+0000","last_became_active":"2024-05-08T05:25:34.052875+0000","last_became_peered":"2024-05-08T05:25:34.052875+0000","last_unstale":"2024-05-08T05:27:22.887903+0000","last_undegraded":"2024-05-08T05:27:22.887903+0000","last_fullsized":"2024-05-08T05:27:22.887903+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_clean_scrub_stamp":"2024-05-08T05:25:33.008741+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T07:38:40.129212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"80'3","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:26:24.121861+0000","last_change":"2024-05-08T05:25:30.009113+0000","last_active":"2024-05-08T05:26:24.121861+0000","last_peered":"2024-05-08T05:26:24.121861+0000","last_clean":"2024-05-08T05:26:24.121861+0000","last_became_active":"2024-05-08T05:25:30.007605+0000","last_became_peered":"2024-05-08T05:25:30.007605+0000","last_unstale":"2024-05-08T05:26:24.121861+0000","last_undegraded":"2024-05-08T05:26:24.121861+0000","last_fullsized":"2024-05-08T05:26:24.121861+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:28.970901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:28.970901+0000","last_clean_scrub_stamp":"2024-05-08T05:25:28.970901+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T10:06:05.177516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"82'9","reported_seq":28,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:27:22.911359+0000","last_change":"2024-05-08T05:25:34.072765+0000","last_active":"2024-05-08T05:27:22.911359+0000","last_peered":"2024-05-08T05:27:22.911359+0000","last_clean":"2024-05-08T05:27:22.911359+0000","last_became_active":"2024-05-08T05:25:34.072381+0000","last_became_peered":"2024-05-08T05:25:34.072381+0000","last_unstale":"2024-05-08T05:27:22.911359+0000","last_undegraded":"2024-05-08T05:27:22.911359+0000","last_fullsized":"2024-05-08T05:27:22.911359+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_clean_scrub_stamp":"2024-05-08T05:25:33.008741+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T11:55:21.046126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"80'1","reported_seq":16,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:26:27.357620+0000","last_change":"2024-05-08T05:26:24.124762+0000","last_active":"2024-05-08T05:26:27.357620+0000","last_peered":"2024-05-08T05:26:27.357620+0000","last_clean":"2024-05-08T05:26:27.357620+0000","last_became_active":"2024-05-08T05:26:24.121235+0000","last_became_peered":"2024-05-08T05:26:24.121235+0000","last_unstale":"2024-05-08T05:26:27.357620+0000","last_undegraded":"2024-05-08T05:26:27.357620+0000","last_fullsized":"2024-05-08T05:26:27.357620+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:28.970901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:28.970901+0000","last_clean_scrub_stamp":"2024-05-08T05:25:28.970901+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T16:08:17.650335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,3,8],"acting":[11,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.b","version":"82'8","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:27:22.914232+0000","last_change":"2024-05-08T05:25:34.071097+0000","last_active":"2024-05-08T05:27:22.914232+0000","last_peered":"2024-05-08T05:27:22.914232+0000","last_clean":"2024-05-08T05:27:22.914232+0000","last_became_active":"2024-05-08T05:25:34.070635+0000","last_became_peered":"2024-05-08T05:25:34.070635+0000","last_unstale":"2024-05-08T05:27:22.914232+0000","last_undegraded":"2024-05-08T05:27:22.914232+0000","last_fullsized":"2024-05-08T05:27:22.914232+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_clean_scrub_stamp":"2024-05-08T05:25:33.008741+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T13:33:17.217958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"80'4","reported_seq":32,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:26:24.116727+0000","last_change":"2024-05-08T05:25:30.002043+0000","last_active":"2024-05-08T05:26:24.116727+0000","last_peered":"2024-05-08T05:26:24.116727+0000","last_clean":"2024-05-08T05:26:24.116727+0000","last_became_active":"2024-05-08T05:25:30.001624+0000","last_became_peered":"2024-05-08T05:25:30.001624+0000","last_unstale":"2024-05-08T05:26:24.116727+0000","last_undegraded":"2024-05-08T05:26:24.116727+0000","last_fullsized":"2024-05-08T05:26:24.116727+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:28.970901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:28.970901+0000","last_clean_scrub_stamp":"2024-05-08T05:25:28.970901+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T07:20:34.740005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"82'5","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:27:22.910044+0000","last_change":"2024-05-08T05:25:34.057883+0000","last_active":"2024-05-08T05:27:22.910044+0000","last_peered":"2024-05-08T05:27:22.910044+0000","last_clean":"2024-05-08T05:27:22.910044+0000","last_became_active":"2024-05-08T05:25:34.056651+0000","last_became_peered":"2024-05-08T05:25:34.056651+0000","last_unstale":"2024-05-08T05:27:22.910044+0000","last_undegraded":"2024-05-08T05:27:22.910044+0000","last_fullsized":"2024-05-08T05:27:22.910044+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_clean_scrub_stamp":"2024-05-08T05:25:33.008741+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T16:52:46.598847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"80'3","reported_seq":31,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:26:24.116077+0000","last_change":"2024-05-08T05:25:30.356166+0000","last_active":"2024-05-08T05:26:24.116077+0000","last_peered":"2024-05-08T05:26:24.116077+0000","last_clean":"2024-05-08T05:26:24.116077+0000","last_became_active":"2024-05-08T05:25:30.355730+0000","last_became_peered":"2024-05-08T05:25:30.355730+0000","last_unstale":"2024-05-08T05:26:24.116077+0000","last_undegraded":"2024-05-08T05:26:24.116077+0000","last_fullsized":"2024-05-08T05:26:24.116077+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:28.970901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:28.970901+0000","last_clean_scrub_stamp":"2024-05-08T05:25:28.970901+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T05:47:47.743725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"82'7","reported_seq":28,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:27:22.905417+0000","last_change":"2024-05-08T05:25:34.058005+0000","last_active":"2024-05-08T05:27:22.905417+0000","last_peered":"2024-05-08T05:27:22.905417+0000","last_clean":"2024-05-08T05:27:22.905417+0000","last_became_active":"2024-05-08T05:25:34.056319+0000","last_became_peered":"2024-05-08T05:25:34.056319+0000","last_unstale":"2024-05-08T05:27:22.905417+0000","last_undegraded":"2024-05-08T05:27:22.905417+0000","last_fullsized":"2024-05-08T05:27:22.905417+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_clean_scrub_stamp":"2024-05-08T05:25:33.008741+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T07:04:22.726450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"80'1","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:26:24.118635+0000","last_change":"2024-05-08T05:25:30.009641+0000","last_active":"2024-05-08T05:26:24.118635+0000","last_peered":"2024-05-08T05:26:24.118635+0000","last_clean":"2024-05-08T05:26:24.118635+0000","last_became_active":"2024-05-08T05:25:30.009244+0000","last_became_peered":"2024-05-08T05:25:30.009244+0000","last_unstale":"2024-05-08T05:26:24.118635+0000","last_undegraded":"2024-05-08T05:26:24.118635+0000","last_fullsized":"2024-05-08T05:26:24.118635+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:28.970901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:28.970901+0000","last_clean_scrub_stamp":"2024-05-08T05:25:28.970901+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T17:15:50.982103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"82'7","reported_seq":28,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:27:22.909297+0000","last_change":"2024-05-08T05:25:34.059603+0000","last_active":"2024-05-08T05:27:22.909297+0000","last_peered":"2024-05-08T05:27:22.909297+0000","last_clean":"2024-05-08T05:27:22.909297+0000","last_became_active":"2024-05-08T05:25:34.059260+0000","last_became_peered":"2024-05-08T05:25:34.059260+0000","last_unstale":"2024-05-08T05:27:22.909297+0000","last_undegraded":"2024-05-08T05:27:22.909297+0000","last_fullsized":"2024-05-08T05:27:22.909297+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_clean_scrub_stamp":"2024-05-08T05:25:33.008741+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T07:47:32.723829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"80'2","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:26:24.117157+0000","last_change":"2024-05-08T05:25:30.013326+0000","last_active":"2024-05-08T05:26:24.117157+0000","last_peered":"2024-05-08T05:26:24.117157+0000","last_clean":"2024-05-08T05:26:24.117157+0000","last_became_active":"2024-05-08T05:25:30.012868+0000","last_became_peered":"2024-05-08T05:25:30.012868+0000","last_unstale":"2024-05-08T05:26:24.117157+0000","last_undegraded":"2024-05-08T05:26:24.117157+0000","last_fullsized":"2024-05-08T05:26:24.117157+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:28.970901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:28.970901+0000","last_clean_scrub_stamp":"2024-05-08T05:25:28.970901+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T14:09:14.210180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"82'9","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:27:22.891022+0000","last_change":"2024-05-08T05:25:34.052621+0000","last_active":"2024-05-08T05:27:22.891022+0000","last_peered":"2024-05-08T05:27:22.891022+0000","last_clean":"2024-05-08T05:27:22.891022+0000","last_became_active":"2024-05-08T05:25:34.052289+0000","last_became_peered":"2024-05-08T05:25:34.052289+0000","last_unstale":"2024-05-08T05:27:22.891022+0000","last_undegraded":"2024-05-08T05:27:22.891022+0000","last_fullsized":"2024-05-08T05:27:22.891022+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_clean_scrub_stamp":"2024-05-08T05:25:33.008741+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T16:37:19.327915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"82'9","reported_seq":28,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:27:22.890913+0000","last_change":"2024-05-08T05:25:34.057918+0000","last_active":"2024-05-08T05:27:22.890913+0000","last_peered":"2024-05-08T05:27:22.890913+0000","last_clean":"2024-05-08T05:27:22.890913+0000","last_became_active":"2024-05-08T05:25:34.057455+0000","last_became_peered":"2024-05-08T05:25:34.057455+0000","last_unstale":"2024-05-08T05:27:22.890913+0000","last_undegraded":"2024-05-08T05:27:22.890913+0000","last_fullsized":"2024-05-08T05:27:22.890913+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_clean_scrub_stamp":"2024-05-08T05:25:33.008741+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T11:36:49.027414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"82'12","reported_seq":33,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:27:22.903184+0000","last_change":"2024-05-08T05:25:34.055114+0000","last_active":"2024-05-08T05:27:22.903184+0000","last_peered":"2024-05-08T05:27:22.903184+0000","last_clean":"2024-05-08T05:27:22.903184+0000","last_became_active":"2024-05-08T05:25:34.054448+0000","last_became_peered":"2024-05-08T05:25:34.054448+0000","last_unstale":"2024-05-08T05:27:22.903184+0000","last_undegraded":"2024-05-08T05:27:22.903184+0000","last_fullsized":"2024-05-08T05:27:22.903184+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_clean_scrub_stamp":"2024-05-08T05:25:33.008741+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T15:19:54.872779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"82'8","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:27:22.915661+0000","last_change":"2024-05-08T05:25:34.064199+0000","last_active":"2024-05-08T05:27:22.915661+0000","last_peered":"2024-05-08T05:27:22.915661+0000","last_clean":"2024-05-08T05:27:22.915661+0000","last_became_active":"2024-05-08T05:25:34.063888+0000","last_became_peered":"2024-05-08T05:25:34.063888+0000","last_unstale":"2024-05-08T05:27:22.915661+0000","last_undegraded":"2024-05-08T05:27:22.915661+0000","last_fullsized":"2024-05-08T05:27:22.915661+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_clean_scrub_stamp":"2024-05-08T05:25:33.008741+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T13:18:15.146769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"82'7","reported_seq":28,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:27:22.918372+0000","last_change":"2024-05-08T05:25:34.070526+0000","last_active":"2024-05-08T05:27:22.918372+0000","last_peered":"2024-05-08T05:27:22.918372+0000","last_clean":"2024-05-08T05:27:22.918372+0000","last_became_active":"2024-05-08T05:25:34.069890+0000","last_became_peered":"2024-05-08T05:25:34.069890+0000","last_unstale":"2024-05-08T05:27:22.918372+0000","last_undegraded":"2024-05-08T05:27:22.918372+0000","last_fullsized":"2024-05-08T05:27:22.918372+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_clean_scrub_stamp":"2024-05-08T05:25:33.008741+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T16:17:56.986221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"82'4","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:27:22.916202+0000","last_change":"2024-05-08T05:25:34.067033+0000","last_active":"2024-05-08T05:27:22.916202+0000","last_peered":"2024-05-08T05:27:22.916202+0000","last_clean":"2024-05-08T05:27:22.916202+0000","last_became_active":"2024-05-08T05:25:34.066492+0000","last_became_peered":"2024-05-08T05:25:34.066492+0000","last_unstale":"2024-05-08T05:27:22.916202+0000","last_undegraded":"2024-05-08T05:27:22.916202+0000","last_fullsized":"2024-05-08T05:27:22.916202+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_clean_scrub_stamp":"2024-05-08T05:25:33.008741+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T07:30:10.450504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"82'6","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:27:22.888388+0000","last_change":"2024-05-08T05:25:34.056525+0000","last_active":"2024-05-08T05:27:22.888388+0000","last_peered":"2024-05-08T05:27:22.888388+0000","last_clean":"2024-05-08T05:27:22.888388+0000","last_became_active":"2024-05-08T05:25:34.056190+0000","last_became_peered":"2024-05-08T05:25:34.056190+0000","last_unstale":"2024-05-08T05:27:22.888388+0000","last_undegraded":"2024-05-08T05:27:22.888388+0000","last_fullsized":"2024-05-08T05:27:22.888388+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_clean_scrub_stamp":"2024-05-08T05:25:33.008741+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T13:13:57.716642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"82'15","reported_seq":36,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:27:22.905265+0000","last_change":"2024-05-08T05:25:34.055643+0000","last_active":"2024-05-08T05:27:22.905265+0000","last_peered":"2024-05-08T05:27:22.905265+0000","last_clean":"2024-05-08T05:27:22.905265+0000","last_became_active":"2024-05-08T05:25:34.054886+0000","last_became_peered":"2024-05-08T05:25:34.054886+0000","last_unstale":"2024-05-08T05:27:22.905265+0000","last_undegraded":"2024-05-08T05:27:22.905265+0000","last_fullsized":"2024-05-08T05:27:22.905265+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_clean_scrub_stamp":"2024-05-08T05:25:33.008741+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T05:53:41.130484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"82'2","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:27:22.908627+0000","last_change":"2024-05-08T05:25:34.056932+0000","last_active":"2024-05-08T05:27:22.908627+0000","last_peered":"2024-05-08T05:27:22.908627+0000","last_clean":"2024-05-08T05:27:22.908627+0000","last_became_active":"2024-05-08T05:25:34.055473+0000","last_became_peered":"2024-05-08T05:25:34.055473+0000","last_unstale":"2024-05-08T05:27:22.908627+0000","last_undegraded":"2024-05-08T05:27:22.908627+0000","last_fullsized":"2024-05-08T05:27:22.908627+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_clean_scrub_stamp":"2024-05-08T05:25:33.008741+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T16:16:13.748056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"82'6","reported_seq":18,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:27:22.912006+0000","last_change":"2024-05-08T05:26:24.134794+0000","last_active":"2024-05-08T05:27:22.912006+0000","last_peered":"2024-05-08T05:27:22.912006+0000","last_clean":"2024-05-08T05:27:22.912006+0000","last_became_active":"2024-05-08T05:26:24.133586+0000","last_became_peered":"2024-05-08T05:26:24.133586+0000","last_unstale":"2024-05-08T05:27:22.912006+0000","last_undegraded":"2024-05-08T05:27:22.912006+0000","last_fullsized":"2024-05-08T05:27:22.912006+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_clean_scrub_stamp":"2024-05-08T05:25:33.008741+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T15:03:05.432689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,9,3],"acting":[6,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.29","version":"82'8","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:27:22.907706+0000","last_change":"2024-05-08T05:25:34.065000+0000","last_active":"2024-05-08T05:27:22.907706+0000","last_peered":"2024-05-08T05:27:22.907706+0000","last_clean":"2024-05-08T05:27:22.907706+0000","last_became_active":"2024-05-08T05:25:34.057748+0000","last_became_peered":"2024-05-08T05:25:34.057748+0000","last_unstale":"2024-05-08T05:27:22.907706+0000","last_undegraded":"2024-05-08T05:27:22.907706+0000","last_fullsized":"2024-05-08T05:27:22.907706+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_clean_scrub_stamp":"2024-05-08T05:25:33.008741+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T15:33:41.411507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"82'10","reported_seq":31,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:27:22.910969+0000","last_change":"2024-05-08T05:25:34.066601+0000","last_active":"2024-05-08T05:27:22.910969+0000","last_peered":"2024-05-08T05:27:22.910969+0000","last_clean":"2024-05-08T05:27:22.910969+0000","last_became_active":"2024-05-08T05:25:34.066226+0000","last_became_peered":"2024-05-08T05:25:34.066226+0000","last_unstale":"2024-05-08T05:27:22.910969+0000","last_undegraded":"2024-05-08T05:27:22.910969+0000","last_fullsized":"2024-05-08T05:27:22.910969+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_clean_scrub_stamp":"2024-05-08T05:25:33.008741+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T15:27:54.180580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"82'11","reported_seq":32,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:27:22.919075+0000","last_change":"2024-05-08T05:25:34.073520+0000","last_active":"2024-05-08T05:27:22.919075+0000","last_peered":"2024-05-08T05:27:22.919075+0000","last_clean":"2024-05-08T05:27:22.919075+0000","last_became_active":"2024-05-08T05:25:34.072250+0000","last_became_peered":"2024-05-08T05:25:34.072250+0000","last_unstale":"2024-05-08T05:27:22.919075+0000","last_undegraded":"2024-05-08T05:27:22.919075+0000","last_fullsized":"2024-05-08T05:27:22.919075+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_clean_scrub_stamp":"2024-05-08T05:25:33.008741+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T08:17:36.181338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"82'8","reported_seq":33,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:27:22.898326+0000","last_change":"2024-05-08T05:26:24.134964+0000","last_active":"2024-05-08T05:27:22.898326+0000","last_peered":"2024-05-08T05:27:22.898326+0000","last_clean":"2024-05-08T05:27:22.898326+0000","last_became_active":"2024-05-08T05:26:24.134583+0000","last_became_peered":"2024-05-08T05:26:24.134583+0000","last_unstale":"2024-05-08T05:27:22.898326+0000","last_undegraded":"2024-05-08T05:27:22.898326+0000","last_fullsized":"2024-05-08T05:27:22.898326+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_clean_scrub_stamp":"2024-05-08T05:25:33.008741+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T16:09:52.525461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,8],"acting":[11,9,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":502,"ondisk_log_size":502,"up":192,"acting":192,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":3563520,"data_stored":3542208,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":92,"ondisk_log_size":92,"up":3,"acting":3,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":75126,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":1261,"num_read_kb":711,"num_write":182,"num_write_kb":133,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":10,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":442368,"data_stored":225378,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":96,"acting":96,"num_store_stats":12}],"osd_stats":[{"osd":11,"up_from":72,"seq":309237645374,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27884,"kb_used_data":868,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717268,"statfs":{"total":95995035648,"available":95966482432,"internally_reserved":0,"allocated":888832,"data_stored":437056,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":66,"seq":283467841604,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36888,"kb_used_data":1552,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708264,"statfs":{"total":95995035648,"available":95957262336,"internally_reserved":0,"allocated":1589248,"data_stored":1094148,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":36174272},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":60,"seq":257698037833,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32060,"kb_used_data":884,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713092,"statfs":{"total":95995035648,"available":95962206208,"internally_reserved":0,"allocated":905216,"data_stored":437292,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":31914432},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":54,"seq":231928234063,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27900,"kb_used_data":884,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717252,"statfs":{"total":95995035648,"available":95966466048,"internally_reserved":0,"allocated":905216,"data_stored":437212,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":48,"seq":206158430293,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36800,"kb_used_data":1464,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708352,"statfs":{"total":95995035648,"available":95957352448,"internally_reserved":0,"allocated":1499136,"data_stored":1030125,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":36174282},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":42,"seq":180388626523,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36208,"kb_used_data":872,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708944,"statfs":{"total":95995035648,"available":95957958656,"internally_reserved":0,"allocated":892928,"data_stored":436681,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574967,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27956,"kb_used_data":940,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717196,"statfs":{"total":95995035648,"available":95966408704,"internally_reserved":0,"allocated":962560,"data_stored":506616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738491,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36228,"kb_used_data":892,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708924,"statfs":{"total":95995035648,"available":95957938176,"internally_reserved":0,"allocated":913408,"data_stored":437952,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411441,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27980,"kb_used_data":964,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717172,"statfs":{"total":95995035648,"available":95966384128,"internally_reserved":0,"allocated":987136,"data_stored":508498,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":25,"seq":107374182507,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27904,"kb_used_data":888,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717248,"statfs":{"total":95995035648,"available":95966461952,"internally_reserved":0,"allocated":909312,"data_stored":436992,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":31,"seq":133143986278,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36212,"kb_used_data":876,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708940,"statfs":{"total":95995035648,"available":95957954560,"internally_reserved":0,"allocated":897024,"data_stored":437960,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":36,"seq":154618822753,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28492,"kb_used_data":1476,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716660,"statfs":{"total":95995035648,"available":95965859840,"internally_reserved":0,"allocated":1511424,"data_stored":1028967,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":77824,"data_stored":70142,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":72024,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1486,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":2008,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":3166,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":110592,"data_stored":72562,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-08T05:29:23.661 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-08T05:29:23.912 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:23.912+0000 7f9388400640 1 -- 172.21.15.87:0/1791686846 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9380108710 msgr2=0x7f938010ab60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:29:23.912 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:23.912+0000 7f9388400640 1 --2- 172.21.15.87:0/1791686846 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9380108710 0x7f938010ab60 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f9378009ca0 tx=0x7f937802a8c0 comp rx=0 tx=0).stop 2024-05-08T05:29:23.913 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:23.912+0000 7f9388400640 1 -- 172.21.15.87:0/1791686846 shutdown_connections 2024-05-08T05:29:23.913 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:23.912+0000 7f9388400640 1 --2- 172.21.15.87:0/1791686846 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9380108710 0x7f938010ab60 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:29:23.913 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:23.912+0000 7f9388400640 1 --2- 172.21.15.87:0/1791686846 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f9380105de0 0x7f93801081d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:29:23.913 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:23.912+0000 7f9388400640 1 --2- 172.21.15.87:0/1791686846 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f93801034b0 0x7f93801058a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:29:23.913 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:23.912+0000 7f9388400640 1 -- 172.21.15.87:0/1791686846 >> 172.21.15.87:0/1791686846 conn(0x7f93800fcea0 msgr2=0x7f93800ff2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:29:23.913 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:23.912+0000 7f9388400640 1 -- 172.21.15.87:0/1791686846 shutdown_connections 2024-05-08T05:29:23.913 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:23.912+0000 7f9388400640 1 -- 172.21.15.87:0/1791686846 wait complete. 2024-05-08T05:29:23.914 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:23.913+0000 7f9388400640 1 Processor -- start 2024-05-08T05:29:23.915 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:23.913+0000 7f9388400640 1 -- start start 2024-05-08T05:29:23.915 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:23.913+0000 7f9388400640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f93801034b0 0x7f9380198ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:29:23.915 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:23.913+0000 7f9388400640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f9380105de0 0x7f93801991e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:29:23.915 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:23.914+0000 7f9388400640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9380108710 0x7f93801a0240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:29:23.915 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:23.914+0000 7f9388400640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f938010e5d0 con 0x7f9380108710 2024-05-08T05:29:23.915 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:23.914+0000 7f9388400640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f938010e450 con 0x7f93801034b0 2024-05-08T05:29:23.915 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:23.914+0000 7f9388400640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f938010e750 con 0x7f9380105de0 2024-05-08T05:29:23.915 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:23.914+0000 7f9385000640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f9380105de0 0x7f93801991e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:29:23.915 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:23.914+0000 7f9385a00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f93801034b0 0x7f9380198ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:29:23.915 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:23.914+0000 7f9386400640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9380108710 0x7f93801a0240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:29:23.915 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:23.914+0000 7f9385a00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f93801034b0 0x7f9380198ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.87:52876/0 (socket says 172.21.15.87:52876) 2024-05-08T05:29:23.915 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:23.914+0000 7f9385a00640 1 -- 172.21.15.87:0/4270012815 learned_addr learned my addr 172.21.15.87:0/4270012815 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T05:29:23.915 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:23.914+0000 7f9385000640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f9380105de0 0x7f93801991e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.87:60330/0 (socket says 172.21.15.87:60330) 2024-05-08T05:29:23.916 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:23.914+0000 7f9385000640 1 -- 172.21.15.87:0/4270012815 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f93801034b0 msgr2=0x7f9380198ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:29:23.916 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:23.914+0000 7f9385000640 1 --2- 172.21.15.87:0/4270012815 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f93801034b0 0x7f9380198ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:29:23.916 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:23.914+0000 7f9385000640 1 -- 172.21.15.87:0/4270012815 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9380108710 msgr2=0x7f93801a0240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:29:23.916 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:23.914+0000 7f9385000640 1 --2- 172.21.15.87:0/4270012815 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9380108710 0x7f93801a0240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:29:23.916 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:23.914+0000 7f9385000640 1 -- 172.21.15.87:0/4270012815 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f93801a08e0 con 0x7f9380105de0 2024-05-08T05:29:23.917 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:23.915+0000 7f9385000640 1 --2- 172.21.15.87:0/4270012815 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f9380105de0 0x7f93801991e0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f936c00e9c0 tx=0x7f936c00ee80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:29:23.917 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:23.915+0000 7f937e000640 1 -- 172.21.15.87:0/4270012815 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f936c00ccc0 con 0x7f9380105de0 2024-05-08T05:29:23.917 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:23.915+0000 7f9388400640 1 -- 172.21.15.87:0/4270012815 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f93801a0bd0 con 0x7f9380105de0 2024-05-08T05:29:23.917 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:23.915+0000 7f937e000640 1 -- 172.21.15.87:0/4270012815 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f936c005020 con 0x7f9380105de0 2024-05-08T05:29:23.917 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:23.915+0000 7f937e000640 1 -- 172.21.15.87:0/4270012815 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f936c004a00 con 0x7f9380105de0 2024-05-08T05:29:23.917 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:23.915+0000 7f9388400640 1 -- 172.21.15.87:0/4270012815 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f93801a1120 con 0x7f9380105de0 2024-05-08T05:29:23.917 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:23.916+0000 7f9388400640 1 -- 172.21.15.87:0/4270012815 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f93800fe990 con 0x7f9380105de0 2024-05-08T05:29:23.919 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:23.918+0000 7f937e000640 1 -- 172.21.15.87:0/4270012815 <== mon.1 v2:172.21.15.160:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7f936c0051d0 con 0x7f9380105de0 2024-05-08T05:29:23.920 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:23.920+0000 7f937e000640 1 --2- 172.21.15.87:0/4270012815 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f93680b27f0 0x7f93680b4cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:29:23.920 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:23.920+0000 7f937e000640 1 -- 172.21.15.87:0/4270012815 <== mon.1 v2:172.21.15.160:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8190+0+0 (secure 0 0 0) 0x7f936c0e21c0 con 0x7f9380105de0 2024-05-08T05:29:23.920 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:23.920+0000 7f9385a00640 1 --2- 172.21.15.87:0/4270012815 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f93680b27f0 0x7f93680b4cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:29:23.921 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:23.921+0000 7f9385a00640 1 --2- 172.21.15.87:0/4270012815 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f93680b27f0 0x7f93680b4cb0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f9380199b70 tx=0x7f9374005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:29:23.924 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:23.924+0000 7f937e000640 1 -- 172.21.15.87:0/4270012815 <== mon.1 v2:172.21.15.160:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f936c0a9eb0 con 0x7f9380105de0 2024-05-08T05:29:24.131 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:24.131+0000 7f9388400640 1 -- 172.21.15.87:0/4270012815 --> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f9380062df0 con 0x7f93680b27f0 2024-05-08T05:29:24.141 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:24.140+0000 7f937e000640 1 -- 172.21.15.87:0/4270012815 <== mgr.14152 v2:172.21.15.87:6800/1189186457 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258811 (secure 0 0 0) 0x7f9380062df0 con 0x7f93680b27f0 2024-05-08T05:29:24.144 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-05-08T05:29:24.145 INFO:teuthology.orchestra.run.smithi087.stderr:dumped all 2024-05-08T05:29:24.147 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:24.145+0000 7f9388400640 1 -- 172.21.15.87:0/4270012815 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f93680b27f0 msgr2=0x7f93680b4cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:29:24.147 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:24.145+0000 7f9388400640 1 --2- 172.21.15.87:0/4270012815 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f93680b27f0 0x7f93680b4cb0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f9380199b70 tx=0x7f9374005f90 comp rx=0 tx=0).stop 2024-05-08T05:29:24.147 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:24.145+0000 7f9388400640 1 -- 172.21.15.87:0/4270012815 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f9380105de0 msgr2=0x7f93801991e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:29:24.147 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:24.145+0000 7f9388400640 1 --2- 172.21.15.87:0/4270012815 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f9380105de0 0x7f93801991e0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f936c00e9c0 tx=0x7f936c00ee80 comp rx=0 tx=0).stop 2024-05-08T05:29:24.148 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:24.145+0000 7f9388400640 1 -- 172.21.15.87:0/4270012815 shutdown_connections 2024-05-08T05:29:24.148 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:24.146+0000 7f9388400640 1 --2- 172.21.15.87:0/4270012815 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f93680b27f0 0x7f93680b4cb0 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:29:24.148 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:24.146+0000 7f9388400640 1 --2- 172.21.15.87:0/4270012815 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9380108710 0x7f93801a0240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:29:24.148 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:24.146+0000 7f9388400640 1 --2- 172.21.15.87:0/4270012815 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f9380105de0 0x7f93801991e0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:29:24.148 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:24.146+0000 7f9388400640 1 --2- 172.21.15.87:0/4270012815 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f93801034b0 0x7f9380198ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:29:24.148 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:24.146+0000 7f9388400640 1 -- 172.21.15.87:0/4270012815 >> 172.21.15.87:0/4270012815 conn(0x7f93800fcea0 msgr2=0x7f9380103df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:29:24.148 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:24.146+0000 7f9388400640 1 -- 172.21.15.87:0/4270012815 shutdown_connections 2024-05-08T05:29:24.148 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:24.146+0000 7f9388400640 1 -- 172.21.15.87:0/4270012815 wait complete. 2024-05-08T05:29:24.166 INFO:teuthology.orchestra.run.smithi087.stdout:{"pg_ready":true,"pg_map":{"version":432,"stamp":"2024-05-08T05:29:22.981824+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":665728,"num_objects":64,"num_object_clones":0,"num_object_copies":192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":1337,"num_read_kb":775,"num_write":307,"num_write_kb":2285,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":13,"num_bytes_recovered":2951840,"num_keys_recovered":10,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":750,"ondisk_log_size":750,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":382512,"kb_used_data":12560,"kb_used_omap":18,"kb_used_meta":369837,"kb_avail":1124559312,"statfs":{"total":1151940427776,"available":1151548735488,"internally_reserved":0,"allocated":12861440,"data_stored":7229499,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19143,"internal_metadata":378713401},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":5993,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":73,"num_read_kb":43,"num_write":7,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005065"},"pg_stats":[{"pgid":"3.3f","version":"82'8","reported_seq":27,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:27:22.911792+0000","last_change":"2024-05-08T05:25:34.073030+0000","last_active":"2024-05-08T05:27:22.911792+0000","last_peered":"2024-05-08T05:27:22.911792+0000","last_clean":"2024-05-08T05:27:22.911792+0000","last_became_active":"2024-05-08T05:25:34.072593+0000","last_became_peered":"2024-05-08T05:25:34.072593+0000","last_unstale":"2024-05-08T05:27:22.911792+0000","last_undegraded":"2024-05-08T05:27:22.911792+0000","last_fullsized":"2024-05-08T05:27:22.911792+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_clean_scrub_stamp":"2024-05-08T05:25:33.008741+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T09:46:17.507034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"82'4","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:27:22.908973+0000","last_change":"2024-05-08T05:25:34.071436+0000","last_active":"2024-05-08T05:27:22.908973+0000","last_peered":"2024-05-08T05:27:22.908973+0000","last_clean":"2024-05-08T05:27:22.908973+0000","last_became_active":"2024-05-08T05:25:34.070985+0000","last_became_peered":"2024-05-08T05:25:34.070985+0000","last_unstale":"2024-05-08T05:27:22.908973+0000","last_undegraded":"2024-05-08T05:27:22.908973+0000","last_fullsized":"2024-05-08T05:27:22.908973+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_clean_scrub_stamp":"2024-05-08T05:25:33.008741+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T10:59:01.312978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"82'7","reported_seq":28,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:27:22.916059+0000","last_change":"2024-05-08T05:25:34.057180+0000","last_active":"2024-05-08T05:27:22.916059+0000","last_peered":"2024-05-08T05:27:22.916059+0000","last_clean":"2024-05-08T05:27:22.916059+0000","last_became_active":"2024-05-08T05:25:34.056775+0000","last_became_peered":"2024-05-08T05:25:34.056775+0000","last_unstale":"2024-05-08T05:27:22.916059+0000","last_undegraded":"2024-05-08T05:27:22.916059+0000","last_fullsized":"2024-05-08T05:27:22.916059+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_clean_scrub_stamp":"2024-05-08T05:25:33.008741+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T13:13:34.389793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"82'8","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:27:22.898318+0000","last_change":"2024-05-08T05:25:34.053102+0000","last_active":"2024-05-08T05:27:22.898318+0000","last_peered":"2024-05-08T05:27:22.898318+0000","last_clean":"2024-05-08T05:27:22.898318+0000","last_became_active":"2024-05-08T05:25:34.052736+0000","last_became_peered":"2024-05-08T05:25:34.052736+0000","last_unstale":"2024-05-08T05:27:22.898318+0000","last_undegraded":"2024-05-08T05:27:22.898318+0000","last_fullsized":"2024-05-08T05:27:22.898318+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_clean_scrub_stamp":"2024-05-08T05:25:33.008741+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T13:05:02.665370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"82'4","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:27:22.900518+0000","last_change":"2024-05-08T05:25:34.070073+0000","last_active":"2024-05-08T05:27:22.900518+0000","last_peered":"2024-05-08T05:27:22.900518+0000","last_clean":"2024-05-08T05:27:22.900518+0000","last_became_active":"2024-05-08T05:25:34.069660+0000","last_became_peered":"2024-05-08T05:25:34.069660+0000","last_unstale":"2024-05-08T05:27:22.900518+0000","last_undegraded":"2024-05-08T05:27:22.900518+0000","last_fullsized":"2024-05-08T05:27:22.900518+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_clean_scrub_stamp":"2024-05-08T05:25:33.008741+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T12:37:10.599082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"82'6","reported_seq":27,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:27:22.899161+0000","last_change":"2024-05-08T05:25:34.057928+0000","last_active":"2024-05-08T05:27:22.899161+0000","last_peered":"2024-05-08T05:27:22.899161+0000","last_clean":"2024-05-08T05:27:22.899161+0000","last_became_active":"2024-05-08T05:25:34.057538+0000","last_became_peered":"2024-05-08T05:25:34.057538+0000","last_unstale":"2024-05-08T05:27:22.899161+0000","last_undegraded":"2024-05-08T05:27:22.899161+0000","last_fullsized":"2024-05-08T05:27:22.899161+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_clean_scrub_stamp":"2024-05-08T05:25:33.008741+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T12:22:49.920889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"82'5","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:27:22.900100+0000","last_change":"2024-05-08T05:25:34.055439+0000","last_active":"2024-05-08T05:27:22.900100+0000","last_peered":"2024-05-08T05:27:22.900100+0000","last_clean":"2024-05-08T05:27:22.900100+0000","last_became_active":"2024-05-08T05:25:34.055002+0000","last_became_peered":"2024-05-08T05:25:34.055002+0000","last_unstale":"2024-05-08T05:27:22.900100+0000","last_undegraded":"2024-05-08T05:27:22.900100+0000","last_fullsized":"2024-05-08T05:27:22.900100+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_clean_scrub_stamp":"2024-05-08T05:25:33.008741+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T11:29:00.482681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"82'9","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:27:22.913447+0000","last_change":"2024-05-08T05:25:34.058943+0000","last_active":"2024-05-08T05:27:22.913447+0000","last_peered":"2024-05-08T05:27:22.913447+0000","last_clean":"2024-05-08T05:27:22.913447+0000","last_became_active":"2024-05-08T05:25:34.058200+0000","last_became_peered":"2024-05-08T05:25:34.058200+0000","last_unstale":"2024-05-08T05:27:22.913447+0000","last_undegraded":"2024-05-08T05:27:22.913447+0000","last_fullsized":"2024-05-08T05:27:22.913447+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_clean_scrub_stamp":"2024-05-08T05:25:33.008741+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T11:13:23.019489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"82'11","reported_seq":32,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:27:22.905575+0000","last_change":"2024-05-08T05:25:34.053948+0000","last_active":"2024-05-08T05:27:22.905575+0000","last_peered":"2024-05-08T05:27:22.905575+0000","last_clean":"2024-05-08T05:27:22.905575+0000","last_became_active":"2024-05-08T05:25:34.053601+0000","last_became_peered":"2024-05-08T05:25:34.053601+0000","last_unstale":"2024-05-08T05:27:22.905575+0000","last_undegraded":"2024-05-08T05:27:22.905575+0000","last_fullsized":"2024-05-08T05:27:22.905575+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_clean_scrub_stamp":"2024-05-08T05:25:33.008741+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T05:50:44.228628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"82'16","reported_seq":37,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:27:22.899056+0000","last_change":"2024-05-08T05:25:34.053167+0000","last_active":"2024-05-08T05:27:22.899056+0000","last_peered":"2024-05-08T05:27:22.899056+0000","last_clean":"2024-05-08T05:27:22.899056+0000","last_became_active":"2024-05-08T05:25:34.052425+0000","last_became_peered":"2024-05-08T05:25:34.052425+0000","last_unstale":"2024-05-08T05:27:22.899056+0000","last_undegraded":"2024-05-08T05:27:22.899056+0000","last_fullsized":"2024-05-08T05:27:22.899056+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_clean_scrub_stamp":"2024-05-08T05:25:33.008741+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T10:56:28.599966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"82'6","reported_seq":27,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:27:22.905304+0000","last_change":"2024-05-08T05:25:34.057677+0000","last_active":"2024-05-08T05:27:22.905304+0000","last_peered":"2024-05-08T05:27:22.905304+0000","last_clean":"2024-05-08T05:27:22.905304+0000","last_became_active":"2024-05-08T05:25:34.054800+0000","last_became_peered":"2024-05-08T05:25:34.054800+0000","last_unstale":"2024-05-08T05:27:22.905304+0000","last_undegraded":"2024-05-08T05:27:22.905304+0000","last_fullsized":"2024-05-08T05:27:22.905304+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_clean_scrub_stamp":"2024-05-08T05:25:33.008741+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T07:41:55.836901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"82'7","reported_seq":28,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:27:22.898468+0000","last_change":"2024-05-08T05:25:34.051744+0000","last_active":"2024-05-08T05:27:22.898468+0000","last_peered":"2024-05-08T05:27:22.898468+0000","last_clean":"2024-05-08T05:27:22.898468+0000","last_became_active":"2024-05-08T05:25:34.051395+0000","last_became_peered":"2024-05-08T05:25:34.051395+0000","last_unstale":"2024-05-08T05:27:22.898468+0000","last_undegraded":"2024-05-08T05:27:22.898468+0000","last_fullsized":"2024-05-08T05:27:22.898468+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_clean_scrub_stamp":"2024-05-08T05:25:33.008741+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T07:58:52.674899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"82'10","reported_seq":31,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:27:22.913323+0000","last_change":"2024-05-08T05:25:34.053197+0000","last_active":"2024-05-08T05:27:22.913323+0000","last_peered":"2024-05-08T05:27:22.913323+0000","last_clean":"2024-05-08T05:27:22.913323+0000","last_became_active":"2024-05-08T05:25:34.052331+0000","last_became_peered":"2024-05-08T05:25:34.052331+0000","last_unstale":"2024-05-08T05:27:22.913323+0000","last_undegraded":"2024-05-08T05:27:22.913323+0000","last_fullsized":"2024-05-08T05:27:22.913323+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_clean_scrub_stamp":"2024-05-08T05:25:33.008741+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T07:19:12.524722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"82'7","reported_seq":28,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:27:22.907958+0000","last_change":"2024-05-08T05:25:34.070242+0000","last_active":"2024-05-08T05:27:22.907958+0000","last_peered":"2024-05-08T05:27:22.907958+0000","last_clean":"2024-05-08T05:27:22.907958+0000","last_became_active":"2024-05-08T05:25:34.069580+0000","last_became_peered":"2024-05-08T05:25:34.069580+0000","last_unstale":"2024-05-08T05:27:22.907958+0000","last_undegraded":"2024-05-08T05:27:22.907958+0000","last_fullsized":"2024-05-08T05:27:22.907958+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_clean_scrub_stamp":"2024-05-08T05:25:33.008741+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T06:33:25.099470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"82'7","reported_seq":28,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:27:22.908516+0000","last_change":"2024-05-08T05:25:34.067174+0000","last_active":"2024-05-08T05:27:22.908516+0000","last_peered":"2024-05-08T05:27:22.908516+0000","last_clean":"2024-05-08T05:27:22.908516+0000","last_became_active":"2024-05-08T05:25:34.066811+0000","last_became_peered":"2024-05-08T05:25:34.066811+0000","last_unstale":"2024-05-08T05:27:22.908516+0000","last_undegraded":"2024-05-08T05:27:22.908516+0000","last_fullsized":"2024-05-08T05:27:22.908516+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_clean_scrub_stamp":"2024-05-08T05:25:33.008741+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T16:17:57.731620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"82'9","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:27:22.918765+0000","last_change":"2024-05-08T05:25:34.064339+0000","last_active":"2024-05-08T05:27:22.918765+0000","last_peered":"2024-05-08T05:27:22.918765+0000","last_clean":"2024-05-08T05:27:22.918765+0000","last_became_active":"2024-05-08T05:25:34.063994+0000","last_became_peered":"2024-05-08T05:25:34.063994+0000","last_unstale":"2024-05-08T05:27:22.918765+0000","last_undegraded":"2024-05-08T05:27:22.918765+0000","last_fullsized":"2024-05-08T05:27:22.918765+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_clean_scrub_stamp":"2024-05-08T05:25:33.008741+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T17:09:34.443411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"82'8","reported_seq":27,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:27:22.911757+0000","last_change":"2024-05-08T05:25:34.073029+0000","last_active":"2024-05-08T05:27:22.911757+0000","last_peered":"2024-05-08T05:27:22.911757+0000","last_clean":"2024-05-08T05:27:22.911757+0000","last_became_active":"2024-05-08T05:25:34.072491+0000","last_became_peered":"2024-05-08T05:25:34.072491+0000","last_unstale":"2024-05-08T05:27:22.911757+0000","last_undegraded":"2024-05-08T05:27:22.911757+0000","last_fullsized":"2024-05-08T05:27:22.911757+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_clean_scrub_stamp":"2024-05-08T05:25:33.008741+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T10:22:25.304349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"82'10","reported_seq":31,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:27:22.898481+0000","last_change":"2024-05-08T05:25:34.061439+0000","last_active":"2024-05-08T05:27:22.898481+0000","last_peered":"2024-05-08T05:27:22.898481+0000","last_clean":"2024-05-08T05:27:22.898481+0000","last_became_active":"2024-05-08T05:25:34.058275+0000","last_became_peered":"2024-05-08T05:25:34.058275+0000","last_unstale":"2024-05-08T05:27:22.898481+0000","last_undegraded":"2024-05-08T05:27:22.898481+0000","last_fullsized":"2024-05-08T05:27:22.898481+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_clean_scrub_stamp":"2024-05-08T05:25:33.008741+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T14:04:32.433114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"82'7","reported_seq":28,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:27:22.903102+0000","last_change":"2024-05-08T05:25:34.061463+0000","last_active":"2024-05-08T05:27:22.903102+0000","last_peered":"2024-05-08T05:27:22.903102+0000","last_clean":"2024-05-08T05:27:22.903102+0000","last_became_active":"2024-05-08T05:25:34.060891+0000","last_became_peered":"2024-05-08T05:25:34.060891+0000","last_unstale":"2024-05-08T05:27:22.903102+0000","last_undegraded":"2024-05-08T05:27:22.903102+0000","last_fullsized":"2024-05-08T05:27:22.903102+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_clean_scrub_stamp":"2024-05-08T05:25:33.008741+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T06:42:17.741180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1f","version":"80'9","reported_seq":37,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:26:24.134584+0000","last_change":"2024-05-08T05:25:30.003956+0000","last_active":"2024-05-08T05:26:24.134584+0000","last_peered":"2024-05-08T05:26:24.134584+0000","last_clean":"2024-05-08T05:26:24.134584+0000","last_became_active":"2024-05-08T05:25:30.003229+0000","last_became_peered":"2024-05-08T05:25:30.003229+0000","last_unstale":"2024-05-08T05:26:24.134584+0000","last_undegraded":"2024-05-08T05:26:24.134584+0000","last_fullsized":"2024-05-08T05:26:24.134584+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:28.970901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:28.970901+0000","last_clean_scrub_stamp":"2024-05-08T05:25:28.970901+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T15:45:15.168997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"82'5","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:27:22.894722+0000","last_change":"2024-05-08T05:25:34.064917+0000","last_active":"2024-05-08T05:27:22.894722+0000","last_peered":"2024-05-08T05:27:22.894722+0000","last_clean":"2024-05-08T05:27:22.894722+0000","last_became_active":"2024-05-08T05:25:34.064567+0000","last_became_peered":"2024-05-08T05:25:34.064567+0000","last_unstale":"2024-05-08T05:27:22.894722+0000","last_undegraded":"2024-05-08T05:27:22.894722+0000","last_fullsized":"2024-05-08T05:27:22.894722+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_clean_scrub_stamp":"2024-05-08T05:25:33.008741+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T11:15:53.439313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"80'2","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:26:24.124003+0000","last_change":"2024-05-08T05:25:30.358617+0000","last_active":"2024-05-08T05:26:24.124003+0000","last_peered":"2024-05-08T05:26:24.124003+0000","last_clean":"2024-05-08T05:26:24.124003+0000","last_became_active":"2024-05-08T05:25:30.358084+0000","last_became_peered":"2024-05-08T05:25:30.358084+0000","last_unstale":"2024-05-08T05:26:24.124003+0000","last_undegraded":"2024-05-08T05:26:24.124003+0000","last_fullsized":"2024-05-08T05:26:24.124003+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:28.970901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:28.970901+0000","last_clean_scrub_stamp":"2024-05-08T05:25:28.970901+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T16:30:36.151645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"82'6","reported_seq":27,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:27:22.915154+0000","last_change":"2024-05-08T05:25:34.070189+0000","last_active":"2024-05-08T05:27:22.915154+0000","last_peered":"2024-05-08T05:27:22.915154+0000","last_clean":"2024-05-08T05:27:22.915154+0000","last_became_active":"2024-05-08T05:25:34.067644+0000","last_became_peered":"2024-05-08T05:25:34.067644+0000","last_unstale":"2024-05-08T05:27:22.915154+0000","last_undegraded":"2024-05-08T05:27:22.915154+0000","last_fullsized":"2024-05-08T05:27:22.915154+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_clean_scrub_stamp":"2024-05-08T05:25:33.008741+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T07:50:03.938036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"80'4","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:26:27.357651+0000","last_change":"2024-05-08T05:26:24.133899+0000","last_active":"2024-05-08T05:26:27.357651+0000","last_peered":"2024-05-08T05:26:27.357651+0000","last_clean":"2024-05-08T05:26:27.357651+0000","last_became_active":"2024-05-08T05:26:24.127975+0000","last_became_peered":"2024-05-08T05:26:24.127975+0000","last_unstale":"2024-05-08T05:26:27.357651+0000","last_undegraded":"2024-05-08T05:26:27.357651+0000","last_fullsized":"2024-05-08T05:26:27.357651+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:28.970901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:28.970901+0000","last_clean_scrub_stamp":"2024-05-08T05:25:28.970901+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T09:52:51.912899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":10,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,7],"acting":[11,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1c","version":"82'9","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:27:22.908643+0000","last_change":"2024-05-08T05:25:34.057034+0000","last_active":"2024-05-08T05:27:22.908643+0000","last_peered":"2024-05-08T05:27:22.908643+0000","last_clean":"2024-05-08T05:27:22.908643+0000","last_became_active":"2024-05-08T05:25:34.056718+0000","last_became_peered":"2024-05-08T05:25:34.056718+0000","last_unstale":"2024-05-08T05:27:22.908643+0000","last_undegraded":"2024-05-08T05:27:22.908643+0000","last_fullsized":"2024-05-08T05:27:22.908643+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_clean_scrub_stamp":"2024-05-08T05:25:33.008741+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T15:30:38.786889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1c","version":"80'2","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:26:24.115973+0000","last_change":"2024-05-08T05:25:29.998007+0000","last_active":"2024-05-08T05:26:24.115973+0000","last_peered":"2024-05-08T05:26:24.115973+0000","last_clean":"2024-05-08T05:26:24.115973+0000","last_became_active":"2024-05-08T05:25:29.997565+0000","last_became_peered":"2024-05-08T05:25:29.997565+0000","last_unstale":"2024-05-08T05:26:24.115973+0000","last_undegraded":"2024-05-08T05:26:24.115973+0000","last_fullsized":"2024-05-08T05:26:24.115973+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:28.970901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:28.970901+0000","last_clean_scrub_stamp":"2024-05-08T05:25:28.970901+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T13:40:09.620809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"82'15","reported_seq":36,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:27:22.905074+0000","last_change":"2024-05-08T05:25:34.060136+0000","last_active":"2024-05-08T05:27:22.905074+0000","last_peered":"2024-05-08T05:27:22.905074+0000","last_clean":"2024-05-08T05:27:22.905074+0000","last_became_active":"2024-05-08T05:25:34.059782+0000","last_became_peered":"2024-05-08T05:25:34.059782+0000","last_unstale":"2024-05-08T05:27:22.905074+0000","last_undegraded":"2024-05-08T05:27:22.905074+0000","last_fullsized":"2024-05-08T05:27:22.905074+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_clean_scrub_stamp":"2024-05-08T05:25:33.008741+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T17:07:33.509305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"82'7","reported_seq":245,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:29:21.275937+0000","last_change":"2024-05-08T05:25:30.001356+0000","last_active":"2024-05-08T05:29:21.275937+0000","last_peered":"2024-05-08T05:29:21.275937+0000","last_clean":"2024-05-08T05:29:21.275937+0000","last_became_active":"2024-05-08T05:25:30.000998+0000","last_became_peered":"2024-05-08T05:25:30.000998+0000","last_unstale":"2024-05-08T05:29:21.275937+0000","last_undegraded":"2024-05-08T05:29:21.275937+0000","last_fullsized":"2024-05-08T05:29:21.275937+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:28.970901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:28.970901+0000","last_clean_scrub_stamp":"2024-05-08T05:25:28.970901+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T10:03:27.279982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1154,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":211,"num_read_kb":4,"num_write":4,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"82'7","reported_seq":28,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:27:22.881387+0000","last_change":"2024-05-08T05:25:34.056548+0000","last_active":"2024-05-08T05:27:22.881387+0000","last_peered":"2024-05-08T05:27:22.881387+0000","last_clean":"2024-05-08T05:27:22.881387+0000","last_became_active":"2024-05-08T05:25:34.056216+0000","last_became_peered":"2024-05-08T05:25:34.056216+0000","last_unstale":"2024-05-08T05:27:22.881387+0000","last_undegraded":"2024-05-08T05:27:22.881387+0000","last_fullsized":"2024-05-08T05:27:22.881387+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_clean_scrub_stamp":"2024-05-08T05:25:33.008741+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T14:46:05.056610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1a","version":"80'3","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:26:24.127545+0000","last_change":"2024-05-08T05:25:30.009289+0000","last_active":"2024-05-08T05:26:24.127545+0000","last_peered":"2024-05-08T05:26:24.127545+0000","last_clean":"2024-05-08T05:26:24.127545+0000","last_became_active":"2024-05-08T05:25:30.008856+0000","last_became_peered":"2024-05-08T05:25:30.008856+0000","last_unstale":"2024-05-08T05:26:24.127545+0000","last_undegraded":"2024-05-08T05:26:24.127545+0000","last_fullsized":"2024-05-08T05:26:24.127545+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:28.970901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:28.970901+0000","last_clean_scrub_stamp":"2024-05-08T05:25:28.970901+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T10:49:55.857415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"82'8","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:27:22.902854+0000","last_change":"2024-05-08T05:25:34.062532+0000","last_active":"2024-05-08T05:27:22.902854+0000","last_peered":"2024-05-08T05:27:22.902854+0000","last_clean":"2024-05-08T05:27:22.902854+0000","last_became_active":"2024-05-08T05:25:34.062246+0000","last_became_peered":"2024-05-08T05:25:34.062246+0000","last_unstale":"2024-05-08T05:27:22.902854+0000","last_undegraded":"2024-05-08T05:27:22.902854+0000","last_fullsized":"2024-05-08T05:27:22.902854+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_clean_scrub_stamp":"2024-05-08T05:25:33.008741+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T07:35:49.149411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"80'2","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:26:24.114481+0000","last_change":"2024-05-08T05:25:30.014336+0000","last_active":"2024-05-08T05:26:24.114481+0000","last_peered":"2024-05-08T05:26:24.114481+0000","last_clean":"2024-05-08T05:26:24.114481+0000","last_became_active":"2024-05-08T05:25:30.012147+0000","last_became_peered":"2024-05-08T05:25:30.012147+0000","last_unstale":"2024-05-08T05:26:24.114481+0000","last_undegraded":"2024-05-08T05:26:24.114481+0000","last_fullsized":"2024-05-08T05:26:24.114481+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:28.970901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:28.970901+0000","last_clean_scrub_stamp":"2024-05-08T05:25:28.970901+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T07:48:20.477581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"82'8","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:27:22.913329+0000","last_change":"2024-05-08T05:25:34.058947+0000","last_active":"2024-05-08T05:27:22.913329+0000","last_peered":"2024-05-08T05:27:22.913329+0000","last_clean":"2024-05-08T05:27:22.913329+0000","last_became_active":"2024-05-08T05:25:34.058626+0000","last_became_peered":"2024-05-08T05:25:34.058626+0000","last_unstale":"2024-05-08T05:27:22.913329+0000","last_undegraded":"2024-05-08T05:27:22.913329+0000","last_fullsized":"2024-05-08T05:27:22.913329+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_clean_scrub_stamp":"2024-05-08T05:25:33.008741+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T12:55:07.742707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"80'1","reported_seq":28,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:26:24.118168+0000","last_change":"2024-05-08T05:25:29.999201+0000","last_active":"2024-05-08T05:26:24.118168+0000","last_peered":"2024-05-08T05:26:24.118168+0000","last_clean":"2024-05-08T05:26:24.118168+0000","last_became_active":"2024-05-08T05:25:29.998819+0000","last_became_peered":"2024-05-08T05:25:29.998819+0000","last_unstale":"2024-05-08T05:26:24.118168+0000","last_undegraded":"2024-05-08T05:26:24.118168+0000","last_fullsized":"2024-05-08T05:26:24.118168+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:28.970901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:28.970901+0000","last_clean_scrub_stamp":"2024-05-08T05:25:28.970901+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T09:00:02.831877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"82'11","reported_seq":32,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:27:22.906445+0000","last_change":"2024-05-08T05:25:34.063770+0000","last_active":"2024-05-08T05:27:22.906445+0000","last_peered":"2024-05-08T05:27:22.906445+0000","last_clean":"2024-05-08T05:27:22.906445+0000","last_became_active":"2024-05-08T05:25:34.061591+0000","last_became_peered":"2024-05-08T05:25:34.061591+0000","last_unstale":"2024-05-08T05:27:22.906445+0000","last_undegraded":"2024-05-08T05:27:22.906445+0000","last_fullsized":"2024-05-08T05:27:22.906445+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_clean_scrub_stamp":"2024-05-08T05:25:33.008741+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T16:51:06.593857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"82'4","reported_seq":234,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:29:17.268696+0000","last_change":"2024-05-08T05:25:30.005678+0000","last_active":"2024-05-08T05:29:17.268696+0000","last_peered":"2024-05-08T05:29:17.268696+0000","last_clean":"2024-05-08T05:29:17.268696+0000","last_became_active":"2024-05-08T05:25:30.005218+0000","last_became_peered":"2024-05-08T05:25:30.005218+0000","last_unstale":"2024-05-08T05:29:17.268696+0000","last_undegraded":"2024-05-08T05:29:17.268696+0000","last_fullsized":"2024-05-08T05:29:17.268696+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:28.970901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:28.970901+0000","last_clean_scrub_stamp":"2024-05-08T05:25:28.970901+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T11:44:56.720663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":203,"num_read_kb":203,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"82'10","reported_seq":31,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:27:22.901986+0000","last_change":"2024-05-08T05:25:34.058640+0000","last_active":"2024-05-08T05:27:22.901986+0000","last_peered":"2024-05-08T05:27:22.901986+0000","last_clean":"2024-05-08T05:27:22.901986+0000","last_became_active":"2024-05-08T05:25:34.058332+0000","last_became_peered":"2024-05-08T05:25:34.058332+0000","last_unstale":"2024-05-08T05:27:22.901986+0000","last_undegraded":"2024-05-08T05:27:22.901986+0000","last_fullsized":"2024-05-08T05:27:22.901986+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_clean_scrub_stamp":"2024-05-08T05:25:33.008741+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T09:21:44.273684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"80'2","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:26:24.115870+0000","last_change":"2024-05-08T05:25:30.000229+0000","last_active":"2024-05-08T05:26:24.115870+0000","last_peered":"2024-05-08T05:26:24.115870+0000","last_clean":"2024-05-08T05:26:24.115870+0000","last_became_active":"2024-05-08T05:25:29.999888+0000","last_became_peered":"2024-05-08T05:25:29.999888+0000","last_unstale":"2024-05-08T05:26:24.115870+0000","last_undegraded":"2024-05-08T05:26:24.115870+0000","last_fullsized":"2024-05-08T05:26:24.115870+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:28.970901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:28.970901+0000","last_clean_scrub_stamp":"2024-05-08T05:25:28.970901+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T10:28:02.849791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"82'9","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:27:22.918728+0000","last_change":"2024-05-08T05:25:34.069600+0000","last_active":"2024-05-08T05:27:22.918728+0000","last_peered":"2024-05-08T05:27:22.918728+0000","last_clean":"2024-05-08T05:27:22.918728+0000","last_became_active":"2024-05-08T05:25:34.069055+0000","last_became_peered":"2024-05-08T05:25:34.069055+0000","last_unstale":"2024-05-08T05:27:22.918728+0000","last_undegraded":"2024-05-08T05:27:22.918728+0000","last_fullsized":"2024-05-08T05:27:22.918728+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_clean_scrub_stamp":"2024-05-08T05:25:33.008741+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T10:22:31.166719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"80'4","reported_seq":32,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:26:24.118776+0000","last_change":"2024-05-08T05:25:30.360911+0000","last_active":"2024-05-08T05:26:24.118776+0000","last_peered":"2024-05-08T05:26:24.118776+0000","last_clean":"2024-05-08T05:26:24.118776+0000","last_became_active":"2024-05-08T05:25:30.360544+0000","last_became_peered":"2024-05-08T05:25:30.360544+0000","last_unstale":"2024-05-08T05:26:24.118776+0000","last_undegraded":"2024-05-08T05:26:24.118776+0000","last_fullsized":"2024-05-08T05:26:24.118776+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:28.970901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:28.970901+0000","last_clean_scrub_stamp":"2024-05-08T05:25:28.970901+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T17:03:10.633420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"82'11","reported_seq":32,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:27:22.903262+0000","last_change":"2024-05-08T05:25:34.058259+0000","last_active":"2024-05-08T05:27:22.903262+0000","last_peered":"2024-05-08T05:27:22.903262+0000","last_clean":"2024-05-08T05:27:22.903262+0000","last_became_active":"2024-05-08T05:25:34.057912+0000","last_became_peered":"2024-05-08T05:25:34.057912+0000","last_unstale":"2024-05-08T05:27:22.903262+0000","last_undegraded":"2024-05-08T05:27:22.903262+0000","last_fullsized":"2024-05-08T05:27:22.903262+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_clean_scrub_stamp":"2024-05-08T05:25:33.008741+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T14:58:49.311769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"82'37","reported_seq":483,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:29:18.279757+0000","last_change":"2024-05-08T05:25:30.001177+0000","last_active":"2024-05-08T05:29:18.279757+0000","last_peered":"2024-05-08T05:29:18.279757+0000","last_clean":"2024-05-08T05:29:18.279757+0000","last_became_active":"2024-05-08T05:25:30.000769+0000","last_became_peered":"2024-05-08T05:25:30.000769+0000","last_unstale":"2024-05-08T05:29:18.279757+0000","last_undegraded":"2024-05-08T05:29:18.279757+0000","last_fullsized":"2024-05-08T05:29:18.279757+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:28.970901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:28.970901+0000","last_clean_scrub_stamp":"2024-05-08T05:25:28.970901+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T14:40:35.540270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70142,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":419,"num_read_kb":279,"num_write":38,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"82'6","reported_seq":27,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:27:22.888709+0000","last_change":"2024-05-08T05:25:34.053366+0000","last_active":"2024-05-08T05:27:22.888709+0000","last_peered":"2024-05-08T05:27:22.888709+0000","last_clean":"2024-05-08T05:27:22.888709+0000","last_became_active":"2024-05-08T05:25:34.052485+0000","last_became_peered":"2024-05-08T05:25:34.052485+0000","last_unstale":"2024-05-08T05:27:22.888709+0000","last_undegraded":"2024-05-08T05:27:22.888709+0000","last_fullsized":"2024-05-08T05:27:22.888709+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_clean_scrub_stamp":"2024-05-08T05:25:33.008741+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T07:35:05.603319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"80'6","reported_seq":34,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:26:24.115427+0000","last_change":"2024-05-08T05:25:30.010453+0000","last_active":"2024-05-08T05:26:24.115427+0000","last_peered":"2024-05-08T05:26:24.115427+0000","last_clean":"2024-05-08T05:26:24.115427+0000","last_became_active":"2024-05-08T05:25:30.010032+0000","last_became_peered":"2024-05-08T05:25:30.010032+0000","last_unstale":"2024-05-08T05:26:24.115427+0000","last_undegraded":"2024-05-08T05:26:24.115427+0000","last_fullsized":"2024-05-08T05:26:24.115427+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:28.970901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:28.970901+0000","last_clean_scrub_stamp":"2024-05-08T05:25:28.970901+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T16:34:35.052481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"82'9","reported_seq":36,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:27:22.904364+0000","last_change":"2024-05-08T05:26:24.134959+0000","last_active":"2024-05-08T05:27:22.904364+0000","last_peered":"2024-05-08T05:27:22.904364+0000","last_clean":"2024-05-08T05:27:22.904364+0000","last_became_active":"2024-05-08T05:26:24.134487+0000","last_became_peered":"2024-05-08T05:26:24.134487+0000","last_unstale":"2024-05-08T05:27:22.904364+0000","last_undegraded":"2024-05-08T05:27:22.904364+0000","last_fullsized":"2024-05-08T05:27:22.904364+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_clean_scrub_stamp":"2024-05-08T05:25:33.008741+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T06:46:55.131407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,9],"acting":[6,7,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"80'3","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:26:24.118218+0000","last_change":"2024-05-08T05:25:30.009768+0000","last_active":"2024-05-08T05:26:24.118218+0000","last_peered":"2024-05-08T05:26:24.118218+0000","last_clean":"2024-05-08T05:26:24.118218+0000","last_became_active":"2024-05-08T05:25:30.009385+0000","last_became_peered":"2024-05-08T05:25:30.009385+0000","last_unstale":"2024-05-08T05:26:24.118218+0000","last_undegraded":"2024-05-08T05:26:24.118218+0000","last_fullsized":"2024-05-08T05:26:24.118218+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:28.970901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:28.970901+0000","last_clean_scrub_stamp":"2024-05-08T05:25:28.970901+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T07:19:19.556003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"82'15","reported_seq":36,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:27:22.912117+0000","last_change":"2024-05-08T05:25:34.055704+0000","last_active":"2024-05-08T05:27:22.912117+0000","last_peered":"2024-05-08T05:27:22.912117+0000","last_clean":"2024-05-08T05:27:22.912117+0000","last_became_active":"2024-05-08T05:25:34.055339+0000","last_became_peered":"2024-05-08T05:25:34.055339+0000","last_unstale":"2024-05-08T05:27:22.912117+0000","last_undegraded":"2024-05-08T05:27:22.912117+0000","last_fullsized":"2024-05-08T05:27:22.912117+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_clean_scrub_stamp":"2024-05-08T05:25:33.008741+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T07:21:52.579094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"82'6","reported_seq":241,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:29:17.408189+0000","last_change":"2024-05-08T05:25:29.998631+0000","last_active":"2024-05-08T05:29:17.408189+0000","last_peered":"2024-05-08T05:29:17.408189+0000","last_clean":"2024-05-08T05:29:17.408189+0000","last_became_active":"2024-05-08T05:25:29.998216+0000","last_became_peered":"2024-05-08T05:25:29.998216+0000","last_unstale":"2024-05-08T05:29:17.408189+0000","last_undegraded":"2024-05-08T05:29:17.408189+0000","last_fullsized":"2024-05-08T05:29:17.408189+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:28.970901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:28.970901+0000","last_clean_scrub_stamp":"2024-05-08T05:25:28.970901+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T14:16:58.252604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1430,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":209,"num_read_kb":6,"num_write":5,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"82'6","reported_seq":27,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:27:22.890182+0000","last_change":"2024-05-08T05:25:34.053216+0000","last_active":"2024-05-08T05:27:22.890182+0000","last_peered":"2024-05-08T05:27:22.890182+0000","last_clean":"2024-05-08T05:27:22.890182+0000","last_became_active":"2024-05-08T05:25:34.052908+0000","last_became_peered":"2024-05-08T05:25:34.052908+0000","last_unstale":"2024-05-08T05:27:22.890182+0000","last_undegraded":"2024-05-08T05:27:22.890182+0000","last_fullsized":"2024-05-08T05:27:22.890182+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_clean_scrub_stamp":"2024-05-08T05:25:33.008741+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T13:01:42.574200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"80'15","reported_seq":43,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:26:24.116096+0000","last_change":"2024-05-08T05:25:30.356349+0000","last_active":"2024-05-08T05:26:24.116096+0000","last_peered":"2024-05-08T05:26:24.116096+0000","last_clean":"2024-05-08T05:26:24.116096+0000","last_became_active":"2024-05-08T05:25:30.355892+0000","last_became_peered":"2024-05-08T05:25:30.355892+0000","last_unstale":"2024-05-08T05:26:24.116096+0000","last_undegraded":"2024-05-08T05:26:24.116096+0000","last_fullsized":"2024-05-08T05:26:24.116096+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:28.970901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:28.970901+0000","last_clean_scrub_stamp":"2024-05-08T05:25:28.970901+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T16:54:22.322606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"82'6","reported_seq":27,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:27:22.904730+0000","last_change":"2024-05-08T05:25:34.062254+0000","last_active":"2024-05-08T05:27:22.904730+0000","last_peered":"2024-05-08T05:27:22.904730+0000","last_clean":"2024-05-08T05:27:22.904730+0000","last_became_active":"2024-05-08T05:25:34.061928+0000","last_became_peered":"2024-05-08T05:25:34.061928+0000","last_unstale":"2024-05-08T05:27:22.904730+0000","last_undegraded":"2024-05-08T05:27:22.904730+0000","last_fullsized":"2024-05-08T05:27:22.904730+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_clean_scrub_stamp":"2024-05-08T05:25:33.008741+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T14:58:17.135661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"80'2","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:26:24.116424+0000","last_change":"2024-05-08T05:25:30.001434+0000","last_active":"2024-05-08T05:26:24.116424+0000","last_peered":"2024-05-08T05:26:24.116424+0000","last_clean":"2024-05-08T05:26:24.116424+0000","last_became_active":"2024-05-08T05:25:30.000900+0000","last_became_peered":"2024-05-08T05:25:30.000900+0000","last_unstale":"2024-05-08T05:26:24.116424+0000","last_undegraded":"2024-05-08T05:26:24.116424+0000","last_fullsized":"2024-05-08T05:26:24.116424+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:28.970901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:28.970901+0000","last_clean_scrub_stamp":"2024-05-08T05:25:28.970901+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T11:47:18.031222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"82'5","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:27:22.889034+0000","last_change":"2024-05-08T05:25:34.057101+0000","last_active":"2024-05-08T05:27:22.889034+0000","last_peered":"2024-05-08T05:27:22.889034+0000","last_clean":"2024-05-08T05:27:22.889034+0000","last_became_active":"2024-05-08T05:25:34.056742+0000","last_became_peered":"2024-05-08T05:25:34.056742+0000","last_unstale":"2024-05-08T05:27:22.889034+0000","last_undegraded":"2024-05-08T05:27:22.889034+0000","last_fullsized":"2024-05-08T05:27:22.889034+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_clean_scrub_stamp":"2024-05-08T05:25:33.008741+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T14:19:22.997586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":27,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:26:24.133876+0000","last_change":"2024-05-08T05:25:30.359474+0000","last_active":"2024-05-08T05:26:24.133876+0000","last_peered":"2024-05-08T05:26:24.133876+0000","last_clean":"2024-05-08T05:26:24.133876+0000","last_became_active":"2024-05-08T05:25:30.358971+0000","last_became_peered":"2024-05-08T05:25:30.358971+0000","last_unstale":"2024-05-08T05:26:24.133876+0000","last_undegraded":"2024-05-08T05:26:24.133876+0000","last_fullsized":"2024-05-08T05:26:24.133876+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:28.970901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:28.970901+0000","last_clean_scrub_stamp":"2024-05-08T05:25:28.970901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T12:51:42.239112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"82'5","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:27:22.909599+0000","last_change":"2024-05-08T05:25:34.061014+0000","last_active":"2024-05-08T05:27:22.909599+0000","last_peered":"2024-05-08T05:27:22.909599+0000","last_clean":"2024-05-08T05:27:22.909599+0000","last_became_active":"2024-05-08T05:25:34.060682+0000","last_became_peered":"2024-05-08T05:25:34.060682+0000","last_unstale":"2024-05-08T05:27:22.909599+0000","last_undegraded":"2024-05-08T05:27:22.909599+0000","last_fullsized":"2024-05-08T05:27:22.909599+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_clean_scrub_stamp":"2024-05-08T05:25:33.008741+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T13:19:48.652257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"80'1","reported_seq":28,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:26:24.116079+0000","last_change":"2024-05-08T05:25:30.009360+0000","last_active":"2024-05-08T05:26:24.116079+0000","last_peered":"2024-05-08T05:26:24.116079+0000","last_clean":"2024-05-08T05:26:24.116079+0000","last_became_active":"2024-05-08T05:25:30.008806+0000","last_became_peered":"2024-05-08T05:25:30.008806+0000","last_unstale":"2024-05-08T05:26:24.116079+0000","last_undegraded":"2024-05-08T05:26:24.116079+0000","last_fullsized":"2024-05-08T05:26:24.116079+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:28.970901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:28.970901+0000","last_clean_scrub_stamp":"2024-05-08T05:25:28.970901+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T11:19:45.905803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"82'7","reported_seq":28,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:27:22.902064+0000","last_change":"2024-05-08T05:25:34.065415+0000","last_active":"2024-05-08T05:27:22.902064+0000","last_peered":"2024-05-08T05:27:22.902064+0000","last_clean":"2024-05-08T05:27:22.902064+0000","last_became_active":"2024-05-08T05:25:34.065017+0000","last_became_peered":"2024-05-08T05:25:34.065017+0000","last_unstale":"2024-05-08T05:27:22.902064+0000","last_undegraded":"2024-05-08T05:27:22.902064+0000","last_fullsized":"2024-05-08T05:27:22.902064+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_clean_scrub_stamp":"2024-05-08T05:25:33.008741+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T14:46:34.518792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.0","version":"82'8","reported_seq":35,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:27:22.887996+0000","last_change":"2024-05-08T05:26:24.120480+0000","last_active":"2024-05-08T05:27:22.887996+0000","last_peered":"2024-05-08T05:27:22.887996+0000","last_clean":"2024-05-08T05:27:22.887996+0000","last_became_active":"2024-05-08T05:26:24.120031+0000","last_became_peered":"2024-05-08T05:26:24.120031+0000","last_unstale":"2024-05-08T05:27:22.887996+0000","last_undegraded":"2024-05-08T05:27:22.887996+0000","last_fullsized":"2024-05-08T05:27:22.887996+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_clean_scrub_stamp":"2024-05-08T05:25:33.008741+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T09:24:18.149796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,8],"acting":[5,2,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"82'6","reported_seq":239,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:29:20.413787+0000","last_change":"2024-05-08T05:25:30.356178+0000","last_active":"2024-05-08T05:29:20.413787+0000","last_peered":"2024-05-08T05:29:20.413787+0000","last_clean":"2024-05-08T05:29:20.413787+0000","last_became_active":"2024-05-08T05:25:30.355750+0000","last_became_peered":"2024-05-08T05:25:30.355750+0000","last_unstale":"2024-05-08T05:29:20.413787+0000","last_undegraded":"2024-05-08T05:29:20.413787+0000","last_fullsized":"2024-05-08T05:29:20.413787+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:28.970901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:28.970901+0000","last_clean_scrub_stamp":"2024-05-08T05:25:28.970901+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T05:57:35.174274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":206,"num_read_kb":206,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"82'8","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:27:22.906527+0000","last_change":"2024-05-08T05:25:34.068189+0000","last_active":"2024-05-08T05:27:22.906527+0000","last_peered":"2024-05-08T05:27:22.906527+0000","last_clean":"2024-05-08T05:27:22.906527+0000","last_became_active":"2024-05-08T05:25:34.064398+0000","last_became_peered":"2024-05-08T05:25:34.064398+0000","last_unstale":"2024-05-08T05:27:22.906527+0000","last_undegraded":"2024-05-08T05:27:22.906527+0000","last_fullsized":"2024-05-08T05:27:22.906527+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_clean_scrub_stamp":"2024-05-08T05:25:33.008741+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T10:27:31.050126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"80'3","reported_seq":32,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:26:24.126812+0000","last_change":"2024-05-08T05:25:30.005110+0000","last_active":"2024-05-08T05:26:24.126812+0000","last_peered":"2024-05-08T05:26:24.126812+0000","last_clean":"2024-05-08T05:26:24.126812+0000","last_became_active":"2024-05-08T05:25:30.004703+0000","last_became_peered":"2024-05-08T05:25:30.004703+0000","last_unstale":"2024-05-08T05:26:24.126812+0000","last_undegraded":"2024-05-08T05:26:24.126812+0000","last_fullsized":"2024-05-08T05:26:24.126812+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:28.970901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:28.970901+0000","last_clean_scrub_stamp":"2024-05-08T05:25:28.970901+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T12:49:21.174417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"21'92","reported_seq":102,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:26:38.132162+0000","last_change":"2024-05-08T05:23:59.731023+0000","last_active":"2024-05-08T05:26:38.132162+0000","last_peered":"2024-05-08T05:26:38.132162+0000","last_clean":"2024-05-08T05:26:38.132162+0000","last_became_active":"2024-05-08T05:23:59.725321+0000","last_became_peered":"2024-05-08T05:23:59.725321+0000","last_unstale":"2024-05-08T05:26:38.132162+0000","last_undegraded":"2024-05-08T05:26:38.132162+0000","last_fullsized":"2024-05-08T05:26:38.132162+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:20:09.357011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:20:09.357011+0000","last_clean_scrub_stamp":"2024-05-08T05:20:09.357011+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T09:50:58.729815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"82'5","reported_seq":32,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:27:22.899430+0000","last_change":"2024-05-08T05:26:24.131360+0000","last_active":"2024-05-08T05:27:22.899430+0000","last_peered":"2024-05-08T05:27:22.899430+0000","last_clean":"2024-05-08T05:27:22.899430+0000","last_became_active":"2024-05-08T05:26:24.130480+0000","last_became_peered":"2024-05-08T05:26:24.130480+0000","last_unstale":"2024-05-08T05:27:22.899430+0000","last_undegraded":"2024-05-08T05:27:22.899430+0000","last_fullsized":"2024-05-08T05:27:22.899430+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_clean_scrub_stamp":"2024-05-08T05:25:33.008741+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T09:26:32.515332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,9,2],"acting":[6,9,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"80'3","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:26:24.115792+0000","last_change":"2024-05-08T05:25:29.999659+0000","last_active":"2024-05-08T05:26:24.115792+0000","last_peered":"2024-05-08T05:26:24.115792+0000","last_clean":"2024-05-08T05:26:24.115792+0000","last_became_active":"2024-05-08T05:25:29.999299+0000","last_became_peered":"2024-05-08T05:25:29.999299+0000","last_unstale":"2024-05-08T05:26:24.115792+0000","last_undegraded":"2024-05-08T05:26:24.115792+0000","last_fullsized":"2024-05-08T05:26:24.115792+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:28.970901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:28.970901+0000","last_clean_scrub_stamp":"2024-05-08T05:25:28.970901+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T11:20:16.513402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"80'1","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:26:24.116094+0000","last_change":"2024-05-08T05:25:30.360940+0000","last_active":"2024-05-08T05:26:24.116094+0000","last_peered":"2024-05-08T05:26:24.116094+0000","last_clean":"2024-05-08T05:26:24.116094+0000","last_became_active":"2024-05-08T05:25:30.360507+0000","last_became_peered":"2024-05-08T05:25:30.360507+0000","last_unstale":"2024-05-08T05:26:24.116094+0000","last_undegraded":"2024-05-08T05:26:24.116094+0000","last_fullsized":"2024-05-08T05:26:24.116094+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:28.970901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:28.970901+0000","last_clean_scrub_stamp":"2024-05-08T05:25:28.970901+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T06:49:39.271211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"82'9","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:27:22.902224+0000","last_change":"2024-05-08T05:25:34.056952+0000","last_active":"2024-05-08T05:27:22.902224+0000","last_peered":"2024-05-08T05:27:22.902224+0000","last_clean":"2024-05-08T05:27:22.902224+0000","last_became_active":"2024-05-08T05:25:34.056495+0000","last_became_peered":"2024-05-08T05:25:34.056495+0000","last_unstale":"2024-05-08T05:27:22.902224+0000","last_undegraded":"2024-05-08T05:27:22.902224+0000","last_fullsized":"2024-05-08T05:27:22.902224+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_clean_scrub_stamp":"2024-05-08T05:25:33.008741+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T09:35:22.540178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"82'13","reported_seq":40,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:27:41.531532+0000","last_change":"2024-05-08T05:25:30.008967+0000","last_active":"2024-05-08T05:27:41.531532+0000","last_peered":"2024-05-08T05:27:41.531532+0000","last_clean":"2024-05-08T05:27:41.531532+0000","last_became_active":"2024-05-08T05:25:30.007542+0000","last_became_peered":"2024-05-08T05:25:30.007542+0000","last_unstale":"2024-05-08T05:27:41.531532+0000","last_undegraded":"2024-05-08T05:27:41.531532+0000","last_fullsized":"2024-05-08T05:27:41.531532+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:28.970901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:28.970901+0000","last_clean_scrub_stamp":"2024-05-08T05:25:28.970901+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T05:29:30.191842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"82'5","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:27:22.902209+0000","last_change":"2024-05-08T05:25:34.054334+0000","last_active":"2024-05-08T05:27:22.902209+0000","last_peered":"2024-05-08T05:27:22.902209+0000","last_clean":"2024-05-08T05:27:22.902209+0000","last_became_active":"2024-05-08T05:25:34.053989+0000","last_became_peered":"2024-05-08T05:25:34.053989+0000","last_unstale":"2024-05-08T05:27:22.902209+0000","last_undegraded":"2024-05-08T05:27:22.902209+0000","last_fullsized":"2024-05-08T05:27:22.902209+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_clean_scrub_stamp":"2024-05-08T05:25:33.008741+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T09:03:25.683445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"80'4","reported_seq":31,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:26:24.127039+0000","last_change":"2024-05-08T05:25:30.007144+0000","last_active":"2024-05-08T05:26:24.127039+0000","last_peered":"2024-05-08T05:26:24.127039+0000","last_clean":"2024-05-08T05:26:24.127039+0000","last_became_active":"2024-05-08T05:25:30.006878+0000","last_became_peered":"2024-05-08T05:25:30.006878+0000","last_unstale":"2024-05-08T05:26:24.127039+0000","last_undegraded":"2024-05-08T05:26:24.127039+0000","last_fullsized":"2024-05-08T05:26:24.127039+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:28.970901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:28.970901+0000","last_clean_scrub_stamp":"2024-05-08T05:25:28.970901+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T07:06:35.573001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"82'7","reported_seq":28,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:27:22.914063+0000","last_change":"2024-05-08T05:25:34.073744+0000","last_active":"2024-05-08T05:27:22.914063+0000","last_peered":"2024-05-08T05:27:22.914063+0000","last_clean":"2024-05-08T05:27:22.914063+0000","last_became_active":"2024-05-08T05:25:34.073368+0000","last_became_peered":"2024-05-08T05:25:34.073368+0000","last_unstale":"2024-05-08T05:27:22.914063+0000","last_undegraded":"2024-05-08T05:27:22.914063+0000","last_fullsized":"2024-05-08T05:27:22.914063+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_clean_scrub_stamp":"2024-05-08T05:25:33.008741+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T10:43:31.480745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"80'2","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:26:24.112998+0000","last_change":"2024-05-08T05:25:30.356584+0000","last_active":"2024-05-08T05:26:24.112998+0000","last_peered":"2024-05-08T05:26:24.112998+0000","last_clean":"2024-05-08T05:26:24.112998+0000","last_became_active":"2024-05-08T05:25:30.356203+0000","last_became_peered":"2024-05-08T05:25:30.356203+0000","last_unstale":"2024-05-08T05:26:24.112998+0000","last_undegraded":"2024-05-08T05:26:24.112998+0000","last_fullsized":"2024-05-08T05:26:24.112998+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:28.970901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:28.970901+0000","last_clean_scrub_stamp":"2024-05-08T05:25:28.970901+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T14:35:21.193856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"82'2","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:27:22.887903+0000","last_change":"2024-05-08T05:25:34.053168+0000","last_active":"2024-05-08T05:27:22.887903+0000","last_peered":"2024-05-08T05:27:22.887903+0000","last_clean":"2024-05-08T05:27:22.887903+0000","last_became_active":"2024-05-08T05:25:34.052875+0000","last_became_peered":"2024-05-08T05:25:34.052875+0000","last_unstale":"2024-05-08T05:27:22.887903+0000","last_undegraded":"2024-05-08T05:27:22.887903+0000","last_fullsized":"2024-05-08T05:27:22.887903+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_clean_scrub_stamp":"2024-05-08T05:25:33.008741+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T07:38:40.129212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"80'3","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:26:24.121861+0000","last_change":"2024-05-08T05:25:30.009113+0000","last_active":"2024-05-08T05:26:24.121861+0000","last_peered":"2024-05-08T05:26:24.121861+0000","last_clean":"2024-05-08T05:26:24.121861+0000","last_became_active":"2024-05-08T05:25:30.007605+0000","last_became_peered":"2024-05-08T05:25:30.007605+0000","last_unstale":"2024-05-08T05:26:24.121861+0000","last_undegraded":"2024-05-08T05:26:24.121861+0000","last_fullsized":"2024-05-08T05:26:24.121861+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:28.970901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:28.970901+0000","last_clean_scrub_stamp":"2024-05-08T05:25:28.970901+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T10:06:05.177516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"82'9","reported_seq":28,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:27:22.911359+0000","last_change":"2024-05-08T05:25:34.072765+0000","last_active":"2024-05-08T05:27:22.911359+0000","last_peered":"2024-05-08T05:27:22.911359+0000","last_clean":"2024-05-08T05:27:22.911359+0000","last_became_active":"2024-05-08T05:25:34.072381+0000","last_became_peered":"2024-05-08T05:25:34.072381+0000","last_unstale":"2024-05-08T05:27:22.911359+0000","last_undegraded":"2024-05-08T05:27:22.911359+0000","last_fullsized":"2024-05-08T05:27:22.911359+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_clean_scrub_stamp":"2024-05-08T05:25:33.008741+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T11:55:21.046126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"80'1","reported_seq":16,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:26:27.357620+0000","last_change":"2024-05-08T05:26:24.124762+0000","last_active":"2024-05-08T05:26:27.357620+0000","last_peered":"2024-05-08T05:26:27.357620+0000","last_clean":"2024-05-08T05:26:27.357620+0000","last_became_active":"2024-05-08T05:26:24.121235+0000","last_became_peered":"2024-05-08T05:26:24.121235+0000","last_unstale":"2024-05-08T05:26:27.357620+0000","last_undegraded":"2024-05-08T05:26:27.357620+0000","last_fullsized":"2024-05-08T05:26:27.357620+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:28.970901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:28.970901+0000","last_clean_scrub_stamp":"2024-05-08T05:25:28.970901+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T16:08:17.650335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,3,8],"acting":[11,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.b","version":"82'8","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:27:22.914232+0000","last_change":"2024-05-08T05:25:34.071097+0000","last_active":"2024-05-08T05:27:22.914232+0000","last_peered":"2024-05-08T05:27:22.914232+0000","last_clean":"2024-05-08T05:27:22.914232+0000","last_became_active":"2024-05-08T05:25:34.070635+0000","last_became_peered":"2024-05-08T05:25:34.070635+0000","last_unstale":"2024-05-08T05:27:22.914232+0000","last_undegraded":"2024-05-08T05:27:22.914232+0000","last_fullsized":"2024-05-08T05:27:22.914232+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_clean_scrub_stamp":"2024-05-08T05:25:33.008741+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T13:33:17.217958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"80'4","reported_seq":32,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:26:24.116727+0000","last_change":"2024-05-08T05:25:30.002043+0000","last_active":"2024-05-08T05:26:24.116727+0000","last_peered":"2024-05-08T05:26:24.116727+0000","last_clean":"2024-05-08T05:26:24.116727+0000","last_became_active":"2024-05-08T05:25:30.001624+0000","last_became_peered":"2024-05-08T05:25:30.001624+0000","last_unstale":"2024-05-08T05:26:24.116727+0000","last_undegraded":"2024-05-08T05:26:24.116727+0000","last_fullsized":"2024-05-08T05:26:24.116727+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:28.970901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:28.970901+0000","last_clean_scrub_stamp":"2024-05-08T05:25:28.970901+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T07:20:34.740005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"82'5","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:27:22.910044+0000","last_change":"2024-05-08T05:25:34.057883+0000","last_active":"2024-05-08T05:27:22.910044+0000","last_peered":"2024-05-08T05:27:22.910044+0000","last_clean":"2024-05-08T05:27:22.910044+0000","last_became_active":"2024-05-08T05:25:34.056651+0000","last_became_peered":"2024-05-08T05:25:34.056651+0000","last_unstale":"2024-05-08T05:27:22.910044+0000","last_undegraded":"2024-05-08T05:27:22.910044+0000","last_fullsized":"2024-05-08T05:27:22.910044+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_clean_scrub_stamp":"2024-05-08T05:25:33.008741+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T16:52:46.598847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"80'3","reported_seq":31,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:26:24.116077+0000","last_change":"2024-05-08T05:25:30.356166+0000","last_active":"2024-05-08T05:26:24.116077+0000","last_peered":"2024-05-08T05:26:24.116077+0000","last_clean":"2024-05-08T05:26:24.116077+0000","last_became_active":"2024-05-08T05:25:30.355730+0000","last_became_peered":"2024-05-08T05:25:30.355730+0000","last_unstale":"2024-05-08T05:26:24.116077+0000","last_undegraded":"2024-05-08T05:26:24.116077+0000","last_fullsized":"2024-05-08T05:26:24.116077+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:28.970901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:28.970901+0000","last_clean_scrub_stamp":"2024-05-08T05:25:28.970901+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T05:47:47.743725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"82'7","reported_seq":28,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:27:22.905417+0000","last_change":"2024-05-08T05:25:34.058005+0000","last_active":"2024-05-08T05:27:22.905417+0000","last_peered":"2024-05-08T05:27:22.905417+0000","last_clean":"2024-05-08T05:27:22.905417+0000","last_became_active":"2024-05-08T05:25:34.056319+0000","last_became_peered":"2024-05-08T05:25:34.056319+0000","last_unstale":"2024-05-08T05:27:22.905417+0000","last_undegraded":"2024-05-08T05:27:22.905417+0000","last_fullsized":"2024-05-08T05:27:22.905417+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_clean_scrub_stamp":"2024-05-08T05:25:33.008741+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T07:04:22.726450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"80'1","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:26:24.118635+0000","last_change":"2024-05-08T05:25:30.009641+0000","last_active":"2024-05-08T05:26:24.118635+0000","last_peered":"2024-05-08T05:26:24.118635+0000","last_clean":"2024-05-08T05:26:24.118635+0000","last_became_active":"2024-05-08T05:25:30.009244+0000","last_became_peered":"2024-05-08T05:25:30.009244+0000","last_unstale":"2024-05-08T05:26:24.118635+0000","last_undegraded":"2024-05-08T05:26:24.118635+0000","last_fullsized":"2024-05-08T05:26:24.118635+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:28.970901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:28.970901+0000","last_clean_scrub_stamp":"2024-05-08T05:25:28.970901+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T17:15:50.982103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"82'7","reported_seq":28,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:27:22.909297+0000","last_change":"2024-05-08T05:25:34.059603+0000","last_active":"2024-05-08T05:27:22.909297+0000","last_peered":"2024-05-08T05:27:22.909297+0000","last_clean":"2024-05-08T05:27:22.909297+0000","last_became_active":"2024-05-08T05:25:34.059260+0000","last_became_peered":"2024-05-08T05:25:34.059260+0000","last_unstale":"2024-05-08T05:27:22.909297+0000","last_undegraded":"2024-05-08T05:27:22.909297+0000","last_fullsized":"2024-05-08T05:27:22.909297+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_clean_scrub_stamp":"2024-05-08T05:25:33.008741+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T07:47:32.723829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"80'2","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:26:24.117157+0000","last_change":"2024-05-08T05:25:30.013326+0000","last_active":"2024-05-08T05:26:24.117157+0000","last_peered":"2024-05-08T05:26:24.117157+0000","last_clean":"2024-05-08T05:26:24.117157+0000","last_became_active":"2024-05-08T05:25:30.012868+0000","last_became_peered":"2024-05-08T05:25:30.012868+0000","last_unstale":"2024-05-08T05:26:24.117157+0000","last_undegraded":"2024-05-08T05:26:24.117157+0000","last_fullsized":"2024-05-08T05:26:24.117157+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:28.970901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:28.970901+0000","last_clean_scrub_stamp":"2024-05-08T05:25:28.970901+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T14:09:14.210180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"82'9","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:27:22.891022+0000","last_change":"2024-05-08T05:25:34.052621+0000","last_active":"2024-05-08T05:27:22.891022+0000","last_peered":"2024-05-08T05:27:22.891022+0000","last_clean":"2024-05-08T05:27:22.891022+0000","last_became_active":"2024-05-08T05:25:34.052289+0000","last_became_peered":"2024-05-08T05:25:34.052289+0000","last_unstale":"2024-05-08T05:27:22.891022+0000","last_undegraded":"2024-05-08T05:27:22.891022+0000","last_fullsized":"2024-05-08T05:27:22.891022+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_clean_scrub_stamp":"2024-05-08T05:25:33.008741+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T16:37:19.327915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"82'9","reported_seq":28,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:27:22.890913+0000","last_change":"2024-05-08T05:25:34.057918+0000","last_active":"2024-05-08T05:27:22.890913+0000","last_peered":"2024-05-08T05:27:22.890913+0000","last_clean":"2024-05-08T05:27:22.890913+0000","last_became_active":"2024-05-08T05:25:34.057455+0000","last_became_peered":"2024-05-08T05:25:34.057455+0000","last_unstale":"2024-05-08T05:27:22.890913+0000","last_undegraded":"2024-05-08T05:27:22.890913+0000","last_fullsized":"2024-05-08T05:27:22.890913+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_clean_scrub_stamp":"2024-05-08T05:25:33.008741+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T11:36:49.027414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"82'12","reported_seq":33,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:27:22.903184+0000","last_change":"2024-05-08T05:25:34.055114+0000","last_active":"2024-05-08T05:27:22.903184+0000","last_peered":"2024-05-08T05:27:22.903184+0000","last_clean":"2024-05-08T05:27:22.903184+0000","last_became_active":"2024-05-08T05:25:34.054448+0000","last_became_peered":"2024-05-08T05:25:34.054448+0000","last_unstale":"2024-05-08T05:27:22.903184+0000","last_undegraded":"2024-05-08T05:27:22.903184+0000","last_fullsized":"2024-05-08T05:27:22.903184+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_clean_scrub_stamp":"2024-05-08T05:25:33.008741+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T15:19:54.872779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"82'8","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:27:22.915661+0000","last_change":"2024-05-08T05:25:34.064199+0000","last_active":"2024-05-08T05:27:22.915661+0000","last_peered":"2024-05-08T05:27:22.915661+0000","last_clean":"2024-05-08T05:27:22.915661+0000","last_became_active":"2024-05-08T05:25:34.063888+0000","last_became_peered":"2024-05-08T05:25:34.063888+0000","last_unstale":"2024-05-08T05:27:22.915661+0000","last_undegraded":"2024-05-08T05:27:22.915661+0000","last_fullsized":"2024-05-08T05:27:22.915661+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_clean_scrub_stamp":"2024-05-08T05:25:33.008741+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T13:18:15.146769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"82'7","reported_seq":28,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:27:22.918372+0000","last_change":"2024-05-08T05:25:34.070526+0000","last_active":"2024-05-08T05:27:22.918372+0000","last_peered":"2024-05-08T05:27:22.918372+0000","last_clean":"2024-05-08T05:27:22.918372+0000","last_became_active":"2024-05-08T05:25:34.069890+0000","last_became_peered":"2024-05-08T05:25:34.069890+0000","last_unstale":"2024-05-08T05:27:22.918372+0000","last_undegraded":"2024-05-08T05:27:22.918372+0000","last_fullsized":"2024-05-08T05:27:22.918372+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_clean_scrub_stamp":"2024-05-08T05:25:33.008741+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T16:17:56.986221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"82'4","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:27:22.916202+0000","last_change":"2024-05-08T05:25:34.067033+0000","last_active":"2024-05-08T05:27:22.916202+0000","last_peered":"2024-05-08T05:27:22.916202+0000","last_clean":"2024-05-08T05:27:22.916202+0000","last_became_active":"2024-05-08T05:25:34.066492+0000","last_became_peered":"2024-05-08T05:25:34.066492+0000","last_unstale":"2024-05-08T05:27:22.916202+0000","last_undegraded":"2024-05-08T05:27:22.916202+0000","last_fullsized":"2024-05-08T05:27:22.916202+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_clean_scrub_stamp":"2024-05-08T05:25:33.008741+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T07:30:10.450504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"82'6","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:27:22.888388+0000","last_change":"2024-05-08T05:25:34.056525+0000","last_active":"2024-05-08T05:27:22.888388+0000","last_peered":"2024-05-08T05:27:22.888388+0000","last_clean":"2024-05-08T05:27:22.888388+0000","last_became_active":"2024-05-08T05:25:34.056190+0000","last_became_peered":"2024-05-08T05:25:34.056190+0000","last_unstale":"2024-05-08T05:27:22.888388+0000","last_undegraded":"2024-05-08T05:27:22.888388+0000","last_fullsized":"2024-05-08T05:27:22.888388+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_clean_scrub_stamp":"2024-05-08T05:25:33.008741+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T13:13:57.716642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"82'15","reported_seq":36,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:27:22.905265+0000","last_change":"2024-05-08T05:25:34.055643+0000","last_active":"2024-05-08T05:27:22.905265+0000","last_peered":"2024-05-08T05:27:22.905265+0000","last_clean":"2024-05-08T05:27:22.905265+0000","last_became_active":"2024-05-08T05:25:34.054886+0000","last_became_peered":"2024-05-08T05:25:34.054886+0000","last_unstale":"2024-05-08T05:27:22.905265+0000","last_undegraded":"2024-05-08T05:27:22.905265+0000","last_fullsized":"2024-05-08T05:27:22.905265+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_clean_scrub_stamp":"2024-05-08T05:25:33.008741+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T05:53:41.130484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"82'2","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:27:22.908627+0000","last_change":"2024-05-08T05:25:34.056932+0000","last_active":"2024-05-08T05:27:22.908627+0000","last_peered":"2024-05-08T05:27:22.908627+0000","last_clean":"2024-05-08T05:27:22.908627+0000","last_became_active":"2024-05-08T05:25:34.055473+0000","last_became_peered":"2024-05-08T05:25:34.055473+0000","last_unstale":"2024-05-08T05:27:22.908627+0000","last_undegraded":"2024-05-08T05:27:22.908627+0000","last_fullsized":"2024-05-08T05:27:22.908627+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_clean_scrub_stamp":"2024-05-08T05:25:33.008741+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T16:16:13.748056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"82'6","reported_seq":18,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:27:22.912006+0000","last_change":"2024-05-08T05:26:24.134794+0000","last_active":"2024-05-08T05:27:22.912006+0000","last_peered":"2024-05-08T05:27:22.912006+0000","last_clean":"2024-05-08T05:27:22.912006+0000","last_became_active":"2024-05-08T05:26:24.133586+0000","last_became_peered":"2024-05-08T05:26:24.133586+0000","last_unstale":"2024-05-08T05:27:22.912006+0000","last_undegraded":"2024-05-08T05:27:22.912006+0000","last_fullsized":"2024-05-08T05:27:22.912006+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_clean_scrub_stamp":"2024-05-08T05:25:33.008741+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T15:03:05.432689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,9,3],"acting":[6,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.29","version":"82'8","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:27:22.907706+0000","last_change":"2024-05-08T05:25:34.065000+0000","last_active":"2024-05-08T05:27:22.907706+0000","last_peered":"2024-05-08T05:27:22.907706+0000","last_clean":"2024-05-08T05:27:22.907706+0000","last_became_active":"2024-05-08T05:25:34.057748+0000","last_became_peered":"2024-05-08T05:25:34.057748+0000","last_unstale":"2024-05-08T05:27:22.907706+0000","last_undegraded":"2024-05-08T05:27:22.907706+0000","last_fullsized":"2024-05-08T05:27:22.907706+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_clean_scrub_stamp":"2024-05-08T05:25:33.008741+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T15:33:41.411507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"82'10","reported_seq":31,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:27:22.910969+0000","last_change":"2024-05-08T05:25:34.066601+0000","last_active":"2024-05-08T05:27:22.910969+0000","last_peered":"2024-05-08T05:27:22.910969+0000","last_clean":"2024-05-08T05:27:22.910969+0000","last_became_active":"2024-05-08T05:25:34.066226+0000","last_became_peered":"2024-05-08T05:25:34.066226+0000","last_unstale":"2024-05-08T05:27:22.910969+0000","last_undegraded":"2024-05-08T05:27:22.910969+0000","last_fullsized":"2024-05-08T05:27:22.910969+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_clean_scrub_stamp":"2024-05-08T05:25:33.008741+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T15:27:54.180580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"82'11","reported_seq":32,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:27:22.919075+0000","last_change":"2024-05-08T05:25:34.073520+0000","last_active":"2024-05-08T05:27:22.919075+0000","last_peered":"2024-05-08T05:27:22.919075+0000","last_clean":"2024-05-08T05:27:22.919075+0000","last_became_active":"2024-05-08T05:25:34.072250+0000","last_became_peered":"2024-05-08T05:25:34.072250+0000","last_unstale":"2024-05-08T05:27:22.919075+0000","last_undegraded":"2024-05-08T05:27:22.919075+0000","last_fullsized":"2024-05-08T05:27:22.919075+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_clean_scrub_stamp":"2024-05-08T05:25:33.008741+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T08:17:36.181338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"82'8","reported_seq":33,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:27:22.898326+0000","last_change":"2024-05-08T05:26:24.134964+0000","last_active":"2024-05-08T05:27:22.898326+0000","last_peered":"2024-05-08T05:27:22.898326+0000","last_clean":"2024-05-08T05:27:22.898326+0000","last_became_active":"2024-05-08T05:26:24.134583+0000","last_became_peered":"2024-05-08T05:26:24.134583+0000","last_unstale":"2024-05-08T05:27:22.898326+0000","last_undegraded":"2024-05-08T05:27:22.898326+0000","last_fullsized":"2024-05-08T05:27:22.898326+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_clean_scrub_stamp":"2024-05-08T05:25:33.008741+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T16:09:52.525461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,8],"acting":[11,9,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":502,"ondisk_log_size":502,"up":192,"acting":192,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":3563520,"data_stored":3542208,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":92,"ondisk_log_size":92,"up":3,"acting":3,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":75126,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":1261,"num_read_kb":711,"num_write":182,"num_write_kb":133,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":10,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":442368,"data_stored":225378,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":96,"acting":96,"num_store_stats":12}],"osd_stats":[{"osd":11,"up_from":72,"seq":309237645374,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27884,"kb_used_data":868,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717268,"statfs":{"total":95995035648,"available":95966482432,"internally_reserved":0,"allocated":888832,"data_stored":437056,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":66,"seq":283467841604,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36888,"kb_used_data":1552,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708264,"statfs":{"total":95995035648,"available":95957262336,"internally_reserved":0,"allocated":1589248,"data_stored":1094148,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":36174272},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":60,"seq":257698037833,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32060,"kb_used_data":884,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713092,"statfs":{"total":95995035648,"available":95962206208,"internally_reserved":0,"allocated":905216,"data_stored":437292,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":31914432},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":54,"seq":231928234063,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27900,"kb_used_data":884,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717252,"statfs":{"total":95995035648,"available":95966466048,"internally_reserved":0,"allocated":905216,"data_stored":437212,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":48,"seq":206158430293,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36800,"kb_used_data":1464,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708352,"statfs":{"total":95995035648,"available":95957352448,"internally_reserved":0,"allocated":1499136,"data_stored":1030125,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":36174282},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":42,"seq":180388626523,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36208,"kb_used_data":872,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708944,"statfs":{"total":95995035648,"available":95957958656,"internally_reserved":0,"allocated":892928,"data_stored":436681,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574967,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27956,"kb_used_data":940,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717196,"statfs":{"total":95995035648,"available":95966408704,"internally_reserved":0,"allocated":962560,"data_stored":506616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738491,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36228,"kb_used_data":892,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708924,"statfs":{"total":95995035648,"available":95957938176,"internally_reserved":0,"allocated":913408,"data_stored":437952,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411441,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27980,"kb_used_data":964,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717172,"statfs":{"total":95995035648,"available":95966384128,"internally_reserved":0,"allocated":987136,"data_stored":508498,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":25,"seq":107374182507,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27904,"kb_used_data":888,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717248,"statfs":{"total":95995035648,"available":95966461952,"internally_reserved":0,"allocated":909312,"data_stored":436992,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":31,"seq":133143986278,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36212,"kb_used_data":876,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708940,"statfs":{"total":95995035648,"available":95957954560,"internally_reserved":0,"allocated":897024,"data_stored":437960,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":36,"seq":154618822753,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28492,"kb_used_data":1476,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716660,"statfs":{"total":95995035648,"available":95965859840,"internally_reserved":0,"allocated":1511424,"data_stored":1028967,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":77824,"data_stored":70142,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":72024,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1486,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":2008,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":3166,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":110592,"data_stored":72562,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-08T05:29:24.169 INFO:tasks.fwd_scrub.ceph_manager:clean! 2024-05-08T05:29:24.170 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-08T05:29:24.420 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:24.419+0000 7ffa4b200640 1 -- 172.21.15.87:0/3591138515 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ffa4c102850 msgr2=0x7ffa4c102c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:29:24.420 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:24.419+0000 7ffa4b200640 1 --2- 172.21.15.87:0/3591138515 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ffa4c102850 0x7ffa4c102c70 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7ffa3c009860 tx=0x7ffa3c02a340 comp rx=0 tx=0).stop 2024-05-08T05:29:24.420 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:24.419+0000 7ffa4b200640 1 -- 172.21.15.87:0/3591138515 shutdown_connections 2024-05-08T05:29:24.420 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:24.419+0000 7ffa4b200640 1 --2- 172.21.15.87:0/3591138515 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ffa4c104400 0x7ffa4c10ac90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:29:24.420 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:24.419+0000 7ffa4b200640 1 --2- 172.21.15.87:0/3591138515 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ffa4c103a40 0x7ffa4c103ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:29:24.420 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:24.419+0000 7ffa4b200640 1 --2- 172.21.15.87:0/3591138515 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ffa4c102850 0x7ffa4c102c70 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:29:24.420 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:24.419+0000 7ffa4b200640 1 -- 172.21.15.87:0/3591138515 >> 172.21.15.87:0/3591138515 conn(0x7ffa4c0fddc0 msgr2=0x7ffa4c100200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:29:24.420 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:24.419+0000 7ffa4b200640 1 -- 172.21.15.87:0/3591138515 shutdown_connections 2024-05-08T05:29:24.421 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:24.419+0000 7ffa4b200640 1 -- 172.21.15.87:0/3591138515 wait complete. 2024-05-08T05:29:24.423 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:24.420+0000 7ffa4b200640 1 Processor -- start 2024-05-08T05:29:24.423 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:24.420+0000 7ffa4b200640 1 -- start start 2024-05-08T05:29:24.423 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:24.421+0000 7ffa4b200640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ffa4c102850 0x7ffa4c19acb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:29:24.423 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:24.421+0000 7ffa4b200640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ffa4c103a40 0x7ffa4c19b1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:29:24.423 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:24.421+0000 7ffa4b200640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ffa4c104400 0x7ffa4c1a2250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:29:24.423 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:24.421+0000 7ffa4b200640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7ffa4c10e370 con 0x7ffa4c102850 2024-05-08T05:29:24.423 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:24.421+0000 7ffa4b200640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7ffa4c10e1f0 con 0x7ffa4c104400 2024-05-08T05:29:24.423 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:24.421+0000 7ffa4b200640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7ffa4c10e4f0 con 0x7ffa4c103a40 2024-05-08T05:29:24.423 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:24.421+0000 7ffa49e00640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ffa4c102850 0x7ffa4c19acb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:29:24.424 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:24.421+0000 7ffa43e00640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ffa4c103a40 0x7ffa4c19b1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:29:24.424 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:24.421+0000 7ffa43e00640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ffa4c103a40 0x7ffa4c19b1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.87:60358/0 (socket says 172.21.15.87:60358) 2024-05-08T05:29:24.424 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:24.421+0000 7ffa43e00640 1 -- 172.21.15.87:0/4167299841 learned_addr learned my addr 172.21.15.87:0/4167299841 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T05:29:24.424 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:24.421+0000 7ffa4a800640 1 --2- 172.21.15.87:0/4167299841 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ffa4c104400 0x7ffa4c1a2250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:29:24.424 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:24.421+0000 7ffa43e00640 1 -- 172.21.15.87:0/4167299841 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ffa4c104400 msgr2=0x7ffa4c1a2250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:29:24.424 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:24.421+0000 7ffa43e00640 1 --2- 172.21.15.87:0/4167299841 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ffa4c104400 0x7ffa4c1a2250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:29:24.424 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:24.421+0000 7ffa43e00640 1 -- 172.21.15.87:0/4167299841 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ffa4c102850 msgr2=0x7ffa4c19acb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:29:24.424 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:24.421+0000 7ffa43e00640 1 --2- 172.21.15.87:0/4167299841 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ffa4c102850 0x7ffa4c19acb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:29:24.424 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:24.421+0000 7ffa43e00640 1 -- 172.21.15.87:0/4167299841 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffa4c1a28f0 con 0x7ffa4c103a40 2024-05-08T05:29:24.424 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:24.421+0000 7ffa49e00640 1 --2- 172.21.15.87:0/4167299841 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ffa4c102850 0x7ffa4c19acb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T05:29:24.424 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:24.422+0000 7ffa43e00640 1 --2- 172.21.15.87:0/4167299841 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ffa4c103a40 0x7ffa4c19b1f0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7ffa3400e9f0 tx=0x7ffa3400edf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:29:24.424 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:24.422+0000 7ffa42a00640 1 -- 172.21.15.87:0/4167299841 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa3400cd80 con 0x7ffa4c103a40 2024-05-08T05:29:24.424 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:24.422+0000 7ffa4b200640 1 -- 172.21.15.87:0/4167299841 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffa4c1a2be0 con 0x7ffa4c103a40 2024-05-08T05:29:24.424 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:24.422+0000 7ffa42a00640 1 -- 172.21.15.87:0/4167299841 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ffa340054d0 con 0x7ffa4c103a40 2024-05-08T05:29:24.425 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:24.422+0000 7ffa42a00640 1 -- 172.21.15.87:0/4167299841 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa34010690 con 0x7ffa4c103a40 2024-05-08T05:29:24.425 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:24.422+0000 7ffa4b200640 1 -- 172.21.15.87:0/4167299841 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffa4c1a30e0 con 0x7ffa4c103a40 2024-05-08T05:29:24.425 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:24.423+0000 7ffa4b200640 1 -- 172.21.15.87:0/4167299841 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffa4c1a3310 con 0x7ffa4c103a40 2024-05-08T05:29:24.426 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:24.426+0000 7ffa42a00640 1 -- 172.21.15.87:0/4167299841 <== mon.1 v2:172.21.15.160:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7ffa34004e30 con 0x7ffa4c103a40 2024-05-08T05:29:24.427 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:24.427+0000 7ffa42a00640 1 --2- 172.21.15.87:0/4167299841 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7ffa300b27f0 0x7ffa300b4cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:29:24.427 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:24.427+0000 7ffa42a00640 1 -- 172.21.15.87:0/4167299841 <== mon.1 v2:172.21.15.160:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8190+0+0 (secure 0 0 0) 0x7ffa340e2800 con 0x7ffa4c103a40 2024-05-08T05:29:24.427 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:24.427+0000 7ffa49e00640 1 --2- 172.21.15.87:0/4167299841 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7ffa300b27f0 0x7ffa300b4cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:29:24.428 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:24.428+0000 7ffa49e00640 1 --2- 172.21.15.87:0/4167299841 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7ffa300b27f0 0x7ffa300b4cb0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7ffa4c19bb80 tx=0x7ffa3c030450 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:29:24.429 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:24.429+0000 7ffa42a00640 1 -- 172.21.15.87:0/4167299841 <== mon.1 v2:172.21.15.160:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7ffa34054df0 con 0x7ffa4c103a40 2024-05-08T05:29:24.638 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:24.637+0000 7ffa4b200640 1 -- 172.21.15.87:0/4167299841 --> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7ffa4c1a34e0 con 0x7ffa300b27f0 2024-05-08T05:29:24.661 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:24.660+0000 7ffa42a00640 1 -- 172.21.15.87:0/4167299841 <== mgr.14152 v2:172.21.15.87:6800/1189186457 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258811 (secure 0 0 0) 0x7ffa4c1a34e0 con 0x7ffa300b27f0 2024-05-08T05:29:24.665 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-05-08T05:29:24.666 INFO:teuthology.orchestra.run.smithi087.stderr:dumped all 2024-05-08T05:29:24.667 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:24.667+0000 7ffa4b200640 1 -- 172.21.15.87:0/4167299841 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7ffa300b27f0 msgr2=0x7ffa300b4cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:29:24.667 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:24.667+0000 7ffa4b200640 1 --2- 172.21.15.87:0/4167299841 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7ffa300b27f0 0x7ffa300b4cb0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7ffa4c19bb80 tx=0x7ffa3c030450 comp rx=0 tx=0).stop 2024-05-08T05:29:24.668 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:24.667+0000 7ffa4b200640 1 -- 172.21.15.87:0/4167299841 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ffa4c103a40 msgr2=0x7ffa4c19b1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:29:24.668 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:24.667+0000 7ffa4b200640 1 --2- 172.21.15.87:0/4167299841 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ffa4c103a40 0x7ffa4c19b1f0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7ffa3400e9f0 tx=0x7ffa3400edf0 comp rx=0 tx=0).stop 2024-05-08T05:29:24.668 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:24.667+0000 7ffa4b200640 1 -- 172.21.15.87:0/4167299841 shutdown_connections 2024-05-08T05:29:24.668 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:24.667+0000 7ffa4b200640 1 --2- 172.21.15.87:0/4167299841 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7ffa300b27f0 0x7ffa300b4cb0 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:29:24.668 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:24.667+0000 7ffa4b200640 1 --2- 172.21.15.87:0/4167299841 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ffa4c104400 0x7ffa4c1a2250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:29:24.668 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:24.667+0000 7ffa4b200640 1 --2- 172.21.15.87:0/4167299841 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ffa4c103a40 0x7ffa4c19b1f0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:29:24.668 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:24.667+0000 7ffa4b200640 1 --2- 172.21.15.87:0/4167299841 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ffa4c102850 0x7ffa4c19acb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:29:24.668 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:24.667+0000 7ffa4b200640 1 -- 172.21.15.87:0/4167299841 >> 172.21.15.87:0/4167299841 conn(0x7ffa4c0fddc0 msgr2=0x7ffa4c109210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:29:24.668 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:24.667+0000 7ffa4b200640 1 -- 172.21.15.87:0/4167299841 shutdown_connections 2024-05-08T05:29:24.668 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:24.667+0000 7ffa4b200640 1 -- 172.21.15.87:0/4167299841 wait complete. 2024-05-08T05:29:24.687 INFO:teuthology.orchestra.run.smithi087.stdout:{"pg_ready":true,"pg_map":{"version":432,"stamp":"2024-05-08T05:29:22.981824+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":665728,"num_objects":64,"num_object_clones":0,"num_object_copies":192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":1337,"num_read_kb":775,"num_write":307,"num_write_kb":2285,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":13,"num_bytes_recovered":2951840,"num_keys_recovered":10,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":750,"ondisk_log_size":750,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":382512,"kb_used_data":12560,"kb_used_omap":18,"kb_used_meta":369837,"kb_avail":1124559312,"statfs":{"total":1151940427776,"available":1151548735488,"internally_reserved":0,"allocated":12861440,"data_stored":7229499,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19143,"internal_metadata":378713401},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":5993,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":73,"num_read_kb":43,"num_write":7,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005065"},"pg_stats":[{"pgid":"3.3f","version":"82'8","reported_seq":27,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:27:22.911792+0000","last_change":"2024-05-08T05:25:34.073030+0000","last_active":"2024-05-08T05:27:22.911792+0000","last_peered":"2024-05-08T05:27:22.911792+0000","last_clean":"2024-05-08T05:27:22.911792+0000","last_became_active":"2024-05-08T05:25:34.072593+0000","last_became_peered":"2024-05-08T05:25:34.072593+0000","last_unstale":"2024-05-08T05:27:22.911792+0000","last_undegraded":"2024-05-08T05:27:22.911792+0000","last_fullsized":"2024-05-08T05:27:22.911792+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_clean_scrub_stamp":"2024-05-08T05:25:33.008741+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T09:46:17.507034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"82'4","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:27:22.908973+0000","last_change":"2024-05-08T05:25:34.071436+0000","last_active":"2024-05-08T05:27:22.908973+0000","last_peered":"2024-05-08T05:27:22.908973+0000","last_clean":"2024-05-08T05:27:22.908973+0000","last_became_active":"2024-05-08T05:25:34.070985+0000","last_became_peered":"2024-05-08T05:25:34.070985+0000","last_unstale":"2024-05-08T05:27:22.908973+0000","last_undegraded":"2024-05-08T05:27:22.908973+0000","last_fullsized":"2024-05-08T05:27:22.908973+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_clean_scrub_stamp":"2024-05-08T05:25:33.008741+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T10:59:01.312978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"82'7","reported_seq":28,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:27:22.916059+0000","last_change":"2024-05-08T05:25:34.057180+0000","last_active":"2024-05-08T05:27:22.916059+0000","last_peered":"2024-05-08T05:27:22.916059+0000","last_clean":"2024-05-08T05:27:22.916059+0000","last_became_active":"2024-05-08T05:25:34.056775+0000","last_became_peered":"2024-05-08T05:25:34.056775+0000","last_unstale":"2024-05-08T05:27:22.916059+0000","last_undegraded":"2024-05-08T05:27:22.916059+0000","last_fullsized":"2024-05-08T05:27:22.916059+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_clean_scrub_stamp":"2024-05-08T05:25:33.008741+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T13:13:34.389793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"82'8","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:27:22.898318+0000","last_change":"2024-05-08T05:25:34.053102+0000","last_active":"2024-05-08T05:27:22.898318+0000","last_peered":"2024-05-08T05:27:22.898318+0000","last_clean":"2024-05-08T05:27:22.898318+0000","last_became_active":"2024-05-08T05:25:34.052736+0000","last_became_peered":"2024-05-08T05:25:34.052736+0000","last_unstale":"2024-05-08T05:27:22.898318+0000","last_undegraded":"2024-05-08T05:27:22.898318+0000","last_fullsized":"2024-05-08T05:27:22.898318+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_clean_scrub_stamp":"2024-05-08T05:25:33.008741+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T13:05:02.665370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"82'4","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:27:22.900518+0000","last_change":"2024-05-08T05:25:34.070073+0000","last_active":"2024-05-08T05:27:22.900518+0000","last_peered":"2024-05-08T05:27:22.900518+0000","last_clean":"2024-05-08T05:27:22.900518+0000","last_became_active":"2024-05-08T05:25:34.069660+0000","last_became_peered":"2024-05-08T05:25:34.069660+0000","last_unstale":"2024-05-08T05:27:22.900518+0000","last_undegraded":"2024-05-08T05:27:22.900518+0000","last_fullsized":"2024-05-08T05:27:22.900518+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_clean_scrub_stamp":"2024-05-08T05:25:33.008741+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T12:37:10.599082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"82'6","reported_seq":27,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:27:22.899161+0000","last_change":"2024-05-08T05:25:34.057928+0000","last_active":"2024-05-08T05:27:22.899161+0000","last_peered":"2024-05-08T05:27:22.899161+0000","last_clean":"2024-05-08T05:27:22.899161+0000","last_became_active":"2024-05-08T05:25:34.057538+0000","last_became_peered":"2024-05-08T05:25:34.057538+0000","last_unstale":"2024-05-08T05:27:22.899161+0000","last_undegraded":"2024-05-08T05:27:22.899161+0000","last_fullsized":"2024-05-08T05:27:22.899161+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_clean_scrub_stamp":"2024-05-08T05:25:33.008741+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T12:22:49.920889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"82'5","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:27:22.900100+0000","last_change":"2024-05-08T05:25:34.055439+0000","last_active":"2024-05-08T05:27:22.900100+0000","last_peered":"2024-05-08T05:27:22.900100+0000","last_clean":"2024-05-08T05:27:22.900100+0000","last_became_active":"2024-05-08T05:25:34.055002+0000","last_became_peered":"2024-05-08T05:25:34.055002+0000","last_unstale":"2024-05-08T05:27:22.900100+0000","last_undegraded":"2024-05-08T05:27:22.900100+0000","last_fullsized":"2024-05-08T05:27:22.900100+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_clean_scrub_stamp":"2024-05-08T05:25:33.008741+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T11:29:00.482681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"82'9","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:27:22.913447+0000","last_change":"2024-05-08T05:25:34.058943+0000","last_active":"2024-05-08T05:27:22.913447+0000","last_peered":"2024-05-08T05:27:22.913447+0000","last_clean":"2024-05-08T05:27:22.913447+0000","last_became_active":"2024-05-08T05:25:34.058200+0000","last_became_peered":"2024-05-08T05:25:34.058200+0000","last_unstale":"2024-05-08T05:27:22.913447+0000","last_undegraded":"2024-05-08T05:27:22.913447+0000","last_fullsized":"2024-05-08T05:27:22.913447+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_clean_scrub_stamp":"2024-05-08T05:25:33.008741+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T11:13:23.019489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"82'11","reported_seq":32,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:27:22.905575+0000","last_change":"2024-05-08T05:25:34.053948+0000","last_active":"2024-05-08T05:27:22.905575+0000","last_peered":"2024-05-08T05:27:22.905575+0000","last_clean":"2024-05-08T05:27:22.905575+0000","last_became_active":"2024-05-08T05:25:34.053601+0000","last_became_peered":"2024-05-08T05:25:34.053601+0000","last_unstale":"2024-05-08T05:27:22.905575+0000","last_undegraded":"2024-05-08T05:27:22.905575+0000","last_fullsized":"2024-05-08T05:27:22.905575+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_clean_scrub_stamp":"2024-05-08T05:25:33.008741+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T05:50:44.228628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"82'16","reported_seq":37,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:27:22.899056+0000","last_change":"2024-05-08T05:25:34.053167+0000","last_active":"2024-05-08T05:27:22.899056+0000","last_peered":"2024-05-08T05:27:22.899056+0000","last_clean":"2024-05-08T05:27:22.899056+0000","last_became_active":"2024-05-08T05:25:34.052425+0000","last_became_peered":"2024-05-08T05:25:34.052425+0000","last_unstale":"2024-05-08T05:27:22.899056+0000","last_undegraded":"2024-05-08T05:27:22.899056+0000","last_fullsized":"2024-05-08T05:27:22.899056+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_clean_scrub_stamp":"2024-05-08T05:25:33.008741+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T10:56:28.599966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"82'6","reported_seq":27,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:27:22.905304+0000","last_change":"2024-05-08T05:25:34.057677+0000","last_active":"2024-05-08T05:27:22.905304+0000","last_peered":"2024-05-08T05:27:22.905304+0000","last_clean":"2024-05-08T05:27:22.905304+0000","last_became_active":"2024-05-08T05:25:34.054800+0000","last_became_peered":"2024-05-08T05:25:34.054800+0000","last_unstale":"2024-05-08T05:27:22.905304+0000","last_undegraded":"2024-05-08T05:27:22.905304+0000","last_fullsized":"2024-05-08T05:27:22.905304+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_clean_scrub_stamp":"2024-05-08T05:25:33.008741+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T07:41:55.836901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"82'7","reported_seq":28,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:27:22.898468+0000","last_change":"2024-05-08T05:25:34.051744+0000","last_active":"2024-05-08T05:27:22.898468+0000","last_peered":"2024-05-08T05:27:22.898468+0000","last_clean":"2024-05-08T05:27:22.898468+0000","last_became_active":"2024-05-08T05:25:34.051395+0000","last_became_peered":"2024-05-08T05:25:34.051395+0000","last_unstale":"2024-05-08T05:27:22.898468+0000","last_undegraded":"2024-05-08T05:27:22.898468+0000","last_fullsized":"2024-05-08T05:27:22.898468+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_clean_scrub_stamp":"2024-05-08T05:25:33.008741+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T07:58:52.674899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"82'10","reported_seq":31,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:27:22.913323+0000","last_change":"2024-05-08T05:25:34.053197+0000","last_active":"2024-05-08T05:27:22.913323+0000","last_peered":"2024-05-08T05:27:22.913323+0000","last_clean":"2024-05-08T05:27:22.913323+0000","last_became_active":"2024-05-08T05:25:34.052331+0000","last_became_peered":"2024-05-08T05:25:34.052331+0000","last_unstale":"2024-05-08T05:27:22.913323+0000","last_undegraded":"2024-05-08T05:27:22.913323+0000","last_fullsized":"2024-05-08T05:27:22.913323+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_clean_scrub_stamp":"2024-05-08T05:25:33.008741+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T07:19:12.524722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"82'7","reported_seq":28,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:27:22.907958+0000","last_change":"2024-05-08T05:25:34.070242+0000","last_active":"2024-05-08T05:27:22.907958+0000","last_peered":"2024-05-08T05:27:22.907958+0000","last_clean":"2024-05-08T05:27:22.907958+0000","last_became_active":"2024-05-08T05:25:34.069580+0000","last_became_peered":"2024-05-08T05:25:34.069580+0000","last_unstale":"2024-05-08T05:27:22.907958+0000","last_undegraded":"2024-05-08T05:27:22.907958+0000","last_fullsized":"2024-05-08T05:27:22.907958+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_clean_scrub_stamp":"2024-05-08T05:25:33.008741+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T06:33:25.099470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"82'7","reported_seq":28,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:27:22.908516+0000","last_change":"2024-05-08T05:25:34.067174+0000","last_active":"2024-05-08T05:27:22.908516+0000","last_peered":"2024-05-08T05:27:22.908516+0000","last_clean":"2024-05-08T05:27:22.908516+0000","last_became_active":"2024-05-08T05:25:34.066811+0000","last_became_peered":"2024-05-08T05:25:34.066811+0000","last_unstale":"2024-05-08T05:27:22.908516+0000","last_undegraded":"2024-05-08T05:27:22.908516+0000","last_fullsized":"2024-05-08T05:27:22.908516+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_clean_scrub_stamp":"2024-05-08T05:25:33.008741+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T16:17:57.731620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"82'9","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:27:22.918765+0000","last_change":"2024-05-08T05:25:34.064339+0000","last_active":"2024-05-08T05:27:22.918765+0000","last_peered":"2024-05-08T05:27:22.918765+0000","last_clean":"2024-05-08T05:27:22.918765+0000","last_became_active":"2024-05-08T05:25:34.063994+0000","last_became_peered":"2024-05-08T05:25:34.063994+0000","last_unstale":"2024-05-08T05:27:22.918765+0000","last_undegraded":"2024-05-08T05:27:22.918765+0000","last_fullsized":"2024-05-08T05:27:22.918765+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_clean_scrub_stamp":"2024-05-08T05:25:33.008741+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T17:09:34.443411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"82'8","reported_seq":27,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:27:22.911757+0000","last_change":"2024-05-08T05:25:34.073029+0000","last_active":"2024-05-08T05:27:22.911757+0000","last_peered":"2024-05-08T05:27:22.911757+0000","last_clean":"2024-05-08T05:27:22.911757+0000","last_became_active":"2024-05-08T05:25:34.072491+0000","last_became_peered":"2024-05-08T05:25:34.072491+0000","last_unstale":"2024-05-08T05:27:22.911757+0000","last_undegraded":"2024-05-08T05:27:22.911757+0000","last_fullsized":"2024-05-08T05:27:22.911757+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_clean_scrub_stamp":"2024-05-08T05:25:33.008741+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T10:22:25.304349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"82'10","reported_seq":31,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:27:22.898481+0000","last_change":"2024-05-08T05:25:34.061439+0000","last_active":"2024-05-08T05:27:22.898481+0000","last_peered":"2024-05-08T05:27:22.898481+0000","last_clean":"2024-05-08T05:27:22.898481+0000","last_became_active":"2024-05-08T05:25:34.058275+0000","last_became_peered":"2024-05-08T05:25:34.058275+0000","last_unstale":"2024-05-08T05:27:22.898481+0000","last_undegraded":"2024-05-08T05:27:22.898481+0000","last_fullsized":"2024-05-08T05:27:22.898481+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_clean_scrub_stamp":"2024-05-08T05:25:33.008741+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T14:04:32.433114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"82'7","reported_seq":28,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:27:22.903102+0000","last_change":"2024-05-08T05:25:34.061463+0000","last_active":"2024-05-08T05:27:22.903102+0000","last_peered":"2024-05-08T05:27:22.903102+0000","last_clean":"2024-05-08T05:27:22.903102+0000","last_became_active":"2024-05-08T05:25:34.060891+0000","last_became_peered":"2024-05-08T05:25:34.060891+0000","last_unstale":"2024-05-08T05:27:22.903102+0000","last_undegraded":"2024-05-08T05:27:22.903102+0000","last_fullsized":"2024-05-08T05:27:22.903102+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_clean_scrub_stamp":"2024-05-08T05:25:33.008741+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T06:42:17.741180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1f","version":"80'9","reported_seq":37,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:26:24.134584+0000","last_change":"2024-05-08T05:25:30.003956+0000","last_active":"2024-05-08T05:26:24.134584+0000","last_peered":"2024-05-08T05:26:24.134584+0000","last_clean":"2024-05-08T05:26:24.134584+0000","last_became_active":"2024-05-08T05:25:30.003229+0000","last_became_peered":"2024-05-08T05:25:30.003229+0000","last_unstale":"2024-05-08T05:26:24.134584+0000","last_undegraded":"2024-05-08T05:26:24.134584+0000","last_fullsized":"2024-05-08T05:26:24.134584+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:28.970901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:28.970901+0000","last_clean_scrub_stamp":"2024-05-08T05:25:28.970901+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T15:45:15.168997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"82'5","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:27:22.894722+0000","last_change":"2024-05-08T05:25:34.064917+0000","last_active":"2024-05-08T05:27:22.894722+0000","last_peered":"2024-05-08T05:27:22.894722+0000","last_clean":"2024-05-08T05:27:22.894722+0000","last_became_active":"2024-05-08T05:25:34.064567+0000","last_became_peered":"2024-05-08T05:25:34.064567+0000","last_unstale":"2024-05-08T05:27:22.894722+0000","last_undegraded":"2024-05-08T05:27:22.894722+0000","last_fullsized":"2024-05-08T05:27:22.894722+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_clean_scrub_stamp":"2024-05-08T05:25:33.008741+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T11:15:53.439313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"80'2","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:26:24.124003+0000","last_change":"2024-05-08T05:25:30.358617+0000","last_active":"2024-05-08T05:26:24.124003+0000","last_peered":"2024-05-08T05:26:24.124003+0000","last_clean":"2024-05-08T05:26:24.124003+0000","last_became_active":"2024-05-08T05:25:30.358084+0000","last_became_peered":"2024-05-08T05:25:30.358084+0000","last_unstale":"2024-05-08T05:26:24.124003+0000","last_undegraded":"2024-05-08T05:26:24.124003+0000","last_fullsized":"2024-05-08T05:26:24.124003+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:28.970901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:28.970901+0000","last_clean_scrub_stamp":"2024-05-08T05:25:28.970901+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T16:30:36.151645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"82'6","reported_seq":27,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:27:22.915154+0000","last_change":"2024-05-08T05:25:34.070189+0000","last_active":"2024-05-08T05:27:22.915154+0000","last_peered":"2024-05-08T05:27:22.915154+0000","last_clean":"2024-05-08T05:27:22.915154+0000","last_became_active":"2024-05-08T05:25:34.067644+0000","last_became_peered":"2024-05-08T05:25:34.067644+0000","last_unstale":"2024-05-08T05:27:22.915154+0000","last_undegraded":"2024-05-08T05:27:22.915154+0000","last_fullsized":"2024-05-08T05:27:22.915154+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_clean_scrub_stamp":"2024-05-08T05:25:33.008741+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T07:50:03.938036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"80'4","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:26:27.357651+0000","last_change":"2024-05-08T05:26:24.133899+0000","last_active":"2024-05-08T05:26:27.357651+0000","last_peered":"2024-05-08T05:26:27.357651+0000","last_clean":"2024-05-08T05:26:27.357651+0000","last_became_active":"2024-05-08T05:26:24.127975+0000","last_became_peered":"2024-05-08T05:26:24.127975+0000","last_unstale":"2024-05-08T05:26:27.357651+0000","last_undegraded":"2024-05-08T05:26:27.357651+0000","last_fullsized":"2024-05-08T05:26:27.357651+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:28.970901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:28.970901+0000","last_clean_scrub_stamp":"2024-05-08T05:25:28.970901+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T09:52:51.912899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":10,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,7],"acting":[11,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1c","version":"82'9","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:27:22.908643+0000","last_change":"2024-05-08T05:25:34.057034+0000","last_active":"2024-05-08T05:27:22.908643+0000","last_peered":"2024-05-08T05:27:22.908643+0000","last_clean":"2024-05-08T05:27:22.908643+0000","last_became_active":"2024-05-08T05:25:34.056718+0000","last_became_peered":"2024-05-08T05:25:34.056718+0000","last_unstale":"2024-05-08T05:27:22.908643+0000","last_undegraded":"2024-05-08T05:27:22.908643+0000","last_fullsized":"2024-05-08T05:27:22.908643+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_clean_scrub_stamp":"2024-05-08T05:25:33.008741+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T15:30:38.786889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1c","version":"80'2","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:26:24.115973+0000","last_change":"2024-05-08T05:25:29.998007+0000","last_active":"2024-05-08T05:26:24.115973+0000","last_peered":"2024-05-08T05:26:24.115973+0000","last_clean":"2024-05-08T05:26:24.115973+0000","last_became_active":"2024-05-08T05:25:29.997565+0000","last_became_peered":"2024-05-08T05:25:29.997565+0000","last_unstale":"2024-05-08T05:26:24.115973+0000","last_undegraded":"2024-05-08T05:26:24.115973+0000","last_fullsized":"2024-05-08T05:26:24.115973+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:28.970901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:28.970901+0000","last_clean_scrub_stamp":"2024-05-08T05:25:28.970901+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T13:40:09.620809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"82'15","reported_seq":36,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:27:22.905074+0000","last_change":"2024-05-08T05:25:34.060136+0000","last_active":"2024-05-08T05:27:22.905074+0000","last_peered":"2024-05-08T05:27:22.905074+0000","last_clean":"2024-05-08T05:27:22.905074+0000","last_became_active":"2024-05-08T05:25:34.059782+0000","last_became_peered":"2024-05-08T05:25:34.059782+0000","last_unstale":"2024-05-08T05:27:22.905074+0000","last_undegraded":"2024-05-08T05:27:22.905074+0000","last_fullsized":"2024-05-08T05:27:22.905074+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_clean_scrub_stamp":"2024-05-08T05:25:33.008741+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T17:07:33.509305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"82'7","reported_seq":245,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:29:21.275937+0000","last_change":"2024-05-08T05:25:30.001356+0000","last_active":"2024-05-08T05:29:21.275937+0000","last_peered":"2024-05-08T05:29:21.275937+0000","last_clean":"2024-05-08T05:29:21.275937+0000","last_became_active":"2024-05-08T05:25:30.000998+0000","last_became_peered":"2024-05-08T05:25:30.000998+0000","last_unstale":"2024-05-08T05:29:21.275937+0000","last_undegraded":"2024-05-08T05:29:21.275937+0000","last_fullsized":"2024-05-08T05:29:21.275937+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:28.970901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:28.970901+0000","last_clean_scrub_stamp":"2024-05-08T05:25:28.970901+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T10:03:27.279982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1154,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":211,"num_read_kb":4,"num_write":4,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"82'7","reported_seq":28,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:27:22.881387+0000","last_change":"2024-05-08T05:25:34.056548+0000","last_active":"2024-05-08T05:27:22.881387+0000","last_peered":"2024-05-08T05:27:22.881387+0000","last_clean":"2024-05-08T05:27:22.881387+0000","last_became_active":"2024-05-08T05:25:34.056216+0000","last_became_peered":"2024-05-08T05:25:34.056216+0000","last_unstale":"2024-05-08T05:27:22.881387+0000","last_undegraded":"2024-05-08T05:27:22.881387+0000","last_fullsized":"2024-05-08T05:27:22.881387+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_clean_scrub_stamp":"2024-05-08T05:25:33.008741+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T14:46:05.056610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1a","version":"80'3","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:26:24.127545+0000","last_change":"2024-05-08T05:25:30.009289+0000","last_active":"2024-05-08T05:26:24.127545+0000","last_peered":"2024-05-08T05:26:24.127545+0000","last_clean":"2024-05-08T05:26:24.127545+0000","last_became_active":"2024-05-08T05:25:30.008856+0000","last_became_peered":"2024-05-08T05:25:30.008856+0000","last_unstale":"2024-05-08T05:26:24.127545+0000","last_undegraded":"2024-05-08T05:26:24.127545+0000","last_fullsized":"2024-05-08T05:26:24.127545+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:28.970901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:28.970901+0000","last_clean_scrub_stamp":"2024-05-08T05:25:28.970901+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T10:49:55.857415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"82'8","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:27:22.902854+0000","last_change":"2024-05-08T05:25:34.062532+0000","last_active":"2024-05-08T05:27:22.902854+0000","last_peered":"2024-05-08T05:27:22.902854+0000","last_clean":"2024-05-08T05:27:22.902854+0000","last_became_active":"2024-05-08T05:25:34.062246+0000","last_became_peered":"2024-05-08T05:25:34.062246+0000","last_unstale":"2024-05-08T05:27:22.902854+0000","last_undegraded":"2024-05-08T05:27:22.902854+0000","last_fullsized":"2024-05-08T05:27:22.902854+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_clean_scrub_stamp":"2024-05-08T05:25:33.008741+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T07:35:49.149411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"80'2","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:26:24.114481+0000","last_change":"2024-05-08T05:25:30.014336+0000","last_active":"2024-05-08T05:26:24.114481+0000","last_peered":"2024-05-08T05:26:24.114481+0000","last_clean":"2024-05-08T05:26:24.114481+0000","last_became_active":"2024-05-08T05:25:30.012147+0000","last_became_peered":"2024-05-08T05:25:30.012147+0000","last_unstale":"2024-05-08T05:26:24.114481+0000","last_undegraded":"2024-05-08T05:26:24.114481+0000","last_fullsized":"2024-05-08T05:26:24.114481+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:28.970901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:28.970901+0000","last_clean_scrub_stamp":"2024-05-08T05:25:28.970901+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T07:48:20.477581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"82'8","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:27:22.913329+0000","last_change":"2024-05-08T05:25:34.058947+0000","last_active":"2024-05-08T05:27:22.913329+0000","last_peered":"2024-05-08T05:27:22.913329+0000","last_clean":"2024-05-08T05:27:22.913329+0000","last_became_active":"2024-05-08T05:25:34.058626+0000","last_became_peered":"2024-05-08T05:25:34.058626+0000","last_unstale":"2024-05-08T05:27:22.913329+0000","last_undegraded":"2024-05-08T05:27:22.913329+0000","last_fullsized":"2024-05-08T05:27:22.913329+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_clean_scrub_stamp":"2024-05-08T05:25:33.008741+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T12:55:07.742707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"80'1","reported_seq":28,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:26:24.118168+0000","last_change":"2024-05-08T05:25:29.999201+0000","last_active":"2024-05-08T05:26:24.118168+0000","last_peered":"2024-05-08T05:26:24.118168+0000","last_clean":"2024-05-08T05:26:24.118168+0000","last_became_active":"2024-05-08T05:25:29.998819+0000","last_became_peered":"2024-05-08T05:25:29.998819+0000","last_unstale":"2024-05-08T05:26:24.118168+0000","last_undegraded":"2024-05-08T05:26:24.118168+0000","last_fullsized":"2024-05-08T05:26:24.118168+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:28.970901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:28.970901+0000","last_clean_scrub_stamp":"2024-05-08T05:25:28.970901+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T09:00:02.831877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"82'11","reported_seq":32,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:27:22.906445+0000","last_change":"2024-05-08T05:25:34.063770+0000","last_active":"2024-05-08T05:27:22.906445+0000","last_peered":"2024-05-08T05:27:22.906445+0000","last_clean":"2024-05-08T05:27:22.906445+0000","last_became_active":"2024-05-08T05:25:34.061591+0000","last_became_peered":"2024-05-08T05:25:34.061591+0000","last_unstale":"2024-05-08T05:27:22.906445+0000","last_undegraded":"2024-05-08T05:27:22.906445+0000","last_fullsized":"2024-05-08T05:27:22.906445+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_clean_scrub_stamp":"2024-05-08T05:25:33.008741+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T16:51:06.593857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"82'4","reported_seq":234,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:29:17.268696+0000","last_change":"2024-05-08T05:25:30.005678+0000","last_active":"2024-05-08T05:29:17.268696+0000","last_peered":"2024-05-08T05:29:17.268696+0000","last_clean":"2024-05-08T05:29:17.268696+0000","last_became_active":"2024-05-08T05:25:30.005218+0000","last_became_peered":"2024-05-08T05:25:30.005218+0000","last_unstale":"2024-05-08T05:29:17.268696+0000","last_undegraded":"2024-05-08T05:29:17.268696+0000","last_fullsized":"2024-05-08T05:29:17.268696+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:28.970901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:28.970901+0000","last_clean_scrub_stamp":"2024-05-08T05:25:28.970901+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T11:44:56.720663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":203,"num_read_kb":203,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"82'10","reported_seq":31,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:27:22.901986+0000","last_change":"2024-05-08T05:25:34.058640+0000","last_active":"2024-05-08T05:27:22.901986+0000","last_peered":"2024-05-08T05:27:22.901986+0000","last_clean":"2024-05-08T05:27:22.901986+0000","last_became_active":"2024-05-08T05:25:34.058332+0000","last_became_peered":"2024-05-08T05:25:34.058332+0000","last_unstale":"2024-05-08T05:27:22.901986+0000","last_undegraded":"2024-05-08T05:27:22.901986+0000","last_fullsized":"2024-05-08T05:27:22.901986+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_clean_scrub_stamp":"2024-05-08T05:25:33.008741+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T09:21:44.273684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"80'2","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:26:24.115870+0000","last_change":"2024-05-08T05:25:30.000229+0000","last_active":"2024-05-08T05:26:24.115870+0000","last_peered":"2024-05-08T05:26:24.115870+0000","last_clean":"2024-05-08T05:26:24.115870+0000","last_became_active":"2024-05-08T05:25:29.999888+0000","last_became_peered":"2024-05-08T05:25:29.999888+0000","last_unstale":"2024-05-08T05:26:24.115870+0000","last_undegraded":"2024-05-08T05:26:24.115870+0000","last_fullsized":"2024-05-08T05:26:24.115870+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:28.970901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:28.970901+0000","last_clean_scrub_stamp":"2024-05-08T05:25:28.970901+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T10:28:02.849791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"82'9","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:27:22.918728+0000","last_change":"2024-05-08T05:25:34.069600+0000","last_active":"2024-05-08T05:27:22.918728+0000","last_peered":"2024-05-08T05:27:22.918728+0000","last_clean":"2024-05-08T05:27:22.918728+0000","last_became_active":"2024-05-08T05:25:34.069055+0000","last_became_peered":"2024-05-08T05:25:34.069055+0000","last_unstale":"2024-05-08T05:27:22.918728+0000","last_undegraded":"2024-05-08T05:27:22.918728+0000","last_fullsized":"2024-05-08T05:27:22.918728+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_clean_scrub_stamp":"2024-05-08T05:25:33.008741+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T10:22:31.166719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"80'4","reported_seq":32,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:26:24.118776+0000","last_change":"2024-05-08T05:25:30.360911+0000","last_active":"2024-05-08T05:26:24.118776+0000","last_peered":"2024-05-08T05:26:24.118776+0000","last_clean":"2024-05-08T05:26:24.118776+0000","last_became_active":"2024-05-08T05:25:30.360544+0000","last_became_peered":"2024-05-08T05:25:30.360544+0000","last_unstale":"2024-05-08T05:26:24.118776+0000","last_undegraded":"2024-05-08T05:26:24.118776+0000","last_fullsized":"2024-05-08T05:26:24.118776+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:28.970901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:28.970901+0000","last_clean_scrub_stamp":"2024-05-08T05:25:28.970901+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T17:03:10.633420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"82'11","reported_seq":32,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:27:22.903262+0000","last_change":"2024-05-08T05:25:34.058259+0000","last_active":"2024-05-08T05:27:22.903262+0000","last_peered":"2024-05-08T05:27:22.903262+0000","last_clean":"2024-05-08T05:27:22.903262+0000","last_became_active":"2024-05-08T05:25:34.057912+0000","last_became_peered":"2024-05-08T05:25:34.057912+0000","last_unstale":"2024-05-08T05:27:22.903262+0000","last_undegraded":"2024-05-08T05:27:22.903262+0000","last_fullsized":"2024-05-08T05:27:22.903262+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_clean_scrub_stamp":"2024-05-08T05:25:33.008741+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T14:58:49.311769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"82'37","reported_seq":483,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:29:18.279757+0000","last_change":"2024-05-08T05:25:30.001177+0000","last_active":"2024-05-08T05:29:18.279757+0000","last_peered":"2024-05-08T05:29:18.279757+0000","last_clean":"2024-05-08T05:29:18.279757+0000","last_became_active":"2024-05-08T05:25:30.000769+0000","last_became_peered":"2024-05-08T05:25:30.000769+0000","last_unstale":"2024-05-08T05:29:18.279757+0000","last_undegraded":"2024-05-08T05:29:18.279757+0000","last_fullsized":"2024-05-08T05:29:18.279757+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:28.970901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:28.970901+0000","last_clean_scrub_stamp":"2024-05-08T05:25:28.970901+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T14:40:35.540270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70142,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":419,"num_read_kb":279,"num_write":38,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"82'6","reported_seq":27,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:27:22.888709+0000","last_change":"2024-05-08T05:25:34.053366+0000","last_active":"2024-05-08T05:27:22.888709+0000","last_peered":"2024-05-08T05:27:22.888709+0000","last_clean":"2024-05-08T05:27:22.888709+0000","last_became_active":"2024-05-08T05:25:34.052485+0000","last_became_peered":"2024-05-08T05:25:34.052485+0000","last_unstale":"2024-05-08T05:27:22.888709+0000","last_undegraded":"2024-05-08T05:27:22.888709+0000","last_fullsized":"2024-05-08T05:27:22.888709+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_clean_scrub_stamp":"2024-05-08T05:25:33.008741+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T07:35:05.603319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"80'6","reported_seq":34,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:26:24.115427+0000","last_change":"2024-05-08T05:25:30.010453+0000","last_active":"2024-05-08T05:26:24.115427+0000","last_peered":"2024-05-08T05:26:24.115427+0000","last_clean":"2024-05-08T05:26:24.115427+0000","last_became_active":"2024-05-08T05:25:30.010032+0000","last_became_peered":"2024-05-08T05:25:30.010032+0000","last_unstale":"2024-05-08T05:26:24.115427+0000","last_undegraded":"2024-05-08T05:26:24.115427+0000","last_fullsized":"2024-05-08T05:26:24.115427+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:28.970901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:28.970901+0000","last_clean_scrub_stamp":"2024-05-08T05:25:28.970901+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T16:34:35.052481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"82'9","reported_seq":36,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:27:22.904364+0000","last_change":"2024-05-08T05:26:24.134959+0000","last_active":"2024-05-08T05:27:22.904364+0000","last_peered":"2024-05-08T05:27:22.904364+0000","last_clean":"2024-05-08T05:27:22.904364+0000","last_became_active":"2024-05-08T05:26:24.134487+0000","last_became_peered":"2024-05-08T05:26:24.134487+0000","last_unstale":"2024-05-08T05:27:22.904364+0000","last_undegraded":"2024-05-08T05:27:22.904364+0000","last_fullsized":"2024-05-08T05:27:22.904364+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_clean_scrub_stamp":"2024-05-08T05:25:33.008741+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T06:46:55.131407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,9],"acting":[6,7,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"80'3","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:26:24.118218+0000","last_change":"2024-05-08T05:25:30.009768+0000","last_active":"2024-05-08T05:26:24.118218+0000","last_peered":"2024-05-08T05:26:24.118218+0000","last_clean":"2024-05-08T05:26:24.118218+0000","last_became_active":"2024-05-08T05:25:30.009385+0000","last_became_peered":"2024-05-08T05:25:30.009385+0000","last_unstale":"2024-05-08T05:26:24.118218+0000","last_undegraded":"2024-05-08T05:26:24.118218+0000","last_fullsized":"2024-05-08T05:26:24.118218+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:28.970901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:28.970901+0000","last_clean_scrub_stamp":"2024-05-08T05:25:28.970901+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T07:19:19.556003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"82'15","reported_seq":36,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:27:22.912117+0000","last_change":"2024-05-08T05:25:34.055704+0000","last_active":"2024-05-08T05:27:22.912117+0000","last_peered":"2024-05-08T05:27:22.912117+0000","last_clean":"2024-05-08T05:27:22.912117+0000","last_became_active":"2024-05-08T05:25:34.055339+0000","last_became_peered":"2024-05-08T05:25:34.055339+0000","last_unstale":"2024-05-08T05:27:22.912117+0000","last_undegraded":"2024-05-08T05:27:22.912117+0000","last_fullsized":"2024-05-08T05:27:22.912117+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_clean_scrub_stamp":"2024-05-08T05:25:33.008741+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T07:21:52.579094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"82'6","reported_seq":241,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:29:17.408189+0000","last_change":"2024-05-08T05:25:29.998631+0000","last_active":"2024-05-08T05:29:17.408189+0000","last_peered":"2024-05-08T05:29:17.408189+0000","last_clean":"2024-05-08T05:29:17.408189+0000","last_became_active":"2024-05-08T05:25:29.998216+0000","last_became_peered":"2024-05-08T05:25:29.998216+0000","last_unstale":"2024-05-08T05:29:17.408189+0000","last_undegraded":"2024-05-08T05:29:17.408189+0000","last_fullsized":"2024-05-08T05:29:17.408189+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:28.970901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:28.970901+0000","last_clean_scrub_stamp":"2024-05-08T05:25:28.970901+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T14:16:58.252604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1430,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":209,"num_read_kb":6,"num_write":5,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"82'6","reported_seq":27,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:27:22.890182+0000","last_change":"2024-05-08T05:25:34.053216+0000","last_active":"2024-05-08T05:27:22.890182+0000","last_peered":"2024-05-08T05:27:22.890182+0000","last_clean":"2024-05-08T05:27:22.890182+0000","last_became_active":"2024-05-08T05:25:34.052908+0000","last_became_peered":"2024-05-08T05:25:34.052908+0000","last_unstale":"2024-05-08T05:27:22.890182+0000","last_undegraded":"2024-05-08T05:27:22.890182+0000","last_fullsized":"2024-05-08T05:27:22.890182+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_clean_scrub_stamp":"2024-05-08T05:25:33.008741+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T13:01:42.574200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"80'15","reported_seq":43,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:26:24.116096+0000","last_change":"2024-05-08T05:25:30.356349+0000","last_active":"2024-05-08T05:26:24.116096+0000","last_peered":"2024-05-08T05:26:24.116096+0000","last_clean":"2024-05-08T05:26:24.116096+0000","last_became_active":"2024-05-08T05:25:30.355892+0000","last_became_peered":"2024-05-08T05:25:30.355892+0000","last_unstale":"2024-05-08T05:26:24.116096+0000","last_undegraded":"2024-05-08T05:26:24.116096+0000","last_fullsized":"2024-05-08T05:26:24.116096+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:28.970901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:28.970901+0000","last_clean_scrub_stamp":"2024-05-08T05:25:28.970901+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T16:54:22.322606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"82'6","reported_seq":27,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:27:22.904730+0000","last_change":"2024-05-08T05:25:34.062254+0000","last_active":"2024-05-08T05:27:22.904730+0000","last_peered":"2024-05-08T05:27:22.904730+0000","last_clean":"2024-05-08T05:27:22.904730+0000","last_became_active":"2024-05-08T05:25:34.061928+0000","last_became_peered":"2024-05-08T05:25:34.061928+0000","last_unstale":"2024-05-08T05:27:22.904730+0000","last_undegraded":"2024-05-08T05:27:22.904730+0000","last_fullsized":"2024-05-08T05:27:22.904730+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_clean_scrub_stamp":"2024-05-08T05:25:33.008741+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T14:58:17.135661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"80'2","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:26:24.116424+0000","last_change":"2024-05-08T05:25:30.001434+0000","last_active":"2024-05-08T05:26:24.116424+0000","last_peered":"2024-05-08T05:26:24.116424+0000","last_clean":"2024-05-08T05:26:24.116424+0000","last_became_active":"2024-05-08T05:25:30.000900+0000","last_became_peered":"2024-05-08T05:25:30.000900+0000","last_unstale":"2024-05-08T05:26:24.116424+0000","last_undegraded":"2024-05-08T05:26:24.116424+0000","last_fullsized":"2024-05-08T05:26:24.116424+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:28.970901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:28.970901+0000","last_clean_scrub_stamp":"2024-05-08T05:25:28.970901+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T11:47:18.031222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"82'5","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:27:22.889034+0000","last_change":"2024-05-08T05:25:34.057101+0000","last_active":"2024-05-08T05:27:22.889034+0000","last_peered":"2024-05-08T05:27:22.889034+0000","last_clean":"2024-05-08T05:27:22.889034+0000","last_became_active":"2024-05-08T05:25:34.056742+0000","last_became_peered":"2024-05-08T05:25:34.056742+0000","last_unstale":"2024-05-08T05:27:22.889034+0000","last_undegraded":"2024-05-08T05:27:22.889034+0000","last_fullsized":"2024-05-08T05:27:22.889034+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_clean_scrub_stamp":"2024-05-08T05:25:33.008741+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T14:19:22.997586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":27,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:26:24.133876+0000","last_change":"2024-05-08T05:25:30.359474+0000","last_active":"2024-05-08T05:26:24.133876+0000","last_peered":"2024-05-08T05:26:24.133876+0000","last_clean":"2024-05-08T05:26:24.133876+0000","last_became_active":"2024-05-08T05:25:30.358971+0000","last_became_peered":"2024-05-08T05:25:30.358971+0000","last_unstale":"2024-05-08T05:26:24.133876+0000","last_undegraded":"2024-05-08T05:26:24.133876+0000","last_fullsized":"2024-05-08T05:26:24.133876+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:28.970901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:28.970901+0000","last_clean_scrub_stamp":"2024-05-08T05:25:28.970901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T12:51:42.239112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"82'5","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:27:22.909599+0000","last_change":"2024-05-08T05:25:34.061014+0000","last_active":"2024-05-08T05:27:22.909599+0000","last_peered":"2024-05-08T05:27:22.909599+0000","last_clean":"2024-05-08T05:27:22.909599+0000","last_became_active":"2024-05-08T05:25:34.060682+0000","last_became_peered":"2024-05-08T05:25:34.060682+0000","last_unstale":"2024-05-08T05:27:22.909599+0000","last_undegraded":"2024-05-08T05:27:22.909599+0000","last_fullsized":"2024-05-08T05:27:22.909599+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_clean_scrub_stamp":"2024-05-08T05:25:33.008741+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T13:19:48.652257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"80'1","reported_seq":28,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:26:24.116079+0000","last_change":"2024-05-08T05:25:30.009360+0000","last_active":"2024-05-08T05:26:24.116079+0000","last_peered":"2024-05-08T05:26:24.116079+0000","last_clean":"2024-05-08T05:26:24.116079+0000","last_became_active":"2024-05-08T05:25:30.008806+0000","last_became_peered":"2024-05-08T05:25:30.008806+0000","last_unstale":"2024-05-08T05:26:24.116079+0000","last_undegraded":"2024-05-08T05:26:24.116079+0000","last_fullsized":"2024-05-08T05:26:24.116079+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:28.970901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:28.970901+0000","last_clean_scrub_stamp":"2024-05-08T05:25:28.970901+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T11:19:45.905803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"82'7","reported_seq":28,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:27:22.902064+0000","last_change":"2024-05-08T05:25:34.065415+0000","last_active":"2024-05-08T05:27:22.902064+0000","last_peered":"2024-05-08T05:27:22.902064+0000","last_clean":"2024-05-08T05:27:22.902064+0000","last_became_active":"2024-05-08T05:25:34.065017+0000","last_became_peered":"2024-05-08T05:25:34.065017+0000","last_unstale":"2024-05-08T05:27:22.902064+0000","last_undegraded":"2024-05-08T05:27:22.902064+0000","last_fullsized":"2024-05-08T05:27:22.902064+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_clean_scrub_stamp":"2024-05-08T05:25:33.008741+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T14:46:34.518792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.0","version":"82'8","reported_seq":35,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:27:22.887996+0000","last_change":"2024-05-08T05:26:24.120480+0000","last_active":"2024-05-08T05:27:22.887996+0000","last_peered":"2024-05-08T05:27:22.887996+0000","last_clean":"2024-05-08T05:27:22.887996+0000","last_became_active":"2024-05-08T05:26:24.120031+0000","last_became_peered":"2024-05-08T05:26:24.120031+0000","last_unstale":"2024-05-08T05:27:22.887996+0000","last_undegraded":"2024-05-08T05:27:22.887996+0000","last_fullsized":"2024-05-08T05:27:22.887996+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_clean_scrub_stamp":"2024-05-08T05:25:33.008741+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T09:24:18.149796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,8],"acting":[5,2,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"82'6","reported_seq":239,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:29:20.413787+0000","last_change":"2024-05-08T05:25:30.356178+0000","last_active":"2024-05-08T05:29:20.413787+0000","last_peered":"2024-05-08T05:29:20.413787+0000","last_clean":"2024-05-08T05:29:20.413787+0000","last_became_active":"2024-05-08T05:25:30.355750+0000","last_became_peered":"2024-05-08T05:25:30.355750+0000","last_unstale":"2024-05-08T05:29:20.413787+0000","last_undegraded":"2024-05-08T05:29:20.413787+0000","last_fullsized":"2024-05-08T05:29:20.413787+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:28.970901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:28.970901+0000","last_clean_scrub_stamp":"2024-05-08T05:25:28.970901+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T05:57:35.174274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":206,"num_read_kb":206,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"82'8","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:27:22.906527+0000","last_change":"2024-05-08T05:25:34.068189+0000","last_active":"2024-05-08T05:27:22.906527+0000","last_peered":"2024-05-08T05:27:22.906527+0000","last_clean":"2024-05-08T05:27:22.906527+0000","last_became_active":"2024-05-08T05:25:34.064398+0000","last_became_peered":"2024-05-08T05:25:34.064398+0000","last_unstale":"2024-05-08T05:27:22.906527+0000","last_undegraded":"2024-05-08T05:27:22.906527+0000","last_fullsized":"2024-05-08T05:27:22.906527+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_clean_scrub_stamp":"2024-05-08T05:25:33.008741+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T10:27:31.050126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"80'3","reported_seq":32,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:26:24.126812+0000","last_change":"2024-05-08T05:25:30.005110+0000","last_active":"2024-05-08T05:26:24.126812+0000","last_peered":"2024-05-08T05:26:24.126812+0000","last_clean":"2024-05-08T05:26:24.126812+0000","last_became_active":"2024-05-08T05:25:30.004703+0000","last_became_peered":"2024-05-08T05:25:30.004703+0000","last_unstale":"2024-05-08T05:26:24.126812+0000","last_undegraded":"2024-05-08T05:26:24.126812+0000","last_fullsized":"2024-05-08T05:26:24.126812+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:28.970901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:28.970901+0000","last_clean_scrub_stamp":"2024-05-08T05:25:28.970901+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T12:49:21.174417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"21'92","reported_seq":102,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:26:38.132162+0000","last_change":"2024-05-08T05:23:59.731023+0000","last_active":"2024-05-08T05:26:38.132162+0000","last_peered":"2024-05-08T05:26:38.132162+0000","last_clean":"2024-05-08T05:26:38.132162+0000","last_became_active":"2024-05-08T05:23:59.725321+0000","last_became_peered":"2024-05-08T05:23:59.725321+0000","last_unstale":"2024-05-08T05:26:38.132162+0000","last_undegraded":"2024-05-08T05:26:38.132162+0000","last_fullsized":"2024-05-08T05:26:38.132162+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:20:09.357011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:20:09.357011+0000","last_clean_scrub_stamp":"2024-05-08T05:20:09.357011+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T09:50:58.729815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"82'5","reported_seq":32,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:27:22.899430+0000","last_change":"2024-05-08T05:26:24.131360+0000","last_active":"2024-05-08T05:27:22.899430+0000","last_peered":"2024-05-08T05:27:22.899430+0000","last_clean":"2024-05-08T05:27:22.899430+0000","last_became_active":"2024-05-08T05:26:24.130480+0000","last_became_peered":"2024-05-08T05:26:24.130480+0000","last_unstale":"2024-05-08T05:27:22.899430+0000","last_undegraded":"2024-05-08T05:27:22.899430+0000","last_fullsized":"2024-05-08T05:27:22.899430+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_clean_scrub_stamp":"2024-05-08T05:25:33.008741+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T09:26:32.515332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,9,2],"acting":[6,9,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"80'3","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:26:24.115792+0000","last_change":"2024-05-08T05:25:29.999659+0000","last_active":"2024-05-08T05:26:24.115792+0000","last_peered":"2024-05-08T05:26:24.115792+0000","last_clean":"2024-05-08T05:26:24.115792+0000","last_became_active":"2024-05-08T05:25:29.999299+0000","last_became_peered":"2024-05-08T05:25:29.999299+0000","last_unstale":"2024-05-08T05:26:24.115792+0000","last_undegraded":"2024-05-08T05:26:24.115792+0000","last_fullsized":"2024-05-08T05:26:24.115792+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:28.970901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:28.970901+0000","last_clean_scrub_stamp":"2024-05-08T05:25:28.970901+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T11:20:16.513402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"80'1","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:26:24.116094+0000","last_change":"2024-05-08T05:25:30.360940+0000","last_active":"2024-05-08T05:26:24.116094+0000","last_peered":"2024-05-08T05:26:24.116094+0000","last_clean":"2024-05-08T05:26:24.116094+0000","last_became_active":"2024-05-08T05:25:30.360507+0000","last_became_peered":"2024-05-08T05:25:30.360507+0000","last_unstale":"2024-05-08T05:26:24.116094+0000","last_undegraded":"2024-05-08T05:26:24.116094+0000","last_fullsized":"2024-05-08T05:26:24.116094+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:28.970901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:28.970901+0000","last_clean_scrub_stamp":"2024-05-08T05:25:28.970901+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T06:49:39.271211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"82'9","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:27:22.902224+0000","last_change":"2024-05-08T05:25:34.056952+0000","last_active":"2024-05-08T05:27:22.902224+0000","last_peered":"2024-05-08T05:27:22.902224+0000","last_clean":"2024-05-08T05:27:22.902224+0000","last_became_active":"2024-05-08T05:25:34.056495+0000","last_became_peered":"2024-05-08T05:25:34.056495+0000","last_unstale":"2024-05-08T05:27:22.902224+0000","last_undegraded":"2024-05-08T05:27:22.902224+0000","last_fullsized":"2024-05-08T05:27:22.902224+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_clean_scrub_stamp":"2024-05-08T05:25:33.008741+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T09:35:22.540178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"82'13","reported_seq":40,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:27:41.531532+0000","last_change":"2024-05-08T05:25:30.008967+0000","last_active":"2024-05-08T05:27:41.531532+0000","last_peered":"2024-05-08T05:27:41.531532+0000","last_clean":"2024-05-08T05:27:41.531532+0000","last_became_active":"2024-05-08T05:25:30.007542+0000","last_became_peered":"2024-05-08T05:25:30.007542+0000","last_unstale":"2024-05-08T05:27:41.531532+0000","last_undegraded":"2024-05-08T05:27:41.531532+0000","last_fullsized":"2024-05-08T05:27:41.531532+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:28.970901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:28.970901+0000","last_clean_scrub_stamp":"2024-05-08T05:25:28.970901+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T05:29:30.191842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"82'5","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:27:22.902209+0000","last_change":"2024-05-08T05:25:34.054334+0000","last_active":"2024-05-08T05:27:22.902209+0000","last_peered":"2024-05-08T05:27:22.902209+0000","last_clean":"2024-05-08T05:27:22.902209+0000","last_became_active":"2024-05-08T05:25:34.053989+0000","last_became_peered":"2024-05-08T05:25:34.053989+0000","last_unstale":"2024-05-08T05:27:22.902209+0000","last_undegraded":"2024-05-08T05:27:22.902209+0000","last_fullsized":"2024-05-08T05:27:22.902209+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_clean_scrub_stamp":"2024-05-08T05:25:33.008741+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T09:03:25.683445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"80'4","reported_seq":31,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:26:24.127039+0000","last_change":"2024-05-08T05:25:30.007144+0000","last_active":"2024-05-08T05:26:24.127039+0000","last_peered":"2024-05-08T05:26:24.127039+0000","last_clean":"2024-05-08T05:26:24.127039+0000","last_became_active":"2024-05-08T05:25:30.006878+0000","last_became_peered":"2024-05-08T05:25:30.006878+0000","last_unstale":"2024-05-08T05:26:24.127039+0000","last_undegraded":"2024-05-08T05:26:24.127039+0000","last_fullsized":"2024-05-08T05:26:24.127039+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:28.970901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:28.970901+0000","last_clean_scrub_stamp":"2024-05-08T05:25:28.970901+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T07:06:35.573001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"82'7","reported_seq":28,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:27:22.914063+0000","last_change":"2024-05-08T05:25:34.073744+0000","last_active":"2024-05-08T05:27:22.914063+0000","last_peered":"2024-05-08T05:27:22.914063+0000","last_clean":"2024-05-08T05:27:22.914063+0000","last_became_active":"2024-05-08T05:25:34.073368+0000","last_became_peered":"2024-05-08T05:25:34.073368+0000","last_unstale":"2024-05-08T05:27:22.914063+0000","last_undegraded":"2024-05-08T05:27:22.914063+0000","last_fullsized":"2024-05-08T05:27:22.914063+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_clean_scrub_stamp":"2024-05-08T05:25:33.008741+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T10:43:31.480745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"80'2","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:26:24.112998+0000","last_change":"2024-05-08T05:25:30.356584+0000","last_active":"2024-05-08T05:26:24.112998+0000","last_peered":"2024-05-08T05:26:24.112998+0000","last_clean":"2024-05-08T05:26:24.112998+0000","last_became_active":"2024-05-08T05:25:30.356203+0000","last_became_peered":"2024-05-08T05:25:30.356203+0000","last_unstale":"2024-05-08T05:26:24.112998+0000","last_undegraded":"2024-05-08T05:26:24.112998+0000","last_fullsized":"2024-05-08T05:26:24.112998+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:28.970901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:28.970901+0000","last_clean_scrub_stamp":"2024-05-08T05:25:28.970901+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T14:35:21.193856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"82'2","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:27:22.887903+0000","last_change":"2024-05-08T05:25:34.053168+0000","last_active":"2024-05-08T05:27:22.887903+0000","last_peered":"2024-05-08T05:27:22.887903+0000","last_clean":"2024-05-08T05:27:22.887903+0000","last_became_active":"2024-05-08T05:25:34.052875+0000","last_became_peered":"2024-05-08T05:25:34.052875+0000","last_unstale":"2024-05-08T05:27:22.887903+0000","last_undegraded":"2024-05-08T05:27:22.887903+0000","last_fullsized":"2024-05-08T05:27:22.887903+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_clean_scrub_stamp":"2024-05-08T05:25:33.008741+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T07:38:40.129212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"80'3","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:26:24.121861+0000","last_change":"2024-05-08T05:25:30.009113+0000","last_active":"2024-05-08T05:26:24.121861+0000","last_peered":"2024-05-08T05:26:24.121861+0000","last_clean":"2024-05-08T05:26:24.121861+0000","last_became_active":"2024-05-08T05:25:30.007605+0000","last_became_peered":"2024-05-08T05:25:30.007605+0000","last_unstale":"2024-05-08T05:26:24.121861+0000","last_undegraded":"2024-05-08T05:26:24.121861+0000","last_fullsized":"2024-05-08T05:26:24.121861+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:28.970901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:28.970901+0000","last_clean_scrub_stamp":"2024-05-08T05:25:28.970901+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T10:06:05.177516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"82'9","reported_seq":28,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:27:22.911359+0000","last_change":"2024-05-08T05:25:34.072765+0000","last_active":"2024-05-08T05:27:22.911359+0000","last_peered":"2024-05-08T05:27:22.911359+0000","last_clean":"2024-05-08T05:27:22.911359+0000","last_became_active":"2024-05-08T05:25:34.072381+0000","last_became_peered":"2024-05-08T05:25:34.072381+0000","last_unstale":"2024-05-08T05:27:22.911359+0000","last_undegraded":"2024-05-08T05:27:22.911359+0000","last_fullsized":"2024-05-08T05:27:22.911359+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_clean_scrub_stamp":"2024-05-08T05:25:33.008741+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T11:55:21.046126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"80'1","reported_seq":16,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:26:27.357620+0000","last_change":"2024-05-08T05:26:24.124762+0000","last_active":"2024-05-08T05:26:27.357620+0000","last_peered":"2024-05-08T05:26:27.357620+0000","last_clean":"2024-05-08T05:26:27.357620+0000","last_became_active":"2024-05-08T05:26:24.121235+0000","last_became_peered":"2024-05-08T05:26:24.121235+0000","last_unstale":"2024-05-08T05:26:27.357620+0000","last_undegraded":"2024-05-08T05:26:27.357620+0000","last_fullsized":"2024-05-08T05:26:27.357620+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:28.970901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:28.970901+0000","last_clean_scrub_stamp":"2024-05-08T05:25:28.970901+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T16:08:17.650335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,3,8],"acting":[11,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.b","version":"82'8","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:27:22.914232+0000","last_change":"2024-05-08T05:25:34.071097+0000","last_active":"2024-05-08T05:27:22.914232+0000","last_peered":"2024-05-08T05:27:22.914232+0000","last_clean":"2024-05-08T05:27:22.914232+0000","last_became_active":"2024-05-08T05:25:34.070635+0000","last_became_peered":"2024-05-08T05:25:34.070635+0000","last_unstale":"2024-05-08T05:27:22.914232+0000","last_undegraded":"2024-05-08T05:27:22.914232+0000","last_fullsized":"2024-05-08T05:27:22.914232+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_clean_scrub_stamp":"2024-05-08T05:25:33.008741+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T13:33:17.217958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"80'4","reported_seq":32,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:26:24.116727+0000","last_change":"2024-05-08T05:25:30.002043+0000","last_active":"2024-05-08T05:26:24.116727+0000","last_peered":"2024-05-08T05:26:24.116727+0000","last_clean":"2024-05-08T05:26:24.116727+0000","last_became_active":"2024-05-08T05:25:30.001624+0000","last_became_peered":"2024-05-08T05:25:30.001624+0000","last_unstale":"2024-05-08T05:26:24.116727+0000","last_undegraded":"2024-05-08T05:26:24.116727+0000","last_fullsized":"2024-05-08T05:26:24.116727+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:28.970901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:28.970901+0000","last_clean_scrub_stamp":"2024-05-08T05:25:28.970901+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T07:20:34.740005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"82'5","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:27:22.910044+0000","last_change":"2024-05-08T05:25:34.057883+0000","last_active":"2024-05-08T05:27:22.910044+0000","last_peered":"2024-05-08T05:27:22.910044+0000","last_clean":"2024-05-08T05:27:22.910044+0000","last_became_active":"2024-05-08T05:25:34.056651+0000","last_became_peered":"2024-05-08T05:25:34.056651+0000","last_unstale":"2024-05-08T05:27:22.910044+0000","last_undegraded":"2024-05-08T05:27:22.910044+0000","last_fullsized":"2024-05-08T05:27:22.910044+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_clean_scrub_stamp":"2024-05-08T05:25:33.008741+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T16:52:46.598847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"80'3","reported_seq":31,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:26:24.116077+0000","last_change":"2024-05-08T05:25:30.356166+0000","last_active":"2024-05-08T05:26:24.116077+0000","last_peered":"2024-05-08T05:26:24.116077+0000","last_clean":"2024-05-08T05:26:24.116077+0000","last_became_active":"2024-05-08T05:25:30.355730+0000","last_became_peered":"2024-05-08T05:25:30.355730+0000","last_unstale":"2024-05-08T05:26:24.116077+0000","last_undegraded":"2024-05-08T05:26:24.116077+0000","last_fullsized":"2024-05-08T05:26:24.116077+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:28.970901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:28.970901+0000","last_clean_scrub_stamp":"2024-05-08T05:25:28.970901+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T05:47:47.743725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"82'7","reported_seq":28,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:27:22.905417+0000","last_change":"2024-05-08T05:25:34.058005+0000","last_active":"2024-05-08T05:27:22.905417+0000","last_peered":"2024-05-08T05:27:22.905417+0000","last_clean":"2024-05-08T05:27:22.905417+0000","last_became_active":"2024-05-08T05:25:34.056319+0000","last_became_peered":"2024-05-08T05:25:34.056319+0000","last_unstale":"2024-05-08T05:27:22.905417+0000","last_undegraded":"2024-05-08T05:27:22.905417+0000","last_fullsized":"2024-05-08T05:27:22.905417+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_clean_scrub_stamp":"2024-05-08T05:25:33.008741+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T07:04:22.726450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"80'1","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:26:24.118635+0000","last_change":"2024-05-08T05:25:30.009641+0000","last_active":"2024-05-08T05:26:24.118635+0000","last_peered":"2024-05-08T05:26:24.118635+0000","last_clean":"2024-05-08T05:26:24.118635+0000","last_became_active":"2024-05-08T05:25:30.009244+0000","last_became_peered":"2024-05-08T05:25:30.009244+0000","last_unstale":"2024-05-08T05:26:24.118635+0000","last_undegraded":"2024-05-08T05:26:24.118635+0000","last_fullsized":"2024-05-08T05:26:24.118635+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:28.970901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:28.970901+0000","last_clean_scrub_stamp":"2024-05-08T05:25:28.970901+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T17:15:50.982103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"82'7","reported_seq":28,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:27:22.909297+0000","last_change":"2024-05-08T05:25:34.059603+0000","last_active":"2024-05-08T05:27:22.909297+0000","last_peered":"2024-05-08T05:27:22.909297+0000","last_clean":"2024-05-08T05:27:22.909297+0000","last_became_active":"2024-05-08T05:25:34.059260+0000","last_became_peered":"2024-05-08T05:25:34.059260+0000","last_unstale":"2024-05-08T05:27:22.909297+0000","last_undegraded":"2024-05-08T05:27:22.909297+0000","last_fullsized":"2024-05-08T05:27:22.909297+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_clean_scrub_stamp":"2024-05-08T05:25:33.008741+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T07:47:32.723829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"80'2","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:26:24.117157+0000","last_change":"2024-05-08T05:25:30.013326+0000","last_active":"2024-05-08T05:26:24.117157+0000","last_peered":"2024-05-08T05:26:24.117157+0000","last_clean":"2024-05-08T05:26:24.117157+0000","last_became_active":"2024-05-08T05:25:30.012868+0000","last_became_peered":"2024-05-08T05:25:30.012868+0000","last_unstale":"2024-05-08T05:26:24.117157+0000","last_undegraded":"2024-05-08T05:26:24.117157+0000","last_fullsized":"2024-05-08T05:26:24.117157+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:28.970901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:28.970901+0000","last_clean_scrub_stamp":"2024-05-08T05:25:28.970901+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T14:09:14.210180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"82'9","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:27:22.891022+0000","last_change":"2024-05-08T05:25:34.052621+0000","last_active":"2024-05-08T05:27:22.891022+0000","last_peered":"2024-05-08T05:27:22.891022+0000","last_clean":"2024-05-08T05:27:22.891022+0000","last_became_active":"2024-05-08T05:25:34.052289+0000","last_became_peered":"2024-05-08T05:25:34.052289+0000","last_unstale":"2024-05-08T05:27:22.891022+0000","last_undegraded":"2024-05-08T05:27:22.891022+0000","last_fullsized":"2024-05-08T05:27:22.891022+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_clean_scrub_stamp":"2024-05-08T05:25:33.008741+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T16:37:19.327915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"82'9","reported_seq":28,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:27:22.890913+0000","last_change":"2024-05-08T05:25:34.057918+0000","last_active":"2024-05-08T05:27:22.890913+0000","last_peered":"2024-05-08T05:27:22.890913+0000","last_clean":"2024-05-08T05:27:22.890913+0000","last_became_active":"2024-05-08T05:25:34.057455+0000","last_became_peered":"2024-05-08T05:25:34.057455+0000","last_unstale":"2024-05-08T05:27:22.890913+0000","last_undegraded":"2024-05-08T05:27:22.890913+0000","last_fullsized":"2024-05-08T05:27:22.890913+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_clean_scrub_stamp":"2024-05-08T05:25:33.008741+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T11:36:49.027414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"82'12","reported_seq":33,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:27:22.903184+0000","last_change":"2024-05-08T05:25:34.055114+0000","last_active":"2024-05-08T05:27:22.903184+0000","last_peered":"2024-05-08T05:27:22.903184+0000","last_clean":"2024-05-08T05:27:22.903184+0000","last_became_active":"2024-05-08T05:25:34.054448+0000","last_became_peered":"2024-05-08T05:25:34.054448+0000","last_unstale":"2024-05-08T05:27:22.903184+0000","last_undegraded":"2024-05-08T05:27:22.903184+0000","last_fullsized":"2024-05-08T05:27:22.903184+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_clean_scrub_stamp":"2024-05-08T05:25:33.008741+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T15:19:54.872779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"82'8","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:27:22.915661+0000","last_change":"2024-05-08T05:25:34.064199+0000","last_active":"2024-05-08T05:27:22.915661+0000","last_peered":"2024-05-08T05:27:22.915661+0000","last_clean":"2024-05-08T05:27:22.915661+0000","last_became_active":"2024-05-08T05:25:34.063888+0000","last_became_peered":"2024-05-08T05:25:34.063888+0000","last_unstale":"2024-05-08T05:27:22.915661+0000","last_undegraded":"2024-05-08T05:27:22.915661+0000","last_fullsized":"2024-05-08T05:27:22.915661+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_clean_scrub_stamp":"2024-05-08T05:25:33.008741+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T13:18:15.146769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"82'7","reported_seq":28,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:27:22.918372+0000","last_change":"2024-05-08T05:25:34.070526+0000","last_active":"2024-05-08T05:27:22.918372+0000","last_peered":"2024-05-08T05:27:22.918372+0000","last_clean":"2024-05-08T05:27:22.918372+0000","last_became_active":"2024-05-08T05:25:34.069890+0000","last_became_peered":"2024-05-08T05:25:34.069890+0000","last_unstale":"2024-05-08T05:27:22.918372+0000","last_undegraded":"2024-05-08T05:27:22.918372+0000","last_fullsized":"2024-05-08T05:27:22.918372+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_clean_scrub_stamp":"2024-05-08T05:25:33.008741+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T16:17:56.986221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"82'4","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:27:22.916202+0000","last_change":"2024-05-08T05:25:34.067033+0000","last_active":"2024-05-08T05:27:22.916202+0000","last_peered":"2024-05-08T05:27:22.916202+0000","last_clean":"2024-05-08T05:27:22.916202+0000","last_became_active":"2024-05-08T05:25:34.066492+0000","last_became_peered":"2024-05-08T05:25:34.066492+0000","last_unstale":"2024-05-08T05:27:22.916202+0000","last_undegraded":"2024-05-08T05:27:22.916202+0000","last_fullsized":"2024-05-08T05:27:22.916202+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_clean_scrub_stamp":"2024-05-08T05:25:33.008741+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T07:30:10.450504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"82'6","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:27:22.888388+0000","last_change":"2024-05-08T05:25:34.056525+0000","last_active":"2024-05-08T05:27:22.888388+0000","last_peered":"2024-05-08T05:27:22.888388+0000","last_clean":"2024-05-08T05:27:22.888388+0000","last_became_active":"2024-05-08T05:25:34.056190+0000","last_became_peered":"2024-05-08T05:25:34.056190+0000","last_unstale":"2024-05-08T05:27:22.888388+0000","last_undegraded":"2024-05-08T05:27:22.888388+0000","last_fullsized":"2024-05-08T05:27:22.888388+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_clean_scrub_stamp":"2024-05-08T05:25:33.008741+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T13:13:57.716642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"82'15","reported_seq":36,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:27:22.905265+0000","last_change":"2024-05-08T05:25:34.055643+0000","last_active":"2024-05-08T05:27:22.905265+0000","last_peered":"2024-05-08T05:27:22.905265+0000","last_clean":"2024-05-08T05:27:22.905265+0000","last_became_active":"2024-05-08T05:25:34.054886+0000","last_became_peered":"2024-05-08T05:25:34.054886+0000","last_unstale":"2024-05-08T05:27:22.905265+0000","last_undegraded":"2024-05-08T05:27:22.905265+0000","last_fullsized":"2024-05-08T05:27:22.905265+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_clean_scrub_stamp":"2024-05-08T05:25:33.008741+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T05:53:41.130484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"82'2","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:27:22.908627+0000","last_change":"2024-05-08T05:25:34.056932+0000","last_active":"2024-05-08T05:27:22.908627+0000","last_peered":"2024-05-08T05:27:22.908627+0000","last_clean":"2024-05-08T05:27:22.908627+0000","last_became_active":"2024-05-08T05:25:34.055473+0000","last_became_peered":"2024-05-08T05:25:34.055473+0000","last_unstale":"2024-05-08T05:27:22.908627+0000","last_undegraded":"2024-05-08T05:27:22.908627+0000","last_fullsized":"2024-05-08T05:27:22.908627+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_clean_scrub_stamp":"2024-05-08T05:25:33.008741+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T16:16:13.748056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"82'6","reported_seq":18,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:27:22.912006+0000","last_change":"2024-05-08T05:26:24.134794+0000","last_active":"2024-05-08T05:27:22.912006+0000","last_peered":"2024-05-08T05:27:22.912006+0000","last_clean":"2024-05-08T05:27:22.912006+0000","last_became_active":"2024-05-08T05:26:24.133586+0000","last_became_peered":"2024-05-08T05:26:24.133586+0000","last_unstale":"2024-05-08T05:27:22.912006+0000","last_undegraded":"2024-05-08T05:27:22.912006+0000","last_fullsized":"2024-05-08T05:27:22.912006+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_clean_scrub_stamp":"2024-05-08T05:25:33.008741+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T15:03:05.432689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,9,3],"acting":[6,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.29","version":"82'8","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:27:22.907706+0000","last_change":"2024-05-08T05:25:34.065000+0000","last_active":"2024-05-08T05:27:22.907706+0000","last_peered":"2024-05-08T05:27:22.907706+0000","last_clean":"2024-05-08T05:27:22.907706+0000","last_became_active":"2024-05-08T05:25:34.057748+0000","last_became_peered":"2024-05-08T05:25:34.057748+0000","last_unstale":"2024-05-08T05:27:22.907706+0000","last_undegraded":"2024-05-08T05:27:22.907706+0000","last_fullsized":"2024-05-08T05:27:22.907706+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_clean_scrub_stamp":"2024-05-08T05:25:33.008741+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T15:33:41.411507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"82'10","reported_seq":31,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:27:22.910969+0000","last_change":"2024-05-08T05:25:34.066601+0000","last_active":"2024-05-08T05:27:22.910969+0000","last_peered":"2024-05-08T05:27:22.910969+0000","last_clean":"2024-05-08T05:27:22.910969+0000","last_became_active":"2024-05-08T05:25:34.066226+0000","last_became_peered":"2024-05-08T05:25:34.066226+0000","last_unstale":"2024-05-08T05:27:22.910969+0000","last_undegraded":"2024-05-08T05:27:22.910969+0000","last_fullsized":"2024-05-08T05:27:22.910969+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_clean_scrub_stamp":"2024-05-08T05:25:33.008741+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T15:27:54.180580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"82'11","reported_seq":32,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:27:22.919075+0000","last_change":"2024-05-08T05:25:34.073520+0000","last_active":"2024-05-08T05:27:22.919075+0000","last_peered":"2024-05-08T05:27:22.919075+0000","last_clean":"2024-05-08T05:27:22.919075+0000","last_became_active":"2024-05-08T05:25:34.072250+0000","last_became_peered":"2024-05-08T05:25:34.072250+0000","last_unstale":"2024-05-08T05:27:22.919075+0000","last_undegraded":"2024-05-08T05:27:22.919075+0000","last_fullsized":"2024-05-08T05:27:22.919075+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_clean_scrub_stamp":"2024-05-08T05:25:33.008741+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T08:17:36.181338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"82'8","reported_seq":33,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:27:22.898326+0000","last_change":"2024-05-08T05:26:24.134964+0000","last_active":"2024-05-08T05:27:22.898326+0000","last_peered":"2024-05-08T05:27:22.898326+0000","last_clean":"2024-05-08T05:27:22.898326+0000","last_became_active":"2024-05-08T05:26:24.134583+0000","last_became_peered":"2024-05-08T05:26:24.134583+0000","last_unstale":"2024-05-08T05:27:22.898326+0000","last_undegraded":"2024-05-08T05:27:22.898326+0000","last_fullsized":"2024-05-08T05:27:22.898326+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:25:33.008741+0000","last_clean_scrub_stamp":"2024-05-08T05:25:33.008741+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T16:09:52.525461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,8],"acting":[11,9,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":502,"ondisk_log_size":502,"up":192,"acting":192,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":3563520,"data_stored":3542208,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":92,"ondisk_log_size":92,"up":3,"acting":3,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":75126,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":1261,"num_read_kb":711,"num_write":182,"num_write_kb":133,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":10,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":442368,"data_stored":225378,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":96,"acting":96,"num_store_stats":12}],"osd_stats":[{"osd":11,"up_from":72,"seq":309237645374,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27884,"kb_used_data":868,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717268,"statfs":{"total":95995035648,"available":95966482432,"internally_reserved":0,"allocated":888832,"data_stored":437056,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":66,"seq":283467841604,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36888,"kb_used_data":1552,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708264,"statfs":{"total":95995035648,"available":95957262336,"internally_reserved":0,"allocated":1589248,"data_stored":1094148,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":36174272},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":60,"seq":257698037833,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32060,"kb_used_data":884,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713092,"statfs":{"total":95995035648,"available":95962206208,"internally_reserved":0,"allocated":905216,"data_stored":437292,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":31914432},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":54,"seq":231928234063,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27900,"kb_used_data":884,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717252,"statfs":{"total":95995035648,"available":95966466048,"internally_reserved":0,"allocated":905216,"data_stored":437212,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":48,"seq":206158430293,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36800,"kb_used_data":1464,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708352,"statfs":{"total":95995035648,"available":95957352448,"internally_reserved":0,"allocated":1499136,"data_stored":1030125,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":36174282},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":42,"seq":180388626523,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36208,"kb_used_data":872,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708944,"statfs":{"total":95995035648,"available":95957958656,"internally_reserved":0,"allocated":892928,"data_stored":436681,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574967,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27956,"kb_used_data":940,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717196,"statfs":{"total":95995035648,"available":95966408704,"internally_reserved":0,"allocated":962560,"data_stored":506616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738491,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36228,"kb_used_data":892,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708924,"statfs":{"total":95995035648,"available":95957938176,"internally_reserved":0,"allocated":913408,"data_stored":437952,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411441,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27980,"kb_used_data":964,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717172,"statfs":{"total":95995035648,"available":95966384128,"internally_reserved":0,"allocated":987136,"data_stored":508498,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":25,"seq":107374182507,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27904,"kb_used_data":888,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717248,"statfs":{"total":95995035648,"available":95966461952,"internally_reserved":0,"allocated":909312,"data_stored":436992,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":31,"seq":133143986278,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36212,"kb_used_data":876,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708940,"statfs":{"total":95995035648,"available":95957954560,"internally_reserved":0,"allocated":897024,"data_stored":437960,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":36,"seq":154618822753,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28492,"kb_used_data":1476,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716660,"statfs":{"total":95995035648,"available":95965859840,"internally_reserved":0,"allocated":1511424,"data_stored":1028967,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":77824,"data_stored":70142,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":72024,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1486,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":2008,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":3166,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":110592,"data_stored":72562,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-08T05:29:24.691 DEBUG:teuthology.orchestra.run.smithi087:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid eeeb813e-0cf9-11ef-bc97-c7b262605968 -- ceph fs dump --format=json 2024-05-08T05:29:24.708 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:29:24 smithi087 ceph-mon[29523]: pgmap v432: 97 pgs: 97 active+clean; 650 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 938 B/s wr, 6 op/s 2024-05-08T05:29:24.708 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:29:24 smithi087 ceph-mon[29523]: from='client.14949 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-05-08T05:29:24.733 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:29:24 smithi090 ceph-mon[34526]: pgmap v432: 97 pgs: 97 active+clean; 650 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 938 B/s wr, 6 op/s 2024-05-08T05:29:24.733 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:29:24 smithi090 ceph-mon[34526]: from='client.14949 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-05-08T05:29:24.788 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:29:24 smithi160 ceph-mon[34827]: pgmap v432: 97 pgs: 97 active+clean; 650 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 938 B/s wr, 6 op/s 2024-05-08T05:29:24.788 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:29:24 smithi160 ceph-mon[34827]: from='client.14949 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-05-08T05:29:25.142 INFO:teuthology.orchestra.run.smithi087.stderr:Inferring config /var/lib/ceph/eeeb813e-0cf9-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T05:29:25.642 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:29:25 smithi087 ceph-mon[29523]: from='client.25057 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-05-08T05:29:25.643 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:29:25 smithi087 ceph-mon[29523]: from='client.25063 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-05-08T05:29:25.733 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:29:25 smithi090 ceph-mon[34526]: from='client.25057 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-05-08T05:29:25.733 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:29:25 smithi090 ceph-mon[34526]: from='client.25063 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-05-08T05:29:25.788 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:29:25 smithi160 ceph-mon[34827]: from='client.25057 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-05-08T05:29:25.789 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:29:25 smithi160 ceph-mon[34827]: from='client.25063 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-05-08T05:29:26.708 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:29:26 smithi087 ceph-mon[29523]: pgmap v433: 97 pgs: 97 active+clean; 650 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 938 B/s wr, 7 op/s 2024-05-08T05:29:26.733 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:29:26 smithi090 ceph-mon[34526]: pgmap v433: 97 pgs: 97 active+clean; 650 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 938 B/s wr, 7 op/s 2024-05-08T05:29:26.788 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:29:26 smithi160 ceph-mon[34827]: pgmap v433: 97 pgs: 97 active+clean; 650 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 938 B/s wr, 7 op/s 2024-05-08T05:29:27.402 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:27.401+0000 7f63a6a00700 1 -- 172.21.15.87:0/778760157 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f63a010a3a0 msgr2=0x7f63a0116840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:29:27.424 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:27.401+0000 7f63a6a00700 1 --2- 172.21.15.87:0/778760157 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f63a010a3a0 0x7f63a0116840 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f639800b0a0 tx=0x7f639800b3b0 comp rx=0 tx=0).stop 2024-05-08T05:29:27.424 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:27.401+0000 7f63a6a00700 1 -- 172.21.15.87:0/778760157 shutdown_connections 2024-05-08T05:29:27.424 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:27.401+0000 7f63a6a00700 1 --2- 172.21.15.87:0/778760157 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f63a010a3a0 0x7f63a0116840 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:29:27.424 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:27.401+0000 7f63a6a00700 1 --2- 172.21.15.87:0/778760157 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f63a010e8b0 0x7f63a010ec90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:29:27.424 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:27.401+0000 7f63a6a00700 1 --2- 172.21.15.87:0/778760157 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f63a01099e0 0x7f63a0109e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:29:27.424 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:27.401+0000 7f63a6a00700 1 -- 172.21.15.87:0/778760157 >> 172.21.15.87:0/778760157 conn(0x7f63a0079230 msgr2=0x7f63a01082c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:29:27.425 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:27.402+0000 7f63a6a00700 1 -- 172.21.15.87:0/778760157 shutdown_connections 2024-05-08T05:29:27.425 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:27.402+0000 7f63a6a00700 1 -- 172.21.15.87:0/778760157 wait complete. 2024-05-08T05:29:27.427 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:27.403+0000 7f63a6a00700 1 Processor -- start 2024-05-08T05:29:27.427 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:27.404+0000 7f63a6a00700 1 -- start start 2024-05-08T05:29:27.427 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:27.404+0000 7f63a6a00700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f63a01099e0 0x7f63a01a0020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:29:27.427 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:27.404+0000 7f63a6a00700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f63a010a3a0 0x7f63a01a0560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:29:27.427 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:27.404+0000 7f63a6a00700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f63a010e8b0 0x7f63a01a48a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:29:27.427 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:27.404+0000 7f63a6a00700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f63a0119b90 con 0x7f63a010a3a0 2024-05-08T05:29:27.427 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:27.404+0000 7f63a6a00700 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f63a0119a10 con 0x7f63a01099e0 2024-05-08T05:29:27.428 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:27.404+0000 7f63a6a00700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f63a0119d10 con 0x7f63a010e8b0 2024-05-08T05:29:27.428 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:27.405+0000 7f63a4c00700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f63a010a3a0 0x7f63a01a0560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:29:27.428 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:27.405+0000 7f63a4c00700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f63a010a3a0 0x7f63a01a0560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:38830/0 (socket says 172.21.15.87:38830) 2024-05-08T05:29:27.428 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:27.405+0000 7f63a4c00700 1 -- 172.21.15.87:0/2262164442 learned_addr learned my addr 172.21.15.87:0/2262164442 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T05:29:27.428 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:27.405+0000 7f63a5600700 1 --2- 172.21.15.87:0/2262164442 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f63a01099e0 0x7f63a01a0020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:29:27.428 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:27.405+0000 7f63a6000700 1 --2- 172.21.15.87:0/2262164442 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f63a010e8b0 0x7f63a01a48a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:29:27.428 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:27.405+0000 7f63a5600700 1 -- 172.21.15.87:0/2262164442 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f63a010e8b0 msgr2=0x7f63a01a48a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:29:27.428 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:27.405+0000 7f63a5600700 1 --2- 172.21.15.87:0/2262164442 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f63a010e8b0 0x7f63a01a48a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:29:27.428 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:27.405+0000 7f63a5600700 1 -- 172.21.15.87:0/2262164442 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f63a010a3a0 msgr2=0x7f63a01a0560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:29:27.428 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:27.405+0000 7f63a5600700 1 --2- 172.21.15.87:0/2262164442 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f63a010a3a0 0x7f63a01a0560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:29:27.428 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:27.405+0000 7f63a5600700 1 -- 172.21.15.87:0/2262164442 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f63a01a4fe0 con 0x7f63a01099e0 2024-05-08T05:29:27.428 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:27.405+0000 7f63a4c00700 1 --2- 172.21.15.87:0/2262164442 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f63a010a3a0 0x7f63a01a0560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T05:29:27.428 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:27.405+0000 7f63a6000700 1 --2- 172.21.15.87:0/2262164442 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f63a010e8b0 0x7f63a01a48a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T05:29:27.428 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:27.406+0000 7f63a5600700 1 --2- 172.21.15.87:0/2262164442 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f63a01099e0 0x7f63a01a0020 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f639400e9f0 tx=0x7f639400ed00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:29:27.429 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:27.406+0000 7f639e000700 1 -- 172.21.15.87:0/2262164442 <== mon.2 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f639400c9c0 con 0x7f63a01099e0 2024-05-08T05:29:27.429 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:27.406+0000 7f639e000700 1 -- 172.21.15.87:0/2262164442 <== mon.2 v2:172.21.15.90:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f639400cb60 con 0x7f63a01099e0 2024-05-08T05:29:27.429 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:27.406+0000 7f63a6a00700 1 -- 172.21.15.87:0/2262164442 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f63a01a52d0 con 0x7f63a01099e0 2024-05-08T05:29:27.429 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:27.406+0000 7f639e000700 1 -- 172.21.15.87:0/2262164442 <== mon.2 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6394018680 con 0x7f63a01099e0 2024-05-08T05:29:27.429 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:27.406+0000 7f63a6a00700 1 -- 172.21.15.87:0/2262164442 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f63a01acb50 con 0x7f63a01099e0 2024-05-08T05:29:27.429 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:27.407+0000 7f63a6a00700 1 -- 172.21.15.87:0/2262164442 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f63a006a190 con 0x7f63a01099e0 2024-05-08T05:29:27.429 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:27.410+0000 7f639e000700 1 -- 172.21.15.87:0/2262164442 <== mon.2 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7f6394010430 con 0x7f63a01099e0 2024-05-08T05:29:27.429 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:27.411+0000 7f639e000700 1 --2- 172.21.15.87:0/2262164442 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f63880b2900 0x7f63880b4dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:29:27.429 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:27.411+0000 7f639e000700 1 -- 172.21.15.87:0/2262164442 <== mon.2 v2:172.21.15.90:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8190+0+0 (secure 0 0 0) 0x7f63940e2600 con 0x7f63a01099e0 2024-05-08T05:29:27.429 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:27.411+0000 7f63a4c00700 1 --2- 172.21.15.87:0/2262164442 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f63880b2900 0x7f63880b4dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:29:27.429 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:27.412+0000 7f63a4c00700 1 --2- 172.21.15.87:0/2262164442 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f63880b2900 0x7f63880b4dc0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f63a01094e0 tx=0x7f638c009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:29:27.429 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:27.413+0000 7f639e000700 1 -- 172.21.15.87:0/2262164442 <== mon.2 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f63940aa2f0 con 0x7f63a01099e0 2024-05-08T05:29:27.696 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:27.696+0000 7f63a6a00700 1 -- 172.21.15.87:0/2262164442 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f63a002e510 con 0x7f63a01099e0 2024-05-08T05:29:27.697 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:27.697+0000 7f639e000700 1 -- 172.21.15.87:0/2262164442 <== mon.2 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) ==== 94+0+11858 (secure 0 0 0) 0x7f63940b2370 con 0x7f63a01099e0 2024-05-08T05:29:27.698 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-05-08T05:29:27.698 INFO:teuthology.orchestra.run.smithi087.stdout:{"epoch":25,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14358,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6835/1183985321","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6834","nonce":1183985321},{"type":"v1","addr":"172.21.15.87:6835","nonce":1183985321}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14370,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6837/1485824316","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6836","nonce":1485824316},{"type":"v1","addr":"172.21.15.87:6837","nonce":1485824316}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14409,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6841/724277538","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6840","nonce":724277538},{"type":"v1","addr":"172.21.15.87:6841","nonce":724277538}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24412,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6833/3339455985","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6832","nonce":3339455985},{"type":"v1","addr":"172.21.15.160:6833","nonce":3339455985}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24413,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6833/3292166873","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6832","nonce":3292166873},{"type":"v1","addr":"172.21.15.90:6833","nonce":3292166873}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24443,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6835/824555459","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6834","nonce":824555459},{"type":"v1","addr":"172.21.15.90:6835","nonce":824555459}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6}],"filesystems":[{"mdsmap":{"epoch":25,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-05-08T05:25:36.816840+0000","modified":"2024-05-08T05:29:16.624018+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24500,"mds_1":24482,"mds_2":24481},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24463":{"gid":24463,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.160:6835/409648357","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6834","nonce":409648357},{"type":"v1","addr":"172.21.15.160:6835","nonce":409648357}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24467":{"gid":24467,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.90:6837/4221919418","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6836","nonce":4221919418},{"type":"v1","addr":"172.21.15.90:6837","nonce":4221919418}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24469":{"gid":24469,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.160:6837/4200018040","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6836","nonce":4200018040},{"type":"v1","addr":"172.21.15.160:6837","nonce":4200018040}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24481":{"gid":24481,"name":"i","rank":2,"incarnation":20,"state":"up:active","state_seq":13,"addr":"172.21.15.160:6839/234657686","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6838","nonce":234657686},{"type":"v1","addr":"172.21.15.160:6839","nonce":234657686}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24482":{"gid":24482,"name":"g","rank":1,"incarnation":18,"state":"up:active","state_seq":12,"addr":"172.21.15.87:6839/2127215876","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6838","nonce":2127215876},{"type":"v1","addr":"172.21.15.87:6839","nonce":2127215876}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24500":{"gid":24500,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.90:6839/160586017","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6838","nonce":160586017},{"type":"v1","addr":"172.21.15.90:6839","nonce":160586017}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24500,"qdb_cluster":[24481,24482,24500]},"id":1}]} 2024-05-08T05:29:27.700 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:27.700+0000 7f63a6a00700 1 -- 172.21.15.87:0/2262164442 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f63880b2900 msgr2=0x7f63880b4dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:29:27.700 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:27.700+0000 7f63a6a00700 1 --2- 172.21.15.87:0/2262164442 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f63880b2900 0x7f63880b4dc0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f63a01094e0 tx=0x7f638c009260 comp rx=0 tx=0).stop 2024-05-08T05:29:27.700 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:27.700+0000 7f63a6a00700 1 -- 172.21.15.87:0/2262164442 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f63a01099e0 msgr2=0x7f63a01a0020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:29:27.700 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:27.700+0000 7f63a6a00700 1 --2- 172.21.15.87:0/2262164442 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f63a01099e0 0x7f63a01a0020 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f639400e9f0 tx=0x7f639400ed00 comp rx=0 tx=0).stop 2024-05-08T05:29:27.701 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:27.700+0000 7f63a6a00700 1 -- 172.21.15.87:0/2262164442 shutdown_connections 2024-05-08T05:29:27.701 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:27.700+0000 7f63a6a00700 1 --2- 172.21.15.87:0/2262164442 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f63880b2900 0x7f63880b4dc0 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:29:27.701 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:27.700+0000 7f63a6a00700 1 --2- 172.21.15.87:0/2262164442 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f63a010e8b0 0x7f63a01a48a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:29:27.701 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:27.700+0000 7f63a6a00700 1 --2- 172.21.15.87:0/2262164442 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f63a01099e0 0x7f63a01a0020 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:29:27.701 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:27.700+0000 7f63a6a00700 1 --2- 172.21.15.87:0/2262164442 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f63a010a3a0 0x7f63a01a0560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:29:27.701 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:27.700+0000 7f63a6a00700 1 -- 172.21.15.87:0/2262164442 >> 172.21.15.87:0/2262164442 conn(0x7f63a0079230 msgr2=0x7f63a00797f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:29:27.701 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:27.700+0000 7f63a6a00700 1 -- 172.21.15.87:0/2262164442 shutdown_connections 2024-05-08T05:29:27.701 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:27.701+0000 7f63a6a00700 1 -- 172.21.15.87:0/2262164442 wait complete. 2024-05-08T05:29:27.702 INFO:teuthology.orchestra.run.smithi087.stderr:dumped fsmap epoch 25 2024-05-08T05:29:28.503 DEBUG:teuthology.orchestra.run.smithi087:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid eeeb813e-0cf9-11ef-bc97-c7b262605968 -- ceph osd dump --format=json 2024-05-08T05:29:28.708 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:29:28 smithi087 ceph-mon[29523]: pgmap v434: 97 pgs: 97 active+clean; 650 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 938 B/s wr, 5 op/s 2024-05-08T05:29:28.708 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:29:28 smithi087 ceph-mon[29523]: from='client.? 172.21.15.87:0/2262164442' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T05:29:28.733 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:29:28 smithi090 ceph-mon[34526]: pgmap v434: 97 pgs: 97 active+clean; 650 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 938 B/s wr, 5 op/s 2024-05-08T05:29:28.734 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:29:28 smithi090 ceph-mon[34526]: from='client.? 172.21.15.87:0/2262164442' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T05:29:28.788 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:29:28 smithi160 ceph-mon[34827]: pgmap v434: 97 pgs: 97 active+clean; 650 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 938 B/s wr, 5 op/s 2024-05-08T05:29:28.789 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:29:28 smithi160 ceph-mon[34827]: from='client.? 172.21.15.87:0/2262164442' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T05:29:28.942 INFO:teuthology.orchestra.run.smithi087.stderr:Inferring config /var/lib/ceph/eeeb813e-0cf9-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T05:29:30.733 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:29:30 smithi090 ceph-mon[34526]: pgmap v435: 97 pgs: 97 active+clean; 650 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 852 B/s wr, 8 op/s 2024-05-08T05:29:30.777 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:29:30 smithi087 ceph-mon[29523]: pgmap v435: 97 pgs: 97 active+clean; 650 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 852 B/s wr, 8 op/s 2024-05-08T05:29:30.788 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:29:30 smithi160 ceph-mon[34827]: pgmap v435: 97 pgs: 97 active+clean; 650 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 852 B/s wr, 8 op/s 2024-05-08T05:29:31.093 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:31.093+0000 7f7ec8000700 1 -- 172.21.15.87:0/194374806 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7ec0075ff0 msgr2=0x7f7ec010f9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:29:31.093 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:31.093+0000 7f7ec8000700 1 --2- 172.21.15.87:0/194374806 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7ec0075ff0 0x7f7ec010f9c0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f7eac009990 tx=0x7f7eac009ca0 comp rx=0 tx=0).stop 2024-05-08T05:29:31.094 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:31.093+0000 7f7ec8000700 1 -- 172.21.15.87:0/194374806 shutdown_connections 2024-05-08T05:29:31.094 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:31.093+0000 7f7ec8000700 1 --2- 172.21.15.87:0/194374806 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7ec010ff00 0x7f7ec01122f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:29:31.094 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:31.093+0000 7f7ec8000700 1 --2- 172.21.15.87:0/194374806 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7ec00756d0 0x7f7ec0075ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:29:31.094 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:31.093+0000 7f7ec8000700 1 --2- 172.21.15.87:0/194374806 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7ec0075ff0 0x7f7ec010f9c0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:29:31.094 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:31.093+0000 7f7ec8000700 1 -- 172.21.15.87:0/194374806 >> 172.21.15.87:0/194374806 conn(0x7f7ec007a530 msgr2=0x7f7ec007a940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:29:31.094 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:31.093+0000 7f7ec8000700 1 -- 172.21.15.87:0/194374806 shutdown_connections 2024-05-08T05:29:31.094 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:31.093+0000 7f7ec8000700 1 -- 172.21.15.87:0/194374806 wait complete. 2024-05-08T05:29:31.095 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:31.094+0000 7f7ec8000700 1 Processor -- start 2024-05-08T05:29:31.095 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:31.094+0000 7f7ec8000700 1 -- start start 2024-05-08T05:29:31.095 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:31.095+0000 7f7ec8000700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7ec00756d0 0x7f7ec019bd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:29:31.095 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:31.095+0000 7f7ec8000700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7ec0075ff0 0x7f7ec019c2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:29:31.095 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:31.095+0000 7f7ec8000700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7ec010ff00 0x7f7ec01a0610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:29:31.095 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:31.095+0000 7f7ec8000700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f7ec01158c0 con 0x7f7ec010ff00 2024-05-08T05:29:31.095 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:31.095+0000 7f7ec8000700 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f7ec0115740 con 0x7f7ec0075ff0 2024-05-08T05:29:31.095 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:31.095+0000 7f7ec8000700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f7ec0115a40 con 0x7f7ec00756d0 2024-05-08T05:29:31.097 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:31.095+0000 7f7ec5600700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7ec00756d0 0x7f7ec019bd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:29:31.097 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:31.095+0000 7f7ec4c00700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7ec0075ff0 0x7f7ec019c2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:29:31.097 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:31.095+0000 7f7ec5600700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7ec00756d0 0x7f7ec019bd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.87:38828/0 (socket says 172.21.15.87:38828) 2024-05-08T05:29:31.097 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:31.095+0000 7f7ec5600700 1 -- 172.21.15.87:0/2868506809 learned_addr learned my addr 172.21.15.87:0/2868506809 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T05:29:31.097 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:31.095+0000 7f7ec6000700 1 --2- 172.21.15.87:0/2868506809 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7ec010ff00 0x7f7ec01a0610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:29:31.097 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:31.096+0000 7f7ec5600700 1 -- 172.21.15.87:0/2868506809 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7ec0075ff0 msgr2=0x7f7ec019c2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:29:31.097 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:31.096+0000 7f7ec5600700 1 --2- 172.21.15.87:0/2868506809 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7ec0075ff0 0x7f7ec019c2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:29:31.097 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:31.096+0000 7f7ec5600700 1 -- 172.21.15.87:0/2868506809 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7ec010ff00 msgr2=0x7f7ec01a0610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:29:31.097 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:31.096+0000 7f7ec5600700 1 --2- 172.21.15.87:0/2868506809 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7ec010ff00 0x7f7ec01a0610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:29:31.097 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:31.096+0000 7f7ec5600700 1 -- 172.21.15.87:0/2868506809 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7ec01a0d50 con 0x7f7ec00756d0 2024-05-08T05:29:31.097 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:31.096+0000 7f7ec5600700 1 --2- 172.21.15.87:0/2868506809 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7ec00756d0 0x7f7ec019bd90 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f7eb400ef10 tx=0x7f7eb400c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:29:31.097 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:31.096+0000 7f7ebe000700 1 -- 172.21.15.87:0/2868506809 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7eb400ca70 con 0x7f7ec00756d0 2024-05-08T05:29:31.097 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:31.096+0000 7f7ec8000700 1 -- 172.21.15.87:0/2868506809 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7ec01a0fe0 con 0x7f7ec00756d0 2024-05-08T05:29:31.098 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:31.096+0000 7f7ebe000700 1 -- 172.21.15.87:0/2868506809 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7eb4019070 con 0x7f7ec00756d0 2024-05-08T05:29:31.098 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:31.096+0000 7f7ebe000700 1 -- 172.21.15.87:0/2868506809 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7eb4014480 con 0x7f7ec00756d0 2024-05-08T05:29:31.098 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:31.096+0000 7f7ec8000700 1 -- 172.21.15.87:0/2868506809 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7ec01a88c0 con 0x7f7ec00756d0 2024-05-08T05:29:31.098 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:31.097+0000 7f7ec8000700 1 -- 172.21.15.87:0/2868506809 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7ec006a190 con 0x7f7ec00756d0 2024-05-08T05:29:31.100 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:31.100+0000 7f7ebe000700 1 -- 172.21.15.87:0/2868506809 <== mon.1 v2:172.21.15.160:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7f7eb4012050 con 0x7f7ec00756d0 2024-05-08T05:29:31.101 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:31.101+0000 7f7ebe000700 1 --2- 172.21.15.87:0/2868506809 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f7ea80b2880 0x7f7ea80b4d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:29:31.102 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:31.101+0000 7f7ebe000700 1 -- 172.21.15.87:0/2868506809 <== mon.1 v2:172.21.15.160:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8190+0+0 (secure 0 0 0) 0x7f7eb40e2920 con 0x7f7ec00756d0 2024-05-08T05:29:31.102 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:31.101+0000 7f7ec4c00700 1 --2- 172.21.15.87:0/2868506809 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f7ea80b2880 0x7f7ea80b4d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:29:31.102 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:31.102+0000 7f7ec4c00700 1 --2- 172.21.15.87:0/2868506809 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f7ea80b2880 0x7f7ea80b4d40 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f7ec0111c20 tx=0x7f7eac005fd0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:29:31.103 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:31.103+0000 7f7ebe000700 1 -- 172.21.15.87:0/2868506809 <== mon.1 v2:172.21.15.160:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f7eb4010040 con 0x7f7ec00756d0 2024-05-08T05:29:31.337 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:31.336+0000 7f7ec8000700 1 -- 172.21.15.87:0/2868506809 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f7ec002e510 con 0x7f7ec00756d0 2024-05-08T05:29:31.339 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:31.338+0000 7f7ebe000700 1 -- 172.21.15.87:0/2868506809 <== mon.1 v2:172.21.15.160:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v82) ==== 74+0+22588 (secure 0 0 0) 0x7f7eb40aa610 con 0x7f7ec00756d0 2024-05-08T05:29:31.339 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-05-08T05:29:31.340 INFO:teuthology.orchestra.run.smithi087.stdout:{"epoch":82,"fsid":"eeeb813e-0cf9-11ef-bc97-c7b262605968","created":"2024-05-08T05:16:14.984330+0000","modified":"2024-05-08T05:26:24.106467+0000","last_up_change":"2024-05-08T05:24:22.324501+0000","last_in_change":"2024-05-08T05:24:01.962570+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-08T05:20:08.907941+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-08T05:25:28.054494+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-08T05:25:32.484126+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"f3e25ce0-0762-46fd-83fb-6766a2e9db69","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6802","nonce":2285285644},{"type":"v1","addr":"172.21.15.87:6803","nonce":2285285644}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6804","nonce":2285285644},{"type":"v1","addr":"172.21.15.87:6805","nonce":2285285644}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6808","nonce":2285285644},{"type":"v1","addr":"172.21.15.87:6809","nonce":2285285644}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6806","nonce":2285285644},{"type":"v1","addr":"172.21.15.87:6807","nonce":2285285644}]},"public_addr":"172.21.15.87:6803/2285285644","cluster_addr":"172.21.15.87:6805/2285285644","heartbeat_back_addr":"172.21.15.87:6809/2285285644","heartbeat_front_addr":"172.21.15.87:6807/2285285644","state":["exists","up"]},{"osd":1,"uuid":"b6de5f4c-1d79-41ff-adee-03d8a47ab55e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6800","nonce":1681573998},{"type":"v1","addr":"172.21.15.90:6801","nonce":1681573998}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6802","nonce":1681573998},{"type":"v1","addr":"172.21.15.90:6803","nonce":1681573998}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6806","nonce":1681573998},{"type":"v1","addr":"172.21.15.90:6807","nonce":1681573998}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6804","nonce":1681573998},{"type":"v1","addr":"172.21.15.90:6805","nonce":1681573998}]},"public_addr":"172.21.15.90:6801/1681573998","cluster_addr":"172.21.15.90:6803/1681573998","heartbeat_back_addr":"172.21.15.90:6807/1681573998","heartbeat_front_addr":"172.21.15.90:6805/1681573998","state":["exists","up"]},{"osd":2,"uuid":"ee3a2729-93b2-4985-b84d-165f92cae8e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6800","nonce":2137179096},{"type":"v1","addr":"172.21.15.160:6801","nonce":2137179096}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6802","nonce":2137179096},{"type":"v1","addr":"172.21.15.160:6803","nonce":2137179096}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6806","nonce":2137179096},{"type":"v1","addr":"172.21.15.160:6807","nonce":2137179096}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6804","nonce":2137179096},{"type":"v1","addr":"172.21.15.160:6805","nonce":2137179096}]},"public_addr":"172.21.15.160:6801/2137179096","cluster_addr":"172.21.15.160:6803/2137179096","heartbeat_back_addr":"172.21.15.160:6807/2137179096","heartbeat_front_addr":"172.21.15.160:6805/2137179096","state":["exists","up"]},{"osd":3,"uuid":"fc7bd69f-5a62-4ec6-b95c-c170be46a7d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6810","nonce":2022667023},{"type":"v1","addr":"172.21.15.87:6811","nonce":2022667023}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6812","nonce":2022667023},{"type":"v1","addr":"172.21.15.87:6813","nonce":2022667023}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6816","nonce":2022667023},{"type":"v1","addr":"172.21.15.87:6817","nonce":2022667023}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6814","nonce":2022667023},{"type":"v1","addr":"172.21.15.87:6815","nonce":2022667023}]},"public_addr":"172.21.15.87:6811/2022667023","cluster_addr":"172.21.15.87:6813/2022667023","heartbeat_back_addr":"172.21.15.87:6817/2022667023","heartbeat_front_addr":"172.21.15.87:6815/2022667023","state":["exists","up"]},{"osd":4,"uuid":"a05f7bd1-962a-4f3e-8f70-e7ef4c68bac2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6808","nonce":1371607578},{"type":"v1","addr":"172.21.15.90:6809","nonce":1371607578}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6810","nonce":1371607578},{"type":"v1","addr":"172.21.15.90:6811","nonce":1371607578}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6814","nonce":1371607578},{"type":"v1","addr":"172.21.15.90:6815","nonce":1371607578}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6812","nonce":1371607578},{"type":"v1","addr":"172.21.15.90:6813","nonce":1371607578}]},"public_addr":"172.21.15.90:6809/1371607578","cluster_addr":"172.21.15.90:6811/1371607578","heartbeat_back_addr":"172.21.15.90:6815/1371607578","heartbeat_front_addr":"172.21.15.90:6813/1371607578","state":["exists","up"]},{"osd":5,"uuid":"85e3af08-32ee-4f26-97df-8d54ba928715","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6808","nonce":2190054276},{"type":"v1","addr":"172.21.15.160:6809","nonce":2190054276}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6810","nonce":2190054276},{"type":"v1","addr":"172.21.15.160:6811","nonce":2190054276}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6814","nonce":2190054276},{"type":"v1","addr":"172.21.15.160:6815","nonce":2190054276}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6812","nonce":2190054276},{"type":"v1","addr":"172.21.15.160:6813","nonce":2190054276}]},"public_addr":"172.21.15.160:6809/2190054276","cluster_addr":"172.21.15.160:6811/2190054276","heartbeat_back_addr":"172.21.15.160:6815/2190054276","heartbeat_front_addr":"172.21.15.160:6813/2190054276","state":["exists","up"]},{"osd":6,"uuid":"df4b22a9-6cd8-473e-a17b-a0cb9ad32e98","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":42,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6818","nonce":2863681447},{"type":"v1","addr":"172.21.15.87:6819","nonce":2863681447}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6820","nonce":2863681447},{"type":"v1","addr":"172.21.15.87:6821","nonce":2863681447}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6824","nonce":2863681447},{"type":"v1","addr":"172.21.15.87:6825","nonce":2863681447}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6822","nonce":2863681447},{"type":"v1","addr":"172.21.15.87:6823","nonce":2863681447}]},"public_addr":"172.21.15.87:6819/2863681447","cluster_addr":"172.21.15.87:6821/2863681447","heartbeat_back_addr":"172.21.15.87:6825/2863681447","heartbeat_front_addr":"172.21.15.87:6823/2863681447","state":["exists","up"]},{"osd":7,"uuid":"f6ef3857-0366-4408-932a-a8c8479ba780","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6816","nonce":1964248958},{"type":"v1","addr":"172.21.15.90:6817","nonce":1964248958}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6818","nonce":1964248958},{"type":"v1","addr":"172.21.15.90:6819","nonce":1964248958}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6822","nonce":1964248958},{"type":"v1","addr":"172.21.15.90:6823","nonce":1964248958}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6820","nonce":1964248958},{"type":"v1","addr":"172.21.15.90:6821","nonce":1964248958}]},"public_addr":"172.21.15.90:6817/1964248958","cluster_addr":"172.21.15.90:6819/1964248958","heartbeat_back_addr":"172.21.15.90:6823/1964248958","heartbeat_front_addr":"172.21.15.90:6821/1964248958","state":["exists","up"]},{"osd":8,"uuid":"027dede9-d0be-4fbe-b7b8-02ce88d57f4d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":54,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6816","nonce":927680738},{"type":"v1","addr":"172.21.15.160:6817","nonce":927680738}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6818","nonce":927680738},{"type":"v1","addr":"172.21.15.160:6819","nonce":927680738}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6822","nonce":927680738},{"type":"v1","addr":"172.21.15.160:6823","nonce":927680738}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6820","nonce":927680738},{"type":"v1","addr":"172.21.15.160:6821","nonce":927680738}]},"public_addr":"172.21.15.160:6817/927680738","cluster_addr":"172.21.15.160:6819/927680738","heartbeat_back_addr":"172.21.15.160:6823/927680738","heartbeat_front_addr":"172.21.15.160:6821/927680738","state":["exists","up"]},{"osd":9,"uuid":"bc9e37de-e509-4db6-bd58-b68e2c8e1aff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6826","nonce":3789116749},{"type":"v1","addr":"172.21.15.87:6827","nonce":3789116749}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6828","nonce":3789116749},{"type":"v1","addr":"172.21.15.87:6829","nonce":3789116749}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6832","nonce":3789116749},{"type":"v1","addr":"172.21.15.87:6833","nonce":3789116749}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6830","nonce":3789116749},{"type":"v1","addr":"172.21.15.87:6831","nonce":3789116749}]},"public_addr":"172.21.15.87:6827/3789116749","cluster_addr":"172.21.15.87:6829/3789116749","heartbeat_back_addr":"172.21.15.87:6833/3789116749","heartbeat_front_addr":"172.21.15.87:6831/3789116749","state":["exists","up"]},{"osd":10,"uuid":"43945081-b4c8-4f5d-9301-3540709e69e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":66,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6824","nonce":716529498},{"type":"v1","addr":"172.21.15.90:6825","nonce":716529498}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6826","nonce":716529498},{"type":"v1","addr":"172.21.15.90:6827","nonce":716529498}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6830","nonce":716529498},{"type":"v1","addr":"172.21.15.90:6831","nonce":716529498}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6828","nonce":716529498},{"type":"v1","addr":"172.21.15.90:6829","nonce":716529498}]},"public_addr":"172.21.15.90:6825/716529498","cluster_addr":"172.21.15.90:6827/716529498","heartbeat_back_addr":"172.21.15.90:6831/716529498","heartbeat_front_addr":"172.21.15.90:6829/716529498","state":["exists","up"]},{"osd":11,"uuid":"da23ff5c-3f79-44e3-bca3-d9d5a003c999","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6824","nonce":1842739135},{"type":"v1","addr":"172.21.15.160:6825","nonce":1842739135}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6826","nonce":1842739135},{"type":"v1","addr":"172.21.15.160:6827","nonce":1842739135}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6830","nonce":1842739135},{"type":"v1","addr":"172.21.15.160:6831","nonce":1842739135}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6828","nonce":1842739135},{"type":"v1","addr":"172.21.15.160:6829","nonce":1842739135}]},"public_addr":"172.21.15.160:6825/1842739135","cluster_addr":"172.21.15.160:6827/1842739135","heartbeat_back_addr":"172.21.15.160:6831/1842739135","heartbeat_front_addr":"172.21.15.160:6829/1842739135","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T05:19:15.869398+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T05:19:42.014078+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T05:20:06.430660+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T05:20:38.555519+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T05:21:04.530605+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T05:21:29.545252+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T05:22:03.141982+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T05:22:29.191127+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T05:22:54.502994+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T05:23:27.899000+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T05:23:54.693979+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T05:24:20.307119+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.a","mappings":[{"from":2,"to":11}]},{"pgid":"2.1d","mappings":[{"from":2,"to":4},{"from":8,"to":11}]},{"pgid":"3.0","mappings":[{"from":4,"to":8}]},{"pgid":"3.1","mappings":[{"from":4,"to":9}]},{"pgid":"3.12","mappings":[{"from":3,"to":9}]},{"pgid":"3.28","mappings":[{"from":5,"to":6}]},{"pgid":"3.2c","mappings":[{"from":4,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.87:0/4226160503":"2024-05-09T05:17:22.736165+0000","172.21.15.87:0/2773684806":"2024-05-09T05:17:22.736165+0000","172.21.15.87:0/349590592":"2024-05-09T05:17:22.736165+0000","172.21.15.87:6801/2710124295":"2024-05-09T05:17:22.736165+0000","172.21.15.87:6800/1823425617":"2024-05-09T05:16:48.155337+0000","172.21.15.87:0/2393072013":"2024-05-09T05:16:48.155337+0000","172.21.15.87:0/1291525416":"2024-05-09T05:16:48.155337+0000","172.21.15.87:6801/1823425617":"2024-05-09T05:16:48.155337+0000","172.21.15.87:0/3839463573":"2024-05-09T05:16:48.155337+0000","172.21.15.87:6800/2710124295":"2024-05-09T05:17:22.736165+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-08T05:29:31.342 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:31.342+0000 7f7ec8000700 1 -- 172.21.15.87:0/2868506809 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f7ea80b2880 msgr2=0x7f7ea80b4d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:29:31.342 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:31.342+0000 7f7ec8000700 1 --2- 172.21.15.87:0/2868506809 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f7ea80b2880 0x7f7ea80b4d40 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f7ec0111c20 tx=0x7f7eac005fd0 comp rx=0 tx=0).stop 2024-05-08T05:29:31.342 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:31.342+0000 7f7ec8000700 1 -- 172.21.15.87:0/2868506809 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7ec00756d0 msgr2=0x7f7ec019bd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:29:31.342 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:31.342+0000 7f7ec8000700 1 --2- 172.21.15.87:0/2868506809 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7ec00756d0 0x7f7ec019bd90 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f7eb400ef10 tx=0x7f7eb400c3a0 comp rx=0 tx=0).stop 2024-05-08T05:29:31.342 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:31.342+0000 7f7ec8000700 1 -- 172.21.15.87:0/2868506809 shutdown_connections 2024-05-08T05:29:31.343 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:31.342+0000 7f7ec8000700 1 --2- 172.21.15.87:0/2868506809 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7ec010ff00 0x7f7ec01a0610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:29:31.343 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:31.342+0000 7f7ec8000700 1 --2- 172.21.15.87:0/2868506809 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f7ea80b2880 0x7f7ea80b4d40 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:29:31.343 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:31.342+0000 7f7ec8000700 1 --2- 172.21.15.87:0/2868506809 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7ec00756d0 0x7f7ec019bd90 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:29:31.343 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:31.342+0000 7f7ec8000700 1 --2- 172.21.15.87:0/2868506809 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7ec0075ff0 0x7f7ec019c2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:29:31.343 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:31.342+0000 7f7ec8000700 1 -- 172.21.15.87:0/2868506809 >> 172.21.15.87:0/2868506809 conn(0x7f7ec007a530 msgr2=0x7f7ec0100710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:29:31.343 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:31.342+0000 7f7ec8000700 1 -- 172.21.15.87:0/2868506809 shutdown_connections 2024-05-08T05:29:31.343 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:31.342+0000 7f7ec8000700 1 -- 172.21.15.87:0/2868506809 wait complete. 2024-05-08T05:29:31.708 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:29:31 smithi087 ceph-mon[29523]: from='client.? 172.21.15.87:0/2868506809' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-08T05:29:31.733 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:29:31 smithi090 ceph-mon[34526]: from='client.? 172.21.15.87:0/2868506809' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-08T05:29:31.788 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:29:31 smithi160 ceph-mon[34827]: from='client.? 172.21.15.87:0/2868506809' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-08T05:29:32.161 DEBUG:tasks.fwd_scrub:Yielding 2024-05-08T05:29:32.161 INFO:teuthology.run_tasks:Running task workunit... 2024-05-08T05:29:32.175 INFO:tasks.workunit:Pulling workunits from ref bee299f4ac344e4c45e550d7a80abcadd7bc3d5a 2024-05-08T05:29:32.175 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-05-08T05:29:32.176 INFO:tasks.workunit:timeout=6h 2024-05-08T05:29:32.176 INFO:tasks.workunit:cleanup=True 2024-05-08T05:29:32.176 DEBUG:teuthology.orchestra.run.smithi087:> stat -- /home/ubuntu/cephtest/mnt.0 2024-05-08T05:29:32.176 INFO:tasks.fwd_scrub.fs.[cephfs]:start scrubbing fs: cephfs 2024-05-08T05:29:32.177 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-05-08T05:29:32.177 DEBUG:teuthology.orchestra.run.smithi087:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid eeeb813e-0cf9-11ef-bc97-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-05-08T05:29:32.227 INFO:teuthology.orchestra.run.smithi087.stdout: File: /home/ubuntu/cephtest/mnt.0 2024-05-08T05:29:32.227 INFO:teuthology.orchestra.run.smithi087.stdout: Size: 0 Blocks: 0 IO Block: 65536 directory 2024-05-08T05:29:32.227 INFO:teuthology.orchestra.run.smithi087.stdout:Device: 72h/114d Inode: 1099511628283 Links: 2 2024-05-08T05:29:32.227 INFO:teuthology.orchestra.run.smithi087.stdout:Access: (1777/drwxrwxrwt) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-08T05:29:32.227 INFO:teuthology.orchestra.run.smithi087.stdout:Context: system_u:object_r:unlabeled_t:s0 2024-05-08T05:29:32.227 INFO:teuthology.orchestra.run.smithi087.stdout:Access: 2024-05-08 05:26:14.174221278 +0000 2024-05-08T05:29:32.228 INFO:teuthology.orchestra.run.smithi087.stdout:Modify: 2024-05-08 05:26:14.174221278 +0000 2024-05-08T05:29:32.228 INFO:teuthology.orchestra.run.smithi087.stdout:Change: 2024-05-08 05:29:15.548427465 +0000 2024-05-08T05:29:32.228 INFO:teuthology.orchestra.run.smithi087.stdout: Birth: 2024-05-08 05:26:14.174221278 +0000 2024-05-08T05:29:32.228 INFO:tasks.workunit:Did not need to create dir /home/ubuntu/cephtest/mnt.0 2024-05-08T05:29:32.228 DEBUG:teuthology.orchestra.run.smithi087:> cd -- /home/ubuntu/cephtest/mnt.0 && sudo install -d -m 0755 --owner=ubuntu -- client.0 2024-05-08T05:29:32.354 DEBUG:teuthology.orchestra.run.smithi087:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph-ci.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout bee299f4ac344e4c45e550d7a80abcadd7bc3d5a 2024-05-08T05:29:32.409 INFO:tasks.workunit.client.0.smithi087.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-05-08T05:29:32.623 INFO:teuthology.orchestra.run.smithi087.stderr:Inferring config /var/lib/ceph/eeeb813e-0cf9-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T05:29:32.708 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:29:32 smithi087 ceph-mon[29523]: pgmap v436: 97 pgs: 97 active+clean; 650 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T05:29:32.733 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:29:32 smithi090 ceph-mon[34526]: pgmap v436: 97 pgs: 97 active+clean; 650 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T05:29:32.788 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:29:32 smithi160 ceph-mon[34827]: pgmap v436: 97 pgs: 97 active+clean; 650 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T05:29:34.721 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:34.719+0000 7f6f05c00700 1 -- 172.21.15.87:0/1487886053 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6f0006b180 msgr2=0x7f6f0006b600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:29:34.721 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:34.719+0000 7f6f05c00700 1 --2- 172.21.15.87:0/1487886053 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6f0006b180 0x7f6f0006b600 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f6ee8009990 tx=0x7f6ee8009ca0 comp rx=0 tx=0).stop 2024-05-08T05:29:34.721 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:34.720+0000 7f6f05c00700 1 -- 172.21.15.87:0/1487886053 shutdown_connections 2024-05-08T05:29:34.721 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:34.720+0000 7f6f05c00700 1 --2- 172.21.15.87:0/1487886053 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6f0006bb40 0x7f6f00110330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:29:34.721 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:34.720+0000 7f6f05c00700 1 --2- 172.21.15.87:0/1487886053 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6f00109510 0x7f6f001098f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:29:34.721 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:34.720+0000 7f6f05c00700 1 --2- 172.21.15.87:0/1487886053 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6f0006b180 0x7f6f0006b600 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:29:34.721 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:34.720+0000 7f6f05c00700 1 -- 172.21.15.87:0/1487886053 >> 172.21.15.87:0/1487886053 conn(0x7f6f00079350 msgr2=0x7f6f00079760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:29:34.722 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:34.720+0000 7f6f05c00700 1 -- 172.21.15.87:0/1487886053 shutdown_connections 2024-05-08T05:29:34.722 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:34.720+0000 7f6f05c00700 1 -- 172.21.15.87:0/1487886053 wait complete. 2024-05-08T05:29:34.723 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:34.721+0000 7f6f05c00700 1 Processor -- start 2024-05-08T05:29:34.723 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:34.722+0000 7f6f05c00700 1 -- start start 2024-05-08T05:29:34.723 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:34.722+0000 7f6f05c00700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6f0006b180 0x7f6f0019bec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:29:34.723 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:34.722+0000 7f6f05c00700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6f0006bb40 0x7f6f0019c400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:29:34.723 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:34.722+0000 7f6f05c00700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6f00109510 0x7f6f001a0790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:29:34.723 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:34.722+0000 7f6f05c00700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f6f00113690 con 0x7f6f0006b180 2024-05-08T05:29:34.723 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:34.722+0000 7f6f05c00700 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f6f00113510 con 0x7f6f0006bb40 2024-05-08T05:29:34.723 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:34.722+0000 7f6f05c00700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f6f00113810 con 0x7f6f00109510 2024-05-08T05:29:34.723 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:34.722+0000 7f6efea00700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6f0006b180 0x7f6f0019bec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:29:34.723 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:34.723+0000 7f6efea00700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6f0006b180 0x7f6f0019bec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:38872/0 (socket says 172.21.15.87:38872) 2024-05-08T05:29:34.724 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:34.723+0000 7f6ef7e00700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6f0006bb40 0x7f6f0019c400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:29:34.724 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:34.723+0000 7f6efea00700 1 -- 172.21.15.87:0/3577951251 learned_addr learned my addr 172.21.15.87:0/3577951251 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T05:29:34.724 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:34.723+0000 7f6eff400700 1 --2- 172.21.15.87:0/3577951251 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6f00109510 0x7f6f001a0790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:29:34.725 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:34.723+0000 7f6ef7e00700 1 -- 172.21.15.87:0/3577951251 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6f00109510 msgr2=0x7f6f001a0790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:29:34.725 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:34.723+0000 7f6ef7e00700 1 --2- 172.21.15.87:0/3577951251 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6f00109510 0x7f6f001a0790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:29:34.725 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:34.723+0000 7f6ef7e00700 1 -- 172.21.15.87:0/3577951251 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6f0006b180 msgr2=0x7f6f0019bec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:29:34.725 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:34.723+0000 7f6ef7e00700 1 --2- 172.21.15.87:0/3577951251 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6f0006b180 0x7f6f0019bec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:29:34.725 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:34.723+0000 7f6ef7e00700 1 -- 172.21.15.87:0/3577951251 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6f001a0ed0 con 0x7f6f0006bb40 2024-05-08T05:29:34.725 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:34.723+0000 7f6ef7e00700 1 --2- 172.21.15.87:0/3577951251 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6f0006bb40 0x7f6f0019c400 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f6ee80098e0 tx=0x7f6ee80057c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:29:34.725 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:34.724+0000 7f6ef7400700 1 -- 172.21.15.87:0/3577951251 <== mon.2 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ee8027070 con 0x7f6f0006bb40 2024-05-08T05:29:34.725 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:34.724+0000 7f6ef7400700 1 -- 172.21.15.87:0/3577951251 <== mon.2 v2:172.21.15.90:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6ee8022470 con 0x7f6f0006bb40 2024-05-08T05:29:34.725 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:34.724+0000 7f6ef7400700 1 -- 172.21.15.87:0/3577951251 <== mon.2 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ee8017650 con 0x7f6f0006bb40 2024-05-08T05:29:34.725 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:34.724+0000 7f6f05c00700 1 -- 172.21.15.87:0/3577951251 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6f001a1160 con 0x7f6f0006bb40 2024-05-08T05:29:34.725 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:34.724+0000 7f6f05c00700 1 -- 172.21.15.87:0/3577951251 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6f001a8a40 con 0x7f6f0006bb40 2024-05-08T05:29:34.727 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:34.727+0000 7f6ef7400700 1 -- 172.21.15.87:0/3577951251 <== mon.2 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7f6ee802a070 con 0x7f6f0006bb40 2024-05-08T05:29:34.729 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:34.729+0000 7f6f1065db80 1 Processor -- start 2024-05-08T05:29:34.729 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:34.729+0000 7f6f1065db80 1 -- start start 2024-05-08T05:29:34.730 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:34.730+0000 7f6f1065db80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55f6dd085c40 0x55f6dd086020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:29:34.730 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:34.730+0000 7f6f1065db80 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55f6dd086560 0x55f6dd080350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:29:34.730 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:34.730+0000 7f6f1065db80 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f6dd080970 0x55f6dd080df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:29:34.730 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:34.730+0000 7f6f1065db80 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x55f6dcfd2aa0 con 0x55f6dd080970 2024-05-08T05:29:34.730 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:34.730+0000 7f6f1065db80 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x55f6dcf707e0 con 0x55f6dd086560 2024-05-08T05:29:34.730 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:34.730+0000 7f6f1065db80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x55f6dcfcea60 con 0x55f6dd085c40 2024-05-08T05:29:34.731 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:34.730+0000 7f6ef7400700 1 --2- 172.21.15.87:0/3577951251 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f6ee40b2880 0x7f6ee40b4d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:29:34.731 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:34.730+0000 7f6efea00700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55f6dd086560 0x55f6dd080350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:29:34.731 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:34.730+0000 7f6efea00700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55f6dd086560 0x55f6dd080350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.87:36552/0 (socket says 172.21.15.87:36552) 2024-05-08T05:29:34.732 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:34.730+0000 7f6efea00700 1 -- 172.21.15.87:0/2621605369 learned_addr learned my addr 172.21.15.87:0/2621605369 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T05:29:34.732 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:34.730+0000 7f6eff400700 1 --2- 172.21.15.87:0/2621605369 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55f6dd085c40 0x55f6dd086020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:29:34.732 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:34.730+0000 7f6ef7400700 1 -- 172.21.15.87:0/3577951251 <== mon.2 v2:172.21.15.90:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8190+0+0 (secure 0 0 0) 0x7f6ee80e2f20 con 0x7f6f0006bb40 2024-05-08T05:29:34.732 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:34.730+0000 7f6ef7e00700 1 --2- 172.21.15.87:0/2621605369 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f6dd080970 0x55f6dd080df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:29:34.732 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:34.730+0000 7f6eff400700 1 --2- 172.21.15.87:0/3577951251 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f6ee40b2880 0x7f6ee40b4d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:29:34.732 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:34.731+0000 7f6efea00700 1 -- 172.21.15.87:0/2621605369 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55f6dd085c40 msgr2=0x55f6dd086020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:29:34.732 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:34.731+0000 7f6efea00700 1 --2- 172.21.15.87:0/2621605369 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55f6dd085c40 0x55f6dd086020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:29:34.732 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:34.731+0000 7f6efea00700 1 -- 172.21.15.87:0/2621605369 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f6dd080970 msgr2=0x55f6dd080df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:29:34.732 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:34.731+0000 7f6efea00700 1 --2- 172.21.15.87:0/2621605369 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f6dd080970 0x55f6dd080df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:29:34.732 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:34.731+0000 7f6efea00700 1 -- 172.21.15.87:0/2621605369 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f6dcf1f950 con 0x55f6dd086560 2024-05-08T05:29:34.732 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:34.731+0000 7f6eff400700 1 --2- 172.21.15.87:0/2621605369 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55f6dd085c40 0x55f6dd086020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T05:29:34.733 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:29:34 smithi087 ceph-mon[29523]: pgmap v437: 97 pgs: 97 active+clean; 650 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 85 B/s wr, 5 op/s 2024-05-08T05:29:34.734 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:34.731+0000 7f6efea00700 1 --2- 172.21.15.87:0/2621605369 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55f6dd086560 0x55f6dd080350 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f6ef0009e30 tx=0x7f6ef0011720 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d73574ab902ae950 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:29:34.734 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:34.732+0000 7f6eefe00700 1 -- 172.21.15.87:0/2621605369 <== mon.2 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ef001e070 con 0x55f6dd086560 2024-05-08T05:29:34.734 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:34.732+0000 7f6eff400700 1 --2- 172.21.15.87:0/3577951251 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f6ee40b2880 0x7f6ee40b4d40 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f6ef8009fd0 tx=0x7f6ef800b040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:29:34.734 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:34.732+0000 7f6eefe00700 1 -- 172.21.15.87:0/2621605369 <== mon.2 v2:172.21.15.90:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6ef0019ae0 con 0x55f6dd086560 2024-05-08T05:29:34.734 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:34.732+0000 7f6eefe00700 1 -- 172.21.15.87:0/2621605369 <== mon.2 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ef000fb00 con 0x55f6dd086560 2024-05-08T05:29:34.734 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:34.733+0000 7f6f1065db80 1 -- 172.21.15.87:0/2621605369 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55f6dd086560 msgr2=0x55f6dd080350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:29:34.734 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:34.733+0000 7f6f1065db80 1 --2- 172.21.15.87:0/2621605369 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55f6dd086560 0x55f6dd080350 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f6ef0009e30 tx=0x7f6ef0011720 comp rx=0 tx=0).stop 2024-05-08T05:29:34.734 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:34.733+0000 7f6f1065db80 1 -- 172.21.15.87:0/2621605369 shutdown_connections 2024-05-08T05:29:34.734 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:34.733+0000 7f6f1065db80 1 --2- 172.21.15.87:0/2621605369 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f6dd080970 0x55f6dd080df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:29:34.734 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:34.733+0000 7f6f1065db80 1 --2- 172.21.15.87:0/2621605369 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55f6dd085c40 0x55f6dd086020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:29:34.735 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:34.733+0000 7f6f1065db80 1 --2- 172.21.15.87:0/2621605369 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55f6dd086560 0x55f6dd080350 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:29:34.735 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:34.733+0000 7f6f1065db80 1 -- 172.21.15.87:0/2621605369 >> 172.21.15.87:0/2621605369 conn(0x55f6dcff8750 msgr2=0x55f6dd07ab80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:29:34.735 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:34.733+0000 7f6f1065db80 1 -- 172.21.15.87:0/2621605369 shutdown_connections 2024-05-08T05:29:34.735 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:34.733+0000 7f6f1065db80 1 -- 172.21.15.87:0/2621605369 wait complete. 2024-05-08T05:29:34.735 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:34.734+0000 7f6f1065db80 1 -- start start 2024-05-08T05:29:34.735 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:34.734+0000 7f6f1065db80 1 Processor -- start 2024-05-08T05:29:34.735 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:29:34 smithi090 ceph-mon[34526]: pgmap v437: 97 pgs: 97 active+clean; 650 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 85 B/s wr, 5 op/s 2024-05-08T05:29:34.737 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:34.734+0000 7f6f1065db80 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55f6dd080970 0x55f6dd08c250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:29:34.737 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:34.734+0000 7f6f1065db80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55f6dd085c40 0x55f6dd0895f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:29:34.738 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:34.734+0000 7f6f1065db80 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f6dd086560 0x55f6dd089b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:29:34.738 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:34.734+0000 7f6f1065db80 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x55f6dd08cfa0 con 0x55f6dd086560 2024-05-08T05:29:34.738 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:34.734+0000 7f6f1065db80 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x55f6dcf38ba0 con 0x55f6dd080970 2024-05-08T05:29:34.738 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:34.734+0000 7f6f1065db80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x55f6dd08d120 con 0x55f6dd085c40 2024-05-08T05:29:34.738 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:34.734+0000 7f6f1065db80 10 client.0 _ll_register_callbacks cb 0x55f6dcf79cf0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T05:29:34.738 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:34.735+0000 7f6efea00700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55f6dd080970 0x55f6dd08c250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:29:34.738 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:34.735+0000 7f6efea00700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55f6dd080970 0x55f6dd08c250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.87:36554/0 (socket says 172.21.15.87:36554) 2024-05-08T05:29:34.738 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:34.735+0000 7f6efea00700 1 -- 172.21.15.87:0/525399083 learned_addr learned my addr 172.21.15.87:0/525399083 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T05:29:34.738 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:34.735+0000 7f6eff400700 1 --2- 172.21.15.87:0/525399083 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f6dd086560 0x55f6dd089b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:29:34.738 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:34.735+0000 7f6ef7e00700 1 --2- 172.21.15.87:0/525399083 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55f6dd085c40 0x55f6dd0895f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:29:34.738 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:34.735+0000 7f6efea00700 1 -- 172.21.15.87:0/525399083 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55f6dd085c40 msgr2=0x55f6dd0895f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:29:34.738 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:34.735+0000 7f6efea00700 1 --2- 172.21.15.87:0/525399083 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55f6dd085c40 0x55f6dd0895f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:29:34.739 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:34.735+0000 7f6efea00700 1 -- 172.21.15.87:0/525399083 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f6dd086560 msgr2=0x55f6dd089b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:29:34.739 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:34.735+0000 7f6efea00700 1 --2- 172.21.15.87:0/525399083 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f6dd086560 0x55f6dd089b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:29:34.739 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:34.735+0000 7f6efea00700 1 -- 172.21.15.87:0/525399083 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f6dcf984a0 con 0x55f6dd080970 2024-05-08T05:29:34.739 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:34.736+0000 7f6efea00700 1 --2- 172.21.15.87:0/525399083 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55f6dd080970 0x55f6dd08c250 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f6ef00098a0 tx=0x7f6ef0019660 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e063aebcdf3eb04a server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:29:34.739 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:34.736+0000 7f6eecc00700 10 client.0 ms_handle_connect on v2:172.21.15.90:3300/0 2024-05-08T05:29:34.739 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:34.736+0000 7f6eecc00700 1 -- 172.21.15.87:0/525399083 <== mon.2 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ef001e070 con 0x55f6dd080970 2024-05-08T05:29:34.739 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:34.736+0000 7f6f1065db80 1 -- 172.21.15.87:0/525399083 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6ef0019ae0 con 0x55f6dd080970 2024-05-08T05:29:34.739 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:34.736+0000 7f6eecc00700 1 -- 172.21.15.87:0/525399083 <== mon.2 v2:172.21.15.90:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8190+0+0 (secure 0 0 0) 0x7f6ef0005230 con 0x55f6dd080970 2024-05-08T05:29:34.739 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:34.736+0000 7f6eecc00700 1 -- 172.21.15.87:0/525399083 <== mon.2 v2:172.21.15.90:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f6ef0005d00 con 0x55f6dd080970 2024-05-08T05:29:34.739 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:34.736+0000 7f6f1065db80 10 client.25085 fetch_fsmap learned FSMap version 25 2024-05-08T05:29:34.739 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:34.736+0000 7f6f1065db80 1 -- 172.21.15.87:0/525399083 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55f6dd097810 con 0x55f6dd080970 2024-05-08T05:29:34.739 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:34.737+0000 7f6eecc00700 1 -- 172.21.15.87:0/525399083 <== mon.2 v2:172.21.15.90:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6ef0019ae0 con 0x55f6dd080970 2024-05-08T05:29:34.739 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:34.737+0000 7f6eecc00700 1 -- 172.21.15.87:0/525399083 <== mon.2 v2:172.21.15.90:3300/0 5 ==== fsmap(e 25) ==== 8338+0+0 (secure 0 0 0) 0x7f6ef000f780 con 0x55f6dd080970 2024-05-08T05:29:34.739 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:34.737+0000 7f6f1065db80 10 client.25085 fetch_fsmap finished waiting for FSMap version 25 2024-05-08T05:29:34.740 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:34.737+0000 7f6f1065db80 10 client.25085 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-05-08T05:29:34.740 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:34.737+0000 7f6f1065db80 20 client.25085 populate_metadata read hostname 'smithi087' 2024-05-08T05:29:34.740 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:34.737+0000 7f6f1065db80 1 --2- 172.21.15.87:0/525399083 >> [v2:172.21.15.90:6838/160586017,v1:172.21.15.90:6839/160586017] conn(0x55f6dd099d90 0x55f6dd09c180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:29:34.740 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:34.737+0000 7f6f1065db80 4 client.25085 mds_command: new command op to 24500 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-08T05:29:34.740 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:34.737+0000 7f6f1065db80 1 -- 172.21.15.87:0/525399083 --> [v2:172.21.15.90:6838/160586017,v1:172.21.15.90:6839/160586017] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f6dd04d1c0 con 0x55f6dd099d90 2024-05-08T05:29:34.741 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:34.738+0000 7f6ef7e00700 1 --2- 172.21.15.87:0/525399083 >> [v2:172.21.15.90:6838/160586017,v1:172.21.15.90:6839/160586017] conn(0x55f6dd099d90 0x55f6dd09c180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:29:34.741 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:34.738+0000 7f6ef7e00700 1 --2- 172.21.15.87:0/525399083 >> [v2:172.21.15.90:6838/160586017,v1:172.21.15.90:6839/160586017] conn(0x55f6dd099d90 0x55f6dd09c180 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2bbc54380389b059 server_cookie=7a0711f7643e9d75 in_seq=0 out_seq=0 2024-05-08T05:29:34.741 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:34.738+0000 7f6eecc00700 10 client.25085 ms_handle_connect on v2:172.21.15.90:6838/160586017 2024-05-08T05:29:34.741 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:34.739+0000 7f6eecc00700 1 -- 172.21.15.87:0/525399083 <== mds.0 v2:172.21.15.90:6838/160586017 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55f6dd04d1c0 con 0x55f6dd099d90 2024-05-08T05:29:34.741 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:34.739+0000 7f6eecc00700 10 client.25085 handle_command_reply: tid=0 2024-05-08T05:29:34.741 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:34.739+0000 7f6f1065db80 1 client.25085 shutdown 2024-05-08T05:29:34.742 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:34.739+0000 7f6f1065db80 1 -- 172.21.15.87:0/525399083 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55f6dd080970 msgr2=0x55f6dd08c250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:29:34.742 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:34.739+0000 7f6f1065db80 1 --2- 172.21.15.87:0/525399083 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55f6dd080970 0x55f6dd08c250 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f6ef00098a0 tx=0x7f6ef0019660 comp rx=0 tx=0).stop 2024-05-08T05:29:34.742 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:34.740+0000 7f6f1065db80 1 -- 172.21.15.87:0/525399083 shutdown_connections 2024-05-08T05:29:34.742 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:34.740+0000 7f6f1065db80 1 --2- 172.21.15.87:0/525399083 >> [v2:172.21.15.90:6838/160586017,v1:172.21.15.90:6839/160586017] conn(0x55f6dd099d90 0x55f6dd09c180 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:29:34.742 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:34.740+0000 7f6f1065db80 1 --2- 172.21.15.87:0/525399083 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f6dd086560 0x55f6dd089b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:29:34.742 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:34.740+0000 7f6f1065db80 1 --2- 172.21.15.87:0/525399083 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55f6dd080970 0x55f6dd08c250 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:29:34.742 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:34.740+0000 7f6f1065db80 1 --2- 172.21.15.87:0/525399083 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55f6dd085c40 0x55f6dd0895f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:29:34.742 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:34.740+0000 7f6eecc00700 0 client.25085 ms_handle_reset on v2:172.21.15.90:6838/160586017 2024-05-08T05:29:34.742 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:34.740+0000 7f6f1065db80 1 -- 172.21.15.87:0/525399083 >> 172.21.15.87:0/525399083 conn(0x55f6dcff8750 msgr2=0x55f6dd07a210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:29:34.742 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:34.740+0000 7f6f1065db80 1 -- 172.21.15.87:0/525399083 shutdown_connections 2024-05-08T05:29:34.742 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:34.740+0000 7f6f1065db80 1 -- 172.21.15.87:0/525399083 wait complete. 2024-05-08T05:29:34.742 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:34.740+0000 7f6f1065db80 20 client.25085 trim_cache size 0 max 16384 2024-05-08T05:29:34.764 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:34.764+0000 7f6f1065db80 1 Processor -- start 2024-05-08T05:29:34.764 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:34.764+0000 7f6f1065db80 1 -- start start 2024-05-08T05:29:34.765 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:34.764+0000 7f6f1065db80 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f6dd080970 0x55f6dd096030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:29:34.765 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:34.764+0000 7f6f1065db80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55f6dd085c40 0x55f6dd07a990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:29:34.765 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:34.764+0000 7f6f1065db80 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55f6dd086560 0x55f6dd0895b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:29:34.765 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:34.765+0000 7f6f1065db80 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f6f001b2450 con 0x55f6dd080970 2024-05-08T05:29:34.765 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:34.765+0000 7f6f1065db80 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f6f001afce0 con 0x55f6dd086560 2024-05-08T05:29:34.765 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:34.765+0000 7f6f1065db80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f6f001adb50 con 0x55f6dd085c40 2024-05-08T05:29:34.766 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:34.765+0000 7f6efea00700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f6dd080970 0x55f6dd096030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:29:34.766 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:34.765+0000 7f6eff400700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55f6dd086560 0x55f6dd0895b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:29:34.766 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:34.765+0000 7f6eff400700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55f6dd086560 0x55f6dd0895b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.87:36562/0 (socket says 172.21.15.87:36562) 2024-05-08T05:29:34.766 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:34.765+0000 7f6ef7e00700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55f6dd085c40 0x55f6dd07a990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:29:34.766 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:34.765+0000 7f6eff400700 1 -- 172.21.15.87:0/1745293238 learned_addr learned my addr 172.21.15.87:0/1745293238 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T05:29:34.767 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:34.765+0000 7f6ef7e00700 1 -- 172.21.15.87:0/1745293238 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55f6dd086560 msgr2=0x55f6dd0895b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:29:34.767 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:34.765+0000 7f6ef7e00700 1 --2- 172.21.15.87:0/1745293238 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55f6dd086560 0x55f6dd0895b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:29:34.767 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:34.765+0000 7f6ef7e00700 1 -- 172.21.15.87:0/1745293238 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f6dd080970 msgr2=0x55f6dd096030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:29:34.767 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:34.765+0000 7f6ef7e00700 1 --2- 172.21.15.87:0/1745293238 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f6dd080970 0x55f6dd096030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:29:34.768 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:34.765+0000 7f6ef7e00700 1 -- 172.21.15.87:0/1745293238 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f6dd075b30 con 0x55f6dd085c40 2024-05-08T05:29:34.768 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:34.766+0000 7f6ef7e00700 1 --2- 172.21.15.87:0/1745293238 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55f6dd085c40 0x55f6dd07a990 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f6ee80aa530 tx=0x7f6ee80e08c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c9c3e0830e854e51 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:29:34.768 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:34.766+0000 7f6eef400700 1 -- 172.21.15.87:0/1745293238 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ee80aaca0 con 0x55f6dd085c40 2024-05-08T05:29:34.768 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:34.766+0000 7f6eef400700 1 -- 172.21.15.87:0/1745293238 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6ee80aa5a0 con 0x55f6dd085c40 2024-05-08T05:29:34.768 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:34.766+0000 7f6eef400700 1 -- 172.21.15.87:0/1745293238 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ee80094b0 con 0x55f6dd085c40 2024-05-08T05:29:34.768 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:34.767+0000 7f6f1065db80 1 -- 172.21.15.87:0/1745293238 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55f6dd085c40 msgr2=0x55f6dd07a990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:29:34.768 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:34.767+0000 7f6f1065db80 1 --2- 172.21.15.87:0/1745293238 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55f6dd085c40 0x55f6dd07a990 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f6ee80aa530 tx=0x7f6ee80e08c0 comp rx=0 tx=0).stop 2024-05-08T05:29:34.768 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:34.767+0000 7f6f1065db80 1 -- 172.21.15.87:0/1745293238 shutdown_connections 2024-05-08T05:29:34.768 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:34.767+0000 7f6f1065db80 1 --2- 172.21.15.87:0/1745293238 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55f6dd086560 0x55f6dd0895b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:29:34.768 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:34.767+0000 7f6f1065db80 1 --2- 172.21.15.87:0/1745293238 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f6dd080970 0x55f6dd096030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:29:34.768 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:34.767+0000 7f6f1065db80 1 --2- 172.21.15.87:0/1745293238 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55f6dd085c40 0x55f6dd07a990 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:29:34.768 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:34.767+0000 7f6f1065db80 1 -- 172.21.15.87:0/1745293238 >> 172.21.15.87:0/1745293238 conn(0x55f6dcff8750 msgr2=0x55f6dd088ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:29:34.768 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:34.767+0000 7f6f1065db80 1 -- 172.21.15.87:0/1745293238 shutdown_connections 2024-05-08T05:29:34.768 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:34.767+0000 7f6f1065db80 1 -- 172.21.15.87:0/1745293238 wait complete. 2024-05-08T05:29:34.769 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:34.767+0000 7f6f1065db80 1 -- start start 2024-05-08T05:29:34.770 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:34.768+0000 7f6f1065db80 1 Processor -- start 2024-05-08T05:29:34.770 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:34.768+0000 7f6f1065db80 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55f6dd080970 0x55f6dd08f380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:29:34.770 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:34.768+0000 7f6f1065db80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55f6dd085c40 0x55f6dd08f8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:29:34.770 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:34.768+0000 7f6f1065db80 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f6dd086560 0x55f6dd08fe00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:29:34.771 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:34.768+0000 7f6f1065db80 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f6f001ae1a0 con 0x55f6dd086560 2024-05-08T05:29:34.771 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:34.768+0000 7f6f1065db80 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f6f001af610 con 0x55f6dd080970 2024-05-08T05:29:34.771 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:34.768+0000 7f6f1065db80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f6f001ae870 con 0x55f6dd085c40 2024-05-08T05:29:34.771 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:34.768+0000 7f6f1065db80 10 client.0 _ll_register_callbacks cb 0x55f6dcf79cf0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T05:29:34.771 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:34.768+0000 7f6eff400700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f6dd086560 0x55f6dd08fe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:29:34.771 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:34.768+0000 7f6ef7e00700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55f6dd085c40 0x55f6dd08f8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:29:34.771 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:34.768+0000 7f6efea00700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55f6dd080970 0x55f6dd08f380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:29:34.771 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:34.768+0000 7f6eff400700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f6dd086560 0x55f6dd08fe00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:38928/0 (socket says 172.21.15.87:38928) 2024-05-08T05:29:34.771 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:34.768+0000 7f6eff400700 1 -- 172.21.15.87:0/1386793829 learned_addr learned my addr 172.21.15.87:0/1386793829 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T05:29:34.771 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:34.768+0000 7f6ef7e00700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55f6dd085c40 0x55f6dd08f8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.87:38880/0 (socket says 172.21.15.87:38880) 2024-05-08T05:29:34.771 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:34.769+0000 7f6eff400700 1 -- 172.21.15.87:0/1386793829 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55f6dd085c40 msgr2=0x55f6dd08f8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:29:34.771 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:34.769+0000 7f6eff400700 1 --2- 172.21.15.87:0/1386793829 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55f6dd085c40 0x55f6dd08f8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:29:34.771 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:34.769+0000 7f6eff400700 1 -- 172.21.15.87:0/1386793829 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55f6dd080970 msgr2=0x55f6dd08f380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:29:34.772 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:34.769+0000 7f6eff400700 1 --2- 172.21.15.87:0/1386793829 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55f6dd080970 0x55f6dd08f380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:29:34.772 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:34.769+0000 7f6eff400700 1 -- 172.21.15.87:0/1386793829 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f6dd104710 con 0x55f6dd086560 2024-05-08T05:29:34.772 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:34.769+0000 7f6eff400700 1 --2- 172.21.15.87:0/1386793829 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f6dd086560 0x55f6dd08fe00 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f6ef8018ca0 tx=0x7f6ef8004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d0b4fcf371c51f75 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:29:34.772 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:34.769+0000 7f6eecc00700 10 client.0 ms_handle_connect on v2:172.21.15.87:3300/0 2024-05-08T05:29:34.772 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:34.770+0000 7f6eecc00700 1 -- 172.21.15.87:0/1386793829 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ef8007be0 con 0x55f6dd086560 2024-05-08T05:29:34.772 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:34.770+0000 7f6eecc00700 1 -- 172.21.15.87:0/1386793829 <== mon.0 v2:172.21.15.87:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8190+0+0 (secure 0 0 0) 0x7f6ef8012040 con 0x55f6dd086560 2024-05-08T05:29:34.772 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:34.770+0000 7f6f1065db80 1 -- 172.21.15.87:0/1386793829 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6ee80aa5a0 con 0x55f6dd086560 2024-05-08T05:29:34.772 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:34.770+0000 7f6eecc00700 1 -- 172.21.15.87:0/1386793829 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f6ef8007d80 con 0x55f6dd086560 2024-05-08T05:29:34.772 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:34.770+0000 7f6f1065db80 10 client.14991 fetch_fsmap learned FSMap version 25 2024-05-08T05:29:34.772 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:34.770+0000 7f6f1065db80 1 -- 172.21.15.87:0/1386793829 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55f6dd105a30 con 0x55f6dd086560 2024-05-08T05:29:34.772 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:34.770+0000 7f6eecc00700 1 -- 172.21.15.87:0/1386793829 <== mon.0 v2:172.21.15.87:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6ee80aa5a0 con 0x55f6dd086560 2024-05-08T05:29:34.774 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:34.770+0000 7f6eecc00700 1 -- 172.21.15.87:0/1386793829 <== mon.0 v2:172.21.15.87:3300/0 5 ==== fsmap(e 25) ==== 8338+0+0 (secure 0 0 0) 0x7f6ef801a470 con 0x55f6dd086560 2024-05-08T05:29:34.774 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:34.771+0000 7f6f1065db80 10 client.14991 fetch_fsmap finished waiting for FSMap version 25 2024-05-08T05:29:34.774 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:34.771+0000 7f6f1065db80 10 client.14991 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-05-08T05:29:34.774 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:34.771+0000 7f6f1065db80 20 client.14991 populate_metadata read hostname 'smithi087' 2024-05-08T05:29:34.774 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:34.771+0000 7f6f1065db80 1 --2- 172.21.15.87:0/1386793829 >> [v2:172.21.15.90:6838/160586017,v1:172.21.15.90:6839/160586017] conn(0x55f6dd106190 0x55f6dd1085b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:29:34.774 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:34.771+0000 7f6f1065db80 4 client.14991 mds_command: new command op to 24500 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-05-08T05:29:34.774 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:34.771+0000 7f6f1065db80 1 -- 172.21.15.87:0/1386793829 --> [v2:172.21.15.90:6838/160586017,v1:172.21.15.90:6839/160586017] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x55f6dcfe0480 con 0x55f6dd106190 2024-05-08T05:29:34.774 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:34.771+0000 7f6efea00700 1 --2- 172.21.15.87:0/1386793829 >> [v2:172.21.15.90:6838/160586017,v1:172.21.15.90:6839/160586017] conn(0x55f6dd106190 0x55f6dd1085b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:29:34.774 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:34.771+0000 7f6efea00700 1 --2- 172.21.15.87:0/1386793829 >> [v2:172.21.15.90:6838/160586017,v1:172.21.15.90:6839/160586017] conn(0x55f6dd106190 0x55f6dd1085b0 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=27acb8b8da747ad3 server_cookie=e5fc9d433f827c69 in_seq=0 out_seq=0 2024-05-08T05:29:34.774 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:34.771+0000 7f6eecc00700 10 client.14991 ms_handle_connect on v2:172.21.15.90:6838/160586017 2024-05-08T05:29:34.775 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:34.773+0000 7f6eecc00700 1 -- 172.21.15.87:0/1386793829 <== mds.0 v2:172.21.15.90:6838/160586017 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55f6dcfe0480 con 0x55f6dd106190 2024-05-08T05:29:34.775 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:34.773+0000 7f6eecc00700 10 client.14991 handle_command_reply: tid=0 2024-05-08T05:29:34.775 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:34.773+0000 7f6f1065db80 1 client.14991 shutdown 2024-05-08T05:29:34.775 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:34.773+0000 7f6f1065db80 1 -- 172.21.15.87:0/1386793829 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f6dd086560 msgr2=0x55f6dd08fe00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:29:34.775 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:34.773+0000 7f6f1065db80 1 --2- 172.21.15.87:0/1386793829 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f6dd086560 0x55f6dd08fe00 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f6ef8018ca0 tx=0x7f6ef8004ad0 comp rx=0 tx=0).stop 2024-05-08T05:29:34.775 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:34.773+0000 7f6f1065db80 1 -- 172.21.15.87:0/1386793829 shutdown_connections 2024-05-08T05:29:34.775 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:34.773+0000 7f6f1065db80 1 --2- 172.21.15.87:0/1386793829 >> [v2:172.21.15.90:6838/160586017,v1:172.21.15.90:6839/160586017] conn(0x55f6dd106190 0x55f6dd1085b0 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:29:34.775 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:34.773+0000 7f6f1065db80 1 --2- 172.21.15.87:0/1386793829 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f6dd086560 0x55f6dd08fe00 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:29:34.775 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:34.773+0000 7f6f1065db80 1 --2- 172.21.15.87:0/1386793829 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55f6dd080970 0x55f6dd08f380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:29:34.775 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:34.773+0000 7f6f1065db80 1 --2- 172.21.15.87:0/1386793829 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55f6dd085c40 0x55f6dd08f8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:29:34.775 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:34.773+0000 7f6f1065db80 1 -- 172.21.15.87:0/1386793829 >> 172.21.15.87:0/1386793829 conn(0x55f6dcff8750 msgr2=0x55f6dd089700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:29:34.775 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:34.773+0000 7f6eecc00700 0 client.14991 ms_handle_reset on v2:172.21.15.90:6838/160586017 2024-05-08T05:29:34.775 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:34.773+0000 7f6f1065db80 1 -- 172.21.15.87:0/1386793829 shutdown_connections 2024-05-08T05:29:34.775 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:34.773+0000 7f6f1065db80 1 -- 172.21.15.87:0/1386793829 wait complete. 2024-05-08T05:29:34.776 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:34.773+0000 7f6f1065db80 20 client.14991 trim_cache size 0 max 16384 2024-05-08T05:29:34.776 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-05-08T05:29:34.776 INFO:teuthology.orchestra.run.smithi087.stdout: "return_code": 0, 2024-05-08T05:29:34.776 INFO:teuthology.orchestra.run.smithi087.stdout: "scrub_tag": "c879003b-a5b5-4a7d-8719-16cd2853a48c", 2024-05-08T05:29:34.776 INFO:teuthology.orchestra.run.smithi087.stdout: "mode": "asynchronous" 2024-05-08T05:29:34.776 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-05-08T05:29:34.777 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:34.774+0000 7f6f05c00700 1 -- 172.21.15.87:0/3577951251 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f6ee40b2880 msgr2=0x7f6ee40b4d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:29:34.777 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:34.774+0000 7f6f05c00700 1 --2- 172.21.15.87:0/3577951251 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f6ee40b2880 0x7f6ee40b4d40 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f6ef8009fd0 tx=0x7f6ef800b040 comp rx=0 tx=0).stop 2024-05-08T05:29:34.777 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:34.774+0000 7f6f05c00700 1 -- 172.21.15.87:0/3577951251 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6f0006bb40 msgr2=0x7f6f0019c400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:29:34.777 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:34.774+0000 7f6f05c00700 1 --2- 172.21.15.87:0/3577951251 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6f0006bb40 0x7f6f0019c400 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f6ee80098e0 tx=0x7f6ee80057c0 comp rx=0 tx=0).stop 2024-05-08T05:29:34.777 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:34.774+0000 7f6f05c00700 1 -- 172.21.15.87:0/3577951251 shutdown_connections 2024-05-08T05:29:34.777 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:34.774+0000 7f6f05c00700 1 --2- 172.21.15.87:0/3577951251 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f6ee40b2880 0x7f6ee40b4d40 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:29:34.777 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:34.774+0000 7f6f05c00700 1 --2- 172.21.15.87:0/3577951251 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6f00109510 0x7f6f001a0790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:29:34.777 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:34.774+0000 7f6f05c00700 1 --2- 172.21.15.87:0/3577951251 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6f0006b180 0x7f6f0019bec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:29:34.777 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:34.774+0000 7f6f05c00700 1 --2- 172.21.15.87:0/3577951251 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6f0006bb40 0x7f6f0019c400 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:29:34.777 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:34.774+0000 7f6f05c00700 1 -- 172.21.15.87:0/3577951251 >> 172.21.15.87:0/3577951251 conn(0x7f6f00079350 msgr2=0x7f6f0010e680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:29:34.777 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:34.774+0000 7f6f05c00700 1 -- 172.21.15.87:0/3577951251 shutdown_connections 2024-05-08T05:29:34.778 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:34.774+0000 7f6f05c00700 1 -- 172.21.15.87:0/3577951251 wait complete. 2024-05-08T05:29:34.788 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:29:34 smithi160 ceph-mon[34827]: pgmap v437: 97 pgs: 97 active+clean; 650 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 85 B/s wr, 5 op/s 2024-05-08T05:29:35.651 DEBUG:teuthology.orchestra.run.smithi087:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid eeeb813e-0cf9-11ef-bc97-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-05-08T05:29:35.788 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:29:35 smithi160 ceph-mon[34827]: scrub queued for path: / 2024-05-08T05:29:35.789 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:29:35 smithi160 ceph-mon[34827]: scrub summary: idle+waiting paths [/] 2024-05-08T05:29:35.789 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:29:35 smithi160 ceph-mon[34827]: scrub summary: active paths [/] 2024-05-08T05:29:35.789 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:29:35 smithi160 ceph-mon[34827]: scrub summary: idle+waiting paths [/] 2024-05-08T05:29:35.958 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:29:35 smithi087 ceph-mon[29523]: scrub queued for path: / 2024-05-08T05:29:35.958 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:29:35 smithi087 ceph-mon[29523]: scrub summary: idle+waiting paths [/] 2024-05-08T05:29:35.958 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:29:35 smithi087 ceph-mon[29523]: scrub summary: active paths [/] 2024-05-08T05:29:35.958 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:29:35 smithi087 ceph-mon[29523]: scrub summary: idle+waiting paths [/] 2024-05-08T05:29:35.983 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:29:35 smithi090 ceph-mon[34526]: scrub queued for path: / 2024-05-08T05:29:35.983 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:29:35 smithi090 ceph-mon[34526]: scrub summary: idle+waiting paths [/] 2024-05-08T05:29:35.983 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:29:35 smithi090 ceph-mon[34526]: scrub summary: active paths [/] 2024-05-08T05:29:35.984 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:29:35 smithi090 ceph-mon[34526]: scrub summary: idle+waiting paths [/] 2024-05-08T05:29:36.109 INFO:teuthology.orchestra.run.smithi087.stderr:Inferring config /var/lib/ceph/eeeb813e-0cf9-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T05:29:36.578 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:29:36 smithi087 ceph-mon[29523]: pgmap v438: 97 pgs: 97 active+clean; 656 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 767 B/s wr, 7 op/s 2024-05-08T05:29:36.788 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:29:36 smithi160 ceph-mon[34827]: pgmap v438: 97 pgs: 97 active+clean; 656 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 767 B/s wr, 7 op/s 2024-05-08T05:29:36.983 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:29:36 smithi090 ceph-mon[34526]: pgmap v438: 97 pgs: 97 active+clean; 656 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 767 B/s wr, 7 op/s 2024-05-08T05:29:38.243 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:38.240+0000 7f1d0ce00700 1 -- 172.21.15.87:0/2379918305 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1d0810b6c0 msgr2=0x7f1d0810baa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:29:38.243 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:38.240+0000 7f1d0ce00700 1 --2- 172.21.15.87:0/2379918305 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1d0810b6c0 0x7f1d0810baa0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f1cf80098f0 tx=0x7f1cf8009c00 comp rx=0 tx=0).stop 2024-05-08T05:29:38.243 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:38.241+0000 7f1d0ce00700 1 -- 172.21.15.87:0/2379918305 shutdown_connections 2024-05-08T05:29:38.243 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:38.241+0000 7f1d0ce00700 1 --2- 172.21.15.87:0/2379918305 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1d08106080 0x7f1d08112590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:29:38.243 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:38.241+0000 7f1d0ce00700 1 --2- 172.21.15.87:0/2379918305 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1d0810b6c0 0x7f1d0810baa0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:29:38.243 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:38.241+0000 7f1d0ce00700 1 --2- 172.21.15.87:0/2379918305 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1d081056c0 0x7f1d08105b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:29:38.243 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:38.241+0000 7f1d0ce00700 1 -- 172.21.15.87:0/2379918305 >> 172.21.15.87:0/2379918305 conn(0x7f1d081011b0 msgr2=0x7f1d081035d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:29:38.244 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:38.241+0000 7f1d0ce00700 1 -- 172.21.15.87:0/2379918305 shutdown_connections 2024-05-08T05:29:38.244 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:38.241+0000 7f1d0ce00700 1 -- 172.21.15.87:0/2379918305 wait complete. 2024-05-08T05:29:38.245 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:38.243+0000 7f1d0ce00700 1 Processor -- start 2024-05-08T05:29:38.245 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:38.243+0000 7f1d0ce00700 1 -- start start 2024-05-08T05:29:38.245 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:38.243+0000 7f1d0ce00700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1d081056c0 0x7f1d0819bdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:29:38.246 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:38.243+0000 7f1d0ce00700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1d08106080 0x7f1d0819c2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:29:38.246 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:38.243+0000 7f1d0ce00700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1d0810b6c0 0x7f1d081a0680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:29:38.246 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:38.243+0000 7f1d0ce00700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f1d081158c0 con 0x7f1d0810b6c0 2024-05-08T05:29:38.246 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:38.243+0000 7f1d0ce00700 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f1d08115740 con 0x7f1d081056c0 2024-05-08T05:29:38.246 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:38.243+0000 7f1d0ce00700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f1d08115a40 con 0x7f1d08106080 2024-05-08T05:29:38.246 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:38.244+0000 7f1d06800700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1d0810b6c0 0x7f1d081a0680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:29:38.246 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:38.244+0000 7f1d06800700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1d0810b6c0 0x7f1d081a0680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:54926/0 (socket says 172.21.15.87:54926) 2024-05-08T05:29:38.246 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:38.244+0000 7f1d06800700 1 -- 172.21.15.87:0/3489577330 learned_addr learned my addr 172.21.15.87:0/3489577330 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T05:29:38.247 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:38.244+0000 7f1d05e00700 1 --2- 172.21.15.87:0/3489577330 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1d081056c0 0x7f1d0819bdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:29:38.247 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:38.244+0000 7f1d05400700 1 --2- 172.21.15.87:0/3489577330 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1d08106080 0x7f1d0819c2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:29:38.248 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:38.244+0000 7f1d05400700 1 -- 172.21.15.87:0/3489577330 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1d081056c0 msgr2=0x7f1d0819bdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:29:38.248 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:38.244+0000 7f1d05400700 1 --2- 172.21.15.87:0/3489577330 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1d081056c0 0x7f1d0819bdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:29:38.248 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:38.244+0000 7f1d05400700 1 -- 172.21.15.87:0/3489577330 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1d0810b6c0 msgr2=0x7f1d081a0680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:29:38.249 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:38.244+0000 7f1d05400700 1 --2- 172.21.15.87:0/3489577330 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1d0810b6c0 0x7f1d081a0680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:29:38.249 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:38.244+0000 7f1d05400700 1 -- 172.21.15.87:0/3489577330 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1d081a0dc0 con 0x7f1d08106080 2024-05-08T05:29:38.249 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:38.244+0000 7f1d06800700 1 --2- 172.21.15.87:0/3489577330 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1d0810b6c0 0x7f1d081a0680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T05:29:38.249 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:38.245+0000 7f1d05400700 1 --2- 172.21.15.87:0/3489577330 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1d08106080 0x7f1d0819c2f0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f1cf400e9c0 tx=0x7f1cf400ecd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:29:38.249 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:38.245+0000 7f1cfea00700 1 -- 172.21.15.87:0/3489577330 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1cf400c9c0 con 0x7f1d08106080 2024-05-08T05:29:38.249 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:38.245+0000 7f1cfea00700 1 -- 172.21.15.87:0/3489577330 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1cf400cb60 con 0x7f1d08106080 2024-05-08T05:29:38.249 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:38.245+0000 7f1d0ce00700 1 -- 172.21.15.87:0/3489577330 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1d081a10b0 con 0x7f1d08106080 2024-05-08T05:29:38.249 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:38.245+0000 7f1cfea00700 1 -- 172.21.15.87:0/3489577330 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1cf4018420 con 0x7f1d08106080 2024-05-08T05:29:38.249 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:38.245+0000 7f1d0ce00700 1 -- 172.21.15.87:0/3489577330 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1d081a8930 con 0x7f1d08106080 2024-05-08T05:29:38.251 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:38.249+0000 7f1cfea00700 1 -- 172.21.15.87:0/3489577330 <== mon.1 v2:172.21.15.160:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7f1cf4010430 con 0x7f1d08106080 2024-05-08T05:29:38.251 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:38.250+0000 7f1d17713b80 1 Processor -- start 2024-05-08T05:29:38.251 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:38.250+0000 7f1d17713b80 1 -- start start 2024-05-08T05:29:38.252 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:38.250+0000 7f1d17713b80 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e8f38ea060 0x55e8f38ea440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:29:38.252 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:38.250+0000 7f1d17713b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55e8f38ea980 0x55e8f38ee490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:29:38.252 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:38.250+0000 7f1d17713b80 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55e8f38ee9d0 0x55e8f38eee30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:29:38.252 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:38.250+0000 7f1d17713b80 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x55e8f383ca20 con 0x55e8f38ea060 2024-05-08T05:29:38.252 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:38.250+0000 7f1d17713b80 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x55e8f37da760 con 0x55e8f38ee9d0 2024-05-08T05:29:38.252 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:38.250+0000 7f1d17713b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x55e8f38389e0 con 0x55e8f38ea980 2024-05-08T05:29:38.252 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:38.251+0000 7f1d06800700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e8f38ea060 0x55e8f38ea440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:29:38.252 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:38.251+0000 7f1d06800700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e8f38ea060 0x55e8f38ea440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:54940/0 (socket says 172.21.15.87:54940) 2024-05-08T05:29:38.252 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:38.251+0000 7f1d05e00700 1 --2- 172.21.15.87:0/3429163044 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55e8f38ea980 0x55e8f38ee490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:29:38.253 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:38.251+0000 7f1d06800700 1 -- 172.21.15.87:0/3429163044 learned_addr learned my addr 172.21.15.87:0/3429163044 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T05:29:38.253 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:38.251+0000 7f1d05400700 1 --2- 172.21.15.87:0/3429163044 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55e8f38ee9d0 0x55e8f38eee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:29:38.254 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:38.251+0000 7f1d05e00700 1 -- 172.21.15.87:0/3429163044 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55e8f38ee9d0 msgr2=0x55e8f38eee30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:29:38.254 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:38.251+0000 7f1d05e00700 1 --2- 172.21.15.87:0/3429163044 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55e8f38ee9d0 0x55e8f38eee30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:29:38.254 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:38.251+0000 7f1d05e00700 1 -- 172.21.15.87:0/3429163044 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e8f38ea060 msgr2=0x55e8f38ea440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:29:38.254 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:38.251+0000 7f1d05e00700 1 --2- 172.21.15.87:0/3429163044 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e8f38ea060 0x55e8f38ea440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:29:38.254 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:38.251+0000 7f1d05e00700 1 -- 172.21.15.87:0/3429163044 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e8f37898d0 con 0x55e8f38ea980 2024-05-08T05:29:38.254 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:38.251+0000 7f1d06800700 1 --2- 172.21.15.87:0/3429163044 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e8f38ea060 0x55e8f38ea440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T05:29:38.254 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:38.251+0000 7f1cfea00700 1 --2- 172.21.15.87:0/3489577330 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f1cec0b2900 0x7f1cec0b4dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:29:38.254 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:38.252+0000 7f1d05e00700 1 --2- 172.21.15.87:0/3429163044 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55e8f38ea980 0x55e8f38ee490 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f1cf80098c0 tx=0x7f1cf8005dc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=428830c56c5432c9 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:29:38.254 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:38.252+0000 7f1cfea00700 1 -- 172.21.15.87:0/3489577330 <== mon.1 v2:172.21.15.160:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8190+0+0 (secure 0 0 0) 0x7f1cf40e2330 con 0x7f1d08106080 2024-05-08T05:29:38.254 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:38.252+0000 7f1d06800700 1 --2- 172.21.15.87:0/3489577330 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f1cec0b2900 0x7f1cec0b4dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:29:38.254 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:38.252+0000 7f1cf3400700 1 -- 172.21.15.87:0/3429163044 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1cf800fe40 con 0x55e8f38ea980 2024-05-08T05:29:38.254 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:38.252+0000 7f1cf3400700 1 -- 172.21.15.87:0/3429163044 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1cf800f910 con 0x55e8f38ea980 2024-05-08T05:29:38.255 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:38.252+0000 7f1cf3400700 1 -- 172.21.15.87:0/3429163044 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1cf80038e0 con 0x55e8f38ea980 2024-05-08T05:29:38.255 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:38.253+0000 7f1d17713b80 1 -- 172.21.15.87:0/3429163044 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55e8f38ea980 msgr2=0x55e8f38ee490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:29:38.255 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:38.253+0000 7f1d17713b80 1 --2- 172.21.15.87:0/3429163044 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55e8f38ea980 0x55e8f38ee490 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f1cf80098c0 tx=0x7f1cf8005dc0 comp rx=0 tx=0).stop 2024-05-08T05:29:38.256 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:38.253+0000 7f1d06800700 1 --2- 172.21.15.87:0/3489577330 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f1cec0b2900 0x7f1cec0b4dc0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f1d00009550 tx=0x7f1d0000b040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:29:38.256 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:38.253+0000 7f1d17713b80 1 -- 172.21.15.87:0/3429163044 shutdown_connections 2024-05-08T05:29:38.256 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:38.253+0000 7f1d17713b80 1 --2- 172.21.15.87:0/3429163044 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55e8f38ee9d0 0x55e8f38eee30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:29:38.256 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:38.253+0000 7f1d17713b80 1 --2- 172.21.15.87:0/3429163044 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e8f38ea060 0x55e8f38ea440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:29:38.256 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:38.253+0000 7f1d17713b80 1 --2- 172.21.15.87:0/3429163044 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55e8f38ea980 0x55e8f38ee490 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:29:38.256 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:38.253+0000 7f1d17713b80 1 -- 172.21.15.87:0/3429163044 >> 172.21.15.87:0/3429163044 conn(0x55e8f3818b60 msgr2=0x55e8f38e47a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:29:38.256 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:38.254+0000 7f1d17713b80 1 -- 172.21.15.87:0/3429163044 shutdown_connections 2024-05-08T05:29:38.256 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:38.254+0000 7f1d17713b80 1 -- 172.21.15.87:0/3429163044 wait complete. 2024-05-08T05:29:38.256 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:38.254+0000 7f1d17713b80 1 -- start start 2024-05-08T05:29:38.257 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:38.255+0000 7f1d17713b80 1 Processor -- start 2024-05-08T05:29:38.257 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:38.255+0000 7f1d17713b80 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e8f38ea060 0x55e8f38f5e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:29:38.257 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:38.255+0000 7f1d17713b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55e8f38ea980 0x55e8f38f31f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:29:38.257 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:38.255+0000 7f1d17713b80 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55e8f38ee9d0 0x55e8f38f3730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:29:38.258 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:38.255+0000 7f1d17713b80 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x55e8f38f6b80 con 0x55e8f38ea060 2024-05-08T05:29:38.258 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:38.255+0000 7f1d17713b80 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x55e8f37a2b20 con 0x55e8f38ee9d0 2024-05-08T05:29:38.258 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:38.255+0000 7f1d17713b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x55e8f38f6d00 con 0x55e8f38ea980 2024-05-08T05:29:38.258 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:38.255+0000 7f1d17713b80 10 client.0 _ll_register_callbacks cb 0x55e8f37e3c70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T05:29:38.258 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:38.256+0000 7f1d06800700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55e8f38ee9d0 0x55e8f38f3730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:29:38.258 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:38.256+0000 7f1d05e00700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e8f38ea060 0x55e8f38f5e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:29:38.258 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:38.256+0000 7f1d06800700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55e8f38ee9d0 0x55e8f38f3730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.87:58278/0 (socket says 172.21.15.87:58278) 2024-05-08T05:29:38.258 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:38.256+0000 7f1d06800700 1 -- 172.21.15.87:0/2978218526 learned_addr learned my addr 172.21.15.87:0/2978218526 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T05:29:38.258 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:38.256+0000 7f1d05400700 1 --2- 172.21.15.87:0/2978218526 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55e8f38ea980 0x55e8f38f31f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:29:38.258 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:38.256+0000 7f1d05e00700 1 -- 172.21.15.87:0/2978218526 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55e8f38ea980 msgr2=0x55e8f38f31f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:29:38.258 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:38.256+0000 7f1d05e00700 1 --2- 172.21.15.87:0/2978218526 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55e8f38ea980 0x55e8f38f31f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:29:38.258 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:38.256+0000 7f1d05e00700 1 -- 172.21.15.87:0/2978218526 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55e8f38ee9d0 msgr2=0x55e8f38f3730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:29:38.258 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:38.256+0000 7f1d05e00700 1 --2- 172.21.15.87:0/2978218526 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55e8f38ee9d0 0x55e8f38f3730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:29:38.259 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:38.256+0000 7f1d05e00700 1 -- 172.21.15.87:0/2978218526 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e8f3802420 con 0x55e8f38ea060 2024-05-08T05:29:38.259 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:38.256+0000 7f1d06800700 1 --2- 172.21.15.87:0/2978218526 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55e8f38ee9d0 0x55e8f38f3730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T05:29:38.260 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:38.256+0000 7f1d05e00700 1 --2- 172.21.15.87:0/2978218526 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e8f38ea060 0x55e8f38f5e50 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f1cf8005a00 tx=0x7f1cf800f690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=30362366a3c463e1 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:29:38.260 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:38.256+0000 7f1ce7e00700 10 client.0 ms_handle_connect on v2:172.21.15.87:3300/0 2024-05-08T05:29:38.260 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:38.257+0000 7f1ce7e00700 1 -- 172.21.15.87:0/2978218526 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1cf802f070 con 0x55e8f38ea060 2024-05-08T05:29:38.260 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:38.257+0000 7f1ce7e00700 1 -- 172.21.15.87:0/2978218526 <== mon.0 v2:172.21.15.87:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8190+0+0 (secure 0 0 0) 0x7f1cf8003680 con 0x55e8f38ea060 2024-05-08T05:29:38.260 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:38.257+0000 7f1d17713b80 1 -- 172.21.15.87:0/2978218526 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1cf800f910 con 0x55e8f38ea060 2024-05-08T05:29:38.261 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:38.257+0000 7f1ce7e00700 1 -- 172.21.15.87:0/2978218526 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f1cf803b050 con 0x55e8f38ea060 2024-05-08T05:29:38.261 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:38.257+0000 7f1d17713b80 10 client.15003 fetch_fsmap learned FSMap version 25 2024-05-08T05:29:38.261 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:38.257+0000 7f1d17713b80 1 -- 172.21.15.87:0/2978218526 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55e8f39013e0 con 0x55e8f38ea060 2024-05-08T05:29:38.261 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:38.258+0000 7f1ce7e00700 1 -- 172.21.15.87:0/2978218526 <== mon.0 v2:172.21.15.87:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1cf800f910 con 0x55e8f38ea060 2024-05-08T05:29:38.261 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:38.258+0000 7f1ce7e00700 1 -- 172.21.15.87:0/2978218526 <== mon.0 v2:172.21.15.87:3300/0 5 ==== fsmap(e 25) ==== 8338+0+0 (secure 0 0 0) 0x7f1cf800b7f0 con 0x55e8f38ea060 2024-05-08T05:29:38.261 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:38.258+0000 7f1d17713b80 10 client.15003 fetch_fsmap finished waiting for FSMap version 25 2024-05-08T05:29:38.261 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:38.258+0000 7f1d17713b80 10 client.15003 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-05-08T05:29:38.261 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:38.258+0000 7f1d17713b80 20 client.15003 populate_metadata read hostname 'smithi087' 2024-05-08T05:29:38.261 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:38.258+0000 7f1d17713b80 1 --2- 172.21.15.87:0/2978218526 >> [v2:172.21.15.90:6838/160586017,v1:172.21.15.90:6839/160586017] conn(0x55e8f39038b0 0x55e8f3905ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:29:38.261 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:38.258+0000 7f1d17713b80 4 client.15003 mds_command: new command op to 24500 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-08T05:29:38.261 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:38.258+0000 7f1d17713b80 1 -- 172.21.15.87:0/2978218526 --> [v2:172.21.15.90:6838/160586017,v1:172.21.15.90:6839/160586017] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e8f38b70a0 con 0x55e8f39038b0 2024-05-08T05:29:38.261 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:38.258+0000 7f1d05400700 1 --2- 172.21.15.87:0/2978218526 >> [v2:172.21.15.90:6838/160586017,v1:172.21.15.90:6839/160586017] conn(0x55e8f39038b0 0x55e8f3905ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:29:38.261 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:38.259+0000 7f1d05400700 1 --2- 172.21.15.87:0/2978218526 >> [v2:172.21.15.90:6838/160586017,v1:172.21.15.90:6839/160586017] conn(0x55e8f39038b0 0x55e8f3905ca0 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1f250c28f5eee073 server_cookie=b9690420d57adfea in_seq=0 out_seq=0 2024-05-08T05:29:38.261 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:38.259+0000 7f1ce7e00700 10 client.15003 ms_handle_connect on v2:172.21.15.90:6838/160586017 2024-05-08T05:29:38.262 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:38.259+0000 7f1ce7e00700 1 -- 172.21.15.87:0/2978218526 <== mds.0 v2:172.21.15.90:6838/160586017 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55e8f38b70a0 con 0x55e8f39038b0 2024-05-08T05:29:38.262 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:38.259+0000 7f1ce7e00700 10 client.15003 handle_command_reply: tid=0 2024-05-08T05:29:38.263 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:38.260+0000 7f1d17713b80 1 client.15003 shutdown 2024-05-08T05:29:38.263 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:38.260+0000 7f1d17713b80 1 -- 172.21.15.87:0/2978218526 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e8f38ea060 msgr2=0x55e8f38f5e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:29:38.263 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:38.260+0000 7f1d17713b80 1 --2- 172.21.15.87:0/2978218526 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e8f38ea060 0x55e8f38f5e50 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f1cf8005a00 tx=0x7f1cf800f690 comp rx=0 tx=0).stop 2024-05-08T05:29:38.263 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:38.260+0000 7f1d17713b80 1 -- 172.21.15.87:0/2978218526 shutdown_connections 2024-05-08T05:29:38.263 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:38.260+0000 7f1d17713b80 1 --2- 172.21.15.87:0/2978218526 >> [v2:172.21.15.90:6838/160586017,v1:172.21.15.90:6839/160586017] conn(0x55e8f39038b0 0x55e8f3905ca0 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:29:38.263 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:38.260+0000 7f1d17713b80 1 --2- 172.21.15.87:0/2978218526 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55e8f38ee9d0 0x55e8f38f3730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:29:38.263 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:38.260+0000 7f1d17713b80 1 --2- 172.21.15.87:0/2978218526 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e8f38ea060 0x55e8f38f5e50 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:29:38.263 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:38.260+0000 7f1d17713b80 1 --2- 172.21.15.87:0/2978218526 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55e8f38ea980 0x55e8f38f31f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:29:38.263 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:38.260+0000 7f1d17713b80 1 -- 172.21.15.87:0/2978218526 >> 172.21.15.87:0/2978218526 conn(0x55e8f3818b60 msgr2=0x55e8f38df2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:29:38.263 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:38.260+0000 7f1ce7e00700 0 client.15003 ms_handle_reset on v2:172.21.15.90:6838/160586017 2024-05-08T05:29:38.263 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:38.260+0000 7f1d17713b80 1 -- 172.21.15.87:0/2978218526 shutdown_connections 2024-05-08T05:29:38.263 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:38.260+0000 7f1d17713b80 1 -- 172.21.15.87:0/2978218526 wait complete. 2024-05-08T05:29:38.263 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:38.260+0000 7f1d17713b80 20 client.15003 trim_cache size 0 max 16384 2024-05-08T05:29:38.283 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:38.282+0000 7f1d17713b80 1 Processor -- start 2024-05-08T05:29:38.283 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:38.282+0000 7f1d17713b80 1 -- start start 2024-05-08T05:29:38.284 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:38.282+0000 7f1d17713b80 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55e8f38ea060 0x55e8f38f0e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:29:38.284 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:38.282+0000 7f1d17713b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55e8f38ea980 0x55e8f38dea20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:29:38.284 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:38.283+0000 7f1d17713b80 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e8f38ee9d0 0x55e8f38def60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:29:38.284 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:38.283+0000 7f1d17713b80 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f1d081b2500 con 0x55e8f38ee9d0 2024-05-08T05:29:38.285 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:38.283+0000 7f1d17713b80 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f1d081afd90 con 0x55e8f38ea060 2024-05-08T05:29:38.285 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:38.283+0000 7f1d17713b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f1d081adbe0 con 0x55e8f38ea980 2024-05-08T05:29:38.285 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:38.283+0000 7f1d06800700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e8f38ee9d0 0x55e8f38def60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:29:38.285 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:38.283+0000 7f1d05e00700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55e8f38ea060 0x55e8f38f0e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:29:38.285 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:38.283+0000 7f1d05e00700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55e8f38ea060 0x55e8f38f0e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.87:58288/0 (socket says 172.21.15.87:58288) 2024-05-08T05:29:38.285 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:38.283+0000 7f1d05400700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55e8f38ea980 0x55e8f38dea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:29:38.285 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:38.283+0000 7f1d06800700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e8f38ee9d0 0x55e8f38def60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:54946/0 (socket says 172.21.15.87:54946) 2024-05-08T05:29:38.285 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:38.283+0000 7f1d06800700 1 -- 172.21.15.87:0/1323300236 learned_addr learned my addr 172.21.15.87:0/1323300236 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T05:29:38.287 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:38.283+0000 7f1d05e00700 1 -- 172.21.15.87:0/1323300236 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55e8f38ea980 msgr2=0x55e8f38dea20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:29:38.287 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:38.283+0000 7f1d05e00700 1 --2- 172.21.15.87:0/1323300236 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55e8f38ea980 0x55e8f38dea20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:29:38.287 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:38.283+0000 7f1d05e00700 1 -- 172.21.15.87:0/1323300236 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e8f38ee9d0 msgr2=0x55e8f38def60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:29:38.287 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:38.283+0000 7f1d05e00700 1 --2- 172.21.15.87:0/1323300236 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e8f38ee9d0 0x55e8f38def60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:29:38.288 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:38.283+0000 7f1d05e00700 1 -- 172.21.15.87:0/1323300236 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e8f38efbc0 con 0x55e8f38ea060 2024-05-08T05:29:38.288 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:38.284+0000 7f1d05e00700 1 --2- 172.21.15.87:0/1323300236 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55e8f38ea060 0x55e8f38f0e80 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f1cf8009810 tx=0x7f1cf8009fd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4e45e896e63bd789 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:29:38.288 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:38.284+0000 7f1cf2a00700 1 -- 172.21.15.87:0/1323300236 <== mon.2 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1cf802f030 con 0x55e8f38ea060 2024-05-08T05:29:38.288 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:38.284+0000 7f1cf2a00700 1 -- 172.21.15.87:0/1323300236 <== mon.2 v2:172.21.15.90:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1cf800f900 con 0x55e8f38ea060 2024-05-08T05:29:38.288 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:38.284+0000 7f1cf2a00700 1 -- 172.21.15.87:0/1323300236 <== mon.2 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1cf802b8e0 con 0x55e8f38ea060 2024-05-08T05:29:38.289 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:38.285+0000 7f1d17713b80 1 -- 172.21.15.87:0/1323300236 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55e8f38ea060 msgr2=0x55e8f38f0e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:29:38.289 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:38.285+0000 7f1d17713b80 1 --2- 172.21.15.87:0/1323300236 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55e8f38ea060 0x55e8f38f0e80 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f1cf8009810 tx=0x7f1cf8009fd0 comp rx=0 tx=0).stop 2024-05-08T05:29:38.289 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:38.285+0000 7f1d17713b80 1 -- 172.21.15.87:0/1323300236 shutdown_connections 2024-05-08T05:29:38.289 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:38.285+0000 7f1d17713b80 1 --2- 172.21.15.87:0/1323300236 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e8f38ee9d0 0x55e8f38def60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:29:38.289 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:38.285+0000 7f1d17713b80 1 --2- 172.21.15.87:0/1323300236 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55e8f38ea060 0x55e8f38f0e80 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:29:38.289 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:38.285+0000 7f1d17713b80 1 --2- 172.21.15.87:0/1323300236 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55e8f38ea980 0x55e8f38dea20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:29:38.289 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:38.285+0000 7f1d17713b80 1 -- 172.21.15.87:0/1323300236 >> 172.21.15.87:0/1323300236 conn(0x55e8f3818b60 msgr2=0x55e8f38f31b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:29:38.289 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:38.285+0000 7f1d17713b80 1 -- 172.21.15.87:0/1323300236 shutdown_connections 2024-05-08T05:29:38.289 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:38.285+0000 7f1d17713b80 1 -- 172.21.15.87:0/1323300236 wait complete. 2024-05-08T05:29:38.290 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:38.285+0000 7f1d17713b80 1 -- start start 2024-05-08T05:29:38.290 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:38.286+0000 7f1d17713b80 1 Processor -- start 2024-05-08T05:29:38.294 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:38.286+0000 7f1d17713b80 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55e8f38ea060 0x55e8f3903e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:29:38.294 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:38.286+0000 7f1d17713b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55e8f38ea980 0x55e8f39043f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:29:38.294 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:38.286+0000 7f1d17713b80 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e8f38ee9d0 0x55e8f3965d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:29:38.294 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:38.286+0000 7f1d17713b80 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f1d081ae250 con 0x55e8f38ee9d0 2024-05-08T05:29:38.294 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:38.286+0000 7f1d17713b80 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f1d081af6c0 con 0x55e8f38ea060 2024-05-08T05:29:38.295 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:38.286+0000 7f1d17713b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f1d081ae920 con 0x55e8f38ea980 2024-05-08T05:29:38.295 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:38.286+0000 7f1d17713b80 10 client.0 _ll_register_callbacks cb 0x55e8f37e3c70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T05:29:38.295 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:38.286+0000 7f1d06800700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e8f38ee9d0 0x55e8f3965d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:29:38.295 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:38.287+0000 7f1d06800700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e8f38ee9d0 0x55e8f3965d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:54956/0 (socket says 172.21.15.87:54956) 2024-05-08T05:29:38.295 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:38.287+0000 7f1d06800700 1 -- 172.21.15.87:0/1347525138 learned_addr learned my addr 172.21.15.87:0/1347525138 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T05:29:38.295 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:38.287+0000 7f1d05e00700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55e8f38ea060 0x55e8f3903e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:29:38.295 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:38.287+0000 7f1d05400700 1 --2- 172.21.15.87:0/1347525138 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55e8f38ea980 0x55e8f39043f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:29:38.295 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:38.287+0000 7f1d06800700 1 -- 172.21.15.87:0/1347525138 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55e8f38ea980 msgr2=0x55e8f39043f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:29:38.295 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:38.287+0000 7f1d06800700 1 --2- 172.21.15.87:0/1347525138 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55e8f38ea980 0x55e8f39043f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:29:38.296 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:38.287+0000 7f1d06800700 1 -- 172.21.15.87:0/1347525138 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55e8f38ea060 msgr2=0x55e8f3903e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:29:38.296 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:38.287+0000 7f1d06800700 1 --2- 172.21.15.87:0/1347525138 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55e8f38ea060 0x55e8f3903e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:29:38.296 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:38.287+0000 7f1d06800700 1 -- 172.21.15.87:0/1347525138 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e8f3966450 con 0x55e8f38ee9d0 2024-05-08T05:29:38.296 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:38.287+0000 7f1d05e00700 1 --2- 172.21.15.87:0/1347525138 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55e8f38ea060 0x55e8f3903e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T05:29:38.296 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:38.287+0000 7f1d06800700 1 --2- 172.21.15.87:0/1347525138 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e8f38ee9d0 0x55e8f3965d80 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f1d00009c10 tx=0x7f1d00004b40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=21e888b54b2cc966 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:29:38.296 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:38.287+0000 7f1ce7e00700 10 client.0 ms_handle_connect on v2:172.21.15.87:3300/0 2024-05-08T05:29:38.296 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:38.288+0000 7f1ce7e00700 1 -- 172.21.15.87:0/1347525138 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d00004bb0 con 0x55e8f38ee9d0 2024-05-08T05:29:38.296 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:38.288+0000 7f1d17713b80 1 -- 172.21.15.87:0/1347525138 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1cf800f900 con 0x55e8f38ee9d0 2024-05-08T05:29:38.296 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:38.288+0000 7f1ce7e00700 1 -- 172.21.15.87:0/1347525138 <== mon.0 v2:172.21.15.87:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8190+0+0 (secure 0 0 0) 0x7f1d00004d50 con 0x55e8f38ee9d0 2024-05-08T05:29:38.296 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:38.288+0000 7f1ce7e00700 1 -- 172.21.15.87:0/1347525138 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f1d00031020 con 0x55e8f38ee9d0 2024-05-08T05:29:38.296 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:38.288+0000 7f1d17713b80 10 client.15009 fetch_fsmap learned FSMap version 25 2024-05-08T05:29:38.297 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:38.288+0000 7f1d17713b80 1 -- 172.21.15.87:0/1347525138 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55e8f396d7a0 con 0x55e8f38ee9d0 2024-05-08T05:29:38.297 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:38.288+0000 7f1ce7e00700 1 -- 172.21.15.87:0/1347525138 <== mon.0 v2:172.21.15.87:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1cf800f900 con 0x55e8f38ee9d0 2024-05-08T05:29:38.297 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:38.289+0000 7f1ce7e00700 1 -- 172.21.15.87:0/1347525138 <== mon.0 v2:172.21.15.87:3300/0 5 ==== fsmap(e 25) ==== 8338+0+0 (secure 0 0 0) 0x7f1d00004020 con 0x55e8f38ee9d0 2024-05-08T05:29:38.297 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:38.289+0000 7f1d17713b80 10 client.15009 fetch_fsmap finished waiting for FSMap version 25 2024-05-08T05:29:38.297 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:38.289+0000 7f1d17713b80 10 client.15009 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-05-08T05:29:38.297 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:38.289+0000 7f1d17713b80 20 client.15009 populate_metadata read hostname 'smithi087' 2024-05-08T05:29:38.297 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:38.289+0000 7f1d17713b80 1 --2- 172.21.15.87:0/1347525138 >> [v2:172.21.15.90:6838/160586017,v1:172.21.15.90:6839/160586017] conn(0x55e8f396df10 0x55e8f3970330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:29:38.297 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:38.289+0000 7f1d17713b80 4 client.15009 mds_command: new command op to 24500 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-05-08T05:29:38.297 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:38.289+0000 7f1d17713b80 1 -- 172.21.15.87:0/1347525138 --> [v2:172.21.15.90:6838/160586017,v1:172.21.15.90:6839/160586017] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55e8f384a400 con 0x55e8f396df10 2024-05-08T05:29:38.297 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:38.289+0000 7f1d05e00700 1 --2- 172.21.15.87:0/1347525138 >> [v2:172.21.15.90:6838/160586017,v1:172.21.15.90:6839/160586017] conn(0x55e8f396df10 0x55e8f3970330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:29:38.297 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:38.290+0000 7f1d05e00700 1 --2- 172.21.15.87:0/1347525138 >> [v2:172.21.15.90:6838/160586017,v1:172.21.15.90:6839/160586017] conn(0x55e8f396df10 0x55e8f3970330 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2f697d78afb3a243 server_cookie=6c59fe69df358007 in_seq=0 out_seq=0 2024-05-08T05:29:38.297 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:38.290+0000 7f1ce7e00700 10 client.15009 ms_handle_connect on v2:172.21.15.90:6838/160586017 2024-05-08T05:29:38.297 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:38.290+0000 7f1ce7e00700 1 -- 172.21.15.87:0/1347525138 <== mds.0 v2:172.21.15.90:6838/160586017 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x55e8f384a400 con 0x55e8f396df10 2024-05-08T05:29:38.297 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:38.290+0000 7f1ce7e00700 10 client.15009 handle_command_reply: tid=0 2024-05-08T05:29:38.297 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:38.290+0000 7f1d17713b80 1 client.15009 shutdown 2024-05-08T05:29:38.298 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:38.290+0000 7f1d17713b80 1 -- 172.21.15.87:0/1347525138 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e8f38ee9d0 msgr2=0x55e8f3965d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:29:38.298 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:38.290+0000 7f1d17713b80 1 --2- 172.21.15.87:0/1347525138 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e8f38ee9d0 0x55e8f3965d80 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f1d00009c10 tx=0x7f1d00004b40 comp rx=0 tx=0).stop 2024-05-08T05:29:38.298 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:38.290+0000 7f1d17713b80 1 -- 172.21.15.87:0/1347525138 shutdown_connections 2024-05-08T05:29:38.298 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:38.290+0000 7f1d17713b80 1 --2- 172.21.15.87:0/1347525138 >> [v2:172.21.15.90:6838/160586017,v1:172.21.15.90:6839/160586017] conn(0x55e8f396df10 0x55e8f3970330 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:29:38.298 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:38.290+0000 7f1d17713b80 1 --2- 172.21.15.87:0/1347525138 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e8f38ee9d0 0x55e8f3965d80 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:29:38.298 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:38.290+0000 7f1d17713b80 1 --2- 172.21.15.87:0/1347525138 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55e8f38ea060 0x55e8f3903e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:29:38.298 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:38.290+0000 7f1d17713b80 1 --2- 172.21.15.87:0/1347525138 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55e8f38ea980 0x55e8f39043f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:29:38.298 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:38.290+0000 7f1d17713b80 1 -- 172.21.15.87:0/1347525138 >> 172.21.15.87:0/1347525138 conn(0x55e8f3818b60 msgr2=0x55e8f38dea20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:29:38.298 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:38.290+0000 7f1ce7e00700 0 client.15009 ms_handle_reset on v2:172.21.15.90:6838/160586017 2024-05-08T05:29:38.298 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:38.290+0000 7f1d17713b80 1 -- 172.21.15.87:0/1347525138 shutdown_connections 2024-05-08T05:29:38.298 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:38.290+0000 7f1d17713b80 1 -- 172.21.15.87:0/1347525138 wait complete. 2024-05-08T05:29:38.299 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:38.291+0000 7f1d17713b80 20 client.15009 trim_cache size 0 max 16384 2024-05-08T05:29:38.299 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-05-08T05:29:38.299 INFO:teuthology.orchestra.run.smithi087.stdout: "status": "IDLE (waiting for more scrubs)", 2024-05-08T05:29:38.299 INFO:teuthology.orchestra.run.smithi087.stdout: "scrubs": { 2024-05-08T05:29:38.299 INFO:teuthology.orchestra.run.smithi087.stdout: "c879003b-a5b5-4a7d-8719-16cd2853a48c": { 2024-05-08T05:29:38.299 INFO:teuthology.orchestra.run.smithi087.stdout: "path": "/", 2024-05-08T05:29:38.299 INFO:teuthology.orchestra.run.smithi087.stdout: "tag": "c879003b-a5b5-4a7d-8719-16cd2853a48c", 2024-05-08T05:29:38.299 INFO:teuthology.orchestra.run.smithi087.stdout: "options": "recursive,force" 2024-05-08T05:29:38.300 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-05-08T05:29:38.300 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-05-08T05:29:38.300 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-05-08T05:29:38.300 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:38.291+0000 7f1d0ce00700 1 -- 172.21.15.87:0/3489577330 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f1cec0b2900 msgr2=0x7f1cec0b4dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:29:38.300 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:38.291+0000 7f1d0ce00700 1 --2- 172.21.15.87:0/3489577330 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f1cec0b2900 0x7f1cec0b4dc0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f1d00009550 tx=0x7f1d0000b040 comp rx=0 tx=0).stop 2024-05-08T05:29:38.300 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:38.291+0000 7f1d0ce00700 1 -- 172.21.15.87:0/3489577330 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1d08106080 msgr2=0x7f1d0819c2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:29:38.300 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:38.291+0000 7f1d0ce00700 1 --2- 172.21.15.87:0/3489577330 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1d08106080 0x7f1d0819c2f0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f1cf400e9c0 tx=0x7f1cf400ecd0 comp rx=0 tx=0).stop 2024-05-08T05:29:38.300 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:38.291+0000 7f1d0ce00700 1 -- 172.21.15.87:0/3489577330 shutdown_connections 2024-05-08T05:29:38.301 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:38.291+0000 7f1d0ce00700 1 --2- 172.21.15.87:0/3489577330 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1d0810b6c0 0x7f1d081a0680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:29:38.301 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:38.291+0000 7f1d0ce00700 1 --2- 172.21.15.87:0/3489577330 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1d081056c0 0x7f1d0819bdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:29:38.301 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:38.291+0000 7f1d0ce00700 1 --2- 172.21.15.87:0/3489577330 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f1cec0b2900 0x7f1cec0b4dc0 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:29:38.301 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:38.291+0000 7f1d0ce00700 1 --2- 172.21.15.87:0/3489577330 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1d08106080 0x7f1d0819c2f0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:29:38.301 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:38.291+0000 7f1d0ce00700 1 -- 172.21.15.87:0/3489577330 >> 172.21.15.87:0/3489577330 conn(0x7f1d081011b0 msgr2=0x7f1d08101a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:29:38.301 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:38.292+0000 7f1d0ce00700 1 -- 172.21.15.87:0/3489577330 shutdown_connections 2024-05-08T05:29:38.301 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:29:38.292+0000 7f1d0ce00700 1 -- 172.21.15.87:0/3489577330 wait complete. 2024-05-08T05:29:38.708 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:29:38 smithi087 ceph-mon[29523]: pgmap v439: 97 pgs: 97 active+clean; 656 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 853 B/s wr, 5 op/s 2024-05-08T05:29:38.789 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:29:38 smithi160 ceph-mon[34827]: pgmap v439: 97 pgs: 97 active+clean; 656 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 853 B/s wr, 5 op/s 2024-05-08T05:29:38.983 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:29:38 smithi090 ceph-mon[34526]: pgmap v439: 97 pgs: 97 active+clean; 656 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 853 B/s wr, 5 op/s 2024-05-08T05:29:39.134 INFO:tasks.cephfs.filesystem:scrub status for tag:c879003b-a5b5-4a7d-8719-16cd2853a48c - {'path': '/', 'tag': 'c879003b-a5b5-4a7d-8719-16cd2853a48c', 'options': 'recursive,force'} 2024-05-08T05:29:40.789 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:29:40 smithi160 ceph-mon[34827]: pgmap v440: 97 pgs: 97 active+clean; 656 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 938 B/s wr, 8 op/s 2024-05-08T05:29:40.958 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:29:40 smithi087 ceph-mon[29523]: pgmap v440: 97 pgs: 97 active+clean; 656 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 938 B/s wr, 8 op/s 2024-05-08T05:29:40.983 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:29:40 smithi090 ceph-mon[34526]: pgmap v440: 97 pgs: 97 active+clean; 656 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 938 B/s wr, 8 op/s 2024-05-08T05:29:42.789 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:29:42 smithi160 ceph-mon[34827]: pgmap v441: 97 pgs: 97 active+clean; 656 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 938 B/s wr, 5 op/s 2024-05-08T05:29:42.958 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:29:42 smithi087 ceph-mon[29523]: pgmap v441: 97 pgs: 97 active+clean; 656 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 938 B/s wr, 5 op/s 2024-05-08T05:29:42.983 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:29:42 smithi090 ceph-mon[34526]: pgmap v441: 97 pgs: 97 active+clean; 656 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 938 B/s wr, 5 op/s 2024-05-08T05:29:44.788 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:29:44 smithi160 ceph-mon[34827]: pgmap v442: 97 pgs: 97 active+clean; 656 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 938 B/s wr, 6 op/s 2024-05-08T05:29:44.958 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:29:44 smithi087 ceph-mon[29523]: pgmap v442: 97 pgs: 97 active+clean; 656 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 938 B/s wr, 6 op/s 2024-05-08T05:29:44.983 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:29:44 smithi090 ceph-mon[34526]: pgmap v442: 97 pgs: 97 active+clean; 656 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 938 B/s wr, 6 op/s 2024-05-08T05:29:46.785 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:29:46 smithi090 ceph-mon[34526]: pgmap v443: 97 pgs: 97 active+clean; 656 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 852 B/s wr, 7 op/s 2024-05-08T05:29:46.788 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:29:46 smithi160 ceph-mon[34827]: pgmap v443: 97 pgs: 97 active+clean; 656 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 852 B/s wr, 7 op/s 2024-05-08T05:29:46.958 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:29:46 smithi087 ceph-mon[29523]: pgmap v443: 97 pgs: 97 active+clean; 656 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 852 B/s wr, 7 op/s 2024-05-08T05:29:48.788 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:29:48 smithi160 ceph-mon[34827]: pgmap v444: 97 pgs: 97 active+clean; 656 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 170 B/s wr, 5 op/s 2024-05-08T05:29:48.788 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:29:48 smithi160 ceph-mon[34827]: scrub summary: idle 2024-05-08T05:29:48.789 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:29:48 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T05:29:48.958 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:29:48 smithi087 ceph-mon[29523]: pgmap v444: 97 pgs: 97 active+clean; 656 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 170 B/s wr, 5 op/s 2024-05-08T05:29:48.959 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:29:48 smithi087 ceph-mon[29523]: scrub summary: idle 2024-05-08T05:29:48.959 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:29:48 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T05:29:48.983 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:29:48 smithi090 ceph-mon[34526]: pgmap v444: 97 pgs: 97 active+clean; 656 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 170 B/s wr, 5 op/s 2024-05-08T05:29:48.983 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:29:48 smithi090 ceph-mon[34526]: scrub summary: idle 2024-05-08T05:29:48.983 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:29:48 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T05:29:50.788 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:29:50 smithi160 ceph-mon[34827]: pgmap v445: 97 pgs: 97 active+clean; 656 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 85 B/s wr, 7 op/s 2024-05-08T05:29:50.789 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:29:50 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T05:29:50.789 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:29:50 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T05:29:50.789 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:29:50 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:29:50.958 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:29:50 smithi087 ceph-mon[29523]: pgmap v445: 97 pgs: 97 active+clean; 656 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 85 B/s wr, 7 op/s 2024-05-08T05:29:50.958 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:29:50 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T05:29:50.959 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:29:50 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T05:29:50.959 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:29:50 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:29:50.983 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:29:50 smithi090 ceph-mon[34526]: pgmap v445: 97 pgs: 97 active+clean; 656 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 85 B/s wr, 7 op/s 2024-05-08T05:29:50.983 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:29:50 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T05:29:50.983 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:29:50 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T05:29:50.983 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:29:50 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:29:52.789 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:29:52 smithi160 ceph-mon[34827]: pgmap v446: 97 pgs: 97 active+clean; 656 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T05:29:52.958 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:29:52 smithi087 ceph-mon[29523]: pgmap v446: 97 pgs: 97 active+clean; 656 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T05:29:52.983 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:29:52 smithi090 ceph-mon[34526]: pgmap v446: 97 pgs: 97 active+clean; 656 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T05:29:54.958 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:29:54 smithi087 ceph-mon[29523]: pgmap v447: 97 pgs: 97 active+clean; 656 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-05-08T05:29:54.983 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:29:54 smithi090 ceph-mon[34526]: pgmap v447: 97 pgs: 97 active+clean; 656 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-05-08T05:29:55.038 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:29:54 smithi160 ceph-mon[34827]: pgmap v447: 97 pgs: 97 active+clean; 656 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-05-08T05:29:56.708 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:29:56 smithi087 ceph-mon[29523]: pgmap v448: 97 pgs: 97 active+clean; 656 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-05-08T05:29:56.983 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:29:56 smithi090 ceph-mon[34526]: pgmap v448: 97 pgs: 97 active+clean; 656 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-05-08T05:29:57.039 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:29:56 smithi160 ceph-mon[34827]: pgmap v448: 97 pgs: 97 active+clean; 656 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-05-08T05:29:58.958 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:29:58 smithi087 ceph-mon[29523]: pgmap v449: 97 pgs: 97 active+clean; 656 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T05:29:58.983 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:29:58 smithi090 ceph-mon[34526]: pgmap v449: 97 pgs: 97 active+clean; 656 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T05:29:59.038 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:29:58 smithi160 ceph-mon[34827]: pgmap v449: 97 pgs: 97 active+clean; 656 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T05:30:00.958 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:30:00 smithi087 ceph-mon[29523]: pgmap v450: 97 pgs: 97 active+clean; 656 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-05-08T05:30:00.958 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:30:00 smithi087 ceph-mon[29523]: overall HEALTH_OK 2024-05-08T05:30:00.983 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:30:00 smithi090 ceph-mon[34526]: pgmap v450: 97 pgs: 97 active+clean; 656 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-05-08T05:30:00.983 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:30:00 smithi090 ceph-mon[34526]: overall HEALTH_OK 2024-05-08T05:30:01.038 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:30:00 smithi160 ceph-mon[34827]: pgmap v450: 97 pgs: 97 active+clean; 656 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-05-08T05:30:01.038 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:30:00 smithi160 ceph-mon[34827]: overall HEALTH_OK 2024-05-08T05:30:02.958 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:30:02 smithi087 ceph-mon[29523]: pgmap v451: 97 pgs: 97 active+clean; 656 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T05:30:02.983 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:30:02 smithi090 ceph-mon[34526]: pgmap v451: 97 pgs: 97 active+clean; 656 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T05:30:03.038 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:30:02 smithi160 ceph-mon[34827]: pgmap v451: 97 pgs: 97 active+clean; 656 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T05:30:04.958 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:30:04 smithi087 ceph-mon[29523]: pgmap v452: 97 pgs: 97 active+clean; 656 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-05-08T05:30:04.983 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:30:04 smithi090 ceph-mon[34526]: pgmap v452: 97 pgs: 97 active+clean; 656 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-05-08T05:30:05.038 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:30:04 smithi160 ceph-mon[34827]: pgmap v452: 97 pgs: 97 active+clean; 656 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-05-08T05:30:06.833 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:30:06 smithi087 ceph-mon[29523]: pgmap v453: 97 pgs: 97 active+clean; 656 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-05-08T05:30:06.841 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:30:06 smithi160 ceph-mon[34827]: pgmap v453: 97 pgs: 97 active+clean; 656 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-05-08T05:30:06.983 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:30:06 smithi090 ceph-mon[34526]: pgmap v453: 97 pgs: 97 active+clean; 656 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-05-08T05:30:08.958 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:30:08 smithi087 ceph-mon[29523]: pgmap v454: 97 pgs: 97 active+clean; 656 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 85 B/s wr, 5 op/s 2024-05-08T05:30:08.983 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:30:08 smithi090 ceph-mon[34526]: pgmap v454: 97 pgs: 97 active+clean; 656 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 85 B/s wr, 5 op/s 2024-05-08T05:30:09.038 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:30:08 smithi160 ceph-mon[34827]: pgmap v454: 97 pgs: 97 active+clean; 656 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 85 B/s wr, 5 op/s 2024-05-08T05:30:09.135 DEBUG:teuthology.orchestra.run.smithi087:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid eeeb813e-0cf9-11ef-bc97-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-05-08T05:30:09.598 INFO:teuthology.orchestra.run.smithi087.stderr:Inferring config /var/lib/ceph/eeeb813e-0cf9-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T05:30:10.708 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:30:10 smithi087 ceph-mon[29523]: pgmap v455: 97 pgs: 97 active+clean; 661 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 682 B/s wr, 7 op/s 2024-05-08T05:30:10.983 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:30:10 smithi090 ceph-mon[34526]: pgmap v455: 97 pgs: 97 active+clean; 661 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 682 B/s wr, 7 op/s 2024-05-08T05:30:11.038 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:30:10 smithi160 ceph-mon[34827]: pgmap v455: 97 pgs: 97 active+clean; 661 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 682 B/s wr, 7 op/s 2024-05-08T05:30:11.640 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:11.639+0000 7f58cb800700 1 -- 172.21.15.87:0/3134960983 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f58c4109ad0 msgr2=0x7f58c4109f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:30:11.641 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:11.639+0000 7f58cb800700 1 --2- 172.21.15.87:0/3134960983 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f58c4109ad0 0x7f58c4109f50 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f58b0009990 tx=0x7f58b0009ca0 comp rx=0 tx=0).stop 2024-05-08T05:30:11.641 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:11.640+0000 7f58cb800700 1 -- 172.21.15.87:0/3134960983 shutdown_connections 2024-05-08T05:30:11.641 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:11.640+0000 7f58cb800700 1 --2- 172.21.15.87:0/3134960983 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f58c410a490 0x7f58c41169a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:30:11.641 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:11.640+0000 7f58cb800700 1 --2- 172.21.15.87:0/3134960983 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f58c410fb60 0x7f58c410ff40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:30:11.641 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:11.640+0000 7f58cb800700 1 --2- 172.21.15.87:0/3134960983 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f58c4109ad0 0x7f58c4109f50 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:30:11.641 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:11.640+0000 7f58cb800700 1 -- 172.21.15.87:0/3134960983 >> 172.21.15.87:0/3134960983 conn(0x7f58c4076c70 msgr2=0x7f58c41082c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:30:11.641 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:11.640+0000 7f58cb800700 1 -- 172.21.15.87:0/3134960983 shutdown_connections 2024-05-08T05:30:11.641 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:11.640+0000 7f58cb800700 1 -- 172.21.15.87:0/3134960983 wait complete. 2024-05-08T05:30:11.642 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:11.641+0000 7f58cb800700 1 Processor -- start 2024-05-08T05:30:11.642 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:11.641+0000 7f58cb800700 1 -- start start 2024-05-08T05:30:11.642 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:11.641+0000 7f58cb800700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f58c4109ad0 0x7f58c41a01f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:30:11.642 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:11.641+0000 7f58cb800700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f58c410a490 0x7f58c41a0730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:30:11.642 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:11.641+0000 7f58cb800700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f58c410fb60 0x7f58c41a4a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:30:11.642 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:11.641+0000 7f58cb800700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f58c4119d20 con 0x7f58c410fb60 2024-05-08T05:30:11.642 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:11.641+0000 7f58cb800700 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f58c4119ba0 con 0x7f58c4109ad0 2024-05-08T05:30:11.642 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:11.641+0000 7f58cb800700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f58c4119ea0 con 0x7f58c410a490 2024-05-08T05:30:11.643 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:11.642+0000 7f58c8e00700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f58c4109ad0 0x7f58c41a01f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:30:11.643 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:11.642+0000 7f58c9800700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f58c410fb60 0x7f58c41a4a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:30:11.643 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:11.642+0000 7f58c8e00700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f58c4109ad0 0x7f58c41a01f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.87:54698/0 (socket says 172.21.15.87:54698) 2024-05-08T05:30:11.643 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:11.642+0000 7f58c8e00700 1 -- 172.21.15.87:0/2924351143 learned_addr learned my addr 172.21.15.87:0/2924351143 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T05:30:11.643 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:11.642+0000 7f58c3e00700 1 --2- 172.21.15.87:0/2924351143 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f58c410a490 0x7f58c41a0730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:30:11.644 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:11.642+0000 7f58c8e00700 1 -- 172.21.15.87:0/2924351143 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f58c410a490 msgr2=0x7f58c41a0730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:30:11.644 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:11.642+0000 7f58c8e00700 1 --2- 172.21.15.87:0/2924351143 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f58c410a490 0x7f58c41a0730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:30:11.644 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:11.642+0000 7f58c8e00700 1 -- 172.21.15.87:0/2924351143 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f58c410fb60 msgr2=0x7f58c41a4a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:30:11.644 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:11.642+0000 7f58c8e00700 1 --2- 172.21.15.87:0/2924351143 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f58c410fb60 0x7f58c41a4a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:30:11.644 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:11.642+0000 7f58c8e00700 1 -- 172.21.15.87:0/2924351143 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f58c41a51b0 con 0x7f58c4109ad0 2024-05-08T05:30:11.644 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:11.643+0000 7f58c8e00700 1 --2- 172.21.15.87:0/2924351143 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f58c4109ad0 0x7f58c41a01f0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f58b800e9a0 tx=0x7f58b800ecb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:30:11.644 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:11.643+0000 7f58c1600700 1 -- 172.21.15.87:0/2924351143 <== mon.2 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58b800ca10 con 0x7f58c4109ad0 2024-05-08T05:30:11.644 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:11.643+0000 7f58c1600700 1 -- 172.21.15.87:0/2924351143 <== mon.2 v2:172.21.15.90:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f58b800cbb0 con 0x7f58c4109ad0 2024-05-08T05:30:11.645 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:11.643+0000 7f58cb800700 1 -- 172.21.15.87:0/2924351143 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f58c41a54a0 con 0x7f58c4109ad0 2024-05-08T05:30:11.645 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:11.643+0000 7f58c1600700 1 -- 172.21.15.87:0/2924351143 <== mon.2 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58b8018680 con 0x7f58c4109ad0 2024-05-08T05:30:11.645 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:11.643+0000 7f58cb800700 1 -- 172.21.15.87:0/2924351143 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f58c41acd20 con 0x7f58c4109ad0 2024-05-08T05:30:11.646 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:11.646+0000 7f58c1600700 1 -- 172.21.15.87:0/2924351143 <== mon.2 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7f58b8010430 con 0x7f58c4109ad0 2024-05-08T05:30:11.648 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:11.648+0000 7f58d6132b80 1 Processor -- start 2024-05-08T05:30:11.649 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:11.648+0000 7f58c1600700 1 --2- 172.21.15.87:0/2924351143 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f58ac0b2900 0x7f58ac0b4dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:30:11.649 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:11.648+0000 7f58d6132b80 1 -- start start 2024-05-08T05:30:11.649 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:11.648+0000 7f58c1600700 1 -- 172.21.15.87:0/2924351143 <== mon.2 v2:172.21.15.90:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8190+0+0 (secure 0 0 0) 0x7f58b80e22c0 con 0x7f58c4109ad0 2024-05-08T05:30:11.649 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:11.648+0000 7f58c9800700 1 --2- 172.21.15.87:0/2924351143 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f58ac0b2900 0x7f58ac0b4dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:30:11.649 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:11.648+0000 7f58d6132b80 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55fafc337060 0x55fafc337440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:30:11.649 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:11.648+0000 7f58d6132b80 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55fafc337980 0x55fafc33b490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:30:11.649 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:11.648+0000 7f58d6132b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55fafc33b9d0 0x55fafc33be30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:30:11.649 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:11.648+0000 7f58d6132b80 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x55fafc289a20 con 0x55fafc337060 2024-05-08T05:30:11.649 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:11.648+0000 7f58d6132b80 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x55fafc227760 con 0x55fafc337980 2024-05-08T05:30:11.649 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:11.648+0000 7f58d6132b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x55fafc2859e0 con 0x55fafc33b9d0 2024-05-08T05:30:11.650 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:11.649+0000 7f58c8e00700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55fafc337060 0x55fafc337440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:30:11.651 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:11.649+0000 7f58c8e00700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55fafc337060 0x55fafc337440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:59786/0 (socket says 172.21.15.87:59786) 2024-05-08T05:30:11.651 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:11.649+0000 7f58c8e00700 1 -- 172.21.15.87:0/2898988140 learned_addr learned my addr 172.21.15.87:0/2898988140 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T05:30:11.651 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:11.649+0000 7f58c3e00700 1 --2- 172.21.15.87:0/2898988140 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55fafc337980 0x55fafc33b490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:30:11.651 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:11.649+0000 7f58c9800700 1 --2- 172.21.15.87:0/2898988140 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55fafc33b9d0 0x55fafc33be30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:30:11.651 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:11.649+0000 7f58c9800700 1 --2- 172.21.15.87:0/2924351143 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f58ac0b2900 0x7f58ac0b4dc0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f58bc003f20 tx=0x7f58bc009ba0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:30:11.651 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:11.649+0000 7f58c8e00700 1 -- 172.21.15.87:0/2898988140 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55fafc33b9d0 msgr2=0x55fafc33be30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:30:11.651 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:11.649+0000 7f58c8e00700 1 --2- 172.21.15.87:0/2898988140 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55fafc33b9d0 0x55fafc33be30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:30:11.651 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:11.649+0000 7f58c8e00700 1 -- 172.21.15.87:0/2898988140 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55fafc337980 msgr2=0x55fafc33b490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:30:11.651 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:11.649+0000 7f58c8e00700 1 --2- 172.21.15.87:0/2898988140 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55fafc337980 0x55fafc33b490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:30:11.651 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:11.649+0000 7f58c8e00700 1 -- 172.21.15.87:0/2898988140 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fafc1d68d0 con 0x55fafc337060 2024-05-08T05:30:11.651 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:11.649+0000 7f58c3e00700 1 --2- 172.21.15.87:0/2898988140 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55fafc337980 0x55fafc33b490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T05:30:11.651 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:11.650+0000 7f58c8e00700 1 --2- 172.21.15.87:0/2898988140 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55fafc337060 0x55fafc337440 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f58b8009230 tx=0x7f58b80a9110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ff3d76ea3ba2373c server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:30:11.651 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:11.650+0000 7f58b6000700 1 -- 172.21.15.87:0/2898988140 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58b80a9fb0 con 0x55fafc337060 2024-05-08T05:30:11.651 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:11.650+0000 7f58b6000700 1 -- 172.21.15.87:0/2898988140 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f58b80a98b0 con 0x55fafc337060 2024-05-08T05:30:11.651 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:11.650+0000 7f58b6000700 1 -- 172.21.15.87:0/2898988140 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58b80b24e0 con 0x55fafc337060 2024-05-08T05:30:11.652 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:11.651+0000 7f58d6132b80 1 -- 172.21.15.87:0/2898988140 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55fafc337060 msgr2=0x55fafc337440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:30:11.652 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:11.651+0000 7f58d6132b80 1 --2- 172.21.15.87:0/2898988140 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55fafc337060 0x55fafc337440 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f58b8009230 tx=0x7f58b80a9110 comp rx=0 tx=0).stop 2024-05-08T05:30:11.653 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:11.651+0000 7f58d6132b80 1 -- 172.21.15.87:0/2898988140 shutdown_connections 2024-05-08T05:30:11.653 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:11.651+0000 7f58d6132b80 1 --2- 172.21.15.87:0/2898988140 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55fafc33b9d0 0x55fafc33be30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:30:11.653 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:11.651+0000 7f58d6132b80 1 --2- 172.21.15.87:0/2898988140 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55fafc337060 0x55fafc337440 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:30:11.653 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:11.651+0000 7f58d6132b80 1 --2- 172.21.15.87:0/2898988140 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55fafc337980 0x55fafc33b490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:30:11.653 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:11.651+0000 7f58d6132b80 1 -- 172.21.15.87:0/2898988140 >> 172.21.15.87:0/2898988140 conn(0x55fafc265b60 msgr2=0x55fafc3317a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:30:11.653 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:11.651+0000 7f58d6132b80 1 -- 172.21.15.87:0/2898988140 shutdown_connections 2024-05-08T05:30:11.653 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:11.651+0000 7f58d6132b80 1 -- 172.21.15.87:0/2898988140 wait complete. 2024-05-08T05:30:11.653 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:11.651+0000 7f58d6132b80 1 -- start start 2024-05-08T05:30:11.653 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:11.652+0000 7f58d6132b80 1 Processor -- start 2024-05-08T05:30:11.653 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:11.652+0000 7f58d6132b80 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55fafc337060 0x55fafc342e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:30:11.654 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:11.652+0000 7f58d6132b80 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55fafc337980 0x55fafc340250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:30:11.654 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:11.652+0000 7f58d6132b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55fafc33b9d0 0x55fafc340790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:30:11.654 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:11.652+0000 7f58d6132b80 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x55fafc343be0 con 0x55fafc337980 2024-05-08T05:30:11.654 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:11.652+0000 7f58d6132b80 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x55fafc1efb20 con 0x55fafc337060 2024-05-08T05:30:11.654 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:11.652+0000 7f58d6132b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x55fafc343d60 con 0x55fafc33b9d0 2024-05-08T05:30:11.654 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:11.652+0000 7f58d6132b80 10 client.0 _ll_register_callbacks cb 0x55fafc230c70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T05:30:11.654 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:11.653+0000 7f58c8e00700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55fafc337060 0x55fafc342e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:30:11.654 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:11.653+0000 7f58c9800700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55fafc33b9d0 0x55fafc340790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:30:11.654 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:11.653+0000 7f58c3e00700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55fafc337980 0x55fafc340250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:30:11.654 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:11.653+0000 7f58c8e00700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55fafc337060 0x55fafc342e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.87:54718/0 (socket says 172.21.15.87:54718) 2024-05-08T05:30:11.654 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:11.653+0000 7f58c8e00700 1 -- 172.21.15.87:0/948842976 learned_addr learned my addr 172.21.15.87:0/948842976 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T05:30:11.657 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:11.653+0000 7f58c8e00700 1 -- 172.21.15.87:0/948842976 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55fafc33b9d0 msgr2=0x55fafc340790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:30:11.657 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:11.653+0000 7f58c8e00700 1 --2- 172.21.15.87:0/948842976 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55fafc33b9d0 0x55fafc340790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:30:11.657 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:11.653+0000 7f58c8e00700 1 -- 172.21.15.87:0/948842976 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55fafc337980 msgr2=0x55fafc340250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:30:11.657 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:11.653+0000 7f58c8e00700 1 --2- 172.21.15.87:0/948842976 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55fafc337980 0x55fafc340250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:30:11.657 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:11.653+0000 7f58c8e00700 1 -- 172.21.15.87:0/948842976 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fafc24f420 con 0x55fafc337060 2024-05-08T05:30:11.657 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:11.653+0000 7f58c9800700 1 --2- 172.21.15.87:0/948842976 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55fafc33b9d0 0x55fafc340790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T05:30:11.658 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:11.653+0000 7f58c3e00700 1 --2- 172.21.15.87:0/948842976 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55fafc337980 0x55fafc340250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T05:30:11.658 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:11.653+0000 7f58c8e00700 1 --2- 172.21.15.87:0/948842976 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55fafc337060 0x55fafc342e60 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f58b800c2d0 tx=0x7f58b80adce0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=40d068a7e1cd3fff server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:30:11.658 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:11.653+0000 7f58aaa00700 10 client.0 ms_handle_connect on v2:172.21.15.90:3300/0 2024-05-08T05:30:11.658 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:11.654+0000 7f58aaa00700 1 -- 172.21.15.87:0/948842976 <== mon.2 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58b80c2070 con 0x55fafc337060 2024-05-08T05:30:11.658 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:11.654+0000 7f58aaa00700 1 -- 172.21.15.87:0/948842976 <== mon.2 v2:172.21.15.90:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8190+0+0 (secure 0 0 0) 0x7f58b80b2280 con 0x55fafc337060 2024-05-08T05:30:11.658 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:11.654+0000 7f58d6132b80 1 -- 172.21.15.87:0/948842976 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f58b80a98b0 con 0x55fafc337060 2024-05-08T05:30:11.658 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:11.654+0000 7f58aaa00700 1 -- 172.21.15.87:0/948842976 <== mon.2 v2:172.21.15.90:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f58b80a9fb0 con 0x55fafc337060 2024-05-08T05:30:11.658 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:11.654+0000 7f58d6132b80 10 client.25121 fetch_fsmap learned FSMap version 25 2024-05-08T05:30:11.658 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:11.654+0000 7f58d6132b80 1 -- 172.21.15.87:0/948842976 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55fafc34e450 con 0x55fafc337060 2024-05-08T05:30:11.658 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:11.654+0000 7f58aaa00700 1 -- 172.21.15.87:0/948842976 <== mon.2 v2:172.21.15.90:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f58b80a98b0 con 0x55fafc337060 2024-05-08T05:30:11.658 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:11.654+0000 7f58aaa00700 1 -- 172.21.15.87:0/948842976 <== mon.2 v2:172.21.15.90:3300/0 5 ==== fsmap(e 25) ==== 8338+0+0 (secure 0 0 0) 0x7f58b8010720 con 0x55fafc337060 2024-05-08T05:30:11.658 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:11.655+0000 7f58d6132b80 10 client.25121 fetch_fsmap finished waiting for FSMap version 25 2024-05-08T05:30:11.658 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:11.655+0000 7f58d6132b80 10 client.25121 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-05-08T05:30:11.658 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:11.655+0000 7f58d6132b80 20 client.25121 populate_metadata read hostname 'smithi087' 2024-05-08T05:30:11.658 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:11.655+0000 7f58d6132b80 1 --2- 172.21.15.87:0/948842976 >> [v2:172.21.15.90:6838/160586017,v1:172.21.15.90:6839/160586017] conn(0x55fafc350750 0x55fafc352b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:30:11.659 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:11.655+0000 7f58d6132b80 4 client.25121 mds_command: new command op to 24500 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-08T05:30:11.659 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:11.655+0000 7f58d6132b80 1 -- 172.21.15.87:0/948842976 --> [v2:172.21.15.90:6838/160586017,v1:172.21.15.90:6839/160586017] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55fafc3040a0 con 0x55fafc350750 2024-05-08T05:30:11.659 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:11.655+0000 7f58c3e00700 1 --2- 172.21.15.87:0/948842976 >> [v2:172.21.15.90:6838/160586017,v1:172.21.15.90:6839/160586017] conn(0x55fafc350750 0x55fafc352b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:30:11.659 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:11.656+0000 7f58c3e00700 1 --2- 172.21.15.87:0/948842976 >> [v2:172.21.15.90:6838/160586017,v1:172.21.15.90:6839/160586017] conn(0x55fafc350750 0x55fafc352b40 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6d50af31e2faf2d4 server_cookie=f0a809bd8d929244 in_seq=0 out_seq=0 2024-05-08T05:30:11.659 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:11.656+0000 7f58aaa00700 10 client.25121 ms_handle_connect on v2:172.21.15.90:6838/160586017 2024-05-08T05:30:11.659 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:11.656+0000 7f58aaa00700 1 -- 172.21.15.87:0/948842976 <== mds.0 v2:172.21.15.90:6838/160586017 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55fafc3040a0 con 0x55fafc350750 2024-05-08T05:30:11.659 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:11.656+0000 7f58aaa00700 10 client.25121 handle_command_reply: tid=0 2024-05-08T05:30:11.659 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:11.656+0000 7f58d6132b80 1 client.25121 shutdown 2024-05-08T05:30:11.659 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:11.657+0000 7f58d6132b80 1 -- 172.21.15.87:0/948842976 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55fafc337060 msgr2=0x55fafc342e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:30:11.659 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:11.657+0000 7f58d6132b80 1 --2- 172.21.15.87:0/948842976 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55fafc337060 0x55fafc342e60 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f58b800c2d0 tx=0x7f58b80adce0 comp rx=0 tx=0).stop 2024-05-08T05:30:11.659 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:11.657+0000 7f58d6132b80 1 -- 172.21.15.87:0/948842976 shutdown_connections 2024-05-08T05:30:11.659 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:11.657+0000 7f58d6132b80 1 --2- 172.21.15.87:0/948842976 >> [v2:172.21.15.90:6838/160586017,v1:172.21.15.90:6839/160586017] conn(0x55fafc350750 0x55fafc352b40 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:30:11.659 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:11.657+0000 7f58d6132b80 1 --2- 172.21.15.87:0/948842976 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55fafc33b9d0 0x55fafc340790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:30:11.659 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:11.657+0000 7f58d6132b80 1 --2- 172.21.15.87:0/948842976 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55fafc337060 0x55fafc342e60 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:30:11.659 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:11.657+0000 7f58d6132b80 1 --2- 172.21.15.87:0/948842976 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55fafc337980 0x55fafc340250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:30:11.659 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:11.657+0000 7f58aaa00700 0 client.25121 ms_handle_reset on v2:172.21.15.90:6838/160586017 2024-05-08T05:30:11.660 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:11.657+0000 7f58d6132b80 1 -- 172.21.15.87:0/948842976 >> 172.21.15.87:0/948842976 conn(0x55fafc265b60 msgr2=0x55fafc32c2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:30:11.660 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:11.657+0000 7f58d6132b80 1 -- 172.21.15.87:0/948842976 shutdown_connections 2024-05-08T05:30:11.660 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:11.657+0000 7f58d6132b80 1 -- 172.21.15.87:0/948842976 wait complete. 2024-05-08T05:30:11.660 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:11.657+0000 7f58d6132b80 20 client.25121 trim_cache size 0 max 16384 2024-05-08T05:30:11.679 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:11.679+0000 7f58d6132b80 1 Processor -- start 2024-05-08T05:30:11.679 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:11.679+0000 7f58d6132b80 1 -- start start 2024-05-08T05:30:11.680 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:11.679+0000 7f58d6132b80 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55fafc337060 0x55fafc32c090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:30:11.680 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:11.679+0000 7f58d6132b80 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55fafc337980 0x55fafc33bdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:30:11.680 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:11.679+0000 7f58d6132b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55fafc33b9d0 0x55fafc33c2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:30:11.680 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:11.679+0000 7f58d6132b80 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f58c41b6a20 con 0x55fafc337060 2024-05-08T05:30:11.680 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:11.679+0000 7f58d6132b80 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f58c41b42b0 con 0x55fafc337980 2024-05-08T05:30:11.680 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:11.679+0000 7f58d6132b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f58c41b2100 con 0x55fafc33b9d0 2024-05-08T05:30:11.680 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:11.680+0000 7f58c8e00700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55fafc337060 0x55fafc32c090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:30:11.681 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:11.680+0000 7f58c8e00700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55fafc337060 0x55fafc32c090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:59812/0 (socket says 172.21.15.87:59812) 2024-05-08T05:30:11.681 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:11.680+0000 7f58c8e00700 1 -- 172.21.15.87:0/494628466 learned_addr learned my addr 172.21.15.87:0/494628466 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T05:30:11.681 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:11.680+0000 7f58c3e00700 1 --2- 172.21.15.87:0/494628466 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55fafc337980 0x55fafc33bdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:30:11.681 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:11.680+0000 7f58c9800700 1 --2- 172.21.15.87:0/494628466 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55fafc33b9d0 0x55fafc33c2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:30:11.682 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:11.680+0000 7f58c8e00700 1 -- 172.21.15.87:0/494628466 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55fafc33b9d0 msgr2=0x55fafc33c2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:30:11.682 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:11.680+0000 7f58c8e00700 1 --2- 172.21.15.87:0/494628466 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55fafc33b9d0 0x55fafc33c2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:30:11.682 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:11.680+0000 7f58c8e00700 1 -- 172.21.15.87:0/494628466 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55fafc337980 msgr2=0x55fafc33bdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:30:11.683 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:11.680+0000 7f58c8e00700 1 --2- 172.21.15.87:0/494628466 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55fafc337980 0x55fafc33bdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:30:11.683 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:11.680+0000 7f58c8e00700 1 -- 172.21.15.87:0/494628466 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fafc32e3f0 con 0x55fafc337060 2024-05-08T05:30:11.683 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:11.681+0000 7f58c3e00700 1 --2- 172.21.15.87:0/494628466 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55fafc337980 0x55fafc33bdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T05:30:11.683 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:11.681+0000 7f58c8e00700 1 --2- 172.21.15.87:0/494628466 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55fafc337060 0x55fafc32c090 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f58b80a9840 tx=0x7f58b8010c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=681c2adb02142757 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:30:11.683 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:11.681+0000 7f58b5600700 1 -- 172.21.15.87:0/494628466 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58b80c2070 con 0x55fafc337060 2024-05-08T05:30:11.683 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:11.681+0000 7f58b5600700 1 -- 172.21.15.87:0/494628466 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f58b80a98b0 con 0x55fafc337060 2024-05-08T05:30:11.683 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:11.681+0000 7f58b5600700 1 -- 172.21.15.87:0/494628466 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58b80b2280 con 0x55fafc337060 2024-05-08T05:30:11.683 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:11.682+0000 7f58d6132b80 1 -- 172.21.15.87:0/494628466 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55fafc337060 msgr2=0x55fafc32c090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:30:11.683 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:11.682+0000 7f58d6132b80 1 --2- 172.21.15.87:0/494628466 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55fafc337060 0x55fafc32c090 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f58b80a9840 tx=0x7f58b8010c10 comp rx=0 tx=0).stop 2024-05-08T05:30:11.683 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:11.682+0000 7f58d6132b80 1 -- 172.21.15.87:0/494628466 shutdown_connections 2024-05-08T05:30:11.683 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:11.682+0000 7f58d6132b80 1 --2- 172.21.15.87:0/494628466 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55fafc33b9d0 0x55fafc33c2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:30:11.683 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:11.682+0000 7f58d6132b80 1 --2- 172.21.15.87:0/494628466 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55fafc337060 0x55fafc32c090 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:30:11.683 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:11.682+0000 7f58d6132b80 1 --2- 172.21.15.87:0/494628466 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55fafc337980 0x55fafc33bdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:30:11.683 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:11.682+0000 7f58d6132b80 1 -- 172.21.15.87:0/494628466 >> 172.21.15.87:0/494628466 conn(0x55fafc265b60 msgr2=0x55fafc336700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:30:11.684 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:11.682+0000 7f58d6132b80 1 -- 172.21.15.87:0/494628466 shutdown_connections 2024-05-08T05:30:11.684 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:11.682+0000 7f58d6132b80 1 -- 172.21.15.87:0/494628466 wait complete. 2024-05-08T05:30:11.687 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:11.683+0000 7f58d6132b80 1 -- start start 2024-05-08T05:30:11.687 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:11.683+0000 7f58d6132b80 1 Processor -- start 2024-05-08T05:30:11.688 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:11.683+0000 7f58d6132b80 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55fafc337060 0x55fafc353870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:30:11.688 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:11.683+0000 7f58d6132b80 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55fafc337980 0x55fafc353db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:30:11.688 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:11.683+0000 7f58d6132b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55fafc33b9d0 0x55fafc3542f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:30:11.688 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:11.683+0000 7f58d6132b80 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f58c41b2770 con 0x55fafc337980 2024-05-08T05:30:11.688 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:11.683+0000 7f58d6132b80 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f58c41b3be0 con 0x55fafc337060 2024-05-08T05:30:11.688 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:11.683+0000 7f58d6132b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f58c41b2e40 con 0x55fafc33b9d0 2024-05-08T05:30:11.688 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:11.683+0000 7f58d6132b80 10 client.0 _ll_register_callbacks cb 0x55fafc230c70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T05:30:11.688 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:11.684+0000 7f58c8e00700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55fafc337060 0x55fafc353870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:30:11.688 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:11.684+0000 7f58c3e00700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55fafc337980 0x55fafc353db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:30:11.688 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:11.684+0000 7f58c8e00700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55fafc337060 0x55fafc353870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.87:54742/0 (socket says 172.21.15.87:54742) 2024-05-08T05:30:11.688 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:11.684+0000 7f58c8e00700 1 -- 172.21.15.87:0/3475309598 learned_addr learned my addr 172.21.15.87:0/3475309598 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T05:30:11.688 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:11.684+0000 7f58c9800700 1 --2- 172.21.15.87:0/3475309598 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55fafc33b9d0 0x55fafc3542f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:30:11.688 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:11.684+0000 7f58c8e00700 1 -- 172.21.15.87:0/3475309598 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55fafc33b9d0 msgr2=0x55fafc3542f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:30:11.688 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:11.684+0000 7f58c8e00700 1 --2- 172.21.15.87:0/3475309598 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55fafc33b9d0 0x55fafc3542f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:30:11.688 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:11.684+0000 7f58c8e00700 1 -- 172.21.15.87:0/3475309598 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55fafc337980 msgr2=0x55fafc353db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:30:11.689 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:11.684+0000 7f58c8e00700 1 --2- 172.21.15.87:0/3475309598 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55fafc337980 0x55fafc353db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:30:11.689 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:11.684+0000 7f58c8e00700 1 -- 172.21.15.87:0/3475309598 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fafc3b9de0 con 0x55fafc337060 2024-05-08T05:30:11.689 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:11.684+0000 7f58c8e00700 1 --2- 172.21.15.87:0/3475309598 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55fafc337060 0x55fafc353870 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f58b80a9190 tx=0x7f58b80b2510 comp rx=0 tx=0).ready entity=mon.2 client_cookie=247ed8aff58d5b9c server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:30:11.689 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:11.684+0000 7f58aaa00700 10 client.0 ms_handle_connect on v2:172.21.15.90:3300/0 2024-05-08T05:30:11.689 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:11.684+0000 7f58aaa00700 1 -- 172.21.15.87:0/3475309598 <== mon.2 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58b80c2070 con 0x55fafc337060 2024-05-08T05:30:11.689 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:11.685+0000 7f58aaa00700 1 -- 172.21.15.87:0/3475309598 <== mon.2 v2:172.21.15.90:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8190+0+0 (secure 0 0 0) 0x7f58b80cad70 con 0x55fafc337060 2024-05-08T05:30:11.689 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:11.685+0000 7f58d6132b80 1 -- 172.21.15.87:0/3475309598 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f58b80a98b0 con 0x55fafc337060 2024-05-08T05:30:11.689 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:11.685+0000 7f58aaa00700 1 -- 172.21.15.87:0/3475309598 <== mon.2 v2:172.21.15.90:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f58b80a5040 con 0x55fafc337060 2024-05-08T05:30:11.689 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:11.685+0000 7f58d6132b80 10 client.25127 fetch_fsmap learned FSMap version 25 2024-05-08T05:30:11.689 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:11.685+0000 7f58d6132b80 1 -- 172.21.15.87:0/3475309598 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55fafc3b9de0 con 0x55fafc337060 2024-05-08T05:30:11.689 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:11.685+0000 7f58aaa00700 1 -- 172.21.15.87:0/3475309598 <== mon.2 v2:172.21.15.90:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f58b80a98b0 con 0x55fafc337060 2024-05-08T05:30:11.689 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:11.685+0000 7f58aaa00700 1 -- 172.21.15.87:0/3475309598 <== mon.2 v2:172.21.15.90:3300/0 5 ==== fsmap(e 25) ==== 8338+0+0 (secure 0 0 0) 0x7f58b80aedf0 con 0x55fafc337060 2024-05-08T05:30:11.689 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:11.685+0000 7f58d6132b80 10 client.25127 fetch_fsmap finished waiting for FSMap version 25 2024-05-08T05:30:11.689 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:11.685+0000 7f58d6132b80 10 client.25127 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-05-08T05:30:11.689 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:11.685+0000 7f58d6132b80 20 client.25127 populate_metadata read hostname 'smithi087' 2024-05-08T05:30:11.690 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:11.685+0000 7f58d6132b80 1 --2- 172.21.15.87:0/3475309598 >> [v2:172.21.15.90:6838/160586017,v1:172.21.15.90:6839/160586017] conn(0x55fafc3bb300 0x55fafc3bd6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:30:11.690 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:11.685+0000 7f58d6132b80 4 client.25127 mds_command: new command op to 24500 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-05-08T05:30:11.690 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:11.685+0000 7f58d6132b80 1 -- 172.21.15.87:0/3475309598 --> [v2:172.21.15.90:6838/160586017,v1:172.21.15.90:6839/160586017] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55fafc297400 con 0x55fafc3bb300 2024-05-08T05:30:11.690 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:11.686+0000 7f58c3e00700 1 --2- 172.21.15.87:0/3475309598 >> [v2:172.21.15.90:6838/160586017,v1:172.21.15.90:6839/160586017] conn(0x55fafc3bb300 0x55fafc3bd6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:30:11.690 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:11.686+0000 7f58c3e00700 1 --2- 172.21.15.87:0/3475309598 >> [v2:172.21.15.90:6838/160586017,v1:172.21.15.90:6839/160586017] conn(0x55fafc3bb300 0x55fafc3bd6f0 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d4de626754a6d342 server_cookie=753ba6d2e99df27d in_seq=0 out_seq=0 2024-05-08T05:30:11.690 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:11.686+0000 7f58aaa00700 10 client.25127 ms_handle_connect on v2:172.21.15.90:6838/160586017 2024-05-08T05:30:11.690 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:11.686+0000 7f58aaa00700 1 -- 172.21.15.87:0/3475309598 <== mds.0 v2:172.21.15.90:6838/160586017 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x55fafc297400 con 0x55fafc3bb300 2024-05-08T05:30:11.690 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:11.686+0000 7f58aaa00700 10 client.25127 handle_command_reply: tid=0 2024-05-08T05:30:11.690 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:11.686+0000 7f58d6132b80 1 client.25127 shutdown 2024-05-08T05:30:11.690 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:11.687+0000 7f58d6132b80 1 -- 172.21.15.87:0/3475309598 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55fafc337060 msgr2=0x55fafc353870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:30:11.690 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:11.687+0000 7f58d6132b80 1 --2- 172.21.15.87:0/3475309598 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55fafc337060 0x55fafc353870 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f58b80a9190 tx=0x7f58b80b2510 comp rx=0 tx=0).stop 2024-05-08T05:30:11.690 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:11.687+0000 7f58d6132b80 1 -- 172.21.15.87:0/3475309598 shutdown_connections 2024-05-08T05:30:11.690 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:11.687+0000 7f58d6132b80 1 --2- 172.21.15.87:0/3475309598 >> [v2:172.21.15.90:6838/160586017,v1:172.21.15.90:6839/160586017] conn(0x55fafc3bb300 0x55fafc3bd6f0 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:30:11.690 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:11.687+0000 7f58d6132b80 1 --2- 172.21.15.87:0/3475309598 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55fafc33b9d0 0x55fafc3542f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:30:11.690 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:11.687+0000 7f58d6132b80 1 --2- 172.21.15.87:0/3475309598 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55fafc337060 0x55fafc353870 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:30:11.691 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:11.687+0000 7f58aaa00700 0 client.25127 ms_handle_reset on v2:172.21.15.90:6838/160586017 2024-05-08T05:30:11.691 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:11.687+0000 7f58d6132b80 1 --2- 172.21.15.87:0/3475309598 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55fafc337980 0x55fafc353db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:30:11.691 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:11.687+0000 7f58d6132b80 1 -- 172.21.15.87:0/3475309598 >> 172.21.15.87:0/3475309598 conn(0x55fafc265b60 msgr2=0x55fafc33a840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:30:11.691 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:11.687+0000 7f58d6132b80 1 -- 172.21.15.87:0/3475309598 shutdown_connections 2024-05-08T05:30:11.691 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:11.687+0000 7f58d6132b80 1 -- 172.21.15.87:0/3475309598 wait complete. 2024-05-08T05:30:11.691 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:11.687+0000 7f58d6132b80 20 client.25127 trim_cache size 0 max 16384 2024-05-08T05:30:11.691 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-05-08T05:30:11.691 INFO:teuthology.orchestra.run.smithi087.stdout: "status": "no active scrubs running", 2024-05-08T05:30:11.691 INFO:teuthology.orchestra.run.smithi087.stdout: "scrubs": {} 2024-05-08T05:30:11.692 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-05-08T05:30:11.692 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:11.688+0000 7f58cb800700 1 -- 172.21.15.87:0/2924351143 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f58ac0b2900 msgr2=0x7f58ac0b4dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:30:11.692 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:11.688+0000 7f58cb800700 1 --2- 172.21.15.87:0/2924351143 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f58ac0b2900 0x7f58ac0b4dc0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f58bc003f20 tx=0x7f58bc009ba0 comp rx=0 tx=0).stop 2024-05-08T05:30:11.692 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:11.688+0000 7f58cb800700 1 -- 172.21.15.87:0/2924351143 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f58c4109ad0 msgr2=0x7f58c41a01f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:30:11.692 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:11.688+0000 7f58cb800700 1 --2- 172.21.15.87:0/2924351143 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f58c4109ad0 0x7f58c41a01f0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f58b800e9a0 tx=0x7f58b800ecb0 comp rx=0 tx=0).stop 2024-05-08T05:30:11.692 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:11.688+0000 7f58cb800700 1 -- 172.21.15.87:0/2924351143 shutdown_connections 2024-05-08T05:30:11.692 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:11.688+0000 7f58cb800700 1 --2- 172.21.15.87:0/2924351143 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f58c410fb60 0x7f58c41a4a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:30:11.693 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:11.688+0000 7f58cb800700 1 --2- 172.21.15.87:0/2924351143 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f58c4109ad0 0x7f58c41a01f0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:30:11.693 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:11.688+0000 7f58cb800700 1 --2- 172.21.15.87:0/2924351143 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f58ac0b2900 0x7f58ac0b4dc0 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:30:11.693 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:11.688+0000 7f58cb800700 1 --2- 172.21.15.87:0/2924351143 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f58c410a490 0x7f58c41a0730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:30:11.693 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:11.688+0000 7f58cb800700 1 -- 172.21.15.87:0/2924351143 >> 172.21.15.87:0/2924351143 conn(0x7f58c4076c70 msgr2=0x7f58c4077230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:30:11.693 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:11.688+0000 7f58cb800700 1 -- 172.21.15.87:0/2924351143 shutdown_connections 2024-05-08T05:30:11.693 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:11.688+0000 7f58cb800700 1 -- 172.21.15.87:0/2924351143 wait complete. 2024-05-08T05:30:12.607 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-05-08T05:30:12.607 DEBUG:teuthology.orchestra.run.smithi087:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid eeeb813e-0cf9-11ef-bc97-c7b262605968 -- ceph fs dump --format=json 2024-05-08T05:30:12.958 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:30:12 smithi087 ceph-mon[29523]: pgmap v456: 97 pgs: 97 active+clean; 661 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 682 B/s wr, 5 op/s 2024-05-08T05:30:12.983 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:30:12 smithi090 ceph-mon[34526]: pgmap v456: 97 pgs: 97 active+clean; 661 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 682 B/s wr, 5 op/s 2024-05-08T05:30:13.038 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:30:12 smithi160 ceph-mon[34827]: pgmap v456: 97 pgs: 97 active+clean; 661 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 682 B/s wr, 5 op/s 2024-05-08T05:30:13.059 INFO:teuthology.orchestra.run.smithi087.stderr:Inferring config /var/lib/ceph/eeeb813e-0cf9-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T05:30:14.764 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:30:14 smithi087 ceph-mon[29523]: pgmap v457: 97 pgs: 97 active+clean; 661 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 682 B/s wr, 6 op/s 2024-05-08T05:30:14.984 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:30:14 smithi090 ceph-mon[34526]: pgmap v457: 97 pgs: 97 active+clean; 661 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 682 B/s wr, 6 op/s 2024-05-08T05:30:15.038 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:30:14 smithi160 ceph-mon[34827]: pgmap v457: 97 pgs: 97 active+clean; 661 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 682 B/s wr, 6 op/s 2024-05-08T05:30:15.307 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:15.306+0000 7fe14ae00700 1 -- 172.21.15.87:0/2523687318 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe144106080 msgr2=0x7fe144112590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:30:15.307 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:15.306+0000 7fe14ae00700 1 --2- 172.21.15.87:0/2523687318 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe144106080 0x7fe144112590 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fe13c00b0a0 tx=0x7fe13c00b3b0 comp rx=0 tx=0).stop 2024-05-08T05:30:15.307 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:15.306+0000 7fe14ae00700 1 -- 172.21.15.87:0/2523687318 shutdown_connections 2024-05-08T05:30:15.308 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:15.306+0000 7fe14ae00700 1 --2- 172.21.15.87:0/2523687318 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe144106080 0x7fe144112590 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:30:15.308 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:15.306+0000 7fe14ae00700 1 --2- 172.21.15.87:0/2523687318 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe14410b6c0 0x7fe14410baa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:30:15.308 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:15.306+0000 7fe14ae00700 1 --2- 172.21.15.87:0/2523687318 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe1441056c0 0x7fe144105b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:30:15.308 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:15.306+0000 7fe14ae00700 1 -- 172.21.15.87:0/2523687318 >> 172.21.15.87:0/2523687318 conn(0x7fe1441011b0 msgr2=0x7fe1441035d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:30:15.308 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:15.306+0000 7fe14ae00700 1 -- 172.21.15.87:0/2523687318 shutdown_connections 2024-05-08T05:30:15.308 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:15.307+0000 7fe14ae00700 1 -- 172.21.15.87:0/2523687318 wait complete. 2024-05-08T05:30:15.308 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:15.308+0000 7fe14ae00700 1 Processor -- start 2024-05-08T05:30:15.308 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:15.308+0000 7fe14ae00700 1 -- start start 2024-05-08T05:30:15.309 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:15.309+0000 7fe14ae00700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe1441056c0 0x7fe14419bda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:30:15.309 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:15.309+0000 7fe14ae00700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe144106080 0x7fe14419c2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:30:15.309 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:15.309+0000 7fe14ae00700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe14410b6c0 0x7fe1441a0620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:30:15.310 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:15.309+0000 7fe14ae00700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fe144115950 con 0x7fe1441056c0 2024-05-08T05:30:15.310 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:15.309+0000 7fe14ae00700 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fe1441157d0 con 0x7fe144106080 2024-05-08T05:30:15.310 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:15.309+0000 7fe14ae00700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7fe144115ad0 con 0x7fe14410b6c0 2024-05-08T05:30:15.310 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:15.309+0000 7fe143e00700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe1441056c0 0x7fe14419bda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:30:15.310 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:15.309+0000 7fe143e00700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe1441056c0 0x7fe14419bda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:59840/0 (socket says 172.21.15.87:59840) 2024-05-08T05:30:15.310 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:15.309+0000 7fe143e00700 1 -- 172.21.15.87:0/1557464101 learned_addr learned my addr 172.21.15.87:0/1557464101 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T05:30:15.310 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:15.309+0000 7fe148e00700 1 --2- 172.21.15.87:0/1557464101 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe14410b6c0 0x7fe1441a0620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:30:15.310 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:15.309+0000 7fe143400700 1 --2- 172.21.15.87:0/1557464101 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe144106080 0x7fe14419c2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:30:15.311 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:15.309+0000 7fe148e00700 1 -- 172.21.15.87:0/1557464101 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe144106080 msgr2=0x7fe14419c2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:30:15.311 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:15.309+0000 7fe148e00700 1 --2- 172.21.15.87:0/1557464101 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe144106080 0x7fe14419c2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:30:15.311 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:15.309+0000 7fe148e00700 1 -- 172.21.15.87:0/1557464101 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe1441056c0 msgr2=0x7fe14419bda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:30:15.311 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:15.309+0000 7fe148e00700 1 --2- 172.21.15.87:0/1557464101 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe1441056c0 0x7fe14419bda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:30:15.311 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:15.309+0000 7fe148e00700 1 -- 172.21.15.87:0/1557464101 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe1441a0d60 con 0x7fe14410b6c0 2024-05-08T05:30:15.311 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:15.310+0000 7fe148e00700 1 --2- 172.21.15.87:0/1557464101 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe14410b6c0 0x7fe1441a0620 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fe13c00b070 tx=0x7fe13c004c80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:30:15.311 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:15.310+0000 7fe140c00700 1 -- 172.21.15.87:0/1557464101 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe13c021070 con 0x7fe14410b6c0 2024-05-08T05:30:15.312 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:15.310+0000 7fe14ae00700 1 -- 172.21.15.87:0/1557464101 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe1441a0ff0 con 0x7fe14410b6c0 2024-05-08T05:30:15.312 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:15.310+0000 7fe140c00700 1 -- 172.21.15.87:0/1557464101 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe13c007e30 con 0x7fe14410b6c0 2024-05-08T05:30:15.312 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:15.310+0000 7fe140c00700 1 -- 172.21.15.87:0/1557464101 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe13c0045f0 con 0x7fe14410b6c0 2024-05-08T05:30:15.312 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:15.310+0000 7fe14ae00700 1 -- 172.21.15.87:0/1557464101 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe1441a88d0 con 0x7fe14410b6c0 2024-05-08T05:30:15.312 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:15.311+0000 7fe14ae00700 1 -- 172.21.15.87:0/1557464101 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe14406a190 con 0x7fe14410b6c0 2024-05-08T05:30:15.314 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:15.314+0000 7fe140c00700 1 -- 172.21.15.87:0/1557464101 <== mon.1 v2:172.21.15.160:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7fe13c007980 con 0x7fe14410b6c0 2024-05-08T05:30:15.315 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:15.315+0000 7fe140c00700 1 --2- 172.21.15.87:0/1557464101 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7fe1280b2900 0x7fe1280b4dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:30:15.316 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:15.316+0000 7fe140c00700 1 -- 172.21.15.87:0/1557464101 <== mon.1 v2:172.21.15.160:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8190+0+0 (secure 0 0 0) 0x7fe13c0e2fb0 con 0x7fe14410b6c0 2024-05-08T05:30:15.316 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:15.316+0000 7fe143e00700 1 --2- 172.21.15.87:0/1557464101 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7fe1280b2900 0x7fe1280b4dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:30:15.316 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:15.316+0000 7fe143e00700 1 --2- 172.21.15.87:0/1557464101 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7fe1280b2900 0x7fe1280b4dc0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fe134009ca0 tx=0x7fe134009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:30:15.318 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:15.318+0000 7fe140c00700 1 -- 172.21.15.87:0/1557464101 <== mon.1 v2:172.21.15.160:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7fe13c0aad30 con 0x7fe14410b6c0 2024-05-08T05:30:15.603 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:15.602+0000 7fe14ae00700 1 -- 172.21.15.87:0/1557464101 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe14410dc70 con 0x7fe14410b6c0 2024-05-08T05:30:15.604 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:15.604+0000 7fe140c00700 1 -- 172.21.15.87:0/1557464101 <== mon.1 v2:172.21.15.160:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) ==== 94+0+11858 (secure 0 0 0) 0x7fe13c0aa630 con 0x7fe14410b6c0 2024-05-08T05:30:15.605 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-05-08T05:30:15.605 INFO:teuthology.orchestra.run.smithi087.stdout:{"epoch":25,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14358,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6835/1183985321","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6834","nonce":1183985321},{"type":"v1","addr":"172.21.15.87:6835","nonce":1183985321}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14370,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6837/1485824316","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6836","nonce":1485824316},{"type":"v1","addr":"172.21.15.87:6837","nonce":1485824316}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14409,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6841/724277538","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6840","nonce":724277538},{"type":"v1","addr":"172.21.15.87:6841","nonce":724277538}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24412,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6833/3339455985","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6832","nonce":3339455985},{"type":"v1","addr":"172.21.15.160:6833","nonce":3339455985}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24413,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6833/3292166873","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6832","nonce":3292166873},{"type":"v1","addr":"172.21.15.90:6833","nonce":3292166873}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24443,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6835/824555459","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6834","nonce":824555459},{"type":"v1","addr":"172.21.15.90:6835","nonce":824555459}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6}],"filesystems":[{"mdsmap":{"epoch":25,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-05-08T05:25:36.816840+0000","modified":"2024-05-08T05:29:16.624018+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24500,"mds_1":24482,"mds_2":24481},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24463":{"gid":24463,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.160:6835/409648357","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6834","nonce":409648357},{"type":"v1","addr":"172.21.15.160:6835","nonce":409648357}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24467":{"gid":24467,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.90:6837/4221919418","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6836","nonce":4221919418},{"type":"v1","addr":"172.21.15.90:6837","nonce":4221919418}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24469":{"gid":24469,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.160:6837/4200018040","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6836","nonce":4200018040},{"type":"v1","addr":"172.21.15.160:6837","nonce":4200018040}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24481":{"gid":24481,"name":"i","rank":2,"incarnation":20,"state":"up:active","state_seq":13,"addr":"172.21.15.160:6839/234657686","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6838","nonce":234657686},{"type":"v1","addr":"172.21.15.160:6839","nonce":234657686}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24482":{"gid":24482,"name":"g","rank":1,"incarnation":18,"state":"up:active","state_seq":12,"addr":"172.21.15.87:6839/2127215876","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6838","nonce":2127215876},{"type":"v1","addr":"172.21.15.87:6839","nonce":2127215876}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24500":{"gid":24500,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.90:6839/160586017","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6838","nonce":160586017},{"type":"v1","addr":"172.21.15.90:6839","nonce":160586017}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24500,"qdb_cluster":[24481,24482,24500]},"id":1}]} 2024-05-08T05:30:15.607 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:15.607+0000 7fe14ae00700 1 -- 172.21.15.87:0/1557464101 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7fe1280b2900 msgr2=0x7fe1280b4dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:30:15.607 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:15.607+0000 7fe14ae00700 1 --2- 172.21.15.87:0/1557464101 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7fe1280b2900 0x7fe1280b4dc0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fe134009ca0 tx=0x7fe134009260 comp rx=0 tx=0).stop 2024-05-08T05:30:15.607 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:15.607+0000 7fe14ae00700 1 -- 172.21.15.87:0/1557464101 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe14410b6c0 msgr2=0x7fe1441a0620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:30:15.607 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:15.607+0000 7fe14ae00700 1 --2- 172.21.15.87:0/1557464101 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe14410b6c0 0x7fe1441a0620 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fe13c00b070 tx=0x7fe13c004c80 comp rx=0 tx=0).stop 2024-05-08T05:30:15.608 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:15.607+0000 7fe14ae00700 1 -- 172.21.15.87:0/1557464101 shutdown_connections 2024-05-08T05:30:15.608 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:15.607+0000 7fe14ae00700 1 --2- 172.21.15.87:0/1557464101 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7fe1280b2900 0x7fe1280b4dc0 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:30:15.608 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:15.607+0000 7fe14ae00700 1 --2- 172.21.15.87:0/1557464101 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe14410b6c0 0x7fe1441a0620 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:30:15.608 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:15.607+0000 7fe14ae00700 1 --2- 172.21.15.87:0/1557464101 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe1441056c0 0x7fe14419bda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:30:15.608 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:15.607+0000 7fe14ae00700 1 --2- 172.21.15.87:0/1557464101 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe144106080 0x7fe14419c2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:30:15.608 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:15.607+0000 7fe14ae00700 1 -- 172.21.15.87:0/1557464101 >> 172.21.15.87:0/1557464101 conn(0x7fe1441011b0 msgr2=0x7fe144101790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:30:15.608 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:15.607+0000 7fe14ae00700 1 -- 172.21.15.87:0/1557464101 shutdown_connections 2024-05-08T05:30:15.608 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:15.608+0000 7fe14ae00700 1 -- 172.21.15.87:0/1557464101 wait complete. 2024-05-08T05:30:15.609 INFO:teuthology.orchestra.run.smithi087.stderr:dumped fsmap epoch 25 2024-05-08T05:30:16.429 DEBUG:teuthology.orchestra.run.smithi087:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid eeeb813e-0cf9-11ef-bc97-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-05-08T05:30:16.708 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:30:16 smithi087 ceph-mon[29523]: pgmap v458: 97 pgs: 97 active+clean; 661 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 682 B/s wr, 7 op/s 2024-05-08T05:30:16.708 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:30:16 smithi087 ceph-mon[29523]: from='client.? 172.21.15.87:0/1557464101' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T05:30:16.881 INFO:teuthology.orchestra.run.smithi087.stderr:Inferring config /var/lib/ceph/eeeb813e-0cf9-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T05:30:16.983 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:30:16 smithi090 ceph-mon[34526]: pgmap v458: 97 pgs: 97 active+clean; 661 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 682 B/s wr, 7 op/s 2024-05-08T05:30:16.983 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:30:16 smithi090 ceph-mon[34526]: from='client.? 172.21.15.87:0/1557464101' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T05:30:17.038 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:30:16 smithi160 ceph-mon[34827]: pgmap v458: 97 pgs: 97 active+clean; 661 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 682 B/s wr, 7 op/s 2024-05-08T05:30:17.039 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:30:16 smithi160 ceph-mon[34827]: from='client.? 172.21.15.87:0/1557464101' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T05:30:18.869 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:30:18 smithi087 ceph-mon[29523]: pgmap v459: 97 pgs: 97 active+clean; 661 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 682 B/s wr, 5 op/s 2024-05-08T05:30:18.983 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:30:18 smithi090 ceph-mon[34526]: pgmap v459: 97 pgs: 97 active+clean; 661 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 682 B/s wr, 5 op/s 2024-05-08T05:30:19.038 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:30:18 smithi160 ceph-mon[34827]: pgmap v459: 97 pgs: 97 active+clean; 661 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 682 B/s wr, 5 op/s 2024-05-08T05:30:19.142 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:19.141+0000 7f0531e00700 1 -- 172.21.15.87:0/2746350805 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f052c0756d0 msgr2=0x7f052c075ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:30:19.142 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:19.141+0000 7f0531e00700 1 --2- 172.21.15.87:0/2746350805 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f052c0756d0 0x7f052c075ab0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f051c00b0a0 tx=0x7f051c00b3b0 comp rx=0 tx=0).stop 2024-05-08T05:30:19.143 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:19.142+0000 7f0531e00700 1 -- 172.21.15.87:0/2746350805 shutdown_connections 2024-05-08T05:30:19.143 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:19.142+0000 7f0531e00700 1 --2- 172.21.15.87:0/2746350805 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f052c10fea0 0x7f052c112290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:30:19.143 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:19.142+0000 7f0531e00700 1 --2- 172.21.15.87:0/2746350805 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f052c0756d0 0x7f052c075ab0 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:30:19.143 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:19.142+0000 7f0531e00700 1 --2- 172.21.15.87:0/2746350805 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f052c075ff0 0x7f052c10f960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:30:19.143 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:19.142+0000 7f0531e00700 1 -- 172.21.15.87:0/2746350805 >> 172.21.15.87:0/2746350805 conn(0x7f052c07a600 msgr2=0x7f052c07aa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:30:19.143 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:19.142+0000 7f0531e00700 1 -- 172.21.15.87:0/2746350805 shutdown_connections 2024-05-08T05:30:19.143 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:19.142+0000 7f0531e00700 1 -- 172.21.15.87:0/2746350805 wait complete. 2024-05-08T05:30:19.144 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:19.143+0000 7f0531e00700 1 Processor -- start 2024-05-08T05:30:19.145 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:19.143+0000 7f0531e00700 1 -- start start 2024-05-08T05:30:19.145 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:19.143+0000 7f0531e00700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f052c0756d0 0x7f052c19bd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:30:19.145 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:19.143+0000 7f0531e00700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f052c075ff0 0x7f052c19c290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:30:19.145 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:19.143+0000 7f0531e00700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f052c10fea0 0x7f052c1a0620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:30:19.145 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:19.143+0000 7f0531e00700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f052c1158c0 con 0x7f052c10fea0 2024-05-08T05:30:19.145 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:19.143+0000 7f0531e00700 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f052c115740 con 0x7f052c0756d0 2024-05-08T05:30:19.145 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:19.143+0000 7f0531e00700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f052c115a40 con 0x7f052c075ff0 2024-05-08T05:30:19.145 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:19.144+0000 7f052b400700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f052c10fea0 0x7f052c1a0620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:30:19.145 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:19.144+0000 7f0522000700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f052c075ff0 0x7f052c19c290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:30:19.145 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:19.144+0000 7f052aa00700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f052c0756d0 0x7f052c19bd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:30:19.145 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:19.144+0000 7f052b400700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f052c10fea0 0x7f052c1a0620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:60544/0 (socket says 172.21.15.87:60544) 2024-05-08T05:30:19.145 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:19.144+0000 7f052b400700 1 -- 172.21.15.87:0/1252791755 learned_addr learned my addr 172.21.15.87:0/1252791755 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T05:30:19.145 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:19.144+0000 7f0522000700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f052c075ff0 0x7f052c19c290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.87:37242/0 (socket says 172.21.15.87:37242) 2024-05-08T05:30:19.146 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:19.144+0000 7f0522000700 1 -- 172.21.15.87:0/1252791755 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f052c0756d0 msgr2=0x7f052c19bd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:30:19.146 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:19.144+0000 7f0522000700 1 --2- 172.21.15.87:0/1252791755 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f052c0756d0 0x7f052c19bd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:30:19.146 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:19.144+0000 7f0522000700 1 -- 172.21.15.87:0/1252791755 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f052c10fea0 msgr2=0x7f052c1a0620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:30:19.146 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:19.144+0000 7f0522000700 1 --2- 172.21.15.87:0/1252791755 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f052c10fea0 0x7f052c1a0620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:30:19.146 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:19.144+0000 7f0522000700 1 -- 172.21.15.87:0/1252791755 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f052c1a0d60 con 0x7f052c075ff0 2024-05-08T05:30:19.147 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:19.145+0000 7f0522000700 1 --2- 172.21.15.87:0/1252791755 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f052c075ff0 0x7f052c19c290 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f051400e9c0 tx=0x7f051400ecd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:30:19.147 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:19.145+0000 7f0530a00700 1 -- 172.21.15.87:0/1252791755 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f051400cb70 con 0x7f052c075ff0 2024-05-08T05:30:19.147 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:19.145+0000 7f0530a00700 1 -- 172.21.15.87:0/1252791755 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f051400ee60 con 0x7f052c075ff0 2024-05-08T05:30:19.147 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:19.145+0000 7f0531e00700 1 -- 172.21.15.87:0/1252791755 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f052c1a1050 con 0x7f052c075ff0 2024-05-08T05:30:19.147 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:19.145+0000 7f0530a00700 1 -- 172.21.15.87:0/1252791755 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0514018680 con 0x7f052c075ff0 2024-05-08T05:30:19.147 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:19.145+0000 7f0531e00700 1 -- 172.21.15.87:0/1252791755 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f052c1a88d0 con 0x7f052c075ff0 2024-05-08T05:30:19.149 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:19.149+0000 7f0530a00700 1 -- 172.21.15.87:0/1252791755 <== mon.1 v2:172.21.15.160:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7f051401f020 con 0x7f052c075ff0 2024-05-08T05:30:19.150 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:19.150+0000 7f053c81cb80 1 Processor -- start 2024-05-08T05:30:19.150 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:19.150+0000 7f053c81cb80 1 -- start start 2024-05-08T05:30:19.150 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:19.150+0000 7f053c81cb80 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55e715083bc0 0x55e715083fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:30:19.151 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:19.150+0000 7f053c81cb80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55e7150844e0 0x55e71507e2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:30:19.151 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:19.150+0000 7f053c81cb80 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e71507e8f0 0x55e71507ed70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:30:19.151 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:19.150+0000 7f053c81cb80 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x55e714fd0a20 con 0x55e71507e8f0 2024-05-08T05:30:19.151 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:19.150+0000 7f053c81cb80 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x55e714f6e760 con 0x55e715083bc0 2024-05-08T05:30:19.151 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:19.150+0000 7f053c81cb80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x55e714fcc9e0 con 0x55e7150844e0 2024-05-08T05:30:19.151 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:19.150+0000 7f0530a00700 1 --2- 172.21.15.87:0/1252791755 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f05100b2900 0x7f05100b4dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:30:19.152 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:19.151+0000 7f052aa00700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55e7150844e0 0x55e71507e2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:30:19.152 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:19.151+0000 7f0530a00700 1 -- 172.21.15.87:0/1252791755 <== mon.1 v2:172.21.15.160:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8190+0+0 (secure 0 0 0) 0x7f05140e1fc0 con 0x7f052c075ff0 2024-05-08T05:30:19.152 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:19.151+0000 7f052aa00700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55e7150844e0 0x55e71507e2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.87:37254/0 (socket says 172.21.15.87:37254) 2024-05-08T05:30:19.152 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:19.151+0000 7f052aa00700 1 -- 172.21.15.87:0/3232547224 learned_addr learned my addr 172.21.15.87:0/3232547224 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T05:30:19.152 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:19.151+0000 7f0522000700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e71507e8f0 0x55e71507ed70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:30:19.152 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:19.151+0000 7f052b400700 1 --2- 172.21.15.87:0/3232547224 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55e715083bc0 0x55e715083fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:30:19.153 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:19.151+0000 7f052b400700 1 --2- 172.21.15.87:0/1252791755 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f05100b2900 0x7f05100b4dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:30:19.153 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:19.151+0000 7f052aa00700 1 -- 172.21.15.87:0/3232547224 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55e715083bc0 msgr2=0x55e715083fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:30:19.153 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:19.151+0000 7f052aa00700 1 --2- 172.21.15.87:0/3232547224 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55e715083bc0 0x55e715083fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:30:19.153 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:19.151+0000 7f052aa00700 1 -- 172.21.15.87:0/3232547224 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e71507e8f0 msgr2=0x55e71507ed70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:30:19.153 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:19.151+0000 7f052aa00700 1 --2- 172.21.15.87:0/3232547224 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e71507e8f0 0x55e71507ed70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:30:19.153 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:19.151+0000 7f052aa00700 1 -- 172.21.15.87:0/3232547224 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e714f1d8d0 con 0x55e7150844e0 2024-05-08T05:30:19.153 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:19.152+0000 7f052aa00700 1 --2- 172.21.15.87:0/3232547224 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55e7150844e0 0x55e71507e2d0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f051c000f80 tx=0x7f051c009360 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e16ded83ea54abe1 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:30:19.153 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:19.152+0000 7f0520c00700 1 -- 172.21.15.87:0/3232547224 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f051c00bcb0 con 0x55e7150844e0 2024-05-08T05:30:19.153 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:19.152+0000 7f0520c00700 1 -- 172.21.15.87:0/3232547224 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f051c0074e0 con 0x55e7150844e0 2024-05-08T05:30:19.153 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:19.152+0000 7f0520c00700 1 -- 172.21.15.87:0/3232547224 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f051c005260 con 0x55e7150844e0 2024-05-08T05:30:19.153 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:19.152+0000 7f052b400700 1 --2- 172.21.15.87:0/1252791755 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f05100b2900 0x7f05100b4dc0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f0524009670 tx=0x7f0524009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:30:19.154 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:19.153+0000 7f053c81cb80 1 -- 172.21.15.87:0/3232547224 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55e7150844e0 msgr2=0x55e71507e2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:30:19.155 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:19.153+0000 7f053c81cb80 1 --2- 172.21.15.87:0/3232547224 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55e7150844e0 0x55e71507e2d0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f051c000f80 tx=0x7f051c009360 comp rx=0 tx=0).stop 2024-05-08T05:30:19.155 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:19.153+0000 7f053c81cb80 1 -- 172.21.15.87:0/3232547224 shutdown_connections 2024-05-08T05:30:19.155 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:19.153+0000 7f053c81cb80 1 --2- 172.21.15.87:0/3232547224 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e71507e8f0 0x55e71507ed70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:30:19.155 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:19.153+0000 7f053c81cb80 1 --2- 172.21.15.87:0/3232547224 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55e715083bc0 0x55e715083fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:30:19.155 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:19.153+0000 7f053c81cb80 1 --2- 172.21.15.87:0/3232547224 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55e7150844e0 0x55e71507e2d0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:30:19.155 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:19.153+0000 7f053c81cb80 1 -- 172.21.15.87:0/3232547224 >> 172.21.15.87:0/3232547224 conn(0x55e714ff66d0 msgr2=0x55e715078b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:30:19.155 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:19.153+0000 7f053c81cb80 1 -- 172.21.15.87:0/3232547224 shutdown_connections 2024-05-08T05:30:19.155 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:19.153+0000 7f053c81cb80 1 -- 172.21.15.87:0/3232547224 wait complete. 2024-05-08T05:30:19.155 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:19.154+0000 7f053c81cb80 1 -- start start 2024-05-08T05:30:19.155 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:19.154+0000 7f053c81cb80 1 Processor -- start 2024-05-08T05:30:19.155 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:19.154+0000 7f053c81cb80 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55e71507e8f0 0x55e71508a1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:30:19.155 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:19.154+0000 7f053c81cb80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55e715083bc0 0x55e715087540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:30:19.156 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:19.154+0000 7f053c81cb80 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e7150844e0 0x55e715087a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:30:19.156 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:19.154+0000 7f053c81cb80 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x55e71508aec0 con 0x55e7150844e0 2024-05-08T05:30:19.156 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:19.154+0000 7f053c81cb80 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x55e714f36b20 con 0x55e71507e8f0 2024-05-08T05:30:19.156 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:19.154+0000 7f053c81cb80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x55e71508b040 con 0x55e715083bc0 2024-05-08T05:30:19.156 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:19.154+0000 7f053c81cb80 10 client.0 _ll_register_callbacks cb 0x55e714f77c70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T05:30:19.158 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:19.155+0000 7f052aa00700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55e71507e8f0 0x55e71508a1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:30:19.158 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:19.155+0000 7f052aa00700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55e71507e8f0 0x55e71508a1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.87:40238/0 (socket says 172.21.15.87:40238) 2024-05-08T05:30:19.158 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:19.155+0000 7f052aa00700 1 -- 172.21.15.87:0/1457623773 learned_addr learned my addr 172.21.15.87:0/1457623773 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T05:30:19.158 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:19.155+0000 7f052b400700 1 --2- 172.21.15.87:0/1457623773 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e7150844e0 0x55e715087a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:30:19.158 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:19.155+0000 7f0522000700 1 --2- 172.21.15.87:0/1457623773 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55e715083bc0 0x55e715087540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:30:19.158 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:19.155+0000 7f052aa00700 1 -- 172.21.15.87:0/1457623773 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55e715083bc0 msgr2=0x55e715087540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:30:19.158 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:19.155+0000 7f052aa00700 1 --2- 172.21.15.87:0/1457623773 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55e715083bc0 0x55e715087540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:30:19.158 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:19.155+0000 7f052aa00700 1 -- 172.21.15.87:0/1457623773 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e7150844e0 msgr2=0x55e715087a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:30:19.159 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:19.155+0000 7f052aa00700 1 --2- 172.21.15.87:0/1457623773 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e7150844e0 0x55e715087a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:30:19.159 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:19.155+0000 7f052aa00700 1 -- 172.21.15.87:0/1457623773 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e714f96420 con 0x55e71507e8f0 2024-05-08T05:30:19.159 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:19.155+0000 7f052aa00700 1 --2- 172.21.15.87:0/1457623773 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55e71507e8f0 0x55e71508a1a0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f051c00b780 tx=0x7f051c007f70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b8ba5b6f42ab4768 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:30:19.159 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:19.155+0000 7f0519600700 10 client.0 ms_handle_connect on v2:172.21.15.90:3300/0 2024-05-08T05:30:19.159 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:19.156+0000 7f0519600700 1 -- 172.21.15.87:0/1457623773 <== mon.2 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f051c003c90 con 0x55e71507e8f0 2024-05-08T05:30:19.159 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:19.156+0000 7f053c81cb80 1 -- 172.21.15.87:0/1457623773 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f051c0074e0 con 0x55e71507e8f0 2024-05-08T05:30:19.159 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:19.156+0000 7f0519600700 1 -- 172.21.15.87:0/1457623773 <== mon.2 v2:172.21.15.90:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8190+0+0 (secure 0 0 0) 0x7f051c007690 con 0x55e71507e8f0 2024-05-08T05:30:19.159 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:19.156+0000 7f0519600700 1 -- 172.21.15.87:0/1457623773 <== mon.2 v2:172.21.15.90:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f051c034020 con 0x55e71507e8f0 2024-05-08T05:30:19.159 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:19.156+0000 7f053c81cb80 10 client.25145 fetch_fsmap learned FSMap version 25 2024-05-08T05:30:19.159 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:19.156+0000 7f053c81cb80 1 -- 172.21.15.87:0/1457623773 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55e715095700 con 0x55e71507e8f0 2024-05-08T05:30:19.159 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:19.156+0000 7f0519600700 1 -- 172.21.15.87:0/1457623773 <== mon.2 v2:172.21.15.90:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f051c0074e0 con 0x55e71507e8f0 2024-05-08T05:30:19.159 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:19.157+0000 7f0519600700 1 -- 172.21.15.87:0/1457623773 <== mon.2 v2:172.21.15.90:3300/0 5 ==== fsmap(e 25) ==== 8338+0+0 (secure 0 0 0) 0x7f051c011070 con 0x55e71507e8f0 2024-05-08T05:30:19.159 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:19.157+0000 7f053c81cb80 10 client.25145 fetch_fsmap finished waiting for FSMap version 25 2024-05-08T05:30:19.159 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:19.157+0000 7f053c81cb80 10 client.25145 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.i 2024-05-08T05:30:19.159 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:19.157+0000 7f053c81cb80 20 client.25145 populate_metadata read hostname 'smithi087' 2024-05-08T05:30:19.160 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:19.157+0000 7f053c81cb80 1 --2- 172.21.15.87:0/1457623773 >> [v2:172.21.15.160:6838/234657686,v1:172.21.15.160:6839/234657686] conn(0x55e715097bd0 0x55e715099fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:30:19.160 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:19.157+0000 7f053c81cb80 4 client.25145 mds_command: new command op to 24481 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-08T05:30:19.160 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:19.157+0000 7f053c81cb80 1 -- 172.21.15.87:0/1457623773 --> [v2:172.21.15.160:6838/234657686,v1:172.21.15.160:6839/234657686] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e71504b140 con 0x55e715097bd0 2024-05-08T05:30:19.160 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:19.157+0000 7f0522000700 1 --2- 172.21.15.87:0/1457623773 >> [v2:172.21.15.160:6838/234657686,v1:172.21.15.160:6839/234657686] conn(0x55e715097bd0 0x55e715099fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:30:19.160 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:19.158+0000 7f0522000700 1 --2- 172.21.15.87:0/1457623773 >> [v2:172.21.15.160:6838/234657686,v1:172.21.15.160:6839/234657686] conn(0x55e715097bd0 0x55e715099fc0 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=8d698e146439ec06 server_cookie=12c7060fc5a2458a in_seq=0 out_seq=0 2024-05-08T05:30:19.160 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:19.158+0000 7f0519600700 10 client.25145 ms_handle_connect on v2:172.21.15.160:6838/234657686 2024-05-08T05:30:19.161 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:19.159+0000 7f0519600700 1 -- 172.21.15.87:0/1457623773 <== mds.2 v2:172.21.15.160:6838/234657686 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55e71504b140 con 0x55e715097bd0 2024-05-08T05:30:19.161 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:19.159+0000 7f0519600700 10 client.25145 handle_command_reply: tid=0 2024-05-08T05:30:19.161 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:19.159+0000 7f053c81cb80 1 client.25145 shutdown 2024-05-08T05:30:19.161 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:19.159+0000 7f053c81cb80 1 -- 172.21.15.87:0/1457623773 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55e71507e8f0 msgr2=0x55e71508a1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:30:19.161 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:19.159+0000 7f053c81cb80 1 --2- 172.21.15.87:0/1457623773 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55e71507e8f0 0x55e71508a1a0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f051c00b780 tx=0x7f051c007f70 comp rx=0 tx=0).stop 2024-05-08T05:30:19.161 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:19.159+0000 7f053c81cb80 1 -- 172.21.15.87:0/1457623773 shutdown_connections 2024-05-08T05:30:19.161 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:19.159+0000 7f053c81cb80 1 --2- 172.21.15.87:0/1457623773 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e7150844e0 0x55e715087a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:30:19.161 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:19.159+0000 7f053c81cb80 1 --2- 172.21.15.87:0/1457623773 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55e71507e8f0 0x55e71508a1a0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:30:19.161 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:19.159+0000 7f053c81cb80 1 --2- 172.21.15.87:0/1457623773 >> [v2:172.21.15.160:6838/234657686,v1:172.21.15.160:6839/234657686] conn(0x55e715097bd0 0x55e715099fc0 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:30:19.161 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:19.159+0000 7f053c81cb80 1 --2- 172.21.15.87:0/1457623773 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55e715083bc0 0x55e715087540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:30:19.161 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:19.159+0000 7f053c81cb80 1 -- 172.21.15.87:0/1457623773 >> 172.21.15.87:0/1457623773 conn(0x55e714ff66d0 msgr2=0x55e715078190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:30:19.162 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:19.159+0000 7f0519600700 0 client.25145 ms_handle_reset on v2:172.21.15.160:6838/234657686 2024-05-08T05:30:19.162 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:19.159+0000 7f053c81cb80 1 -- 172.21.15.87:0/1457623773 shutdown_connections 2024-05-08T05:30:19.162 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:19.159+0000 7f053c81cb80 1 -- 172.21.15.87:0/1457623773 wait complete. 2024-05-08T05:30:19.162 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:19.159+0000 7f053c81cb80 20 client.25145 trim_cache size 0 max 16384 2024-05-08T05:30:19.177 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:19.175+0000 7f053c81cb80 1 Processor -- start 2024-05-08T05:30:19.177 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:19.176+0000 7f053c81cb80 1 -- start start 2024-05-08T05:30:19.177 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:19.176+0000 7f053c81cb80 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e71507e8f0 0x55e71507e2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:30:19.177 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:19.176+0000 7f053c81cb80 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55e715083bc0 0x55e715089480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:30:19.177 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:19.176+0000 7f053c81cb80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55e7150844e0 0x55e715078910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:30:19.177 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:19.176+0000 7f053c81cb80 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f052c1b2380 con 0x55e71507e8f0 2024-05-08T05:30:19.177 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:19.176+0000 7f053c81cb80 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f052c1afc10 con 0x55e715083bc0 2024-05-08T05:30:19.177 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:19.176+0000 7f053c81cb80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f052c1ada80 con 0x55e7150844e0 2024-05-08T05:30:19.177 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:19.176+0000 7f052aa00700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e71507e8f0 0x55e71507e2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:30:19.178 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:19.176+0000 7f052aa00700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e71507e8f0 0x55e71507e2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:60582/0 (socket says 172.21.15.87:60582) 2024-05-08T05:30:19.178 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:19.176+0000 7f052aa00700 1 -- 172.21.15.87:0/2272747379 learned_addr learned my addr 172.21.15.87:0/2272747379 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T05:30:19.178 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:19.176+0000 7f0522000700 1 --2- 172.21.15.87:0/2272747379 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55e715083bc0 0x55e715089480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:30:19.178 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:19.176+0000 7f052b400700 1 --2- 172.21.15.87:0/2272747379 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55e7150844e0 0x55e715078910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:30:19.178 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:19.177+0000 7f052aa00700 1 -- 172.21.15.87:0/2272747379 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55e7150844e0 msgr2=0x55e715078910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:30:19.178 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:19.177+0000 7f052aa00700 1 --2- 172.21.15.87:0/2272747379 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55e7150844e0 0x55e715078910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:30:19.178 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:19.177+0000 7f052aa00700 1 -- 172.21.15.87:0/2272747379 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55e715083bc0 msgr2=0x55e715089480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:30:19.178 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:19.177+0000 7f052aa00700 1 --2- 172.21.15.87:0/2272747379 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55e715083bc0 0x55e715089480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:30:19.178 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:19.177+0000 7f052aa00700 1 -- 172.21.15.87:0/2272747379 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e71508a510 con 0x55e71507e8f0 2024-05-08T05:30:19.178 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:19.177+0000 7f052b400700 1 --2- 172.21.15.87:0/2272747379 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55e7150844e0 0x55e715078910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T05:30:19.180 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:19.177+0000 7f052aa00700 1 --2- 172.21.15.87:0/2272747379 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e71507e8f0 0x55e71507e2d0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f051c009610 tx=0x7f051c005b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=729f75b43b55217f server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:30:19.181 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:19.177+0000 7f051be00700 1 -- 172.21.15.87:0/2272747379 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f051c005c60 con 0x55e71507e8f0 2024-05-08T05:30:19.181 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:19.177+0000 7f051be00700 1 -- 172.21.15.87:0/2272747379 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f051c005e00 con 0x55e71507e8f0 2024-05-08T05:30:19.181 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:19.178+0000 7f051be00700 1 -- 172.21.15.87:0/2272747379 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f051c030a00 con 0x55e71507e8f0 2024-05-08T05:30:19.181 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:19.178+0000 7f053c81cb80 1 -- 172.21.15.87:0/2272747379 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e71507e8f0 msgr2=0x55e71507e2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:30:19.181 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:19.178+0000 7f053c81cb80 1 --2- 172.21.15.87:0/2272747379 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e71507e8f0 0x55e71507e2d0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f051c009610 tx=0x7f051c005b50 comp rx=0 tx=0).stop 2024-05-08T05:30:19.181 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:19.178+0000 7f053c81cb80 1 -- 172.21.15.87:0/2272747379 shutdown_connections 2024-05-08T05:30:19.181 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:19.178+0000 7f053c81cb80 1 --2- 172.21.15.87:0/2272747379 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55e7150844e0 0x55e715078910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:30:19.181 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:19.178+0000 7f053c81cb80 1 --2- 172.21.15.87:0/2272747379 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e71507e8f0 0x55e71507e2d0 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:30:19.181 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:19.178+0000 7f053c81cb80 1 --2- 172.21.15.87:0/2272747379 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55e715083bc0 0x55e715089480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:30:19.181 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:19.178+0000 7f053c81cb80 1 -- 172.21.15.87:0/2272747379 >> 172.21.15.87:0/2272747379 conn(0x55e714ff66d0 msgr2=0x55e715084f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:30:19.181 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:19.178+0000 7f053c81cb80 1 -- 172.21.15.87:0/2272747379 shutdown_connections 2024-05-08T05:30:19.181 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:19.178+0000 7f053c81cb80 1 -- 172.21.15.87:0/2272747379 wait complete. 2024-05-08T05:30:19.181 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:19.179+0000 7f053c81cb80 1 -- start start 2024-05-08T05:30:19.182 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:19.179+0000 7f053c81cb80 1 Processor -- start 2024-05-08T05:30:19.182 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:19.180+0000 7f053c81cb80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55e71507e8f0 0x55e7150fa4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:30:19.182 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:19.180+0000 7f053c81cb80 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55e715083bc0 0x55e7150faa00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:30:19.182 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:19.180+0000 7f053c81cb80 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e7150844e0 0x55e71509a4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:30:19.182 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:19.180+0000 7f053c81cb80 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f052c1ae0d0 con 0x55e7150844e0 2024-05-08T05:30:19.182 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:19.180+0000 7f053c81cb80 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f052c1af540 con 0x55e715083bc0 2024-05-08T05:30:19.182 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:19.180+0000 7f053c81cb80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f052c1ae7a0 con 0x55e71507e8f0 2024-05-08T05:30:19.182 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:19.180+0000 7f053c81cb80 10 client.0 _ll_register_callbacks cb 0x55e714f77c70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T05:30:19.182 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:19.180+0000 7f052aa00700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55e71507e8f0 0x55e7150fa4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:30:19.182 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:19.180+0000 7f052b400700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e7150844e0 0x55e71509a4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:30:19.182 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:19.180+0000 7f052aa00700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55e71507e8f0 0x55e7150fa4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.87:37274/0 (socket says 172.21.15.87:37274) 2024-05-08T05:30:19.182 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:19.180+0000 7f052aa00700 1 -- 172.21.15.87:0/975107424 learned_addr learned my addr 172.21.15.87:0/975107424 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T05:30:19.182 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:19.180+0000 7f0522000700 1 --2- 172.21.15.87:0/975107424 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55e715083bc0 0x55e7150faa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:30:19.182 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:19.180+0000 7f052aa00700 1 -- 172.21.15.87:0/975107424 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55e715083bc0 msgr2=0x55e7150faa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:30:19.183 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:19.180+0000 7f052aa00700 1 --2- 172.21.15.87:0/975107424 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55e715083bc0 0x55e7150faa00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:30:19.183 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:19.180+0000 7f052aa00700 1 -- 172.21.15.87:0/975107424 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e7150844e0 msgr2=0x55e71509a4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:30:19.183 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:19.180+0000 7f052aa00700 1 --2- 172.21.15.87:0/975107424 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e7150844e0 0x55e71509a4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:30:19.183 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:19.180+0000 7f052aa00700 1 -- 172.21.15.87:0/975107424 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e71509aba0 con 0x55e71507e8f0 2024-05-08T05:30:19.185 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:19.181+0000 7f052aa00700 1 --2- 172.21.15.87:0/975107424 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55e71507e8f0 0x55e7150fa4c0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f051c00d010 tx=0x7f051c005300 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7634d218b2c947b9 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:30:19.185 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:19.181+0000 7f0519600700 10 client.0 ms_handle_connect on v2:172.21.15.160:3300/0 2024-05-08T05:30:19.185 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:19.181+0000 7f0519600700 1 -- 172.21.15.87:0/975107424 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f051c005c60 con 0x55e71507e8f0 2024-05-08T05:30:19.185 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:19.181+0000 7f053c81cb80 1 -- 172.21.15.87:0/975107424 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f051c005e00 con 0x55e71507e8f0 2024-05-08T05:30:19.185 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:19.181+0000 7f0519600700 1 -- 172.21.15.87:0/975107424 <== mon.1 v2:172.21.15.160:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8190+0+0 (secure 0 0 0) 0x7f051c0076b0 con 0x55e71507e8f0 2024-05-08T05:30:19.185 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:19.181+0000 7f0519600700 1 -- 172.21.15.87:0/975107424 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f051c0078f0 con 0x55e71507e8f0 2024-05-08T05:30:19.185 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:19.181+0000 7f053c81cb80 10 client.25153 fetch_fsmap learned FSMap version 25 2024-05-08T05:30:19.186 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:19.181+0000 7f053c81cb80 1 -- 172.21.15.87:0/975107424 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55e715101cf0 con 0x55e71507e8f0 2024-05-08T05:30:19.186 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:19.182+0000 7f0519600700 1 -- 172.21.15.87:0/975107424 <== mon.1 v2:172.21.15.160:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f051c005e00 con 0x55e71507e8f0 2024-05-08T05:30:19.186 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:19.182+0000 7f0519600700 1 -- 172.21.15.87:0/975107424 <== mon.1 v2:172.21.15.160:3300/0 5 ==== fsmap(e 25) ==== 8338+0+0 (secure 0 0 0) 0x7f051c011040 con 0x55e71507e8f0 2024-05-08T05:30:19.186 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:19.182+0000 7f053c81cb80 10 client.25153 fetch_fsmap finished waiting for FSMap version 25 2024-05-08T05:30:19.186 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:19.182+0000 7f053c81cb80 10 client.25153 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.i 2024-05-08T05:30:19.186 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:19.182+0000 7f053c81cb80 20 client.25153 populate_metadata read hostname 'smithi087' 2024-05-08T05:30:19.186 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:19.182+0000 7f053c81cb80 1 --2- 172.21.15.87:0/975107424 >> [v2:172.21.15.160:6838/234657686,v1:172.21.15.160:6839/234657686] conn(0x55e715102330 0x55e715104750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:30:19.186 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:19.182+0000 7f053c81cb80 4 client.25153 mds_command: new command op to 24481 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-05-08T05:30:19.186 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:19.182+0000 7f053c81cb80 1 -- 172.21.15.87:0/975107424 --> [v2:172.21.15.160:6838/234657686,v1:172.21.15.160:6839/234657686] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55e714fde400 con 0x55e715102330 2024-05-08T05:30:19.186 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:19.182+0000 7f0522000700 1 --2- 172.21.15.87:0/975107424 >> [v2:172.21.15.160:6838/234657686,v1:172.21.15.160:6839/234657686] conn(0x55e715102330 0x55e715104750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:30:19.186 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:19.183+0000 7f0522000700 1 --2- 172.21.15.87:0/975107424 >> [v2:172.21.15.160:6838/234657686,v1:172.21.15.160:6839/234657686] conn(0x55e715102330 0x55e715104750 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=748e2e57f2d22d3d server_cookie=b6c2f069956243a7 in_seq=0 out_seq=0 2024-05-08T05:30:19.186 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:19.183+0000 7f0519600700 10 client.25153 ms_handle_connect on v2:172.21.15.160:6838/234657686 2024-05-08T05:30:19.186 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:19.183+0000 7f0519600700 1 -- 172.21.15.87:0/975107424 <== mds.2 v2:172.21.15.160:6838/234657686 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55e714fde400 con 0x55e715102330 2024-05-08T05:30:19.187 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:19.183+0000 7f0519600700 10 client.25153 handle_command_reply: tid=0 2024-05-08T05:30:19.187 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:19.183+0000 7f053c81cb80 1 client.25153 shutdown 2024-05-08T05:30:19.187 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:19.183+0000 7f053c81cb80 1 -- 172.21.15.87:0/975107424 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55e71507e8f0 msgr2=0x55e7150fa4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:30:19.187 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:19.183+0000 7f053c81cb80 1 --2- 172.21.15.87:0/975107424 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55e71507e8f0 0x55e7150fa4c0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f051c00d010 tx=0x7f051c005300 comp rx=0 tx=0).stop 2024-05-08T05:30:19.187 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:19.183+0000 7f053c81cb80 1 -- 172.21.15.87:0/975107424 shutdown_connections 2024-05-08T05:30:19.187 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:19.183+0000 7f053c81cb80 1 --2- 172.21.15.87:0/975107424 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e7150844e0 0x55e71509a4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:30:19.187 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:19.183+0000 7f053c81cb80 1 --2- 172.21.15.87:0/975107424 >> [v2:172.21.15.160:6838/234657686,v1:172.21.15.160:6839/234657686] conn(0x55e715102330 0x55e715104750 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:30:19.187 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:19.183+0000 7f053c81cb80 1 --2- 172.21.15.87:0/975107424 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55e71507e8f0 0x55e7150fa4c0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:30:19.187 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:19.183+0000 7f053c81cb80 1 --2- 172.21.15.87:0/975107424 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55e715083bc0 0x55e7150faa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:30:19.187 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:19.183+0000 7f053c81cb80 1 -- 172.21.15.87:0/975107424 >> 172.21.15.87:0/975107424 conn(0x55e714ff66d0 msgr2=0x55e715082f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:30:19.187 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:19.183+0000 7f0519600700 0 client.25153 ms_handle_reset on v2:172.21.15.160:6838/234657686 2024-05-08T05:30:19.187 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:19.184+0000 7f053c81cb80 1 -- 172.21.15.87:0/975107424 shutdown_connections 2024-05-08T05:30:19.187 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:19.184+0000 7f053c81cb80 1 -- 172.21.15.87:0/975107424 wait complete. 2024-05-08T05:30:19.187 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:19.184+0000 7f053c81cb80 20 client.25153 trim_cache size 0 max 16384 2024-05-08T05:30:19.188 INFO:teuthology.orchestra.run.smithi087.stdout:[] 2024-05-08T05:30:19.188 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:19.184+0000 7f0531e00700 1 -- 172.21.15.87:0/1252791755 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f05100b2900 msgr2=0x7f05100b4dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:30:19.189 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:19.184+0000 7f0531e00700 1 --2- 172.21.15.87:0/1252791755 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f05100b2900 0x7f05100b4dc0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f0524009670 tx=0x7f0524009260 comp rx=0 tx=0).stop 2024-05-08T05:30:19.189 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:19.184+0000 7f0531e00700 1 -- 172.21.15.87:0/1252791755 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f052c075ff0 msgr2=0x7f052c19c290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:30:19.189 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:19.184+0000 7f0531e00700 1 --2- 172.21.15.87:0/1252791755 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f052c075ff0 0x7f052c19c290 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f051400e9c0 tx=0x7f051400ecd0 comp rx=0 tx=0).stop 2024-05-08T05:30:19.189 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:19.184+0000 7f0531e00700 1 -- 172.21.15.87:0/1252791755 shutdown_connections 2024-05-08T05:30:19.189 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:19.184+0000 7f0531e00700 1 --2- 172.21.15.87:0/1252791755 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f052c10fea0 0x7f052c1a0620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:30:19.189 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:19.184+0000 7f0531e00700 1 --2- 172.21.15.87:0/1252791755 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f052c0756d0 0x7f052c19bd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:30:19.189 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:19.184+0000 7f0531e00700 1 --2- 172.21.15.87:0/1252791755 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f05100b2900 0x7f05100b4dc0 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:30:19.189 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:19.184+0000 7f0531e00700 1 --2- 172.21.15.87:0/1252791755 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f052c075ff0 0x7f052c19c290 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:30:19.189 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:19.185+0000 7f0531e00700 1 -- 172.21.15.87:0/1252791755 >> 172.21.15.87:0/1252791755 conn(0x7f052c07a600 msgr2=0x7f052c100630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:30:19.189 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:19.185+0000 7f0531e00700 1 -- 172.21.15.87:0/1252791755 shutdown_connections 2024-05-08T05:30:19.189 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:19.185+0000 7f0531e00700 1 -- 172.21.15.87:0/1252791755 wait complete. 2024-05-08T05:30:20.100 DEBUG:teuthology.orchestra.run.smithi087:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid eeeb813e-0cf9-11ef-bc97-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-05-08T05:30:20.549 INFO:teuthology.orchestra.run.smithi087.stderr:Inferring config /var/lib/ceph/eeeb813e-0cf9-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T05:30:20.947 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:30:20 smithi087 ceph-mon[29523]: pgmap v460: 97 pgs: 97 active+clean; 661 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 597 B/s wr, 7 op/s 2024-05-08T05:30:20.983 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:30:20 smithi090 ceph-mon[34526]: pgmap v460: 97 pgs: 97 active+clean; 661 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 597 B/s wr, 7 op/s 2024-05-08T05:30:21.038 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:30:20 smithi160 ceph-mon[34827]: pgmap v460: 97 pgs: 97 active+clean; 661 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 597 B/s wr, 7 op/s 2024-05-08T05:30:22.657 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:22.655+0000 7f2802200700 1 -- 172.21.15.87:0/1429553250 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f27fc1055c0 msgr2=0x7f27fc105a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:30:22.657 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:22.655+0000 7f2802200700 1 --2- 172.21.15.87:0/1429553250 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f27fc1055c0 0x7f27fc105a40 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f27e8009990 tx=0x7f27e8009ca0 comp rx=0 tx=0).stop 2024-05-08T05:30:22.657 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:22.655+0000 7f2802200700 1 -- 172.21.15.87:0/1429553250 shutdown_connections 2024-05-08T05:30:22.657 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:22.655+0000 7f2802200700 1 --2- 172.21.15.87:0/1429553250 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f27fc105f80 0x7f27fc112490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:30:22.657 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:22.655+0000 7f2802200700 1 --2- 172.21.15.87:0/1429553250 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f27fc10b650 0x7f27fc10ba30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:30:22.658 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:22.655+0000 7f2802200700 1 --2- 172.21.15.87:0/1429553250 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f27fc1055c0 0x7f27fc105a40 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:30:22.658 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:22.655+0000 7f2802200700 1 -- 172.21.15.87:0/1429553250 >> 172.21.15.87:0/1429553250 conn(0x7f27fc101090 msgr2=0x7f27fc1034b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:30:22.658 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:22.655+0000 7f2802200700 1 -- 172.21.15.87:0/1429553250 shutdown_connections 2024-05-08T05:30:22.658 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:22.656+0000 7f2802200700 1 -- 172.21.15.87:0/1429553250 wait complete. 2024-05-08T05:30:22.659 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:22.656+0000 7f2802200700 1 Processor -- start 2024-05-08T05:30:22.659 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:22.657+0000 7f2802200700 1 -- start start 2024-05-08T05:30:22.659 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:22.657+0000 7f2802200700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f27fc1055c0 0x7f27fc1a18d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:30:22.660 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:22.657+0000 7f2802200700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f27fc105f80 0x7f27fc1a1e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:30:22.660 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:22.657+0000 7f2802200700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f27fc10b650 0x7f27fc19ba90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:30:22.660 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:22.657+0000 7f2802200700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f27fc1157f0 con 0x7f27fc10b650 2024-05-08T05:30:22.660 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:22.657+0000 7f2802200700 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f27fc115670 con 0x7f27fc105f80 2024-05-08T05:30:22.660 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:22.657+0000 7f2802200700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f27fc115970 con 0x7f27fc1055c0 2024-05-08T05:30:22.660 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:22.657+0000 7f2801800700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f27fc10b650 0x7f27fc19ba90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:30:22.660 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:22.657+0000 7f27fbe00700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f27fc105f80 0x7f27fc1a1e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:30:22.660 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:22.657+0000 7f27fbe00700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f27fc105f80 0x7f27fc1a1e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.87:40280/0 (socket says 172.21.15.87:40280) 2024-05-08T05:30:22.660 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:22.657+0000 7f27fbe00700 1 -- 172.21.15.87:0/3280442242 learned_addr learned my addr 172.21.15.87:0/3280442242 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T05:30:22.660 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:22.658+0000 7f2800e00700 1 --2- 172.21.15.87:0/3280442242 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f27fc1055c0 0x7f27fc1a18d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:30:22.661 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:22.658+0000 7f2801800700 1 -- 172.21.15.87:0/3280442242 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f27fc1055c0 msgr2=0x7f27fc1a18d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:30:22.661 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:22.658+0000 7f2801800700 1 --2- 172.21.15.87:0/3280442242 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f27fc1055c0 0x7f27fc1a18d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:30:22.661 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:22.658+0000 7f2801800700 1 -- 172.21.15.87:0/3280442242 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f27fc105f80 msgr2=0x7f27fc1a1e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:30:22.661 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:22.658+0000 7f2801800700 1 --2- 172.21.15.87:0/3280442242 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f27fc105f80 0x7f27fc1a1e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:30:22.661 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:22.658+0000 7f2801800700 1 -- 172.21.15.87:0/3280442242 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f27fc19c1f0 con 0x7f27fc10b650 2024-05-08T05:30:22.661 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:22.658+0000 7f27fbe00700 1 --2- 172.21.15.87:0/3280442242 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f27fc105f80 0x7f27fc1a1e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T05:30:22.661 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:22.658+0000 7f2801800700 1 --2- 172.21.15.87:0/3280442242 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f27fc10b650 0x7f27fc19ba90 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f27f400efc0 tx=0x7f27f400c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:30:22.661 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:22.658+0000 7f27f9600700 1 -- 172.21.15.87:0/3280442242 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27f40092e0 con 0x7f27fc10b650 2024-05-08T05:30:22.662 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:22.659+0000 7f27f9600700 1 -- 172.21.15.87:0/3280442242 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f27f4004bb0 con 0x7f27fc10b650 2024-05-08T05:30:22.662 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:22.659+0000 7f27f9600700 1 -- 172.21.15.87:0/3280442242 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27f4004020 con 0x7f27fc10b650 2024-05-08T05:30:22.662 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:22.659+0000 7f2802200700 1 -- 172.21.15.87:0/3280442242 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f27fc19c480 con 0x7f27fc10b650 2024-05-08T05:30:22.662 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:22.659+0000 7f2802200700 1 -- 172.21.15.87:0/3280442242 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f27fc1a87a0 con 0x7f27fc10b650 2024-05-08T05:30:22.664 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:22.662+0000 7f27f9600700 1 -- 172.21.15.87:0/3280442242 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7f27f401b030 con 0x7f27fc10b650 2024-05-08T05:30:22.666 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:22.664+0000 7f280e1f9b80 1 Processor -- start 2024-05-08T05:30:22.666 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:22.664+0000 7f280e1f9b80 1 -- start start 2024-05-08T05:30:22.667 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:22.665+0000 7f280e1f9b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55b24c9c99e0 0x55b24c9c9dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:30:22.667 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:22.665+0000 7f280e1f9b80 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55b24c9ca300 0x55b24c9c3fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:30:22.667 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:22.665+0000 7f280e1f9b80 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55b24c9c4600 0x55b24c9c4a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:30:22.667 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:22.665+0000 7f280e1f9b80 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x55b24c916a20 con 0x55b24c9ca300 2024-05-08T05:30:22.667 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:22.665+0000 7f280e1f9b80 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x55b24c8b4760 con 0x55b24c9c4600 2024-05-08T05:30:22.667 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:22.665+0000 7f280e1f9b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x55b24c9129e0 con 0x55b24c9c99e0 2024-05-08T05:30:22.667 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:22.665+0000 7f27f9600700 1 --2- 172.21.15.87:0/3280442242 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f27e40b2880 0x7f27e40b4d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:30:22.667 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:22.665+0000 7f27f9600700 1 -- 172.21.15.87:0/3280442242 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8190+0+0 (secure 0 0 0) 0x7f27f40e1d20 con 0x7f27fc10b650 2024-05-08T05:30:22.667 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:22.665+0000 7f2801800700 1 --2- 172.21.15.87:0/3280442242 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f27e40b2880 0x7f27e40b4d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:30:22.667 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:22.665+0000 7f27fbe00700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55b24c9c99e0 0x55b24c9c9dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:30:22.668 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:22.665+0000 7f27fbe00700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55b24c9c99e0 0x55b24c9c9dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.87:37316/0 (socket says 172.21.15.87:37316) 2024-05-08T05:30:22.668 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:22.666+0000 7f27fbe00700 1 -- 172.21.15.87:0/2958457522 learned_addr learned my addr 172.21.15.87:0/2958457522 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T05:30:22.668 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:22.666+0000 7f27fbe00700 1 --2- 172.21.15.87:0/2958457522 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55b24c9c4600 0x55b24c9c4a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:30:22.668 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:22.666+0000 7f2800e00700 1 --2- 172.21.15.87:0/2958457522 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55b24c9ca300 0x55b24c9c3fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:30:22.669 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:22.666+0000 7f27fbe00700 1 -- 172.21.15.87:0/2958457522 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55b24c9c99e0 msgr2=0x55b24c9c9dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:30:22.669 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:22.666+0000 7f27fbe00700 1 --2- 172.21.15.87:0/2958457522 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55b24c9c99e0 0x55b24c9c9dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:30:22.669 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:22.666+0000 7f27fbe00700 1 -- 172.21.15.87:0/2958457522 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55b24c9ca300 msgr2=0x55b24c9c3fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:30:22.669 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:22.666+0000 7f27fbe00700 1 --2- 172.21.15.87:0/2958457522 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55b24c9ca300 0x55b24c9c3fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:30:22.670 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:22.666+0000 7f27fbe00700 1 -- 172.21.15.87:0/2958457522 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b24c8638d0 con 0x55b24c9c4600 2024-05-08T05:30:22.670 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:22.666+0000 7f27fbe00700 1 --2- 172.21.15.87:0/2958457522 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55b24c9c4600 0x55b24c9c4a80 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f27e800bf70 tx=0x7f27e800b280 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4b3129ce649c14eb server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:30:22.670 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:22.666+0000 7f2801800700 1 --2- 172.21.15.87:0/3280442242 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f27e40b2880 0x7f27e40b4d40 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f27f40a90a0 tx=0x7f27f4009040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:30:22.670 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:22.667+0000 7f27ee000700 1 -- 172.21.15.87:0/2958457522 <== mon.2 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27e8003b90 con 0x55b24c9c4600 2024-05-08T05:30:22.670 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:22.667+0000 7f27ee000700 1 -- 172.21.15.87:0/2958457522 <== mon.2 v2:172.21.15.90:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f27e8003d30 con 0x55b24c9c4600 2024-05-08T05:30:22.670 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:22.667+0000 7f27ee000700 1 -- 172.21.15.87:0/2958457522 <== mon.2 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27e800f950 con 0x55b24c9c4600 2024-05-08T05:30:22.670 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:22.668+0000 7f280e1f9b80 1 -- 172.21.15.87:0/2958457522 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55b24c9c4600 msgr2=0x55b24c9c4a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:30:22.670 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:22.668+0000 7f280e1f9b80 1 --2- 172.21.15.87:0/2958457522 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55b24c9c4600 0x55b24c9c4a80 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f27e800bf70 tx=0x7f27e800b280 comp rx=0 tx=0).stop 2024-05-08T05:30:22.670 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:22.668+0000 7f280e1f9b80 1 -- 172.21.15.87:0/2958457522 shutdown_connections 2024-05-08T05:30:22.670 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:22.668+0000 7f280e1f9b80 1 --2- 172.21.15.87:0/2958457522 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55b24c9c4600 0x55b24c9c4a80 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:30:22.670 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:22.668+0000 7f280e1f9b80 1 --2- 172.21.15.87:0/2958457522 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55b24c9c99e0 0x55b24c9c9dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:30:22.670 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:22.668+0000 7f280e1f9b80 1 --2- 172.21.15.87:0/2958457522 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55b24c9ca300 0x55b24c9c3fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:30:22.671 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:22.668+0000 7f280e1f9b80 1 -- 172.21.15.87:0/2958457522 >> 172.21.15.87:0/2958457522 conn(0x55b24c8f2b60 msgr2=0x55b24c9be9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:30:22.671 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:22.668+0000 7f280e1f9b80 1 -- 172.21.15.87:0/2958457522 shutdown_connections 2024-05-08T05:30:22.671 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:22.668+0000 7f280e1f9b80 1 -- 172.21.15.87:0/2958457522 wait complete. 2024-05-08T05:30:22.673 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:22.669+0000 7f280e1f9b80 1 -- start start 2024-05-08T05:30:22.673 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:22.669+0000 7f280e1f9b80 1 Processor -- start 2024-05-08T05:30:22.673 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:22.669+0000 7f280e1f9b80 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55b24c9c4600 0x55b24c9cff70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:30:22.673 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:22.669+0000 7f280e1f9b80 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55b24c9c99e0 0x55b24c9cd310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:30:22.673 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:22.669+0000 7f280e1f9b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55b24c9ca300 0x55b24c9cd850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:30:22.673 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:22.669+0000 7f280e1f9b80 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x55b24c9d0d50 con 0x55b24c9c4600 2024-05-08T05:30:22.673 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:22.669+0000 7f280e1f9b80 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x55b24c87cb20 con 0x55b24c9c99e0 2024-05-08T05:30:22.673 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:22.669+0000 7f280e1f9b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x55b24c9d0ed0 con 0x55b24c9ca300 2024-05-08T05:30:22.673 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:22.669+0000 7f280e1f9b80 10 client.0 _ll_register_callbacks cb 0x55b24c8bdc70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T05:30:22.673 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:22.670+0000 7f27fbe00700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55b24c9c4600 0x55b24c9cff70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:30:22.674 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:22.670+0000 7f27fbe00700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55b24c9c4600 0x55b24c9cff70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:60622/0 (socket says 172.21.15.87:60622) 2024-05-08T05:30:22.674 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:22.670+0000 7f27fbe00700 1 -- 172.21.15.87:0/3864334681 learned_addr learned my addr 172.21.15.87:0/3864334681 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T05:30:22.674 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:22.670+0000 7f2800e00700 1 --2- 172.21.15.87:0/3864334681 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55b24c9c99e0 0x55b24c9cd310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:30:22.674 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:22.670+0000 7f27fbe00700 1 --2- 172.21.15.87:0/3864334681 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55b24c9ca300 0x55b24c9cd850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:30:22.674 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:22.670+0000 7f2800e00700 1 -- 172.21.15.87:0/3864334681 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55b24c9ca300 msgr2=0x55b24c9cd850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:30:22.674 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:22.670+0000 7f2800e00700 1 --2- 172.21.15.87:0/3864334681 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55b24c9ca300 0x55b24c9cd850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:30:22.674 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:22.670+0000 7f2800e00700 1 -- 172.21.15.87:0/3864334681 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55b24c9c4600 msgr2=0x55b24c9cff70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:30:22.674 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:22.670+0000 7f2800e00700 1 --2- 172.21.15.87:0/3864334681 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55b24c9c4600 0x55b24c9cff70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:30:22.674 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:22.670+0000 7f2800e00700 1 -- 172.21.15.87:0/3864334681 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b24c8dc420 con 0x55b24c9c99e0 2024-05-08T05:30:22.674 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:22.670+0000 7f27fbe00700 1 --2- 172.21.15.87:0/3864334681 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55b24c9c4600 0x55b24c9cff70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T05:30:22.674 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:22.670+0000 7f2800e00700 1 --2- 172.21.15.87:0/3864334681 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55b24c9c99e0 0x55b24c9cd310 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f27fc106700 tx=0x7f27f0012a20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a634dea299383a26 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:30:22.674 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:22.670+0000 7f27e2a00700 10 client.0 ms_handle_connect on v2:172.21.15.90:3300/0 2024-05-08T05:30:22.674 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:22.671+0000 7f27e2a00700 1 -- 172.21.15.87:0/3864334681 <== mon.2 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27f0004020 con 0x55b24c9c99e0 2024-05-08T05:30:22.674 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:22.671+0000 7f27e2a00700 1 -- 172.21.15.87:0/3864334681 <== mon.2 v2:172.21.15.90:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8190+0+0 (secure 0 0 0) 0x7f27f00041c0 con 0x55b24c9c99e0 2024-05-08T05:30:22.675 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:22.671+0000 7f280e1f9b80 1 -- 172.21.15.87:0/3864334681 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f27e8003d30 con 0x55b24c9c99e0 2024-05-08T05:30:22.675 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:22.671+0000 7f27e2a00700 1 -- 172.21.15.87:0/3864334681 <== mon.2 v2:172.21.15.90:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f27f00043c0 con 0x55b24c9c99e0 2024-05-08T05:30:22.675 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:22.671+0000 7f280e1f9b80 10 client.25163 fetch_fsmap learned FSMap version 25 2024-05-08T05:30:22.675 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:22.671+0000 7f280e1f9b80 1 -- 172.21.15.87:0/3864334681 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55b24c9db580 con 0x55b24c9c99e0 2024-05-08T05:30:22.675 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:22.671+0000 7f27e2a00700 1 -- 172.21.15.87:0/3864334681 <== mon.2 v2:172.21.15.90:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f27e8003d30 con 0x55b24c9c99e0 2024-05-08T05:30:22.675 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:22.672+0000 7f27e2a00700 1 -- 172.21.15.87:0/3864334681 <== mon.2 v2:172.21.15.90:3300/0 5 ==== fsmap(e 25) ==== 8338+0+0 (secure 0 0 0) 0x7f27f000f740 con 0x55b24c9c99e0 2024-05-08T05:30:22.675 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:22.672+0000 7f280e1f9b80 10 client.25163 fetch_fsmap finished waiting for FSMap version 25 2024-05-08T05:30:22.675 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:22.672+0000 7f280e1f9b80 10 client.25163 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.g 2024-05-08T05:30:22.675 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:22.672+0000 7f280e1f9b80 20 client.25163 populate_metadata read hostname 'smithi087' 2024-05-08T05:30:22.675 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:22.672+0000 7f280e1f9b80 1 --2- 172.21.15.87:0/3864334681 >> [v2:172.21.15.87:6838/2127215876,v1:172.21.15.87:6839/2127215876] conn(0x55b24c9ddbc0 0x55b24c9dffb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:30:22.675 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:22.672+0000 7f280e1f9b80 4 client.25163 mds_command: new command op to 24482 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-08T05:30:22.675 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:22.672+0000 7f280e1f9b80 1 -- 172.21.15.87:0/3864334681 --> [v2:172.21.15.87:6838/2127215876,v1:172.21.15.87:6839/2127215876] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b24c9910a0 con 0x55b24c9ddbc0 2024-05-08T05:30:22.676 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:22.672+0000 7f27fbe00700 1 --2- 172.21.15.87:0/3864334681 >> [v2:172.21.15.87:6838/2127215876,v1:172.21.15.87:6839/2127215876] conn(0x55b24c9ddbc0 0x55b24c9dffb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:30:22.676 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:22.673+0000 7f27fbe00700 1 --2- 172.21.15.87:0/3864334681 >> [v2:172.21.15.87:6838/2127215876,v1:172.21.15.87:6839/2127215876] conn(0x55b24c9ddbc0 0x55b24c9dffb0 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=b55dffd7871a0205 server_cookie=e2e7c83e327da5b in_seq=0 out_seq=0 2024-05-08T05:30:22.677 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:22.673+0000 7f27e2a00700 10 client.25163 ms_handle_connect on v2:172.21.15.87:6838/2127215876 2024-05-08T05:30:22.677 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:22.673+0000 7f27e2a00700 1 -- 172.21.15.87:0/3864334681 <== mds.1 v2:172.21.15.87:6838/2127215876 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55b24c9910a0 con 0x55b24c9ddbc0 2024-05-08T05:30:22.677 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:22.673+0000 7f27e2a00700 10 client.25163 handle_command_reply: tid=0 2024-05-08T05:30:22.677 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:22.674+0000 7f280e1f9b80 1 client.25163 shutdown 2024-05-08T05:30:22.677 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:22.674+0000 7f280e1f9b80 1 -- 172.21.15.87:0/3864334681 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55b24c9c99e0 msgr2=0x55b24c9cd310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:30:22.677 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:22.674+0000 7f280e1f9b80 1 --2- 172.21.15.87:0/3864334681 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55b24c9c99e0 0x55b24c9cd310 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f27fc106700 tx=0x7f27f0012a20 comp rx=0 tx=0).stop 2024-05-08T05:30:22.677 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:22.674+0000 7f280e1f9b80 1 -- 172.21.15.87:0/3864334681 shutdown_connections 2024-05-08T05:30:22.677 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:22.674+0000 7f280e1f9b80 1 --2- 172.21.15.87:0/3864334681 >> [v2:172.21.15.87:6838/2127215876,v1:172.21.15.87:6839/2127215876] conn(0x55b24c9ddbc0 0x55b24c9dffb0 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:30:22.677 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:22.674+0000 7f280e1f9b80 1 --2- 172.21.15.87:0/3864334681 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55b24c9ca300 0x55b24c9cd850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:30:22.677 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:22.674+0000 7f280e1f9b80 1 --2- 172.21.15.87:0/3864334681 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55b24c9c4600 0x55b24c9cff70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:30:22.677 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:22.674+0000 7f280e1f9b80 1 --2- 172.21.15.87:0/3864334681 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55b24c9c99e0 0x55b24c9cd310 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:30:22.677 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:22.674+0000 7f27e2a00700 0 client.25163 ms_handle_reset on v2:172.21.15.87:6838/2127215876 2024-05-08T05:30:22.677 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:22.674+0000 7f280e1f9b80 1 -- 172.21.15.87:0/3864334681 >> 172.21.15.87:0/3864334681 conn(0x55b24c8f2b60 msgr2=0x55b24c9b9460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:30:22.677 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:22.674+0000 7f280e1f9b80 1 -- 172.21.15.87:0/3864334681 shutdown_connections 2024-05-08T05:30:22.677 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:22.674+0000 7f280e1f9b80 1 -- 172.21.15.87:0/3864334681 wait complete. 2024-05-08T05:30:22.678 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:22.674+0000 7f280e1f9b80 20 client.25163 trim_cache size 0 max 16384 2024-05-08T05:30:22.692 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:22.691+0000 7f280e1f9b80 1 Processor -- start 2024-05-08T05:30:22.692 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:22.691+0000 7f280e1f9b80 1 -- start start 2024-05-08T05:30:22.693 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:22.691+0000 7f280e1f9b80 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55b24c9c4600 0x55b24c9d9de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:30:22.693 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:22.691+0000 7f280e1f9b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55b24c9c99e0 0x55b24c9c3fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:30:22.694 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:22.691+0000 7f280e1f9b80 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55b24c9ca300 0x55b24c9cbc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:30:22.694 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:22.691+0000 7f280e1f9b80 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f27fc1b2350 con 0x55b24c9ca300 2024-05-08T05:30:22.694 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:22.691+0000 7f280e1f9b80 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f27fc1afbe0 con 0x55b24c9c4600 2024-05-08T05:30:22.694 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:22.691+0000 7f280e1f9b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f27fc1ada50 con 0x55b24c9c99e0 2024-05-08T05:30:22.694 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:22.692+0000 7f2800e00700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55b24c9c99e0 0x55b24c9c3fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:30:22.694 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:22.692+0000 7f2800e00700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55b24c9c99e0 0x55b24c9c3fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.87:37330/0 (socket says 172.21.15.87:37330) 2024-05-08T05:30:22.694 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:22.692+0000 7f2800e00700 1 -- 172.21.15.87:0/2995283143 learned_addr learned my addr 172.21.15.87:0/2995283143 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T05:30:22.694 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:22.692+0000 7f27fbe00700 1 --2- 172.21.15.87:0/2995283143 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55b24c9c4600 0x55b24c9d9de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:30:22.694 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:22.692+0000 7f27fbe00700 1 --2- 172.21.15.87:0/2995283143 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55b24c9ca300 0x55b24c9cbc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:30:22.694 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:22.692+0000 7f2800e00700 1 -- 172.21.15.87:0/2995283143 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55b24c9c4600 msgr2=0x55b24c9d9de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:30:22.694 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:22.692+0000 7f2800e00700 1 --2- 172.21.15.87:0/2995283143 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55b24c9c4600 0x55b24c9d9de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:30:22.694 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:22.692+0000 7f2800e00700 1 -- 172.21.15.87:0/2995283143 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55b24c9ca300 msgr2=0x55b24c9cbc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:30:22.694 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:22.692+0000 7f2800e00700 1 --2- 172.21.15.87:0/2995283143 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55b24c9ca300 0x55b24c9cbc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:30:22.695 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:22.692+0000 7f2800e00700 1 -- 172.21.15.87:0/2995283143 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b24c9bf8a0 con 0x55b24c9c99e0 2024-05-08T05:30:22.695 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:22.692+0000 7f27fbe00700 1 --2- 172.21.15.87:0/2995283143 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55b24c9ca300 0x55b24c9cbc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T05:30:22.697 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:22.693+0000 7f2800e00700 1 --2- 172.21.15.87:0/2995283143 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55b24c9c99e0 0x55b24c9c3fe0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f27f000fb90 tx=0x7f27f000ff90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b13332536b900997 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:30:22.697 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:22.693+0000 7f27ed600700 1 -- 172.21.15.87:0/2995283143 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27f00055f0 con 0x55b24c9c99e0 2024-05-08T05:30:22.697 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:22.693+0000 7f27ed600700 1 -- 172.21.15.87:0/2995283143 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f27f0005790 con 0x55b24c9c99e0 2024-05-08T05:30:22.697 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:22.693+0000 7f27ed600700 1 -- 172.21.15.87:0/2995283143 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27f0010430 con 0x55b24c9c99e0 2024-05-08T05:30:22.697 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:22.694+0000 7f280e1f9b80 1 -- 172.21.15.87:0/2995283143 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55b24c9c99e0 msgr2=0x55b24c9c3fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:30:22.697 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:22.694+0000 7f280e1f9b80 1 --2- 172.21.15.87:0/2995283143 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55b24c9c99e0 0x55b24c9c3fe0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f27f000fb90 tx=0x7f27f000ff90 comp rx=0 tx=0).stop 2024-05-08T05:30:22.697 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:22.694+0000 7f280e1f9b80 1 -- 172.21.15.87:0/2995283143 shutdown_connections 2024-05-08T05:30:22.697 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:22.694+0000 7f280e1f9b80 1 --2- 172.21.15.87:0/2995283143 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55b24c9ca300 0x55b24c9cbc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:30:22.697 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:22.694+0000 7f280e1f9b80 1 --2- 172.21.15.87:0/2995283143 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55b24c9c4600 0x55b24c9d9de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:30:22.697 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:22.694+0000 7f280e1f9b80 1 --2- 172.21.15.87:0/2995283143 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55b24c9c99e0 0x55b24c9c3fe0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:30:22.698 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:22.694+0000 7f280e1f9b80 1 -- 172.21.15.87:0/2995283143 >> 172.21.15.87:0/2995283143 conn(0x55b24c8f2b60 msgr2=0x55b24c9c74f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:30:22.698 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:22.694+0000 7f280e1f9b80 1 -- 172.21.15.87:0/2995283143 shutdown_connections 2024-05-08T05:30:22.698 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:22.694+0000 7f280e1f9b80 1 -- 172.21.15.87:0/2995283143 wait complete. 2024-05-08T05:30:22.698 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:22.694+0000 7f280e1f9b80 1 -- start start 2024-05-08T05:30:22.698 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:22.694+0000 7f280e1f9b80 1 Processor -- start 2024-05-08T05:30:22.698 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:22.695+0000 7f280e1f9b80 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55b24c9c4600 0x55b24c9d6420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:30:22.698 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:22.695+0000 7f280e1f9b80 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55b24c9c99e0 0x55b24c9e4b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:30:22.698 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:22.695+0000 7f280e1f9b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55b24c9ca300 0x55b24c9e50c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:30:22.698 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:22.695+0000 7f280e1f9b80 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f27fc1ae0a0 con 0x55b24c9c99e0 2024-05-08T05:30:22.698 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:22.695+0000 7f280e1f9b80 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f27fc1af510 con 0x55b24c9c4600 2024-05-08T05:30:22.698 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:22.695+0000 7f280e1f9b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f27fc1ae770 con 0x55b24c9ca300 2024-05-08T05:30:22.698 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:22.695+0000 7f280e1f9b80 10 client.0 _ll_register_callbacks cb 0x55b24c8bdc70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T05:30:22.698 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:22.695+0000 7f2800e00700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55b24c9c99e0 0x55b24c9e4b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:30:22.699 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:22.695+0000 7f27fbe00700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55b24c9c4600 0x55b24c9d6420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:30:22.699 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:22.695+0000 7f2800e00700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55b24c9c99e0 0x55b24c9e4b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:60638/0 (socket says 172.21.15.87:60638) 2024-05-08T05:30:22.699 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:22.695+0000 7f2800e00700 1 -- 172.21.15.87:0/91546217 learned_addr learned my addr 172.21.15.87:0/91546217 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T05:30:22.699 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:22.696+0000 7f27fbe00700 1 --2- 172.21.15.87:0/91546217 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55b24c9ca300 0x55b24c9e50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:30:22.702 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:22.696+0000 7f2800e00700 1 -- 172.21.15.87:0/91546217 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55b24c9ca300 msgr2=0x55b24c9e50c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:30:22.702 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:22.696+0000 7f2800e00700 1 --2- 172.21.15.87:0/91546217 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55b24c9ca300 0x55b24c9e50c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:30:22.702 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:22.696+0000 7f2800e00700 1 -- 172.21.15.87:0/91546217 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55b24c9c4600 msgr2=0x55b24c9d6420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:30:22.702 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:22.696+0000 7f2800e00700 1 --2- 172.21.15.87:0/91546217 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55b24c9c4600 0x55b24c9d6420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:30:22.702 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:22.696+0000 7f2800e00700 1 -- 172.21.15.87:0/91546217 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b24c9e5630 con 0x55b24c9c99e0 2024-05-08T05:30:22.702 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:22.696+0000 7f27fbe00700 1 --2- 172.21.15.87:0/91546217 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55b24c9c4600 0x55b24c9d6420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T05:30:22.702 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:22.696+0000 7f2800e00700 1 --2- 172.21.15.87:0/91546217 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55b24c9c99e0 0x55b24c9e4b80 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f27f0012f20 tx=0x7f27f0009370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6fb787a2b577174f server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:30:22.702 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:22.696+0000 7f27e2a00700 10 client.0 ms_handle_connect on v2:172.21.15.87:3300/0 2024-05-08T05:30:22.702 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:22.696+0000 7f27e2a00700 1 -- 172.21.15.87:0/91546217 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27f001c6f0 con 0x55b24c9c99e0 2024-05-08T05:30:22.702 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:22.696+0000 7f280e1f9b80 1 -- 172.21.15.87:0/91546217 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f27f0005790 con 0x55b24c9c99e0 2024-05-08T05:30:22.703 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:22.696+0000 7f27e2a00700 1 -- 172.21.15.87:0/91546217 <== mon.0 v2:172.21.15.87:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8190+0+0 (secure 0 0 0) 0x7f27f001c890 con 0x55b24c9c99e0 2024-05-08T05:30:22.703 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:22.697+0000 7f27e2a00700 1 -- 172.21.15.87:0/91546217 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f27f001ca90 con 0x55b24c9c99e0 2024-05-08T05:30:22.703 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:22.697+0000 7f280e1f9b80 10 client.15066 fetch_fsmap learned FSMap version 25 2024-05-08T05:30:22.703 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:22.697+0000 7f280e1f9b80 1 -- 172.21.15.87:0/91546217 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55b24ca508e0 con 0x55b24c9c99e0 2024-05-08T05:30:22.703 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:22.697+0000 7f27e2a00700 1 -- 172.21.15.87:0/91546217 <== mon.0 v2:172.21.15.87:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f27f0005790 con 0x55b24c9c99e0 2024-05-08T05:30:22.703 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:22.697+0000 7f27e2a00700 1 -- 172.21.15.87:0/91546217 <== mon.0 v2:172.21.15.87:3300/0 5 ==== fsmap(e 25) ==== 8338+0+0 (secure 0 0 0) 0x7f27f003a430 con 0x55b24c9c99e0 2024-05-08T05:30:22.703 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:22.697+0000 7f280e1f9b80 10 client.15066 fetch_fsmap finished waiting for FSMap version 25 2024-05-08T05:30:22.703 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:22.697+0000 7f280e1f9b80 10 client.15066 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.g 2024-05-08T05:30:22.703 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:22.697+0000 7f280e1f9b80 20 client.15066 populate_metadata read hostname 'smithi087' 2024-05-08T05:30:22.703 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:22.697+0000 7f280e1f9b80 1 --2- 172.21.15.87:0/91546217 >> [v2:172.21.15.87:6838/2127215876,v1:172.21.15.87:6839/2127215876] conn(0x55b24ca50ea0 0x55b24ca53290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:30:22.703 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:22.697+0000 7f280e1f9b80 4 client.15066 mds_command: new command op to 24482 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-05-08T05:30:22.703 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:22.697+0000 7f280e1f9b80 1 -- 172.21.15.87:0/91546217 --> [v2:172.21.15.87:6838/2127215876,v1:172.21.15.87:6839/2127215876] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55b24c924400 con 0x55b24ca50ea0 2024-05-08T05:30:22.703 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:22.698+0000 7f27fbe00700 1 --2- 172.21.15.87:0/91546217 >> [v2:172.21.15.87:6838/2127215876,v1:172.21.15.87:6839/2127215876] conn(0x55b24ca50ea0 0x55b24ca53290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:30:22.703 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:22.698+0000 7f27fbe00700 1 --2- 172.21.15.87:0/91546217 >> [v2:172.21.15.87:6838/2127215876,v1:172.21.15.87:6839/2127215876] conn(0x55b24ca50ea0 0x55b24ca53290 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=85a53ea130d2d22b server_cookie=3e7f494eb34f613e in_seq=0 out_seq=0 2024-05-08T05:30:22.703 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:22.698+0000 7f27e2a00700 10 client.15066 ms_handle_connect on v2:172.21.15.87:6838/2127215876 2024-05-08T05:30:22.703 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:22.698+0000 7f27e2a00700 1 -- 172.21.15.87:0/91546217 <== mds.1 v2:172.21.15.87:6838/2127215876 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55b24c924400 con 0x55b24ca50ea0 2024-05-08T05:30:22.704 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:22.698+0000 7f27e2a00700 10 client.15066 handle_command_reply: tid=0 2024-05-08T05:30:22.704 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:22.698+0000 7f280e1f9b80 1 client.15066 shutdown 2024-05-08T05:30:22.704 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:22.699+0000 7f280e1f9b80 1 -- 172.21.15.87:0/91546217 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55b24c9c99e0 msgr2=0x55b24c9e4b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:30:22.704 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:22.699+0000 7f280e1f9b80 1 --2- 172.21.15.87:0/91546217 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55b24c9c99e0 0x55b24c9e4b80 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f27f0012f20 tx=0x7f27f0009370 comp rx=0 tx=0).stop 2024-05-08T05:30:22.704 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:22.699+0000 7f280e1f9b80 1 -- 172.21.15.87:0/91546217 shutdown_connections 2024-05-08T05:30:22.704 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:22.699+0000 7f280e1f9b80 1 --2- 172.21.15.87:0/91546217 >> [v2:172.21.15.87:6838/2127215876,v1:172.21.15.87:6839/2127215876] conn(0x55b24ca50ea0 0x55b24ca53290 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:30:22.704 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:22.699+0000 7f280e1f9b80 1 --2- 172.21.15.87:0/91546217 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55b24c9ca300 0x55b24c9e50c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:30:22.704 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:22.699+0000 7f280e1f9b80 1 --2- 172.21.15.87:0/91546217 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55b24c9c4600 0x55b24c9d6420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:30:22.704 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:22.699+0000 7f280e1f9b80 1 --2- 172.21.15.87:0/91546217 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55b24c9c99e0 0x55b24c9e4b80 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:30:22.704 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:22.699+0000 7f280e1f9b80 1 -- 172.21.15.87:0/91546217 >> 172.21.15.87:0/91546217 conn(0x55b24c8f2b60 msgr2=0x55b24c9ca6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:30:22.704 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:22.699+0000 7f27e2a00700 0 client.15066 ms_handle_reset on v2:172.21.15.87:6838/2127215876 2024-05-08T05:30:22.704 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:22.699+0000 7f280e1f9b80 1 -- 172.21.15.87:0/91546217 shutdown_connections 2024-05-08T05:30:22.704 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:22.699+0000 7f280e1f9b80 1 -- 172.21.15.87:0/91546217 wait complete. 2024-05-08T05:30:22.704 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:22.699+0000 7f280e1f9b80 20 client.15066 trim_cache size 0 max 16384 2024-05-08T05:30:22.705 INFO:teuthology.orchestra.run.smithi087.stdout:[] 2024-05-08T05:30:22.705 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:22.700+0000 7f2802200700 1 -- 172.21.15.87:0/3280442242 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f27e40b2880 msgr2=0x7f27e40b4d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:30:22.705 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:22.700+0000 7f2802200700 1 --2- 172.21.15.87:0/3280442242 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f27e40b2880 0x7f27e40b4d40 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f27f40a90a0 tx=0x7f27f4009040 comp rx=0 tx=0).stop 2024-05-08T05:30:22.705 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:22.700+0000 7f2802200700 1 -- 172.21.15.87:0/3280442242 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f27fc10b650 msgr2=0x7f27fc19ba90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:30:22.706 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:22.700+0000 7f2802200700 1 --2- 172.21.15.87:0/3280442242 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f27fc10b650 0x7f27fc19ba90 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f27f400efc0 tx=0x7f27f400c3a0 comp rx=0 tx=0).stop 2024-05-08T05:30:22.706 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:22.700+0000 7f2802200700 1 -- 172.21.15.87:0/3280442242 shutdown_connections 2024-05-08T05:30:22.706 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:22.700+0000 7f2802200700 1 --2- 172.21.15.87:0/3280442242 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f27fc10b650 0x7f27fc19ba90 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:30:22.706 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:22.700+0000 7f2802200700 1 --2- 172.21.15.87:0/3280442242 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f27e40b2880 0x7f27e40b4d40 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:30:22.706 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:22.700+0000 7f2802200700 1 --2- 172.21.15.87:0/3280442242 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f27fc1055c0 0x7f27fc1a18d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:30:22.706 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:22.700+0000 7f2802200700 1 --2- 172.21.15.87:0/3280442242 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f27fc105f80 0x7f27fc1a1e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:30:22.706 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:22.700+0000 7f2802200700 1 -- 172.21.15.87:0/3280442242 >> 172.21.15.87:0/3280442242 conn(0x7f27fc101090 msgr2=0x7f27fc1027d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:30:22.706 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:22.700+0000 7f2802200700 1 -- 172.21.15.87:0/3280442242 shutdown_connections 2024-05-08T05:30:22.706 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:22.700+0000 7f2802200700 1 -- 172.21.15.87:0/3280442242 wait complete. 2024-05-08T05:30:22.958 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:30:22 smithi087 ceph-mon[29523]: pgmap v461: 97 pgs: 97 active+clean; 661 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T05:30:22.983 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:30:22 smithi090 ceph-mon[34526]: pgmap v461: 97 pgs: 97 active+clean; 661 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T05:30:23.038 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:30:22 smithi160 ceph-mon[34827]: pgmap v461: 97 pgs: 97 active+clean; 661 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T05:30:23.556 DEBUG:teuthology.orchestra.run.smithi087:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid eeeb813e-0cf9-11ef-bc97-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-05-08T05:30:24.004 INFO:teuthology.orchestra.run.smithi087.stderr:Inferring config /var/lib/ceph/eeeb813e-0cf9-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T05:30:24.708 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:30:24 smithi087 ceph-mon[29523]: pgmap v462: 97 pgs: 97 active+clean; 661 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-05-08T05:30:24.983 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:30:24 smithi090 ceph-mon[34526]: pgmap v462: 97 pgs: 97 active+clean; 661 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-05-08T05:30:25.038 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:30:24 smithi160 ceph-mon[34827]: pgmap v462: 97 pgs: 97 active+clean; 661 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-05-08T05:30:25.873 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:25.871+0000 7f04b7200700 1 -- 172.21.15.87:0/1154322044 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f04b8103d90 msgr2=0x7f04b81102a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:30:25.873 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:25.871+0000 7f04b7200700 1 --2- 172.21.15.87:0/1154322044 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f04b8103d90 0x7f04b81102a0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f04b000b0a0 tx=0x7f04b000b3b0 comp rx=0 tx=0).stop 2024-05-08T05:30:25.873 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:25.871+0000 7f04b7200700 1 -- 172.21.15.87:0/1154322044 shutdown_connections 2024-05-08T05:30:25.873 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:25.871+0000 7f04b7200700 1 --2- 172.21.15.87:0/1154322044 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f04b8103d90 0x7f04b81102a0 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:30:25.873 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:25.871+0000 7f04b7200700 1 --2- 172.21.15.87:0/1154322044 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f04b8109460 0x7f04b8109840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:30:25.874 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:25.871+0000 7f04b7200700 1 --2- 172.21.15.87:0/1154322044 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f04b81033d0 0x7f04b8103850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:30:25.874 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:25.871+0000 7f04b7200700 1 -- 172.21.15.87:0/1154322044 >> 172.21.15.87:0/1154322044 conn(0x7f04b80fef20 msgr2=0x7f04b8101340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:30:25.874 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:25.871+0000 7f04b7200700 1 -- 172.21.15.87:0/1154322044 shutdown_connections 2024-05-08T05:30:25.874 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:25.871+0000 7f04b7200700 1 -- 172.21.15.87:0/1154322044 wait complete. 2024-05-08T05:30:25.875 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:25.872+0000 7f04b7200700 1 Processor -- start 2024-05-08T05:30:25.876 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:25.872+0000 7f04b7200700 1 -- start start 2024-05-08T05:30:25.876 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:25.873+0000 7f04b7200700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f04b81033d0 0x7f04b81a18c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:30:25.876 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:25.873+0000 7f04b7200700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f04b8103d90 0x7f04b81a1e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:30:25.876 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:25.873+0000 7f04b7200700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f04b8109460 0x7f04b819ba80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:30:25.876 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:25.873+0000 7f04b7200700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f04b81135c0 con 0x7f04b8109460 2024-05-08T05:30:25.876 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:25.873+0000 7f04b7200700 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f04b8113440 con 0x7f04b8103d90 2024-05-08T05:30:25.876 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:25.873+0000 7f04b7200700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f04b8113740 con 0x7f04b81033d0 2024-05-08T05:30:25.876 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:25.873+0000 7f04b5400700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f04b8103d90 0x7f04b81a1e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:30:25.876 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:25.873+0000 7f04b5e00700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f04b81033d0 0x7f04b81a18c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:30:25.876 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:25.873+0000 7f04b5400700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f04b8103d90 0x7f04b81a1e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.87:41312/0 (socket says 172.21.15.87:41312) 2024-05-08T05:30:25.876 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:25.873+0000 7f04b5400700 1 -- 172.21.15.87:0/3616817877 learned_addr learned my addr 172.21.15.87:0/3616817877 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T05:30:25.876 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:25.873+0000 7f04b6800700 1 --2- 172.21.15.87:0/3616817877 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f04b8109460 0x7f04b819ba80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:30:25.876 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:25.874+0000 7f04b5400700 1 -- 172.21.15.87:0/3616817877 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f04b81033d0 msgr2=0x7f04b81a18c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:30:25.876 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:25.874+0000 7f04b5400700 1 --2- 172.21.15.87:0/3616817877 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f04b81033d0 0x7f04b81a18c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:30:25.877 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:25.874+0000 7f04b5400700 1 -- 172.21.15.87:0/3616817877 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f04b8109460 msgr2=0x7f04b819ba80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:30:25.877 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:25.874+0000 7f04b5400700 1 --2- 172.21.15.87:0/3616817877 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f04b8109460 0x7f04b819ba80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:30:25.877 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:25.874+0000 7f04b5400700 1 -- 172.21.15.87:0/3616817877 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f04b819c1e0 con 0x7f04b8103d90 2024-05-08T05:30:25.877 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:25.874+0000 7f04b6800700 1 --2- 172.21.15.87:0/3616817877 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f04b8109460 0x7f04b819ba80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T05:30:25.877 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:25.874+0000 7f04b5400700 1 --2- 172.21.15.87:0/3616817877 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f04b8103d90 0x7f04b81a1e00 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f04a400e9a0 tx=0x7f04a400ecb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:30:25.877 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:25.874+0000 7f04aea00700 1 -- 172.21.15.87:0/3616817877 <== mon.2 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04a400ca10 con 0x7f04b8103d90 2024-05-08T05:30:25.877 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:25.874+0000 7f04b7200700 1 -- 172.21.15.87:0/3616817877 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f04b819c4d0 con 0x7f04b8103d90 2024-05-08T05:30:25.877 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:25.874+0000 7f04aea00700 1 -- 172.21.15.87:0/3616817877 <== mon.2 v2:172.21.15.90:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f04a400cbb0 con 0x7f04b8103d90 2024-05-08T05:30:25.877 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:25.874+0000 7f04aea00700 1 -- 172.21.15.87:0/3616817877 <== mon.2 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04a4018680 con 0x7f04b8103d90 2024-05-08T05:30:25.877 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:25.875+0000 7f04b7200700 1 -- 172.21.15.87:0/3616817877 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f04b81a8790 con 0x7f04b8103d90 2024-05-08T05:30:25.880 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:25.879+0000 7f04aea00700 1 -- 172.21.15.87:0/3616817877 <== mon.2 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7f04a4010430 con 0x7f04b8103d90 2024-05-08T05:30:25.880 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:25.879+0000 7f04c7561b80 1 Processor -- start 2024-05-08T05:30:25.880 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:25.879+0000 7f04c7561b80 1 -- start start 2024-05-08T05:30:25.881 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:25.880+0000 7f04c7561b80 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56250c5e99e0 0x56250c5e9dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:30:25.881 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:25.880+0000 7f04c7561b80 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x56250c5ea300 0x56250c5e3fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:30:25.881 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:25.880+0000 7f04c7561b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x56250c5e4600 0x56250c5e4a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:30:25.881 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:25.880+0000 7f04c7561b80 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x56250c536a20 con 0x56250c5e99e0 2024-05-08T05:30:25.881 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:25.880+0000 7f04c7561b80 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x56250c4d4760 con 0x56250c5ea300 2024-05-08T05:30:25.881 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:25.880+0000 7f04c7561b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x56250c5329e0 con 0x56250c5e4600 2024-05-08T05:30:25.882 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:25.880+0000 7f04b5e00700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x56250c5ea300 0x56250c5e3fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:30:25.882 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:25.880+0000 7f04b6800700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56250c5e99e0 0x56250c5e9dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:30:25.882 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:25.880+0000 7f04b5e00700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x56250c5ea300 0x56250c5e3fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.87:41328/0 (socket says 172.21.15.87:41328) 2024-05-08T05:30:25.883 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:25.880+0000 7f04b5e00700 1 -- 172.21.15.87:0/1872904165 learned_addr learned my addr 172.21.15.87:0/1872904165 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T05:30:25.883 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:25.880+0000 7f04b5400700 1 --2- 172.21.15.87:0/1872904165 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x56250c5e4600 0x56250c5e4a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:30:25.883 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:25.880+0000 7f04aea00700 1 --2- 172.21.15.87:0/3616817877 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f049c0b2880 0x7f049c0b4d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:30:25.883 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:25.881+0000 7f04aea00700 1 -- 172.21.15.87:0/3616817877 <== mon.2 v2:172.21.15.90:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8190+0+0 (secure 0 0 0) 0x7f04a40e2390 con 0x7f04b8103d90 2024-05-08T05:30:25.883 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:25.881+0000 7f04b6800700 1 --2- 172.21.15.87:0/3616817877 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f049c0b2880 0x7f049c0b4d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:30:25.883 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:25.881+0000 7f04b5e00700 1 -- 172.21.15.87:0/1872904165 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x56250c5e4600 msgr2=0x56250c5e4a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:30:25.883 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:25.881+0000 7f04b5e00700 1 --2- 172.21.15.87:0/1872904165 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x56250c5e4600 0x56250c5e4a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:30:25.883 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:25.881+0000 7f04b5e00700 1 -- 172.21.15.87:0/1872904165 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56250c5e99e0 msgr2=0x56250c5e9dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:30:25.883 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:25.881+0000 7f04b5e00700 1 --2- 172.21.15.87:0/1872904165 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56250c5e99e0 0x56250c5e9dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:30:25.883 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:25.881+0000 7f04b5e00700 1 -- 172.21.15.87:0/1872904165 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56250c4838d0 con 0x56250c5ea300 2024-05-08T05:30:25.883 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:25.881+0000 7f04b6800700 1 --2- 172.21.15.87:0/1872904165 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56250c5e99e0 0x56250c5e9dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T05:30:25.884 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:25.882+0000 7f04b5e00700 1 --2- 172.21.15.87:0/1872904165 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x56250c5ea300 0x56250c5e3fe0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f04a8009ca0 tx=0x7f04a8011440 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fac16a27753eb944 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:30:25.884 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:25.882+0000 7f04a3400700 1 -- 172.21.15.87:0/1872904165 <== mon.2 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04a8011d80 con 0x56250c5ea300 2024-05-08T05:30:25.884 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:25.882+0000 7f04a3400700 1 -- 172.21.15.87:0/1872904165 <== mon.2 v2:172.21.15.90:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f04a8004ce0 con 0x56250c5ea300 2024-05-08T05:30:25.884 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:25.882+0000 7f04b6800700 1 --2- 172.21.15.87:0/3616817877 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f049c0b2880 0x7f049c0b4d40 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f04b000b780 tx=0x7f04b000b3b0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:30:25.885 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:25.882+0000 7f04a3400700 1 -- 172.21.15.87:0/1872904165 <== mon.2 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04a8019690 con 0x56250c5ea300 2024-05-08T05:30:25.885 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:25.883+0000 7f04c7561b80 1 -- 172.21.15.87:0/1872904165 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x56250c5ea300 msgr2=0x56250c5e3fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:30:25.885 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:25.883+0000 7f04c7561b80 1 --2- 172.21.15.87:0/1872904165 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x56250c5ea300 0x56250c5e3fe0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f04a8009ca0 tx=0x7f04a8011440 comp rx=0 tx=0).stop 2024-05-08T05:30:25.885 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:25.883+0000 7f04c7561b80 1 -- 172.21.15.87:0/1872904165 shutdown_connections 2024-05-08T05:30:25.885 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:25.883+0000 7f04c7561b80 1 --2- 172.21.15.87:0/1872904165 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x56250c5e4600 0x56250c5e4a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:30:25.885 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:25.883+0000 7f04c7561b80 1 --2- 172.21.15.87:0/1872904165 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56250c5e99e0 0x56250c5e9dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:30:25.885 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:25.883+0000 7f04c7561b80 1 --2- 172.21.15.87:0/1872904165 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x56250c5ea300 0x56250c5e3fe0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:30:25.885 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:25.883+0000 7f04c7561b80 1 -- 172.21.15.87:0/1872904165 >> 172.21.15.87:0/1872904165 conn(0x56250c512b60 msgr2=0x56250c5de9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:30:25.885 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:25.883+0000 7f04c7561b80 1 -- 172.21.15.87:0/1872904165 shutdown_connections 2024-05-08T05:30:25.885 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:25.883+0000 7f04c7561b80 1 -- 172.21.15.87:0/1872904165 wait complete. 2024-05-08T05:30:25.887 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:25.884+0000 7f04c7561b80 1 -- start start 2024-05-08T05:30:25.887 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:25.884+0000 7f04c7561b80 1 Processor -- start 2024-05-08T05:30:25.888 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:25.885+0000 7f04c7561b80 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x56250c5e4600 0x56250c5efe80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:30:25.888 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:25.885+0000 7f04c7561b80 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56250c5e99e0 0x56250c5f03c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:30:25.888 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:25.885+0000 7f04c7561b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x56250c5ea300 0x56250c5ed400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:30:25.888 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:25.885+0000 7f04c7561b80 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x56250c5f0db0 con 0x56250c5e99e0 2024-05-08T05:30:25.888 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:25.885+0000 7f04c7561b80 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x56250c49cb20 con 0x56250c5e4600 2024-05-08T05:30:25.888 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:25.885+0000 7f04c7561b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x56250c5f0f30 con 0x56250c5ea300 2024-05-08T05:30:25.888 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:25.885+0000 7f04c7561b80 10 client.0 _ll_register_callbacks cb 0x56250c4ddc70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T05:30:25.888 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:25.885+0000 7f04b5e00700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x56250c5e4600 0x56250c5efe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:30:25.888 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:25.885+0000 7f04b5400700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56250c5e99e0 0x56250c5f03c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:30:25.888 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:25.885+0000 7f04b5e00700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x56250c5e4600 0x56250c5efe80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.87:41338/0 (socket says 172.21.15.87:41338) 2024-05-08T05:30:25.888 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:25.885+0000 7f04b5400700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56250c5e99e0 0x56250c5f03c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:54232/0 (socket says 172.21.15.87:54232) 2024-05-08T05:30:25.888 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:25.885+0000 7f04b5e00700 1 -- 172.21.15.87:0/1029055817 learned_addr learned my addr 172.21.15.87:0/1029055817 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T05:30:25.888 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:25.885+0000 7f04b6800700 1 --2- 172.21.15.87:0/1029055817 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x56250c5ea300 0x56250c5ed400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:30:25.889 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:25.885+0000 7f04b5400700 1 -- 172.21.15.87:0/1029055817 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x56250c5ea300 msgr2=0x56250c5ed400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:30:25.889 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:25.885+0000 7f04b5400700 1 --2- 172.21.15.87:0/1029055817 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x56250c5ea300 0x56250c5ed400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:30:25.889 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:25.885+0000 7f04b5400700 1 -- 172.21.15.87:0/1029055817 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x56250c5e4600 msgr2=0x56250c5efe80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:30:25.889 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:25.885+0000 7f04b5400700 1 --2- 172.21.15.87:0/1029055817 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x56250c5e4600 0x56250c5efe80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:30:25.889 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:25.885+0000 7f04b5400700 1 -- 172.21.15.87:0/1029055817 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56250c4fc420 con 0x56250c5e99e0 2024-05-08T05:30:25.889 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:25.885+0000 7f04b5e00700 1 --2- 172.21.15.87:0/1029055817 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x56250c5e4600 0x56250c5efe80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T05:30:25.889 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:25.886+0000 7f04b5400700 1 --2- 172.21.15.87:0/1029055817 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56250c5e99e0 0x56250c5f03c0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x56250c5e4fc0 tx=0x7f04a40a9ec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8a46b466a6c2f282 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:30:25.889 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:25.886+0000 7f0497e00700 10 client.0 ms_handle_connect on v2:172.21.15.87:3300/0 2024-05-08T05:30:25.889 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:25.886+0000 7f0497e00700 1 -- 172.21.15.87:0/1029055817 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04a40cc2e0 con 0x56250c5e99e0 2024-05-08T05:30:25.890 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:25.886+0000 7f0497e00700 1 -- 172.21.15.87:0/1029055817 <== mon.0 v2:172.21.15.87:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8190+0+0 (secure 0 0 0) 0x7f04a4010920 con 0x56250c5e99e0 2024-05-08T05:30:25.890 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:25.886+0000 7f04c7561b80 1 -- 172.21.15.87:0/1029055817 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f04a8004ce0 con 0x56250c5e99e0 2024-05-08T05:30:25.890 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:25.886+0000 7f0497e00700 1 -- 172.21.15.87:0/1029055817 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f04a40b2120 con 0x56250c5e99e0 2024-05-08T05:30:25.890 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:25.886+0000 7f04c7561b80 10 client.15078 fetch_fsmap learned FSMap version 25 2024-05-08T05:30:25.890 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:25.886+0000 7f04c7561b80 1 -- 172.21.15.87:0/1029055817 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x56250c5fb480 con 0x56250c5e99e0 2024-05-08T05:30:25.892 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:25.887+0000 7f0497e00700 1 -- 172.21.15.87:0/1029055817 <== mon.0 v2:172.21.15.87:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f04a8004ce0 con 0x56250c5e99e0 2024-05-08T05:30:25.892 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:25.887+0000 7f0497e00700 1 -- 172.21.15.87:0/1029055817 <== mon.0 v2:172.21.15.87:3300/0 5 ==== fsmap(e 25) ==== 8338+0+0 (secure 0 0 0) 0x7f04a40a52f0 con 0x56250c5e99e0 2024-05-08T05:30:25.892 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:25.887+0000 7f04c7561b80 10 client.15078 fetch_fsmap finished waiting for FSMap version 25 2024-05-08T05:30:25.892 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:25.887+0000 7f04c7561b80 10 client.15078 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-05-08T05:30:25.892 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:25.887+0000 7f04c7561b80 20 client.15078 populate_metadata read hostname 'smithi087' 2024-05-08T05:30:25.893 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:25.887+0000 7f04c7561b80 1 --2- 172.21.15.87:0/1029055817 >> [v2:172.21.15.90:6838/160586017,v1:172.21.15.90:6839/160586017] conn(0x56250c5fda10 0x56250c5ffe00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:30:25.893 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:25.887+0000 7f04c7561b80 4 client.15078 mds_command: new command op to 24500 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-08T05:30:25.893 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:25.887+0000 7f04c7561b80 1 -- 172.21.15.87:0/1029055817 --> [v2:172.21.15.90:6838/160586017,v1:172.21.15.90:6839/160586017] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56250c5b10a0 con 0x56250c5fda10 2024-05-08T05:30:25.893 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:25.887+0000 7f04b5e00700 1 --2- 172.21.15.87:0/1029055817 >> [v2:172.21.15.90:6838/160586017,v1:172.21.15.90:6839/160586017] conn(0x56250c5fda10 0x56250c5ffe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:30:25.893 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:25.888+0000 7f04b5e00700 1 --2- 172.21.15.87:0/1029055817 >> [v2:172.21.15.90:6838/160586017,v1:172.21.15.90:6839/160586017] conn(0x56250c5fda10 0x56250c5ffe00 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bb7b0206a39af886 server_cookie=4fe01072bf30b120 in_seq=0 out_seq=0 2024-05-08T05:30:25.893 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:25.888+0000 7f0497e00700 10 client.15078 ms_handle_connect on v2:172.21.15.90:6838/160586017 2024-05-08T05:30:25.893 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:25.889+0000 7f0497e00700 1 -- 172.21.15.87:0/1029055817 <== mds.0 v2:172.21.15.90:6838/160586017 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x56250c5b10a0 con 0x56250c5fda10 2024-05-08T05:30:25.893 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:25.889+0000 7f0497e00700 10 client.15078 handle_command_reply: tid=0 2024-05-08T05:30:25.893 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:25.889+0000 7f04c7561b80 1 client.15078 shutdown 2024-05-08T05:30:25.893 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:25.889+0000 7f04c7561b80 1 -- 172.21.15.87:0/1029055817 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56250c5e99e0 msgr2=0x56250c5f03c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:30:25.893 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:25.889+0000 7f04c7561b80 1 --2- 172.21.15.87:0/1029055817 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56250c5e99e0 0x56250c5f03c0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x56250c5e4fc0 tx=0x7f04a40a9ec0 comp rx=0 tx=0).stop 2024-05-08T05:30:25.893 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:25.889+0000 7f04c7561b80 1 -- 172.21.15.87:0/1029055817 shutdown_connections 2024-05-08T05:30:25.893 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:25.889+0000 7f04c7561b80 1 --2- 172.21.15.87:0/1029055817 >> [v2:172.21.15.90:6838/160586017,v1:172.21.15.90:6839/160586017] conn(0x56250c5fda10 0x56250c5ffe00 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:30:25.894 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:25.889+0000 7f04c7561b80 1 --2- 172.21.15.87:0/1029055817 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x56250c5ea300 0x56250c5ed400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:30:25.894 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:25.889+0000 7f0497e00700 0 client.15078 ms_handle_reset on v2:172.21.15.90:6838/160586017 2024-05-08T05:30:25.894 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:25.889+0000 7f04c7561b80 1 --2- 172.21.15.87:0/1029055817 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x56250c5e4600 0x56250c5efe80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:30:25.894 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:25.889+0000 7f04c7561b80 1 --2- 172.21.15.87:0/1029055817 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56250c5e99e0 0x56250c5f03c0 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:30:25.894 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:25.889+0000 7f04c7561b80 1 -- 172.21.15.87:0/1029055817 >> 172.21.15.87:0/1029055817 conn(0x56250c512b60 msgr2=0x56250c5d9460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:30:25.894 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:25.889+0000 7f04c7561b80 1 -- 172.21.15.87:0/1029055817 shutdown_connections 2024-05-08T05:30:25.894 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:25.889+0000 7f04c7561b80 1 -- 172.21.15.87:0/1029055817 wait complete. 2024-05-08T05:30:25.894 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:25.889+0000 7f04c7561b80 20 client.15078 trim_cache size 0 max 16384 2024-05-08T05:30:25.907 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:25.905+0000 7f04c7561b80 1 Processor -- start 2024-05-08T05:30:25.907 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:25.905+0000 7f04c7561b80 1 -- start start 2024-05-08T05:30:25.908 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:25.906+0000 7f04c7561b80 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x56250c5e4600 0x56250c5eadf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:30:25.908 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:25.906+0000 7f04c7561b80 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56250c5e99e0 0x56250c605660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:30:25.908 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:25.906+0000 7f04c7561b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x56250c5ea300 0x56250c605ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:30:25.908 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:25.906+0000 7f04c7561b80 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f04b81b2540 con 0x56250c5e99e0 2024-05-08T05:30:25.908 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:25.906+0000 7f04c7561b80 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f04b81afdd0 con 0x56250c5e4600 2024-05-08T05:30:25.908 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:25.906+0000 7f04c7561b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f04b81adc20 con 0x56250c5ea300 2024-05-08T05:30:25.908 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:25.906+0000 7f04b5400700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56250c5e99e0 0x56250c605660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:30:25.908 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:25.906+0000 7f04b6800700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x56250c5ea300 0x56250c605ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:30:25.908 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:25.906+0000 7f04b5400700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56250c5e99e0 0x56250c605660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:54246/0 (socket says 172.21.15.87:54246) 2024-05-08T05:30:25.908 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:25.906+0000 7f04b5e00700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x56250c5e4600 0x56250c5eadf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:30:25.909 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:25.906+0000 7f04b5400700 1 -- 172.21.15.87:0/3971340675 learned_addr learned my addr 172.21.15.87:0/3971340675 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T05:30:25.909 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:25.907+0000 7f04b6800700 1 -- 172.21.15.87:0/3971340675 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x56250c5e4600 msgr2=0x56250c5eadf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:30:25.909 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:25.907+0000 7f04b6800700 1 --2- 172.21.15.87:0/3971340675 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x56250c5e4600 0x56250c5eadf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:30:25.909 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:25.907+0000 7f04b6800700 1 -- 172.21.15.87:0/3971340675 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56250c5e99e0 msgr2=0x56250c605660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:30:25.909 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:25.907+0000 7f04b6800700 1 --2- 172.21.15.87:0/3971340675 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56250c5e99e0 0x56250c605660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:30:25.909 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:25.907+0000 7f04b6800700 1 -- 172.21.15.87:0/3971340675 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56250c5eb790 con 0x56250c5ea300 2024-05-08T05:30:25.910 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:25.907+0000 7f04b6800700 1 --2- 172.21.15.87:0/3971340675 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x56250c5ea300 0x56250c605ba0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f04b00062a0 tx=0x7f04b000bf60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=eb567a1ec780abd9 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:30:25.910 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:25.907+0000 7f04a2a00700 1 -- 172.21.15.87:0/3971340675 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04b0007940 con 0x56250c5ea300 2024-05-08T05:30:25.910 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:25.907+0000 7f04a2a00700 1 -- 172.21.15.87:0/3971340675 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f04b002a440 con 0x56250c5ea300 2024-05-08T05:30:25.910 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:25.907+0000 7f04a2a00700 1 -- 172.21.15.87:0/3971340675 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04b00052a0 con 0x56250c5ea300 2024-05-08T05:30:25.911 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:25.908+0000 7f04c7561b80 1 -- 172.21.15.87:0/3971340675 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x56250c5ea300 msgr2=0x56250c605ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:30:25.911 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:25.908+0000 7f04c7561b80 1 --2- 172.21.15.87:0/3971340675 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x56250c5ea300 0x56250c605ba0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f04b00062a0 tx=0x7f04b000bf60 comp rx=0 tx=0).stop 2024-05-08T05:30:25.911 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:25.908+0000 7f04c7561b80 1 -- 172.21.15.87:0/3971340675 shutdown_connections 2024-05-08T05:30:25.911 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:25.908+0000 7f04c7561b80 1 --2- 172.21.15.87:0/3971340675 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x56250c5ea300 0x56250c605ba0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:30:25.911 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:25.908+0000 7f04c7561b80 1 --2- 172.21.15.87:0/3971340675 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x56250c5e4600 0x56250c5eadf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:30:25.911 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:25.908+0000 7f04c7561b80 1 --2- 172.21.15.87:0/3971340675 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56250c5e99e0 0x56250c605660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:30:25.911 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:25.908+0000 7f04c7561b80 1 -- 172.21.15.87:0/3971340675 >> 172.21.15.87:0/3971340675 conn(0x56250c512b60 msgr2=0x56250c5ea6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:30:25.911 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:25.909+0000 7f04c7561b80 1 -- 172.21.15.87:0/3971340675 shutdown_connections 2024-05-08T05:30:25.911 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:25.909+0000 7f04c7561b80 1 -- 172.21.15.87:0/3971340675 wait complete. 2024-05-08T05:30:25.911 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:25.909+0000 7f04c7561b80 1 -- start start 2024-05-08T05:30:25.913 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:25.909+0000 7f04c7561b80 1 Processor -- start 2024-05-08T05:30:25.913 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:25.910+0000 7f04c7561b80 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56250c5e4600 0x56250c5f6650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:30:25.914 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:25.910+0000 7f04c7561b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x56250c5e99e0 0x56250c604c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:30:25.914 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:25.910+0000 7f04c7561b80 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x56250c5ea300 0x56250c605150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:30:25.914 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:25.910+0000 7f04c7561b80 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f04b81ae290 con 0x56250c5e4600 2024-05-08T05:30:25.914 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:25.910+0000 7f04c7561b80 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f04b81af700 con 0x56250c5ea300 2024-05-08T05:30:25.914 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:25.910+0000 7f04c7561b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f04b81ae960 con 0x56250c5e99e0 2024-05-08T05:30:25.914 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:25.910+0000 7f04c7561b80 10 client.0 _ll_register_callbacks cb 0x56250c4ddc70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T05:30:25.914 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:25.910+0000 7f04b5e00700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56250c5e4600 0x56250c5f6650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:30:25.914 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:25.910+0000 7f04b5e00700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56250c5e4600 0x56250c5f6650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:54260/0 (socket says 172.21.15.87:54260) 2024-05-08T05:30:25.914 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:25.910+0000 7f04b5e00700 1 -- 172.21.15.87:0/820102012 learned_addr learned my addr 172.21.15.87:0/820102012 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T05:30:25.914 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:25.911+0000 7f04b6800700 1 --2- 172.21.15.87:0/820102012 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x56250c5ea300 0x56250c605150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:30:25.914 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:25.911+0000 7f04b5400700 1 --2- 172.21.15.87:0/820102012 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x56250c5e99e0 0x56250c604c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:30:25.914 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:25.911+0000 7f04b5e00700 1 -- 172.21.15.87:0/820102012 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x56250c5e99e0 msgr2=0x56250c604c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:30:25.915 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:25.911+0000 7f04b5e00700 1 --2- 172.21.15.87:0/820102012 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x56250c5e99e0 0x56250c604c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:30:25.915 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:25.911+0000 7f04b5e00700 1 -- 172.21.15.87:0/820102012 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x56250c5ea300 msgr2=0x56250c605150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:30:25.915 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:25.911+0000 7f04b5e00700 1 --2- 172.21.15.87:0/820102012 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x56250c5ea300 0x56250c605150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:30:25.915 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:25.911+0000 7f04b5e00700 1 -- 172.21.15.87:0/820102012 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56250c605880 con 0x56250c5e4600 2024-05-08T05:30:25.915 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:25.911+0000 7f04b5e00700 1 --2- 172.21.15.87:0/820102012 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56250c5e4600 0x56250c5f6650 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f04a8005510 tx=0x7f04a80096d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=885d63fc352b3243 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:30:25.915 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:25.911+0000 7f0497e00700 10 client.0 ms_handle_connect on v2:172.21.15.87:3300/0 2024-05-08T05:30:25.915 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:25.911+0000 7f0497e00700 1 -- 172.21.15.87:0/820102012 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04a8003880 con 0x56250c5e4600 2024-05-08T05:30:25.915 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:25.912+0000 7f04c7561b80 1 -- 172.21.15.87:0/820102012 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f04b002a440 con 0x56250c5e4600 2024-05-08T05:30:25.915 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:25.912+0000 7f0497e00700 1 -- 172.21.15.87:0/820102012 <== mon.0 v2:172.21.15.87:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8190+0+0 (secure 0 0 0) 0x7f04a8003a20 con 0x56250c5e4600 2024-05-08T05:30:25.915 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:25.912+0000 7f0497e00700 1 -- 172.21.15.87:0/820102012 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f04a8039050 con 0x56250c5e4600 2024-05-08T05:30:25.915 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:25.912+0000 7f04c7561b80 10 client.15084 fetch_fsmap learned FSMap version 25 2024-05-08T05:30:25.915 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:25.912+0000 7f04c7561b80 1 -- 172.21.15.87:0/820102012 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x56250c668150 con 0x56250c5e4600 2024-05-08T05:30:25.915 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:25.912+0000 7f0497e00700 1 -- 172.21.15.87:0/820102012 <== mon.0 v2:172.21.15.87:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f04b002a440 con 0x56250c5e4600 2024-05-08T05:30:25.915 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:25.912+0000 7f0497e00700 1 -- 172.21.15.87:0/820102012 <== mon.0 v2:172.21.15.87:3300/0 5 ==== fsmap(e 25) ==== 8338+0+0 (secure 0 0 0) 0x7f04a802a810 con 0x56250c5e4600 2024-05-08T05:30:25.915 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:25.912+0000 7f04c7561b80 10 client.15084 fetch_fsmap finished waiting for FSMap version 25 2024-05-08T05:30:25.916 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:25.912+0000 7f04c7561b80 10 client.15084 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-05-08T05:30:25.916 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:25.912+0000 7f04c7561b80 20 client.15084 populate_metadata read hostname 'smithi087' 2024-05-08T05:30:25.916 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:25.912+0000 7f04c7561b80 1 --2- 172.21.15.87:0/820102012 >> [v2:172.21.15.90:6838/160586017,v1:172.21.15.90:6839/160586017] conn(0x56250c6686d0 0x56250c66aaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:30:25.916 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:25.912+0000 7f04c7561b80 4 client.15084 mds_command: new command op to 24500 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-05-08T05:30:25.916 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:25.912+0000 7f04c7561b80 1 -- 172.21.15.87:0/820102012 --> [v2:172.21.15.90:6838/160586017,v1:172.21.15.90:6839/160586017] -- command(tid 0: {"prefix": "damage ls"}) -- 0x56250c544400 con 0x56250c6686d0 2024-05-08T05:30:25.917 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:25.913+0000 7f04b5400700 1 --2- 172.21.15.87:0/820102012 >> [v2:172.21.15.90:6838/160586017,v1:172.21.15.90:6839/160586017] conn(0x56250c6686d0 0x56250c66aaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:30:25.917 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:25.913+0000 7f04b5400700 1 --2- 172.21.15.87:0/820102012 >> [v2:172.21.15.90:6838/160586017,v1:172.21.15.90:6839/160586017] conn(0x56250c6686d0 0x56250c66aaf0 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=553d88fda0e4afcf server_cookie=2f9e634ad098c8d3 in_seq=0 out_seq=0 2024-05-08T05:30:25.917 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:25.913+0000 7f0497e00700 10 client.15084 ms_handle_connect on v2:172.21.15.90:6838/160586017 2024-05-08T05:30:25.917 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:25.913+0000 7f0497e00700 1 -- 172.21.15.87:0/820102012 <== mds.0 v2:172.21.15.90:6838/160586017 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x56250c544400 con 0x56250c6686d0 2024-05-08T05:30:25.917 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:25.913+0000 7f0497e00700 10 client.15084 handle_command_reply: tid=0 2024-05-08T05:30:25.918 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:25.913+0000 7f04c7561b80 1 client.15084 shutdown 2024-05-08T05:30:25.918 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:25.914+0000 7f04c7561b80 1 -- 172.21.15.87:0/820102012 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56250c5e4600 msgr2=0x56250c5f6650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:30:25.918 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:25.914+0000 7f04c7561b80 1 --2- 172.21.15.87:0/820102012 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56250c5e4600 0x56250c5f6650 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f04a8005510 tx=0x7f04a80096d0 comp rx=0 tx=0).stop 2024-05-08T05:30:25.918 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:25.914+0000 7f04c7561b80 1 -- 172.21.15.87:0/820102012 shutdown_connections 2024-05-08T05:30:25.918 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:25.914+0000 7f04c7561b80 1 --2- 172.21.15.87:0/820102012 >> [v2:172.21.15.90:6838/160586017,v1:172.21.15.90:6839/160586017] conn(0x56250c6686d0 0x56250c66aaf0 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:30:25.918 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:25.914+0000 7f04c7561b80 1 --2- 172.21.15.87:0/820102012 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x56250c5ea300 0x56250c605150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:30:25.918 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:25.914+0000 7f0497e00700 0 client.15084 ms_handle_reset on v2:172.21.15.90:6838/160586017 2024-05-08T05:30:25.918 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:25.914+0000 7f04c7561b80 1 --2- 172.21.15.87:0/820102012 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56250c5e4600 0x56250c5f6650 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:30:25.918 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:25.914+0000 7f04c7561b80 1 --2- 172.21.15.87:0/820102012 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x56250c5e99e0 0x56250c604c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:30:25.918 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:25.914+0000 7f04c7561b80 1 -- 172.21.15.87:0/820102012 >> 172.21.15.87:0/820102012 conn(0x56250c512b60 msgr2=0x56250c5ebb10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:30:25.918 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:25.914+0000 7f04c7561b80 1 -- 172.21.15.87:0/820102012 shutdown_connections 2024-05-08T05:30:25.918 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:25.914+0000 7f04c7561b80 1 -- 172.21.15.87:0/820102012 wait complete. 2024-05-08T05:30:25.918 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:25.914+0000 7f04c7561b80 20 client.15084 trim_cache size 0 max 16384 2024-05-08T05:30:25.919 INFO:teuthology.orchestra.run.smithi087.stdout:[] 2024-05-08T05:30:25.919 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:25.915+0000 7f04b7200700 1 -- 172.21.15.87:0/3616817877 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f049c0b2880 msgr2=0x7f049c0b4d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:30:25.920 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:25.915+0000 7f04b7200700 1 --2- 172.21.15.87:0/3616817877 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f049c0b2880 0x7f049c0b4d40 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f04b000b780 tx=0x7f04b000b3b0 comp rx=0 tx=0).stop 2024-05-08T05:30:25.920 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:25.915+0000 7f04b7200700 1 -- 172.21.15.87:0/3616817877 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f04b8103d90 msgr2=0x7f04b81a1e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:30:25.920 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:25.915+0000 7f04b7200700 1 --2- 172.21.15.87:0/3616817877 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f04b8103d90 0x7f04b81a1e00 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f04a400e9a0 tx=0x7f04a400ecb0 comp rx=0 tx=0).stop 2024-05-08T05:30:25.920 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:25.915+0000 7f04b7200700 1 -- 172.21.15.87:0/3616817877 shutdown_connections 2024-05-08T05:30:25.920 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:25.915+0000 7f04b7200700 1 --2- 172.21.15.87:0/3616817877 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f04b8109460 0x7f04b819ba80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:30:25.920 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:25.915+0000 7f04b7200700 1 --2- 172.21.15.87:0/3616817877 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f049c0b2880 0x7f049c0b4d40 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:30:25.920 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:25.915+0000 7f04b7200700 1 --2- 172.21.15.87:0/3616817877 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f04b81033d0 0x7f04b81a18c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:30:25.920 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:25.915+0000 7f04b7200700 1 --2- 172.21.15.87:0/3616817877 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f04b8103d90 0x7f04b81a1e00 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:30:25.920 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:25.915+0000 7f04b7200700 1 -- 172.21.15.87:0/3616817877 >> 172.21.15.87:0/3616817877 conn(0x7f04b80fef20 msgr2=0x7f04b8108720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:30:25.920 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:25.915+0000 7f04b7200700 1 -- 172.21.15.87:0/3616817877 shutdown_connections 2024-05-08T05:30:25.920 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:25.915+0000 7f04b7200700 1 -- 172.21.15.87:0/3616817877 wait complete. 2024-05-08T05:30:26.958 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:30:26 smithi087 ceph-mon[29523]: pgmap v463: 97 pgs: 97 active+clean; 661 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-05-08T05:30:26.983 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:30:26 smithi090 ceph-mon[34526]: pgmap v463: 97 pgs: 97 active+clean; 661 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-05-08T05:30:27.038 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:30:26 smithi160 ceph-mon[34827]: pgmap v463: 97 pgs: 97 active+clean; 661 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-05-08T05:30:27.827 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-05-08T05:30:27.827 DEBUG:teuthology.orchestra.run.smithi087:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid eeeb813e-0cf9-11ef-bc97-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-05-08T05:30:28.299 INFO:teuthology.orchestra.run.smithi087.stderr:Inferring config /var/lib/ceph/eeeb813e-0cf9-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T05:30:28.708 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:30:28 smithi087 ceph-mon[29523]: pgmap v464: 97 pgs: 97 active+clean; 661 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T05:30:28.983 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:30:28 smithi090 ceph-mon[34526]: pgmap v464: 97 pgs: 97 active+clean; 661 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T05:30:29.038 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:30:28 smithi160 ceph-mon[34827]: pgmap v464: 97 pgs: 97 active+clean; 661 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T05:30:30.575 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:30.573+0000 7fd5c9c00700 1 -- 172.21.15.87:0/4244884239 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd5c4109600 msgr2=0x7fd5c41099e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:30:30.575 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:30.573+0000 7fd5c9c00700 1 --2- 172.21.15.87:0/4244884239 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd5c4109600 0x7fd5c41099e0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fd5b4009990 tx=0x7fd5b4009ca0 comp rx=0 tx=0).stop 2024-05-08T05:30:30.575 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:30.573+0000 7fd5c9c00700 1 -- 172.21.15.87:0/4244884239 shutdown_connections 2024-05-08T05:30:30.575 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:30.573+0000 7fd5c9c00700 1 --2- 172.21.15.87:0/4244884239 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd5c4103eb0 0x7fd5c4110390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:30:30.575 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:30.573+0000 7fd5c9c00700 1 --2- 172.21.15.87:0/4244884239 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd5c4109600 0x7fd5c41099e0 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:30:30.575 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:30.573+0000 7fd5c9c00700 1 --2- 172.21.15.87:0/4244884239 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd5c41034f0 0x7fd5c4103970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:30:30.575 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:30.573+0000 7fd5c9c00700 1 -- 172.21.15.87:0/4244884239 >> 172.21.15.87:0/4244884239 conn(0x7fd5c407a650 msgr2=0x7fd5c407aa60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:30:30.576 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:30.573+0000 7fd5c9c00700 1 -- 172.21.15.87:0/4244884239 shutdown_connections 2024-05-08T05:30:30.576 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:30.575+0000 7fd5c9c00700 1 -- 172.21.15.87:0/4244884239 wait complete. 2024-05-08T05:30:30.578 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:30.576+0000 7fd5c9c00700 1 Processor -- start 2024-05-08T05:30:30.578 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:30.577+0000 7fd5c9c00700 1 -- start start 2024-05-08T05:30:30.578 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:30.577+0000 7fd5c9c00700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd5c41034f0 0x7fd5c419bd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:30:30.578 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:30.577+0000 7fd5c9c00700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd5c4103eb0 0x7fd5c419c290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:30:30.579 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:30.577+0000 7fd5c9c00700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd5c4109600 0x7fd5c41a0620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:30:30.579 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:30.577+0000 7fd5c9c00700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fd5c4113650 con 0x7fd5c41034f0 2024-05-08T05:30:30.579 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:30.577+0000 7fd5c9c00700 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fd5c41134d0 con 0x7fd5c4109600 2024-05-08T05:30:30.579 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:30.577+0000 7fd5c9c00700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7fd5c41137d0 con 0x7fd5c4103eb0 2024-05-08T05:30:30.580 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:30.578+0000 7fd5c3400700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd5c4109600 0x7fd5c41a0620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:30:30.580 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:30.578+0000 7fd5c2000700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd5c4103eb0 0x7fd5c419c290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:30:30.580 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:30.578+0000 7fd5c3400700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd5c4109600 0x7fd5c41a0620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.87:41384/0 (socket says 172.21.15.87:41384) 2024-05-08T05:30:30.580 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:30.578+0000 7fd5c3400700 1 -- 172.21.15.87:0/3867566888 learned_addr learned my addr 172.21.15.87:0/3867566888 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T05:30:30.580 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:30.578+0000 7fd5c2a00700 1 --2- 172.21.15.87:0/3867566888 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd5c41034f0 0x7fd5c419bd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:30:30.580 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:30.578+0000 7fd5c3400700 1 -- 172.21.15.87:0/3867566888 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd5c4103eb0 msgr2=0x7fd5c419c290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:30:30.580 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:30.578+0000 7fd5c3400700 1 --2- 172.21.15.87:0/3867566888 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd5c4103eb0 0x7fd5c419c290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:30:30.580 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:30.578+0000 7fd5c3400700 1 -- 172.21.15.87:0/3867566888 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd5c41034f0 msgr2=0x7fd5c419bd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:30:30.580 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:30.578+0000 7fd5c3400700 1 --2- 172.21.15.87:0/3867566888 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd5c41034f0 0x7fd5c419bd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:30:30.580 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:30.578+0000 7fd5c3400700 1 -- 172.21.15.87:0/3867566888 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd5c41a0d60 con 0x7fd5c4109600 2024-05-08T05:30:30.580 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:30.578+0000 7fd5c3400700 1 --2- 172.21.15.87:0/3867566888 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd5c4109600 0x7fd5c41a0620 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fd5bc00efc0 tx=0x7fd5bc00c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:30:30.581 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:30.579+0000 7fd5bb400700 1 -- 172.21.15.87:0/3867566888 <== mon.2 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5bc0092e0 con 0x7fd5c4109600 2024-05-08T05:30:30.581 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:30.579+0000 7fd5c9c00700 1 -- 172.21.15.87:0/3867566888 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd5c41a0ff0 con 0x7fd5c4109600 2024-05-08T05:30:30.581 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:30.579+0000 7fd5bb400700 1 -- 172.21.15.87:0/3867566888 <== mon.2 v2:172.21.15.90:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd5bc004bb0 con 0x7fd5c4109600 2024-05-08T05:30:30.581 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:30.579+0000 7fd5bb400700 1 -- 172.21.15.87:0/3867566888 <== mon.2 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5bc004020 con 0x7fd5c4109600 2024-05-08T05:30:30.581 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:30.580+0000 7fd5c9c00700 1 -- 172.21.15.87:0/3867566888 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd5c41a88d0 con 0x7fd5c4109600 2024-05-08T05:30:30.585 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:30.584+0000 7fd5bb400700 1 -- 172.21.15.87:0/3867566888 <== mon.2 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7fd5bc01b030 con 0x7fd5c4109600 2024-05-08T05:30:30.587 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:30.586+0000 7fd5bb400700 1 --2- 172.21.15.87:0/3867566888 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7fd5a80b2900 0x7fd5a80b4dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:30:30.587 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:30.586+0000 7fd5bb400700 1 -- 172.21.15.87:0/3867566888 <== mon.2 v2:172.21.15.90:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8190+0+0 (secure 0 0 0) 0x7fd5bc0e1a20 con 0x7fd5c4109600 2024-05-08T05:30:30.587 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:30.586+0000 7fd5d44adb80 1 Processor -- start 2024-05-08T05:30:30.588 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:30.586+0000 7fd5d44adb80 1 -- start start 2024-05-08T05:30:30.588 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:30.586+0000 7fd5c2a00700 1 --2- 172.21.15.87:0/3867566888 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7fd5a80b2900 0x7fd5a80b4dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:30:30.588 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:30.587+0000 7fd5d44adb80 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x562b45e7e0e0 0x562b45e7e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:30:30.588 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:30.587+0000 7fd5d44adb80 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x562b45e7ea00 0x562b45e82510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:30:30.588 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:30.587+0000 7fd5d44adb80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x562b45e82a50 0x562b45e82eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:30:30.588 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:30.587+0000 7fd5d44adb80 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x562b45dd0aa0 con 0x562b45e7ea00 2024-05-08T05:30:30.588 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:30.587+0000 7fd5d44adb80 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x562b45d6e7e0 con 0x562b45e7e0e0 2024-05-08T05:30:30.588 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:30.587+0000 7fd5d44adb80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x562b45dcca60 con 0x562b45e82a50 2024-05-08T05:30:30.589 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:30.587+0000 7fd5c2000700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x562b45e7ea00 0x562b45e82510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:30:30.589 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:30.587+0000 7fd5c2000700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x562b45e7ea00 0x562b45e82510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:54286/0 (socket says 172.21.15.87:54286) 2024-05-08T05:30:30.590 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:30.587+0000 7fd5c2000700 1 -- 172.21.15.87:0/254515799 learned_addr learned my addr 172.21.15.87:0/254515799 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T05:30:30.590 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:30.587+0000 7fd5c3400700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x562b45e82a50 0x562b45e82eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:30:30.590 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:30.587+0000 7fd5c2a00700 1 --2- 172.21.15.87:0/254515799 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x562b45e7e0e0 0x562b45e7e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:30:30.590 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:30.587+0000 7fd5c2a00700 1 --2- 172.21.15.87:0/3867566888 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7fd5a80b2900 0x7fd5a80b4dc0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fd5b40098e0 tx=0x7fd5b4005960 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:30:30.590 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:30.588+0000 7fd5c3400700 1 -- 172.21.15.87:0/254515799 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x562b45e7e0e0 msgr2=0x562b45e7e4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:30:30.590 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:30.588+0000 7fd5c3400700 1 --2- 172.21.15.87:0/254515799 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x562b45e7e0e0 0x562b45e7e4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:30:30.590 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:30.588+0000 7fd5c3400700 1 -- 172.21.15.87:0/254515799 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x562b45e7ea00 msgr2=0x562b45e82510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:30:30.590 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:30.588+0000 7fd5c3400700 1 --2- 172.21.15.87:0/254515799 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x562b45e7ea00 0x562b45e82510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:30:30.590 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:30.588+0000 7fd5c3400700 1 -- 172.21.15.87:0/254515799 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562b45d1d950 con 0x562b45e82a50 2024-05-08T05:30:30.590 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:30.588+0000 7fd5c2a00700 1 --2- 172.21.15.87:0/254515799 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x562b45e7e0e0 0x562b45e7e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T05:30:30.590 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:30.588+0000 7fd5c2000700 1 --2- 172.21.15.87:0/254515799 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x562b45e7ea00 0x562b45e82510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T05:30:30.590 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:30.588+0000 7fd5c3400700 1 --2- 172.21.15.87:0/254515799 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x562b45e82a50 0x562b45e82eb0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fd5bc0a6370 tx=0x7fd5bc0a9000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b62b68dcdf382eef server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:30:30.590 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:30.588+0000 7fd5afe00700 1 -- 172.21.15.87:0/254515799 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5bc0a9100 con 0x562b45e82a50 2024-05-08T05:30:30.591 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:30.588+0000 7fd5afe00700 1 -- 172.21.15.87:0/254515799 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd5bc0ad4b0 con 0x562b45e82a50 2024-05-08T05:30:30.591 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:30.588+0000 7fd5afe00700 1 -- 172.21.15.87:0/254515799 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5bc0b1ca0 con 0x562b45e82a50 2024-05-08T05:30:30.591 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:30.589+0000 7fd5d44adb80 1 -- 172.21.15.87:0/254515799 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x562b45e82a50 msgr2=0x562b45e82eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:30:30.592 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:30.589+0000 7fd5d44adb80 1 --2- 172.21.15.87:0/254515799 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x562b45e82a50 0x562b45e82eb0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fd5bc0a6370 tx=0x7fd5bc0a9000 comp rx=0 tx=0).stop 2024-05-08T05:30:30.592 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:30.589+0000 7fd5d44adb80 1 -- 172.21.15.87:0/254515799 shutdown_connections 2024-05-08T05:30:30.592 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:30.589+0000 7fd5d44adb80 1 --2- 172.21.15.87:0/254515799 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x562b45e82a50 0x562b45e82eb0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:30:30.592 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:30.589+0000 7fd5d44adb80 1 --2- 172.21.15.87:0/254515799 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x562b45e7e0e0 0x562b45e7e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:30:30.592 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:30.589+0000 7fd5d44adb80 1 --2- 172.21.15.87:0/254515799 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x562b45e7ea00 0x562b45e82510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:30:30.592 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:30.589+0000 7fd5d44adb80 1 -- 172.21.15.87:0/254515799 >> 172.21.15.87:0/254515799 conn(0x562b45dacbe0 msgr2=0x562b45e78820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:30:30.592 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:30.590+0000 7fd5d44adb80 1 -- 172.21.15.87:0/254515799 shutdown_connections 2024-05-08T05:30:30.592 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:30.590+0000 7fd5d44adb80 1 -- 172.21.15.87:0/254515799 wait complete. 2024-05-08T05:30:30.592 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:30.590+0000 7fd5d44adb80 1 -- start start 2024-05-08T05:30:30.592 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:30.590+0000 7fd5d44adb80 1 Processor -- start 2024-05-08T05:30:30.593 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:30.591+0000 7fd5d44adb80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x562b45e7e0e0 0x562b45e89ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:30:30.593 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:30.591+0000 7fd5d44adb80 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x562b45e7ea00 0x562b45e87290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:30:30.593 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:30.591+0000 7fd5d44adb80 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x562b45e82a50 0x562b45e877d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:30:30.593 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:30.591+0000 7fd5d44adb80 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x562b45e8ac00 con 0x562b45e7ea00 2024-05-08T05:30:30.593 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:30.591+0000 7fd5d44adb80 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x562b45d36ba0 con 0x562b45e82a50 2024-05-08T05:30:30.593 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:30.591+0000 7fd5d44adb80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x562b45e8ad80 con 0x562b45e7e0e0 2024-05-08T05:30:30.593 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:30.591+0000 7fd5d44adb80 10 client.0 _ll_register_callbacks cb 0x562b45d77cf0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T05:30:30.593 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:30.591+0000 7fd5c2a00700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x562b45e7e0e0 0x562b45e89ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:30:30.594 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:30.591+0000 7fd5c2a00700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x562b45e7e0e0 0x562b45e89ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.87:38028/0 (socket says 172.21.15.87:38028) 2024-05-08T05:30:30.594 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:30.591+0000 7fd5c2a00700 1 -- 172.21.15.87:0/3235556534 learned_addr learned my addr 172.21.15.87:0/3235556534 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T05:30:30.594 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:30.591+0000 7fd5c3400700 1 --2- 172.21.15.87:0/3235556534 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x562b45e82a50 0x562b45e877d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:30:30.594 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:30.591+0000 7fd5c2000700 1 --2- 172.21.15.87:0/3235556534 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x562b45e7ea00 0x562b45e87290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:30:30.594 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:30.592+0000 7fd5c3400700 1 -- 172.21.15.87:0/3235556534 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x562b45e7e0e0 msgr2=0x562b45e89ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:30:30.594 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:30.592+0000 7fd5c3400700 1 --2- 172.21.15.87:0/3235556534 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x562b45e7e0e0 0x562b45e89ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:30:30.594 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:30.592+0000 7fd5c3400700 1 -- 172.21.15.87:0/3235556534 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x562b45e7ea00 msgr2=0x562b45e87290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:30:30.594 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:30.592+0000 7fd5c3400700 1 --2- 172.21.15.87:0/3235556534 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x562b45e7ea00 0x562b45e87290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:30:30.594 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:30.592+0000 7fd5c3400700 1 -- 172.21.15.87:0/3235556534 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562b45d964a0 con 0x562b45e82a50 2024-05-08T05:30:30.596 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:30.592+0000 7fd5c3400700 1 --2- 172.21.15.87:0/3235556534 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x562b45e82a50 0x562b45e877d0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fd5bc0a6370 tx=0x7fd5bc009e10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=262ca20bdfd52fe server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:30:30.596 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:30.592+0000 7fd5acc00700 10 client.0 ms_handle_connect on v2:172.21.15.90:3300/0 2024-05-08T05:30:30.596 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:30.592+0000 7fd5acc00700 1 -- 172.21.15.87:0/3235556534 <== mon.2 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5bc0a56f0 con 0x562b45e82a50 2024-05-08T05:30:30.596 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:30.592+0000 7fd5acc00700 1 -- 172.21.15.87:0/3235556534 <== mon.2 v2:172.21.15.90:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8190+0+0 (secure 0 0 0) 0x7fd5bc0b1a40 con 0x562b45e82a50 2024-05-08T05:30:30.596 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:30.593+0000 7fd5d44adb80 1 -- 172.21.15.87:0/3235556534 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd5bc0ad4b0 con 0x562b45e82a50 2024-05-08T05:30:30.596 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:30.593+0000 7fd5acc00700 1 -- 172.21.15.87:0/3235556534 <== mon.2 v2:172.21.15.90:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fd5bc0c9020 con 0x562b45e82a50 2024-05-08T05:30:30.596 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:30.593+0000 7fd5d44adb80 10 client.25196 fetch_fsmap learned FSMap version 25 2024-05-08T05:30:30.596 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:30.593+0000 7fd5d44adb80 1 -- 172.21.15.87:0/3235556534 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x562b45e95480 con 0x562b45e82a50 2024-05-08T05:30:30.596 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:30.593+0000 7fd5acc00700 1 -- 172.21.15.87:0/3235556534 <== mon.2 v2:172.21.15.90:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd5bc0ad4b0 con 0x562b45e82a50 2024-05-08T05:30:30.596 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:30.594+0000 7fd5acc00700 1 -- 172.21.15.87:0/3235556534 <== mon.2 v2:172.21.15.90:3300/0 5 ==== fsmap(e 25) ==== 8338+0+0 (secure 0 0 0) 0x7fd5bc0a7f60 con 0x562b45e82a50 2024-05-08T05:30:30.596 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:30.594+0000 7fd5d44adb80 10 client.25196 fetch_fsmap finished waiting for FSMap version 25 2024-05-08T05:30:30.596 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:30.594+0000 7fd5d44adb80 10 client.25196 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-05-08T05:30:30.597 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:30.594+0000 7fd5d44adb80 20 client.25196 populate_metadata read hostname 'smithi087' 2024-05-08T05:30:30.597 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:30.594+0000 7fd5d44adb80 1 --2- 172.21.15.87:0/3235556534 >> [v2:172.21.15.90:6838/160586017,v1:172.21.15.90:6839/160586017] conn(0x562b45e97950 0x562b45e99d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:30:30.597 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:30.594+0000 7fd5d44adb80 4 client.25196 mds_command: new command op to 24500 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-08T05:30:30.597 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:30.594+0000 7fd5d44adb80 1 -- 172.21.15.87:0/3235556534 --> [v2:172.21.15.90:6838/160586017,v1:172.21.15.90:6839/160586017] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562b45e4b120 con 0x562b45e97950 2024-05-08T05:30:30.597 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:30.594+0000 7fd5c2a00700 1 --2- 172.21.15.87:0/3235556534 >> [v2:172.21.15.90:6838/160586017,v1:172.21.15.90:6839/160586017] conn(0x562b45e97950 0x562b45e99d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:30:30.597 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:30.595+0000 7fd5c2a00700 1 --2- 172.21.15.87:0/3235556534 >> [v2:172.21.15.90:6838/160586017,v1:172.21.15.90:6839/160586017] conn(0x562b45e97950 0x562b45e99d40 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8e86c40f294ab713 server_cookie=3716e1b0a21e9fd in_seq=0 out_seq=0 2024-05-08T05:30:30.597 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:30.595+0000 7fd5acc00700 10 client.25196 ms_handle_connect on v2:172.21.15.90:6838/160586017 2024-05-08T05:30:30.598 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:30.595+0000 7fd5acc00700 1 -- 172.21.15.87:0/3235556534 <== mds.0 v2:172.21.15.90:6838/160586017 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x562b45e4b120 con 0x562b45e97950 2024-05-08T05:30:30.598 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:30.595+0000 7fd5acc00700 10 client.25196 handle_command_reply: tid=0 2024-05-08T05:30:30.598 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:30.596+0000 7fd5d44adb80 1 client.25196 shutdown 2024-05-08T05:30:30.598 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:30.596+0000 7fd5d44adb80 1 -- 172.21.15.87:0/3235556534 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x562b45e82a50 msgr2=0x562b45e877d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:30:30.598 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:30.596+0000 7fd5d44adb80 1 --2- 172.21.15.87:0/3235556534 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x562b45e82a50 0x562b45e877d0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fd5bc0a6370 tx=0x7fd5bc009e10 comp rx=0 tx=0).stop 2024-05-08T05:30:30.598 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:30.596+0000 7fd5d44adb80 1 -- 172.21.15.87:0/3235556534 shutdown_connections 2024-05-08T05:30:30.598 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:30.596+0000 7fd5d44adb80 1 --2- 172.21.15.87:0/3235556534 >> [v2:172.21.15.90:6838/160586017,v1:172.21.15.90:6839/160586017] conn(0x562b45e97950 0x562b45e99d40 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:30:30.598 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:30.596+0000 7fd5d44adb80 1 --2- 172.21.15.87:0/3235556534 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x562b45e82a50 0x562b45e877d0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:30:30.599 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:30.596+0000 7fd5d44adb80 1 --2- 172.21.15.87:0/3235556534 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x562b45e7e0e0 0x562b45e89ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:30:30.599 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:30.596+0000 7fd5d44adb80 1 --2- 172.21.15.87:0/3235556534 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x562b45e7ea00 0x562b45e87290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:30:30.599 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:30.596+0000 7fd5d44adb80 1 -- 172.21.15.87:0/3235556534 >> 172.21.15.87:0/3235556534 conn(0x562b45dacbe0 msgr2=0x562b45e73330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:30:30.599 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:30.596+0000 7fd5acc00700 0 client.25196 ms_handle_reset on v2:172.21.15.90:6838/160586017 2024-05-08T05:30:30.599 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:30.596+0000 7fd5d44adb80 1 -- 172.21.15.87:0/3235556534 shutdown_connections 2024-05-08T05:30:30.599 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:30.596+0000 7fd5d44adb80 1 -- 172.21.15.87:0/3235556534 wait complete. 2024-05-08T05:30:30.599 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:30.596+0000 7fd5d44adb80 20 client.25196 trim_cache size 0 max 16384 2024-05-08T05:30:30.621 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:30.620+0000 7fd5d44adb80 1 Processor -- start 2024-05-08T05:30:30.621 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:30.620+0000 7fd5d44adb80 1 -- start start 2024-05-08T05:30:30.622 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:30.620+0000 7fd5d44adb80 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x562b45e7e0e0 0x562b45e861f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:30:30.622 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:30.620+0000 7fd5d44adb80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x562b45e7ea00 0x562b45e80340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:30:30.622 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:30.620+0000 7fd5d44adb80 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x562b45e82a50 0x562b45e80880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:30:30.622 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:30.620+0000 7fd5d44adb80 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fd5c41b25d0 con 0x562b45e7e0e0 2024-05-08T05:30:30.622 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:30.620+0000 7fd5d44adb80 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fd5c41afe60 con 0x562b45e82a50 2024-05-08T05:30:30.622 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:30.620+0000 7fd5d44adb80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7fd5c41adcb0 con 0x562b45e7ea00 2024-05-08T05:30:30.623 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:30.621+0000 7fd5c2a00700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x562b45e7e0e0 0x562b45e861f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:30:30.623 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:30.621+0000 7fd5c2000700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x562b45e7ea00 0x562b45e80340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:30:30.623 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:30.621+0000 7fd5c2000700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x562b45e7ea00 0x562b45e80340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.87:38032/0 (socket says 172.21.15.87:38032) 2024-05-08T05:30:30.623 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:30.621+0000 7fd5c3400700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x562b45e82a50 0x562b45e80880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:30:30.623 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:30.621+0000 7fd5c2000700 1 -- 172.21.15.87:0/614290099 learned_addr learned my addr 172.21.15.87:0/614290099 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T05:30:30.623 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:30.621+0000 7fd5c2a00700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x562b45e7e0e0 0x562b45e861f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:54302/0 (socket says 172.21.15.87:54302) 2024-05-08T05:30:30.623 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:30.621+0000 7fd5c2000700 1 -- 172.21.15.87:0/614290099 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x562b45e82a50 msgr2=0x562b45e80880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:30:30.623 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:30.621+0000 7fd5c2000700 1 --2- 172.21.15.87:0/614290099 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x562b45e82a50 0x562b45e80880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:30:30.623 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:30.621+0000 7fd5c2000700 1 -- 172.21.15.87:0/614290099 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x562b45e7e0e0 msgr2=0x562b45e861f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:30:30.623 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:30.621+0000 7fd5c2000700 1 --2- 172.21.15.87:0/614290099 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x562b45e7e0e0 0x562b45e861f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:30:30.624 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:30.621+0000 7fd5c2000700 1 -- 172.21.15.87:0/614290099 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562b45e75470 con 0x562b45e7ea00 2024-05-08T05:30:30.624 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:30.622+0000 7fd5c2000700 1 --2- 172.21.15.87:0/614290099 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x562b45e7ea00 0x562b45e80340 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fd5b0012480 tx=0x7fd5b0009260 comp rx=0 tx=0).ready entity=mon.1 client_cookie=380490c20765dad6 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:30:30.624 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:30.622+0000 7fd5af400700 1 -- 172.21.15.87:0/614290099 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5b0012be0 con 0x562b45e7ea00 2024-05-08T05:30:30.624 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:30.622+0000 7fd5af400700 1 -- 172.21.15.87:0/614290099 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd5b00044e0 con 0x562b45e7ea00 2024-05-08T05:30:30.625 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:30.622+0000 7fd5af400700 1 -- 172.21.15.87:0/614290099 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5b0003e10 con 0x562b45e7ea00 2024-05-08T05:30:30.625 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:30.623+0000 7fd5d44adb80 1 -- 172.21.15.87:0/614290099 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x562b45e7ea00 msgr2=0x562b45e80340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:30:30.625 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:30.623+0000 7fd5d44adb80 1 --2- 172.21.15.87:0/614290099 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x562b45e7ea00 0x562b45e80340 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fd5b0012480 tx=0x7fd5b0009260 comp rx=0 tx=0).stop 2024-05-08T05:30:30.625 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:30.623+0000 7fd5d44adb80 1 -- 172.21.15.87:0/614290099 shutdown_connections 2024-05-08T05:30:30.625 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:30.623+0000 7fd5d44adb80 1 --2- 172.21.15.87:0/614290099 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x562b45e82a50 0x562b45e80880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:30:30.625 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:30.623+0000 7fd5d44adb80 1 --2- 172.21.15.87:0/614290099 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x562b45e7e0e0 0x562b45e861f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:30:30.625 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:30.623+0000 7fd5d44adb80 1 --2- 172.21.15.87:0/614290099 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x562b45e7ea00 0x562b45e80340 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:30:30.625 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:30.623+0000 7fd5d44adb80 1 -- 172.21.15.87:0/614290099 >> 172.21.15.87:0/614290099 conn(0x562b45dacbe0 msgr2=0x562b45e73330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:30:30.625 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:30.623+0000 7fd5d44adb80 1 -- 172.21.15.87:0/614290099 shutdown_connections 2024-05-08T05:30:30.625 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:30.623+0000 7fd5d44adb80 1 -- 172.21.15.87:0/614290099 wait complete. 2024-05-08T05:30:30.626 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:30.624+0000 7fd5d44adb80 1 -- start start 2024-05-08T05:30:30.626 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:30.624+0000 7fd5d44adb80 1 Processor -- start 2024-05-08T05:30:30.626 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:30.625+0000 7fd5d44adb80 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x562b45e7e0e0 0x562b45e9cbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:30:30.626 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:30.625+0000 7fd5d44adb80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x562b45e7ea00 0x562b45e99020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:30:30.626 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:30.625+0000 7fd5d44adb80 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x562b45e82a50 0x562b45e99560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:30:30.626 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:30.625+0000 7fd5d44adb80 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fd5c41ae320 con 0x562b45e82a50 2024-05-08T05:30:30.626 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:30.625+0000 7fd5d44adb80 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fd5c41af790 con 0x562b45e7e0e0 2024-05-08T05:30:30.626 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:30.625+0000 7fd5d44adb80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7fd5c41ae9f0 con 0x562b45e7ea00 2024-05-08T05:30:30.626 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:30.625+0000 7fd5d44adb80 10 client.0 _ll_register_callbacks cb 0x562b45d77cf0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T05:30:30.627 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:30.625+0000 7fd5c2a00700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x562b45e7e0e0 0x562b45e9cbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:30:30.627 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:30.625+0000 7fd5c3400700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x562b45e82a50 0x562b45e99560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:30:30.627 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:30.625+0000 7fd5c2000700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x562b45e7ea00 0x562b45e99020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:30:30.627 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:30.625+0000 7fd5c2a00700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x562b45e7e0e0 0x562b45e9cbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.87:41424/0 (socket says 172.21.15.87:41424) 2024-05-08T05:30:30.628 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:30.625+0000 7fd5c3400700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x562b45e82a50 0x562b45e99560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:54316/0 (socket says 172.21.15.87:54316) 2024-05-08T05:30:30.628 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:30.625+0000 7fd5c2000700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x562b45e7ea00 0x562b45e99020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.87:38038/0 (socket says 172.21.15.87:38038) 2024-05-08T05:30:30.628 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:30.625+0000 7fd5c2a00700 1 -- 172.21.15.87:0/806736513 learned_addr learned my addr 172.21.15.87:0/806736513 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T05:30:30.628 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:30.626+0000 7fd5c3400700 1 -- 172.21.15.87:0/806736513 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x562b45e7ea00 msgr2=0x562b45e99020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:30:30.628 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:30.626+0000 7fd5c3400700 1 --2- 172.21.15.87:0/806736513 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x562b45e7ea00 0x562b45e99020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:30:30.628 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:30.626+0000 7fd5c3400700 1 -- 172.21.15.87:0/806736513 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x562b45e7e0e0 msgr2=0x562b45e9cbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:30:30.628 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:30.626+0000 7fd5c3400700 1 --2- 172.21.15.87:0/806736513 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x562b45e7e0e0 0x562b45e9cbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:30:30.628 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:30.626+0000 7fd5c3400700 1 -- 172.21.15.87:0/806736513 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562b45e99af0 con 0x562b45e82a50 2024-05-08T05:30:30.628 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:30.626+0000 7fd5c2a00700 1 --2- 172.21.15.87:0/806736513 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x562b45e7e0e0 0x562b45e9cbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T05:30:30.628 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:30.626+0000 7fd5c2000700 1 --2- 172.21.15.87:0/806736513 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x562b45e7ea00 0x562b45e99020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T05:30:30.628 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:30.626+0000 7fd5c3400700 1 --2- 172.21.15.87:0/806736513 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x562b45e82a50 0x562b45e99560 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fd5bc0df8c0 tx=0x7fd5bc0a8000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=436bd8c92d1cd0db server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:30:30.628 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:30.626+0000 7fd5acc00700 10 client.0 ms_handle_connect on v2:172.21.15.87:3300/0 2024-05-08T05:30:30.629 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:30.628+0000 7fd5acc00700 1 -- 172.21.15.87:0/806736513 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5bc0ad4b0 con 0x562b45e82a50 2024-05-08T05:30:30.629 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:30.628+0000 7fd5acc00700 1 -- 172.21.15.87:0/806736513 <== mon.0 v2:172.21.15.87:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8190+0+0 (secure 0 0 0) 0x7fd5bc0a56f0 con 0x562b45e82a50 2024-05-08T05:30:30.629 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:30.628+0000 7fd5d44adb80 1 -- 172.21.15.87:0/806736513 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd5b00044e0 con 0x562b45e82a50 2024-05-08T05:30:30.629 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:30.628+0000 7fd5acc00700 1 -- 172.21.15.87:0/806736513 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fd5bc087070 con 0x562b45e82a50 2024-05-08T05:30:30.630 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:30.628+0000 7fd5d44adb80 10 client.15102 fetch_fsmap learned FSMap version 25 2024-05-08T05:30:30.630 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:30.628+0000 7fd5d44adb80 1 -- 172.21.15.87:0/806736513 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x562b45f02c50 con 0x562b45e82a50 2024-05-08T05:30:30.630 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:30.629+0000 7fd5acc00700 1 -- 172.21.15.87:0/806736513 <== mon.0 v2:172.21.15.87:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd5b00044e0 con 0x562b45e82a50 2024-05-08T05:30:30.631 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:30.629+0000 7fd5acc00700 1 -- 172.21.15.87:0/806736513 <== mon.0 v2:172.21.15.87:3300/0 5 ==== fsmap(e 25) ==== 8338+0+0 (secure 0 0 0) 0x7fd5bc003a00 con 0x562b45e82a50 2024-05-08T05:30:30.631 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:30.629+0000 7fd5d44adb80 10 client.15102 fetch_fsmap finished waiting for FSMap version 25 2024-05-08T05:30:30.631 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:30.629+0000 7fd5d44adb80 10 client.15102 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-05-08T05:30:30.631 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:30.629+0000 7fd5d44adb80 20 client.15102 populate_metadata read hostname 'smithi087' 2024-05-08T05:30:30.631 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:30.629+0000 7fd5d44adb80 1 --2- 172.21.15.87:0/806736513 >> [v2:172.21.15.90:6838/160586017,v1:172.21.15.90:6839/160586017] conn(0x562b45f03040 0x562b45f05460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:30:30.631 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:30.629+0000 7fd5d44adb80 4 client.15102 mds_command: new command op to 24500 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-05-08T05:30:30.631 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:30.629+0000 7fd5d44adb80 1 -- 172.21.15.87:0/806736513 --> [v2:172.21.15.90:6838/160586017,v1:172.21.15.90:6839/160586017] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x562b45dde480 con 0x562b45f03040 2024-05-08T05:30:30.631 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:30.629+0000 7fd5c2a00700 1 --2- 172.21.15.87:0/806736513 >> [v2:172.21.15.90:6838/160586017,v1:172.21.15.90:6839/160586017] conn(0x562b45f03040 0x562b45f05460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:30:30.631 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:30.630+0000 7fd5c2a00700 1 --2- 172.21.15.87:0/806736513 >> [v2:172.21.15.90:6838/160586017,v1:172.21.15.90:6839/160586017] conn(0x562b45f03040 0x562b45f05460 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c5a44409304fa0d2 server_cookie=9e7b1f9e50c7ad6c in_seq=0 out_seq=0 2024-05-08T05:30:30.631 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:30.630+0000 7fd5acc00700 10 client.15102 ms_handle_connect on v2:172.21.15.90:6838/160586017 2024-05-08T05:30:30.632 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:30.631+0000 7fd5acc00700 1 -- 172.21.15.87:0/806736513 <== mds.0 v2:172.21.15.90:6838/160586017 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x562b45dde480 con 0x562b45f03040 2024-05-08T05:30:30.632 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:30.631+0000 7fd5acc00700 10 client.15102 handle_command_reply: tid=0 2024-05-08T05:30:30.632 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:30.631+0000 7fd5d44adb80 1 client.15102 shutdown 2024-05-08T05:30:30.633 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:30.631+0000 7fd5d44adb80 1 -- 172.21.15.87:0/806736513 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x562b45e82a50 msgr2=0x562b45e99560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:30:30.633 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:30.631+0000 7fd5d44adb80 1 --2- 172.21.15.87:0/806736513 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x562b45e82a50 0x562b45e99560 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fd5bc0df8c0 tx=0x7fd5bc0a8000 comp rx=0 tx=0).stop 2024-05-08T05:30:30.633 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:30.631+0000 7fd5d44adb80 1 -- 172.21.15.87:0/806736513 shutdown_connections 2024-05-08T05:30:30.633 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:30.631+0000 7fd5d44adb80 1 --2- 172.21.15.87:0/806736513 >> [v2:172.21.15.90:6838/160586017,v1:172.21.15.90:6839/160586017] conn(0x562b45f03040 0x562b45f05460 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:30:30.633 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:30.631+0000 7fd5d44adb80 1 --2- 172.21.15.87:0/806736513 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x562b45e82a50 0x562b45e99560 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:30:30.633 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:30.631+0000 7fd5d44adb80 1 --2- 172.21.15.87:0/806736513 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x562b45e7e0e0 0x562b45e9cbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:30:30.633 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:30.631+0000 7fd5d44adb80 1 --2- 172.21.15.87:0/806736513 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x562b45e7ea00 0x562b45e99020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:30:30.633 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:30.631+0000 7fd5acc00700 0 client.15102 ms_handle_reset on v2:172.21.15.90:6838/160586017 2024-05-08T05:30:30.634 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:30.632+0000 7fd5d44adb80 1 -- 172.21.15.87:0/806736513 >> 172.21.15.87:0/806736513 conn(0x562b45dacbe0 msgr2=0x562b45e88860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:30:30.634 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:30.632+0000 7fd5d44adb80 1 -- 172.21.15.87:0/806736513 shutdown_connections 2024-05-08T05:30:30.634 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:30.632+0000 7fd5d44adb80 1 -- 172.21.15.87:0/806736513 wait complete. 2024-05-08T05:30:30.634 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:30.632+0000 7fd5d44adb80 20 client.15102 trim_cache size 0 max 16384 2024-05-08T05:30:30.634 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-05-08T05:30:30.634 INFO:teuthology.orchestra.run.smithi087.stdout: "return_code": 0, 2024-05-08T05:30:30.634 INFO:teuthology.orchestra.run.smithi087.stdout: "scrub_tag": "b33134a7-7a7e-40bf-b98c-02aa39dabbfb", 2024-05-08T05:30:30.634 INFO:teuthology.orchestra.run.smithi087.stdout: "mode": "asynchronous" 2024-05-08T05:30:30.635 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-05-08T05:30:30.635 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:30.633+0000 7fd5c9c00700 1 -- 172.21.15.87:0/3867566888 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7fd5a80b2900 msgr2=0x7fd5a80b4dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:30:30.635 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:30.633+0000 7fd5c9c00700 1 --2- 172.21.15.87:0/3867566888 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7fd5a80b2900 0x7fd5a80b4dc0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fd5b40098e0 tx=0x7fd5b4005960 comp rx=0 tx=0).stop 2024-05-08T05:30:30.635 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:30.633+0000 7fd5c9c00700 1 -- 172.21.15.87:0/3867566888 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd5c4109600 msgr2=0x7fd5c41a0620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:30:30.635 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:30.633+0000 7fd5c9c00700 1 --2- 172.21.15.87:0/3867566888 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd5c4109600 0x7fd5c41a0620 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fd5bc00efc0 tx=0x7fd5bc00c3a0 comp rx=0 tx=0).stop 2024-05-08T05:30:30.635 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:30.633+0000 7fd5c9c00700 1 -- 172.21.15.87:0/3867566888 shutdown_connections 2024-05-08T05:30:30.635 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:30.633+0000 7fd5c9c00700 1 --2- 172.21.15.87:0/3867566888 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd5c4109600 0x7fd5c41a0620 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:30:30.636 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:30.633+0000 7fd5c9c00700 1 --2- 172.21.15.87:0/3867566888 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd5c41034f0 0x7fd5c419bd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:30:30.636 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:30.633+0000 7fd5c9c00700 1 --2- 172.21.15.87:0/3867566888 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7fd5a80b2900 0x7fd5a80b4dc0 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:30:30.636 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:30.633+0000 7fd5c9c00700 1 --2- 172.21.15.87:0/3867566888 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd5c4103eb0 0x7fd5c419c290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:30:30.636 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:30.633+0000 7fd5c9c00700 1 -- 172.21.15.87:0/3867566888 >> 172.21.15.87:0/3867566888 conn(0x7fd5c407a650 msgr2=0x7fd5c4101e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:30:30.636 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:30.633+0000 7fd5c9c00700 1 -- 172.21.15.87:0/3867566888 shutdown_connections 2024-05-08T05:30:30.636 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:30.634+0000 7fd5c9c00700 1 -- 172.21.15.87:0/3867566888 wait complete. 2024-05-08T05:30:30.701 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:30:30 smithi087 ceph-mon[29523]: pgmap v465: 97 pgs: 97 active+clean; 661 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-05-08T05:30:30.983 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:30:30 smithi090 ceph-mon[34526]: pgmap v465: 97 pgs: 97 active+clean; 661 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-05-08T05:30:31.038 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:30:30 smithi160 ceph-mon[34827]: pgmap v465: 97 pgs: 97 active+clean; 661 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-05-08T05:30:31.582 DEBUG:teuthology.orchestra.run.smithi087:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid eeeb813e-0cf9-11ef-bc97-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-05-08T05:30:31.958 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:30:31 smithi087 ceph-mon[29523]: scrub queued for path: / 2024-05-08T05:30:31.958 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:30:31 smithi087 ceph-mon[29523]: scrub summary: idle+waiting paths [/] 2024-05-08T05:30:31.958 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:30:31 smithi087 ceph-mon[29523]: scrub summary: active paths [/] 2024-05-08T05:30:31.958 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:30:31 smithi087 ceph-mon[29523]: scrub summary: idle+waiting paths [/] 2024-05-08T05:30:31.983 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:30:31 smithi090 ceph-mon[34526]: scrub queued for path: / 2024-05-08T05:30:31.983 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:30:31 smithi090 ceph-mon[34526]: scrub summary: idle+waiting paths [/] 2024-05-08T05:30:31.983 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:30:31 smithi090 ceph-mon[34526]: scrub summary: active paths [/] 2024-05-08T05:30:31.983 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:30:31 smithi090 ceph-mon[34526]: scrub summary: idle+waiting paths [/] 2024-05-08T05:30:32.038 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:30:31 smithi160 ceph-mon[34827]: scrub queued for path: / 2024-05-08T05:30:32.038 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:30:31 smithi160 ceph-mon[34827]: scrub summary: idle+waiting paths [/] 2024-05-08T05:30:32.039 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:30:31 smithi160 ceph-mon[34827]: scrub summary: active paths [/] 2024-05-08T05:30:32.039 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:30:31 smithi160 ceph-mon[34827]: scrub summary: idle+waiting paths [/] 2024-05-08T05:30:32.043 INFO:teuthology.orchestra.run.smithi087.stderr:Inferring config /var/lib/ceph/eeeb813e-0cf9-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T05:30:32.958 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:30:32 smithi087 ceph-mon[29523]: pgmap v466: 97 pgs: 97 active+clean; 661 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T05:30:32.983 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:30:32 smithi090 ceph-mon[34526]: pgmap v466: 97 pgs: 97 active+clean; 661 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T05:30:33.038 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:30:32 smithi160 ceph-mon[34827]: pgmap v466: 97 pgs: 97 active+clean; 661 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T05:30:33.708 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:30:33 smithi087 ceph-mon[29523]: scrub summary: idle 2024-05-08T05:30:33.983 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:30:33 smithi090 ceph-mon[34526]: scrub summary: idle 2024-05-08T05:30:34.039 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:30:33 smithi160 ceph-mon[34827]: scrub summary: idle 2024-05-08T05:30:34.285 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:34.283+0000 7fe94f800700 1 -- 172.21.15.87:0/3471749919 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe948075ff0 msgr2=0x7fe94810f960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:30:34.285 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:34.283+0000 7fe94f800700 1 --2- 172.21.15.87:0/3471749919 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe948075ff0 0x7fe94810f960 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fe934009990 tx=0x7fe934009ca0 comp rx=0 tx=0).stop 2024-05-08T05:30:34.285 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:34.283+0000 7fe94f800700 1 -- 172.21.15.87:0/3471749919 shutdown_connections 2024-05-08T05:30:34.285 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:34.283+0000 7fe94f800700 1 --2- 172.21.15.87:0/3471749919 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe94810fea0 0x7fe948112290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:30:34.285 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:34.283+0000 7fe94f800700 1 --2- 172.21.15.87:0/3471749919 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe9480756d0 0x7fe948075ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:30:34.285 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:34.283+0000 7fe94f800700 1 --2- 172.21.15.87:0/3471749919 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe948075ff0 0x7fe94810f960 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:30:34.285 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:34.283+0000 7fe94f800700 1 -- 172.21.15.87:0/3471749919 >> 172.21.15.87:0/3471749919 conn(0x7fe94807a650 msgr2=0x7fe94807aa60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:30:34.285 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:34.283+0000 7fe94f800700 1 -- 172.21.15.87:0/3471749919 shutdown_connections 2024-05-08T05:30:34.285 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:34.283+0000 7fe94f800700 1 -- 172.21.15.87:0/3471749919 wait complete. 2024-05-08T05:30:34.286 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:34.284+0000 7fe94f800700 1 Processor -- start 2024-05-08T05:30:34.287 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:34.284+0000 7fe94f800700 1 -- start start 2024-05-08T05:30:34.287 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:34.285+0000 7fe94f800700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe9480756d0 0x7fe94819be30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:30:34.287 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:34.285+0000 7fe94f800700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe948075ff0 0x7fe94819c370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:30:34.287 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:34.285+0000 7fe94f800700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe94810fea0 0x7fe9481a06b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:30:34.287 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:34.285+0000 7fe94f800700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fe9481158e0 con 0x7fe9480756d0 2024-05-08T05:30:34.287 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:34.285+0000 7fe94f800700 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fe948115760 con 0x7fe94810fea0 2024-05-08T05:30:34.287 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:34.285+0000 7fe94f800700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7fe948115a60 con 0x7fe948075ff0 2024-05-08T05:30:34.287 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:34.285+0000 7fe94ce00700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe9480756d0 0x7fe94819be30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:30:34.287 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:34.285+0000 7fe94ce00700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe9480756d0 0x7fe94819be30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:54348/0 (socket says 172.21.15.87:54348) 2024-05-08T05:30:34.287 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:34.285+0000 7fe94ce00700 1 -- 172.21.15.87:0/3945653864 learned_addr learned my addr 172.21.15.87:0/3945653864 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T05:30:34.287 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:34.285+0000 7fe947e00700 1 --2- 172.21.15.87:0/3945653864 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe948075ff0 0x7fe94819c370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:30:34.287 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:34.285+0000 7fe94d800700 1 --2- 172.21.15.87:0/3945653864 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe94810fea0 0x7fe9481a06b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:30:34.288 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:34.286+0000 7fe947e00700 1 -- 172.21.15.87:0/3945653864 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe94810fea0 msgr2=0x7fe9481a06b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:30:34.288 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:34.286+0000 7fe947e00700 1 --2- 172.21.15.87:0/3945653864 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe94810fea0 0x7fe9481a06b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:30:34.288 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:34.286+0000 7fe947e00700 1 -- 172.21.15.87:0/3945653864 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe9480756d0 msgr2=0x7fe94819be30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:30:34.288 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:34.286+0000 7fe947e00700 1 --2- 172.21.15.87:0/3945653864 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe9480756d0 0x7fe94819be30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:30:34.288 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:34.286+0000 7fe947e00700 1 -- 172.21.15.87:0/3945653864 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe9481a0df0 con 0x7fe948075ff0 2024-05-08T05:30:34.288 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:34.286+0000 7fe94ce00700 1 --2- 172.21.15.87:0/3945653864 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe9480756d0 0x7fe94819be30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T05:30:34.288 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:34.286+0000 7fe947e00700 1 --2- 172.21.15.87:0/3945653864 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe948075ff0 0x7fe94819c370 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fe9340059d0 tx=0x7fe9340047b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:30:34.289 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:34.286+0000 7fe945600700 1 -- 172.21.15.87:0/3945653864 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe934027070 con 0x7fe948075ff0 2024-05-08T05:30:34.289 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:34.286+0000 7fe94f800700 1 -- 172.21.15.87:0/3945653864 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe9481a1080 con 0x7fe948075ff0 2024-05-08T05:30:34.289 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:34.286+0000 7fe945600700 1 -- 172.21.15.87:0/3945653864 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe934022470 con 0x7fe948075ff0 2024-05-08T05:30:34.289 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:34.286+0000 7fe945600700 1 -- 172.21.15.87:0/3945653864 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe934017650 con 0x7fe948075ff0 2024-05-08T05:30:34.289 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:34.287+0000 7fe94f800700 1 -- 172.21.15.87:0/3945653864 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe9481a8960 con 0x7fe948075ff0 2024-05-08T05:30:34.291 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:34.290+0000 7fe945600700 1 -- 172.21.15.87:0/3945653864 <== mon.1 v2:172.21.15.160:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7fe93402a070 con 0x7fe948075ff0 2024-05-08T05:30:34.292 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:34.291+0000 7fe95a11fb80 1 Processor -- start 2024-05-08T05:30:34.292 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:34.291+0000 7fe95a11fb80 1 -- start start 2024-05-08T05:30:34.292 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:34.291+0000 7fe95a11fb80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x560d045ae060 0x560d045ae440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:30:34.293 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:34.291+0000 7fe95a11fb80 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x560d045ae980 0x560d045b2490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:30:34.293 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:34.291+0000 7fe95a11fb80 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x560d045b29d0 0x560d045b2e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:30:34.293 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:34.291+0000 7fe95a11fb80 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x560d04500a20 con 0x560d045ae980 2024-05-08T05:30:34.293 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:34.291+0000 7fe95a11fb80 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x560d0449e760 con 0x560d045b29d0 2024-05-08T05:30:34.293 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:34.291+0000 7fe95a11fb80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x560d044fc9e0 con 0x560d045ae060 2024-05-08T05:30:34.294 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:34.292+0000 7fe94d800700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x560d045ae060 0x560d045ae440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:30:34.294 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:34.292+0000 7fe94d800700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x560d045ae060 0x560d045ae440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.87:38050/0 (socket says 172.21.15.87:38050) 2024-05-08T05:30:34.294 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:34.292+0000 7fe94d800700 1 -- 172.21.15.87:0/2058939733 learned_addr learned my addr 172.21.15.87:0/2058939733 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T05:30:34.294 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:34.292+0000 7fe947e00700 1 --2- 172.21.15.87:0/2058939733 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x560d045b29d0 0x560d045b2e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:30:34.294 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:34.292+0000 7fe945600700 1 --2- 172.21.15.87:0/3945653864 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7fe9300b2880 0x7fe9300b4d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:30:34.294 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:34.292+0000 7fe94d800700 1 -- 172.21.15.87:0/2058939733 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x560d045b29d0 msgr2=0x560d045b2e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:30:34.294 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:34.292+0000 7fe94d800700 1 --2- 172.21.15.87:0/2058939733 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x560d045b29d0 0x560d045b2e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:30:34.294 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:34.292+0000 7fe945600700 1 -- 172.21.15.87:0/3945653864 <== mon.1 v2:172.21.15.160:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8190+0+0 (secure 0 0 0) 0x7fe9340e2f20 con 0x7fe948075ff0 2024-05-08T05:30:34.294 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:34.292+0000 7fe94d800700 1 -- 172.21.15.87:0/2058939733 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x560d045ae980 msgr2=0x560d045b2490 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-08T05:30:34.295 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:34.293+0000 7fe94ce00700 1 --2- 172.21.15.87:0/2058939733 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x560d045ae980 0x560d045b2490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:30:34.295 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:34.293+0000 7fe94d800700 1 --2- 172.21.15.87:0/2058939733 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x560d045ae980 0x560d045b2490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:30:34.295 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:34.293+0000 7fe94d800700 1 -- 172.21.15.87:0/2058939733 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560d0444d8d0 con 0x560d045ae060 2024-05-08T05:30:34.295 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:34.294+0000 7fe94d800700 1 --2- 172.21.15.87:0/3945653864 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7fe9300b2880 0x7fe9300b4d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:30:34.295 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:34.294+0000 7fe94ce00700 1 --2- 172.21.15.87:0/2058939733 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x560d045ae980 0x560d045b2490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T05:30:34.295 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:34.294+0000 7fe94d800700 1 --2- 172.21.15.87:0/2058939733 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x560d045ae060 0x560d045ae440 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fe940011680 tx=0x7fe940011990 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f257545bbd6d4150 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:30:34.296 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:34.294+0000 7fe93a000700 1 -- 172.21.15.87:0/2058939733 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe94001b070 con 0x560d045ae060 2024-05-08T05:30:34.296 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:34.294+0000 7fe93a000700 1 -- 172.21.15.87:0/2058939733 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe940017b00 con 0x560d045ae060 2024-05-08T05:30:34.296 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:34.294+0000 7fe93a000700 1 -- 172.21.15.87:0/2058939733 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe940021990 con 0x560d045ae060 2024-05-08T05:30:34.297 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:34.295+0000 7fe95a11fb80 1 -- 172.21.15.87:0/2058939733 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x560d045ae060 msgr2=0x560d045ae440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:30:34.297 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:34.295+0000 7fe94d800700 1 --2- 172.21.15.87:0/3945653864 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7fe9300b2880 0x7fe9300b4d40 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fe940020000 tx=0x7fe94001d000 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:30:34.297 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:34.295+0000 7fe95a11fb80 1 --2- 172.21.15.87:0/2058939733 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x560d045ae060 0x560d045ae440 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fe940011680 tx=0x7fe940011990 comp rx=0 tx=0).stop 2024-05-08T05:30:34.297 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:34.296+0000 7fe95a11fb80 1 -- 172.21.15.87:0/2058939733 shutdown_connections 2024-05-08T05:30:34.297 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:34.296+0000 7fe95a11fb80 1 --2- 172.21.15.87:0/2058939733 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x560d045b29d0 0x560d045b2e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:30:34.297 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:34.296+0000 7fe95a11fb80 1 --2- 172.21.15.87:0/2058939733 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x560d045ae060 0x560d045ae440 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:30:34.297 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:34.296+0000 7fe95a11fb80 1 --2- 172.21.15.87:0/2058939733 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x560d045ae980 0x560d045b2490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:30:34.297 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:34.296+0000 7fe95a11fb80 1 -- 172.21.15.87:0/2058939733 >> 172.21.15.87:0/2058939733 conn(0x560d044dcb60 msgr2=0x560d045a87a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:30:34.297 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:34.296+0000 7fe95a11fb80 1 -- 172.21.15.87:0/2058939733 shutdown_connections 2024-05-08T05:30:34.298 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:34.296+0000 7fe95a11fb80 1 -- 172.21.15.87:0/2058939733 wait complete. 2024-05-08T05:30:34.298 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:34.296+0000 7fe95a11fb80 1 -- start start 2024-05-08T05:30:34.299 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:34.297+0000 7fe95a11fb80 1 Processor -- start 2024-05-08T05:30:34.299 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:34.297+0000 7fe95a11fb80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x560d045ae060 0x560d045b9e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:30:34.299 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:34.297+0000 7fe95a11fb80 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x560d045ae980 0x560d045b71f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:30:34.299 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:34.297+0000 7fe95a11fb80 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x560d045b29d0 0x560d045b7730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:30:34.299 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:34.297+0000 7fe95a11fb80 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x560d045babe0 con 0x560d045ae980 2024-05-08T05:30:34.299 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:34.297+0000 7fe95a11fb80 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x560d04466b20 con 0x560d045b29d0 2024-05-08T05:30:34.299 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:34.297+0000 7fe95a11fb80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x560d045bad60 con 0x560d045ae060 2024-05-08T05:30:34.299 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:34.297+0000 7fe95a11fb80 10 client.0 _ll_register_callbacks cb 0x560d044a7c70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T05:30:34.299 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:34.297+0000 7fe947e00700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x560d045ae980 0x560d045b71f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:30:34.300 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:34.298+0000 7fe94ce00700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x560d045ae060 0x560d045b9e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:30:34.300 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:34.298+0000 7fe947e00700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x560d045ae980 0x560d045b71f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:54360/0 (socket says 172.21.15.87:54360) 2024-05-08T05:30:34.300 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:34.298+0000 7fe94d800700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x560d045b29d0 0x560d045b7730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:30:34.301 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:34.298+0000 7fe947e00700 1 -- 172.21.15.87:0/64963014 learned_addr learned my addr 172.21.15.87:0/64963014 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T05:30:34.301 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:34.298+0000 7fe94ce00700 1 -- 172.21.15.87:0/64963014 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x560d045b29d0 msgr2=0x560d045b7730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:30:34.301 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:34.298+0000 7fe94ce00700 1 --2- 172.21.15.87:0/64963014 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x560d045b29d0 0x560d045b7730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:30:34.301 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:34.298+0000 7fe94ce00700 1 -- 172.21.15.87:0/64963014 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x560d045ae980 msgr2=0x560d045b71f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:30:34.301 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:34.298+0000 7fe94ce00700 1 --2- 172.21.15.87:0/64963014 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x560d045ae980 0x560d045b71f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:30:34.301 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:34.298+0000 7fe94ce00700 1 -- 172.21.15.87:0/64963014 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560d044c6420 con 0x560d045ae060 2024-05-08T05:30:34.301 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:34.298+0000 7fe94d800700 1 --2- 172.21.15.87:0/64963014 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x560d045b29d0 0x560d045b7730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T05:30:34.301 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:34.298+0000 7fe94ce00700 1 --2- 172.21.15.87:0/64963014 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x560d045ae060 0x560d045b9e50 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fe93c0117a0 tx=0x7fe93c011ab0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=82d29c4f96e02f37 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:30:34.301 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:34.298+0000 7fe92ea00700 10 client.0 ms_handle_connect on v2:172.21.15.160:3300/0 2024-05-08T05:30:34.301 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:34.299+0000 7fe92ea00700 1 -- 172.21.15.87:0/64963014 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe93c004310 con 0x560d045ae060 2024-05-08T05:30:34.301 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:34.299+0000 7fe92ea00700 1 -- 172.21.15.87:0/64963014 <== mon.1 v2:172.21.15.160:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8190+0+0 (secure 0 0 0) 0x7fe93c0044b0 con 0x560d045ae060 2024-05-08T05:30:34.301 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:34.299+0000 7fe95a11fb80 1 -- 172.21.15.87:0/64963014 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe940017b00 con 0x560d045ae060 2024-05-08T05:30:34.301 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:34.299+0000 7fe92ea00700 1 -- 172.21.15.87:0/64963014 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fe93c003680 con 0x560d045ae060 2024-05-08T05:30:34.301 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:34.299+0000 7fe95a11fb80 10 client.25219 fetch_fsmap learned FSMap version 25 2024-05-08T05:30:34.302 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:34.299+0000 7fe95a11fb80 1 -- 172.21.15.87:0/64963014 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x560d045cdc20 con 0x560d045ae060 2024-05-08T05:30:34.302 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:34.299+0000 7fe92ea00700 1 -- 172.21.15.87:0/64963014 <== mon.1 v2:172.21.15.160:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe940017b00 con 0x560d045ae060 2024-05-08T05:30:34.303 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:34.300+0000 7fe92ea00700 1 -- 172.21.15.87:0/64963014 <== mon.1 v2:172.21.15.160:3300/0 5 ==== fsmap(e 25) ==== 8338+0+0 (secure 0 0 0) 0x7fe93c012a50 con 0x560d045ae060 2024-05-08T05:30:34.303 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:34.300+0000 7fe95a11fb80 10 client.25219 fetch_fsmap finished waiting for FSMap version 25 2024-05-08T05:30:34.303 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:34.300+0000 7fe95a11fb80 10 client.25219 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-05-08T05:30:34.303 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:34.300+0000 7fe95a11fb80 20 client.25219 populate_metadata read hostname 'smithi087' 2024-05-08T05:30:34.303 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:34.300+0000 7fe95a11fb80 1 --2- 172.21.15.87:0/64963014 >> [v2:172.21.15.90:6838/160586017,v1:172.21.15.90:6839/160586017] conn(0x560d045d0260 0x560d045d2690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:30:34.303 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:34.300+0000 7fe95a11fb80 4 client.25219 mds_command: new command op to 24500 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-08T05:30:34.303 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:34.300+0000 7fe95a11fb80 1 -- 172.21.15.87:0/64963014 --> [v2:172.21.15.90:6838/160586017,v1:172.21.15.90:6839/160586017] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x560d0457b0a0 con 0x560d045d0260 2024-05-08T05:30:34.303 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:34.300+0000 7fe947e00700 1 --2- 172.21.15.87:0/64963014 >> [v2:172.21.15.90:6838/160586017,v1:172.21.15.90:6839/160586017] conn(0x560d045d0260 0x560d045d2690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:30:34.303 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:34.301+0000 7fe92ea00700 10 client.25219 ms_handle_connect on v2:172.21.15.90:6838/160586017 2024-05-08T05:30:34.303 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:34.301+0000 7fe947e00700 1 --2- 172.21.15.87:0/64963014 >> [v2:172.21.15.90:6838/160586017,v1:172.21.15.90:6839/160586017] conn(0x560d045d0260 0x560d045d2690 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d70907cfc7a0a92 server_cookie=a893d56460f0d6a9 in_seq=0 out_seq=0 2024-05-08T05:30:34.303 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:34.302+0000 7fe92ea00700 1 -- 172.21.15.87:0/64963014 <== mds.0 v2:172.21.15.90:6838/160586017 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x560d0457b0a0 con 0x560d045d0260 2024-05-08T05:30:34.303 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:34.302+0000 7fe92ea00700 10 client.25219 handle_command_reply: tid=0 2024-05-08T05:30:34.304 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:34.302+0000 7fe95a11fb80 1 client.25219 shutdown 2024-05-08T05:30:34.304 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:34.302+0000 7fe95a11fb80 1 -- 172.21.15.87:0/64963014 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x560d045ae060 msgr2=0x560d045b9e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:30:34.304 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:34.302+0000 7fe95a11fb80 1 --2- 172.21.15.87:0/64963014 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x560d045ae060 0x560d045b9e50 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fe93c0117a0 tx=0x7fe93c011ab0 comp rx=0 tx=0).stop 2024-05-08T05:30:34.304 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:34.302+0000 7fe95a11fb80 1 -- 172.21.15.87:0/64963014 shutdown_connections 2024-05-08T05:30:34.305 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:34.302+0000 7fe95a11fb80 1 --2- 172.21.15.87:0/64963014 >> [v2:172.21.15.90:6838/160586017,v1:172.21.15.90:6839/160586017] conn(0x560d045d0260 0x560d045d2690 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:30:34.305 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:34.302+0000 7fe95a11fb80 1 --2- 172.21.15.87:0/64963014 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x560d045b29d0 0x560d045b7730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:30:34.305 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:34.302+0000 7fe95a11fb80 1 --2- 172.21.15.87:0/64963014 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x560d045ae060 0x560d045b9e50 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:30:34.305 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:34.302+0000 7fe95a11fb80 1 --2- 172.21.15.87:0/64963014 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x560d045ae980 0x560d045b71f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:30:34.305 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:34.302+0000 7fe95a11fb80 1 -- 172.21.15.87:0/64963014 >> 172.21.15.87:0/64963014 conn(0x560d044dcb60 msgr2=0x560d045a32b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:30:34.305 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:34.302+0000 7fe92ea00700 0 client.25219 ms_handle_reset on v2:172.21.15.90:6838/160586017 2024-05-08T05:30:34.305 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:34.302+0000 7fe95a11fb80 1 -- 172.21.15.87:0/64963014 shutdown_connections 2024-05-08T05:30:34.305 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:34.302+0000 7fe95a11fb80 1 -- 172.21.15.87:0/64963014 wait complete. 2024-05-08T05:30:34.305 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:34.303+0000 7fe95a11fb80 20 client.25219 trim_cache size 0 max 16384 2024-05-08T05:30:34.335 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:34.333+0000 7fe95a11fb80 1 Processor -- start 2024-05-08T05:30:34.335 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:34.333+0000 7fe95a11fb80 1 -- start start 2024-05-08T05:30:34.335 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:34.334+0000 7fe95a11fb80 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x560d045ae060 0x560d045cc500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:30:34.335 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:34.334+0000 7fe95a11fb80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x560d045ae980 0x560d045a3130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:30:34.336 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:34.334+0000 7fe95a11fb80 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x560d045b29d0 0x560d045b2db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:30:34.336 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:34.334+0000 7fe95a11fb80 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fe9481ae0a0 con 0x560d045b29d0 2024-05-08T05:30:34.336 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:34.334+0000 7fe95a11fb80 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fe9481ab930 con 0x560d045ae060 2024-05-08T05:30:34.336 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:34.334+0000 7fe95a11fb80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7fe948107360 con 0x560d045ae980 2024-05-08T05:30:34.337 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:34.334+0000 7fe94d800700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x560d045b29d0 0x560d045b2db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:30:34.337 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:34.334+0000 7fe94ce00700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x560d045ae060 0x560d045cc500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:30:34.337 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:34.334+0000 7fe947e00700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x560d045ae980 0x560d045a3130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:30:34.337 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:34.334+0000 7fe94ce00700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x560d045ae060 0x560d045cc500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.87:41466/0 (socket says 172.21.15.87:41466) 2024-05-08T05:30:34.337 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:34.334+0000 7fe94ce00700 1 -- 172.21.15.87:0/695317755 learned_addr learned my addr 172.21.15.87:0/695317755 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T05:30:34.337 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:34.335+0000 7fe94ce00700 1 -- 172.21.15.87:0/695317755 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x560d045ae980 msgr2=0x560d045a3130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:30:34.337 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:34.335+0000 7fe94ce00700 1 --2- 172.21.15.87:0/695317755 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x560d045ae980 0x560d045a3130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:30:34.337 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:34.335+0000 7fe94ce00700 1 -- 172.21.15.87:0/695317755 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x560d045b29d0 msgr2=0x560d045b2db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:30:34.337 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:34.335+0000 7fe94ce00700 1 --2- 172.21.15.87:0/695317755 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x560d045b29d0 0x560d045b2db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:30:34.337 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:34.335+0000 7fe94ce00700 1 -- 172.21.15.87:0/695317755 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560d045a99c0 con 0x560d045ae060 2024-05-08T05:30:34.337 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:34.335+0000 7fe94ce00700 1 --2- 172.21.15.87:0/695317755 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x560d045ae060 0x560d045cc500 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fe93c012ec0 tx=0x7fe93c005c20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=183dc08a1b60a068 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:30:34.338 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:34.335+0000 7fe939600700 1 -- 172.21.15.87:0/695317755 <== mon.2 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe93c004310 con 0x560d045ae060 2024-05-08T05:30:34.338 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:34.335+0000 7fe939600700 1 -- 172.21.15.87:0/695317755 <== mon.2 v2:172.21.15.90:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe93c0044b0 con 0x560d045ae060 2024-05-08T05:30:34.338 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:34.335+0000 7fe939600700 1 -- 172.21.15.87:0/695317755 <== mon.2 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe93c012bc0 con 0x560d045ae060 2024-05-08T05:30:34.339 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:34.336+0000 7fe95a11fb80 1 -- 172.21.15.87:0/695317755 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x560d045ae060 msgr2=0x560d045cc500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:30:34.340 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:34.336+0000 7fe95a11fb80 1 --2- 172.21.15.87:0/695317755 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x560d045ae060 0x560d045cc500 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fe93c012ec0 tx=0x7fe93c005c20 comp rx=0 tx=0).stop 2024-05-08T05:30:34.340 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:34.336+0000 7fe95a11fb80 1 -- 172.21.15.87:0/695317755 shutdown_connections 2024-05-08T05:30:34.340 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:34.336+0000 7fe95a11fb80 1 --2- 172.21.15.87:0/695317755 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x560d045b29d0 0x560d045b2db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:30:34.340 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:34.336+0000 7fe95a11fb80 1 --2- 172.21.15.87:0/695317755 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x560d045ae060 0x560d045cc500 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:30:34.340 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:34.336+0000 7fe95a11fb80 1 --2- 172.21.15.87:0/695317755 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x560d045ae980 0x560d045a3130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:30:34.340 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:34.336+0000 7fe95a11fb80 1 -- 172.21.15.87:0/695317755 >> 172.21.15.87:0/695317755 conn(0x560d044dcb60 msgr2=0x560d045a2a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:30:34.340 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:34.336+0000 7fe95a11fb80 1 -- 172.21.15.87:0/695317755 shutdown_connections 2024-05-08T05:30:34.340 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:34.336+0000 7fe95a11fb80 1 -- 172.21.15.87:0/695317755 wait complete. 2024-05-08T05:30:34.340 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:34.337+0000 7fe95a11fb80 1 -- start start 2024-05-08T05:30:34.340 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:34.337+0000 7fe95a11fb80 1 Processor -- start 2024-05-08T05:30:34.340 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:34.338+0000 7fe95a11fb80 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x560d045ae060 0x560d045c8880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:30:34.341 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:34.338+0000 7fe95a11fb80 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x560d045ae980 0x560d045c8dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:30:34.341 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:34.338+0000 7fe95a11fb80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x560d045b29d0 0x560d045c5850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:30:34.341 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:34.338+0000 7fe95a11fb80 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fe9481a9e10 con 0x560d045ae980 2024-05-08T05:30:34.341 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:34.338+0000 7fe95a11fb80 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fe9481ab260 con 0x560d045ae060 2024-05-08T05:30:34.341 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:34.338+0000 7fe95a11fb80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7fe9481aa4c0 con 0x560d045b29d0 2024-05-08T05:30:34.341 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:34.338+0000 7fe95a11fb80 10 client.0 _ll_register_callbacks cb 0x560d044a7c70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T05:30:34.341 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:34.338+0000 7fe947e00700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x560d045ae980 0x560d045c8dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:30:34.341 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:34.338+0000 7fe947e00700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x560d045ae980 0x560d045c8dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:54390/0 (socket says 172.21.15.87:54390) 2024-05-08T05:30:34.341 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:34.338+0000 7fe947e00700 1 -- 172.21.15.87:0/1538087203 learned_addr learned my addr 172.21.15.87:0/1538087203 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T05:30:34.341 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:34.338+0000 7fe94d800700 1 --2- 172.21.15.87:0/1538087203 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x560d045b29d0 0x560d045c5850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:30:34.341 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:34.338+0000 7fe947e00700 1 -- 172.21.15.87:0/1538087203 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x560d045b29d0 msgr2=0x560d045c5850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:30:34.341 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:34.338+0000 7fe947e00700 1 --2- 172.21.15.87:0/1538087203 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x560d045b29d0 0x560d045c5850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:30:34.341 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:34.338+0000 7fe947e00700 1 -- 172.21.15.87:0/1538087203 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x560d045ae060 msgr2=0x560d045c8880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:30:34.341 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:34.338+0000 7fe94ce00700 1 --2- 172.21.15.87:0/1538087203 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x560d045ae060 0x560d045c8880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:30:34.342 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:34.338+0000 7fe947e00700 1 --2- 172.21.15.87:0/1538087203 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x560d045ae060 0x560d045c8880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:30:34.342 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:34.338+0000 7fe947e00700 1 -- 172.21.15.87:0/1538087203 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560d045c5d90 con 0x560d045ae980 2024-05-08T05:30:34.344 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:34.339+0000 7fe947e00700 1 --2- 172.21.15.87:0/1538087203 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x560d045ae980 0x560d045c8dc0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fe9340e0990 tx=0x7fe934022ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=610c53255c1de53 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:30:34.344 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:34.339+0000 7fe92ea00700 10 client.0 ms_handle_connect on v2:172.21.15.87:3300/0 2024-05-08T05:30:34.344 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:34.339+0000 7fe92ea00700 1 -- 172.21.15.87:0/1538087203 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9340a9d10 con 0x560d045ae980 2024-05-08T05:30:34.344 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:34.339+0000 7fe92ea00700 1 -- 172.21.15.87:0/1538087203 <== mon.0 v2:172.21.15.87:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8190+0+0 (secure 0 0 0) 0x7fe9340aa800 con 0x560d045ae980 2024-05-08T05:30:34.344 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:34.339+0000 7fe95a11fb80 1 -- 172.21.15.87:0/1538087203 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe93c0044b0 con 0x560d045ae980 2024-05-08T05:30:34.344 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:34.339+0000 7fe92ea00700 1 -- 172.21.15.87:0/1538087203 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fe9340aa0b0 con 0x560d045ae980 2024-05-08T05:30:34.344 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:34.339+0000 7fe95a11fb80 10 client.15117 fetch_fsmap learned FSMap version 25 2024-05-08T05:30:34.344 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:34.339+0000 7fe95a11fb80 1 -- 172.21.15.87:0/1538087203 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x560d0463b300 con 0x560d045ae980 2024-05-08T05:30:34.344 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:34.340+0000 7fe92ea00700 1 -- 172.21.15.87:0/1538087203 <== mon.0 v2:172.21.15.87:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe93c0044b0 con 0x560d045ae980 2024-05-08T05:30:34.344 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:34.340+0000 7fe92ea00700 1 -- 172.21.15.87:0/1538087203 <== mon.0 v2:172.21.15.87:3300/0 5 ==== fsmap(e 25) ==== 8338+0+0 (secure 0 0 0) 0x7fe9340b2ee0 con 0x560d045ae980 2024-05-08T05:30:34.344 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:34.340+0000 7fe95a11fb80 10 client.15117 fetch_fsmap finished waiting for FSMap version 25 2024-05-08T05:30:34.344 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:34.340+0000 7fe95a11fb80 10 client.15117 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-05-08T05:30:34.344 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:34.340+0000 7fe95a11fb80 20 client.15117 populate_metadata read hostname 'smithi087' 2024-05-08T05:30:34.345 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:34.340+0000 7fe95a11fb80 1 --2- 172.21.15.87:0/1538087203 >> [v2:172.21.15.90:6838/160586017,v1:172.21.15.90:6839/160586017] conn(0x560d0463ba10 0x560d0463de30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:30:34.345 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:34.340+0000 7fe95a11fb80 4 client.15117 mds_command: new command op to 24500 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-05-08T05:30:34.345 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:34.340+0000 7fe95a11fb80 1 -- 172.21.15.87:0/1538087203 --> [v2:172.21.15.90:6838/160586017,v1:172.21.15.90:6839/160586017] -- command(tid 0: {"prefix": "scrub status"}) -- 0x560d0450e400 con 0x560d0463ba10 2024-05-08T05:30:34.345 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:34.340+0000 7fe94ce00700 1 --2- 172.21.15.87:0/1538087203 >> [v2:172.21.15.90:6838/160586017,v1:172.21.15.90:6839/160586017] conn(0x560d0463ba10 0x560d0463de30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:30:34.345 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:34.341+0000 7fe92ea00700 10 client.15117 ms_handle_connect on v2:172.21.15.90:6838/160586017 2024-05-08T05:30:34.345 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:34.341+0000 7fe94ce00700 1 --2- 172.21.15.87:0/1538087203 >> [v2:172.21.15.90:6838/160586017,v1:172.21.15.90:6839/160586017] conn(0x560d0463ba10 0x560d0463de30 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ef07dccc9e463fef server_cookie=e314c70cc5e0aa2d in_seq=0 out_seq=0 2024-05-08T05:30:34.345 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:34.341+0000 7fe92ea00700 1 -- 172.21.15.87:0/1538087203 <== mds.0 v2:172.21.15.90:6838/160586017 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x560d0450e400 con 0x560d0463ba10 2024-05-08T05:30:34.345 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:34.341+0000 7fe92ea00700 10 client.15117 handle_command_reply: tid=0 2024-05-08T05:30:34.345 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:34.341+0000 7fe95a11fb80 1 client.15117 shutdown 2024-05-08T05:30:34.345 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:34.341+0000 7fe95a11fb80 1 -- 172.21.15.87:0/1538087203 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x560d045ae980 msgr2=0x560d045c8dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:30:34.345 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:34.341+0000 7fe95a11fb80 1 --2- 172.21.15.87:0/1538087203 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x560d045ae980 0x560d045c8dc0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fe9340e0990 tx=0x7fe934022ce0 comp rx=0 tx=0).stop 2024-05-08T05:30:34.345 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:34.342+0000 7fe95a11fb80 1 -- 172.21.15.87:0/1538087203 shutdown_connections 2024-05-08T05:30:34.345 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:34.342+0000 7fe95a11fb80 1 --2- 172.21.15.87:0/1538087203 >> [v2:172.21.15.90:6838/160586017,v1:172.21.15.90:6839/160586017] conn(0x560d0463ba10 0x560d0463de30 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:30:34.345 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:34.342+0000 7fe95a11fb80 1 --2- 172.21.15.87:0/1538087203 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x560d045b29d0 0x560d045c5850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:30:34.345 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:34.342+0000 7fe95a11fb80 1 --2- 172.21.15.87:0/1538087203 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x560d045ae060 0x560d045c8880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:30:34.346 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:34.342+0000 7fe95a11fb80 1 --2- 172.21.15.87:0/1538087203 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x560d045ae980 0x560d045c8dc0 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:30:34.346 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:34.342+0000 7fe95a11fb80 1 -- 172.21.15.87:0/1538087203 >> 172.21.15.87:0/1538087203 conn(0x560d044dcb60 msgr2=0x560d045a32b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:30:34.346 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:34.342+0000 7fe92ea00700 0 client.15117 ms_handle_reset on v2:172.21.15.90:6838/160586017 2024-05-08T05:30:34.346 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:34.342+0000 7fe95a11fb80 1 -- 172.21.15.87:0/1538087203 shutdown_connections 2024-05-08T05:30:34.346 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:34.342+0000 7fe95a11fb80 1 -- 172.21.15.87:0/1538087203 wait complete. 2024-05-08T05:30:34.346 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:34.342+0000 7fe95a11fb80 20 client.15117 trim_cache size 0 max 16384 2024-05-08T05:30:34.346 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-05-08T05:30:34.346 INFO:teuthology.orchestra.run.smithi087.stdout: "status": "no active scrubs running", 2024-05-08T05:30:34.346 INFO:teuthology.orchestra.run.smithi087.stdout: "scrubs": {} 2024-05-08T05:30:34.347 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-05-08T05:30:34.347 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:34.343+0000 7fe94f800700 1 -- 172.21.15.87:0/3945653864 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7fe9300b2880 msgr2=0x7fe9300b4d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:30:34.347 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:34.343+0000 7fe94f800700 1 --2- 172.21.15.87:0/3945653864 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7fe9300b2880 0x7fe9300b4d40 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fe940020000 tx=0x7fe94001d000 comp rx=0 tx=0).stop 2024-05-08T05:30:34.347 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:34.343+0000 7fe94f800700 1 -- 172.21.15.87:0/3945653864 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe948075ff0 msgr2=0x7fe94819c370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:30:34.347 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:34.343+0000 7fe94f800700 1 --2- 172.21.15.87:0/3945653864 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe948075ff0 0x7fe94819c370 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fe9340059d0 tx=0x7fe9340047b0 comp rx=0 tx=0).stop 2024-05-08T05:30:34.347 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:34.343+0000 7fe94f800700 1 -- 172.21.15.87:0/3945653864 shutdown_connections 2024-05-08T05:30:34.347 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:34.343+0000 7fe94f800700 1 --2- 172.21.15.87:0/3945653864 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe94810fea0 0x7fe9481a06b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:30:34.348 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:34.343+0000 7fe94f800700 1 --2- 172.21.15.87:0/3945653864 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe9480756d0 0x7fe94819be30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:30:34.348 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:34.343+0000 7fe94f800700 1 --2- 172.21.15.87:0/3945653864 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7fe9300b2880 0x7fe9300b4d40 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:30:34.348 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:34.343+0000 7fe94f800700 1 --2- 172.21.15.87:0/3945653864 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe948075ff0 0x7fe94819c370 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:30:34.348 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:34.343+0000 7fe94f800700 1 -- 172.21.15.87:0/3945653864 >> 172.21.15.87:0/3945653864 conn(0x7fe94807a650 msgr2=0x7fe948100750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:30:34.348 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:34.343+0000 7fe94f800700 1 -- 172.21.15.87:0/3945653864 shutdown_connections 2024-05-08T05:30:34.348 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:34.343+0000 7fe94f800700 1 -- 172.21.15.87:0/3945653864 wait complete. 2024-05-08T05:30:34.958 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:30:34 smithi087 ceph-mon[29523]: pgmap v467: 97 pgs: 97 active+clean; 661 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-05-08T05:30:34.983 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:30:34 smithi090 ceph-mon[34526]: pgmap v467: 97 pgs: 97 active+clean; 661 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-05-08T05:30:35.039 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:30:34 smithi160 ceph-mon[34827]: pgmap v467: 97 pgs: 97 active+clean; 661 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-05-08T05:30:35.314 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-05-08T05:30:35.315 DEBUG:teuthology.orchestra.run.smithi087:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid eeeb813e-0cf9-11ef-bc97-c7b262605968 -- ceph fs dump --format=json 2024-05-08T05:30:35.795 INFO:teuthology.orchestra.run.smithi087.stderr:Inferring config /var/lib/ceph/eeeb813e-0cf9-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T05:30:36.959 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:30:36 smithi087 ceph-mon[29523]: pgmap v468: 97 pgs: 97 active+clean; 661 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 6 op/s 2024-05-08T05:30:36.983 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:30:36 smithi090 ceph-mon[34526]: pgmap v468: 97 pgs: 97 active+clean; 661 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 6 op/s 2024-05-08T05:30:37.038 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:30:36 smithi160 ceph-mon[34827]: pgmap v468: 97 pgs: 97 active+clean; 661 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 6 op/s 2024-05-08T05:30:37.967 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:37.966+0000 7f1a5fc00700 1 -- 172.21.15.87:0/1737450043 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1a58114670 msgr2=0x7f1a58116a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:30:37.967 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:37.966+0000 7f1a5fc00700 1 --2- 172.21.15.87:0/1737450043 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1a58114670 0x7f1a58116a60 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f1a5000b0a0 tx=0x7f1a5000b3b0 comp rx=0 tx=0).stop 2024-05-08T05:30:37.967 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:37.966+0000 7f1a5fc00700 1 -- 172.21.15.87:0/1737450043 shutdown_connections 2024-05-08T05:30:37.967 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:37.966+0000 7f1a5fc00700 1 --2- 172.21.15.87:0/1737450043 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1a58114670 0x7f1a58116a60 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:30:37.967 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:37.966+0000 7f1a5fc00700 1 --2- 172.21.15.87:0/1737450043 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1a580756d0 0x7f1a58075ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:30:37.967 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:37.966+0000 7f1a5fc00700 1 --2- 172.21.15.87:0/1737450043 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1a58075ff0 0x7f1a58114130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:30:37.967 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:37.966+0000 7f1a5fc00700 1 -- 172.21.15.87:0/1737450043 >> 172.21.15.87:0/1737450043 conn(0x7f1a5807a650 msgr2=0x7f1a5807aa60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:30:37.967 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:37.966+0000 7f1a5fc00700 1 -- 172.21.15.87:0/1737450043 shutdown_connections 2024-05-08T05:30:37.968 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:37.966+0000 7f1a5fc00700 1 -- 172.21.15.87:0/1737450043 wait complete. 2024-05-08T05:30:37.968 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:37.967+0000 7f1a5fc00700 1 Processor -- start 2024-05-08T05:30:37.968 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:37.968+0000 7f1a5fc00700 1 -- start start 2024-05-08T05:30:37.969 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:37.968+0000 7f1a5fc00700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1a580756d0 0x7f1a581a0110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:30:37.969 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:37.968+0000 7f1a5fc00700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1a58075ff0 0x7f1a581a0650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:30:37.969 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:37.968+0000 7f1a5fc00700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1a58114670 0x7f1a581a49e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:30:37.969 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:37.968+0000 7f1a5fc00700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f1a58119d00 con 0x7f1a580756d0 2024-05-08T05:30:37.969 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:37.968+0000 7f1a5fc00700 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f1a58119b80 con 0x7f1a58114670 2024-05-08T05:30:37.969 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:37.968+0000 7f1a5fc00700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f1a58119e80 con 0x7f1a58075ff0 2024-05-08T05:30:37.970 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:37.969+0000 7f1a57e00700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1a58075ff0 0x7f1a581a0650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:30:37.970 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:37.969+0000 7f1a5dc00700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1a58114670 0x7f1a581a49e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:30:37.970 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:37.969+0000 7f1a57e00700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1a58075ff0 0x7f1a581a0650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.87:32998/0 (socket says 172.21.15.87:32998) 2024-05-08T05:30:37.970 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:37.969+0000 7f1a57e00700 1 -- 172.21.15.87:0/487759665 learned_addr learned my addr 172.21.15.87:0/487759665 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T05:30:37.970 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:37.969+0000 7f1a57e00700 1 -- 172.21.15.87:0/487759665 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1a58114670 msgr2=0x7f1a581a49e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:30:37.970 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:37.969+0000 7f1a57e00700 1 --2- 172.21.15.87:0/487759665 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1a58114670 0x7f1a581a49e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:30:37.970 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:37.969+0000 7f1a57e00700 1 -- 172.21.15.87:0/487759665 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1a580756d0 msgr2=0x7f1a581a0110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:30:37.971 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:37.969+0000 7f1a57e00700 1 --2- 172.21.15.87:0/487759665 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1a580756d0 0x7f1a581a0110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:30:37.971 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:37.969+0000 7f1a57e00700 1 -- 172.21.15.87:0/487759665 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1a581a5120 con 0x7f1a58075ff0 2024-05-08T05:30:37.971 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:37.970+0000 7f1a57e00700 1 --2- 172.21.15.87:0/487759665 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1a58075ff0 0x7f1a581a0650 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f1a4400e9c0 tx=0x7f1a4400ecd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:30:37.971 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:37.970+0000 7f1a55600700 1 -- 172.21.15.87:0/487759665 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a4400cbd0 con 0x7f1a58075ff0 2024-05-08T05:30:37.971 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:37.970+0000 7f1a55600700 1 -- 172.21.15.87:0/487759665 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1a4400cd70 con 0x7f1a58075ff0 2024-05-08T05:30:37.972 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:37.970+0000 7f1a55600700 1 -- 172.21.15.87:0/487759665 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a44005680 con 0x7f1a58075ff0 2024-05-08T05:30:37.972 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:37.970+0000 7f1a5fc00700 1 -- 172.21.15.87:0/487759665 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1a581a5410 con 0x7f1a58075ff0 2024-05-08T05:30:37.972 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:37.970+0000 7f1a5fc00700 1 -- 172.21.15.87:0/487759665 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1a581acc90 con 0x7f1a58075ff0 2024-05-08T05:30:37.972 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:37.972+0000 7f1a5fc00700 1 -- 172.21.15.87:0/487759665 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1a5806a190 con 0x7f1a58075ff0 2024-05-08T05:30:37.974 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:37.974+0000 7f1a55600700 1 -- 172.21.15.87:0/487759665 <== mon.1 v2:172.21.15.160:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7f1a44004750 con 0x7f1a58075ff0 2024-05-08T05:30:37.976 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:37.976+0000 7f1a55600700 1 --2- 172.21.15.87:0/487759665 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f1a400b2900 0x7f1a400b4dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:30:37.976 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:37.976+0000 7f1a55600700 1 -- 172.21.15.87:0/487759665 <== mon.1 v2:172.21.15.160:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8190+0+0 (secure 0 0 0) 0x7f1a440e2410 con 0x7f1a58075ff0 2024-05-08T05:30:37.976 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:37.976+0000 7f1a5d200700 1 --2- 172.21.15.87:0/487759665 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f1a400b2900 0x7f1a400b4dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:30:37.977 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:37.977+0000 7f1a5d200700 1 --2- 172.21.15.87:0/487759665 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f1a400b2900 0x7f1a400b4dc0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f1a4c005950 tx=0x7f1a4c0058e0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:30:37.979 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:37.979+0000 7f1a55600700 1 -- 172.21.15.87:0/487759665 <== mon.1 v2:172.21.15.160:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f1a440aa100 con 0x7f1a58075ff0 2024-05-08T05:30:38.292 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:38.292+0000 7f1a5fc00700 1 -- 172.21.15.87:0/487759665 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f1a581acef0 con 0x7f1a58075ff0 2024-05-08T05:30:38.293 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:38.293+0000 7f1a55600700 1 -- 172.21.15.87:0/487759665 <== mon.1 v2:172.21.15.160:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) ==== 94+0+11858 (secure 0 0 0) 0x7f1a440a9a00 con 0x7f1a58075ff0 2024-05-08T05:30:38.294 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-05-08T05:30:38.294 INFO:teuthology.orchestra.run.smithi087.stdout:{"epoch":25,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14358,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6835/1183985321","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6834","nonce":1183985321},{"type":"v1","addr":"172.21.15.87:6835","nonce":1183985321}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14370,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6837/1485824316","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6836","nonce":1485824316},{"type":"v1","addr":"172.21.15.87:6837","nonce":1485824316}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14409,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6841/724277538","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6840","nonce":724277538},{"type":"v1","addr":"172.21.15.87:6841","nonce":724277538}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24412,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6833/3339455985","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6832","nonce":3339455985},{"type":"v1","addr":"172.21.15.160:6833","nonce":3339455985}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24413,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6833/3292166873","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6832","nonce":3292166873},{"type":"v1","addr":"172.21.15.90:6833","nonce":3292166873}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24443,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6835/824555459","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6834","nonce":824555459},{"type":"v1","addr":"172.21.15.90:6835","nonce":824555459}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6}],"filesystems":[{"mdsmap":{"epoch":25,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-05-08T05:25:36.816840+0000","modified":"2024-05-08T05:29:16.624018+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24500,"mds_1":24482,"mds_2":24481},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24463":{"gid":24463,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.160:6835/409648357","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6834","nonce":409648357},{"type":"v1","addr":"172.21.15.160:6835","nonce":409648357}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24467":{"gid":24467,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.90:6837/4221919418","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6836","nonce":4221919418},{"type":"v1","addr":"172.21.15.90:6837","nonce":4221919418}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24469":{"gid":24469,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.160:6837/4200018040","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6836","nonce":4200018040},{"type":"v1","addr":"172.21.15.160:6837","nonce":4200018040}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24481":{"gid":24481,"name":"i","rank":2,"incarnation":20,"state":"up:active","state_seq":13,"addr":"172.21.15.160:6839/234657686","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6838","nonce":234657686},{"type":"v1","addr":"172.21.15.160:6839","nonce":234657686}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24482":{"gid":24482,"name":"g","rank":1,"incarnation":18,"state":"up:active","state_seq":12,"addr":"172.21.15.87:6839/2127215876","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6838","nonce":2127215876},{"type":"v1","addr":"172.21.15.87:6839","nonce":2127215876}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24500":{"gid":24500,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.90:6839/160586017","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6838","nonce":160586017},{"type":"v1","addr":"172.21.15.90:6839","nonce":160586017}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24500,"qdb_cluster":[24481,24482,24500]},"id":1}]} 2024-05-08T05:30:38.297 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:38.296+0000 7f1a5fc00700 1 -- 172.21.15.87:0/487759665 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f1a400b2900 msgr2=0x7f1a400b4dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:30:38.297 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:38.296+0000 7f1a5fc00700 1 --2- 172.21.15.87:0/487759665 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f1a400b2900 0x7f1a400b4dc0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f1a4c005950 tx=0x7f1a4c0058e0 comp rx=0 tx=0).stop 2024-05-08T05:30:38.297 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:38.296+0000 7f1a5fc00700 1 -- 172.21.15.87:0/487759665 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1a58075ff0 msgr2=0x7f1a581a0650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:30:38.297 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:38.296+0000 7f1a5fc00700 1 --2- 172.21.15.87:0/487759665 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1a58075ff0 0x7f1a581a0650 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f1a4400e9c0 tx=0x7f1a4400ecd0 comp rx=0 tx=0).stop 2024-05-08T05:30:38.297 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:38.296+0000 7f1a5fc00700 1 -- 172.21.15.87:0/487759665 shutdown_connections 2024-05-08T05:30:38.298 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:38.296+0000 7f1a5fc00700 1 --2- 172.21.15.87:0/487759665 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1a58114670 0x7f1a581a49e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:30:38.298 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:38.296+0000 7f1a5fc00700 1 --2- 172.21.15.87:0/487759665 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1a580756d0 0x7f1a581a0110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:30:38.298 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:38.296+0000 7f1a5fc00700 1 --2- 172.21.15.87:0/487759665 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f1a400b2900 0x7f1a400b4dc0 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:30:38.298 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:38.296+0000 7f1a5fc00700 1 --2- 172.21.15.87:0/487759665 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1a58075ff0 0x7f1a581a0650 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:30:38.298 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:38.297+0000 7f1a5fc00700 1 -- 172.21.15.87:0/487759665 >> 172.21.15.87:0/487759665 conn(0x7f1a5807a650 msgr2=0x7f1a58113430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:30:38.298 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:38.297+0000 7f1a5fc00700 1 -- 172.21.15.87:0/487759665 shutdown_connections 2024-05-08T05:30:38.298 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:38.297+0000 7f1a5fc00700 1 -- 172.21.15.87:0/487759665 wait complete. 2024-05-08T05:30:38.299 INFO:teuthology.orchestra.run.smithi087.stderr:dumped fsmap epoch 25 2024-05-08T05:30:38.958 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:30:38 smithi087 ceph-mon[29523]: pgmap v469: 97 pgs: 97 active+clean; 661 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-05-08T05:30:38.958 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:30:38 smithi087 ceph-mon[29523]: from='client.? 172.21.15.87:0/487759665' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T05:30:38.983 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:30:38 smithi090 ceph-mon[34526]: pgmap v469: 97 pgs: 97 active+clean; 661 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-05-08T05:30:38.983 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:30:38 smithi090 ceph-mon[34526]: from='client.? 172.21.15.87:0/487759665' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T05:30:39.039 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:30:38 smithi160 ceph-mon[34827]: pgmap v469: 97 pgs: 97 active+clean; 661 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-05-08T05:30:39.060 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:30:38 smithi160 ceph-mon[34827]: from='client.? 172.21.15.87:0/487759665' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T05:30:39.230 DEBUG:teuthology.orchestra.run.smithi087:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid eeeb813e-0cf9-11ef-bc97-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-05-08T05:30:39.676 INFO:teuthology.orchestra.run.smithi087.stderr:Inferring config /var/lib/ceph/eeeb813e-0cf9-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T05:30:40.958 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:30:40 smithi087 ceph-mon[29523]: pgmap v470: 97 pgs: 97 active+clean; 661 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 7 op/s 2024-05-08T05:30:40.983 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:30:40 smithi090 ceph-mon[34526]: pgmap v470: 97 pgs: 97 active+clean; 661 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 7 op/s 2024-05-08T05:30:41.038 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:30:40 smithi160 ceph-mon[34827]: pgmap v470: 97 pgs: 97 active+clean; 661 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 7 op/s 2024-05-08T05:30:42.022 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:42.021+0000 7fd4e5c00700 1 -- 172.21.15.87:0/3539146593 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd4e01055d0 msgr2=0x7fd4e0105a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:30:42.022 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:42.021+0000 7fd4e5c00700 1 --2- 172.21.15.87:0/3539146593 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd4e01055d0 0x7fd4e0105a50 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fd4cc0099c0 tx=0x7fd4cc009cd0 comp rx=0 tx=0).stop 2024-05-08T05:30:42.023 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:42.021+0000 7fd4e5c00700 1 -- 172.21.15.87:0/3539146593 shutdown_connections 2024-05-08T05:30:42.023 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:42.021+0000 7fd4e5c00700 1 --2- 172.21.15.87:0/3539146593 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd4e0105f90 0x7fd4e0112450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:30:42.023 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:42.021+0000 7fd4e5c00700 1 --2- 172.21.15.87:0/3539146593 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd4e010b680 0x7fd4e010ba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:30:42.023 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:42.021+0000 7fd4e5c00700 1 --2- 172.21.15.87:0/3539146593 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd4e01055d0 0x7fd4e0105a50 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:30:42.023 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:42.021+0000 7fd4e5c00700 1 -- 172.21.15.87:0/3539146593 >> 172.21.15.87:0/3539146593 conn(0x7fd4e0101080 msgr2=0x7fd4e01034a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:30:42.023 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:42.021+0000 7fd4e5c00700 1 -- 172.21.15.87:0/3539146593 shutdown_connections 2024-05-08T05:30:42.023 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:42.021+0000 7fd4e5c00700 1 -- 172.21.15.87:0/3539146593 wait complete. 2024-05-08T05:30:42.024 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:42.022+0000 7fd4e5c00700 1 Processor -- start 2024-05-08T05:30:42.024 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:42.023+0000 7fd4e5c00700 1 -- start start 2024-05-08T05:30:42.024 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:42.023+0000 7fd4e5c00700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd4e01055d0 0x7fd4e01a1890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:30:42.024 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:42.023+0000 7fd4e5c00700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd4e0105f90 0x7fd4e01a1dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:30:42.024 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:42.023+0000 7fd4e5c00700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd4e010b680 0x7fd4e019ba50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:30:42.024 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:42.023+0000 7fd4e5c00700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fd4e0115830 con 0x7fd4e01055d0 2024-05-08T05:30:42.024 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:42.023+0000 7fd4e5c00700 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fd4e01156b0 con 0x7fd4e010b680 2024-05-08T05:30:42.025 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:42.023+0000 7fd4e5c00700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7fd4e01159b0 con 0x7fd4e0105f90 2024-05-08T05:30:42.025 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:42.024+0000 7fd4df400700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd4e0105f90 0x7fd4e01a1dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:30:42.025 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:42.024+0000 7fd4dfe00700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd4e01055d0 0x7fd4e01a1890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:30:42.025 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:42.024+0000 7fd4df400700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd4e0105f90 0x7fd4e01a1dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.87:33014/0 (socket says 172.21.15.87:33014) 2024-05-08T05:30:42.025 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:42.024+0000 7fd4df400700 1 -- 172.21.15.87:0/901793179 learned_addr learned my addr 172.21.15.87:0/901793179 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T05:30:42.025 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:42.024+0000 7fd4e5200700 1 --2- 172.21.15.87:0/901793179 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd4e010b680 0x7fd4e019ba50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:30:42.026 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:42.024+0000 7fd4df400700 1 -- 172.21.15.87:0/901793179 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd4e010b680 msgr2=0x7fd4e019ba50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:30:42.026 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:42.024+0000 7fd4df400700 1 --2- 172.21.15.87:0/901793179 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd4e010b680 0x7fd4e019ba50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:30:42.026 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:42.024+0000 7fd4df400700 1 -- 172.21.15.87:0/901793179 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd4e01055d0 msgr2=0x7fd4e01a1890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:30:42.026 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:42.024+0000 7fd4df400700 1 --2- 172.21.15.87:0/901793179 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd4e01055d0 0x7fd4e01a1890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:30:42.026 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:42.024+0000 7fd4df400700 1 -- 172.21.15.87:0/901793179 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd4e019c1b0 con 0x7fd4e0105f90 2024-05-08T05:30:42.026 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:42.025+0000 7fd4df400700 1 --2- 172.21.15.87:0/901793179 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd4e0105f90 0x7fd4e01a1dd0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fd4cc006010 tx=0x7fd4cc005280 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:30:42.026 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:42.025+0000 7fd4dcc00700 1 -- 172.21.15.87:0/901793179 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4cc026070 con 0x7fd4e0105f90 2024-05-08T05:30:42.026 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:42.025+0000 7fd4dcc00700 1 -- 172.21.15.87:0/901793179 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd4cc005680 con 0x7fd4e0105f90 2024-05-08T05:30:42.026 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:42.025+0000 7fd4e5c00700 1 -- 172.21.15.87:0/901793179 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd4e019c440 con 0x7fd4e0105f90 2024-05-08T05:30:42.026 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:42.025+0000 7fd4dcc00700 1 -- 172.21.15.87:0/901793179 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4cc00fb20 con 0x7fd4e0105f90 2024-05-08T05:30:42.026 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:42.025+0000 7fd4e5c00700 1 -- 172.21.15.87:0/901793179 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd4e01a8760 con 0x7fd4e0105f90 2024-05-08T05:30:42.031 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:42.031+0000 7fd4dcc00700 1 -- 172.21.15.87:0/901793179 <== mon.1 v2:172.21.15.160:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7fd4cc029070 con 0x7fd4e0105f90 2024-05-08T05:30:42.031 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:42.031+0000 7fd4f1c53b80 1 Processor -- start 2024-05-08T05:30:42.031 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:42.031+0000 7fd4f1c53b80 1 -- start start 2024-05-08T05:30:42.032 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:42.031+0000 7fd4f1c53b80 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55a2714071d0 0x55a2714075b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:30:42.032 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:42.032+0000 7fd4f1c53b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55a271407af0 0x55a2714017f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:30:42.032 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:42.032+0000 7fd4f1c53b80 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a271401e10 0x55a271402270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:30:42.032 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:42.032+0000 7fd4f1c53b80 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x55a27134ba20 con 0x55a271401e10 2024-05-08T05:30:42.032 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:42.032+0000 7fd4f1c53b80 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x55a2712e9760 con 0x55a2714071d0 2024-05-08T05:30:42.032 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:42.032+0000 7fd4f1c53b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x55a2713479e0 con 0x55a271407af0 2024-05-08T05:30:42.033 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:42.032+0000 7fd4e5200700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55a2714071d0 0x55a2714075b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:30:42.034 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:42.032+0000 7fd4e5200700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55a2714071d0 0x55a2714075b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.87:39324/0 (socket says 172.21.15.87:39324) 2024-05-08T05:30:42.034 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:42.032+0000 7fd4e5200700 1 -- 172.21.15.87:0/3808012250 learned_addr learned my addr 172.21.15.87:0/3808012250 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T05:30:42.034 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:42.032+0000 7fd4dfe00700 1 --2- 172.21.15.87:0/3808012250 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55a271407af0 0x55a2714017f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:30:42.034 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:42.032+0000 7fd4df400700 1 --2- 172.21.15.87:0/3808012250 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a271401e10 0x55a271402270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:30:42.034 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:42.032+0000 7fd4e5200700 1 -- 172.21.15.87:0/3808012250 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55a271407af0 msgr2=0x55a2714017f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:30:42.034 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:42.032+0000 7fd4e5200700 1 --2- 172.21.15.87:0/3808012250 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55a271407af0 0x55a2714017f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:30:42.034 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:42.032+0000 7fd4e5200700 1 -- 172.21.15.87:0/3808012250 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a271401e10 msgr2=0x55a271402270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:30:42.034 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:42.032+0000 7fd4e5200700 1 --2- 172.21.15.87:0/3808012250 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a271401e10 0x55a271402270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:30:42.034 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:42.032+0000 7fd4e5200700 1 -- 172.21.15.87:0/3808012250 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a2712988d0 con 0x55a2714071d0 2024-05-08T05:30:42.034 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:42.033+0000 7fd4e5200700 1 --2- 172.21.15.87:0/3808012250 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55a2714071d0 0x55a2714075b0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fd4d8011680 tx=0x7fd4d8009920 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5bb4c66b83cbc23d server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:30:42.034 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:42.033+0000 7fd4dcc00700 1 --2- 172.21.15.87:0/901793179 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7fd4c40b2880 0x7fd4c40b4d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:30:42.034 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:42.033+0000 7fd4d5600700 1 -- 172.21.15.87:0/3808012250 <== mon.2 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4d8019030 con 0x55a2714071d0 2024-05-08T05:30:42.034 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:42.033+0000 7fd4d5600700 1 -- 172.21.15.87:0/3808012250 <== mon.2 v2:172.21.15.90:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd4d80092e0 con 0x55a2714071d0 2024-05-08T05:30:42.035 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:42.033+0000 7fd4d5600700 1 -- 172.21.15.87:0/3808012250 <== mon.2 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4d8007500 con 0x55a2714071d0 2024-05-08T05:30:42.035 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:42.033+0000 7fd4dcc00700 1 -- 172.21.15.87:0/901793179 <== mon.1 v2:172.21.15.160:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8190+0+0 (secure 0 0 0) 0x7fd4cc0e29f0 con 0x7fd4e0105f90 2024-05-08T05:30:42.035 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:42.034+0000 7fd4dfe00700 1 --2- 172.21.15.87:0/901793179 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7fd4c40b2880 0x7fd4c40b4d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:30:42.035 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:42.034+0000 7fd4f1c53b80 1 -- 172.21.15.87:0/3808012250 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55a2714071d0 msgr2=0x55a2714075b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:30:42.036 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:42.034+0000 7fd4f1c53b80 1 --2- 172.21.15.87:0/3808012250 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55a2714071d0 0x55a2714075b0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fd4d8011680 tx=0x7fd4d8009920 comp rx=0 tx=0).stop 2024-05-08T05:30:42.036 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:42.034+0000 7fd4f1c53b80 1 -- 172.21.15.87:0/3808012250 shutdown_connections 2024-05-08T05:30:42.036 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:42.034+0000 7fd4f1c53b80 1 --2- 172.21.15.87:0/3808012250 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a271401e10 0x55a271402270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:30:42.036 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:42.034+0000 7fd4f1c53b80 1 --2- 172.21.15.87:0/3808012250 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55a2714071d0 0x55a2714075b0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:30:42.036 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:42.034+0000 7fd4f1c53b80 1 --2- 172.21.15.87:0/3808012250 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55a271407af0 0x55a2714017f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:30:42.036 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:42.034+0000 7fd4f1c53b80 1 -- 172.21.15.87:0/3808012250 >> 172.21.15.87:0/3808012250 conn(0x55a271327b60 msgr2=0x55a2713f39b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:30:42.036 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:42.035+0000 7fd4dfe00700 1 --2- 172.21.15.87:0/901793179 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7fd4c40b2880 0x7fd4c40b4d40 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fd4e019cb90 tx=0x7fd4d0009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:30:42.036 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:42.035+0000 7fd4f1c53b80 1 -- 172.21.15.87:0/3808012250 shutdown_connections 2024-05-08T05:30:42.036 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:42.035+0000 7fd4f1c53b80 1 -- 172.21.15.87:0/3808012250 wait complete. 2024-05-08T05:30:42.036 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:42.035+0000 7fd4f1c53b80 1 -- start start 2024-05-08T05:30:42.036 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:42.035+0000 7fd4f1c53b80 1 Processor -- start 2024-05-08T05:30:42.037 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:42.036+0000 7fd4f1c53b80 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55a271401e10 0x55a27140d6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:30:42.037 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:42.036+0000 7fd4f1c53b80 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a2714071d0 0x55a27140aa60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:30:42.038 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:42.036+0000 7fd4f1c53b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55a271407af0 0x55a27140afa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:30:42.038 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:42.036+0000 7fd4f1c53b80 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x55a27140e5f0 con 0x55a2714071d0 2024-05-08T05:30:42.038 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:42.036+0000 7fd4f1c53b80 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x55a2712b1b20 con 0x55a271401e10 2024-05-08T05:30:42.038 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:42.036+0000 7fd4f1c53b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x55a27140e770 con 0x55a271407af0 2024-05-08T05:30:42.038 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:42.036+0000 7fd4f1c53b80 10 client.0 _ll_register_callbacks cb 0x55a2712f2c70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T05:30:42.038 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:42.036+0000 7fd4dfe00700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55a271401e10 0x55a27140d6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:30:42.038 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:42.036+0000 7fd4e5200700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55a271407af0 0x55a27140afa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:30:42.038 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:42.036+0000 7fd4dfe00700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55a271401e10 0x55a27140d6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.87:39334/0 (socket says 172.21.15.87:39334) 2024-05-08T05:30:42.038 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:42.036+0000 7fd4dfe00700 1 -- 172.21.15.87:0/83839581 learned_addr learned my addr 172.21.15.87:0/83839581 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T05:30:42.038 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:42.036+0000 7fd4df400700 1 --2- 172.21.15.87:0/83839581 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a2714071d0 0x55a27140aa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:30:42.038 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:42.037+0000 7fd4dfe00700 1 -- 172.21.15.87:0/83839581 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55a271407af0 msgr2=0x55a27140afa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:30:42.038 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:42.037+0000 7fd4dfe00700 1 --2- 172.21.15.87:0/83839581 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55a271407af0 0x55a27140afa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:30:42.039 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:42.037+0000 7fd4dfe00700 1 -- 172.21.15.87:0/83839581 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a2714071d0 msgr2=0x55a27140aa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:30:42.039 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:42.037+0000 7fd4dfe00700 1 --2- 172.21.15.87:0/83839581 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a2714071d0 0x55a27140aa60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:30:42.039 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:42.037+0000 7fd4dfe00700 1 -- 172.21.15.87:0/83839581 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a271311420 con 0x55a271401e10 2024-05-08T05:30:42.039 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:42.037+0000 7fd4e5200700 1 --2- 172.21.15.87:0/83839581 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55a271407af0 0x55a27140afa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T05:30:42.039 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:42.037+0000 7fd4dfe00700 1 --2- 172.21.15.87:0/83839581 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55a271401e10 0x55a27140d6c0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fd4d00045e0 tx=0x7fd4d00047c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5758ca20af1ab0bc server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:30:42.039 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:42.037+0000 7fd4ca000700 10 client.0 ms_handle_connect on v2:172.21.15.90:3300/0 2024-05-08T05:30:42.039 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:42.037+0000 7fd4ca000700 1 -- 172.21.15.87:0/83839581 <== mon.2 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4d0004830 con 0x55a271401e10 2024-05-08T05:30:42.039 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:42.037+0000 7fd4ca000700 1 -- 172.21.15.87:0/83839581 <== mon.2 v2:172.21.15.90:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8190+0+0 (secure 0 0 0) 0x7fd4d00049d0 con 0x55a271401e10 2024-05-08T05:30:42.039 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:42.037+0000 7fd4f1c53b80 1 -- 172.21.15.87:0/83839581 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd4d80092e0 con 0x55a271401e10 2024-05-08T05:30:42.040 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:42.038+0000 7fd4ca000700 1 -- 172.21.15.87:0/83839581 <== mon.2 v2:172.21.15.90:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fd4d0004bd0 con 0x55a271401e10 2024-05-08T05:30:42.040 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:42.038+0000 7fd4f1c53b80 10 client.25235 fetch_fsmap learned FSMap version 25 2024-05-08T05:30:42.040 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:42.038+0000 7fd4f1c53b80 1 -- 172.21.15.87:0/83839581 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55a271418db0 con 0x55a271401e10 2024-05-08T05:30:42.040 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:42.038+0000 7fd4ca000700 1 -- 172.21.15.87:0/83839581 <== mon.2 v2:172.21.15.90:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd4d80092e0 con 0x55a271401e10 2024-05-08T05:30:42.040 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:42.038+0000 7fd4ca000700 1 -- 172.21.15.87:0/83839581 <== mon.2 v2:172.21.15.90:3300/0 5 ==== fsmap(e 25) ==== 8338+0+0 (secure 0 0 0) 0x7fd4d0027070 con 0x55a271401e10 2024-05-08T05:30:42.041 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:42.038+0000 7fd4f1c53b80 10 client.25235 fetch_fsmap finished waiting for FSMap version 25 2024-05-08T05:30:42.041 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:42.038+0000 7fd4f1c53b80 10 client.25235 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.i 2024-05-08T05:30:42.041 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:42.038+0000 7fd4f1c53b80 20 client.25235 populate_metadata read hostname 'smithi087' 2024-05-08T05:30:42.041 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:42.038+0000 7fd4f1c53b80 1 --2- 172.21.15.87:0/83839581 >> [v2:172.21.15.160:6838/234657686,v1:172.21.15.160:6839/234657686] conn(0x55a27141b3f0 0x55a27141d870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:30:42.041 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:42.038+0000 7fd4f1c53b80 4 client.25235 mds_command: new command op to 24481 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-08T05:30:42.041 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:42.038+0000 7fd4f1c53b80 1 -- 172.21.15.87:0/83839581 --> [v2:172.21.15.160:6838/234657686,v1:172.21.15.160:6839/234657686] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a2713c60a0 con 0x55a27141b3f0 2024-05-08T05:30:42.041 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:42.039+0000 7fd4df400700 1 --2- 172.21.15.87:0/83839581 >> [v2:172.21.15.160:6838/234657686,v1:172.21.15.160:6839/234657686] conn(0x55a27141b3f0 0x55a27141d870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:30:42.041 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:42.039+0000 7fd4df400700 1 --2- 172.21.15.87:0/83839581 >> [v2:172.21.15.160:6838/234657686,v1:172.21.15.160:6839/234657686] conn(0x55a27141b3f0 0x55a27141d870 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=3d15107f6f88c54f server_cookie=9d26549f8a648158 in_seq=0 out_seq=0 2024-05-08T05:30:42.041 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:42.039+0000 7fd4ca000700 10 client.25235 ms_handle_connect on v2:172.21.15.160:6838/234657686 2024-05-08T05:30:42.042 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:42.040+0000 7fd4ca000700 1 -- 172.21.15.87:0/83839581 <== mds.2 v2:172.21.15.160:6838/234657686 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55a2713c60a0 con 0x55a27141b3f0 2024-05-08T05:30:42.042 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:42.040+0000 7fd4ca000700 10 client.25235 handle_command_reply: tid=0 2024-05-08T05:30:42.042 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:42.040+0000 7fd4f1c53b80 1 client.25235 shutdown 2024-05-08T05:30:42.042 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:42.041+0000 7fd4f1c53b80 1 -- 172.21.15.87:0/83839581 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55a271401e10 msgr2=0x55a27140d6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:30:42.042 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:42.041+0000 7fd4f1c53b80 1 --2- 172.21.15.87:0/83839581 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55a271401e10 0x55a27140d6c0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fd4d00045e0 tx=0x7fd4d00047c0 comp rx=0 tx=0).stop 2024-05-08T05:30:42.043 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:42.041+0000 7fd4f1c53b80 1 -- 172.21.15.87:0/83839581 shutdown_connections 2024-05-08T05:30:42.043 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:42.041+0000 7fd4f1c53b80 1 --2- 172.21.15.87:0/83839581 >> [v2:172.21.15.160:6838/234657686,v1:172.21.15.160:6839/234657686] conn(0x55a27141b3f0 0x55a27141d870 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:30:42.043 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:42.041+0000 7fd4f1c53b80 1 --2- 172.21.15.87:0/83839581 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55a271407af0 0x55a27140afa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:30:42.043 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:42.041+0000 7fd4f1c53b80 1 --2- 172.21.15.87:0/83839581 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55a271401e10 0x55a27140d6c0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:30:42.043 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:42.041+0000 7fd4ca000700 0 client.25235 ms_handle_reset on v2:172.21.15.160:6838/234657686 2024-05-08T05:30:42.043 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:42.041+0000 7fd4f1c53b80 1 --2- 172.21.15.87:0/83839581 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a2714071d0 0x55a27140aa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:30:42.043 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:42.041+0000 7fd4f1c53b80 1 -- 172.21.15.87:0/83839581 >> 172.21.15.87:0/83839581 conn(0x55a271327b60 msgr2=0x55a2713ee460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:30:42.043 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:42.041+0000 7fd4f1c53b80 1 -- 172.21.15.87:0/83839581 shutdown_connections 2024-05-08T05:30:42.043 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:42.041+0000 7fd4f1c53b80 1 -- 172.21.15.87:0/83839581 wait complete. 2024-05-08T05:30:42.043 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:42.041+0000 7fd4f1c53b80 20 client.25235 trim_cache size 0 max 16384 2024-05-08T05:30:42.059 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:42.058+0000 7fd4f1c53b80 1 Processor -- start 2024-05-08T05:30:42.059 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:42.058+0000 7fd4f1c53b80 1 -- start start 2024-05-08T05:30:42.059 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:42.058+0000 7fd4f1c53b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55a271401e10 0x55a271423140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:30:42.059 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:42.058+0000 7fd4f1c53b80 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a2714071d0 0x55a271423680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:30:42.059 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:42.058+0000 7fd4f1c53b80 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55a271407af0 0x55a271407ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:30:42.059 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:42.058+0000 7fd4f1c53b80 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fd4e01adf60 con 0x55a2714071d0 2024-05-08T05:30:42.059 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:42.058+0000 7fd4f1c53b80 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fd4e01ab7f0 con 0x55a271407af0 2024-05-08T05:30:42.059 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:42.058+0000 7fd4f1c53b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7fd4e007b810 con 0x55a271401e10 2024-05-08T05:30:42.059 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:42.058+0000 7fd4df400700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a2714071d0 0x55a271423680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:30:42.060 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:42.058+0000 7fd4e5200700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55a271407af0 0x55a271407ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:30:42.060 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:42.058+0000 7fd4df400700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a2714071d0 0x55a271423680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:44786/0 (socket says 172.21.15.87:44786) 2024-05-08T05:30:42.060 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:42.058+0000 7fd4df400700 1 -- 172.21.15.87:0/76723316 learned_addr learned my addr 172.21.15.87:0/76723316 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T05:30:42.060 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:42.058+0000 7fd4e5200700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55a271407af0 0x55a271407ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.87:39344/0 (socket says 172.21.15.87:39344) 2024-05-08T05:30:42.060 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:42.058+0000 7fd4dfe00700 1 --2- 172.21.15.87:0/76723316 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55a271401e10 0x55a271423140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:30:42.061 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:42.059+0000 7fd4e5200700 1 -- 172.21.15.87:0/76723316 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55a271401e10 msgr2=0x55a271423140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:30:42.061 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:42.059+0000 7fd4e5200700 1 --2- 172.21.15.87:0/76723316 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55a271401e10 0x55a271423140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:30:42.061 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:42.059+0000 7fd4e5200700 1 -- 172.21.15.87:0/76723316 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a2714071d0 msgr2=0x55a271423680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:30:42.061 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:42.059+0000 7fd4e5200700 1 --2- 172.21.15.87:0/76723316 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a2714071d0 0x55a271423680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:30:42.061 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:42.059+0000 7fd4e5200700 1 -- 172.21.15.87:0/76723316 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a27140d300 con 0x55a271407af0 2024-05-08T05:30:42.061 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:42.059+0000 7fd4e5200700 1 --2- 172.21.15.87:0/76723316 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55a271407af0 0x55a271407ed0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fd4d800b010 tx=0x7fd4d800afa0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=91fa3982bdc50a26 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:30:42.062 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:42.060+0000 7fd4d4c00700 1 -- 172.21.15.87:0/76723316 <== mon.2 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4d8004ab0 con 0x55a271407af0 2024-05-08T05:30:42.062 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:42.060+0000 7fd4d4c00700 1 -- 172.21.15.87:0/76723316 <== mon.2 v2:172.21.15.90:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd4d8023030 con 0x55a271407af0 2024-05-08T05:30:42.062 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:42.060+0000 7fd4d4c00700 1 -- 172.21.15.87:0/76723316 <== mon.2 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4d8004300 con 0x55a271407af0 2024-05-08T05:30:42.062 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:42.060+0000 7fd4f1c53b80 1 -- 172.21.15.87:0/76723316 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55a271407af0 msgr2=0x55a271407ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:30:42.062 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:42.060+0000 7fd4f1c53b80 1 --2- 172.21.15.87:0/76723316 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55a271407af0 0x55a271407ed0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fd4d800b010 tx=0x7fd4d800afa0 comp rx=0 tx=0).stop 2024-05-08T05:30:42.062 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:42.061+0000 7fd4f1c53b80 1 -- 172.21.15.87:0/76723316 shutdown_connections 2024-05-08T05:30:42.062 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:42.061+0000 7fd4f1c53b80 1 --2- 172.21.15.87:0/76723316 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55a271407af0 0x55a271407ed0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:30:42.062 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:42.061+0000 7fd4f1c53b80 1 --2- 172.21.15.87:0/76723316 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55a271401e10 0x55a271423140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:30:42.062 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:42.061+0000 7fd4f1c53b80 1 --2- 172.21.15.87:0/76723316 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a2714071d0 0x55a271423680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:30:42.062 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:42.061+0000 7fd4f1c53b80 1 -- 172.21.15.87:0/76723316 >> 172.21.15.87:0/76723316 conn(0x55a271327b60 msgr2=0x55a271404d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:30:42.062 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:42.061+0000 7fd4f1c53b80 1 -- 172.21.15.87:0/76723316 shutdown_connections 2024-05-08T05:30:42.062 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:42.061+0000 7fd4f1c53b80 1 -- 172.21.15.87:0/76723316 wait complete. 2024-05-08T05:30:42.064 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:42.061+0000 7fd4f1c53b80 1 -- start start 2024-05-08T05:30:42.064 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:42.062+0000 7fd4f1c53b80 1 Processor -- start 2024-05-08T05:30:42.064 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:42.062+0000 7fd4f1c53b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55a271401e10 0x55a2714227d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:30:42.064 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:42.062+0000 7fd4f1c53b80 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a2714071d0 0x55a271422d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:30:42.065 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:42.062+0000 7fd4f1c53b80 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55a271407af0 0x55a271423250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:30:42.065 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:42.062+0000 7fd4f1c53b80 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fd4e01a9cb0 con 0x55a2714071d0 2024-05-08T05:30:42.065 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:42.062+0000 7fd4f1c53b80 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fd4e01ab120 con 0x55a271407af0 2024-05-08T05:30:42.065 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:42.062+0000 7fd4f1c53b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7fd4e01aa380 con 0x55a271401e10 2024-05-08T05:30:42.065 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:42.062+0000 7fd4f1c53b80 10 client.0 _ll_register_callbacks cb 0x55a2712f2c70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T05:30:42.065 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:42.063+0000 7fd4dfe00700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55a271401e10 0x55a2714227d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:30:42.065 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:42.063+0000 7fd4dfe00700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55a271401e10 0x55a2714227d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.87:33052/0 (socket says 172.21.15.87:33052) 2024-05-08T05:30:42.065 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:42.063+0000 7fd4dfe00700 1 -- 172.21.15.87:0/2947248265 learned_addr learned my addr 172.21.15.87:0/2947248265 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T05:30:42.065 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:42.063+0000 7fd4e5200700 1 --2- 172.21.15.87:0/2947248265 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55a271407af0 0x55a271423250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:30:42.065 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:42.063+0000 7fd4dfe00700 1 -- 172.21.15.87:0/2947248265 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55a271407af0 msgr2=0x55a271423250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:30:42.065 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:42.063+0000 7fd4dfe00700 1 --2- 172.21.15.87:0/2947248265 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55a271407af0 0x55a271423250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:30:42.065 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:42.063+0000 7fd4dfe00700 1 -- 172.21.15.87:0/2947248265 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a2714071d0 msgr2=0x55a271422d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:30:42.065 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:42.063+0000 7fd4dfe00700 1 --2- 172.21.15.87:0/2947248265 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a2714071d0 0x55a271422d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:30:42.065 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:42.063+0000 7fd4dfe00700 1 -- 172.21.15.87:0/2947248265 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a271484cf0 con 0x55a271401e10 2024-05-08T05:30:42.065 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:42.064+0000 7fd4dfe00700 1 --2- 172.21.15.87:0/2947248265 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55a271401e10 0x55a2714227d0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fd4d0012ac0 tx=0x7fd4d001e540 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f8110bacedeab799 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:30:42.066 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:42.064+0000 7fd4ca000700 10 client.0 ms_handle_connect on v2:172.21.15.160:3300/0 2024-05-08T05:30:42.066 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:42.064+0000 7fd4ca000700 1 -- 172.21.15.87:0/2947248265 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4d001ea90 con 0x55a271401e10 2024-05-08T05:30:42.066 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:42.064+0000 7fd4ca000700 1 -- 172.21.15.87:0/2947248265 <== mon.1 v2:172.21.15.160:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8190+0+0 (secure 0 0 0) 0x7fd4d001ec30 con 0x55a271401e10 2024-05-08T05:30:42.066 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:42.064+0000 7fd4f1c53b80 1 -- 172.21.15.87:0/2947248265 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd4d8023030 con 0x55a271401e10 2024-05-08T05:30:42.066 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:42.064+0000 7fd4ca000700 1 -- 172.21.15.87:0/2947248265 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fd4d0043050 con 0x55a271401e10 2024-05-08T05:30:42.066 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:42.064+0000 7fd4f1c53b80 10 client.25249 fetch_fsmap learned FSMap version 25 2024-05-08T05:30:42.066 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:42.064+0000 7fd4f1c53b80 1 -- 172.21.15.87:0/2947248265 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55a271485f70 con 0x55a271401e10 2024-05-08T05:30:42.067 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:42.065+0000 7fd4ca000700 1 -- 172.21.15.87:0/2947248265 <== mon.1 v2:172.21.15.160:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd4d8023030 con 0x55a271401e10 2024-05-08T05:30:42.068 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:42.065+0000 7fd4ca000700 1 -- 172.21.15.87:0/2947248265 <== mon.1 v2:172.21.15.160:3300/0 5 ==== fsmap(e 25) ==== 8338+0+0 (secure 0 0 0) 0x7fd4d0027040 con 0x55a271401e10 2024-05-08T05:30:42.068 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:42.065+0000 7fd4f1c53b80 10 client.25249 fetch_fsmap finished waiting for FSMap version 25 2024-05-08T05:30:42.068 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:42.065+0000 7fd4f1c53b80 10 client.25249 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.i 2024-05-08T05:30:42.068 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:42.065+0000 7fd4f1c53b80 20 client.25249 populate_metadata read hostname 'smithi087' 2024-05-08T05:30:42.068 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:42.065+0000 7fd4f1c53b80 1 --2- 172.21.15.87:0/2947248265 >> [v2:172.21.15.160:6838/234657686,v1:172.21.15.160:6839/234657686] conn(0x55a271486680 0x55a271488ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:30:42.068 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:42.065+0000 7fd4f1c53b80 4 client.25249 mds_command: new command op to 24481 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-05-08T05:30:42.068 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:42.065+0000 7fd4f1c53b80 1 -- 172.21.15.87:0/2947248265 --> [v2:172.21.15.160:6838/234657686,v1:172.21.15.160:6839/234657686] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55a271359400 con 0x55a271486680 2024-05-08T05:30:42.068 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:42.065+0000 7fd4df400700 1 --2- 172.21.15.87:0/2947248265 >> [v2:172.21.15.160:6838/234657686,v1:172.21.15.160:6839/234657686] conn(0x55a271486680 0x55a271488ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:30:42.068 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:42.066+0000 7fd4df400700 1 --2- 172.21.15.87:0/2947248265 >> [v2:172.21.15.160:6838/234657686,v1:172.21.15.160:6839/234657686] conn(0x55a271486680 0x55a271488ae0 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=6fe4d7867271db66 server_cookie=8d9e82a48cae4ddc in_seq=0 out_seq=0 2024-05-08T05:30:42.068 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:42.066+0000 7fd4ca000700 10 client.25249 ms_handle_connect on v2:172.21.15.160:6838/234657686 2024-05-08T05:30:42.068 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:42.066+0000 7fd4ca000700 1 -- 172.21.15.87:0/2947248265 <== mds.2 v2:172.21.15.160:6838/234657686 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55a271359400 con 0x55a271486680 2024-05-08T05:30:42.068 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:42.066+0000 7fd4ca000700 10 client.25249 handle_command_reply: tid=0 2024-05-08T05:30:42.068 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:42.066+0000 7fd4f1c53b80 1 client.25249 shutdown 2024-05-08T05:30:42.069 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:42.066+0000 7fd4f1c53b80 1 -- 172.21.15.87:0/2947248265 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55a271401e10 msgr2=0x55a2714227d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:30:42.069 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:42.066+0000 7fd4f1c53b80 1 --2- 172.21.15.87:0/2947248265 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55a271401e10 0x55a2714227d0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fd4d0012ac0 tx=0x7fd4d001e540 comp rx=0 tx=0).stop 2024-05-08T05:30:42.069 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:42.066+0000 7fd4f1c53b80 1 -- 172.21.15.87:0/2947248265 shutdown_connections 2024-05-08T05:30:42.069 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:42.066+0000 7fd4f1c53b80 1 --2- 172.21.15.87:0/2947248265 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55a271407af0 0x55a271423250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:30:42.069 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:42.066+0000 7fd4f1c53b80 1 --2- 172.21.15.87:0/2947248265 >> [v2:172.21.15.160:6838/234657686,v1:172.21.15.160:6839/234657686] conn(0x55a271486680 0x55a271488ae0 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:30:42.069 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:42.066+0000 7fd4f1c53b80 1 --2- 172.21.15.87:0/2947248265 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55a271401e10 0x55a2714227d0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:30:42.069 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:42.066+0000 7fd4f1c53b80 1 --2- 172.21.15.87:0/2947248265 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a2714071d0 0x55a271422d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:30:42.069 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:42.066+0000 7fd4ca000700 0 client.25249 ms_handle_reset on v2:172.21.15.160:6838/234657686 2024-05-08T05:30:42.069 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:42.067+0000 7fd4f1c53b80 1 -- 172.21.15.87:0/2947248265 >> 172.21.15.87:0/2947248265 conn(0x55a271327b60 msgr2=0x55a271407ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:30:42.069 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:42.067+0000 7fd4f1c53b80 1 -- 172.21.15.87:0/2947248265 shutdown_connections 2024-05-08T05:30:42.069 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:42.067+0000 7fd4f1c53b80 1 -- 172.21.15.87:0/2947248265 wait complete. 2024-05-08T05:30:42.069 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:42.067+0000 7fd4f1c53b80 20 client.25249 trim_cache size 0 max 16384 2024-05-08T05:30:42.070 INFO:teuthology.orchestra.run.smithi087.stdout:[] 2024-05-08T05:30:42.070 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:42.068+0000 7fd4e5c00700 1 -- 172.21.15.87:0/901793179 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7fd4c40b2880 msgr2=0x7fd4c40b4d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:30:42.070 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:42.068+0000 7fd4e5c00700 1 --2- 172.21.15.87:0/901793179 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7fd4c40b2880 0x7fd4c40b4d40 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fd4e019cb90 tx=0x7fd4d0009260 comp rx=0 tx=0).stop 2024-05-08T05:30:42.070 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:42.068+0000 7fd4e5c00700 1 -- 172.21.15.87:0/901793179 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd4e0105f90 msgr2=0x7fd4e01a1dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:30:42.070 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:42.068+0000 7fd4e5c00700 1 --2- 172.21.15.87:0/901793179 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd4e0105f90 0x7fd4e01a1dd0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fd4cc006010 tx=0x7fd4cc005280 comp rx=0 tx=0).stop 2024-05-08T05:30:42.070 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:42.068+0000 7fd4e5c00700 1 -- 172.21.15.87:0/901793179 shutdown_connections 2024-05-08T05:30:42.070 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:42.068+0000 7fd4e5c00700 1 --2- 172.21.15.87:0/901793179 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd4e010b680 0x7fd4e019ba50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:30:42.070 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:42.068+0000 7fd4e5c00700 1 --2- 172.21.15.87:0/901793179 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd4e01055d0 0x7fd4e01a1890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:30:42.070 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:42.068+0000 7fd4e5c00700 1 --2- 172.21.15.87:0/901793179 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7fd4c40b2880 0x7fd4c40b4d40 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:30:42.070 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:42.068+0000 7fd4e5c00700 1 --2- 172.21.15.87:0/901793179 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd4e0105f90 0x7fd4e01a1dd0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:30:42.071 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:42.068+0000 7fd4e5c00700 1 -- 172.21.15.87:0/901793179 >> 172.21.15.87:0/901793179 conn(0x7fd4e0101080 msgr2=0x7fd4e01026f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:30:42.071 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:42.068+0000 7fd4e5c00700 1 -- 172.21.15.87:0/901793179 shutdown_connections 2024-05-08T05:30:42.071 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:42.068+0000 7fd4e5c00700 1 -- 172.21.15.87:0/901793179 wait complete. 2024-05-08T05:30:42.786 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:30:42 smithi087 ceph-mon[29523]: pgmap v471: 97 pgs: 97 active+clean; 661 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-05-08T05:30:42.983 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:30:42 smithi090 ceph-mon[34526]: pgmap v471: 97 pgs: 97 active+clean; 661 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-05-08T05:30:43.038 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:30:42 smithi160 ceph-mon[34827]: pgmap v471: 97 pgs: 97 active+clean; 661 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-05-08T05:30:43.043 DEBUG:teuthology.orchestra.run.smithi087:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid eeeb813e-0cf9-11ef-bc97-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-05-08T05:30:43.522 INFO:teuthology.orchestra.run.smithi087.stderr:Inferring config /var/lib/ceph/eeeb813e-0cf9-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T05:30:44.938 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:30:44 smithi087 ceph-mon[29523]: pgmap v472: 97 pgs: 97 active+clean; 661 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 5 op/s 2024-05-08T05:30:44.983 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:30:44 smithi090 ceph-mon[34526]: pgmap v472: 97 pgs: 97 active+clean; 661 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 5 op/s 2024-05-08T05:30:45.038 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:30:44 smithi160 ceph-mon[34827]: pgmap v472: 97 pgs: 97 active+clean; 661 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 5 op/s 2024-05-08T05:30:46.958 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:30:46 smithi087 ceph-mon[29523]: pgmap v473: 97 pgs: 97 active+clean; 661 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 6 op/s 2024-05-08T05:30:46.983 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:30:46 smithi090 ceph-mon[34526]: pgmap v473: 97 pgs: 97 active+clean; 661 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 6 op/s 2024-05-08T05:30:47.039 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:30:46 smithi160 ceph-mon[34827]: pgmap v473: 97 pgs: 97 active+clean; 661 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 6 op/s 2024-05-08T05:30:48.477 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:48.476+0000 7f51c2400700 1 -- 172.21.15.87:0/1564574510 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f51bc104eb0 msgr2=0x7f51bc10d3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:30:48.477 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:48.476+0000 7f51c2400700 1 --2- 172.21.15.87:0/1564574510 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f51bc104eb0 0x7f51bc10d3a0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f51a80098f0 tx=0x7f51a8009c00 comp rx=0 tx=0).stop 2024-05-08T05:30:48.478 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:48.476+0000 7f51c2400700 1 -- 172.21.15.87:0/1564574510 shutdown_connections 2024-05-08T05:30:48.478 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:48.476+0000 7f51c2400700 1 --2- 172.21.15.87:0/1564574510 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f51bc10d9c0 0x7f51bc10fe80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:30:48.478 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:48.476+0000 7f51c2400700 1 --2- 172.21.15.87:0/1564574510 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f51bc104590 0x7f51bc104970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:30:48.478 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:48.476+0000 7f51c2400700 1 --2- 172.21.15.87:0/1564574510 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f51bc104eb0 0x7f51bc10d3a0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:30:48.478 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:48.476+0000 7f51c2400700 1 -- 172.21.15.87:0/1564574510 >> 172.21.15.87:0/1564574510 conn(0x7f51bc0fddc0 msgr2=0x7f51bc1001e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:30:48.478 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:48.477+0000 7f51c2400700 1 -- 172.21.15.87:0/1564574510 shutdown_connections 2024-05-08T05:30:48.478 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:48.477+0000 7f51c2400700 1 -- 172.21.15.87:0/1564574510 wait complete. 2024-05-08T05:30:48.482 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:48.478+0000 7f51c2400700 1 Processor -- start 2024-05-08T05:30:48.482 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:48.478+0000 7f51c2400700 1 -- start start 2024-05-08T05:30:48.482 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:48.478+0000 7f51c2400700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f51bc104590 0x7f51bc19bd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:30:48.482 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:48.478+0000 7f51c2400700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f51bc104eb0 0x7f51bc19c250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:30:48.482 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:48.478+0000 7f51c2400700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f51bc10d9c0 0x7f51bc1a05e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:30:48.482 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:48.478+0000 7f51c2400700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f51bc113590 con 0x7f51bc104590 2024-05-08T05:30:48.483 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:48.478+0000 7f51c2400700 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f51bc113410 con 0x7f51bc10d9c0 2024-05-08T05:30:48.483 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:48.478+0000 7f51c2400700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f51bc113710 con 0x7f51bc104eb0 2024-05-08T05:30:48.483 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:48.479+0000 7f51c1000700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f51bc104590 0x7f51bc19bd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:30:48.483 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:48.479+0000 7f51c1000700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f51bc104590 0x7f51bc19bd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:37196/0 (socket says 172.21.15.87:37196) 2024-05-08T05:30:48.483 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:48.479+0000 7f51c1000700 1 -- 172.21.15.87:0/1760714577 learned_addr learned my addr 172.21.15.87:0/1760714577 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T05:30:48.483 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:48.479+0000 7f51bbe00700 1 --2- 172.21.15.87:0/1760714577 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f51bc104eb0 0x7f51bc19c250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:30:48.483 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:48.479+0000 7f51c1a00700 1 --2- 172.21.15.87:0/1760714577 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f51bc10d9c0 0x7f51bc1a05e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:30:48.483 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:48.479+0000 7f51bbe00700 1 -- 172.21.15.87:0/1760714577 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f51bc10d9c0 msgr2=0x7f51bc1a05e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:30:48.483 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:48.479+0000 7f51bbe00700 1 --2- 172.21.15.87:0/1760714577 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f51bc10d9c0 0x7f51bc1a05e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:30:48.483 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:48.479+0000 7f51bbe00700 1 -- 172.21.15.87:0/1760714577 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f51bc104590 msgr2=0x7f51bc19bd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:30:48.483 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:48.479+0000 7f51bbe00700 1 --2- 172.21.15.87:0/1760714577 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f51bc104590 0x7f51bc19bd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:30:48.483 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:48.479+0000 7f51bbe00700 1 -- 172.21.15.87:0/1760714577 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f51bc1a0d20 con 0x7f51bc104eb0 2024-05-08T05:30:48.483 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:48.480+0000 7f51bbe00700 1 --2- 172.21.15.87:0/1760714577 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f51bc104eb0 0x7f51bc19c250 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f51a8009230 tx=0x7f51a800f950 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:30:48.483 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:48.480+0000 7f51b9600700 1 -- 172.21.15.87:0/1760714577 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51a8005040 con 0x7f51bc104eb0 2024-05-08T05:30:48.484 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:48.480+0000 7f51b9600700 1 -- 172.21.15.87:0/1760714577 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f51a8005690 con 0x7f51bc104eb0 2024-05-08T05:30:48.484 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:48.480+0000 7f51b9600700 1 -- 172.21.15.87:0/1760714577 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51a8003970 con 0x7f51bc104eb0 2024-05-08T05:30:48.484 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:48.480+0000 7f51c2400700 1 -- 172.21.15.87:0/1760714577 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f51bc1a0fb0 con 0x7f51bc104eb0 2024-05-08T05:30:48.484 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:48.481+0000 7f51c2400700 1 -- 172.21.15.87:0/1760714577 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f51bc1a8890 con 0x7f51bc104eb0 2024-05-08T05:30:48.486 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:48.485+0000 7f51b9600700 1 -- 172.21.15.87:0/1760714577 <== mon.1 v2:172.21.15.160:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7f51a800b7f0 con 0x7f51bc104eb0 2024-05-08T05:30:48.486 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:48.485+0000 7f51ce32ab80 1 Processor -- start 2024-05-08T05:30:48.486 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:48.486+0000 7f51ce32ab80 1 -- start start 2024-05-08T05:30:48.487 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:48.486+0000 7f51ce32ab80 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x557fdb7fdda0 0x557fdb7fe180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:30:48.487 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:48.486+0000 7f51ce32ab80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x557fdb7fe6c0 0x557fdb7f8430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:30:48.487 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:48.486+0000 7f51ce32ab80 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x557fdb7f8a50 0x557fdb7f8ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:30:48.487 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:48.486+0000 7f51ce32ab80 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x557fdb74aa20 con 0x557fdb7fdda0 2024-05-08T05:30:48.487 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:48.486+0000 7f51ce32ab80 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x557fdb6e8760 con 0x557fdb7f8a50 2024-05-08T05:30:48.487 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:48.486+0000 7f51ce32ab80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x557fdb7469e0 con 0x557fdb7fe6c0 2024-05-08T05:30:48.489 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:48.487+0000 7f51c1a00700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x557fdb7fdda0 0x557fdb7fe180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:30:48.489 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:48.487+0000 7f51c1000700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x557fdb7fe6c0 0x557fdb7f8430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:30:48.489 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:48.487+0000 7f51c1a00700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x557fdb7fdda0 0x557fdb7fe180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:37202/0 (socket says 172.21.15.87:37202) 2024-05-08T05:30:48.489 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:48.487+0000 7f51c1a00700 1 -- 172.21.15.87:0/3783343837 learned_addr learned my addr 172.21.15.87:0/3783343837 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T05:30:48.489 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:48.487+0000 7f51bbe00700 1 --2- 172.21.15.87:0/3783343837 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x557fdb7f8a50 0x557fdb7f8ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:30:48.489 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:48.487+0000 7f51c1000700 1 -- 172.21.15.87:0/3783343837 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x557fdb7f8a50 msgr2=0x557fdb7f8ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:30:48.489 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:48.487+0000 7f51c1000700 1 --2- 172.21.15.87:0/3783343837 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x557fdb7f8a50 0x557fdb7f8ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:30:48.489 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:48.487+0000 7f51c1000700 1 -- 172.21.15.87:0/3783343837 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x557fdb7fdda0 msgr2=0x557fdb7fe180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:30:48.489 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:48.487+0000 7f51c1000700 1 --2- 172.21.15.87:0/3783343837 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x557fdb7fdda0 0x557fdb7fe180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:30:48.489 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:48.487+0000 7f51c1000700 1 -- 172.21.15.87:0/3783343837 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557fdb6978d0 con 0x557fdb7fe6c0 2024-05-08T05:30:48.490 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:48.487+0000 7f51b9600700 1 --2- 172.21.15.87:0/1760714577 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f51a40b29d0 0x7f51a40b4e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:30:48.490 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:48.488+0000 7f51b9600700 1 -- 172.21.15.87:0/1760714577 <== mon.1 v2:172.21.15.160:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8190+0+0 (secure 0 0 0) 0x7f51a80e2750 con 0x7f51bc104eb0 2024-05-08T05:30:48.490 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:48.488+0000 7f51c1000700 1 --2- 172.21.15.87:0/3783343837 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x557fdb7fe6c0 0x557fdb7f8430 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f51b0009db0 tx=0x7f51b0011720 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e91ec0fc9fa8bfbf server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:30:48.490 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:48.488+0000 7f51c1a00700 1 --2- 172.21.15.87:0/1760714577 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f51a40b29d0 0x7f51a40b4e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:30:48.490 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:48.488+0000 7f51ae000700 1 -- 172.21.15.87:0/3783343837 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51b0004a30 con 0x557fdb7fe6c0 2024-05-08T05:30:48.490 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:48.488+0000 7f51ae000700 1 -- 172.21.15.87:0/3783343837 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f51b00054d0 con 0x557fdb7fe6c0 2024-05-08T05:30:48.490 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:48.488+0000 7f51ae000700 1 -- 172.21.15.87:0/3783343837 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51b0019890 con 0x557fdb7fe6c0 2024-05-08T05:30:48.491 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:48.489+0000 7f51ce32ab80 1 -- 172.21.15.87:0/3783343837 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x557fdb7fe6c0 msgr2=0x557fdb7f8430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:30:48.491 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:48.489+0000 7f51ce32ab80 1 --2- 172.21.15.87:0/3783343837 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x557fdb7fe6c0 0x557fdb7f8430 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f51b0009db0 tx=0x7f51b0011720 comp rx=0 tx=0).stop 2024-05-08T05:30:48.491 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:48.489+0000 7f51c1a00700 1 --2- 172.21.15.87:0/1760714577 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f51a40b29d0 0x7f51a40b4e90 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f51b4009fd0 tx=0x7f51b400b040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:30:48.491 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:48.489+0000 7f51ce32ab80 1 -- 172.21.15.87:0/3783343837 shutdown_connections 2024-05-08T05:30:48.491 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:48.489+0000 7f51ce32ab80 1 --2- 172.21.15.87:0/3783343837 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x557fdb7f8a50 0x557fdb7f8ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:30:48.492 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:48.489+0000 7f51ce32ab80 1 --2- 172.21.15.87:0/3783343837 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x557fdb7fdda0 0x557fdb7fe180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:30:48.492 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:48.489+0000 7f51ce32ab80 1 --2- 172.21.15.87:0/3783343837 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x557fdb7fe6c0 0x557fdb7f8430 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:30:48.492 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:48.489+0000 7f51ce32ab80 1 -- 172.21.15.87:0/3783343837 >> 172.21.15.87:0/3783343837 conn(0x557fdb7706d0 msgr2=0x557fdb7f2ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:30:48.492 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:48.490+0000 7f51ce32ab80 1 -- 172.21.15.87:0/3783343837 shutdown_connections 2024-05-08T05:30:48.492 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:48.490+0000 7f51ce32ab80 1 -- 172.21.15.87:0/3783343837 wait complete. 2024-05-08T05:30:48.492 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:48.490+0000 7f51ce32ab80 1 -- start start 2024-05-08T05:30:48.492 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:48.491+0000 7f51ce32ab80 1 Processor -- start 2024-05-08T05:30:48.494 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:48.491+0000 7f51ce32ab80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x557fdb7f8a50 0x557fdb804430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:30:48.494 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:48.491+0000 7f51ce32ab80 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x557fdb7fdda0 0x557fdb8017d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:30:48.494 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:48.491+0000 7f51ce32ab80 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x557fdb7fe6c0 0x557fdb801d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:30:48.494 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:48.491+0000 7f51ce32ab80 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x557fdb805150 con 0x557fdb7fdda0 2024-05-08T05:30:48.494 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:48.491+0000 7f51ce32ab80 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x557fdb6b0b20 con 0x557fdb7fe6c0 2024-05-08T05:30:48.494 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:48.491+0000 7f51ce32ab80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x557fdb8052d0 con 0x557fdb7f8a50 2024-05-08T05:30:48.494 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:48.491+0000 7f51ce32ab80 10 client.0 _ll_register_callbacks cb 0x557fdb6f1c70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T05:30:48.494 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:48.492+0000 7f51c1000700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x557fdb7f8a50 0x557fdb804430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:30:48.494 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:48.492+0000 7f51c1a00700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x557fdb7fe6c0 0x557fdb801d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:30:48.495 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:48.492+0000 7f51c1a00700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x557fdb7fe6c0 0x557fdb801d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.87:59612/0 (socket says 172.21.15.87:59612) 2024-05-08T05:30:48.495 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:48.492+0000 7f51c1a00700 1 -- 172.21.15.87:0/3954146861 learned_addr learned my addr 172.21.15.87:0/3954146861 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T05:30:48.495 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:48.492+0000 7f51c1a00700 1 -- 172.21.15.87:0/3954146861 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x557fdb7f8a50 msgr2=0x557fdb804430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:30:48.495 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:48.492+0000 7f51c1a00700 1 --2- 172.21.15.87:0/3954146861 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x557fdb7f8a50 0x557fdb804430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:30:48.495 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:48.492+0000 7f51c1a00700 1 -- 172.21.15.87:0/3954146861 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x557fdb7fdda0 msgr2=0x557fdb8017d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:30:48.495 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:48.492+0000 7f51c1a00700 1 --2- 172.21.15.87:0/3954146861 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x557fdb7fdda0 0x557fdb8017d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:30:48.495 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:48.492+0000 7f51c1a00700 1 -- 172.21.15.87:0/3954146861 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557fdb710420 con 0x557fdb7fe6c0 2024-05-08T05:30:48.495 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:48.493+0000 7f51c1a00700 1 --2- 172.21.15.87:0/3954146861 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x557fdb7fe6c0 0x557fdb801d10 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f51b4016a90 tx=0x7f51b4004b40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e9c1afbdaeee8730 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:30:48.495 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:48.493+0000 7f51a2a00700 10 client.0 ms_handle_connect on v2:172.21.15.90:3300/0 2024-05-08T05:30:48.495 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:48.493+0000 7f51a2a00700 1 -- 172.21.15.87:0/3954146861 <== mon.2 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51b4027020 con 0x557fdb7fe6c0 2024-05-08T05:30:48.495 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:48.493+0000 7f51ce32ab80 1 -- 172.21.15.87:0/3954146861 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f51b00054d0 con 0x557fdb7fe6c0 2024-05-08T05:30:48.495 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:48.493+0000 7f51a2a00700 1 -- 172.21.15.87:0/3954146861 <== mon.2 v2:172.21.15.90:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8190+0+0 (secure 0 0 0) 0x7f51b4015a20 con 0x557fdb7fe6c0 2024-05-08T05:30:48.497 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:48.494+0000 7f51a2a00700 1 -- 172.21.15.87:0/3954146861 <== mon.2 v2:172.21.15.90:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f51b4016e50 con 0x557fdb7fe6c0 2024-05-08T05:30:48.497 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:48.494+0000 7f51ce32ab80 10 client.25250 fetch_fsmap learned FSMap version 25 2024-05-08T05:30:48.497 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:48.494+0000 7f51ce32ab80 1 -- 172.21.15.87:0/3954146861 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x557fdb80fab0 con 0x557fdb7fe6c0 2024-05-08T05:30:48.497 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:48.494+0000 7f51a2a00700 1 -- 172.21.15.87:0/3954146861 <== mon.2 v2:172.21.15.90:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f51b00054d0 con 0x557fdb7fe6c0 2024-05-08T05:30:48.497 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:48.495+0000 7f51a2a00700 1 -- 172.21.15.87:0/3954146861 <== mon.2 v2:172.21.15.90:3300/0 5 ==== fsmap(e 25) ==== 8338+0+0 (secure 0 0 0) 0x7f51b40223a0 con 0x557fdb7fe6c0 2024-05-08T05:30:48.497 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:48.495+0000 7f51ce32ab80 10 client.25250 fetch_fsmap finished waiting for FSMap version 25 2024-05-08T05:30:48.497 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:48.495+0000 7f51ce32ab80 10 client.25250 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.g 2024-05-08T05:30:48.497 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:48.495+0000 7f51ce32ab80 20 client.25250 populate_metadata read hostname 'smithi087' 2024-05-08T05:30:48.498 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:48.495+0000 7f51ce32ab80 1 --2- 172.21.15.87:0/3954146861 >> [v2:172.21.15.87:6838/2127215876,v1:172.21.15.87:6839/2127215876] conn(0x557fdb812040 0x557fdb8144b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:30:48.498 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:48.495+0000 7f51ce32ab80 4 client.25250 mds_command: new command op to 24482 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-08T05:30:48.498 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:48.495+0000 7f51ce32ab80 1 -- 172.21.15.87:0/3954146861 --> [v2:172.21.15.87:6838/2127215876,v1:172.21.15.87:6839/2127215876] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x557fdb7c5140 con 0x557fdb812040 2024-05-08T05:30:48.498 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:48.495+0000 7f51c1000700 1 --2- 172.21.15.87:0/3954146861 >> [v2:172.21.15.87:6838/2127215876,v1:172.21.15.87:6839/2127215876] conn(0x557fdb812040 0x557fdb8144b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:30:48.498 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:48.496+0000 7f51c1000700 1 --2- 172.21.15.87:0/3954146861 >> [v2:172.21.15.87:6838/2127215876,v1:172.21.15.87:6839/2127215876] conn(0x557fdb812040 0x557fdb8144b0 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=4179b3ac34203d7a server_cookie=23a74fe56c3fef10 in_seq=0 out_seq=0 2024-05-08T05:30:48.498 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:48.496+0000 7f51a2a00700 10 client.25250 ms_handle_connect on v2:172.21.15.87:6838/2127215876 2024-05-08T05:30:48.499 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:48.497+0000 7f51a2a00700 1 -- 172.21.15.87:0/3954146861 <== mds.1 v2:172.21.15.87:6838/2127215876 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x557fdb7c5140 con 0x557fdb812040 2024-05-08T05:30:48.499 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:48.497+0000 7f51a2a00700 10 client.25250 handle_command_reply: tid=0 2024-05-08T05:30:48.499 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:48.497+0000 7f51ce32ab80 1 client.25250 shutdown 2024-05-08T05:30:48.499 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:48.497+0000 7f51ce32ab80 1 -- 172.21.15.87:0/3954146861 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x557fdb7fe6c0 msgr2=0x557fdb801d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:30:48.499 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:48.497+0000 7f51ce32ab80 1 --2- 172.21.15.87:0/3954146861 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x557fdb7fe6c0 0x557fdb801d10 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f51b4016a90 tx=0x7f51b4004b40 comp rx=0 tx=0).stop 2024-05-08T05:30:48.499 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:48.497+0000 7f51ce32ab80 1 -- 172.21.15.87:0/3954146861 shutdown_connections 2024-05-08T05:30:48.499 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:48.497+0000 7f51ce32ab80 1 --2- 172.21.15.87:0/3954146861 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x557fdb7fe6c0 0x557fdb801d10 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:30:48.499 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:48.497+0000 7f51ce32ab80 1 --2- 172.21.15.87:0/3954146861 >> [v2:172.21.15.87:6838/2127215876,v1:172.21.15.87:6839/2127215876] conn(0x557fdb812040 0x557fdb8144b0 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:30:48.500 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:48.497+0000 7f51ce32ab80 1 --2- 172.21.15.87:0/3954146861 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x557fdb7f8a50 0x557fdb804430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:30:48.500 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:48.497+0000 7f51ce32ab80 1 --2- 172.21.15.87:0/3954146861 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x557fdb7fdda0 0x557fdb8017d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:30:48.500 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:48.497+0000 7f51ce32ab80 1 -- 172.21.15.87:0/3954146861 >> 172.21.15.87:0/3954146861 conn(0x557fdb7706d0 msgr2=0x557fdb7ed750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:30:48.500 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:48.497+0000 7f51a2a00700 0 client.25250 ms_handle_reset on v2:172.21.15.87:6838/2127215876 2024-05-08T05:30:48.500 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:48.498+0000 7f51ce32ab80 1 -- 172.21.15.87:0/3954146861 shutdown_connections 2024-05-08T05:30:48.500 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:48.498+0000 7f51ce32ab80 1 -- 172.21.15.87:0/3954146861 wait complete. 2024-05-08T05:30:48.500 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:48.499+0000 7f51ce32ab80 20 client.25250 trim_cache size 0 max 16384 2024-05-08T05:30:48.515 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:48.515+0000 7f51ce32ab80 1 Processor -- start 2024-05-08T05:30:48.515 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:48.515+0000 7f51ce32ab80 1 -- start start 2024-05-08T05:30:48.516 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:48.515+0000 7f51ce32ab80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x557fdb7f8a50 0x557fdb7f8430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:30:48.516 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:48.515+0000 7f51ce32ab80 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x557fdb7fdda0 0x557fdb80e1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:30:48.516 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:48.515+0000 7f51ce32ab80 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x557fdb7fe6c0 0x557fdb7ed860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:30:48.516 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:48.515+0000 7f51ce32ab80 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f51bc1b22a0 con 0x557fdb7fdda0 2024-05-08T05:30:48.516 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:48.515+0000 7f51ce32ab80 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f51bc1afb30 con 0x557fdb7fe6c0 2024-05-08T05:30:48.516 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:48.515+0000 7f51ce32ab80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f51bc1ad9a0 con 0x557fdb7f8a50 2024-05-08T05:30:48.519 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:48.516+0000 7f51bbe00700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x557fdb7fdda0 0x557fdb80e1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:30:48.519 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:48.516+0000 7f51bbe00700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x557fdb7fdda0 0x557fdb80e1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:37220/0 (socket says 172.21.15.87:37220) 2024-05-08T05:30:48.519 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:48.516+0000 7f51c1a00700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x557fdb7fe6c0 0x557fdb7ed860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:30:48.519 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:48.516+0000 7f51bbe00700 1 -- 172.21.15.87:0/1386347377 learned_addr learned my addr 172.21.15.87:0/1386347377 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T05:30:48.519 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:48.516+0000 7f51c1000700 1 --2- 172.21.15.87:0/1386347377 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x557fdb7f8a50 0x557fdb7f8430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:30:48.519 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:48.517+0000 7f51bbe00700 1 -- 172.21.15.87:0/1386347377 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x557fdb7f8a50 msgr2=0x557fdb7f8430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:30:48.519 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:48.517+0000 7f51bbe00700 1 --2- 172.21.15.87:0/1386347377 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x557fdb7f8a50 0x557fdb7f8430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:30:48.519 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:48.517+0000 7f51bbe00700 1 -- 172.21.15.87:0/1386347377 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x557fdb7fe6c0 msgr2=0x557fdb7ed860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:30:48.519 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:48.517+0000 7f51bbe00700 1 --2- 172.21.15.87:0/1386347377 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x557fdb7fe6c0 0x557fdb7ed860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:30:48.519 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:48.517+0000 7f51bbe00700 1 -- 172.21.15.87:0/1386347377 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557fdb7ef8a0 con 0x557fdb7fdda0 2024-05-08T05:30:48.519 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:48.517+0000 7f51c1a00700 1 --2- 172.21.15.87:0/1386347377 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x557fdb7fe6c0 0x557fdb7ed860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T05:30:48.519 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:48.518+0000 7f51bbe00700 1 --2- 172.21.15.87:0/1386347377 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x557fdb7fdda0 0x557fdb80e1e0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f51a80a7040 tx=0x7f51a8009480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5b0fbad6df296b27 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:30:48.519 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:48.518+0000 7f51ad600700 1 -- 172.21.15.87:0/1386347377 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51a80aa4d0 con 0x557fdb7fdda0 2024-05-08T05:30:48.520 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:48.518+0000 7f51ad600700 1 -- 172.21.15.87:0/1386347377 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f51a80a9dd0 con 0x557fdb7fdda0 2024-05-08T05:30:48.520 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:48.518+0000 7f51ad600700 1 -- 172.21.15.87:0/1386347377 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51a80b2710 con 0x557fdb7fdda0 2024-05-08T05:30:48.521 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:48.519+0000 7f51ce32ab80 1 -- 172.21.15.87:0/1386347377 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x557fdb7fdda0 msgr2=0x557fdb80e1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:30:48.521 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:48.519+0000 7f51ce32ab80 1 --2- 172.21.15.87:0/1386347377 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x557fdb7fdda0 0x557fdb80e1e0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f51a80a7040 tx=0x7f51a8009480 comp rx=0 tx=0).stop 2024-05-08T05:30:48.521 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:48.519+0000 7f51ce32ab80 1 -- 172.21.15.87:0/1386347377 shutdown_connections 2024-05-08T05:30:48.521 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:48.519+0000 7f51ce32ab80 1 --2- 172.21.15.87:0/1386347377 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x557fdb7fe6c0 0x557fdb7ed860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:30:48.521 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:48.519+0000 7f51ce32ab80 1 --2- 172.21.15.87:0/1386347377 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x557fdb7f8a50 0x557fdb7f8430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:30:48.521 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:48.519+0000 7f51ce32ab80 1 --2- 172.21.15.87:0/1386347377 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x557fdb7fdda0 0x557fdb80e1e0 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:30:48.521 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:48.519+0000 7f51ce32ab80 1 -- 172.21.15.87:0/1386347377 >> 172.21.15.87:0/1386347377 conn(0x557fdb7706d0 msgr2=0x557fdb7fead0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:30:48.521 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:48.520+0000 7f51ce32ab80 1 -- 172.21.15.87:0/1386347377 shutdown_connections 2024-05-08T05:30:48.521 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:48.520+0000 7f51ce32ab80 1 -- 172.21.15.87:0/1386347377 wait complete. 2024-05-08T05:30:48.521 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:48.520+0000 7f51ce32ab80 1 -- start start 2024-05-08T05:30:48.522 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:48.521+0000 7f51ce32ab80 1 Processor -- start 2024-05-08T05:30:48.522 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:48.521+0000 7f51ce32ab80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x557fdb7f8a50 0x557fdb80a560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:30:48.522 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:48.521+0000 7f51ce32ab80 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x557fdb7fdda0 0x557fdb80aaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:30:48.523 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:48.522+0000 7f51ce32ab80 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x557fdb7fe6c0 0x557fdb807530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:30:48.523 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:48.522+0000 7f51ce32ab80 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f51bc1adff0 con 0x557fdb7fdda0 2024-05-08T05:30:48.523 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:48.522+0000 7f51ce32ab80 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f51bc1af460 con 0x557fdb7fe6c0 2024-05-08T05:30:48.523 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:48.522+0000 7f51ce32ab80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f51bc1ae6c0 con 0x557fdb7f8a50 2024-05-08T05:30:48.523 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:48.522+0000 7f51ce32ab80 10 client.0 _ll_register_callbacks cb 0x557fdb6f1c70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T05:30:48.524 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:48.522+0000 7f51bbe00700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x557fdb7fdda0 0x557fdb80aaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:30:48.524 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:48.522+0000 7f51c1000700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x557fdb7f8a50 0x557fdb80a560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:30:48.524 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:48.522+0000 7f51bbe00700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x557fdb7fdda0 0x557fdb80aaa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:37222/0 (socket says 172.21.15.87:37222) 2024-05-08T05:30:48.524 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:48.522+0000 7f51bbe00700 1 -- 172.21.15.87:0/3542177669 learned_addr learned my addr 172.21.15.87:0/3542177669 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T05:30:48.524 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:48.522+0000 7f51c1a00700 1 --2- 172.21.15.87:0/3542177669 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x557fdb7fe6c0 0x557fdb807530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:30:48.524 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:48.523+0000 7f51bbe00700 1 -- 172.21.15.87:0/3542177669 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x557fdb7f8a50 msgr2=0x557fdb80a560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:30:48.524 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:48.523+0000 7f51bbe00700 1 --2- 172.21.15.87:0/3542177669 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x557fdb7f8a50 0x557fdb80a560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:30:48.524 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:48.523+0000 7f51bbe00700 1 -- 172.21.15.87:0/3542177669 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x557fdb7fe6c0 msgr2=0x557fdb807530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:30:48.524 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:48.523+0000 7f51bbe00700 1 --2- 172.21.15.87:0/3542177669 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x557fdb7fe6c0 0x557fdb807530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:30:48.524 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:48.523+0000 7f51bbe00700 1 -- 172.21.15.87:0/3542177669 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557fdb807a70 con 0x557fdb7fdda0 2024-05-08T05:30:48.524 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:48.523+0000 7f51bbe00700 1 --2- 172.21.15.87:0/3542177669 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x557fdb7fdda0 0x557fdb80aaa0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f51a80a9ad0 tx=0x7f51a8009520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7a6d14c5b52b190f server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:30:48.525 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:48.523+0000 7f51a2a00700 10 client.0 ms_handle_connect on v2:172.21.15.87:3300/0 2024-05-08T05:30:48.525 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:48.524+0000 7f51a2a00700 1 -- 172.21.15.87:0/3542177669 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51a80aa4d0 con 0x557fdb7fdda0 2024-05-08T05:30:48.525 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:48.524+0000 7f51ce32ab80 1 -- 172.21.15.87:0/3542177669 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f51a80a9dd0 con 0x557fdb7fdda0 2024-05-08T05:30:48.525 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:48.524+0000 7f51a2a00700 1 -- 172.21.15.87:0/3542177669 <== mon.0 v2:172.21.15.87:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8190+0+0 (secure 0 0 0) 0x7f51a80a63c0 con 0x557fdb7fdda0 2024-05-08T05:30:48.525 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:48.524+0000 7f51a2a00700 1 -- 172.21.15.87:0/3542177669 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f51a808a020 con 0x557fdb7fdda0 2024-05-08T05:30:48.525 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:48.524+0000 7f51ce32ab80 10 client.15150 fetch_fsmap learned FSMap version 25 2024-05-08T05:30:48.526 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:48.524+0000 7f51ce32ab80 1 -- 172.21.15.87:0/3542177669 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x557fdb87d040 con 0x557fdb7fdda0 2024-05-08T05:30:48.526 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:48.524+0000 7f51a2a00700 1 -- 172.21.15.87:0/3542177669 <== mon.0 v2:172.21.15.87:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f51a80a9dd0 con 0x557fdb7fdda0 2024-05-08T05:30:48.526 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:48.525+0000 7f51a2a00700 1 -- 172.21.15.87:0/3542177669 <== mon.0 v2:172.21.15.87:3300/0 5 ==== fsmap(e 25) ==== 8338+0+0 (secure 0 0 0) 0x7f51a8029020 con 0x557fdb7fdda0 2024-05-08T05:30:48.526 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:48.525+0000 7f51ce32ab80 10 client.15150 fetch_fsmap finished waiting for FSMap version 25 2024-05-08T05:30:48.526 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:48.525+0000 7f51ce32ab80 10 client.15150 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.g 2024-05-08T05:30:48.526 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:48.525+0000 7f51ce32ab80 20 client.15150 populate_metadata read hostname 'smithi087' 2024-05-08T05:30:48.526 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:48.525+0000 7f51ce32ab80 1 --2- 172.21.15.87:0/3542177669 >> [v2:172.21.15.87:6838/2127215876,v1:172.21.15.87:6839/2127215876] conn(0x557fdb87d540 0x557fdb87f960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:30:48.526 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:48.525+0000 7f51ce32ab80 4 client.15150 mds_command: new command op to 24482 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-05-08T05:30:48.526 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:48.525+0000 7f51ce32ab80 1 -- 172.21.15.87:0/3542177669 --> [v2:172.21.15.87:6838/2127215876,v1:172.21.15.87:6839/2127215876] -- command(tid 0: {"prefix": "damage ls"}) -- 0x557fdb758400 con 0x557fdb87d540 2024-05-08T05:30:48.527 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:48.526+0000 7f51c1000700 1 --2- 172.21.15.87:0/3542177669 >> [v2:172.21.15.87:6838/2127215876,v1:172.21.15.87:6839/2127215876] conn(0x557fdb87d540 0x557fdb87f960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:30:48.529 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:48.528+0000 7f51a2a00700 10 client.15150 ms_handle_connect on v2:172.21.15.87:6838/2127215876 2024-05-08T05:30:48.529 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:48.528+0000 7f51c1000700 1 --2- 172.21.15.87:0/3542177669 >> [v2:172.21.15.87:6838/2127215876,v1:172.21.15.87:6839/2127215876] conn(0x557fdb87d540 0x557fdb87f960 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=7b02250e2796e81d server_cookie=dadbe7354ae4a6f3 in_seq=0 out_seq=0 2024-05-08T05:30:48.529 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:48.529+0000 7f51a2a00700 1 -- 172.21.15.87:0/3542177669 <== mds.1 v2:172.21.15.87:6838/2127215876 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x557fdb758400 con 0x557fdb87d540 2024-05-08T05:30:48.529 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:48.529+0000 7f51a2a00700 10 client.15150 handle_command_reply: tid=0 2024-05-08T05:30:48.530 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:48.529+0000 7f51ce32ab80 1 client.15150 shutdown 2024-05-08T05:30:48.530 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:48.530+0000 7f51ce32ab80 1 -- 172.21.15.87:0/3542177669 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x557fdb7fdda0 msgr2=0x557fdb80aaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:30:48.530 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:48.530+0000 7f51ce32ab80 1 --2- 172.21.15.87:0/3542177669 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x557fdb7fdda0 0x557fdb80aaa0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f51a80a9ad0 tx=0x7f51a8009520 comp rx=0 tx=0).stop 2024-05-08T05:30:48.530 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:48.530+0000 7f51ce32ab80 1 -- 172.21.15.87:0/3542177669 shutdown_connections 2024-05-08T05:30:48.530 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:48.530+0000 7f51ce32ab80 1 --2- 172.21.15.87:0/3542177669 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x557fdb7fe6c0 0x557fdb807530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:30:48.531 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:48.530+0000 7f51ce32ab80 1 --2- 172.21.15.87:0/3542177669 >> [v2:172.21.15.87:6838/2127215876,v1:172.21.15.87:6839/2127215876] conn(0x557fdb87d540 0x557fdb87f960 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:30:48.531 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:48.530+0000 7f51ce32ab80 1 --2- 172.21.15.87:0/3542177669 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x557fdb7f8a50 0x557fdb80a560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:30:48.531 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:48.530+0000 7f51ce32ab80 1 --2- 172.21.15.87:0/3542177669 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x557fdb7fdda0 0x557fdb80aaa0 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:30:48.531 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:48.530+0000 7f51a2a00700 0 client.15150 ms_handle_reset on v2:172.21.15.87:6838/2127215876 2024-05-08T05:30:48.531 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:48.530+0000 7f51ce32ab80 1 -- 172.21.15.87:0/3542177669 >> 172.21.15.87:0/3542177669 conn(0x557fdb7706d0 msgr2=0x557fdb7ff360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:30:48.531 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:48.531+0000 7f51ce32ab80 1 -- 172.21.15.87:0/3542177669 shutdown_connections 2024-05-08T05:30:48.531 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:48.531+0000 7f51ce32ab80 1 -- 172.21.15.87:0/3542177669 wait complete. 2024-05-08T05:30:48.532 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:48.531+0000 7f51ce32ab80 20 client.15150 trim_cache size 0 max 16384 2024-05-08T05:30:48.532 INFO:teuthology.orchestra.run.smithi087.stdout:[] 2024-05-08T05:30:48.532 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:48.532+0000 7f51c2400700 1 -- 172.21.15.87:0/1760714577 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f51a40b29d0 msgr2=0x7f51a40b4e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:30:48.532 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:48.532+0000 7f51c2400700 1 --2- 172.21.15.87:0/1760714577 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f51a40b29d0 0x7f51a40b4e90 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f51b4009fd0 tx=0x7f51b400b040 comp rx=0 tx=0).stop 2024-05-08T05:30:48.532 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:48.532+0000 7f51c2400700 1 -- 172.21.15.87:0/1760714577 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f51bc104eb0 msgr2=0x7f51bc19c250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:30:48.533 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:48.532+0000 7f51c2400700 1 --2- 172.21.15.87:0/1760714577 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f51bc104eb0 0x7f51bc19c250 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f51a8009230 tx=0x7f51a800f950 comp rx=0 tx=0).stop 2024-05-08T05:30:48.533 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:48.532+0000 7f51c2400700 1 -- 172.21.15.87:0/1760714577 shutdown_connections 2024-05-08T05:30:48.533 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:48.532+0000 7f51c2400700 1 --2- 172.21.15.87:0/1760714577 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f51bc10d9c0 0x7f51bc1a05e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:30:48.533 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:48.532+0000 7f51c2400700 1 --2- 172.21.15.87:0/1760714577 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f51bc104590 0x7f51bc19bd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:30:48.533 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:48.532+0000 7f51c2400700 1 --2- 172.21.15.87:0/1760714577 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f51a40b29d0 0x7f51a40b4e90 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:30:48.533 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:48.532+0000 7f51c2400700 1 --2- 172.21.15.87:0/1760714577 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f51bc104eb0 0x7f51bc19c250 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:30:48.533 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:48.532+0000 7f51c2400700 1 -- 172.21.15.87:0/1760714577 >> 172.21.15.87:0/1760714577 conn(0x7f51bc0fddc0 msgr2=0x7f51bc10ed60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:30:48.533 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:48.532+0000 7f51c2400700 1 -- 172.21.15.87:0/1760714577 shutdown_connections 2024-05-08T05:30:48.534 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:48.532+0000 7f51c2400700 1 -- 172.21.15.87:0/1760714577 wait complete. 2024-05-08T05:30:48.917 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:30:48 smithi087 ceph-mon[29523]: pgmap v474: 97 pgs: 97 active+clean; 661 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T05:30:48.983 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:30:48 smithi090 ceph-mon[34526]: pgmap v474: 97 pgs: 97 active+clean; 661 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T05:30:49.038 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:30:48 smithi160 ceph-mon[34827]: pgmap v474: 97 pgs: 97 active+clean; 661 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T05:30:49.449 DEBUG:teuthology.orchestra.run.smithi087:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid eeeb813e-0cf9-11ef-bc97-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-05-08T05:30:49.972 INFO:teuthology.orchestra.run.smithi087.stderr:Inferring config /var/lib/ceph/eeeb813e-0cf9-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T05:30:49.983 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:30:49 smithi090 ceph-mon[34526]: pgmap v475: 97 pgs: 97 active+clean; 661 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-05-08T05:30:50.038 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:30:49 smithi160 ceph-mon[34827]: pgmap v475: 97 pgs: 97 active+clean; 661 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-05-08T05:30:50.130 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:30:49 smithi087 ceph-mon[29523]: pgmap v475: 97 pgs: 97 active+clean; 661 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-05-08T05:30:50.983 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:30:50 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T05:30:51.038 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:30:50 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T05:30:51.161 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:30:50 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T05:30:51.832 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:30:51 smithi087 ceph-mon[29523]: pgmap v476: 97 pgs: 97 active+clean; 661 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T05:30:51.832 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:30:51 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T05:30:51.832 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:30:51 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T05:30:51.832 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:30:51 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:30:52.022 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:52.021+0000 7f0d30a00700 1 -- 172.21.15.87:0/2740958124 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0d2c102d60 msgr2=0x7f0d2c10f250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:30:52.022 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:52.021+0000 7f0d30a00700 1 --2- 172.21.15.87:0/2740958124 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0d2c102d60 0x7f0d2c10f250 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f0d2400b0a0 tx=0x7f0d2400b3b0 comp rx=0 tx=0).stop 2024-05-08T05:30:52.022 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:52.021+0000 7f0d30a00700 1 -- 172.21.15.87:0/2740958124 shutdown_connections 2024-05-08T05:30:52.022 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:52.021+0000 7f0d30a00700 1 --2- 172.21.15.87:0/2740958124 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0d2c102d60 0x7f0d2c10f250 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:30:52.023 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:52.021+0000 7f0d30a00700 1 --2- 172.21.15.87:0/2740958124 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0d2c108410 0x7f0d2c1087f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:30:52.023 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:52.021+0000 7f0d30a00700 1 --2- 172.21.15.87:0/2740958124 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0d2c1023a0 0x7f0d2c102820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:30:52.023 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:52.021+0000 7f0d30a00700 1 -- 172.21.15.87:0/2740958124 >> 172.21.15.87:0/2740958124 conn(0x7f0d2c079350 msgr2=0x7f0d2c079760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:30:52.023 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:52.021+0000 7f0d30a00700 1 -- 172.21.15.87:0/2740958124 shutdown_connections 2024-05-08T05:30:52.023 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:52.021+0000 7f0d30a00700 1 -- 172.21.15.87:0/2740958124 wait complete. 2024-05-08T05:30:52.024 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:52.022+0000 7f0d30a00700 1 Processor -- start 2024-05-08T05:30:52.025 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:52.023+0000 7f0d30a00700 1 -- start start 2024-05-08T05:30:52.025 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:52.023+0000 7f0d30a00700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0d2c1023a0 0x7f0d2c1a1a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:30:52.025 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:52.023+0000 7f0d30a00700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0d2c102d60 0x7f0d2c1a1f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:30:52.025 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:52.023+0000 7f0d30a00700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0d2c108410 0x7f0d2c19bb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:30:52.025 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:52.023+0000 7f0d30a00700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f0d2c113650 con 0x7f0d2c102d60 2024-05-08T05:30:52.025 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:52.023+0000 7f0d30a00700 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f0d2c1134d0 con 0x7f0d2c108410 2024-05-08T05:30:52.025 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:52.023+0000 7f0d30a00700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f0d2c1137d0 con 0x7f0d2c1023a0 2024-05-08T05:30:52.025 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:52.024+0000 7f0d29e00700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0d2c1023a0 0x7f0d2c1a1a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:30:52.025 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:52.024+0000 7f0d29e00700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0d2c1023a0 0x7f0d2c1a1a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.87:57640/0 (socket says 172.21.15.87:57640) 2024-05-08T05:30:52.025 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:52.024+0000 7f0d29e00700 1 -- 172.21.15.87:0/1829786239 learned_addr learned my addr 172.21.15.87:0/1829786239 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T05:30:52.025 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:52.024+0000 7f0d2a800700 1 --2- 172.21.15.87:0/1829786239 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0d2c108410 0x7f0d2c19bb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:30:52.025 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:52.024+0000 7f0d29400700 1 --2- 172.21.15.87:0/1829786239 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0d2c102d60 0x7f0d2c1a1f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:30:52.025 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:52.024+0000 7f0d2a800700 1 -- 172.21.15.87:0/1829786239 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0d2c1023a0 msgr2=0x7f0d2c1a1a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:30:52.026 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:52.024+0000 7f0d2a800700 1 --2- 172.21.15.87:0/1829786239 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0d2c1023a0 0x7f0d2c1a1a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:30:52.026 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:52.024+0000 7f0d2a800700 1 -- 172.21.15.87:0/1829786239 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0d2c102d60 msgr2=0x7f0d2c1a1f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:30:52.026 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:52.024+0000 7f0d2a800700 1 --2- 172.21.15.87:0/1829786239 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0d2c102d60 0x7f0d2c1a1f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:30:52.026 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:52.024+0000 7f0d2a800700 1 -- 172.21.15.87:0/1829786239 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0d2c19c3f0 con 0x7f0d2c108410 2024-05-08T05:30:52.026 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:52.024+0000 7f0d29e00700 1 --2- 172.21.15.87:0/1829786239 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0d2c1023a0 0x7f0d2c1a1a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T05:30:52.026 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:52.024+0000 7f0d29400700 1 --2- 172.21.15.87:0/1829786239 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0d2c102d60 0x7f0d2c1a1f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T05:30:52.026 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:52.024+0000 7f0d2a800700 1 --2- 172.21.15.87:0/1829786239 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0d2c108410 0x7f0d2c19bb10 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f0d2400b070 tx=0x7f0d24004d00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:30:52.026 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:52.025+0000 7f0d22a00700 1 -- 172.21.15.87:0/1829786239 <== mon.2 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d24021070 con 0x7f0d2c108410 2024-05-08T05:30:52.026 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:52.025+0000 7f0d30a00700 1 -- 172.21.15.87:0/1829786239 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0d2c19c680 con 0x7f0d2c108410 2024-05-08T05:30:52.027 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:52.025+0000 7f0d22a00700 1 -- 172.21.15.87:0/1829786239 <== mon.2 v2:172.21.15.90:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0d24007e30 con 0x7f0d2c108410 2024-05-08T05:30:52.027 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:52.025+0000 7f0d22a00700 1 -- 172.21.15.87:0/1829786239 <== mon.2 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d24004630 con 0x7f0d2c108410 2024-05-08T05:30:52.027 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:52.025+0000 7f0d30a00700 1 -- 172.21.15.87:0/1829786239 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0d2c1a89c0 con 0x7f0d2c108410 2024-05-08T05:30:52.031 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:52.030+0000 7f0d22a00700 1 -- 172.21.15.87:0/1829786239 <== mon.2 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7f0d24003c90 con 0x7f0d2c108410 2024-05-08T05:30:52.031 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:52.031+0000 7f0d3b438b80 1 Processor -- start 2024-05-08T05:30:52.031 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:52.031+0000 7f0d3b438b80 1 -- start start 2024-05-08T05:30:52.033 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:52.031+0000 7f0d3b438b80 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x563581175060 0x563581175440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:30:52.033 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:52.031+0000 7f0d3b438b80 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x563581175980 0x563581179490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:30:52.033 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:52.032+0000 7f0d3b438b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5635811799d0 0x563581179e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:30:52.033 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:52.032+0000 7f0d3b438b80 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x5635810c7a20 con 0x563581175060 2024-05-08T05:30:52.033 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:52.032+0000 7f0d3b438b80 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x563581065760 con 0x563581175980 2024-05-08T05:30:52.033 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:52.032+0000 7f0d3b438b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x5635810c39e0 con 0x5635811799d0 2024-05-08T05:30:52.033 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:52.032+0000 7f0d29e00700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x563581175980 0x563581179490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:30:52.033 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:52.032+0000 7f0d29e00700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x563581175980 0x563581179490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.87:59664/0 (socket says 172.21.15.87:59664) 2024-05-08T05:30:52.033 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:52.032+0000 7f0d29e00700 1 -- 172.21.15.87:0/612904014 learned_addr learned my addr 172.21.15.87:0/612904014 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T05:30:52.034 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:52.032+0000 7f0d29e00700 1 -- 172.21.15.87:0/612904014 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5635811799d0 msgr2=0x563581179e30 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-08T05:30:52.034 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:52.032+0000 7f0d29e00700 1 --2- 172.21.15.87:0/612904014 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5635811799d0 0x563581179e30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:30:52.034 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:52.032+0000 7f0d29e00700 1 -- 172.21.15.87:0/612904014 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x563581175060 msgr2=0x563581175440 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-08T05:30:52.034 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:52.033+0000 7f0d22a00700 1 --2- 172.21.15.87:0/1829786239 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f0d100b2900 0x7f0d100b4dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:30:52.035 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:52.033+0000 7f0d22a00700 1 -- 172.21.15.87:0/1829786239 <== mon.2 v2:172.21.15.90:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8190+0+0 (secure 0 0 0) 0x7f0d2400f020 con 0x7f0d2c108410 2024-05-08T05:30:52.035 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:52.033+0000 7f0d29e00700 1 --2- 172.21.15.87:0/612904014 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x563581175060 0x563581175440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:30:52.035 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:52.033+0000 7f0d29e00700 1 -- 172.21.15.87:0/612904014 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5635810148d0 con 0x563581175980 2024-05-08T05:30:52.035 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:52.034+0000 7f0d29e00700 1 --2- 172.21.15.87:0/612904014 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x563581175980 0x563581179490 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f0d1c011650 tx=0x7f0d1c011960 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fa5d9f41c792a207 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:30:52.035 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:52.034+0000 7f0d29400700 1 --2- 172.21.15.87:0/1829786239 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f0d100b2900 0x7f0d100b4dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:30:52.035 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:52.034+0000 7f0d17400700 1 -- 172.21.15.87:0/612904014 <== mon.2 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d1c01e070 con 0x563581175980 2024-05-08T05:30:52.035 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:52.034+0000 7f0d17400700 1 -- 172.21.15.87:0/612904014 <== mon.2 v2:172.21.15.90:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0d1c00fb30 con 0x563581175980 2024-05-08T05:30:52.035 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:52.034+0000 7f0d17400700 1 -- 172.21.15.87:0/612904014 <== mon.2 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d1c019ba0 con 0x563581175980 2024-05-08T05:30:52.036 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:52.035+0000 7f0d3b438b80 1 -- 172.21.15.87:0/612904014 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x563581175980 msgr2=0x563581179490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:30:52.036 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:52.035+0000 7f0d29400700 1 --2- 172.21.15.87:0/1829786239 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f0d100b2900 0x7f0d100b4dc0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f0d2c19d260 tx=0x7f0d18009610 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:30:52.036 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:52.035+0000 7f0d3b438b80 1 --2- 172.21.15.87:0/612904014 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x563581175980 0x563581179490 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f0d1c011650 tx=0x7f0d1c011960 comp rx=0 tx=0).stop 2024-05-08T05:30:52.036 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:52.036+0000 7f0d3b438b80 1 -- 172.21.15.87:0/612904014 shutdown_connections 2024-05-08T05:30:52.036 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:52.036+0000 7f0d3b438b80 1 --2- 172.21.15.87:0/612904014 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5635811799d0 0x563581179e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:30:52.037 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:52.036+0000 7f0d3b438b80 1 --2- 172.21.15.87:0/612904014 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x563581175060 0x563581175440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:30:52.037 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:52.036+0000 7f0d3b438b80 1 --2- 172.21.15.87:0/612904014 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x563581175980 0x563581179490 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:30:52.037 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:52.036+0000 7f0d3b438b80 1 -- 172.21.15.87:0/612904014 >> 172.21.15.87:0/612904014 conn(0x5635810a3b60 msgr2=0x56358116f7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:30:52.037 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:52.036+0000 7f0d3b438b80 1 -- 172.21.15.87:0/612904014 shutdown_connections 2024-05-08T05:30:52.037 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:52.036+0000 7f0d3b438b80 1 -- 172.21.15.87:0/612904014 wait complete. 2024-05-08T05:30:52.037 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:52.036+0000 7f0d3b438b80 1 -- start start 2024-05-08T05:30:52.037 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:52.037+0000 7f0d3b438b80 1 Processor -- start 2024-05-08T05:30:52.037 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:52.037+0000 7f0d3b438b80 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x563581175060 0x563581180e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:30:52.038 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:52.037+0000 7f0d3b438b80 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x563581175980 0x56358117e210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:30:52.038 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:52.037+0000 7f0d3b438b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5635811799d0 0x56358117e750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:30:52.038 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:52.037+0000 7f0d3b438b80 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x563581181be0 con 0x563581175980 2024-05-08T05:30:52.038 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:52.037+0000 7f0d3b438b80 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x56358102db20 con 0x563581175060 2024-05-08T05:30:52.038 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:52.037+0000 7f0d3b438b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x563581181d60 con 0x5635811799d0 2024-05-08T05:30:52.038 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:52.037+0000 7f0d3b438b80 10 client.0 _ll_register_callbacks cb 0x56358106ec70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T05:30:52.039 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:52.038+0000 7f0d29400700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x563581175980 0x56358117e210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:30:52.039 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:52.038+0000 7f0d2a800700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5635811799d0 0x56358117e750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:30:52.039 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:30:51 smithi160 ceph-mon[34827]: pgmap v476: 97 pgs: 97 active+clean; 661 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T05:30:52.039 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:30:51 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T05:30:52.039 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:30:51 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T05:30:52.039 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:30:51 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:30:52.041 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:52.038+0000 7f0d29400700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x563581175980 0x56358117e210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:37266/0 (socket says 172.21.15.87:37266) 2024-05-08T05:30:52.041 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:52.038+0000 7f0d29400700 1 -- 172.21.15.87:0/322616408 learned_addr learned my addr 172.21.15.87:0/322616408 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T05:30:52.041 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:52.038+0000 7f0d29e00700 1 --2- 172.21.15.87:0/322616408 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x563581175060 0x563581180e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:30:52.041 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:52.039+0000 7f0d29400700 1 -- 172.21.15.87:0/322616408 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5635811799d0 msgr2=0x56358117e750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:30:52.041 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:52.039+0000 7f0d29400700 1 --2- 172.21.15.87:0/322616408 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5635811799d0 0x56358117e750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:30:52.041 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:52.039+0000 7f0d29400700 1 -- 172.21.15.87:0/322616408 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x563581175060 msgr2=0x563581180e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:30:52.041 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:52.039+0000 7f0d29400700 1 --2- 172.21.15.87:0/322616408 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x563581175060 0x563581180e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:30:52.041 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:52.039+0000 7f0d29400700 1 -- 172.21.15.87:0/322616408 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56358108d420 con 0x563581175980 2024-05-08T05:30:52.041 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:52.039+0000 7f0d2a800700 1 --2- 172.21.15.87:0/322616408 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5635811799d0 0x56358117e750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T05:30:52.041 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:52.039+0000 7f0d29e00700 1 --2- 172.21.15.87:0/322616408 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x563581175060 0x563581180e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T05:30:52.041 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:52.039+0000 7f0d29400700 1 --2- 172.21.15.87:0/322616408 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x563581175980 0x56358117e210 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f0d18009710 tx=0x7f0d18009260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a087acc954a57ef4 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:30:52.041 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:52.039+0000 7f0d0be00700 10 client.0 ms_handle_connect on v2:172.21.15.87:3300/0 2024-05-08T05:30:52.041 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:52.040+0000 7f0d0be00700 1 -- 172.21.15.87:0/322616408 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d18004220 con 0x563581175980 2024-05-08T05:30:52.042 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:52.040+0000 7f0d0be00700 1 -- 172.21.15.87:0/322616408 <== mon.0 v2:172.21.15.87:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8190+0+0 (secure 0 0 0) 0x7f0d180043c0 con 0x563581175980 2024-05-08T05:30:52.042 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:52.040+0000 7f0d3b438b80 1 -- 172.21.15.87:0/322616408 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0d1c00fb30 con 0x563581175980 2024-05-08T05:30:52.042 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:52.040+0000 7f0d0be00700 1 -- 172.21.15.87:0/322616408 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f0d18003680 con 0x563581175980 2024-05-08T05:30:52.042 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:52.040+0000 7f0d3b438b80 10 client.15159 fetch_fsmap learned FSMap version 25 2024-05-08T05:30:52.042 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:52.040+0000 7f0d3b438b80 1 -- 172.21.15.87:0/322616408 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x56358118c4c0 con 0x563581175980 2024-05-08T05:30:52.042 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:52.041+0000 7f0d0be00700 1 -- 172.21.15.87:0/322616408 <== mon.0 v2:172.21.15.87:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0d1c00fb30 con 0x563581175980 2024-05-08T05:30:52.043 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:52.041+0000 7f0d0be00700 1 -- 172.21.15.87:0/322616408 <== mon.0 v2:172.21.15.87:3300/0 5 ==== fsmap(e 25) ==== 8338+0+0 (secure 0 0 0) 0x7f0d18023070 con 0x563581175980 2024-05-08T05:30:52.043 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:52.041+0000 7f0d3b438b80 10 client.15159 fetch_fsmap finished waiting for FSMap version 25 2024-05-08T05:30:52.043 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:52.041+0000 7f0d3b438b80 10 client.15159 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-05-08T05:30:52.043 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:52.041+0000 7f0d3b438b80 20 client.15159 populate_metadata read hostname 'smithi087' 2024-05-08T05:30:52.043 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:52.041+0000 7f0d3b438b80 1 --2- 172.21.15.87:0/322616408 >> [v2:172.21.15.90:6838/160586017,v1:172.21.15.90:6839/160586017] conn(0x56358118eb00 0x563581190ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:30:52.043 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:52.041+0000 7f0d3b438b80 4 client.15159 mds_command: new command op to 24500 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-08T05:30:52.044 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:52.041+0000 7f0d3b438b80 1 -- 172.21.15.87:0/322616408 --> [v2:172.21.15.90:6838/160586017,v1:172.21.15.90:6839/160586017] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5635811420a0 con 0x56358118eb00 2024-05-08T05:30:52.044 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:52.042+0000 7f0d29e00700 1 --2- 172.21.15.87:0/322616408 >> [v2:172.21.15.90:6838/160586017,v1:172.21.15.90:6839/160586017] conn(0x56358118eb00 0x563581190ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:30:52.044 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:52.042+0000 7f0d29e00700 1 --2- 172.21.15.87:0/322616408 >> [v2:172.21.15.90:6838/160586017,v1:172.21.15.90:6839/160586017] conn(0x56358118eb00 0x563581190ef0 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c9aa08fc4dc2ec30 server_cookie=abd045e53dfb209f in_seq=0 out_seq=0 2024-05-08T05:30:52.044 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:52.042+0000 7f0d0be00700 10 client.15159 ms_handle_connect on v2:172.21.15.90:6838/160586017 2024-05-08T05:30:52.044 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:52.043+0000 7f0d0be00700 1 -- 172.21.15.87:0/322616408 <== mds.0 v2:172.21.15.90:6838/160586017 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x5635811420a0 con 0x56358118eb00 2024-05-08T05:30:52.044 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:52.043+0000 7f0d0be00700 10 client.15159 handle_command_reply: tid=0 2024-05-08T05:30:52.044 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:52.043+0000 7f0d3b438b80 1 client.15159 shutdown 2024-05-08T05:30:52.045 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:52.043+0000 7f0d3b438b80 1 -- 172.21.15.87:0/322616408 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x563581175980 msgr2=0x56358117e210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:30:52.045 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:52.043+0000 7f0d3b438b80 1 --2- 172.21.15.87:0/322616408 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x563581175980 0x56358117e210 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f0d18009710 tx=0x7f0d18009260 comp rx=0 tx=0).stop 2024-05-08T05:30:52.045 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:52.044+0000 7f0d3b438b80 1 -- 172.21.15.87:0/322616408 shutdown_connections 2024-05-08T05:30:52.045 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:52.044+0000 7f0d3b438b80 1 --2- 172.21.15.87:0/322616408 >> [v2:172.21.15.90:6838/160586017,v1:172.21.15.90:6839/160586017] conn(0x56358118eb00 0x563581190ef0 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:30:52.045 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:52.044+0000 7f0d3b438b80 1 --2- 172.21.15.87:0/322616408 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5635811799d0 0x56358117e750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:30:52.045 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:52.044+0000 7f0d3b438b80 1 --2- 172.21.15.87:0/322616408 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x563581175060 0x563581180e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:30:52.045 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:52.044+0000 7f0d3b438b80 1 --2- 172.21.15.87:0/322616408 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x563581175980 0x56358117e210 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:30:52.045 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:52.044+0000 7f0d0be00700 0 client.15159 ms_handle_reset on v2:172.21.15.90:6838/160586017 2024-05-08T05:30:52.045 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:52.044+0000 7f0d3b438b80 1 -- 172.21.15.87:0/322616408 >> 172.21.15.87:0/322616408 conn(0x5635810a3b60 msgr2=0x56358116f760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:30:52.045 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:52.044+0000 7f0d3b438b80 1 -- 172.21.15.87:0/322616408 shutdown_connections 2024-05-08T05:30:52.045 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:52.044+0000 7f0d3b438b80 1 -- 172.21.15.87:0/322616408 wait complete. 2024-05-08T05:30:52.045 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:52.044+0000 7f0d3b438b80 20 client.15159 trim_cache size 0 max 16384 2024-05-08T05:30:52.060 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:52.060+0000 7f0d3b438b80 1 Processor -- start 2024-05-08T05:30:52.060 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:52.060+0000 7f0d3b438b80 1 -- start start 2024-05-08T05:30:52.061 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:52.061+0000 7f0d3b438b80 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x563581175060 0x56358118ac70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:30:52.061 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:52.061+0000 7f0d3b438b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x563581175980 0x56358117b620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:30:52.061 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:52.061+0000 7f0d3b438b80 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5635811799d0 0x56358117bb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:30:52.061 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:52.061+0000 7f0d3b438b80 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f0d2c1b25e0 con 0x563581175060 2024-05-08T05:30:52.062 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:52.061+0000 7f0d3b438b80 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f0d2c1afe70 con 0x5635811799d0 2024-05-08T05:30:52.062 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:52.061+0000 7f0d3b438b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f0d2c1adce0 con 0x563581175980 2024-05-08T05:30:52.062 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:52.061+0000 7f0d29e00700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x563581175060 0x56358118ac70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:30:52.062 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:52.061+0000 7f0d29e00700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x563581175060 0x56358118ac70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:37268/0 (socket says 172.21.15.87:37268) 2024-05-08T05:30:52.062 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:52.061+0000 7f0d29e00700 1 -- 172.21.15.87:0/2912398155 learned_addr learned my addr 172.21.15.87:0/2912398155 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T05:30:52.062 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:52.061+0000 7f0d2a800700 1 --2- 172.21.15.87:0/2912398155 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5635811799d0 0x56358117bb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:30:52.063 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:52.061+0000 7f0d29e00700 1 -- 172.21.15.87:0/2912398155 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x563581175980 msgr2=0x56358117b620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:30:52.063 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:52.061+0000 7f0d29e00700 1 --2- 172.21.15.87:0/2912398155 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x563581175980 0x56358117b620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:30:52.063 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:52.061+0000 7f0d29e00700 1 -- 172.21.15.87:0/2912398155 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5635811799d0 msgr2=0x56358117bb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:30:52.063 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:52.061+0000 7f0d29e00700 1 --2- 172.21.15.87:0/2912398155 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5635811799d0 0x56358117bb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:30:52.063 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:52.062+0000 7f0d29e00700 1 -- 172.21.15.87:0/2912398155 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563581191570 con 0x563581175060 2024-05-08T05:30:52.063 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:52.062+0000 7f0d2a800700 1 --2- 172.21.15.87:0/2912398155 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5635811799d0 0x56358117bb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T05:30:52.063 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:52.062+0000 7f0d29e00700 1 --2- 172.21.15.87:0/2912398155 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x563581175060 0x56358118ac70 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f0d1c01c040 tx=0x7f0d1c009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=96afe1650f303c4e server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:30:52.063 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:52.062+0000 7f0d16a00700 1 -- 172.21.15.87:0/2912398155 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d1c01e040 con 0x563581175060 2024-05-08T05:30:52.063 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:52.063+0000 7f0d16a00700 1 -- 172.21.15.87:0/2912398155 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0d1c01ac90 con 0x563581175060 2024-05-08T05:30:52.063 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:52.063+0000 7f0d16a00700 1 -- 172.21.15.87:0/2912398155 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d1c004970 con 0x563581175060 2024-05-08T05:30:52.064 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:52.064+0000 7f0d3b438b80 1 -- 172.21.15.87:0/2912398155 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x563581175060 msgr2=0x56358118ac70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:30:52.064 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:52.064+0000 7f0d3b438b80 1 --2- 172.21.15.87:0/2912398155 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x563581175060 0x56358118ac70 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f0d1c01c040 tx=0x7f0d1c009840 comp rx=0 tx=0).stop 2024-05-08T05:30:52.064 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:52.064+0000 7f0d3b438b80 1 -- 172.21.15.87:0/2912398155 shutdown_connections 2024-05-08T05:30:52.064 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:52.064+0000 7f0d3b438b80 1 --2- 172.21.15.87:0/2912398155 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5635811799d0 0x56358117bb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:30:52.065 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:52.064+0000 7f0d3b438b80 1 --2- 172.21.15.87:0/2912398155 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x563581175060 0x56358118ac70 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:30:52.065 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:52.064+0000 7f0d3b438b80 1 --2- 172.21.15.87:0/2912398155 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x563581175980 0x56358117b620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:30:52.065 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:52.064+0000 7f0d3b438b80 1 -- 172.21.15.87:0/2912398155 >> 172.21.15.87:0/2912398155 conn(0x5635810a3b60 msgr2=0x56358116f6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:30:52.065 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:52.064+0000 7f0d3b438b80 1 -- 172.21.15.87:0/2912398155 shutdown_connections 2024-05-08T05:30:52.065 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:52.064+0000 7f0d3b438b80 1 -- 172.21.15.87:0/2912398155 wait complete. 2024-05-08T05:30:52.065 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:52.064+0000 7f0d3b438b80 1 -- start start 2024-05-08T05:30:52.065 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:52.065+0000 7f0d3b438b80 1 Processor -- start 2024-05-08T05:30:52.066 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:52.065+0000 7f0d3b438b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x563581175060 0x5635811957b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:30:52.066 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:52.065+0000 7f0d3b438b80 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x563581175980 0x563581195cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:30:52.066 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:52.065+0000 7f0d3b438b80 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5635811799d0 0x563581185ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:30:52.066 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:52.065+0000 7f0d3b438b80 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f0d2c1ae330 con 0x5635811799d0 2024-05-08T05:30:52.066 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:52.065+0000 7f0d3b438b80 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f0d2c1af7a0 con 0x563581175980 2024-05-08T05:30:52.067 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:52.065+0000 7f0d3b438b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f0d2c1aea00 con 0x563581175060 2024-05-08T05:30:52.067 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:52.066+0000 7f0d29400700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x563581175980 0x563581195cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:30:52.067 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:52.066+0000 7f0d29e00700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x563581175060 0x5635811957b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:30:52.067 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:52.066+0000 7f0d3b438b80 10 client.0 _ll_register_callbacks cb 0x56358106ec70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T05:30:52.067 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:52.066+0000 7f0d29400700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x563581175980 0x563581195cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.87:59686/0 (socket says 172.21.15.87:59686) 2024-05-08T05:30:52.067 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:52.066+0000 7f0d29400700 1 -- 172.21.15.87:0/4680129 learned_addr learned my addr 172.21.15.87:0/4680129 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T05:30:52.067 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:52.066+0000 7f0d2a800700 1 --2- 172.21.15.87:0/4680129 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5635811799d0 0x563581185ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:30:52.068 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:52.067+0000 7f0d29e00700 1 -- 172.21.15.87:0/4680129 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x563581175980 msgr2=0x563581195cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:30:52.068 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:52.067+0000 7f0d29e00700 1 --2- 172.21.15.87:0/4680129 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x563581175980 0x563581195cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:30:52.068 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:52.067+0000 7f0d29e00700 1 -- 172.21.15.87:0/4680129 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5635811799d0 msgr2=0x563581185ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:30:52.068 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:52.067+0000 7f0d29e00700 1 --2- 172.21.15.87:0/4680129 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5635811799d0 0x563581185ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:30:52.068 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:52.067+0000 7f0d29e00700 1 -- 172.21.15.87:0/4680129 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563581186530 con 0x563581175060 2024-05-08T05:30:52.068 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:52.067+0000 7f0d29e00700 1 --2- 172.21.15.87:0/4680129 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x563581175060 0x5635811957b0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f0d1c00a010 tx=0x7f0d1c00fee0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5534a00c0f1dc577 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:30:52.068 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:52.067+0000 7f0d0be00700 10 client.0 ms_handle_connect on v2:172.21.15.160:3300/0 2024-05-08T05:30:52.069 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:52.067+0000 7f0d0be00700 1 -- 172.21.15.87:0/4680129 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d1c01e040 con 0x563581175060 2024-05-08T05:30:52.069 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:52.068+0000 7f0d0be00700 1 -- 172.21.15.87:0/4680129 <== mon.1 v2:172.21.15.160:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8190+0+0 (secure 0 0 0) 0x7f0d1c005030 con 0x563581175060 2024-05-08T05:30:52.069 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:52.068+0000 7f0d3b438b80 1 -- 172.21.15.87:0/4680129 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0d1c01ac90 con 0x563581175060 2024-05-08T05:30:52.069 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:52.068+0000 7f0d0be00700 1 -- 172.21.15.87:0/4680129 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f0d1c01ae40 con 0x563581175060 2024-05-08T05:30:52.069 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:52.068+0000 7f0d3b438b80 10 client.25279 fetch_fsmap learned FSMap version 25 2024-05-08T05:30:52.069 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:52.068+0000 7f0d3b438b80 1 -- 172.21.15.87:0/4680129 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x563581187810 con 0x563581175060 2024-05-08T05:30:52.070 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:52.068+0000 7f0d0be00700 1 -- 172.21.15.87:0/4680129 <== mon.1 v2:172.21.15.160:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0d1c0056e0 con 0x563581175060 2024-05-08T05:30:52.070 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:52.069+0000 7f0d0be00700 1 -- 172.21.15.87:0/4680129 <== mon.1 v2:172.21.15.160:3300/0 5 ==== fsmap(e 25) ==== 8338+0+0 (secure 0 0 0) 0x7f0d1c01a040 con 0x563581175060 2024-05-08T05:30:52.070 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:52.069+0000 7f0d3b438b80 10 client.25279 fetch_fsmap finished waiting for FSMap version 25 2024-05-08T05:30:52.070 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:52.069+0000 7f0d3b438b80 10 client.25279 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-05-08T05:30:52.070 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:52.069+0000 7f0d3b438b80 20 client.25279 populate_metadata read hostname 'smithi087' 2024-05-08T05:30:52.070 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:52.069+0000 7f0d3b438b80 1 --2- 172.21.15.87:0/4680129 >> [v2:172.21.15.90:6838/160586017,v1:172.21.15.90:6839/160586017] conn(0x5635811f9370 0x5635811fb760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:30:52.070 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:52.069+0000 7f0d3b438b80 4 client.25279 mds_command: new command op to 24500 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-05-08T05:30:52.070 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:52.069+0000 7f0d3b438b80 1 -- 172.21.15.87:0/4680129 --> [v2:172.21.15.90:6838/160586017,v1:172.21.15.90:6839/160586017] -- command(tid 0: {"prefix": "damage ls"}) -- 0x7f0d1c01ac90 con 0x5635811f9370 2024-05-08T05:30:52.070 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:52.069+0000 7f0d29400700 1 --2- 172.21.15.87:0/4680129 >> [v2:172.21.15.90:6838/160586017,v1:172.21.15.90:6839/160586017] conn(0x5635811f9370 0x5635811fb760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:30:52.070 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:52.070+0000 7f0d29400700 1 --2- 172.21.15.87:0/4680129 >> [v2:172.21.15.90:6838/160586017,v1:172.21.15.90:6839/160586017] conn(0x5635811f9370 0x5635811fb760 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ea0c0fbcd38dc432 server_cookie=2de58eb6bc6356a1 in_seq=0 out_seq=0 2024-05-08T05:30:52.071 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:52.070+0000 7f0d0be00700 10 client.25279 ms_handle_connect on v2:172.21.15.90:6838/160586017 2024-05-08T05:30:52.072 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:52.070+0000 7f0d0be00700 1 -- 172.21.15.87:0/4680129 <== mds.0 v2:172.21.15.90:6838/160586017 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x7f0d1c01ac90 con 0x5635811f9370 2024-05-08T05:30:52.072 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:52.070+0000 7f0d0be00700 10 client.25279 handle_command_reply: tid=0 2024-05-08T05:30:52.072 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:52.070+0000 7f0d3b438b80 1 client.25279 shutdown 2024-05-08T05:30:52.072 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:52.070+0000 7f0d3b438b80 1 -- 172.21.15.87:0/4680129 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x563581175060 msgr2=0x5635811957b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:30:52.072 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:52.070+0000 7f0d3b438b80 1 --2- 172.21.15.87:0/4680129 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x563581175060 0x5635811957b0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f0d1c00a010 tx=0x7f0d1c00fee0 comp rx=0 tx=0).stop 2024-05-08T05:30:52.072 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:52.070+0000 7f0d3b438b80 1 -- 172.21.15.87:0/4680129 shutdown_connections 2024-05-08T05:30:52.072 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:52.070+0000 7f0d3b438b80 1 --2- 172.21.15.87:0/4680129 >> [v2:172.21.15.90:6838/160586017,v1:172.21.15.90:6839/160586017] conn(0x5635811f9370 0x5635811fb760 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:30:52.072 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:52.070+0000 7f0d3b438b80 1 --2- 172.21.15.87:0/4680129 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5635811799d0 0x563581185ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:30:52.072 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:52.071+0000 7f0d3b438b80 1 --2- 172.21.15.87:0/4680129 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x563581175060 0x5635811957b0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:30:52.072 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:52.071+0000 7f0d3b438b80 1 --2- 172.21.15.87:0/4680129 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x563581175980 0x563581195cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:30:52.073 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:52.071+0000 7f0d3b438b80 1 -- 172.21.15.87:0/4680129 >> 172.21.15.87:0/4680129 conn(0x5635810a3b60 msgr2=0x56358117b620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:30:52.073 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:52.071+0000 7f0d0be00700 0 client.25279 ms_handle_reset on v2:172.21.15.90:6838/160586017 2024-05-08T05:30:52.073 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:52.071+0000 7f0d3b438b80 1 -- 172.21.15.87:0/4680129 shutdown_connections 2024-05-08T05:30:52.073 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:52.071+0000 7f0d3b438b80 1 -- 172.21.15.87:0/4680129 wait complete. 2024-05-08T05:30:52.073 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:52.071+0000 7f0d3b438b80 20 client.25279 trim_cache size 0 max 16384 2024-05-08T05:30:52.073 INFO:teuthology.orchestra.run.smithi087.stdout:[] 2024-05-08T05:30:52.074 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:52.072+0000 7f0d30a00700 1 -- 172.21.15.87:0/1829786239 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f0d100b2900 msgr2=0x7f0d100b4dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:30:52.074 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:52.072+0000 7f0d30a00700 1 --2- 172.21.15.87:0/1829786239 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f0d100b2900 0x7f0d100b4dc0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f0d2c19d260 tx=0x7f0d18009610 comp rx=0 tx=0).stop 2024-05-08T05:30:52.074 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:52.072+0000 7f0d30a00700 1 -- 172.21.15.87:0/1829786239 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0d2c108410 msgr2=0x7f0d2c19bb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:30:52.074 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:52.072+0000 7f0d30a00700 1 --2- 172.21.15.87:0/1829786239 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0d2c108410 0x7f0d2c19bb10 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f0d2400b070 tx=0x7f0d24004d00 comp rx=0 tx=0).stop 2024-05-08T05:30:52.074 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:52.072+0000 7f0d30a00700 1 -- 172.21.15.87:0/1829786239 shutdown_connections 2024-05-08T05:30:52.074 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:52.072+0000 7f0d30a00700 1 --2- 172.21.15.87:0/1829786239 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0d2c108410 0x7f0d2c19bb10 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:30:52.074 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:52.072+0000 7f0d30a00700 1 --2- 172.21.15.87:0/1829786239 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f0d100b2900 0x7f0d100b4dc0 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:30:52.074 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:52.072+0000 7f0d30a00700 1 --2- 172.21.15.87:0/1829786239 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0d2c1023a0 0x7f0d2c1a1a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:30:52.074 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:52.072+0000 7f0d30a00700 1 --2- 172.21.15.87:0/1829786239 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0d2c102d60 0x7f0d2c1a1f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:30:52.075 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:52.072+0000 7f0d30a00700 1 -- 172.21.15.87:0/1829786239 >> 172.21.15.87:0/1829786239 conn(0x7f0d2c079350 msgr2=0x7f0d2c10d840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:30:52.075 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:52.072+0000 7f0d30a00700 1 -- 172.21.15.87:0/1829786239 shutdown_connections 2024-05-08T05:30:52.075 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:52.073+0000 7f0d30a00700 1 -- 172.21.15.87:0/1829786239 wait complete. 2024-05-08T05:30:52.233 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:30:51 smithi090 ceph-mon[34526]: pgmap v476: 97 pgs: 97 active+clean; 661 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T05:30:52.234 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:30:51 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T05:30:52.234 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:30:51 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T05:30:52.234 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:30:51 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:30:53.957 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-05-08T05:30:53.957 DEBUG:teuthology.orchestra.run.smithi087:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid eeeb813e-0cf9-11ef-bc97-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-05-08T05:30:54.210 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:30:54 smithi087 ceph-mon[29523]: pgmap v477: 97 pgs: 97 active+clean; 661 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-05-08T05:30:54.449 INFO:teuthology.orchestra.run.smithi087.stderr:Inferring config /var/lib/ceph/eeeb813e-0cf9-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T05:30:54.483 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:30:54 smithi090 ceph-mon[34526]: pgmap v477: 97 pgs: 97 active+clean; 661 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-05-08T05:30:54.538 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:30:54 smithi160 ceph-mon[34827]: pgmap v477: 97 pgs: 97 active+clean; 661 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-05-08T05:30:56.337 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:30:56 smithi087 ceph-mon[29523]: pgmap v478: 97 pgs: 97 active+clean; 661 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-05-08T05:30:56.483 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:30:56 smithi090 ceph-mon[34526]: pgmap v478: 97 pgs: 97 active+clean; 661 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-05-08T05:30:56.538 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:30:56 smithi160 ceph-mon[34827]: pgmap v478: 97 pgs: 97 active+clean; 661 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-05-08T05:30:56.638 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:56.636+0000 7f311a200700 1 -- 172.21.15.87:0/1670123288 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3114109510 msgr2=0x7f31141098f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:30:56.639 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:56.636+0000 7f311a200700 1 --2- 172.21.15.87:0/1670123288 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3114109510 0x7f31141098f0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f3104009990 tx=0x7f3104009ca0 comp rx=0 tx=0).stop 2024-05-08T05:30:56.639 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:56.636+0000 7f311a200700 1 -- 172.21.15.87:0/1670123288 shutdown_connections 2024-05-08T05:30:56.639 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:56.636+0000 7f311a200700 1 --2- 172.21.15.87:0/1670123288 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f311406bb40 0x7f3114110330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:30:56.639 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:56.636+0000 7f311a200700 1 --2- 172.21.15.87:0/1670123288 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3114109510 0x7f31141098f0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:30:56.639 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:56.636+0000 7f311a200700 1 --2- 172.21.15.87:0/1670123288 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f311406b180 0x7f311406b600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:30:56.639 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:56.636+0000 7f311a200700 1 -- 172.21.15.87:0/1670123288 >> 172.21.15.87:0/1670123288 conn(0x7f3114079350 msgr2=0x7f3114079760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:30:56.639 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:56.636+0000 7f311a200700 1 -- 172.21.15.87:0/1670123288 shutdown_connections 2024-05-08T05:30:56.639 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:56.636+0000 7f311a200700 1 -- 172.21.15.87:0/1670123288 wait complete. 2024-05-08T05:30:56.639 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:56.638+0000 7f311a200700 1 Processor -- start 2024-05-08T05:30:56.640 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:56.638+0000 7f311a200700 1 -- start start 2024-05-08T05:30:56.640 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:56.639+0000 7f311a200700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f311406b180 0x7f311419e730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:30:56.640 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:56.639+0000 7f311a200700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f311406bb40 0x7f31141977c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:30:56.640 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:56.639+0000 7f311a200700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3114109510 0x7f3114197d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:30:56.640 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:56.639+0000 7f311a200700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f31141114a0 con 0x7f311406b180 2024-05-08T05:30:56.641 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:56.639+0000 7f311a200700 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f3114111320 con 0x7f3114109510 2024-05-08T05:30:56.641 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:56.639+0000 7f311a200700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f3114111620 con 0x7f311406bb40 2024-05-08T05:30:56.641 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:56.639+0000 7f3113e00700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3114109510 0x7f3114197d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:30:56.641 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:56.640+0000 7f3113e00700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3114109510 0x7f3114197d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.87:47620/0 (socket says 172.21.15.87:47620) 2024-05-08T05:30:56.641 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:56.640+0000 7f3113e00700 1 -- 172.21.15.87:0/3341900667 learned_addr learned my addr 172.21.15.87:0/3341900667 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T05:30:56.641 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:56.640+0000 7f3112a00700 1 --2- 172.21.15.87:0/3341900667 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f311406bb40 0x7f31141977c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:30:56.641 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:56.640+0000 7f3113400700 1 --2- 172.21.15.87:0/3341900667 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f311406b180 0x7f311419e730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:30:56.642 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:56.640+0000 7f3112a00700 1 -- 172.21.15.87:0/3341900667 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3114109510 msgr2=0x7f3114197d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:30:56.642 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:56.640+0000 7f3112a00700 1 --2- 172.21.15.87:0/3341900667 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3114109510 0x7f3114197d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:30:56.642 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:56.640+0000 7f3112a00700 1 -- 172.21.15.87:0/3341900667 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f311406b180 msgr2=0x7f311419e730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:30:56.642 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:56.640+0000 7f3112a00700 1 --2- 172.21.15.87:0/3341900667 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f311406b180 0x7f311419e730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:30:56.642 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:56.640+0000 7f3112a00700 1 -- 172.21.15.87:0/3341900667 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3114198310 con 0x7f311406bb40 2024-05-08T05:30:56.642 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:56.641+0000 7f3112a00700 1 --2- 172.21.15.87:0/3341900667 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f311406bb40 0x7f31141977c0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f310000e9f0 tx=0x7f310000ed00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:30:56.642 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:56.641+0000 7f310be00700 1 -- 172.21.15.87:0/3341900667 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f310000c9c0 con 0x7f311406bb40 2024-05-08T05:30:56.643 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:56.641+0000 7f311a200700 1 -- 172.21.15.87:0/3341900667 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3114198600 con 0x7f311406bb40 2024-05-08T05:30:56.643 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:56.641+0000 7f310be00700 1 -- 172.21.15.87:0/3341900667 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f310000cb60 con 0x7f311406bb40 2024-05-08T05:30:56.643 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:56.642+0000 7f310be00700 1 -- 172.21.15.87:0/3341900667 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3100018680 con 0x7f311406bb40 2024-05-08T05:30:56.643 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:56.642+0000 7f311a200700 1 -- 172.21.15.87:0/3341900667 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f311419c620 con 0x7f311406bb40 2024-05-08T05:30:56.647 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:56.647+0000 7f310be00700 1 -- 172.21.15.87:0/3341900667 <== mon.1 v2:172.21.15.160:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7f3100018820 con 0x7f311406bb40 2024-05-08T05:30:56.648 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:56.648+0000 7f310be00700 1 --2- 172.21.15.87:0/3341900667 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f30f80b2900 0x7f30f80b4dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:30:56.649 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:56.648+0000 7f310be00700 1 -- 172.21.15.87:0/3341900667 <== mon.1 v2:172.21.15.160:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8190+0+0 (secure 0 0 0) 0x7f31000e3320 con 0x7f311406bb40 2024-05-08T05:30:56.649 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:56.649+0000 7f3124c56b80 1 Processor -- start 2024-05-08T05:30:56.650 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:56.649+0000 7f3113400700 1 --2- 172.21.15.87:0/3341900667 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f30f80b2900 0x7f30f80b4dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:30:56.651 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:56.650+0000 7f3124c56b80 1 -- start start 2024-05-08T05:30:56.651 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:56.650+0000 7f3124c56b80 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5557a42890e0 0x5557a42894c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:30:56.651 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:56.650+0000 7f3124c56b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5557a4289a00 0x5557a428d510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:30:56.651 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:56.650+0000 7f3124c56b80 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5557a428da50 0x5557a428deb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:30:56.651 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:56.650+0000 7f3124c56b80 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x5557a41dbaa0 con 0x5557a428da50 2024-05-08T05:30:56.651 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:56.650+0000 7f3124c56b80 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x5557a41797e0 con 0x5557a42890e0 2024-05-08T05:30:56.651 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:56.650+0000 7f3124c56b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x5557a41d7a60 con 0x5557a4289a00 2024-05-08T05:30:56.651 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:56.650+0000 7f3113400700 1 --2- 172.21.15.87:0/3341900667 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f30f80b2900 0x7f30f80b4dc0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f3104006010 tx=0x7f310400b260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:30:56.651 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:56.650+0000 7f3113400700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5557a42890e0 0x5557a42894c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:30:56.652 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:56.650+0000 7f3113400700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5557a42890e0 0x5557a42894c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.87:47636/0 (socket says 172.21.15.87:47636) 2024-05-08T05:30:56.652 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:56.650+0000 7f3113400700 1 -- 172.21.15.87:0/2610439948 learned_addr learned my addr 172.21.15.87:0/2610439948 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T05:30:56.653 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:56.651+0000 7f3113400700 1 -- 172.21.15.87:0/2610439948 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5557a4289a00 msgr2=0x5557a428d510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:30:56.653 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:56.651+0000 7f3112a00700 1 --2- 172.21.15.87:0/2610439948 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5557a4289a00 0x5557a428d510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:30:56.653 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:56.651+0000 7f3113400700 1 --2- 172.21.15.87:0/2610439948 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5557a4289a00 0x5557a428d510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:30:56.653 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:56.651+0000 7f3113400700 1 -- 172.21.15.87:0/2610439948 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5557a428da50 msgr2=0x5557a428deb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:30:56.653 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:56.651+0000 7f3113400700 1 --2- 172.21.15.87:0/2610439948 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5557a428da50 0x5557a428deb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:30:56.653 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:56.651+0000 7f3113400700 1 -- 172.21.15.87:0/2610439948 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5557a4128950 con 0x5557a42890e0 2024-05-08T05:30:56.653 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:56.651+0000 7f3112a00700 1 --2- 172.21.15.87:0/2610439948 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5557a4289a00 0x5557a428d510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T05:30:56.653 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:56.652+0000 7f3113400700 1 --2- 172.21.15.87:0/2610439948 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5557a42890e0 0x5557a42894c0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f31040056e0 tx=0x7f310401f000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=71fd0ffe7257983c server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:30:56.653 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:56.652+0000 7f3108c00700 1 -- 172.21.15.87:0/2610439948 <== mon.2 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f310400bab0 con 0x5557a42890e0 2024-05-08T05:30:56.653 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:56.652+0000 7f3108c00700 1 -- 172.21.15.87:0/2610439948 <== mon.2 v2:172.21.15.90:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f310400bc50 con 0x5557a42890e0 2024-05-08T05:30:56.654 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:56.652+0000 7f3108c00700 1 -- 172.21.15.87:0/2610439948 <== mon.2 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3104024670 con 0x5557a42890e0 2024-05-08T05:30:56.654 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:56.653+0000 7f3124c56b80 1 -- 172.21.15.87:0/2610439948 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5557a42890e0 msgr2=0x5557a42894c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:30:56.654 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:56.653+0000 7f3124c56b80 1 --2- 172.21.15.87:0/2610439948 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5557a42890e0 0x5557a42894c0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f31040056e0 tx=0x7f310401f000 comp rx=0 tx=0).stop 2024-05-08T05:30:56.654 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:56.654+0000 7f3124c56b80 1 -- 172.21.15.87:0/2610439948 shutdown_connections 2024-05-08T05:30:56.654 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:56.654+0000 7f3124c56b80 1 --2- 172.21.15.87:0/2610439948 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5557a428da50 0x5557a428deb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:30:56.654 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:56.654+0000 7f3124c56b80 1 --2- 172.21.15.87:0/2610439948 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5557a42890e0 0x5557a42894c0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:30:56.655 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:56.654+0000 7f3124c56b80 1 --2- 172.21.15.87:0/2610439948 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5557a4289a00 0x5557a428d510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:30:56.655 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:56.654+0000 7f3124c56b80 1 -- 172.21.15.87:0/2610439948 >> 172.21.15.87:0/2610439948 conn(0x5557a41b7be0 msgr2=0x5557a4283820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:30:56.655 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:56.654+0000 7f3124c56b80 1 -- 172.21.15.87:0/2610439948 shutdown_connections 2024-05-08T05:30:56.655 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:56.654+0000 7f3124c56b80 1 -- 172.21.15.87:0/2610439948 wait complete. 2024-05-08T05:30:56.655 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:56.655+0000 7f3124c56b80 1 -- start start 2024-05-08T05:30:56.655 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:56.655+0000 7f3124c56b80 1 Processor -- start 2024-05-08T05:30:56.656 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:56.656+0000 7f3124c56b80 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5557a42890e0 0x5557a4294ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:30:56.656 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:56.656+0000 7f3124c56b80 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5557a4289a00 0x5557a4292270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:30:56.656 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:56.656+0000 7f3124c56b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5557a428da50 0x5557a42927b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:30:56.657 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:56.656+0000 7f3124c56b80 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x5557a4295c00 con 0x5557a42890e0 2024-05-08T05:30:56.657 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:56.656+0000 7f3124c56b80 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x5557a4141ba0 con 0x5557a4289a00 2024-05-08T05:30:56.657 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:56.656+0000 7f3124c56b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x5557a4295d80 con 0x5557a428da50 2024-05-08T05:30:56.657 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:56.656+0000 7f3124c56b80 10 client.0 _ll_register_callbacks cb 0x5557a4182cf0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T05:30:56.657 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:56.656+0000 7f3112a00700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5557a4289a00 0x5557a4292270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:30:56.657 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:56.656+0000 7f3112a00700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5557a4289a00 0x5557a4292270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.87:47642/0 (socket says 172.21.15.87:47642) 2024-05-08T05:30:56.657 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:56.656+0000 7f3112a00700 1 -- 172.21.15.87:0/1385655136 learned_addr learned my addr 172.21.15.87:0/1385655136 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T05:30:56.658 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:56.657+0000 7f3113400700 1 --2- 172.21.15.87:0/1385655136 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5557a42890e0 0x5557a4294ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:30:56.658 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:56.657+0000 7f3113e00700 1 --2- 172.21.15.87:0/1385655136 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5557a428da50 0x5557a42927b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:30:56.658 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:56.657+0000 7f3112a00700 1 -- 172.21.15.87:0/1385655136 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5557a428da50 msgr2=0x5557a42927b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:30:56.658 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:56.657+0000 7f3112a00700 1 --2- 172.21.15.87:0/1385655136 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5557a428da50 0x5557a42927b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:30:56.659 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:56.657+0000 7f3112a00700 1 -- 172.21.15.87:0/1385655136 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5557a42890e0 msgr2=0x5557a4294ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:30:56.659 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:56.657+0000 7f3112a00700 1 --2- 172.21.15.87:0/1385655136 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5557a42890e0 0x5557a4294ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:30:56.659 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:56.657+0000 7f3112a00700 1 -- 172.21.15.87:0/1385655136 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5557a41a14a0 con 0x5557a4289a00 2024-05-08T05:30:56.659 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:56.658+0000 7f3113400700 1 --2- 172.21.15.87:0/1385655136 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5557a42890e0 0x5557a4294ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T05:30:56.659 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:56.658+0000 7f3112a00700 1 --2- 172.21.15.87:0/1385655136 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5557a4289a00 0x5557a4292270 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f31000a7b80 tx=0x7f31000b31f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a4c652d41db9237d server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:30:56.659 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:56.658+0000 7f30fd600700 10 client.0 ms_handle_connect on v2:172.21.15.90:3300/0 2024-05-08T05:30:56.659 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:56.658+0000 7f30fd600700 1 -- 172.21.15.87:0/1385655136 <== mon.2 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31000ab010 con 0x5557a4289a00 2024-05-08T05:30:56.659 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:56.658+0000 7f30fd600700 1 -- 172.21.15.87:0/1385655136 <== mon.2 v2:172.21.15.90:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8190+0+0 (secure 0 0 0) 0x7f31000b32e0 con 0x5557a4289a00 2024-05-08T05:30:56.659 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:56.658+0000 7f3124c56b80 1 -- 172.21.15.87:0/1385655136 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f310400bc50 con 0x5557a4289a00 2024-05-08T05:30:56.660 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:56.658+0000 7f30fd600700 1 -- 172.21.15.87:0/1385655136 <== mon.2 v2:172.21.15.90:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f31000aa910 con 0x5557a4289a00 2024-05-08T05:30:56.660 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:56.659+0000 7f3124c56b80 10 client.25283 fetch_fsmap learned FSMap version 25 2024-05-08T05:30:56.660 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:56.659+0000 7f3124c56b80 1 -- 172.21.15.87:0/1385655136 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x5557a42a0420 con 0x5557a4289a00 2024-05-08T05:30:56.660 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:56.659+0000 7f30fd600700 1 -- 172.21.15.87:0/1385655136 <== mon.2 v2:172.21.15.90:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f310400bc50 con 0x5557a4289a00 2024-05-08T05:30:56.661 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:56.660+0000 7f30fd600700 1 -- 172.21.15.87:0/1385655136 <== mon.2 v2:172.21.15.90:3300/0 5 ==== fsmap(e 25) ==== 8338+0+0 (secure 0 0 0) 0x7f31000cbbc0 con 0x5557a4289a00 2024-05-08T05:30:56.661 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:56.660+0000 7f3124c56b80 10 client.25283 fetch_fsmap finished waiting for FSMap version 25 2024-05-08T05:30:56.661 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:56.660+0000 7f3124c56b80 10 client.25283 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-05-08T05:30:56.661 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:56.660+0000 7f3124c56b80 20 client.25283 populate_metadata read hostname 'smithi087' 2024-05-08T05:30:56.661 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:56.660+0000 7f3124c56b80 1 --2- 172.21.15.87:0/1385655136 >> [v2:172.21.15.90:6838/160586017,v1:172.21.15.90:6839/160586017] conn(0x5557a42a2a60 0x5557a42a4e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:30:56.661 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:56.660+0000 7f3124c56b80 4 client.25283 mds_command: new command op to 24500 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-08T05:30:56.661 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:56.660+0000 7f3124c56b80 1 -- 172.21.15.87:0/1385655136 --> [v2:172.21.15.90:6838/160586017,v1:172.21.15.90:6839/160586017] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5557a4256120 con 0x5557a42a2a60 2024-05-08T05:30:56.662 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:56.661+0000 7f3113400700 1 --2- 172.21.15.87:0/1385655136 >> [v2:172.21.15.90:6838/160586017,v1:172.21.15.90:6839/160586017] conn(0x5557a42a2a60 0x5557a42a4e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:30:56.662 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:56.661+0000 7f3113400700 1 --2- 172.21.15.87:0/1385655136 >> [v2:172.21.15.90:6838/160586017,v1:172.21.15.90:6839/160586017] conn(0x5557a42a2a60 0x5557a42a4e50 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a250d0f5464c7981 server_cookie=1b53cac0c6f9bc79 in_seq=0 out_seq=0 2024-05-08T05:30:56.662 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:56.661+0000 7f30fd600700 10 client.25283 ms_handle_connect on v2:172.21.15.90:6838/160586017 2024-05-08T05:30:56.663 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:56.662+0000 7f30fd600700 1 -- 172.21.15.87:0/1385655136 <== mds.0 v2:172.21.15.90:6838/160586017 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x5557a4256120 con 0x5557a42a2a60 2024-05-08T05:30:56.663 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:56.662+0000 7f30fd600700 10 client.25283 handle_command_reply: tid=0 2024-05-08T05:30:56.663 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:56.663+0000 7f3124c56b80 1 client.25283 shutdown 2024-05-08T05:30:56.664 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:56.664+0000 7f3124c56b80 1 -- 172.21.15.87:0/1385655136 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5557a4289a00 msgr2=0x5557a4292270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:30:56.664 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:56.664+0000 7f3124c56b80 1 --2- 172.21.15.87:0/1385655136 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5557a4289a00 0x5557a4292270 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f31000a7b80 tx=0x7f31000b31f0 comp rx=0 tx=0).stop 2024-05-08T05:30:56.664 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:56.664+0000 7f3124c56b80 1 -- 172.21.15.87:0/1385655136 shutdown_connections 2024-05-08T05:30:56.664 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:56.664+0000 7f3124c56b80 1 --2- 172.21.15.87:0/1385655136 >> [v2:172.21.15.90:6838/160586017,v1:172.21.15.90:6839/160586017] conn(0x5557a42a2a60 0x5557a42a4e50 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:30:56.664 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:56.664+0000 7f3124c56b80 1 --2- 172.21.15.87:0/1385655136 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5557a428da50 0x5557a42927b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:30:56.665 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:56.664+0000 7f3124c56b80 1 --2- 172.21.15.87:0/1385655136 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5557a42890e0 0x5557a4294ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:30:56.665 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:56.664+0000 7f30fd600700 0 client.25283 ms_handle_reset on v2:172.21.15.90:6838/160586017 2024-05-08T05:30:56.665 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:56.664+0000 7f3124c56b80 1 --2- 172.21.15.87:0/1385655136 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5557a4289a00 0x5557a4292270 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:30:56.665 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:56.664+0000 7f3124c56b80 1 -- 172.21.15.87:0/1385655136 >> 172.21.15.87:0/1385655136 conn(0x5557a41b7be0 msgr2=0x5557a427e330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:30:56.665 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:56.664+0000 7f3124c56b80 1 -- 172.21.15.87:0/1385655136 shutdown_connections 2024-05-08T05:30:56.665 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:56.665+0000 7f3124c56b80 1 -- 172.21.15.87:0/1385655136 wait complete. 2024-05-08T05:30:56.666 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:56.665+0000 7f3124c56b80 20 client.25283 trim_cache size 0 max 16384 2024-05-08T05:30:56.707 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:56.707+0000 7f3124c56b80 1 Processor -- start 2024-05-08T05:30:56.708 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:56.707+0000 7f3124c56b80 1 -- start start 2024-05-08T05:30:56.708 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:56.707+0000 7f3124c56b80 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5557a42890e0 0x5557a429ec90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:30:56.708 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:56.707+0000 7f3124c56b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5557a4289a00 0x5557a42aa6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:30:56.708 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:56.708+0000 7f3124c56b80 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5557a428da50 0x5557a42aabe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:30:56.709 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:56.708+0000 7f3124c56b80 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f31141bf090 con 0x5557a42890e0 2024-05-08T05:30:56.709 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:56.708+0000 7f3124c56b80 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f31141bc920 con 0x5557a428da50 2024-05-08T05:30:56.709 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:56.708+0000 7f3124c56b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f31141ba820 con 0x5557a4289a00 2024-05-08T05:30:56.709 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:56.708+0000 7f3113400700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5557a42890e0 0x5557a429ec90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:30:56.709 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:56.708+0000 7f3113400700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5557a42890e0 0x5557a429ec90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:42156/0 (socket says 172.21.15.87:42156) 2024-05-08T05:30:56.709 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:56.708+0000 7f3113400700 1 -- 172.21.15.87:0/2185705633 learned_addr learned my addr 172.21.15.87:0/2185705633 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T05:30:56.709 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:56.708+0000 7f3112a00700 1 --2- 172.21.15.87:0/2185705633 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5557a4289a00 0x5557a42aa6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:30:56.710 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:56.709+0000 7f3113e00700 1 --2- 172.21.15.87:0/2185705633 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5557a428da50 0x5557a42aabe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:30:56.710 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:56.709+0000 7f3113400700 1 -- 172.21.15.87:0/2185705633 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5557a4289a00 msgr2=0x5557a42aa6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:30:56.710 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:56.709+0000 7f3113400700 1 --2- 172.21.15.87:0/2185705633 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5557a4289a00 0x5557a42aa6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:30:56.710 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:56.709+0000 7f3113400700 1 -- 172.21.15.87:0/2185705633 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5557a428da50 msgr2=0x5557a42aabe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:30:56.710 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:56.709+0000 7f3113400700 1 --2- 172.21.15.87:0/2185705633 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5557a428da50 0x5557a42aabe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:30:56.710 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:56.709+0000 7f3113400700 1 -- 172.21.15.87:0/2185705633 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5557a428ee40 con 0x5557a42890e0 2024-05-08T05:30:56.710 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:56.709+0000 7f3113400700 1 --2- 172.21.15.87:0/2185705633 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5557a42890e0 0x5557a429ec90 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f310400fdb0 tx=0x7f310400fd40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e677ab70db55de8e server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:30:56.711 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:56.710+0000 7f30ffe00700 1 -- 172.21.15.87:0/2185705633 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31040247a0 con 0x5557a42890e0 2024-05-08T05:30:56.711 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:56.710+0000 7f30ffe00700 1 -- 172.21.15.87:0/2185705633 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3104024df0 con 0x5557a42890e0 2024-05-08T05:30:56.711 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:56.710+0000 7f30ffe00700 1 -- 172.21.15.87:0/2185705633 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3104003680 con 0x5557a42890e0 2024-05-08T05:30:56.711 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:56.711+0000 7f3124c56b80 1 -- 172.21.15.87:0/2185705633 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5557a42890e0 msgr2=0x5557a429ec90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:30:56.711 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:56.711+0000 7f3124c56b80 1 --2- 172.21.15.87:0/2185705633 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5557a42890e0 0x5557a429ec90 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f310400fdb0 tx=0x7f310400fd40 comp rx=0 tx=0).stop 2024-05-08T05:30:56.712 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:56.711+0000 7f3124c56b80 1 -- 172.21.15.87:0/2185705633 shutdown_connections 2024-05-08T05:30:56.712 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:56.711+0000 7f3124c56b80 1 --2- 172.21.15.87:0/2185705633 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5557a428da50 0x5557a42aabe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:30:56.712 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:56.711+0000 7f3124c56b80 1 --2- 172.21.15.87:0/2185705633 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5557a42890e0 0x5557a429ec90 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:30:56.712 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:56.711+0000 7f3124c56b80 1 --2- 172.21.15.87:0/2185705633 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5557a4289a00 0x5557a42aa6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:30:56.712 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:56.711+0000 7f3124c56b80 1 -- 172.21.15.87:0/2185705633 >> 172.21.15.87:0/2185705633 conn(0x5557a41b7be0 msgr2=0x5557a428fd90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:30:56.713 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:56.712+0000 7f3124c56b80 1 -- 172.21.15.87:0/2185705633 shutdown_connections 2024-05-08T05:30:56.713 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:56.712+0000 7f3124c56b80 1 -- 172.21.15.87:0/2185705633 wait complete. 2024-05-08T05:30:56.713 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:56.712+0000 7f3124c56b80 1 -- start start 2024-05-08T05:30:56.713 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:56.713+0000 7f3124c56b80 1 Processor -- start 2024-05-08T05:30:56.713 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:56.713+0000 7f3124c56b80 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5557a42890e0 0x5557a4297fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:30:56.714 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:56.713+0000 7f3124c56b80 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5557a4289a00 0x5557a4298520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:30:56.714 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:56.713+0000 7f3124c56b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5557a428da50 0x5557a4298a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:30:56.714 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:56.713+0000 7f3124c56b80 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f31141bade0 con 0x5557a4289a00 2024-05-08T05:30:56.714 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:56.713+0000 7f3124c56b80 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f31141bc250 con 0x5557a42890e0 2024-05-08T05:30:56.714 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:56.713+0000 7f3124c56b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f31141bb4b0 con 0x5557a428da50 2024-05-08T05:30:56.714 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:56.713+0000 7f3124c56b80 10 client.0 _ll_register_callbacks cb 0x5557a4182cf0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T05:30:56.715 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:56.714+0000 7f3113400700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5557a42890e0 0x5557a4297fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:30:56.715 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:56.714+0000 7f3113e00700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5557a428da50 0x5557a4298a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:30:56.715 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:56.714+0000 7f3113e00700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5557a428da50 0x5557a4298a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.87:43968/0 (socket says 172.21.15.87:43968) 2024-05-08T05:30:56.715 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:56.714+0000 7f3113e00700 1 -- 172.21.15.87:0/3152483530 learned_addr learned my addr 172.21.15.87:0/3152483530 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T05:30:56.715 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:56.715+0000 7f3112a00700 1 --2- 172.21.15.87:0/3152483530 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5557a4289a00 0x5557a4298520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:30:56.716 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:56.715+0000 7f3113400700 1 -- 172.21.15.87:0/3152483530 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5557a428da50 msgr2=0x5557a4298a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:30:56.716 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:56.715+0000 7f3113400700 1 --2- 172.21.15.87:0/3152483530 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5557a428da50 0x5557a4298a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:30:56.716 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:56.715+0000 7f3113400700 1 -- 172.21.15.87:0/3152483530 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5557a4289a00 msgr2=0x5557a4298520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:30:56.716 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:56.715+0000 7f3113400700 1 --2- 172.21.15.87:0/3152483530 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5557a4289a00 0x5557a4298520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:30:56.716 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:56.715+0000 7f3113400700 1 -- 172.21.15.87:0/3152483530 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5557a430d420 con 0x5557a42890e0 2024-05-08T05:30:56.717 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:56.716+0000 7f3113400700 1 --2- 172.21.15.87:0/3152483530 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5557a42890e0 0x5557a4297fe0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f310400fdb0 tx=0x7f3104009370 comp rx=0 tx=0).ready entity=mon.2 client_cookie=39aefcf7b808c628 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:30:56.717 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:56.716+0000 7f30fd600700 10 client.0 ms_handle_connect on v2:172.21.15.90:3300/0 2024-05-08T05:30:56.717 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:56.717+0000 7f30fd600700 1 -- 172.21.15.87:0/3152483530 <== mon.2 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f310400ba00 con 0x5557a42890e0 2024-05-08T05:30:56.717 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:56.717+0000 7f30fd600700 1 -- 172.21.15.87:0/3152483530 <== mon.2 v2:172.21.15.90:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8190+0+0 (secure 0 0 0) 0x7f310400f460 con 0x5557a42890e0 2024-05-08T05:30:56.717 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:56.717+0000 7f3124c56b80 1 -- 172.21.15.87:0/3152483530 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3104024df0 con 0x5557a42890e0 2024-05-08T05:30:56.718 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:56.717+0000 7f30fd600700 1 -- 172.21.15.87:0/3152483530 <== mon.2 v2:172.21.15.90:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f310400fb90 con 0x5557a42890e0 2024-05-08T05:30:56.718 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:56.717+0000 7f3124c56b80 10 client.25289 fetch_fsmap learned FSMap version 25 2024-05-08T05:30:56.718 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:56.717+0000 7f3124c56b80 1 -- 172.21.15.87:0/3152483530 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x5557a430e740 con 0x5557a42890e0 2024-05-08T05:30:56.718 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:56.718+0000 7f30fd600700 1 -- 172.21.15.87:0/3152483530 <== mon.2 v2:172.21.15.90:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3104024df0 con 0x5557a42890e0 2024-05-08T05:30:56.719 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:56.718+0000 7f30fd600700 1 -- 172.21.15.87:0/3152483530 <== mon.2 v2:172.21.15.90:3300/0 5 ==== fsmap(e 25) ==== 8338+0+0 (secure 0 0 0) 0x7f3104003b70 con 0x5557a42890e0 2024-05-08T05:30:56.719 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:56.718+0000 7f3124c56b80 10 client.25289 fetch_fsmap finished waiting for FSMap version 25 2024-05-08T05:30:56.719 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:56.718+0000 7f3124c56b80 10 client.25289 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-05-08T05:30:56.719 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:56.718+0000 7f3124c56b80 20 client.25289 populate_metadata read hostname 'smithi087' 2024-05-08T05:30:56.720 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:56.718+0000 7f3124c56b80 1 --2- 172.21.15.87:0/3152483530 >> [v2:172.21.15.90:6838/160586017,v1:172.21.15.90:6839/160586017] conn(0x5557a430e960 0x5557a4310d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:30:56.720 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:56.718+0000 7f3124c56b80 4 client.25289 mds_command: new command op to 24500 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-05-08T05:30:56.720 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:56.718+0000 7f3124c56b80 1 -- 172.21.15.87:0/3152483530 --> [v2:172.21.15.90:6838/160586017,v1:172.21.15.90:6839/160586017] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x5557a41e9480 con 0x5557a430e960 2024-05-08T05:30:56.720 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:56.719+0000 7f3112a00700 1 --2- 172.21.15.87:0/3152483530 >> [v2:172.21.15.90:6838/160586017,v1:172.21.15.90:6839/160586017] conn(0x5557a430e960 0x5557a4310d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:30:56.720 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:56.719+0000 7f3112a00700 1 --2- 172.21.15.87:0/3152483530 >> [v2:172.21.15.90:6838/160586017,v1:172.21.15.90:6839/160586017] conn(0x5557a430e960 0x5557a4310d50 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6c13a3874a5d1120 server_cookie=4b396ec7224b2e48 in_seq=0 out_seq=0 2024-05-08T05:30:56.720 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:56.719+0000 7f30fd600700 10 client.25289 ms_handle_connect on v2:172.21.15.90:6838/160586017 2024-05-08T05:30:56.721 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:56.721+0000 7f30fd600700 1 -- 172.21.15.87:0/3152483530 <== mds.0 v2:172.21.15.90:6838/160586017 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x5557a41e9480 con 0x5557a430e960 2024-05-08T05:30:56.721 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:56.721+0000 7f30fd600700 10 client.25289 handle_command_reply: tid=0 2024-05-08T05:30:56.721 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:56.721+0000 7f3124c56b80 1 client.25289 shutdown 2024-05-08T05:30:56.722 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:56.721+0000 7f3124c56b80 1 -- 172.21.15.87:0/3152483530 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5557a42890e0 msgr2=0x5557a4297fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:30:56.722 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:56.721+0000 7f3124c56b80 1 --2- 172.21.15.87:0/3152483530 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5557a42890e0 0x5557a4297fe0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f310400fdb0 tx=0x7f3104009370 comp rx=0 tx=0).stop 2024-05-08T05:30:56.722 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:56.721+0000 7f3124c56b80 1 -- 172.21.15.87:0/3152483530 shutdown_connections 2024-05-08T05:30:56.723 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:56.721+0000 7f3124c56b80 1 --2- 172.21.15.87:0/3152483530 >> [v2:172.21.15.90:6838/160586017,v1:172.21.15.90:6839/160586017] conn(0x5557a430e960 0x5557a4310d50 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:30:56.724 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-05-08T05:30:56.724 INFO:teuthology.orchestra.run.smithi087.stdout: "return_code": 0, 2024-05-08T05:30:56.724 INFO:teuthology.orchestra.run.smithi087.stdout: "scrub_tag": "9a9ec88c-a7aa-4a40-b962-fd1941f55238", 2024-05-08T05:30:56.724 INFO:teuthology.orchestra.run.smithi087.stdout: "mode": "asynchronous" 2024-05-08T05:30:56.724 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-05-08T05:30:56.725 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:56.721+0000 7f3124c56b80 1 --2- 172.21.15.87:0/3152483530 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5557a428da50 0x5557a4298a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:30:56.725 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:56.721+0000 7f3124c56b80 1 --2- 172.21.15.87:0/3152483530 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5557a42890e0 0x5557a4297fe0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:30:56.725 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:56.721+0000 7f3124c56b80 1 --2- 172.21.15.87:0/3152483530 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5557a4289a00 0x5557a4298520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:30:56.725 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:56.721+0000 7f3124c56b80 1 -- 172.21.15.87:0/3152483530 >> 172.21.15.87:0/3152483530 conn(0x5557a41b7be0 msgr2=0x5557a428c8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:30:56.725 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:56.721+0000 7f30fd600700 0 client.25289 ms_handle_reset on v2:172.21.15.90:6838/160586017 2024-05-08T05:30:56.725 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:56.722+0000 7f3124c56b80 1 -- 172.21.15.87:0/3152483530 shutdown_connections 2024-05-08T05:30:56.725 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:56.722+0000 7f3124c56b80 1 -- 172.21.15.87:0/3152483530 wait complete. 2024-05-08T05:30:56.725 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:56.722+0000 7f3124c56b80 20 client.25289 trim_cache size 0 max 16384 2024-05-08T05:30:56.725 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:56.723+0000 7f311a200700 1 -- 172.21.15.87:0/3341900667 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f30f80b2900 msgr2=0x7f30f80b4dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:30:56.725 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:56.723+0000 7f311a200700 1 --2- 172.21.15.87:0/3341900667 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f30f80b2900 0x7f30f80b4dc0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f3104006010 tx=0x7f310400b260 comp rx=0 tx=0).stop 2024-05-08T05:30:56.725 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:56.723+0000 7f311a200700 1 -- 172.21.15.87:0/3341900667 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f311406bb40 msgr2=0x7f31141977c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:30:56.725 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:56.723+0000 7f311a200700 1 --2- 172.21.15.87:0/3341900667 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f311406bb40 0x7f31141977c0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f310000e9f0 tx=0x7f310000ed00 comp rx=0 tx=0).stop 2024-05-08T05:30:56.726 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:56.723+0000 7f311a200700 1 -- 172.21.15.87:0/3341900667 shutdown_connections 2024-05-08T05:30:56.726 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:56.723+0000 7f311a200700 1 --2- 172.21.15.87:0/3341900667 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3114109510 0x7f3114197d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:30:56.726 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:56.723+0000 7f311a200700 1 --2- 172.21.15.87:0/3341900667 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f311406b180 0x7f311419e730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:30:56.726 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:56.723+0000 7f311a200700 1 --2- 172.21.15.87:0/3341900667 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f30f80b2900 0x7f30f80b4dc0 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:30:56.726 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:56.723+0000 7f311a200700 1 --2- 172.21.15.87:0/3341900667 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f311406bb40 0x7f31141977c0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:30:56.726 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:56.723+0000 7f311a200700 1 -- 172.21.15.87:0/3341900667 >> 172.21.15.87:0/3341900667 conn(0x7f3114079350 msgr2=0x7f3114101190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:30:56.726 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:56.724+0000 7f311a200700 1 -- 172.21.15.87:0/3341900667 shutdown_connections 2024-05-08T05:30:56.726 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:30:56.724+0000 7f311a200700 1 -- 172.21.15.87:0/3341900667 wait complete. 2024-05-08T05:30:57.451 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:30:57 smithi087 ceph-mon[29523]: scrub queued for path: / 2024-05-08T05:30:57.451 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:30:57 smithi087 ceph-mon[29523]: scrub summary: idle+waiting paths [/] 2024-05-08T05:30:57.451 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:30:57 smithi087 ceph-mon[29523]: scrub summary: active paths [/] 2024-05-08T05:30:57.451 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:30:57 smithi087 ceph-mon[29523]: scrub summary: idle+waiting paths [/] 2024-05-08T05:30:57.483 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:30:57 smithi090 ceph-mon[34526]: scrub queued for path: / 2024-05-08T05:30:57.483 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:30:57 smithi090 ceph-mon[34526]: scrub summary: idle+waiting paths [/] 2024-05-08T05:30:57.483 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:30:57 smithi090 ceph-mon[34526]: scrub summary: active paths [/] 2024-05-08T05:30:57.484 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:30:57 smithi090 ceph-mon[34526]: scrub summary: idle+waiting paths [/] 2024-05-08T05:30:57.502 DEBUG:teuthology.orchestra.run.smithi087:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid eeeb813e-0cf9-11ef-bc97-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-05-08T05:30:57.538 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:30:57 smithi160 ceph-mon[34827]: scrub queued for path: / 2024-05-08T05:30:57.539 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:30:57 smithi160 ceph-mon[34827]: scrub summary: idle+waiting paths [/] 2024-05-08T05:30:57.539 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:30:57 smithi160 ceph-mon[34827]: scrub summary: active paths [/] 2024-05-08T05:30:57.539 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:30:57 smithi160 ceph-mon[34827]: scrub summary: idle+waiting paths [/] 2024-05-08T05:30:57.915 INFO:teuthology.orchestra.run.smithi087.stderr:Inferring config /var/lib/ceph/eeeb813e-0cf9-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T05:30:58.404 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:30:58 smithi087 ceph-mon[29523]: pgmap v479: 97 pgs: 97 active+clean; 661 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T05:30:58.404 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:30:58 smithi087 ceph-mon[29523]: scrub summary: idle 2024-05-08T05:30:58.483 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:30:58 smithi090 ceph-mon[34526]: pgmap v479: 97 pgs: 97 active+clean; 661 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T05:30:58.483 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:30:58 smithi090 ceph-mon[34526]: scrub summary: idle 2024-05-08T05:30:58.538 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:30:58 smithi160 ceph-mon[34827]: pgmap v479: 97 pgs: 97 active+clean; 661 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T05:30:58.538 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:30:58 smithi160 ceph-mon[34827]: scrub summary: idle 2024-05-08T05:31:00.022 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:00.020+0000 7f8a42600700 1 -- 172.21.15.87:0/2851495363 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8a3c103d90 msgr2=0x7f8a3c1102a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:31:00.022 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:00.020+0000 7f8a42600700 1 --2- 172.21.15.87:0/2851495363 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8a3c103d90 0x7f8a3c1102a0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f8a34009f90 tx=0x7f8a3400b330 comp rx=0 tx=0).stop 2024-05-08T05:31:00.023 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:00.020+0000 7f8a42600700 1 -- 172.21.15.87:0/2851495363 shutdown_connections 2024-05-08T05:31:00.023 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:00.020+0000 7f8a42600700 1 --2- 172.21.15.87:0/2851495363 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8a3c103d90 0x7f8a3c1102a0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:31:00.023 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:00.020+0000 7f8a42600700 1 --2- 172.21.15.87:0/2851495363 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8a3c109460 0x7f8a3c109840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:31:00.023 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:00.020+0000 7f8a42600700 1 --2- 172.21.15.87:0/2851495363 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f8a3c1033d0 0x7f8a3c103850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:31:00.023 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:00.020+0000 7f8a42600700 1 -- 172.21.15.87:0/2851495363 >> 172.21.15.87:0/2851495363 conn(0x7f8a3c0fef20 msgr2=0x7f8a3c101340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:31:00.023 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:00.020+0000 7f8a42600700 1 -- 172.21.15.87:0/2851495363 shutdown_connections 2024-05-08T05:31:00.023 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:00.020+0000 7f8a42600700 1 -- 172.21.15.87:0/2851495363 wait complete. 2024-05-08T05:31:00.023 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:00.022+0000 7f8a42600700 1 Processor -- start 2024-05-08T05:31:00.023 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:00.022+0000 7f8a42600700 1 -- start start 2024-05-08T05:31:00.024 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:00.023+0000 7f8a42600700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8a3c1033d0 0x7f8a3c1a18a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:31:00.024 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:00.023+0000 7f8a42600700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f8a3c103d90 0x7f8a3c1a1de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:31:00.024 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:00.023+0000 7f8a42600700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8a3c109460 0x7f8a3c19ba60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:31:00.024 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:00.023+0000 7f8a42600700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f8a3c1135c0 con 0x7f8a3c109460 2024-05-08T05:31:00.024 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:00.023+0000 7f8a42600700 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f8a3c113440 con 0x7f8a3c1033d0 2024-05-08T05:31:00.024 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:00.023+0000 7f8a42600700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f8a3c113740 con 0x7f8a3c103d90 2024-05-08T05:31:00.024 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:00.023+0000 7f8a41200700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8a3c1033d0 0x7f8a3c1a18a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:31:00.024 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:00.023+0000 7f8a41c00700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8a3c109460 0x7f8a3c19ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:31:00.025 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:00.023+0000 7f8a41200700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8a3c1033d0 0x7f8a3c1a18a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.87:47690/0 (socket says 172.21.15.87:47690) 2024-05-08T05:31:00.025 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:00.023+0000 7f8a41200700 1 -- 172.21.15.87:0/2594205298 learned_addr learned my addr 172.21.15.87:0/2594205298 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T05:31:00.025 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:00.023+0000 7f8a3be00700 1 --2- 172.21.15.87:0/2594205298 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f8a3c103d90 0x7f8a3c1a1de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:31:00.025 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:00.024+0000 7f8a41c00700 1 -- 172.21.15.87:0/2594205298 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f8a3c103d90 msgr2=0x7f8a3c1a1de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:31:00.025 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:00.024+0000 7f8a41c00700 1 --2- 172.21.15.87:0/2594205298 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f8a3c103d90 0x7f8a3c1a1de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:31:00.025 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:00.024+0000 7f8a41c00700 1 -- 172.21.15.87:0/2594205298 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8a3c1033d0 msgr2=0x7f8a3c1a18a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:31:00.025 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:00.024+0000 7f8a41c00700 1 --2- 172.21.15.87:0/2594205298 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8a3c1033d0 0x7f8a3c1a18a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:31:00.025 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:00.024+0000 7f8a41c00700 1 -- 172.21.15.87:0/2594205298 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8a3c19c1c0 con 0x7f8a3c109460 2024-05-08T05:31:00.026 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:00.025+0000 7f8a41c00700 1 --2- 172.21.15.87:0/2594205298 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8a3c109460 0x7f8a3c19ba60 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f8a3400b6c0 tx=0x7f8a3400cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:31:00.026 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:00.025+0000 7f8a39600700 1 -- 172.21.15.87:0/2594205298 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a34021070 con 0x7f8a3c109460 2024-05-08T05:31:00.026 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:00.025+0000 7f8a42600700 1 -- 172.21.15.87:0/2594205298 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8a3c19c450 con 0x7f8a3c109460 2024-05-08T05:31:00.026 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:00.026+0000 7f8a39600700 1 -- 172.21.15.87:0/2594205298 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8a34007ac0 con 0x7f8a3c109460 2024-05-08T05:31:00.026 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:00.026+0000 7f8a39600700 1 -- 172.21.15.87:0/2594205298 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a340052a0 con 0x7f8a3c109460 2024-05-08T05:31:00.026 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:00.026+0000 7f8a42600700 1 -- 172.21.15.87:0/2594205298 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8a3c1a8770 con 0x7f8a3c109460 2024-05-08T05:31:00.029 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:00.029+0000 7f8a39600700 1 -- 172.21.15.87:0/2594205298 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7f8a34024070 con 0x7f8a3c109460 2024-05-08T05:31:00.031 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:00.031+0000 7f8a39600700 1 --2- 172.21.15.87:0/2594205298 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f8a240b2900 0x7f8a240b4dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:31:00.031 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:00.031+0000 7f8a39600700 1 -- 172.21.15.87:0/2594205298 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8190+0+0 (secure 0 0 0) 0x7f8a3400f020 con 0x7f8a3c109460 2024-05-08T05:31:00.032 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:00.031+0000 7f8a41200700 1 --2- 172.21.15.87:0/2594205298 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f8a240b2900 0x7f8a240b4dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:31:00.032 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:00.032+0000 7f8a4e4bdb80 1 Processor -- start 2024-05-08T05:31:00.032 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:00.032+0000 7f8a4e4bdb80 1 -- start start 2024-05-08T05:31:00.032 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:00.032+0000 7f8a41200700 1 --2- 172.21.15.87:0/2594205298 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f8a240b2900 0x7f8a240b4dc0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f8a3c19cba0 tx=0x7f8a30009310 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:31:00.033 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:00.033+0000 7f8a4e4bdb80 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55cadd7279e0 0x55cadd727dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:31:00.034 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:00.033+0000 7f8a4e4bdb80 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55cadd728300 0x55cadd721fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:31:00.034 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:00.033+0000 7f8a4e4bdb80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55cadd722600 0x55cadd722a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:31:00.035 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:00.033+0000 7f8a4e4bdb80 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x55cadd674a20 con 0x55cadd728300 2024-05-08T05:31:00.035 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:00.033+0000 7f8a4e4bdb80 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x55cadd612760 con 0x55cadd7279e0 2024-05-08T05:31:00.035 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:00.033+0000 7f8a4e4bdb80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x55cadd6709e0 con 0x55cadd722600 2024-05-08T05:31:00.035 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:00.033+0000 7f8a3be00700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55cadd728300 0x55cadd721fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:31:00.036 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:00.034+0000 7f8a3be00700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55cadd728300 0x55cadd721fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:42194/0 (socket says 172.21.15.87:42194) 2024-05-08T05:31:00.036 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:00.034+0000 7f8a3be00700 1 -- 172.21.15.87:0/1270376654 learned_addr learned my addr 172.21.15.87:0/1270376654 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T05:31:00.036 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:00.034+0000 7f8a41200700 1 --2- 172.21.15.87:0/1270376654 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55cadd7279e0 0x55cadd727dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:31:00.036 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:00.034+0000 7f8a3be00700 1 -- 172.21.15.87:0/1270376654 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55cadd722600 msgr2=0x55cadd722a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:31:00.036 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:00.034+0000 7f8a41c00700 1 --2- 172.21.15.87:0/1270376654 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55cadd722600 0x55cadd722a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:31:00.036 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:00.034+0000 7f8a3be00700 1 --2- 172.21.15.87:0/1270376654 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55cadd722600 0x55cadd722a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:31:00.036 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:00.034+0000 7f8a3be00700 1 -- 172.21.15.87:0/1270376654 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55cadd7279e0 msgr2=0x55cadd727dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:31:00.036 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:00.034+0000 7f8a3be00700 1 --2- 172.21.15.87:0/1270376654 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55cadd7279e0 0x55cadd727dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:31:00.036 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:00.034+0000 7f8a3be00700 1 -- 172.21.15.87:0/1270376654 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cadd5c18d0 con 0x55cadd728300 2024-05-08T05:31:00.037 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:00.034+0000 7f8a41200700 1 --2- 172.21.15.87:0/1270376654 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55cadd7279e0 0x55cadd727dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T05:31:00.037 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:00.034+0000 7f8a3be00700 1 --2- 172.21.15.87:0/1270376654 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55cadd728300 0x55cadd721fe0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f8a28009cb0 tx=0x7f8a280113e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a4f9e522907f99e3 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:31:00.037 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:00.035+0000 7f8a2e000700 1 -- 172.21.15.87:0/1270376654 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a28011d10 con 0x55cadd728300 2024-05-08T05:31:00.037 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:00.035+0000 7f8a2e000700 1 -- 172.21.15.87:0/1270376654 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8a2800f8f0 con 0x55cadd728300 2024-05-08T05:31:00.037 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:00.035+0000 7f8a2e000700 1 -- 172.21.15.87:0/1270376654 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a28022750 con 0x55cadd728300 2024-05-08T05:31:00.038 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:00.036+0000 7f8a4e4bdb80 1 -- 172.21.15.87:0/1270376654 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55cadd728300 msgr2=0x55cadd721fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:31:00.038 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:00.036+0000 7f8a4e4bdb80 1 --2- 172.21.15.87:0/1270376654 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55cadd728300 0x55cadd721fe0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f8a28009cb0 tx=0x7f8a280113e0 comp rx=0 tx=0).stop 2024-05-08T05:31:00.038 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:00.036+0000 7f8a4e4bdb80 1 -- 172.21.15.87:0/1270376654 shutdown_connections 2024-05-08T05:31:00.038 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:00.036+0000 7f8a4e4bdb80 1 --2- 172.21.15.87:0/1270376654 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55cadd722600 0x55cadd722a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:31:00.038 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:00.036+0000 7f8a4e4bdb80 1 --2- 172.21.15.87:0/1270376654 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55cadd7279e0 0x55cadd727dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:31:00.038 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:00.036+0000 7f8a4e4bdb80 1 --2- 172.21.15.87:0/1270376654 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55cadd728300 0x55cadd721fe0 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:31:00.038 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:00.036+0000 7f8a4e4bdb80 1 -- 172.21.15.87:0/1270376654 >> 172.21.15.87:0/1270376654 conn(0x55cadd650b60 msgr2=0x55cadd71c9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:31:00.038 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:00.037+0000 7f8a4e4bdb80 1 -- 172.21.15.87:0/1270376654 shutdown_connections 2024-05-08T05:31:00.038 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:00.037+0000 7f8a4e4bdb80 1 -- 172.21.15.87:0/1270376654 wait complete. 2024-05-08T05:31:00.038 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:00.037+0000 7f8a4e4bdb80 1 -- start start 2024-05-08T05:31:00.038 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:00.037+0000 7f8a4e4bdb80 1 Processor -- start 2024-05-08T05:31:00.039 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:00.038+0000 7f8a4e4bdb80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55cadd722600 0x55cadd72ded0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:31:00.039 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:00.038+0000 7f8a4e4bdb80 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55cadd7279e0 0x55cadd72b270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:31:00.039 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:00.038+0000 7f8a4e4bdb80 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55cadd728300 0x55cadd72b7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:31:00.039 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:00.038+0000 7f8a4e4bdb80 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x55cadd72edb0 con 0x55cadd7279e0 2024-05-08T05:31:00.039 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:00.038+0000 7f8a4e4bdb80 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x55cadd5dab20 con 0x55cadd728300 2024-05-08T05:31:00.040 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:00.038+0000 7f8a4e4bdb80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x55cadd72ef30 con 0x55cadd722600 2024-05-08T05:31:00.040 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:00.038+0000 7f8a4e4bdb80 10 client.0 _ll_register_callbacks cb 0x55cadd61bc70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T05:31:00.040 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:00.038+0000 7f8a3be00700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55cadd7279e0 0x55cadd72b270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:31:00.040 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:00.038+0000 7f8a3be00700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55cadd7279e0 0x55cadd72b270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:42204/0 (socket says 172.21.15.87:42204) 2024-05-08T05:31:00.040 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:00.038+0000 7f8a3be00700 1 -- 172.21.15.87:0/904275981 learned_addr learned my addr 172.21.15.87:0/904275981 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T05:31:00.041 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:00.038+0000 7f8a41200700 1 --2- 172.21.15.87:0/904275981 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55cadd722600 0x55cadd72ded0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:31:00.041 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:00.038+0000 7f8a41c00700 1 --2- 172.21.15.87:0/904275981 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55cadd728300 0x55cadd72b7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:31:00.041 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:00.039+0000 7f8a3be00700 1 -- 172.21.15.87:0/904275981 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55cadd722600 msgr2=0x55cadd72ded0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:31:00.041 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:00.039+0000 7f8a3be00700 1 --2- 172.21.15.87:0/904275981 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55cadd722600 0x55cadd72ded0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:31:00.041 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:00.039+0000 7f8a3be00700 1 -- 172.21.15.87:0/904275981 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55cadd728300 msgr2=0x55cadd72b7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:31:00.042 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:00.039+0000 7f8a3be00700 1 --2- 172.21.15.87:0/904275981 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55cadd728300 0x55cadd72b7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:31:00.042 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:00.039+0000 7f8a3be00700 1 -- 172.21.15.87:0/904275981 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cadd63a420 con 0x55cadd7279e0 2024-05-08T05:31:00.042 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:00.039+0000 7f8a3be00700 1 --2- 172.21.15.87:0/904275981 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55cadd7279e0 0x55cadd72b270 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f8a28011fc0 tx=0x7f8a2800f860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d31c3f517a946b18 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:31:00.042 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:00.039+0000 7f8a22a00700 10 client.0 ms_handle_connect on v2:172.21.15.87:3300/0 2024-05-08T05:31:00.042 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:00.039+0000 7f8a22a00700 1 -- 172.21.15.87:0/904275981 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a28005230 con 0x55cadd7279e0 2024-05-08T05:31:00.042 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:00.039+0000 7f8a22a00700 1 -- 172.21.15.87:0/904275981 <== mon.0 v2:172.21.15.87:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8190+0+0 (secure 0 0 0) 0x7f8a280053d0 con 0x55cadd7279e0 2024-05-08T05:31:00.042 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:00.040+0000 7f8a4e4bdb80 1 -- 172.21.15.87:0/904275981 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8a2800f8f0 con 0x55cadd7279e0 2024-05-08T05:31:00.042 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:00.040+0000 7f8a22a00700 1 -- 172.21.15.87:0/904275981 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f8a280055d0 con 0x55cadd7279e0 2024-05-08T05:31:00.042 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:00.040+0000 7f8a4e4bdb80 10 client.15192 fetch_fsmap learned FSMap version 25 2024-05-08T05:31:00.042 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:00.040+0000 7f8a4e4bdb80 1 -- 172.21.15.87:0/904275981 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55cadd7394e0 con 0x55cadd7279e0 2024-05-08T05:31:00.042 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:00.040+0000 7f8a22a00700 1 -- 172.21.15.87:0/904275981 <== mon.0 v2:172.21.15.87:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8a2800f8f0 con 0x55cadd7279e0 2024-05-08T05:31:00.042 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:00.041+0000 7f8a22a00700 1 -- 172.21.15.87:0/904275981 <== mon.0 v2:172.21.15.87:3300/0 5 ==== fsmap(e 25) ==== 8338+0+0 (secure 0 0 0) 0x7f8a2802c6f0 con 0x55cadd7279e0 2024-05-08T05:31:00.042 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:00.041+0000 7f8a4e4bdb80 10 client.15192 fetch_fsmap finished waiting for FSMap version 25 2024-05-08T05:31:00.043 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:00.041+0000 7f8a4e4bdb80 10 client.15192 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-05-08T05:31:00.043 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:00.041+0000 7f8a4e4bdb80 20 client.15192 populate_metadata read hostname 'smithi087' 2024-05-08T05:31:00.043 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:00.041+0000 7f8a4e4bdb80 1 --2- 172.21.15.87:0/904275981 >> [v2:172.21.15.90:6838/160586017,v1:172.21.15.90:6839/160586017] conn(0x55cadd73bac0 0x55cadd73deb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:31:00.043 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:00.041+0000 7f8a4e4bdb80 4 client.15192 mds_command: new command op to 24500 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-08T05:31:00.043 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:00.041+0000 7f8a4e4bdb80 1 -- 172.21.15.87:0/904275981 --> [v2:172.21.15.90:6838/160586017,v1:172.21.15.90:6839/160586017] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55cadd6ef0a0 con 0x55cadd73bac0 2024-05-08T05:31:00.043 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:00.041+0000 7f8a41200700 1 --2- 172.21.15.87:0/904275981 >> [v2:172.21.15.90:6838/160586017,v1:172.21.15.90:6839/160586017] conn(0x55cadd73bac0 0x55cadd73deb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:31:00.044 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:00.042+0000 7f8a41200700 1 --2- 172.21.15.87:0/904275981 >> [v2:172.21.15.90:6838/160586017,v1:172.21.15.90:6839/160586017] conn(0x55cadd73bac0 0x55cadd73deb0 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=145a9e0bc1122a00 server_cookie=24a3f927ffe62672 in_seq=0 out_seq=0 2024-05-08T05:31:00.044 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:00.042+0000 7f8a22a00700 10 client.15192 ms_handle_connect on v2:172.21.15.90:6838/160586017 2024-05-08T05:31:00.044 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:00.043+0000 7f8a22a00700 1 -- 172.21.15.87:0/904275981 <== mds.0 v2:172.21.15.90:6838/160586017 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55cadd6ef0a0 con 0x55cadd73bac0 2024-05-08T05:31:00.044 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:00.043+0000 7f8a22a00700 10 client.15192 handle_command_reply: tid=0 2024-05-08T05:31:00.044 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:00.043+0000 7f8a4e4bdb80 1 client.15192 shutdown 2024-05-08T05:31:00.044 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:00.043+0000 7f8a4e4bdb80 1 -- 172.21.15.87:0/904275981 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55cadd7279e0 msgr2=0x55cadd72b270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:31:00.044 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:00.043+0000 7f8a4e4bdb80 1 --2- 172.21.15.87:0/904275981 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55cadd7279e0 0x55cadd72b270 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f8a28011fc0 tx=0x7f8a2800f860 comp rx=0 tx=0).stop 2024-05-08T05:31:00.045 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:00.044+0000 7f8a4e4bdb80 1 -- 172.21.15.87:0/904275981 shutdown_connections 2024-05-08T05:31:00.045 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:00.044+0000 7f8a4e4bdb80 1 --2- 172.21.15.87:0/904275981 >> [v2:172.21.15.90:6838/160586017,v1:172.21.15.90:6839/160586017] conn(0x55cadd73bac0 0x55cadd73deb0 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:31:00.045 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:00.044+0000 7f8a4e4bdb80 1 --2- 172.21.15.87:0/904275981 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55cadd728300 0x55cadd72b7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:31:00.045 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:00.044+0000 7f8a4e4bdb80 1 --2- 172.21.15.87:0/904275981 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55cadd722600 0x55cadd72ded0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:31:00.045 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:00.044+0000 7f8a4e4bdb80 1 --2- 172.21.15.87:0/904275981 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55cadd7279e0 0x55cadd72b270 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:31:00.045 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:00.044+0000 7f8a4e4bdb80 1 -- 172.21.15.87:0/904275981 >> 172.21.15.87:0/904275981 conn(0x55cadd650b60 msgr2=0x55cadd717460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:31:00.046 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:00.044+0000 7f8a22a00700 0 client.15192 ms_handle_reset on v2:172.21.15.90:6838/160586017 2024-05-08T05:31:00.046 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:00.044+0000 7f8a4e4bdb80 1 -- 172.21.15.87:0/904275981 shutdown_connections 2024-05-08T05:31:00.046 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:00.044+0000 7f8a4e4bdb80 1 -- 172.21.15.87:0/904275981 wait complete. 2024-05-08T05:31:00.046 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:00.044+0000 7f8a4e4bdb80 20 client.15192 trim_cache size 0 max 16384 2024-05-08T05:31:00.065 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:00.065+0000 7f8a4e4bdb80 1 Processor -- start 2024-05-08T05:31:00.066 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:00.065+0000 7f8a4e4bdb80 1 -- start start 2024-05-08T05:31:00.066 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:00.066+0000 7f8a4e4bdb80 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55cadd722600 0x55cadd72b230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:31:00.066 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:00.066+0000 7f8a4e4bdb80 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55cadd7279e0 0x55cadd72b770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:31:00.067 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:00.066+0000 7f8a4e4bdb80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55cadd728300 0x55cadd729b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:31:00.067 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:00.066+0000 7f8a4e4bdb80 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f8a3c1adf50 con 0x55cadd7279e0 2024-05-08T05:31:00.067 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:00.066+0000 7f8a4e4bdb80 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f8a3c1ab7e0 con 0x55cadd722600 2024-05-08T05:31:00.067 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:00.066+0000 7f8a4e4bdb80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f8a3c10e140 con 0x55cadd728300 2024-05-08T05:31:00.067 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:00.066+0000 7f8a41200700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55cadd722600 0x55cadd72b230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:31:00.068 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:00.066+0000 7f8a41200700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55cadd722600 0x55cadd72b230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.87:47722/0 (socket says 172.21.15.87:47722) 2024-05-08T05:31:00.068 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:00.066+0000 7f8a41200700 1 -- 172.21.15.87:0/2526056767 learned_addr learned my addr 172.21.15.87:0/2526056767 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T05:31:00.068 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:00.066+0000 7f8a41c00700 1 --2- 172.21.15.87:0/2526056767 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55cadd728300 0x55cadd729b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:31:00.068 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:00.066+0000 7f8a3be00700 1 --2- 172.21.15.87:0/2526056767 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55cadd7279e0 0x55cadd72b770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:31:00.068 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:00.066+0000 7f8a41200700 1 -- 172.21.15.87:0/2526056767 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55cadd728300 msgr2=0x55cadd729b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:31:00.068 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:00.066+0000 7f8a41200700 1 --2- 172.21.15.87:0/2526056767 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55cadd728300 0x55cadd729b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:31:00.068 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:00.066+0000 7f8a41200700 1 -- 172.21.15.87:0/2526056767 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55cadd7279e0 msgr2=0x55cadd72b770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:31:00.068 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:00.067+0000 7f8a41200700 1 --2- 172.21.15.87:0/2526056767 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55cadd7279e0 0x55cadd72b770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:31:00.068 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:00.067+0000 7f8a41200700 1 -- 172.21.15.87:0/2526056767 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cadd728130 con 0x55cadd722600 2024-05-08T05:31:00.068 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:00.067+0000 7f8a3be00700 1 --2- 172.21.15.87:0/2526056767 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55cadd7279e0 0x55cadd72b770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T05:31:00.069 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:00.067+0000 7f8a41200700 1 --2- 172.21.15.87:0/2526056767 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55cadd722600 0x55cadd72b230 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f8a300040b0 tx=0x7f8a30014000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=43770ecaecfd31d5 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:31:00.069 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:00.068+0000 7f8a2d600700 1 -- 172.21.15.87:0/2526056767 <== mon.2 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a3002d070 con 0x55cadd722600 2024-05-08T05:31:00.069 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:00.068+0000 7f8a2d600700 1 -- 172.21.15.87:0/2526056767 <== mon.2 v2:172.21.15.90:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8a30016070 con 0x55cadd722600 2024-05-08T05:31:00.069 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:00.068+0000 7f8a2d600700 1 -- 172.21.15.87:0/2526056767 <== mon.2 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a300288e0 con 0x55cadd722600 2024-05-08T05:31:00.069 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:00.069+0000 7f8a4e4bdb80 1 -- 172.21.15.87:0/2526056767 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55cadd722600 msgr2=0x55cadd72b230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:31:00.069 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:00.069+0000 7f8a4e4bdb80 1 --2- 172.21.15.87:0/2526056767 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55cadd722600 0x55cadd72b230 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f8a300040b0 tx=0x7f8a30014000 comp rx=0 tx=0).stop 2024-05-08T05:31:00.070 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:00.069+0000 7f8a4e4bdb80 1 -- 172.21.15.87:0/2526056767 shutdown_connections 2024-05-08T05:31:00.070 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:00.069+0000 7f8a4e4bdb80 1 --2- 172.21.15.87:0/2526056767 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55cadd728300 0x55cadd729b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:31:00.070 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:00.069+0000 7f8a4e4bdb80 1 --2- 172.21.15.87:0/2526056767 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55cadd722600 0x55cadd72b230 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:31:00.070 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:00.069+0000 7f8a4e4bdb80 1 --2- 172.21.15.87:0/2526056767 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55cadd7279e0 0x55cadd72b770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:31:00.070 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:00.069+0000 7f8a4e4bdb80 1 -- 172.21.15.87:0/2526056767 >> 172.21.15.87:0/2526056767 conn(0x55cadd650b60 msgr2=0x55cadd71c920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:31:00.070 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:00.069+0000 7f8a4e4bdb80 1 -- 172.21.15.87:0/2526056767 shutdown_connections 2024-05-08T05:31:00.070 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:00.070+0000 7f8a4e4bdb80 1 -- 172.21.15.87:0/2526056767 wait complete. 2024-05-08T05:31:00.071 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:00.070+0000 7f8a4e4bdb80 1 -- start start 2024-05-08T05:31:00.071 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:00.070+0000 7f8a4e4bdb80 1 Processor -- start 2024-05-08T05:31:00.071 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:00.071+0000 7f8a4e4bdb80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55cadd722600 0x55cadd7343d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:31:00.071 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:00.071+0000 7f8a4e4bdb80 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55cadd7279e0 0x55cadd734910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:31:00.071 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:00.071+0000 7f8a4e4bdb80 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55cadd728300 0x55cadd742670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:31:00.071 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:00.071+0000 7f8a4e4bdb80 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f8a3c1a9ca0 con 0x55cadd728300 2024-05-08T05:31:00.071 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:00.071+0000 7f8a4e4bdb80 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f8a3c1ab110 con 0x55cadd7279e0 2024-05-08T05:31:00.071 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:00.071+0000 7f8a4e4bdb80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f8a3c1aa370 con 0x55cadd722600 2024-05-08T05:31:00.071 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:00.071+0000 7f8a4e4bdb80 10 client.0 _ll_register_callbacks cb 0x55cadd61bc70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T05:31:00.073 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:00.071+0000 7f8a41c00700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55cadd728300 0x55cadd742670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:31:00.073 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:00.071+0000 7f8a41c00700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55cadd728300 0x55cadd742670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:42222/0 (socket says 172.21.15.87:42222) 2024-05-08T05:31:00.073 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:00.071+0000 7f8a41c00700 1 -- 172.21.15.87:0/2244470484 learned_addr learned my addr 172.21.15.87:0/2244470484 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T05:31:00.073 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:00.072+0000 7f8a3be00700 1 --2- 172.21.15.87:0/2244470484 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55cadd7279e0 0x55cadd734910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:31:00.073 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:00.072+0000 7f8a41c00700 1 -- 172.21.15.87:0/2244470484 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55cadd722600 msgr2=0x55cadd7343d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:31:00.073 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:00.072+0000 7f8a41c00700 1 --2- 172.21.15.87:0/2244470484 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55cadd722600 0x55cadd7343d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:31:00.073 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:00.072+0000 7f8a41c00700 1 -- 172.21.15.87:0/2244470484 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55cadd7279e0 msgr2=0x55cadd734910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:31:00.073 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:00.072+0000 7f8a41c00700 1 --2- 172.21.15.87:0/2244470484 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55cadd7279e0 0x55cadd734910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:31:00.073 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:00.072+0000 7f8a41c00700 1 -- 172.21.15.87:0/2244470484 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cadd742eb0 con 0x55cadd728300 2024-05-08T05:31:00.073 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:00.072+0000 7f8a41c00700 1 --2- 172.21.15.87:0/2244470484 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55cadd728300 0x55cadd742670 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f8a340ab900 tx=0x7f8a3400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dd15e0389a136ebf server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:31:00.073 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:00.072+0000 7f8a22a00700 10 client.0 ms_handle_connect on v2:172.21.15.87:3300/0 2024-05-08T05:31:00.074 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:00.073+0000 7f8a22a00700 1 -- 172.21.15.87:0/2244470484 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a340c2020 con 0x55cadd728300 2024-05-08T05:31:00.074 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:00.073+0000 7f8a22a00700 1 -- 172.21.15.87:0/2244470484 <== mon.0 v2:172.21.15.87:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8190+0+0 (secure 0 0 0) 0x7f8a340c5260 con 0x55cadd728300 2024-05-08T05:31:00.074 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:00.073+0000 7f8a4e4bdb80 1 -- 172.21.15.87:0/2244470484 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8a30016070 con 0x55cadd728300 2024-05-08T05:31:00.074 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:00.074+0000 7f8a22a00700 1 -- 172.21.15.87:0/2244470484 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f8a34093040 con 0x55cadd728300 2024-05-08T05:31:00.074 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:00.074+0000 7f8a4e4bdb80 10 client.15195 fetch_fsmap learned FSMap version 25 2024-05-08T05:31:00.075 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:00.074+0000 7f8a4e4bdb80 1 -- 172.21.15.87:0/2244470484 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55cadd7a5c90 con 0x55cadd728300 2024-05-08T05:31:00.075 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:00.074+0000 7f8a22a00700 1 -- 172.21.15.87:0/2244470484 <== mon.0 v2:172.21.15.87:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8a30016070 con 0x55cadd728300 2024-05-08T05:31:00.075 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:00.074+0000 7f8a22a00700 1 -- 172.21.15.87:0/2244470484 <== mon.0 v2:172.21.15.87:3300/0 5 ==== fsmap(e 25) ==== 8338+0+0 (secure 0 0 0) 0x7f8a34011070 con 0x55cadd728300 2024-05-08T05:31:00.075 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:00.074+0000 7f8a4e4bdb80 10 client.15195 fetch_fsmap finished waiting for FSMap version 25 2024-05-08T05:31:00.075 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:00.074+0000 7f8a4e4bdb80 10 client.15195 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-05-08T05:31:00.075 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:00.074+0000 7f8a4e4bdb80 20 client.15195 populate_metadata read hostname 'smithi087' 2024-05-08T05:31:00.075 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:00.074+0000 7f8a4e4bdb80 1 --2- 172.21.15.87:0/2244470484 >> [v2:172.21.15.90:6838/160586017,v1:172.21.15.90:6839/160586017] conn(0x55cadd7a6320 0x55cadd7a8760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:31:00.076 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:00.074+0000 7f8a4e4bdb80 4 client.15195 mds_command: new command op to 24500 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-05-08T05:31:00.076 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:00.074+0000 7f8a4e4bdb80 1 -- 172.21.15.87:0/2244470484 --> [v2:172.21.15.90:6838/160586017,v1:172.21.15.90:6839/160586017] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55cadd682400 con 0x55cadd7a6320 2024-05-08T05:31:00.076 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:00.076+0000 7f8a41200700 1 --2- 172.21.15.87:0/2244470484 >> [v2:172.21.15.90:6838/160586017,v1:172.21.15.90:6839/160586017] conn(0x55cadd7a6320 0x55cadd7a8760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:31:00.077 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:00.077+0000 7f8a22a00700 10 client.15195 ms_handle_connect on v2:172.21.15.90:6838/160586017 2024-05-08T05:31:00.077 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:00.077+0000 7f8a41200700 1 --2- 172.21.15.87:0/2244470484 >> [v2:172.21.15.90:6838/160586017,v1:172.21.15.90:6839/160586017] conn(0x55cadd7a6320 0x55cadd7a8760 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e5068bbc8d69970c server_cookie=12644e88252e9fd4 in_seq=0 out_seq=0 2024-05-08T05:31:00.077 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:00.077+0000 7f8a22a00700 1 -- 172.21.15.87:0/2244470484 <== mds.0 v2:172.21.15.90:6838/160586017 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x55cadd682400 con 0x55cadd7a6320 2024-05-08T05:31:00.078 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:00.077+0000 7f8a22a00700 10 client.15195 handle_command_reply: tid=0 2024-05-08T05:31:00.078 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:00.077+0000 7f8a4e4bdb80 1 client.15195 shutdown 2024-05-08T05:31:00.078 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:00.077+0000 7f8a4e4bdb80 1 -- 172.21.15.87:0/2244470484 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55cadd728300 msgr2=0x55cadd742670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:31:00.078 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:00.077+0000 7f8a4e4bdb80 1 --2- 172.21.15.87:0/2244470484 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55cadd728300 0x55cadd742670 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f8a340ab900 tx=0x7f8a3400b330 comp rx=0 tx=0).stop 2024-05-08T05:31:00.079 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:00.077+0000 7f8a4e4bdb80 1 -- 172.21.15.87:0/2244470484 shutdown_connections 2024-05-08T05:31:00.079 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:00.077+0000 7f8a4e4bdb80 1 --2- 172.21.15.87:0/2244470484 >> [v2:172.21.15.90:6838/160586017,v1:172.21.15.90:6839/160586017] conn(0x55cadd7a6320 0x55cadd7a8760 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:31:00.079 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:00.077+0000 7f8a4e4bdb80 1 --2- 172.21.15.87:0/2244470484 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55cadd728300 0x55cadd742670 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:31:00.079 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:00.077+0000 7f8a4e4bdb80 1 --2- 172.21.15.87:0/2244470484 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55cadd722600 0x55cadd7343d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:31:00.079 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:00.077+0000 7f8a4e4bdb80 1 --2- 172.21.15.87:0/2244470484 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55cadd7279e0 0x55cadd734910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:31:00.079 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:00.077+0000 7f8a4e4bdb80 1 -- 172.21.15.87:0/2244470484 >> 172.21.15.87:0/2244470484 conn(0x55cadd650b60 msgr2=0x55cadd72b1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:31:00.079 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:00.077+0000 7f8a22a00700 0 client.15195 ms_handle_reset on v2:172.21.15.90:6838/160586017 2024-05-08T05:31:00.079 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:00.078+0000 7f8a4e4bdb80 1 -- 172.21.15.87:0/2244470484 shutdown_connections 2024-05-08T05:31:00.079 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:00.078+0000 7f8a4e4bdb80 1 -- 172.21.15.87:0/2244470484 wait complete. 2024-05-08T05:31:00.079 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:00.078+0000 7f8a4e4bdb80 20 client.15195 trim_cache size 0 max 16384 2024-05-08T05:31:00.080 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-05-08T05:31:00.080 INFO:teuthology.orchestra.run.smithi087.stdout: "status": "no active scrubs running", 2024-05-08T05:31:00.080 INFO:teuthology.orchestra.run.smithi087.stdout: "scrubs": {} 2024-05-08T05:31:00.080 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-05-08T05:31:00.081 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:00.079+0000 7f8a42600700 1 -- 172.21.15.87:0/2594205298 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f8a240b2900 msgr2=0x7f8a240b4dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:31:00.081 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:00.079+0000 7f8a42600700 1 --2- 172.21.15.87:0/2594205298 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f8a240b2900 0x7f8a240b4dc0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f8a3c19cba0 tx=0x7f8a30009310 comp rx=0 tx=0).stop 2024-05-08T05:31:00.081 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:00.079+0000 7f8a42600700 1 -- 172.21.15.87:0/2594205298 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8a3c109460 msgr2=0x7f8a3c19ba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:31:00.081 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:00.079+0000 7f8a42600700 1 --2- 172.21.15.87:0/2594205298 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8a3c109460 0x7f8a3c19ba60 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f8a3400b6c0 tx=0x7f8a3400cce0 comp rx=0 tx=0).stop 2024-05-08T05:31:00.081 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:00.079+0000 7f8a42600700 1 -- 172.21.15.87:0/2594205298 shutdown_connections 2024-05-08T05:31:00.081 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:00.079+0000 7f8a42600700 1 --2- 172.21.15.87:0/2594205298 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8a3c109460 0x7f8a3c19ba60 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:31:00.081 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:00.079+0000 7f8a42600700 1 --2- 172.21.15.87:0/2594205298 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8a3c1033d0 0x7f8a3c1a18a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:31:00.081 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:00.079+0000 7f8a42600700 1 --2- 172.21.15.87:0/2594205298 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f8a240b2900 0x7f8a240b4dc0 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:31:00.081 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:00.079+0000 7f8a42600700 1 --2- 172.21.15.87:0/2594205298 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f8a3c103d90 0x7f8a3c1a1de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:31:00.081 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:00.079+0000 7f8a42600700 1 -- 172.21.15.87:0/2594205298 >> 172.21.15.87:0/2594205298 conn(0x7f8a3c0fef20 msgr2=0x7f8a3c108720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:31:00.081 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:00.080+0000 7f8a42600700 1 -- 172.21.15.87:0/2594205298 shutdown_connections 2024-05-08T05:31:00.081 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:00.080+0000 7f8a42600700 1 -- 172.21.15.87:0/2594205298 wait complete. 2024-05-08T05:31:00.448 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:31:00 smithi087 ceph-mon[29523]: pgmap v480: 97 pgs: 97 active+clean; 661 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 7 op/s 2024-05-08T05:31:00.483 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:31:00 smithi090 ceph-mon[34526]: pgmap v480: 97 pgs: 97 active+clean; 661 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 7 op/s 2024-05-08T05:31:00.538 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:31:00 smithi160 ceph-mon[34827]: pgmap v480: 97 pgs: 97 active+clean; 661 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 7 op/s 2024-05-08T05:31:00.988 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-05-08T05:31:00.989 DEBUG:teuthology.orchestra.run.smithi087:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid eeeb813e-0cf9-11ef-bc97-c7b262605968 -- ceph fs dump --format=json 2024-05-08T05:31:01.445 INFO:teuthology.orchestra.run.smithi087.stderr:Inferring config /var/lib/ceph/eeeb813e-0cf9-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T05:31:02.208 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:31:02 smithi087 ceph-mon[29523]: pgmap v481: 97 pgs: 97 active+clean; 661 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 5 op/s 2024-05-08T05:31:02.484 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:31:02 smithi090 ceph-mon[34526]: pgmap v481: 97 pgs: 97 active+clean; 661 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 5 op/s 2024-05-08T05:31:02.538 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:31:02 smithi160 ceph-mon[34827]: pgmap v481: 97 pgs: 97 active+clean; 661 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 5 op/s 2024-05-08T05:31:03.688 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:03.687+0000 7f0e0dc00700 1 -- 172.21.15.87:0/1197113033 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0e08104100 msgr2=0x7f0e08108120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:31:03.688 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:03.687+0000 7f0e0dc00700 1 --2- 172.21.15.87:0/1197113033 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0e08104100 0x7f0e08108120 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f0df40098f0 tx=0x7f0df4009c00 comp rx=0 tx=0).stop 2024-05-08T05:31:03.688 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:03.687+0000 7f0e0dc00700 1 -- 172.21.15.87:0/1197113033 shutdown_connections 2024-05-08T05:31:03.688 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:03.687+0000 7f0e0dc00700 1 --2- 172.21.15.87:0/1197113033 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0e08108850 0x7f0e081103d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:31:03.688 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:03.687+0000 7f0e0dc00700 1 --2- 172.21.15.87:0/1197113033 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0e08103750 0x7f0e08103b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:31:03.688 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:03.687+0000 7f0e0dc00700 1 --2- 172.21.15.87:0/1197113033 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0e08104100 0x7f0e08108120 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:31:03.688 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:03.687+0000 7f0e0dc00700 1 -- 172.21.15.87:0/1197113033 >> 172.21.15.87:0/1197113033 conn(0x7f0e0807a600 msgr2=0x7f0e0807aa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:31:03.688 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:03.687+0000 7f0e0dc00700 1 -- 172.21.15.87:0/1197113033 shutdown_connections 2024-05-08T05:31:03.689 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:03.688+0000 7f0e0dc00700 1 -- 172.21.15.87:0/1197113033 wait complete. 2024-05-08T05:31:03.690 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:03.690+0000 7f0e0dc00700 1 Processor -- start 2024-05-08T05:31:03.690 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:03.690+0000 7f0e0dc00700 1 -- start start 2024-05-08T05:31:03.691 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:03.691+0000 7f0e0dc00700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0e08103750 0x7f0e080757a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:31:03.691 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:03.691+0000 7f0e0dc00700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0e08104100 0x7f0e08075ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:31:03.691 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:03.691+0000 7f0e0dc00700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0e08108850 0x7f0e08076220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:31:03.691 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:03.691+0000 7f0e0dc00700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f0e08113680 con 0x7f0e08108850 2024-05-08T05:31:03.691 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:03.691+0000 7f0e0dc00700 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f0e08113500 con 0x7f0e08103750 2024-05-08T05:31:03.691 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:03.691+0000 7f0e0dc00700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f0e08113800 con 0x7f0e08104100 2024-05-08T05:31:03.692 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:03.691+0000 7f0e06000700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0e08104100 0x7f0e08075ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:31:03.692 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:03.691+0000 7f0e06000700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0e08104100 0x7f0e08075ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.87:44030/0 (socket says 172.21.15.87:44030) 2024-05-08T05:31:03.692 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:03.691+0000 7f0e06000700 1 -- 172.21.15.87:0/1486445026 learned_addr learned my addr 172.21.15.87:0/1486445026 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T05:31:03.692 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:03.691+0000 7f0e06a00700 1 --2- 172.21.15.87:0/1486445026 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0e08103750 0x7f0e080757a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:31:03.692 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:03.691+0000 7f0e06a00700 1 -- 172.21.15.87:0/1486445026 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0e08104100 msgr2=0x7f0e08075ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:31:03.692 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:03.691+0000 7f0e07400700 1 --2- 172.21.15.87:0/1486445026 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0e08108850 0x7f0e08076220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:31:03.692 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:03.691+0000 7f0e06a00700 1 --2- 172.21.15.87:0/1486445026 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0e08104100 0x7f0e08075ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:31:03.692 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:03.691+0000 7f0e06a00700 1 -- 172.21.15.87:0/1486445026 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0e08108850 msgr2=0x7f0e08076220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:31:03.692 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:03.692+0000 7f0e06a00700 1 --2- 172.21.15.87:0/1486445026 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0e08108850 0x7f0e08076220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:31:03.692 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:03.692+0000 7f0e06a00700 1 -- 172.21.15.87:0/1486445026 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0e081a8090 con 0x7f0e08103750 2024-05-08T05:31:03.693 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:03.692+0000 7f0e07400700 1 --2- 172.21.15.87:0/1486445026 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0e08108850 0x7f0e08076220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T05:31:03.693 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:03.692+0000 7f0e06000700 1 --2- 172.21.15.87:0/1486445026 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0e08104100 0x7f0e08075ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T05:31:03.693 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:03.692+0000 7f0e06a00700 1 --2- 172.21.15.87:0/1486445026 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0e08103750 0x7f0e080757a0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f0df800e9c0 tx=0x7f0df800ecd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:31:03.693 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:03.692+0000 7f0dff400700 1 -- 172.21.15.87:0/1486445026 <== mon.2 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0df800c9c0 con 0x7f0e08103750 2024-05-08T05:31:03.694 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:03.692+0000 7f0e0dc00700 1 -- 172.21.15.87:0/1486445026 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0e081a8380 con 0x7f0e08103750 2024-05-08T05:31:03.694 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:03.692+0000 7f0dff400700 1 -- 172.21.15.87:0/1486445026 <== mon.2 v2:172.21.15.90:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0df800cb60 con 0x7f0e08103750 2024-05-08T05:31:03.694 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:03.693+0000 7f0dff400700 1 -- 172.21.15.87:0/1486445026 <== mon.2 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0df8018680 con 0x7f0e08103750 2024-05-08T05:31:03.694 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:03.693+0000 7f0e0dc00700 1 -- 172.21.15.87:0/1486445026 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0e081a8910 con 0x7f0e08103750 2024-05-08T05:31:03.694 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:03.694+0000 7f0e0dc00700 1 -- 172.21.15.87:0/1486445026 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0de8005330 con 0x7f0e08103750 2024-05-08T05:31:03.698 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:03.698+0000 7f0dff400700 1 -- 172.21.15.87:0/1486445026 <== mon.2 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7f0df800cd10 con 0x7f0e08103750 2024-05-08T05:31:03.699 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:03.699+0000 7f0dff400700 1 --2- 172.21.15.87:0/1486445026 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f0dec0b2900 0x7f0dec0b4dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:31:03.700 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:03.699+0000 7f0dff400700 1 -- 172.21.15.87:0/1486445026 <== mon.2 v2:172.21.15.90:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8190+0+0 (secure 0 0 0) 0x7f0df80e2250 con 0x7f0e08103750 2024-05-08T05:31:03.700 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:03.700+0000 7f0e06000700 1 --2- 172.21.15.87:0/1486445026 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f0dec0b2900 0x7f0dec0b4dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:31:03.701 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:03.701+0000 7f0e06000700 1 --2- 172.21.15.87:0/1486445026 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f0dec0b2900 0x7f0dec0b4dc0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f0e081030b0 tx=0x7f0df4019040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:31:03.704 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:03.703+0000 7f0dff400700 1 -- 172.21.15.87:0/1486445026 <== mon.2 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f0df8054df0 con 0x7f0e08103750 2024-05-08T05:31:03.974 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:03.974+0000 7f0e0dc00700 1 -- 172.21.15.87:0/1486445026 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f0de8005620 con 0x7f0e08103750 2024-05-08T05:31:03.975 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:03.975+0000 7f0dff400700 1 -- 172.21.15.87:0/1486445026 <== mon.2 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) ==== 94+0+11858 (secure 0 0 0) 0x7f0df80a9fa0 con 0x7f0e08103750 2024-05-08T05:31:03.976 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-05-08T05:31:03.976 INFO:teuthology.orchestra.run.smithi087.stdout:{"epoch":25,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14358,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6835/1183985321","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6834","nonce":1183985321},{"type":"v1","addr":"172.21.15.87:6835","nonce":1183985321}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14370,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6837/1485824316","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6836","nonce":1485824316},{"type":"v1","addr":"172.21.15.87:6837","nonce":1485824316}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14409,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6841/724277538","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6840","nonce":724277538},{"type":"v1","addr":"172.21.15.87:6841","nonce":724277538}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24412,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6833/3339455985","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6832","nonce":3339455985},{"type":"v1","addr":"172.21.15.160:6833","nonce":3339455985}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24413,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6833/3292166873","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6832","nonce":3292166873},{"type":"v1","addr":"172.21.15.90:6833","nonce":3292166873}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24443,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6835/824555459","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6834","nonce":824555459},{"type":"v1","addr":"172.21.15.90:6835","nonce":824555459}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6}],"filesystems":[{"mdsmap":{"epoch":25,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-05-08T05:25:36.816840+0000","modified":"2024-05-08T05:29:16.624018+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24500,"mds_1":24482,"mds_2":24481},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24463":{"gid":24463,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.160:6835/409648357","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6834","nonce":409648357},{"type":"v1","addr":"172.21.15.160:6835","nonce":409648357}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24467":{"gid":24467,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.90:6837/4221919418","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6836","nonce":4221919418},{"type":"v1","addr":"172.21.15.90:6837","nonce":4221919418}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24469":{"gid":24469,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.160:6837/4200018040","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6836","nonce":4200018040},{"type":"v1","addr":"172.21.15.160:6837","nonce":4200018040}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24481":{"gid":24481,"name":"i","rank":2,"incarnation":20,"state":"up:active","state_seq":13,"addr":"172.21.15.160:6839/234657686","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6838","nonce":234657686},{"type":"v1","addr":"172.21.15.160:6839","nonce":234657686}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24482":{"gid":24482,"name":"g","rank":1,"incarnation":18,"state":"up:active","state_seq":12,"addr":"172.21.15.87:6839/2127215876","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6838","nonce":2127215876},{"type":"v1","addr":"172.21.15.87:6839","nonce":2127215876}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24500":{"gid":24500,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.90:6839/160586017","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6838","nonce":160586017},{"type":"v1","addr":"172.21.15.90:6839","nonce":160586017}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24500,"qdb_cluster":[24481,24482,24500]},"id":1}]} 2024-05-08T05:31:03.978 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:03.978+0000 7f0e0dc00700 1 -- 172.21.15.87:0/1486445026 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f0dec0b2900 msgr2=0x7f0dec0b4dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:31:03.979 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:03.978+0000 7f0e0dc00700 1 --2- 172.21.15.87:0/1486445026 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f0dec0b2900 0x7f0dec0b4dc0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f0e081030b0 tx=0x7f0df4019040 comp rx=0 tx=0).stop 2024-05-08T05:31:03.979 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:03.978+0000 7f0e0dc00700 1 -- 172.21.15.87:0/1486445026 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0e08103750 msgr2=0x7f0e080757a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:31:03.979 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:03.978+0000 7f0e0dc00700 1 --2- 172.21.15.87:0/1486445026 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0e08103750 0x7f0e080757a0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f0df800e9c0 tx=0x7f0df800ecd0 comp rx=0 tx=0).stop 2024-05-08T05:31:03.979 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:03.978+0000 7f0e0dc00700 1 -- 172.21.15.87:0/1486445026 shutdown_connections 2024-05-08T05:31:03.979 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:03.978+0000 7f0e0dc00700 1 --2- 172.21.15.87:0/1486445026 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0e08108850 0x7f0e08076220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:31:03.979 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:03.978+0000 7f0e0dc00700 1 --2- 172.21.15.87:0/1486445026 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0e08103750 0x7f0e080757a0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:31:03.979 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:03.978+0000 7f0e0dc00700 1 --2- 172.21.15.87:0/1486445026 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f0dec0b2900 0x7f0dec0b4dc0 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:31:03.979 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:03.978+0000 7f0e0dc00700 1 --2- 172.21.15.87:0/1486445026 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0e08104100 0x7f0e08075ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:31:03.979 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:03.978+0000 7f0e0dc00700 1 -- 172.21.15.87:0/1486445026 >> 172.21.15.87:0/1486445026 conn(0x7f0e0807a600 msgr2=0x7f0e08101740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:31:03.979 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:03.978+0000 7f0e0dc00700 1 -- 172.21.15.87:0/1486445026 shutdown_connections 2024-05-08T05:31:03.979 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:03.979+0000 7f0e0dc00700 1 -- 172.21.15.87:0/1486445026 wait complete. 2024-05-08T05:31:03.980 INFO:teuthology.orchestra.run.smithi087.stderr:dumped fsmap epoch 25 2024-05-08T05:31:04.237 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:31:04 smithi087 ceph-mon[29523]: pgmap v482: 97 pgs: 97 active+clean; 661 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 5 op/s 2024-05-08T05:31:04.237 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:31:04 smithi087 ceph-mon[29523]: from='client.? 172.21.15.87:0/1486445026' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T05:31:04.483 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:31:04 smithi090 ceph-mon[34526]: pgmap v482: 97 pgs: 97 active+clean; 661 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 5 op/s 2024-05-08T05:31:04.483 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:31:04 smithi090 ceph-mon[34526]: from='client.? 172.21.15.87:0/1486445026' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T05:31:04.538 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:31:04 smithi160 ceph-mon[34827]: pgmap v482: 97 pgs: 97 active+clean; 661 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 5 op/s 2024-05-08T05:31:04.539 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:31:04 smithi160 ceph-mon[34827]: from='client.? 172.21.15.87:0/1486445026' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T05:31:04.811 DEBUG:teuthology.orchestra.run.smithi087:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid eeeb813e-0cf9-11ef-bc97-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-05-08T05:31:05.256 INFO:teuthology.orchestra.run.smithi087.stderr:Inferring config /var/lib/ceph/eeeb813e-0cf9-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T05:31:06.444 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:31:06 smithi087 ceph-mon[29523]: pgmap v483: 97 pgs: 97 active+clean; 661 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 6 op/s 2024-05-08T05:31:06.483 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:31:06 smithi090 ceph-mon[34526]: pgmap v483: 97 pgs: 97 active+clean; 661 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 6 op/s 2024-05-08T05:31:06.538 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:31:06 smithi160 ceph-mon[34827]: pgmap v483: 97 pgs: 97 active+clean; 661 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 6 op/s 2024-05-08T05:31:07.373 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:07.372+0000 7f94eac00700 1 -- 172.21.15.87:0/3602262661 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f94e4075ff0 msgr2=0x7f94e410f9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:31:07.374 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:07.372+0000 7f94eac00700 1 --2- 172.21.15.87:0/3602262661 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f94e4075ff0 0x7f94e410f9c0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f94d0009990 tx=0x7f94d0009ca0 comp rx=0 tx=0).stop 2024-05-08T05:31:07.374 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:07.373+0000 7f94eac00700 1 -- 172.21.15.87:0/3602262661 shutdown_connections 2024-05-08T05:31:07.375 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:07.373+0000 7f94eac00700 1 --2- 172.21.15.87:0/3602262661 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f94e410ff00 0x7f94e41122f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:31:07.375 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:07.373+0000 7f94eac00700 1 --2- 172.21.15.87:0/3602262661 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f94e40756d0 0x7f94e4075ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:31:07.375 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:07.373+0000 7f94eac00700 1 --2- 172.21.15.87:0/3602262661 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f94e4075ff0 0x7f94e410f9c0 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:31:07.375 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:07.373+0000 7f94eac00700 1 -- 172.21.15.87:0/3602262661 >> 172.21.15.87:0/3602262661 conn(0x7f94e407a600 msgr2=0x7f94e407aa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:31:07.375 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:07.373+0000 7f94eac00700 1 -- 172.21.15.87:0/3602262661 shutdown_connections 2024-05-08T05:31:07.375 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:07.373+0000 7f94eac00700 1 -- 172.21.15.87:0/3602262661 wait complete. 2024-05-08T05:31:07.375 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:07.374+0000 7f94eac00700 1 Processor -- start 2024-05-08T05:31:07.376 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:07.375+0000 7f94eac00700 1 -- start start 2024-05-08T05:31:07.376 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:07.375+0000 7f94eac00700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f94e40756d0 0x7f94e41a2be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:31:07.377 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:07.375+0000 7f94eac00700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f94e4075ff0 0x7f94e41a0cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:31:07.377 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:07.375+0000 7f94eac00700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f94e410ff00 0x7f94e41a1230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:31:07.377 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:07.376+0000 7f94eac00700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f94e41158d0 con 0x7f94e410ff00 2024-05-08T05:31:07.377 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:07.376+0000 7f94e3e00700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f94e40756d0 0x7f94e41a2be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:31:07.378 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:07.376+0000 7f94e3400700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f94e4075ff0 0x7f94e41a0cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:31:07.378 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:07.376+0000 7f94e3e00700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f94e40756d0 0x7f94e41a2be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.87:37312/0 (socket says 172.21.15.87:37312) 2024-05-08T05:31:07.378 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:07.376+0000 7f94e3e00700 1 -- 172.21.15.87:0/2854492800 learned_addr learned my addr 172.21.15.87:0/2854492800 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T05:31:07.378 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:07.376+0000 7f94eac00700 1 -- 172.21.15.87:0/2854492800 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f94e4115750 con 0x7f94e40756d0 2024-05-08T05:31:07.378 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:07.376+0000 7f94eac00700 1 -- 172.21.15.87:0/2854492800 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f94e4115a50 con 0x7f94e4075ff0 2024-05-08T05:31:07.379 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:07.377+0000 7f94e8c00700 1 --2- 172.21.15.87:0/2854492800 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f94e410ff00 0x7f94e41a1230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:31:07.379 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:07.377+0000 7f94e3e00700 1 -- 172.21.15.87:0/2854492800 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f94e4075ff0 msgr2=0x7f94e41a0cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:31:07.379 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:07.377+0000 7f94e3e00700 1 --2- 172.21.15.87:0/2854492800 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f94e4075ff0 0x7f94e41a0cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:31:07.379 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:07.377+0000 7f94e3e00700 1 -- 172.21.15.87:0/2854492800 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f94e410ff00 msgr2=0x7f94e41a1230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:31:07.379 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:07.377+0000 7f94e3e00700 1 --2- 172.21.15.87:0/2854492800 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f94e410ff00 0x7f94e41a1230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:31:07.379 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:07.377+0000 7f94e3e00700 1 -- 172.21.15.87:0/2854492800 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f94e41a18d0 con 0x7f94e40756d0 2024-05-08T05:31:07.379 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:07.377+0000 7f94e3400700 1 --2- 172.21.15.87:0/2854492800 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f94e4075ff0 0x7f94e41a0cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T05:31:07.380 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:07.377+0000 7f94e3e00700 1 --2- 172.21.15.87:0/2854492800 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f94e40756d0 0x7f94e41a2be0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f94d400e9c0 tx=0x7f94d400ecd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:31:07.380 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:07.378+0000 7f94e0c00700 1 -- 172.21.15.87:0/2854492800 <== mon.2 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94d400cbd0 con 0x7f94e40756d0 2024-05-08T05:31:07.380 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:07.378+0000 7f94e0c00700 1 -- 172.21.15.87:0/2854492800 <== mon.2 v2:172.21.15.90:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f94d400ee60 con 0x7f94e40756d0 2024-05-08T05:31:07.380 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:07.378+0000 7f94e0c00700 1 -- 172.21.15.87:0/2854492800 <== mon.2 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94d40055c0 con 0x7f94e40756d0 2024-05-08T05:31:07.380 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:07.378+0000 7f94eac00700 1 -- 172.21.15.87:0/2854492800 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f94e410e9f0 con 0x7f94e40756d0 2024-05-08T05:31:07.380 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:07.378+0000 7f94eac00700 1 -- 172.21.15.87:0/2854492800 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f94e410eeb0 con 0x7f94e40756d0 2024-05-08T05:31:07.385 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:07.383+0000 7f94f560bb80 1 Processor -- start 2024-05-08T05:31:07.385 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:07.384+0000 7f94f560bb80 1 -- start start 2024-05-08T05:31:07.385 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:07.384+0000 7f94e0c00700 1 -- 172.21.15.87:0/2854492800 <== mon.2 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7f94d4004750 con 0x7f94e40756d0 2024-05-08T05:31:07.386 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:07.385+0000 7f94f560bb80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55a0618f1060 0x55a0618f1440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:31:07.387 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:07.385+0000 7f94f560bb80 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a0618f1980 0x55a0618f5490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:31:07.387 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:07.385+0000 7f94f560bb80 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55a0618f59d0 0x55a0618f5e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:31:07.387 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:07.385+0000 7f94f560bb80 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x55a061843a20 con 0x55a0618f1980 2024-05-08T05:31:07.387 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:07.385+0000 7f94f560bb80 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x55a0617e1760 con 0x55a0618f59d0 2024-05-08T05:31:07.387 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:07.385+0000 7f94f560bb80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x55a06183f9e0 con 0x55a0618f1060 2024-05-08T05:31:07.387 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:07.385+0000 7f94e3400700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55a0618f59d0 0x55a0618f5e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:31:07.387 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:07.385+0000 7f94e8c00700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55a0618f1060 0x55a0618f1440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:31:07.388 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:07.385+0000 7f94e3400700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55a0618f59d0 0x55a0618f5e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.87:37326/0 (socket says 172.21.15.87:37326) 2024-05-08T05:31:07.388 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:07.385+0000 7f94e3400700 1 -- 172.21.15.87:0/1353140906 learned_addr learned my addr 172.21.15.87:0/1353140906 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T05:31:07.388 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:07.385+0000 7f94e8c00700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55a0618f1060 0x55a0618f1440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.87:43026/0 (socket says 172.21.15.87:43026) 2024-05-08T05:31:07.388 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:07.386+0000 7f94e3e00700 1 --2- 172.21.15.87:0/1353140906 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a0618f1980 0x55a0618f5490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:31:07.388 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:07.386+0000 7f94e8c00700 1 -- 172.21.15.87:0/1353140906 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55a0618f59d0 msgr2=0x55a0618f5e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:31:07.388 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:07.386+0000 7f94e8c00700 1 --2- 172.21.15.87:0/1353140906 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55a0618f59d0 0x55a0618f5e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:31:07.388 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:07.386+0000 7f94e8c00700 1 -- 172.21.15.87:0/1353140906 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a0618f1980 msgr2=0x55a0618f5490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:31:07.388 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:07.386+0000 7f94e8c00700 1 --2- 172.21.15.87:0/1353140906 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a0618f1980 0x55a0618f5490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:31:07.388 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:07.386+0000 7f94e8c00700 1 -- 172.21.15.87:0/1353140906 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a0617908d0 con 0x55a0618f1060 2024-05-08T05:31:07.390 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:07.387+0000 7f94e8c00700 1 --2- 172.21.15.87:0/1353140906 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55a0618f1060 0x55a0618f1440 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f94dc003e60 tx=0x7f94dc009ba0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=963eb3d78429a873 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:31:07.390 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:07.387+0000 7f94d9600700 1 -- 172.21.15.87:0/1353140906 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94dc004bb0 con 0x55a0618f1060 2024-05-08T05:31:07.390 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:07.387+0000 7f94d9600700 1 -- 172.21.15.87:0/1353140906 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f94dc004d50 con 0x55a0618f1060 2024-05-08T05:31:07.390 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:07.387+0000 7f94d9600700 1 -- 172.21.15.87:0/1353140906 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94dc007c10 con 0x55a0618f1060 2024-05-08T05:31:07.390 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:07.388+0000 7f94f560bb80 1 -- 172.21.15.87:0/1353140906 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55a0618f1060 msgr2=0x55a0618f1440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:31:07.391 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:07.388+0000 7f94f560bb80 1 --2- 172.21.15.87:0/1353140906 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55a0618f1060 0x55a0618f1440 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f94dc003e60 tx=0x7f94dc009ba0 comp rx=0 tx=0).stop 2024-05-08T05:31:07.391 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:07.388+0000 7f94f560bb80 1 -- 172.21.15.87:0/1353140906 shutdown_connections 2024-05-08T05:31:07.391 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:07.388+0000 7f94f560bb80 1 --2- 172.21.15.87:0/1353140906 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55a0618f59d0 0x55a0618f5e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:31:07.391 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:07.388+0000 7f94f560bb80 1 --2- 172.21.15.87:0/1353140906 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55a0618f1060 0x55a0618f1440 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:31:07.391 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:07.388+0000 7f94f560bb80 1 --2- 172.21.15.87:0/1353140906 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a0618f1980 0x55a0618f5490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:31:07.391 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:07.388+0000 7f94f560bb80 1 -- 172.21.15.87:0/1353140906 >> 172.21.15.87:0/1353140906 conn(0x55a06181fb60 msgr2=0x55a0618eb7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:31:07.391 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:07.388+0000 7f94f560bb80 1 -- 172.21.15.87:0/1353140906 shutdown_connections 2024-05-08T05:31:07.391 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:07.388+0000 7f94e0c00700 1 --2- 172.21.15.87:0/2854492800 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f94c80b2900 0x7f94c80b4dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:31:07.391 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:07.388+0000 7f94f560bb80 1 -- 172.21.15.87:0/1353140906 wait complete. 2024-05-08T05:31:07.391 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:07.389+0000 7f94e0c00700 1 -- 172.21.15.87:0/2854492800 <== mon.2 v2:172.21.15.90:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8190+0+0 (secure 0 0 0) 0x7f94d40e23e0 con 0x7f94e40756d0 2024-05-08T05:31:07.391 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:07.389+0000 7f94f560bb80 1 -- start start 2024-05-08T05:31:07.392 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:07.389+0000 7f94e8c00700 1 --2- 172.21.15.87:0/2854492800 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f94c80b2900 0x7f94c80b4dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:31:07.392 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:07.389+0000 7f94f560bb80 1 Processor -- start 2024-05-08T05:31:07.392 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:07.390+0000 7f94e8c00700 1 --2- 172.21.15.87:0/2854492800 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f94c80b2900 0x7f94c80b4dc0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f94dc000f80 tx=0x7f94dc003f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:31:07.392 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:07.391+0000 7f94f560bb80 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a0618f1060 0x55a0618fce00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:31:07.393 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:07.391+0000 7f94f560bb80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55a0618f1980 0x55a0618fa1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:31:07.393 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:07.391+0000 7f94f560bb80 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55a0618f59d0 0x55a0618fa730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:31:07.393 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:07.391+0000 7f94f560bb80 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x55a0618fdbe0 con 0x55a0618f1060 2024-05-08T05:31:07.393 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:07.391+0000 7f94f560bb80 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x55a0617a9b20 con 0x55a0618f59d0 2024-05-08T05:31:07.393 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:07.391+0000 7f94f560bb80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x55a0618fdd60 con 0x55a0618f1980 2024-05-08T05:31:07.393 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:07.391+0000 7f94e3400700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55a0618f1980 0x55a0618fa1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:31:07.393 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:07.391+0000 7f94e3400700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55a0618f1980 0x55a0618fa1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.87:43028/0 (socket says 172.21.15.87:43028) 2024-05-08T05:31:07.393 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:07.392+0000 7f94e3400700 1 -- 172.21.15.87:0/3741342849 learned_addr learned my addr 172.21.15.87:0/3741342849 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T05:31:07.393 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:07.391+0000 7f94f560bb80 10 client.0 _ll_register_callbacks cb 0x55a0617eac70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T05:31:07.394 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:07.392+0000 7f94e8c00700 1 --2- 172.21.15.87:0/3741342849 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55a0618f59d0 0x55a0618fa730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:31:07.394 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:07.392+0000 7f94e3e00700 1 --2- 172.21.15.87:0/3741342849 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a0618f1060 0x55a0618fce00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:31:07.394 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:07.392+0000 7f94e3400700 1 -- 172.21.15.87:0/3741342849 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55a0618f59d0 msgr2=0x55a0618fa730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:31:07.394 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:07.392+0000 7f94e3400700 1 --2- 172.21.15.87:0/3741342849 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55a0618f59d0 0x55a0618fa730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:31:07.394 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:07.392+0000 7f94e3400700 1 -- 172.21.15.87:0/3741342849 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a0618f1060 msgr2=0x55a0618fce00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:31:07.394 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:07.392+0000 7f94e3400700 1 --2- 172.21.15.87:0/3741342849 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a0618f1060 0x55a0618fce00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:31:07.394 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:07.392+0000 7f94e3400700 1 -- 172.21.15.87:0/3741342849 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a061809420 con 0x55a0618f1980 2024-05-08T05:31:07.395 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:07.392+0000 7f94e3400700 1 --2- 172.21.15.87:0/3741342849 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55a0618f1980 0x55a0618fa1f0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f94d00059d0 tx=0x7f94d000bfa0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=244a7d1d9b8eeb8d server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:31:07.395 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:07.392+0000 7f94ce000700 10 client.0 ms_handle_connect on v2:172.21.15.160:3300/0 2024-05-08T05:31:07.395 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:07.393+0000 7f94ce000700 1 -- 172.21.15.87:0/3741342849 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94d0003880 con 0x55a0618f1980 2024-05-08T05:31:07.395 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:07.393+0000 7f94f560bb80 1 -- 172.21.15.87:0/3741342849 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f94dc004d50 con 0x55a0618f1980 2024-05-08T05:31:07.395 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:07.393+0000 7f94ce000700 1 -- 172.21.15.87:0/3741342849 <== mon.1 v2:172.21.15.160:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8190+0+0 (secure 0 0 0) 0x7f94d0003a20 con 0x55a0618f1980 2024-05-08T05:31:07.395 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:07.393+0000 7f94ce000700 1 -- 172.21.15.87:0/3741342849 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f94d0003c20 con 0x55a0618f1980 2024-05-08T05:31:07.395 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:07.393+0000 7f94f560bb80 10 client.25324 fetch_fsmap learned FSMap version 25 2024-05-08T05:31:07.395 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:07.393+0000 7f94f560bb80 1 -- 172.21.15.87:0/3741342849 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55a061908410 con 0x55a0618f1980 2024-05-08T05:31:07.396 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:07.394+0000 7f94ce000700 1 -- 172.21.15.87:0/3741342849 <== mon.1 v2:172.21.15.160:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f94dc004d50 con 0x55a0618f1980 2024-05-08T05:31:07.396 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:07.394+0000 7f94ce000700 1 -- 172.21.15.87:0/3741342849 <== mon.1 v2:172.21.15.160:3300/0 5 ==== fsmap(e 25) ==== 8338+0+0 (secure 0 0 0) 0x7f94d002c030 con 0x55a0618f1980 2024-05-08T05:31:07.396 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:07.394+0000 7f94f560bb80 10 client.25324 fetch_fsmap finished waiting for FSMap version 25 2024-05-08T05:31:07.396 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:07.394+0000 7f94f560bb80 10 client.25324 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.i 2024-05-08T05:31:07.396 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:07.394+0000 7f94f560bb80 20 client.25324 populate_metadata read hostname 'smithi087' 2024-05-08T05:31:07.396 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:07.394+0000 7f94f560bb80 1 --2- 172.21.15.87:0/3741342849 >> [v2:172.21.15.160:6838/234657686,v1:172.21.15.160:6839/234657686] conn(0x55a06190aaa0 0x55a06190ce90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:31:07.396 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:07.394+0000 7f94f560bb80 4 client.25324 mds_command: new command op to 24481 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-08T05:31:07.396 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:07.394+0000 7f94f560bb80 1 -- 172.21.15.87:0/3741342849 --> [v2:172.21.15.160:6838/234657686,v1:172.21.15.160:6839/234657686] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a0618be0a0 con 0x55a06190aaa0 2024-05-08T05:31:07.396 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:07.395+0000 7f94e3e00700 1 --2- 172.21.15.87:0/3741342849 >> [v2:172.21.15.160:6838/234657686,v1:172.21.15.160:6839/234657686] conn(0x55a06190aaa0 0x55a06190ce90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:31:07.397 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:07.395+0000 7f94e3e00700 1 --2- 172.21.15.87:0/3741342849 >> [v2:172.21.15.160:6838/234657686,v1:172.21.15.160:6839/234657686] conn(0x55a06190aaa0 0x55a06190ce90 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=d99ec276a56a8b1d server_cookie=1c3fba41c6bbfbb5 in_seq=0 out_seq=0 2024-05-08T05:31:07.397 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:07.395+0000 7f94ce000700 10 client.25324 ms_handle_connect on v2:172.21.15.160:6838/234657686 2024-05-08T05:31:07.397 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:07.396+0000 7f94ce000700 1 -- 172.21.15.87:0/3741342849 <== mds.2 v2:172.21.15.160:6838/234657686 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55a0618be0a0 con 0x55a06190aaa0 2024-05-08T05:31:07.398 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:07.396+0000 7f94ce000700 10 client.25324 handle_command_reply: tid=0 2024-05-08T05:31:07.398 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:07.396+0000 7f94f560bb80 1 client.25324 shutdown 2024-05-08T05:31:07.398 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:07.397+0000 7f94f560bb80 1 -- 172.21.15.87:0/3741342849 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55a0618f1980 msgr2=0x55a0618fa1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:31:07.398 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:07.397+0000 7f94f560bb80 1 --2- 172.21.15.87:0/3741342849 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55a0618f1980 0x55a0618fa1f0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f94d00059d0 tx=0x7f94d000bfa0 comp rx=0 tx=0).stop 2024-05-08T05:31:07.398 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:07.397+0000 7f94f560bb80 1 -- 172.21.15.87:0/3741342849 shutdown_connections 2024-05-08T05:31:07.399 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:07.397+0000 7f94f560bb80 1 --2- 172.21.15.87:0/3741342849 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55a0618f59d0 0x55a0618fa730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:31:07.399 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:07.397+0000 7f94f560bb80 1 --2- 172.21.15.87:0/3741342849 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a0618f1060 0x55a0618fce00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:31:07.399 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:07.397+0000 7f94f560bb80 1 --2- 172.21.15.87:0/3741342849 >> [v2:172.21.15.160:6838/234657686,v1:172.21.15.160:6839/234657686] conn(0x55a06190aaa0 0x55a06190ce90 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:31:07.399 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:07.397+0000 7f94f560bb80 1 --2- 172.21.15.87:0/3741342849 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55a0618f1980 0x55a0618fa1f0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:31:07.399 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:07.397+0000 7f94ce000700 0 client.25324 ms_handle_reset on v2:172.21.15.160:6838/234657686 2024-05-08T05:31:07.399 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:07.397+0000 7f94f560bb80 1 -- 172.21.15.87:0/3741342849 >> 172.21.15.87:0/3741342849 conn(0x55a06181fb60 msgr2=0x55a0618eb760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:31:07.399 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:07.397+0000 7f94f560bb80 1 -- 172.21.15.87:0/3741342849 shutdown_connections 2024-05-08T05:31:07.399 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:07.397+0000 7f94f560bb80 1 -- 172.21.15.87:0/3741342849 wait complete. 2024-05-08T05:31:07.399 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:07.397+0000 7f94f560bb80 20 client.25324 trim_cache size 0 max 16384 2024-05-08T05:31:07.429 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:07.427+0000 7f94f560bb80 1 Processor -- start 2024-05-08T05:31:07.430 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:07.428+0000 7f94f560bb80 1 -- start start 2024-05-08T05:31:07.430 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:07.428+0000 7f94f560bb80 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a06181fb60 0x55a061906ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:31:07.431 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:07.428+0000 7f94f560bb80 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55a0618f1060 0x55a0618f64c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:31:07.431 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:07.429+0000 7f94f560bb80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55a0618f1980 0x55a0618fb850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:31:07.431 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:07.429+0000 7f94f560bb80 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f94e41bf060 con 0x55a06181fb60 2024-05-08T05:31:07.431 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:07.429+0000 7f94f560bb80 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f94e41bc8f0 con 0x55a0618f1060 2024-05-08T05:31:07.431 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:07.429+0000 7f94f560bb80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f94e41ba740 con 0x55a0618f1980 2024-05-08T05:31:07.431 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:07.429+0000 7f94e3e00700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a06181fb60 0x55a061906ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:31:07.431 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:07.429+0000 7f94e3e00700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a06181fb60 0x55a061906ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:44784/0 (socket says 172.21.15.87:44784) 2024-05-08T05:31:07.431 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:07.429+0000 7f94e3e00700 1 -- 172.21.15.87:0/2849918281 learned_addr learned my addr 172.21.15.87:0/2849918281 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T05:31:07.432 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:07.429+0000 7f94e3400700 1 --2- 172.21.15.87:0/2849918281 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55a0618f1060 0x55a0618f64c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:31:07.432 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:07.430+0000 7f94e3e00700 1 -- 172.21.15.87:0/2849918281 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55a0618f1980 msgr2=0x55a0618fb850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:31:07.432 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:07.430+0000 7f94e8c00700 1 --2- 172.21.15.87:0/2849918281 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55a0618f1980 0x55a0618fb850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:31:07.432 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:07.430+0000 7f94e3e00700 1 --2- 172.21.15.87:0/2849918281 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55a0618f1980 0x55a0618fb850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:31:07.432 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:07.430+0000 7f94e3e00700 1 -- 172.21.15.87:0/2849918281 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55a0618f1060 msgr2=0x55a0618f64c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:31:07.432 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:07.430+0000 7f94e3e00700 1 --2- 172.21.15.87:0/2849918281 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55a0618f1060 0x55a0618f64c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:31:07.432 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:07.430+0000 7f94e3e00700 1 -- 172.21.15.87:0/2849918281 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a06190d510 con 0x55a06181fb60 2024-05-08T05:31:07.432 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:07.430+0000 7f94e3400700 1 --2- 172.21.15.87:0/2849918281 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55a0618f1060 0x55a0618f64c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T05:31:07.432 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:07.430+0000 7f94e8c00700 1 --2- 172.21.15.87:0/2849918281 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55a0618f1980 0x55a0618fb850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T05:31:07.433 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:07.430+0000 7f94e3e00700 1 --2- 172.21.15.87:0/2849918281 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a06181fb60 0x55a061906ca0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f94d400ced0 tx=0x7f94d4091040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8433eacec82bde57 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:31:07.433 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:07.431+0000 7f94d8c00700 1 -- 172.21.15.87:0/2849918281 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94d408f070 con 0x55a06181fb60 2024-05-08T05:31:07.433 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:07.431+0000 7f94d8c00700 1 -- 172.21.15.87:0/2849918281 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f94d40b21d0 con 0x55a06181fb60 2024-05-08T05:31:07.433 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:07.431+0000 7f94d8c00700 1 -- 172.21.15.87:0/2849918281 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94d40adde0 con 0x55a06181fb60 2024-05-08T05:31:07.434 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:07.432+0000 7f94f560bb80 1 -- 172.21.15.87:0/2849918281 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a06181fb60 msgr2=0x55a061906ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:31:07.434 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:07.432+0000 7f94f560bb80 1 --2- 172.21.15.87:0/2849918281 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a06181fb60 0x55a061906ca0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f94d400ced0 tx=0x7f94d4091040 comp rx=0 tx=0).stop 2024-05-08T05:31:07.434 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:07.432+0000 7f94f560bb80 1 -- 172.21.15.87:0/2849918281 shutdown_connections 2024-05-08T05:31:07.434 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:07.432+0000 7f94f560bb80 1 --2- 172.21.15.87:0/2849918281 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55a0618f1980 0x55a0618fb850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:31:07.434 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:07.432+0000 7f94f560bb80 1 --2- 172.21.15.87:0/2849918281 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a06181fb60 0x55a061906ca0 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:31:07.434 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:07.432+0000 7f94f560bb80 1 --2- 172.21.15.87:0/2849918281 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55a0618f1060 0x55a0618f64c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:31:07.434 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:07.432+0000 7f94f560bb80 1 -- 172.21.15.87:0/2849918281 >> 172.21.15.87:0/2849918281 conn(0x55a0618ed750 msgr2=0x55a0618f5db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:31:07.434 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:07.432+0000 7f94f560bb80 1 -- 172.21.15.87:0/2849918281 shutdown_connections 2024-05-08T05:31:07.434 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:07.432+0000 7f94f560bb80 1 -- 172.21.15.87:0/2849918281 wait complete. 2024-05-08T05:31:07.435 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:07.433+0000 7f94f560bb80 1 -- start start 2024-05-08T05:31:07.435 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:07.433+0000 7f94f560bb80 1 Processor -- start 2024-05-08T05:31:07.435 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:07.433+0000 7f94f560bb80 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a06181fb60 0x55a061903020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:31:07.435 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:07.434+0000 7f94f560bb80 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55a0618f1060 0x55a061903560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:31:07.435 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:07.434+0000 7f94f560bb80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55a0618f1980 0x55a0618ffff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:31:07.436 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:07.434+0000 7f94f560bb80 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f94e41badb0 con 0x55a06181fb60 2024-05-08T05:31:07.436 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:07.434+0000 7f94f560bb80 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f94e41bc220 con 0x55a0618f1060 2024-05-08T05:31:07.436 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:07.434+0000 7f94f560bb80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f94e41bb480 con 0x55a0618f1980 2024-05-08T05:31:07.436 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:07.434+0000 7f94f560bb80 10 client.0 _ll_register_callbacks cb 0x55a0617eac70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T05:31:07.437 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:07.434+0000 7f94e3e00700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a06181fb60 0x55a061903020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:31:07.437 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:07.434+0000 7f94e3e00700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a06181fb60 0x55a061903020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:44786/0 (socket says 172.21.15.87:44786) 2024-05-08T05:31:07.437 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:07.434+0000 7f94e3e00700 1 -- 172.21.15.87:0/1455358853 learned_addr learned my addr 172.21.15.87:0/1455358853 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T05:31:07.437 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:07.434+0000 7f94e8c00700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55a0618f1980 0x55a0618ffff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:31:07.437 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:07.434+0000 7f94e3400700 1 --2- 172.21.15.87:0/1455358853 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55a0618f1060 0x55a061903560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:31:07.437 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:07.434+0000 7f94e3e00700 1 -- 172.21.15.87:0/1455358853 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55a0618f1980 msgr2=0x55a0618ffff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:31:07.437 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:07.434+0000 7f94e3e00700 1 --2- 172.21.15.87:0/1455358853 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55a0618f1980 0x55a0618ffff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:31:07.437 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:07.435+0000 7f94e3e00700 1 -- 172.21.15.87:0/1455358853 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55a0618f1060 msgr2=0x55a061903560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:31:07.437 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:07.435+0000 7f94e3e00700 1 --2- 172.21.15.87:0/1455358853 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55a0618f1060 0x55a061903560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:31:07.437 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:07.435+0000 7f94e3e00700 1 -- 172.21.15.87:0/1455358853 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a0619006b0 con 0x55a06181fb60 2024-05-08T05:31:07.438 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:07.435+0000 7f94e3e00700 1 --2- 172.21.15.87:0/1455358853 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a06181fb60 0x55a061903020 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f94d40dff60 tx=0x7f94d40a9380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=db6294695c745485 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:31:07.438 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:07.435+0000 7f94ce000700 10 client.0 ms_handle_connect on v2:172.21.15.87:3300/0 2024-05-08T05:31:07.438 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:07.435+0000 7f94ce000700 1 -- 172.21.15.87:0/1455358853 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94d408f070 con 0x55a06181fb60 2024-05-08T05:31:07.438 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:07.436+0000 7f94f560bb80 1 -- 172.21.15.87:0/1455358853 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55a061851400 con 0x55a06181fb60 2024-05-08T05:31:07.438 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:07.436+0000 7f94ce000700 1 -- 172.21.15.87:0/1455358853 <== mon.0 v2:172.21.15.87:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8190+0+0 (secure 0 0 0) 0x7f94d40a9ea0 con 0x55a06181fb60 2024-05-08T05:31:07.438 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:07.436+0000 7f94ce000700 1 -- 172.21.15.87:0/1455358853 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f94d40a51c0 con 0x55a06181fb60 2024-05-08T05:31:07.438 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:07.436+0000 7f94f560bb80 10 client.15216 fetch_fsmap learned FSMap version 25 2024-05-08T05:31:07.438 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:07.436+0000 7f94f560bb80 1 -- 172.21.15.87:0/1455358853 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55a061975ca0 con 0x55a06181fb60 2024-05-08T05:31:07.439 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:07.437+0000 7f94ce000700 1 -- 172.21.15.87:0/1455358853 <== mon.0 v2:172.21.15.87:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x55a061851400 con 0x55a06181fb60 2024-05-08T05:31:07.439 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:07.437+0000 7f94ce000700 1 -- 172.21.15.87:0/1455358853 <== mon.0 v2:172.21.15.87:3300/0 5 ==== fsmap(e 25) ==== 8338+0+0 (secure 0 0 0) 0x7f94d40cace0 con 0x55a06181fb60 2024-05-08T05:31:07.439 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:07.437+0000 7f94f560bb80 10 client.15216 fetch_fsmap finished waiting for FSMap version 25 2024-05-08T05:31:07.439 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:07.437+0000 7f94f560bb80 10 client.15216 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.i 2024-05-08T05:31:07.439 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:07.437+0000 7f94f560bb80 20 client.15216 populate_metadata read hostname 'smithi087' 2024-05-08T05:31:07.439 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:07.437+0000 7f94f560bb80 1 --2- 172.21.15.87:0/1455358853 >> [v2:172.21.15.160:6838/234657686,v1:172.21.15.160:6839/234657686] conn(0x55a0618f59d0 0x55a061978260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:31:07.439 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:07.437+0000 7f94f560bb80 4 client.15216 mds_command: new command op to 24481 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-05-08T05:31:07.439 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:07.437+0000 7f94f560bb80 1 -- 172.21.15.87:0/1455358853 --> [v2:172.21.15.160:6838/234657686,v1:172.21.15.160:6839/234657686] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55a06184b4a0 con 0x55a0618f59d0 2024-05-08T05:31:07.440 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:07.438+0000 7f94e3400700 1 --2- 172.21.15.87:0/1455358853 >> [v2:172.21.15.160:6838/234657686,v1:172.21.15.160:6839/234657686] conn(0x55a0618f59d0 0x55a061978260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:31:07.440 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:07.438+0000 7f94ce000700 10 client.15216 ms_handle_connect on v2:172.21.15.160:6838/234657686 2024-05-08T05:31:07.440 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:07.438+0000 7f94e3400700 1 --2- 172.21.15.87:0/1455358853 >> [v2:172.21.15.160:6838/234657686,v1:172.21.15.160:6839/234657686] conn(0x55a0618f59d0 0x55a061978260 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=8811d757765c5ce9 server_cookie=ee0b654b24246efd in_seq=0 out_seq=0 2024-05-08T05:31:07.441 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:07.439+0000 7f94ce000700 1 -- 172.21.15.87:0/1455358853 <== mds.2 v2:172.21.15.160:6838/234657686 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55a06184b4a0 con 0x55a0618f59d0 2024-05-08T05:31:07.441 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:07.439+0000 7f94ce000700 10 client.15216 handle_command_reply: tid=0 2024-05-08T05:31:07.441 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:07.439+0000 7f94f560bb80 1 client.15216 shutdown 2024-05-08T05:31:07.441 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:07.439+0000 7f94f560bb80 1 -- 172.21.15.87:0/1455358853 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a06181fb60 msgr2=0x55a061903020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:31:07.441 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:07.439+0000 7f94f560bb80 1 --2- 172.21.15.87:0/1455358853 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a06181fb60 0x55a061903020 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f94d40dff60 tx=0x7f94d40a9380 comp rx=0 tx=0).stop 2024-05-08T05:31:07.441 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:07.439+0000 7f94f560bb80 1 -- 172.21.15.87:0/1455358853 shutdown_connections 2024-05-08T05:31:07.441 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:07.439+0000 7f94f560bb80 1 --2- 172.21.15.87:0/1455358853 >> [v2:172.21.15.160:6838/234657686,v1:172.21.15.160:6839/234657686] conn(0x55a0618f59d0 0x55a061978260 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:31:07.441 INFO:teuthology.orchestra.run.smithi087.stdout:[] 2024-05-08T05:31:07.442 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:07.439+0000 7f94ce000700 0 client.15216 ms_handle_reset on v2:172.21.15.160:6838/234657686 2024-05-08T05:31:07.442 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:07.439+0000 7f94f560bb80 1 --2- 172.21.15.87:0/1455358853 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55a0618f1980 0x55a0618ffff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:31:07.442 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:07.439+0000 7f94f560bb80 1 --2- 172.21.15.87:0/1455358853 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a06181fb60 0x55a061903020 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:31:07.442 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:07.439+0000 7f94f560bb80 1 --2- 172.21.15.87:0/1455358853 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55a0618f1060 0x55a061903560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:31:07.442 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:07.439+0000 7f94f560bb80 1 -- 172.21.15.87:0/1455358853 >> 172.21.15.87:0/1455358853 conn(0x55a0618ed750 msgr2=0x55a0618f0700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:31:07.442 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:07.440+0000 7f94f560bb80 1 -- 172.21.15.87:0/1455358853 shutdown_connections 2024-05-08T05:31:07.442 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:07.440+0000 7f94f560bb80 1 -- 172.21.15.87:0/1455358853 wait complete. 2024-05-08T05:31:07.442 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:07.440+0000 7f94f560bb80 20 client.15216 trim_cache size 0 max 16384 2024-05-08T05:31:07.444 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:07.443+0000 7f94eac00700 1 -- 172.21.15.87:0/2854492800 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f94c80b2900 msgr2=0x7f94c80b4dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:31:07.444 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:07.443+0000 7f94eac00700 1 --2- 172.21.15.87:0/2854492800 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f94c80b2900 0x7f94c80b4dc0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f94dc000f80 tx=0x7f94dc003f90 comp rx=0 tx=0).stop 2024-05-08T05:31:07.445 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:07.443+0000 7f94eac00700 1 -- 172.21.15.87:0/2854492800 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f94e40756d0 msgr2=0x7f94e41a2be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:31:07.445 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:07.443+0000 7f94eac00700 1 --2- 172.21.15.87:0/2854492800 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f94e40756d0 0x7f94e41a2be0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f94d400e9c0 tx=0x7f94d400ecd0 comp rx=0 tx=0).stop 2024-05-08T05:31:07.445 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:07.443+0000 7f94eac00700 1 -- 172.21.15.87:0/2854492800 shutdown_connections 2024-05-08T05:31:07.445 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:07.443+0000 7f94eac00700 1 --2- 172.21.15.87:0/2854492800 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f94e410ff00 0x7f94e41a1230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:31:07.445 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:07.443+0000 7f94eac00700 1 --2- 172.21.15.87:0/2854492800 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f94e40756d0 0x7f94e41a2be0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:31:07.445 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:07.443+0000 7f94eac00700 1 --2- 172.21.15.87:0/2854492800 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f94c80b2900 0x7f94c80b4dc0 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:31:07.445 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:07.443+0000 7f94eac00700 1 --2- 172.21.15.87:0/2854492800 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f94e4075ff0 0x7f94e41a0cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:31:07.445 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:07.443+0000 7f94eac00700 1 -- 172.21.15.87:0/2854492800 >> 172.21.15.87:0/2854492800 conn(0x7f94e407a600 msgr2=0x7f94e4100590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:31:07.446 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:07.444+0000 7f94eac00700 1 -- 172.21.15.87:0/2854492800 shutdown_connections 2024-05-08T05:31:07.446 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:07.444+0000 7f94eac00700 1 -- 172.21.15.87:0/2854492800 wait complete. 2024-05-08T05:31:08.295 DEBUG:teuthology.orchestra.run.smithi087:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid eeeb813e-0cf9-11ef-bc97-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-05-08T05:31:08.378 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:31:08 smithi087 ceph-mon[29523]: pgmap v484: 97 pgs: 97 active+clean; 661 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-05-08T05:31:08.483 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:31:08 smithi090 ceph-mon[34526]: pgmap v484: 97 pgs: 97 active+clean; 661 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-05-08T05:31:08.538 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:31:08 smithi160 ceph-mon[34827]: pgmap v484: 97 pgs: 97 active+clean; 661 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-05-08T05:31:08.867 INFO:teuthology.orchestra.run.smithi087.stderr:Inferring config /var/lib/ceph/eeeb813e-0cf9-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T05:31:10.458 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:31:10 smithi087 ceph-mon[29523]: pgmap v485: 97 pgs: 97 active+clean; 661 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 7 op/s 2024-05-08T05:31:10.483 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:31:10 smithi090 ceph-mon[34526]: pgmap v485: 97 pgs: 97 active+clean; 661 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 7 op/s 2024-05-08T05:31:10.538 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:31:10 smithi160 ceph-mon[34827]: pgmap v485: 97 pgs: 97 active+clean; 661 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 7 op/s 2024-05-08T05:31:10.895 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:10.894+0000 7fa60d600700 1 -- 172.21.15.87:0/311030430 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa608076160 msgr2=0x7fa608113ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:31:10.896 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:10.894+0000 7fa60d600700 1 --2- 172.21.15.87:0/311030430 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa608076160 0x7fa608113ea0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fa5f40098f0 tx=0x7fa5f4009c00 comp rx=0 tx=0).stop 2024-05-08T05:31:10.896 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:10.894+0000 7fa60d600700 1 -- 172.21.15.87:0/311030430 shutdown_connections 2024-05-08T05:31:10.896 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:10.894+0000 7fa60d600700 1 --2- 172.21.15.87:0/311030430 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa6081143e0 0x7fa6081167d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:31:10.896 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:10.894+0000 7fa60d600700 1 --2- 172.21.15.87:0/311030430 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa608075840 0x7fa608075c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:31:10.896 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:10.894+0000 7fa60d600700 1 --2- 172.21.15.87:0/311030430 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa608076160 0x7fa608113ea0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:31:10.896 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:10.894+0000 7fa60d600700 1 -- 172.21.15.87:0/311030430 >> 172.21.15.87:0/311030430 conn(0x7fa6080fef20 msgr2=0x7fa608101340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:31:10.896 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:10.894+0000 7fa60d600700 1 -- 172.21.15.87:0/311030430 shutdown_connections 2024-05-08T05:31:10.897 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:10.894+0000 7fa60d600700 1 -- 172.21.15.87:0/311030430 wait complete. 2024-05-08T05:31:10.897 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:10.896+0000 7fa60d600700 1 Processor -- start 2024-05-08T05:31:10.897 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:10.896+0000 7fa60d600700 1 -- start start 2024-05-08T05:31:10.898 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:10.896+0000 7fa60d600700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa608075840 0x7fa6081a0190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:31:10.898 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:10.896+0000 7fa60d600700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa608076160 0x7fa6081a06d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:31:10.898 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:10.896+0000 7fa60d600700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa6081143e0 0x7fa6081a4a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:31:10.898 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:10.897+0000 7fa60d600700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fa608119c00 con 0x7fa608076160 2024-05-08T05:31:10.898 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:10.897+0000 7fa60d600700 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fa608119a80 con 0x7fa6081143e0 2024-05-08T05:31:10.898 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:10.897+0000 7fa60d600700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7fa608119d80 con 0x7fa608075840 2024-05-08T05:31:10.899 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:10.897+0000 7fa60cc00700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa6081143e0 0x7fa6081a4a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:31:10.899 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:10.897+0000 7fa60cc00700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa6081143e0 0x7fa6081a4a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.87:37378/0 (socket says 172.21.15.87:37378) 2024-05-08T05:31:10.899 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:10.897+0000 7fa60cc00700 1 -- 172.21.15.87:0/1110258514 learned_addr learned my addr 172.21.15.87:0/1110258514 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T05:31:10.899 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:10.897+0000 7fa607400700 1 --2- 172.21.15.87:0/1110258514 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa608076160 0x7fa6081a06d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:31:10.899 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:10.897+0000 7fa60cc00700 1 -- 172.21.15.87:0/1110258514 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa608075840 msgr2=0x7fa6081a0190 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-05-08T05:31:10.899 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:10.897+0000 7fa60cc00700 1 --2- 172.21.15.87:0/1110258514 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa608075840 0x7fa6081a0190 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:31:10.899 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:10.897+0000 7fa60cc00700 1 -- 172.21.15.87:0/1110258514 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa608076160 msgr2=0x7fa6081a06d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:31:10.899 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:10.897+0000 7fa60cc00700 1 --2- 172.21.15.87:0/1110258514 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa608076160 0x7fa6081a06d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:31:10.899 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:10.897+0000 7fa60cc00700 1 -- 172.21.15.87:0/1110258514 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa6081a5150 con 0x7fa6081143e0 2024-05-08T05:31:10.899 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:10.897+0000 7fa607400700 1 --2- 172.21.15.87:0/1110258514 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa608076160 0x7fa6081a06d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T05:31:10.900 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:10.898+0000 7fa60cc00700 1 --2- 172.21.15.87:0/1110258514 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa6081143e0 0x7fa6081a4a10 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fa60000ef90 tx=0x7fa60000c450 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:31:10.900 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:10.898+0000 7fa604c00700 1 -- 172.21.15.87:0/1110258514 <== mon.2 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa60000cd10 con 0x7fa6081143e0 2024-05-08T05:31:10.900 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:10.898+0000 7fa60d600700 1 -- 172.21.15.87:0/1110258514 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa6081a53e0 con 0x7fa6081143e0 2024-05-08T05:31:10.900 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:10.898+0000 7fa604c00700 1 -- 172.21.15.87:0/1110258514 <== mon.2 v2:172.21.15.90:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa600004bb0 con 0x7fa6081143e0 2024-05-08T05:31:10.900 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:10.898+0000 7fa604c00700 1 -- 172.21.15.87:0/1110258514 <== mon.2 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa600004280 con 0x7fa6081143e0 2024-05-08T05:31:10.901 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:10.899+0000 7fa60d600700 1 -- 172.21.15.87:0/1110258514 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa6081accc0 con 0x7fa6081143e0 2024-05-08T05:31:10.904 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:10.903+0000 7fa619517b80 1 Processor -- start 2024-05-08T05:31:10.905 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:10.904+0000 7fa604c00700 1 -- 172.21.15.87:0/1110258514 <== mon.2 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7fa60001b030 con 0x7fa6081143e0 2024-05-08T05:31:10.905 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:10.904+0000 7fa619517b80 1 -- start start 2024-05-08T05:31:10.906 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:10.905+0000 7fa619517b80 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55aa4ee17da0 0x55aa4ee18180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:31:10.907 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:10.905+0000 7fa619517b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55aa4ee186c0 0x55aa4ee12430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:31:10.907 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:10.905+0000 7fa619517b80 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55aa4ee12a50 0x55aa4ee12ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:31:10.907 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:10.905+0000 7fa619517b80 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x55aa4ed64a20 con 0x55aa4ee12a50 2024-05-08T05:31:10.907 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:10.905+0000 7fa619517b80 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x55aa4ed02760 con 0x55aa4ee17da0 2024-05-08T05:31:10.907 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:10.905+0000 7fa619517b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x55aa4ed609e0 con 0x55aa4ee186c0 2024-05-08T05:31:10.907 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:10.905+0000 7fa607e00700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55aa4ee186c0 0x55aa4ee12430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:31:10.907 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:10.905+0000 7fa607e00700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55aa4ee186c0 0x55aa4ee12430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.87:43080/0 (socket says 172.21.15.87:43080) 2024-05-08T05:31:10.907 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:10.905+0000 7fa607e00700 1 -- 172.21.15.87:0/3849461937 learned_addr learned my addr 172.21.15.87:0/3849461937 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T05:31:10.908 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:10.906+0000 7fa604c00700 1 --2- 172.21.15.87:0/1110258514 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7fa5ec0b2900 0x7fa5ec0b4dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:31:10.908 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:10.906+0000 7fa607e00700 1 -- 172.21.15.87:0/3849461937 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55aa4ee17da0 msgr2=0x55aa4ee18180 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-08T05:31:10.908 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:10.906+0000 7fa607e00700 1 --2- 172.21.15.87:0/3849461937 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55aa4ee17da0 0x55aa4ee18180 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:31:10.908 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:10.906+0000 7fa607e00700 1 -- 172.21.15.87:0/3849461937 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55aa4ee12a50 msgr2=0x55aa4ee12ed0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-08T05:31:10.909 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:10.906+0000 7fa607e00700 1 --2- 172.21.15.87:0/3849461937 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55aa4ee12a50 0x55aa4ee12ed0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:31:10.909 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:10.906+0000 7fa607e00700 1 -- 172.21.15.87:0/3849461937 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55aa4ecb18d0 con 0x55aa4ee186c0 2024-05-08T05:31:10.909 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:10.907+0000 7fa607e00700 1 --2- 172.21.15.87:0/3849461937 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55aa4ee186c0 0x55aa4ee12430 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fa5f8009c60 tx=0x7fa5f8009f70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ce2a8912dc73bc75 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:31:10.909 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:10.907+0000 7fa604c00700 1 -- 172.21.15.87:0/1110258514 <== mon.2 v2:172.21.15.90:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8190+0+0 (secure 0 0 0) 0x7fa6000e19c0 con 0x7fa6081143e0 2024-05-08T05:31:10.909 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:10.907+0000 7fa60cc00700 1 --2- 172.21.15.87:0/1110258514 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7fa5ec0b2900 0x7fa5ec0b4dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:31:10.909 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:10.908+0000 7fa5fd600700 1 -- 172.21.15.87:0/3849461937 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5f800ec10 con 0x55aa4ee186c0 2024-05-08T05:31:10.909 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:10.908+0000 7fa5fd600700 1 -- 172.21.15.87:0/3849461937 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa5f800edb0 con 0x55aa4ee186c0 2024-05-08T05:31:10.909 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:10.908+0000 7fa5fd600700 1 -- 172.21.15.87:0/3849461937 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5f8010430 con 0x55aa4ee186c0 2024-05-08T05:31:10.910 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:10.909+0000 7fa619517b80 1 -- 172.21.15.87:0/3849461937 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55aa4ee186c0 msgr2=0x55aa4ee12430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:31:10.910 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:10.909+0000 7fa619517b80 1 --2- 172.21.15.87:0/3849461937 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55aa4ee186c0 0x55aa4ee12430 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fa5f8009c60 tx=0x7fa5f8009f70 comp rx=0 tx=0).stop 2024-05-08T05:31:10.910 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:10.909+0000 7fa60cc00700 1 --2- 172.21.15.87:0/1110258514 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7fa5ec0b2900 0x7fa5ec0b4dc0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fa600019ff0 tx=0x7fa600006230 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:31:10.910 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:10.909+0000 7fa619517b80 1 -- 172.21.15.87:0/3849461937 shutdown_connections 2024-05-08T05:31:10.911 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:10.909+0000 7fa619517b80 1 --2- 172.21.15.87:0/3849461937 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55aa4ee12a50 0x55aa4ee12ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:31:10.911 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:10.909+0000 7fa619517b80 1 --2- 172.21.15.87:0/3849461937 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55aa4ee17da0 0x55aa4ee18180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:31:10.911 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:10.909+0000 7fa619517b80 1 --2- 172.21.15.87:0/3849461937 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55aa4ee186c0 0x55aa4ee12430 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:31:10.911 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:10.909+0000 7fa619517b80 1 -- 172.21.15.87:0/3849461937 >> 172.21.15.87:0/3849461937 conn(0x55aa4ed8a6d0 msgr2=0x55aa4ee0cca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:31:10.911 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:10.909+0000 7fa619517b80 1 -- 172.21.15.87:0/3849461937 shutdown_connections 2024-05-08T05:31:10.912 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:10.909+0000 7fa619517b80 1 -- 172.21.15.87:0/3849461937 wait complete. 2024-05-08T05:31:10.912 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:10.910+0000 7fa619517b80 1 -- start start 2024-05-08T05:31:10.912 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:10.910+0000 7fa619517b80 1 Processor -- start 2024-05-08T05:31:10.912 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:10.911+0000 7fa619517b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55aa4ee12a50 0x55aa4ee1e3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:31:10.913 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:10.911+0000 7fa619517b80 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55aa4ee17da0 0x55aa4ee1b780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:31:10.913 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:10.911+0000 7fa619517b80 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55aa4ee186c0 0x55aa4ee1bcc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:31:10.913 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:10.911+0000 7fa619517b80 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x55aa4ee1f150 con 0x55aa4ee17da0 2024-05-08T05:31:10.913 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:10.911+0000 7fa619517b80 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x55aa4eccab20 con 0x55aa4ee186c0 2024-05-08T05:31:10.913 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:10.911+0000 7fa619517b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x55aa4ee1f2d0 con 0x55aa4ee12a50 2024-05-08T05:31:10.913 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:10.911+0000 7fa619517b80 10 client.0 _ll_register_callbacks cb 0x55aa4ed0bc70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T05:31:10.914 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:10.912+0000 7fa607e00700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55aa4ee17da0 0x55aa4ee1b780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:31:10.914 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:10.912+0000 7fa607e00700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55aa4ee17da0 0x55aa4ee1b780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:44820/0 (socket says 172.21.15.87:44820) 2024-05-08T05:31:10.914 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:10.912+0000 7fa607e00700 1 -- 172.21.15.87:0/2447184591 learned_addr learned my addr 172.21.15.87:0/2447184591 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T05:31:10.914 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:10.912+0000 7fa607400700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55aa4ee12a50 0x55aa4ee1e3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:31:10.914 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:10.912+0000 7fa607400700 1 --2- 172.21.15.87:0/2447184591 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55aa4ee186c0 0x55aa4ee1bcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:31:10.914 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:10.912+0000 7fa607400700 1 -- 172.21.15.87:0/2447184591 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55aa4ee186c0 msgr2=0x55aa4ee1bcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:31:10.914 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:10.912+0000 7fa607400700 1 --2- 172.21.15.87:0/2447184591 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55aa4ee186c0 0x55aa4ee1bcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:31:10.914 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:10.912+0000 7fa607400700 1 -- 172.21.15.87:0/2447184591 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55aa4ee17da0 msgr2=0x55aa4ee1b780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:31:10.914 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:10.912+0000 7fa607400700 1 --2- 172.21.15.87:0/2447184591 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55aa4ee17da0 0x55aa4ee1b780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:31:10.915 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:10.912+0000 7fa607400700 1 -- 172.21.15.87:0/2447184591 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55aa4ed2a420 con 0x55aa4ee12a50 2024-05-08T05:31:10.915 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:10.913+0000 7fa607e00700 1 --2- 172.21.15.87:0/2447184591 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55aa4ee17da0 0x55aa4ee1b780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T05:31:10.915 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:10.913+0000 7fa607400700 1 --2- 172.21.15.87:0/2447184591 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55aa4ee12a50 0x55aa4ee1e3e0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fa5f40098c0 tx=0x7fa5f4005de0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7ccfa9cd57ed062c server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:31:10.915 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:10.913+0000 7fa5f2000700 10 client.0 ms_handle_connect on v2:172.21.15.160:3300/0 2024-05-08T05:31:10.915 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:10.914+0000 7fa5f2000700 1 -- 172.21.15.87:0/2447184591 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5f4005070 con 0x55aa4ee12a50 2024-05-08T05:31:10.915 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:10.914+0000 7fa619517b80 1 -- 172.21.15.87:0/2447184591 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa5f800edb0 con 0x55aa4ee12a50 2024-05-08T05:31:10.916 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:10.914+0000 7fa5f2000700 1 -- 172.21.15.87:0/2447184591 <== mon.1 v2:172.21.15.160:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8190+0+0 (secure 0 0 0) 0x7fa5f4005210 con 0x55aa4ee12a50 2024-05-08T05:31:10.916 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:10.914+0000 7fa5f2000700 1 -- 172.21.15.87:0/2447184591 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fa5f4005410 con 0x55aa4ee12a50 2024-05-08T05:31:10.916 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:10.914+0000 7fa619517b80 10 client.25336 fetch_fsmap learned FSMap version 25 2024-05-08T05:31:10.916 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:10.914+0000 7fa619517b80 1 -- 172.21.15.87:0/2447184591 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55aa4ee299b0 con 0x55aa4ee12a50 2024-05-08T05:31:10.916 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:10.914+0000 7fa5f2000700 1 -- 172.21.15.87:0/2447184591 <== mon.1 v2:172.21.15.160:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa5f800edb0 con 0x55aa4ee12a50 2024-05-08T05:31:10.917 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:10.915+0000 7fa5f2000700 1 -- 172.21.15.87:0/2447184591 <== mon.1 v2:172.21.15.160:3300/0 5 ==== fsmap(e 25) ==== 8338+0+0 (secure 0 0 0) 0x7fa5f400b560 con 0x55aa4ee12a50 2024-05-08T05:31:10.917 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:10.915+0000 7fa619517b80 10 client.25336 fetch_fsmap finished waiting for FSMap version 25 2024-05-08T05:31:10.917 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:10.915+0000 7fa619517b80 10 client.25336 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.g 2024-05-08T05:31:10.917 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:10.915+0000 7fa619517b80 20 client.25336 populate_metadata read hostname 'smithi087' 2024-05-08T05:31:10.917 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:10.915+0000 7fa619517b80 1 --2- 172.21.15.87:0/2447184591 >> [v2:172.21.15.87:6838/2127215876,v1:172.21.15.87:6839/2127215876] conn(0x55aa4ee2bf70 0x55aa4ee2e390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:31:10.917 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:10.915+0000 7fa619517b80 4 client.25336 mds_command: new command op to 24482 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-08T05:31:10.917 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:10.915+0000 7fa619517b80 1 -- 172.21.15.87:0/2447184591 --> [v2:172.21.15.87:6838/2127215876,v1:172.21.15.87:6839/2127215876] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55aa4eddf140 con 0x55aa4ee2bf70 2024-05-08T05:31:10.917 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:10.915+0000 7fa607e00700 1 --2- 172.21.15.87:0/2447184591 >> [v2:172.21.15.87:6838/2127215876,v1:172.21.15.87:6839/2127215876] conn(0x55aa4ee2bf70 0x55aa4ee2e390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:31:10.918 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:10.916+0000 7fa5f2000700 10 client.25336 ms_handle_connect on v2:172.21.15.87:6838/2127215876 2024-05-08T05:31:10.918 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:10.916+0000 7fa607e00700 1 --2- 172.21.15.87:0/2447184591 >> [v2:172.21.15.87:6838/2127215876,v1:172.21.15.87:6839/2127215876] conn(0x55aa4ee2bf70 0x55aa4ee2e390 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=8dade319ef7c5063 server_cookie=e3f2c9eba1859c87 in_seq=0 out_seq=0 2024-05-08T05:31:10.919 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:10.917+0000 7fa5f2000700 1 -- 172.21.15.87:0/2447184591 <== mds.1 v2:172.21.15.87:6838/2127215876 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55aa4eddf140 con 0x55aa4ee2bf70 2024-05-08T05:31:10.919 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:10.917+0000 7fa5f2000700 10 client.25336 handle_command_reply: tid=0 2024-05-08T05:31:10.919 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:10.917+0000 7fa619517b80 1 client.25336 shutdown 2024-05-08T05:31:10.919 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:10.918+0000 7fa619517b80 1 -- 172.21.15.87:0/2447184591 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55aa4ee12a50 msgr2=0x55aa4ee1e3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:31:10.919 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:10.918+0000 7fa619517b80 1 --2- 172.21.15.87:0/2447184591 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55aa4ee12a50 0x55aa4ee1e3e0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fa5f40098c0 tx=0x7fa5f4005de0 comp rx=0 tx=0).stop 2024-05-08T05:31:10.920 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:10.918+0000 7fa619517b80 1 -- 172.21.15.87:0/2447184591 shutdown_connections 2024-05-08T05:31:10.920 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:10.918+0000 7fa619517b80 1 --2- 172.21.15.87:0/2447184591 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55aa4ee186c0 0x55aa4ee1bcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:31:10.920 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:10.918+0000 7fa619517b80 1 --2- 172.21.15.87:0/2447184591 >> [v2:172.21.15.87:6838/2127215876,v1:172.21.15.87:6839/2127215876] conn(0x55aa4ee2bf70 0x55aa4ee2e390 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:31:10.920 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:10.918+0000 7fa619517b80 1 --2- 172.21.15.87:0/2447184591 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55aa4ee12a50 0x55aa4ee1e3e0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:31:10.920 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:10.918+0000 7fa619517b80 1 --2- 172.21.15.87:0/2447184591 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55aa4ee17da0 0x55aa4ee1b780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:31:10.920 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:10.918+0000 7fa5f2000700 0 client.25336 ms_handle_reset on v2:172.21.15.87:6838/2127215876 2024-05-08T05:31:10.920 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:10.918+0000 7fa619517b80 1 -- 172.21.15.87:0/2447184591 >> 172.21.15.87:0/2447184591 conn(0x55aa4ed8a6d0 msgr2=0x55aa4ee07750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:31:10.920 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:10.918+0000 7fa619517b80 1 -- 172.21.15.87:0/2447184591 shutdown_connections 2024-05-08T05:31:10.920 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:10.919+0000 7fa619517b80 1 -- 172.21.15.87:0/2447184591 wait complete. 2024-05-08T05:31:10.921 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:10.919+0000 7fa619517b80 20 client.25336 trim_cache size 0 max 16384 2024-05-08T05:31:10.936 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:10.935+0000 7fa619517b80 1 Processor -- start 2024-05-08T05:31:10.936 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:10.935+0000 7fa619517b80 1 -- start start 2024-05-08T05:31:10.937 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:10.935+0000 7fa619517b80 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55aa4ee12a50 0x55aa4ee12430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:31:10.937 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:10.935+0000 7fa619517b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55aa4ee17da0 0x55aa4ee281e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:31:10.937 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:10.935+0000 7fa619517b80 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55aa4ee186c0 0x55aa4ee1a900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:31:10.937 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:10.935+0000 7fa619517b80 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fa6081b6900 con 0x55aa4ee186c0 2024-05-08T05:31:10.937 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:10.935+0000 7fa619517b80 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fa6081b4190 con 0x55aa4ee12a50 2024-05-08T05:31:10.937 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:10.935+0000 7fa619517b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7fa6081b2000 con 0x55aa4ee17da0 2024-05-08T05:31:10.938 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:10.936+0000 7fa607400700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55aa4ee12a50 0x55aa4ee12430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:31:10.938 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:10.936+0000 7fa607400700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55aa4ee12a50 0x55aa4ee12430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.87:37392/0 (socket says 172.21.15.87:37392) 2024-05-08T05:31:10.938 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:10.936+0000 7fa607400700 1 -- 172.21.15.87:0/1663872701 learned_addr learned my addr 172.21.15.87:0/1663872701 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T05:31:10.938 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:10.936+0000 7fa607e00700 1 --2- 172.21.15.87:0/1663872701 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55aa4ee17da0 0x55aa4ee281e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:31:10.938 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:10.936+0000 7fa607400700 1 --2- 172.21.15.87:0/1663872701 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55aa4ee186c0 0x55aa4ee1a900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:31:10.938 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:10.936+0000 7fa607400700 1 -- 172.21.15.87:0/1663872701 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55aa4ee17da0 msgr2=0x55aa4ee281e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:31:10.938 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:10.936+0000 7fa607400700 1 --2- 172.21.15.87:0/1663872701 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55aa4ee17da0 0x55aa4ee281e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:31:10.938 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:10.936+0000 7fa607400700 1 -- 172.21.15.87:0/1663872701 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55aa4ee186c0 msgr2=0x55aa4ee1a900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:31:10.938 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:10.936+0000 7fa607400700 1 --2- 172.21.15.87:0/1663872701 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55aa4ee186c0 0x55aa4ee1a900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:31:10.939 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:10.936+0000 7fa607400700 1 -- 172.21.15.87:0/1663872701 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55aa4ee098a0 con 0x55aa4ee12a50 2024-05-08T05:31:10.939 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:10.936+0000 7fa607e00700 1 --2- 172.21.15.87:0/1663872701 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55aa4ee17da0 0x55aa4ee281e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T05:31:10.939 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:10.937+0000 7fa607400700 1 --2- 172.21.15.87:0/1663872701 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55aa4ee12a50 0x55aa4ee12430 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fa5f4009fd0 tx=0x7fa5f4005e50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fbbbe87bec4c7c32 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:31:10.939 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:10.937+0000 7fa5fcc00700 1 -- 172.21.15.87:0/1663872701 <== mon.2 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5f400b560 con 0x55aa4ee12a50 2024-05-08T05:31:10.939 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:10.937+0000 7fa5fcc00700 1 -- 172.21.15.87:0/1663872701 <== mon.2 v2:172.21.15.90:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa5f400b700 con 0x55aa4ee12a50 2024-05-08T05:31:10.939 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:10.937+0000 7fa5fcc00700 1 -- 172.21.15.87:0/1663872701 <== mon.2 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5f400e4d0 con 0x55aa4ee12a50 2024-05-08T05:31:10.940 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:10.938+0000 7fa619517b80 1 -- 172.21.15.87:0/1663872701 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55aa4ee12a50 msgr2=0x55aa4ee12430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:31:10.940 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:10.938+0000 7fa619517b80 1 --2- 172.21.15.87:0/1663872701 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55aa4ee12a50 0x55aa4ee12430 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fa5f4009fd0 tx=0x7fa5f4005e50 comp rx=0 tx=0).stop 2024-05-08T05:31:10.940 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:10.938+0000 7fa619517b80 1 -- 172.21.15.87:0/1663872701 shutdown_connections 2024-05-08T05:31:10.941 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:10.938+0000 7fa619517b80 1 --2- 172.21.15.87:0/1663872701 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55aa4ee186c0 0x55aa4ee1a900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:31:10.941 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:10.938+0000 7fa619517b80 1 --2- 172.21.15.87:0/1663872701 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55aa4ee12a50 0x55aa4ee12430 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:31:10.941 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:10.938+0000 7fa619517b80 1 --2- 172.21.15.87:0/1663872701 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55aa4ee17da0 0x55aa4ee281e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:31:10.941 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:10.938+0000 7fa619517b80 1 -- 172.21.15.87:0/1663872701 >> 172.21.15.87:0/1663872701 conn(0x55aa4ed8a6d0 msgr2=0x55aa4ee19110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:31:10.941 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:10.939+0000 7fa619517b80 1 -- 172.21.15.87:0/1663872701 shutdown_connections 2024-05-08T05:31:10.941 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:10.939+0000 7fa619517b80 1 -- 172.21.15.87:0/1663872701 wait complete. 2024-05-08T05:31:10.941 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:10.939+0000 7fa619517b80 1 -- start start 2024-05-08T05:31:10.941 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:10.939+0000 7fa619517b80 1 Processor -- start 2024-05-08T05:31:10.942 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:10.940+0000 7fa619517b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55aa4ee12a50 0x55aa4ee24740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:31:10.942 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:10.940+0000 7fa619517b80 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55aa4ee17da0 0x55aa4ee24c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:31:10.942 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:10.940+0000 7fa619517b80 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55aa4ee186c0 0x55aa4ee32c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:31:10.942 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:10.940+0000 7fa619517b80 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fa6081b2650 con 0x55aa4ee186c0 2024-05-08T05:31:10.942 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:10.940+0000 7fa619517b80 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fa6081b3ac0 con 0x55aa4ee17da0 2024-05-08T05:31:10.942 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:10.940+0000 7fa619517b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7fa6081b2d20 con 0x55aa4ee12a50 2024-05-08T05:31:10.943 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:10.940+0000 7fa619517b80 10 client.0 _ll_register_callbacks cb 0x55aa4ed0bc70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T05:31:10.943 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:10.940+0000 7fa607400700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55aa4ee186c0 0x55aa4ee32c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:31:10.943 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:10.940+0000 7fa607400700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55aa4ee12a50 0x55aa4ee24740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:31:10.943 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:10.940+0000 7fa607400700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55aa4ee12a50 0x55aa4ee24740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.87:43112/0 (socket says 172.21.15.87:43112) 2024-05-08T05:31:10.943 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:10.940+0000 7fa607400700 1 -- 172.21.15.87:0/1663380638 learned_addr learned my addr 172.21.15.87:0/1663380638 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T05:31:10.943 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:10.941+0000 7fa607e00700 1 --2- 172.21.15.87:0/1663380638 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55aa4ee17da0 0x55aa4ee24c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:31:10.944 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:10.941+0000 7fa607400700 1 -- 172.21.15.87:0/1663380638 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55aa4ee12a50 msgr2=0x55aa4ee24740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:31:10.944 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:10.941+0000 7fa607400700 1 --2- 172.21.15.87:0/1663380638 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55aa4ee12a50 0x55aa4ee24740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:31:10.944 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:10.941+0000 7fa607400700 1 -- 172.21.15.87:0/1663380638 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55aa4ee17da0 msgr2=0x55aa4ee24c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:31:10.944 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:10.941+0000 7fa607400700 1 --2- 172.21.15.87:0/1663380638 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55aa4ee17da0 0x55aa4ee24c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:31:10.944 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:10.941+0000 7fa607400700 1 -- 172.21.15.87:0/1663380638 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55aa4ee33450 con 0x55aa4ee186c0 2024-05-08T05:31:10.944 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:10.942+0000 7fa607400700 1 --2- 172.21.15.87:0/1663380638 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55aa4ee186c0 0x55aa4ee32c50 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fa5f400b930 tx=0x7fa5f4003bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=caa44aeca5df7f server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:31:10.945 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:10.942+0000 7fa5f2000700 10 client.0 ms_handle_connect on v2:172.21.15.87:3300/0 2024-05-08T05:31:10.945 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:10.942+0000 7fa5f2000700 1 -- 172.21.15.87:0/1663380638 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5f4003880 con 0x55aa4ee186c0 2024-05-08T05:31:10.945 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:10.942+0000 7fa619517b80 1 -- 172.21.15.87:0/1663380638 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa5f400b700 con 0x55aa4ee186c0 2024-05-08T05:31:10.945 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:10.942+0000 7fa5f2000700 1 -- 172.21.15.87:0/1663380638 <== mon.0 v2:172.21.15.87:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8190+0+0 (secure 0 0 0) 0x7fa5f400e4a0 con 0x55aa4ee186c0 2024-05-08T05:31:10.945 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:10.942+0000 7fa5f2000700 1 -- 172.21.15.87:0/1663380638 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fa5f400e6a0 con 0x55aa4ee186c0 2024-05-08T05:31:10.945 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:10.942+0000 7fa619517b80 10 client.15231 fetch_fsmap learned FSMap version 25 2024-05-08T05:31:10.945 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:10.942+0000 7fa619517b80 1 -- 172.21.15.87:0/1663380638 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55aa4ee962d0 con 0x55aa4ee186c0 2024-05-08T05:31:10.945 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:10.943+0000 7fa5f2000700 1 -- 172.21.15.87:0/1663380638 <== mon.0 v2:172.21.15.87:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa5f400b700 con 0x55aa4ee186c0 2024-05-08T05:31:10.945 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:10.943+0000 7fa5f2000700 1 -- 172.21.15.87:0/1663380638 <== mon.0 v2:172.21.15.87:3300/0 5 ==== fsmap(e 25) ==== 8338+0+0 (secure 0 0 0) 0x7fa5f403d020 con 0x55aa4ee186c0 2024-05-08T05:31:10.946 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:10.943+0000 7fa619517b80 10 client.15231 fetch_fsmap finished waiting for FSMap version 25 2024-05-08T05:31:10.946 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:10.943+0000 7fa619517b80 10 client.15231 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.g 2024-05-08T05:31:10.947 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:10.943+0000 7fa619517b80 20 client.15231 populate_metadata read hostname 'smithi087' 2024-05-08T05:31:10.947 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:10.943+0000 7fa619517b80 1 --2- 172.21.15.87:0/1663380638 >> [v2:172.21.15.87:6838/2127215876,v1:172.21.15.87:6839/2127215876] conn(0x55aa4ee96840 0x55aa4ee98c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:31:10.947 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:10.943+0000 7fa619517b80 4 client.15231 mds_command: new command op to 24482 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-05-08T05:31:10.947 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:10.943+0000 7fa619517b80 1 -- 172.21.15.87:0/1663380638 --> [v2:172.21.15.87:6838/2127215876,v1:172.21.15.87:6839/2127215876] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55aa4ed72400 con 0x55aa4ee96840 2024-05-08T05:31:10.947 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:10.944+0000 7fa607e00700 1 --2- 172.21.15.87:0/1663380638 >> [v2:172.21.15.87:6838/2127215876,v1:172.21.15.87:6839/2127215876] conn(0x55aa4ee96840 0x55aa4ee98c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:31:10.947 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:10.945+0000 7fa607e00700 1 --2- 172.21.15.87:0/1663380638 >> [v2:172.21.15.87:6838/2127215876,v1:172.21.15.87:6839/2127215876] conn(0x55aa4ee96840 0x55aa4ee98c60 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=9f735c391f8c8439 server_cookie=7fff49a8a27e9164 in_seq=0 out_seq=0 2024-05-08T05:31:10.947 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:10.945+0000 7fa5f2000700 10 client.15231 ms_handle_connect on v2:172.21.15.87:6838/2127215876 2024-05-08T05:31:10.947 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:10.945+0000 7fa5f2000700 1 -- 172.21.15.87:0/1663380638 <== mds.1 v2:172.21.15.87:6838/2127215876 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55aa4ed72400 con 0x55aa4ee96840 2024-05-08T05:31:10.947 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:10.945+0000 7fa5f2000700 10 client.15231 handle_command_reply: tid=0 2024-05-08T05:31:10.947 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:10.945+0000 7fa619517b80 1 client.15231 shutdown 2024-05-08T05:31:10.948 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:10.946+0000 7fa619517b80 1 -- 172.21.15.87:0/1663380638 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55aa4ee186c0 msgr2=0x55aa4ee32c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:31:10.948 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:10.946+0000 7fa619517b80 1 --2- 172.21.15.87:0/1663380638 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55aa4ee186c0 0x55aa4ee32c50 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fa5f400b930 tx=0x7fa5f4003bd0 comp rx=0 tx=0).stop 2024-05-08T05:31:10.948 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:10.946+0000 7fa619517b80 1 -- 172.21.15.87:0/1663380638 shutdown_connections 2024-05-08T05:31:10.948 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:10.946+0000 7fa619517b80 1 --2- 172.21.15.87:0/1663380638 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55aa4ee186c0 0x55aa4ee32c50 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:31:10.948 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:10.946+0000 7fa619517b80 1 --2- 172.21.15.87:0/1663380638 >> [v2:172.21.15.87:6838/2127215876,v1:172.21.15.87:6839/2127215876] conn(0x55aa4ee96840 0x55aa4ee98c60 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:31:10.948 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:10.946+0000 7fa5f2000700 0 client.15231 ms_handle_reset on v2:172.21.15.87:6838/2127215876 2024-05-08T05:31:10.948 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:10.946+0000 7fa619517b80 1 --2- 172.21.15.87:0/1663380638 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55aa4ee12a50 0x55aa4ee24740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:31:10.949 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:10.946+0000 7fa619517b80 1 --2- 172.21.15.87:0/1663380638 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55aa4ee17da0 0x55aa4ee24c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:31:10.949 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:10.946+0000 7fa619517b80 1 -- 172.21.15.87:0/1663380638 >> 172.21.15.87:0/1663380638 conn(0x55aa4ed8a6d0 msgr2=0x55aa4ee168a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:31:10.949 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:10.947+0000 7fa619517b80 1 -- 172.21.15.87:0/1663380638 shutdown_connections 2024-05-08T05:31:10.949 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:10.947+0000 7fa619517b80 1 -- 172.21.15.87:0/1663380638 wait complete. 2024-05-08T05:31:10.949 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:10.948+0000 7fa619517b80 20 client.15231 trim_cache size 0 max 16384 2024-05-08T05:31:10.950 INFO:teuthology.orchestra.run.smithi087.stdout:[] 2024-05-08T05:31:10.950 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:10.949+0000 7fa60d600700 1 -- 172.21.15.87:0/1110258514 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7fa5ec0b2900 msgr2=0x7fa5ec0b4dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:31:10.951 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:10.949+0000 7fa60d600700 1 --2- 172.21.15.87:0/1110258514 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7fa5ec0b2900 0x7fa5ec0b4dc0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fa600019ff0 tx=0x7fa600006230 comp rx=0 tx=0).stop 2024-05-08T05:31:10.951 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:10.949+0000 7fa60d600700 1 -- 172.21.15.87:0/1110258514 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa6081143e0 msgr2=0x7fa6081a4a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:31:10.951 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:10.949+0000 7fa60d600700 1 --2- 172.21.15.87:0/1110258514 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa6081143e0 0x7fa6081a4a10 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fa60000ef90 tx=0x7fa60000c450 comp rx=0 tx=0).stop 2024-05-08T05:31:10.951 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:10.950+0000 7fa60d600700 1 -- 172.21.15.87:0/1110258514 shutdown_connections 2024-05-08T05:31:10.951 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:10.950+0000 7fa60d600700 1 --2- 172.21.15.87:0/1110258514 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa6081143e0 0x7fa6081a4a10 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:31:10.952 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:10.950+0000 7fa60d600700 1 --2- 172.21.15.87:0/1110258514 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7fa5ec0b2900 0x7fa5ec0b4dc0 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:31:10.952 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:10.950+0000 7fa60d600700 1 --2- 172.21.15.87:0/1110258514 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa608075840 0x7fa6081a0190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:31:10.952 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:10.950+0000 7fa60d600700 1 --2- 172.21.15.87:0/1110258514 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa608076160 0x7fa6081a06d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:31:10.952 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:10.950+0000 7fa60d600700 1 -- 172.21.15.87:0/1110258514 >> 172.21.15.87:0/1110258514 conn(0x7fa6080fef20 msgr2=0x7fa608100820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:31:10.952 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:10.950+0000 7fa60d600700 1 -- 172.21.15.87:0/1110258514 shutdown_connections 2024-05-08T05:31:10.952 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:10.950+0000 7fa60d600700 1 -- 172.21.15.87:0/1110258514 wait complete. 2024-05-08T05:31:11.813 DEBUG:teuthology.orchestra.run.smithi087:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid eeeb813e-0cf9-11ef-bc97-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-05-08T05:31:12.113 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:31:12 smithi087 ceph-mon[29523]: pgmap v486: 97 pgs: 97 active+clean; 661 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 5 op/s 2024-05-08T05:31:12.423 INFO:teuthology.orchestra.run.smithi087.stderr:Inferring config /var/lib/ceph/eeeb813e-0cf9-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T05:31:12.483 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:31:12 smithi090 ceph-mon[34526]: pgmap v486: 97 pgs: 97 active+clean; 661 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 5 op/s 2024-05-08T05:31:12.538 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:31:12 smithi160 ceph-mon[34827]: pgmap v486: 97 pgs: 97 active+clean; 661 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 5 op/s 2024-05-08T05:31:14.368 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:31:14 smithi087 ceph-mon[29523]: pgmap v487: 97 pgs: 97 active+clean; 661 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-05-08T05:31:14.483 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:31:14 smithi090 ceph-mon[34526]: pgmap v487: 97 pgs: 97 active+clean; 661 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-05-08T05:31:14.538 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:31:14 smithi160 ceph-mon[34827]: pgmap v487: 97 pgs: 97 active+clean; 661 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-05-08T05:31:14.706 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:14.703+0000 7f788dc00700 1 -- 172.21.15.87:0/962423313 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7888103750 msgr2=0x7f7888103b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:31:14.706 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:14.703+0000 7f788dc00700 1 --2- 172.21.15.87:0/962423313 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7888103750 0x7f7888103b30 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f78780099c0 tx=0x7f7878009cd0 comp rx=0 tx=0).stop 2024-05-08T05:31:14.706 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:14.703+0000 7f788dc00700 1 -- 172.21.15.87:0/962423313 shutdown_connections 2024-05-08T05:31:14.706 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:14.703+0000 7f788dc00700 1 --2- 172.21.15.87:0/962423313 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7888108850 0x7f78881103d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:31:14.706 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:14.703+0000 7f788dc00700 1 --2- 172.21.15.87:0/962423313 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7888103750 0x7f7888103b30 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:31:14.707 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:14.703+0000 7f788dc00700 1 --2- 172.21.15.87:0/962423313 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7888104100 0x7f7888108120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:31:14.707 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:14.703+0000 7f788dc00700 1 -- 172.21.15.87:0/962423313 >> 172.21.15.87:0/962423313 conn(0x7f788807a600 msgr2=0x7f788807aa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:31:14.707 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:14.703+0000 7f788dc00700 1 -- 172.21.15.87:0/962423313 shutdown_connections 2024-05-08T05:31:14.707 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:14.703+0000 7f788dc00700 1 -- 172.21.15.87:0/962423313 wait complete. 2024-05-08T05:31:14.707 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:14.705+0000 7f788dc00700 1 Processor -- start 2024-05-08T05:31:14.707 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:14.705+0000 7f788dc00700 1 -- start start 2024-05-08T05:31:14.707 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:14.705+0000 7f788dc00700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7888103750 0x7f788819f770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:31:14.707 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:14.706+0000 7f788dc00700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7888104100 0x7f788819fcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:31:14.708 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:14.706+0000 7f788dc00700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7888108850 0x7f7888199930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:31:14.708 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:14.706+0000 7f788dc00700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f7888113670 con 0x7f7888103750 2024-05-08T05:31:14.708 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:14.706+0000 7f788dc00700 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f78881134f0 con 0x7f7888104100 2024-05-08T05:31:14.708 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:14.706+0000 7f788dc00700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f78881137f0 con 0x7f7888108850 2024-05-08T05:31:14.708 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:14.706+0000 7f7886a00700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7888103750 0x7f788819f770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:31:14.708 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:14.706+0000 7f7886a00700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7888103750 0x7f788819f770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:44866/0 (socket says 172.21.15.87:44866) 2024-05-08T05:31:14.708 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:14.706+0000 7f7886a00700 1 -- 172.21.15.87:0/4190434435 learned_addr learned my addr 172.21.15.87:0/4190434435 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T05:31:14.708 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:14.706+0000 7f7886000700 1 --2- 172.21.15.87:0/4190434435 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7888104100 0x7f788819fcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:31:14.709 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:14.706+0000 7f7887400700 1 --2- 172.21.15.87:0/4190434435 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7888108850 0x7f7888199930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:31:14.709 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:14.707+0000 7f7886a00700 1 -- 172.21.15.87:0/4190434435 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7888108850 msgr2=0x7f7888199930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:31:14.709 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:14.707+0000 7f7886a00700 1 --2- 172.21.15.87:0/4190434435 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7888108850 0x7f7888199930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:31:14.709 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:14.707+0000 7f7886a00700 1 -- 172.21.15.87:0/4190434435 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7888104100 msgr2=0x7f788819fcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:31:14.709 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:14.707+0000 7f7886a00700 1 --2- 172.21.15.87:0/4190434435 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7888104100 0x7f788819fcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:31:14.709 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:14.707+0000 7f7886a00700 1 -- 172.21.15.87:0/4190434435 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f788819a090 con 0x7f7888103750 2024-05-08T05:31:14.709 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:14.707+0000 7f7886a00700 1 --2- 172.21.15.87:0/4190434435 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7888103750 0x7f788819f770 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f7878006010 tx=0x7f7878005280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:31:14.710 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:14.707+0000 7f787f400700 1 -- 172.21.15.87:0/4190434435 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7878026070 con 0x7f7888103750 2024-05-08T05:31:14.710 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:14.707+0000 7f788dc00700 1 -- 172.21.15.87:0/4190434435 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f788819a320 con 0x7f7888103750 2024-05-08T05:31:14.710 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:14.708+0000 7f788dc00700 1 -- 172.21.15.87:0/4190434435 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f78880756d0 con 0x7f7888103750 2024-05-08T05:31:14.710 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:14.708+0000 7f787f400700 1 -- 172.21.15.87:0/4190434435 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f787800b790 con 0x7f7888103750 2024-05-08T05:31:14.710 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:14.708+0000 7f787f400700 1 -- 172.21.15.87:0/4190434435 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f787800f6c0 con 0x7f7888103750 2024-05-08T05:31:14.716 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:14.714+0000 7f7898540b80 1 Processor -- start 2024-05-08T05:31:14.716 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:14.714+0000 7f787f400700 1 -- 172.21.15.87:0/4190434435 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7f7878029070 con 0x7f7888103750 2024-05-08T05:31:14.716 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:14.714+0000 7f7898540b80 1 -- start start 2024-05-08T05:31:14.716 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:14.715+0000 7f7898540b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x557bd5bbd870 0x557bd5bbdc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:31:14.717 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:14.715+0000 7f7898540b80 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x557bd5bbe190 0x557bd5bc1ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:31:14.717 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:14.715+0000 7f7898540b80 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x557bd5bc21e0 0x557bd5bc2620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:31:14.717 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:14.715+0000 7f7898540b80 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x557bd5b07a20 con 0x557bd5bc21e0 2024-05-08T05:31:14.717 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:14.715+0000 7f7898540b80 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x557bd5aa5760 con 0x557bd5bbe190 2024-05-08T05:31:14.717 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:14.715+0000 7f7898540b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x557bd5b039e0 con 0x557bd5bbd870 2024-05-08T05:31:14.717 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:14.716+0000 7f7887400700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x557bd5bbd870 0x557bd5bbdc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:31:14.718 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:14.716+0000 7f7887400700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x557bd5bbd870 0x557bd5bbdc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.87:43142/0 (socket says 172.21.15.87:43142) 2024-05-08T05:31:14.718 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:14.716+0000 7f7887400700 1 -- 172.21.15.87:0/3546753673 learned_addr learned my addr 172.21.15.87:0/3546753673 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T05:31:14.718 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:14.716+0000 7f7886000700 1 --2- 172.21.15.87:0/3546753673 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x557bd5bc21e0 0x557bd5bc2620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:31:14.718 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:14.716+0000 7f7887400700 1 -- 172.21.15.87:0/3546753673 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x557bd5bbe190 msgr2=0x557bd5bc1ca0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-08T05:31:14.718 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:14.716+0000 7f7887400700 1 --2- 172.21.15.87:0/3546753673 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x557bd5bbe190 0x557bd5bc1ca0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:31:14.718 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:14.716+0000 7f7887400700 1 -- 172.21.15.87:0/3546753673 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x557bd5bc21e0 msgr2=0x557bd5bc2620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:31:14.718 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:14.716+0000 7f7887400700 1 --2- 172.21.15.87:0/3546753673 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x557bd5bc21e0 0x557bd5bc2620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:31:14.718 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:14.716+0000 7f7887400700 1 -- 172.21.15.87:0/3546753673 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557bd5a548d0 con 0x557bd5bbd870 2024-05-08T05:31:14.719 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:14.717+0000 7f7887400700 1 --2- 172.21.15.87:0/3546753673 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x557bd5bbd870 0x557bd5bbdc50 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f7880009500 tx=0x7f7880009920 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7b077dc565883208 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:31:14.719 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:14.717+0000 7f787f400700 1 --2- 172.21.15.87:0/4190434435 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f786c0b2900 0x7f786c0b4dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:31:14.720 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:14.717+0000 7f787f400700 1 -- 172.21.15.87:0/4190434435 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8190+0+0 (secure 0 0 0) 0x7f78780e2810 con 0x7f7888103750 2024-05-08T05:31:14.720 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:14.717+0000 7f7873e00700 1 -- 172.21.15.87:0/3546753673 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7880003c00 con 0x557bd5bbd870 2024-05-08T05:31:14.720 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:14.717+0000 7f7873e00700 1 -- 172.21.15.87:0/3546753673 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7880016070 con 0x557bd5bbd870 2024-05-08T05:31:14.720 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:14.717+0000 7f7873e00700 1 -- 172.21.15.87:0/3546753673 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78800128d0 con 0x557bd5bbd870 2024-05-08T05:31:14.720 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:14.718+0000 7f7886a00700 1 --2- 172.21.15.87:0/4190434435 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f786c0b2900 0x7f786c0b4dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:31:14.720 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:14.718+0000 7f7898540b80 1 -- 172.21.15.87:0/3546753673 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x557bd5bbd870 msgr2=0x557bd5bbdc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:31:14.721 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:14.718+0000 7f7898540b80 1 --2- 172.21.15.87:0/3546753673 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x557bd5bbd870 0x557bd5bbdc50 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f7880009500 tx=0x7f7880009920 comp rx=0 tx=0).stop 2024-05-08T05:31:14.721 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:14.719+0000 7f7898540b80 1 -- 172.21.15.87:0/3546753673 shutdown_connections 2024-05-08T05:31:14.721 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:14.719+0000 7f7898540b80 1 --2- 172.21.15.87:0/3546753673 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x557bd5bc21e0 0x557bd5bc2620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:31:14.721 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:14.719+0000 7f7898540b80 1 --2- 172.21.15.87:0/3546753673 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x557bd5bbd870 0x557bd5bbdc50 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:31:14.721 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:14.719+0000 7f7898540b80 1 --2- 172.21.15.87:0/3546753673 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x557bd5bbe190 0x557bd5bc1ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:31:14.721 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:14.719+0000 7f7898540b80 1 -- 172.21.15.87:0/3546753673 >> 172.21.15.87:0/3546753673 conn(0x557bd5ae3b60 msgr2=0x557bd5baf7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:31:14.721 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:14.719+0000 7f7886a00700 1 --2- 172.21.15.87:0/4190434435 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f786c0b2900 0x7f786c0b4dc0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f78780a5f10 tx=0x7f78780a96b0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:31:14.721 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:14.719+0000 7f7898540b80 1 -- 172.21.15.87:0/3546753673 shutdown_connections 2024-05-08T05:31:14.721 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:14.719+0000 7f7898540b80 1 -- 172.21.15.87:0/3546753673 wait complete. 2024-05-08T05:31:14.722 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:14.720+0000 7f7898540b80 1 -- start start 2024-05-08T05:31:14.722 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:14.720+0000 7f7898540b80 1 Processor -- start 2024-05-08T05:31:14.722 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:14.721+0000 7f7898540b80 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x557bd5bbd870 0x557bd5bc9660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:31:14.722 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:14.721+0000 7f7898540b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x557bd5bbe190 0x557bd5bc6a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:31:14.723 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:14.721+0000 7f7898540b80 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x557bd5bc21e0 0x557bd5bc6f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:31:14.723 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:14.721+0000 7f7898540b80 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x557bd5bca440 con 0x557bd5bbd870 2024-05-08T05:31:14.723 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:14.721+0000 7f7898540b80 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x557bd5a6db20 con 0x557bd5bc21e0 2024-05-08T05:31:14.723 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:14.721+0000 7f7898540b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x557bd5bca5c0 con 0x557bd5bbe190 2024-05-08T05:31:14.723 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:14.721+0000 7f7898540b80 10 client.0 _ll_register_callbacks cb 0x557bd5aaec70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T05:31:14.723 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:14.721+0000 7f7887400700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x557bd5bbd870 0x557bd5bc9660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:31:14.723 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:14.722+0000 7f7887400700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x557bd5bbd870 0x557bd5bc9660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:44888/0 (socket says 172.21.15.87:44888) 2024-05-08T05:31:14.723 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:14.722+0000 7f7887400700 1 -- 172.21.15.87:0/1741955487 learned_addr learned my addr 172.21.15.87:0/1741955487 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T05:31:14.723 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:14.722+0000 7f7886000700 1 --2- 172.21.15.87:0/1741955487 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x557bd5bbe190 0x557bd5bc6a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:31:14.724 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:14.723+0000 7f7887400700 1 -- 172.21.15.87:0/1741955487 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x557bd5bbe190 msgr2=0x557bd5bc6a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:31:14.724 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:14.723+0000 7f7887400700 1 --2- 172.21.15.87:0/1741955487 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x557bd5bbe190 0x557bd5bc6a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:31:14.724 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:14.723+0000 7f7887400700 1 -- 172.21.15.87:0/1741955487 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x557bd5bc21e0 msgr2=0x557bd5bc6f90 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-08T05:31:14.724 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:14.723+0000 7f7887400700 1 --2- 172.21.15.87:0/1741955487 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x557bd5bc21e0 0x557bd5bc6f90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:31:14.724 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:14.723+0000 7f7887400700 1 -- 172.21.15.87:0/1741955487 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557bd5acd420 con 0x557bd5bbd870 2024-05-08T05:31:14.725 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:14.723+0000 7f7887400700 1 --2- 172.21.15.87:0/1741955487 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x557bd5bbd870 0x557bd5bc9660 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f78800049e0 tx=0x7f78800128c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=17bee9820ead5f96 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:31:14.725 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:14.723+0000 7f7870c00700 10 client.0 ms_handle_connect on v2:172.21.15.87:3300/0 2024-05-08T05:31:14.726 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:14.724+0000 7f7870c00700 1 -- 172.21.15.87:0/1741955487 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7880012d90 con 0x557bd5bbd870 2024-05-08T05:31:14.726 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:14.724+0000 7f7870c00700 1 -- 172.21.15.87:0/1741955487 <== mon.0 v2:172.21.15.87:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8190+0+0 (secure 0 0 0) 0x7f7880005040 con 0x557bd5bbd870 2024-05-08T05:31:14.726 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:14.724+0000 7f7898540b80 1 -- 172.21.15.87:0/1741955487 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7880016070 con 0x557bd5bbd870 2024-05-08T05:31:14.726 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:14.724+0000 7f7870c00700 1 -- 172.21.15.87:0/1741955487 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f7880005240 con 0x557bd5bbd870 2024-05-08T05:31:14.726 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:14.724+0000 7f7898540b80 10 client.15243 fetch_fsmap learned FSMap version 25 2024-05-08T05:31:14.726 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:14.724+0000 7f7898540b80 1 -- 172.21.15.87:0/1741955487 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x557bd5bd4d10 con 0x557bd5bbd870 2024-05-08T05:31:14.727 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:14.725+0000 7f7870c00700 1 -- 172.21.15.87:0/1741955487 <== mon.0 v2:172.21.15.87:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7880016070 con 0x557bd5bbd870 2024-05-08T05:31:14.727 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:14.725+0000 7f7870c00700 1 -- 172.21.15.87:0/1741955487 <== mon.0 v2:172.21.15.87:3300/0 5 ==== fsmap(e 25) ==== 8338+0+0 (secure 0 0 0) 0x7f7880022a40 con 0x557bd5bbd870 2024-05-08T05:31:14.727 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:14.725+0000 7f7898540b80 10 client.15243 fetch_fsmap finished waiting for FSMap version 25 2024-05-08T05:31:14.727 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:14.725+0000 7f7898540b80 10 client.15243 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-05-08T05:31:14.727 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:14.725+0000 7f7898540b80 20 client.15243 populate_metadata read hostname 'smithi087' 2024-05-08T05:31:14.727 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:14.725+0000 7f7898540b80 1 --2- 172.21.15.87:0/1741955487 >> [v2:172.21.15.90:6838/160586017,v1:172.21.15.90:6839/160586017] conn(0x557bd5bd72f0 0x557bd5bd96e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:31:14.727 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:14.725+0000 7f7898540b80 4 client.15243 mds_command: new command op to 24500 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-08T05:31:14.727 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:14.725+0000 7f7898540b80 1 -- 172.21.15.87:0/1741955487 --> [v2:172.21.15.90:6838/160586017,v1:172.21.15.90:6839/160586017] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x557bd5b820a0 con 0x557bd5bd72f0 2024-05-08T05:31:14.727 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:14.726+0000 7f7886000700 1 --2- 172.21.15.87:0/1741955487 >> [v2:172.21.15.90:6838/160586017,v1:172.21.15.90:6839/160586017] conn(0x557bd5bd72f0 0x557bd5bd96e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:31:14.728 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:14.727+0000 7f7886000700 1 --2- 172.21.15.87:0/1741955487 >> [v2:172.21.15.90:6838/160586017,v1:172.21.15.90:6839/160586017] conn(0x557bd5bd72f0 0x557bd5bd96e0 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ecc09066f99237c2 server_cookie=64b9fa48c8d72205 in_seq=0 out_seq=0 2024-05-08T05:31:14.728 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:14.727+0000 7f7870c00700 10 client.15243 ms_handle_connect on v2:172.21.15.90:6838/160586017 2024-05-08T05:31:14.728 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:14.727+0000 7f7870c00700 1 -- 172.21.15.87:0/1741955487 <== mds.0 v2:172.21.15.90:6838/160586017 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x557bd5b820a0 con 0x557bd5bd72f0 2024-05-08T05:31:14.729 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:14.727+0000 7f7870c00700 10 client.15243 handle_command_reply: tid=0 2024-05-08T05:31:14.729 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:14.727+0000 7f7898540b80 1 client.15243 shutdown 2024-05-08T05:31:14.729 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:14.728+0000 7f7898540b80 1 -- 172.21.15.87:0/1741955487 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x557bd5bbd870 msgr2=0x557bd5bc9660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:31:14.729 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:14.728+0000 7f7898540b80 1 --2- 172.21.15.87:0/1741955487 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x557bd5bbd870 0x557bd5bc9660 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f78800049e0 tx=0x7f78800128c0 comp rx=0 tx=0).stop 2024-05-08T05:31:14.730 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:14.728+0000 7f7898540b80 1 -- 172.21.15.87:0/1741955487 shutdown_connections 2024-05-08T05:31:14.730 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:14.728+0000 7f7898540b80 1 --2- 172.21.15.87:0/1741955487 >> [v2:172.21.15.90:6838/160586017,v1:172.21.15.90:6839/160586017] conn(0x557bd5bd72f0 0x557bd5bd96e0 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:31:14.730 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:14.728+0000 7f7898540b80 1 --2- 172.21.15.87:0/1741955487 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x557bd5bc21e0 0x557bd5bc6f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:31:14.730 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:14.728+0000 7f7898540b80 1 --2- 172.21.15.87:0/1741955487 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x557bd5bbd870 0x557bd5bc9660 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:31:14.730 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:14.728+0000 7f7898540b80 1 --2- 172.21.15.87:0/1741955487 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x557bd5bbe190 0x557bd5bc6a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:31:14.730 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:14.728+0000 7f7898540b80 1 -- 172.21.15.87:0/1741955487 >> 172.21.15.87:0/1741955487 conn(0x557bd5ae3b60 msgr2=0x557bd5baf760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:31:14.730 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:14.729+0000 7f7870c00700 0 client.15243 ms_handle_reset on v2:172.21.15.90:6838/160586017 2024-05-08T05:31:14.730 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:14.729+0000 7f7898540b80 1 -- 172.21.15.87:0/1741955487 shutdown_connections 2024-05-08T05:31:14.731 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:14.729+0000 7f7898540b80 1 -- 172.21.15.87:0/1741955487 wait complete. 2024-05-08T05:31:14.731 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:14.729+0000 7f7898540b80 20 client.15243 trim_cache size 0 max 16384 2024-05-08T05:31:14.747 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:14.746+0000 7f7898540b80 1 Processor -- start 2024-05-08T05:31:14.747 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:14.746+0000 7f7898540b80 1 -- start start 2024-05-08T05:31:14.748 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:14.746+0000 7f7898540b80 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x557bd5bbd870 0x557bd5bc6fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:31:14.748 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:14.746+0000 7f7898540b80 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x557bd5bbe190 0x557bd5bd3560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:31:14.748 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:14.746+0000 7f7898540b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x557bd5bc21e0 0x557bd5bc4530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:31:14.748 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:14.746+0000 7f7898540b80 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f786800fbb0 con 0x557bd5bbe190 2024-05-08T05:31:14.748 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:14.746+0000 7f7898540b80 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f786800d440 con 0x557bd5bbd870 2024-05-08T05:31:14.748 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:14.746+0000 7f7898540b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f786800b290 con 0x557bd5bc21e0 2024-05-08T05:31:14.749 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:14.747+0000 7f7886000700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x557bd5bbe190 0x557bd5bd3560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:31:14.749 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:14.747+0000 7f7886000700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x557bd5bbe190 0x557bd5bd3560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:44892/0 (socket says 172.21.15.87:44892) 2024-05-08T05:31:14.749 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:14.747+0000 7f7886000700 1 -- 172.21.15.87:0/1010195815 learned_addr learned my addr 172.21.15.87:0/1010195815 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T05:31:14.749 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:14.747+0000 7f7887400700 1 --2- 172.21.15.87:0/1010195815 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x557bd5bc21e0 0x557bd5bc4530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:31:14.749 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:14.747+0000 7f7887400700 1 --2- 172.21.15.87:0/1010195815 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x557bd5bbd870 0x557bd5bc6fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:31:14.750 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:14.748+0000 7f7887400700 1 -- 172.21.15.87:0/1010195815 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x557bd5bbd870 msgr2=0x557bd5bc6fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:31:14.750 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:14.748+0000 7f7887400700 1 --2- 172.21.15.87:0/1010195815 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x557bd5bbd870 0x557bd5bc6fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:31:14.750 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:14.748+0000 7f7887400700 1 -- 172.21.15.87:0/1010195815 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x557bd5bbe190 msgr2=0x557bd5bd3560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:31:14.750 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:14.748+0000 7f7887400700 1 --2- 172.21.15.87:0/1010195815 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x557bd5bbe190 0x557bd5bd3560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:31:14.750 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:14.748+0000 7f7887400700 1 -- 172.21.15.87:0/1010195815 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557bd5bb09c0 con 0x557bd5bc21e0 2024-05-08T05:31:14.750 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:14.748+0000 7f7887400700 1 --2- 172.21.15.87:0/1010195815 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x557bd5bc21e0 0x557bd5bc4530 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f7880024040 tx=0x7f78800128c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d9f6bdddc47eec3d server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:31:14.750 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:14.748+0000 7f7873400700 1 -- 172.21.15.87:0/1010195815 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7880005040 con 0x557bd5bc21e0 2024-05-08T05:31:14.750 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:14.748+0000 7f7873400700 1 -- 172.21.15.87:0/1010195815 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7880016070 con 0x557bd5bc21e0 2024-05-08T05:31:14.750 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:14.749+0000 7f7873400700 1 -- 172.21.15.87:0/1010195815 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78800058a0 con 0x557bd5bc21e0 2024-05-08T05:31:14.751 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:14.749+0000 7f7898540b80 1 -- 172.21.15.87:0/1010195815 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x557bd5bc21e0 msgr2=0x557bd5bc4530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:31:14.751 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:14.749+0000 7f7898540b80 1 --2- 172.21.15.87:0/1010195815 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x557bd5bc21e0 0x557bd5bc4530 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f7880024040 tx=0x7f78800128c0 comp rx=0 tx=0).stop 2024-05-08T05:31:14.751 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:14.749+0000 7f7898540b80 1 -- 172.21.15.87:0/1010195815 shutdown_connections 2024-05-08T05:31:14.751 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:14.749+0000 7f7898540b80 1 --2- 172.21.15.87:0/1010195815 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x557bd5bc21e0 0x557bd5bc4530 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:31:14.751 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:14.749+0000 7f7898540b80 1 --2- 172.21.15.87:0/1010195815 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x557bd5bbd870 0x557bd5bc6fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:31:14.751 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:14.749+0000 7f7898540b80 1 --2- 172.21.15.87:0/1010195815 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x557bd5bbe190 0x557bd5bd3560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:31:14.751 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:14.749+0000 7f7898540b80 1 -- 172.21.15.87:0/1010195815 >> 172.21.15.87:0/1010195815 conn(0x557bd5ae3b60 msgr2=0x557bd5bc3e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:31:14.751 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:14.750+0000 7f7898540b80 1 -- 172.21.15.87:0/1010195815 shutdown_connections 2024-05-08T05:31:14.752 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:14.750+0000 7f7898540b80 1 -- 172.21.15.87:0/1010195815 wait complete. 2024-05-08T05:31:14.752 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:14.750+0000 7f7898540b80 1 -- start start 2024-05-08T05:31:14.752 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:14.751+0000 7f7898540b80 1 Processor -- start 2024-05-08T05:31:14.753 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:14.751+0000 7f7898540b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x557bd5bbd870 0x557bd5bcf8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:31:14.753 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:14.751+0000 7f7898540b80 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x557bd5bbe190 0x557bd5bcfe20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:31:14.753 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:14.751+0000 7f7898540b80 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x557bd5bc21e0 0x557bd5bddd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:31:14.753 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:14.751+0000 7f7898540b80 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f786800b900 con 0x557bd5bbe190 2024-05-08T05:31:14.753 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:14.751+0000 7f7898540b80 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f786800cd70 con 0x557bd5bc21e0 2024-05-08T05:31:14.753 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:14.751+0000 7f7898540b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f786800bfd0 con 0x557bd5bbd870 2024-05-08T05:31:14.753 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:14.752+0000 7f7898540b80 10 client.0 _ll_register_callbacks cb 0x557bd5aaec70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T05:31:14.754 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:14.752+0000 7f7887400700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x557bd5bbd870 0x557bd5bcf8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:31:14.754 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:14.752+0000 7f7887400700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x557bd5bbd870 0x557bd5bcf8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.87:43164/0 (socket says 172.21.15.87:43164) 2024-05-08T05:31:14.754 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:14.752+0000 7f7887400700 1 -- 172.21.15.87:0/1588101204 learned_addr learned my addr 172.21.15.87:0/1588101204 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T05:31:14.754 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:14.752+0000 7f7886000700 1 --2- 172.21.15.87:0/1588101204 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x557bd5bbe190 0x557bd5bcfe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:31:14.754 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:14.752+0000 7f7887400700 1 --2- 172.21.15.87:0/1588101204 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x557bd5bc21e0 0x557bd5bddd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:31:14.754 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:14.753+0000 7f7886000700 1 -- 172.21.15.87:0/1588101204 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x557bd5bbd870 msgr2=0x557bd5bcf8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:31:14.754 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:14.753+0000 7f7886000700 1 --2- 172.21.15.87:0/1588101204 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x557bd5bbd870 0x557bd5bcf8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:31:14.755 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:14.753+0000 7f7886000700 1 -- 172.21.15.87:0/1588101204 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x557bd5bc21e0 msgr2=0x557bd5bddd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:31:14.755 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:14.753+0000 7f7886000700 1 --2- 172.21.15.87:0/1588101204 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x557bd5bc21e0 0x557bd5bddd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:31:14.755 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:14.753+0000 7f7886000700 1 -- 172.21.15.87:0/1588101204 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557bd5bde2c0 con 0x557bd5bbe190 2024-05-08T05:31:14.756 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:14.753+0000 7f7886000700 1 --2- 172.21.15.87:0/1588101204 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x557bd5bbe190 0x557bd5bcfe20 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x557bd5bb0580 tx=0x7f7874009260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fbba65e4a609778b server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:31:14.756 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:14.753+0000 7f7870c00700 10 client.0 ms_handle_connect on v2:172.21.15.87:3300/0 2024-05-08T05:31:14.756 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:14.754+0000 7f7870c00700 1 -- 172.21.15.87:0/1588101204 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f787401e840 con 0x557bd5bbe190 2024-05-08T05:31:14.756 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:14.754+0000 7f7870c00700 1 -- 172.21.15.87:0/1588101204 <== mon.0 v2:172.21.15.87:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8190+0+0 (secure 0 0 0) 0x7f787401e9e0 con 0x557bd5bbe190 2024-05-08T05:31:14.756 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:14.754+0000 7f7898540b80 1 -- 172.21.15.87:0/1588101204 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7880016070 con 0x557bd5bbe190 2024-05-08T05:31:14.756 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:14.754+0000 7f7870c00700 1 -- 172.21.15.87:0/1588101204 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f7874004560 con 0x557bd5bbe190 2024-05-08T05:31:14.756 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:14.754+0000 7f7898540b80 10 client.15249 fetch_fsmap learned FSMap version 25 2024-05-08T05:31:14.756 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:14.754+0000 7f7898540b80 1 -- 172.21.15.87:0/1588101204 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x557bd5c411a0 con 0x557bd5bbe190 2024-05-08T05:31:14.757 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:14.755+0000 7f7870c00700 1 -- 172.21.15.87:0/1588101204 <== mon.0 v2:172.21.15.87:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7880016070 con 0x557bd5bbe190 2024-05-08T05:31:14.757 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:14.755+0000 7f7870c00700 1 -- 172.21.15.87:0/1588101204 <== mon.0 v2:172.21.15.87:3300/0 5 ==== fsmap(e 25) ==== 8338+0+0 (secure 0 0 0) 0x7f78740107b0 con 0x557bd5bbe190 2024-05-08T05:31:14.757 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:14.755+0000 7f7898540b80 10 client.15249 fetch_fsmap finished waiting for FSMap version 25 2024-05-08T05:31:14.757 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:14.755+0000 7f7898540b80 10 client.15249 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-05-08T05:31:14.757 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:14.755+0000 7f7898540b80 20 client.15249 populate_metadata read hostname 'smithi087' 2024-05-08T05:31:14.758 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:14.755+0000 7f7898540b80 1 --2- 172.21.15.87:0/1588101204 >> [v2:172.21.15.90:6838/160586017,v1:172.21.15.90:6839/160586017] conn(0x557bd5c41900 0x557bd5c43d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:31:14.758 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:14.755+0000 7f7898540b80 4 client.15249 mds_command: new command op to 24500 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-05-08T05:31:14.758 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:14.755+0000 7f7898540b80 1 -- 172.21.15.87:0/1588101204 --> [v2:172.21.15.90:6838/160586017,v1:172.21.15.90:6839/160586017] -- command(tid 0: {"prefix": "damage ls"}) -- 0x557bd5b15400 con 0x557bd5c41900 2024-05-08T05:31:14.758 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:14.755+0000 7f7887400700 1 --2- 172.21.15.87:0/1588101204 >> [v2:172.21.15.90:6838/160586017,v1:172.21.15.90:6839/160586017] conn(0x557bd5c41900 0x557bd5c43d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:31:14.758 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:14.756+0000 7f7887400700 1 --2- 172.21.15.87:0/1588101204 >> [v2:172.21.15.90:6838/160586017,v1:172.21.15.90:6839/160586017] conn(0x557bd5c41900 0x557bd5c43d20 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=acf941e08cc5ab03 server_cookie=ed88932d0cce57cb in_seq=0 out_seq=0 2024-05-08T05:31:14.758 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:14.756+0000 7f7870c00700 10 client.15249 ms_handle_connect on v2:172.21.15.90:6838/160586017 2024-05-08T05:31:14.758 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:14.756+0000 7f7870c00700 1 -- 172.21.15.87:0/1588101204 <== mds.0 v2:172.21.15.90:6838/160586017 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x557bd5b15400 con 0x557bd5c41900 2024-05-08T05:31:14.758 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:14.756+0000 7f7870c00700 10 client.15249 handle_command_reply: tid=0 2024-05-08T05:31:14.758 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:14.756+0000 7f7898540b80 1 client.15249 shutdown 2024-05-08T05:31:14.759 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:14.756+0000 7f7898540b80 1 -- 172.21.15.87:0/1588101204 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x557bd5bbe190 msgr2=0x557bd5bcfe20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:31:14.759 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:14.756+0000 7f7898540b80 1 --2- 172.21.15.87:0/1588101204 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x557bd5bbe190 0x557bd5bcfe20 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x557bd5bb0580 tx=0x7f7874009260 comp rx=0 tx=0).stop 2024-05-08T05:31:14.759 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:14.757+0000 7f7898540b80 1 -- 172.21.15.87:0/1588101204 shutdown_connections 2024-05-08T05:31:14.759 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:14.757+0000 7f7898540b80 1 --2- 172.21.15.87:0/1588101204 >> [v2:172.21.15.90:6838/160586017,v1:172.21.15.90:6839/160586017] conn(0x557bd5c41900 0x557bd5c43d20 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:31:14.759 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:14.757+0000 7f7898540b80 1 --2- 172.21.15.87:0/1588101204 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x557bd5bc21e0 0x557bd5bddd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:31:14.759 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:14.757+0000 7f7898540b80 1 --2- 172.21.15.87:0/1588101204 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x557bd5bbd870 0x557bd5bcf8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:31:14.759 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:14.757+0000 7f7870c00700 0 client.15249 ms_handle_reset on v2:172.21.15.90:6838/160586017 2024-05-08T05:31:14.759 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:14.757+0000 7f7898540b80 1 --2- 172.21.15.87:0/1588101204 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x557bd5bbe190 0x557bd5bcfe20 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:31:14.759 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:14.757+0000 7f7898540b80 1 -- 172.21.15.87:0/1588101204 >> 172.21.15.87:0/1588101204 conn(0x557bd5ae3b60 msgr2=0x557bd5ba9a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:31:14.759 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:14.757+0000 7f7898540b80 1 -- 172.21.15.87:0/1588101204 shutdown_connections 2024-05-08T05:31:14.760 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:14.757+0000 7f7898540b80 1 -- 172.21.15.87:0/1588101204 wait complete. 2024-05-08T05:31:14.760 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:14.757+0000 7f7898540b80 20 client.15249 trim_cache size 0 max 16384 2024-05-08T05:31:14.760 INFO:teuthology.orchestra.run.smithi087.stdout:[] 2024-05-08T05:31:14.761 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:14.758+0000 7f788dc00700 1 -- 172.21.15.87:0/4190434435 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f786c0b2900 msgr2=0x7f786c0b4dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:31:14.761 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:14.758+0000 7f788dc00700 1 --2- 172.21.15.87:0/4190434435 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f786c0b2900 0x7f786c0b4dc0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f78780a5f10 tx=0x7f78780a96b0 comp rx=0 tx=0).stop 2024-05-08T05:31:14.761 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:14.758+0000 7f788dc00700 1 -- 172.21.15.87:0/4190434435 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7888103750 msgr2=0x7f788819f770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:31:14.761 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:14.758+0000 7f788dc00700 1 --2- 172.21.15.87:0/4190434435 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7888103750 0x7f788819f770 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f7878006010 tx=0x7f7878005280 comp rx=0 tx=0).stop 2024-05-08T05:31:14.761 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:14.759+0000 7f788dc00700 1 -- 172.21.15.87:0/4190434435 shutdown_connections 2024-05-08T05:31:14.761 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:14.759+0000 7f788dc00700 1 --2- 172.21.15.87:0/4190434435 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f786c0b2900 0x7f786c0b4dc0 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:31:14.761 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:14.759+0000 7f788dc00700 1 --2- 172.21.15.87:0/4190434435 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7888108850 0x7f7888199930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:31:14.761 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:14.759+0000 7f788dc00700 1 --2- 172.21.15.87:0/4190434435 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7888103750 0x7f788819f770 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:31:14.761 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:14.759+0000 7f788dc00700 1 --2- 172.21.15.87:0/4190434435 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7888104100 0x7f788819fcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:31:14.761 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:14.759+0000 7f788dc00700 1 -- 172.21.15.87:0/4190434435 >> 172.21.15.87:0/4190434435 conn(0x7f788807a600 msgr2=0x7f7888101690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:31:14.761 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:14.759+0000 7f788dc00700 1 -- 172.21.15.87:0/4190434435 shutdown_connections 2024-05-08T05:31:14.761 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:14.759+0000 7f788dc00700 1 -- 172.21.15.87:0/4190434435 wait complete. 2024-05-08T05:31:16.458 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:31:16 smithi087 ceph-mon[29523]: pgmap v488: 97 pgs: 97 active+clean; 661 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-05-08T05:31:16.483 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:31:16 smithi090 ceph-mon[34526]: pgmap v488: 97 pgs: 97 active+clean; 661 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-05-08T05:31:16.538 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:31:16 smithi160 ceph-mon[34827]: pgmap v488: 97 pgs: 97 active+clean; 661 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-05-08T05:31:16.599 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-05-08T05:31:16.600 DEBUG:teuthology.orchestra.run.smithi087:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid eeeb813e-0cf9-11ef-bc97-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-05-08T05:31:17.032 INFO:teuthology.orchestra.run.smithi087.stderr:Inferring config /var/lib/ceph/eeeb813e-0cf9-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T05:31:18.208 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:31:18 smithi087 ceph-mon[29523]: pgmap v489: 97 pgs: 97 active+clean; 661 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T05:31:18.483 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:31:18 smithi090 ceph-mon[34526]: pgmap v489: 97 pgs: 97 active+clean; 661 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T05:31:18.538 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:31:18 smithi160 ceph-mon[34827]: pgmap v489: 97 pgs: 97 active+clean; 661 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T05:31:19.429 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:19.203+0000 7f171f600700 1 -- 172.21.15.87:0/2901699534 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1718105690 msgr2=0x7f1718105b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:31:19.430 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:19.203+0000 7f171f600700 1 --2- 172.21.15.87:0/2901699534 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1718105690 0x7f1718105b10 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f1704009990 tx=0x7f1704009ca0 comp rx=0 tx=0).stop 2024-05-08T05:31:19.430 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:19.204+0000 7f171f600700 1 -- 172.21.15.87:0/2901699534 shutdown_connections 2024-05-08T05:31:19.430 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:19.204+0000 7f171f600700 1 --2- 172.21.15.87:0/2901699534 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1718106050 0x7f1718112560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:31:19.430 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:19.204+0000 7f171f600700 1 --2- 172.21.15.87:0/2901699534 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f171810b690 0x7f171810ba70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:31:19.430 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:19.204+0000 7f171f600700 1 --2- 172.21.15.87:0/2901699534 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1718105690 0x7f1718105b10 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:31:19.430 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:19.204+0000 7f171f600700 1 -- 172.21.15.87:0/2901699534 >> 172.21.15.87:0/2901699534 conn(0x7f1718101180 msgr2=0x7f17181035a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:31:19.430 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:19.204+0000 7f171f600700 1 -- 172.21.15.87:0/2901699534 shutdown_connections 2024-05-08T05:31:19.430 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:19.204+0000 7f171f600700 1 -- 172.21.15.87:0/2901699534 wait complete. 2024-05-08T05:31:19.430 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:19.205+0000 7f171f600700 1 Processor -- start 2024-05-08T05:31:19.430 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:19.205+0000 7f171f600700 1 -- start start 2024-05-08T05:31:19.431 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:19.205+0000 7f171f600700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1718105690 0x7f171819bd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:31:19.431 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:19.205+0000 7f171f600700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1718106050 0x7f171819c280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:31:19.431 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:19.205+0000 7f171f600700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f171810b690 0x7f17181a0610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:31:19.431 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:19.205+0000 7f171f600700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f1718115890 con 0x7f1718105690 2024-05-08T05:31:19.431 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:19.205+0000 7f171f600700 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f1718115710 con 0x7f1718106050 2024-05-08T05:31:19.431 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:19.205+0000 7f171f600700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f1718115a10 con 0x7f171810b690 2024-05-08T05:31:19.431 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:19.206+0000 7f171cc00700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1718105690 0x7f171819bd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:31:19.431 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:19.206+0000 7f1717e00700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1718106050 0x7f171819c280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:31:19.431 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:19.206+0000 7f171cc00700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1718105690 0x7f171819bd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:47212/0 (socket says 172.21.15.87:47212) 2024-05-08T05:31:19.431 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:19.206+0000 7f171cc00700 1 -- 172.21.15.87:0/4272610343 learned_addr learned my addr 172.21.15.87:0/4272610343 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T05:31:19.431 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:19.206+0000 7f171d600700 1 --2- 172.21.15.87:0/4272610343 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f171810b690 0x7f17181a0610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:31:19.431 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:19.206+0000 7f1717e00700 1 -- 172.21.15.87:0/4272610343 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f171810b690 msgr2=0x7f17181a0610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:31:19.431 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:19.206+0000 7f1717e00700 1 --2- 172.21.15.87:0/4272610343 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f171810b690 0x7f17181a0610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:31:19.431 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:19.206+0000 7f1717e00700 1 -- 172.21.15.87:0/4272610343 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1718105690 msgr2=0x7f171819bd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:31:19.431 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:19.206+0000 7f1717e00700 1 --2- 172.21.15.87:0/4272610343 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1718105690 0x7f171819bd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:31:19.431 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:19.206+0000 7f1717e00700 1 -- 172.21.15.87:0/4272610343 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f17181a0d50 con 0x7f1718106050 2024-05-08T05:31:19.432 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:19.206+0000 7f171cc00700 1 --2- 172.21.15.87:0/4272610343 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1718105690 0x7f171819bd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T05:31:19.432 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:19.206+0000 7f171d600700 1 --2- 172.21.15.87:0/4272610343 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f171810b690 0x7f17181a0610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T05:31:19.432 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:19.206+0000 7f1717e00700 1 --2- 172.21.15.87:0/4272610343 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1718106050 0x7f171819c280 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f1704006010 tx=0x7f17040057a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:31:19.432 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:19.207+0000 7f1715600700 1 -- 172.21.15.87:0/4272610343 <== mon.2 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1704027070 con 0x7f1718106050 2024-05-08T05:31:19.432 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:19.207+0000 7f171f600700 1 -- 172.21.15.87:0/4272610343 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f17181a0fe0 con 0x7f1718106050 2024-05-08T05:31:19.432 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:19.207+0000 7f1715600700 1 -- 172.21.15.87:0/4272610343 <== mon.2 v2:172.21.15.90:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1704003fe0 con 0x7f1718106050 2024-05-08T05:31:19.432 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:19.207+0000 7f1715600700 1 -- 172.21.15.87:0/4272610343 <== mon.2 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1704022ad0 con 0x7f1718106050 2024-05-08T05:31:19.432 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:19.207+0000 7f171f600700 1 -- 172.21.15.87:0/4272610343 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f17181a88c0 con 0x7f1718106050 2024-05-08T05:31:19.432 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:19.210+0000 7f1715600700 1 -- 172.21.15.87:0/4272610343 <== mon.2 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7f170402a070 con 0x7f1718106050 2024-05-08T05:31:19.432 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:19.211+0000 7f1729f7ab80 1 Processor -- start 2024-05-08T05:31:19.432 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:19.211+0000 7f1729f7ab80 1 -- start start 2024-05-08T05:31:19.432 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:19.211+0000 7f1729f7ab80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55d32f46dc40 0x55d32f46e020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:31:19.432 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:19.211+0000 7f1729f7ab80 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55d32f46e560 0x55d32f468350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:31:19.432 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:19.211+0000 7f1729f7ab80 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55d32f468970 0x55d32f468df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:31:19.432 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:19.211+0000 7f1729f7ab80 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x55d32f3baaa0 con 0x55d32f46e560 2024-05-08T05:31:19.433 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:19.211+0000 7f1729f7ab80 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x55d32f3587e0 con 0x55d32f468970 2024-05-08T05:31:19.433 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:19.211+0000 7f1729f7ab80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x55d32f3b6a60 con 0x55d32f46dc40 2024-05-08T05:31:19.433 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:19.212+0000 7f1715600700 1 --2- 172.21.15.87:0/4272610343 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f17000b2880 0x7f17000b4d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:31:19.433 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:19.212+0000 7f171cc00700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55d32f46e560 0x55d32f468350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:31:19.433 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:19.212+0000 7f171cc00700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55d32f46e560 0x55d32f468350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:47226/0 (socket says 172.21.15.87:47226) 2024-05-08T05:31:19.433 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:19.212+0000 7f171cc00700 1 -- 172.21.15.87:0/1826241032 learned_addr learned my addr 172.21.15.87:0/1826241032 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T05:31:19.433 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:19.212+0000 7f171d600700 1 --2- 172.21.15.87:0/1826241032 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55d32f46dc40 0x55d32f46e020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:31:19.433 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:19.212+0000 7f1715600700 1 -- 172.21.15.87:0/4272610343 <== mon.2 v2:172.21.15.90:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8190+0+0 (secure 0 0 0) 0x7f17040e32d0 con 0x7f1718106050 2024-05-08T05:31:19.433 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:19.212+0000 7f1717e00700 1 --2- 172.21.15.87:0/1826241032 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55d32f468970 0x55d32f468df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:31:19.433 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:19.212+0000 7f171d600700 1 --2- 172.21.15.87:0/4272610343 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f17000b2880 0x7f17000b4d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:31:19.433 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:19.212+0000 7f171cc00700 1 -- 172.21.15.87:0/1826241032 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55d32f46dc40 msgr2=0x55d32f46e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:31:19.433 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:19.212+0000 7f171cc00700 1 --2- 172.21.15.87:0/1826241032 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55d32f46dc40 0x55d32f46e020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:31:19.433 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:19.212+0000 7f171cc00700 1 -- 172.21.15.87:0/1826241032 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55d32f468970 msgr2=0x55d32f468df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:31:19.433 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:19.212+0000 7f171cc00700 1 --2- 172.21.15.87:0/1826241032 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55d32f468970 0x55d32f468df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:31:19.433 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:19.213+0000 7f171cc00700 1 -- 172.21.15.87:0/1826241032 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d32f307950 con 0x55d32f46e560 2024-05-08T05:31:19.433 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:19.213+0000 7f171cc00700 1 --2- 172.21.15.87:0/1826241032 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55d32f46e560 0x55d32f468350 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f170c007850 tx=0x7f170c0092b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b33a97a1ca8a7fdd server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:31:19.434 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:19.213+0000 7f171d600700 1 --2- 172.21.15.87:0/4272610343 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f17000b2880 0x7f17000b4d40 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f1710005950 tx=0x7f17100047c0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:31:19.434 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:19.213+0000 7f170a000700 1 -- 172.21.15.87:0/1826241032 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f170c019020 con 0x55d32f46e560 2024-05-08T05:31:19.434 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:19.213+0000 7f170a000700 1 -- 172.21.15.87:0/1826241032 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f170c015d00 con 0x55d32f46e560 2024-05-08T05:31:19.434 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:19.213+0000 7f170a000700 1 -- 172.21.15.87:0/1826241032 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f170c014d70 con 0x55d32f46e560 2024-05-08T05:31:19.434 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:19.214+0000 7f1729f7ab80 1 -- 172.21.15.87:0/1826241032 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55d32f46e560 msgr2=0x55d32f468350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:31:19.434 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:19.214+0000 7f1729f7ab80 1 --2- 172.21.15.87:0/1826241032 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55d32f46e560 0x55d32f468350 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f170c007850 tx=0x7f170c0092b0 comp rx=0 tx=0).stop 2024-05-08T05:31:19.434 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:19.214+0000 7f1729f7ab80 1 -- 172.21.15.87:0/1826241032 shutdown_connections 2024-05-08T05:31:19.434 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:19.214+0000 7f1729f7ab80 1 --2- 172.21.15.87:0/1826241032 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55d32f468970 0x55d32f468df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:31:19.434 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:19.214+0000 7f1729f7ab80 1 --2- 172.21.15.87:0/1826241032 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55d32f46dc40 0x55d32f46e020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:31:19.434 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:19.214+0000 7f1729f7ab80 1 --2- 172.21.15.87:0/1826241032 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55d32f46e560 0x55d32f468350 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:31:19.434 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:19.214+0000 7f1729f7ab80 1 -- 172.21.15.87:0/1826241032 >> 172.21.15.87:0/1826241032 conn(0x55d32f3e0750 msgr2=0x55d32f462b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:31:19.435 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:19.214+0000 7f1729f7ab80 1 -- 172.21.15.87:0/1826241032 shutdown_connections 2024-05-08T05:31:19.435 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:19.214+0000 7f1729f7ab80 1 -- 172.21.15.87:0/1826241032 wait complete. 2024-05-08T05:31:19.435 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:19.215+0000 7f1729f7ab80 1 -- start start 2024-05-08T05:31:19.435 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:19.215+0000 7f1729f7ab80 1 Processor -- start 2024-05-08T05:31:19.435 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:19.216+0000 7f1729f7ab80 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55d32f468970 0x55d32f474240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:31:19.435 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:19.216+0000 7f1729f7ab80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55d32f46dc40 0x55d32f4715e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:31:19.435 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:19.216+0000 7f1729f7ab80 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55d32f46e560 0x55d32f471b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:31:19.435 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:19.216+0000 7f1729f7ab80 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x55d32f474fa0 con 0x55d32f468970 2024-05-08T05:31:19.435 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:19.216+0000 7f1729f7ab80 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x55d32f320ba0 con 0x55d32f46e560 2024-05-08T05:31:19.435 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:19.216+0000 7f1729f7ab80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x55d32f475120 con 0x55d32f46dc40 2024-05-08T05:31:19.435 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:19.216+0000 7f1729f7ab80 10 client.0 _ll_register_callbacks cb 0x55d32f361cf0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T05:31:19.435 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:19.216+0000 7f171cc00700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55d32f468970 0x55d32f474240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:31:19.435 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:19.216+0000 7f1717e00700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55d32f46dc40 0x55d32f4715e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:31:19.435 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:19.216+0000 7f1717e00700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55d32f46dc40 0x55d32f4715e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.87:39442/0 (socket says 172.21.15.87:39442) 2024-05-08T05:31:19.436 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:19.216+0000 7f1717e00700 1 -- 172.21.15.87:0/1791209172 learned_addr learned my addr 172.21.15.87:0/1791209172 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T05:31:19.436 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:19.216+0000 7f171d600700 1 --2- 172.21.15.87:0/1791209172 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55d32f46e560 0x55d32f471b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:31:19.436 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:19.216+0000 7f171cc00700 1 -- 172.21.15.87:0/1791209172 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55d32f46dc40 msgr2=0x55d32f4715e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:31:19.436 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:19.216+0000 7f171cc00700 1 --2- 172.21.15.87:0/1791209172 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55d32f46dc40 0x55d32f4715e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:31:19.436 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:19.216+0000 7f171cc00700 1 -- 172.21.15.87:0/1791209172 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55d32f46e560 msgr2=0x55d32f471b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:31:19.436 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:19.216+0000 7f171cc00700 1 --2- 172.21.15.87:0/1791209172 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55d32f46e560 0x55d32f471b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:31:19.436 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:19.216+0000 7f171cc00700 1 -- 172.21.15.87:0/1791209172 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d32f3804a0 con 0x55d32f468970 2024-05-08T05:31:19.436 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:19.216+0000 7f1717e00700 1 --2- 172.21.15.87:0/1791209172 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55d32f46dc40 0x55d32f4715e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T05:31:19.436 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:19.217+0000 7f171cc00700 1 --2- 172.21.15.87:0/1791209172 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55d32f468970 0x55d32f474240 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f170c009550 tx=0x7f170c004d00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=88a15f65127899e3 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:31:19.436 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:19.217+0000 7f16fea00700 10 client.0 ms_handle_connect on v2:172.21.15.87:3300/0 2024-05-08T05:31:19.437 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:19.217+0000 7f16fea00700 1 -- 172.21.15.87:0/1791209172 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f170c019070 con 0x55d32f468970 2024-05-08T05:31:19.437 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:19.217+0000 7f16fea00700 1 -- 172.21.15.87:0/1791209172 <== mon.0 v2:172.21.15.87:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8190+0+0 (secure 0 0 0) 0x7f170c015a60 con 0x55d32f468970 2024-05-08T05:31:19.437 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:19.217+0000 7f1729f7ab80 1 -- 172.21.15.87:0/1791209172 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f170c015d00 con 0x55d32f468970 2024-05-08T05:31:19.437 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:19.217+0000 7f16fea00700 1 -- 172.21.15.87:0/1791209172 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f170c02d070 con 0x55d32f468970 2024-05-08T05:31:19.437 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:19.217+0000 7f1729f7ab80 10 client.15261 fetch_fsmap learned FSMap version 25 2024-05-08T05:31:19.437 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:19.217+0000 7f1729f7ab80 1 -- 172.21.15.87:0/1791209172 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55d32f47f800 con 0x55d32f468970 2024-05-08T05:31:19.437 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:19.218+0000 7f16fea00700 1 -- 172.21.15.87:0/1791209172 <== mon.0 v2:172.21.15.87:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f170c015d00 con 0x55d32f468970 2024-05-08T05:31:19.437 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:19.218+0000 7f16fea00700 1 -- 172.21.15.87:0/1791209172 <== mon.0 v2:172.21.15.87:3300/0 5 ==== fsmap(e 25) ==== 8338+0+0 (secure 0 0 0) 0x7f170c005500 con 0x55d32f468970 2024-05-08T05:31:19.437 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:19.218+0000 7f1729f7ab80 10 client.15261 fetch_fsmap finished waiting for FSMap version 25 2024-05-08T05:31:19.437 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:19.218+0000 7f1729f7ab80 10 client.15261 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-05-08T05:31:19.437 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:19.218+0000 7f1729f7ab80 20 client.15261 populate_metadata read hostname 'smithi087' 2024-05-08T05:31:19.437 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:19.218+0000 7f1729f7ab80 1 --2- 172.21.15.87:0/1791209172 >> [v2:172.21.15.90:6838/160586017,v1:172.21.15.90:6839/160586017] conn(0x55d32f481e80 0x55d32f4842f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:31:19.437 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:19.218+0000 7f1729f7ab80 4 client.15261 mds_command: new command op to 24500 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-08T05:31:19.437 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:19.218+0000 7f1729f7ab80 1 -- 172.21.15.87:0/1791209172 --> [v2:172.21.15.90:6838/160586017,v1:172.21.15.90:6839/160586017] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d32f4351c0 con 0x55d32f481e80 2024-05-08T05:31:19.438 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:19.218+0000 7f1717e00700 1 --2- 172.21.15.87:0/1791209172 >> [v2:172.21.15.90:6838/160586017,v1:172.21.15.90:6839/160586017] conn(0x55d32f481e80 0x55d32f4842f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:31:19.438 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:19.219+0000 7f16fea00700 10 client.15261 ms_handle_connect on v2:172.21.15.90:6838/160586017 2024-05-08T05:31:19.438 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:19.219+0000 7f1717e00700 1 --2- 172.21.15.87:0/1791209172 >> [v2:172.21.15.90:6838/160586017,v1:172.21.15.90:6839/160586017] conn(0x55d32f481e80 0x55d32f4842f0 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1f6c9e9daa91da9 server_cookie=b83f7c34beebd081 in_seq=0 out_seq=0 2024-05-08T05:31:19.438 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:19.220+0000 7f16fea00700 1 -- 172.21.15.87:0/1791209172 <== mds.0 v2:172.21.15.90:6838/160586017 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55d32f4351c0 con 0x55d32f481e80 2024-05-08T05:31:19.438 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:19.220+0000 7f16fea00700 10 client.15261 handle_command_reply: tid=0 2024-05-08T05:31:19.438 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:19.220+0000 7f1729f7ab80 1 client.15261 shutdown 2024-05-08T05:31:19.438 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:19.220+0000 7f1729f7ab80 1 -- 172.21.15.87:0/1791209172 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55d32f468970 msgr2=0x55d32f474240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:31:19.438 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:19.220+0000 7f1729f7ab80 1 --2- 172.21.15.87:0/1791209172 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55d32f468970 0x55d32f474240 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f170c009550 tx=0x7f170c004d00 comp rx=0 tx=0).stop 2024-05-08T05:31:19.438 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:19.220+0000 7f1729f7ab80 1 -- 172.21.15.87:0/1791209172 shutdown_connections 2024-05-08T05:31:19.438 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:19.220+0000 7f1729f7ab80 1 --2- 172.21.15.87:0/1791209172 >> [v2:172.21.15.90:6838/160586017,v1:172.21.15.90:6839/160586017] conn(0x55d32f481e80 0x55d32f4842f0 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:31:19.438 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:19.220+0000 7f1729f7ab80 1 --2- 172.21.15.87:0/1791209172 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55d32f46e560 0x55d32f471b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:31:19.438 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:19.220+0000 7f1729f7ab80 1 --2- 172.21.15.87:0/1791209172 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55d32f468970 0x55d32f474240 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:31:19.438 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:19.220+0000 7f1729f7ab80 1 --2- 172.21.15.87:0/1791209172 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55d32f46dc40 0x55d32f4715e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:31:19.439 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:19.220+0000 7f1729f7ab80 1 -- 172.21.15.87:0/1791209172 >> 172.21.15.87:0/1791209172 conn(0x55d32f3e0750 msgr2=0x55d32f462210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:31:19.439 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:19.220+0000 7f16fea00700 0 client.15261 ms_handle_reset on v2:172.21.15.90:6838/160586017 2024-05-08T05:31:19.439 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:19.220+0000 7f1729f7ab80 1 -- 172.21.15.87:0/1791209172 shutdown_connections 2024-05-08T05:31:19.439 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:19.220+0000 7f1729f7ab80 1 -- 172.21.15.87:0/1791209172 wait complete. 2024-05-08T05:31:19.439 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:19.220+0000 7f1729f7ab80 20 client.15261 trim_cache size 0 max 16384 2024-05-08T05:31:19.439 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:19.242+0000 7f1729f7ab80 1 Processor -- start 2024-05-08T05:31:19.439 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:19.242+0000 7f1729f7ab80 1 -- start start 2024-05-08T05:31:19.439 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:19.243+0000 7f1729f7ab80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55d32f468970 0x55d32f468350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:31:19.439 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:19.243+0000 7f1729f7ab80 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55d32f46dc40 0x55d32f46cff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:31:19.439 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:19.243+0000 7f1729f7ab80 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55d32f46e560 0x55d32f462990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:31:19.439 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:19.243+0000 7f1729f7ab80 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f17181b2490 con 0x55d32f46e560 2024-05-08T05:31:19.439 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:19.243+0000 7f1729f7ab80 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f17181afd20 con 0x55d32f46dc40 2024-05-08T05:31:19.439 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:19.243+0000 7f1729f7ab80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f17181adb90 con 0x55d32f468970 2024-05-08T05:31:19.439 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:19.243+0000 7f171d600700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55d32f46e560 0x55d32f462990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:31:19.440 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:19.243+0000 7f171cc00700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55d32f468970 0x55d32f468350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:31:19.440 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:19.243+0000 7f171d600700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55d32f46e560 0x55d32f462990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:47244/0 (socket says 172.21.15.87:47244) 2024-05-08T05:31:19.440 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:19.243+0000 7f1717e00700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55d32f46dc40 0x55d32f46cff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:31:19.440 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:19.243+0000 7f171d600700 1 -- 172.21.15.87:0/715841004 learned_addr learned my addr 172.21.15.87:0/715841004 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T05:31:19.440 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:19.243+0000 7f171cc00700 1 -- 172.21.15.87:0/715841004 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55d32f46dc40 msgr2=0x55d32f46cff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:31:19.440 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:19.243+0000 7f171cc00700 1 --2- 172.21.15.87:0/715841004 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55d32f46dc40 0x55d32f46cff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:31:19.440 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:19.243+0000 7f171cc00700 1 -- 172.21.15.87:0/715841004 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55d32f46e560 msgr2=0x55d32f462990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:31:19.440 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:19.243+0000 7f171cc00700 1 --2- 172.21.15.87:0/715841004 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55d32f46e560 0x55d32f462990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:31:19.440 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:19.243+0000 7f171cc00700 1 -- 172.21.15.87:0/715841004 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d32f4705a0 con 0x55d32f468970 2024-05-08T05:31:19.440 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:19.244+0000 7f171cc00700 1 --2- 172.21.15.87:0/715841004 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55d32f468970 0x55d32f468350 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f170c005920 tx=0x7f170c004a10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=31af249a7c5c5a6c server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:31:19.440 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:19.244+0000 7f1709600700 1 -- 172.21.15.87:0/715841004 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f170c019040 con 0x55d32f468970 2024-05-08T05:31:19.440 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:19.244+0000 7f1709600700 1 -- 172.21.15.87:0/715841004 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f170c005c60 con 0x55d32f468970 2024-05-08T05:31:19.440 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:19.244+0000 7f1709600700 1 -- 172.21.15.87:0/715841004 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f170c01ece0 con 0x55d32f468970 2024-05-08T05:31:19.441 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:19.245+0000 7f1729f7ab80 1 -- 172.21.15.87:0/715841004 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55d32f468970 msgr2=0x55d32f468350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:31:19.441 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:19.245+0000 7f1729f7ab80 1 --2- 172.21.15.87:0/715841004 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55d32f468970 0x55d32f468350 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f170c005920 tx=0x7f170c004a10 comp rx=0 tx=0).stop 2024-05-08T05:31:19.441 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:19.245+0000 7f1729f7ab80 1 -- 172.21.15.87:0/715841004 shutdown_connections 2024-05-08T05:31:19.441 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:19.245+0000 7f1729f7ab80 1 --2- 172.21.15.87:0/715841004 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55d32f46e560 0x55d32f462990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:31:19.441 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:19.245+0000 7f1729f7ab80 1 --2- 172.21.15.87:0/715841004 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55d32f468970 0x55d32f468350 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:31:19.441 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:19.245+0000 7f1729f7ab80 1 --2- 172.21.15.87:0/715841004 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55d32f46dc40 0x55d32f46cff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:31:19.441 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:19.245+0000 7f1729f7ab80 1 -- 172.21.15.87:0/715841004 >> 172.21.15.87:0/715841004 conn(0x55d32f3e0750 msgr2=0x55d32f46efb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:31:19.441 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:19.245+0000 7f1729f7ab80 1 -- 172.21.15.87:0/715841004 shutdown_connections 2024-05-08T05:31:19.441 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:19.245+0000 7f1729f7ab80 1 -- 172.21.15.87:0/715841004 wait complete. 2024-05-08T05:31:19.441 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:19.245+0000 7f1729f7ab80 1 -- start start 2024-05-08T05:31:19.441 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:19.246+0000 7f1729f7ab80 1 Processor -- start 2024-05-08T05:31:19.441 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:19.246+0000 7f1729f7ab80 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55d32f468970 0x55d32f4875e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:31:19.441 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:19.246+0000 7f1729f7ab80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55d32f46dc40 0x55d32f487b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:31:19.441 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:19.246+0000 7f1729f7ab80 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55d32f46e560 0x55d32f488060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:31:19.442 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:19.246+0000 7f1729f7ab80 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f17181ae1e0 con 0x55d32f468970 2024-05-08T05:31:19.442 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:19.246+0000 7f1729f7ab80 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f17181af650 con 0x55d32f46e560 2024-05-08T05:31:19.442 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:19.246+0000 7f1729f7ab80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f17181ae8b0 con 0x55d32f46dc40 2024-05-08T05:31:19.442 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:19.246+0000 7f1729f7ab80 10 client.0 _ll_register_callbacks cb 0x55d32f361cf0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T05:31:19.442 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:19.246+0000 7f171cc00700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55d32f468970 0x55d32f4875e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:31:19.442 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:19.246+0000 7f171d600700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55d32f46e560 0x55d32f488060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:31:19.442 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:19.246+0000 7f171d600700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55d32f46e560 0x55d32f488060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.87:35348/0 (socket says 172.21.15.87:35348) 2024-05-08T05:31:19.442 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:19.246+0000 7f171d600700 1 -- 172.21.15.87:0/2006188108 learned_addr learned my addr 172.21.15.87:0/2006188108 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T05:31:19.442 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:19.247+0000 7f1717e00700 1 --2- 172.21.15.87:0/2006188108 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55d32f46dc40 0x55d32f487b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:31:19.442 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:19.247+0000 7f1717e00700 1 -- 172.21.15.87:0/2006188108 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55d32f46e560 msgr2=0x55d32f488060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:31:19.442 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:19.247+0000 7f1717e00700 1 --2- 172.21.15.87:0/2006188108 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55d32f46e560 0x55d32f488060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:31:19.442 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:19.247+0000 7f1717e00700 1 -- 172.21.15.87:0/2006188108 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55d32f468970 msgr2=0x55d32f4875e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:31:19.442 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:19.247+0000 7f1717e00700 1 --2- 172.21.15.87:0/2006188108 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55d32f468970 0x55d32f4875e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:31:19.443 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:19.247+0000 7f1717e00700 1 -- 172.21.15.87:0/2006188108 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d32f4eb630 con 0x55d32f46dc40 2024-05-08T05:31:19.443 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:19.247+0000 7f171cc00700 1 --2- 172.21.15.87:0/2006188108 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55d32f468970 0x55d32f4875e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T05:31:19.443 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:19.247+0000 7f1717e00700 1 --2- 172.21.15.87:0/2006188108 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55d32f46dc40 0x55d32f487b20 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f17040aa650 tx=0x7f1704092040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=acccacc02f92edf0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:31:19.443 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:19.247+0000 7f16fea00700 10 client.0 ms_handle_connect on v2:172.21.15.160:3300/0 2024-05-08T05:31:19.443 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:19.247+0000 7f16fea00700 1 -- 172.21.15.87:0/2006188108 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f170408f070 con 0x55d32f46dc40 2024-05-08T05:31:19.443 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:19.247+0000 7f1729f7ab80 1 -- 172.21.15.87:0/2006188108 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f170c005c60 con 0x55d32f46dc40 2024-05-08T05:31:19.443 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:19.247+0000 7f16fea00700 1 -- 172.21.15.87:0/2006188108 <== mon.1 v2:172.21.15.160:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8190+0+0 (secure 0 0 0) 0x7f17040aadb0 con 0x55d32f46dc40 2024-05-08T05:31:19.443 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:19.248+0000 7f16fea00700 1 -- 172.21.15.87:0/2006188108 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f17040a60e0 con 0x55d32f46dc40 2024-05-08T05:31:19.443 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:19.248+0000 7f1729f7ab80 10 client.25378 fetch_fsmap learned FSMap version 25 2024-05-08T05:31:19.443 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:19.248+0000 7f1729f7ab80 1 -- 172.21.15.87:0/2006188108 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55d32f4ec9e0 con 0x55d32f46dc40 2024-05-08T05:31:19.443 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:19.248+0000 7f16fea00700 1 -- 172.21.15.87:0/2006188108 <== mon.1 v2:172.21.15.160:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f170c005c60 con 0x55d32f46dc40 2024-05-08T05:31:19.443 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:19.248+0000 7f16fea00700 1 -- 172.21.15.87:0/2006188108 <== mon.1 v2:172.21.15.160:3300/0 5 ==== fsmap(e 25) ==== 8338+0+0 (secure 0 0 0) 0x7f1704070240 con 0x55d32f46dc40 2024-05-08T05:31:19.443 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:19.248+0000 7f1729f7ab80 10 client.25378 fetch_fsmap finished waiting for FSMap version 25 2024-05-08T05:31:19.444 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:19.248+0000 7f1729f7ab80 10 client.25378 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-05-08T05:31:19.444 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:19.248+0000 7f1729f7ab80 20 client.25378 populate_metadata read hostname 'smithi087' 2024-05-08T05:31:19.444 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:19.248+0000 7f1729f7ab80 1 --2- 172.21.15.87:0/2006188108 >> [v2:172.21.15.90:6838/160586017,v1:172.21.15.90:6839/160586017] conn(0x55d32f4ed140 0x55d32f4ef560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:31:19.444 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:19.248+0000 7f1729f7ab80 4 client.25378 mds_command: new command op to 24500 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-05-08T05:31:19.444 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:19.248+0000 7f1729f7ab80 1 -- 172.21.15.87:0/2006188108 --> [v2:172.21.15.90:6838/160586017,v1:172.21.15.90:6839/160586017] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x55d32f3c8480 con 0x55d32f4ed140 2024-05-08T05:31:19.444 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:19.249+0000 7f171cc00700 1 --2- 172.21.15.87:0/2006188108 >> [v2:172.21.15.90:6838/160586017,v1:172.21.15.90:6839/160586017] conn(0x55d32f4ed140 0x55d32f4ef560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:31:19.444 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:19.249+0000 7f171cc00700 1 --2- 172.21.15.87:0/2006188108 >> [v2:172.21.15.90:6838/160586017,v1:172.21.15.90:6839/160586017] conn(0x55d32f4ed140 0x55d32f4ef560 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5e86fd9ce6ce0df1 server_cookie=4d3d990b592075a7 in_seq=0 out_seq=0 2024-05-08T05:31:19.444 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:19.249+0000 7f16fea00700 10 client.25378 ms_handle_connect on v2:172.21.15.90:6838/160586017 2024-05-08T05:31:19.444 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:19.250+0000 7f16fea00700 1 -- 172.21.15.87:0/2006188108 <== mds.0 v2:172.21.15.90:6838/160586017 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55d32f3c8480 con 0x55d32f4ed140 2024-05-08T05:31:19.444 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:19.250+0000 7f16fea00700 10 client.25378 handle_command_reply: tid=0 2024-05-08T05:31:19.444 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:19.250+0000 7f1729f7ab80 1 client.25378 shutdown 2024-05-08T05:31:19.445 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-05-08T05:31:19.445 INFO:teuthology.orchestra.run.smithi087.stdout: "return_code": 0, 2024-05-08T05:31:19.445 INFO:teuthology.orchestra.run.smithi087.stdout: "scrub_tag": "511c9a78-4ff4-47dc-912c-f45aea636ef7", 2024-05-08T05:31:19.445 INFO:teuthology.orchestra.run.smithi087.stdout: "mode": "asynchronous" 2024-05-08T05:31:19.445 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-05-08T05:31:19.445 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:19.250+0000 7f1729f7ab80 1 -- 172.21.15.87:0/2006188108 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55d32f46dc40 msgr2=0x55d32f487b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:31:19.445 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:19.250+0000 7f1729f7ab80 1 --2- 172.21.15.87:0/2006188108 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55d32f46dc40 0x55d32f487b20 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f17040aa650 tx=0x7f1704092040 comp rx=0 tx=0).stop 2024-05-08T05:31:19.446 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:19.250+0000 7f1729f7ab80 1 -- 172.21.15.87:0/2006188108 shutdown_connections 2024-05-08T05:31:19.446 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:19.250+0000 7f1729f7ab80 1 --2- 172.21.15.87:0/2006188108 >> [v2:172.21.15.90:6838/160586017,v1:172.21.15.90:6839/160586017] conn(0x55d32f4ed140 0x55d32f4ef560 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:31:19.446 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:19.250+0000 7f1729f7ab80 1 --2- 172.21.15.87:0/2006188108 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55d32f46e560 0x55d32f488060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:31:19.446 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:19.250+0000 7f1729f7ab80 1 --2- 172.21.15.87:0/2006188108 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55d32f468970 0x55d32f4875e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:31:19.446 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:19.250+0000 7f16fea00700 0 client.25378 ms_handle_reset on v2:172.21.15.90:6838/160586017 2024-05-08T05:31:19.446 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:19.250+0000 7f1729f7ab80 1 --2- 172.21.15.87:0/2006188108 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55d32f46dc40 0x55d32f487b20 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:31:19.446 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:19.250+0000 7f1729f7ab80 1 -- 172.21.15.87:0/2006188108 >> 172.21.15.87:0/2006188108 conn(0x55d32f3e0750 msgr2=0x55d32f46cff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:31:19.446 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:19.251+0000 7f1729f7ab80 1 -- 172.21.15.87:0/2006188108 shutdown_connections 2024-05-08T05:31:19.446 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:19.251+0000 7f1729f7ab80 1 -- 172.21.15.87:0/2006188108 wait complete. 2024-05-08T05:31:19.446 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:19.251+0000 7f1729f7ab80 20 client.25378 trim_cache size 0 max 16384 2024-05-08T05:31:19.446 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:19.251+0000 7f171f600700 1 -- 172.21.15.87:0/4272610343 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f17000b2880 msgr2=0x7f17000b4d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:31:19.446 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:19.251+0000 7f171f600700 1 --2- 172.21.15.87:0/4272610343 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f17000b2880 0x7f17000b4d40 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f1710005950 tx=0x7f17100047c0 comp rx=0 tx=0).stop 2024-05-08T05:31:19.447 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:19.251+0000 7f171f600700 1 -- 172.21.15.87:0/4272610343 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1718106050 msgr2=0x7f171819c280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:31:19.447 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:19.251+0000 7f171f600700 1 --2- 172.21.15.87:0/4272610343 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1718106050 0x7f171819c280 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f1704006010 tx=0x7f17040057a0 comp rx=0 tx=0).stop 2024-05-08T05:31:19.447 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:19.252+0000 7f171f600700 1 -- 172.21.15.87:0/4272610343 shutdown_connections 2024-05-08T05:31:19.447 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:19.252+0000 7f171f600700 1 --2- 172.21.15.87:0/4272610343 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f17000b2880 0x7f17000b4d40 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:31:19.447 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:19.252+0000 7f171f600700 1 --2- 172.21.15.87:0/4272610343 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f171810b690 0x7f17181a0610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:31:19.447 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:19.252+0000 7f171f600700 1 --2- 172.21.15.87:0/4272610343 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1718105690 0x7f171819bd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:31:19.447 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:19.252+0000 7f171f600700 1 --2- 172.21.15.87:0/4272610343 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1718106050 0x7f171819c280 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:31:19.447 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:19.252+0000 7f171f600700 1 -- 172.21.15.87:0/4272610343 >> 172.21.15.87:0/4272610343 conn(0x7f1718101180 msgr2=0x7f1718101810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:31:19.447 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:19.252+0000 7f171f600700 1 -- 172.21.15.87:0/4272610343 shutdown_connections 2024-05-08T05:31:19.447 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:19.252+0000 7f171f600700 1 -- 172.21.15.87:0/4272610343 wait complete. 2024-05-08T05:31:20.423 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:31:20 smithi087 ceph-mon[29523]: pgmap v490: 97 pgs: 97 active+clean; 661 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-05-08T05:31:20.423 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:31:20 smithi087 ceph-mon[29523]: scrub queued for path: / 2024-05-08T05:31:20.423 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:31:20 smithi087 ceph-mon[29523]: scrub summary: idle+waiting paths [/] 2024-05-08T05:31:20.423 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:31:20 smithi087 ceph-mon[29523]: scrub summary: active paths [/] 2024-05-08T05:31:20.423 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:31:20 smithi087 ceph-mon[29523]: scrub summary: idle+waiting paths [/] 2024-05-08T05:31:20.425 DEBUG:teuthology.orchestra.run.smithi087:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid eeeb813e-0cf9-11ef-bc97-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-05-08T05:31:20.483 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:31:20 smithi090 ceph-mon[34526]: pgmap v490: 97 pgs: 97 active+clean; 661 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-05-08T05:31:20.483 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:31:20 smithi090 ceph-mon[34526]: scrub queued for path: / 2024-05-08T05:31:20.483 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:31:20 smithi090 ceph-mon[34526]: scrub summary: idle+waiting paths [/] 2024-05-08T05:31:20.483 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:31:20 smithi090 ceph-mon[34526]: scrub summary: active paths [/] 2024-05-08T05:31:20.483 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:31:20 smithi090 ceph-mon[34526]: scrub summary: idle+waiting paths [/] 2024-05-08T05:31:20.538 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:31:20 smithi160 ceph-mon[34827]: pgmap v490: 97 pgs: 97 active+clean; 661 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-05-08T05:31:20.539 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:31:20 smithi160 ceph-mon[34827]: scrub queued for path: / 2024-05-08T05:31:20.539 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:31:20 smithi160 ceph-mon[34827]: scrub summary: idle+waiting paths [/] 2024-05-08T05:31:20.539 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:31:20 smithi160 ceph-mon[34827]: scrub summary: active paths [/] 2024-05-08T05:31:20.539 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:31:20 smithi160 ceph-mon[34827]: scrub summary: idle+waiting paths [/] 2024-05-08T05:31:20.858 INFO:teuthology.orchestra.run.smithi087.stderr:Inferring config /var/lib/ceph/eeeb813e-0cf9-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T05:31:22.208 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:31:22 smithi087 ceph-mon[29523]: pgmap v491: 97 pgs: 97 active+clean; 661 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T05:31:22.483 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:31:22 smithi090 ceph-mon[34526]: pgmap v491: 97 pgs: 97 active+clean; 661 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T05:31:22.538 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:31:22 smithi160 ceph-mon[34827]: pgmap v491: 97 pgs: 97 active+clean; 661 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T05:31:22.641 INFO:tasks.workunit.client.0.smithi087.stderr:Updating files: 58% (7187/12271) Updating files: 59% (7240/12271) Updating files: 60% (7363/12271) Updating files: 61% (7486/12271) Updating files: 62% (7609/12271) Updating files: 63% (7731/12271) Updating files: 64% (7854/12271) Updating files: 65% (7977/12271) Updating files: 66% (8099/12271) Updating files: 67% (8222/12271) Updating files: 68% (8345/12271) Updating files: 69% (8467/12271) Updating files: 70% (8590/12271) Updating files: 71% (8713/12271) Updating files: 72% (8836/12271) Updating files: 73% (8958/12271) Updating files: 74% (9081/12271) Updating files: 75% (9204/12271) Updating files: 76% (9326/12271) Updating files: 77% (9449/12271) Updating files: 78% (9572/12271) Updating files: 79% (9695/12271) Updating files: 80% (9817/12271) Updating files: 81% (9940/12271) Updating files: 82% (10063/12271) Updating files: 83% (10185/12271) Updating files: 84% (10308/12271) Updating files: 85% (10431/12271) Updating files: 86% (10554/12271) Updating files: 87% (10676/12271) Updating files: 88% (10799/12271) Updating files: 89% (10922/12271) Updating files: 90% (11044/12271) Updating files: 91% (11167/12271) Updating files: 92% (11290/12271) Updating files: 93% (11413/12271) Updating files: 94% (11535/12271) Updating files: 95% (11658/12271) Updating files: 96% (11781/12271) Updating files: 96% (11862/12271) Updating files: 97% (11903/12271) Updating files: 98% (12026/12271) Updating files: 99% (12149/12271) Updating files: 100% (12271/12271) Updating files: 100% (12271/12271), done. 2024-05-08T05:31:23.197 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:23.196+0000 7f5b23200700 1 -- 172.21.15.87:0/3933943002 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5b24102180 msgr2=0x7f5b24102560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:31:23.197 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:23.196+0000 7f5b23200700 1 --2- 172.21.15.87:0/3933943002 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5b24102180 0x7f5b24102560 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f5b140098f0 tx=0x7f5b14009c00 comp rx=0 tx=0).stop 2024-05-08T05:31:23.197 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:23.196+0000 7f5b23200700 1 -- 172.21.15.87:0/3933943002 shutdown_connections 2024-05-08T05:31:23.197 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:23.196+0000 7f5b23200700 1 --2- 172.21.15.87:0/3933943002 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5b2410fd30 0x7f5b24112120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:31:23.197 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:23.196+0000 7f5b23200700 1 --2- 172.21.15.87:0/3933943002 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5b24102180 0x7f5b24102560 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:31:23.197 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:23.196+0000 7f5b23200700 1 --2- 172.21.15.87:0/3933943002 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5b24102b30 0x7f5b2410f7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:31:23.197 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:23.196+0000 7f5b23200700 1 -- 172.21.15.87:0/3933943002 >> 172.21.15.87:0/3933943002 conn(0x7f5b240fddc0 msgr2=0x7f5b241001e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:31:23.197 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:23.196+0000 7f5b23200700 1 -- 172.21.15.87:0/3933943002 shutdown_connections 2024-05-08T05:31:23.197 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:23.196+0000 7f5b23200700 1 -- 172.21.15.87:0/3933943002 wait complete. 2024-05-08T05:31:23.198 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:23.197+0000 7f5b23200700 1 Processor -- start 2024-05-08T05:31:23.198 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:23.198+0000 7f5b23200700 1 -- start start 2024-05-08T05:31:23.198 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:23.198+0000 7f5b23200700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5b24102180 0x7f5b2419bd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:31:23.199 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:23.198+0000 7f5b23200700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5b24102b30 0x7f5b2419c2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:31:23.199 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:23.198+0000 7f5b23200700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5b2410fd30 0x7f5b241a05f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:31:23.199 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:23.198+0000 7f5b23200700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f5b241157e0 con 0x7f5b24102180 2024-05-08T05:31:23.199 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:23.198+0000 7f5b23200700 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f5b24115660 con 0x7f5b2410fd30 2024-05-08T05:31:23.199 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:23.198+0000 7f5b23200700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f5b24115960 con 0x7f5b24102b30 2024-05-08T05:31:23.200 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:23.198+0000 7f5b21e00700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5b24102180 0x7f5b2419bd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:31:23.200 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:23.198+0000 7f5b21e00700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5b24102180 0x7f5b2419bd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:47282/0 (socket says 172.21.15.87:47282) 2024-05-08T05:31:23.200 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:23.198+0000 7f5b21e00700 1 -- 172.21.15.87:0/2649713484 learned_addr learned my addr 172.21.15.87:0/2649713484 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T05:31:23.200 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:23.198+0000 7f5b22800700 1 --2- 172.21.15.87:0/2649713484 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5b2410fd30 0x7f5b241a05f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:31:23.200 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:23.199+0000 7f5b21400700 1 --2- 172.21.15.87:0/2649713484 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5b24102b30 0x7f5b2419c2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:31:23.200 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:23.199+0000 7f5b22800700 1 -- 172.21.15.87:0/2649713484 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5b24102b30 msgr2=0x7f5b2419c2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:31:23.200 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:23.199+0000 7f5b22800700 1 --2- 172.21.15.87:0/2649713484 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5b24102b30 0x7f5b2419c2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:31:23.200 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:23.199+0000 7f5b22800700 1 -- 172.21.15.87:0/2649713484 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5b24102180 msgr2=0x7f5b2419bd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:31:23.200 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:23.199+0000 7f5b22800700 1 --2- 172.21.15.87:0/2649713484 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5b24102180 0x7f5b2419bd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:31:23.200 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:23.199+0000 7f5b22800700 1 -- 172.21.15.87:0/2649713484 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5b241a0d30 con 0x7f5b2410fd30 2024-05-08T05:31:23.200 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:23.199+0000 7f5b21e00700 1 --2- 172.21.15.87:0/2649713484 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5b24102180 0x7f5b2419bd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T05:31:23.200 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:23.199+0000 7f5b22800700 1 --2- 172.21.15.87:0/2649713484 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5b2410fd30 0x7f5b241a05f0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f5b1c00ef90 tx=0x7f5b1c00c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:31:23.201 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:23.199+0000 7f5b1aa00700 1 -- 172.21.15.87:0/2649713484 <== mon.2 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b1c0092e0 con 0x7f5b2410fd30 2024-05-08T05:31:23.201 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:23.200+0000 7f5b1aa00700 1 -- 172.21.15.87:0/2649713484 <== mon.2 v2:172.21.15.90:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5b1c004bb0 con 0x7f5b2410fd30 2024-05-08T05:31:23.201 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:23.200+0000 7f5b23200700 1 -- 172.21.15.87:0/2649713484 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5b241a0fc0 con 0x7f5b2410fd30 2024-05-08T05:31:23.201 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:23.200+0000 7f5b1aa00700 1 -- 172.21.15.87:0/2649713484 <== mon.2 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b1c004020 con 0x7f5b2410fd30 2024-05-08T05:31:23.201 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:23.200+0000 7f5b23200700 1 -- 172.21.15.87:0/2649713484 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5b241a88a0 con 0x7f5b2410fd30 2024-05-08T05:31:23.203 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:23.203+0000 7f5b1aa00700 1 -- 172.21.15.87:0/2649713484 <== mon.2 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7f5b1c01b030 con 0x7f5b2410fd30 2024-05-08T05:31:23.205 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:23.205+0000 7f5b33794b80 1 Processor -- start 2024-05-08T05:31:23.205 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:23.205+0000 7f5b33794b80 1 -- start start 2024-05-08T05:31:23.205 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:23.205+0000 7f5b1aa00700 1 --2- 172.21.15.87:0/2649713484 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f5b080b2900 0x7f5b080b4dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:31:23.206 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:23.206+0000 7f5b1aa00700 1 -- 172.21.15.87:0/2649713484 <== mon.2 v2:172.21.15.90:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8190+0+0 (secure 0 0 0) 0x7f5b1c0e1c90 con 0x7f5b2410fd30 2024-05-08T05:31:23.207 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:23.206+0000 7f5b33794b80 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55bb0d35d9e0 0x55bb0d35ddc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:31:23.207 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:23.206+0000 7f5b21400700 1 --2- 172.21.15.87:0/2649713484 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f5b080b2900 0x7f5b080b4dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:31:23.207 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:23.206+0000 7f5b33794b80 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55bb0d35e300 0x55bb0d357fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:31:23.207 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:23.206+0000 7f5b33794b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55bb0d358600 0x55bb0d358a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:31:23.207 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:23.206+0000 7f5b33794b80 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x55bb0d2aaa20 con 0x55bb0d35e300 2024-05-08T05:31:23.207 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:23.206+0000 7f5b33794b80 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x55bb0d248760 con 0x55bb0d35d9e0 2024-05-08T05:31:23.207 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:23.206+0000 7f5b33794b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x55bb0d2a69e0 con 0x55bb0d358600 2024-05-08T05:31:23.207 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:23.206+0000 7f5b21e00700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55bb0d35d9e0 0x55bb0d35ddc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:31:23.207 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:23.206+0000 7f5b21400700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55bb0d35e300 0x55bb0d357fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:31:23.207 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:23.206+0000 7f5b21e00700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55bb0d35d9e0 0x55bb0d35ddc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.87:35368/0 (socket says 172.21.15.87:35368) 2024-05-08T05:31:23.207 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:23.206+0000 7f5b21e00700 1 -- 172.21.15.87:0/1566310129 learned_addr learned my addr 172.21.15.87:0/1566310129 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T05:31:23.207 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:23.206+0000 7f5b22800700 1 --2- 172.21.15.87:0/1566310129 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55bb0d358600 0x55bb0d358a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:31:23.207 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:23.206+0000 7f5b21e00700 1 -- 172.21.15.87:0/1566310129 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55bb0d358600 msgr2=0x55bb0d358a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:31:23.207 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:23.206+0000 7f5b21e00700 1 --2- 172.21.15.87:0/1566310129 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55bb0d358600 0x55bb0d358a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:31:23.207 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:23.206+0000 7f5b21e00700 1 -- 172.21.15.87:0/1566310129 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55bb0d35e300 msgr2=0x55bb0d357fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:31:23.208 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:23.207+0000 7f5b21e00700 1 --2- 172.21.15.87:0/1566310129 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55bb0d35e300 0x55bb0d357fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:31:23.208 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:23.207+0000 7f5b21e00700 1 -- 172.21.15.87:0/1566310129 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bb0d1f78d0 con 0x55bb0d35d9e0 2024-05-08T05:31:23.209 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:23.207+0000 7f5b21e00700 1 --2- 172.21.15.87:0/1566310129 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55bb0d35d9e0 0x55bb0d35ddc0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f5b140095f0 tx=0x7f5b14009620 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e7ed282c66202266 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:31:23.209 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:23.207+0000 7f5b21400700 1 --2- 172.21.15.87:0/2649713484 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f5b080b2900 0x7f5b080b4dc0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f5b10009fd0 tx=0x7f5b10009c60 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:31:23.209 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:23.207+0000 7f5b0f400700 1 -- 172.21.15.87:0/1566310129 <== mon.2 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b14028070 con 0x55bb0d35d9e0 2024-05-08T05:31:23.209 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:23.207+0000 7f5b0f400700 1 -- 172.21.15.87:0/1566310129 <== mon.2 v2:172.21.15.90:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5b14005040 con 0x55bb0d35d9e0 2024-05-08T05:31:23.209 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:23.207+0000 7f5b0f400700 1 -- 172.21.15.87:0/1566310129 <== mon.2 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b1400b940 con 0x55bb0d35d9e0 2024-05-08T05:31:23.209 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:23.208+0000 7f5b33794b80 1 -- 172.21.15.87:0/1566310129 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55bb0d35d9e0 msgr2=0x55bb0d35ddc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:31:23.209 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:23.208+0000 7f5b33794b80 1 --2- 172.21.15.87:0/1566310129 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55bb0d35d9e0 0x55bb0d35ddc0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f5b140095f0 tx=0x7f5b14009620 comp rx=0 tx=0).stop 2024-05-08T05:31:23.210 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:23.208+0000 7f5b33794b80 1 -- 172.21.15.87:0/1566310129 shutdown_connections 2024-05-08T05:31:23.210 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:23.208+0000 7f5b33794b80 1 --2- 172.21.15.87:0/1566310129 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55bb0d358600 0x55bb0d358a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:31:23.210 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:23.208+0000 7f5b33794b80 1 --2- 172.21.15.87:0/1566310129 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55bb0d35d9e0 0x55bb0d35ddc0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:31:23.210 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:23.208+0000 7f5b33794b80 1 --2- 172.21.15.87:0/1566310129 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55bb0d35e300 0x55bb0d357fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:31:23.210 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:23.208+0000 7f5b33794b80 1 -- 172.21.15.87:0/1566310129 >> 172.21.15.87:0/1566310129 conn(0x55bb0d286b60 msgr2=0x55bb0d3529b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:31:23.210 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:23.208+0000 7f5b33794b80 1 -- 172.21.15.87:0/1566310129 shutdown_connections 2024-05-08T05:31:23.210 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:23.208+0000 7f5b33794b80 1 -- 172.21.15.87:0/1566310129 wait complete. 2024-05-08T05:31:23.210 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:23.209+0000 7f5b33794b80 1 -- start start 2024-05-08T05:31:23.210 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:23.209+0000 7f5b33794b80 1 Processor -- start 2024-05-08T05:31:23.212 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:23.209+0000 7f5b33794b80 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55bb0d358600 0x55bb0d363e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:31:23.212 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:23.209+0000 7f5b33794b80 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55bb0d35d9e0 0x55bb0d3643d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:31:23.212 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:23.209+0000 7f5b33794b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55bb0d35e300 0x55bb0d361430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:31:23.212 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:23.210+0000 7f5b33794b80 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x55bb0d364d50 con 0x55bb0d35d9e0 2024-05-08T05:31:23.212 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:23.210+0000 7f5b33794b80 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x55bb0d210b20 con 0x55bb0d358600 2024-05-08T05:31:23.212 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:23.210+0000 7f5b33794b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x55bb0d364ed0 con 0x55bb0d35e300 2024-05-08T05:31:23.212 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:23.210+0000 7f5b33794b80 10 client.0 _ll_register_callbacks cb 0x55bb0d251c70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T05:31:23.212 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:23.210+0000 7f5b21400700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55bb0d35d9e0 0x55bb0d3643d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:31:23.212 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:23.210+0000 7f5b21e00700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55bb0d358600 0x55bb0d363e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:31:23.213 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:23.210+0000 7f5b21e00700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55bb0d358600 0x55bb0d363e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.87:35384/0 (socket says 172.21.15.87:35384) 2024-05-08T05:31:23.213 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:23.210+0000 7f5b21e00700 1 -- 172.21.15.87:0/1712785776 learned_addr learned my addr 172.21.15.87:0/1712785776 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T05:31:23.213 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:23.210+0000 7f5b22800700 1 --2- 172.21.15.87:0/1712785776 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55bb0d35e300 0x55bb0d361430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:31:23.213 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:23.210+0000 7f5b22800700 1 -- 172.21.15.87:0/1712785776 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55bb0d358600 msgr2=0x55bb0d363e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:31:23.213 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:23.210+0000 7f5b22800700 1 --2- 172.21.15.87:0/1712785776 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55bb0d358600 0x55bb0d363e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:31:23.213 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:23.210+0000 7f5b22800700 1 -- 172.21.15.87:0/1712785776 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55bb0d35d9e0 msgr2=0x55bb0d3643d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:31:23.213 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:23.210+0000 7f5b22800700 1 --2- 172.21.15.87:0/1712785776 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55bb0d35d9e0 0x55bb0d3643d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:31:23.213 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:23.210+0000 7f5b22800700 1 -- 172.21.15.87:0/1712785776 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bb0d270420 con 0x55bb0d35e300 2024-05-08T05:31:23.213 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:23.210+0000 7f5b21400700 1 --2- 172.21.15.87:0/1712785776 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55bb0d35d9e0 0x55bb0d3643d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T05:31:23.213 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:23.211+0000 7f5b22800700 1 --2- 172.21.15.87:0/1712785776 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55bb0d35e300 0x55bb0d361430 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f5b1c0df760 tx=0x7f5b1c0b1f30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4dd714688f9eb626 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:31:23.213 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:23.211+0000 7f5b03e00700 10 client.0 ms_handle_connect on v2:172.21.15.160:3300/0 2024-05-08T05:31:23.213 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:23.211+0000 7f5b03e00700 1 -- 172.21.15.87:0/1712785776 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b1c0a8e20 con 0x55bb0d35e300 2024-05-08T05:31:23.213 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:23.211+0000 7f5b03e00700 1 -- 172.21.15.87:0/1712785776 <== mon.1 v2:172.21.15.160:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8190+0+0 (secure 0 0 0) 0x7f5b1c0a4e90 con 0x55bb0d35e300 2024-05-08T05:31:23.213 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:23.211+0000 7f5b33794b80 1 -- 172.21.15.87:0/1712785776 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5b14005040 con 0x55bb0d35e300 2024-05-08T05:31:23.214 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:23.211+0000 7f5b03e00700 1 -- 172.21.15.87:0/1712785776 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f5b1c0a9a10 con 0x55bb0d35e300 2024-05-08T05:31:23.214 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:23.211+0000 7f5b33794b80 10 client.25390 fetch_fsmap learned FSMap version 25 2024-05-08T05:31:23.214 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:23.211+0000 7f5b33794b80 1 -- 172.21.15.87:0/1712785776 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55bb0d36f470 con 0x55bb0d35e300 2024-05-08T05:31:23.214 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:23.211+0000 7f5b03e00700 1 -- 172.21.15.87:0/1712785776 <== mon.1 v2:172.21.15.160:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5b14005040 con 0x55bb0d35e300 2024-05-08T05:31:23.214 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:23.212+0000 7f5b03e00700 1 -- 172.21.15.87:0/1712785776 <== mon.1 v2:172.21.15.160:3300/0 5 ==== fsmap(e 25) ==== 8338+0+0 (secure 0 0 0) 0x7f5b1c0c3b70 con 0x55bb0d35e300 2024-05-08T05:31:23.214 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:23.212+0000 7f5b33794b80 10 client.25390 fetch_fsmap finished waiting for FSMap version 25 2024-05-08T05:31:23.214 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:23.212+0000 7f5b33794b80 10 client.25390 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-05-08T05:31:23.214 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:23.212+0000 7f5b33794b80 20 client.25390 populate_metadata read hostname 'smithi087' 2024-05-08T05:31:23.214 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:23.212+0000 7f5b33794b80 1 --2- 172.21.15.87:0/1712785776 >> [v2:172.21.15.90:6838/160586017,v1:172.21.15.90:6839/160586017] conn(0x55bb0d371a00 0x55bb0d373e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:31:23.214 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:23.212+0000 7f5b33794b80 4 client.25390 mds_command: new command op to 24500 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-08T05:31:23.214 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:23.212+0000 7f5b33794b80 1 -- 172.21.15.87:0/1712785776 --> [v2:172.21.15.90:6838/160586017,v1:172.21.15.90:6839/160586017] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55bb0d3250a0 con 0x55bb0d371a00 2024-05-08T05:31:23.216 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:23.212+0000 7f5b21e00700 1 --2- 172.21.15.87:0/1712785776 >> [v2:172.21.15.90:6838/160586017,v1:172.21.15.90:6839/160586017] conn(0x55bb0d371a00 0x55bb0d373e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:31:23.216 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:23.213+0000 7f5b21e00700 1 --2- 172.21.15.87:0/1712785776 >> [v2:172.21.15.90:6838/160586017,v1:172.21.15.90:6839/160586017] conn(0x55bb0d371a00 0x55bb0d373e40 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=176476372b88ec4 server_cookie=e8c45e2444f3634d in_seq=0 out_seq=0 2024-05-08T05:31:23.216 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:23.213+0000 7f5b03e00700 10 client.25390 ms_handle_connect on v2:172.21.15.90:6838/160586017 2024-05-08T05:31:23.216 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:23.214+0000 7f5b03e00700 1 -- 172.21.15.87:0/1712785776 <== mds.0 v2:172.21.15.90:6838/160586017 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55bb0d3250a0 con 0x55bb0d371a00 2024-05-08T05:31:23.216 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:23.214+0000 7f5b03e00700 10 client.25390 handle_command_reply: tid=0 2024-05-08T05:31:23.216 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:23.214+0000 7f5b33794b80 1 client.25390 shutdown 2024-05-08T05:31:23.216 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:23.214+0000 7f5b33794b80 1 -- 172.21.15.87:0/1712785776 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55bb0d35e300 msgr2=0x55bb0d361430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:31:23.216 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:23.214+0000 7f5b33794b80 1 --2- 172.21.15.87:0/1712785776 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55bb0d35e300 0x55bb0d361430 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f5b1c0df760 tx=0x7f5b1c0b1f30 comp rx=0 tx=0).stop 2024-05-08T05:31:23.216 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:23.214+0000 7f5b33794b80 1 -- 172.21.15.87:0/1712785776 shutdown_connections 2024-05-08T05:31:23.216 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:23.214+0000 7f5b33794b80 1 --2- 172.21.15.87:0/1712785776 >> [v2:172.21.15.90:6838/160586017,v1:172.21.15.90:6839/160586017] conn(0x55bb0d371a00 0x55bb0d373e40 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:31:23.216 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:23.214+0000 7f5b33794b80 1 --2- 172.21.15.87:0/1712785776 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55bb0d35e300 0x55bb0d361430 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:31:23.216 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:23.214+0000 7f5b33794b80 1 --2- 172.21.15.87:0/1712785776 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55bb0d358600 0x55bb0d363e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:31:23.216 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:23.214+0000 7f5b33794b80 1 --2- 172.21.15.87:0/1712785776 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55bb0d35d9e0 0x55bb0d3643d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:31:23.216 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:23.214+0000 7f5b33794b80 1 -- 172.21.15.87:0/1712785776 >> 172.21.15.87:0/1712785776 conn(0x55bb0d286b60 msgr2=0x55bb0d34d460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:31:23.217 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:23.214+0000 7f5b03e00700 0 client.25390 ms_handle_reset on v2:172.21.15.90:6838/160586017 2024-05-08T05:31:23.217 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:23.214+0000 7f5b33794b80 1 -- 172.21.15.87:0/1712785776 shutdown_connections 2024-05-08T05:31:23.217 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:23.214+0000 7f5b33794b80 1 -- 172.21.15.87:0/1712785776 wait complete. 2024-05-08T05:31:23.217 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:23.214+0000 7f5b33794b80 20 client.25390 trim_cache size 0 max 16384 2024-05-08T05:31:23.237 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:23.236+0000 7f5b33794b80 1 Processor -- start 2024-05-08T05:31:23.237 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:23.236+0000 7f5b33794b80 1 -- start start 2024-05-08T05:31:23.237 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:23.236+0000 7f5b33794b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55bb0d358600 0x55bb0d357fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:31:23.237 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:23.236+0000 7f5b33794b80 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55bb0d35d9e0 0x55bb0d35edf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:31:23.237 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:23.236+0000 7f5b33794b80 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55bb0d35e300 0x55bb0d379710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:31:23.237 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:23.236+0000 7f5b33794b80 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f5b241b2490 con 0x55bb0d35d9e0 2024-05-08T05:31:23.237 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:23.236+0000 7f5b33794b80 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f5b241afd20 con 0x55bb0d35e300 2024-05-08T05:31:23.238 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:23.236+0000 7f5b33794b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f5b241adb70 con 0x55bb0d358600 2024-05-08T05:31:23.238 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:23.237+0000 7f5b21e00700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55bb0d358600 0x55bb0d357fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:31:23.238 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:23.237+0000 7f5b21400700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55bb0d35d9e0 0x55bb0d35edf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:31:23.238 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:23.237+0000 7f5b21e00700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55bb0d358600 0x55bb0d357fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.87:39514/0 (socket says 172.21.15.87:39514) 2024-05-08T05:31:23.238 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:23.237+0000 7f5b21e00700 1 -- 172.21.15.87:0/3322319338 learned_addr learned my addr 172.21.15.87:0/3322319338 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T05:31:23.238 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:23.237+0000 7f5b22800700 1 --2- 172.21.15.87:0/3322319338 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55bb0d35e300 0x55bb0d379710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:31:23.239 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:23.237+0000 7f5b21400700 1 -- 172.21.15.87:0/3322319338 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55bb0d358600 msgr2=0x55bb0d357fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:31:23.239 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:23.237+0000 7f5b21400700 1 --2- 172.21.15.87:0/3322319338 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55bb0d358600 0x55bb0d357fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:31:23.239 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:23.237+0000 7f5b21400700 1 -- 172.21.15.87:0/3322319338 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55bb0d35e300 msgr2=0x55bb0d379710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:31:23.239 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:23.237+0000 7f5b21400700 1 --2- 172.21.15.87:0/3322319338 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55bb0d35e300 0x55bb0d379710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:31:23.239 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:23.237+0000 7f5b21400700 1 -- 172.21.15.87:0/3322319338 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bb0d353480 con 0x55bb0d35d9e0 2024-05-08T05:31:23.239 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:23.237+0000 7f5b22800700 1 --2- 172.21.15.87:0/3322319338 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55bb0d35e300 0x55bb0d379710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T05:31:23.239 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:23.238+0000 7f5b21400700 1 --2- 172.21.15.87:0/3322319338 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55bb0d35d9e0 0x55bb0d35edf0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x55bb0d362800 tx=0x7f5b10009310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=671fcb7914516e00 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:31:23.239 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:23.238+0000 7f5b0ea00700 1 -- 172.21.15.87:0/3322319338 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b10011820 con 0x55bb0d35d9e0 2024-05-08T05:31:23.239 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:23.238+0000 7f5b0ea00700 1 -- 172.21.15.87:0/3322319338 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5b10003680 con 0x55bb0d35d9e0 2024-05-08T05:31:23.239 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:23.238+0000 7f5b0ea00700 1 -- 172.21.15.87:0/3322319338 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b1002b6e0 con 0x55bb0d35d9e0 2024-05-08T05:31:23.240 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:23.239+0000 7f5b33794b80 1 -- 172.21.15.87:0/3322319338 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55bb0d35d9e0 msgr2=0x55bb0d35edf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:31:23.240 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:23.239+0000 7f5b33794b80 1 --2- 172.21.15.87:0/3322319338 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55bb0d35d9e0 0x55bb0d35edf0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x55bb0d362800 tx=0x7f5b10009310 comp rx=0 tx=0).stop 2024-05-08T05:31:23.240 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:23.239+0000 7f5b33794b80 1 -- 172.21.15.87:0/3322319338 shutdown_connections 2024-05-08T05:31:23.240 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:23.239+0000 7f5b33794b80 1 --2- 172.21.15.87:0/3322319338 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55bb0d35e300 0x55bb0d379710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:31:23.241 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:23.239+0000 7f5b33794b80 1 --2- 172.21.15.87:0/3322319338 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55bb0d358600 0x55bb0d357fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:31:23.241 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:23.239+0000 7f5b33794b80 1 --2- 172.21.15.87:0/3322319338 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55bb0d35d9e0 0x55bb0d35edf0 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:31:23.241 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:23.239+0000 7f5b33794b80 1 -- 172.21.15.87:0/3322319338 >> 172.21.15.87:0/3322319338 conn(0x55bb0d286b60 msgr2=0x55bb0d35e6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:31:23.241 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:23.239+0000 7f5b33794b80 1 -- 172.21.15.87:0/3322319338 shutdown_connections 2024-05-08T05:31:23.241 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:23.239+0000 7f5b33794b80 1 -- 172.21.15.87:0/3322319338 wait complete. 2024-05-08T05:31:23.241 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:23.240+0000 7f5b33794b80 1 -- start start 2024-05-08T05:31:23.241 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:23.240+0000 7f5b33794b80 1 Processor -- start 2024-05-08T05:31:23.242 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:23.240+0000 7f5b33794b80 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55bb0d358600 0x55bb0d36a830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:31:23.242 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:23.240+0000 7f5b33794b80 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55bb0d35d9e0 0x55bb0d367130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:31:23.242 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:23.240+0000 7f5b33794b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55bb0d35e300 0x55bb0d367870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:31:23.243 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:23.240+0000 7f5b33794b80 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f5b241ae1e0 con 0x55bb0d35d9e0 2024-05-08T05:31:23.243 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:23.240+0000 7f5b33794b80 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f5b241af650 con 0x55bb0d358600 2024-05-08T05:31:23.243 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:23.240+0000 7f5b33794b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f5b241ae8b0 con 0x55bb0d35e300 2024-05-08T05:31:23.243 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:23.240+0000 7f5b33794b80 10 client.0 _ll_register_callbacks cb 0x55bb0d251c70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T05:31:23.243 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:23.241+0000 7f5b21400700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55bb0d35d9e0 0x55bb0d367130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:31:23.243 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:23.241+0000 7f5b21e00700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55bb0d358600 0x55bb0d36a830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:31:23.243 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:23.241+0000 7f5b21e00700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55bb0d358600 0x55bb0d36a830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.87:35400/0 (socket says 172.21.15.87:35400) 2024-05-08T05:31:23.243 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:23.241+0000 7f5b21e00700 1 -- 172.21.15.87:0/1721977403 learned_addr learned my addr 172.21.15.87:0/1721977403 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T05:31:23.243 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:23.241+0000 7f5b22800700 1 --2- 172.21.15.87:0/1721977403 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55bb0d35e300 0x55bb0d367870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:31:23.243 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:23.241+0000 7f5b21400700 1 -- 172.21.15.87:0/1721977403 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55bb0d35e300 msgr2=0x55bb0d367870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:31:23.243 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:23.241+0000 7f5b21400700 1 --2- 172.21.15.87:0/1721977403 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55bb0d35e300 0x55bb0d367870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:31:23.243 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:23.241+0000 7f5b21400700 1 -- 172.21.15.87:0/1721977403 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55bb0d358600 msgr2=0x55bb0d36a830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:31:23.243 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:23.241+0000 7f5b21400700 1 --2- 172.21.15.87:0/1721977403 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55bb0d358600 0x55bb0d36a830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:31:23.243 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:23.241+0000 7f5b21400700 1 -- 172.21.15.87:0/1721977403 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bb0d3dc2d0 con 0x55bb0d35d9e0 2024-05-08T05:31:23.243 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:23.241+0000 7f5b22800700 1 --2- 172.21.15.87:0/1721977403 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55bb0d35e300 0x55bb0d367870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T05:31:23.244 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:23.242+0000 7f5b21400700 1 --2- 172.21.15.87:0/1721977403 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55bb0d35d9e0 0x55bb0d367130 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x55bb0d358f40 tx=0x7f5b10003a60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=41979dbd8b8cdb28 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:31:23.244 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:23.242+0000 7f5b03e00700 10 client.0 ms_handle_connect on v2:172.21.15.87:3300/0 2024-05-08T05:31:23.244 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:23.242+0000 7f5b03e00700 1 -- 172.21.15.87:0/1721977403 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b10011820 con 0x55bb0d35d9e0 2024-05-08T05:31:23.244 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:23.242+0000 7f5b03e00700 1 -- 172.21.15.87:0/1721977403 <== mon.0 v2:172.21.15.87:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8190+0+0 (secure 0 0 0) 0x7f5b100119c0 con 0x55bb0d35d9e0 2024-05-08T05:31:23.244 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:23.242+0000 7f5b33794b80 1 -- 172.21.15.87:0/1721977403 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5b10003680 con 0x55bb0d35d9e0 2024-05-08T05:31:23.244 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:23.242+0000 7f5b03e00700 1 -- 172.21.15.87:0/1721977403 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f5b10011bc0 con 0x55bb0d35d9e0 2024-05-08T05:31:23.244 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:23.242+0000 7f5b33794b80 10 client.15285 fetch_fsmap learned FSMap version 25 2024-05-08T05:31:23.244 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:23.242+0000 7f5b33794b80 1 -- 172.21.15.87:0/1721977403 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55bb0d3dd430 con 0x55bb0d35d9e0 2024-05-08T05:31:23.245 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:23.243+0000 7f5b03e00700 1 -- 172.21.15.87:0/1721977403 <== mon.0 v2:172.21.15.87:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5b10003680 con 0x55bb0d35d9e0 2024-05-08T05:31:23.246 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:23.243+0000 7f5b03e00700 1 -- 172.21.15.87:0/1721977403 <== mon.0 v2:172.21.15.87:3300/0 5 ==== fsmap(e 25) ==== 8338+0+0 (secure 0 0 0) 0x7f5b1001f040 con 0x55bb0d35d9e0 2024-05-08T05:31:23.246 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:23.243+0000 7f5b33794b80 10 client.15285 fetch_fsmap finished waiting for FSMap version 25 2024-05-08T05:31:23.246 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:23.243+0000 7f5b33794b80 10 client.15285 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-05-08T05:31:23.246 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:23.243+0000 7f5b33794b80 20 client.15285 populate_metadata read hostname 'smithi087' 2024-05-08T05:31:23.246 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:23.243+0000 7f5b33794b80 1 --2- 172.21.15.87:0/1721977403 >> [v2:172.21.15.90:6838/160586017,v1:172.21.15.90:6839/160586017] conn(0x55bb0d3dda90 0x55bb0d3dfeb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:31:23.246 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:23.243+0000 7f5b33794b80 4 client.15285 mds_command: new command op to 24500 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-05-08T05:31:23.246 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:23.243+0000 7f5b33794b80 1 -- 172.21.15.87:0/1721977403 --> [v2:172.21.15.90:6838/160586017,v1:172.21.15.90:6839/160586017] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55bb0d2b8400 con 0x55bb0d3dda90 2024-05-08T05:31:23.246 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:23.243+0000 7f5b21e00700 1 --2- 172.21.15.87:0/1721977403 >> [v2:172.21.15.90:6838/160586017,v1:172.21.15.90:6839/160586017] conn(0x55bb0d3dda90 0x55bb0d3dfeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:31:23.246 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:23.244+0000 7f5b21e00700 1 --2- 172.21.15.87:0/1721977403 >> [v2:172.21.15.90:6838/160586017,v1:172.21.15.90:6839/160586017] conn(0x55bb0d3dda90 0x55bb0d3dfeb0 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8a80b2926496ef76 server_cookie=d437cde5e684313 in_seq=0 out_seq=0 2024-05-08T05:31:23.246 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:23.244+0000 7f5b03e00700 10 client.15285 ms_handle_connect on v2:172.21.15.90:6838/160586017 2024-05-08T05:31:23.246 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:23.244+0000 7f5b03e00700 1 -- 172.21.15.87:0/1721977403 <== mds.0 v2:172.21.15.90:6838/160586017 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x55bb0d2b8400 con 0x55bb0d3dda90 2024-05-08T05:31:23.246 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:23.244+0000 7f5b03e00700 10 client.15285 handle_command_reply: tid=0 2024-05-08T05:31:23.247 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:23.244+0000 7f5b33794b80 1 client.15285 shutdown 2024-05-08T05:31:23.247 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:23.244+0000 7f5b33794b80 1 -- 172.21.15.87:0/1721977403 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55bb0d35d9e0 msgr2=0x55bb0d367130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:31:23.247 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:23.244+0000 7f5b33794b80 1 --2- 172.21.15.87:0/1721977403 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55bb0d35d9e0 0x55bb0d367130 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x55bb0d358f40 tx=0x7f5b10003a60 comp rx=0 tx=0).stop 2024-05-08T05:31:23.247 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:23.244+0000 7f5b33794b80 1 -- 172.21.15.87:0/1721977403 shutdown_connections 2024-05-08T05:31:23.247 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:23.244+0000 7f5b33794b80 1 --2- 172.21.15.87:0/1721977403 >> [v2:172.21.15.90:6838/160586017,v1:172.21.15.90:6839/160586017] conn(0x55bb0d3dda90 0x55bb0d3dfeb0 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:31:23.247 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:23.244+0000 7f5b33794b80 1 --2- 172.21.15.87:0/1721977403 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55bb0d35e300 0x55bb0d367870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:31:23.247 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:23.244+0000 7f5b33794b80 1 --2- 172.21.15.87:0/1721977403 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55bb0d358600 0x55bb0d36a830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:31:23.247 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:23.244+0000 7f5b33794b80 1 --2- 172.21.15.87:0/1721977403 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55bb0d35d9e0 0x55bb0d367130 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:31:23.247 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:23.244+0000 7f5b33794b80 1 -- 172.21.15.87:0/1721977403 >> 172.21.15.87:0/1721977403 conn(0x55bb0d286b60 msgr2=0x55bb0d34d460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:31:23.247 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:23.244+0000 7f5b03e00700 0 client.15285 ms_handle_reset on v2:172.21.15.90:6838/160586017 2024-05-08T05:31:23.247 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:23.245+0000 7f5b33794b80 1 -- 172.21.15.87:0/1721977403 shutdown_connections 2024-05-08T05:31:23.247 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:23.245+0000 7f5b33794b80 1 -- 172.21.15.87:0/1721977403 wait complete. 2024-05-08T05:31:23.247 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:23.245+0000 7f5b33794b80 20 client.15285 trim_cache size 0 max 16384 2024-05-08T05:31:23.248 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-05-08T05:31:23.248 INFO:teuthology.orchestra.run.smithi087.stdout: "status": "no active scrubs running", 2024-05-08T05:31:23.248 INFO:teuthology.orchestra.run.smithi087.stdout: "scrubs": {} 2024-05-08T05:31:23.248 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-05-08T05:31:23.249 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:23.245+0000 7f5b23200700 1 -- 172.21.15.87:0/2649713484 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f5b080b2900 msgr2=0x7f5b080b4dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:31:23.249 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:23.245+0000 7f5b23200700 1 --2- 172.21.15.87:0/2649713484 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f5b080b2900 0x7f5b080b4dc0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f5b10009fd0 tx=0x7f5b10009c60 comp rx=0 tx=0).stop 2024-05-08T05:31:23.249 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:23.245+0000 7f5b23200700 1 -- 172.21.15.87:0/2649713484 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5b2410fd30 msgr2=0x7f5b241a05f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:31:23.249 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:23.245+0000 7f5b23200700 1 --2- 172.21.15.87:0/2649713484 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5b2410fd30 0x7f5b241a05f0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f5b1c00ef90 tx=0x7f5b1c00c3a0 comp rx=0 tx=0).stop 2024-05-08T05:31:23.249 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:23.246+0000 7f5b23200700 1 -- 172.21.15.87:0/2649713484 shutdown_connections 2024-05-08T05:31:23.249 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:23.246+0000 7f5b23200700 1 --2- 172.21.15.87:0/2649713484 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5b2410fd30 0x7f5b241a05f0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:31:23.249 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:23.246+0000 7f5b23200700 1 --2- 172.21.15.87:0/2649713484 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5b24102180 0x7f5b2419bd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:31:23.249 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:23.246+0000 7f5b23200700 1 --2- 172.21.15.87:0/2649713484 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f5b080b2900 0x7f5b080b4dc0 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:31:23.249 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:23.246+0000 7f5b23200700 1 --2- 172.21.15.87:0/2649713484 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5b24102b30 0x7f5b2419c2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:31:23.249 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:23.246+0000 7f5b23200700 1 -- 172.21.15.87:0/2649713484 >> 172.21.15.87:0/2649713484 conn(0x7f5b240fddc0 msgr2=0x7f5b241001b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:31:23.249 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:23.246+0000 7f5b23200700 1 -- 172.21.15.87:0/2649713484 shutdown_connections 2024-05-08T05:31:23.249 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:23.246+0000 7f5b23200700 1 -- 172.21.15.87:0/2649713484 wait complete. 2024-05-08T05:31:23.458 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:31:23 smithi087 ceph-mon[29523]: scrub summary: idle 2024-05-08T05:31:23.483 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:31:23 smithi090 ceph-mon[34526]: scrub summary: idle 2024-05-08T05:31:23.539 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:31:23 smithi160 ceph-mon[34827]: scrub summary: idle 2024-05-08T05:31:23.636 INFO:tasks.workunit.client.0.smithi087.stderr:Note: switching to 'bee299f4ac344e4c45e550d7a80abcadd7bc3d5a'. 2024-05-08T05:31:23.637 INFO:tasks.workunit.client.0.smithi087.stderr: 2024-05-08T05:31:23.637 INFO:tasks.workunit.client.0.smithi087.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-05-08T05:31:23.637 INFO:tasks.workunit.client.0.smithi087.stderr:changes and commit them, and you can discard any commits you make in this 2024-05-08T05:31:23.637 INFO:tasks.workunit.client.0.smithi087.stderr:state without impacting any branches by switching back to a branch. 2024-05-08T05:31:23.637 INFO:tasks.workunit.client.0.smithi087.stderr: 2024-05-08T05:31:23.637 INFO:tasks.workunit.client.0.smithi087.stderr:If you want to create a new branch to retain commits you create, you may 2024-05-08T05:31:23.637 INFO:tasks.workunit.client.0.smithi087.stderr:do so (now or later) by using -c with the switch command. Example: 2024-05-08T05:31:23.637 INFO:tasks.workunit.client.0.smithi087.stderr: 2024-05-08T05:31:23.637 INFO:tasks.workunit.client.0.smithi087.stderr: git switch -c 2024-05-08T05:31:23.637 INFO:tasks.workunit.client.0.smithi087.stderr: 2024-05-08T05:31:23.637 INFO:tasks.workunit.client.0.smithi087.stderr:Or undo this operation with: 2024-05-08T05:31:23.637 INFO:tasks.workunit.client.0.smithi087.stderr: 2024-05-08T05:31:23.637 INFO:tasks.workunit.client.0.smithi087.stderr: git switch - 2024-05-08T05:31:23.637 INFO:tasks.workunit.client.0.smithi087.stderr: 2024-05-08T05:31:23.638 INFO:tasks.workunit.client.0.smithi087.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-05-08T05:31:23.638 INFO:tasks.workunit.client.0.smithi087.stderr: 2024-05-08T05:31:23.638 INFO:tasks.workunit.client.0.smithi087.stderr:HEAD is now at bee299f4ac3 mds: relax divergent backtrace scrub failures for replicated ancestor inodes 2024-05-08T05:31:23.651 DEBUG:teuthology.orchestra.run.smithi087:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-05-08T05:31:23.724 INFO:tasks.workunit.client.0.smithi087.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-05-08T05:31:23.730 INFO:tasks.workunit.client.0.smithi087.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-05-08T05:31:23.730 INFO:tasks.workunit.client.0.smithi087.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-05-08T05:31:24.307 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-05-08T05:31:24.308 DEBUG:teuthology.orchestra.run.smithi087:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid eeeb813e-0cf9-11ef-bc97-c7b262605968 -- ceph fs dump --format=json 2024-05-08T05:31:24.458 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:31:24 smithi087 ceph-mon[29523]: pgmap v492: 97 pgs: 97 active+clean; 661 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-05-08T05:31:24.483 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:31:24 smithi090 ceph-mon[34526]: pgmap v492: 97 pgs: 97 active+clean; 661 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-05-08T05:31:24.538 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:31:24 smithi160 ceph-mon[34827]: pgmap v492: 97 pgs: 97 active+clean; 661 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-05-08T05:31:24.735 INFO:teuthology.orchestra.run.smithi087.stderr:Inferring config /var/lib/ceph/eeeb813e-0cf9-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T05:31:25.176 INFO:tasks.workunit.client.0.smithi087.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-05-08T05:31:25.339 INFO:tasks.workunit.client.0.smithi087.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-05-08T05:31:25.414 INFO:tasks.workunit.client.0.smithi087.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-05-08T05:31:25.418 INFO:tasks.workunit.client.0.smithi087.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-05-08T05:31:25.419 INFO:tasks.workunit.client.0.smithi087.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-05-08T05:31:25.493 INFO:tasks.workunit.client.0.smithi087.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-05-08T05:31:25.503 DEBUG:teuthology.orchestra.run.smithi087:> set -ex 2024-05-08T05:31:25.503 DEBUG:teuthology.orchestra.run.smithi087:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-05-08T05:31:25.547 INFO:tasks.workunit:Running workunits matching suites/fsstress.sh on client.0... 2024-05-08T05:31:25.548 INFO:tasks.workunit:Running workunit suites/fsstress.sh... 2024-05-08T05:31:25.548 DEBUG:teuthology.orchestra.run.smithi087:workunit test suites/fsstress.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=bee299f4ac344e4c45e550d7a80abcadd7bc3d5a TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 6h /home/ubuntu/cephtest/clone.client.0/qa/workunits/suites/fsstress.sh 2024-05-08T05:31:25.658 INFO:tasks.workunit.client.0.smithi087.stderr:+ mkdir -p fsstress 2024-05-08T05:31:25.662 INFO:tasks.workunit.client.0.smithi087.stderr:+ pushd fsstress 2024-05-08T05:31:25.663 INFO:tasks.workunit.client.0.smithi087.stdout:~/cephtest/mnt.0/client.0/tmp/fsstress ~/cephtest/mnt.0/client.0/tmp 2024-05-08T05:31:25.663 INFO:tasks.workunit.client.0.smithi087.stderr:+ wget -q -O ltp-full.tgz http://download.ceph.com/qa/ltp-full-20091231.tgz 2024-05-08T05:31:26.412 INFO:tasks.workunit.client.0.smithi087.stderr:+ tar xzf ltp-full.tgz 2024-05-08T05:31:26.458 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:31:26 smithi087 ceph-mon[29523]: pgmap v493: 97 pgs: 97 active+clean; 661 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 6 op/s 2024-05-08T05:31:26.483 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:31:26 smithi090 ceph-mon[34526]: pgmap v493: 97 pgs: 97 active+clean; 661 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 6 op/s 2024-05-08T05:31:26.538 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:31:26 smithi160 ceph-mon[34827]: pgmap v493: 97 pgs: 97 active+clean; 661 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 6 op/s 2024-05-08T05:31:27.031 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:27.030+0000 7fb151800700 1 -- 172.21.15.87:0/2449543020 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb14c106080 msgr2=0x7fb14c112590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:31:27.031 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:27.030+0000 7fb151800700 1 --2- 172.21.15.87:0/2449543020 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb14c106080 0x7fb14c112590 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fb14400b0a0 tx=0x7fb14400b3b0 comp rx=0 tx=0).stop 2024-05-08T05:31:27.031 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:27.030+0000 7fb151800700 1 -- 172.21.15.87:0/2449543020 shutdown_connections 2024-05-08T05:31:27.031 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:27.030+0000 7fb151800700 1 --2- 172.21.15.87:0/2449543020 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb14c106080 0x7fb14c112590 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:31:27.031 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:27.030+0000 7fb151800700 1 --2- 172.21.15.87:0/2449543020 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb14c10b6c0 0x7fb14c10baa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:31:27.031 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:27.030+0000 7fb151800700 1 --2- 172.21.15.87:0/2449543020 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb14c1056c0 0x7fb14c105b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:31:27.031 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:27.030+0000 7fb151800700 1 -- 172.21.15.87:0/2449543020 >> 172.21.15.87:0/2449543020 conn(0x7fb14c1011b0 msgr2=0x7fb14c1035d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:31:27.031 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:27.030+0000 7fb151800700 1 -- 172.21.15.87:0/2449543020 shutdown_connections 2024-05-08T05:31:27.031 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:27.030+0000 7fb151800700 1 -- 172.21.15.87:0/2449543020 wait complete. 2024-05-08T05:31:27.032 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:27.031+0000 7fb151800700 1 Processor -- start 2024-05-08T05:31:27.032 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:27.031+0000 7fb151800700 1 -- start start 2024-05-08T05:31:27.032 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:27.032+0000 7fb151800700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb14c1056c0 0x7fb14c19bd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:31:27.032 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:27.032+0000 7fb151800700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb14c106080 0x7fb14c19c2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:31:27.032 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:27.032+0000 7fb151800700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb14c10b6c0 0x7fb14c1a0630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:31:27.032 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:27.032+0000 7fb151800700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fb14c115910 con 0x7fb14c10b6c0 2024-05-08T05:31:27.032 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:27.032+0000 7fb151800700 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fb14c115790 con 0x7fb14c106080 2024-05-08T05:31:27.032 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:27.032+0000 7fb151800700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7fb14c115a90 con 0x7fb14c1056c0 2024-05-08T05:31:27.033 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:27.032+0000 7fb14b400700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb14c10b6c0 0x7fb14c1a0630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:31:27.033 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:27.032+0000 7fb14a000700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb14c106080 0x7fb14c19c2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:31:27.033 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:27.032+0000 7fb14b400700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb14c10b6c0 0x7fb14c1a0630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:52406/0 (socket says 172.21.15.87:52406) 2024-05-08T05:31:27.033 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:27.032+0000 7fb14b400700 1 -- 172.21.15.87:0/756734972 learned_addr learned my addr 172.21.15.87:0/756734972 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T05:31:27.033 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:27.032+0000 7fb14aa00700 1 --2- 172.21.15.87:0/756734972 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb14c1056c0 0x7fb14c19bd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:31:27.033 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:27.033+0000 7fb14aa00700 1 -- 172.21.15.87:0/756734972 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb14c106080 msgr2=0x7fb14c19c2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:31:27.034 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:27.033+0000 7fb14aa00700 1 --2- 172.21.15.87:0/756734972 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb14c106080 0x7fb14c19c2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:31:27.034 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:27.033+0000 7fb14aa00700 1 -- 172.21.15.87:0/756734972 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb14c10b6c0 msgr2=0x7fb14c1a0630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:31:27.034 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:27.033+0000 7fb14aa00700 1 --2- 172.21.15.87:0/756734972 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb14c10b6c0 0x7fb14c1a0630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:31:27.034 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:27.033+0000 7fb14aa00700 1 -- 172.21.15.87:0/756734972 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb14c1a0d70 con 0x7fb14c1056c0 2024-05-08T05:31:27.034 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:27.033+0000 7fb14b400700 1 --2- 172.21.15.87:0/756734972 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb14c10b6c0 0x7fb14c1a0630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T05:31:27.034 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:27.033+0000 7fb14a000700 1 --2- 172.21.15.87:0/756734972 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb14c106080 0x7fb14c19c2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T05:31:27.034 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:27.033+0000 7fb14aa00700 1 --2- 172.21.15.87:0/756734972 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb14c1056c0 0x7fb14c19bd60 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fb13c00e9f0 tx=0x7fb13c00ed00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:31:27.035 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:27.033+0000 7fb143400700 1 -- 172.21.15.87:0/756734972 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb13c00c9c0 con 0x7fb14c1056c0 2024-05-08T05:31:27.035 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:27.033+0000 7fb143400700 1 -- 172.21.15.87:0/756734972 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb13c00cb60 con 0x7fb14c1056c0 2024-05-08T05:31:27.035 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:27.033+0000 7fb143400700 1 -- 172.21.15.87:0/756734972 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb13c018680 con 0x7fb14c1056c0 2024-05-08T05:31:27.035 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:27.033+0000 7fb151800700 1 -- 172.21.15.87:0/756734972 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb14c1a1060 con 0x7fb14c1056c0 2024-05-08T05:31:27.035 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:27.034+0000 7fb151800700 1 -- 172.21.15.87:0/756734972 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb14c1a88e0 con 0x7fb14c1056c0 2024-05-08T05:31:27.035 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:27.035+0000 7fb151800700 1 -- 172.21.15.87:0/756734972 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb14c06a190 con 0x7fb14c1056c0 2024-05-08T05:31:27.037 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:27.037+0000 7fb143400700 1 -- 172.21.15.87:0/756734972 <== mon.1 v2:172.21.15.160:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7fb13c010430 con 0x7fb14c1056c0 2024-05-08T05:31:27.039 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:27.039+0000 7fb143400700 1 --2- 172.21.15.87:0/756734972 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7fb1300b2880 0x7fb1300b4d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:31:27.039 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:27.039+0000 7fb143400700 1 -- 172.21.15.87:0/756734972 <== mon.1 v2:172.21.15.160:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8190+0+0 (secure 0 0 0) 0x7fb13c0e26a0 con 0x7fb14c1056c0 2024-05-08T05:31:27.039 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:27.039+0000 7fb14a000700 1 --2- 172.21.15.87:0/756734972 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7fb1300b2880 0x7fb1300b4d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:31:27.040 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:27.040+0000 7fb14a000700 1 --2- 172.21.15.87:0/756734972 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7fb1300b2880 0x7fb1300b4d40 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fb14c103780 tx=0x7fb13800b3c0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:31:27.041 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:27.041+0000 7fb143400700 1 -- 172.21.15.87:0/756734972 <== mon.1 v2:172.21.15.160:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7fb13c0aa390 con 0x7fb14c1056c0 2024-05-08T05:31:27.351 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:27.350+0000 7fb151800700 1 -- 172.21.15.87:0/756734972 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fb14c02e510 con 0x7fb14c1056c0 2024-05-08T05:31:27.352 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-05-08T05:31:27.352 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:27.351+0000 7fb143400700 1 -- 172.21.15.87:0/756734972 <== mon.1 v2:172.21.15.160:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) ==== 94+0+11858 (secure 0 0 0) 0x7fb13c0b2410 con 0x7fb14c1056c0 2024-05-08T05:31:27.353 INFO:teuthology.orchestra.run.smithi087.stdout:{"epoch":25,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14358,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6835/1183985321","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6834","nonce":1183985321},{"type":"v1","addr":"172.21.15.87:6835","nonce":1183985321}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14370,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6837/1485824316","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6836","nonce":1485824316},{"type":"v1","addr":"172.21.15.87:6837","nonce":1485824316}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14409,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6841/724277538","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6840","nonce":724277538},{"type":"v1","addr":"172.21.15.87:6841","nonce":724277538}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24412,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6833/3339455985","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6832","nonce":3339455985},{"type":"v1","addr":"172.21.15.160:6833","nonce":3339455985}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24413,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6833/3292166873","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6832","nonce":3292166873},{"type":"v1","addr":"172.21.15.90:6833","nonce":3292166873}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24443,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6835/824555459","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6834","nonce":824555459},{"type":"v1","addr":"172.21.15.90:6835","nonce":824555459}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6}],"filesystems":[{"mdsmap":{"epoch":25,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-05-08T05:25:36.816840+0000","modified":"2024-05-08T05:29:16.624018+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24500,"mds_1":24482,"mds_2":24481},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24463":{"gid":24463,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.160:6835/409648357","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6834","nonce":409648357},{"type":"v1","addr":"172.21.15.160:6835","nonce":409648357}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24467":{"gid":24467,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.90:6837/4221919418","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6836","nonce":4221919418},{"type":"v1","addr":"172.21.15.90:6837","nonce":4221919418}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24469":{"gid":24469,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.160:6837/4200018040","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6836","nonce":4200018040},{"type":"v1","addr":"172.21.15.160:6837","nonce":4200018040}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24481":{"gid":24481,"name":"i","rank":2,"incarnation":20,"state":"up:active","state_seq":13,"addr":"172.21.15.160:6839/234657686","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6838","nonce":234657686},{"type":"v1","addr":"172.21.15.160:6839","nonce":234657686}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24482":{"gid":24482,"name":"g","rank":1,"incarnation":18,"state":"up:active","state_seq":12,"addr":"172.21.15.87:6839/2127215876","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6838","nonce":2127215876},{"type":"v1","addr":"172.21.15.87:6839","nonce":2127215876}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24500":{"gid":24500,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.90:6839/160586017","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6838","nonce":160586017},{"type":"v1","addr":"172.21.15.90:6839","nonce":160586017}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24500,"qdb_cluster":[24481,24482,24500]},"id":1}]} 2024-05-08T05:31:27.355 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:27.355+0000 7fb151800700 1 -- 172.21.15.87:0/756734972 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7fb1300b2880 msgr2=0x7fb1300b4d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:31:27.356 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:27.355+0000 7fb151800700 1 --2- 172.21.15.87:0/756734972 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7fb1300b2880 0x7fb1300b4d40 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fb14c103780 tx=0x7fb13800b3c0 comp rx=0 tx=0).stop 2024-05-08T05:31:27.356 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:27.355+0000 7fb151800700 1 -- 172.21.15.87:0/756734972 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb14c1056c0 msgr2=0x7fb14c19bd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:31:27.356 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:27.355+0000 7fb151800700 1 --2- 172.21.15.87:0/756734972 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb14c1056c0 0x7fb14c19bd60 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fb13c00e9f0 tx=0x7fb13c00ed00 comp rx=0 tx=0).stop 2024-05-08T05:31:27.356 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:27.355+0000 7fb151800700 1 -- 172.21.15.87:0/756734972 shutdown_connections 2024-05-08T05:31:27.356 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:27.355+0000 7fb151800700 1 --2- 172.21.15.87:0/756734972 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb14c10b6c0 0x7fb14c1a0630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:31:27.356 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:27.355+0000 7fb151800700 1 --2- 172.21.15.87:0/756734972 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7fb1300b2880 0x7fb1300b4d40 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:31:27.356 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:27.355+0000 7fb151800700 1 --2- 172.21.15.87:0/756734972 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb14c1056c0 0x7fb14c19bd60 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:31:27.356 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:27.355+0000 7fb151800700 1 --2- 172.21.15.87:0/756734972 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb14c106080 0x7fb14c19c2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:31:27.357 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:27.355+0000 7fb151800700 1 -- 172.21.15.87:0/756734972 >> 172.21.15.87:0/756734972 conn(0x7fb14c1011b0 msgr2=0x7fb14c101820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:31:27.357 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:27.355+0000 7fb151800700 1 -- 172.21.15.87:0/756734972 shutdown_connections 2024-05-08T05:31:27.357 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:27.355+0000 7fb151800700 1 -- 172.21.15.87:0/756734972 wait complete. 2024-05-08T05:31:27.357 INFO:teuthology.orchestra.run.smithi087.stderr:dumped fsmap epoch 25 2024-05-08T05:31:28.294 DEBUG:teuthology.orchestra.run.smithi087:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid eeeb813e-0cf9-11ef-bc97-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-05-08T05:31:28.458 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:31:28 smithi087 ceph-mon[29523]: pgmap v494: 97 pgs: 97 active+clean; 661 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 85 B/s wr, 5 op/s 2024-05-08T05:31:28.458 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:31:28 smithi087 ceph-mon[29523]: from='client.? 172.21.15.87:0/756734972' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T05:31:28.483 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:31:28 smithi090 ceph-mon[34526]: pgmap v494: 97 pgs: 97 active+clean; 661 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 85 B/s wr, 5 op/s 2024-05-08T05:31:28.483 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:31:28 smithi090 ceph-mon[34526]: from='client.? 172.21.15.87:0/756734972' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T05:31:28.538 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:31:28 smithi160 ceph-mon[34827]: pgmap v494: 97 pgs: 97 active+clean; 661 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 85 B/s wr, 5 op/s 2024-05-08T05:31:28.539 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:31:28 smithi160 ceph-mon[34827]: from='client.? 172.21.15.87:0/756734972' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T05:31:28.760 INFO:teuthology.orchestra.run.smithi087.stderr:Inferring config /var/lib/ceph/eeeb813e-0cf9-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T05:31:30.458 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:31:30 smithi087 ceph-mon[29523]: pgmap v495: 97 pgs: 97 active+clean; 2.1 MiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 91 KiB/s rd, 126 KiB/s wr, 8 op/s 2024-05-08T05:31:30.486 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:31:30 smithi090 ceph-mon[34526]: pgmap v495: 97 pgs: 97 active+clean; 2.1 MiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 91 KiB/s rd, 126 KiB/s wr, 8 op/s 2024-05-08T05:31:30.539 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:31:30 smithi160 ceph-mon[34827]: pgmap v495: 97 pgs: 97 active+clean; 2.1 MiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 91 KiB/s rd, 126 KiB/s wr, 8 op/s 2024-05-08T05:31:31.127 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:31.126+0000 7fca57200700 1 -- 172.21.15.87:0/3912466368 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fca50104360 msgr2=0x7fca5006ba10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:31:31.127 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:31.126+0000 7fca57200700 1 --2- 172.21.15.87:0/3912466368 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fca50104360 0x7fca5006ba10 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fca440098f0 tx=0x7fca44009c00 comp rx=0 tx=0).stop 2024-05-08T05:31:31.127 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:31.126+0000 7fca57200700 1 -- 172.21.15.87:0/3912466368 shutdown_connections 2024-05-08T05:31:31.128 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:31.126+0000 7fca57200700 1 --2- 172.21.15.87:0/3912466368 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fca5010fc60 0x7fca50112090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:31:31.128 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:31.126+0000 7fca57200700 1 --2- 172.21.15.87:0/3912466368 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fca50104360 0x7fca5006ba10 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:31:31.128 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:31.126+0000 7fca57200700 1 --2- 172.21.15.87:0/3912466368 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fca5006bf50 0x7fca5006c3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:31:31.128 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:31.126+0000 7fca57200700 1 -- 172.21.15.87:0/3912466368 >> 172.21.15.87:0/3912466368 conn(0x7fca500791e0 msgr2=0x7fca500795f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:31:31.128 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:31.127+0000 7fca57200700 1 -- 172.21.15.87:0/3912466368 shutdown_connections 2024-05-08T05:31:31.128 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:31.127+0000 7fca57200700 1 -- 172.21.15.87:0/3912466368 wait complete. 2024-05-08T05:31:31.129 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:31.128+0000 7fca57200700 1 Processor -- start 2024-05-08T05:31:31.129 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:31.128+0000 7fca57200700 1 -- start start 2024-05-08T05:31:31.129 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:31.128+0000 7fca57200700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fca5006bf50 0x7fca501a1a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:31:31.129 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:31.128+0000 7fca57200700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fca50104360 0x7fca501a1fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:31:31.130 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:31.128+0000 7fca57200700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fca5010fc60 0x7fca5019bb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:31:31.130 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:31.128+0000 7fca57200700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fca50115800 con 0x7fca50104360 2024-05-08T05:31:31.130 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:31.128+0000 7fca57200700 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fca50115680 con 0x7fca5006bf50 2024-05-08T05:31:31.130 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:31.128+0000 7fca57200700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7fca50115980 con 0x7fca5010fc60 2024-05-08T05:31:31.130 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:31.128+0000 7fca55e00700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fca5006bf50 0x7fca501a1a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:31:31.130 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:31.128+0000 7fca55400700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fca50104360 0x7fca501a1fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:31:31.130 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:31.128+0000 7fca55e00700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fca5006bf50 0x7fca501a1a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.87:41186/0 (socket says 172.21.15.87:41186) 2024-05-08T05:31:31.130 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:31.129+0000 7fca55e00700 1 -- 172.21.15.87:0/1175640246 learned_addr learned my addr 172.21.15.87:0/1175640246 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T05:31:31.130 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:31.129+0000 7fca56800700 1 --2- 172.21.15.87:0/1175640246 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fca5010fc60 0x7fca5019bb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:31:31.130 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:31.129+0000 7fca55e00700 1 -- 172.21.15.87:0/1175640246 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fca5010fc60 msgr2=0x7fca5019bb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:31:31.130 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:31.129+0000 7fca55e00700 1 --2- 172.21.15.87:0/1175640246 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fca5010fc60 0x7fca5019bb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:31:31.130 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:31.129+0000 7fca55e00700 1 -- 172.21.15.87:0/1175640246 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fca50104360 msgr2=0x7fca501a1fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:31:31.131 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:31.129+0000 7fca55e00700 1 --2- 172.21.15.87:0/1175640246 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fca50104360 0x7fca501a1fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:31:31.131 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:31.129+0000 7fca55e00700 1 -- 172.21.15.87:0/1175640246 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fca5019c460 con 0x7fca5006bf50 2024-05-08T05:31:31.131 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:31.129+0000 7fca55e00700 1 --2- 172.21.15.87:0/1175640246 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fca5006bf50 0x7fca501a1a60 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fca44009230 tx=0x7fca4400fa70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:31:31.132 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:31.130+0000 7fca4aa00700 1 -- 172.21.15.87:0/1175640246 <== mon.2 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca44005140 con 0x7fca5006bf50 2024-05-08T05:31:31.132 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:31.130+0000 7fca4aa00700 1 -- 172.21.15.87:0/1175640246 <== mon.2 v2:172.21.15.90:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fca4400b560 con 0x7fca5006bf50 2024-05-08T05:31:31.132 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:31.130+0000 7fca4aa00700 1 -- 172.21.15.87:0/1175640246 <== mon.2 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca44003ae0 con 0x7fca5006bf50 2024-05-08T05:31:31.132 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:31.130+0000 7fca57200700 1 -- 172.21.15.87:0/1175640246 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fca5019c6f0 con 0x7fca5006bf50 2024-05-08T05:31:31.132 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:31.130+0000 7fca57200700 1 -- 172.21.15.87:0/1175640246 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fca501a89e0 con 0x7fca5006bf50 2024-05-08T05:31:31.134 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:31.133+0000 7fca4aa00700 1 -- 172.21.15.87:0/1175640246 <== mon.2 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7fca44003c80 con 0x7fca5006bf50 2024-05-08T05:31:31.135 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:31.135+0000 7fca630c6b80 1 Processor -- start 2024-05-08T05:31:31.136 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:31.135+0000 7fca630c6b80 1 -- start start 2024-05-08T05:31:31.137 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:31.136+0000 7fca630c6b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55e18365e1d0 0x55e18365e5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:31:31.137 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:31.136+0000 7fca630c6b80 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e18365eaf0 0x55e1836587f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:31:31.137 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:31.136+0000 7fca630c6b80 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55e183658e10 0x55e183659270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:31:31.137 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:31.136+0000 7fca4aa00700 1 --2- 172.21.15.87:0/1175640246 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7fca380b2900 0x7fca380b4dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:31:31.137 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:31.136+0000 7fca630c6b80 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x55e1835a2a20 con 0x55e18365eaf0 2024-05-08T05:31:31.137 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:31.136+0000 7fca630c6b80 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x55e183540760 con 0x55e183658e10 2024-05-08T05:31:31.138 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:31.136+0000 7fca630c6b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x55e18359e9e0 con 0x55e18365e1d0 2024-05-08T05:31:31.138 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:31.136+0000 7fca55e00700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e18365eaf0 0x55e1836587f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:31:31.138 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:31.136+0000 7fca56800700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55e18365e1d0 0x55e18365e5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:31:31.138 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:31.136+0000 7fca55e00700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e18365eaf0 0x55e1836587f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:52442/0 (socket says 172.21.15.87:52442) 2024-05-08T05:31:31.138 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:31.136+0000 7fca55e00700 1 -- 172.21.15.87:0/4018707536 learned_addr learned my addr 172.21.15.87:0/4018707536 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T05:31:31.138 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:31.136+0000 7fca4aa00700 1 -- 172.21.15.87:0/1175640246 <== mon.2 v2:172.21.15.90:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8190+0+0 (secure 0 0 0) 0x7fca440e3170 con 0x7fca5006bf50 2024-05-08T05:31:31.139 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:31.136+0000 7fca56800700 1 --2- 172.21.15.87:0/4018707536 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55e183658e10 0x55e183659270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:31:31.139 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:31.136+0000 7fca55400700 1 --2- 172.21.15.87:0/1175640246 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7fca380b2900 0x7fca380b4dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:31:31.144 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:31.137+0000 7fca56800700 1 -- 172.21.15.87:0/4018707536 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55e183658e10 msgr2=0x55e183659270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:31:31.144 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:31.137+0000 7fca56800700 1 --2- 172.21.15.87:0/4018707536 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55e183658e10 0x55e183659270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:31:31.144 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:31.137+0000 7fca56800700 1 -- 172.21.15.87:0/4018707536 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e18365eaf0 msgr2=0x55e1836587f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:31:31.144 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:31.137+0000 7fca56800700 1 --2- 172.21.15.87:0/4018707536 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e18365eaf0 0x55e1836587f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:31:31.144 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:31.137+0000 7fca56800700 1 -- 172.21.15.87:0/4018707536 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e1834ef8d0 con 0x55e18365e1d0 2024-05-08T05:31:31.144 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:31.137+0000 7fca55e00700 1 --2- 172.21.15.87:0/4018707536 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e18365eaf0 0x55e1836587f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T05:31:31.145 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:31.137+0000 7fca56800700 1 --2- 172.21.15.87:0/4018707536 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55e18365e1d0 0x55e18365e5b0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fca5006b6d0 tx=0x7fca4c009920 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1d07da7be912fb46 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:31:31.145 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:31.137+0000 7fca3f400700 1 -- 172.21.15.87:0/4018707536 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca4c004db0 con 0x55e18365e1d0 2024-05-08T05:31:31.145 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:31.137+0000 7fca3f400700 1 -- 172.21.15.87:0/4018707536 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fca4c003a00 con 0x55e18365e1d0 2024-05-08T05:31:31.145 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:31.137+0000 7fca3f400700 1 -- 172.21.15.87:0/4018707536 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca4c017d30 con 0x55e18365e1d0 2024-05-08T05:31:31.145 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:31.138+0000 7fca630c6b80 1 -- 172.21.15.87:0/4018707536 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55e18365e1d0 msgr2=0x55e18365e5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:31:31.145 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:31.138+0000 7fca55400700 1 --2- 172.21.15.87:0/1175640246 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7fca380b2900 0x7fca380b4dc0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fca40009750 tx=0x7fca40009310 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:31:31.146 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:31.138+0000 7fca630c6b80 1 --2- 172.21.15.87:0/4018707536 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55e18365e1d0 0x55e18365e5b0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fca5006b6d0 tx=0x7fca4c009920 comp rx=0 tx=0).stop 2024-05-08T05:31:31.146 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:31.138+0000 7fca630c6b80 1 -- 172.21.15.87:0/4018707536 shutdown_connections 2024-05-08T05:31:31.146 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:31.138+0000 7fca630c6b80 1 --2- 172.21.15.87:0/4018707536 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55e183658e10 0x55e183659270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:31:31.146 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:31.138+0000 7fca630c6b80 1 --2- 172.21.15.87:0/4018707536 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55e18365e1d0 0x55e18365e5b0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:31:31.146 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:31.138+0000 7fca630c6b80 1 --2- 172.21.15.87:0/4018707536 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e18365eaf0 0x55e1836587f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:31:31.146 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:31.138+0000 7fca630c6b80 1 -- 172.21.15.87:0/4018707536 >> 172.21.15.87:0/4018707536 conn(0x55e18357eb60 msgr2=0x55e18364a9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:31:31.147 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:31.138+0000 7fca630c6b80 1 -- 172.21.15.87:0/4018707536 shutdown_connections 2024-05-08T05:31:31.147 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:31.138+0000 7fca630c6b80 1 -- 172.21.15.87:0/4018707536 wait complete. 2024-05-08T05:31:31.147 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:31.139+0000 7fca630c6b80 1 -- start start 2024-05-08T05:31:31.147 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:31.139+0000 7fca630c6b80 1 Processor -- start 2024-05-08T05:31:31.147 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:31.140+0000 7fca630c6b80 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55e183658e10 0x55e183664720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:31:31.147 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:31.140+0000 7fca630c6b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55e18365e1d0 0x55e183661ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:31:31.147 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:31.140+0000 7fca630c6b80 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e18365eaf0 0x55e183662000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:31:31.147 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:31.140+0000 7fca630c6b80 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x55e183665590 con 0x55e18365eaf0 2024-05-08T05:31:31.148 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:31.140+0000 7fca630c6b80 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x55e183508b20 con 0x55e183658e10 2024-05-08T05:31:31.148 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:31.140+0000 7fca630c6b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x55e183665710 con 0x55e18365e1d0 2024-05-08T05:31:31.148 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:31.140+0000 7fca630c6b80 10 client.0 _ll_register_callbacks cb 0x55e183549c70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T05:31:31.148 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:31.140+0000 7fca55e00700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55e183658e10 0x55e183664720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:31:31.148 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:31.140+0000 7fca55e00700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55e183658e10 0x55e183664720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.87:41208/0 (socket says 172.21.15.87:41208) 2024-05-08T05:31:31.148 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:31.140+0000 7fca55e00700 1 -- 172.21.15.87:0/2652635269 learned_addr learned my addr 172.21.15.87:0/2652635269 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T05:31:31.148 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:31.140+0000 7fca56800700 1 --2- 172.21.15.87:0/2652635269 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e18365eaf0 0x55e183662000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:31:31.148 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:31.140+0000 7fca55400700 1 --2- 172.21.15.87:0/2652635269 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55e18365e1d0 0x55e183661ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:31:31.148 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:31.140+0000 7fca55400700 1 -- 172.21.15.87:0/2652635269 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55e183658e10 msgr2=0x55e183664720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:31:31.148 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:31.140+0000 7fca55400700 1 --2- 172.21.15.87:0/2652635269 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55e183658e10 0x55e183664720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:31:31.149 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:31.140+0000 7fca55400700 1 -- 172.21.15.87:0/2652635269 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e18365eaf0 msgr2=0x55e183662000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:31:31.149 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:31.140+0000 7fca55400700 1 --2- 172.21.15.87:0/2652635269 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e18365eaf0 0x55e183662000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:31:31.149 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:31.140+0000 7fca55400700 1 -- 172.21.15.87:0/2652635269 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e183568420 con 0x55e18365e1d0 2024-05-08T05:31:31.149 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:31.141+0000 7fca55400700 1 --2- 172.21.15.87:0/2652635269 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55e18365e1d0 0x55e183661ac0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fca5019d310 tx=0x7fca400047c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e7e671f274efc79b server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:31:31.149 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:31.141+0000 7fca33e00700 10 client.0 ms_handle_connect on v2:172.21.15.160:3300/0 2024-05-08T05:31:31.149 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:31.141+0000 7fca33e00700 1 -- 172.21.15.87:0/2652635269 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca4001cb90 con 0x55e18365e1d0 2024-05-08T05:31:31.149 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:31.141+0000 7fca630c6b80 1 -- 172.21.15.87:0/2652635269 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fca4c003a00 con 0x55e18365e1d0 2024-05-08T05:31:31.149 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:31.141+0000 7fca33e00700 1 -- 172.21.15.87:0/2652635269 <== mon.1 v2:172.21.15.160:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8190+0+0 (secure 0 0 0) 0x7fca4001cd30 con 0x55e18365e1d0 2024-05-08T05:31:31.150 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:31.142+0000 7fca33e00700 1 -- 172.21.15.87:0/2652635269 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fca40040070 con 0x55e18365e1d0 2024-05-08T05:31:31.150 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:31.142+0000 7fca630c6b80 10 client.25414 fetch_fsmap learned FSMap version 25 2024-05-08T05:31:31.150 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:31.142+0000 7fca630c6b80 1 -- 172.21.15.87:0/2652635269 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55e183650090 con 0x55e18365e1d0 2024-05-08T05:31:31.150 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:31.142+0000 7fca33e00700 1 -- 172.21.15.87:0/2652635269 <== mon.1 v2:172.21.15.160:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fca4c003a00 con 0x55e18365e1d0 2024-05-08T05:31:31.150 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:31.142+0000 7fca33e00700 1 -- 172.21.15.87:0/2652635269 <== mon.1 v2:172.21.15.160:3300/0 5 ==== fsmap(e 25) ==== 8338+0+0 (secure 0 0 0) 0x7fca4002e420 con 0x55e18365e1d0 2024-05-08T05:31:31.150 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:31.142+0000 7fca630c6b80 10 client.25414 fetch_fsmap finished waiting for FSMap version 25 2024-05-08T05:31:31.151 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:31.142+0000 7fca630c6b80 10 client.25414 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.i 2024-05-08T05:31:31.151 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:31.142+0000 7fca630c6b80 20 client.25414 populate_metadata read hostname 'smithi087' 2024-05-08T05:31:31.151 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:31.142+0000 7fca630c6b80 1 --2- 172.21.15.87:0/2652635269 >> [v2:172.21.15.160:6838/234657686,v1:172.21.15.160:6839/234657686] conn(0x55e183652620 0x55e183654a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:31:31.151 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:31.142+0000 7fca630c6b80 4 client.25414 mds_command: new command op to 24481 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-08T05:31:31.151 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:31.142+0000 7fca630c6b80 1 -- 172.21.15.87:0/2652635269 --> [v2:172.21.15.160:6838/234657686,v1:172.21.15.160:6839/234657686] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e18361d0a0 con 0x55e183652620 2024-05-08T05:31:31.151 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:31.143+0000 7fca55e00700 1 --2- 172.21.15.87:0/2652635269 >> [v2:172.21.15.160:6838/234657686,v1:172.21.15.160:6839/234657686] conn(0x55e183652620 0x55e183654a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:31:31.152 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:31.143+0000 7fca55e00700 1 --2- 172.21.15.87:0/2652635269 >> [v2:172.21.15.160:6838/234657686,v1:172.21.15.160:6839/234657686] conn(0x55e183652620 0x55e183654a40 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=33e8eb8fb1df802c server_cookie=2498f7c4db1fd7 in_seq=0 out_seq=0 2024-05-08T05:31:31.152 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:31.143+0000 7fca33e00700 10 client.25414 ms_handle_connect on v2:172.21.15.160:6838/234657686 2024-05-08T05:31:31.153 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:31.144+0000 7fca33e00700 1 -- 172.21.15.87:0/2652635269 <== mds.2 v2:172.21.15.160:6838/234657686 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55e18361d0a0 con 0x55e183652620 2024-05-08T05:31:31.154 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:31.144+0000 7fca33e00700 10 client.25414 handle_command_reply: tid=0 2024-05-08T05:31:31.154 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:31.144+0000 7fca630c6b80 1 client.25414 shutdown 2024-05-08T05:31:31.154 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:31.145+0000 7fca630c6b80 1 -- 172.21.15.87:0/2652635269 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55e18365e1d0 msgr2=0x55e183661ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:31:31.154 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:31.145+0000 7fca630c6b80 1 --2- 172.21.15.87:0/2652635269 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55e18365e1d0 0x55e183661ac0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fca5019d310 tx=0x7fca400047c0 comp rx=0 tx=0).stop 2024-05-08T05:31:31.154 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:31.145+0000 7fca630c6b80 1 -- 172.21.15.87:0/2652635269 shutdown_connections 2024-05-08T05:31:31.155 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:31.145+0000 7fca630c6b80 1 --2- 172.21.15.87:0/2652635269 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e18365eaf0 0x55e183662000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:31:31.155 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:31.145+0000 7fca630c6b80 1 --2- 172.21.15.87:0/2652635269 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55e183658e10 0x55e183664720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:31:31.155 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:31.145+0000 7fca630c6b80 1 --2- 172.21.15.87:0/2652635269 >> [v2:172.21.15.160:6838/234657686,v1:172.21.15.160:6839/234657686] conn(0x55e183652620 0x55e183654a40 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:31:31.155 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:31.145+0000 7fca630c6b80 1 --2- 172.21.15.87:0/2652635269 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55e18365e1d0 0x55e183661ac0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:31:31.155 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:31.145+0000 7fca630c6b80 1 -- 172.21.15.87:0/2652635269 >> 172.21.15.87:0/2652635269 conn(0x55e18357eb60 msgr2=0x55e183645460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:31:31.155 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:31.145+0000 7fca33e00700 0 client.25414 ms_handle_reset on v2:172.21.15.160:6838/234657686 2024-05-08T05:31:31.155 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:31.146+0000 7fca630c6b80 1 -- 172.21.15.87:0/2652635269 shutdown_connections 2024-05-08T05:31:31.156 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:31.146+0000 7fca630c6b80 1 -- 172.21.15.87:0/2652635269 wait complete. 2024-05-08T05:31:31.156 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:31.146+0000 7fca630c6b80 20 client.25414 trim_cache size 0 max 16384 2024-05-08T05:31:31.163 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:31.163+0000 7fca630c6b80 1 Processor -- start 2024-05-08T05:31:31.163 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:31.163+0000 7fca630c6b80 1 -- start start 2024-05-08T05:31:31.164 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:31.163+0000 7fca630c6b80 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55e183658e10 0x55e18365f760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:31:31.165 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:31.164+0000 7fca630c6b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55e18365e1d0 0x55e183658330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:31:31.165 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:31.164+0000 7fca630c6b80 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e18365eaf0 0x55e1836452e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:31:31.165 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:31.164+0000 7fca630c6b80 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fca501ae090 con 0x55e18365eaf0 2024-05-08T05:31:31.165 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:31.164+0000 7fca630c6b80 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fca501ab920 con 0x55e183658e10 2024-05-08T05:31:31.165 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:31.164+0000 7fca630c6b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7fca50108540 con 0x55e18365e1d0 2024-05-08T05:31:31.165 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:31.164+0000 7fca55e00700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55e183658e10 0x55e18365f760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:31:31.165 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:31.164+0000 7fca55e00700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55e183658e10 0x55e18365f760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.87:41222/0 (socket says 172.21.15.87:41222) 2024-05-08T05:31:31.165 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:31.164+0000 7fca55e00700 1 -- 172.21.15.87:0/2438913942 learned_addr learned my addr 172.21.15.87:0/2438913942 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T05:31:31.165 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:31.164+0000 7fca55400700 1 --2- 172.21.15.87:0/2438913942 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55e18365e1d0 0x55e183658330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:31:31.165 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:31.164+0000 7fca56800700 1 --2- 172.21.15.87:0/2438913942 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e18365eaf0 0x55e1836452e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:31:31.165 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:31.164+0000 7fca55e00700 1 -- 172.21.15.87:0/2438913942 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55e18365e1d0 msgr2=0x55e183658330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:31:31.166 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:31.164+0000 7fca55e00700 1 --2- 172.21.15.87:0/2438913942 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55e18365e1d0 0x55e183658330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:31:31.166 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:31.164+0000 7fca55e00700 1 -- 172.21.15.87:0/2438913942 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e18365eaf0 msgr2=0x55e1836452e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:31:31.166 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:31.164+0000 7fca55e00700 1 --2- 172.21.15.87:0/2438913942 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e18365eaf0 0x55e1836452e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:31:31.166 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:31.164+0000 7fca55e00700 1 -- 172.21.15.87:0/2438913942 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e183662860 con 0x55e183658e10 2024-05-08T05:31:31.166 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:31.164+0000 7fca55400700 1 --2- 172.21.15.87:0/2438913942 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55e18365e1d0 0x55e183658330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T05:31:31.166 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:31.165+0000 7fca55e00700 1 --2- 172.21.15.87:0/2438913942 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55e183658e10 0x55e18365f760 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fca44005950 tx=0x7fca440b1040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=53553e71b599bf08 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:31:31.167 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:31.165+0000 7fca3ea00700 1 -- 172.21.15.87:0/2438913942 <== mon.2 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca440cd0b0 con 0x55e183658e10 2024-05-08T05:31:31.167 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:31.165+0000 7fca3ea00700 1 -- 172.21.15.87:0/2438913942 <== mon.2 v2:172.21.15.90:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fca440aa300 con 0x55e183658e10 2024-05-08T05:31:31.167 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:31.165+0000 7fca3ea00700 1 -- 172.21.15.87:0/2438913942 <== mon.2 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca4400b710 con 0x55e183658e10 2024-05-08T05:31:31.167 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:31.166+0000 7fca630c6b80 1 -- 172.21.15.87:0/2438913942 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55e183658e10 msgr2=0x55e18365f760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:31:31.168 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:31.166+0000 7fca630c6b80 1 --2- 172.21.15.87:0/2438913942 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55e183658e10 0x55e18365f760 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fca44005950 tx=0x7fca440b1040 comp rx=0 tx=0).stop 2024-05-08T05:31:31.168 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:31.166+0000 7fca630c6b80 1 -- 172.21.15.87:0/2438913942 shutdown_connections 2024-05-08T05:31:31.168 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:31.166+0000 7fca630c6b80 1 --2- 172.21.15.87:0/2438913942 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e18365eaf0 0x55e1836452e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:31:31.168 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:31.166+0000 7fca630c6b80 1 --2- 172.21.15.87:0/2438913942 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55e183658e10 0x55e18365f760 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:31:31.168 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:31.166+0000 7fca630c6b80 1 --2- 172.21.15.87:0/2438913942 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55e18365e1d0 0x55e183658330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:31:31.169 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:31.166+0000 7fca630c6b80 1 -- 172.21.15.87:0/2438913942 >> 172.21.15.87:0/2438913942 conn(0x55e18357eb60 msgr2=0x55e183644bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:31:31.169 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:31.166+0000 7fca630c6b80 1 -- 172.21.15.87:0/2438913942 shutdown_connections 2024-05-08T05:31:31.169 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:31.166+0000 7fca630c6b80 1 -- 172.21.15.87:0/2438913942 wait complete. 2024-05-08T05:31:31.169 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:31.167+0000 7fca630c6b80 1 -- start start 2024-05-08T05:31:31.169 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:31.167+0000 7fca630c6b80 1 Processor -- start 2024-05-08T05:31:31.175 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:31.167+0000 7fca630c6b80 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55e183658e10 0x55e183674ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:31:31.176 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:31.167+0000 7fca630c6b80 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e18365e1d0 0x55e183673270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:31:31.176 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:31.167+0000 7fca630c6b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55e18365eaf0 0x55e1836737b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:31:31.176 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:31.167+0000 7fca630c6b80 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fca501a9e10 con 0x55e18365e1d0 2024-05-08T05:31:31.176 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:31.167+0000 7fca630c6b80 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fca501ab250 con 0x55e183658e10 2024-05-08T05:31:31.176 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:31.167+0000 7fca630c6b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7fca501aa4b0 con 0x55e18365eaf0 2024-05-08T05:31:31.176 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:31.167+0000 7fca630c6b80 10 client.0 _ll_register_callbacks cb 0x55e183549c70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T05:31:31.177 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:31.168+0000 7fca55e00700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55e183658e10 0x55e183674ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:31:31.177 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:31.168+0000 7fca55e00700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55e183658e10 0x55e183674ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.87:41234/0 (socket says 172.21.15.87:41234) 2024-05-08T05:31:31.177 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:31.168+0000 7fca55e00700 1 -- 172.21.15.87:0/3568326102 learned_addr learned my addr 172.21.15.87:0/3568326102 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T05:31:31.177 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:31.168+0000 7fca55400700 1 --2- 172.21.15.87:0/3568326102 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e18365e1d0 0x55e183673270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:31:31.177 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:31.168+0000 7fca56800700 1 --2- 172.21.15.87:0/3568326102 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55e18365eaf0 0x55e1836737b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:31:31.177 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:31.168+0000 7fca55e00700 1 -- 172.21.15.87:0/3568326102 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55e18365eaf0 msgr2=0x55e1836737b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:31:31.178 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:31.168+0000 7fca55e00700 1 --2- 172.21.15.87:0/3568326102 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55e18365eaf0 0x55e1836737b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:31:31.178 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:31.168+0000 7fca55e00700 1 -- 172.21.15.87:0/3568326102 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e18365e1d0 msgr2=0x55e183673270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:31:31.178 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:31.168+0000 7fca55e00700 1 --2- 172.21.15.87:0/3568326102 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e18365e1d0 0x55e183673270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:31:31.178 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:31.168+0000 7fca55e00700 1 -- 172.21.15.87:0/3568326102 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e183673cf0 con 0x55e183658e10 2024-05-08T05:31:31.178 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:31.168+0000 7fca55e00700 1 --2- 172.21.15.87:0/3568326102 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55e183658e10 0x55e183674ec0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fca440098c0 tx=0x7fca4400b9a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=eabeaeb06e869372 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:31:31.178 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:31.168+0000 7fca33e00700 10 client.0 ms_handle_connect on v2:172.21.15.90:3300/0 2024-05-08T05:31:31.179 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:31.168+0000 7fca33e00700 1 -- 172.21.15.87:0/3568326102 <== mon.2 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca440cd0b0 con 0x55e183658e10 2024-05-08T05:31:31.179 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:31.169+0000 7fca33e00700 1 -- 172.21.15.87:0/3568326102 <== mon.2 v2:172.21.15.90:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8190+0+0 (secure 0 0 0) 0x7fca440a6de0 con 0x55e183658e10 2024-05-08T05:31:31.179 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:31.169+0000 7fca630c6b80 1 -- 172.21.15.87:0/3568326102 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fca440aa300 con 0x55e183658e10 2024-05-08T05:31:31.179 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:31.169+0000 7fca33e00700 1 -- 172.21.15.87:0/3568326102 <== mon.2 v2:172.21.15.90:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fca440b35c0 con 0x55e183658e10 2024-05-08T05:31:31.179 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:31.169+0000 7fca630c6b80 10 client.25412 fetch_fsmap learned FSMap version 25 2024-05-08T05:31:31.179 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:31.169+0000 7fca630c6b80 1 -- 172.21.15.87:0/3568326102 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55e1836d4560 con 0x55e183658e10 2024-05-08T05:31:31.179 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:31.169+0000 7fca33e00700 1 -- 172.21.15.87:0/3568326102 <== mon.2 v2:172.21.15.90:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fca440aa300 con 0x55e183658e10 2024-05-08T05:31:31.180 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:31.169+0000 7fca33e00700 1 -- 172.21.15.87:0/3568326102 <== mon.2 v2:172.21.15.90:3300/0 5 ==== fsmap(e 25) ==== 8338+0+0 (secure 0 0 0) 0x7fca440b3130 con 0x55e183658e10 2024-05-08T05:31:31.180 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:31.169+0000 7fca630c6b80 10 client.25412 fetch_fsmap finished waiting for FSMap version 25 2024-05-08T05:31:31.180 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:31.169+0000 7fca630c6b80 10 client.25412 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.i 2024-05-08T05:31:31.180 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:31.169+0000 7fca630c6b80 20 client.25412 populate_metadata read hostname 'smithi087' 2024-05-08T05:31:31.180 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:31.169+0000 7fca630c6b80 1 --2- 172.21.15.87:0/3568326102 >> [v2:172.21.15.160:6838/234657686,v1:172.21.15.160:6839/234657686] conn(0x55e1836d4a30 0x55e1836d6e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:31:31.180 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:31.169+0000 7fca630c6b80 4 client.25412 mds_command: new command op to 24481 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-05-08T05:31:31.180 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:31.169+0000 7fca630c6b80 1 -- 172.21.15.87:0/3568326102 --> [v2:172.21.15.160:6838/234657686,v1:172.21.15.160:6839/234657686] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55e1835b0400 con 0x55e1836d4a30 2024-05-08T05:31:31.181 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:31.170+0000 7fca55400700 1 --2- 172.21.15.87:0/3568326102 >> [v2:172.21.15.160:6838/234657686,v1:172.21.15.160:6839/234657686] conn(0x55e1836d4a30 0x55e1836d6e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:31:31.181 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:31.170+0000 7fca55400700 1 --2- 172.21.15.87:0/3568326102 >> [v2:172.21.15.160:6838/234657686,v1:172.21.15.160:6839/234657686] conn(0x55e1836d4a30 0x55e1836d6e50 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=5c2bc5958ac402db server_cookie=f2ff1756c6b3db2 in_seq=0 out_seq=0 2024-05-08T05:31:31.181 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:31.170+0000 7fca33e00700 10 client.25412 ms_handle_connect on v2:172.21.15.160:6838/234657686 2024-05-08T05:31:31.181 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:31.171+0000 7fca33e00700 1 -- 172.21.15.87:0/3568326102 <== mds.2 v2:172.21.15.160:6838/234657686 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55e1835b0400 con 0x55e1836d4a30 2024-05-08T05:31:31.181 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:31.171+0000 7fca33e00700 10 client.25412 handle_command_reply: tid=0 2024-05-08T05:31:31.181 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:31.171+0000 7fca630c6b80 1 client.25412 shutdown 2024-05-08T05:31:31.181 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:31.171+0000 7fca630c6b80 1 -- 172.21.15.87:0/3568326102 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55e183658e10 msgr2=0x55e183674ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:31:31.181 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:31.171+0000 7fca630c6b80 1 --2- 172.21.15.87:0/3568326102 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55e183658e10 0x55e183674ec0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fca440098c0 tx=0x7fca4400b9a0 comp rx=0 tx=0).stop 2024-05-08T05:31:31.182 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:31.171+0000 7fca630c6b80 1 -- 172.21.15.87:0/3568326102 shutdown_connections 2024-05-08T05:31:31.182 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:31.171+0000 7fca630c6b80 1 --2- 172.21.15.87:0/3568326102 >> [v2:172.21.15.160:6838/234657686,v1:172.21.15.160:6839/234657686] conn(0x55e1836d4a30 0x55e1836d6e50 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:31:31.182 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:31.171+0000 7fca630c6b80 1 --2- 172.21.15.87:0/3568326102 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55e18365eaf0 0x55e1836737b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:31:31.182 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:31.171+0000 7fca630c6b80 1 --2- 172.21.15.87:0/3568326102 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55e183658e10 0x55e183674ec0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:31:31.182 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:31.171+0000 7fca630c6b80 1 --2- 172.21.15.87:0/3568326102 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e18365e1d0 0x55e183673270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:31:31.182 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:31.171+0000 7fca630c6b80 1 -- 172.21.15.87:0/3568326102 >> 172.21.15.87:0/3568326102 conn(0x55e18357eb60 msgr2=0x55e183645460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:31:31.182 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:31.171+0000 7fca33e00700 0 client.25412 ms_handle_reset on v2:172.21.15.160:6838/234657686 2024-05-08T05:31:31.183 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:31.171+0000 7fca630c6b80 1 -- 172.21.15.87:0/3568326102 shutdown_connections 2024-05-08T05:31:31.183 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:31.171+0000 7fca630c6b80 1 -- 172.21.15.87:0/3568326102 wait complete. 2024-05-08T05:31:31.183 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:31.171+0000 7fca630c6b80 20 client.25412 trim_cache size 0 max 16384 2024-05-08T05:31:31.183 INFO:teuthology.orchestra.run.smithi087.stdout:[] 2024-05-08T05:31:31.184 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:31.172+0000 7fca57200700 1 -- 172.21.15.87:0/1175640246 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7fca380b2900 msgr2=0x7fca380b4dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:31:31.185 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:31.172+0000 7fca57200700 1 --2- 172.21.15.87:0/1175640246 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7fca380b2900 0x7fca380b4dc0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fca40009750 tx=0x7fca40009310 comp rx=0 tx=0).stop 2024-05-08T05:31:31.185 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:31.172+0000 7fca57200700 1 -- 172.21.15.87:0/1175640246 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fca5006bf50 msgr2=0x7fca501a1a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:31:31.185 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:31.172+0000 7fca57200700 1 --2- 172.21.15.87:0/1175640246 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fca5006bf50 0x7fca501a1a60 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fca44009230 tx=0x7fca4400fa70 comp rx=0 tx=0).stop 2024-05-08T05:31:31.185 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:31.172+0000 7fca57200700 1 -- 172.21.15.87:0/1175640246 shutdown_connections 2024-05-08T05:31:31.185 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:31.172+0000 7fca57200700 1 --2- 172.21.15.87:0/1175640246 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7fca380b2900 0x7fca380b4dc0 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:31:31.185 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:31.172+0000 7fca57200700 1 --2- 172.21.15.87:0/1175640246 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fca5010fc60 0x7fca5019bb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:31:31.186 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:31.172+0000 7fca57200700 1 --2- 172.21.15.87:0/1175640246 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fca5006bf50 0x7fca501a1a60 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:31:31.186 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:31.172+0000 7fca57200700 1 --2- 172.21.15.87:0/1175640246 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fca50104360 0x7fca501a1fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:31:31.186 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:31.172+0000 7fca57200700 1 -- 172.21.15.87:0/1175640246 >> 172.21.15.87:0/1175640246 conn(0x7fca500791e0 msgr2=0x7fca50101550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:31:31.186 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:31.173+0000 7fca57200700 1 -- 172.21.15.87:0/1175640246 shutdown_connections 2024-05-08T05:31:31.186 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:31.173+0000 7fca57200700 1 -- 172.21.15.87:0/1175640246 wait complete. 2024-05-08T05:31:32.076 DEBUG:teuthology.orchestra.run.smithi087:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid eeeb813e-0cf9-11ef-bc97-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-05-08T05:31:32.458 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:31:32 smithi087 ceph-mon[29523]: pgmap v496: 97 pgs: 97 active+clean; 2.1 MiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 90 KiB/s rd, 128 KiB/s wr, 6 op/s 2024-05-08T05:31:32.483 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:31:32 smithi090 ceph-mon[34526]: pgmap v496: 97 pgs: 97 active+clean; 2.1 MiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 90 KiB/s rd, 128 KiB/s wr, 6 op/s 2024-05-08T05:31:32.523 INFO:teuthology.orchestra.run.smithi087.stderr:Inferring config /var/lib/ceph/eeeb813e-0cf9-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T05:31:32.538 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:31:32 smithi160 ceph-mon[34827]: pgmap v496: 97 pgs: 97 active+clean; 2.1 MiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 90 KiB/s rd, 128 KiB/s wr, 6 op/s 2024-05-08T05:31:34.442 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:31:34 smithi087 ceph-mon[29523]: pgmap v497: 97 pgs: 97 active+clean; 7.8 MiB data, 392 MiB used, 1.0 TiB / 1.0 TiB avail; 220 KiB/s rd, 657 KiB/s wr, 23 op/s 2024-05-08T05:31:34.483 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:31:34 smithi090 ceph-mon[34526]: pgmap v497: 97 pgs: 97 active+clean; 7.8 MiB data, 392 MiB used, 1.0 TiB / 1.0 TiB avail; 220 KiB/s rd, 657 KiB/s wr, 23 op/s 2024-05-08T05:31:34.538 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:31:34 smithi160 ceph-mon[34827]: pgmap v497: 97 pgs: 97 active+clean; 7.8 MiB data, 392 MiB used, 1.0 TiB / 1.0 TiB avail; 220 KiB/s rd, 657 KiB/s wr, 23 op/s 2024-05-08T05:31:34.743 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:34.742+0000 7f7afac00700 1 -- 172.21.15.87:0/552765815 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7af410ff50 msgr2=0x7f7af4112340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:31:34.743 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:34.742+0000 7f7afac00700 1 --2- 172.21.15.87:0/552765815 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7af410ff50 0x7f7af4112340 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f7aec00b0a0 tx=0x7f7aec00b3b0 comp rx=0 tx=0).stop 2024-05-08T05:31:34.743 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:34.742+0000 7f7afac00700 1 -- 172.21.15.87:0/552765815 shutdown_connections 2024-05-08T05:31:34.744 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:34.742+0000 7f7afac00700 1 --2- 172.21.15.87:0/552765815 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7af410ff50 0x7f7af4112340 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:31:34.744 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:34.742+0000 7f7afac00700 1 --2- 172.21.15.87:0/552765815 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7af406b1b0 0x7f7af406b590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:31:34.744 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:34.742+0000 7f7afac00700 1 --2- 172.21.15.87:0/552765815 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7af406bad0 0x7f7af410fa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:31:34.744 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:34.742+0000 7f7afac00700 1 -- 172.21.15.87:0/552765815 >> 172.21.15.87:0/552765815 conn(0x7f7af4079350 msgr2=0x7f7af4079760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:31:34.744 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:34.742+0000 7f7afac00700 1 -- 172.21.15.87:0/552765815 shutdown_connections 2024-05-08T05:31:34.744 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:34.743+0000 7f7afac00700 1 -- 172.21.15.87:0/552765815 wait complete. 2024-05-08T05:31:34.745 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:34.744+0000 7f7afac00700 1 Processor -- start 2024-05-08T05:31:34.745 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:34.744+0000 7f7afac00700 1 -- start start 2024-05-08T05:31:34.745 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:34.744+0000 7f7afac00700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7af406b1b0 0x7f7af419be30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:31:34.745 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:34.744+0000 7f7afac00700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7af406bad0 0x7f7af419c370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:31:34.745 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:34.744+0000 7f7afac00700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7af410ff50 0x7f7af41a06b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:31:34.745 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:34.744+0000 7f7afac00700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f7af41158c0 con 0x7f7af410ff50 2024-05-08T05:31:34.745 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:34.744+0000 7f7afac00700 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f7af4115740 con 0x7f7af406bad0 2024-05-08T05:31:34.746 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:34.744+0000 7f7afac00700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f7af4115a40 con 0x7f7af406b1b0 2024-05-08T05:31:34.746 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:34.745+0000 7f7aeb400700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7af406bad0 0x7f7af419c370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:31:34.746 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:34.745+0000 7f7aeb400700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7af406bad0 0x7f7af419c370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.87:41250/0 (socket says 172.21.15.87:41250) 2024-05-08T05:31:34.746 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:34.745+0000 7f7af8c00700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7af410ff50 0x7f7af41a06b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:31:34.746 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:34.745+0000 7f7aeb400700 1 -- 172.21.15.87:0/2641972869 learned_addr learned my addr 172.21.15.87:0/2641972869 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T05:31:34.746 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:34.745+0000 7f7af3e00700 1 --2- 172.21.15.87:0/2641972869 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7af406b1b0 0x7f7af419be30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:31:34.747 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:34.745+0000 7f7aeb400700 1 -- 172.21.15.87:0/2641972869 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7af406b1b0 msgr2=0x7f7af419be30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:31:34.747 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:34.745+0000 7f7aeb400700 1 --2- 172.21.15.87:0/2641972869 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7af406b1b0 0x7f7af419be30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:31:34.747 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:34.745+0000 7f7aeb400700 1 -- 172.21.15.87:0/2641972869 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7af410ff50 msgr2=0x7f7af41a06b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:31:34.747 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:34.745+0000 7f7aeb400700 1 --2- 172.21.15.87:0/2641972869 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7af410ff50 0x7f7af41a06b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:31:34.747 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:34.745+0000 7f7aeb400700 1 -- 172.21.15.87:0/2641972869 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7af41a0df0 con 0x7f7af406bad0 2024-05-08T05:31:34.747 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:34.745+0000 7f7af3e00700 1 --2- 172.21.15.87:0/2641972869 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7af406b1b0 0x7f7af419be30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T05:31:34.747 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:34.745+0000 7f7aeb400700 1 --2- 172.21.15.87:0/2641972869 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7af406bad0 0x7f7af419c370 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f7adc00d980 tx=0x7f7adc00dc90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:31:34.747 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:34.746+0000 7f7af1600700 1 -- 172.21.15.87:0/2641972869 <== mon.2 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7adc017070 con 0x7f7af406bad0 2024-05-08T05:31:34.747 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:34.746+0000 7f7af1600700 1 -- 172.21.15.87:0/2641972869 <== mon.2 v2:172.21.15.90:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7adc005020 con 0x7f7af406bad0 2024-05-08T05:31:34.747 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:34.746+0000 7f7afac00700 1 -- 172.21.15.87:0/2641972869 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7af41a10e0 con 0x7f7af406bad0 2024-05-08T05:31:34.747 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:34.746+0000 7f7af1600700 1 -- 172.21.15.87:0/2641972869 <== mon.2 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7adc009b50 con 0x7f7af406bad0 2024-05-08T05:31:34.748 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:34.746+0000 7f7afac00700 1 -- 172.21.15.87:0/2641972869 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7af41a8960 con 0x7f7af406bad0 2024-05-08T05:31:34.749 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:34.749+0000 7f7af1600700 1 -- 172.21.15.87:0/2641972869 <== mon.2 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7f7adc0051d0 con 0x7f7af406bad0 2024-05-08T05:31:34.750 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:34.750+0000 7f7b05553b80 1 Processor -- start 2024-05-08T05:31:34.751 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:34.750+0000 7f7b05553b80 1 -- start start 2024-05-08T05:31:34.752 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:34.751+0000 7f7b05553b80 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x556194384060 0x556194384440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:31:34.752 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:34.751+0000 7f7b05553b80 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x556194384980 0x556194388490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:31:34.752 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:34.751+0000 7f7b05553b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5561943889d0 0x556194388e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:31:34.752 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:34.751+0000 7f7b05553b80 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x5561942d6a20 con 0x556194384060 2024-05-08T05:31:34.752 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:34.751+0000 7f7b05553b80 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x556194274760 con 0x556194384980 2024-05-08T05:31:34.752 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:34.751+0000 7f7b05553b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x5561942d29e0 con 0x5561943889d0 2024-05-08T05:31:34.752 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:34.751+0000 7f7af1600700 1 --2- 172.21.15.87:0/2641972869 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f7ad80b2900 0x7f7ad80b4dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:31:34.752 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:34.751+0000 7f7af1600700 1 -- 172.21.15.87:0/2641972869 <== mon.2 v2:172.21.15.90:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8190+0+0 (secure 0 0 0) 0x7f7adc0e2040 con 0x7f7af406bad0 2024-05-08T05:31:34.752 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:34.751+0000 7f7af3e00700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x556194384980 0x556194388490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:31:34.752 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:34.751+0000 7f7af3e00700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x556194384980 0x556194388490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.87:41266/0 (socket says 172.21.15.87:41266) 2024-05-08T05:31:34.753 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:34.751+0000 7f7af3e00700 1 -- 172.21.15.87:0/3402146614 learned_addr learned my addr 172.21.15.87:0/3402146614 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T05:31:34.753 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:34.751+0000 7f7af8c00700 1 --2- 172.21.15.87:0/3402146614 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x556194384060 0x556194384440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:31:34.753 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:34.751+0000 7f7aeb400700 1 --2- 172.21.15.87:0/3402146614 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5561943889d0 0x556194388e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:31:34.753 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:34.751+0000 7f7af8c00700 1 --2- 172.21.15.87:0/2641972869 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f7ad80b2900 0x7f7ad80b4dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:31:34.753 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:34.752+0000 7f7af3e00700 1 -- 172.21.15.87:0/3402146614 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5561943889d0 msgr2=0x556194388e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:31:34.753 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:34.752+0000 7f7af3e00700 1 --2- 172.21.15.87:0/3402146614 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5561943889d0 0x556194388e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:31:34.753 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:34.752+0000 7f7af3e00700 1 -- 172.21.15.87:0/3402146614 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x556194384060 msgr2=0x556194384440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:31:34.753 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:34.752+0000 7f7af3e00700 1 --2- 172.21.15.87:0/3402146614 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x556194384060 0x556194384440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:31:34.753 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:34.752+0000 7f7af3e00700 1 -- 172.21.15.87:0/3402146614 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5561942238d0 con 0x556194384980 2024-05-08T05:31:34.755 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:34.752+0000 7f7af3e00700 1 --2- 172.21.15.87:0/3402146614 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x556194384980 0x556194388490 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f7ae4009df0 tx=0x7f7ae40116c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f3be5036d813210e server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:31:34.755 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:34.752+0000 7f7af8c00700 1 --2- 172.21.15.87:0/2641972869 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f7ad80b2900 0x7f7ad80b4dc0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f7aec009fd0 tx=0x7f7aec006210 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:31:34.755 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:34.752+0000 7f7ae9600700 1 -- 172.21.15.87:0/3402146614 <== mon.2 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ae4011e20 con 0x556194384980 2024-05-08T05:31:34.755 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:34.752+0000 7f7ae9600700 1 -- 172.21.15.87:0/3402146614 <== mon.2 v2:172.21.15.90:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7ae4012900 con 0x556194384980 2024-05-08T05:31:34.755 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:34.752+0000 7f7ae9600700 1 -- 172.21.15.87:0/3402146614 <== mon.2 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ae400f900 con 0x556194384980 2024-05-08T05:31:34.755 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:34.753+0000 7f7b05553b80 1 -- 172.21.15.87:0/3402146614 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x556194384980 msgr2=0x556194388490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:31:34.755 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:34.753+0000 7f7b05553b80 1 --2- 172.21.15.87:0/3402146614 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x556194384980 0x556194388490 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f7ae4009df0 tx=0x7f7ae40116c0 comp rx=0 tx=0).stop 2024-05-08T05:31:34.756 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:34.753+0000 7f7b05553b80 1 -- 172.21.15.87:0/3402146614 shutdown_connections 2024-05-08T05:31:34.756 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:34.753+0000 7f7b05553b80 1 --2- 172.21.15.87:0/3402146614 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5561943889d0 0x556194388e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:31:34.756 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:34.753+0000 7f7b05553b80 1 --2- 172.21.15.87:0/3402146614 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x556194384060 0x556194384440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:31:34.756 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:34.753+0000 7f7b05553b80 1 --2- 172.21.15.87:0/3402146614 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x556194384980 0x556194388490 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:31:34.756 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:34.753+0000 7f7b05553b80 1 -- 172.21.15.87:0/3402146614 >> 172.21.15.87:0/3402146614 conn(0x5561942b2b60 msgr2=0x55619437e7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:31:34.756 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:34.753+0000 7f7b05553b80 1 -- 172.21.15.87:0/3402146614 shutdown_connections 2024-05-08T05:31:34.756 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:34.753+0000 7f7b05553b80 1 -- 172.21.15.87:0/3402146614 wait complete. 2024-05-08T05:31:34.756 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:34.754+0000 7f7b05553b80 1 -- start start 2024-05-08T05:31:34.756 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:34.754+0000 7f7b05553b80 1 Processor -- start 2024-05-08T05:31:34.756 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:34.755+0000 7f7b05553b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x556194384060 0x55619438fe70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:31:34.756 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:34.755+0000 7f7b05553b80 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x556194384980 0x55619438d210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:31:34.756 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:34.755+0000 7f7b05553b80 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5561943889d0 0x55619438d750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:31:34.756 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:34.755+0000 7f7b05553b80 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x556194390be0 con 0x556194384980 2024-05-08T05:31:34.756 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:34.755+0000 7f7b05553b80 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x55619423cb20 con 0x5561943889d0 2024-05-08T05:31:34.756 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:34.755+0000 7f7b05553b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x556194390d60 con 0x556194384060 2024-05-08T05:31:34.757 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:34.755+0000 7f7b05553b80 10 client.0 _ll_register_callbacks cb 0x55619427dc70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T05:31:34.759 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:34.755+0000 7f7af3e00700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x556194384060 0x55619438fe70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:31:34.759 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:34.755+0000 7f7aeb400700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x556194384980 0x55619438d210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:31:34.759 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:34.755+0000 7f7af3e00700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x556194384060 0x55619438fe70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.87:47126/0 (socket says 172.21.15.87:47126) 2024-05-08T05:31:34.759 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:34.755+0000 7f7af3e00700 1 -- 172.21.15.87:0/342298972 learned_addr learned my addr 172.21.15.87:0/342298972 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T05:31:34.759 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:34.755+0000 7f7af8c00700 1 --2- 172.21.15.87:0/342298972 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5561943889d0 0x55619438d750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:31:34.759 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:34.756+0000 7f7af8c00700 1 -- 172.21.15.87:0/342298972 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x556194384060 msgr2=0x55619438fe70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:31:34.759 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:34.756+0000 7f7af8c00700 1 --2- 172.21.15.87:0/342298972 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x556194384060 0x55619438fe70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:31:34.759 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:34.756+0000 7f7af8c00700 1 -- 172.21.15.87:0/342298972 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x556194384980 msgr2=0x55619438d210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:31:34.759 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:34.756+0000 7f7af8c00700 1 --2- 172.21.15.87:0/342298972 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x556194384980 0x55619438d210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:31:34.759 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:34.756+0000 7f7af8c00700 1 -- 172.21.15.87:0/342298972 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55619429c420 con 0x5561943889d0 2024-05-08T05:31:34.759 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:34.756+0000 7f7aeb400700 1 --2- 172.21.15.87:0/342298972 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x556194384980 0x55619438d210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T05:31:34.760 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:34.756+0000 7f7af8c00700 1 --2- 172.21.15.87:0/342298972 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5561943889d0 0x55619438d750 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f7aec00b070 tx=0x7f7aec0099e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b930aa176f1dfc71 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:31:34.760 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:34.756+0000 7f7ae2000700 10 client.0 ms_handle_connect on v2:172.21.15.90:3300/0 2024-05-08T05:31:34.760 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:34.756+0000 7f7ae2000700 1 -- 172.21.15.87:0/342298972 <== mon.2 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7aec031060 con 0x5561943889d0 2024-05-08T05:31:34.760 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:34.756+0000 7f7ae2000700 1 -- 172.21.15.87:0/342298972 <== mon.2 v2:172.21.15.90:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8190+0+0 (secure 0 0 0) 0x7f7aec021460 con 0x5561943889d0 2024-05-08T05:31:34.760 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:34.756+0000 7f7b05553b80 1 -- 172.21.15.87:0/342298972 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7ae4012900 con 0x5561943889d0 2024-05-08T05:31:34.760 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:34.757+0000 7f7ae2000700 1 -- 172.21.15.87:0/342298972 <== mon.2 v2:172.21.15.90:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f7aec025050 con 0x5561943889d0 2024-05-08T05:31:34.760 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:34.757+0000 7f7b05553b80 10 client.25424 fetch_fsmap learned FSMap version 25 2024-05-08T05:31:34.760 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:34.757+0000 7f7b05553b80 1 -- 172.21.15.87:0/342298972 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55619439b460 con 0x5561943889d0 2024-05-08T05:31:34.760 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:34.757+0000 7f7ae2000700 1 -- 172.21.15.87:0/342298972 <== mon.2 v2:172.21.15.90:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7ae4012900 con 0x5561943889d0 2024-05-08T05:31:34.760 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:34.757+0000 7f7ae2000700 1 -- 172.21.15.87:0/342298972 <== mon.2 v2:172.21.15.90:3300/0 5 ==== fsmap(e 25) ==== 8338+0+0 (secure 0 0 0) 0x7f7aec011070 con 0x5561943889d0 2024-05-08T05:31:34.760 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:34.757+0000 7f7b05553b80 10 client.25424 fetch_fsmap finished waiting for FSMap version 25 2024-05-08T05:31:34.760 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:34.757+0000 7f7b05553b80 10 client.25424 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.g 2024-05-08T05:31:34.760 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:34.757+0000 7f7b05553b80 20 client.25424 populate_metadata read hostname 'smithi087' 2024-05-08T05:31:34.760 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:34.757+0000 7f7b05553b80 1 --2- 172.21.15.87:0/342298972 >> [v2:172.21.15.87:6838/2127215876,v1:172.21.15.87:6839/2127215876] conn(0x55619439daa0 0x55619439fe90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:31:34.760 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:34.757+0000 7f7b05553b80 4 client.25424 mds_command: new command op to 24482 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-08T05:31:34.761 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:34.757+0000 7f7b05553b80 1 -- 172.21.15.87:0/342298972 --> [v2:172.21.15.87:6838/2127215876,v1:172.21.15.87:6839/2127215876] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5561943510a0 con 0x55619439daa0 2024-05-08T05:31:34.761 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:34.758+0000 7f7af3e00700 1 --2- 172.21.15.87:0/342298972 >> [v2:172.21.15.87:6838/2127215876,v1:172.21.15.87:6839/2127215876] conn(0x55619439daa0 0x55619439fe90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:31:34.761 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:34.759+0000 7f7ae2000700 10 client.25424 ms_handle_connect on v2:172.21.15.87:6838/2127215876 2024-05-08T05:31:34.761 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:34.759+0000 7f7af3e00700 1 --2- 172.21.15.87:0/342298972 >> [v2:172.21.15.87:6838/2127215876,v1:172.21.15.87:6839/2127215876] conn(0x55619439daa0 0x55619439fe90 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=31cbe358ba46f91b server_cookie=a951d7f0d32b37e3 in_seq=0 out_seq=0 2024-05-08T05:31:34.762 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:34.759+0000 7f7ae2000700 1 -- 172.21.15.87:0/342298972 <== mds.1 v2:172.21.15.87:6838/2127215876 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x5561943510a0 con 0x55619439daa0 2024-05-08T05:31:34.762 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:34.759+0000 7f7ae2000700 10 client.25424 handle_command_reply: tid=0 2024-05-08T05:31:34.762 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:34.760+0000 7f7b05553b80 1 client.25424 shutdown 2024-05-08T05:31:34.762 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:34.760+0000 7f7b05553b80 1 -- 172.21.15.87:0/342298972 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5561943889d0 msgr2=0x55619438d750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:31:34.762 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:34.760+0000 7f7b05553b80 1 --2- 172.21.15.87:0/342298972 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5561943889d0 0x55619438d750 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f7aec00b070 tx=0x7f7aec0099e0 comp rx=0 tx=0).stop 2024-05-08T05:31:34.762 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:34.760+0000 7f7b05553b80 1 -- 172.21.15.87:0/342298972 shutdown_connections 2024-05-08T05:31:34.762 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:34.760+0000 7f7b05553b80 1 --2- 172.21.15.87:0/342298972 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5561943889d0 0x55619438d750 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:31:34.762 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:34.760+0000 7f7b05553b80 1 --2- 172.21.15.87:0/342298972 >> [v2:172.21.15.87:6838/2127215876,v1:172.21.15.87:6839/2127215876] conn(0x55619439daa0 0x55619439fe90 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:31:34.762 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:34.760+0000 7f7b05553b80 1 --2- 172.21.15.87:0/342298972 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x556194384060 0x55619438fe70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:31:34.762 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:34.760+0000 7f7b05553b80 1 --2- 172.21.15.87:0/342298972 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x556194384980 0x55619438d210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:31:34.763 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:34.760+0000 7f7b05553b80 1 -- 172.21.15.87:0/342298972 >> 172.21.15.87:0/342298972 conn(0x5561942b2b60 msgr2=0x5561943792b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:31:34.763 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:34.760+0000 7f7ae2000700 0 client.25424 ms_handle_reset on v2:172.21.15.87:6838/2127215876 2024-05-08T05:31:34.763 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:34.760+0000 7f7b05553b80 1 -- 172.21.15.87:0/342298972 shutdown_connections 2024-05-08T05:31:34.763 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:34.760+0000 7f7b05553b80 1 -- 172.21.15.87:0/342298972 wait complete. 2024-05-08T05:31:34.763 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:34.760+0000 7f7b05553b80 20 client.25424 trim_cache size 0 max 16384 2024-05-08T05:31:34.778 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:34.778+0000 7f7b05553b80 1 Processor -- start 2024-05-08T05:31:34.779 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:34.778+0000 7f7b05553b80 1 -- start start 2024-05-08T05:31:34.779 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:34.779+0000 7f7b05553b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x556194384060 0x55619438ae20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:31:34.779 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:34.779+0000 7f7b05553b80 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x556194384980 0x556194399c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:31:34.779 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:34.779+0000 7f7b05553b80 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5561943889d0 0x5561943894c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:31:34.779 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:34.779+0000 7f7b05553b80 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f7af41b2540 con 0x556194384980 2024-05-08T05:31:34.779 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:34.779+0000 7f7b05553b80 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f7af41afdd0 con 0x5561943889d0 2024-05-08T05:31:34.780 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:34.779+0000 7f7b05553b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f7af41adc40 con 0x556194384060 2024-05-08T05:31:34.780 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:34.779+0000 7f7af8c00700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5561943889d0 0x5561943894c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:31:34.780 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:34.779+0000 7f7aeb400700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x556194384980 0x556194399c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:31:34.780 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:34.779+0000 7f7af8c00700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5561943889d0 0x5561943894c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.87:41286/0 (socket says 172.21.15.87:41286) 2024-05-08T05:31:34.780 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:34.779+0000 7f7af8c00700 1 -- 172.21.15.87:0/3679563151 learned_addr learned my addr 172.21.15.87:0/3679563151 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T05:31:34.780 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:34.779+0000 7f7af3e00700 1 --2- 172.21.15.87:0/3679563151 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x556194384060 0x55619438ae20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:31:34.781 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:34.779+0000 7f7af8c00700 1 -- 172.21.15.87:0/3679563151 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x556194384060 msgr2=0x55619438ae20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:31:34.781 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:34.779+0000 7f7af8c00700 1 --2- 172.21.15.87:0/3679563151 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x556194384060 0x55619438ae20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:31:34.782 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:34.779+0000 7f7af8c00700 1 -- 172.21.15.87:0/3679563151 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x556194384980 msgr2=0x556194399c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:31:34.782 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:34.779+0000 7f7af8c00700 1 --2- 172.21.15.87:0/3679563151 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x556194384980 0x556194399c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:31:34.782 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:34.779+0000 7f7af8c00700 1 -- 172.21.15.87:0/3679563151 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556194390ac0 con 0x5561943889d0 2024-05-08T05:31:34.782 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:34.780+0000 7f7af8c00700 1 --2- 172.21.15.87:0/3679563151 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5561943889d0 0x5561943894c0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f7aec02c5b0 tx=0x7f7aec00bd20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4611e080670db378 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:31:34.782 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:34.780+0000 7f7ae8c00700 1 -- 172.21.15.87:0/3679563151 <== mon.2 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7aec03c030 con 0x5561943889d0 2024-05-08T05:31:34.782 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:34.780+0000 7f7ae8c00700 1 -- 172.21.15.87:0/3679563151 <== mon.2 v2:172.21.15.90:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7aec026040 con 0x5561943889d0 2024-05-08T05:31:34.782 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:34.780+0000 7f7ae8c00700 1 -- 172.21.15.87:0/3679563151 <== mon.2 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7aec031070 con 0x5561943889d0 2024-05-08T05:31:34.782 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:34.781+0000 7f7b05553b80 1 -- 172.21.15.87:0/3679563151 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5561943889d0 msgr2=0x5561943894c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:31:34.782 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:34.781+0000 7f7b05553b80 1 --2- 172.21.15.87:0/3679563151 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5561943889d0 0x5561943894c0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f7aec02c5b0 tx=0x7f7aec00bd20 comp rx=0 tx=0).stop 2024-05-08T05:31:34.782 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:34.781+0000 7f7b05553b80 1 -- 172.21.15.87:0/3679563151 shutdown_connections 2024-05-08T05:31:34.782 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:34.781+0000 7f7b05553b80 1 --2- 172.21.15.87:0/3679563151 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5561943889d0 0x5561943894c0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:31:34.782 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:34.781+0000 7f7b05553b80 1 --2- 172.21.15.87:0/3679563151 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x556194384060 0x55619438ae20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:31:34.782 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:34.781+0000 7f7b05553b80 1 --2- 172.21.15.87:0/3679563151 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x556194384980 0x556194399c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:31:34.783 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:34.781+0000 7f7b05553b80 1 -- 172.21.15.87:0/3679563151 >> 172.21.15.87:0/3679563151 conn(0x5561942b2b60 msgr2=0x556194388db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:31:34.783 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:34.781+0000 7f7b05553b80 1 -- 172.21.15.87:0/3679563151 shutdown_connections 2024-05-08T05:31:34.783 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:34.781+0000 7f7b05553b80 1 -- 172.21.15.87:0/3679563151 wait complete. 2024-05-08T05:31:34.783 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:34.782+0000 7f7b05553b80 1 -- start start 2024-05-08T05:31:34.785 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:34.782+0000 7f7b05553b80 1 Processor -- start 2024-05-08T05:31:34.785 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:34.782+0000 7f7b05553b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x556194384060 0x556194396350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:31:34.785 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:34.782+0000 7f7b05553b80 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x556194384980 0x556194389a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:31:34.785 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:34.782+0000 7f7b05553b80 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5561943889d0 0x556194389fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:31:34.785 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:34.782+0000 7f7b05553b80 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f7af41ae290 con 0x5561943889d0 2024-05-08T05:31:34.785 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:34.782+0000 7f7b05553b80 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f7af41af700 con 0x556194384980 2024-05-08T05:31:34.785 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:34.782+0000 7f7b05553b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f7af41ae960 con 0x556194384060 2024-05-08T05:31:34.785 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:34.782+0000 7f7b05553b80 10 client.0 _ll_register_callbacks cb 0x55619427dc70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T05:31:34.785 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:34.782+0000 7f7aeb400700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x556194384980 0x556194389a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:31:34.786 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:34.783+0000 7f7aeb400700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x556194384980 0x556194389a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.87:41296/0 (socket says 172.21.15.87:41296) 2024-05-08T05:31:34.786 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:34.783+0000 7f7aeb400700 1 -- 172.21.15.87:0/4255261904 learned_addr learned my addr 172.21.15.87:0/4255261904 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T05:31:34.786 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:34.783+0000 7f7af3e00700 1 --2- 172.21.15.87:0/4255261904 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x556194384060 0x556194396350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:31:34.786 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:34.783+0000 7f7af8c00700 1 --2- 172.21.15.87:0/4255261904 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5561943889d0 0x556194389fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:31:34.786 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:34.783+0000 7f7aeb400700 1 -- 172.21.15.87:0/4255261904 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x556194384060 msgr2=0x556194396350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:31:34.786 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:34.783+0000 7f7aeb400700 1 --2- 172.21.15.87:0/4255261904 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x556194384060 0x556194396350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:31:34.786 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:34.783+0000 7f7aeb400700 1 -- 172.21.15.87:0/4255261904 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5561943889d0 msgr2=0x556194389fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:31:34.786 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:34.783+0000 7f7aeb400700 1 --2- 172.21.15.87:0/4255261904 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5561943889d0 0x556194389fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:31:34.786 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:34.783+0000 7f7aeb400700 1 -- 172.21.15.87:0/4255261904 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55619438a5e0 con 0x556194384980 2024-05-08T05:31:34.786 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:34.783+0000 7f7af3e00700 1 --2- 172.21.15.87:0/4255261904 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x556194384060 0x556194396350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T05:31:34.786 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:34.783+0000 7f7af8c00700 1 --2- 172.21.15.87:0/4255261904 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5561943889d0 0x556194389fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T05:31:34.786 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:34.783+0000 7f7aeb400700 1 --2- 172.21.15.87:0/4255261904 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x556194384980 0x556194389a60 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f7adc0dfee0 tx=0x7f7adc0a5680 comp rx=0 tx=0).ready entity=mon.2 client_cookie=861c70ed5204409d server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:31:34.786 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:34.783+0000 7f7ae2000700 10 client.0 ms_handle_connect on v2:172.21.15.90:3300/0 2024-05-08T05:31:34.787 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:34.783+0000 7f7ae2000700 1 -- 172.21.15.87:0/4255261904 <== mon.2 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7adc014070 con 0x556194384980 2024-05-08T05:31:34.787 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:34.783+0000 7f7ae2000700 1 -- 172.21.15.87:0/4255261904 <== mon.2 v2:172.21.15.90:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8190+0+0 (secure 0 0 0) 0x7f7adc0a9b00 con 0x556194384980 2024-05-08T05:31:34.787 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:34.783+0000 7f7b05553b80 1 -- 172.21.15.87:0/4255261904 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7aec026040 con 0x556194384980 2024-05-08T05:31:34.787 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:34.784+0000 7f7ae2000700 1 -- 172.21.15.87:0/4255261904 <== mon.2 v2:172.21.15.90:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f7adc0ca070 con 0x556194384980 2024-05-08T05:31:34.787 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:34.784+0000 7f7b05553b80 10 client.25430 fetch_fsmap learned FSMap version 25 2024-05-08T05:31:34.787 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:34.784+0000 7f7b05553b80 1 -- 172.21.15.87:0/4255261904 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x556194395f00 con 0x556194384980 2024-05-08T05:31:34.787 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:34.784+0000 7f7ae2000700 1 -- 172.21.15.87:0/4255261904 <== mon.2 v2:172.21.15.90:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7aec026040 con 0x556194384980 2024-05-08T05:31:34.787 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:34.784+0000 7f7ae2000700 1 -- 172.21.15.87:0/4255261904 <== mon.2 v2:172.21.15.90:3300/0 5 ==== fsmap(e 25) ==== 8338+0+0 (secure 0 0 0) 0x7f7adc004a30 con 0x556194384980 2024-05-08T05:31:34.787 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:34.784+0000 7f7b05553b80 10 client.25430 fetch_fsmap finished waiting for FSMap version 25 2024-05-08T05:31:34.787 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:34.784+0000 7f7b05553b80 10 client.25430 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.g 2024-05-08T05:31:34.787 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:34.784+0000 7f7b05553b80 20 client.25430 populate_metadata read hostname 'smithi087' 2024-05-08T05:31:34.787 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:34.784+0000 7f7b05553b80 1 --2- 172.21.15.87:0/4255261904 >> [v2:172.21.15.87:6838/2127215876,v1:172.21.15.87:6839/2127215876] conn(0x556194408830 0x55619440ac50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:31:34.787 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:34.784+0000 7f7b05553b80 4 client.25430 mds_command: new command op to 24482 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-05-08T05:31:34.787 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:34.784+0000 7f7b05553b80 1 -- 172.21.15.87:0/4255261904 --> [v2:172.21.15.87:6838/2127215876,v1:172.21.15.87:6839/2127215876] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5561942e4400 con 0x556194408830 2024-05-08T05:31:34.787 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:34.785+0000 7f7af3e00700 1 --2- 172.21.15.87:0/4255261904 >> [v2:172.21.15.87:6838/2127215876,v1:172.21.15.87:6839/2127215876] conn(0x556194408830 0x55619440ac50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:31:34.789 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:34.785+0000 7f7af3e00700 1 --2- 172.21.15.87:0/4255261904 >> [v2:172.21.15.87:6838/2127215876,v1:172.21.15.87:6839/2127215876] conn(0x556194408830 0x55619440ac50 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=7de786b3dedcd56c server_cookie=53302dddb367381a in_seq=0 out_seq=0 2024-05-08T05:31:34.789 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:34.785+0000 7f7ae2000700 10 client.25430 ms_handle_connect on v2:172.21.15.87:6838/2127215876 2024-05-08T05:31:34.789 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:34.785+0000 7f7ae2000700 1 -- 172.21.15.87:0/4255261904 <== mds.1 v2:172.21.15.87:6838/2127215876 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5561942e4400 con 0x556194408830 2024-05-08T05:31:34.789 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:34.785+0000 7f7ae2000700 10 client.25430 handle_command_reply: tid=0 2024-05-08T05:31:34.789 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:34.786+0000 7f7b05553b80 1 client.25430 shutdown 2024-05-08T05:31:34.789 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:34.786+0000 7f7b05553b80 1 -- 172.21.15.87:0/4255261904 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x556194384980 msgr2=0x556194389a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:31:34.789 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:34.786+0000 7f7b05553b80 1 --2- 172.21.15.87:0/4255261904 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x556194384980 0x556194389a60 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f7adc0dfee0 tx=0x7f7adc0a5680 comp rx=0 tx=0).stop 2024-05-08T05:31:34.789 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:34.786+0000 7f7b05553b80 1 -- 172.21.15.87:0/4255261904 shutdown_connections 2024-05-08T05:31:34.789 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:34.786+0000 7f7b05553b80 1 --2- 172.21.15.87:0/4255261904 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5561943889d0 0x556194389fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:31:34.789 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:34.786+0000 7f7b05553b80 1 --2- 172.21.15.87:0/4255261904 >> [v2:172.21.15.87:6838/2127215876,v1:172.21.15.87:6839/2127215876] conn(0x556194408830 0x55619440ac50 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:31:34.789 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:34.786+0000 7f7b05553b80 1 --2- 172.21.15.87:0/4255261904 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x556194384060 0x556194396350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:31:34.790 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:34.786+0000 7f7b05553b80 1 --2- 172.21.15.87:0/4255261904 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x556194384980 0x556194389a60 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:31:34.790 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:34.786+0000 7f7b05553b80 1 -- 172.21.15.87:0/4255261904 >> 172.21.15.87:0/4255261904 conn(0x5561942b2b60 msgr2=0x5561943792b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:31:34.790 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:34.786+0000 7f7ae2000700 0 client.25430 ms_handle_reset on v2:172.21.15.87:6838/2127215876 2024-05-08T05:31:34.790 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:34.786+0000 7f7b05553b80 1 -- 172.21.15.87:0/4255261904 shutdown_connections 2024-05-08T05:31:34.790 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:34.786+0000 7f7b05553b80 1 -- 172.21.15.87:0/4255261904 wait complete. 2024-05-08T05:31:34.790 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:34.786+0000 7f7b05553b80 20 client.25430 trim_cache size 0 max 16384 2024-05-08T05:31:34.790 INFO:teuthology.orchestra.run.smithi087.stdout:[] 2024-05-08T05:31:34.791 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:34.787+0000 7f7afac00700 1 -- 172.21.15.87:0/2641972869 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f7ad80b2900 msgr2=0x7f7ad80b4dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:31:34.791 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:34.787+0000 7f7afac00700 1 --2- 172.21.15.87:0/2641972869 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f7ad80b2900 0x7f7ad80b4dc0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f7aec009fd0 tx=0x7f7aec006210 comp rx=0 tx=0).stop 2024-05-08T05:31:34.791 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:34.787+0000 7f7afac00700 1 -- 172.21.15.87:0/2641972869 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7af406bad0 msgr2=0x7f7af419c370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:31:34.791 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:34.787+0000 7f7afac00700 1 --2- 172.21.15.87:0/2641972869 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7af406bad0 0x7f7af419c370 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f7adc00d980 tx=0x7f7adc00dc90 comp rx=0 tx=0).stop 2024-05-08T05:31:34.791 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:34.787+0000 7f7afac00700 1 -- 172.21.15.87:0/2641972869 shutdown_connections 2024-05-08T05:31:34.791 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:34.787+0000 7f7afac00700 1 --2- 172.21.15.87:0/2641972869 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7af410ff50 0x7f7af41a06b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:31:34.791 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:34.787+0000 7f7afac00700 1 --2- 172.21.15.87:0/2641972869 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f7ad80b2900 0x7f7ad80b4dc0 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:31:34.791 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:34.787+0000 7f7afac00700 1 --2- 172.21.15.87:0/2641972869 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7af406b1b0 0x7f7af419be30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:31:34.791 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:34.787+0000 7f7afac00700 1 --2- 172.21.15.87:0/2641972869 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7af406bad0 0x7f7af419c370 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:31:34.791 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:34.787+0000 7f7afac00700 1 -- 172.21.15.87:0/2641972869 >> 172.21.15.87:0/2641972869 conn(0x7f7af4079350 msgr2=0x7f7af4111440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:31:34.792 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:34.787+0000 7f7afac00700 1 -- 172.21.15.87:0/2641972869 shutdown_connections 2024-05-08T05:31:34.792 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:34.787+0000 7f7afac00700 1 -- 172.21.15.87:0/2641972869 wait complete. 2024-05-08T05:31:35.704 DEBUG:teuthology.orchestra.run.smithi087:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid eeeb813e-0cf9-11ef-bc97-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-05-08T05:31:36.213 INFO:teuthology.orchestra.run.smithi087.stderr:Inferring config /var/lib/ceph/eeeb813e-0cf9-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T05:31:36.458 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:31:36 smithi087 ceph-mon[29523]: pgmap v498: 97 pgs: 97 active+clean; 19 MiB data, 429 MiB used, 1.0 TiB / 1.0 TiB avail; 468 KiB/s rd, 1.6 MiB/s wr, 38 op/s 2024-05-08T05:31:36.483 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:31:36 smithi090 ceph-mon[34526]: pgmap v498: 97 pgs: 97 active+clean; 19 MiB data, 429 MiB used, 1.0 TiB / 1.0 TiB avail; 468 KiB/s rd, 1.6 MiB/s wr, 38 op/s 2024-05-08T05:31:36.538 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:31:36 smithi160 ceph-mon[34827]: pgmap v498: 97 pgs: 97 active+clean; 19 MiB data, 429 MiB used, 1.0 TiB / 1.0 TiB avail; 468 KiB/s rd, 1.6 MiB/s wr, 38 op/s 2024-05-08T05:31:38.299 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:31:38 smithi087 ceph-mon[29523]: pgmap v499: 97 pgs: 97 active+clean; 24 MiB data, 438 MiB used, 1.0 TiB / 1.0 TiB avail; 635 KiB/s rd, 2.0 MiB/s wr, 63 op/s 2024-05-08T05:31:38.483 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:31:38 smithi090 ceph-mon[34526]: pgmap v499: 97 pgs: 97 active+clean; 24 MiB data, 438 MiB used, 1.0 TiB / 1.0 TiB avail; 635 KiB/s rd, 2.0 MiB/s wr, 63 op/s 2024-05-08T05:31:38.538 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:31:38 smithi160 ceph-mon[34827]: pgmap v499: 97 pgs: 97 active+clean; 24 MiB data, 438 MiB used, 1.0 TiB / 1.0 TiB avail; 635 KiB/s rd, 2.0 MiB/s wr, 63 op/s 2024-05-08T05:31:38.613 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:38.612+0000 7fc278a00700 1 -- 172.21.15.87:0/656559703 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc274102180 msgr2=0x7fc274102560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:31:38.613 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:38.612+0000 7fc278a00700 1 --2- 172.21.15.87:0/656559703 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc274102180 0x7fc274102560 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fc264009990 tx=0x7fc264009ca0 comp rx=0 tx=0).stop 2024-05-08T05:31:38.613 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:38.612+0000 7fc278a00700 1 -- 172.21.15.87:0/656559703 shutdown_connections 2024-05-08T05:31:38.613 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:38.612+0000 7fc278a00700 1 --2- 172.21.15.87:0/656559703 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc27410fd30 0x7fc274112120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:31:38.614 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:38.612+0000 7fc278a00700 1 --2- 172.21.15.87:0/656559703 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc274102180 0x7fc274102560 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:31:38.614 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:38.612+0000 7fc278a00700 1 --2- 172.21.15.87:0/656559703 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc274102b30 0x7fc27410f7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:31:38.614 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:38.612+0000 7fc278a00700 1 -- 172.21.15.87:0/656559703 >> 172.21.15.87:0/656559703 conn(0x7fc2740fddc0 msgr2=0x7fc2741001e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:31:38.614 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:38.613+0000 7fc278a00700 1 -- 172.21.15.87:0/656559703 shutdown_connections 2024-05-08T05:31:38.614 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:38.613+0000 7fc278a00700 1 -- 172.21.15.87:0/656559703 wait complete. 2024-05-08T05:31:38.614 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:38.614+0000 7fc278a00700 1 Processor -- start 2024-05-08T05:31:38.614 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:38.614+0000 7fc278a00700 1 -- start start 2024-05-08T05:31:38.615 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:38.615+0000 7fc278a00700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc274102180 0x7fc2741a1900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:31:38.615 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:38.615+0000 7fc278a00700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc274102b30 0x7fc2741a1e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:31:38.615 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:38.615+0000 7fc278a00700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc27410fd30 0x7fc27419bac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:31:38.615 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:38.615+0000 7fc278a00700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fc274115800 con 0x7fc274102180 2024-05-08T05:31:38.615 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:38.615+0000 7fc278a00700 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fc274115680 con 0x7fc274102b30 2024-05-08T05:31:38.616 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:38.615+0000 7fc278a00700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7fc274115980 con 0x7fc27410fd30 2024-05-08T05:31:38.616 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:38.615+0000 7fc271e00700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc274102b30 0x7fc2741a1e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:31:38.616 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:38.615+0000 7fc271e00700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc274102b30 0x7fc2741a1e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.87:51450/0 (socket says 172.21.15.87:51450) 2024-05-08T05:31:38.616 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:38.615+0000 7fc271e00700 1 -- 172.21.15.87:0/745425541 learned_addr learned my addr 172.21.15.87:0/745425541 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T05:31:38.616 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:38.615+0000 7fc272800700 1 --2- 172.21.15.87:0/745425541 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc274102180 0x7fc2741a1900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:31:38.616 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:38.615+0000 7fc273200700 1 --2- 172.21.15.87:0/745425541 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc27410fd30 0x7fc27419bac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:31:38.617 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:38.615+0000 7fc271e00700 1 -- 172.21.15.87:0/745425541 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc27410fd30 msgr2=0x7fc27419bac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:31:38.617 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:38.615+0000 7fc271e00700 1 --2- 172.21.15.87:0/745425541 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc27410fd30 0x7fc27419bac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:31:38.617 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:38.615+0000 7fc271e00700 1 -- 172.21.15.87:0/745425541 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc274102180 msgr2=0x7fc2741a1900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:31:38.617 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:38.615+0000 7fc271e00700 1 --2- 172.21.15.87:0/745425541 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc274102180 0x7fc2741a1900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:31:38.617 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:38.615+0000 7fc271e00700 1 -- 172.21.15.87:0/745425541 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc27419c220 con 0x7fc274102b30 2024-05-08T05:31:38.617 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:38.616+0000 7fc271e00700 1 --2- 172.21.15.87:0/745425541 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc274102b30 0x7fc2741a1e40 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fc26000eb30 tx=0x7fc26000ee40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:31:38.617 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:38.616+0000 7fc26b400700 1 -- 172.21.15.87:0/745425541 <== mon.2 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc26000cbd0 con 0x7fc274102b30 2024-05-08T05:31:38.617 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:38.616+0000 7fc26b400700 1 -- 172.21.15.87:0/745425541 <== mon.2 v2:172.21.15.90:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc2600044d0 con 0x7fc274102b30 2024-05-08T05:31:38.617 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:38.616+0000 7fc26b400700 1 -- 172.21.15.87:0/745425541 <== mon.2 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc260003e30 con 0x7fc274102b30 2024-05-08T05:31:38.618 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:38.616+0000 7fc278a00700 1 -- 172.21.15.87:0/745425541 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc27419c510 con 0x7fc274102b30 2024-05-08T05:31:38.618 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:38.616+0000 7fc278a00700 1 -- 172.21.15.87:0/745425541 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc2741a87d0 con 0x7fc274102b30 2024-05-08T05:31:38.621 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:38.621+0000 7fc26b400700 1 -- 172.21.15.87:0/745425541 <== mon.2 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7fc260004000 con 0x7fc274102b30 2024-05-08T05:31:38.622 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:38.622+0000 7fc283c92b80 1 Processor -- start 2024-05-08T05:31:38.622 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:38.622+0000 7fc283c92b80 1 -- start start 2024-05-08T05:31:38.623 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:38.622+0000 7fc283c92b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x560e89d721d0 0x560e89d725b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:31:38.623 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:38.622+0000 7fc283c92b80 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x560e89d72af0 0x560e89d6c7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:31:38.623 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:38.622+0000 7fc283c92b80 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x560e89d6ce10 0x560e89d6d270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:31:38.624 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:38.622+0000 7fc283c92b80 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x560e89cb6a20 con 0x560e89d6ce10 2024-05-08T05:31:38.624 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:38.622+0000 7fc283c92b80 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x560e89c54760 con 0x560e89d72af0 2024-05-08T05:31:38.624 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:38.622+0000 7fc283c92b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x560e89cb29e0 con 0x560e89d721d0 2024-05-08T05:31:38.624 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:38.623+0000 7fc273200700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x560e89d721d0 0x560e89d725b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:31:38.624 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:38.623+0000 7fc272800700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x560e89d72af0 0x560e89d6c7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:31:38.624 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:38.623+0000 7fc273200700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x560e89d721d0 0x560e89d725b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.87:56266/0 (socket says 172.21.15.87:56266) 2024-05-08T05:31:38.624 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:38.623+0000 7fc273200700 1 -- 172.21.15.87:0/3290578643 learned_addr learned my addr 172.21.15.87:0/3290578643 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T05:31:38.624 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:38.623+0000 7fc271e00700 1 --2- 172.21.15.87:0/3290578643 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x560e89d6ce10 0x560e89d6d270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:31:38.629 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:38.623+0000 7fc272800700 1 -- 172.21.15.87:0/3290578643 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x560e89d721d0 msgr2=0x560e89d725b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:31:38.629 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:38.623+0000 7fc272800700 1 --2- 172.21.15.87:0/3290578643 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x560e89d721d0 0x560e89d725b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:31:38.629 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:38.623+0000 7fc272800700 1 -- 172.21.15.87:0/3290578643 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x560e89d6ce10 msgr2=0x560e89d6d270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:31:38.629 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:38.623+0000 7fc272800700 1 --2- 172.21.15.87:0/3290578643 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x560e89d6ce10 0x560e89d6d270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:31:38.629 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:38.623+0000 7fc272800700 1 -- 172.21.15.87:0/3290578643 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560e89c038d0 con 0x560e89d72af0 2024-05-08T05:31:38.629 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:38.623+0000 7fc26b400700 1 --2- 172.21.15.87:0/745425541 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7fc2580b2980 0x7fc2580b4e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:31:38.629 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:38.624+0000 7fc272800700 1 --2- 172.21.15.87:0/3290578643 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x560e89d72af0 0x560e89d6c7f0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fc264006010 tx=0x7fc2640096a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f59bbc92b0878990 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:31:38.629 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:38.624+0000 7fc26b400700 1 -- 172.21.15.87:0/745425541 <== mon.2 v2:172.21.15.90:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8190+0+0 (secure 0 0 0) 0x7fc2600e2530 con 0x7fc274102b30 2024-05-08T05:31:38.629 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:38.624+0000 7fc25fe00700 1 -- 172.21.15.87:0/3290578643 <== mon.2 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc264027070 con 0x560e89d72af0 2024-05-08T05:31:38.629 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:38.624+0000 7fc25fe00700 1 -- 172.21.15.87:0/3290578643 <== mon.2 v2:172.21.15.90:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc2640056a0 con 0x560e89d72af0 2024-05-08T05:31:38.630 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:38.624+0000 7fc25fe00700 1 -- 172.21.15.87:0/3290578643 <== mon.2 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc264003a70 con 0x560e89d72af0 2024-05-08T05:31:38.630 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:38.624+0000 7fc273200700 1 --2- 172.21.15.87:0/745425541 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7fc2580b2980 0x7fc2580b4e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:31:38.630 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:38.625+0000 7fc283c92b80 1 -- 172.21.15.87:0/3290578643 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x560e89d72af0 msgr2=0x560e89d6c7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:31:38.630 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:38.625+0000 7fc283c92b80 1 --2- 172.21.15.87:0/3290578643 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x560e89d72af0 0x560e89d6c7f0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fc264006010 tx=0x7fc2640096a0 comp rx=0 tx=0).stop 2024-05-08T05:31:38.630 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:38.625+0000 7fc283c92b80 1 -- 172.21.15.87:0/3290578643 shutdown_connections 2024-05-08T05:31:38.630 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:38.625+0000 7fc283c92b80 1 --2- 172.21.15.87:0/3290578643 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x560e89d6ce10 0x560e89d6d270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:31:38.630 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:38.625+0000 7fc283c92b80 1 --2- 172.21.15.87:0/3290578643 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x560e89d721d0 0x560e89d725b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:31:38.630 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:38.625+0000 7fc283c92b80 1 --2- 172.21.15.87:0/3290578643 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x560e89d72af0 0x560e89d6c7f0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:31:38.630 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:38.625+0000 7fc283c92b80 1 -- 172.21.15.87:0/3290578643 >> 172.21.15.87:0/3290578643 conn(0x560e89c92b60 msgr2=0x560e89d5e9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:31:38.630 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:38.625+0000 7fc283c92b80 1 -- 172.21.15.87:0/3290578643 shutdown_connections 2024-05-08T05:31:38.630 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:38.625+0000 7fc273200700 1 --2- 172.21.15.87:0/745425541 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7fc2580b2980 0x7fc2580b4e40 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fc26c0074e0 tx=0x7fc26c00b040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:31:38.630 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:38.625+0000 7fc283c92b80 1 -- 172.21.15.87:0/3290578643 wait complete. 2024-05-08T05:31:38.630 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:38.626+0000 7fc283c92b80 1 -- start start 2024-05-08T05:31:38.630 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:38.626+0000 7fc283c92b80 1 Processor -- start 2024-05-08T05:31:38.631 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:38.627+0000 7fc283c92b80 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x560e89d6ce10 0x560e89d78700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:31:38.631 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:38.627+0000 7fc283c92b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x560e89d721d0 0x560e89d75aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:31:38.631 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:38.627+0000 7fc283c92b80 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x560e89d72af0 0x560e89d75fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:31:38.631 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:38.627+0000 7fc283c92b80 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x560e89d79590 con 0x560e89d6ce10 2024-05-08T05:31:38.631 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:38.627+0000 7fc283c92b80 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x560e89c1cb20 con 0x560e89d72af0 2024-05-08T05:31:38.631 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:38.627+0000 7fc283c92b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x560e89d79710 con 0x560e89d721d0 2024-05-08T05:31:38.631 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:38.627+0000 7fc283c92b80 10 client.0 _ll_register_callbacks cb 0x560e89c5dc70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T05:31:38.631 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:38.627+0000 7fc272800700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x560e89d6ce10 0x560e89d78700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:31:38.631 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:38.627+0000 7fc272800700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x560e89d6ce10 0x560e89d78700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:37004/0 (socket says 172.21.15.87:37004) 2024-05-08T05:31:38.631 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:38.627+0000 7fc273200700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x560e89d72af0 0x560e89d75fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:31:38.631 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:38.628+0000 7fc272800700 1 -- 172.21.15.87:0/3045197074 learned_addr learned my addr 172.21.15.87:0/3045197074 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T05:31:38.631 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:38.628+0000 7fc271e00700 1 --2- 172.21.15.87:0/3045197074 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x560e89d721d0 0x560e89d75aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:31:38.631 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:38.628+0000 7fc273200700 1 -- 172.21.15.87:0/3045197074 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x560e89d721d0 msgr2=0x560e89d75aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:31:38.631 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:38.628+0000 7fc273200700 1 --2- 172.21.15.87:0/3045197074 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x560e89d721d0 0x560e89d75aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:31:38.632 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:38.628+0000 7fc273200700 1 -- 172.21.15.87:0/3045197074 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x560e89d6ce10 msgr2=0x560e89d78700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:31:38.632 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:38.628+0000 7fc273200700 1 --2- 172.21.15.87:0/3045197074 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x560e89d6ce10 0x560e89d78700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:31:38.632 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:38.628+0000 7fc273200700 1 -- 172.21.15.87:0/3045197074 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560e89c7c420 con 0x560e89d72af0 2024-05-08T05:31:38.632 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:38.628+0000 7fc273200700 1 --2- 172.21.15.87:0/3045197074 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x560e89d72af0 0x560e89d75fe0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fc26c016ba0 tx=0x7fc26c004b40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cffce9098a5e9f14 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:31:38.632 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:38.628+0000 7fc25cc00700 10 client.0 ms_handle_connect on v2:172.21.15.90:3300/0 2024-05-08T05:31:38.632 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:38.629+0000 7fc25cc00700 1 -- 172.21.15.87:0/3045197074 <== mon.2 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc26c027020 con 0x560e89d72af0 2024-05-08T05:31:38.632 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:38.629+0000 7fc25cc00700 1 -- 172.21.15.87:0/3045197074 <== mon.2 v2:172.21.15.90:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8190+0+0 (secure 0 0 0) 0x7fc26c015cf0 con 0x560e89d72af0 2024-05-08T05:31:38.632 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:38.629+0000 7fc283c92b80 1 -- 172.21.15.87:0/3045197074 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc2640056a0 con 0x560e89d72af0 2024-05-08T05:31:38.634 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:38.629+0000 7fc25cc00700 1 -- 172.21.15.87:0/3045197074 <== mon.2 v2:172.21.15.90:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fc26c023480 con 0x560e89d72af0 2024-05-08T05:31:38.634 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:38.629+0000 7fc283c92b80 10 client.25442 fetch_fsmap learned FSMap version 25 2024-05-08T05:31:38.634 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:38.629+0000 7fc283c92b80 1 -- 172.21.15.87:0/3045197074 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x560e89d83d30 con 0x560e89d72af0 2024-05-08T05:31:38.634 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:38.629+0000 7fc25cc00700 1 -- 172.21.15.87:0/3045197074 <== mon.2 v2:172.21.15.90:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc2640056a0 con 0x560e89d72af0 2024-05-08T05:31:38.634 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:38.630+0000 7fc25cc00700 1 -- 172.21.15.87:0/3045197074 <== mon.2 v2:172.21.15.90:3300/0 5 ==== fsmap(e 25) ==== 8338+0+0 (secure 0 0 0) 0x7fc26c02e600 con 0x560e89d72af0 2024-05-08T05:31:38.635 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:38.630+0000 7fc283c92b80 10 client.25442 fetch_fsmap finished waiting for FSMap version 25 2024-05-08T05:31:38.635 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:38.630+0000 7fc283c92b80 10 client.25442 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-05-08T05:31:38.635 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:38.630+0000 7fc283c92b80 20 client.25442 populate_metadata read hostname 'smithi087' 2024-05-08T05:31:38.635 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:38.630+0000 7fc283c92b80 1 --2- 172.21.15.87:0/3045197074 >> [v2:172.21.15.90:6838/160586017,v1:172.21.15.90:6839/160586017] conn(0x560e89d86370 0x560e89d887b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:31:38.635 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:38.630+0000 7fc283c92b80 4 client.25442 mds_command: new command op to 24500 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-08T05:31:38.635 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:38.630+0000 7fc283c92b80 1 -- 172.21.15.87:0/3045197074 --> [v2:172.21.15.90:6838/160586017,v1:172.21.15.90:6839/160586017] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x560e89d310a0 con 0x560e89d86370 2024-05-08T05:31:38.635 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:38.630+0000 7fc272800700 1 --2- 172.21.15.87:0/3045197074 >> [v2:172.21.15.90:6838/160586017,v1:172.21.15.90:6839/160586017] conn(0x560e89d86370 0x560e89d887b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:31:38.635 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:38.631+0000 7fc272800700 1 --2- 172.21.15.87:0/3045197074 >> [v2:172.21.15.90:6838/160586017,v1:172.21.15.90:6839/160586017] conn(0x560e89d86370 0x560e89d887b0 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cf9f6c79189aab6f server_cookie=8389530fcb354372 in_seq=0 out_seq=0 2024-05-08T05:31:38.635 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:38.631+0000 7fc25cc00700 10 client.25442 ms_handle_connect on v2:172.21.15.90:6838/160586017 2024-05-08T05:31:38.635 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:38.633+0000 7fc25cc00700 1 -- 172.21.15.87:0/3045197074 <== mds.0 v2:172.21.15.90:6838/160586017 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x560e89d310a0 con 0x560e89d86370 2024-05-08T05:31:38.635 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:38.633+0000 7fc25cc00700 10 client.25442 handle_command_reply: tid=0 2024-05-08T05:31:38.636 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:38.633+0000 7fc283c92b80 1 client.25442 shutdown 2024-05-08T05:31:38.636 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:38.634+0000 7fc283c92b80 1 -- 172.21.15.87:0/3045197074 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x560e89d72af0 msgr2=0x560e89d75fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:31:38.636 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:38.634+0000 7fc283c92b80 1 --2- 172.21.15.87:0/3045197074 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x560e89d72af0 0x560e89d75fe0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fc26c016ba0 tx=0x7fc26c004b40 comp rx=0 tx=0).stop 2024-05-08T05:31:38.636 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:38.634+0000 7fc283c92b80 1 -- 172.21.15.87:0/3045197074 shutdown_connections 2024-05-08T05:31:38.636 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:38.634+0000 7fc283c92b80 1 --2- 172.21.15.87:0/3045197074 >> [v2:172.21.15.90:6838/160586017,v1:172.21.15.90:6839/160586017] conn(0x560e89d86370 0x560e89d887b0 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:31:38.636 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:38.634+0000 7fc283c92b80 1 --2- 172.21.15.87:0/3045197074 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x560e89d72af0 0x560e89d75fe0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:31:38.636 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:38.634+0000 7fc283c92b80 1 --2- 172.21.15.87:0/3045197074 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x560e89d6ce10 0x560e89d78700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:31:38.636 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:38.634+0000 7fc283c92b80 1 --2- 172.21.15.87:0/3045197074 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x560e89d721d0 0x560e89d75aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:31:38.636 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:38.634+0000 7fc25cc00700 0 client.25442 ms_handle_reset on v2:172.21.15.90:6838/160586017 2024-05-08T05:31:38.636 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:38.634+0000 7fc283c92b80 1 -- 172.21.15.87:0/3045197074 >> 172.21.15.87:0/3045197074 conn(0x560e89c92b60 msgr2=0x560e89d59460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:31:38.636 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:38.634+0000 7fc283c92b80 1 -- 172.21.15.87:0/3045197074 shutdown_connections 2024-05-08T05:31:38.636 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:38.634+0000 7fc283c92b80 1 -- 172.21.15.87:0/3045197074 wait complete. 2024-05-08T05:31:38.636 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:38.634+0000 7fc283c92b80 20 client.25442 trim_cache size 0 max 16384 2024-05-08T05:31:38.653 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:38.652+0000 7fc283c92b80 1 Processor -- start 2024-05-08T05:31:38.653 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:38.652+0000 7fc283c92b80 1 -- start start 2024-05-08T05:31:38.653 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:38.653+0000 7fc283c92b80 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x560e89d6ce10 0x560e89d82620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:31:38.653 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:38.653+0000 7fc283c92b80 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x560e89d721d0 0x560e89d735e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:31:38.653 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:38.653+0000 7fc283c92b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x560e89d72af0 0x560e89d8e080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:31:38.653 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:38.653+0000 7fc283c92b80 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fc2741ae060 con 0x560e89d6ce10 2024-05-08T05:31:38.653 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:38.653+0000 7fc283c92b80 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fc2741ab8f0 con 0x560e89d721d0 2024-05-08T05:31:38.653 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:38.653+0000 7fc283c92b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7fc2741082f0 con 0x560e89d72af0 2024-05-08T05:31:38.654 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:38.653+0000 7fc271e00700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x560e89d721d0 0x560e89d735e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:31:38.654 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:38.653+0000 7fc272800700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x560e89d6ce10 0x560e89d82620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:31:38.654 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:38.653+0000 7fc271e00700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x560e89d721d0 0x560e89d735e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.87:51482/0 (socket says 172.21.15.87:51482) 2024-05-08T05:31:38.655 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:38.653+0000 7fc271e00700 1 -- 172.21.15.87:0/4156420020 learned_addr learned my addr 172.21.15.87:0/4156420020 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T05:31:38.655 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:38.653+0000 7fc273200700 1 --2- 172.21.15.87:0/4156420020 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x560e89d72af0 0x560e89d8e080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:31:38.655 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:38.654+0000 7fc271e00700 1 -- 172.21.15.87:0/4156420020 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x560e89d72af0 msgr2=0x560e89d8e080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:31:38.655 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:38.654+0000 7fc271e00700 1 --2- 172.21.15.87:0/4156420020 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x560e89d72af0 0x560e89d8e080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:31:38.655 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:38.654+0000 7fc271e00700 1 -- 172.21.15.87:0/4156420020 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x560e89d6ce10 msgr2=0x560e89d82620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:31:38.655 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:38.654+0000 7fc271e00700 1 --2- 172.21.15.87:0/4156420020 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x560e89d6ce10 0x560e89d82620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:31:38.655 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:38.654+0000 7fc271e00700 1 -- 172.21.15.87:0/4156420020 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560e89d73fd0 con 0x560e89d721d0 2024-05-08T05:31:38.655 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:38.654+0000 7fc271e00700 1 --2- 172.21.15.87:0/4156420020 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x560e89d721d0 0x560e89d735e0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fc2600a9820 tx=0x7fc2600e5af0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f65552e55e1935a7 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:31:38.655 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:38.654+0000 7fc25f400700 1 -- 172.21.15.87:0/4156420020 <== mon.2 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2600a59e0 con 0x560e89d721d0 2024-05-08T05:31:38.655 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:38.654+0000 7fc25f400700 1 -- 172.21.15.87:0/4156420020 <== mon.2 v2:172.21.15.90:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc2600aae50 con 0x560e89d721d0 2024-05-08T05:31:38.655 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:38.654+0000 7fc25f400700 1 -- 172.21.15.87:0/4156420020 <== mon.2 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2600a52b0 con 0x560e89d721d0 2024-05-08T05:31:38.657 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:38.655+0000 7fc283c92b80 1 -- 172.21.15.87:0/4156420020 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x560e89d721d0 msgr2=0x560e89d735e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:31:38.657 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:38.655+0000 7fc283c92b80 1 --2- 172.21.15.87:0/4156420020 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x560e89d721d0 0x560e89d735e0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fc2600a9820 tx=0x7fc2600e5af0 comp rx=0 tx=0).stop 2024-05-08T05:31:38.657 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:38.655+0000 7fc283c92b80 1 -- 172.21.15.87:0/4156420020 shutdown_connections 2024-05-08T05:31:38.657 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:38.655+0000 7fc283c92b80 1 --2- 172.21.15.87:0/4156420020 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x560e89d72af0 0x560e89d8e080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:31:38.657 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:38.655+0000 7fc283c92b80 1 --2- 172.21.15.87:0/4156420020 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x560e89d6ce10 0x560e89d82620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:31:38.657 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:38.655+0000 7fc283c92b80 1 --2- 172.21.15.87:0/4156420020 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x560e89d721d0 0x560e89d735e0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:31:38.657 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:38.655+0000 7fc283c92b80 1 -- 172.21.15.87:0/4156420020 >> 172.21.15.87:0/4156420020 conn(0x560e89c92b60 msgr2=0x560e89d72ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:31:38.657 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:38.655+0000 7fc283c92b80 1 -- 172.21.15.87:0/4156420020 shutdown_connections 2024-05-08T05:31:38.657 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:38.655+0000 7fc283c92b80 1 -- 172.21.15.87:0/4156420020 wait complete. 2024-05-08T05:31:38.657 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:38.656+0000 7fc283c92b80 1 -- start start 2024-05-08T05:31:38.658 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:38.656+0000 7fc283c92b80 1 Processor -- start 2024-05-08T05:31:38.658 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:38.656+0000 7fc283c92b80 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x560e89d6ce10 0x560e89d8d9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:31:38.658 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:38.656+0000 7fc283c92b80 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x560e89d721d0 0x560e89d8df20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:31:38.658 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:38.656+0000 7fc283c92b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x560e89d72af0 0x560e89d8e460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:31:38.658 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:38.656+0000 7fc283c92b80 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fc2741a9db0 con 0x560e89d721d0 2024-05-08T05:31:38.658 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:38.656+0000 7fc283c92b80 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fc2741ab220 con 0x560e89d6ce10 2024-05-08T05:31:38.658 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:38.656+0000 7fc283c92b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7fc2741aa480 con 0x560e89d72af0 2024-05-08T05:31:38.658 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:38.656+0000 7fc283c92b80 10 client.0 _ll_register_callbacks cb 0x560e89c5dc70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T05:31:38.658 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:38.657+0000 7fc272800700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x560e89d6ce10 0x560e89d8d9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:31:38.658 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:38.657+0000 7fc271e00700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x560e89d721d0 0x560e89d8df20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:31:38.658 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:38.657+0000 7fc272800700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x560e89d6ce10 0x560e89d8d9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.87:51498/0 (socket says 172.21.15.87:51498) 2024-05-08T05:31:38.658 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:38.657+0000 7fc272800700 1 -- 172.21.15.87:0/2411990257 learned_addr learned my addr 172.21.15.87:0/2411990257 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T05:31:38.658 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:38.657+0000 7fc273200700 1 --2- 172.21.15.87:0/2411990257 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x560e89d72af0 0x560e89d8e460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:31:38.660 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:38.657+0000 7fc272800700 1 -- 172.21.15.87:0/2411990257 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x560e89d72af0 msgr2=0x560e89d8e460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:31:38.660 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:38.657+0000 7fc272800700 1 --2- 172.21.15.87:0/2411990257 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x560e89d72af0 0x560e89d8e460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:31:38.660 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:38.657+0000 7fc272800700 1 -- 172.21.15.87:0/2411990257 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x560e89d721d0 msgr2=0x560e89d8df20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:31:38.660 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:38.657+0000 7fc272800700 1 --2- 172.21.15.87:0/2411990257 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x560e89d721d0 0x560e89d8df20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:31:38.661 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:38.657+0000 7fc272800700 1 -- 172.21.15.87:0/2411990257 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560e89defda0 con 0x560e89d6ce10 2024-05-08T05:31:38.661 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:38.657+0000 7fc271e00700 1 --2- 172.21.15.87:0/2411990257 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x560e89d721d0 0x560e89d8df20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T05:31:38.661 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:38.657+0000 7fc272800700 1 --2- 172.21.15.87:0/2411990257 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x560e89d6ce10 0x560e89d8d9e0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fc26400b2a0 tx=0x7fc2640054b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3848192f29bb5343 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:31:38.661 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:38.657+0000 7fc25cc00700 10 client.0 ms_handle_connect on v2:172.21.15.90:3300/0 2024-05-08T05:31:38.661 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:38.658+0000 7fc25cc00700 1 -- 172.21.15.87:0/2411990257 <== mon.2 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc264039060 con 0x560e89d6ce10 2024-05-08T05:31:38.661 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:38.658+0000 7fc283c92b80 1 -- 172.21.15.87:0/2411990257 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc2600aae50 con 0x560e89d6ce10 2024-05-08T05:31:38.661 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:38.658+0000 7fc25cc00700 1 -- 172.21.15.87:0/2411990257 <== mon.2 v2:172.21.15.90:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8190+0+0 (secure 0 0 0) 0x7fc26400b8c0 con 0x560e89d6ce10 2024-05-08T05:31:38.661 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:38.658+0000 7fc25cc00700 1 -- 172.21.15.87:0/2411990257 <== mon.2 v2:172.21.15.90:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fc264027040 con 0x560e89d6ce10 2024-05-08T05:31:38.661 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:38.658+0000 7fc283c92b80 10 client.25448 fetch_fsmap learned FSMap version 25 2024-05-08T05:31:38.661 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:38.658+0000 7fc283c92b80 1 -- 172.21.15.87:0/2411990257 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x560e89df1040 con 0x560e89d6ce10 2024-05-08T05:31:38.661 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:38.658+0000 7fc25cc00700 1 -- 172.21.15.87:0/2411990257 <== mon.2 v2:172.21.15.90:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc2600aae50 con 0x560e89d6ce10 2024-05-08T05:31:38.661 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:38.658+0000 7fc25cc00700 1 -- 172.21.15.87:0/2411990257 <== mon.2 v2:172.21.15.90:3300/0 5 ==== fsmap(e 25) ==== 8338+0+0 (secure 0 0 0) 0x7fc264021070 con 0x560e89d6ce10 2024-05-08T05:31:38.661 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:38.659+0000 7fc283c92b80 10 client.25448 fetch_fsmap finished waiting for FSMap version 25 2024-05-08T05:31:38.661 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:38.659+0000 7fc283c92b80 10 client.25448 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-05-08T05:31:38.662 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:38.659+0000 7fc283c92b80 20 client.25448 populate_metadata read hostname 'smithi087' 2024-05-08T05:31:38.662 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:38.659+0000 7fc283c92b80 1 --2- 172.21.15.87:0/2411990257 >> [v2:172.21.15.90:6838/160586017,v1:172.21.15.90:6839/160586017] conn(0x560e89df12d0 0x560e89df36c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:31:38.662 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:38.659+0000 7fc283c92b80 4 client.25448 mds_command: new command op to 24500 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-05-08T05:31:38.662 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:38.659+0000 7fc283c92b80 1 -- 172.21.15.87:0/2411990257 --> [v2:172.21.15.90:6838/160586017,v1:172.21.15.90:6839/160586017] -- command(tid 0: {"prefix": "damage ls"}) -- 0x560e89cc4400 con 0x560e89df12d0 2024-05-08T05:31:38.662 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:38.659+0000 7fc271e00700 1 --2- 172.21.15.87:0/2411990257 >> [v2:172.21.15.90:6838/160586017,v1:172.21.15.90:6839/160586017] conn(0x560e89df12d0 0x560e89df36c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:31:38.662 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:38.659+0000 7fc271e00700 1 --2- 172.21.15.87:0/2411990257 >> [v2:172.21.15.90:6838/160586017,v1:172.21.15.90:6839/160586017] conn(0x560e89df12d0 0x560e89df36c0 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b6b6c0c0557901c1 server_cookie=a930ed58f19be177 in_seq=0 out_seq=0 2024-05-08T05:31:38.662 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:38.659+0000 7fc25cc00700 10 client.25448 ms_handle_connect on v2:172.21.15.90:6838/160586017 2024-05-08T05:31:38.663 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:38.662+0000 7fc25cc00700 1 -- 172.21.15.87:0/2411990257 <== mds.0 v2:172.21.15.90:6838/160586017 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x560e89cc4400 con 0x560e89df12d0 2024-05-08T05:31:38.663 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:38.662+0000 7fc25cc00700 10 client.25448 handle_command_reply: tid=0 2024-05-08T05:31:38.663 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:38.662+0000 7fc283c92b80 1 client.25448 shutdown 2024-05-08T05:31:38.663 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:38.662+0000 7fc283c92b80 1 -- 172.21.15.87:0/2411990257 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x560e89d6ce10 msgr2=0x560e89d8d9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:31:38.663 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:38.662+0000 7fc283c92b80 1 --2- 172.21.15.87:0/2411990257 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x560e89d6ce10 0x560e89d8d9e0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fc26400b2a0 tx=0x7fc2640054b0 comp rx=0 tx=0).stop 2024-05-08T05:31:38.663 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:38.662+0000 7fc283c92b80 1 -- 172.21.15.87:0/2411990257 shutdown_connections 2024-05-08T05:31:38.664 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:38.662+0000 7fc283c92b80 1 --2- 172.21.15.87:0/2411990257 >> [v2:172.21.15.90:6838/160586017,v1:172.21.15.90:6839/160586017] conn(0x560e89df12d0 0x560e89df36c0 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:31:38.664 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:38.662+0000 7fc283c92b80 1 --2- 172.21.15.87:0/2411990257 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x560e89d72af0 0x560e89d8e460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:31:38.664 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:38.662+0000 7fc283c92b80 1 --2- 172.21.15.87:0/2411990257 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x560e89d6ce10 0x560e89d8d9e0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:31:38.664 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:38.662+0000 7fc283c92b80 1 --2- 172.21.15.87:0/2411990257 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x560e89d721d0 0x560e89d8df20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:31:38.664 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:38.662+0000 7fc283c92b80 1 -- 172.21.15.87:0/2411990257 >> 172.21.15.87:0/2411990257 conn(0x560e89c92b60 msgr2=0x560e89d58bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:31:38.664 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:38.662+0000 7fc25cc00700 0 client.25448 ms_handle_reset on v2:172.21.15.90:6838/160586017 2024-05-08T05:31:38.664 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:38.662+0000 7fc283c92b80 1 -- 172.21.15.87:0/2411990257 shutdown_connections 2024-05-08T05:31:38.664 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:38.662+0000 7fc283c92b80 1 -- 172.21.15.87:0/2411990257 wait complete. 2024-05-08T05:31:38.664 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:38.663+0000 7fc283c92b80 20 client.25448 trim_cache size 0 max 16384 2024-05-08T05:31:38.664 INFO:teuthology.orchestra.run.smithi087.stdout:[] 2024-05-08T05:31:38.665 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:38.663+0000 7fc278a00700 1 -- 172.21.15.87:0/745425541 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7fc2580b2980 msgr2=0x7fc2580b4e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:31:38.665 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:38.663+0000 7fc278a00700 1 --2- 172.21.15.87:0/745425541 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7fc2580b2980 0x7fc2580b4e40 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fc26c0074e0 tx=0x7fc26c00b040 comp rx=0 tx=0).stop 2024-05-08T05:31:38.665 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:38.663+0000 7fc278a00700 1 -- 172.21.15.87:0/745425541 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc274102b30 msgr2=0x7fc2741a1e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:31:38.665 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:38.663+0000 7fc278a00700 1 --2- 172.21.15.87:0/745425541 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc274102b30 0x7fc2741a1e40 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fc26000eb30 tx=0x7fc26000ee40 comp rx=0 tx=0).stop 2024-05-08T05:31:38.665 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:38.663+0000 7fc278a00700 1 -- 172.21.15.87:0/745425541 shutdown_connections 2024-05-08T05:31:38.665 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:38.663+0000 7fc278a00700 1 --2- 172.21.15.87:0/745425541 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7fc2580b2980 0x7fc2580b4e40 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:31:38.665 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:38.663+0000 7fc278a00700 1 --2- 172.21.15.87:0/745425541 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc27410fd30 0x7fc27419bac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:31:38.665 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:38.663+0000 7fc278a00700 1 --2- 172.21.15.87:0/745425541 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc274102180 0x7fc2741a1900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:31:38.665 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:38.663+0000 7fc278a00700 1 --2- 172.21.15.87:0/745425541 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc274102b30 0x7fc2741a1e40 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:31:38.665 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:38.663+0000 7fc278a00700 1 -- 172.21.15.87:0/745425541 >> 172.21.15.87:0/745425541 conn(0x7fc2740fddc0 msgr2=0x7fc2741001b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:31:38.665 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:38.664+0000 7fc278a00700 1 -- 172.21.15.87:0/745425541 shutdown_connections 2024-05-08T05:31:38.666 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:38.664+0000 7fc278a00700 1 -- 172.21.15.87:0/745425541 wait complete. 2024-05-08T05:31:40.458 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:31:40 smithi087 ceph-mon[29523]: pgmap v500: 97 pgs: 97 active+clean; 28 MiB data, 458 MiB used, 1.0 TiB / 1.0 TiB avail; 848 KiB/s rd, 2.4 MiB/s wr, 141 op/s 2024-05-08T05:31:40.483 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:31:40 smithi090 ceph-mon[34526]: pgmap v500: 97 pgs: 97 active+clean; 28 MiB data, 458 MiB used, 1.0 TiB / 1.0 TiB avail; 848 KiB/s rd, 2.4 MiB/s wr, 141 op/s 2024-05-08T05:31:40.538 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:31:40 smithi160 ceph-mon[34827]: pgmap v500: 97 pgs: 97 active+clean; 28 MiB data, 458 MiB used, 1.0 TiB / 1.0 TiB avail; 848 KiB/s rd, 2.4 MiB/s wr, 141 op/s 2024-05-08T05:31:40.630 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-05-08T05:31:40.630 DEBUG:teuthology.orchestra.run.smithi087:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid eeeb813e-0cf9-11ef-bc97-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-05-08T05:31:41.096 INFO:teuthology.orchestra.run.smithi087.stderr:Inferring config /var/lib/ceph/eeeb813e-0cf9-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T05:31:42.458 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:31:42 smithi087 ceph-mon[29523]: pgmap v501: 97 pgs: 97 active+clean; 30 MiB data, 470 MiB used, 1.0 TiB / 1.0 TiB avail; 759 KiB/s rd, 2.5 MiB/s wr, 184 op/s 2024-05-08T05:31:42.483 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:31:42 smithi090 ceph-mon[34526]: pgmap v501: 97 pgs: 97 active+clean; 30 MiB data, 470 MiB used, 1.0 TiB / 1.0 TiB avail; 759 KiB/s rd, 2.5 MiB/s wr, 184 op/s 2024-05-08T05:31:42.538 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:31:42 smithi160 ceph-mon[34827]: pgmap v501: 97 pgs: 97 active+clean; 30 MiB data, 470 MiB used, 1.0 TiB / 1.0 TiB avail; 759 KiB/s rd, 2.5 MiB/s wr, 184 op/s 2024-05-08T05:31:43.376 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:43.343+0000 7f24afe00700 1 -- 172.21.15.87:0/1329540372 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f24b010da10 msgr2=0x7f24b010fed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:31:43.376 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:43.343+0000 7f24afe00700 1 --2- 172.21.15.87:0/1329540372 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f24b010da10 0x7f24b010fed0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f24a800b0a0 tx=0x7f24a800b3b0 comp rx=0 tx=0).stop 2024-05-08T05:31:43.376 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:43.343+0000 7f24afe00700 1 -- 172.21.15.87:0/1329540372 shutdown_connections 2024-05-08T05:31:43.376 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:43.343+0000 7f24afe00700 1 --2- 172.21.15.87:0/1329540372 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f24b010da10 0x7f24b010fed0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:31:43.376 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:43.343+0000 7f24afe00700 1 --2- 172.21.15.87:0/1329540372 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f24b01045e0 0x7f24b01049c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:31:43.376 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:43.343+0000 7f24afe00700 1 --2- 172.21.15.87:0/1329540372 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f24b0104f00 0x7f24b010d3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:31:43.376 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:43.343+0000 7f24afe00700 1 -- 172.21.15.87:0/1329540372 >> 172.21.15.87:0/1329540372 conn(0x7f24b00fde30 msgr2=0x7f24b0100250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:31:43.377 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:43.343+0000 7f24afe00700 1 -- 172.21.15.87:0/1329540372 shutdown_connections 2024-05-08T05:31:43.377 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:43.344+0000 7f24afe00700 1 -- 172.21.15.87:0/1329540372 wait complete. 2024-05-08T05:31:43.377 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:43.345+0000 7f24afe00700 1 Processor -- start 2024-05-08T05:31:43.377 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:43.345+0000 7f24afe00700 1 -- start start 2024-05-08T05:31:43.377 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:43.346+0000 7f24afe00700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f24b01045e0 0x7f24b0102240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:31:43.377 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:43.346+0000 7f24afe00700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f24b0104f00 0x7f24b0102780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:31:43.377 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:43.346+0000 7f24afe00700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f24b010da10 0x7f24b0102cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:31:43.377 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:43.346+0000 7f24afe00700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f24b0113680 con 0x7f24b010da10 2024-05-08T05:31:43.377 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:43.346+0000 7f24afe00700 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f24b0113500 con 0x7f24b01045e0 2024-05-08T05:31:43.377 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:43.346+0000 7f24afe00700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f24b0113800 con 0x7f24b0104f00 2024-05-08T05:31:43.377 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:43.346+0000 7f24aea00700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f24b01045e0 0x7f24b0102240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:31:43.377 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:43.346+0000 7f24aea00700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f24b01045e0 0x7f24b0102240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.87:51504/0 (socket says 172.21.15.87:51504) 2024-05-08T05:31:43.377 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:43.346+0000 7f24aea00700 1 -- 172.21.15.87:0/1764768473 learned_addr learned my addr 172.21.15.87:0/1764768473 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T05:31:43.377 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:43.346+0000 7f24ae000700 1 --2- 172.21.15.87:0/1764768473 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f24b0104f00 0x7f24b0102780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:31:43.378 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:43.346+0000 7f24af400700 1 --2- 172.21.15.87:0/1764768473 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f24b010da10 0x7f24b0102cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:31:43.378 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:43.347+0000 7f24aea00700 1 -- 172.21.15.87:0/1764768473 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f24b0104f00 msgr2=0x7f24b0102780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:31:43.378 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:43.347+0000 7f24aea00700 1 --2- 172.21.15.87:0/1764768473 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f24b0104f00 0x7f24b0102780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:31:43.378 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:43.347+0000 7f24aea00700 1 -- 172.21.15.87:0/1764768473 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f24b010da10 msgr2=0x7f24b0102cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:31:43.378 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:43.347+0000 7f24aea00700 1 --2- 172.21.15.87:0/1764768473 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f24b010da10 0x7f24b0102cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:31:43.378 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:43.347+0000 7f24aea00700 1 -- 172.21.15.87:0/1764768473 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f24b01a8060 con 0x7f24b01045e0 2024-05-08T05:31:43.378 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:43.347+0000 7f24af400700 1 --2- 172.21.15.87:0/1764768473 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f24b010da10 0x7f24b0102cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T05:31:43.378 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:43.347+0000 7f24ae000700 1 --2- 172.21.15.87:0/1764768473 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f24b0104f00 0x7f24b0102780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T05:31:43.378 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:43.347+0000 7f24aea00700 1 --2- 172.21.15.87:0/1764768473 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f24b01045e0 0x7f24b0102240 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f24a000e9a0 tx=0x7f24a000ecb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:31:43.378 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:43.347+0000 7f24a7400700 1 -- 172.21.15.87:0/1764768473 <== mon.2 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24a000cbd0 con 0x7f24b01045e0 2024-05-08T05:31:43.378 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:43.347+0000 7f24a7400700 1 -- 172.21.15.87:0/1764768473 <== mon.2 v2:172.21.15.90:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f24a000cd70 con 0x7f24b01045e0 2024-05-08T05:31:43.378 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:43.347+0000 7f24afe00700 1 -- 172.21.15.87:0/1764768473 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f24b01a8350 con 0x7f24b01045e0 2024-05-08T05:31:43.378 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:43.347+0000 7f24a7400700 1 -- 172.21.15.87:0/1764768473 <== mon.2 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24a0018680 con 0x7f24b01045e0 2024-05-08T05:31:43.378 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:43.347+0000 7f24afe00700 1 -- 172.21.15.87:0/1764768473 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f24b01a88e0 con 0x7f24b01045e0 2024-05-08T05:31:43.379 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:43.352+0000 7f24c0675b80 1 Processor -- start 2024-05-08T05:31:43.379 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:43.352+0000 7f24c0675b80 1 -- start start 2024-05-08T05:31:43.379 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:43.352+0000 7f24c0675b80 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x56051569de20 0x56051569e200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:31:43.379 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:43.353+0000 7f24c0675b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x56051569e740 0x5605156984b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:31:43.379 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:43.353+0000 7f24c0675b80 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x560515698ad0 0x560515698f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:31:43.379 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:43.353+0000 7f24c0675b80 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x5605155eaaa0 con 0x560515698ad0 2024-05-08T05:31:43.379 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:43.353+0000 7f24c0675b80 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x5605155887e0 con 0x56051569de20 2024-05-08T05:31:43.379 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:43.353+0000 7f24c0675b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x5605155e6a60 con 0x56051569e740 2024-05-08T05:31:43.379 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:43.353+0000 7f24af400700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x56051569de20 0x56051569e200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:31:43.379 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:43.353+0000 7f24af400700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x56051569de20 0x56051569e200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.87:51514/0 (socket says 172.21.15.87:51514) 2024-05-08T05:31:43.379 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:43.353+0000 7f24af400700 1 -- 172.21.15.87:0/4072974384 learned_addr learned my addr 172.21.15.87:0/4072974384 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T05:31:43.379 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:43.353+0000 7f24a7400700 1 -- 172.21.15.87:0/1764768473 <== mon.2 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7f24a0018820 con 0x7f24b01045e0 2024-05-08T05:31:43.379 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:43.353+0000 7f24ae000700 1 --2- 172.21.15.87:0/4072974384 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x560515698ad0 0x560515698f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:31:43.380 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:43.353+0000 7f24af400700 1 -- 172.21.15.87:0/4072974384 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x56051569e740 msgr2=0x5605156984b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:31:43.380 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:43.353+0000 7f24af400700 1 --2- 172.21.15.87:0/4072974384 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x56051569e740 0x5605156984b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:31:43.380 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:43.353+0000 7f24af400700 1 -- 172.21.15.87:0/4072974384 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x560515698ad0 msgr2=0x560515698f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:31:43.380 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:43.353+0000 7f24af400700 1 --2- 172.21.15.87:0/4072974384 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x560515698ad0 0x560515698f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:31:43.380 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:43.353+0000 7f24af400700 1 -- 172.21.15.87:0/4072974384 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560515537950 con 0x56051569de20 2024-05-08T05:31:43.380 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:43.354+0000 7f24ae000700 1 --2- 172.21.15.87:0/4072974384 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x560515698ad0 0x560515698f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T05:31:43.380 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:43.354+0000 7f24af400700 1 --2- 172.21.15.87:0/4072974384 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x56051569de20 0x56051569e200 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f24a800b0a0 tx=0x7f24a8009360 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6d7101047631514e server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:31:43.380 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:43.354+0000 7f249be00700 1 -- 172.21.15.87:0/4072974384 <== mon.2 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24a800bcb0 con 0x56051569de20 2024-05-08T05:31:43.380 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:43.354+0000 7f249be00700 1 -- 172.21.15.87:0/4072974384 <== mon.2 v2:172.21.15.90:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f24a80074e0 con 0x56051569de20 2024-05-08T05:31:43.380 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:43.354+0000 7f249be00700 1 -- 172.21.15.87:0/4072974384 <== mon.2 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24a80052a0 con 0x56051569de20 2024-05-08T05:31:43.380 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:43.355+0000 7f24a7400700 1 --2- 172.21.15.87:0/1764768473 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f24940b2900 0x7f24940b4dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:31:43.380 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:43.355+0000 7f24a7400700 1 -- 172.21.15.87:0/1764768473 <== mon.2 v2:172.21.15.90:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8190+0+0 (secure 0 0 0) 0x7f24a00e2320 con 0x7f24b01045e0 2024-05-08T05:31:43.380 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:43.355+0000 7f24c0675b80 1 -- 172.21.15.87:0/4072974384 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x56051569de20 msgr2=0x56051569e200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:31:43.381 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:43.355+0000 7f24c0675b80 1 --2- 172.21.15.87:0/4072974384 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x56051569de20 0x56051569e200 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f24a800b0a0 tx=0x7f24a8009360 comp rx=0 tx=0).stop 2024-05-08T05:31:43.381 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:43.355+0000 7f24aea00700 1 --2- 172.21.15.87:0/1764768473 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f24940b2900 0x7f24940b4dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:31:43.381 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:43.355+0000 7f24c0675b80 1 -- 172.21.15.87:0/4072974384 shutdown_connections 2024-05-08T05:31:43.381 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:43.355+0000 7f24c0675b80 1 --2- 172.21.15.87:0/4072974384 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x560515698ad0 0x560515698f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:31:43.381 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:43.355+0000 7f24c0675b80 1 --2- 172.21.15.87:0/4072974384 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x56051569de20 0x56051569e200 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:31:43.381 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:43.355+0000 7f24c0675b80 1 --2- 172.21.15.87:0/4072974384 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x56051569e740 0x5605156984b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:31:43.381 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:43.355+0000 7f24c0675b80 1 -- 172.21.15.87:0/4072974384 >> 172.21.15.87:0/4072974384 conn(0x560515610750 msgr2=0x560515692d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:31:43.381 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:43.356+0000 7f24c0675b80 1 -- 172.21.15.87:0/4072974384 shutdown_connections 2024-05-08T05:31:43.381 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:43.356+0000 7f24c0675b80 1 -- 172.21.15.87:0/4072974384 wait complete. 2024-05-08T05:31:43.381 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:43.356+0000 7f24aea00700 1 --2- 172.21.15.87:0/1764768473 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f24940b2900 0x7f24940b4dc0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x5605156949f0 tx=0x7f24a00b2040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:31:43.381 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:43.356+0000 7f24c0675b80 1 -- start start 2024-05-08T05:31:43.381 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:43.356+0000 7f24c0675b80 1 Processor -- start 2024-05-08T05:31:43.381 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:43.357+0000 7f24c0675b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x560515698ad0 0x5605156a43e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:31:43.382 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:43.357+0000 7f24c0675b80 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x56051569de20 0x5605156a1780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:31:43.382 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:43.357+0000 7f24c0675b80 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56051569e740 0x5605156a1cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:31:43.382 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:43.357+0000 7f24c0675b80 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x5605156a5170 con 0x56051569e740 2024-05-08T05:31:43.382 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:43.357+0000 7f24c0675b80 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x560515550ba0 con 0x56051569de20 2024-05-08T05:31:43.382 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:43.357+0000 7f24c0675b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x5605156a52f0 con 0x560515698ad0 2024-05-08T05:31:43.382 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:43.357+0000 7f24c0675b80 10 client.0 _ll_register_callbacks cb 0x560515591cf0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T05:31:43.382 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:43.357+0000 7f24ae000700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x56051569de20 0x5605156a1780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:31:43.382 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:43.357+0000 7f24ae000700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x56051569de20 0x5605156a1780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.87:51520/0 (socket says 172.21.15.87:51520) 2024-05-08T05:31:43.382 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:43.357+0000 7f24ae000700 1 -- 172.21.15.87:0/2964294428 learned_addr learned my addr 172.21.15.87:0/2964294428 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T05:31:43.382 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:43.357+0000 7f24af400700 1 --2- 172.21.15.87:0/2964294428 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56051569e740 0x5605156a1cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:31:43.382 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:43.358+0000 7f24ae000700 1 -- 172.21.15.87:0/2964294428 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x560515698ad0 msgr2=0x5605156a43e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:31:43.382 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:43.358+0000 7f24af400700 1 --2- 172.21.15.87:0/2964294428 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x560515698ad0 0x5605156a43e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:31:43.382 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:43.358+0000 7f24ae000700 1 --2- 172.21.15.87:0/2964294428 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x560515698ad0 0x5605156a43e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:31:43.382 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:43.358+0000 7f24ae000700 1 -- 172.21.15.87:0/2964294428 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56051569e740 msgr2=0x5605156a1cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:31:43.383 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:43.358+0000 7f24ae000700 1 --2- 172.21.15.87:0/2964294428 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56051569e740 0x5605156a1cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:31:43.383 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:43.358+0000 7f24ae000700 1 -- 172.21.15.87:0/2964294428 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5605155b04a0 con 0x56051569de20 2024-05-08T05:31:43.383 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:43.358+0000 7f24af400700 1 --2- 172.21.15.87:0/2964294428 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x560515698ad0 0x5605156a43e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T05:31:43.383 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:43.358+0000 7f24ae000700 1 --2- 172.21.15.87:0/2964294428 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x56051569de20 0x5605156a1780 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f249c011950 tx=0x7f249c011d10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=42002067249f5d12 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:31:43.383 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:43.358+0000 7f2498c00700 10 client.0 ms_handle_connect on v2:172.21.15.90:3300/0 2024-05-08T05:31:43.383 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:43.358+0000 7f2498c00700 1 -- 172.21.15.87:0/2964294428 <== mon.2 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f249c01f060 con 0x56051569de20 2024-05-08T05:31:43.383 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:43.358+0000 7f24c0675b80 1 -- 172.21.15.87:0/2964294428 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f24a80074e0 con 0x56051569de20 2024-05-08T05:31:43.383 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:43.358+0000 7f2498c00700 1 -- 172.21.15.87:0/2964294428 <== mon.2 v2:172.21.15.90:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8190+0+0 (secure 0 0 0) 0x7f249c004320 con 0x56051569de20 2024-05-08T05:31:43.383 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:43.359+0000 7f2498c00700 1 -- 172.21.15.87:0/2964294428 <== mon.2 v2:172.21.15.90:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f249c004520 con 0x56051569de20 2024-05-08T05:31:43.383 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:43.359+0000 7f24c0675b80 10 client.25460 fetch_fsmap learned FSMap version 26 2024-05-08T05:31:43.383 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:43.359+0000 7f24c0675b80 1 -- 172.21.15.87:0/2964294428 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x5605156afa70 con 0x56051569de20 2024-05-08T05:31:43.383 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:43.359+0000 7f2498c00700 1 -- 172.21.15.87:0/2964294428 <== mon.2 v2:172.21.15.90:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f24a80074e0 con 0x56051569de20 2024-05-08T05:31:43.383 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:43.359+0000 7f2498c00700 1 -- 172.21.15.87:0/2964294428 <== mon.2 v2:172.21.15.90:3300/0 5 ==== fsmap(e 26) ==== 8346+0+0 (secure 0 0 0) 0x7f249c003ca0 con 0x56051569de20 2024-05-08T05:31:43.384 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:43.359+0000 7f24c0675b80 10 client.25460 fetch_fsmap finished waiting for FSMap version 26 2024-05-08T05:31:43.384 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:43.359+0000 7f24c0675b80 10 client.25460 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-05-08T05:31:43.384 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:43.359+0000 7f24c0675b80 20 client.25460 populate_metadata read hostname 'smithi087' 2024-05-08T05:31:43.384 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:43.359+0000 7f24c0675b80 1 --2- 172.21.15.87:0/2964294428 >> [v2:172.21.15.90:6838/160586017,v1:172.21.15.90:6839/160586017] conn(0x5605156b2100 0x5605156b44f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:31:43.384 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:43.359+0000 7f24c0675b80 4 client.25460 mds_command: new command op to 24500 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-08T05:31:43.384 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:43.359+0000 7f24c0675b80 1 -- 172.21.15.87:0/2964294428 --> [v2:172.21.15.90:6838/160586017,v1:172.21.15.90:6839/160586017] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5605156651c0 con 0x5605156b2100 2024-05-08T05:31:43.384 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:43.359+0000 7f24af400700 1 --2- 172.21.15.87:0/2964294428 >> [v2:172.21.15.90:6838/160586017,v1:172.21.15.90:6839/160586017] conn(0x5605156b2100 0x5605156b44f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:31:43.384 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:43.360+0000 7f24af400700 1 --2- 172.21.15.87:0/2964294428 >> [v2:172.21.15.90:6838/160586017,v1:172.21.15.90:6839/160586017] conn(0x5605156b2100 0x5605156b44f0 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=23c411422b826b10 server_cookie=d7462a4121eae718 in_seq=0 out_seq=0 2024-05-08T05:31:43.384 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:43.360+0000 7f2498c00700 10 client.25460 ms_handle_connect on v2:172.21.15.90:6838/160586017 2024-05-08T05:31:43.384 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:43.362+0000 7f2498c00700 1 -- 172.21.15.87:0/2964294428 <== mds.0 v2:172.21.15.90:6838/160586017 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x5605156651c0 con 0x5605156b2100 2024-05-08T05:31:43.384 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:43.362+0000 7f2498c00700 10 client.25460 handle_command_reply: tid=0 2024-05-08T05:31:43.384 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:43.362+0000 7f24c0675b80 1 client.25460 shutdown 2024-05-08T05:31:43.384 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:43.362+0000 7f24c0675b80 1 -- 172.21.15.87:0/2964294428 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x56051569de20 msgr2=0x5605156a1780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:31:43.384 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:43.362+0000 7f24c0675b80 1 --2- 172.21.15.87:0/2964294428 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x56051569de20 0x5605156a1780 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f249c011950 tx=0x7f249c011d10 comp rx=0 tx=0).stop 2024-05-08T05:31:43.385 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:43.362+0000 7f24c0675b80 1 -- 172.21.15.87:0/2964294428 shutdown_connections 2024-05-08T05:31:43.385 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:43.362+0000 7f24c0675b80 1 --2- 172.21.15.87:0/2964294428 >> [v2:172.21.15.90:6838/160586017,v1:172.21.15.90:6839/160586017] conn(0x5605156b2100 0x5605156b44f0 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:31:43.385 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:43.362+0000 7f24c0675b80 1 --2- 172.21.15.87:0/2964294428 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56051569e740 0x5605156a1cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:31:43.385 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:43.362+0000 7f24c0675b80 1 --2- 172.21.15.87:0/2964294428 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x560515698ad0 0x5605156a43e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:31:43.385 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:43.362+0000 7f2498c00700 0 client.25460 ms_handle_reset on v2:172.21.15.90:6838/160586017 2024-05-08T05:31:43.385 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:43.362+0000 7f24c0675b80 1 --2- 172.21.15.87:0/2964294428 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x56051569de20 0x5605156a1780 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:31:43.385 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:43.362+0000 7f24c0675b80 1 -- 172.21.15.87:0/2964294428 >> 172.21.15.87:0/2964294428 conn(0x560515610750 msgr2=0x56051568d7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:31:43.385 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:43.362+0000 7f24c0675b80 1 -- 172.21.15.87:0/2964294428 shutdown_connections 2024-05-08T05:31:43.385 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:43.363+0000 7f24c0675b80 1 -- 172.21.15.87:0/2964294428 wait complete. 2024-05-08T05:31:43.385 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:43.363+0000 7f24c0675b80 20 client.25460 trim_cache size 0 max 16384 2024-05-08T05:31:43.386 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:43.386+0000 7f24c0675b80 1 Processor -- start 2024-05-08T05:31:43.386 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:43.386+0000 7f24c0675b80 1 -- start start 2024-05-08T05:31:43.387 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:43.386+0000 7f24c0675b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x560515698ad0 0x5605156ae290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:31:43.387 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:43.386+0000 7f24c0675b80 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56051569de20 0x56051568d8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:31:43.387 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:43.386+0000 7f24c0675b80 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x56051569e740 0x5605156a1740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:31:43.387 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:43.386+0000 7f24c0675b80 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f249000fb30 con 0x56051569de20 2024-05-08T05:31:43.387 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:43.386+0000 7f24c0675b80 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f249000d3c0 con 0x56051569e740 2024-05-08T05:31:43.387 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:43.386+0000 7f24c0675b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f249000b210 con 0x560515698ad0 2024-05-08T05:31:43.387 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:43.387+0000 7f24af400700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x56051569e740 0x5605156a1740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:31:43.387 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:43.387+0000 7f24af400700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x56051569e740 0x5605156a1740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.87:51534/0 (socket says 172.21.15.87:51534) 2024-05-08T05:31:43.388 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:43.387+0000 7f24af400700 1 -- 172.21.15.87:0/3915088267 learned_addr learned my addr 172.21.15.87:0/3915088267 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T05:31:43.388 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:43.387+0000 7f24ae000700 1 --2- 172.21.15.87:0/3915088267 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56051569de20 0x56051568d8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:31:43.388 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:43.387+0000 7f24af400700 1 --2- 172.21.15.87:0/3915088267 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x560515698ad0 0x5605156ae290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:31:43.389 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:43.387+0000 7f24af400700 1 -- 172.21.15.87:0/3915088267 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x560515698ad0 msgr2=0x5605156ae290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:31:43.389 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:43.387+0000 7f24af400700 1 --2- 172.21.15.87:0/3915088267 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x560515698ad0 0x5605156ae290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:31:43.389 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:43.387+0000 7f24af400700 1 -- 172.21.15.87:0/3915088267 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56051569de20 msgr2=0x56051568d8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:31:43.389 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:43.387+0000 7f24af400700 1 --2- 172.21.15.87:0/3915088267 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56051569de20 0x56051568d8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:31:43.389 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:43.387+0000 7f24af400700 1 -- 172.21.15.87:0/3915088267 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56051568f920 con 0x56051569e740 2024-05-08T05:31:43.389 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:43.387+0000 7f24af400700 1 --2- 172.21.15.87:0/3915088267 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x56051569e740 0x5605156a1740 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f24a8007e40 tx=0x7f24a80097e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c32366b385cce30a server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:31:43.389 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:43.388+0000 7f249b400700 1 -- 172.21.15.87:0/3915088267 <== mon.2 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24a8003d90 con 0x56051569e740 2024-05-08T05:31:43.389 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:43.388+0000 7f249b400700 1 -- 172.21.15.87:0/3915088267 <== mon.2 v2:172.21.15.90:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f24a802f830 con 0x56051569e740 2024-05-08T05:31:43.389 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:43.388+0000 7f249b400700 1 -- 172.21.15.87:0/3915088267 <== mon.2 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24a8007af0 con 0x56051569e740 2024-05-08T05:31:43.389 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:43.388+0000 7f24c0675b80 1 -- 172.21.15.87:0/3915088267 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x56051569e740 msgr2=0x5605156a1740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:31:43.390 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:43.388+0000 7f24c0675b80 1 --2- 172.21.15.87:0/3915088267 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x56051569e740 0x5605156a1740 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f24a8007e40 tx=0x7f24a80097e0 comp rx=0 tx=0).stop 2024-05-08T05:31:43.390 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:43.389+0000 7f24c0675b80 1 -- 172.21.15.87:0/3915088267 shutdown_connections 2024-05-08T05:31:43.390 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:43.389+0000 7f24c0675b80 1 --2- 172.21.15.87:0/3915088267 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x56051569e740 0x5605156a1740 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:31:43.390 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:43.389+0000 7f24c0675b80 1 --2- 172.21.15.87:0/3915088267 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x560515698ad0 0x5605156ae290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:31:43.390 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:43.389+0000 7f24c0675b80 1 --2- 172.21.15.87:0/3915088267 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56051569de20 0x56051568d8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:31:43.390 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:43.389+0000 7f24c0675b80 1 -- 172.21.15.87:0/3915088267 >> 172.21.15.87:0/3915088267 conn(0x560515610750 msgr2=0x5605156a1030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:31:43.390 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:43.389+0000 7f24c0675b80 1 -- 172.21.15.87:0/3915088267 shutdown_connections 2024-05-08T05:31:43.390 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:43.389+0000 7f24c0675b80 1 -- 172.21.15.87:0/3915088267 wait complete. 2024-05-08T05:31:43.391 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:43.389+0000 7f24c0675b80 1 -- start start 2024-05-08T05:31:43.391 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:43.390+0000 7f24c0675b80 1 Processor -- start 2024-05-08T05:31:43.391 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:43.390+0000 7f24c0675b80 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x560515698ad0 0x5605156aa8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:31:43.392 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:43.390+0000 7f24c0675b80 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x56051569de20 0x5605156a7cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:31:43.392 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:43.390+0000 7f24c0675b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x56051569e740 0x5605156a8200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:31:43.392 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:43.390+0000 7f24c0675b80 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f249000b880 con 0x560515698ad0 2024-05-08T05:31:43.392 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:43.390+0000 7f24c0675b80 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f249000ccf0 con 0x56051569de20 2024-05-08T05:31:43.392 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:43.390+0000 7f24c0675b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f249000bf50 con 0x56051569e740 2024-05-08T05:31:43.392 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:43.390+0000 7f24c0675b80 10 client.0 _ll_register_callbacks cb 0x560515591cf0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T05:31:43.392 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:43.391+0000 7f24af400700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x560515698ad0 0x5605156aa8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:31:43.392 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:43.391+0000 7f24af400700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x560515698ad0 0x5605156aa8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:37064/0 (socket says 172.21.15.87:37064) 2024-05-08T05:31:43.392 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:43.391+0000 7f24af400700 1 -- 172.21.15.87:0/159878970 learned_addr learned my addr 172.21.15.87:0/159878970 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T05:31:43.392 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:43.391+0000 7f24ae000700 1 --2- 172.21.15.87:0/159878970 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x56051569de20 0x5605156a7cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:31:43.392 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:43.391+0000 7f24af400700 1 --2- 172.21.15.87:0/159878970 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x56051569e740 0x5605156a8200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:31:43.392 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:43.391+0000 7f24af400700 1 -- 172.21.15.87:0/159878970 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x56051569e740 msgr2=0x5605156a8200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:31:43.392 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:43.391+0000 7f24af400700 1 --2- 172.21.15.87:0/159878970 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x56051569e740 0x5605156a8200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:31:43.392 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:43.391+0000 7f24af400700 1 -- 172.21.15.87:0/159878970 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x56051569de20 msgr2=0x5605156a7cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:31:43.393 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:43.391+0000 7f24af400700 1 --2- 172.21.15.87:0/159878970 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x56051569de20 0x5605156a7cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:31:43.393 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:43.391+0000 7f24af400700 1 -- 172.21.15.87:0/159878970 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5605156a87c0 con 0x560515698ad0 2024-05-08T05:31:43.393 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:43.391+0000 7f24ae000700 1 --2- 172.21.15.87:0/159878970 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x56051569de20 0x5605156a7cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T05:31:43.394 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:43.391+0000 7f24af400700 1 --2- 172.21.15.87:0/159878970 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x560515698ad0 0x5605156aa8d0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f24a80093a0 tx=0x7f24a800b3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4757bce705081f8d server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:31:43.394 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:43.391+0000 7f2498c00700 10 client.0 ms_handle_connect on v2:172.21.15.87:3300/0 2024-05-08T05:31:43.394 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:43.392+0000 7f2498c00700 1 -- 172.21.15.87:0/159878970 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24a802f380 con 0x560515698ad0 2024-05-08T05:31:43.394 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:43.392+0000 7f2498c00700 1 -- 172.21.15.87:0/159878970 <== mon.0 v2:172.21.15.87:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8190+0+0 (secure 0 0 0) 0x7f24a802f520 con 0x560515698ad0 2024-05-08T05:31:43.394 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:43.392+0000 7f24c0675b80 1 -- 172.21.15.87:0/159878970 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f24a802f830 con 0x560515698ad0 2024-05-08T05:31:43.394 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:43.392+0000 7f2498c00700 1 -- 172.21.15.87:0/159878970 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f24a8003a00 con 0x560515698ad0 2024-05-08T05:31:43.394 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:43.392+0000 7f24c0675b80 10 client.15363 fetch_fsmap learned FSMap version 26 2024-05-08T05:31:43.395 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:43.392+0000 7f24c0675b80 1 -- 172.21.15.87:0/159878970 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x56051571e780 con 0x560515698ad0 2024-05-08T05:31:43.395 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:43.393+0000 7f2498c00700 1 -- 172.21.15.87:0/159878970 <== mon.0 v2:172.21.15.87:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f24a802f830 con 0x560515698ad0 2024-05-08T05:31:43.395 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:43.393+0000 7f2498c00700 1 -- 172.21.15.87:0/159878970 <== mon.0 v2:172.21.15.87:3300/0 5 ==== fsmap(e 26) ==== 8346+0+0 (secure 0 0 0) 0x7f24a8011070 con 0x560515698ad0 2024-05-08T05:31:43.395 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:43.393+0000 7f24c0675b80 10 client.15363 fetch_fsmap finished waiting for FSMap version 26 2024-05-08T05:31:43.395 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:43.393+0000 7f24c0675b80 10 client.15363 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-05-08T05:31:43.395 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:43.393+0000 7f24c0675b80 20 client.15363 populate_metadata read hostname 'smithi087' 2024-05-08T05:31:43.395 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:43.393+0000 7f24c0675b80 1 --2- 172.21.15.87:0/159878970 >> [v2:172.21.15.90:6838/160586017,v1:172.21.15.90:6839/160586017] conn(0x56051571e9b0 0x560515720da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:31:43.395 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:43.393+0000 7f24c0675b80 4 client.15363 mds_command: new command op to 24500 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-05-08T05:31:43.395 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:43.393+0000 7f24c0675b80 1 -- 172.21.15.87:0/159878970 --> [v2:172.21.15.90:6838/160586017,v1:172.21.15.90:6839/160586017] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x5605155f8480 con 0x56051571e9b0 2024-05-08T05:31:43.395 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:43.393+0000 7f24ae000700 1 --2- 172.21.15.87:0/159878970 >> [v2:172.21.15.90:6838/160586017,v1:172.21.15.90:6839/160586017] conn(0x56051571e9b0 0x560515720da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:31:43.395 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:43.394+0000 7f2498c00700 10 client.15363 ms_handle_connect on v2:172.21.15.90:6838/160586017 2024-05-08T05:31:43.395 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:43.394+0000 7f24ae000700 1 --2- 172.21.15.87:0/159878970 >> [v2:172.21.15.90:6838/160586017,v1:172.21.15.90:6839/160586017] conn(0x56051571e9b0 0x560515720da0 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=789c4bec5809bbd3 server_cookie=b994660a151f6870 in_seq=0 out_seq=0 2024-05-08T05:31:43.415 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:43.414+0000 7f2498c00700 1 -- 172.21.15.87:0/159878970 <== mds.0 v2:172.21.15.90:6838/160586017 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x5605155f8480 con 0x56051571e9b0 2024-05-08T05:31:43.415 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:43.414+0000 7f2498c00700 10 client.15363 handle_command_reply: tid=0 2024-05-08T05:31:43.415 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:43.414+0000 7f24c0675b80 1 client.15363 shutdown 2024-05-08T05:31:43.415 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:43.414+0000 7f24c0675b80 1 -- 172.21.15.87:0/159878970 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x560515698ad0 msgr2=0x5605156aa8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:31:43.416 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:43.414+0000 7f24c0675b80 1 --2- 172.21.15.87:0/159878970 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x560515698ad0 0x5605156aa8d0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f24a80093a0 tx=0x7f24a800b3b0 comp rx=0 tx=0).stop 2024-05-08T05:31:43.416 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:43.414+0000 7f24c0675b80 1 -- 172.21.15.87:0/159878970 shutdown_connections 2024-05-08T05:31:43.416 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:43.415+0000 7f24c0675b80 1 --2- 172.21.15.87:0/159878970 >> [v2:172.21.15.90:6838/160586017,v1:172.21.15.90:6839/160586017] conn(0x56051571e9b0 0x560515720da0 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:31:43.416 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:43.415+0000 7f24c0675b80 1 --2- 172.21.15.87:0/159878970 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x56051569e740 0x5605156a8200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:31:43.416 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:43.415+0000 7f2498c00700 0 client.15363 ms_handle_reset on v2:172.21.15.90:6838/160586017 2024-05-08T05:31:43.416 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:43.415+0000 7f24c0675b80 1 --2- 172.21.15.87:0/159878970 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x560515698ad0 0x5605156aa8d0 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:31:43.416 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:43.415+0000 7f24c0675b80 1 --2- 172.21.15.87:0/159878970 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x56051569de20 0x5605156a7cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:31:43.416 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:43.415+0000 7f24c0675b80 1 -- 172.21.15.87:0/159878970 >> 172.21.15.87:0/159878970 conn(0x560515610750 msgr2=0x5605156a18c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:31:43.416 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:43.415+0000 7f24c0675b80 1 -- 172.21.15.87:0/159878970 shutdown_connections 2024-05-08T05:31:43.416 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:43.415+0000 7f24c0675b80 1 -- 172.21.15.87:0/159878970 wait complete. 2024-05-08T05:31:43.416 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:43.415+0000 7f24c0675b80 20 client.15363 trim_cache size 0 max 16384 2024-05-08T05:31:43.417 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-05-08T05:31:43.417 INFO:teuthology.orchestra.run.smithi087.stdout: "return_code": 0, 2024-05-08T05:31:43.417 INFO:teuthology.orchestra.run.smithi087.stdout: "scrub_tag": "0c24892a-dd87-4fe4-b170-57d44f003ac0", 2024-05-08T05:31:43.417 INFO:teuthology.orchestra.run.smithi087.stdout: "mode": "asynchronous" 2024-05-08T05:31:43.417 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-05-08T05:31:43.418 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:43.416+0000 7f24afe00700 1 -- 172.21.15.87:0/1764768473 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f24940b2900 msgr2=0x7f24940b4dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:31:43.418 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:43.416+0000 7f24afe00700 1 --2- 172.21.15.87:0/1764768473 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f24940b2900 0x7f24940b4dc0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x5605156949f0 tx=0x7f24a00b2040 comp rx=0 tx=0).stop 2024-05-08T05:31:43.418 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:43.416+0000 7f24afe00700 1 -- 172.21.15.87:0/1764768473 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f24b01045e0 msgr2=0x7f24b0102240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:31:43.418 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:43.416+0000 7f24afe00700 1 --2- 172.21.15.87:0/1764768473 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f24b01045e0 0x7f24b0102240 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f24a000e9a0 tx=0x7f24a000ecb0 comp rx=0 tx=0).stop 2024-05-08T05:31:43.418 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:43.416+0000 7f24afe00700 1 -- 172.21.15.87:0/1764768473 shutdown_connections 2024-05-08T05:31:43.418 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:43.416+0000 7f24afe00700 1 --2- 172.21.15.87:0/1764768473 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f24b010da10 0x7f24b0102cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:31:43.418 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:43.416+0000 7f24afe00700 1 --2- 172.21.15.87:0/1764768473 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f24b01045e0 0x7f24b0102240 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:31:43.418 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:43.416+0000 7f24afe00700 1 --2- 172.21.15.87:0/1764768473 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f24940b2900 0x7f24940b4dc0 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:31:43.418 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:43.416+0000 7f24afe00700 1 --2- 172.21.15.87:0/1764768473 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f24b0104f00 0x7f24b0102780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:31:43.418 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:43.416+0000 7f24afe00700 1 -- 172.21.15.87:0/1764768473 >> 172.21.15.87:0/1764768473 conn(0x7f24b00fde30 msgr2=0x7f24b00feba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:31:43.418 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:43.416+0000 7f24afe00700 1 -- 172.21.15.87:0/1764768473 shutdown_connections 2024-05-08T05:31:43.418 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:43.417+0000 7f24afe00700 1 -- 172.21.15.87:0/1764768473 wait complete. 2024-05-08T05:31:44.458 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:31:44 smithi087 ceph-mon[29523]: pgmap v502: 97 pgs: 97 active+clean; 34 MiB data, 492 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 2.9 MiB/s wr, 204 op/s 2024-05-08T05:31:44.459 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:31:44 smithi087 ceph-mon[29523]: fsmap cephfs:3 {0=b=up:active,1=g=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-05-08T05:31:44.459 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:31:44 smithi087 ceph-mon[29523]: scrub queued for path: / 2024-05-08T05:31:44.459 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:31:44 smithi087 ceph-mon[29523]: scrub summary: idle+waiting paths [/] 2024-05-08T05:31:44.459 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:31:44 smithi087 ceph-mon[29523]: scrub summary: active paths [/] 2024-05-08T05:31:44.459 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:31:44 smithi087 ceph-mon[29523]: scrub summary: active paths [/] 2024-05-08T05:31:44.483 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:31:44 smithi090 ceph-mon[34526]: pgmap v502: 97 pgs: 97 active+clean; 34 MiB data, 492 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 2.9 MiB/s wr, 204 op/s 2024-05-08T05:31:44.483 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:31:44 smithi090 ceph-mon[34526]: fsmap cephfs:3 {0=b=up:active,1=g=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-05-08T05:31:44.483 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:31:44 smithi090 ceph-mon[34526]: scrub queued for path: / 2024-05-08T05:31:44.483 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:31:44 smithi090 ceph-mon[34526]: scrub summary: idle+waiting paths [/] 2024-05-08T05:31:44.483 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:31:44 smithi090 ceph-mon[34526]: scrub summary: active paths [/] 2024-05-08T05:31:44.483 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:31:44 smithi090 ceph-mon[34526]: scrub summary: active paths [/] 2024-05-08T05:31:44.538 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:31:44 smithi160 ceph-mon[34827]: pgmap v502: 97 pgs: 97 active+clean; 34 MiB data, 492 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 2.9 MiB/s wr, 204 op/s 2024-05-08T05:31:44.539 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:31:44 smithi160 ceph-mon[34827]: fsmap cephfs:3 {0=b=up:active,1=g=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-05-08T05:31:44.539 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:31:44 smithi160 ceph-mon[34827]: scrub queued for path: / 2024-05-08T05:31:44.539 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:31:44 smithi160 ceph-mon[34827]: scrub summary: idle+waiting paths [/] 2024-05-08T05:31:44.539 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:31:44 smithi160 ceph-mon[34827]: scrub summary: active paths [/] 2024-05-08T05:31:44.539 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:31:44 smithi160 ceph-mon[34827]: scrub summary: active paths [/] 2024-05-08T05:31:44.683 DEBUG:teuthology.orchestra.run.smithi087:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid eeeb813e-0cf9-11ef-bc97-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-05-08T05:31:45.153 INFO:teuthology.orchestra.run.smithi087.stderr:Inferring config /var/lib/ceph/eeeb813e-0cf9-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T05:31:45.307 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:31:45 smithi087 ceph-mon[29523]: scrub summary: idle+waiting paths [/] 2024-05-08T05:31:45.307 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:31:45 smithi087 ceph-mon[29523]: scrub summary: active paths [/] 2024-05-08T05:31:45.307 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:31:45 smithi087 ceph-mon[29523]: scrub summary: idle+waiting paths [/] 2024-05-08T05:31:45.483 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:31:45 smithi090 ceph-mon[34526]: scrub summary: idle+waiting paths [/] 2024-05-08T05:31:45.483 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:31:45 smithi090 ceph-mon[34526]: scrub summary: active paths [/] 2024-05-08T05:31:45.483 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:31:45 smithi090 ceph-mon[34526]: scrub summary: idle+waiting paths [/] 2024-05-08T05:31:45.538 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:31:45 smithi160 ceph-mon[34827]: scrub summary: idle+waiting paths [/] 2024-05-08T05:31:45.538 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:31:45 smithi160 ceph-mon[34827]: scrub summary: active paths [/] 2024-05-08T05:31:45.539 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:31:45 smithi160 ceph-mon[34827]: scrub summary: idle+waiting paths [/] 2024-05-08T05:31:46.483 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:31:46 smithi090 ceph-mon[34526]: pgmap v503: 97 pgs: 97 active+clean; 38 MiB data, 499 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 2.7 MiB/s wr, 195 op/s 2024-05-08T05:31:46.483 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:31:46 smithi090 ceph-mon[34526]: scrub summary: idle+waiting paths [/] 2024-05-08T05:31:46.538 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:31:46 smithi160 ceph-mon[34827]: pgmap v503: 97 pgs: 97 active+clean; 38 MiB data, 499 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 2.7 MiB/s wr, 195 op/s 2024-05-08T05:31:46.538 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:31:46 smithi160 ceph-mon[34827]: scrub summary: idle+waiting paths [/] 2024-05-08T05:31:46.647 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:31:46 smithi087 ceph-mon[29523]: pgmap v503: 97 pgs: 97 active+clean; 38 MiB data, 499 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 2.7 MiB/s wr, 195 op/s 2024-05-08T05:31:46.647 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:31:46 smithi087 ceph-mon[29523]: scrub summary: idle+waiting paths [/] 2024-05-08T05:31:47.482 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:47.481+0000 7f92c4a00700 1 -- 172.21.15.87:0/1266387261 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f92c0109460 msgr2=0x7f92c0109840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:31:47.482 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:47.481+0000 7f92c4a00700 1 --2- 172.21.15.87:0/1266387261 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f92c0109460 0x7f92c0109840 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f92b0009990 tx=0x7f92b0009ca0 comp rx=0 tx=0).stop 2024-05-08T05:31:47.482 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:47.481+0000 7f92c4a00700 1 -- 172.21.15.87:0/1266387261 shutdown_connections 2024-05-08T05:31:47.482 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:47.481+0000 7f92c4a00700 1 --2- 172.21.15.87:0/1266387261 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f92c0103d90 0x7f92c01102a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:31:47.483 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:47.481+0000 7f92c4a00700 1 --2- 172.21.15.87:0/1266387261 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f92c0109460 0x7f92c0109840 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:31:47.483 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:47.481+0000 7f92c4a00700 1 --2- 172.21.15.87:0/1266387261 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f92c01033d0 0x7f92c0103850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:31:47.483 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:47.481+0000 7f92c4a00700 1 -- 172.21.15.87:0/1266387261 >> 172.21.15.87:0/1266387261 conn(0x7f92c00fef20 msgr2=0x7f92c0101340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:31:47.483 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:47.481+0000 7f92c4a00700 1 -- 172.21.15.87:0/1266387261 shutdown_connections 2024-05-08T05:31:47.483 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:47.481+0000 7f92c4a00700 1 -- 172.21.15.87:0/1266387261 wait complete. 2024-05-08T05:31:47.485 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:47.482+0000 7f92c4a00700 1 Processor -- start 2024-05-08T05:31:47.485 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:47.483+0000 7f92c4a00700 1 -- start start 2024-05-08T05:31:47.485 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:47.483+0000 7f92c4a00700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f92c01033d0 0x7f92c019f740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:31:47.485 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:47.483+0000 7f92c4a00700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f92c0103d90 0x7f92c019fc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:31:47.485 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:47.483+0000 7f92c4a00700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f92c0109460 0x7f92c0199900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:31:47.485 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:47.483+0000 7f92c4a00700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f92c01135c0 con 0x7f92c0103d90 2024-05-08T05:31:47.485 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:47.483+0000 7f92c4a00700 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f92c0113440 con 0x7f92c0109460 2024-05-08T05:31:47.485 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:47.483+0000 7f92c4a00700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f92c0113740 con 0x7f92c01033d0 2024-05-08T05:31:47.485 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:47.483+0000 7f92bfe00700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f92c0109460 0x7f92c0199900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:31:47.485 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:47.483+0000 7f92bea00700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f92c0103d90 0x7f92c019fc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:31:47.485 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:47.483+0000 7f92bfe00700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f92c0109460 0x7f92c0199900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.87:43614/0 (socket says 172.21.15.87:43614) 2024-05-08T05:31:47.485 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:47.483+0000 7f92bfe00700 1 -- 172.21.15.87:0/2596868941 learned_addr learned my addr 172.21.15.87:0/2596868941 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T05:31:47.486 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:47.483+0000 7f92bf400700 1 --2- 172.21.15.87:0/2596868941 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f92c01033d0 0x7f92c019f740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:31:47.486 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:47.484+0000 7f92bfe00700 1 -- 172.21.15.87:0/2596868941 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f92c01033d0 msgr2=0x7f92c019f740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:31:47.486 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:47.484+0000 7f92bfe00700 1 --2- 172.21.15.87:0/2596868941 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f92c01033d0 0x7f92c019f740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:31:47.486 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:47.484+0000 7f92bfe00700 1 -- 172.21.15.87:0/2596868941 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f92c0103d90 msgr2=0x7f92c019fc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:31:47.486 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:47.484+0000 7f92bfe00700 1 --2- 172.21.15.87:0/2596868941 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f92c0103d90 0x7f92c019fc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:31:47.486 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:47.484+0000 7f92bfe00700 1 -- 172.21.15.87:0/2596868941 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f92c019a060 con 0x7f92c0109460 2024-05-08T05:31:47.486 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:47.484+0000 7f92bfe00700 1 --2- 172.21.15.87:0/2596868941 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f92c0109460 0x7f92c0199900 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f92b800c370 tx=0x7f92b800c680 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:31:47.486 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:47.484+0000 7f92b7e00700 1 -- 172.21.15.87:0/2596868941 <== mon.2 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92b80092e0 con 0x7f92c0109460 2024-05-08T05:31:47.486 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:47.484+0000 7f92b7e00700 1 -- 172.21.15.87:0/2596868941 <== mon.2 v2:172.21.15.90:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f92b8003a00 con 0x7f92c0109460 2024-05-08T05:31:47.486 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:47.484+0000 7f92c4a00700 1 -- 172.21.15.87:0/2596868941 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f92c019a2f0 con 0x7f92c0109460 2024-05-08T05:31:47.486 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:47.484+0000 7f92b7e00700 1 -- 172.21.15.87:0/2596868941 <== mon.2 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92b80046f0 con 0x7f92c0109460 2024-05-08T05:31:47.486 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:47.484+0000 7f92c4a00700 1 -- 172.21.15.87:0/2596868941 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f92c01a6610 con 0x7f92c0109460 2024-05-08T05:31:47.488 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:47.488+0000 7f92b7e00700 1 -- 172.21.15.87:0/2596868941 <== mon.2 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7f92b801a020 con 0x7f92c0109460 2024-05-08T05:31:47.490 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:47.490+0000 7f92d0949b80 1 Processor -- start 2024-05-08T05:31:47.490 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:47.490+0000 7f92b7e00700 1 --2- 172.21.15.87:0/2596868941 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f92a40b2880 0x7f92a40b4d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:31:47.490 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:47.490+0000 7f92d0949b80 1 -- start start 2024-05-08T05:31:47.498 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:47.490+0000 7f92b7e00700 1 -- 172.21.15.87:0/2596868941 <== mon.2 v2:172.21.15.90:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8190+0+0 (secure 0 0 0) 0x7f92b80e1a60 con 0x7f92c0109460 2024-05-08T05:31:47.498 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:47.490+0000 7f92bea00700 1 --2- 172.21.15.87:0/2596868941 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f92a40b2880 0x7f92a40b4d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:31:47.498 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:47.490+0000 7f92d0949b80 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5556f1331dd0 0x5556f13321b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:31:47.498 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:47.490+0000 7f92d0949b80 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5556f13326f0 0x5556f132c3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:31:47.498 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:47.490+0000 7f92d0949b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5556f132ca10 0x5556f132ce70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:31:47.498 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:47.491+0000 7f92d0949b80 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x5556f127aa20 con 0x5556f1331dd0 2024-05-08T05:31:47.498 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:47.491+0000 7f92d0949b80 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x5556f1218760 con 0x5556f13326f0 2024-05-08T05:31:47.498 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:47.491+0000 7f92d0949b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x5556f12769e0 con 0x5556f132ca10 2024-05-08T05:31:47.498 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:47.491+0000 7f92bf400700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5556f1331dd0 0x5556f13321b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:31:47.498 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:47.491+0000 7f92bea00700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5556f13326f0 0x5556f132c3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:31:47.499 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:47.491+0000 7f92bf400700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5556f1331dd0 0x5556f13321b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:54108/0 (socket says 172.21.15.87:54108) 2024-05-08T05:31:47.499 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:47.491+0000 7f92bf400700 1 -- 172.21.15.87:0/4144514465 learned_addr learned my addr 172.21.15.87:0/4144514465 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T05:31:47.499 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:47.491+0000 7f92bf400700 1 -- 172.21.15.87:0/4144514465 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5556f132ca10 msgr2=0x5556f132ce70 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-08T05:31:47.499 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:47.491+0000 7f92bf400700 1 --2- 172.21.15.87:0/4144514465 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5556f132ca10 0x5556f132ce70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:31:47.499 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:47.491+0000 7f92bf400700 1 -- 172.21.15.87:0/4144514465 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5556f13326f0 msgr2=0x5556f132c3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:31:47.499 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:47.491+0000 7f92bf400700 1 --2- 172.21.15.87:0/4144514465 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5556f13326f0 0x5556f132c3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:31:47.499 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:47.491+0000 7f92bf400700 1 -- 172.21.15.87:0/4144514465 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5556f11c78d0 con 0x5556f1331dd0 2024-05-08T05:31:47.499 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:47.491+0000 7f92bea00700 1 --2- 172.21.15.87:0/4144514465 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5556f13326f0 0x5556f132c3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T05:31:47.499 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:47.492+0000 7f92bea00700 1 --2- 172.21.15.87:0/2596868941 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f92a40b2880 0x7f92a40b4d40 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f92c0101580 tx=0x7f92ac0149f0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:31:47.499 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:47.492+0000 7f92bf400700 1 --2- 172.21.15.87:0/4144514465 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5556f1331dd0 0x5556f13321b0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f92b0015000 tx=0x7f92b0005fd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4d9fb011a7432fc7 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:31:47.499 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:47.492+0000 7f92b4c00700 1 -- 172.21.15.87:0/4144514465 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92b000b720 con 0x5556f1331dd0 2024-05-08T05:31:47.499 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:47.492+0000 7f92b4c00700 1 -- 172.21.15.87:0/4144514465 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f92b0027070 con 0x5556f1331dd0 2024-05-08T05:31:47.499 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:47.492+0000 7f92b4c00700 1 -- 172.21.15.87:0/4144514465 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92b0003c60 con 0x5556f1331dd0 2024-05-08T05:31:47.499 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:47.493+0000 7f92d0949b80 1 -- 172.21.15.87:0/4144514465 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5556f1331dd0 msgr2=0x5556f13321b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:31:47.500 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:47.493+0000 7f92d0949b80 1 --2- 172.21.15.87:0/4144514465 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5556f1331dd0 0x5556f13321b0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f92b0015000 tx=0x7f92b0005fd0 comp rx=0 tx=0).stop 2024-05-08T05:31:47.500 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:47.493+0000 7f92d0949b80 1 -- 172.21.15.87:0/4144514465 shutdown_connections 2024-05-08T05:31:47.500 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:47.493+0000 7f92d0949b80 1 --2- 172.21.15.87:0/4144514465 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5556f132ca10 0x5556f132ce70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:31:47.500 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:47.493+0000 7f92d0949b80 1 --2- 172.21.15.87:0/4144514465 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5556f1331dd0 0x5556f13321b0 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:31:47.500 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:47.493+0000 7f92d0949b80 1 --2- 172.21.15.87:0/4144514465 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5556f13326f0 0x5556f132c3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:31:47.500 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:47.493+0000 7f92d0949b80 1 -- 172.21.15.87:0/4144514465 >> 172.21.15.87:0/4144514465 conn(0x5556f1256b60 msgr2=0x5556f13229b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:31:47.500 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:47.493+0000 7f92d0949b80 1 -- 172.21.15.87:0/4144514465 shutdown_connections 2024-05-08T05:31:47.500 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:47.493+0000 7f92d0949b80 1 -- 172.21.15.87:0/4144514465 wait complete. 2024-05-08T05:31:47.500 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:47.494+0000 7f92d0949b80 1 -- start start 2024-05-08T05:31:47.500 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:47.494+0000 7f92d0949b80 1 Processor -- start 2024-05-08T05:31:47.500 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:47.494+0000 7f92d0949b80 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5556f132ca10 0x5556f1338360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:31:47.500 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:47.494+0000 7f92d0949b80 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5556f1331dd0 0x5556f1335700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:31:47.500 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:47.494+0000 7f92d0949b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5556f13326f0 0x5556f1335c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:31:47.500 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:47.495+0000 7f92d0949b80 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x5556f1339190 con 0x5556f1331dd0 2024-05-08T05:31:47.500 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:47.495+0000 7f92d0949b80 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x5556f11e0b20 con 0x5556f132ca10 2024-05-08T05:31:47.501 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:47.495+0000 7f92d0949b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x5556f1339310 con 0x5556f13326f0 2024-05-08T05:31:47.501 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:47.495+0000 7f92d0949b80 10 client.0 _ll_register_callbacks cb 0x5556f1221c70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T05:31:47.501 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:47.495+0000 7f92bf400700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5556f132ca10 0x5556f1338360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:31:47.501 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:47.495+0000 7f92bf400700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5556f132ca10 0x5556f1338360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.87:43630/0 (socket says 172.21.15.87:43630) 2024-05-08T05:31:47.501 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:47.495+0000 7f92bf400700 1 -- 172.21.15.87:0/2961516334 learned_addr learned my addr 172.21.15.87:0/2961516334 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T05:31:47.501 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:47.495+0000 7f92bea00700 1 --2- 172.21.15.87:0/2961516334 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5556f1331dd0 0x5556f1335700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:31:47.501 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:47.495+0000 7f92bfe00700 1 --2- 172.21.15.87:0/2961516334 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5556f13326f0 0x5556f1335c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:31:47.501 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:47.495+0000 7f92bf400700 1 -- 172.21.15.87:0/2961516334 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5556f13326f0 msgr2=0x5556f1335c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:31:47.501 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:47.495+0000 7f92bf400700 1 --2- 172.21.15.87:0/2961516334 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5556f13326f0 0x5556f1335c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:31:47.501 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:47.495+0000 7f92bf400700 1 -- 172.21.15.87:0/2961516334 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5556f1331dd0 msgr2=0x5556f1335700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:31:47.501 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:47.495+0000 7f92bf400700 1 --2- 172.21.15.87:0/2961516334 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5556f1331dd0 0x5556f1335700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:31:47.501 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:47.495+0000 7f92bf400700 1 -- 172.21.15.87:0/2961516334 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5556f1240420 con 0x5556f132ca10 2024-05-08T05:31:47.501 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:47.495+0000 7f92bfe00700 1 --2- 172.21.15.87:0/2961516334 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5556f13326f0 0x5556f1335c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T05:31:47.501 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:47.495+0000 7f92bf400700 1 --2- 172.21.15.87:0/2961516334 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5556f132ca10 0x5556f1338360 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f92b000b2e0 tx=0x7f92b0003be0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3d5430c3cf4b26dd server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:31:47.502 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:47.495+0000 7f92a9600700 10 client.0 ms_handle_connect on v2:172.21.15.90:3300/0 2024-05-08T05:31:47.502 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:47.496+0000 7f92a9600700 1 -- 172.21.15.87:0/2961516334 <== mon.2 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92b000b920 con 0x5556f132ca10 2024-05-08T05:31:47.502 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:47.496+0000 7f92a9600700 1 -- 172.21.15.87:0/2961516334 <== mon.2 v2:172.21.15.90:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8190+0+0 (secure 0 0 0) 0x7f92b000bac0 con 0x5556f132ca10 2024-05-08T05:31:47.502 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:47.496+0000 7f92d0949b80 1 -- 172.21.15.87:0/2961516334 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f92b0027070 con 0x5556f132ca10 2024-05-08T05:31:47.502 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:47.496+0000 7f92a9600700 1 -- 172.21.15.87:0/2961516334 <== mon.2 v2:172.21.15.90:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f92b00036f0 con 0x5556f132ca10 2024-05-08T05:31:47.502 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:47.496+0000 7f92d0949b80 10 client.25478 fetch_fsmap learned FSMap version 26 2024-05-08T05:31:47.502 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:47.496+0000 7f92d0949b80 1 -- 172.21.15.87:0/2961516334 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x5556f1343930 con 0x5556f132ca10 2024-05-08T05:31:47.502 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:47.496+0000 7f92a9600700 1 -- 172.21.15.87:0/2961516334 <== mon.2 v2:172.21.15.90:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f92b0027070 con 0x5556f132ca10 2024-05-08T05:31:47.502 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:47.497+0000 7f92a9600700 1 -- 172.21.15.87:0/2961516334 <== mon.2 v2:172.21.15.90:3300/0 5 ==== fsmap(e 26) ==== 8346+0+0 (secure 0 0 0) 0x7f92b0035430 con 0x5556f132ca10 2024-05-08T05:31:47.502 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:47.497+0000 7f92d0949b80 10 client.25478 fetch_fsmap finished waiting for FSMap version 26 2024-05-08T05:31:47.502 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:47.497+0000 7f92d0949b80 10 client.25478 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-05-08T05:31:47.502 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:47.497+0000 7f92d0949b80 20 client.25478 populate_metadata read hostname 'smithi087' 2024-05-08T05:31:47.502 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:47.497+0000 7f92d0949b80 1 --2- 172.21.15.87:0/2961516334 >> [v2:172.21.15.90:6838/160586017,v1:172.21.15.90:6839/160586017] conn(0x5556f1345e00 0x5556f13481f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:31:47.502 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:47.497+0000 7f92d0949b80 4 client.25478 mds_command: new command op to 24500 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-08T05:31:47.502 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:47.497+0000 7f92d0949b80 1 -- 172.21.15.87:0/2961516334 --> [v2:172.21.15.90:6838/160586017,v1:172.21.15.90:6839/160586017] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5556f12f50a0 con 0x5556f1345e00 2024-05-08T05:31:47.503 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:47.497+0000 7f92bea00700 1 --2- 172.21.15.87:0/2961516334 >> [v2:172.21.15.90:6838/160586017,v1:172.21.15.90:6839/160586017] conn(0x5556f1345e00 0x5556f13481f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:31:47.503 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:47.498+0000 7f92bea00700 1 --2- 172.21.15.87:0/2961516334 >> [v2:172.21.15.90:6838/160586017,v1:172.21.15.90:6839/160586017] conn(0x5556f1345e00 0x5556f13481f0 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a34d909be56e1425 server_cookie=8397832911ec3760 in_seq=0 out_seq=0 2024-05-08T05:31:47.503 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:47.498+0000 7f92a9600700 10 client.25478 ms_handle_connect on v2:172.21.15.90:6838/160586017 2024-05-08T05:31:47.504 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:47.499+0000 7f92a9600700 1 -- 172.21.15.87:0/2961516334 <== mds.0 v2:172.21.15.90:6838/160586017 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x5556f12f50a0 con 0x5556f1345e00 2024-05-08T05:31:47.504 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:47.499+0000 7f92a9600700 10 client.25478 handle_command_reply: tid=0 2024-05-08T05:31:47.504 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:47.499+0000 7f92d0949b80 1 client.25478 shutdown 2024-05-08T05:31:47.504 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:47.499+0000 7f92d0949b80 1 -- 172.21.15.87:0/2961516334 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5556f132ca10 msgr2=0x5556f1338360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:31:47.504 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:47.499+0000 7f92d0949b80 1 --2- 172.21.15.87:0/2961516334 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5556f132ca10 0x5556f1338360 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f92b000b2e0 tx=0x7f92b0003be0 comp rx=0 tx=0).stop 2024-05-08T05:31:47.504 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:47.499+0000 7f92d0949b80 1 -- 172.21.15.87:0/2961516334 shutdown_connections 2024-05-08T05:31:47.504 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:47.499+0000 7f92d0949b80 1 --2- 172.21.15.87:0/2961516334 >> [v2:172.21.15.90:6838/160586017,v1:172.21.15.90:6839/160586017] conn(0x5556f1345e00 0x5556f13481f0 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:31:47.504 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:47.499+0000 7f92d0949b80 1 --2- 172.21.15.87:0/2961516334 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5556f13326f0 0x5556f1335c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:31:47.504 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:47.499+0000 7f92a9600700 0 client.25478 ms_handle_reset on v2:172.21.15.90:6838/160586017 2024-05-08T05:31:47.505 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:47.499+0000 7f92d0949b80 1 --2- 172.21.15.87:0/2961516334 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5556f132ca10 0x5556f1338360 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:31:47.505 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:47.499+0000 7f92d0949b80 1 --2- 172.21.15.87:0/2961516334 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5556f1331dd0 0x5556f1335700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:31:47.505 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:47.499+0000 7f92d0949b80 1 -- 172.21.15.87:0/2961516334 >> 172.21.15.87:0/2961516334 conn(0x5556f1256b60 msgr2=0x5556f131d460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:31:47.505 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:47.499+0000 7f92d0949b80 1 -- 172.21.15.87:0/2961516334 shutdown_connections 2024-05-08T05:31:47.505 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:47.499+0000 7f92d0949b80 1 -- 172.21.15.87:0/2961516334 wait complete. 2024-05-08T05:31:47.505 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:47.500+0000 7f92d0949b80 20 client.25478 trim_cache size 0 max 16384 2024-05-08T05:31:47.523 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:47.523+0000 7f92d0949b80 1 Processor -- start 2024-05-08T05:31:47.523 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:47.523+0000 7f92d0949b80 1 -- start start 2024-05-08T05:31:47.524 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:47.523+0000 7f92d0949b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5556f132ca10 0x5556f13331e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:31:47.524 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:47.523+0000 7f92d0949b80 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5556f1331dd0 0x5556f134b210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:31:47.524 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:47.523+0000 7f92d0949b80 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5556f13326f0 0x5556f134b750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:31:47.524 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:47.523+0000 7f92d0949b80 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f92c01adf80 con 0x5556f13326f0 2024-05-08T05:31:47.525 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:47.523+0000 7f92d0949b80 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f92c01ab810 con 0x5556f1331dd0 2024-05-08T05:31:47.525 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:47.523+0000 7f92d0949b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f92c01a96a0 con 0x5556f132ca10 2024-05-08T05:31:47.525 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:47.524+0000 7f92bea00700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5556f1331dd0 0x5556f134b210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:31:47.525 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:47.524+0000 7f92bea00700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5556f1331dd0 0x5556f134b210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.87:43634/0 (socket says 172.21.15.87:43634) 2024-05-08T05:31:47.525 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:47.524+0000 7f92bea00700 1 -- 172.21.15.87:0/3111030314 learned_addr learned my addr 172.21.15.87:0/3111030314 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T05:31:47.525 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:47.524+0000 7f92bfe00700 1 --2- 172.21.15.87:0/3111030314 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5556f13326f0 0x5556f134b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:31:47.525 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:47.524+0000 7f92bf400700 1 --2- 172.21.15.87:0/3111030314 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5556f132ca10 0x5556f13331e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:31:47.525 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:47.524+0000 7f92bea00700 1 -- 172.21.15.87:0/3111030314 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5556f132ca10 msgr2=0x5556f13331e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:31:47.525 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:47.524+0000 7f92bea00700 1 --2- 172.21.15.87:0/3111030314 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5556f132ca10 0x5556f13331e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:31:47.525 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:47.524+0000 7f92bea00700 1 -- 172.21.15.87:0/3111030314 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5556f13326f0 msgr2=0x5556f134b750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:31:47.525 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:47.524+0000 7f92bea00700 1 --2- 172.21.15.87:0/3111030314 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5556f13326f0 0x5556f134b750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:31:47.525 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:47.524+0000 7f92bea00700 1 -- 172.21.15.87:0/3111030314 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5556f1337fa0 con 0x5556f1331dd0 2024-05-08T05:31:47.525 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:47.524+0000 7f92bfe00700 1 --2- 172.21.15.87:0/3111030314 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5556f13326f0 0x5556f134b750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T05:31:47.525 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:47.524+0000 7f92bea00700 1 --2- 172.21.15.87:0/3111030314 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5556f1331dd0 0x5556f134b210 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f92ac014fd0 tx=0x7f92ac01d000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1b3f860061ef5b3f server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:31:47.527 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:47.525+0000 7f92abe00700 1 -- 172.21.15.87:0/3111030314 <== mon.2 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92ac00b940 con 0x5556f1331dd0 2024-05-08T05:31:47.527 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:47.525+0000 7f92abe00700 1 -- 172.21.15.87:0/3111030314 <== mon.2 v2:172.21.15.90:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f92ac004ce0 con 0x5556f1331dd0 2024-05-08T05:31:47.527 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:47.525+0000 7f92abe00700 1 -- 172.21.15.87:0/3111030314 <== mon.2 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92ac005390 con 0x5556f1331dd0 2024-05-08T05:31:47.527 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:47.525+0000 7f92d0949b80 1 -- 172.21.15.87:0/3111030314 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5556f1331dd0 msgr2=0x5556f134b210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:31:47.527 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:47.525+0000 7f92d0949b80 1 --2- 172.21.15.87:0/3111030314 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5556f1331dd0 0x5556f134b210 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f92ac014fd0 tx=0x7f92ac01d000 comp rx=0 tx=0).stop 2024-05-08T05:31:47.527 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:47.526+0000 7f92d0949b80 1 -- 172.21.15.87:0/3111030314 shutdown_connections 2024-05-08T05:31:47.527 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:47.526+0000 7f92d0949b80 1 --2- 172.21.15.87:0/3111030314 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5556f13326f0 0x5556f134b750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:31:47.527 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:47.526+0000 7f92d0949b80 1 --2- 172.21.15.87:0/3111030314 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5556f132ca10 0x5556f13331e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:31:47.527 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:47.526+0000 7f92d0949b80 1 --2- 172.21.15.87:0/3111030314 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5556f1331dd0 0x5556f134b210 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:31:47.527 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:47.526+0000 7f92d0949b80 1 -- 172.21.15.87:0/3111030314 >> 172.21.15.87:0/3111030314 conn(0x5556f1256b60 msgr2=0x5556f1332ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:31:47.527 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:47.526+0000 7f92d0949b80 1 -- 172.21.15.87:0/3111030314 shutdown_connections 2024-05-08T05:31:47.527 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:47.526+0000 7f92d0949b80 1 -- 172.21.15.87:0/3111030314 wait complete. 2024-05-08T05:31:47.528 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:47.526+0000 7f92d0949b80 1 -- start start 2024-05-08T05:31:47.528 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:47.527+0000 7f92d0949b80 1 Processor -- start 2024-05-08T05:31:47.529 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:47.527+0000 7f92d0949b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5556f132ca10 0x5556f13494c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:31:47.529 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:47.527+0000 7f92d0949b80 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5556f1331dd0 0x5556f1349a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:31:47.529 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:47.527+0000 7f92d0949b80 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5556f13326f0 0x5556f13af320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:31:47.530 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:47.527+0000 7f92d0949b80 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f92c01a9cf0 con 0x5556f1331dd0 2024-05-08T05:31:47.530 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:47.527+0000 7f92d0949b80 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f92c01ab140 con 0x5556f13326f0 2024-05-08T05:31:47.530 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:47.527+0000 7f92d0949b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f92c01aa3a0 con 0x5556f132ca10 2024-05-08T05:31:47.530 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:47.527+0000 7f92d0949b80 10 client.0 _ll_register_callbacks cb 0x5556f1221c70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T05:31:47.530 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:47.527+0000 7f92bfe00700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5556f13326f0 0x5556f13af320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:31:47.530 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:47.527+0000 7f92bfe00700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5556f13326f0 0x5556f13af320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.87:43644/0 (socket says 172.21.15.87:43644) 2024-05-08T05:31:47.530 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:47.527+0000 7f92bfe00700 1 -- 172.21.15.87:0/3929377282 learned_addr learned my addr 172.21.15.87:0/3929377282 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T05:31:47.530 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:47.527+0000 7f92bea00700 1 --2- 172.21.15.87:0/3929377282 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5556f1331dd0 0x5556f1349a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:31:47.530 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:47.528+0000 7f92bf400700 1 --2- 172.21.15.87:0/3929377282 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5556f132ca10 0x5556f13494c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:31:47.530 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:47.528+0000 7f92bfe00700 1 -- 172.21.15.87:0/3929377282 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5556f132ca10 msgr2=0x5556f13494c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:31:47.530 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:47.528+0000 7f92bfe00700 1 --2- 172.21.15.87:0/3929377282 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5556f132ca10 0x5556f13494c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:31:47.530 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:47.528+0000 7f92bfe00700 1 -- 172.21.15.87:0/3929377282 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5556f1331dd0 msgr2=0x5556f1349a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:31:47.530 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:47.528+0000 7f92bfe00700 1 --2- 172.21.15.87:0/3929377282 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5556f1331dd0 0x5556f1349a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:31:47.531 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:47.528+0000 7f92bfe00700 1 -- 172.21.15.87:0/3929377282 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5556f134a2a0 con 0x5556f13326f0 2024-05-08T05:31:47.531 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:47.528+0000 7f92bf400700 1 --2- 172.21.15.87:0/3929377282 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5556f132ca10 0x5556f13494c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T05:31:47.531 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:47.528+0000 7f92bfe00700 1 --2- 172.21.15.87:0/3929377282 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5556f13326f0 0x5556f13af320 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f92b80df530 tx=0x7f92b80a88b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b84f807ef5beebf5 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:31:47.531 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:47.528+0000 7f92a9600700 10 client.0 ms_handle_connect on v2:172.21.15.90:3300/0 2024-05-08T05:31:47.531 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:47.528+0000 7f92a9600700 1 -- 172.21.15.87:0/3929377282 <== mon.2 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92b80c3060 con 0x5556f13326f0 2024-05-08T05:31:47.531 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:47.528+0000 7f92a9600700 1 -- 172.21.15.87:0/3929377282 <== mon.2 v2:172.21.15.90:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8190+0+0 (secure 0 0 0) 0x7f92b80a92b0 con 0x5556f13326f0 2024-05-08T05:31:47.531 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:47.528+0000 7f92d0949b80 1 -- 172.21.15.87:0/3929377282 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f92ac004ce0 con 0x5556f13326f0 2024-05-08T05:31:47.531 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:47.529+0000 7f92a9600700 1 -- 172.21.15.87:0/3929377282 <== mon.2 v2:172.21.15.90:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f92b80a9750 con 0x5556f13326f0 2024-05-08T05:31:47.531 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:47.529+0000 7f92d0949b80 10 client.25484 fetch_fsmap learned FSMap version 26 2024-05-08T05:31:47.531 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:47.529+0000 7f92d0949b80 1 -- 172.21.15.87:0/3929377282 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x5556f13b09a0 con 0x5556f13326f0 2024-05-08T05:31:47.531 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:47.529+0000 7f92a9600700 1 -- 172.21.15.87:0/3929377282 <== mon.2 v2:172.21.15.90:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f92ac004ce0 con 0x5556f13326f0 2024-05-08T05:31:47.532 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:47.529+0000 7f92a9600700 1 -- 172.21.15.87:0/3929377282 <== mon.2 v2:172.21.15.90:3300/0 5 ==== fsmap(e 26) ==== 8346+0+0 (secure 0 0 0) 0x7f92b80b1a20 con 0x5556f13326f0 2024-05-08T05:31:47.532 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:47.529+0000 7f92d0949b80 10 client.25484 fetch_fsmap finished waiting for FSMap version 26 2024-05-08T05:31:47.532 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:47.529+0000 7f92d0949b80 10 client.25484 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-05-08T05:31:47.532 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:47.529+0000 7f92d0949b80 20 client.25484 populate_metadata read hostname 'smithi087' 2024-05-08T05:31:47.532 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:47.529+0000 7f92d0949b80 1 --2- 172.21.15.87:0/3929377282 >> [v2:172.21.15.90:6838/160586017,v1:172.21.15.90:6839/160586017] conn(0x5556f1345e00 0x5556f13b3100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:31:47.532 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:47.529+0000 7f92d0949b80 4 client.25484 mds_command: new command op to 24500 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-05-08T05:31:47.532 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:47.529+0000 7f92d0949b80 1 -- 172.21.15.87:0/3929377282 --> [v2:172.21.15.90:6838/160586017,v1:172.21.15.90:6839/160586017] -- command(tid 0: {"prefix": "scrub status"}) -- 0x5556f1288400 con 0x5556f1345e00 2024-05-08T05:31:47.532 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:47.529+0000 7f92bf400700 1 --2- 172.21.15.87:0/3929377282 >> [v2:172.21.15.90:6838/160586017,v1:172.21.15.90:6839/160586017] conn(0x5556f1345e00 0x5556f13b3100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:31:47.533 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:47.530+0000 7f92bf400700 1 --2- 172.21.15.87:0/3929377282 >> [v2:172.21.15.90:6838/160586017,v1:172.21.15.90:6839/160586017] conn(0x5556f1345e00 0x5556f13b3100 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=99598f53a83dd320 server_cookie=15558670ee850733 in_seq=0 out_seq=0 2024-05-08T05:31:47.533 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:47.530+0000 7f92a9600700 10 client.25484 ms_handle_connect on v2:172.21.15.90:6838/160586017 2024-05-08T05:31:47.533 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:47.530+0000 7f92a9600700 1 -- 172.21.15.87:0/3929377282 <== mds.0 v2:172.21.15.90:6838/160586017 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x5556f1288400 con 0x5556f1345e00 2024-05-08T05:31:47.533 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:47.530+0000 7f92a9600700 10 client.25484 handle_command_reply: tid=0 2024-05-08T05:31:47.533 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:47.530+0000 7f92d0949b80 1 client.25484 shutdown 2024-05-08T05:31:47.533 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:47.531+0000 7f92d0949b80 1 -- 172.21.15.87:0/3929377282 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5556f13326f0 msgr2=0x5556f13af320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:31:47.533 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:47.531+0000 7f92d0949b80 1 --2- 172.21.15.87:0/3929377282 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5556f13326f0 0x5556f13af320 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f92b80df530 tx=0x7f92b80a88b0 comp rx=0 tx=0).stop 2024-05-08T05:31:47.533 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:47.531+0000 7f92d0949b80 1 -- 172.21.15.87:0/3929377282 shutdown_connections 2024-05-08T05:31:47.533 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:47.531+0000 7f92d0949b80 1 --2- 172.21.15.87:0/3929377282 >> [v2:172.21.15.90:6838/160586017,v1:172.21.15.90:6839/160586017] conn(0x5556f1345e00 0x5556f13b3100 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:31:47.534 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:47.531+0000 7f92d0949b80 1 --2- 172.21.15.87:0/3929377282 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5556f13326f0 0x5556f13af320 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:31:47.534 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:47.531+0000 7f92d0949b80 1 --2- 172.21.15.87:0/3929377282 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5556f132ca10 0x5556f13494c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:31:47.534 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:47.531+0000 7f92d0949b80 1 --2- 172.21.15.87:0/3929377282 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5556f1331dd0 0x5556f1349a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:31:47.534 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:47.531+0000 7f92a9600700 0 client.25484 ms_handle_reset on v2:172.21.15.90:6838/160586017 2024-05-08T05:31:47.534 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:47.531+0000 7f92d0949b80 1 -- 172.21.15.87:0/3929377282 >> 172.21.15.87:0/3929377282 conn(0x5556f1256b60 msgr2=0x5556f131cbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:31:47.534 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:47.531+0000 7f92d0949b80 1 -- 172.21.15.87:0/3929377282 shutdown_connections 2024-05-08T05:31:47.534 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:47.531+0000 7f92d0949b80 1 -- 172.21.15.87:0/3929377282 wait complete. 2024-05-08T05:31:47.534 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:47.531+0000 7f92d0949b80 20 client.25484 trim_cache size 0 max 16384 2024-05-08T05:31:47.534 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-05-08T05:31:47.535 INFO:teuthology.orchestra.run.smithi087.stdout: "status": "IDLE (waiting for more scrubs)", 2024-05-08T05:31:47.535 INFO:teuthology.orchestra.run.smithi087.stdout: "scrubs": { 2024-05-08T05:31:47.535 INFO:teuthology.orchestra.run.smithi087.stdout: "0c24892a-dd87-4fe4-b170-57d44f003ac0": { 2024-05-08T05:31:47.535 INFO:teuthology.orchestra.run.smithi087.stdout: "path": "/", 2024-05-08T05:31:47.535 INFO:teuthology.orchestra.run.smithi087.stdout: "tag": "0c24892a-dd87-4fe4-b170-57d44f003ac0", 2024-05-08T05:31:47.535 INFO:teuthology.orchestra.run.smithi087.stdout: "options": "recursive,force" 2024-05-08T05:31:47.535 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-05-08T05:31:47.535 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-05-08T05:31:47.535 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-05-08T05:31:47.536 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:47.532+0000 7f92c4a00700 1 -- 172.21.15.87:0/2596868941 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f92a40b2880 msgr2=0x7f92a40b4d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:31:47.536 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:47.532+0000 7f92c4a00700 1 --2- 172.21.15.87:0/2596868941 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f92a40b2880 0x7f92a40b4d40 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f92c0101580 tx=0x7f92ac0149f0 comp rx=0 tx=0).stop 2024-05-08T05:31:47.536 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:47.532+0000 7f92c4a00700 1 -- 172.21.15.87:0/2596868941 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f92c0109460 msgr2=0x7f92c0199900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:31:47.536 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:47.532+0000 7f92c4a00700 1 --2- 172.21.15.87:0/2596868941 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f92c0109460 0x7f92c0199900 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f92b800c370 tx=0x7f92b800c680 comp rx=0 tx=0).stop 2024-05-08T05:31:47.536 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:47.532+0000 7f92c4a00700 1 -- 172.21.15.87:0/2596868941 shutdown_connections 2024-05-08T05:31:47.536 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:47.532+0000 7f92c4a00700 1 --2- 172.21.15.87:0/2596868941 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f92c0109460 0x7f92c0199900 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:31:47.536 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:47.532+0000 7f92c4a00700 1 --2- 172.21.15.87:0/2596868941 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f92a40b2880 0x7f92a40b4d40 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:31:47.536 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:47.532+0000 7f92c4a00700 1 --2- 172.21.15.87:0/2596868941 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f92c01033d0 0x7f92c019f740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:31:47.537 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:47.532+0000 7f92c4a00700 1 --2- 172.21.15.87:0/2596868941 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f92c0103d90 0x7f92c019fc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:31:47.537 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:47.532+0000 7f92c4a00700 1 -- 172.21.15.87:0/2596868941 >> 172.21.15.87:0/2596868941 conn(0x7f92c00fef20 msgr2=0x7f92c00ff6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:31:47.537 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:47.532+0000 7f92c4a00700 1 -- 172.21.15.87:0/2596868941 shutdown_connections 2024-05-08T05:31:47.537 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:31:47.532+0000 7f92c4a00700 1 -- 172.21.15.87:0/2596868941 wait complete. 2024-05-08T05:31:48.400 INFO:tasks.cephfs.filesystem:scrub status for tag:0c24892a-dd87-4fe4-b170-57d44f003ac0 - {'path': '/', 'tag': '0c24892a-dd87-4fe4-b170-57d44f003ac0', 'options': 'recursive,force'} 2024-05-08T05:31:48.483 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:31:48 smithi090 ceph-mon[34526]: pgmap v504: 97 pgs: 97 active+clean; 39 MiB data, 502 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.9 MiB/s wr, 181 op/s 2024-05-08T05:31:48.538 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:31:48 smithi160 ceph-mon[34827]: pgmap v504: 97 pgs: 97 active+clean; 39 MiB data, 502 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.9 MiB/s wr, 181 op/s 2024-05-08T05:31:48.708 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:31:48 smithi087 ceph-mon[29523]: pgmap v504: 97 pgs: 97 active+clean; 39 MiB data, 502 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.9 MiB/s wr, 181 op/s 2024-05-08T05:31:50.483 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:31:50 smithi090 ceph-mon[34526]: pgmap v505: 97 pgs: 97 active+clean; 42 MiB data, 512 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.7 MiB/s wr, 160 op/s 2024-05-08T05:31:50.538 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:31:50 smithi160 ceph-mon[34827]: pgmap v505: 97 pgs: 97 active+clean; 42 MiB data, 512 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.7 MiB/s wr, 160 op/s 2024-05-08T05:31:50.708 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:31:50 smithi087 ceph-mon[29523]: pgmap v505: 97 pgs: 97 active+clean; 42 MiB data, 512 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.7 MiB/s wr, 160 op/s 2024-05-08T05:31:52.483 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:31:52 smithi090 ceph-mon[34526]: pgmap v506: 97 pgs: 97 active+clean; 42 MiB data, 516 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.3 MiB/s wr, 82 op/s 2024-05-08T05:31:52.483 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:31:52 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T05:31:52.538 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:31:52 smithi160 ceph-mon[34827]: pgmap v506: 97 pgs: 97 active+clean; 42 MiB data, 516 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.3 MiB/s wr, 82 op/s 2024-05-08T05:31:52.538 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:31:52 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T05:31:52.708 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:31:52 smithi087 ceph-mon[29523]: pgmap v506: 97 pgs: 97 active+clean; 42 MiB data, 516 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.3 MiB/s wr, 82 op/s 2024-05-08T05:31:52.708 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:31:52 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T05:31:53.483 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:31:53 smithi090 ceph-mon[34526]: scrub summary: idle 2024-05-08T05:31:53.484 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:31:53 smithi090 ceph-mon[34526]: scrub summary: idle 2024-05-08T05:31:53.484 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:31:53 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T05:31:53.484 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:31:53 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T05:31:53.484 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:31:53 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:31:53.538 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:31:53 smithi160 ceph-mon[34827]: scrub summary: idle 2024-05-08T05:31:53.539 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:31:53 smithi160 ceph-mon[34827]: scrub summary: idle 2024-05-08T05:31:53.539 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:31:53 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T05:31:53.539 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:31:53 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T05:31:53.539 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:31:53 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:31:53.708 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:31:53 smithi087 ceph-mon[29523]: scrub summary: idle 2024-05-08T05:31:53.709 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:31:53 smithi087 ceph-mon[29523]: scrub summary: idle 2024-05-08T05:31:53.709 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:31:53 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T05:31:53.709 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:31:53 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T05:31:53.709 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:31:53 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:31:53.763 INFO:tasks.workunit.client.0.smithi087.stderr:+ pushd ltp-full-20091231/testcases/kernel/fs/fsstress 2024-05-08T05:31:53.768 INFO:tasks.workunit.client.0.smithi087.stdout:~/cephtest/mnt.0/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress ~/cephtest/mnt.0/client.0/tmp/fsstress ~/cephtest/mnt.0/client.0/tmp 2024-05-08T05:31:53.768 INFO:tasks.workunit.client.0.smithi087.stderr:+ make 2024-05-08T05:31:54.009 INFO:tasks.workunit.client.0.smithi087.stdout:cc -DNO_XFS -I/home/ubuntu/cephtest/mnt.0/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress -D_LARGEFILE64_SOURCE -D_GNU_SOURCE -I../../../../include -I../../../../include -L../../../../lib fsstress.c -o fsstress 2024-05-08T05:31:54.431 INFO:tasks.workunit.client.0.smithi087.stderr:++ readlink -f fsstress 2024-05-08T05:31:54.433 INFO:tasks.workunit.client.0.smithi087.stderr:+ BIN=/home/ubuntu/cephtest/mnt.0/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress/fsstress 2024-05-08T05:31:54.433 INFO:tasks.workunit.client.0.smithi087.stderr:+ popd 2024-05-08T05:31:54.433 INFO:tasks.workunit.client.0.smithi087.stdout:~/cephtest/mnt.0/client.0/tmp/fsstress ~/cephtest/mnt.0/client.0/tmp 2024-05-08T05:31:54.434 INFO:tasks.workunit.client.0.smithi087.stderr:+ popd 2024-05-08T05:31:54.434 INFO:tasks.workunit.client.0.smithi087.stdout:~/cephtest/mnt.0/client.0/tmp 2024-05-08T05:31:54.435 INFO:tasks.workunit.client.0.smithi087.stderr:++ mktemp -d -p . 2024-05-08T05:31:54.439 INFO:tasks.workunit.client.0.smithi087.stderr:+ T=./tmp.CFEGAHb0bu 2024-05-08T05:31:54.439 INFO:tasks.workunit.client.0.smithi087.stderr:+ /home/ubuntu/cephtest/mnt.0/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress/fsstress -d ./tmp.CFEGAHb0bu -l 1 -n 1000 -p 10 -v 2024-05-08T05:31:54.443 INFO:tasks.workunit.client.0.smithi087.stdout:seed = 1715325894 2024-05-08T05:31:54.448 INFO:tasks.workunit.client.0.smithi087.stdout:0/0: mkdir d0 0 2024-05-08T05:31:54.448 INFO:tasks.workunit.client.0.smithi087.stdout:0/1: write - no filename 2024-05-08T05:31:54.448 INFO:tasks.workunit.client.0.smithi087.stdout:0/2: truncate - no filename 2024-05-08T05:31:54.450 INFO:tasks.workunit.client.0.smithi087.stdout:6/0: creat f0 x:0 0 0 2024-05-08T05:31:54.450 INFO:tasks.workunit.client.0.smithi087.stdout:6/1: write f0 [315141,38574] 0 2024-05-08T05:31:54.450 INFO:tasks.workunit.client.0.smithi087.stdout:6/2: write f0 [629575,64678] 0 2024-05-08T05:31:54.450 INFO:tasks.workunit.client.0.smithi087.stdout:6/3: write f0 [1472791,69626] 0 2024-05-08T05:31:54.450 INFO:tasks.workunit.client.0.smithi087.stdout:0/3: creat d0/f1 x:0 0 0 2024-05-08T05:31:54.450 INFO:tasks.workunit.client.0.smithi087.stdout:0/4: truncate d0/f1 319632 0 2024-05-08T05:31:54.451 INFO:tasks.workunit.client.0.smithi087.stdout:3/0: write - no filename 2024-05-08T05:31:54.451 INFO:tasks.workunit.client.0.smithi087.stdout:1/0: mknod c0 0 2024-05-08T05:31:54.452 INFO:tasks.workunit.client.0.smithi087.stdout:4/0: getdents . 0 2024-05-08T05:31:54.452 INFO:tasks.workunit.client.0.smithi087.stdout:4/1: truncate - no filename 2024-05-08T05:31:54.452 INFO:tasks.workunit.client.0.smithi087.stdout:3/1: mknod c0 0 2024-05-08T05:31:54.452 INFO:tasks.workunit.client.0.smithi087.stdout:3/2: dwrite - no filename 2024-05-08T05:31:54.453 INFO:tasks.workunit.client.0.smithi087.stdout:3/3: stat c0 0 2024-05-08T05:31:54.453 INFO:tasks.workunit.client.0.smithi087.stdout:3/4: dread - no filename 2024-05-08T05:31:54.453 INFO:tasks.workunit.client.0.smithi087.stdout:3/5: truncate - no filename 2024-05-08T05:31:54.453 INFO:tasks.workunit.client.0.smithi087.stdout:3/6: dwrite - no filename 2024-05-08T05:31:54.453 INFO:tasks.workunit.client.0.smithi087.stdout:3/7: chown c0 5 1 2024-05-08T05:31:54.453 INFO:tasks.workunit.client.0.smithi087.stdout:3/8: stat c0 0 2024-05-08T05:31:54.453 INFO:tasks.workunit.client.0.smithi087.stdout:3/9: dread - no filename 2024-05-08T05:31:54.453 INFO:tasks.workunit.client.0.smithi087.stdout:1/1: symlink l1 0 2024-05-08T05:31:54.454 INFO:tasks.workunit.client.0.smithi087.stdout:4/2: mknod c0 0 2024-05-08T05:31:54.454 INFO:tasks.workunit.client.0.smithi087.stdout:4/3: read - no filename 2024-05-08T05:31:54.455 INFO:tasks.workunit.client.0.smithi087.stdout:3/10: symlink l1 0 2024-05-08T05:31:54.455 INFO:tasks.workunit.client.0.smithi087.stdout:1/2: mknod c2 0 2024-05-08T05:31:54.456 INFO:tasks.workunit.client.0.smithi087.stdout:5/0: read - no filename 2024-05-08T05:31:54.456 INFO:tasks.workunit.client.0.smithi087.stdout:5/1: write - no filename 2024-05-08T05:31:54.456 INFO:tasks.workunit.client.0.smithi087.stdout:5/2: chown . 4 1 2024-05-08T05:31:54.456 INFO:tasks.workunit.client.0.smithi087.stdout:5/3: write - no filename 2024-05-08T05:31:54.456 INFO:tasks.workunit.client.0.smithi087.stdout:5/4: write - no filename 2024-05-08T05:31:54.457 INFO:tasks.workunit.client.0.smithi087.stdout:5/5: readlink - no filename 2024-05-08T05:31:54.457 INFO:tasks.workunit.client.0.smithi087.stdout:2/0: symlink l0 0 2024-05-08T05:31:54.457 INFO:tasks.workunit.client.0.smithi087.stdout:4/4: creat f1 x:0 0 0 2024-05-08T05:31:54.457 INFO:tasks.workunit.client.0.smithi087.stdout:4/5: dread - f1 zero size 2024-05-08T05:31:54.457 INFO:tasks.workunit.client.0.smithi087.stdout:4/6: write f1 [1035177,14068] 0 2024-05-08T05:31:54.461 INFO:tasks.workunit.client.0.smithi087.stdout:1/3: creat f3 x:0 0 0 2024-05-08T05:31:54.461 INFO:tasks.workunit.client.0.smithi087.stdout:3/11: creat f2 x:0 0 0 2024-05-08T05:31:54.461 INFO:tasks.workunit.client.0.smithi087.stdout:5/6: creat f0 x:0 0 0 2024-05-08T05:31:54.461 INFO:tasks.workunit.client.0.smithi087.stdout:3/12: read - f2 zero size 2024-05-08T05:31:54.461 INFO:tasks.workunit.client.0.smithi087.stdout:7/0: dread - no filename 2024-05-08T05:31:54.462 INFO:tasks.workunit.client.0.smithi087.stdout:2/1: creat f1 x:0 0 0 2024-05-08T05:31:54.462 INFO:tasks.workunit.client.0.smithi087.stdout:2/2: write f1 [417200,22510] 0 2024-05-08T05:31:54.470 INFO:tasks.workunit.client.0.smithi087.stdout:8/0: dwrite - no filename 2024-05-08T05:31:54.470 INFO:tasks.workunit.client.0.smithi087.stdout:8/1: rename - no filename 2024-05-08T05:31:54.471 INFO:tasks.workunit.client.0.smithi087.stdout:7/1: symlink l0 0 2024-05-08T05:31:54.472 INFO:tasks.workunit.client.0.smithi087.stdout:2/3: mkdir d2 0 2024-05-08T05:31:54.473 INFO:tasks.workunit.client.0.smithi087.stdout:8/2: creat f0 x:0 0 0 2024-05-08T05:31:54.475 INFO:tasks.workunit.client.0.smithi087.stdout:7/2: symlink l1 0 2024-05-08T05:31:54.475 INFO:tasks.workunit.client.0.smithi087.stdout:7/3: read - no filename 2024-05-08T05:31:54.476 INFO:tasks.workunit.client.0.smithi087.stdout:6/4: dread f0 [0,4194304] 0 2024-05-08T05:31:54.476 INFO:tasks.workunit.client.0.smithi087.stdout:8/3: creat f1 x:0 0 0 2024-05-08T05:31:54.477 INFO:tasks.workunit.client.0.smithi087.stdout:9/0: creat f0 x:0 0 0 2024-05-08T05:31:54.477 INFO:tasks.workunit.client.0.smithi087.stdout:9/1: write f0 [931802,9250] 0 2024-05-08T05:31:54.481 INFO:tasks.workunit.client.0.smithi087.stdout:7/4: mkdir d2 0 2024-05-08T05:31:54.481 INFO:tasks.workunit.client.0.smithi087.stdout:7/5: write - no filename 2024-05-08T05:31:54.481 INFO:tasks.workunit.client.0.smithi087.stdout:7/6: dwrite - no filename 2024-05-08T05:31:54.481 INFO:tasks.workunit.client.0.smithi087.stdout:7/7: write - no filename 2024-05-08T05:31:54.481 INFO:tasks.workunit.client.0.smithi087.stdout:7/8: truncate - no filename 2024-05-08T05:31:54.481 INFO:tasks.workunit.client.0.smithi087.stdout:7/9: fsync - no filename 2024-05-08T05:31:54.483 INFO:tasks.workunit.client.0.smithi087.stdout:3/13: getdents . 0 2024-05-08T05:31:54.483 INFO:tasks.workunit.client.0.smithi087.stdout:3/14: readlink l1 0 2024-05-08T05:31:54.483 INFO:tasks.workunit.client.0.smithi087.stdout:6/5: rename f0 to f1 0 2024-05-08T05:31:54.483 INFO:tasks.workunit.client.0.smithi087.stdout:3/15: dread - f2 zero size 2024-05-08T05:31:54.483 INFO:tasks.workunit.client.0.smithi087.stdout:6/6: chown f1 1771583 1 2024-05-08T05:31:54.483 INFO:tasks.workunit.client.0.smithi087.stdout:3/16: write f2 [607130,74688] 0 2024-05-08T05:31:54.483 INFO:tasks.workunit.client.0.smithi087.stdout:8/4: rename f1 to f2 0 2024-05-08T05:31:54.486 INFO:tasks.workunit.client.0.smithi087.stdout:7/10: rename l1 to d2/l3 0 2024-05-08T05:31:54.486 INFO:tasks.workunit.client.0.smithi087.stdout:7/11: write - no filename 2024-05-08T05:31:54.486 INFO:tasks.workunit.client.0.smithi087.stdout:7/12: chown l0 5857 1 2024-05-08T05:31:54.487 INFO:tasks.workunit.client.0.smithi087.stdout:8/5: creat f3 x:0 0 0 2024-05-08T05:31:54.489 INFO:tasks.workunit.client.0.smithi087.stdout:7/13: creat d2/f4 x:0 0 0 2024-05-08T05:31:54.491 INFO:tasks.workunit.client.0.smithi087.stdout:8/6: creat f4 x:0 0 0 2024-05-08T05:31:54.491 INFO:tasks.workunit.client.0.smithi087.stdout:7/14: creat d2/f5 x:0 0 0 2024-05-08T05:31:54.492 INFO:tasks.workunit.client.0.smithi087.stdout:7/15: mkdir d2/d6 0 2024-05-08T05:31:54.494 INFO:tasks.workunit.client.0.smithi087.stdout:7/16: rmdir d2 39 2024-05-08T05:31:54.494 INFO:tasks.workunit.client.0.smithi087.stdout:7/17: dread - d2/f5 zero size 2024-05-08T05:31:54.494 INFO:tasks.workunit.client.0.smithi087.stdout:7/18: dread - d2/f4 zero size 2024-05-08T05:31:54.494 INFO:tasks.workunit.client.0.smithi087.stdout:7/19: dread - d2/f5 zero size 2024-05-08T05:31:54.495 INFO:tasks.workunit.client.0.smithi087.stdout:6/7: link f1 f2 0 2024-05-08T05:31:54.497 INFO:tasks.workunit.client.0.smithi087.stdout:7/20: link d2/f4 d2/d6/f7 0 2024-05-08T05:31:54.497 INFO:tasks.workunit.client.0.smithi087.stdout:7/21: chown d2 6 1 2024-05-08T05:31:54.497 INFO:tasks.workunit.client.0.smithi087.stdout:7/22: dread - d2/f5 zero size 2024-05-08T05:31:54.497 INFO:tasks.workunit.client.0.smithi087.stdout:9/2: dread f0 [0,4194304] 0 2024-05-08T05:31:54.500 INFO:tasks.workunit.client.0.smithi087.stdout:2/4: dread f1 [0,4194304] 0 2024-05-08T05:31:54.500 INFO:tasks.workunit.client.0.smithi087.stdout:2/5: truncate f1 1345886 0 2024-05-08T05:31:54.500 INFO:tasks.workunit.client.0.smithi087.stdout:2/6: getdents d2 0 2024-05-08T05:31:54.500 INFO:tasks.workunit.client.0.smithi087.stdout:2/7: getdents d2 0 2024-05-08T05:31:54.503 INFO:tasks.workunit.client.0.smithi087.stdout:9/3: unlink f0 0 2024-05-08T05:31:54.505 INFO:tasks.workunit.client.0.smithi087.stdout:9/4: mkdir d1 0 2024-05-08T05:31:54.506 INFO:tasks.workunit.client.0.smithi087.stdout:9/5: rename d1 to d1/d2 22 2024-05-08T05:31:54.506 INFO:tasks.workunit.client.0.smithi087.stdout:9/6: dread - no filename 2024-05-08T05:31:54.506 INFO:tasks.workunit.client.0.smithi087.stdout:9/7: rename d1 to d1/d3 22 2024-05-08T05:31:54.507 INFO:tasks.workunit.client.0.smithi087.stdout:9/8: fsync - no filename 2024-05-08T05:31:54.507 INFO:tasks.workunit.client.0.smithi087.stdout:9/9: dwrite - no filename 2024-05-08T05:31:54.507 INFO:tasks.workunit.client.0.smithi087.stdout:9/10: dwrite - no filename 2024-05-08T05:31:54.507 INFO:tasks.workunit.client.0.smithi087.stdout:9/11: dwrite - no filename 2024-05-08T05:31:54.516 INFO:tasks.workunit.client.0.smithi087.stdout:0/5: dwrite d0/f1 [0,4194304] 0 2024-05-08T05:31:54.517 INFO:tasks.workunit.client.0.smithi087.stdout:7/23: getdents d2/d6 0 2024-05-08T05:31:54.518 INFO:tasks.workunit.client.0.smithi087.stdout:2/8: truncate f1 168076 0 2024-05-08T05:31:54.518 INFO:tasks.workunit.client.0.smithi087.stdout:2/9: getdents d2 0 2024-05-08T05:31:54.518 INFO:tasks.workunit.client.0.smithi087.stdout:2/10: stat d2 0 2024-05-08T05:31:54.518 INFO:tasks.workunit.client.0.smithi087.stdout:9/12: creat d1/f4 x:0 0 0 2024-05-08T05:31:54.520 INFO:tasks.workunit.client.0.smithi087.stdout:7/24: symlink d2/l8 0 2024-05-08T05:31:54.520 INFO:tasks.workunit.client.0.smithi087.stdout:7/25: readlink d2/l3 0 2024-05-08T05:31:54.525 INFO:tasks.workunit.client.0.smithi087.stdout:9/13: creat d1/f5 x:0 0 0 2024-05-08T05:31:54.525 INFO:tasks.workunit.client.0.smithi087.stdout:9/14: dread - d1/f4 zero size 2024-05-08T05:31:54.525 INFO:tasks.workunit.client.0.smithi087.stdout:0/6: write d0/f1 [5106299,58290] 0 2024-05-08T05:31:54.525 INFO:tasks.workunit.client.0.smithi087.stdout:7/26: rename d2/l8 to d2/d6/l9 0 2024-05-08T05:31:54.531 INFO:tasks.workunit.client.0.smithi087.stdout:0/7: getdents d0 0 2024-05-08T05:31:54.531 INFO:tasks.workunit.client.0.smithi087.stdout:0/8: chown d0 10 1 2024-05-08T05:31:54.532 INFO:tasks.workunit.client.0.smithi087.stdout:2/11: rmdir d2 0 2024-05-08T05:31:54.538 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:31:54 smithi160 ceph-mon[34827]: scrub summary: idle 2024-05-08T05:31:54.538 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:31:54 smithi160 ceph-mon[34827]: pgmap v507: 97 pgs: 97 active+clean; 52 MiB data, 533 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 2.0 MiB/s wr, 82 op/s 2024-05-08T05:31:54.574 INFO:tasks.workunit.client.0.smithi087.stdout:2/12: dread f1 [0,4194304] 0 2024-05-08T05:31:54.581 INFO:tasks.workunit.client.0.smithi087.stdout:2/13: read f1 [23915,75012] 0 2024-05-08T05:31:54.581 INFO:tasks.workunit.client.0.smithi087.stdout:2/14: chown f1 88 1 2024-05-08T05:31:54.584 INFO:tasks.workunit.client.0.smithi087.stdout:2/15: creat f3 x:0 0 0 2024-05-08T05:31:54.617 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:31:54 smithi087 ceph-mon[29523]: scrub summary: idle 2024-05-08T05:31:54.617 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:31:54 smithi087 ceph-mon[29523]: pgmap v507: 97 pgs: 97 active+clean; 52 MiB data, 533 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 2.0 MiB/s wr, 82 op/s 2024-05-08T05:31:54.662 INFO:tasks.workunit.client.0.smithi087.stdout:4/7: dwrite f1 [0,4194304] 0 2024-05-08T05:31:54.670 INFO:tasks.workunit.client.0.smithi087.stdout:4/8: symlink l2 0 2024-05-08T05:31:54.733 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:31:54 smithi090 ceph-mon[34526]: scrub summary: idle 2024-05-08T05:31:54.733 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:31:54 smithi090 ceph-mon[34526]: pgmap v507: 97 pgs: 97 active+clean; 52 MiB data, 533 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 2.0 MiB/s wr, 82 op/s 2024-05-08T05:31:54.814 INFO:tasks.workunit.client.0.smithi087.stdout:4/9: dread f1 [0,4194304] 0 2024-05-08T05:31:54.924 INFO:tasks.workunit.client.0.smithi087.stdout:3/17: dwrite f2 [0,4194304] 0 2024-05-08T05:31:54.935 INFO:tasks.workunit.client.0.smithi087.stdout:4/10: write f1 [4237992,76151] 0 2024-05-08T05:31:55.003 INFO:tasks.workunit.client.0.smithi087.stdout:6/8: dwrite f1 [0,4194304] 0 2024-05-08T05:31:55.003 INFO:tasks.workunit.client.0.smithi087.stdout:6/9: rmdir - no directory 2024-05-08T05:31:55.006 INFO:tasks.workunit.client.0.smithi087.stdout:0/9: dwrite d0/f1 [0,4194304] 0 2024-05-08T05:31:55.308 INFO:tasks.workunit.client.0.smithi087.stdout:0/10: dwrite d0/f1 [4194304,4194304] 0 2024-05-08T05:31:55.503 INFO:tasks.workunit.client.0.smithi087.stdout:3/18: link l1 l3 0 2024-05-08T05:31:55.505 INFO:tasks.workunit.client.0.smithi087.stdout:4/11: getdents . 0 2024-05-08T05:31:55.516 INFO:tasks.workunit.client.0.smithi087.stdout:9/15: dwrite d1/f5 [0,4194304] 0 2024-05-08T05:31:56.538 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:31:56 smithi160 ceph-mon[34827]: pgmap v508: 97 pgs: 97 active+clean; 62 MiB data, 572 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 2.5 MiB/s wr, 138 op/s 2024-05-08T05:31:56.708 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:31:56 smithi087 ceph-mon[29523]: pgmap v508: 97 pgs: 97 active+clean; 62 MiB data, 572 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 2.5 MiB/s wr, 138 op/s 2024-05-08T05:31:56.733 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:31:56 smithi090 ceph-mon[34526]: pgmap v508: 97 pgs: 97 active+clean; 62 MiB data, 572 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 2.5 MiB/s wr, 138 op/s 2024-05-08T05:31:58.147 INFO:tasks.workunit.client.0.smithi087.stdout:3/19: mkdir d4 0 2024-05-08T05:31:58.174 INFO:tasks.workunit.client.0.smithi087.stdout:4/12: rename l2 to l3 0 2024-05-08T05:31:58.207 INFO:tasks.workunit.client.0.smithi087.stdout:4/13: dread f1 [0,4194304] 0 2024-05-08T05:31:58.268 INFO:tasks.workunit.client.0.smithi087.stdout:9/16: unlink d1/f5 0 2024-05-08T05:31:58.268 INFO:tasks.workunit.client.0.smithi087.stdout:9/17: readlink - no filename 2024-05-08T05:31:58.268 INFO:tasks.workunit.client.0.smithi087.stdout:9/18: dread - d1/f4 zero size 2024-05-08T05:31:58.321 INFO:tasks.workunit.client.0.smithi087.stdout:4/14: dwrite f1 [0,4194304] 0 2024-05-08T05:31:58.538 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:31:58 smithi160 ceph-mon[34827]: pgmap v509: 97 pgs: 97 active+clean; 81 MiB data, 638 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 4.1 MiB/s wr, 279 op/s 2024-05-08T05:31:58.708 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:31:58 smithi087 ceph-mon[29523]: pgmap v509: 97 pgs: 97 active+clean; 81 MiB data, 638 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 4.1 MiB/s wr, 279 op/s 2024-05-08T05:31:58.733 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:31:58 smithi090 ceph-mon[34526]: pgmap v509: 97 pgs: 97 active+clean; 81 MiB data, 638 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 4.1 MiB/s wr, 279 op/s 2024-05-08T05:31:59.061 INFO:tasks.workunit.client.0.smithi087.stdout:9/19: symlink d1/l6 0 2024-05-08T05:31:59.062 INFO:tasks.workunit.client.0.smithi087.stdout:4/15: mkdir d4 0 2024-05-08T05:31:59.063 INFO:tasks.workunit.client.0.smithi087.stdout:4/16: symlink d4/l5 0 2024-05-08T05:31:59.239 INFO:tasks.workunit.client.0.smithi087.stdout:4/17: link l3 d4/l6 0 2024-05-08T05:31:59.271 INFO:tasks.workunit.client.0.smithi087.stdout:4/18: write f1 [876492,6270] 0 2024-05-08T05:31:59.500 INFO:tasks.workunit.client.0.smithi087.stdout:9/20: getdents d1 0 2024-05-08T05:31:59.503 INFO:tasks.workunit.client.0.smithi087.stdout:9/21: creat d1/f7 x:0 0 0 2024-05-08T05:31:59.503 INFO:tasks.workunit.client.0.smithi087.stdout:9/22: stat d1 0 2024-05-08T05:31:59.503 INFO:tasks.workunit.client.0.smithi087.stdout:9/23: chown d1/f7 6703901 1 2024-05-08T05:31:59.503 INFO:tasks.workunit.client.0.smithi087.stdout:9/24: dread - d1/f4 zero size 2024-05-08T05:31:59.531 INFO:tasks.workunit.client.0.smithi087.stdout:4/19: truncate f1 2505158 0 2024-05-08T05:31:59.570 INFO:tasks.workunit.client.0.smithi087.stdout:2/16: sync 2024-05-08T05:31:59.570 INFO:tasks.workunit.client.0.smithi087.stdout:2/17: read - f3 zero size 2024-05-08T05:31:59.570 INFO:tasks.workunit.client.0.smithi087.stdout:1/4: sync 2024-05-08T05:31:59.570 INFO:tasks.workunit.client.0.smithi087.stdout:0/11: sync 2024-05-08T05:31:59.570 INFO:tasks.workunit.client.0.smithi087.stdout:3/20: sync 2024-05-08T05:31:59.570 INFO:tasks.workunit.client.0.smithi087.stdout:6/10: sync 2024-05-08T05:31:59.570 INFO:tasks.workunit.client.0.smithi087.stdout:6/11: rmdir - no directory 2024-05-08T05:31:59.570 INFO:tasks.workunit.client.0.smithi087.stdout:8/7: sync 2024-05-08T05:31:59.570 INFO:tasks.workunit.client.0.smithi087.stdout:8/8: chown f0 94163 1 2024-05-08T05:31:59.570 INFO:tasks.workunit.client.0.smithi087.stdout:0/12: getdents d0 0 2024-05-08T05:31:59.570 INFO:tasks.workunit.client.0.smithi087.stdout:7/27: sync 2024-05-08T05:31:59.570 INFO:tasks.workunit.client.0.smithi087.stdout:5/7: sync 2024-05-08T05:31:59.580 INFO:tasks.workunit.client.0.smithi087.stdout:2/18: dread f1 [0,4194304] 0 2024-05-08T05:31:59.602 INFO:tasks.workunit.client.0.smithi087.stdout:9/25: dwrite d1/f4 [0,4194304] 0 2024-05-08T05:31:59.607 INFO:tasks.workunit.client.0.smithi087.stdout:6/12: creat f3 x:0 0 0 2024-05-08T05:31:59.607 INFO:tasks.workunit.client.0.smithi087.stdout:6/13: truncate f3 186322 0 2024-05-08T05:31:59.608 INFO:tasks.workunit.client.0.smithi087.stdout:1/5: rename c0 to c4 0 2024-05-08T05:31:59.610 INFO:tasks.workunit.client.0.smithi087.stdout:8/9: link f3 f5 0 2024-05-08T05:31:59.610 INFO:tasks.workunit.client.0.smithi087.stdout:8/10: chown f2 108936 1 2024-05-08T05:31:59.610 INFO:tasks.workunit.client.0.smithi087.stdout:8/11: stat f2 0 2024-05-08T05:31:59.610 INFO:tasks.workunit.client.0.smithi087.stdout:8/12: truncate f4 295795 0 2024-05-08T05:31:59.610 INFO:tasks.workunit.client.0.smithi087.stdout:3/21: creat d4/f5 x:0 0 0 2024-05-08T05:31:59.611 INFO:tasks.workunit.client.0.smithi087.stdout:5/8: rename f0 to f1 0 2024-05-08T05:31:59.611 INFO:tasks.workunit.client.0.smithi087.stdout:5/9: chown f1 92312 1 2024-05-08T05:31:59.612 INFO:tasks.workunit.client.0.smithi087.stdout:7/28: mkdir d2/da 0 2024-05-08T05:31:59.614 INFO:tasks.workunit.client.0.smithi087.stdout:6/14: mkdir d4 0 2024-05-08T05:31:59.614 INFO:tasks.workunit.client.0.smithi087.stdout:6/15: chown d4 3 1 2024-05-08T05:31:59.616 INFO:tasks.workunit.client.0.smithi087.stdout:8/13: creat f6 x:0 0 0 2024-05-08T05:31:59.617 INFO:tasks.workunit.client.0.smithi087.stdout:3/22: creat d4/f6 x:0 0 0 2024-05-08T05:31:59.623 INFO:tasks.workunit.client.0.smithi087.stdout:7/29: creat d2/d6/fb x:0 0 0 2024-05-08T05:31:59.623 INFO:tasks.workunit.client.0.smithi087.stdout:4/20: dwrite f1 [0,4194304] 0 2024-05-08T05:31:59.623 INFO:tasks.workunit.client.0.smithi087.stdout:4/21: rename d4 to d4/d7 22 2024-05-08T05:31:59.627 INFO:tasks.workunit.client.0.smithi087.stdout:8/14: creat f7 x:0 0 0 2024-05-08T05:31:59.632 INFO:tasks.workunit.client.0.smithi087.stdout:3/23: link l3 d4/l7 0 2024-05-08T05:31:59.632 INFO:tasks.workunit.client.0.smithi087.stdout:3/24: dread - d4/f5 zero size 2024-05-08T05:31:59.641 INFO:tasks.workunit.client.0.smithi087.stdout:8/15: creat f8 x:0 0 0 2024-05-08T05:31:59.641 INFO:tasks.workunit.client.0.smithi087.stdout:3/25: symlink d4/l8 0 2024-05-08T05:31:59.641 INFO:tasks.workunit.client.0.smithi087.stdout:9/26: write d1/f4 [450097,14683] 0 2024-05-08T05:31:59.641 INFO:tasks.workunit.client.0.smithi087.stdout:9/27: chown d1 1464 1 2024-05-08T05:31:59.643 INFO:tasks.workunit.client.0.smithi087.stdout:6/16: dread f3 [0,4194304] 0 2024-05-08T05:31:59.644 INFO:tasks.workunit.client.0.smithi087.stdout:6/17: readlink - no filename 2024-05-08T05:31:59.644 INFO:tasks.workunit.client.0.smithi087.stdout:6/18: chown f2 666683831 1 2024-05-08T05:31:59.645 INFO:tasks.workunit.client.0.smithi087.stdout:3/26: rmdir d4 39 2024-05-08T05:31:59.646 INFO:tasks.workunit.client.0.smithi087.stdout:8/16: unlink f7 0 2024-05-08T05:31:59.647 INFO:tasks.workunit.client.0.smithi087.stdout:8/17: readlink - no filename 2024-05-08T05:31:59.647 INFO:tasks.workunit.client.0.smithi087.stdout:8/18: stat f4 0 2024-05-08T05:31:59.647 INFO:tasks.workunit.client.0.smithi087.stdout:3/27: truncate f2 4054137 0 2024-05-08T05:31:59.647 INFO:tasks.workunit.client.0.smithi087.stdout:3/28: dread - d4/f5 zero size 2024-05-08T05:31:59.652 INFO:tasks.workunit.client.0.smithi087.stdout:8/19: creat f9 x:0 0 0 2024-05-08T05:31:59.652 INFO:tasks.workunit.client.0.smithi087.stdout:8/20: read - f3 zero size 2024-05-08T05:31:59.662 INFO:tasks.workunit.client.0.smithi087.stdout:4/22: truncate f1 1859536 0 2024-05-08T05:31:59.665 INFO:tasks.workunit.client.0.smithi087.stdout:4/23: creat d4/f8 x:0 0 0 2024-05-08T05:31:59.668 INFO:tasks.workunit.client.0.smithi087.stdout:3/29: write f2 [4654372,80838] 0 2024-05-08T05:31:59.668 INFO:tasks.workunit.client.0.smithi087.stdout:3/30: write d4/f6 [261686,110598] 0 2024-05-08T05:31:59.689 INFO:tasks.workunit.client.0.smithi087.stdout:7/30: dwrite d2/d6/f7 [0,4194304] 0 2024-05-08T05:31:59.690 INFO:tasks.workunit.client.0.smithi087.stdout:2/19: dwrite f1 [0,4194304] 0 2024-05-08T05:31:59.691 INFO:tasks.workunit.client.0.smithi087.stdout:3/31: mknod d4/c9 0 2024-05-08T05:31:59.691 INFO:tasks.workunit.client.0.smithi087.stdout:3/32: chown d4/f5 118581 1 2024-05-08T05:31:59.693 INFO:tasks.workunit.client.0.smithi087.stdout:1/6: dwrite f3 [0,4194304] 0 2024-05-08T05:31:59.696 INFO:tasks.workunit.client.0.smithi087.stdout:2/20: link f1 f4 0 2024-05-08T05:31:59.696 INFO:tasks.workunit.client.0.smithi087.stdout:3/33: rename l3 to d4/la 0 2024-05-08T05:31:59.700 INFO:tasks.workunit.client.0.smithi087.stdout:3/34: creat d4/fb x:0 0 0 2024-05-08T05:31:59.719 INFO:tasks.workunit.client.0.smithi087.stdout:5/10: dwrite f1 [0,4194304] 0 2024-05-08T05:31:59.724 INFO:tasks.workunit.client.0.smithi087.stdout:7/31: dread d2/d6/f7 [0,4194304] 0 2024-05-08T05:31:59.726 INFO:tasks.workunit.client.0.smithi087.stdout:5/11: rename f1 to f2 0 2024-05-08T05:31:59.726 INFO:tasks.workunit.client.0.smithi087.stdout:8/21: dwrite f2 [0,4194304] 0 2024-05-08T05:31:59.726 INFO:tasks.workunit.client.0.smithi087.stdout:8/22: write f8 [503603,16936] 0 2024-05-08T05:31:59.729 INFO:tasks.workunit.client.0.smithi087.stdout:7/32: rename d2/l3 to d2/da/lc 0 2024-05-08T05:31:59.730 INFO:tasks.workunit.client.0.smithi087.stdout:5/12: mknod c3 0 2024-05-08T05:31:59.730 INFO:tasks.workunit.client.0.smithi087.stdout:5/13: chown f2 92173 1 2024-05-08T05:31:59.731 INFO:tasks.workunit.client.0.smithi087.stdout:7/33: mknod d2/da/cd 0 2024-05-08T05:31:59.731 INFO:tasks.workunit.client.0.smithi087.stdout:7/34: dread - d2/f5 zero size 2024-05-08T05:31:59.731 INFO:tasks.workunit.client.0.smithi087.stdout:7/35: dread - d2/f5 zero size 2024-05-08T05:31:59.731 INFO:tasks.workunit.client.0.smithi087.stdout:2/21: dread f4 [0,4194304] 0 2024-05-08T05:31:59.731 INFO:tasks.workunit.client.0.smithi087.stdout:6/19: dwrite f1 [0,4194304] 0 2024-05-08T05:31:59.736 INFO:tasks.workunit.client.0.smithi087.stdout:7/36: creat d2/d6/fe x:0 0 0 2024-05-08T05:31:59.736 INFO:tasks.workunit.client.0.smithi087.stdout:6/20: rename f2 to d4/f5 0 2024-05-08T05:31:59.736 INFO:tasks.workunit.client.0.smithi087.stdout:3/35: dread d4/f6 [0,4194304] 0 2024-05-08T05:31:59.737 INFO:tasks.workunit.client.0.smithi087.stdout:6/21: mkdir d4/d6 0 2024-05-08T05:31:59.737 INFO:tasks.workunit.client.0.smithi087.stdout:4/24: dwrite d4/f8 [0,4194304] 0 2024-05-08T05:31:59.737 INFO:tasks.workunit.client.0.smithi087.stdout:3/36: mknod d4/cc 0 2024-05-08T05:31:59.737 INFO:tasks.workunit.client.0.smithi087.stdout:6/22: link f1 d4/f7 0 2024-05-08T05:31:59.739 INFO:tasks.workunit.client.0.smithi087.stdout:4/25: creat d4/f9 x:0 0 0 2024-05-08T05:31:59.740 INFO:tasks.workunit.client.0.smithi087.stdout:3/37: rename d4/cc to d4/cd 0 2024-05-08T05:31:59.743 INFO:tasks.workunit.client.0.smithi087.stdout:4/26: link d4/l5 d4/la 0 2024-05-08T05:31:59.743 INFO:tasks.workunit.client.0.smithi087.stdout:4/27: fdatasync d4/f9 0 2024-05-08T05:31:59.746 INFO:tasks.workunit.client.0.smithi087.stdout:1/7: dwrite f3 [0,4194304] 0 2024-05-08T05:31:59.746 INFO:tasks.workunit.client.0.smithi087.stdout:1/8: readlink l1 0 2024-05-08T05:31:59.750 INFO:tasks.workunit.client.0.smithi087.stdout:4/28: symlink d4/lb 0 2024-05-08T05:31:59.750 INFO:tasks.workunit.client.0.smithi087.stdout:2/22: dread f4 [0,4194304] 0 2024-05-08T05:31:59.750 INFO:tasks.workunit.client.0.smithi087.stdout:8/23: read f2 [1747944,121869] 0 2024-05-08T05:31:59.752 INFO:tasks.workunit.client.0.smithi087.stdout:2/23: creat f5 x:0 0 0 2024-05-08T05:31:59.752 INFO:tasks.workunit.client.0.smithi087.stdout:2/24: dread - f5 zero size 2024-05-08T05:31:59.757 INFO:tasks.workunit.client.0.smithi087.stdout:8/24: creat fa x:0 0 0 2024-05-08T05:31:59.757 INFO:tasks.workunit.client.0.smithi087.stdout:8/25: truncate f9 144205 0 2024-05-08T05:31:59.757 INFO:tasks.workunit.client.0.smithi087.stdout:8/26: rmdir - no directory 2024-05-08T05:31:59.757 INFO:tasks.workunit.client.0.smithi087.stdout:8/27: rmdir - no directory 2024-05-08T05:31:59.757 INFO:tasks.workunit.client.0.smithi087.stdout:2/25: rename f4 to f6 0 2024-05-08T05:31:59.757 INFO:tasks.workunit.client.0.smithi087.stdout:2/26: readlink l0 0 2024-05-08T05:31:59.757 INFO:tasks.workunit.client.0.smithi087.stdout:2/27: mkdir d7 0 2024-05-08T05:31:59.758 INFO:tasks.workunit.client.0.smithi087.stdout:7/37: dread d2/d6/f7 [0,4194304] 0 2024-05-08T05:31:59.758 INFO:tasks.workunit.client.0.smithi087.stdout:7/38: chown d2/d6/f7 45604 1 2024-05-08T05:31:59.758 INFO:tasks.workunit.client.0.smithi087.stdout:7/39: dread - d2/d6/fb zero size 2024-05-08T05:31:59.758 INFO:tasks.workunit.client.0.smithi087.stdout:7/40: fdatasync d2/f4 0 2024-05-08T05:31:59.759 INFO:tasks.workunit.client.0.smithi087.stdout:2/28: link f3 d7/f8 0 2024-05-08T05:31:59.762 INFO:tasks.workunit.client.0.smithi087.stdout:8/28: dread f4 [0,4194304] 0 2024-05-08T05:31:59.764 INFO:tasks.workunit.client.0.smithi087.stdout:8/29: read f4 [16558,50922] 0 2024-05-08T05:31:59.769 INFO:tasks.workunit.client.0.smithi087.stdout:2/29: symlink d7/l9 0 2024-05-08T05:31:59.769 INFO:tasks.workunit.client.0.smithi087.stdout:1/9: write f3 [1558258,72209] 0 2024-05-08T05:31:59.770 INFO:tasks.workunit.client.0.smithi087.stdout:8/30: mkdir db 0 2024-05-08T05:31:59.771 INFO:tasks.workunit.client.0.smithi087.stdout:6/23: write f1 [32863,108313] 0 2024-05-08T05:31:59.771 INFO:tasks.workunit.client.0.smithi087.stdout:2/30: symlink d7/la 0 2024-05-08T05:31:59.771 INFO:tasks.workunit.client.0.smithi087.stdout:2/31: fdatasync f5 0 2024-05-08T05:31:59.771 INFO:tasks.workunit.client.0.smithi087.stdout:2/32: chown d7/f8 6172155 1 2024-05-08T05:31:59.776 INFO:tasks.workunit.client.0.smithi087.stdout:8/31: mknod db/cc 0 2024-05-08T05:31:59.776 INFO:tasks.workunit.client.0.smithi087.stdout:1/10: fsync f3 0 2024-05-08T05:31:59.776 INFO:tasks.workunit.client.0.smithi087.stdout:1/11: readlink l1 0 2024-05-08T05:31:59.776 INFO:tasks.workunit.client.0.smithi087.stdout:1/12: readlink l1 0 2024-05-08T05:31:59.776 INFO:tasks.workunit.client.0.smithi087.stdout:1/13: fdatasync f3 0 2024-05-08T05:31:59.776 INFO:tasks.workunit.client.0.smithi087.stdout:2/33: mknod d7/cb 0 2024-05-08T05:31:59.777 INFO:tasks.workunit.client.0.smithi087.stdout:6/24: mkdir d4/d8 0 2024-05-08T05:31:59.777 INFO:tasks.workunit.client.0.smithi087.stdout:6/25: chown d4/f7 5981 1 2024-05-08T05:31:59.777 INFO:tasks.workunit.client.0.smithi087.stdout:6/26: write f3 [564142,33228] 0 2024-05-08T05:31:59.779 INFO:tasks.workunit.client.0.smithi087.stdout:6/27: rename d4/f5 to d4/d6/f9 0 2024-05-08T05:31:59.781 INFO:tasks.workunit.client.0.smithi087.stdout:6/28: creat d4/d6/fa x:0 0 0 2024-05-08T05:31:59.781 INFO:tasks.workunit.client.0.smithi087.stdout:6/29: chown d4 0 1 2024-05-08T05:31:59.792 INFO:tasks.workunit.client.0.smithi087.stdout:6/30: link d4/d6/fa d4/d8/fb 0 2024-05-08T05:31:59.796 INFO:tasks.workunit.client.0.smithi087.stdout:6/31: rename f3 to d4/d6/fc 0 2024-05-08T05:31:59.796 INFO:tasks.workunit.client.0.smithi087.stdout:7/41: dread d2/d6/f7 [0,4194304] 0 2024-05-08T05:31:59.796 INFO:tasks.workunit.client.0.smithi087.stdout:7/42: fsync d2/d6/fb 0 2024-05-08T05:31:59.796 INFO:tasks.workunit.client.0.smithi087.stdout:6/32: read d4/f7 [1408861,113352] 0 2024-05-08T05:31:59.797 INFO:tasks.workunit.client.0.smithi087.stdout:6/33: rmdir d4 39 2024-05-08T05:31:59.816 INFO:tasks.workunit.client.0.smithi087.stdout:2/34: write f6 [1103332,19647] 0 2024-05-08T05:31:59.821 INFO:tasks.workunit.client.0.smithi087.stdout:5/14: dwrite f2 [0,4194304] 0 2024-05-08T05:31:59.823 INFO:tasks.workunit.client.0.smithi087.stdout:5/15: mknod c4 0 2024-05-08T05:31:59.823 INFO:tasks.workunit.client.0.smithi087.stdout:5/16: fdatasync f2 0 2024-05-08T05:31:59.824 INFO:tasks.workunit.client.0.smithi087.stdout:2/35: fsync f1 0 2024-05-08T05:31:59.824 INFO:tasks.workunit.client.0.smithi087.stdout:0/13: rmdir d0 39 2024-05-08T05:31:59.824 INFO:tasks.workunit.client.0.smithi087.stdout:0/14: getdents d0 0 2024-05-08T05:31:59.825 INFO:tasks.workunit.client.0.smithi087.stdout:9/28: rmdir d1 39 2024-05-08T05:31:59.833 INFO:tasks.workunit.client.0.smithi087.stdout:0/15: rename d0/f1 to d0/f2 0 2024-05-08T05:31:59.833 INFO:tasks.workunit.client.0.smithi087.stdout:2/36: symlink d7/lc 0 2024-05-08T05:31:59.834 INFO:tasks.workunit.client.0.smithi087.stdout:9/29: getdents d1 0 2024-05-08T05:31:59.834 INFO:tasks.workunit.client.0.smithi087.stdout:2/37: fsync f3 0 2024-05-08T05:31:59.834 INFO:tasks.workunit.client.0.smithi087.stdout:2/38: dread - f5 zero size 2024-05-08T05:31:59.834 INFO:tasks.workunit.client.0.smithi087.stdout:9/30: creat d1/f8 x:0 0 0 2024-05-08T05:31:59.834 INFO:tasks.workunit.client.0.smithi087.stdout:9/31: write d1/f7 [378921,43614] 0 2024-05-08T05:31:59.838 INFO:tasks.workunit.client.0.smithi087.stdout:3/38: dwrite f2 [0,4194304] 0 2024-05-08T05:31:59.838 INFO:tasks.workunit.client.0.smithi087.stdout:3/39: chown l1 326725199 1 2024-05-08T05:31:59.839 INFO:tasks.workunit.client.0.smithi087.stdout:8/32: dwrite f0 [0,4194304] 0 2024-05-08T05:31:59.846 INFO:tasks.workunit.client.0.smithi087.stdout:9/32: dread d1/f4 [0,4194304] 0 2024-05-08T05:31:59.846 INFO:tasks.workunit.client.0.smithi087.stdout:9/33: readlink d1/l6 0 2024-05-08T05:31:59.850 INFO:tasks.workunit.client.0.smithi087.stdout:8/33: symlink db/ld 0 2024-05-08T05:31:59.850 INFO:tasks.workunit.client.0.smithi087.stdout:3/40: symlink d4/le 0 2024-05-08T05:31:59.851 INFO:tasks.workunit.client.0.smithi087.stdout:2/39: dread f6 [0,4194304] 0 2024-05-08T05:31:59.851 INFO:tasks.workunit.client.0.smithi087.stdout:2/40: fdatasync f6 0 2024-05-08T05:31:59.851 INFO:tasks.workunit.client.0.smithi087.stdout:2/41: chown d7 457819 1 2024-05-08T05:31:59.851 INFO:tasks.workunit.client.0.smithi087.stdout:2/42: chown d7/cb 1 1 2024-05-08T05:31:59.851 INFO:tasks.workunit.client.0.smithi087.stdout:2/43: dread - f5 zero size 2024-05-08T05:31:59.853 INFO:tasks.workunit.client.0.smithi087.stdout:2/44: write d7/f8 [758183,32314] 0 2024-05-08T05:31:59.854 INFO:tasks.workunit.client.0.smithi087.stdout:2/45: dread - f5 zero size 2024-05-08T05:31:59.855 INFO:tasks.workunit.client.0.smithi087.stdout:1/14: dwrite f3 [4194304,4194304] 0 2024-05-08T05:31:59.856 INFO:tasks.workunit.client.0.smithi087.stdout:5/17: dread f2 [0,4194304] 0 2024-05-08T05:31:59.856 INFO:tasks.workunit.client.0.smithi087.stdout:1/15: read f3 [921371,124013] 0 2024-05-08T05:31:59.856 INFO:tasks.workunit.client.0.smithi087.stdout:1/16: rmdir - no directory 2024-05-08T05:31:59.861 INFO:tasks.workunit.client.0.smithi087.stdout:4/29: dwrite d4/f8 [0,4194304] 0 2024-05-08T05:31:59.866 INFO:tasks.workunit.client.0.smithi087.stdout:9/34: dread d1/f4 [0,4194304] 0 2024-05-08T05:31:59.875 INFO:tasks.workunit.client.0.smithi087.stdout:5/18: dread f2 [0,4194304] 0 2024-05-08T05:31:59.875 INFO:tasks.workunit.client.0.smithi087.stdout:5/19: chown c4 73148 1 2024-05-08T05:31:59.878 INFO:tasks.workunit.client.0.smithi087.stdout:8/34: mknod db/ce 0 2024-05-08T05:31:59.879 INFO:tasks.workunit.client.0.smithi087.stdout:3/41: symlink d4/lf 0 2024-05-08T05:31:59.880 INFO:tasks.workunit.client.0.smithi087.stdout:3/42: write d4/fb [518146,65731] 0 2024-05-08T05:31:59.881 INFO:tasks.workunit.client.0.smithi087.stdout:1/17: mknod c5 0 2024-05-08T05:31:59.882 INFO:tasks.workunit.client.0.smithi087.stdout:9/35: mknod d1/c9 0 2024-05-08T05:31:59.884 INFO:tasks.workunit.client.0.smithi087.stdout:9/36: write d1/f7 [265127,64449] 0 2024-05-08T05:31:59.884 INFO:tasks.workunit.client.0.smithi087.stdout:5/20: unlink c3 0 2024-05-08T05:31:59.884 INFO:tasks.workunit.client.0.smithi087.stdout:9/37: write d1/f8 [957878,35871] 0 2024-05-08T05:31:59.886 INFO:tasks.workunit.client.0.smithi087.stdout:8/35: mknod db/cf 0 2024-05-08T05:31:59.887 INFO:tasks.workunit.client.0.smithi087.stdout:3/43: symlink d4/l10 0 2024-05-08T05:31:59.889 INFO:tasks.workunit.client.0.smithi087.stdout:0/16: write d0/f2 [4110520,113604] 0 2024-05-08T05:31:59.889 INFO:tasks.workunit.client.0.smithi087.stdout:8/36: rmdir db 39 2024-05-08T05:31:59.889 INFO:tasks.workunit.client.0.smithi087.stdout:8/37: truncate f6 426510 0 2024-05-08T05:31:59.893 INFO:tasks.workunit.client.0.smithi087.stdout:9/38: fsync d1/f8 0 2024-05-08T05:31:59.894 INFO:tasks.workunit.client.0.smithi087.stdout:3/44: mkdir d4/d11 0 2024-05-08T05:31:59.914 INFO:tasks.workunit.client.0.smithi087.stdout:6/34: dwrite d4/d6/f9 [4194304,4194304] 0 2024-05-08T05:31:59.914 INFO:tasks.workunit.client.0.smithi087.stdout:6/35: link f1 d4/fd 0 2024-05-08T05:31:59.914 INFO:tasks.workunit.client.0.smithi087.stdout:3/45: fsync d4/fb 0 2024-05-08T05:31:59.914 INFO:tasks.workunit.client.0.smithi087.stdout:3/46: fdatasync f2 0 2024-05-08T05:31:59.917 INFO:tasks.workunit.client.0.smithi087.stdout:1/18: read f3 [5227332,14711] 0 2024-05-08T05:31:59.918 INFO:tasks.workunit.client.0.smithi087.stdout:1/19: fdatasync f3 0 2024-05-08T05:31:59.918 INFO:tasks.workunit.client.0.smithi087.stdout:1/20: stat f3 0 2024-05-08T05:31:59.918 INFO:tasks.workunit.client.0.smithi087.stdout:1/21: write f3 [900320,53785] 0 2024-05-08T05:31:59.929 INFO:tasks.workunit.client.0.smithi087.stdout:1/22: link c4 c6 0 2024-05-08T05:31:59.933 INFO:tasks.workunit.client.0.smithi087.stdout:5/21: dread f2 [0,4194304] 0 2024-05-08T05:31:59.935 INFO:tasks.workunit.client.0.smithi087.stdout:5/22: link c4 c5 0 2024-05-08T05:31:59.937 INFO:tasks.workunit.client.0.smithi087.stdout:5/23: link f2 f6 0 2024-05-08T05:31:59.937 INFO:tasks.workunit.client.0.smithi087.stdout:5/24: chown c5 121418127 1 2024-05-08T05:31:59.938 INFO:tasks.workunit.client.0.smithi087.stdout:2/46: dwrite d7/f8 [0,4194304] 0 2024-05-08T05:31:59.938 INFO:tasks.workunit.client.0.smithi087.stdout:2/47: write f1 [1417595,50882] 0 2024-05-08T05:31:59.940 INFO:tasks.workunit.client.0.smithi087.stdout:2/48: creat d7/fd x:0 0 0 2024-05-08T05:31:59.949 INFO:tasks.workunit.client.0.smithi087.stdout:1/23: truncate f3 2421316 0 2024-05-08T05:31:59.953 INFO:tasks.workunit.client.0.smithi087.stdout:9/39: dwrite d1/f8 [0,4194304] 0 2024-05-08T05:31:59.955 INFO:tasks.workunit.client.0.smithi087.stdout:4/30: dwrite d4/f8 [0,4194304] 0 2024-05-08T05:31:59.955 INFO:tasks.workunit.client.0.smithi087.stdout:4/31: fsync f1 0 2024-05-08T05:31:59.970 INFO:tasks.workunit.client.0.smithi087.stdout:8/38: dwrite f0 [0,4194304] 0 2024-05-08T05:31:59.991 INFO:tasks.workunit.client.0.smithi087.stdout:3/47: dwrite d4/fb [0,4194304] 0 2024-05-08T05:31:59.998 INFO:tasks.workunit.client.0.smithi087.stdout:0/17: dwrite d0/f2 [4194304,4194304] 0 2024-05-08T05:32:00.004 INFO:tasks.workunit.client.0.smithi087.stdout:5/25: dwrite f2 [0,4194304] 0 2024-05-08T05:32:00.019 INFO:tasks.workunit.client.0.smithi087.stdout:9/40: dwrite d1/f8 [0,4194304] 0 2024-05-08T05:32:00.023 INFO:tasks.workunit.client.0.smithi087.stdout:6/36: dwrite d4/fd [0,4194304] 0 2024-05-08T05:32:00.050 INFO:tasks.workunit.client.0.smithi087.stdout:2/49: dwrite f1 [0,4194304] 0 2024-05-08T05:32:00.064 INFO:tasks.workunit.client.0.smithi087.stdout:6/37: write d4/f7 [1698712,93442] 0 2024-05-08T05:32:00.065 INFO:tasks.workunit.client.0.smithi087.stdout:3/48: dwrite d4/f5 [0,4194304] 0 2024-05-08T05:32:00.136 INFO:tasks.workunit.client.0.smithi087.stdout:2/50: dwrite f6 [0,4194304] 0 2024-05-08T05:32:00.148 INFO:tasks.workunit.client.0.smithi087.stdout:6/38: dwrite d4/d6/fc [0,4194304] 0 2024-05-08T05:32:00.176 INFO:tasks.workunit.client.0.smithi087.stdout:1/24: fsync f3 0 2024-05-08T05:32:00.177 INFO:tasks.workunit.client.0.smithi087.stdout:1/25: fdatasync f3 0 2024-05-08T05:32:00.177 INFO:tasks.workunit.client.0.smithi087.stdout:1/26: chown l1 31443304 1 2024-05-08T05:32:00.177 INFO:tasks.workunit.client.0.smithi087.stdout:1/27: chown c4 20863 1 2024-05-08T05:32:00.177 INFO:tasks.workunit.client.0.smithi087.stdout:1/28: write f3 [2820005,107168] 0 2024-05-08T05:32:00.193 INFO:tasks.workunit.client.0.smithi087.stdout:8/39: unlink f0 0 2024-05-08T05:32:00.193 INFO:tasks.workunit.client.0.smithi087.stdout:0/18: mknod d0/c3 0 2024-05-08T05:32:00.193 INFO:tasks.workunit.client.0.smithi087.stdout:0/19: readlink - no filename 2024-05-08T05:32:00.196 INFO:tasks.workunit.client.0.smithi087.stdout:9/41: getdents d1 0 2024-05-08T05:32:00.196 INFO:tasks.workunit.client.0.smithi087.stdout:3/49: mknod d4/d11/c12 0 2024-05-08T05:32:00.196 INFO:tasks.workunit.client.0.smithi087.stdout:3/50: fsync d4/fb 0 2024-05-08T05:32:00.196 INFO:tasks.workunit.client.0.smithi087.stdout:3/51: readlink l1 0 2024-05-08T05:32:00.197 INFO:tasks.workunit.client.0.smithi087.stdout:5/26: creat f7 x:0 0 0 2024-05-08T05:32:00.197 INFO:tasks.workunit.client.0.smithi087.stdout:9/42: write d1/f4 [2131606,122579] 0 2024-05-08T05:32:00.197 INFO:tasks.workunit.client.0.smithi087.stdout:2/51: mkdir d7/de 0 2024-05-08T05:32:00.197 INFO:tasks.workunit.client.0.smithi087.stdout:1/29: symlink l7 0 2024-05-08T05:32:00.198 INFO:tasks.workunit.client.0.smithi087.stdout:8/40: symlink db/l10 0 2024-05-08T05:32:00.198 INFO:tasks.workunit.client.0.smithi087.stdout:8/41: fsync f2 0 2024-05-08T05:32:00.198 INFO:tasks.workunit.client.0.smithi087.stdout:8/42: truncate f2 4744092 0 2024-05-08T05:32:00.199 INFO:tasks.workunit.client.0.smithi087.stdout:0/20: mkdir d0/d4 0 2024-05-08T05:32:00.201 INFO:tasks.workunit.client.0.smithi087.stdout:3/52: rename d4/cd to d4/c13 0 2024-05-08T05:32:00.203 INFO:tasks.workunit.client.0.smithi087.stdout:5/27: rename c5 to c8 0 2024-05-08T05:32:00.204 INFO:tasks.workunit.client.0.smithi087.stdout:9/43: dread d1/f7 [0,4194304] 0 2024-05-08T05:32:00.206 INFO:tasks.workunit.client.0.smithi087.stdout:2/52: symlink d7/lf 0 2024-05-08T05:32:00.208 INFO:tasks.workunit.client.0.smithi087.stdout:0/21: rmdir d0/d4 0 2024-05-08T05:32:00.208 INFO:tasks.workunit.client.0.smithi087.stdout:0/22: rename d0 to d0/d5 22 2024-05-08T05:32:00.209 INFO:tasks.workunit.client.0.smithi087.stdout:3/53: rmdir d4/d11 39 2024-05-08T05:32:00.211 INFO:tasks.workunit.client.0.smithi087.stdout:5/28: rename f6 to f9 0 2024-05-08T05:32:00.213 INFO:tasks.workunit.client.0.smithi087.stdout:8/43: dread f2 [0,4194304] 0 2024-05-08T05:32:00.213 INFO:tasks.workunit.client.0.smithi087.stdout:6/39: dwrite d4/d6/fa [0,4194304] 0 2024-05-08T05:32:00.213 INFO:tasks.workunit.client.0.smithi087.stdout:6/40: readlink - no filename 2024-05-08T05:32:00.215 INFO:tasks.workunit.client.0.smithi087.stdout:2/53: creat d7/de/f10 x:0 0 0 2024-05-08T05:32:00.216 INFO:tasks.workunit.client.0.smithi087.stdout:0/23: rename d0/c3 to d0/c6 0 2024-05-08T05:32:00.216 INFO:tasks.workunit.client.0.smithi087.stdout:0/24: fdatasync d0/f2 0 2024-05-08T05:32:00.216 INFO:tasks.workunit.client.0.smithi087.stdout:0/25: read d0/f2 [786233,6905] 0 2024-05-08T05:32:00.217 INFO:tasks.workunit.client.0.smithi087.stdout:3/54: unlink d4/la 0 2024-05-08T05:32:00.220 INFO:tasks.workunit.client.0.smithi087.stdout:7/43: sync 2024-05-08T05:32:00.220 INFO:tasks.workunit.client.0.smithi087.stdout:4/32: sync 2024-05-08T05:32:00.221 INFO:tasks.workunit.client.0.smithi087.stdout:8/44: creat db/f11 x:0 0 0 2024-05-08T05:32:00.223 INFO:tasks.workunit.client.0.smithi087.stdout:2/54: creat d7/de/f11 x:0 0 0 2024-05-08T05:32:00.228 INFO:tasks.workunit.client.0.smithi087.stdout:3/55: mkdir d4/d14 0 2024-05-08T05:32:00.228 INFO:tasks.workunit.client.0.smithi087.stdout:3/56: stat d4/c9 0 2024-05-08T05:32:00.230 INFO:tasks.workunit.client.0.smithi087.stdout:7/44: getdents d2/da 0 2024-05-08T05:32:00.230 INFO:tasks.workunit.client.0.smithi087.stdout:7/45: chown d2/da/lc 88 1 2024-05-08T05:32:00.230 INFO:tasks.workunit.client.0.smithi087.stdout:1/30: truncate f3 2508130 0 2024-05-08T05:32:00.230 INFO:tasks.workunit.client.0.smithi087.stdout:7/46: write d2/f5 [265935,65301] 0 2024-05-08T05:32:00.231 INFO:tasks.workunit.client.0.smithi087.stdout:4/33: symlink d4/lc 0 2024-05-08T05:32:00.233 INFO:tasks.workunit.client.0.smithi087.stdout:3/57: symlink d4/l15 0 2024-05-08T05:32:00.234 INFO:tasks.workunit.client.0.smithi087.stdout:1/31: symlink l8 0 2024-05-08T05:32:00.236 INFO:tasks.workunit.client.0.smithi087.stdout:3/58: mknod d4/d14/c16 0 2024-05-08T05:32:00.239 INFO:tasks.workunit.client.0.smithi087.stdout:3/59: read d4/f6 [231878,43060] 0 2024-05-08T05:32:00.239 INFO:tasks.workunit.client.0.smithi087.stdout:3/60: chown d4 32450 1 2024-05-08T05:32:00.239 INFO:tasks.workunit.client.0.smithi087.stdout:3/61: readlink d4/l10 0 2024-05-08T05:32:00.239 INFO:tasks.workunit.client.0.smithi087.stdout:3/62: truncate d4/f6 1372969 0 2024-05-08T05:32:00.240 INFO:tasks.workunit.client.0.smithi087.stdout:1/32: mknod c9 0 2024-05-08T05:32:00.243 INFO:tasks.workunit.client.0.smithi087.stdout:1/33: creat fa x:0 0 0 2024-05-08T05:32:00.246 INFO:tasks.workunit.client.0.smithi087.stdout:7/47: dread d2/f4 [0,4194304] 0 2024-05-08T05:32:00.247 INFO:tasks.workunit.client.0.smithi087.stdout:6/41: dread d4/d6/f9 [4194304,4194304] 0 2024-05-08T05:32:00.250 INFO:tasks.workunit.client.0.smithi087.stdout:6/42: mknod d4/d6/ce 0 2024-05-08T05:32:00.250 INFO:tasks.workunit.client.0.smithi087.stdout:6/43: chown f1 0 1 2024-05-08T05:32:00.250 INFO:tasks.workunit.client.0.smithi087.stdout:6/44: fsync d4/d6/fc 0 2024-05-08T05:32:00.253 INFO:tasks.workunit.client.0.smithi087.stdout:2/55: write f3 [259916,66910] 0 2024-05-08T05:32:00.256 INFO:tasks.workunit.client.0.smithi087.stdout:6/45: mkdir d4/d8/df 0 2024-05-08T05:32:00.256 INFO:tasks.workunit.client.0.smithi087.stdout:6/46: write f1 [2785345,71779] 0 2024-05-08T05:32:00.256 INFO:tasks.workunit.client.0.smithi087.stdout:6/47: fdatasync d4/d8/fb 0 2024-05-08T05:32:00.266 INFO:tasks.workunit.client.0.smithi087.stdout:1/34: fsync fa 0 2024-05-08T05:32:00.266 INFO:tasks.workunit.client.0.smithi087.stdout:3/63: dread d4/f5 [0,4194304] 0 2024-05-08T05:32:00.268 INFO:tasks.workunit.client.0.smithi087.stdout:3/64: rename d4/c13 to d4/c17 0 2024-05-08T05:32:00.268 INFO:tasks.workunit.client.0.smithi087.stdout:3/65: chown d4/l10 1 1 2024-05-08T05:32:00.270 INFO:tasks.workunit.client.0.smithi087.stdout:3/66: symlink d4/d11/l18 0 2024-05-08T05:32:00.272 INFO:tasks.workunit.client.0.smithi087.stdout:3/67: creat d4/d11/f19 x:0 0 0 2024-05-08T05:32:00.272 INFO:tasks.workunit.client.0.smithi087.stdout:3/68: chown d4/l8 1463 1 2024-05-08T05:32:00.273 INFO:tasks.workunit.client.0.smithi087.stdout:3/69: link d4/fb d4/d14/f1a 0 2024-05-08T05:32:00.277 INFO:tasks.workunit.client.0.smithi087.stdout:3/70: creat d4/d11/f1b x:0 0 0 2024-05-08T05:32:00.279 INFO:tasks.workunit.client.0.smithi087.stdout:0/26: dwrite d0/f2 [4194304,4194304] 0 2024-05-08T05:32:00.280 INFO:tasks.workunit.client.0.smithi087.stdout:0/27: chown d0/c6 3486 1 2024-05-08T05:32:00.281 INFO:tasks.workunit.client.0.smithi087.stdout:1/35: dread f3 [0,4194304] 0 2024-05-08T05:32:00.281 INFO:tasks.workunit.client.0.smithi087.stdout:1/36: rmdir - no directory 2024-05-08T05:32:00.281 INFO:tasks.workunit.client.0.smithi087.stdout:1/37: write f3 [4789,16959] 0 2024-05-08T05:32:00.281 INFO:tasks.workunit.client.0.smithi087.stdout:1/38: chown fa 0 1 2024-05-08T05:32:00.288 INFO:tasks.workunit.client.0.smithi087.stdout:5/29: dwrite f2 [0,4194304] 0 2024-05-08T05:32:00.299 INFO:tasks.workunit.client.0.smithi087.stdout:3/71: read f2 [2278289,6492] 0 2024-05-08T05:32:00.300 INFO:tasks.workunit.client.0.smithi087.stdout:3/72: truncate d4/f5 1102730 0 2024-05-08T05:32:00.300 INFO:tasks.workunit.client.0.smithi087.stdout:3/73: dread - d4/d11/f19 zero size 2024-05-08T05:32:00.304 INFO:tasks.workunit.client.0.smithi087.stdout:0/28: dread d0/f2 [0,4194304] 0 2024-05-08T05:32:00.304 INFO:tasks.workunit.client.0.smithi087.stdout:0/29: rename d0 to d0/d7 22 2024-05-08T05:32:00.318 INFO:tasks.workunit.client.0.smithi087.stdout:8/45: dwrite db/f11 [0,4194304] 0 2024-05-08T05:32:00.320 INFO:tasks.workunit.client.0.smithi087.stdout:8/46: creat db/f12 x:0 0 0 2024-05-08T05:32:00.322 INFO:tasks.workunit.client.0.smithi087.stdout:8/47: creat db/f13 x:0 0 0 2024-05-08T05:32:00.324 INFO:tasks.workunit.client.0.smithi087.stdout:8/48: mkdir db/d14 0 2024-05-08T05:32:00.325 INFO:tasks.workunit.client.0.smithi087.stdout:8/49: mkdir db/d14/d15 0 2024-05-08T05:32:00.325 INFO:tasks.workunit.client.0.smithi087.stdout:8/50: dread - fa zero size 2024-05-08T05:32:00.326 INFO:tasks.workunit.client.0.smithi087.stdout:8/51: mknod db/c16 0 2024-05-08T05:32:00.326 INFO:tasks.workunit.client.0.smithi087.stdout:8/52: truncate db/f11 4279709 0 2024-05-08T05:32:00.326 INFO:tasks.workunit.client.0.smithi087.stdout:8/53: truncate f5 839813 0 2024-05-08T05:32:00.327 INFO:tasks.workunit.client.0.smithi087.stdout:8/54: mknod db/d14/d15/c17 0 2024-05-08T05:32:00.328 INFO:tasks.workunit.client.0.smithi087.stdout:7/48: dwrite d2/d6/f7 [4194304,4194304] 0 2024-05-08T05:32:00.328 INFO:tasks.workunit.client.0.smithi087.stdout:7/49: truncate d2/f4 8422430 0 2024-05-08T05:32:00.328 INFO:tasks.workunit.client.0.smithi087.stdout:7/50: stat d2/f5 0 2024-05-08T05:32:00.329 INFO:tasks.workunit.client.0.smithi087.stdout:8/55: rmdir db/d14 39 2024-05-08T05:32:00.329 INFO:tasks.workunit.client.0.smithi087.stdout:8/56: write f9 [747407,64560] 0 2024-05-08T05:32:00.330 INFO:tasks.workunit.client.0.smithi087.stdout:7/51: mkdir d2/da/df 0 2024-05-08T05:32:00.331 INFO:tasks.workunit.client.0.smithi087.stdout:8/57: symlink db/d14/l18 0 2024-05-08T05:32:00.331 INFO:tasks.workunit.client.0.smithi087.stdout:8/58: read - db/f12 zero size 2024-05-08T05:32:00.333 INFO:tasks.workunit.client.0.smithi087.stdout:8/59: fsync db/f13 0 2024-05-08T05:32:00.333 INFO:tasks.workunit.client.0.smithi087.stdout:8/60: stat fa 0 2024-05-08T05:32:00.333 INFO:tasks.workunit.client.0.smithi087.stdout:8/61: readlink db/d14/l18 0 2024-05-08T05:32:00.333 INFO:tasks.workunit.client.0.smithi087.stdout:0/30: dread d0/f2 [0,4194304] 0 2024-05-08T05:32:00.334 INFO:tasks.workunit.client.0.smithi087.stdout:0/31: chown d0/c6 69168015 1 2024-05-08T05:32:00.337 INFO:tasks.workunit.client.0.smithi087.stdout:8/62: unlink db/f13 0 2024-05-08T05:32:00.338 INFO:tasks.workunit.client.0.smithi087.stdout:0/32: creat d0/f8 x:0 0 0 2024-05-08T05:32:00.339 INFO:tasks.workunit.client.0.smithi087.stdout:7/52: truncate d2/f4 1787112 0 2024-05-08T05:32:00.340 INFO:tasks.workunit.client.0.smithi087.stdout:8/63: getdents db/d14/d15 0 2024-05-08T05:32:00.341 INFO:tasks.workunit.client.0.smithi087.stdout:0/33: mkdir d0/d9 0 2024-05-08T05:32:00.344 INFO:tasks.workunit.client.0.smithi087.stdout:7/53: creat d2/da/df/f10 x:0 0 0 2024-05-08T05:32:00.345 INFO:tasks.workunit.client.0.smithi087.stdout:7/54: fdatasync d2/d6/fb 0 2024-05-08T05:32:00.345 INFO:tasks.workunit.client.0.smithi087.stdout:0/34: mkdir d0/da 0 2024-05-08T05:32:00.346 INFO:tasks.workunit.client.0.smithi087.stdout:7/55: unlink d2/d6/l9 0 2024-05-08T05:32:00.346 INFO:tasks.workunit.client.0.smithi087.stdout:7/56: chown d2/da 1 1 2024-05-08T05:32:00.346 INFO:tasks.workunit.client.0.smithi087.stdout:7/57: stat d2/d6/fb 0 2024-05-08T05:32:00.346 INFO:tasks.workunit.client.0.smithi087.stdout:7/58: dread - d2/d6/fb zero size 2024-05-08T05:32:00.347 INFO:tasks.workunit.client.0.smithi087.stdout:7/59: truncate d2/d6/f7 970947 0 2024-05-08T05:32:00.347 INFO:tasks.workunit.client.0.smithi087.stdout:7/60: chown d2/d6/fe 11440811 1 2024-05-08T05:32:00.348 INFO:tasks.workunit.client.0.smithi087.stdout:7/61: dread - d2/d6/fb zero size 2024-05-08T05:32:00.349 INFO:tasks.workunit.client.0.smithi087.stdout:7/62: rename d2/f5 to d2/da/f11 0 2024-05-08T05:32:00.352 INFO:tasks.workunit.client.0.smithi087.stdout:7/63: mkdir d2/d6/d12 0 2024-05-08T05:32:00.354 INFO:tasks.workunit.client.0.smithi087.stdout:7/64: creat d2/da/df/f13 x:0 0 0 2024-05-08T05:32:00.355 INFO:tasks.workunit.client.0.smithi087.stdout:7/65: mknod d2/d6/c14 0 2024-05-08T05:32:00.367 INFO:tasks.workunit.client.0.smithi087.stdout:3/74: dread d4/f5 [0,4194304] 0 2024-05-08T05:32:00.374 INFO:tasks.workunit.client.0.smithi087.stdout:3/75: truncate f2 590597 0 2024-05-08T05:32:00.375 INFO:tasks.workunit.client.0.smithi087.stdout:1/39: dwrite fa [0,4194304] 0 2024-05-08T05:32:00.376 INFO:tasks.workunit.client.0.smithi087.stdout:3/76: symlink d4/l1c 0 2024-05-08T05:32:00.380 INFO:tasks.workunit.client.0.smithi087.stdout:1/40: creat fb x:0 0 0 2024-05-08T05:32:00.380 INFO:tasks.workunit.client.0.smithi087.stdout:3/77: creat d4/f1d x:0 0 0 2024-05-08T05:32:00.380 INFO:tasks.workunit.client.0.smithi087.stdout:3/78: rmdir d4 39 2024-05-08T05:32:00.380 INFO:tasks.workunit.client.0.smithi087.stdout:3/79: creat d4/f1e x:0 0 0 2024-05-08T05:32:00.384 INFO:tasks.workunit.client.0.smithi087.stdout:4/34: dwrite d4/f8 [0,4194304] 0 2024-05-08T05:32:00.390 INFO:tasks.workunit.client.0.smithi087.stdout:8/64: dwrite fa [0,4194304] 0 2024-05-08T05:32:00.395 INFO:tasks.workunit.client.0.smithi087.stdout:8/65: creat db/d14/d15/f19 x:0 0 0 2024-05-08T05:32:00.403 INFO:tasks.workunit.client.0.smithi087.stdout:4/35: dread f1 [0,4194304] 0 2024-05-08T05:32:00.404 INFO:tasks.workunit.client.0.smithi087.stdout:6/48: dwrite d4/fd [8388608,4194304] 0 2024-05-08T05:32:00.405 INFO:tasks.workunit.client.0.smithi087.stdout:4/36: rmdir d4 39 2024-05-08T05:32:00.406 INFO:tasks.workunit.client.0.smithi087.stdout:6/49: creat d4/d8/df/f10 x:0 0 0 2024-05-08T05:32:00.411 INFO:tasks.workunit.client.0.smithi087.stdout:5/30: dwrite f7 [0,4194304] 0 2024-05-08T05:32:00.414 INFO:tasks.workunit.client.0.smithi087.stdout:0/35: dwrite d0/f8 [0,4194304] 0 2024-05-08T05:32:00.423 INFO:tasks.workunit.client.0.smithi087.stdout:0/36: truncate d0/f2 4535000 0 2024-05-08T05:32:00.425 INFO:tasks.workunit.client.0.smithi087.stdout:0/37: creat d0/d9/fb x:0 0 0 2024-05-08T05:32:00.425 INFO:tasks.workunit.client.0.smithi087.stdout:0/38: rename d0/d9 to d0/d9/dc 22 2024-05-08T05:32:00.427 INFO:tasks.workunit.client.0.smithi087.stdout:0/39: creat d0/d9/fd x:0 0 0 2024-05-08T05:32:00.427 INFO:tasks.workunit.client.0.smithi087.stdout:0/40: fsync d0/f8 0 2024-05-08T05:32:00.444 INFO:tasks.workunit.client.0.smithi087.stdout:2/56: dwrite d7/fd [0,4194304] 0 2024-05-08T05:32:00.444 INFO:tasks.workunit.client.0.smithi087.stdout:2/57: write d7/f8 [2771424,73604] 0 2024-05-08T05:32:00.444 INFO:tasks.workunit.client.0.smithi087.stdout:1/41: dwrite fb [0,4194304] 0 2024-05-08T05:32:00.460 INFO:tasks.workunit.client.0.smithi087.stdout:4/37: read d4/f8 [684498,45194] 0 2024-05-08T05:32:00.466 INFO:tasks.workunit.client.0.smithi087.stdout:8/66: dwrite db/f12 [0,4194304] 0 2024-05-08T05:32:00.466 INFO:tasks.workunit.client.0.smithi087.stdout:5/31: dwrite f2 [0,4194304] 0 2024-05-08T05:32:00.466 INFO:tasks.workunit.client.0.smithi087.stdout:5/32: readlink - no filename 2024-05-08T05:32:00.467 INFO:tasks.workunit.client.0.smithi087.stdout:6/50: dwrite d4/f7 [8388608,4194304] 0 2024-05-08T05:32:00.476 INFO:tasks.workunit.client.0.smithi087.stdout:0/41: dwrite d0/f2 [0,4194304] 0 2024-05-08T05:32:00.538 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:32:00 smithi160 ceph-mon[34827]: pgmap v510: 97 pgs: 97 active+clean; 119 MiB data, 818 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 7.4 MiB/s wr, 594 op/s 2024-05-08T05:32:00.572 INFO:tasks.workunit.client.0.smithi087.stdout:9/44: creat d1/fa x:0 0 0 2024-05-08T05:32:00.575 INFO:tasks.workunit.client.0.smithi087.stdout:2/58: mkdir d7/de/d12 0 2024-05-08T05:32:00.576 INFO:tasks.workunit.client.0.smithi087.stdout:1/42: mknod cc 0 2024-05-08T05:32:00.578 INFO:tasks.workunit.client.0.smithi087.stdout:4/38: mknod d4/cd 0 2024-05-08T05:32:00.582 INFO:tasks.workunit.client.0.smithi087.stdout:8/67: mknod db/d14/c1a 0 2024-05-08T05:32:00.582 INFO:tasks.workunit.client.0.smithi087.stdout:5/33: mkdir da 0 2024-05-08T05:32:00.582 INFO:tasks.workunit.client.0.smithi087.stdout:5/34: readlink - no filename 2024-05-08T05:32:00.583 INFO:tasks.workunit.client.0.smithi087.stdout:6/51: creat d4/f11 x:0 0 0 2024-05-08T05:32:00.585 INFO:tasks.workunit.client.0.smithi087.stdout:0/42: truncate d0/f8 1145561 0 2024-05-08T05:32:00.592 INFO:tasks.workunit.client.0.smithi087.stdout:2/59: creat d7/de/f13 x:0 0 0 2024-05-08T05:32:00.594 INFO:tasks.workunit.client.0.smithi087.stdout:1/43: rename cc to cd 0 2024-05-08T05:32:00.595 INFO:tasks.workunit.client.0.smithi087.stdout:4/39: creat d4/fe x:0 0 0 2024-05-08T05:32:00.595 INFO:tasks.workunit.client.0.smithi087.stdout:4/40: chown d4/fe 6325199 1 2024-05-08T05:32:00.595 INFO:tasks.workunit.client.0.smithi087.stdout:8/68: mkdir db/d14/d1b 0 2024-05-08T05:32:00.596 INFO:tasks.workunit.client.0.smithi087.stdout:5/35: mkdir da/db 0 2024-05-08T05:32:00.597 INFO:tasks.workunit.client.0.smithi087.stdout:6/52: creat d4/f12 x:0 0 0 2024-05-08T05:32:00.609 INFO:tasks.workunit.client.0.smithi087.stdout:9/45: mkdir d1/db 0 2024-05-08T05:32:00.615 INFO:tasks.workunit.client.0.smithi087.stdout:5/36: mknod da/cc 0 2024-05-08T05:32:00.615 INFO:tasks.workunit.client.0.smithi087.stdout:8/69: creat db/f1c x:0 0 0 2024-05-08T05:32:00.616 INFO:tasks.workunit.client.0.smithi087.stdout:9/46: creat d1/db/fc x:0 0 0 2024-05-08T05:32:00.616 INFO:tasks.workunit.client.0.smithi087.stdout:4/41: getdents d4 0 2024-05-08T05:32:00.617 INFO:tasks.workunit.client.0.smithi087.stdout:5/37: write f7 [5111612,51276] 0 2024-05-08T05:32:00.621 INFO:tasks.workunit.client.0.smithi087.stdout:1/44: dread fb [0,4194304] 0 2024-05-08T05:32:00.622 INFO:tasks.workunit.client.0.smithi087.stdout:8/70: link f9 db/d14/d15/f1d 0 2024-05-08T05:32:00.622 INFO:tasks.workunit.client.0.smithi087.stdout:8/71: readlink db/ld 0 2024-05-08T05:32:00.622 INFO:tasks.workunit.client.0.smithi087.stdout:8/72: chown f6 693047910 1 2024-05-08T05:32:00.622 INFO:tasks.workunit.client.0.smithi087.stdout:9/47: creat d1/fd x:0 0 0 2024-05-08T05:32:00.623 INFO:tasks.workunit.client.0.smithi087.stdout:4/42: symlink d4/lf 0 2024-05-08T05:32:00.624 INFO:tasks.workunit.client.0.smithi087.stdout:5/38: rmdir da 39 2024-05-08T05:32:00.624 INFO:tasks.workunit.client.0.smithi087.stdout:9/48: truncate d1/f7 632708 0 2024-05-08T05:32:00.625 INFO:tasks.workunit.client.0.smithi087.stdout:8/73: creat db/d14/d15/f1e x:0 0 0 2024-05-08T05:32:00.628 INFO:tasks.workunit.client.0.smithi087.stdout:5/39: mkdir da/dd 0 2024-05-08T05:32:00.629 INFO:tasks.workunit.client.0.smithi087.stdout:5/40: write f9 [4666548,64011] 0 2024-05-08T05:32:00.629 INFO:tasks.workunit.client.0.smithi087.stdout:9/49: symlink d1/db/le 0 2024-05-08T05:32:00.630 INFO:tasks.workunit.client.0.smithi087.stdout:4/43: creat d4/f10 x:0 0 0 2024-05-08T05:32:00.631 INFO:tasks.workunit.client.0.smithi087.stdout:8/74: creat db/f1f x:0 0 0 2024-05-08T05:32:00.633 INFO:tasks.workunit.client.0.smithi087.stdout:5/41: mknod da/db/ce 0 2024-05-08T05:32:00.634 INFO:tasks.workunit.client.0.smithi087.stdout:4/44: rename d4/la to d4/l11 0 2024-05-08T05:32:00.635 INFO:tasks.workunit.client.0.smithi087.stdout:4/45: truncate d4/f10 1012045 0 2024-05-08T05:32:00.636 INFO:tasks.workunit.client.0.smithi087.stdout:8/75: mknod db/d14/d15/c20 0 2024-05-08T05:32:00.636 INFO:tasks.workunit.client.0.smithi087.stdout:5/42: mknod da/cf 0 2024-05-08T05:32:00.637 INFO:tasks.workunit.client.0.smithi087.stdout:4/46: mknod d4/c12 0 2024-05-08T05:32:00.638 INFO:tasks.workunit.client.0.smithi087.stdout:8/76: creat db/d14/d15/f21 x:0 0 0 2024-05-08T05:32:00.640 INFO:tasks.workunit.client.0.smithi087.stdout:5/43: mkdir da/dd/d10 0 2024-05-08T05:32:00.640 INFO:tasks.workunit.client.0.smithi087.stdout:5/44: chown da/dd 114 1 2024-05-08T05:32:00.641 INFO:tasks.workunit.client.0.smithi087.stdout:4/47: mkdir d4/d13 0 2024-05-08T05:32:00.641 INFO:tasks.workunit.client.0.smithi087.stdout:4/48: truncate d4/fe 249494 0 2024-05-08T05:32:00.643 INFO:tasks.workunit.client.0.smithi087.stdout:9/50: fsync d1/fd 0 2024-05-08T05:32:00.643 INFO:tasks.workunit.client.0.smithi087.stdout:9/51: stat d1/fd 0 2024-05-08T05:32:00.647 INFO:tasks.workunit.client.0.smithi087.stdout:1/45: write fa [3015662,109016] 0 2024-05-08T05:32:00.648 INFO:tasks.workunit.client.0.smithi087.stdout:4/49: dread d4/f10 [0,4194304] 0 2024-05-08T05:32:00.648 INFO:tasks.workunit.client.0.smithi087.stdout:9/52: mkdir d1/df 0 2024-05-08T05:32:00.648 INFO:tasks.workunit.client.0.smithi087.stdout:9/53: write d1/fa [895190,60922] 0 2024-05-08T05:32:00.648 INFO:tasks.workunit.client.0.smithi087.stdout:9/54: chown d1/fa 298965 1 2024-05-08T05:32:00.649 INFO:tasks.workunit.client.0.smithi087.stdout:4/50: read d4/fe [40861,85040] 0 2024-05-08T05:32:00.650 INFO:tasks.workunit.client.0.smithi087.stdout:1/46: unlink cd 0 2024-05-08T05:32:00.651 INFO:tasks.workunit.client.0.smithi087.stdout:9/55: creat d1/db/f10 x:0 0 0 2024-05-08T05:32:00.652 INFO:tasks.workunit.client.0.smithi087.stdout:4/51: rename d4/f8 to d4/f14 0 2024-05-08T05:32:00.652 INFO:tasks.workunit.client.0.smithi087.stdout:4/52: stat d4/f9 0 2024-05-08T05:32:00.653 INFO:tasks.workunit.client.0.smithi087.stdout:1/47: mknod ce 0 2024-05-08T05:32:00.653 INFO:tasks.workunit.client.0.smithi087.stdout:1/48: stat l7 0 2024-05-08T05:32:00.653 INFO:tasks.workunit.client.0.smithi087.stdout:1/49: rmdir - no directory 2024-05-08T05:32:00.653 INFO:tasks.workunit.client.0.smithi087.stdout:6/53: dwrite d4/f7 [4194304,4194304] 0 2024-05-08T05:32:00.657 INFO:tasks.workunit.client.0.smithi087.stdout:4/53: symlink d4/l15 0 2024-05-08T05:32:00.657 INFO:tasks.workunit.client.0.smithi087.stdout:1/50: mkdir df 0 2024-05-08T05:32:00.658 INFO:tasks.workunit.client.0.smithi087.stdout:6/54: unlink d4/f11 0 2024-05-08T05:32:00.659 INFO:tasks.workunit.client.0.smithi087.stdout:2/60: dwrite d7/de/f13 [0,4194304] 0 2024-05-08T05:32:00.659 INFO:tasks.workunit.client.0.smithi087.stdout:8/77: write db/f11 [292573,113486] 0 2024-05-08T05:32:00.659 INFO:tasks.workunit.client.0.smithi087.stdout:1/51: link c6 df/c10 0 2024-05-08T05:32:00.662 INFO:tasks.workunit.client.0.smithi087.stdout:2/61: rename d7/de/d12 to d7/d14 0 2024-05-08T05:32:00.662 INFO:tasks.workunit.client.0.smithi087.stdout:4/54: read f1 [1285984,57241] 0 2024-05-08T05:32:00.664 INFO:tasks.workunit.client.0.smithi087.stdout:5/45: dread f7 [4194304,4194304] 0 2024-05-08T05:32:00.667 INFO:tasks.workunit.client.0.smithi087.stdout:5/46: write f9 [5714479,96989] 0 2024-05-08T05:32:00.668 INFO:tasks.workunit.client.0.smithi087.stdout:0/43: dwrite d0/d9/fd [0,4194304] 0 2024-05-08T05:32:00.668 INFO:tasks.workunit.client.0.smithi087.stdout:1/52: creat df/f11 x:0 0 0 2024-05-08T05:32:00.668 INFO:tasks.workunit.client.0.smithi087.stdout:0/44: write d0/f8 [1279164,4180] 0 2024-05-08T05:32:00.682 INFO:tasks.workunit.client.0.smithi087.stdout:6/55: read d4/d8/fb [1512378,69923] 0 2024-05-08T05:32:00.684 INFO:tasks.workunit.client.0.smithi087.stdout:6/56: rename d4/d6/f9 to d4/d6/f13 0 2024-05-08T05:32:00.684 INFO:tasks.workunit.client.0.smithi087.stdout:6/57: rmdir d4 39 2024-05-08T05:32:00.700 INFO:tasks.workunit.client.0.smithi087.stdout:4/55: dread d4/f14 [0,4194304] 0 2024-05-08T05:32:00.702 INFO:tasks.workunit.client.0.smithi087.stdout:8/78: write db/d14/d15/f1d [307074,33042] 0 2024-05-08T05:32:00.708 INFO:tasks.workunit.client.0.smithi087.stdout:9/56: dwrite d1/fa [0,4194304] 0 2024-05-08T05:32:00.708 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:32:00 smithi087 ceph-mon[29523]: pgmap v510: 97 pgs: 97 active+clean; 119 MiB data, 818 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 7.4 MiB/s wr, 594 op/s 2024-05-08T05:32:00.715 INFO:tasks.workunit.client.0.smithi087.stdout:5/47: dwrite f9 [4194304,4194304] 0 2024-05-08T05:32:00.717 INFO:tasks.workunit.client.0.smithi087.stdout:5/48: creat da/dd/f11 x:0 0 0 2024-05-08T05:32:00.717 INFO:tasks.workunit.client.0.smithi087.stdout:8/79: dread db/d14/d15/f1d [0,4194304] 0 2024-05-08T05:32:00.725 INFO:tasks.workunit.client.0.smithi087.stdout:8/80: dread f5 [0,4194304] 0 2024-05-08T05:32:00.730 INFO:tasks.workunit.client.0.smithi087.stdout:8/81: dread f6 [0,4194304] 0 2024-05-08T05:32:00.731 INFO:tasks.workunit.client.0.smithi087.stdout:8/82: symlink db/d14/d1b/l22 0 2024-05-08T05:32:00.733 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:32:00 smithi090 ceph-mon[34526]: pgmap v510: 97 pgs: 97 active+clean; 119 MiB data, 818 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 7.4 MiB/s wr, 594 op/s 2024-05-08T05:32:00.741 INFO:tasks.workunit.client.0.smithi087.stdout:4/56: dwrite d4/fe [0,4194304] 0 2024-05-08T05:32:00.742 INFO:tasks.workunit.client.0.smithi087.stdout:6/58: dwrite d4/d6/fc [4194304,4194304] 0 2024-05-08T05:32:00.743 INFO:tasks.workunit.client.0.smithi087.stdout:6/59: dread - d4/d8/df/f10 zero size 2024-05-08T05:32:00.743 INFO:tasks.workunit.client.0.smithi087.stdout:0/45: dwrite d0/f8 [0,4194304] 0 2024-05-08T05:32:00.747 INFO:tasks.workunit.client.0.smithi087.stdout:6/60: rename d4/f7 to d4/f14 0 2024-05-08T05:32:00.747 INFO:tasks.workunit.client.0.smithi087.stdout:6/61: stat d4/d6/fa 0 2024-05-08T05:32:00.748 INFO:tasks.workunit.client.0.smithi087.stdout:8/83: rename db/d14 to db/d23 0 2024-05-08T05:32:00.750 INFO:tasks.workunit.client.0.smithi087.stdout:0/46: rename d0/f8 to d0/da/fe 0 2024-05-08T05:32:00.750 INFO:tasks.workunit.client.0.smithi087.stdout:6/62: rmdir d4/d8 39 2024-05-08T05:32:00.751 INFO:tasks.workunit.client.0.smithi087.stdout:6/63: fsync d4/d6/fc 0 2024-05-08T05:32:00.751 INFO:tasks.workunit.client.0.smithi087.stdout:0/47: mkdir d0/d9/df 0 2024-05-08T05:32:00.753 INFO:tasks.workunit.client.0.smithi087.stdout:0/48: creat d0/d9/f10 x:0 0 0 2024-05-08T05:32:00.753 INFO:tasks.workunit.client.0.smithi087.stdout:0/49: chown d0/d9/df 874 1 2024-05-08T05:32:00.753 INFO:tasks.workunit.client.0.smithi087.stdout:0/50: readlink - no filename 2024-05-08T05:32:00.753 INFO:tasks.workunit.client.0.smithi087.stdout:0/51: readlink - no filename 2024-05-08T05:32:00.754 INFO:tasks.workunit.client.0.smithi087.stdout:4/57: dread d4/f14 [0,4194304] 0 2024-05-08T05:32:00.754 INFO:tasks.workunit.client.0.smithi087.stdout:4/58: write f1 [1094735,61735] 0 2024-05-08T05:32:00.755 INFO:tasks.workunit.client.0.smithi087.stdout:4/59: unlink d4/lb 0 2024-05-08T05:32:00.756 INFO:tasks.workunit.client.0.smithi087.stdout:7/66: sync 2024-05-08T05:32:00.756 INFO:tasks.workunit.client.0.smithi087.stdout:3/80: sync 2024-05-08T05:32:00.756 INFO:tasks.workunit.client.0.smithi087.stdout:7/67: write d2/d6/fe [259982,43113] 0 2024-05-08T05:32:00.756 INFO:tasks.workunit.client.0.smithi087.stdout:7/68: write d2/da/df/f13 [573493,82041] 0 2024-05-08T05:32:00.758 INFO:tasks.workunit.client.0.smithi087.stdout:3/81: link d4/d11/f19 d4/d14/f1f 0 2024-05-08T05:32:00.763 INFO:tasks.workunit.client.0.smithi087.stdout:5/49: dwrite f9 [4194304,4194304] 0 2024-05-08T05:32:00.763 INFO:tasks.workunit.client.0.smithi087.stdout:5/50: stat da/dd/f11 0 2024-05-08T05:32:00.773 INFO:tasks.workunit.client.0.smithi087.stdout:9/57: dwrite d1/f4 [4194304,4194304] 0 2024-05-08T05:32:00.780 INFO:tasks.workunit.client.0.smithi087.stdout:9/58: symlink d1/l11 0 2024-05-08T05:32:00.780 INFO:tasks.workunit.client.0.smithi087.stdout:3/82: dread d4/d14/f1a [0,4194304] 0 2024-05-08T05:32:00.786 INFO:tasks.workunit.client.0.smithi087.stdout:5/51: read f9 [6505113,63657] 0 2024-05-08T05:32:00.786 INFO:tasks.workunit.client.0.smithi087.stdout:3/83: creat d4/d11/f20 x:0 0 0 2024-05-08T05:32:00.786 INFO:tasks.workunit.client.0.smithi087.stdout:3/84: read d4/f6 [813111,82409] 0 2024-05-08T05:32:00.787 INFO:tasks.workunit.client.0.smithi087.stdout:5/52: mknod da/db/c12 0 2024-05-08T05:32:00.787 INFO:tasks.workunit.client.0.smithi087.stdout:5/53: rmdir da 39 2024-05-08T05:32:00.800 INFO:tasks.workunit.client.0.smithi087.stdout:4/60: dwrite d4/f10 [0,4194304] 0 2024-05-08T05:32:00.800 INFO:tasks.workunit.client.0.smithi087.stdout:9/59: dread d1/fa [0,4194304] 0 2024-05-08T05:32:00.802 INFO:tasks.workunit.client.0.smithi087.stdout:9/60: link d1/fd d1/df/f12 0 2024-05-08T05:32:00.804 INFO:tasks.workunit.client.0.smithi087.stdout:9/61: fdatasync d1/f8 0 2024-05-08T05:32:00.804 INFO:tasks.workunit.client.0.smithi087.stdout:9/62: chown d1/l11 58881 1 2024-05-08T05:32:00.804 INFO:tasks.workunit.client.0.smithi087.stdout:9/63: dread - d1/db/fc zero size 2024-05-08T05:32:00.811 INFO:tasks.workunit.client.0.smithi087.stdout:8/84: dwrite db/f12 [0,4194304] 0 2024-05-08T05:32:00.811 INFO:tasks.workunit.client.0.smithi087.stdout:8/85: fdatasync f8 0 2024-05-08T05:32:00.811 INFO:tasks.workunit.client.0.smithi087.stdout:8/86: write db/f1c [3636,127640] 0 2024-05-08T05:32:00.813 INFO:tasks.workunit.client.0.smithi087.stdout:5/54: dread f7 [0,4194304] 0 2024-05-08T05:32:00.817 INFO:tasks.workunit.client.0.smithi087.stdout:9/64: fsync d1/df/f12 0 2024-05-08T05:32:00.817 INFO:tasks.workunit.client.0.smithi087.stdout:6/64: dwrite d4/d6/fa [0,4194304] 0 2024-05-08T05:32:00.817 INFO:tasks.workunit.client.0.smithi087.stdout:6/65: fsync d4/d6/fa 0 2024-05-08T05:32:00.820 INFO:tasks.workunit.client.0.smithi087.stdout:6/66: symlink d4/d6/l15 0 2024-05-08T05:32:00.820 INFO:tasks.workunit.client.0.smithi087.stdout:8/87: dread f4 [0,4194304] 0 2024-05-08T05:32:00.820 INFO:tasks.workunit.client.0.smithi087.stdout:8/88: fsync db/d23/d15/f1d 0 2024-05-08T05:32:00.824 INFO:tasks.workunit.client.0.smithi087.stdout:6/67: creat d4/f16 x:0 0 0 2024-05-08T05:32:00.824 INFO:tasks.workunit.client.0.smithi087.stdout:6/68: chown d4/d6/l15 21 1 2024-05-08T05:32:00.825 INFO:tasks.workunit.client.0.smithi087.stdout:6/69: mknod d4/d8/c17 0 2024-05-08T05:32:00.826 INFO:tasks.workunit.client.0.smithi087.stdout:9/65: write d1/fa [2937261,15551] 0 2024-05-08T05:32:00.826 INFO:tasks.workunit.client.0.smithi087.stdout:7/69: dwrite d2/f4 [0,4194304] 0 2024-05-08T05:32:00.831 INFO:tasks.workunit.client.0.smithi087.stdout:9/66: link d1/fa d1/f13 0 2024-05-08T05:32:00.833 INFO:tasks.workunit.client.0.smithi087.stdout:2/62: sync 2024-05-08T05:32:00.833 INFO:tasks.workunit.client.0.smithi087.stdout:7/70: dread d2/d6/fe [0,4194304] 0 2024-05-08T05:32:00.838 INFO:tasks.workunit.client.0.smithi087.stdout:2/63: rename d7/de/f10 to d7/de/f15 0 2024-05-08T05:32:00.839 INFO:tasks.workunit.client.0.smithi087.stdout:2/64: write d7/de/f15 [126548,117852] 0 2024-05-08T05:32:00.839 INFO:tasks.workunit.client.0.smithi087.stdout:2/65: chown d7/d14 1465804053 1 2024-05-08T05:32:00.839 INFO:tasks.workunit.client.0.smithi087.stdout:2/66: write d7/de/f15 [798938,94925] 0 2024-05-08T05:32:00.839 INFO:tasks.workunit.client.0.smithi087.stdout:2/67: readlink l0 0 2024-05-08T05:32:00.839 INFO:tasks.workunit.client.0.smithi087.stdout:2/68: fdatasync f5 0 2024-05-08T05:32:00.839 INFO:tasks.workunit.client.0.smithi087.stdout:2/69: chown d7/lc 18 1 2024-05-08T05:32:00.839 INFO:tasks.workunit.client.0.smithi087.stdout:2/70: dread - d7/de/f11 zero size 2024-05-08T05:32:00.843 INFO:tasks.workunit.client.0.smithi087.stdout:3/85: dwrite f2 [0,4194304] 0 2024-05-08T05:32:00.851 INFO:tasks.workunit.client.0.smithi087.stdout:2/71: dread f3 [0,4194304] 0 2024-05-08T05:32:00.857 INFO:tasks.workunit.client.0.smithi087.stdout:3/86: write d4/d14/f1a [3670317,37616] 0 2024-05-08T05:32:00.857 INFO:tasks.workunit.client.0.smithi087.stdout:2/72: unlink d7/de/f11 0 2024-05-08T05:32:00.858 INFO:tasks.workunit.client.0.smithi087.stdout:3/87: truncate d4/f6 549986 0 2024-05-08T05:32:00.859 INFO:tasks.workunit.client.0.smithi087.stdout:2/73: mknod d7/de/c16 0 2024-05-08T05:32:00.860 INFO:tasks.workunit.client.0.smithi087.stdout:2/74: creat d7/f17 x:0 0 0 2024-05-08T05:32:00.862 INFO:tasks.workunit.client.0.smithi087.stdout:4/61: dwrite d4/fe [0,4194304] 0 2024-05-08T05:32:00.866 INFO:tasks.workunit.client.0.smithi087.stdout:4/62: creat d4/d13/f16 x:0 0 0 2024-05-08T05:32:00.868 INFO:tasks.workunit.client.0.smithi087.stdout:6/70: dread d4/fd [8388608,4194304] 0 2024-05-08T05:32:00.868 INFO:tasks.workunit.client.0.smithi087.stdout:6/71: stat d4/d6/l15 0 2024-05-08T05:32:00.868 INFO:tasks.workunit.client.0.smithi087.stdout:8/89: dwrite db/d23/d15/f1d [0,4194304] 0 2024-05-08T05:32:00.868 INFO:tasks.workunit.client.0.smithi087.stdout:8/90: dread - db/d23/d15/f1e zero size 2024-05-08T05:32:00.869 INFO:tasks.workunit.client.0.smithi087.stdout:4/63: rename d4/l6 to d4/l17 0 2024-05-08T05:32:00.872 INFO:tasks.workunit.client.0.smithi087.stdout:8/91: getdents db 0 2024-05-08T05:32:00.873 INFO:tasks.workunit.client.0.smithi087.stdout:4/64: unlink d4/l11 0 2024-05-08T05:32:00.873 INFO:tasks.workunit.client.0.smithi087.stdout:1/53: sync 2024-05-08T05:32:00.873 INFO:tasks.workunit.client.0.smithi087.stdout:0/52: sync 2024-05-08T05:32:00.873 INFO:tasks.workunit.client.0.smithi087.stdout:0/53: chown d0/d9/fb 5572048 1 2024-05-08T05:32:00.875 INFO:tasks.workunit.client.0.smithi087.stdout:2/75: dread d7/f8 [0,4194304] 0 2024-05-08T05:32:00.875 INFO:tasks.workunit.client.0.smithi087.stdout:2/76: dread - d7/f17 zero size 2024-05-08T05:32:00.875 INFO:tasks.workunit.client.0.smithi087.stdout:4/65: mknod d4/c18 0 2024-05-08T05:32:00.879 INFO:tasks.workunit.client.0.smithi087.stdout:1/54: mkdir df/d12 0 2024-05-08T05:32:00.879 INFO:tasks.workunit.client.0.smithi087.stdout:0/54: mkdir d0/da/d11 0 2024-05-08T05:32:00.879 INFO:tasks.workunit.client.0.smithi087.stdout:0/55: truncate d0/d9/fb 344089 0 2024-05-08T05:32:00.879 INFO:tasks.workunit.client.0.smithi087.stdout:0/56: write d0/d9/f10 [310158,34619] 0 2024-05-08T05:32:00.879 INFO:tasks.workunit.client.0.smithi087.stdout:0/57: stat d0/d9/fd 0 2024-05-08T05:32:00.879 INFO:tasks.workunit.client.0.smithi087.stdout:0/58: chown d0/f2 44610378 1 2024-05-08T05:32:00.879 INFO:tasks.workunit.client.0.smithi087.stdout:2/77: unlink d7/l9 0 2024-05-08T05:32:00.879 INFO:tasks.workunit.client.0.smithi087.stdout:2/78: dread - d7/f17 zero size 2024-05-08T05:32:00.886 INFO:tasks.workunit.client.0.smithi087.stdout:6/72: dread d4/fd [0,4194304] 0 2024-05-08T05:32:00.886 INFO:tasks.workunit.client.0.smithi087.stdout:6/73: fdatasync d4/fd 0 2024-05-08T05:32:00.891 INFO:tasks.workunit.client.0.smithi087.stdout:4/66: write d4/f10 [1499424,119349] 0 2024-05-08T05:32:00.891 INFO:tasks.workunit.client.0.smithi087.stdout:0/59: dread d0/d9/f10 [0,4194304] 0 2024-05-08T05:32:00.893 INFO:tasks.workunit.client.0.smithi087.stdout:4/67: mkdir d4/d19 0 2024-05-08T05:32:00.893 INFO:tasks.workunit.client.0.smithi087.stdout:0/60: creat d0/d9/f12 x:0 0 0 2024-05-08T05:32:00.895 INFO:tasks.workunit.client.0.smithi087.stdout:0/61: link d0/d9/fd d0/d9/f13 0 2024-05-08T05:32:00.895 INFO:tasks.workunit.client.0.smithi087.stdout:0/62: dread - d0/d9/f12 zero size 2024-05-08T05:32:00.897 INFO:tasks.workunit.client.0.smithi087.stdout:1/55: dread fa [0,4194304] 0 2024-05-08T05:32:00.897 INFO:tasks.workunit.client.0.smithi087.stdout:0/63: link d0/d9/fd d0/d9/f14 0 2024-05-08T05:32:00.898 INFO:tasks.workunit.client.0.smithi087.stdout:1/56: truncate fa 2856757 0 2024-05-08T05:32:00.899 INFO:tasks.workunit.client.0.smithi087.stdout:1/57: mkdir df/d12/d13 0 2024-05-08T05:32:00.900 INFO:tasks.workunit.client.0.smithi087.stdout:1/58: symlink df/d12/l14 0 2024-05-08T05:32:00.904 INFO:tasks.workunit.client.0.smithi087.stdout:6/74: write f1 [8168199,100246] 0 2024-05-08T05:32:00.904 INFO:tasks.workunit.client.0.smithi087.stdout:6/75: fdatasync d4/d8/df/f10 0 2024-05-08T05:32:00.906 INFO:tasks.workunit.client.0.smithi087.stdout:3/88: dwrite d4/d11/f19 [0,4194304] 0 2024-05-08T05:32:00.910 INFO:tasks.workunit.client.0.smithi087.stdout:3/89: creat d4/f21 x:0 0 0 2024-05-08T05:32:00.911 INFO:tasks.workunit.client.0.smithi087.stdout:4/68: dread d4/f14 [0,4194304] 0 2024-05-08T05:32:00.913 INFO:tasks.workunit.client.0.smithi087.stdout:3/90: mknod d4/c22 0 2024-05-08T05:32:00.914 INFO:tasks.workunit.client.0.smithi087.stdout:8/92: dwrite f9 [4194304,4194304] 0 2024-05-08T05:32:00.918 INFO:tasks.workunit.client.0.smithi087.stdout:4/69: rmdir d4/d19 0 2024-05-08T05:32:00.918 INFO:tasks.workunit.client.0.smithi087.stdout:3/91: rename d4/f1e to d4/d11/f23 0 2024-05-08T05:32:00.918 INFO:tasks.workunit.client.0.smithi087.stdout:3/92: write d4/d14/f1a [4507124,12531] 0 2024-05-08T05:32:00.918 INFO:tasks.workunit.client.0.smithi087.stdout:0/64: dread d0/da/fe [0,4194304] 0 2024-05-08T05:32:00.921 INFO:tasks.workunit.client.0.smithi087.stdout:4/70: rename d4/lc to d4/d13/l1a 0 2024-05-08T05:32:00.921 INFO:tasks.workunit.client.0.smithi087.stdout:0/65: stat d0/c6 0 2024-05-08T05:32:00.922 INFO:tasks.workunit.client.0.smithi087.stdout:4/71: symlink d4/d13/l1b 0 2024-05-08T05:32:00.922 INFO:tasks.workunit.client.0.smithi087.stdout:4/72: read - d4/d13/f16 zero size 2024-05-08T05:32:00.925 INFO:tasks.workunit.client.0.smithi087.stdout:0/66: creat d0/d9/df/f15 x:0 0 0 2024-05-08T05:32:00.928 INFO:tasks.workunit.client.0.smithi087.stdout:0/67: rmdir d0 39 2024-05-08T05:32:00.928 INFO:tasks.workunit.client.0.smithi087.stdout:6/76: write d4/d6/fc [5780127,70576] 0 2024-05-08T05:32:00.931 INFO:tasks.workunit.client.0.smithi087.stdout:3/93: dread d4/d11/f19 [0,4194304] 0 2024-05-08T05:32:00.934 INFO:tasks.workunit.client.0.smithi087.stdout:0/68: creat d0/da/f16 x:0 0 0 2024-05-08T05:32:00.935 INFO:tasks.workunit.client.0.smithi087.stdout:0/69: chown d0/da/f16 2313168 1 2024-05-08T05:32:00.935 INFO:tasks.workunit.client.0.smithi087.stdout:0/70: truncate d0/d9/f12 277400 0 2024-05-08T05:32:00.936 INFO:tasks.workunit.client.0.smithi087.stdout:0/71: mkdir d0/d17 0 2024-05-08T05:32:00.936 INFO:tasks.workunit.client.0.smithi087.stdout:0/72: write d0/d9/df/f15 [318759,53335] 0 2024-05-08T05:32:00.937 INFO:tasks.workunit.client.0.smithi087.stdout:0/73: mknod d0/da/d11/c18 0 2024-05-08T05:32:00.938 INFO:tasks.workunit.client.0.smithi087.stdout:3/94: dread d4/f5 [0,4194304] 0 2024-05-08T05:32:00.938 INFO:tasks.workunit.client.0.smithi087.stdout:3/95: write d4/d11/f20 [173330,10677] 0 2024-05-08T05:32:00.939 INFO:tasks.workunit.client.0.smithi087.stdout:0/74: mknod d0/d9/df/c19 0 2024-05-08T05:32:00.939 INFO:tasks.workunit.client.0.smithi087.stdout:4/73: dread f1 [0,4194304] 0 2024-05-08T05:32:00.940 INFO:tasks.workunit.client.0.smithi087.stdout:0/75: creat d0/d9/f1a x:0 0 0 2024-05-08T05:32:00.941 INFO:tasks.workunit.client.0.smithi087.stdout:0/76: mkdir d0/d9/d1b 0 2024-05-08T05:32:00.945 INFO:tasks.workunit.client.0.smithi087.stdout:6/77: dread d4/d6/f13 [0,4194304] 0 2024-05-08T05:32:00.947 INFO:tasks.workunit.client.0.smithi087.stdout:6/78: rename d4/f14 to d4/d8/f18 0 2024-05-08T05:32:00.947 INFO:tasks.workunit.client.0.smithi087.stdout:6/79: dread - d4/f16 zero size 2024-05-08T05:32:00.962 INFO:tasks.workunit.client.0.smithi087.stdout:1/59: dwrite fa [0,4194304] 0 2024-05-08T05:32:00.975 INFO:tasks.workunit.client.0.smithi087.stdout:1/60: write fb [2013540,110413] 0 2024-05-08T05:32:00.975 INFO:tasks.workunit.client.0.smithi087.stdout:1/61: readlink df/d12/l14 0 2024-05-08T05:32:00.978 INFO:tasks.workunit.client.0.smithi087.stdout:1/62: unlink f3 0 2024-05-08T05:32:00.978 INFO:tasks.workunit.client.0.smithi087.stdout:1/63: dread - df/f11 zero size 2024-05-08T05:32:00.978 INFO:tasks.workunit.client.0.smithi087.stdout:1/64: chown l1 1480 1 2024-05-08T05:32:00.984 INFO:tasks.workunit.client.0.smithi087.stdout:4/74: dwrite f1 [0,4194304] 0 2024-05-08T05:32:00.986 INFO:tasks.workunit.client.0.smithi087.stdout:4/75: mknod d4/c1c 0 2024-05-08T05:32:00.987 INFO:tasks.workunit.client.0.smithi087.stdout:4/76: stat d4/l5 0 2024-05-08T05:32:00.987 INFO:tasks.workunit.client.0.smithi087.stdout:8/93: dwrite db/f11 [0,4194304] 0 2024-05-08T05:32:00.988 INFO:tasks.workunit.client.0.smithi087.stdout:4/77: getdents d4/d13 0 2024-05-08T05:32:00.990 INFO:tasks.workunit.client.0.smithi087.stdout:4/78: link d4/l5 d4/l1d 0 2024-05-08T05:32:00.990 INFO:tasks.workunit.client.0.smithi087.stdout:8/94: rmdir db/d23/d15 39 2024-05-08T05:32:00.993 INFO:tasks.workunit.client.0.smithi087.stdout:8/95: creat db/f24 x:0 0 0 2024-05-08T05:32:00.994 INFO:tasks.workunit.client.0.smithi087.stdout:8/96: creat db/f25 x:0 0 0 2024-05-08T05:32:00.997 INFO:tasks.workunit.client.0.smithi087.stdout:8/97: rename db/f1c to db/d23/d1b/f26 0 2024-05-08T05:32:00.998 INFO:tasks.workunit.client.0.smithi087.stdout:5/55: sync 2024-05-08T05:32:01.000 INFO:tasks.workunit.client.0.smithi087.stdout:8/98: mknod db/d23/d15/c27 0 2024-05-08T05:32:01.000 INFO:tasks.workunit.client.0.smithi087.stdout:8/99: chown db 11055 1 2024-05-08T05:32:01.014 INFO:tasks.workunit.client.0.smithi087.stdout:5/56: mkdir da/dd/d13 0 2024-05-08T05:32:01.015 INFO:tasks.workunit.client.0.smithi087.stdout:8/100: symlink db/d23/d15/l28 0 2024-05-08T05:32:01.015 INFO:tasks.workunit.client.0.smithi087.stdout:8/101: fsync f4 0 2024-05-08T05:32:01.019 INFO:tasks.workunit.client.0.smithi087.stdout:5/57: rename da/cc to da/c14 0 2024-05-08T05:32:01.019 INFO:tasks.workunit.client.0.smithi087.stdout:5/58: chown c8 1192 1 2024-05-08T05:32:01.019 INFO:tasks.workunit.client.0.smithi087.stdout:5/59: read - da/dd/f11 zero size 2024-05-08T05:32:01.019 INFO:tasks.workunit.client.0.smithi087.stdout:5/60: write f2 [5130551,76415] 0 2024-05-08T05:32:01.019 INFO:tasks.workunit.client.0.smithi087.stdout:5/61: dread - da/dd/f11 zero size 2024-05-08T05:32:01.027 INFO:tasks.workunit.client.0.smithi087.stdout:6/80: dwrite d4/f16 [0,4194304] 0 2024-05-08T05:32:01.027 INFO:tasks.workunit.client.0.smithi087.stdout:6/81: chown d4/d6/fa 3273703 1 2024-05-08T05:32:01.027 INFO:tasks.workunit.client.0.smithi087.stdout:6/82: truncate d4/d8/df/f10 67 0 2024-05-08T05:32:01.027 INFO:tasks.workunit.client.0.smithi087.stdout:6/83: fdatasync d4/d8/f18 0 2024-05-08T05:32:01.027 INFO:tasks.workunit.client.0.smithi087.stdout:6/84: stat d4/d8/fb 0 2024-05-08T05:32:01.030 INFO:tasks.workunit.client.0.smithi087.stdout:6/85: symlink d4/l19 0 2024-05-08T05:32:01.031 INFO:tasks.workunit.client.0.smithi087.stdout:6/86: getdents d4/d8 0 2024-05-08T05:32:01.033 INFO:tasks.workunit.client.0.smithi087.stdout:6/87: creat d4/d8/df/f1a x:0 0 0 2024-05-08T05:32:01.045 INFO:tasks.workunit.client.0.smithi087.stdout:6/88: dread d4/d8/df/f10 [0,4194304] 0 2024-05-08T05:32:01.049 INFO:tasks.workunit.client.0.smithi087.stdout:1/65: dwrite df/f11 [0,4194304] 0 2024-05-08T05:32:01.049 INFO:tasks.workunit.client.0.smithi087.stdout:1/66: truncate fb 4866217 0 2024-05-08T05:32:01.049 INFO:tasks.workunit.client.0.smithi087.stdout:1/67: chown df/f11 69738 1 2024-05-08T05:32:01.053 INFO:tasks.workunit.client.0.smithi087.stdout:1/68: rmdir df/d12/d13 0 2024-05-08T05:32:01.053 INFO:tasks.workunit.client.0.smithi087.stdout:1/69: fsync fa 0 2024-05-08T05:32:01.055 INFO:tasks.workunit.client.0.smithi087.stdout:4/79: dwrite d4/f14 [0,4194304] 0 2024-05-08T05:32:01.055 INFO:tasks.workunit.client.0.smithi087.stdout:4/80: truncate d4/f9 657157 0 2024-05-08T05:32:01.057 INFO:tasks.workunit.client.0.smithi087.stdout:4/81: rename d4/l17 to d4/l1e 0 2024-05-08T05:32:01.057 INFO:tasks.workunit.client.0.smithi087.stdout:4/82: write d4/f10 [414322,25307] 0 2024-05-08T05:32:01.058 INFO:tasks.workunit.client.0.smithi087.stdout:4/83: creat d4/f1f x:0 0 0 2024-05-08T05:32:01.062 INFO:tasks.workunit.client.0.smithi087.stdout:8/102: dwrite f5 [0,4194304] 0 2024-05-08T05:32:01.062 INFO:tasks.workunit.client.0.smithi087.stdout:8/103: truncate db/f24 747294 0 2024-05-08T05:32:01.064 INFO:tasks.workunit.client.0.smithi087.stdout:8/104: mkdir db/d23/d15/d29 0 2024-05-08T05:32:01.064 INFO:tasks.workunit.client.0.smithi087.stdout:8/105: chown f5 320 1 2024-05-08T05:32:01.064 INFO:tasks.workunit.client.0.smithi087.stdout:8/106: fsync f3 0 2024-05-08T05:32:01.076 INFO:tasks.workunit.client.0.smithi087.stdout:4/84: write f1 [259760,96073] 0 2024-05-08T05:32:01.077 INFO:tasks.workunit.client.0.smithi087.stdout:4/85: mknod d4/d13/c20 0 2024-05-08T05:32:01.078 INFO:tasks.workunit.client.0.smithi087.stdout:4/86: mknod d4/c21 0 2024-05-08T05:32:01.080 INFO:tasks.workunit.client.0.smithi087.stdout:4/87: creat d4/f22 x:0 0 0 2024-05-08T05:32:01.081 INFO:tasks.workunit.client.0.smithi087.stdout:4/88: creat d4/d13/f23 x:0 0 0 2024-05-08T05:32:01.082 INFO:tasks.workunit.client.0.smithi087.stdout:4/89: rmdir d4/d13 39 2024-05-08T05:32:01.084 INFO:tasks.workunit.client.0.smithi087.stdout:4/90: unlink c0 0 2024-05-08T05:32:01.085 INFO:tasks.workunit.client.0.smithi087.stdout:4/91: symlink d4/l24 0 2024-05-08T05:32:01.085 INFO:tasks.workunit.client.0.smithi087.stdout:4/92: readlink d4/d13/l1b 0 2024-05-08T05:32:01.086 INFO:tasks.workunit.client.0.smithi087.stdout:4/93: mkdir d4/d25 0 2024-05-08T05:32:01.087 INFO:tasks.workunit.client.0.smithi087.stdout:4/94: rmdir d4/d13 39 2024-05-08T05:32:01.090 INFO:tasks.workunit.client.0.smithi087.stdout:5/62: dwrite da/dd/f11 [0,4194304] 0 2024-05-08T05:32:01.091 INFO:tasks.workunit.client.0.smithi087.stdout:6/89: dread d4/d6/f13 [0,4194304] 0 2024-05-08T05:32:01.091 INFO:tasks.workunit.client.0.smithi087.stdout:5/63: readlink - no filename 2024-05-08T05:32:01.101 INFO:tasks.workunit.client.0.smithi087.stdout:6/90: creat d4/d6/f1b x:0 0 0 2024-05-08T05:32:01.111 INFO:tasks.workunit.client.0.smithi087.stdout:8/107: dread f3 [0,4194304] 0 2024-05-08T05:32:01.111 INFO:tasks.workunit.client.0.smithi087.stdout:8/108: read f4 [143778,92813] 0 2024-05-08T05:32:01.114 INFO:tasks.workunit.client.0.smithi087.stdout:5/64: dread da/dd/f11 [0,4194304] 0 2024-05-08T05:32:01.115 INFO:tasks.workunit.client.0.smithi087.stdout:6/91: creat d4/d8/f1c x:0 0 0 2024-05-08T05:32:01.115 INFO:tasks.workunit.client.0.smithi087.stdout:6/92: fdatasync d4/d6/f13 0 2024-05-08T05:32:01.115 INFO:tasks.workunit.client.0.smithi087.stdout:1/70: dwrite fa [0,4194304] 0 2024-05-08T05:32:01.118 INFO:tasks.workunit.client.0.smithi087.stdout:6/93: unlink d4/d8/f1c 0 2024-05-08T05:32:01.119 INFO:tasks.workunit.client.0.smithi087.stdout:2/79: sync 2024-05-08T05:32:01.119 INFO:tasks.workunit.client.0.smithi087.stdout:9/67: sync 2024-05-08T05:32:01.119 INFO:tasks.workunit.client.0.smithi087.stdout:9/68: stat d1/db/fc 0 2024-05-08T05:32:01.119 INFO:tasks.workunit.client.0.smithi087.stdout:2/80: write d7/f17 [218305,98948] 0 2024-05-08T05:32:01.119 INFO:tasks.workunit.client.0.smithi087.stdout:1/71: mknod df/d12/c15 0 2024-05-08T05:32:01.119 INFO:tasks.workunit.client.0.smithi087.stdout:1/72: chown df 4992486 1 2024-05-08T05:32:01.119 INFO:tasks.workunit.client.0.smithi087.stdout:7/71: sync 2024-05-08T05:32:01.119 INFO:tasks.workunit.client.0.smithi087.stdout:9/69: mkdir d1/df/d14 0 2024-05-08T05:32:01.120 INFO:tasks.workunit.client.0.smithi087.stdout:0/77: sync 2024-05-08T05:32:01.120 INFO:tasks.workunit.client.0.smithi087.stdout:3/96: sync 2024-05-08T05:32:01.120 INFO:tasks.workunit.client.0.smithi087.stdout:3/97: chown d4/d14/f1a 158042434 1 2024-05-08T05:32:01.121 INFO:tasks.workunit.client.0.smithi087.stdout:3/98: readlink l1 0 2024-05-08T05:32:01.121 INFO:tasks.workunit.client.0.smithi087.stdout:1/73: rename ce to df/c16 0 2024-05-08T05:32:01.122 INFO:tasks.workunit.client.0.smithi087.stdout:9/70: creat d1/f15 x:0 0 0 2024-05-08T05:32:01.134 INFO:tasks.workunit.client.0.smithi087.stdout:4/95: dwrite d4/f22 [0,4194304] 0 2024-05-08T05:32:01.139 INFO:tasks.workunit.client.0.smithi087.stdout:7/72: mkdir d2/d6/d12/d15 0 2024-05-08T05:32:01.139 INFO:tasks.workunit.client.0.smithi087.stdout:7/73: dread - d2/da/df/f10 zero size 2024-05-08T05:32:01.139 INFO:tasks.workunit.client.0.smithi087.stdout:1/74: rename c2 to df/c17 0 2024-05-08T05:32:01.139 INFO:tasks.workunit.client.0.smithi087.stdout:7/74: fsync d2/d6/fb 0 2024-05-08T05:32:01.139 INFO:tasks.workunit.client.0.smithi087.stdout:0/78: truncate d0/d9/f14 1036759 0 2024-05-08T05:32:01.139 INFO:tasks.workunit.client.0.smithi087.stdout:3/99: mkdir d4/d11/d24 0 2024-05-08T05:32:01.139 INFO:tasks.workunit.client.0.smithi087.stdout:3/100: write d4/fb [1868543,123264] 0 2024-05-08T05:32:01.139 INFO:tasks.workunit.client.0.smithi087.stdout:4/96: rename d4/f14 to d4/d13/f26 0 2024-05-08T05:32:01.140 INFO:tasks.workunit.client.0.smithi087.stdout:2/81: dread d7/f8 [0,4194304] 0 2024-05-08T05:32:01.140 INFO:tasks.workunit.client.0.smithi087.stdout:2/82: stat d7/cb 0 2024-05-08T05:32:01.158 INFO:tasks.workunit.client.0.smithi087.stdout:0/79: rename d0/c6 to d0/da/d11/c1c 0 2024-05-08T05:32:01.159 INFO:tasks.workunit.client.0.smithi087.stdout:3/101: mkdir d4/d11/d24/d25 0 2024-05-08T05:32:01.159 INFO:tasks.workunit.client.0.smithi087.stdout:4/97: truncate d4/fe 2528422 0 2024-05-08T05:32:01.159 INFO:tasks.workunit.client.0.smithi087.stdout:4/98: chown d4/d13/f16 1069 1 2024-05-08T05:32:01.159 INFO:tasks.workunit.client.0.smithi087.stdout:4/99: readlink d4/l24 0 2024-05-08T05:32:01.160 INFO:tasks.workunit.client.0.smithi087.stdout:0/80: mknod d0/d9/d1b/c1d 0 2024-05-08T05:32:01.160 INFO:tasks.workunit.client.0.smithi087.stdout:5/65: dread f2 [0,4194304] 0 2024-05-08T05:32:01.164 INFO:tasks.workunit.client.0.smithi087.stdout:3/102: creat d4/d11/d24/f26 x:0 0 0 2024-05-08T05:32:01.164 INFO:tasks.workunit.client.0.smithi087.stdout:0/81: creat d0/da/f1e x:0 0 0 2024-05-08T05:32:01.164 INFO:tasks.workunit.client.0.smithi087.stdout:0/82: readlink - no filename 2024-05-08T05:32:01.178 INFO:tasks.workunit.client.0.smithi087.stdout:4/100: write d4/f22 [1932234,112204] 0 2024-05-08T05:32:01.179 INFO:tasks.workunit.client.0.smithi087.stdout:8/109: dwrite f3 [4194304,4194304] 0 2024-05-08T05:32:01.181 INFO:tasks.workunit.client.0.smithi087.stdout:9/71: dread d1/f8 [0,4194304] 0 2024-05-08T05:32:01.187 INFO:tasks.workunit.client.0.smithi087.stdout:0/83: read d0/da/fe [2408667,78713] 0 2024-05-08T05:32:01.190 INFO:tasks.workunit.client.0.smithi087.stdout:8/110: getdents db/d23/d1b 0 2024-05-08T05:32:01.192 INFO:tasks.workunit.client.0.smithi087.stdout:0/84: mknod d0/da/d11/c1f 0 2024-05-08T05:32:01.192 INFO:tasks.workunit.client.0.smithi087.stdout:0/85: write d0/d9/f12 [804207,38453] 0 2024-05-08T05:32:01.192 INFO:tasks.workunit.client.0.smithi087.stdout:0/86: truncate d0/d9/f1a 880854 0 2024-05-08T05:32:01.196 INFO:tasks.workunit.client.0.smithi087.stdout:5/66: dread f7 [0,4194304] 0 2024-05-08T05:32:01.200 INFO:tasks.workunit.client.0.smithi087.stdout:2/83: dwrite f6 [0,4194304] 0 2024-05-08T05:32:01.231 INFO:tasks.workunit.client.0.smithi087.stdout:3/103: dwrite d4/fb [0,4194304] 0 2024-05-08T05:32:01.231 INFO:tasks.workunit.client.0.smithi087.stdout:3/104: fsync d4/f1d 0 2024-05-08T05:32:01.231 INFO:tasks.workunit.client.0.smithi087.stdout:3/105: write d4/d11/f20 [416477,67514] 0 2024-05-08T05:32:01.232 INFO:tasks.workunit.client.0.smithi087.stdout:5/67: mknod da/dd/d13/c15 0 2024-05-08T05:32:01.233 INFO:tasks.workunit.client.0.smithi087.stdout:2/84: rmdir d7/d14 0 2024-05-08T05:32:01.237 INFO:tasks.workunit.client.0.smithi087.stdout:3/106: rename d4/d11/l18 to d4/d14/l27 0 2024-05-08T05:32:01.237 INFO:tasks.workunit.client.0.smithi087.stdout:3/107: stat d4/f21 0 2024-05-08T05:32:01.237 INFO:tasks.workunit.client.0.smithi087.stdout:5/68: rmdir da 39 2024-05-08T05:32:01.238 INFO:tasks.workunit.client.0.smithi087.stdout:2/85: creat d7/f18 x:0 0 0 2024-05-08T05:32:01.238 INFO:tasks.workunit.client.0.smithi087.stdout:2/86: stat d7/fd 0 2024-05-08T05:32:01.238 INFO:tasks.workunit.client.0.smithi087.stdout:2/87: truncate f5 850586 0 2024-05-08T05:32:01.240 INFO:tasks.workunit.client.0.smithi087.stdout:3/108: rename d4/d11/f1b to d4/d14/f28 0 2024-05-08T05:32:01.240 INFO:tasks.workunit.client.0.smithi087.stdout:5/69: unlink da/cf 0 2024-05-08T05:32:01.241 INFO:tasks.workunit.client.0.smithi087.stdout:2/88: mknod d7/de/c19 0 2024-05-08T05:32:01.243 INFO:tasks.workunit.client.0.smithi087.stdout:3/109: creat d4/d14/f29 x:0 0 0 2024-05-08T05:32:01.243 INFO:tasks.workunit.client.0.smithi087.stdout:3/110: chown d4/d11/f23 13670679 1 2024-05-08T05:32:01.243 INFO:tasks.workunit.client.0.smithi087.stdout:3/111: truncate d4/d11/d24/f26 983536 0 2024-05-08T05:32:01.243 INFO:tasks.workunit.client.0.smithi087.stdout:3/112: readlink d4/l7 0 2024-05-08T05:32:01.244 INFO:tasks.workunit.client.0.smithi087.stdout:3/113: chown d4/lf 1780 1 2024-05-08T05:32:01.246 INFO:tasks.workunit.client.0.smithi087.stdout:5/70: truncate f2 7640024 0 2024-05-08T05:32:01.246 INFO:tasks.workunit.client.0.smithi087.stdout:5/71: stat da/dd 0 2024-05-08T05:32:01.246 INFO:tasks.workunit.client.0.smithi087.stdout:5/72: fsync da/dd/f11 0 2024-05-08T05:32:01.246 INFO:tasks.workunit.client.0.smithi087.stdout:9/72: dwrite d1/fd [0,4194304] 0 2024-05-08T05:32:01.246 INFO:tasks.workunit.client.0.smithi087.stdout:2/89: mkdir d7/d1a 0 2024-05-08T05:32:01.246 INFO:tasks.workunit.client.0.smithi087.stdout:2/90: readlink d7/la 0 2024-05-08T05:32:01.247 INFO:tasks.workunit.client.0.smithi087.stdout:2/91: truncate f5 1824988 0 2024-05-08T05:32:01.247 INFO:tasks.workunit.client.0.smithi087.stdout:3/114: creat d4/f2a x:0 0 0 2024-05-08T05:32:01.247 INFO:tasks.workunit.client.0.smithi087.stdout:5/73: mkdir da/dd/d13/d16 0 2024-05-08T05:32:01.249 INFO:tasks.workunit.client.0.smithi087.stdout:9/73: rmdir d1/db 39 2024-05-08T05:32:01.249 INFO:tasks.workunit.client.0.smithi087.stdout:9/74: fdatasync d1/db/fc 0 2024-05-08T05:32:01.250 INFO:tasks.workunit.client.0.smithi087.stdout:2/92: symlink d7/de/l1b 0 2024-05-08T05:32:01.252 INFO:tasks.workunit.client.0.smithi087.stdout:3/115: rename d4/l7 to d4/d11/l2b 0 2024-05-08T05:32:01.252 INFO:tasks.workunit.client.0.smithi087.stdout:3/116: chown d4/d14/l27 12115276 1 2024-05-08T05:32:01.252 INFO:tasks.workunit.client.0.smithi087.stdout:5/74: rmdir da/db 39 2024-05-08T05:32:01.253 INFO:tasks.workunit.client.0.smithi087.stdout:9/75: symlink d1/df/d14/l16 0 2024-05-08T05:32:01.253 INFO:tasks.workunit.client.0.smithi087.stdout:6/94: dwrite d4/d8/f18 [4194304,4194304] 0 2024-05-08T05:32:01.253 INFO:tasks.workunit.client.0.smithi087.stdout:7/75: dwrite d2/f4 [4194304,4194304] 0 2024-05-08T05:32:01.254 INFO:tasks.workunit.client.0.smithi087.stdout:1/75: dwrite fa [0,4194304] 0 2024-05-08T05:32:01.254 INFO:tasks.workunit.client.0.smithi087.stdout:2/93: link d7/de/f15 d7/d1a/f1c 0 2024-05-08T05:32:01.255 INFO:tasks.workunit.client.0.smithi087.stdout:3/117: getdents d4/d11/d24 0 2024-05-08T05:32:01.256 INFO:tasks.workunit.client.0.smithi087.stdout:9/76: readlink d1/l6 0 2024-05-08T05:32:01.256 INFO:tasks.workunit.client.0.smithi087.stdout:9/77: stat d1/db/f10 0 2024-05-08T05:32:01.257 INFO:tasks.workunit.client.0.smithi087.stdout:9/78: dread - d1/f15 zero size 2024-05-08T05:32:01.257 INFO:tasks.workunit.client.0.smithi087.stdout:9/79: write d1/f15 [941306,64749] 0 2024-05-08T05:32:01.257 INFO:tasks.workunit.client.0.smithi087.stdout:9/80: write d1/f13 [3319479,99731] 0 2024-05-08T05:32:01.257 INFO:tasks.workunit.client.0.smithi087.stdout:9/81: fdatasync d1/db/fc 0 2024-05-08T05:32:01.257 INFO:tasks.workunit.client.0.smithi087.stdout:0/87: dwrite d0/d9/f1a [0,4194304] 0 2024-05-08T05:32:01.263 INFO:tasks.workunit.client.0.smithi087.stdout:2/94: symlink d7/de/l1d 0 2024-05-08T05:32:01.263 INFO:tasks.workunit.client.0.smithi087.stdout:2/95: readlink d7/lf 0 2024-05-08T05:32:01.266 INFO:tasks.workunit.client.0.smithi087.stdout:2/96: write f5 [1649905,104900] 0 2024-05-08T05:32:01.266 INFO:tasks.workunit.client.0.smithi087.stdout:2/97: chown f6 47693 1 2024-05-08T05:32:01.270 INFO:tasks.workunit.client.0.smithi087.stdout:0/88: dread d0/d9/f12 [0,4194304] 0 2024-05-08T05:32:01.273 INFO:tasks.workunit.client.0.smithi087.stdout:1/76: write fa [2760221,37282] 0 2024-05-08T05:32:01.276 INFO:tasks.workunit.client.0.smithi087.stdout:2/98: creat d7/f1e x:0 0 0 2024-05-08T05:32:01.276 INFO:tasks.workunit.client.0.smithi087.stdout:6/95: write d4/f16 [2820348,68390] 0 2024-05-08T05:32:01.277 INFO:tasks.workunit.client.0.smithi087.stdout:0/89: link d0/da/f1e d0/da/d11/f20 0 2024-05-08T05:32:01.277 INFO:tasks.workunit.client.0.smithi087.stdout:0/90: truncate d0/d9/fb 923653 0 2024-05-08T05:32:01.278 INFO:tasks.workunit.client.0.smithi087.stdout:1/77: mkdir df/d18 0 2024-05-08T05:32:01.279 INFO:tasks.workunit.client.0.smithi087.stdout:0/91: mknod d0/d9/df/c21 0 2024-05-08T05:32:01.281 INFO:tasks.workunit.client.0.smithi087.stdout:0/92: rename d0/d17 to d0/d22 0 2024-05-08T05:32:01.283 INFO:tasks.workunit.client.0.smithi087.stdout:1/78: read fb [4347357,120073] 0 2024-05-08T05:32:01.283 INFO:tasks.workunit.client.0.smithi087.stdout:7/76: truncate d2/f4 2480356 0 2024-05-08T05:32:01.284 INFO:tasks.workunit.client.0.smithi087.stdout:1/79: mknod df/c19 0 2024-05-08T05:32:01.285 INFO:tasks.workunit.client.0.smithi087.stdout:7/77: mknod d2/da/df/c16 0 2024-05-08T05:32:01.286 INFO:tasks.workunit.client.0.smithi087.stdout:2/99: dread f5 [0,4194304] 0 2024-05-08T05:32:01.290 INFO:tasks.workunit.client.0.smithi087.stdout:1/80: link fa df/d12/f1a 0 2024-05-08T05:32:01.290 INFO:tasks.workunit.client.0.smithi087.stdout:1/81: write df/d12/f1a [1632061,94967] 0 2024-05-08T05:32:01.290 INFO:tasks.workunit.client.0.smithi087.stdout:7/78: creat d2/da/df/f17 x:0 0 0 2024-05-08T05:32:01.293 INFO:tasks.workunit.client.0.smithi087.stdout:9/82: dread d1/f7 [0,4194304] 0 2024-05-08T05:32:01.293 INFO:tasks.workunit.client.0.smithi087.stdout:9/83: write d1/f15 [1288718,6532] 0 2024-05-08T05:32:01.293 INFO:tasks.workunit.client.0.smithi087.stdout:9/84: write d1/f13 [1674351,115284] 0 2024-05-08T05:32:01.295 INFO:tasks.workunit.client.0.smithi087.stdout:1/82: creat df/d18/f1b x:0 0 0 2024-05-08T05:32:01.295 INFO:tasks.workunit.client.0.smithi087.stdout:7/79: getdents d2/d6/d12 0 2024-05-08T05:32:01.296 INFO:tasks.workunit.client.0.smithi087.stdout:4/101: sync 2024-05-08T05:32:01.296 INFO:tasks.workunit.client.0.smithi087.stdout:8/111: sync 2024-05-08T05:32:01.296 INFO:tasks.workunit.client.0.smithi087.stdout:8/112: stat f8 0 2024-05-08T05:32:01.296 INFO:tasks.workunit.client.0.smithi087.stdout:8/113: chown db/d23/d15/c27 39095 1 2024-05-08T05:32:01.298 INFO:tasks.workunit.client.0.smithi087.stdout:9/85: creat d1/df/d14/f17 x:0 0 0 2024-05-08T05:32:01.298 INFO:tasks.workunit.client.0.smithi087.stdout:7/80: symlink d2/da/l18 0 2024-05-08T05:32:01.298 INFO:tasks.workunit.client.0.smithi087.stdout:7/81: write d2/da/df/f10 [698229,80110] 0 2024-05-08T05:32:01.299 INFO:tasks.workunit.client.0.smithi087.stdout:4/102: unlink d4/l15 0 2024-05-08T05:32:01.299 INFO:tasks.workunit.client.0.smithi087.stdout:4/103: chown d4/f9 0 1 2024-05-08T05:32:01.300 INFO:tasks.workunit.client.0.smithi087.stdout:7/82: mkdir d2/d6/d12/d19 0 2024-05-08T05:32:01.302 INFO:tasks.workunit.client.0.smithi087.stdout:7/83: rename d2/d6/c14 to d2/da/df/c1a 0 2024-05-08T05:32:01.302 INFO:tasks.workunit.client.0.smithi087.stdout:7/84: chown d2/da/f11 184 1 2024-05-08T05:32:01.304 INFO:tasks.workunit.client.0.smithi087.stdout:7/85: unlink d2/d6/f7 0 2024-05-08T05:32:01.313 INFO:tasks.workunit.client.0.smithi087.stdout:2/100: read d7/de/f13 [1260743,11983] 0 2024-05-08T05:32:01.314 INFO:tasks.workunit.client.0.smithi087.stdout:5/75: dwrite da/dd/f11 [0,4194304] 0 2024-05-08T05:32:01.314 INFO:tasks.workunit.client.0.smithi087.stdout:5/76: stat da/dd/d13 0 2024-05-08T05:32:01.321 INFO:tasks.workunit.client.0.smithi087.stdout:9/86: dread d1/fd [0,4194304] 0 2024-05-08T05:32:01.323 INFO:tasks.workunit.client.0.smithi087.stdout:9/87: mkdir d1/df/d14/d18 0 2024-05-08T05:32:01.325 INFO:tasks.workunit.client.0.smithi087.stdout:2/101: dread d7/f17 [0,4194304] 0 2024-05-08T05:32:01.328 INFO:tasks.workunit.client.0.smithi087.stdout:5/77: dread f9 [0,4194304] 0 2024-05-08T05:32:01.330 INFO:tasks.workunit.client.0.smithi087.stdout:9/88: creat d1/f19 x:0 0 0 2024-05-08T05:32:01.331 INFO:tasks.workunit.client.0.smithi087.stdout:9/89: chown d1/db 22321210 1 2024-05-08T05:32:01.331 INFO:tasks.workunit.client.0.smithi087.stdout:4/104: dread d4/d13/f26 [0,4194304] 0 2024-05-08T05:32:01.342 INFO:tasks.workunit.client.0.smithi087.stdout:9/90: write d1/fd [2100524,76285] 0 2024-05-08T05:32:01.345 INFO:tasks.workunit.client.0.smithi087.stdout:9/91: creat d1/f1a x:0 0 0 2024-05-08T05:32:01.346 INFO:tasks.workunit.client.0.smithi087.stdout:4/105: dread d4/fe [0,4194304] 0 2024-05-08T05:32:01.356 INFO:tasks.workunit.client.0.smithi087.stdout:2/102: dwrite d7/de/f15 [0,4194304] 0 2024-05-08T05:32:01.359 INFO:tasks.workunit.client.0.smithi087.stdout:0/93: dwrite d0/da/f1e [0,4194304] 0 2024-05-08T05:32:01.360 INFO:tasks.workunit.client.0.smithi087.stdout:4/106: dread f1 [0,4194304] 0 2024-05-08T05:32:01.362 INFO:tasks.workunit.client.0.smithi087.stdout:9/92: dread d1/f15 [0,4194304] 0 2024-05-08T05:32:01.362 INFO:tasks.workunit.client.0.smithi087.stdout:0/94: unlink d0/d9/fd 0 2024-05-08T05:32:01.363 INFO:tasks.workunit.client.0.smithi087.stdout:6/96: dwrite d4/d6/f13 [8388608,4194304] 0 2024-05-08T05:32:01.363 INFO:tasks.workunit.client.0.smithi087.stdout:5/78: dread f2 [4194304,4194304] 0 2024-05-08T05:32:01.363 INFO:tasks.workunit.client.0.smithi087.stdout:6/97: truncate d4/d6/f1b 596968 0 2024-05-08T05:32:01.364 INFO:tasks.workunit.client.0.smithi087.stdout:6/98: read d4/d6/f13 [3659711,15702] 0 2024-05-08T05:32:01.364 INFO:tasks.workunit.client.0.smithi087.stdout:6/99: write d4/d6/f13 [1627547,7907] 0 2024-05-08T05:32:01.364 INFO:tasks.workunit.client.0.smithi087.stdout:6/100: chown f1 2113586251 1 2024-05-08T05:32:01.364 INFO:tasks.workunit.client.0.smithi087.stdout:4/107: creat d4/d25/f27 x:0 0 0 2024-05-08T05:32:01.364 INFO:tasks.workunit.client.0.smithi087.stdout:9/93: creat d1/db/f1b x:0 0 0 2024-05-08T05:32:01.365 INFO:tasks.workunit.client.0.smithi087.stdout:0/95: truncate d0/da/fe 4161088 0 2024-05-08T05:32:01.366 INFO:tasks.workunit.client.0.smithi087.stdout:5/79: mkdir da/dd/d10/d17 0 2024-05-08T05:32:01.366 INFO:tasks.workunit.client.0.smithi087.stdout:0/96: write d0/d9/df/f15 [232543,103590] 0 2024-05-08T05:32:01.368 INFO:tasks.workunit.client.0.smithi087.stdout:6/101: unlink d4/d6/fc 0 2024-05-08T05:32:01.368 INFO:tasks.workunit.client.0.smithi087.stdout:6/102: chown d4 2057288005 1 2024-05-08T05:32:01.369 INFO:tasks.workunit.client.0.smithi087.stdout:4/108: mkdir d4/d25/d28 0 2024-05-08T05:32:01.369 INFO:tasks.workunit.client.0.smithi087.stdout:9/94: mknod d1/df/d14/c1c 0 2024-05-08T05:32:01.371 INFO:tasks.workunit.client.0.smithi087.stdout:0/97: mkdir d0/d9/d23 0 2024-05-08T05:32:01.371 INFO:tasks.workunit.client.0.smithi087.stdout:6/103: symlink d4/d8/l1d 0 2024-05-08T05:32:01.372 INFO:tasks.workunit.client.0.smithi087.stdout:4/109: creat d4/d25/f29 x:0 0 0 2024-05-08T05:32:01.373 INFO:tasks.workunit.client.0.smithi087.stdout:4/110: readlink d4/lf 0 2024-05-08T05:32:01.374 INFO:tasks.workunit.client.0.smithi087.stdout:9/95: rename d1/l6 to d1/df/l1d 0 2024-05-08T05:32:01.375 INFO:tasks.workunit.client.0.smithi087.stdout:0/98: getdents d0/d9/d1b 0 2024-05-08T05:32:01.375 INFO:tasks.workunit.client.0.smithi087.stdout:0/99: readlink - no filename 2024-05-08T05:32:01.378 INFO:tasks.workunit.client.0.smithi087.stdout:6/104: mkdir d4/d8/df/d1e 0 2024-05-08T05:32:01.381 INFO:tasks.workunit.client.0.smithi087.stdout:9/96: link d1/db/f10 d1/df/d14/d18/f1e 0 2024-05-08T05:32:01.382 INFO:tasks.workunit.client.0.smithi087.stdout:0/100: mkdir d0/d9/d23/d24 0 2024-05-08T05:32:01.383 INFO:tasks.workunit.client.0.smithi087.stdout:0/101: readlink - no filename 2024-05-08T05:32:01.383 INFO:tasks.workunit.client.0.smithi087.stdout:4/111: getdents d4/d25 0 2024-05-08T05:32:01.383 INFO:tasks.workunit.client.0.smithi087.stdout:4/112: write f1 [2704819,80280] 0 2024-05-08T05:32:01.386 INFO:tasks.workunit.client.0.smithi087.stdout:6/105: dread d4/d8/df/f10 [0,4194304] 0 2024-05-08T05:32:01.387 INFO:tasks.workunit.client.0.smithi087.stdout:4/113: symlink d4/d13/l2a 0 2024-05-08T05:32:01.389 INFO:tasks.workunit.client.0.smithi087.stdout:6/106: link d4/d6/l15 d4/d8/df/l1f 0 2024-05-08T05:32:01.390 INFO:tasks.workunit.client.0.smithi087.stdout:0/102: mknod d0/d9/d23/c25 0 2024-05-08T05:32:01.391 INFO:tasks.workunit.client.0.smithi087.stdout:6/107: mknod d4/d8/df/d1e/c20 0 2024-05-08T05:32:01.392 INFO:tasks.workunit.client.0.smithi087.stdout:6/108: rmdir d4/d6 39 2024-05-08T05:32:01.393 INFO:tasks.workunit.client.0.smithi087.stdout:0/103: mknod d0/d9/c26 0 2024-05-08T05:32:01.394 INFO:tasks.workunit.client.0.smithi087.stdout:6/109: creat d4/d8/f21 x:0 0 0 2024-05-08T05:32:01.395 INFO:tasks.workunit.client.0.smithi087.stdout:0/104: mkdir d0/da/d11/d27 0 2024-05-08T05:32:01.397 INFO:tasks.workunit.client.0.smithi087.stdout:6/110: link d4/d8/df/l1f d4/d8/l22 0 2024-05-08T05:32:01.399 INFO:tasks.workunit.client.0.smithi087.stdout:0/105: rename d0/d9/df/c21 to d0/da/d11/c28 0 2024-05-08T05:32:01.399 INFO:tasks.workunit.client.0.smithi087.stdout:0/106: chown d0/d9/f10 11127853 1 2024-05-08T05:32:01.427 INFO:tasks.workunit.client.0.smithi087.stdout:4/114: dwrite d4/fe [0,4194304] 0 2024-05-08T05:32:01.439 INFO:tasks.workunit.client.0.smithi087.stdout:5/80: write da/dd/f11 [2547947,53700] 0 2024-05-08T05:32:01.447 INFO:tasks.workunit.client.0.smithi087.stdout:2/103: dwrite f6 [0,4194304] 0 2024-05-08T05:32:01.457 INFO:tasks.workunit.client.0.smithi087.stdout:9/97: dwrite d1/db/f1b [0,4194304] 0 2024-05-08T05:32:01.457 INFO:tasks.workunit.client.0.smithi087.stdout:9/98: write d1/f4 [2719800,105607] 0 2024-05-08T05:32:01.459 INFO:tasks.workunit.client.0.smithi087.stdout:6/111: dwrite d4/d8/df/f1a [0,4194304] 0 2024-05-08T05:32:01.464 INFO:tasks.workunit.client.0.smithi087.stdout:0/107: dwrite d0/d9/f12 [0,4194304] 0 2024-05-08T05:32:01.468 INFO:tasks.workunit.client.0.smithi087.stdout:6/112: creat d4/d8/df/d1e/f23 x:0 0 0 2024-05-08T05:32:01.468 INFO:tasks.workunit.client.0.smithi087.stdout:6/113: fdatasync d4/d6/f1b 0 2024-05-08T05:32:01.470 INFO:tasks.workunit.client.0.smithi087.stdout:2/104: dread d7/de/f15 [0,4194304] 0 2024-05-08T05:32:01.472 INFO:tasks.workunit.client.0.smithi087.stdout:6/114: mknod d4/d8/df/c24 0 2024-05-08T05:32:01.473 INFO:tasks.workunit.client.0.smithi087.stdout:5/81: dread f7 [0,4194304] 0 2024-05-08T05:32:01.474 INFO:tasks.workunit.client.0.smithi087.stdout:2/105: creat d7/f1f x:0 0 0 2024-05-08T05:32:01.475 INFO:tasks.workunit.client.0.smithi087.stdout:6/115: mkdir d4/d8/df/d1e/d25 0 2024-05-08T05:32:01.475 INFO:tasks.workunit.client.0.smithi087.stdout:6/116: stat d4/d8 0 2024-05-08T05:32:01.476 INFO:tasks.workunit.client.0.smithi087.stdout:2/106: getdents d7/de 0 2024-05-08T05:32:01.477 INFO:tasks.workunit.client.0.smithi087.stdout:2/107: mknod d7/de/c20 0 2024-05-08T05:32:01.483 INFO:tasks.workunit.client.0.smithi087.stdout:3/118: sync 2024-05-08T05:32:01.483 INFO:tasks.workunit.client.0.smithi087.stdout:3/119: write d4/d11/f20 [432132,37319] 0 2024-05-08T05:32:01.483 INFO:tasks.workunit.client.0.smithi087.stdout:4/115: dwrite d4/fe [0,4194304] 0 2024-05-08T05:32:01.483 INFO:tasks.workunit.client.0.smithi087.stdout:0/108: dread d0/da/fe [0,4194304] 0 2024-05-08T05:32:01.493 INFO:tasks.workunit.client.0.smithi087.stdout:6/117: read d4/d6/f13 [7307601,66359] 0 2024-05-08T05:32:01.494 INFO:tasks.workunit.client.0.smithi087.stdout:2/108: dread d7/de/f15 [0,4194304] 0 2024-05-08T05:32:01.494 INFO:tasks.workunit.client.0.smithi087.stdout:2/109: readlink d7/la 0 2024-05-08T05:32:01.494 INFO:tasks.workunit.client.0.smithi087.stdout:2/110: dread - d7/f18 zero size 2024-05-08T05:32:01.494 INFO:tasks.workunit.client.0.smithi087.stdout:6/118: mknod d4/d8/c26 0 2024-05-08T05:32:01.495 INFO:tasks.workunit.client.0.smithi087.stdout:6/119: getdents d4/d6 0 2024-05-08T05:32:01.495 INFO:tasks.workunit.client.0.smithi087.stdout:6/120: readlink d4/d8/l1d 0 2024-05-08T05:32:01.495 INFO:tasks.workunit.client.0.smithi087.stdout:6/121: chown d4/d8/fb 307 1 2024-05-08T05:32:01.496 INFO:tasks.workunit.client.0.smithi087.stdout:6/122: symlink d4/d8/df/d1e/d25/l27 0 2024-05-08T05:32:01.497 INFO:tasks.workunit.client.0.smithi087.stdout:6/123: truncate d4/d8/fb 977728 0 2024-05-08T05:32:01.511 INFO:tasks.workunit.client.0.smithi087.stdout:2/111: dread d7/de/f15 [0,4194304] 0 2024-05-08T05:32:01.511 INFO:tasks.workunit.client.0.smithi087.stdout:2/112: truncate d7/f1e 523584 0 2024-05-08T05:32:01.512 INFO:tasks.workunit.client.0.smithi087.stdout:5/82: dread da/dd/f11 [0,4194304] 0 2024-05-08T05:32:01.513 INFO:tasks.workunit.client.0.smithi087.stdout:0/109: dread d0/d9/fb [0,4194304] 0 2024-05-08T05:32:01.515 INFO:tasks.workunit.client.0.smithi087.stdout:2/113: rename f1 to d7/d1a/f21 0 2024-05-08T05:32:01.516 INFO:tasks.workunit.client.0.smithi087.stdout:5/83: truncate f9 954405 0 2024-05-08T05:32:01.517 INFO:tasks.workunit.client.0.smithi087.stdout:5/84: readlink - no filename 2024-05-08T05:32:01.517 INFO:tasks.workunit.client.0.smithi087.stdout:2/114: truncate d7/f1f 375213 0 2024-05-08T05:32:01.519 INFO:tasks.workunit.client.0.smithi087.stdout:2/115: link d7/d1a/f21 d7/f22 0 2024-05-08T05:32:01.520 INFO:tasks.workunit.client.0.smithi087.stdout:5/85: truncate f9 1931225 0 2024-05-08T05:32:01.521 INFO:tasks.workunit.client.0.smithi087.stdout:0/110: dread d0/d9/fb [0,4194304] 0 2024-05-08T05:32:01.523 INFO:tasks.workunit.client.0.smithi087.stdout:2/116: creat d7/d1a/f23 x:0 0 0 2024-05-08T05:32:01.523 INFO:tasks.workunit.client.0.smithi087.stdout:2/117: fsync d7/f1f 0 2024-05-08T05:32:01.523 INFO:tasks.workunit.client.0.smithi087.stdout:2/118: stat d7/de/c20 0 2024-05-08T05:32:01.524 INFO:tasks.workunit.client.0.smithi087.stdout:0/111: link d0/da/fe d0/f29 0 2024-05-08T05:32:01.526 INFO:tasks.workunit.client.0.smithi087.stdout:0/112: creat d0/d9/d23/f2a x:0 0 0 2024-05-08T05:32:01.527 INFO:tasks.workunit.client.0.smithi087.stdout:0/113: mknod d0/d9/d23/d24/c2b 0 2024-05-08T05:32:01.527 INFO:tasks.workunit.client.0.smithi087.stdout:0/114: write d0/da/f16 [16002,21077] 0 2024-05-08T05:32:01.528 INFO:tasks.workunit.client.0.smithi087.stdout:0/115: mkdir d0/d9/d23/d2c 0 2024-05-08T05:32:01.529 INFO:tasks.workunit.client.0.smithi087.stdout:3/120: dwrite d4/d14/f28 [0,4194304] 0 2024-05-08T05:32:01.530 INFO:tasks.workunit.client.0.smithi087.stdout:3/121: symlink d4/l2c 0 2024-05-08T05:32:01.530 INFO:tasks.workunit.client.0.smithi087.stdout:3/122: fdatasync d4/d11/f20 0 2024-05-08T05:32:01.533 INFO:tasks.workunit.client.0.smithi087.stdout:3/123: link l1 d4/d11/d24/d25/l2d 0 2024-05-08T05:32:01.535 INFO:tasks.workunit.client.0.smithi087.stdout:9/99: dwrite d1/db/fc [0,4194304] 0 2024-05-08T05:32:01.538 INFO:tasks.workunit.client.0.smithi087.stdout:5/86: dread da/dd/f11 [0,4194304] 0 2024-05-08T05:32:01.544 INFO:tasks.workunit.client.0.smithi087.stdout:3/124: mknod d4/d11/d24/d25/c2e 0 2024-05-08T05:32:01.547 INFO:tasks.workunit.client.0.smithi087.stdout:4/116: dwrite f1 [0,4194304] 0 2024-05-08T05:32:01.551 INFO:tasks.workunit.client.0.smithi087.stdout:3/125: creat d4/d11/d24/d25/f2f x:0 0 0 2024-05-08T05:32:01.553 INFO:tasks.workunit.client.0.smithi087.stdout:4/117: rename d4/c21 to d4/d13/c2b 0 2024-05-08T05:32:01.553 INFO:tasks.workunit.client.0.smithi087.stdout:9/100: creat d1/db/f1f x:0 0 0 2024-05-08T05:32:01.553 INFO:tasks.workunit.client.0.smithi087.stdout:9/101: dread - d1/f1a zero size 2024-05-08T05:32:01.553 INFO:tasks.workunit.client.0.smithi087.stdout:3/126: rename d4/c9 to d4/d14/c30 0 2024-05-08T05:32:01.553 INFO:tasks.workunit.client.0.smithi087.stdout:1/83: sync 2024-05-08T05:32:01.553 INFO:tasks.workunit.client.0.smithi087.stdout:3/127: symlink d4/l31 0 2024-05-08T05:32:01.554 INFO:tasks.workunit.client.0.smithi087.stdout:3/128: readlink d4/le 0 2024-05-08T05:32:01.555 INFO:tasks.workunit.client.0.smithi087.stdout:8/114: sync 2024-05-08T05:32:01.555 INFO:tasks.workunit.client.0.smithi087.stdout:7/86: sync 2024-05-08T05:32:01.571 INFO:tasks.workunit.client.0.smithi087.stdout:0/116: dwrite d0/d9/f14 [0,4194304] 0 2024-05-08T05:32:01.573 INFO:tasks.workunit.client.0.smithi087.stdout:0/117: rmdir d0/d9/d23/d2c 0 2024-05-08T05:32:01.574 INFO:tasks.workunit.client.0.smithi087.stdout:0/118: getdents d0/da/d11 0 2024-05-08T05:32:01.576 INFO:tasks.workunit.client.0.smithi087.stdout:0/119: creat d0/d9/d23/d24/f2d x:0 0 0 2024-05-08T05:32:01.577 INFO:tasks.workunit.client.0.smithi087.stdout:7/87: dread d2/f4 [0,4194304] 0 2024-05-08T05:32:01.577 INFO:tasks.workunit.client.0.smithi087.stdout:0/120: mknod d0/da/c2e 0 2024-05-08T05:32:01.577 INFO:tasks.workunit.client.0.smithi087.stdout:0/121: fdatasync d0/d9/df/f15 0 2024-05-08T05:32:01.579 INFO:tasks.workunit.client.0.smithi087.stdout:2/119: dwrite d7/f8 [0,4194304] 0 2024-05-08T05:32:01.579 INFO:tasks.workunit.client.0.smithi087.stdout:8/115: dread db/f12 [0,4194304] 0 2024-05-08T05:32:01.580 INFO:tasks.workunit.client.0.smithi087.stdout:7/88: unlink l0 0 2024-05-08T05:32:01.584 INFO:tasks.workunit.client.0.smithi087.stdout:8/116: link f8 db/d23/d1b/f2a 0 2024-05-08T05:32:01.584 INFO:tasks.workunit.client.0.smithi087.stdout:2/120: creat d7/de/f24 x:0 0 0 2024-05-08T05:32:01.584 INFO:tasks.workunit.client.0.smithi087.stdout:8/117: read - db/d23/d15/f19 zero size 2024-05-08T05:32:01.585 INFO:tasks.workunit.client.0.smithi087.stdout:2/121: symlink d7/de/l25 0 2024-05-08T05:32:01.585 INFO:tasks.workunit.client.0.smithi087.stdout:2/122: write d7/d1a/f23 [387703,75712] 0 2024-05-08T05:32:01.586 INFO:tasks.workunit.client.0.smithi087.stdout:8/118: truncate db/d23/d1b/f2a 475486 0 2024-05-08T05:32:01.588 INFO:tasks.workunit.client.0.smithi087.stdout:7/89: write d2/f4 [1414394,86026] 0 2024-05-08T05:32:01.588 INFO:tasks.workunit.client.0.smithi087.stdout:2/123: rename d7/d1a to d7/de/d26 0 2024-05-08T05:32:01.588 INFO:tasks.workunit.client.0.smithi087.stdout:7/90: write d2/da/f11 [1343304,129471] 0 2024-05-08T05:32:01.589 INFO:tasks.workunit.client.0.smithi087.stdout:8/119: getdents db/d23/d15 0 2024-05-08T05:32:01.592 INFO:tasks.workunit.client.0.smithi087.stdout:2/124: mkdir d7/de/d27 0 2024-05-08T05:32:01.592 INFO:tasks.workunit.client.0.smithi087.stdout:2/125: chown d7/de/l1b 1 1 2024-05-08T05:32:01.592 INFO:tasks.workunit.client.0.smithi087.stdout:8/120: creat db/d23/d1b/f2b x:0 0 0 2024-05-08T05:32:01.593 INFO:tasks.workunit.client.0.smithi087.stdout:2/126: write d7/f1f [321647,79669] 0 2024-05-08T05:32:01.595 INFO:tasks.workunit.client.0.smithi087.stdout:8/121: rename db/f1f to db/d23/d15/f2c 0 2024-05-08T05:32:01.595 INFO:tasks.workunit.client.0.smithi087.stdout:7/91: dread d2/d6/fe [0,4194304] 0 2024-05-08T05:32:01.595 INFO:tasks.workunit.client.0.smithi087.stdout:7/92: write d2/da/df/f13 [1612839,126635] 0 2024-05-08T05:32:01.596 INFO:tasks.workunit.client.0.smithi087.stdout:8/122: link f2 db/d23/f2d 0 2024-05-08T05:32:01.596 INFO:tasks.workunit.client.0.smithi087.stdout:8/123: chown db/d23/d1b/f26 105 1 2024-05-08T05:32:01.599 INFO:tasks.workunit.client.0.smithi087.stdout:4/118: dwrite d4/d25/f27 [0,4194304] 0 2024-05-08T05:32:01.599 INFO:tasks.workunit.client.0.smithi087.stdout:4/119: stat d4/d13/l1a 0 2024-05-08T05:32:01.603 INFO:tasks.workunit.client.0.smithi087.stdout:4/120: truncate d4/f10 3642260 0 2024-05-08T05:32:01.603 INFO:tasks.workunit.client.0.smithi087.stdout:4/121: truncate f1 5036433 0 2024-05-08T05:32:01.604 INFO:tasks.workunit.client.0.smithi087.stdout:4/122: symlink d4/l2c 0 2024-05-08T05:32:01.609 INFO:tasks.workunit.client.0.smithi087.stdout:4/123: symlink d4/l2d 0 2024-05-08T05:32:01.628 INFO:tasks.workunit.client.0.smithi087.stdout:1/84: dwrite fb [0,4194304] 0 2024-05-08T05:32:01.631 INFO:tasks.workunit.client.0.smithi087.stdout:1/85: rename df/d12/l14 to df/d18/l1c 0 2024-05-08T05:32:01.633 INFO:tasks.workunit.client.0.smithi087.stdout:0/122: dwrite d0/d9/d23/f2a [0,4194304] 0 2024-05-08T05:32:01.635 INFO:tasks.workunit.client.0.smithi087.stdout:0/123: stat d0/d9/f1a 0 2024-05-08T05:32:01.636 INFO:tasks.workunit.client.0.smithi087.stdout:0/124: stat d0/da/d11/f20 0 2024-05-08T05:32:01.637 INFO:tasks.workunit.client.0.smithi087.stdout:0/125: truncate d0/d9/f12 3512612 0 2024-05-08T05:32:01.638 INFO:tasks.workunit.client.0.smithi087.stdout:2/127: dwrite f5 [0,4194304] 0 2024-05-08T05:32:01.639 INFO:tasks.workunit.client.0.smithi087.stdout:0/126: getdents d0/d9/df 0 2024-05-08T05:32:01.639 INFO:tasks.workunit.client.0.smithi087.stdout:0/127: fsync d0/f2 0 2024-05-08T05:32:01.639 INFO:tasks.workunit.client.0.smithi087.stdout:7/93: dwrite d2/d6/fe [0,4194304] 0 2024-05-08T05:32:01.642 INFO:tasks.workunit.client.0.smithi087.stdout:1/86: write fb [2379204,26162] 0 2024-05-08T05:32:01.643 INFO:tasks.workunit.client.0.smithi087.stdout:2/128: mknod d7/c28 0 2024-05-08T05:32:01.643 INFO:tasks.workunit.client.0.smithi087.stdout:2/129: fsync d7/de/f13 0 2024-05-08T05:32:01.646 INFO:tasks.workunit.client.0.smithi087.stdout:7/94: creat d2/d6/d12/d15/f1b x:0 0 0 2024-05-08T05:32:01.647 INFO:tasks.workunit.client.0.smithi087.stdout:4/124: dwrite d4/d13/f23 [0,4194304] 0 2024-05-08T05:32:01.648 INFO:tasks.workunit.client.0.smithi087.stdout:1/87: truncate fa 2461647 0 2024-05-08T05:32:01.649 INFO:tasks.workunit.client.0.smithi087.stdout:2/130: rename d7/de/c19 to d7/de/d27/c29 0 2024-05-08T05:32:01.649 INFO:tasks.workunit.client.0.smithi087.stdout:7/95: write d2/da/f11 [1326944,2152] 0 2024-05-08T05:32:01.649 INFO:tasks.workunit.client.0.smithi087.stdout:7/96: dread - d2/d6/d12/d15/f1b zero size 2024-05-08T05:32:01.650 INFO:tasks.workunit.client.0.smithi087.stdout:7/97: write d2/d6/d12/d15/f1b [285323,107067] 0 2024-05-08T05:32:01.654 INFO:tasks.workunit.client.0.smithi087.stdout:1/88: mkdir df/d18/d1d 0 2024-05-08T05:32:01.656 INFO:tasks.workunit.client.0.smithi087.stdout:0/128: rename d0/da/d11/d27 to d0/d9/d1b/d2f 0 2024-05-08T05:32:01.658 INFO:tasks.workunit.client.0.smithi087.stdout:7/98: symlink d2/d6/d12/l1c 0 2024-05-08T05:32:01.662 INFO:tasks.workunit.client.0.smithi087.stdout:4/125: rename d4/f1f to d4/d13/f2e 0 2024-05-08T05:32:01.663 INFO:tasks.workunit.client.0.smithi087.stdout:0/129: creat d0/da/f30 x:0 0 0 2024-05-08T05:32:01.663 INFO:tasks.workunit.client.0.smithi087.stdout:0/130: readlink - no filename 2024-05-08T05:32:01.663 INFO:tasks.workunit.client.0.smithi087.stdout:0/131: write d0/da/f16 [544047,13766] 0 2024-05-08T05:32:01.665 INFO:tasks.workunit.client.0.smithi087.stdout:1/89: dread fb [0,4194304] 0 2024-05-08T05:32:01.667 INFO:tasks.workunit.client.0.smithi087.stdout:7/99: rename d2/da/df to d2/d6/d12/d1d 0 2024-05-08T05:32:01.671 INFO:tasks.workunit.client.0.smithi087.stdout:0/132: symlink d0/d9/d1b/d2f/l31 0 2024-05-08T05:32:01.671 INFO:tasks.workunit.client.0.smithi087.stdout:0/133: rename d0/d22 to d0/d22/d32 22 2024-05-08T05:32:01.675 INFO:tasks.workunit.client.0.smithi087.stdout:1/90: symlink df/d12/l1e 0 2024-05-08T05:32:01.675 INFO:tasks.workunit.client.0.smithi087.stdout:6/124: sync 2024-05-08T05:32:01.675 INFO:tasks.workunit.client.0.smithi087.stdout:7/100: link d2/d6/d12/d1d/f17 d2/d6/d12/d19/f1e 0 2024-05-08T05:32:01.675 INFO:tasks.workunit.client.0.smithi087.stdout:1/91: truncate df/f11 4612682 0 2024-05-08T05:32:01.675 INFO:tasks.workunit.client.0.smithi087.stdout:7/101: write d2/d6/d12/d15/f1b [1012602,44030] 0 2024-05-08T05:32:01.675 INFO:tasks.workunit.client.0.smithi087.stdout:7/102: write d2/d6/fb [27964,13458] 0 2024-05-08T05:32:01.675 INFO:tasks.workunit.client.0.smithi087.stdout:0/134: mknod d0/d9/d1b/d2f/c33 0 2024-05-08T05:32:01.677 INFO:tasks.workunit.client.0.smithi087.stdout:1/92: unlink fb 0 2024-05-08T05:32:01.678 INFO:tasks.workunit.client.0.smithi087.stdout:6/125: mkdir d4/d8/df/d1e/d25/d28 0 2024-05-08T05:32:01.680 INFO:tasks.workunit.client.0.smithi087.stdout:0/135: rename d0/d9/f14 to d0/d9/df/f34 0 2024-05-08T05:32:01.682 INFO:tasks.workunit.client.0.smithi087.stdout:1/93: creat df/f1f x:0 0 0 2024-05-08T05:32:01.682 INFO:tasks.workunit.client.0.smithi087.stdout:4/126: write d4/fe [56218,56209] 0 2024-05-08T05:32:01.683 INFO:tasks.workunit.client.0.smithi087.stdout:0/136: mkdir d0/da/d35 0 2024-05-08T05:32:01.683 INFO:tasks.workunit.client.0.smithi087.stdout:2/131: dwrite d7/de/d26/f21 [4194304,4194304] 0 2024-05-08T05:32:01.683 INFO:tasks.workunit.client.0.smithi087.stdout:1/94: creat df/f20 x:0 0 0 2024-05-08T05:32:01.685 INFO:tasks.workunit.client.0.smithi087.stdout:0/137: symlink d0/d22/l36 0 2024-05-08T05:32:01.686 INFO:tasks.workunit.client.0.smithi087.stdout:1/95: getdents df/d18 0 2024-05-08T05:32:01.687 INFO:tasks.workunit.client.0.smithi087.stdout:1/96: symlink df/d18/d1d/l21 0 2024-05-08T05:32:01.690 INFO:tasks.workunit.client.0.smithi087.stdout:1/97: mknod df/c22 0 2024-05-08T05:32:01.690 INFO:tasks.workunit.client.0.smithi087.stdout:1/98: fdatasync df/f20 0 2024-05-08T05:32:01.690 INFO:tasks.workunit.client.0.smithi087.stdout:1/99: truncate df/d18/f1b 313922 0 2024-05-08T05:32:01.699 INFO:tasks.workunit.client.0.smithi087.stdout:2/132: write d7/de/f15 [3788500,99452] 0 2024-05-08T05:32:01.700 INFO:tasks.workunit.client.0.smithi087.stdout:1/100: creat df/d12/f23 x:0 0 0 2024-05-08T05:32:01.701 INFO:tasks.workunit.client.0.smithi087.stdout:1/101: write df/f1f [321154,79556] 0 2024-05-08T05:32:01.701 INFO:tasks.workunit.client.0.smithi087.stdout:1/102: readlink df/d18/l1c 0 2024-05-08T05:32:01.701 INFO:tasks.workunit.client.0.smithi087.stdout:1/103: getdents df/d18 0 2024-05-08T05:32:01.702 INFO:tasks.workunit.client.0.smithi087.stdout:5/87: sync 2024-05-08T05:32:01.709 INFO:tasks.workunit.client.0.smithi087.stdout:2/133: mknod d7/de/c2a 0 2024-05-08T05:32:01.709 INFO:tasks.workunit.client.0.smithi087.stdout:2/134: chown d7/de/d26/f1c 3173 1 2024-05-08T05:32:01.709 INFO:tasks.workunit.client.0.smithi087.stdout:1/104: creat df/f24 x:0 0 0 2024-05-08T05:32:01.709 INFO:tasks.workunit.client.0.smithi087.stdout:4/127: write d4/d13/f23 [2724345,121213] 0 2024-05-08T05:32:01.709 INFO:tasks.workunit.client.0.smithi087.stdout:1/105: write df/d18/f1b [660027,83644] 0 2024-05-08T05:32:01.709 INFO:tasks.workunit.client.0.smithi087.stdout:1/106: chown df/d18/l1c 3334 1 2024-05-08T05:32:01.712 INFO:tasks.workunit.client.0.smithi087.stdout:5/88: mknod da/dd/d10/c18 0 2024-05-08T05:32:01.712 INFO:tasks.workunit.client.0.smithi087.stdout:4/128: truncate d4/d25/f27 1474259 0 2024-05-08T05:32:01.712 INFO:tasks.workunit.client.0.smithi087.stdout:4/129: fsync d4/d25/f29 0 2024-05-08T05:32:01.713 INFO:tasks.workunit.client.0.smithi087.stdout:1/107: rename df/c22 to df/c25 0 2024-05-08T05:32:01.714 INFO:tasks.workunit.client.0.smithi087.stdout:5/89: symlink da/dd/d13/l19 0 2024-05-08T05:32:01.714 INFO:tasks.workunit.client.0.smithi087.stdout:5/90: rename da/dd to da/dd/d13/d16/d1a 22 2024-05-08T05:32:01.714 INFO:tasks.workunit.client.0.smithi087.stdout:5/91: write da/dd/f11 [2415317,81279] 0 2024-05-08T05:32:01.714 INFO:tasks.workunit.client.0.smithi087.stdout:5/92: write da/dd/f11 [2220361,125101] 0 2024-05-08T05:32:01.715 INFO:tasks.workunit.client.0.smithi087.stdout:2/135: dread d7/f17 [0,4194304] 0 2024-05-08T05:32:01.719 INFO:tasks.workunit.client.0.smithi087.stdout:1/108: symlink df/l26 0 2024-05-08T05:32:01.720 INFO:tasks.workunit.client.0.smithi087.stdout:5/93: read f9 [1657539,82712] 0 2024-05-08T05:32:01.720 INFO:tasks.workunit.client.0.smithi087.stdout:1/109: write df/d12/f1a [3026924,11973] 0 2024-05-08T05:32:01.720 INFO:tasks.workunit.client.0.smithi087.stdout:1/110: chown l7 664915 1 2024-05-08T05:32:01.729 INFO:tasks.workunit.client.0.smithi087.stdout:4/130: read d4/d25/f27 [742179,270] 0 2024-05-08T05:32:01.732 INFO:tasks.workunit.client.0.smithi087.stdout:4/131: getdents d4 0 2024-05-08T05:32:01.732 INFO:tasks.workunit.client.0.smithi087.stdout:4/132: write d4/d13/f16 [93770,79337] 0 2024-05-08T05:32:01.739 INFO:tasks.workunit.client.0.smithi087.stdout:0/138: fdatasync d0/da/f16 0 2024-05-08T05:32:01.741 INFO:tasks.workunit.client.0.smithi087.stdout:0/139: creat d0/da/d35/f37 x:0 0 0 2024-05-08T05:32:01.741 INFO:tasks.workunit.client.0.smithi087.stdout:0/140: fdatasync d0/f29 0 2024-05-08T05:32:01.741 INFO:tasks.workunit.client.0.smithi087.stdout:0/141: write d0/d9/f10 [457475,56415] 0 2024-05-08T05:32:01.743 INFO:tasks.workunit.client.0.smithi087.stdout:7/103: dwrite d2/d6/d12/d15/f1b [0,4194304] 0 2024-05-08T05:32:01.752 INFO:tasks.workunit.client.0.smithi087.stdout:6/126: dwrite d4/d6/f13 [8388608,4194304] 0 2024-05-08T05:32:01.758 INFO:tasks.workunit.client.0.smithi087.stdout:6/127: symlink d4/d8/df/l29 0 2024-05-08T05:32:01.762 INFO:tasks.workunit.client.0.smithi087.stdout:3/129: sync 2024-05-08T05:32:01.762 INFO:tasks.workunit.client.0.smithi087.stdout:8/124: sync 2024-05-08T05:32:01.762 INFO:tasks.workunit.client.0.smithi087.stdout:9/102: sync 2024-05-08T05:32:01.763 INFO:tasks.workunit.client.0.smithi087.stdout:3/130: write d4/d11/f20 [53072,37641] 0 2024-05-08T05:32:01.763 INFO:tasks.workunit.client.0.smithi087.stdout:3/131: read - d4/f2a zero size 2024-05-08T05:32:01.765 INFO:tasks.workunit.client.0.smithi087.stdout:3/132: write d4/d14/f29 [587503,54767] 0 2024-05-08T05:32:01.765 INFO:tasks.workunit.client.0.smithi087.stdout:8/125: creat db/d23/f2e x:0 0 0 2024-05-08T05:32:01.766 INFO:tasks.workunit.client.0.smithi087.stdout:8/126: rename db/c16 to db/d23/d1b/c2f 0 2024-05-08T05:32:01.767 INFO:tasks.workunit.client.0.smithi087.stdout:8/127: write f8 [1346876,54701] 0 2024-05-08T05:32:01.767 INFO:tasks.workunit.client.0.smithi087.stdout:8/128: fsync f5 0 2024-05-08T05:32:01.769 INFO:tasks.workunit.client.0.smithi087.stdout:8/129: creat db/d23/d1b/f30 x:0 0 0 2024-05-08T05:32:01.769 INFO:tasks.workunit.client.0.smithi087.stdout:8/130: write db/f24 [162343,66861] 0 2024-05-08T05:32:01.769 INFO:tasks.workunit.client.0.smithi087.stdout:8/131: chown db/d23/d1b/f2b 5 1 2024-05-08T05:32:01.771 INFO:tasks.workunit.client.0.smithi087.stdout:4/133: dread d4/d13/f23 [0,4194304] 0 2024-05-08T05:32:01.773 INFO:tasks.workunit.client.0.smithi087.stdout:9/103: write d1/f15 [831981,120183] 0 2024-05-08T05:32:01.774 INFO:tasks.workunit.client.0.smithi087.stdout:4/134: link d4/d13/f2e d4/f2f 0 2024-05-08T05:32:01.776 INFO:tasks.workunit.client.0.smithi087.stdout:1/111: dwrite df/d12/f23 [0,4194304] 0 2024-05-08T05:32:01.776 INFO:tasks.workunit.client.0.smithi087.stdout:1/112: fdatasync df/f24 0 2024-05-08T05:32:01.779 INFO:tasks.workunit.client.0.smithi087.stdout:1/113: mkdir df/d18/d1d/d27 0 2024-05-08T05:32:01.790 INFO:tasks.workunit.client.0.smithi087.stdout:8/132: write f3 [3264157,111534] 0 2024-05-08T05:32:01.790 INFO:tasks.workunit.client.0.smithi087.stdout:8/133: chown f5 3924 1 2024-05-08T05:32:01.790 INFO:tasks.workunit.client.0.smithi087.stdout:9/104: fdatasync d1/f15 0 2024-05-08T05:32:01.795 INFO:tasks.workunit.client.0.smithi087.stdout:5/94: dwrite f2 [0,4194304] 0 2024-05-08T05:32:01.796 INFO:tasks.workunit.client.0.smithi087.stdout:8/134: symlink db/d23/l31 0 2024-05-08T05:32:01.796 INFO:tasks.workunit.client.0.smithi087.stdout:9/105: unlink d1/f15 0 2024-05-08T05:32:01.796 INFO:tasks.workunit.client.0.smithi087.stdout:3/133: write d4/d14/f1a [623679,79207] 0 2024-05-08T05:32:01.797 INFO:tasks.workunit.client.0.smithi087.stdout:9/106: write d1/f1a [354881,47062] 0 2024-05-08T05:32:01.798 INFO:tasks.workunit.client.0.smithi087.stdout:5/95: symlink da/db/l1b 0 2024-05-08T05:32:01.799 INFO:tasks.workunit.client.0.smithi087.stdout:3/134: mknod d4/d11/d24/c32 0 2024-05-08T05:32:01.801 INFO:tasks.workunit.client.0.smithi087.stdout:8/135: creat db/d23/d15/d29/f32 x:0 0 0 2024-05-08T05:32:01.802 INFO:tasks.workunit.client.0.smithi087.stdout:3/135: mknod d4/c33 0 2024-05-08T05:32:01.802 INFO:tasks.workunit.client.0.smithi087.stdout:7/104: dwrite d2/d6/d12/d1d/f13 [0,4194304] 0 2024-05-08T05:32:01.802 INFO:tasks.workunit.client.0.smithi087.stdout:7/105: write d2/da/f11 [1809693,56529] 0 2024-05-08T05:32:01.802 INFO:tasks.workunit.client.0.smithi087.stdout:7/106: chown d2/d6/d12/d15 785675 1 2024-05-08T05:32:01.803 INFO:tasks.workunit.client.0.smithi087.stdout:8/136: mkdir db/d23/d15/d29/d33 0 2024-05-08T05:32:01.814 INFO:tasks.workunit.client.0.smithi087.stdout:3/136: rename d4/f2a to d4/d11/d24/d25/f34 0 2024-05-08T05:32:01.814 INFO:tasks.workunit.client.0.smithi087.stdout:3/137: fsync d4/d11/f20 0 2024-05-08T05:32:01.814 INFO:tasks.workunit.client.0.smithi087.stdout:7/107: rename d2/d6/d12/d19 to d2/d6/d12/d19/d1f 22 2024-05-08T05:32:01.815 INFO:tasks.workunit.client.0.smithi087.stdout:7/108: mknod d2/da/c20 0 2024-05-08T05:32:01.816 INFO:tasks.workunit.client.0.smithi087.stdout:7/109: creat d2/da/f21 x:0 0 0 2024-05-08T05:32:01.816 INFO:tasks.workunit.client.0.smithi087.stdout:7/110: chown d2/da/f21 4967 1 2024-05-08T05:32:01.821 INFO:tasks.workunit.client.0.smithi087.stdout:3/138: dread d4/d14/f29 [0,4194304] 0 2024-05-08T05:32:01.826 INFO:tasks.workunit.client.0.smithi087.stdout:0/142: dwrite d0/f2 [0,4194304] 0 2024-05-08T05:32:01.827 INFO:tasks.workunit.client.0.smithi087.stdout:0/143: getdents d0/da/d35 0 2024-05-08T05:32:01.828 INFO:tasks.workunit.client.0.smithi087.stdout:6/128: dwrite f1 [8388608,4194304] 0 2024-05-08T05:32:01.829 INFO:tasks.workunit.client.0.smithi087.stdout:0/144: symlink d0/d9/df/l38 0 2024-05-08T05:32:01.829 INFO:tasks.workunit.client.0.smithi087.stdout:0/145: chown d0/d9/d23/d24/c2b 6 1 2024-05-08T05:32:01.845 INFO:tasks.workunit.client.0.smithi087.stdout:5/96: dwrite da/dd/f11 [0,4194304] 0 2024-05-08T05:32:01.846 INFO:tasks.workunit.client.0.smithi087.stdout:5/97: mknod da/dd/d10/c1c 0 2024-05-08T05:32:01.855 INFO:tasks.workunit.client.0.smithi087.stdout:4/135: dwrite f1 [4194304,4194304] 0 2024-05-08T05:32:01.855 INFO:tasks.workunit.client.0.smithi087.stdout:0/146: dread d0/d9/f12 [0,4194304] 0 2024-05-08T05:32:01.867 INFO:tasks.workunit.client.0.smithi087.stdout:5/98: dread f9 [0,4194304] 0 2024-05-08T05:32:01.867 INFO:tasks.workunit.client.0.smithi087.stdout:5/99: stat da/db/l1b 0 2024-05-08T05:32:01.869 INFO:tasks.workunit.client.0.smithi087.stdout:3/139: dwrite d4/d11/f20 [0,4194304] 0 2024-05-08T05:32:01.870 INFO:tasks.workunit.client.0.smithi087.stdout:3/140: truncate d4/d11/d24/f26 1300007 0 2024-05-08T05:32:01.870 INFO:tasks.workunit.client.0.smithi087.stdout:6/129: write d4/d8/df/f1a [1506459,41495] 0 2024-05-08T05:32:01.873 INFO:tasks.workunit.client.0.smithi087.stdout:3/141: getdents d4/d14 0 2024-05-08T05:32:01.873 INFO:tasks.workunit.client.0.smithi087.stdout:0/147: dread d0/da/d11/f20 [0,4194304] 0 2024-05-08T05:32:01.879 INFO:tasks.workunit.client.0.smithi087.stdout:7/111: write d2/d6/d12/d15/f1b [1909136,40277] 0 2024-05-08T05:32:01.879 INFO:tasks.workunit.client.0.smithi087.stdout:7/112: write d2/d6/fb [565810,34466] 0 2024-05-08T05:32:01.880 INFO:tasks.workunit.client.0.smithi087.stdout:8/137: dwrite fa [4194304,4194304] 0 2024-05-08T05:32:01.880 INFO:tasks.workunit.client.0.smithi087.stdout:8/138: write db/f25 [27323,60138] 0 2024-05-08T05:32:01.885 INFO:tasks.workunit.client.0.smithi087.stdout:6/130: dread f1 [4194304,4194304] 0 2024-05-08T05:32:01.885 INFO:tasks.workunit.client.0.smithi087.stdout:9/107: dwrite d1/df/f12 [0,4194304] 0 2024-05-08T05:32:01.886 INFO:tasks.workunit.client.0.smithi087.stdout:7/113: unlink d2/da/cd 0 2024-05-08T05:32:01.887 INFO:tasks.workunit.client.0.smithi087.stdout:7/114: chown d2/d6/d12/l1c 216 1 2024-05-08T05:32:01.887 INFO:tasks.workunit.client.0.smithi087.stdout:7/115: chown d2/da/lc 3 1 2024-05-08T05:32:01.887 INFO:tasks.workunit.client.0.smithi087.stdout:8/139: unlink db/cc 0 2024-05-08T05:32:01.890 INFO:tasks.workunit.client.0.smithi087.stdout:9/108: symlink d1/db/l20 0 2024-05-08T05:32:01.890 INFO:tasks.workunit.client.0.smithi087.stdout:0/148: dread d0/d9/f12 [0,4194304] 0 2024-05-08T05:32:01.891 INFO:tasks.workunit.client.0.smithi087.stdout:0/149: write d0/d9/fb [1172643,1479] 0 2024-05-08T05:32:01.891 INFO:tasks.workunit.client.0.smithi087.stdout:7/116: rename d2/d6/d12/d1d/f10 to d2/d6/d12/d19/f22 0 2024-05-08T05:32:01.891 INFO:tasks.workunit.client.0.smithi087.stdout:7/117: dread - d2/d6/d12/d19/f1e zero size 2024-05-08T05:32:01.891 INFO:tasks.workunit.client.0.smithi087.stdout:7/118: chown d2/d6/d12/d1d/f17 638963 1 2024-05-08T05:32:01.891 INFO:tasks.workunit.client.0.smithi087.stdout:9/109: creat d1/f21 x:0 0 0 2024-05-08T05:32:01.893 INFO:tasks.workunit.client.0.smithi087.stdout:7/119: mkdir d2/d6/d12/d1d/d23 0 2024-05-08T05:32:01.894 INFO:tasks.workunit.client.0.smithi087.stdout:9/110: mkdir d1/df/d14/d18/d22 0 2024-05-08T05:32:01.895 INFO:tasks.workunit.client.0.smithi087.stdout:7/120: mknod d2/d6/d12/c24 0 2024-05-08T05:32:01.895 INFO:tasks.workunit.client.0.smithi087.stdout:7/121: write d2/d6/fe [5036166,13925] 0 2024-05-08T05:32:01.895 INFO:tasks.workunit.client.0.smithi087.stdout:7/122: fdatasync d2/d6/d12/d19/f1e 0 2024-05-08T05:32:01.896 INFO:tasks.workunit.client.0.smithi087.stdout:9/111: creat d1/df/d14/d18/f23 x:0 0 0 2024-05-08T05:32:01.897 INFO:tasks.workunit.client.0.smithi087.stdout:7/123: creat d2/d6/f25 x:0 0 0 2024-05-08T05:32:01.897 INFO:tasks.workunit.client.0.smithi087.stdout:7/124: stat d2/d6/d12/l1c 0 2024-05-08T05:32:01.897 INFO:tasks.workunit.client.0.smithi087.stdout:7/125: write d2/da/f21 [121086,120887] 0 2024-05-08T05:32:01.897 INFO:tasks.workunit.client.0.smithi087.stdout:7/126: write d2/d6/d12/d19/f1e [107216,61698] 0 2024-05-08T05:32:01.899 INFO:tasks.workunit.client.0.smithi087.stdout:6/131: dread d4/d6/f13 [0,4194304] 0 2024-05-08T05:32:01.899 INFO:tasks.workunit.client.0.smithi087.stdout:6/132: chown d4 544825 1 2024-05-08T05:32:01.902 INFO:tasks.workunit.client.0.smithi087.stdout:9/112: symlink d1/df/d14/l24 0 2024-05-08T05:32:01.903 INFO:tasks.workunit.client.0.smithi087.stdout:9/113: fdatasync d1/db/fc 0 2024-05-08T05:32:01.904 INFO:tasks.workunit.client.0.smithi087.stdout:9/114: link d1/df/l1d d1/df/d14/l25 0 2024-05-08T05:32:01.904 INFO:tasks.workunit.client.0.smithi087.stdout:3/142: dread d4/fb [0,4194304] 0 2024-05-08T05:32:01.904 INFO:tasks.workunit.client.0.smithi087.stdout:3/143: chown d4/c17 0 1 2024-05-08T05:32:01.908 INFO:tasks.workunit.client.0.smithi087.stdout:1/114: sync 2024-05-08T05:32:01.908 INFO:tasks.workunit.client.0.smithi087.stdout:2/136: sync 2024-05-08T05:32:01.908 INFO:tasks.workunit.client.0.smithi087.stdout:2/137: chown d7/fd 28889 1 2024-05-08T05:32:01.908 INFO:tasks.workunit.client.0.smithi087.stdout:3/144: link d4/l31 d4/l35 0 2024-05-08T05:32:01.909 INFO:tasks.workunit.client.0.smithi087.stdout:1/115: creat df/d18/f28 x:0 0 0 2024-05-08T05:32:01.910 INFO:tasks.workunit.client.0.smithi087.stdout:2/138: creat d7/de/f2b x:0 0 0 2024-05-08T05:32:01.911 INFO:tasks.workunit.client.0.smithi087.stdout:1/116: creat df/d12/f29 x:0 0 0 2024-05-08T05:32:01.912 INFO:tasks.workunit.client.0.smithi087.stdout:2/139: rmdir d7/de/d26 39 2024-05-08T05:32:01.912 INFO:tasks.workunit.client.0.smithi087.stdout:3/145: rmdir d4 39 2024-05-08T05:32:01.915 INFO:tasks.workunit.client.0.smithi087.stdout:1/117: link l8 df/d18/l2a 0 2024-05-08T05:32:01.915 INFO:tasks.workunit.client.0.smithi087.stdout:5/100: dwrite f2 [4194304,4194304] 0 2024-05-08T05:32:01.916 INFO:tasks.workunit.client.0.smithi087.stdout:2/140: mkdir d7/de/d2c 0 2024-05-08T05:32:01.917 INFO:tasks.workunit.client.0.smithi087.stdout:3/146: symlink d4/d11/d24/d25/l36 0 2024-05-08T05:32:01.917 INFO:tasks.workunit.client.0.smithi087.stdout:3/147: truncate d4/d14/f28 4259401 0 2024-05-08T05:32:01.918 INFO:tasks.workunit.client.0.smithi087.stdout:1/118: symlink df/d18/l2b 0 2024-05-08T05:32:01.920 INFO:tasks.workunit.client.0.smithi087.stdout:3/148: rename d4/l31 to d4/l37 0 2024-05-08T05:32:01.921 INFO:tasks.workunit.client.0.smithi087.stdout:1/119: mknod df/c2c 0 2024-05-08T05:32:01.923 INFO:tasks.workunit.client.0.smithi087.stdout:3/149: rename d4/d14/f1f to d4/d11/f38 0 2024-05-08T05:32:01.923 INFO:tasks.workunit.client.0.smithi087.stdout:3/150: readlink d4/l37 0 2024-05-08T05:32:01.924 INFO:tasks.workunit.client.0.smithi087.stdout:1/120: rename df/f20 to df/d18/d1d/f2d 0 2024-05-08T05:32:01.925 INFO:tasks.workunit.client.0.smithi087.stdout:3/151: mkdir d4/d11/d24/d39 0 2024-05-08T05:32:01.925 INFO:tasks.workunit.client.0.smithi087.stdout:3/152: write d4/d14/f29 [1096142,15353] 0 2024-05-08T05:32:01.925 INFO:tasks.workunit.client.0.smithi087.stdout:3/153: chown d4/l2c 15 1 2024-05-08T05:32:01.926 INFO:tasks.workunit.client.0.smithi087.stdout:1/121: creat df/d18/d1d/f2e x:0 0 0 2024-05-08T05:32:01.927 INFO:tasks.workunit.client.0.smithi087.stdout:5/101: dread f9 [0,4194304] 0 2024-05-08T05:32:01.929 INFO:tasks.workunit.client.0.smithi087.stdout:0/150: dwrite d0/f29 [0,4194304] 0 2024-05-08T05:32:01.943 INFO:tasks.workunit.client.0.smithi087.stdout:3/154: write d4/d14/f28 [1798813,43927] 0 2024-05-08T05:32:01.944 INFO:tasks.workunit.client.0.smithi087.stdout:2/141: dread d7/fd [0,4194304] 0 2024-05-08T05:32:01.944 INFO:tasks.workunit.client.0.smithi087.stdout:2/142: fdatasync d7/f18 0 2024-05-08T05:32:01.944 INFO:tasks.workunit.client.0.smithi087.stdout:2/143: write d7/f1e [602435,45452] 0 2024-05-08T05:32:01.944 INFO:tasks.workunit.client.0.smithi087.stdout:2/144: truncate d7/de/d26/f1c 5032078 0 2024-05-08T05:32:01.947 INFO:tasks.workunit.client.0.smithi087.stdout:9/115: read d1/db/f1b [781035,81799] 0 2024-05-08T05:32:01.948 INFO:tasks.workunit.client.0.smithi087.stdout:7/127: dwrite d2/d6/d12/d15/f1b [4194304,4194304] 0 2024-05-08T05:32:01.962 INFO:tasks.workunit.client.0.smithi087.stdout:0/151: write d0/d9/f12 [1855259,105955] 0 2024-05-08T05:32:01.962 INFO:tasks.workunit.client.0.smithi087.stdout:0/152: dread - d0/da/d35/f37 zero size 2024-05-08T05:32:01.963 INFO:tasks.workunit.client.0.smithi087.stdout:3/155: write d4/d11/f38 [2860032,59068] 0 2024-05-08T05:32:01.968 INFO:tasks.workunit.client.0.smithi087.stdout:1/122: dwrite df/d18/d1d/f2d [0,4194304] 0 2024-05-08T05:32:01.970 INFO:tasks.workunit.client.0.smithi087.stdout:7/128: dread d2/d6/fe [0,4194304] 0 2024-05-08T05:32:01.970 INFO:tasks.workunit.client.0.smithi087.stdout:7/129: chown d2/d6/d12/d19/f1e 46093091 1 2024-05-08T05:32:01.970 INFO:tasks.workunit.client.0.smithi087.stdout:7/130: chown d2/da 29442147 1 2024-05-08T05:32:01.970 INFO:tasks.workunit.client.0.smithi087.stdout:7/131: chown d2 22 1 2024-05-08T05:32:01.970 INFO:tasks.workunit.client.0.smithi087.stdout:7/132: chown d2/d6 66916 1 2024-05-08T05:32:01.973 INFO:tasks.workunit.client.0.smithi087.stdout:5/102: dwrite f2 [4194304,4194304] 0 2024-05-08T05:32:01.980 INFO:tasks.workunit.client.0.smithi087.stdout:7/133: rename d2/d6/d12/l1c to d2/d6/d12/d19/l26 0 2024-05-08T05:32:01.980 INFO:tasks.workunit.client.0.smithi087.stdout:5/103: rename da/dd to da/dd/d10/d17/d1d 22 2024-05-08T05:32:01.985 INFO:tasks.workunit.client.0.smithi087.stdout:7/134: rename d2/d6/fb to d2/f27 0 2024-05-08T05:32:01.986 INFO:tasks.workunit.client.0.smithi087.stdout:7/135: creat d2/d6/d12/d15/f28 x:0 0 0 2024-05-08T05:32:01.988 INFO:tasks.workunit.client.0.smithi087.stdout:7/136: mkdir d2/d6/d12/d15/d29 0 2024-05-08T05:32:01.988 INFO:tasks.workunit.client.0.smithi087.stdout:7/137: write d2/d6/d12/d1d/f17 [142248,72382] 0 2024-05-08T05:32:01.988 INFO:tasks.workunit.client.0.smithi087.stdout:9/116: write d1/f8 [2999528,108081] 0 2024-05-08T05:32:01.988 INFO:tasks.workunit.client.0.smithi087.stdout:9/117: stat d1/df/d14/c1c 0 2024-05-08T05:32:01.988 INFO:tasks.workunit.client.0.smithi087.stdout:9/118: write d1/db/f1b [3322537,83732] 0 2024-05-08T05:32:01.989 INFO:tasks.workunit.client.0.smithi087.stdout:7/138: getdents d2/d6/d12/d1d 0 2024-05-08T05:32:01.989 INFO:tasks.workunit.client.0.smithi087.stdout:7/139: rmdir d2/d6/d12/d15 39 2024-05-08T05:32:01.991 INFO:tasks.workunit.client.0.smithi087.stdout:7/140: unlink d2/d6/d12/d15/f1b 0 2024-05-08T05:32:01.992 INFO:tasks.workunit.client.0.smithi087.stdout:7/141: fdatasync d2/d6/f25 0 2024-05-08T05:32:01.993 INFO:tasks.workunit.client.0.smithi087.stdout:7/142: mkdir d2/d6/d12/d19/d2a 0 2024-05-08T05:32:01.998 INFO:tasks.workunit.client.0.smithi087.stdout:7/143: link d2/d6/d12/d1d/c1a d2/c2b 0 2024-05-08T05:32:01.998 INFO:tasks.workunit.client.0.smithi087.stdout:4/136: sync 2024-05-08T05:32:01.999 INFO:tasks.workunit.client.0.smithi087.stdout:9/119: dread d1/f4 [0,4194304] 0 2024-05-08T05:32:01.999 INFO:tasks.workunit.client.0.smithi087.stdout:9/120: write d1/f7 [1293326,83159] 0 2024-05-08T05:32:02.000 INFO:tasks.workunit.client.0.smithi087.stdout:5/104: write f2 [1156138,4554] 0 2024-05-08T05:32:02.004 INFO:tasks.workunit.client.0.smithi087.stdout:5/105: fsync f9 0 2024-05-08T05:32:02.005 INFO:tasks.workunit.client.0.smithi087.stdout:2/145: dwrite d7/f22 [4194304,4194304] 0 2024-05-08T05:32:02.008 INFO:tasks.workunit.client.0.smithi087.stdout:7/144: dread d2/d6/d12/d1d/f17 [0,4194304] 0 2024-05-08T05:32:02.013 INFO:tasks.workunit.client.0.smithi087.stdout:7/145: rmdir d2/d6 39 2024-05-08T05:32:02.013 INFO:tasks.workunit.client.0.smithi087.stdout:7/146: write d2/d6/d12/d1d/f17 [1011378,1649] 0 2024-05-08T05:32:02.014 INFO:tasks.workunit.client.0.smithi087.stdout:7/147: symlink d2/d6/d12/d19/d2a/l2c 0 2024-05-08T05:32:02.017 INFO:tasks.workunit.client.0.smithi087.stdout:1/123: write df/f11 [1636209,116204] 0 2024-05-08T05:32:02.017 INFO:tasks.workunit.client.0.smithi087.stdout:1/124: chown df/d18 27671638 1 2024-05-08T05:32:02.024 INFO:tasks.workunit.client.0.smithi087.stdout:4/137: read d4/f9 [106842,63399] 0 2024-05-08T05:32:02.024 INFO:tasks.workunit.client.0.smithi087.stdout:4/138: fdatasync d4/d25/f29 0 2024-05-08T05:32:02.024 INFO:tasks.workunit.client.0.smithi087.stdout:7/148: dread d2/da/f21 [0,4194304] 0 2024-05-08T05:32:02.024 INFO:tasks.workunit.client.0.smithi087.stdout:7/149: dread - d2/d6/f25 zero size 2024-05-08T05:32:02.025 INFO:tasks.workunit.client.0.smithi087.stdout:9/121: dread d1/df/f12 [0,4194304] 0 2024-05-08T05:32:02.026 INFO:tasks.workunit.client.0.smithi087.stdout:3/156: dwrite d4/d11/d24/d25/f34 [0,4194304] 0 2024-05-08T05:32:02.026 INFO:tasks.workunit.client.0.smithi087.stdout:2/146: dread d7/de/d26/f23 [0,4194304] 0 2024-05-08T05:32:02.026 INFO:tasks.workunit.client.0.smithi087.stdout:3/157: stat d4/f21 0 2024-05-08T05:32:02.027 INFO:tasks.workunit.client.0.smithi087.stdout:2/147: fdatasync d7/f1e 0 2024-05-08T05:32:02.027 INFO:tasks.workunit.client.0.smithi087.stdout:5/106: dread da/dd/f11 [0,4194304] 0 2024-05-08T05:32:02.027 INFO:tasks.workunit.client.0.smithi087.stdout:1/125: mkdir df/d2f 0 2024-05-08T05:32:02.028 INFO:tasks.workunit.client.0.smithi087.stdout:4/139: getdents d4/d13 0 2024-05-08T05:32:02.030 INFO:tasks.workunit.client.0.smithi087.stdout:7/150: creat d2/d6/d12/d19/f2d x:0 0 0 2024-05-08T05:32:02.030 INFO:tasks.workunit.client.0.smithi087.stdout:9/122: creat d1/df/d14/d18/d22/f26 x:0 0 0 2024-05-08T05:32:02.040 INFO:tasks.workunit.client.0.smithi087.stdout:0/153: dwrite d0/d9/f1a [0,4194304] 0 2024-05-08T05:32:02.041 INFO:tasks.workunit.client.0.smithi087.stdout:3/158: symlink d4/l3a 0 2024-05-08T05:32:02.041 INFO:tasks.workunit.client.0.smithi087.stdout:5/107: write da/dd/f11 [3923295,57055] 0 2024-05-08T05:32:02.041 INFO:tasks.workunit.client.0.smithi087.stdout:9/123: mknod d1/df/d14/d18/d22/c27 0 2024-05-08T05:32:02.042 INFO:tasks.workunit.client.0.smithi087.stdout:9/124: readlink d1/db/le 0 2024-05-08T05:32:02.042 INFO:tasks.workunit.client.0.smithi087.stdout:2/148: mkdir d7/d2d 0 2024-05-08T05:32:02.042 INFO:tasks.workunit.client.0.smithi087.stdout:4/140: dread d4/f10 [0,4194304] 0 2024-05-08T05:32:02.044 INFO:tasks.workunit.client.0.smithi087.stdout:5/108: creat da/db/f1e x:0 0 0 2024-05-08T05:32:02.045 INFO:tasks.workunit.client.0.smithi087.stdout:4/141: symlink d4/d13/l30 0 2024-05-08T05:32:02.047 INFO:tasks.workunit.client.0.smithi087.stdout:0/154: mknod d0/d9/c39 0 2024-05-08T05:32:02.047 INFO:tasks.workunit.client.0.smithi087.stdout:0/155: chown d0/d9/f1a 234 1 2024-05-08T05:32:02.047 INFO:tasks.workunit.client.0.smithi087.stdout:5/109: fdatasync da/dd/f11 0 2024-05-08T05:32:02.049 INFO:tasks.workunit.client.0.smithi087.stdout:4/142: unlink d4/f9 0 2024-05-08T05:32:02.063 INFO:tasks.workunit.client.0.smithi087.stdout:0/156: creat d0/da/f3a x:0 0 0 2024-05-08T05:32:02.063 INFO:tasks.workunit.client.0.smithi087.stdout:3/159: dread d4/fb [0,4194304] 0 2024-05-08T05:32:02.063 INFO:tasks.workunit.client.0.smithi087.stdout:8/140: sync 2024-05-08T05:32:02.063 INFO:tasks.workunit.client.0.smithi087.stdout:3/160: fsync d4/f6 0 2024-05-08T05:32:02.063 INFO:tasks.workunit.client.0.smithi087.stdout:8/141: chown db/d23/d1b/f30 359263637 1 2024-05-08T05:32:02.065 INFO:tasks.workunit.client.0.smithi087.stdout:6/133: sync 2024-05-08T05:32:02.065 INFO:tasks.workunit.client.0.smithi087.stdout:6/134: chown d4/f16 0 1 2024-05-08T05:32:02.066 INFO:tasks.workunit.client.0.smithi087.stdout:6/135: read - d4/d8/f21 zero size 2024-05-08T05:32:02.067 INFO:tasks.workunit.client.0.smithi087.stdout:5/110: dread f9 [4194304,4194304] 0 2024-05-08T05:32:02.067 INFO:tasks.workunit.client.0.smithi087.stdout:3/161: mknod d4/d11/d24/c3b 0 2024-05-08T05:32:02.068 INFO:tasks.workunit.client.0.smithi087.stdout:2/149: write f6 [597239,93415] 0 2024-05-08T05:32:02.068 INFO:tasks.workunit.client.0.smithi087.stdout:2/150: truncate d7/de/f24 606321 0 2024-05-08T05:32:02.069 INFO:tasks.workunit.client.0.smithi087.stdout:9/125: write d1/db/fc [3501948,71513] 0 2024-05-08T05:32:02.072 INFO:tasks.workunit.client.0.smithi087.stdout:6/136: mkdir d4/d2a 0 2024-05-08T05:32:02.072 INFO:tasks.workunit.client.0.smithi087.stdout:5/111: truncate f7 180689 0 2024-05-08T05:32:02.075 INFO:tasks.workunit.client.0.smithi087.stdout:2/151: rename d7/f8 to d7/de/d27/f2e 0 2024-05-08T05:32:02.075 INFO:tasks.workunit.client.0.smithi087.stdout:2/152: write d7/f1e [1450006,6052] 0 2024-05-08T05:32:02.077 INFO:tasks.workunit.client.0.smithi087.stdout:5/112: mknod da/db/c1f 0 2024-05-08T05:32:02.078 INFO:tasks.workunit.client.0.smithi087.stdout:6/137: mknod d4/d8/df/d1e/c2b 0 2024-05-08T05:32:02.079 INFO:tasks.workunit.client.0.smithi087.stdout:1/126: dwrite df/d12/f1a [0,4194304] 0 2024-05-08T05:32:02.084 INFO:tasks.workunit.client.0.smithi087.stdout:2/153: link d7/de/c16 d7/c2f 0 2024-05-08T05:32:02.084 INFO:tasks.workunit.client.0.smithi087.stdout:7/151: dwrite d2/d6/d12/d1d/f13 [0,4194304] 0 2024-05-08T05:32:02.084 INFO:tasks.workunit.client.0.smithi087.stdout:6/138: rename d4/d8/l1d to d4/d8/df/d1e/l2c 0 2024-05-08T05:32:02.084 INFO:tasks.workunit.client.0.smithi087.stdout:5/113: mknod da/dd/d13/c20 0 2024-05-08T05:32:02.084 INFO:tasks.workunit.client.0.smithi087.stdout:6/139: fsync d4/d6/fa 0 2024-05-08T05:32:02.085 INFO:tasks.workunit.client.0.smithi087.stdout:6/140: fsync d4/f12 0 2024-05-08T05:32:02.087 INFO:tasks.workunit.client.0.smithi087.stdout:5/114: symlink da/dd/d13/d16/l21 0 2024-05-08T05:32:02.087 INFO:tasks.workunit.client.0.smithi087.stdout:5/115: chown da/dd/f11 1190 1 2024-05-08T05:32:02.087 INFO:tasks.workunit.client.0.smithi087.stdout:5/116: chown da/dd/d10/d17 651417073 1 2024-05-08T05:32:02.094 INFO:tasks.workunit.client.0.smithi087.stdout:0/157: read d0/d9/f1a [2100518,43989] 0 2024-05-08T05:32:02.097 INFO:tasks.workunit.client.0.smithi087.stdout:7/152: dread d2/d6/d12/d1d/f13 [0,4194304] 0 2024-05-08T05:32:02.098 INFO:tasks.workunit.client.0.smithi087.stdout:3/162: dwrite d4/f5 [0,4194304] 0 2024-05-08T05:32:02.099 INFO:tasks.workunit.client.0.smithi087.stdout:7/153: unlink d2/da/f21 0 2024-05-08T05:32:02.103 INFO:tasks.workunit.client.0.smithi087.stdout:3/163: creat d4/f3c x:0 0 0 2024-05-08T05:32:02.104 INFO:tasks.workunit.client.0.smithi087.stdout:3/164: fdatasync d4/f1d 0 2024-05-08T05:32:02.113 INFO:tasks.workunit.client.0.smithi087.stdout:9/126: dwrite d1/f8 [4194304,4194304] 0 2024-05-08T05:32:02.113 INFO:tasks.workunit.client.0.smithi087.stdout:9/127: write d1/f8 [3941998,65936] 0 2024-05-08T05:32:02.134 INFO:tasks.workunit.client.0.smithi087.stdout:9/128: dread d1/f8 [0,4194304] 0 2024-05-08T05:32:02.134 INFO:tasks.workunit.client.0.smithi087.stdout:9/129: read d1/db/fc [1062462,45906] 0 2024-05-08T05:32:02.137 INFO:tasks.workunit.client.0.smithi087.stdout:8/142: dwrite f3 [4194304,4194304] 0 2024-05-08T05:32:02.141 INFO:tasks.workunit.client.0.smithi087.stdout:8/143: rename db/d23/d15/f1d to db/d23/d15/f34 0 2024-05-08T05:32:02.142 INFO:tasks.workunit.client.0.smithi087.stdout:8/144: mkdir db/d23/d1b/d35 0 2024-05-08T05:32:02.145 INFO:tasks.workunit.client.0.smithi087.stdout:8/145: creat db/d23/d15/f36 x:0 0 0 2024-05-08T05:32:02.146 INFO:tasks.workunit.client.0.smithi087.stdout:9/130: write d1/df/f12 [827747,46732] 0 2024-05-08T05:32:02.146 INFO:tasks.workunit.client.0.smithi087.stdout:9/131: write d1/df/d14/f17 [363359,47670] 0 2024-05-08T05:32:02.146 INFO:tasks.workunit.client.0.smithi087.stdout:9/132: chown d1/f7 35953 1 2024-05-08T05:32:02.148 INFO:tasks.workunit.client.0.smithi087.stdout:9/133: mkdir d1/db/d28 0 2024-05-08T05:32:02.149 INFO:tasks.workunit.client.0.smithi087.stdout:6/141: dwrite d4/d6/fa [0,4194304] 0 2024-05-08T05:32:02.149 INFO:tasks.workunit.client.0.smithi087.stdout:9/134: symlink d1/df/d14/l29 0 2024-05-08T05:32:02.151 INFO:tasks.workunit.client.0.smithi087.stdout:6/142: mkdir d4/d8/df/d1e/d25/d28/d2d 0 2024-05-08T05:32:02.151 INFO:tasks.workunit.client.0.smithi087.stdout:9/135: mknod d1/db/c2a 0 2024-05-08T05:32:02.153 INFO:tasks.workunit.client.0.smithi087.stdout:6/143: creat d4/d8/f2e x:0 0 0 2024-05-08T05:32:02.155 INFO:tasks.workunit.client.0.smithi087.stdout:9/136: unlink d1/f4 0 2024-05-08T05:32:02.157 INFO:tasks.workunit.client.0.smithi087.stdout:9/137: symlink d1/df/d14/d18/l2b 0 2024-05-08T05:32:02.158 INFO:tasks.workunit.client.0.smithi087.stdout:0/158: dwrite d0/d9/f1a [0,4194304] 0 2024-05-08T05:32:02.160 INFO:tasks.workunit.client.0.smithi087.stdout:0/159: mknod d0/d9/d1b/d2f/c3b 0 2024-05-08T05:32:02.171 INFO:tasks.workunit.client.0.smithi087.stdout:1/127: dwrite df/d18/f1b [0,4194304] 0 2024-05-08T05:32:02.174 INFO:tasks.workunit.client.0.smithi087.stdout:0/160: dread d0/d9/f12 [0,4194304] 0 2024-05-08T05:32:02.174 INFO:tasks.workunit.client.0.smithi087.stdout:0/161: chown d0/d9/df/f15 5 1 2024-05-08T05:32:02.176 INFO:tasks.workunit.client.0.smithi087.stdout:1/128: rename df/d18/d1d/f2e to df/d18/f30 0 2024-05-08T05:32:02.177 INFO:tasks.workunit.client.0.smithi087.stdout:2/154: dwrite d7/f22 [0,4194304] 0 2024-05-08T05:32:02.177 INFO:tasks.workunit.client.0.smithi087.stdout:2/155: chown d7/de/l1b 73885 1 2024-05-08T05:32:02.180 INFO:tasks.workunit.client.0.smithi087.stdout:6/144: dread d4/fd [4194304,4194304] 0 2024-05-08T05:32:02.180 INFO:tasks.workunit.client.0.smithi087.stdout:6/145: chown d4/d8/df/d1e/d25/l27 316 1 2024-05-08T05:32:02.181 INFO:tasks.workunit.client.0.smithi087.stdout:2/156: creat d7/de/d26/f30 x:0 0 0 2024-05-08T05:32:02.182 INFO:tasks.workunit.client.0.smithi087.stdout:6/146: creat d4/d8/df/d1e/d25/f2f x:0 0 0 2024-05-08T05:32:02.183 INFO:tasks.workunit.client.0.smithi087.stdout:2/157: truncate d7/de/d26/f1c 3522069 0 2024-05-08T05:32:02.184 INFO:tasks.workunit.client.0.smithi087.stdout:3/165: dwrite d4/d11/d24/f26 [0,4194304] 0 2024-05-08T05:32:02.184 INFO:tasks.workunit.client.0.smithi087.stdout:6/147: rmdir d4/d8/df/d1e 39 2024-05-08T05:32:02.186 INFO:tasks.workunit.client.0.smithi087.stdout:2/158: rmdir d7/de/d27 39 2024-05-08T05:32:02.190 INFO:tasks.workunit.client.0.smithi087.stdout:3/166: mkdir d4/d11/d3d 0 2024-05-08T05:32:02.190 INFO:tasks.workunit.client.0.smithi087.stdout:3/167: write d4/f21 [935972,5668] 0 2024-05-08T05:32:02.190 INFO:tasks.workunit.client.0.smithi087.stdout:8/146: dwrite f9 [4194304,4194304] 0 2024-05-08T05:32:02.191 INFO:tasks.workunit.client.0.smithi087.stdout:2/159: creat d7/de/d2c/f31 x:0 0 0 2024-05-08T05:32:02.195 INFO:tasks.workunit.client.0.smithi087.stdout:3/168: truncate d4/d14/f29 107165 0 2024-05-08T05:32:02.195 INFO:tasks.workunit.client.0.smithi087.stdout:3/169: dread - d4/d11/f23 zero size 2024-05-08T05:32:02.195 INFO:tasks.workunit.client.0.smithi087.stdout:8/147: rename db/f24 to db/f37 0 2024-05-08T05:32:02.197 INFO:tasks.workunit.client.0.smithi087.stdout:8/148: creat db/d23/f38 x:0 0 0 2024-05-08T05:32:02.199 INFO:tasks.workunit.client.0.smithi087.stdout:2/160: dread d7/f17 [0,4194304] 0 2024-05-08T05:32:02.199 INFO:tasks.workunit.client.0.smithi087.stdout:2/161: stat d7/de/d26 0 2024-05-08T05:32:02.200 INFO:tasks.workunit.client.0.smithi087.stdout:8/149: read - db/d23/d15/f1e zero size 2024-05-08T05:32:02.202 INFO:tasks.workunit.client.0.smithi087.stdout:4/143: sync 2024-05-08T05:32:02.202 INFO:tasks.workunit.client.0.smithi087.stdout:3/170: dread d4/f6 [0,4194304] 0 2024-05-08T05:32:02.202 INFO:tasks.workunit.client.0.smithi087.stdout:8/150: creat db/f39 x:0 0 0 2024-05-08T05:32:02.203 INFO:tasks.workunit.client.0.smithi087.stdout:2/162: link l0 d7/l32 0 2024-05-08T05:32:02.206 INFO:tasks.workunit.client.0.smithi087.stdout:4/144: creat d4/d13/f31 x:0 0 0 2024-05-08T05:32:02.206 INFO:tasks.workunit.client.0.smithi087.stdout:6/148: dread d4/fd [8388608,4194304] 0 2024-05-08T05:32:02.206 INFO:tasks.workunit.client.0.smithi087.stdout:6/149: read d4/d6/f13 [2529656,53683] 0 2024-05-08T05:32:02.207 INFO:tasks.workunit.client.0.smithi087.stdout:2/163: rename d7/de/d26 to d7/de/d27/d33 0 2024-05-08T05:32:02.209 INFO:tasks.workunit.client.0.smithi087.stdout:9/138: dwrite d1/f21 [0,4194304] 0 2024-05-08T05:32:02.209 INFO:tasks.workunit.client.0.smithi087.stdout:9/139: truncate d1/f1a 1284479 0 2024-05-08T05:32:02.218 INFO:tasks.workunit.client.0.smithi087.stdout:0/162: dwrite d0/d9/f10 [0,4194304] 0 2024-05-08T05:32:02.218 INFO:tasks.workunit.client.0.smithi087.stdout:0/163: fdatasync d0/da/f16 0 2024-05-08T05:32:02.218 INFO:tasks.workunit.client.0.smithi087.stdout:6/150: mknod d4/d8/df/d1e/c30 0 2024-05-08T05:32:02.219 INFO:tasks.workunit.client.0.smithi087.stdout:2/164: mknod d7/de/d2c/c34 0 2024-05-08T05:32:02.219 INFO:tasks.workunit.client.0.smithi087.stdout:4/145: getdents d4/d13 0 2024-05-08T05:32:02.220 INFO:tasks.workunit.client.0.smithi087.stdout:4/146: write d4/f22 [1862106,58771] 0 2024-05-08T05:32:02.220 INFO:tasks.workunit.client.0.smithi087.stdout:4/147: fsync d4/d25/f29 0 2024-05-08T05:32:02.220 INFO:tasks.workunit.client.0.smithi087.stdout:4/148: truncate d4/d25/f27 2038346 0 2024-05-08T05:32:02.220 INFO:tasks.workunit.client.0.smithi087.stdout:4/149: chown d4/l2d 160664 1 2024-05-08T05:32:02.220 INFO:tasks.workunit.client.0.smithi087.stdout:0/164: mkdir d0/d22/d3c 0 2024-05-08T05:32:02.222 INFO:tasks.workunit.client.0.smithi087.stdout:9/140: dread d1/f8 [4194304,4194304] 0 2024-05-08T05:32:02.222 INFO:tasks.workunit.client.0.smithi087.stdout:9/141: write d1/df/f12 [2647340,101591] 0 2024-05-08T05:32:02.225 INFO:tasks.workunit.client.0.smithi087.stdout:2/165: symlink d7/de/l35 0 2024-05-08T05:32:02.225 INFO:tasks.workunit.client.0.smithi087.stdout:4/150: mkdir d4/d13/d32 0 2024-05-08T05:32:02.226 INFO:tasks.workunit.client.0.smithi087.stdout:9/142: creat d1/df/f2c x:0 0 0 2024-05-08T05:32:02.227 INFO:tasks.workunit.client.0.smithi087.stdout:9/143: unlink d1/df/d14/l25 0 2024-05-08T05:32:02.228 INFO:tasks.workunit.client.0.smithi087.stdout:9/144: creat d1/df/d14/d18/d22/f2d x:0 0 0 2024-05-08T05:32:02.229 INFO:tasks.workunit.client.0.smithi087.stdout:9/145: rmdir d1/df/d14/d18/d22 39 2024-05-08T05:32:02.229 INFO:tasks.workunit.client.0.smithi087.stdout:9/146: chown d1/db/f1b 117 1 2024-05-08T05:32:02.258 INFO:tasks.workunit.client.0.smithi087.stdout:0/165: dread d0/d9/d23/f2a [0,4194304] 0 2024-05-08T05:32:02.259 INFO:tasks.workunit.client.0.smithi087.stdout:8/151: dwrite f6 [0,4194304] 0 2024-05-08T05:32:02.260 INFO:tasks.workunit.client.0.smithi087.stdout:9/147: dread d1/fd [0,4194304] 0 2024-05-08T05:32:02.260 INFO:tasks.workunit.client.0.smithi087.stdout:9/148: dread - d1/df/d14/d18/f1e zero size 2024-05-08T05:32:02.260 INFO:tasks.workunit.client.0.smithi087.stdout:9/149: readlink d1/df/l1d 0 2024-05-08T05:32:02.264 INFO:tasks.workunit.client.0.smithi087.stdout:6/151: dread d4/d8/f18 [4194304,4194304] 0 2024-05-08T05:32:02.264 INFO:tasks.workunit.client.0.smithi087.stdout:0/166: getdents d0/d9/d1b 0 2024-05-08T05:32:02.264 INFO:tasks.workunit.client.0.smithi087.stdout:3/171: dwrite d4/d11/d24/f26 [0,4194304] 0 2024-05-08T05:32:02.267 INFO:tasks.workunit.client.0.smithi087.stdout:9/150: creat d1/db/d28/f2e x:0 0 0 2024-05-08T05:32:02.268 INFO:tasks.workunit.client.0.smithi087.stdout:6/152: rmdir d4/d8/df/d1e 39 2024-05-08T05:32:02.270 INFO:tasks.workunit.client.0.smithi087.stdout:9/151: creat d1/df/d14/f2f x:0 0 0 2024-05-08T05:32:02.271 INFO:tasks.workunit.client.0.smithi087.stdout:6/153: link d4/d8/f2e d4/d8/df/f31 0 2024-05-08T05:32:02.273 INFO:tasks.workunit.client.0.smithi087.stdout:6/154: link d4/d8/df/c24 d4/d8/c32 0 2024-05-08T05:32:02.273 INFO:tasks.workunit.client.0.smithi087.stdout:6/155: fdatasync d4/d8/df/f10 0 2024-05-08T05:32:02.273 INFO:tasks.workunit.client.0.smithi087.stdout:6/156: stat d4/f12 0 2024-05-08T05:32:02.275 INFO:tasks.workunit.client.0.smithi087.stdout:5/117: sync 2024-05-08T05:32:02.275 INFO:tasks.workunit.client.0.smithi087.stdout:5/118: write f9 [3174081,130902] 0 2024-05-08T05:32:02.276 INFO:tasks.workunit.client.0.smithi087.stdout:5/119: symlink da/dd/d10/l22 0 2024-05-08T05:32:02.277 INFO:tasks.workunit.client.0.smithi087.stdout:5/120: mknod da/db/c23 0 2024-05-08T05:32:02.277 INFO:tasks.workunit.client.0.smithi087.stdout:5/121: readlink da/dd/d13/d16/l21 0 2024-05-08T05:32:02.277 INFO:tasks.workunit.client.0.smithi087.stdout:5/122: readlink da/dd/d13/l19 0 2024-05-08T05:32:02.278 INFO:tasks.workunit.client.0.smithi087.stdout:5/123: rmdir da/dd 39 2024-05-08T05:32:02.281 INFO:tasks.workunit.client.0.smithi087.stdout:2/166: dwrite f5 [0,4194304] 0 2024-05-08T05:32:02.281 INFO:tasks.workunit.client.0.smithi087.stdout:0/167: write d0/da/f1e [2320028,46042] 0 2024-05-08T05:32:02.287 INFO:tasks.workunit.client.0.smithi087.stdout:0/168: creat d0/da/d35/f3d x:0 0 0 2024-05-08T05:32:02.290 INFO:tasks.workunit.client.0.smithi087.stdout:0/169: creat d0/d9/d1b/f3e x:0 0 0 2024-05-08T05:32:02.296 INFO:tasks.workunit.client.0.smithi087.stdout:4/151: dwrite d4/d13/f31 [0,4194304] 0 2024-05-08T05:32:02.296 INFO:tasks.workunit.client.0.smithi087.stdout:4/152: chown d4/f2f 267 1 2024-05-08T05:32:02.296 INFO:tasks.workunit.client.0.smithi087.stdout:8/152: dread f9 [0,4194304] 0 2024-05-08T05:32:02.301 INFO:tasks.workunit.client.0.smithi087.stdout:0/170: dread d0/d9/df/f15 [0,4194304] 0 2024-05-08T05:32:02.302 INFO:tasks.workunit.client.0.smithi087.stdout:0/171: readlink d0/d22/l36 0 2024-05-08T05:32:02.303 INFO:tasks.workunit.client.0.smithi087.stdout:4/153: unlink d4/f22 0 2024-05-08T05:32:02.304 INFO:tasks.workunit.client.0.smithi087.stdout:4/154: dread - d4/d25/f29 zero size 2024-05-08T05:32:02.307 INFO:tasks.workunit.client.0.smithi087.stdout:7/154: sync 2024-05-08T05:32:02.309 INFO:tasks.workunit.client.0.smithi087.stdout:7/155: rename d2/d6/fe to d2/d6/d12/d1d/f2e 0 2024-05-08T05:32:02.312 INFO:tasks.workunit.client.0.smithi087.stdout:0/172: dread d0/d9/df/f15 [0,4194304] 0 2024-05-08T05:32:02.322 INFO:tasks.workunit.client.0.smithi087.stdout:7/156: dread d2/d6/d12/d1d/f2e [4194304,4194304] 0 2024-05-08T05:32:02.324 INFO:tasks.workunit.client.0.smithi087.stdout:7/157: write d2/d6/d12/d19/f1e [575368,126305] 0 2024-05-08T05:32:02.324 INFO:tasks.workunit.client.0.smithi087.stdout:7/158: stat d2/f4 0 2024-05-08T05:32:02.330 INFO:tasks.workunit.client.0.smithi087.stdout:2/167: dwrite f6 [0,4194304] 0 2024-05-08T05:32:02.330 INFO:tasks.workunit.client.0.smithi087.stdout:6/157: dwrite d4/d8/df/f31 [0,4194304] 0 2024-05-08T05:32:02.334 INFO:tasks.workunit.client.0.smithi087.stdout:2/168: unlink d7/f1f 0 2024-05-08T05:32:02.334 INFO:tasks.workunit.client.0.smithi087.stdout:0/173: dread d0/da/d11/f20 [0,4194304] 0 2024-05-08T05:32:02.334 INFO:tasks.workunit.client.0.smithi087.stdout:2/169: chown d7/de/d27/d33/f30 122 1 2024-05-08T05:32:02.334 INFO:tasks.workunit.client.0.smithi087.stdout:5/124: dwrite f7 [0,4194304] 0 2024-05-08T05:32:02.335 INFO:tasks.workunit.client.0.smithi087.stdout:7/159: dread d2/d6/d12/d19/f22 [0,4194304] 0 2024-05-08T05:32:02.335 INFO:tasks.workunit.client.0.smithi087.stdout:7/160: write d2/f4 [1430131,128314] 0 2024-05-08T05:32:02.336 INFO:tasks.workunit.client.0.smithi087.stdout:5/125: truncate da/dd/f11 2668293 0 2024-05-08T05:32:02.337 INFO:tasks.workunit.client.0.smithi087.stdout:7/161: creat d2/d6/d12/d1d/d23/f2f x:0 0 0 2024-05-08T05:32:02.340 INFO:tasks.workunit.client.0.smithi087.stdout:8/153: dwrite db/d23/d15/f2c [0,4194304] 0 2024-05-08T05:32:02.341 INFO:tasks.workunit.client.0.smithi087.stdout:8/154: dread - db/d23/d1b/f2b zero size 2024-05-08T05:32:02.342 INFO:tasks.workunit.client.0.smithi087.stdout:5/126: unlink da/db/f1e 0 2024-05-08T05:32:02.342 INFO:tasks.workunit.client.0.smithi087.stdout:5/127: readlink da/db/l1b 0 2024-05-08T05:32:02.342 INFO:tasks.workunit.client.0.smithi087.stdout:7/162: rmdir d2/d6/d12/d1d/d23 39 2024-05-08T05:32:02.343 INFO:tasks.workunit.client.0.smithi087.stdout:1/129: sync 2024-05-08T05:32:02.343 INFO:tasks.workunit.client.0.smithi087.stdout:1/130: stat df/d18/d1d/f2d 0 2024-05-08T05:32:02.343 INFO:tasks.workunit.client.0.smithi087.stdout:1/131: fdatasync df/f1f 0 2024-05-08T05:32:02.345 INFO:tasks.workunit.client.0.smithi087.stdout:5/128: unlink da/dd/d13/c20 0 2024-05-08T05:32:02.345 INFO:tasks.workunit.client.0.smithi087.stdout:5/129: truncate da/dd/f11 3353097 0 2024-05-08T05:32:02.345 INFO:tasks.workunit.client.0.smithi087.stdout:5/130: chown da/dd/d13/d16/l21 5438 1 2024-05-08T05:32:02.346 INFO:tasks.workunit.client.0.smithi087.stdout:7/163: link d2/f4 d2/d6/d12/d15/d29/f30 0 2024-05-08T05:32:02.346 INFO:tasks.workunit.client.0.smithi087.stdout:7/164: truncate d2/d6/d12/d1d/f17 1813654 0 2024-05-08T05:32:02.346 INFO:tasks.workunit.client.0.smithi087.stdout:7/165: fsync d2/d6/d12/d19/f2d 0 2024-05-08T05:32:02.346 INFO:tasks.workunit.client.0.smithi087.stdout:7/166: read - d2/d6/f25 zero size 2024-05-08T05:32:02.348 INFO:tasks.workunit.client.0.smithi087.stdout:5/131: rename da/dd/d10/l22 to da/dd/l24 0 2024-05-08T05:32:02.349 INFO:tasks.workunit.client.0.smithi087.stdout:5/132: creat da/db/f25 x:0 0 0 2024-05-08T05:32:02.361 INFO:tasks.workunit.client.0.smithi087.stdout:7/167: dread d2/d6/d12/d1d/f17 [0,4194304] 0 2024-05-08T05:32:02.363 INFO:tasks.workunit.client.0.smithi087.stdout:7/168: rmdir d2/d6/d12/d19/d2a 39 2024-05-08T05:32:02.363 INFO:tasks.workunit.client.0.smithi087.stdout:7/169: write d2/d6/d12/d1d/d23/f2f [799160,123093] 0 2024-05-08T05:32:02.364 INFO:tasks.workunit.client.0.smithi087.stdout:7/170: truncate d2/d6/d12/d1d/f2e 598790 0 2024-05-08T05:32:02.364 INFO:tasks.workunit.client.0.smithi087.stdout:7/171: stat d2/d6/d12/d19 0 2024-05-08T05:32:02.364 INFO:tasks.workunit.client.0.smithi087.stdout:1/132: dread df/d12/f1a [0,4194304] 0 2024-05-08T05:32:02.364 INFO:tasks.workunit.client.0.smithi087.stdout:8/155: dread f8 [0,4194304] 0 2024-05-08T05:32:02.365 INFO:tasks.workunit.client.0.smithi087.stdout:7/172: creat d2/da/f31 x:0 0 0 2024-05-08T05:32:02.366 INFO:tasks.workunit.client.0.smithi087.stdout:1/133: getdents df/d12 0 2024-05-08T05:32:02.366 INFO:tasks.workunit.client.0.smithi087.stdout:1/134: fdatasync df/d18/f30 0 2024-05-08T05:32:02.367 INFO:tasks.workunit.client.0.smithi087.stdout:8/156: mkdir db/d23/d3a 0 2024-05-08T05:32:02.367 INFO:tasks.workunit.client.0.smithi087.stdout:8/157: chown db/l10 287 1 2024-05-08T05:32:02.371 INFO:tasks.workunit.client.0.smithi087.stdout:1/135: rmdir df/d12 39 2024-05-08T05:32:02.371 INFO:tasks.workunit.client.0.smithi087.stdout:0/174: dwrite d0/da/f3a [0,4194304] 0 2024-05-08T05:32:02.372 INFO:tasks.workunit.client.0.smithi087.stdout:0/175: fdatasync d0/da/f30 0 2024-05-08T05:32:02.374 INFO:tasks.workunit.client.0.smithi087.stdout:0/176: symlink d0/da/d11/l3f 0 2024-05-08T05:32:02.377 INFO:tasks.workunit.client.0.smithi087.stdout:0/177: rename d0/d9/d23/d24/f2d to d0/d9/d1b/d2f/f40 0 2024-05-08T05:32:02.377 INFO:tasks.workunit.client.0.smithi087.stdout:0/178: truncate d0/da/f16 1004613 0 2024-05-08T05:32:02.377 INFO:tasks.workunit.client.0.smithi087.stdout:0/179: chown d0/da/d11/c28 7881 1 2024-05-08T05:32:02.379 INFO:tasks.workunit.client.0.smithi087.stdout:5/133: dread da/dd/f11 [0,4194304] 0 2024-05-08T05:32:02.381 INFO:tasks.workunit.client.0.smithi087.stdout:2/170: write d7/f22 [1144637,20523] 0 2024-05-08T05:32:02.382 INFO:tasks.workunit.client.0.smithi087.stdout:7/173: write d2/d6/d12/d1d/f2e [388812,28803] 0 2024-05-08T05:32:02.382 INFO:tasks.workunit.client.0.smithi087.stdout:7/174: chown d2/da/lc 0 1 2024-05-08T05:32:02.383 INFO:tasks.workunit.client.0.smithi087.stdout:5/134: creat da/dd/d13/d16/f26 x:0 0 0 2024-05-08T05:32:02.384 INFO:tasks.workunit.client.0.smithi087.stdout:2/171: mknod d7/c36 0 2024-05-08T05:32:02.385 INFO:tasks.workunit.client.0.smithi087.stdout:2/172: chown d7/de/d2c/c34 1481446717 1 2024-05-08T05:32:02.386 INFO:tasks.workunit.client.0.smithi087.stdout:7/175: mkdir d2/d6/d12/d1d/d32 0 2024-05-08T05:32:02.386 INFO:tasks.workunit.client.0.smithi087.stdout:7/176: stat d2/da 0 2024-05-08T05:32:02.386 INFO:tasks.workunit.client.0.smithi087.stdout:7/177: fsync d2/d6/d12/d15/d29/f30 0 2024-05-08T05:32:02.386 INFO:tasks.workunit.client.0.smithi087.stdout:5/135: mknod da/dd/d10/d17/c27 0 2024-05-08T05:32:02.387 INFO:tasks.workunit.client.0.smithi087.stdout:5/136: fdatasync da/dd/d13/d16/f26 0 2024-05-08T05:32:02.389 INFO:tasks.workunit.client.0.smithi087.stdout:7/178: symlink d2/d6/d12/d1d/d32/l33 0 2024-05-08T05:32:02.391 INFO:tasks.workunit.client.0.smithi087.stdout:6/158: dwrite d4/d6/fa [0,4194304] 0 2024-05-08T05:32:02.391 INFO:tasks.workunit.client.0.smithi087.stdout:7/179: mkdir d2/d6/d12/d19/d34 0 2024-05-08T05:32:02.396 INFO:tasks.workunit.client.0.smithi087.stdout:9/152: sync 2024-05-08T05:32:02.396 INFO:tasks.workunit.client.0.smithi087.stdout:3/172: sync 2024-05-08T05:32:02.396 INFO:tasks.workunit.client.0.smithi087.stdout:4/155: sync 2024-05-08T05:32:02.397 INFO:tasks.workunit.client.0.smithi087.stdout:3/173: fdatasync d4/d11/f20 0 2024-05-08T05:32:02.397 INFO:tasks.workunit.client.0.smithi087.stdout:3/174: stat d4/lf 0 2024-05-08T05:32:02.397 INFO:tasks.workunit.client.0.smithi087.stdout:6/159: truncate d4/d8/fb 3657715 0 2024-05-08T05:32:02.398 INFO:tasks.workunit.client.0.smithi087.stdout:3/175: mkdir d4/d11/d24/d25/d3e 0 2024-05-08T05:32:02.398 INFO:tasks.workunit.client.0.smithi087.stdout:3/176: fdatasync d4/d11/d24/f26 0 2024-05-08T05:32:02.399 INFO:tasks.workunit.client.0.smithi087.stdout:6/160: mknod d4/d8/df/d1e/d25/d28/c33 0 2024-05-08T05:32:02.400 INFO:tasks.workunit.client.0.smithi087.stdout:3/177: mkdir d4/d11/d24/d25/d3e/d3f 0 2024-05-08T05:32:02.405 INFO:tasks.workunit.client.0.smithi087.stdout:3/178: symlink d4/l40 0 2024-05-08T05:32:02.405 INFO:tasks.workunit.client.0.smithi087.stdout:6/161: mknod d4/d8/df/d1e/d25/c34 0 2024-05-08T05:32:02.405 INFO:tasks.workunit.client.0.smithi087.stdout:6/162: getdents d4/d2a 0 2024-05-08T05:32:02.405 INFO:tasks.workunit.client.0.smithi087.stdout:6/163: chown d4/d8/df/d1e/d25/f2f 53446 1 2024-05-08T05:32:02.405 INFO:tasks.workunit.client.0.smithi087.stdout:6/164: creat d4/d8/f35 x:0 0 0 2024-05-08T05:32:02.405 INFO:tasks.workunit.client.0.smithi087.stdout:6/165: fsync d4/f16 0 2024-05-08T05:32:02.405 INFO:tasks.workunit.client.0.smithi087.stdout:6/166: creat d4/d8/df/d1e/d25/d28/f36 x:0 0 0 2024-05-08T05:32:02.406 INFO:tasks.workunit.client.0.smithi087.stdout:6/167: mkdir d4/d8/df/d1e/d25/d28/d2d/d37 0 2024-05-08T05:32:02.406 INFO:tasks.workunit.client.0.smithi087.stdout:6/168: creat d4/f38 x:0 0 0 2024-05-08T05:32:02.412 INFO:tasks.workunit.client.0.smithi087.stdout:6/169: mkdir d4/d8/df/d39 0 2024-05-08T05:32:02.413 INFO:tasks.workunit.client.0.smithi087.stdout:8/158: dwrite f8 [0,4194304] 0 2024-05-08T05:32:02.416 INFO:tasks.workunit.client.0.smithi087.stdout:4/156: dread d4/d13/f23 [0,4194304] 0 2024-05-08T05:32:02.417 INFO:tasks.workunit.client.0.smithi087.stdout:4/157: stat d4/d13/l2a 0 2024-05-08T05:32:02.417 INFO:tasks.workunit.client.0.smithi087.stdout:4/158: getdents d4/d25/d28 0 2024-05-08T05:32:02.423 INFO:tasks.workunit.client.0.smithi087.stdout:4/159: dread d4/d13/f16 [0,4194304] 0 2024-05-08T05:32:02.426 INFO:tasks.workunit.client.0.smithi087.stdout:5/137: dwrite da/dd/d13/d16/f26 [0,4194304] 0 2024-05-08T05:32:02.439 INFO:tasks.workunit.client.0.smithi087.stdout:5/138: write f2 [4365318,80259] 0 2024-05-08T05:32:02.439 INFO:tasks.workunit.client.0.smithi087.stdout:5/139: chown f2 3161417 1 2024-05-08T05:32:02.442 INFO:tasks.workunit.client.0.smithi087.stdout:5/140: creat da/dd/d10/d17/f28 x:0 0 0 2024-05-08T05:32:02.444 INFO:tasks.workunit.client.0.smithi087.stdout:5/141: mknod da/dd/d13/c29 0 2024-05-08T05:32:02.444 INFO:tasks.workunit.client.0.smithi087.stdout:5/142: chown da/dd/d13/d16/l21 2674578 1 2024-05-08T05:32:02.446 INFO:tasks.workunit.client.0.smithi087.stdout:5/143: mkdir da/db/d2a 0 2024-05-08T05:32:02.448 INFO:tasks.workunit.client.0.smithi087.stdout:5/144: creat da/dd/d10/d17/f2b x:0 0 0 2024-05-08T05:32:02.448 INFO:tasks.workunit.client.0.smithi087.stdout:5/145: fdatasync da/dd/d13/d16/f26 0 2024-05-08T05:32:02.449 INFO:tasks.workunit.client.0.smithi087.stdout:5/146: link da/db/l1b da/db/l2c 0 2024-05-08T05:32:02.450 INFO:tasks.workunit.client.0.smithi087.stdout:5/147: link da/c14 da/dd/d13/d16/c2d 0 2024-05-08T05:32:02.451 INFO:tasks.workunit.client.0.smithi087.stdout:5/148: creat da/f2e x:0 0 0 2024-05-08T05:32:02.451 INFO:tasks.workunit.client.0.smithi087.stdout:5/149: chown da/dd/d10/d17/f2b 97 1 2024-05-08T05:32:02.454 INFO:tasks.workunit.client.0.smithi087.stdout:7/180: dwrite d2/f27 [0,4194304] 0 2024-05-08T05:32:02.454 INFO:tasks.workunit.client.0.smithi087.stdout:5/150: fdatasync f2 0 2024-05-08T05:32:02.461 INFO:tasks.workunit.client.0.smithi087.stdout:4/160: dwrite d4/d25/f29 [0,4194304] 0 2024-05-08T05:32:02.464 INFO:tasks.workunit.client.0.smithi087.stdout:8/159: dwrite db/d23/d1b/f26 [0,4194304] 0 2024-05-08T05:32:02.464 INFO:tasks.workunit.client.0.smithi087.stdout:8/160: chown fa 503091470 1 2024-05-08T05:32:02.465 INFO:tasks.workunit.client.0.smithi087.stdout:8/161: truncate db/d23/f38 813246 0 2024-05-08T05:32:02.465 INFO:tasks.workunit.client.0.smithi087.stdout:8/162: dread - db/d23/d15/f36 zero size 2024-05-08T05:32:02.465 INFO:tasks.workunit.client.0.smithi087.stdout:4/161: truncate d4/d25/f27 784910 0 2024-05-08T05:32:02.468 INFO:tasks.workunit.client.0.smithi087.stdout:8/163: write db/d23/d15/f19 [993470,75147] 0 2024-05-08T05:32:02.468 INFO:tasks.workunit.client.0.smithi087.stdout:8/164: mkdir db/d23/d15/d29/d33/d3b 0 2024-05-08T05:32:02.469 INFO:tasks.workunit.client.0.smithi087.stdout:8/165: stat db 0 2024-05-08T05:32:02.471 INFO:tasks.workunit.client.0.smithi087.stdout:8/166: mkdir db/d23/d15/d3c 0 2024-05-08T05:32:02.490 INFO:tasks.workunit.client.0.smithi087.stdout:9/153: dwrite d1/f13 [0,4194304] 0 2024-05-08T05:32:02.491 INFO:tasks.workunit.client.0.smithi087.stdout:9/154: creat d1/f30 x:0 0 0 2024-05-08T05:32:02.491 INFO:tasks.workunit.client.0.smithi087.stdout:9/155: write d1/fd [1220328,34539] 0 2024-05-08T05:32:02.495 INFO:tasks.workunit.client.0.smithi087.stdout:9/156: rmdir d1/df/d14 39 2024-05-08T05:32:02.496 INFO:tasks.workunit.client.0.smithi087.stdout:8/167: dread db/d23/d15/f34 [0,4194304] 0 2024-05-08T05:32:02.498 INFO:tasks.workunit.client.0.smithi087.stdout:8/168: truncate db/f12 1255515 0 2024-05-08T05:32:02.498 INFO:tasks.workunit.client.0.smithi087.stdout:8/169: chown db/d23/d15/d29 915476 1 2024-05-08T05:32:02.498 INFO:tasks.workunit.client.0.smithi087.stdout:8/170: getdents db/d23/d1b/d35 0 2024-05-08T05:32:02.498 INFO:tasks.workunit.client.0.smithi087.stdout:8/171: stat db/d23/f2d 0 2024-05-08T05:32:02.499 INFO:tasks.workunit.client.0.smithi087.stdout:8/172: rename db/d23/d15/f2c to db/d23/d1b/f3d 0 2024-05-08T05:32:02.503 INFO:tasks.workunit.client.0.smithi087.stdout:3/179: dwrite d4/d11/d24/f26 [0,4194304] 0 2024-05-08T05:32:02.503 INFO:tasks.workunit.client.0.smithi087.stdout:3/180: write d4/f21 [1163620,29049] 0 2024-05-08T05:32:02.505 INFO:tasks.workunit.client.0.smithi087.stdout:3/181: unlink d4/f21 0 2024-05-08T05:32:02.505 INFO:tasks.workunit.client.0.smithi087.stdout:3/182: read d4/d14/f28 [2693184,57756] 0 2024-05-08T05:32:02.510 INFO:tasks.workunit.client.0.smithi087.stdout:3/183: mknod d4/d11/d3d/c41 0 2024-05-08T05:32:02.512 INFO:tasks.workunit.client.0.smithi087.stdout:3/184: getdents d4/d11/d24 0 2024-05-08T05:32:02.512 INFO:tasks.workunit.client.0.smithi087.stdout:3/185: dread - d4/d11/d24/d25/f2f zero size 2024-05-08T05:32:02.521 INFO:tasks.workunit.client.0.smithi087.stdout:3/186: dread d4/d14/f29 [0,4194304] 0 2024-05-08T05:32:02.521 INFO:tasks.workunit.client.0.smithi087.stdout:3/187: readlink d4/d11/d24/d25/l36 0 2024-05-08T05:32:02.523 INFO:tasks.workunit.client.0.smithi087.stdout:7/181: dwrite d2/f4 [0,4194304] 0 2024-05-08T05:32:02.523 INFO:tasks.workunit.client.0.smithi087.stdout:3/188: rename l1 to d4/d11/d24/d25/d3e/d3f/l42 0 2024-05-08T05:32:02.523 INFO:tasks.workunit.client.0.smithi087.stdout:3/189: dread - d4/f1d zero size 2024-05-08T05:32:02.525 INFO:tasks.workunit.client.0.smithi087.stdout:3/190: link d4/d11/c12 d4/d11/d24/d25/d3e/c43 0 2024-05-08T05:32:02.528 INFO:tasks.workunit.client.0.smithi087.stdout:3/191: symlink d4/d11/d24/d25/d3e/d3f/l44 0 2024-05-08T05:32:02.528 INFO:tasks.workunit.client.0.smithi087.stdout:3/192: readlink d4/l15 0 2024-05-08T05:32:02.530 INFO:tasks.workunit.client.0.smithi087.stdout:3/193: creat d4/d11/d3d/f45 x:0 0 0 2024-05-08T05:32:02.532 INFO:tasks.workunit.client.0.smithi087.stdout:5/151: dwrite da/dd/f11 [0,4194304] 0 2024-05-08T05:32:02.535 INFO:tasks.workunit.client.0.smithi087.stdout:7/182: dread d2/d6/d12/d1d/f2e [0,4194304] 0 2024-05-08T05:32:02.536 INFO:tasks.workunit.client.0.smithi087.stdout:5/152: rename da/dd/l24 to da/dd/d10/l2f 0 2024-05-08T05:32:02.538 INFO:tasks.workunit.client.0.smithi087.stdout:7/183: mknod d2/d6/d12/d1d/d23/c35 0 2024-05-08T05:32:02.538 INFO:tasks.workunit.client.0.smithi087.stdout:7/184: write d2/d6/d12/d19/f1e [292601,115834] 0 2024-05-08T05:32:02.538 INFO:tasks.workunit.client.0.smithi087.stdout:7/185: chown d2/da 18464454 1 2024-05-08T05:32:02.538 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:32:02 smithi160 ceph-mon[34827]: pgmap v511: 97 pgs: 97 active+clean; 140 MiB data, 899 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 9.7 MiB/s wr, 742 op/s 2024-05-08T05:32:02.549 INFO:tasks.workunit.client.0.smithi087.stdout:5/153: dread f9 [4194304,4194304] 0 2024-05-08T05:32:02.549 INFO:tasks.workunit.client.0.smithi087.stdout:5/154: chown da/dd/d10/c1c 3 1 2024-05-08T05:32:02.550 INFO:tasks.workunit.client.0.smithi087.stdout:5/155: creat da/f30 x:0 0 0 2024-05-08T05:32:02.550 INFO:tasks.workunit.client.0.smithi087.stdout:5/156: chown c8 5629084 1 2024-05-08T05:32:02.551 INFO:tasks.workunit.client.0.smithi087.stdout:5/157: fsync da/f2e 0 2024-05-08T05:32:02.551 INFO:tasks.workunit.client.0.smithi087.stdout:7/186: dread d2/d6/d12/d19/f22 [0,4194304] 0 2024-05-08T05:32:02.551 INFO:tasks.workunit.client.0.smithi087.stdout:9/157: dwrite d1/f21 [0,4194304] 0 2024-05-08T05:32:02.552 INFO:tasks.workunit.client.0.smithi087.stdout:5/158: creat da/db/d2a/f31 x:0 0 0 2024-05-08T05:32:02.552 INFO:tasks.workunit.client.0.smithi087.stdout:8/173: dwrite fa [0,4194304] 0 2024-05-08T05:32:02.553 INFO:tasks.workunit.client.0.smithi087.stdout:7/187: symlink d2/d6/d12/l36 0 2024-05-08T05:32:02.555 INFO:tasks.workunit.client.0.smithi087.stdout:9/158: link d1/df/d14/d18/d22/f26 d1/df/d14/d18/d22/f31 0 2024-05-08T05:32:02.555 INFO:tasks.workunit.client.0.smithi087.stdout:9/159: fsync d1/f13 0 2024-05-08T05:32:02.555 INFO:tasks.workunit.client.0.smithi087.stdout:9/160: read - d1/f30 zero size 2024-05-08T05:32:02.555 INFO:tasks.workunit.client.0.smithi087.stdout:8/174: creat db/d23/d15/d3c/f3e x:0 0 0 2024-05-08T05:32:02.556 INFO:tasks.workunit.client.0.smithi087.stdout:8/175: fdatasync f3 0 2024-05-08T05:32:02.557 INFO:tasks.workunit.client.0.smithi087.stdout:8/176: creat db/d23/d15/d3c/f3f x:0 0 0 2024-05-08T05:32:02.557 INFO:tasks.workunit.client.0.smithi087.stdout:8/177: write f5 [19270,7159] 0 2024-05-08T05:32:02.557 INFO:tasks.workunit.client.0.smithi087.stdout:7/188: rmdir d2/da 39 2024-05-08T05:32:02.557 INFO:tasks.workunit.client.0.smithi087.stdout:7/189: write d2/da/f11 [434000,98382] 0 2024-05-08T05:32:02.563 INFO:tasks.workunit.client.0.smithi087.stdout:1/136: sync 2024-05-08T05:32:02.564 INFO:tasks.workunit.client.0.smithi087.stdout:1/137: creat df/d12/f31 x:0 0 0 2024-05-08T05:32:02.564 INFO:tasks.workunit.client.0.smithi087.stdout:1/138: fdatasync df/d18/f30 0 2024-05-08T05:32:02.565 INFO:tasks.workunit.client.0.smithi087.stdout:1/139: mkdir df/d18/d1d/d32 0 2024-05-08T05:32:02.565 INFO:tasks.workunit.client.0.smithi087.stdout:1/140: truncate df/d18/f30 240657 0 2024-05-08T05:32:02.565 INFO:tasks.workunit.client.0.smithi087.stdout:1/141: stat df/f24 0 2024-05-08T05:32:02.567 INFO:tasks.workunit.client.0.smithi087.stdout:8/178: dread f4 [0,4194304] 0 2024-05-08T05:32:02.567 INFO:tasks.workunit.client.0.smithi087.stdout:3/194: dwrite d4/d11/d3d/f45 [0,4194304] 0 2024-05-08T05:32:02.569 INFO:tasks.workunit.client.0.smithi087.stdout:3/195: creat d4/d11/d24/d25/d3e/f46 x:0 0 0 2024-05-08T05:32:02.570 INFO:tasks.workunit.client.0.smithi087.stdout:8/179: link db/cf db/d23/d1b/d35/c40 0 2024-05-08T05:32:02.597 INFO:tasks.workunit.client.0.smithi087.stdout:8/180: write db/f11 [2524731,90043] 0 2024-05-08T05:32:02.597 INFO:tasks.workunit.client.0.smithi087.stdout:8/181: write db/f11 [3185312,9875] 0 2024-05-08T05:32:02.605 INFO:tasks.workunit.client.0.smithi087.stdout:8/182: write db/d23/d15/f34 [2929072,1418] 0 2024-05-08T05:32:02.607 INFO:tasks.workunit.client.0.smithi087.stdout:8/183: creat db/f41 x:0 0 0 2024-05-08T05:32:02.607 INFO:tasks.workunit.client.0.smithi087.stdout:9/161: dwrite d1/df/f12 [0,4194304] 0 2024-05-08T05:32:02.607 INFO:tasks.workunit.client.0.smithi087.stdout:9/162: fsync d1/df/d14/d18/f23 0 2024-05-08T05:32:02.608 INFO:tasks.workunit.client.0.smithi087.stdout:9/163: unlink d1/df/d14/l24 0 2024-05-08T05:32:02.610 INFO:tasks.workunit.client.0.smithi087.stdout:9/164: rename d1/l11 to d1/df/d14/d18/d22/l32 0 2024-05-08T05:32:02.611 INFO:tasks.workunit.client.0.smithi087.stdout:9/165: mknod d1/df/d14/d18/c33 0 2024-05-08T05:32:02.612 INFO:tasks.workunit.client.0.smithi087.stdout:5/159: dwrite da/f2e [0,4194304] 0 2024-05-08T05:32:02.613 INFO:tasks.workunit.client.0.smithi087.stdout:7/190: dread d2/f27 [0,4194304] 0 2024-05-08T05:32:02.613 INFO:tasks.workunit.client.0.smithi087.stdout:5/160: truncate da/dd/d10/d17/f2b 117623 0 2024-05-08T05:32:02.618 INFO:tasks.workunit.client.0.smithi087.stdout:9/166: rmdir d1/df/d14 39 2024-05-08T05:32:02.619 INFO:tasks.workunit.client.0.smithi087.stdout:7/191: getdents d2/d6 0 2024-05-08T05:32:02.619 INFO:tasks.workunit.client.0.smithi087.stdout:7/192: chown d2/d6/d12/d19/f2d 0 1 2024-05-08T05:32:02.619 INFO:tasks.workunit.client.0.smithi087.stdout:7/193: chown d2/d6/d12/d1d/c1a 2 1 2024-05-08T05:32:02.626 INFO:tasks.workunit.client.0.smithi087.stdout:3/196: dread f2 [0,4194304] 0 2024-05-08T05:32:02.627 INFO:tasks.workunit.client.0.smithi087.stdout:7/194: unlink d2/d6/d12/d1d/d32/l33 0 2024-05-08T05:32:02.627 INFO:tasks.workunit.client.0.smithi087.stdout:5/161: dread da/f2e [0,4194304] 0 2024-05-08T05:32:02.627 INFO:tasks.workunit.client.0.smithi087.stdout:5/162: read - da/db/d2a/f31 zero size 2024-05-08T05:32:02.627 INFO:tasks.workunit.client.0.smithi087.stdout:5/163: dread - da/db/f25 zero size 2024-05-08T05:32:02.627 INFO:tasks.workunit.client.0.smithi087.stdout:7/195: symlink d2/d6/d12/d15/l37 0 2024-05-08T05:32:02.629 INFO:tasks.workunit.client.0.smithi087.stdout:5/164: creat da/db/d2a/f32 x:0 0 0 2024-05-08T05:32:02.629 INFO:tasks.workunit.client.0.smithi087.stdout:5/165: write da/dd/d10/d17/f28 [704414,105031] 0 2024-05-08T05:32:02.630 INFO:tasks.workunit.client.0.smithi087.stdout:7/196: symlink d2/d6/d12/d19/d2a/l38 0 2024-05-08T05:32:02.630 INFO:tasks.workunit.client.0.smithi087.stdout:7/197: chown d2/d6/d12/d1d/d23 11917 1 2024-05-08T05:32:02.630 INFO:tasks.workunit.client.0.smithi087.stdout:7/198: write d2/da/f11 [310958,69203] 0 2024-05-08T05:32:02.640 INFO:tasks.workunit.client.0.smithi087.stdout:9/167: truncate d1/fd 247449 0 2024-05-08T05:32:02.640 INFO:tasks.workunit.client.0.smithi087.stdout:5/166: mknod da/dd/d10/d17/c33 0 2024-05-08T05:32:02.640 INFO:tasks.workunit.client.0.smithi087.stdout:6/170: sync 2024-05-08T05:32:02.640 INFO:tasks.workunit.client.0.smithi087.stdout:2/173: sync 2024-05-08T05:32:02.641 INFO:tasks.workunit.client.0.smithi087.stdout:4/162: sync 2024-05-08T05:32:02.641 INFO:tasks.workunit.client.0.smithi087.stdout:0/180: sync 2024-05-08T05:32:02.641 INFO:tasks.workunit.client.0.smithi087.stdout:7/199: stat d2/d6/d12/d1d/c1a 0 2024-05-08T05:32:02.641 INFO:tasks.workunit.client.0.smithi087.stdout:5/167: symlink da/db/l34 0 2024-05-08T05:32:02.641 INFO:tasks.workunit.client.0.smithi087.stdout:2/174: write d7/de/f15 [4458502,101550] 0 2024-05-08T05:32:02.642 INFO:tasks.workunit.client.0.smithi087.stdout:7/200: creat d2/d6/d12/f39 x:0 0 0 2024-05-08T05:32:02.642 INFO:tasks.workunit.client.0.smithi087.stdout:2/175: creat d7/f37 x:0 0 0 2024-05-08T05:32:02.647 INFO:tasks.workunit.client.0.smithi087.stdout:7/201: creat d2/d6/d12/d1d/f3a x:0 0 0 2024-05-08T05:32:02.647 INFO:tasks.workunit.client.0.smithi087.stdout:2/176: creat d7/de/d27/d33/f38 x:0 0 0 2024-05-08T05:32:02.647 INFO:tasks.workunit.client.0.smithi087.stdout:2/177: write d7/de/d27/d33/f30 [401890,106598] 0 2024-05-08T05:32:02.647 INFO:tasks.workunit.client.0.smithi087.stdout:7/202: truncate d2/d6/d12/f39 1035129 0 2024-05-08T05:32:02.650 INFO:tasks.workunit.client.0.smithi087.stdout:5/168: dread da/dd/d10/d17/f2b [0,4194304] 0 2024-05-08T05:32:02.650 INFO:tasks.workunit.client.0.smithi087.stdout:7/203: symlink d2/d6/d12/l3b 0 2024-05-08T05:32:02.654 INFO:tasks.workunit.client.0.smithi087.stdout:2/178: fdatasync d7/de/d27/d33/f1c 0 2024-05-08T05:32:02.655 INFO:tasks.workunit.client.0.smithi087.stdout:2/179: stat d7/de/f24 0 2024-05-08T05:32:02.657 INFO:tasks.workunit.client.0.smithi087.stdout:1/142: dwrite df/f11 [0,4194304] 0 2024-05-08T05:32:02.658 INFO:tasks.workunit.client.0.smithi087.stdout:0/181: dread d0/da/d11/f20 [0,4194304] 0 2024-05-08T05:32:02.659 INFO:tasks.workunit.client.0.smithi087.stdout:0/182: write d0/da/f30 [503253,47581] 0 2024-05-08T05:32:02.659 INFO:tasks.workunit.client.0.smithi087.stdout:2/180: fdatasync d7/de/f13 0 2024-05-08T05:32:02.659 INFO:tasks.workunit.client.0.smithi087.stdout:0/183: fsync d0/da/f3a 0 2024-05-08T05:32:02.659 INFO:tasks.workunit.client.0.smithi087.stdout:0/184: fdatasync d0/d9/f12 0 2024-05-08T05:32:02.659 INFO:tasks.workunit.client.0.smithi087.stdout:0/185: truncate d0/f2 5496949 0 2024-05-08T05:32:02.672 INFO:tasks.workunit.client.0.smithi087.stdout:3/197: dwrite d4/d11/d24/d25/d3e/f46 [0,4194304] 0 2024-05-08T05:32:02.675 INFO:tasks.workunit.client.0.smithi087.stdout:0/186: truncate d0/d9/f10 2127886 0 2024-05-08T05:32:02.683 INFO:tasks.workunit.client.0.smithi087.stdout:0/187: symlink d0/l41 0 2024-05-08T05:32:02.686 INFO:tasks.workunit.client.0.smithi087.stdout:3/198: dread d4/d14/f1a [0,4194304] 0 2024-05-08T05:32:02.687 INFO:tasks.workunit.client.0.smithi087.stdout:5/169: dread da/dd/d10/d17/f2b [0,4194304] 0 2024-05-08T05:32:02.689 INFO:tasks.workunit.client.0.smithi087.stdout:1/143: write df/d12/f23 [3150365,72982] 0 2024-05-08T05:32:02.693 INFO:tasks.workunit.client.0.smithi087.stdout:0/188: link d0/d9/d1b/d2f/c3b d0/d9/d23/c42 0 2024-05-08T05:32:02.693 INFO:tasks.workunit.client.0.smithi087.stdout:0/189: truncate d0/da/d35/f37 241757 0 2024-05-08T05:32:02.693 INFO:tasks.workunit.client.0.smithi087.stdout:5/170: link da/dd/d13/c15 da/c35 0 2024-05-08T05:32:02.693 INFO:tasks.workunit.client.0.smithi087.stdout:3/199: creat d4/d11/d3d/f47 x:0 0 0 2024-05-08T05:32:02.694 INFO:tasks.workunit.client.0.smithi087.stdout:3/200: mkdir d4/d11/d3d/d48 0 2024-05-08T05:32:02.702 INFO:tasks.workunit.client.0.smithi087.stdout:9/168: dwrite d1/df/f12 [0,4194304] 0 2024-05-08T05:32:02.705 INFO:tasks.workunit.client.0.smithi087.stdout:7/204: dwrite d2/f27 [0,4194304] 0 2024-05-08T05:32:02.708 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:32:02 smithi087 ceph-mon[29523]: pgmap v511: 97 pgs: 97 active+clean; 140 MiB data, 899 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 9.7 MiB/s wr, 742 op/s 2024-05-08T05:32:02.729 INFO:tasks.workunit.client.0.smithi087.stdout:0/190: dwrite d0/da/d11/f20 [0,4194304] 0 2024-05-08T05:32:02.730 INFO:tasks.workunit.client.0.smithi087.stdout:0/191: unlink d0/d9/fb 0 2024-05-08T05:32:02.732 INFO:tasks.workunit.client.0.smithi087.stdout:0/192: rename d0/d9/f12 to d0/da/d11/f43 0 2024-05-08T05:32:02.733 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:32:02 smithi090 ceph-mon[34526]: pgmap v511: 97 pgs: 97 active+clean; 140 MiB data, 899 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 9.7 MiB/s wr, 742 op/s 2024-05-08T05:32:02.734 INFO:tasks.workunit.client.0.smithi087.stdout:0/193: truncate d0/da/d11/f43 17145 0 2024-05-08T05:32:02.735 INFO:tasks.workunit.client.0.smithi087.stdout:0/194: creat d0/d22/d3c/f44 x:0 0 0 2024-05-08T05:32:02.744 INFO:tasks.workunit.client.0.smithi087.stdout:0/195: dread d0/da/d11/f43 [0,4194304] 0 2024-05-08T05:32:02.755 INFO:tasks.workunit.client.0.smithi087.stdout:1/144: read df/f11 [1132493,69075] 0 2024-05-08T05:32:02.755 INFO:tasks.workunit.client.0.smithi087.stdout:1/145: truncate df/f1f 826134 0 2024-05-08T05:32:02.755 INFO:tasks.workunit.client.0.smithi087.stdout:1/146: fdatasync df/d12/f31 0 2024-05-08T05:32:02.756 INFO:tasks.workunit.client.0.smithi087.stdout:1/147: symlink df/d18/d1d/l33 0 2024-05-08T05:32:02.756 INFO:tasks.workunit.client.0.smithi087.stdout:1/148: write df/d18/f1b [4224195,99765] 0 2024-05-08T05:32:02.759 INFO:tasks.workunit.client.0.smithi087.stdout:3/201: write d4/d11/d24/d25/f34 [2919306,26960] 0 2024-05-08T05:32:02.759 INFO:tasks.workunit.client.0.smithi087.stdout:5/171: dwrite da/db/d2a/f32 [0,4194304] 0 2024-05-08T05:32:02.760 INFO:tasks.workunit.client.0.smithi087.stdout:5/172: read f9 [7103373,39933] 0 2024-05-08T05:32:02.760 INFO:tasks.workunit.client.0.smithi087.stdout:6/171: dwrite d4/f12 [0,4194304] 0 2024-05-08T05:32:02.760 INFO:tasks.workunit.client.0.smithi087.stdout:6/172: write d4/d8/df/d1e/f23 [205072,28400] 0 2024-05-08T05:32:02.763 INFO:tasks.workunit.client.0.smithi087.stdout:3/202: rename d4/d11/c12 to d4/d11/d24/d25/d3e/c49 0 2024-05-08T05:32:02.764 INFO:tasks.workunit.client.0.smithi087.stdout:5/173: mkdir da/dd/d10/d36 0 2024-05-08T05:32:02.766 INFO:tasks.workunit.client.0.smithi087.stdout:7/205: dwrite d2/f27 [0,4194304] 0 2024-05-08T05:32:02.766 INFO:tasks.workunit.client.0.smithi087.stdout:7/206: chown d2/d6/d12/d1d/f13 131983 1 2024-05-08T05:32:02.767 INFO:tasks.workunit.client.0.smithi087.stdout:5/174: rename da/dd/d10/c18 to da/db/d2a/c37 0 2024-05-08T05:32:02.767 INFO:tasks.workunit.client.0.smithi087.stdout:5/175: fsync f2 0 2024-05-08T05:32:02.767 INFO:tasks.workunit.client.0.smithi087.stdout:5/176: stat da/dd/f11 0 2024-05-08T05:32:02.768 INFO:tasks.workunit.client.0.smithi087.stdout:9/169: dread d1/f8 [0,4194304] 0 2024-05-08T05:32:02.768 INFO:tasks.workunit.client.0.smithi087.stdout:9/170: readlink d1/df/d14/d18/d22/l32 0 2024-05-08T05:32:02.768 INFO:tasks.workunit.client.0.smithi087.stdout:9/171: fdatasync d1/db/f1f 0 2024-05-08T05:32:02.768 INFO:tasks.workunit.client.0.smithi087.stdout:9/172: dread - d1/df/d14/d18/f1e zero size 2024-05-08T05:32:02.770 INFO:tasks.workunit.client.0.smithi087.stdout:8/184: sync 2024-05-08T05:32:02.770 INFO:tasks.workunit.client.0.smithi087.stdout:8/185: fdatasync fa 0 2024-05-08T05:32:02.772 INFO:tasks.workunit.client.0.smithi087.stdout:9/173: creat d1/df/d14/d18/f34 x:0 0 0 2024-05-08T05:32:02.772 INFO:tasks.workunit.client.0.smithi087.stdout:9/174: fsync d1/db/f10 0 2024-05-08T05:32:02.783 INFO:tasks.workunit.client.0.smithi087.stdout:8/186: getdents db/d23/d15/d3c 0 2024-05-08T05:32:02.783 INFO:tasks.workunit.client.0.smithi087.stdout:8/187: fsync db/d23/d1b/f30 0 2024-05-08T05:32:02.783 INFO:tasks.workunit.client.0.smithi087.stdout:9/175: creat d1/df/f35 x:0 0 0 2024-05-08T05:32:02.783 INFO:tasks.workunit.client.0.smithi087.stdout:2/181: sync 2024-05-08T05:32:02.783 INFO:tasks.workunit.client.0.smithi087.stdout:4/163: sync 2024-05-08T05:32:02.783 INFO:tasks.workunit.client.0.smithi087.stdout:9/176: write d1/df/d14/d18/f34 [402,104434] 0 2024-05-08T05:32:02.786 INFO:tasks.workunit.client.0.smithi087.stdout:4/164: rename d4/cd to d4/d25/c33 0 2024-05-08T05:32:02.787 INFO:tasks.workunit.client.0.smithi087.stdout:9/177: getdents d1/df/d14/d18/d22 0 2024-05-08T05:32:02.787 INFO:tasks.workunit.client.0.smithi087.stdout:9/178: readlink d1/db/le 0 2024-05-08T05:32:02.788 INFO:tasks.workunit.client.0.smithi087.stdout:8/188: rmdir db/d23 39 2024-05-08T05:32:02.790 INFO:tasks.workunit.client.0.smithi087.stdout:4/165: mknod d4/d25/c34 0 2024-05-08T05:32:02.792 INFO:tasks.workunit.client.0.smithi087.stdout:6/173: dread d4/d8/df/f31 [0,4194304] 0 2024-05-08T05:32:02.799 INFO:tasks.workunit.client.0.smithi087.stdout:8/189: getdents db/d23 0 2024-05-08T05:32:02.799 INFO:tasks.workunit.client.0.smithi087.stdout:8/190: chown f8 3 1 2024-05-08T05:32:02.802 INFO:tasks.workunit.client.0.smithi087.stdout:6/174: link d4/d8/df/d1e/l2c d4/d8/l3a 0 2024-05-08T05:32:02.810 INFO:tasks.workunit.client.0.smithi087.stdout:6/175: link d4/fd d4/d8/f3b 0 2024-05-08T05:32:02.810 INFO:tasks.workunit.client.0.smithi087.stdout:9/179: symlink d1/l36 0 2024-05-08T05:32:02.810 INFO:tasks.workunit.client.0.smithi087.stdout:6/176: readlink d4/d8/l3a 0 2024-05-08T05:32:02.810 INFO:tasks.workunit.client.0.smithi087.stdout:9/180: readlink d1/df/d14/d18/d22/l32 0 2024-05-08T05:32:02.810 INFO:tasks.workunit.client.0.smithi087.stdout:9/181: dread - d1/df/d14/f2f zero size 2024-05-08T05:32:02.810 INFO:tasks.workunit.client.0.smithi087.stdout:9/182: read - d1/df/d14/d18/d22/f31 zero size 2024-05-08T05:32:02.810 INFO:tasks.workunit.client.0.smithi087.stdout:9/183: write d1/f1a [2183253,27231] 0 2024-05-08T05:32:02.810 INFO:tasks.workunit.client.0.smithi087.stdout:9/184: readlink d1/db/l20 0 2024-05-08T05:32:02.812 INFO:tasks.workunit.client.0.smithi087.stdout:9/185: rmdir d1/db 39 2024-05-08T05:32:02.812 INFO:tasks.workunit.client.0.smithi087.stdout:9/186: chown d1/db/f1b 103277 1 2024-05-08T05:32:02.812 INFO:tasks.workunit.client.0.smithi087.stdout:9/187: stat d1/df/d14/d18/d22/f2d 0 2024-05-08T05:32:02.812 INFO:tasks.workunit.client.0.smithi087.stdout:9/188: truncate d1/f30 359795 0 2024-05-08T05:32:02.818 INFO:tasks.workunit.client.0.smithi087.stdout:9/189: mkdir d1/df/d37 0 2024-05-08T05:32:02.818 INFO:tasks.workunit.client.0.smithi087.stdout:9/190: dread - d1/df/d14/d18/d22/f31 zero size 2024-05-08T05:32:02.818 INFO:tasks.workunit.client.0.smithi087.stdout:9/191: stat d1/db/l20 0 2024-05-08T05:32:02.830 INFO:tasks.workunit.client.0.smithi087.stdout:5/177: dwrite f7 [4194304,4194304] 0 2024-05-08T05:32:02.832 INFO:tasks.workunit.client.0.smithi087.stdout:5/178: rename da/dd/d10/c1c to da/dd/d10/d17/c38 0 2024-05-08T05:32:02.834 INFO:tasks.workunit.client.0.smithi087.stdout:5/179: rename da/dd/f11 to da/dd/d10/d36/f39 0 2024-05-08T05:32:02.836 INFO:tasks.workunit.client.0.smithi087.stdout:5/180: creat da/dd/d10/d17/f3a x:0 0 0 2024-05-08T05:32:02.837 INFO:tasks.workunit.client.0.smithi087.stdout:1/149: dwrite df/f11 [0,4194304] 0 2024-05-08T05:32:02.841 INFO:tasks.workunit.client.0.smithi087.stdout:3/203: dwrite d4/d11/d3d/f47 [0,4194304] 0 2024-05-08T05:32:02.841 INFO:tasks.workunit.client.0.smithi087.stdout:4/166: dwrite d4/d13/f31 [4194304,4194304] 0 2024-05-08T05:32:02.842 INFO:tasks.workunit.client.0.smithi087.stdout:4/167: write d4/fe [2822558,123453] 0 2024-05-08T05:32:02.842 INFO:tasks.workunit.client.0.smithi087.stdout:4/168: chown d4/d25/d28 4356389 1 2024-05-08T05:32:02.842 INFO:tasks.workunit.client.0.smithi087.stdout:4/169: fsync d4/d25/f27 0 2024-05-08T05:32:02.842 INFO:tasks.workunit.client.0.smithi087.stdout:4/170: fdatasync d4/f2f 0 2024-05-08T05:32:02.842 INFO:tasks.workunit.client.0.smithi087.stdout:4/171: readlink d4/l1d 0 2024-05-08T05:32:02.844 INFO:tasks.workunit.client.0.smithi087.stdout:3/204: creat d4/d11/d24/d25/d3e/d3f/f4a x:0 0 0 2024-05-08T05:32:02.846 INFO:tasks.workunit.client.0.smithi087.stdout:4/172: unlink d4/l2d 0 2024-05-08T05:32:02.846 INFO:tasks.workunit.client.0.smithi087.stdout:4/173: write d4/d13/f31 [8735336,24491] 0 2024-05-08T05:32:02.846 INFO:tasks.workunit.client.0.smithi087.stdout:4/174: write d4/d13/f23 [1881714,73709] 0 2024-05-08T05:32:02.851 INFO:tasks.workunit.client.0.smithi087.stdout:4/175: mkdir d4/d25/d28/d35 0 2024-05-08T05:32:02.852 INFO:tasks.workunit.client.0.smithi087.stdout:2/182: dwrite f5 [4194304,4194304] 0 2024-05-08T05:32:02.854 INFO:tasks.workunit.client.0.smithi087.stdout:2/183: truncate d7/de/f15 948624 0 2024-05-08T05:32:02.861 INFO:tasks.workunit.client.0.smithi087.stdout:3/205: dread d4/d14/f28 [0,4194304] 0 2024-05-08T05:32:02.864 INFO:tasks.workunit.client.0.smithi087.stdout:9/192: dwrite d1/df/f2c [0,4194304] 0 2024-05-08T05:32:02.864 INFO:tasks.workunit.client.0.smithi087.stdout:9/193: getdents d1/df/d37 0 2024-05-08T05:32:02.864 INFO:tasks.workunit.client.0.smithi087.stdout:9/194: write d1/df/d14/f17 [378504,37434] 0 2024-05-08T05:32:02.866 INFO:tasks.workunit.client.0.smithi087.stdout:9/195: symlink d1/df/l38 0 2024-05-08T05:32:02.874 INFO:tasks.workunit.client.0.smithi087.stdout:8/191: dwrite db/d23/d15/f21 [0,4194304] 0 2024-05-08T05:32:02.874 INFO:tasks.workunit.client.0.smithi087.stdout:8/192: dread - db/f39 zero size 2024-05-08T05:32:02.874 INFO:tasks.workunit.client.0.smithi087.stdout:9/196: symlink d1/db/d28/l39 0 2024-05-08T05:32:02.879 INFO:tasks.workunit.client.0.smithi087.stdout:6/177: dwrite d4/d8/f35 [0,4194304] 0 2024-05-08T05:32:02.883 INFO:tasks.workunit.client.0.smithi087.stdout:8/193: creat db/d23/d1b/f42 x:0 0 0 2024-05-08T05:32:02.883 INFO:tasks.workunit.client.0.smithi087.stdout:8/194: readlink db/d23/l18 0 2024-05-08T05:32:02.885 INFO:tasks.workunit.client.0.smithi087.stdout:9/197: rmdir d1 39 2024-05-08T05:32:02.887 INFO:tasks.workunit.client.0.smithi087.stdout:5/181: dwrite da/db/d2a/f32 [0,4194304] 0 2024-05-08T05:32:02.891 INFO:tasks.workunit.client.0.smithi087.stdout:6/178: creat d4/d8/f3c x:0 0 0 2024-05-08T05:32:02.897 INFO:tasks.workunit.client.0.smithi087.stdout:6/179: unlink d4/d8/df/f10 0 2024-05-08T05:32:02.900 INFO:tasks.workunit.client.0.smithi087.stdout:6/180: rename d4/f16 to d4/d6/f3d 0 2024-05-08T05:32:02.900 INFO:tasks.workunit.client.0.smithi087.stdout:6/181: stat d4/d6/l15 0 2024-05-08T05:32:02.902 INFO:tasks.workunit.client.0.smithi087.stdout:0/196: sync 2024-05-08T05:32:02.902 INFO:tasks.workunit.client.0.smithi087.stdout:7/207: sync 2024-05-08T05:32:02.902 INFO:tasks.workunit.client.0.smithi087.stdout:9/198: write d1/df/f2c [2322664,106799] 0 2024-05-08T05:32:02.905 INFO:tasks.workunit.client.0.smithi087.stdout:7/208: rename d2/d6/d12/d1d/c1a to d2/d6/c3c 0 2024-05-08T05:32:02.908 INFO:tasks.workunit.client.0.smithi087.stdout:0/197: symlink d0/da/d35/l45 0 2024-05-08T05:32:02.910 INFO:tasks.workunit.client.0.smithi087.stdout:1/150: dwrite df/d18/f30 [0,4194304] 0 2024-05-08T05:32:02.911 INFO:tasks.workunit.client.0.smithi087.stdout:5/182: dread f7 [0,4194304] 0 2024-05-08T05:32:02.911 INFO:tasks.workunit.client.0.smithi087.stdout:5/183: rename da to da/db/d2a/d3b 22 2024-05-08T05:32:02.912 INFO:tasks.workunit.client.0.smithi087.stdout:1/151: mknod df/d18/d1d/d27/c34 0 2024-05-08T05:32:02.912 INFO:tasks.workunit.client.0.smithi087.stdout:5/184: getdents da/dd/d13/d16 0 2024-05-08T05:32:02.912 INFO:tasks.workunit.client.0.smithi087.stdout:5/185: stat da/dd/d10/d36/f39 0 2024-05-08T05:32:02.912 INFO:tasks.workunit.client.0.smithi087.stdout:5/186: fdatasync f7 0 2024-05-08T05:32:02.913 INFO:tasks.workunit.client.0.smithi087.stdout:5/187: creat da/f3c x:0 0 0 2024-05-08T05:32:02.913 INFO:tasks.workunit.client.0.smithi087.stdout:5/188: chown da/dd/d10/d17 0 1 2024-05-08T05:32:02.915 INFO:tasks.workunit.client.0.smithi087.stdout:5/189: link da/c35 da/db/c3d 0 2024-05-08T05:32:02.916 INFO:tasks.workunit.client.0.smithi087.stdout:5/190: symlink da/dd/d13/l3e 0 2024-05-08T05:32:02.916 INFO:tasks.workunit.client.0.smithi087.stdout:5/191: truncate da/db/d2a/f32 4951424 0 2024-05-08T05:32:02.917 INFO:tasks.workunit.client.0.smithi087.stdout:2/184: dwrite d7/de/f15 [0,4194304] 0 2024-05-08T05:32:02.917 INFO:tasks.workunit.client.0.smithi087.stdout:5/192: symlink da/dd/d13/l3f 0 2024-05-08T05:32:02.918 INFO:tasks.workunit.client.0.smithi087.stdout:2/185: link d7/f17 d7/d2d/f39 0 2024-05-08T05:32:02.919 INFO:tasks.workunit.client.0.smithi087.stdout:5/193: creat da/dd/d10/f40 x:0 0 0 2024-05-08T05:32:02.919 INFO:tasks.workunit.client.0.smithi087.stdout:5/194: truncate da/f30 233123 0 2024-05-08T05:32:02.920 INFO:tasks.workunit.client.0.smithi087.stdout:5/195: dread - da/f3c zero size 2024-05-08T05:32:02.920 INFO:tasks.workunit.client.0.smithi087.stdout:5/196: chown da/dd/d10/d17/c33 22 1 2024-05-08T05:32:02.921 INFO:tasks.workunit.client.0.smithi087.stdout:2/186: rmdir d7/d2d 39 2024-05-08T05:32:02.921 INFO:tasks.workunit.client.0.smithi087.stdout:4/176: dwrite d4/d13/f31 [4194304,4194304] 0 2024-05-08T05:32:02.921 INFO:tasks.workunit.client.0.smithi087.stdout:4/177: truncate d4/d13/f31 9051349 0 2024-05-08T05:32:02.922 INFO:tasks.workunit.client.0.smithi087.stdout:3/206: dwrite d4/d11/f19 [0,4194304] 0 2024-05-08T05:32:02.925 INFO:tasks.workunit.client.0.smithi087.stdout:4/178: creat d4/d25/f36 x:0 0 0 2024-05-08T05:32:02.926 INFO:tasks.workunit.client.0.smithi087.stdout:4/179: mknod d4/d13/c37 0 2024-05-08T05:32:02.930 INFO:tasks.workunit.client.0.smithi087.stdout:4/180: rename d4/d25/f29 to d4/d25/f38 0 2024-05-08T05:32:02.930 INFO:tasks.workunit.client.0.smithi087.stdout:4/181: chown d4/f2f 7596181 1 2024-05-08T05:32:02.933 INFO:tasks.workunit.client.0.smithi087.stdout:8/195: dwrite db/d23/d15/f36 [0,4194304] 0 2024-05-08T05:32:02.933 INFO:tasks.workunit.client.0.smithi087.stdout:6/182: dwrite d4/d8/df/d1e/f23 [0,4194304] 0 2024-05-08T05:32:02.942 INFO:tasks.workunit.client.0.smithi087.stdout:5/197: dread f9 [0,4194304] 0 2024-05-08T05:32:02.956 INFO:tasks.workunit.client.0.smithi087.stdout:8/196: mkdir db/d23/d1b/d35/d43 0 2024-05-08T05:32:02.956 INFO:tasks.workunit.client.0.smithi087.stdout:5/198: mkdir da/dd/d10/d41 0 2024-05-08T05:32:02.957 INFO:tasks.workunit.client.0.smithi087.stdout:6/183: dread d4/d6/f3d [0,4194304] 0 2024-05-08T05:32:02.959 INFO:tasks.workunit.client.0.smithi087.stdout:8/197: rmdir db/d23/d15/d29/d33 39 2024-05-08T05:32:02.960 INFO:tasks.workunit.client.0.smithi087.stdout:5/199: truncate f7 1696790 0 2024-05-08T05:32:02.964 INFO:tasks.workunit.client.0.smithi087.stdout:5/200: rmdir da/db/d2a 39 2024-05-08T05:32:02.977 INFO:tasks.workunit.client.0.smithi087.stdout:5/201: dread da/dd/d10/d17/f28 [0,4194304] 0 2024-05-08T05:32:02.980 INFO:tasks.workunit.client.0.smithi087.stdout:4/182: dread d4/d13/f31 [0,4194304] 0 2024-05-08T05:32:02.984 INFO:tasks.workunit.client.0.smithi087.stdout:7/209: dwrite d2/d6/d12/d19/f2d [0,4194304] 0 2024-05-08T05:32:02.984 INFO:tasks.workunit.client.0.smithi087.stdout:7/210: getdents d2/d6/d12/d19/d34 0 2024-05-08T05:32:02.984 INFO:tasks.workunit.client.0.smithi087.stdout:1/152: dwrite df/d18/f1b [0,4194304] 0 2024-05-08T05:32:02.984 INFO:tasks.workunit.client.0.smithi087.stdout:1/153: chown df/d12/f29 273 1 2024-05-08T05:32:02.984 INFO:tasks.workunit.client.0.smithi087.stdout:3/207: dwrite d4/d11/f20 [0,4194304] 0 2024-05-08T05:32:02.986 INFO:tasks.workunit.client.0.smithi087.stdout:7/211: getdents d2 0 2024-05-08T05:32:02.990 INFO:tasks.workunit.client.0.smithi087.stdout:2/187: dwrite f3 [0,4194304] 0 2024-05-08T05:32:02.990 INFO:tasks.workunit.client.0.smithi087.stdout:2/188: fdatasync f3 0 2024-05-08T05:32:02.990 INFO:tasks.workunit.client.0.smithi087.stdout:3/208: symlink d4/d11/d3d/l4b 0 2024-05-08T05:32:02.990 INFO:tasks.workunit.client.0.smithi087.stdout:3/209: creat d4/d11/d24/d25/d3e/f4c x:0 0 0 2024-05-08T05:32:02.994 INFO:tasks.workunit.client.0.smithi087.stdout:5/202: dread da/f2e [0,4194304] 0 2024-05-08T05:32:02.995 INFO:tasks.workunit.client.0.smithi087.stdout:5/203: mkdir da/dd/d10/d42 0 2024-05-08T05:32:02.997 INFO:tasks.workunit.client.0.smithi087.stdout:5/204: mkdir da/dd/d10/d42/d43 0 2024-05-08T05:32:02.997 INFO:tasks.workunit.client.0.smithi087.stdout:5/205: chown da/dd/d10/d17/f28 0 1 2024-05-08T05:32:02.998 INFO:tasks.workunit.client.0.smithi087.stdout:5/206: mknod da/db/d2a/c44 0 2024-05-08T05:32:02.999 INFO:tasks.workunit.client.0.smithi087.stdout:1/154: write df/f1f [555613,85780] 0 2024-05-08T05:32:02.999 INFO:tasks.workunit.client.0.smithi087.stdout:1/155: truncate df/f24 621932 0 2024-05-08T05:32:02.999 INFO:tasks.workunit.client.0.smithi087.stdout:1/156: truncate df/d12/f31 661178 0 2024-05-08T05:32:03.001 INFO:tasks.workunit.client.0.smithi087.stdout:1/157: creat df/d2f/f35 x:0 0 0 2024-05-08T05:32:03.001 INFO:tasks.workunit.client.0.smithi087.stdout:1/158: chown df/c17 285139129 1 2024-05-08T05:32:03.002 INFO:tasks.workunit.client.0.smithi087.stdout:1/159: write df/d2f/f35 [80404,85913] 0 2024-05-08T05:32:03.003 INFO:tasks.workunit.client.0.smithi087.stdout:1/160: mknod df/d12/c36 0 2024-05-08T05:32:03.004 INFO:tasks.workunit.client.0.smithi087.stdout:1/161: truncate df/d18/f30 1592530 0 2024-05-08T05:32:03.006 INFO:tasks.workunit.client.0.smithi087.stdout:6/184: dwrite d4/d6/f1b [0,4194304] 0 2024-05-08T05:32:03.012 INFO:tasks.workunit.client.0.smithi087.stdout:6/185: mknod d4/d8/df/d1e/d25/d28/d2d/d37/c3e 0 2024-05-08T05:32:03.013 INFO:tasks.workunit.client.0.smithi087.stdout:6/186: rmdir d4/d8/df/d1e/d25 39 2024-05-08T05:32:03.015 INFO:tasks.workunit.client.0.smithi087.stdout:6/187: link d4/d8/f18 d4/d8/df/d1e/d25/f3f 0 2024-05-08T05:32:03.017 INFO:tasks.workunit.client.0.smithi087.stdout:8/198: dwrite db/d23/f38 [0,4194304] 0 2024-05-08T05:32:03.017 INFO:tasks.workunit.client.0.smithi087.stdout:8/199: fsync db/d23/d15/f36 0 2024-05-08T05:32:03.020 INFO:tasks.workunit.client.0.smithi087.stdout:8/200: rename db/f39 to db/d23/d1b/d35/d43/f44 0 2024-05-08T05:32:03.022 INFO:tasks.workunit.client.0.smithi087.stdout:8/201: getdents db/d23/d1b 0 2024-05-08T05:32:03.022 INFO:tasks.workunit.client.0.smithi087.stdout:8/202: write db/d23/d15/f19 [1293187,30072] 0 2024-05-08T05:32:03.025 INFO:tasks.workunit.client.0.smithi087.stdout:8/203: unlink db/ce 0 2024-05-08T05:32:03.030 INFO:tasks.workunit.client.0.smithi087.stdout:0/198: sync 2024-05-08T05:32:03.030 INFO:tasks.workunit.client.0.smithi087.stdout:9/199: sync 2024-05-08T05:32:03.031 INFO:tasks.workunit.client.0.smithi087.stdout:9/200: getdents d1/df/d37 0 2024-05-08T05:32:03.032 INFO:tasks.workunit.client.0.smithi087.stdout:0/199: mknod d0/da/d35/c46 0 2024-05-08T05:32:03.034 INFO:tasks.workunit.client.0.smithi087.stdout:9/201: getdents d1/df/d14 0 2024-05-08T05:32:03.034 INFO:tasks.workunit.client.0.smithi087.stdout:9/202: truncate d1/df/d14/d18/d22/f2d 565210 0 2024-05-08T05:32:03.035 INFO:tasks.workunit.client.0.smithi087.stdout:2/189: dwrite d7/de/f24 [0,4194304] 0 2024-05-08T05:32:03.039 INFO:tasks.workunit.client.0.smithi087.stdout:2/190: rename d7/de/f13 to d7/de/f3a 0 2024-05-08T05:32:03.039 INFO:tasks.workunit.client.0.smithi087.stdout:2/191: stat d7/de/c2a 0 2024-05-08T05:32:03.054 INFO:tasks.workunit.client.0.smithi087.stdout:0/200: read d0/f29 [1238000,69925] 0 2024-05-08T05:32:03.055 INFO:tasks.workunit.client.0.smithi087.stdout:0/201: getdents d0/d9 0 2024-05-08T05:32:03.057 INFO:tasks.workunit.client.0.smithi087.stdout:0/202: link d0/d9/df/f34 d0/da/f47 0 2024-05-08T05:32:03.058 INFO:tasks.workunit.client.0.smithi087.stdout:4/183: dwrite d4/d13/f26 [0,4194304] 0 2024-05-08T05:32:03.061 INFO:tasks.workunit.client.0.smithi087.stdout:1/162: dwrite df/d18/f30 [0,4194304] 0 2024-05-08T05:32:03.062 INFO:tasks.workunit.client.0.smithi087.stdout:1/163: read df/d12/f31 [321495,128213] 0 2024-05-08T05:32:03.062 INFO:tasks.workunit.client.0.smithi087.stdout:0/203: rename d0/d9/d1b/d2f/f40 to d0/d9/f48 0 2024-05-08T05:32:03.063 INFO:tasks.workunit.client.0.smithi087.stdout:4/184: creat d4/d25/d28/f39 x:0 0 0 2024-05-08T05:32:03.066 INFO:tasks.workunit.client.0.smithi087.stdout:0/204: creat d0/d22/d3c/f49 x:0 0 0 2024-05-08T05:32:03.066 INFO:tasks.workunit.client.0.smithi087.stdout:0/205: stat d0/l41 0 2024-05-08T05:32:03.073 INFO:tasks.workunit.client.0.smithi087.stdout:3/210: dwrite d4/d11/d24/d25/f34 [0,4194304] 0 2024-05-08T05:32:03.073 INFO:tasks.workunit.client.0.smithi087.stdout:3/211: truncate d4/f3c 369991 0 2024-05-08T05:32:03.075 INFO:tasks.workunit.client.0.smithi087.stdout:6/188: dwrite d4/d6/f13 [4194304,4194304] 0 2024-05-08T05:32:03.075 INFO:tasks.workunit.client.0.smithi087.stdout:6/189: dread - d4/d8/f3c zero size 2024-05-08T05:32:03.075 INFO:tasks.workunit.client.0.smithi087.stdout:8/204: dread db/d23/f38 [0,4194304] 0 2024-05-08T05:32:03.075 INFO:tasks.workunit.client.0.smithi087.stdout:8/205: fdatasync f9 0 2024-05-08T05:32:03.075 INFO:tasks.workunit.client.0.smithi087.stdout:6/190: write d4/d8/df/d1e/d25/f2f [1508,115228] 0 2024-05-08T05:32:03.081 INFO:tasks.workunit.client.0.smithi087.stdout:3/212: mkdir d4/d11/d24/d25/d4d 0 2024-05-08T05:32:03.082 INFO:tasks.workunit.client.0.smithi087.stdout:8/206: link f2 db/d23/d15/d29/d33/d3b/f45 0 2024-05-08T05:32:03.086 INFO:tasks.workunit.client.0.smithi087.stdout:3/213: mkdir d4/d11/d3d/d4e 0 2024-05-08T05:32:03.086 INFO:tasks.workunit.client.0.smithi087.stdout:3/214: read d4/d14/f28 [92472,84830] 0 2024-05-08T05:32:03.087 INFO:tasks.workunit.client.0.smithi087.stdout:8/207: creat db/d23/d3a/f46 x:0 0 0 2024-05-08T05:32:03.091 INFO:tasks.workunit.client.0.smithi087.stdout:3/215: mknod d4/d14/c4f 0 2024-05-08T05:32:03.092 INFO:tasks.workunit.client.0.smithi087.stdout:3/216: creat d4/d11/f50 x:0 0 0 2024-05-08T05:32:03.094 INFO:tasks.workunit.client.0.smithi087.stdout:3/217: truncate d4/d11/d3d/f47 581893 0 2024-05-08T05:32:03.094 INFO:tasks.workunit.client.0.smithi087.stdout:3/218: stat d4/d11/d24/d39 0 2024-05-08T05:32:03.102 INFO:tasks.workunit.client.0.smithi087.stdout:8/208: dread f3 [0,4194304] 0 2024-05-08T05:32:03.102 INFO:tasks.workunit.client.0.smithi087.stdout:8/209: fdatasync db/d23/d15/f21 0 2024-05-08T05:32:03.105 INFO:tasks.workunit.client.0.smithi087.stdout:8/210: mknod db/d23/c47 0 2024-05-08T05:32:03.114 INFO:tasks.workunit.client.0.smithi087.stdout:5/207: dwrite f7 [0,4194304] 0 2024-05-08T05:32:03.116 INFO:tasks.workunit.client.0.smithi087.stdout:1/164: dwrite df/d2f/f35 [0,4194304] 0 2024-05-08T05:32:03.133 INFO:tasks.workunit.client.0.smithi087.stdout:6/191: dwrite d4/d8/f2e [0,4194304] 0 2024-05-08T05:32:03.139 INFO:tasks.workunit.client.0.smithi087.stdout:4/185: dwrite d4/d13/f16 [0,4194304] 0 2024-05-08T05:32:03.142 INFO:tasks.workunit.client.0.smithi087.stdout:4/186: link d4/d13/f16 d4/d25/d28/d35/f3a 0 2024-05-08T05:32:03.143 INFO:tasks.workunit.client.0.smithi087.stdout:4/187: mknod d4/c3b 0 2024-05-08T05:32:03.147 INFO:tasks.workunit.client.0.smithi087.stdout:2/192: dwrite d7/de/d27/d33/f23 [0,4194304] 0 2024-05-08T05:32:03.147 INFO:tasks.workunit.client.0.smithi087.stdout:1/165: dread df/f11 [0,4194304] 0 2024-05-08T05:32:03.151 INFO:tasks.workunit.client.0.smithi087.stdout:0/206: dwrite d0/da/d35/f3d [0,4194304] 0 2024-05-08T05:32:03.152 INFO:tasks.workunit.client.0.smithi087.stdout:6/192: dread d4/d6/f1b [0,4194304] 0 2024-05-08T05:32:03.155 INFO:tasks.workunit.client.0.smithi087.stdout:2/193: dread d7/f17 [0,4194304] 0 2024-05-08T05:32:03.156 INFO:tasks.workunit.client.0.smithi087.stdout:2/194: readlink d7/de/l1d 0 2024-05-08T05:32:03.159 INFO:tasks.workunit.client.0.smithi087.stdout:8/211: dwrite f5 [8388608,4194304] 0 2024-05-08T05:32:03.159 INFO:tasks.workunit.client.0.smithi087.stdout:3/219: dwrite d4/d14/f29 [0,4194304] 0 2024-05-08T05:32:03.159 INFO:tasks.workunit.client.0.smithi087.stdout:3/220: stat d4/d11 0 2024-05-08T05:32:03.164 INFO:tasks.workunit.client.0.smithi087.stdout:0/207: dread d0/d9/d23/f2a [0,4194304] 0 2024-05-08T05:32:03.164 INFO:tasks.workunit.client.0.smithi087.stdout:8/212: mknod db/d23/d1b/c48 0 2024-05-08T05:32:03.164 INFO:tasks.workunit.client.0.smithi087.stdout:7/212: sync 2024-05-08T05:32:03.164 INFO:tasks.workunit.client.0.smithi087.stdout:8/213: write db/d23/d3a/f46 [867045,4642] 0 2024-05-08T05:32:03.164 INFO:tasks.workunit.client.0.smithi087.stdout:9/203: sync 2024-05-08T05:32:03.164 INFO:tasks.workunit.client.0.smithi087.stdout:0/208: symlink d0/da/d35/l4a 0 2024-05-08T05:32:03.166 INFO:tasks.workunit.client.0.smithi087.stdout:7/213: symlink d2/d6/l3d 0 2024-05-08T05:32:03.166 INFO:tasks.workunit.client.0.smithi087.stdout:7/214: readlink d2/d6/l3d 0 2024-05-08T05:32:03.167 INFO:tasks.workunit.client.0.smithi087.stdout:7/215: creat d2/d6/d12/d1d/d32/f3e x:0 0 0 2024-05-08T05:32:03.168 INFO:tasks.workunit.client.0.smithi087.stdout:3/221: dread d4/f3c [0,4194304] 0 2024-05-08T05:32:03.168 INFO:tasks.workunit.client.0.smithi087.stdout:3/222: readlink d4/l35 0 2024-05-08T05:32:03.168 INFO:tasks.workunit.client.0.smithi087.stdout:3/223: fdatasync d4/d11/d24/d25/f2f 0 2024-05-08T05:32:03.169 INFO:tasks.workunit.client.0.smithi087.stdout:6/193: dread d4/fd [4194304,4194304] 0 2024-05-08T05:32:03.170 INFO:tasks.workunit.client.0.smithi087.stdout:3/224: rename f2 to d4/d11/d3d/f51 0 2024-05-08T05:32:03.170 INFO:tasks.workunit.client.0.smithi087.stdout:6/194: getdents d4/d8/df/d1e/d25/d28/d2d 0 2024-05-08T05:32:03.172 INFO:tasks.workunit.client.0.smithi087.stdout:8/214: dread f4 [0,4194304] 0 2024-05-08T05:32:03.172 INFO:tasks.workunit.client.0.smithi087.stdout:3/225: creat d4/d11/d3d/d48/f52 x:0 0 0 2024-05-08T05:32:03.173 INFO:tasks.workunit.client.0.smithi087.stdout:8/215: symlink db/d23/d15/d29/l49 0 2024-05-08T05:32:03.173 INFO:tasks.workunit.client.0.smithi087.stdout:8/216: write db/d23/d15/d29/d33/d3b/f45 [3489152,82779] 0 2024-05-08T05:32:03.176 INFO:tasks.workunit.client.0.smithi087.stdout:8/217: mkdir db/d23/d15/d29/d33/d4a 0 2024-05-08T05:32:03.176 INFO:tasks.workunit.client.0.smithi087.stdout:8/218: chown db/d23/d1b/l22 83548 1 2024-05-08T05:32:03.183 INFO:tasks.workunit.client.0.smithi087.stdout:6/195: write d4/d6/f1b [2020269,92788] 0 2024-05-08T05:32:03.183 INFO:tasks.workunit.client.0.smithi087.stdout:6/196: chown d4/d8/df 61615907 1 2024-05-08T05:32:03.183 INFO:tasks.workunit.client.0.smithi087.stdout:9/204: dread d1/df/f2c [0,4194304] 0 2024-05-08T05:32:03.183 INFO:tasks.workunit.client.0.smithi087.stdout:8/219: mkdir db/d23/d1b/d4b 0 2024-05-08T05:32:03.183 INFO:tasks.workunit.client.0.smithi087.stdout:9/205: truncate d1/f8 2920049 0 2024-05-08T05:32:03.183 INFO:tasks.workunit.client.0.smithi087.stdout:9/206: mknod d1/df/d14/d18/d22/c3a 0 2024-05-08T05:32:03.183 INFO:tasks.workunit.client.0.smithi087.stdout:9/207: write d1/df/f2c [2690309,44896] 0 2024-05-08T05:32:03.184 INFO:tasks.workunit.client.0.smithi087.stdout:9/208: link d1/df/d14/d18/c33 d1/db/d28/c3b 0 2024-05-08T05:32:03.191 INFO:tasks.workunit.client.0.smithi087.stdout:5/208: dwrite da/dd/d10/d17/f28 [0,4194304] 0 2024-05-08T05:32:03.215 INFO:tasks.workunit.client.0.smithi087.stdout:9/209: write d1/fa [2370935,37115] 0 2024-05-08T05:32:03.215 INFO:tasks.workunit.client.0.smithi087.stdout:9/210: dread - d1/df/f35 zero size 2024-05-08T05:32:03.224 INFO:tasks.workunit.client.0.smithi087.stdout:1/166: dwrite df/d18/f30 [0,4194304] 0 2024-05-08T05:32:03.224 INFO:tasks.workunit.client.0.smithi087.stdout:0/209: dwrite d0/f2 [0,4194304] 0 2024-05-08T05:32:03.225 INFO:tasks.workunit.client.0.smithi087.stdout:0/210: mknod d0/c4b 0 2024-05-08T05:32:03.232 INFO:tasks.workunit.client.0.smithi087.stdout:1/167: rmdir df/d12 39 2024-05-08T05:32:03.233 INFO:tasks.workunit.client.0.smithi087.stdout:1/168: unlink df/c10 0 2024-05-08T05:32:03.239 INFO:tasks.workunit.client.0.smithi087.stdout:1/169: mknod df/d18/d1d/d27/c37 0 2024-05-08T05:32:03.239 INFO:tasks.workunit.client.0.smithi087.stdout:6/197: dwrite d4/d8/df/d1e/f23 [0,4194304] 0 2024-05-08T05:32:03.239 INFO:tasks.workunit.client.0.smithi087.stdout:1/170: chown df/c19 410271358 1 2024-05-08T05:32:03.239 INFO:tasks.workunit.client.0.smithi087.stdout:6/198: fdatasync d4/d8/f3b 0 2024-05-08T05:32:03.239 INFO:tasks.workunit.client.0.smithi087.stdout:6/199: chown d4/d6 10673 1 2024-05-08T05:32:03.240 INFO:tasks.workunit.client.0.smithi087.stdout:8/220: dwrite db/d23/d1b/f3d [4194304,4194304] 0 2024-05-08T05:32:03.240 INFO:tasks.workunit.client.0.smithi087.stdout:1/171: symlink df/d18/d1d/d32/l38 0 2024-05-08T05:32:03.240 INFO:tasks.workunit.client.0.smithi087.stdout:6/200: mknod d4/d8/df/d39/c40 0 2024-05-08T05:32:03.240 INFO:tasks.workunit.client.0.smithi087.stdout:6/201: readlink d4/d6/l15 0 2024-05-08T05:32:03.240 INFO:tasks.workunit.client.0.smithi087.stdout:8/221: unlink db/d23/d15/d29/d33/d3b/f45 0 2024-05-08T05:32:03.240 INFO:tasks.workunit.client.0.smithi087.stdout:8/222: readlink db/l10 0 2024-05-08T05:32:03.242 INFO:tasks.workunit.client.0.smithi087.stdout:5/209: dread da/dd/d10/d17/f28 [0,4194304] 0 2024-05-08T05:32:03.243 INFO:tasks.workunit.client.0.smithi087.stdout:6/202: mknod d4/d6/c41 0 2024-05-08T05:32:03.245 INFO:tasks.workunit.client.0.smithi087.stdout:8/223: creat db/d23/d15/d29/d33/d3b/f4c x:0 0 0 2024-05-08T05:32:03.246 INFO:tasks.workunit.client.0.smithi087.stdout:6/203: mkdir d4/d8/df/d39/d42 0 2024-05-08T05:32:03.247 INFO:tasks.workunit.client.0.smithi087.stdout:8/224: mkdir db/d23/d15/d29/d4d 0 2024-05-08T05:32:03.249 INFO:tasks.workunit.client.0.smithi087.stdout:8/225: truncate f9 6860006 0 2024-05-08T05:32:03.250 INFO:tasks.workunit.client.0.smithi087.stdout:8/226: symlink db/d23/d3a/l4e 0 2024-05-08T05:32:03.251 INFO:tasks.workunit.client.0.smithi087.stdout:2/195: dwrite d7/f22 [0,4194304] 0 2024-05-08T05:32:03.252 INFO:tasks.workunit.client.0.smithi087.stdout:0/211: dread d0/da/d35/f3d [0,4194304] 0 2024-05-08T05:32:03.252 INFO:tasks.workunit.client.0.smithi087.stdout:1/172: dread fa [0,4194304] 0 2024-05-08T05:32:03.252 INFO:tasks.workunit.client.0.smithi087.stdout:8/227: mkdir db/d23/d1b/d4f 0 2024-05-08T05:32:03.253 INFO:tasks.workunit.client.0.smithi087.stdout:2/196: getdents d7/de/d27 0 2024-05-08T05:32:03.255 INFO:tasks.workunit.client.0.smithi087.stdout:0/212: symlink d0/da/d35/l4c 0 2024-05-08T05:32:03.257 INFO:tasks.workunit.client.0.smithi087.stdout:1/173: mkdir df/d39 0 2024-05-08T05:32:03.258 INFO:tasks.workunit.client.0.smithi087.stdout:9/211: dwrite d1/db/f1f [0,4194304] 0 2024-05-08T05:32:03.259 INFO:tasks.workunit.client.0.smithi087.stdout:9/212: truncate d1/db/f10 260444 0 2024-05-08T05:32:03.260 INFO:tasks.workunit.client.0.smithi087.stdout:8/228: creat db/d23/d1b/d35/d43/f50 x:0 0 0 2024-05-08T05:32:03.260 INFO:tasks.workunit.client.0.smithi087.stdout:8/229: chown db/d23/c1a 4072 1 2024-05-08T05:32:03.262 INFO:tasks.workunit.client.0.smithi087.stdout:2/197: mknod d7/c3b 0 2024-05-08T05:32:03.266 INFO:tasks.workunit.client.0.smithi087.stdout:0/213: truncate d0/da/f3a 2513098 0 2024-05-08T05:32:03.266 INFO:tasks.workunit.client.0.smithi087.stdout:9/213: mknod d1/db/d28/c3c 0 2024-05-08T05:32:03.266 INFO:tasks.workunit.client.0.smithi087.stdout:9/214: readlink d1/df/l38 0 2024-05-08T05:32:03.266 INFO:tasks.workunit.client.0.smithi087.stdout:9/215: write d1/f21 [4358921,58346] 0 2024-05-08T05:32:03.266 INFO:tasks.workunit.client.0.smithi087.stdout:9/216: chown d1/f19 841 1 2024-05-08T05:32:03.268 INFO:tasks.workunit.client.0.smithi087.stdout:2/198: rename d7/lf to d7/d2d/l3c 0 2024-05-08T05:32:03.269 INFO:tasks.workunit.client.0.smithi087.stdout:2/199: mknod d7/de/d27/d33/c3d 0 2024-05-08T05:32:03.271 INFO:tasks.workunit.client.0.smithi087.stdout:8/230: dread db/f12 [0,4194304] 0 2024-05-08T05:32:03.277 INFO:tasks.workunit.client.0.smithi087.stdout:2/200: mknod d7/de/d2c/c3e 0 2024-05-08T05:32:03.277 INFO:tasks.workunit.client.0.smithi087.stdout:0/214: dread d0/da/f30 [0,4194304] 0 2024-05-08T05:32:03.279 INFO:tasks.workunit.client.0.smithi087.stdout:0/215: creat d0/d9/df/f4d x:0 0 0 2024-05-08T05:32:03.279 INFO:tasks.workunit.client.0.smithi087.stdout:0/216: stat d0/da/f1e 0 2024-05-08T05:32:03.290 INFO:tasks.workunit.client.0.smithi087.stdout:0/217: getdents d0/da 0 2024-05-08T05:32:03.304 INFO:tasks.workunit.client.0.smithi087.stdout:2/201: dread d7/de/d27/d33/f21 [4194304,4194304] 0 2024-05-08T05:32:03.305 INFO:tasks.workunit.client.0.smithi087.stdout:2/202: stat d7/de 0 2024-05-08T05:32:03.306 INFO:tasks.workunit.client.0.smithi087.stdout:2/203: symlink d7/de/l3f 0 2024-05-08T05:32:03.309 INFO:tasks.workunit.client.0.smithi087.stdout:2/204: link d7/de/l1b d7/d2d/l40 0 2024-05-08T05:32:03.312 INFO:tasks.workunit.client.0.smithi087.stdout:2/205: truncate d7/f1e 26341 0 2024-05-08T05:32:03.312 INFO:tasks.workunit.client.0.smithi087.stdout:2/206: chown d7/de/d2c/c34 11352 1 2024-05-08T05:32:03.314 INFO:tasks.workunit.client.0.smithi087.stdout:2/207: symlink d7/de/d27/l41 0 2024-05-08T05:32:03.314 INFO:tasks.workunit.client.0.smithi087.stdout:2/208: fdatasync d7/f1e 0 2024-05-08T05:32:03.327 INFO:tasks.workunit.client.0.smithi087.stdout:1/174: dwrite df/d12/f1a [0,4194304] 0 2024-05-08T05:32:03.328 INFO:tasks.workunit.client.0.smithi087.stdout:2/209: write d7/de/d27/f2e [85812,65299] 0 2024-05-08T05:32:03.328 INFO:tasks.workunit.client.0.smithi087.stdout:2/210: chown d7/de/d27/d33/f30 35 1 2024-05-08T05:32:03.328 INFO:tasks.workunit.client.0.smithi087.stdout:2/211: write d7/de/f3a [3101866,23073] 0 2024-05-08T05:32:03.328 INFO:tasks.workunit.client.0.smithi087.stdout:8/231: dwrite db/d23/d1b/f30 [0,4194304] 0 2024-05-08T05:32:03.329 INFO:tasks.workunit.client.0.smithi087.stdout:5/210: dwrite f9 [0,4194304] 0 2024-05-08T05:32:03.330 INFO:tasks.workunit.client.0.smithi087.stdout:9/217: dwrite d1/df/f12 [0,4194304] 0 2024-05-08T05:32:03.331 INFO:tasks.workunit.client.0.smithi087.stdout:9/218: fdatasync d1/db/fc 0 2024-05-08T05:32:03.331 INFO:tasks.workunit.client.0.smithi087.stdout:9/219: chown d1/l36 5551696 1 2024-05-08T05:32:03.331 INFO:tasks.workunit.client.0.smithi087.stdout:9/220: chown d1/df/d14/d18/d22/c27 11 1 2024-05-08T05:32:03.331 INFO:tasks.workunit.client.0.smithi087.stdout:9/221: write d1/f13 [2133994,15882] 0 2024-05-08T05:32:03.332 INFO:tasks.workunit.client.0.smithi087.stdout:1/175: creat df/d18/d1d/f3a x:0 0 0 2024-05-08T05:32:03.332 INFO:tasks.workunit.client.0.smithi087.stdout:1/176: chown c4 112166 1 2024-05-08T05:32:03.332 INFO:tasks.workunit.client.0.smithi087.stdout:6/204: dwrite d4/d8/f35 [0,4194304] 0 2024-05-08T05:32:03.332 INFO:tasks.workunit.client.0.smithi087.stdout:6/205: stat d4/d8/c26 0 2024-05-08T05:32:03.334 INFO:tasks.workunit.client.0.smithi087.stdout:1/177: write df/f24 [360694,110629] 0 2024-05-08T05:32:03.345 INFO:tasks.workunit.client.0.smithi087.stdout:2/212: rename d7/de/d27/d33/f23 to d7/f42 0 2024-05-08T05:32:03.345 INFO:tasks.workunit.client.0.smithi087.stdout:7/216: sync 2024-05-08T05:32:03.345 INFO:tasks.workunit.client.0.smithi087.stdout:3/226: sync 2024-05-08T05:32:03.346 INFO:tasks.workunit.client.0.smithi087.stdout:3/227: write d4/d11/f23 [396506,109794] 0 2024-05-08T05:32:03.346 INFO:tasks.workunit.client.0.smithi087.stdout:4/188: sync 2024-05-08T05:32:03.347 INFO:tasks.workunit.client.0.smithi087.stdout:6/206: rename d4/d8/df/f1a to d4/d8/df/d1e/f43 0 2024-05-08T05:32:03.347 INFO:tasks.workunit.client.0.smithi087.stdout:6/207: fdatasync d4/fd 0 2024-05-08T05:32:03.347 INFO:tasks.workunit.client.0.smithi087.stdout:3/228: symlink d4/d11/d24/d39/l53 0 2024-05-08T05:32:03.349 INFO:tasks.workunit.client.0.smithi087.stdout:3/229: creat d4/d11/d24/d25/f54 x:0 0 0 2024-05-08T05:32:03.356 INFO:tasks.workunit.client.0.smithi087.stdout:4/189: rename d4/d13/f26 to d4/d13/d32/f3c 0 2024-05-08T05:32:03.357 INFO:tasks.workunit.client.0.smithi087.stdout:5/211: dread da/db/d2a/f32 [0,4194304] 0 2024-05-08T05:32:03.367 INFO:tasks.workunit.client.0.smithi087.stdout:5/212: stat da/db/d2a/c37 0 2024-05-08T05:32:03.367 INFO:tasks.workunit.client.0.smithi087.stdout:5/213: mkdir da/dd/d10/d36/d45 0 2024-05-08T05:32:03.367 INFO:tasks.workunit.client.0.smithi087.stdout:5/214: write da/dd/d10/d17/f3a [682861,1700] 0 2024-05-08T05:32:03.380 INFO:tasks.workunit.client.0.smithi087.stdout:3/230: write d4/f3c [266073,129109] 0 2024-05-08T05:32:03.381 INFO:tasks.workunit.client.0.smithi087.stdout:8/232: dwrite f8 [0,4194304] 0 2024-05-08T05:32:03.382 INFO:tasks.workunit.client.0.smithi087.stdout:6/208: dread d4/d8/f2e [0,4194304] 0 2024-05-08T05:32:03.382 INFO:tasks.workunit.client.0.smithi087.stdout:6/209: chown d4/d8/df/d1e/l2c 336505975 1 2024-05-08T05:32:03.382 INFO:tasks.workunit.client.0.smithi087.stdout:6/210: readlink d4/l19 0 2024-05-08T05:32:03.386 INFO:tasks.workunit.client.0.smithi087.stdout:3/231: symlink d4/d11/d24/d39/l55 0 2024-05-08T05:32:03.389 INFO:tasks.workunit.client.0.smithi087.stdout:6/211: mknod d4/d8/df/c44 0 2024-05-08T05:32:03.389 INFO:tasks.workunit.client.0.smithi087.stdout:3/232: link d4/d11/f23 d4/d11/d3d/f56 0 2024-05-08T05:32:03.389 INFO:tasks.workunit.client.0.smithi087.stdout:3/233: mknod d4/d11/d24/d39/c57 0 2024-05-08T05:32:03.396 INFO:tasks.workunit.client.0.smithi087.stdout:9/222: dwrite d1/df/f12 [0,4194304] 0 2024-05-08T05:32:03.400 INFO:tasks.workunit.client.0.smithi087.stdout:2/213: dwrite d7/de/d27/f2e [4194304,4194304] 0 2024-05-08T05:32:03.400 INFO:tasks.workunit.client.0.smithi087.stdout:2/214: readlink d7/d2d/l40 0 2024-05-08T05:32:03.400 INFO:tasks.workunit.client.0.smithi087.stdout:2/215: dread - d7/de/d2c/f31 zero size 2024-05-08T05:32:03.400 INFO:tasks.workunit.client.0.smithi087.stdout:2/216: readlink d7/de/l1b 0 2024-05-08T05:32:03.404 INFO:tasks.workunit.client.0.smithi087.stdout:2/217: mkdir d7/de/d2c/d43 0 2024-05-08T05:32:03.404 INFO:tasks.workunit.client.0.smithi087.stdout:2/218: fdatasync d7/de/d27/d33/f21 0 2024-05-08T05:32:03.405 INFO:tasks.workunit.client.0.smithi087.stdout:2/219: creat d7/de/d27/f44 x:0 0 0 2024-05-08T05:32:03.406 INFO:tasks.workunit.client.0.smithi087.stdout:1/178: dwrite df/d18/f1b [0,4194304] 0 2024-05-08T05:32:03.419 INFO:tasks.workunit.client.0.smithi087.stdout:9/223: dread d1/db/f1b [0,4194304] 0 2024-05-08T05:32:03.421 INFO:tasks.workunit.client.0.smithi087.stdout:9/224: link d1/f19 d1/db/d28/f3d 0 2024-05-08T05:32:03.424 INFO:tasks.workunit.client.0.smithi087.stdout:9/225: fdatasync d1/df/d14/f2f 0 2024-05-08T05:32:03.425 INFO:tasks.workunit.client.0.smithi087.stdout:4/190: dwrite d4/d25/f36 [0,4194304] 0 2024-05-08T05:32:03.425 INFO:tasks.workunit.client.0.smithi087.stdout:4/191: readlink d4/l5 0 2024-05-08T05:32:03.427 INFO:tasks.workunit.client.0.smithi087.stdout:1/179: read df/f11 [3674119,51702] 0 2024-05-08T05:32:03.427 INFO:tasks.workunit.client.0.smithi087.stdout:1/180: readlink l7 0 2024-05-08T05:32:03.427 INFO:tasks.workunit.client.0.smithi087.stdout:2/220: read d7/de/d27/d33/f1c [3203468,95573] 0 2024-05-08T05:32:03.427 INFO:tasks.workunit.client.0.smithi087.stdout:3/234: dread d4/d11/d24/f26 [0,4194304] 0 2024-05-08T05:32:03.427 INFO:tasks.workunit.client.0.smithi087.stdout:3/235: chown d4/d11/d24/d25/d3e/c43 597 1 2024-05-08T05:32:03.428 INFO:tasks.workunit.client.0.smithi087.stdout:7/217: dwrite d2/d6/d12/d1d/f17 [0,4194304] 0 2024-05-08T05:32:03.428 INFO:tasks.workunit.client.0.smithi087.stdout:5/215: dwrite f2 [4194304,4194304] 0 2024-05-08T05:32:03.432 INFO:tasks.workunit.client.0.smithi087.stdout:2/221: link d7/de/d27/l41 d7/de/d2c/l45 0 2024-05-08T05:32:03.432 INFO:tasks.workunit.client.0.smithi087.stdout:6/212: write d4/f12 [4049094,67325] 0 2024-05-08T05:32:03.433 INFO:tasks.workunit.client.0.smithi087.stdout:3/236: rmdir d4/d11/d24/d25/d3e 39 2024-05-08T05:32:03.434 INFO:tasks.workunit.client.0.smithi087.stdout:4/192: rename d4/d13/c2b to d4/d25/d28/d35/c3d 0 2024-05-08T05:32:03.445 INFO:tasks.workunit.client.0.smithi087.stdout:9/226: dread d1/db/fc [0,4194304] 0 2024-05-08T05:32:03.445 INFO:tasks.workunit.client.0.smithi087.stdout:9/227: chown d1/db/d28/f3d 96080 1 2024-05-08T05:32:03.447 INFO:tasks.workunit.client.0.smithi087.stdout:5/216: read f9 [5342473,95453] 0 2024-05-08T05:32:03.447 INFO:tasks.workunit.client.0.smithi087.stdout:4/193: rename d4/d25 to d4/d13/d3e 0 2024-05-08T05:32:03.447 INFO:tasks.workunit.client.0.smithi087.stdout:4/194: fsync d4/d13/f16 0 2024-05-08T05:32:03.451 INFO:tasks.workunit.client.0.smithi087.stdout:4/195: creat d4/d13/f3f x:0 0 0 2024-05-08T05:32:03.453 INFO:tasks.workunit.client.0.smithi087.stdout:4/196: creat d4/f40 x:0 0 0 2024-05-08T05:32:03.459 INFO:tasks.workunit.client.0.smithi087.stdout:4/197: getdents d4/d13 0 2024-05-08T05:32:03.461 INFO:tasks.workunit.client.0.smithi087.stdout:7/218: dwrite d2/d6/f25 [0,4194304] 0 2024-05-08T05:32:03.461 INFO:tasks.workunit.client.0.smithi087.stdout:3/237: write d4/d11/f38 [2295647,15162] 0 2024-05-08T05:32:03.461 INFO:tasks.workunit.client.0.smithi087.stdout:6/213: dread d4/d8/df/d1e/f23 [0,4194304] 0 2024-05-08T05:32:03.461 INFO:tasks.workunit.client.0.smithi087.stdout:6/214: chown d4/d8/f3c 111 1 2024-05-08T05:32:03.461 INFO:tasks.workunit.client.0.smithi087.stdout:6/215: readlink d4/d6/l15 0 2024-05-08T05:32:03.461 INFO:tasks.workunit.client.0.smithi087.stdout:8/233: dwrite db/f37 [0,4194304] 0 2024-05-08T05:32:03.461 INFO:tasks.workunit.client.0.smithi087.stdout:8/234: write db/f41 [293627,99803] 0 2024-05-08T05:32:03.462 INFO:tasks.workunit.client.0.smithi087.stdout:8/235: write db/d23/d15/d3c/f3f [931339,25987] 0 2024-05-08T05:32:03.462 INFO:tasks.workunit.client.0.smithi087.stdout:9/228: rename d1/df/d14/d18/d22 to d1/df/d37/d3e 0 2024-05-08T05:32:03.463 INFO:tasks.workunit.client.0.smithi087.stdout:1/181: write df/d12/f1a [815043,68398] 0 2024-05-08T05:32:03.464 INFO:tasks.workunit.client.0.smithi087.stdout:4/198: rmdir d4/d13/d3e/d28 39 2024-05-08T05:32:03.464 INFO:tasks.workunit.client.0.smithi087.stdout:6/216: truncate d4/d8/f35 4107760 0 2024-05-08T05:32:03.464 INFO:tasks.workunit.client.0.smithi087.stdout:4/199: chown d4/d13/d3e/d28/d35/c3d 207681 1 2024-05-08T05:32:03.468 INFO:tasks.workunit.client.0.smithi087.stdout:8/236: link db/d23/d15/f34 db/d23/d3a/f51 0 2024-05-08T05:32:03.471 INFO:tasks.workunit.client.0.smithi087.stdout:7/219: rename d2/d6/d12/d15/d29 to d2/da/d3f 0 2024-05-08T05:32:03.473 INFO:tasks.workunit.client.0.smithi087.stdout:6/217: mkdir d4/d8/df/d1e/d25/d28/d2d/d37/d45 0 2024-05-08T05:32:03.473 INFO:tasks.workunit.client.0.smithi087.stdout:6/218: fdatasync d4/d8/f18 0 2024-05-08T05:32:03.475 INFO:tasks.workunit.client.0.smithi087.stdout:4/200: creat d4/d13/d3e/d28/d35/f41 x:0 0 0 2024-05-08T05:32:03.478 INFO:tasks.workunit.client.0.smithi087.stdout:8/237: rename db/d23/d1b/f42 to db/d23/d15/d29/f52 0 2024-05-08T05:32:03.478 INFO:tasks.workunit.client.0.smithi087.stdout:8/238: stat db/d23/d3a/f46 0 2024-05-08T05:32:03.482 INFO:tasks.workunit.client.0.smithi087.stdout:8/239: write db/d23/d15/f19 [813969,32730] 0 2024-05-08T05:32:03.482 INFO:tasks.workunit.client.0.smithi087.stdout:8/240: read - db/d23/d15/d29/f32 zero size 2024-05-08T05:32:03.482 INFO:tasks.workunit.client.0.smithi087.stdout:8/241: readlink db/l10 0 2024-05-08T05:32:03.482 INFO:tasks.workunit.client.0.smithi087.stdout:8/242: readlink db/l10 0 2024-05-08T05:32:03.483 INFO:tasks.workunit.client.0.smithi087.stdout:4/201: mkdir d4/d13/d32/d42 0 2024-05-08T05:32:03.484 INFO:tasks.workunit.client.0.smithi087.stdout:8/243: creat db/d23/d1b/d35/d43/f53 x:0 0 0 2024-05-08T05:32:03.485 INFO:tasks.workunit.client.0.smithi087.stdout:4/202: creat d4/d13/d3e/d28/d35/f43 x:0 0 0 2024-05-08T05:32:03.485 INFO:tasks.workunit.client.0.smithi087.stdout:4/203: write d4/fe [673974,69296] 0 2024-05-08T05:32:03.485 INFO:tasks.workunit.client.0.smithi087.stdout:4/204: chown d4/l1e 947969430 1 2024-05-08T05:32:03.486 INFO:tasks.workunit.client.0.smithi087.stdout:8/244: mkdir db/d23/d54 0 2024-05-08T05:32:03.488 INFO:tasks.workunit.client.0.smithi087.stdout:4/205: truncate d4/d13/f31 3333304 0 2024-05-08T05:32:03.488 INFO:tasks.workunit.client.0.smithi087.stdout:4/206: chown d4/f10 136332149 1 2024-05-08T05:32:03.489 INFO:tasks.workunit.client.0.smithi087.stdout:5/217: dwrite da/dd/d13/d16/f26 [0,4194304] 0 2024-05-08T05:32:03.489 INFO:tasks.workunit.client.0.smithi087.stdout:4/207: creat d4/d13/d32/d42/f44 x:0 0 0 2024-05-08T05:32:03.490 INFO:tasks.workunit.client.0.smithi087.stdout:7/220: dread d2/da/d3f/f30 [0,4194304] 0 2024-05-08T05:32:03.490 INFO:tasks.workunit.client.0.smithi087.stdout:7/221: fdatasync d2/d6/f25 0 2024-05-08T05:32:03.490 INFO:tasks.workunit.client.0.smithi087.stdout:5/218: rmdir da/dd/d10 39 2024-05-08T05:32:03.491 INFO:tasks.workunit.client.0.smithi087.stdout:5/219: chown da/db/l34 2013960640 1 2024-05-08T05:32:03.492 INFO:tasks.workunit.client.0.smithi087.stdout:7/222: unlink d2/d6/d12/d1d/d23/f2f 0 2024-05-08T05:32:03.493 INFO:tasks.workunit.client.0.smithi087.stdout:5/220: mkdir da/db/d2a/d46 0 2024-05-08T05:32:03.493 INFO:tasks.workunit.client.0.smithi087.stdout:0/218: sync 2024-05-08T05:32:03.493 INFO:tasks.workunit.client.0.smithi087.stdout:5/221: write da/f30 [514300,47419] 0 2024-05-08T05:32:03.494 INFO:tasks.workunit.client.0.smithi087.stdout:4/208: rmdir d4/d13 39 2024-05-08T05:32:03.496 INFO:tasks.workunit.client.0.smithi087.stdout:5/222: unlink da/db/d2a/c37 0 2024-05-08T05:32:03.497 INFO:tasks.workunit.client.0.smithi087.stdout:0/219: creat d0/d9/d23/d24/f4e x:0 0 0 2024-05-08T05:32:03.499 INFO:tasks.workunit.client.0.smithi087.stdout:5/223: creat da/dd/d10/d36/f47 x:0 0 0 2024-05-08T05:32:03.499 INFO:tasks.workunit.client.0.smithi087.stdout:1/182: dwrite df/d12/f1a [0,4194304] 0 2024-05-08T05:32:03.500 INFO:tasks.workunit.client.0.smithi087.stdout:0/220: mkdir d0/d9/d23/d4f 0 2024-05-08T05:32:03.502 INFO:tasks.workunit.client.0.smithi087.stdout:5/224: creat da/f48 x:0 0 0 2024-05-08T05:32:03.502 INFO:tasks.workunit.client.0.smithi087.stdout:1/183: getdents df/d12 0 2024-05-08T05:32:03.503 INFO:tasks.workunit.client.0.smithi087.stdout:0/221: mknod d0/da/d11/c50 0 2024-05-08T05:32:03.503 INFO:tasks.workunit.client.0.smithi087.stdout:5/225: mknod da/dd/c49 0 2024-05-08T05:32:03.504 INFO:tasks.workunit.client.0.smithi087.stdout:5/226: write da/db/d2a/f32 [5582392,84129] 0 2024-05-08T05:32:03.505 INFO:tasks.workunit.client.0.smithi087.stdout:5/227: mknod da/dd/d10/d17/c4a 0 2024-05-08T05:32:03.525 INFO:tasks.workunit.client.0.smithi087.stdout:4/209: dread d4/d13/f16 [0,4194304] 0 2024-05-08T05:32:03.528 INFO:tasks.workunit.client.0.smithi087.stdout:4/210: creat d4/d13/d32/f45 x:0 0 0 2024-05-08T05:32:03.530 INFO:tasks.workunit.client.0.smithi087.stdout:4/211: rename d4/c12 to d4/d13/d32/d42/c46 0 2024-05-08T05:32:03.533 INFO:tasks.workunit.client.0.smithi087.stdout:4/212: fdatasync d4/fe 0 2024-05-08T05:32:03.535 INFO:tasks.workunit.client.0.smithi087.stdout:7/223: dwrite d2/d6/d12/d15/f28 [0,4194304] 0 2024-05-08T05:32:03.536 INFO:tasks.workunit.client.0.smithi087.stdout:4/213: symlink d4/d13/d3e/l47 0 2024-05-08T05:32:03.536 INFO:tasks.workunit.client.0.smithi087.stdout:5/228: read da/f2e [2616107,23947] 0 2024-05-08T05:32:03.536 INFO:tasks.workunit.client.0.smithi087.stdout:5/229: readlink da/dd/d13/l19 0 2024-05-08T05:32:03.537 INFO:tasks.workunit.client.0.smithi087.stdout:7/224: mknod d2/da/c40 0 2024-05-08T05:32:03.538 INFO:tasks.workunit.client.0.smithi087.stdout:4/214: mknod d4/d13/d3e/c48 0 2024-05-08T05:32:03.538 INFO:tasks.workunit.client.0.smithi087.stdout:4/215: write d4/fe [1818508,76819] 0 2024-05-08T05:32:03.539 INFO:tasks.workunit.client.0.smithi087.stdout:7/225: symlink d2/d6/d12/d1d/d32/l41 0 2024-05-08T05:32:03.539 INFO:tasks.workunit.client.0.smithi087.stdout:4/216: mknod d4/d13/d32/d42/c49 0 2024-05-08T05:32:03.540 INFO:tasks.workunit.client.0.smithi087.stdout:7/226: unlink d2/d6/d12/d19/d2a/l2c 0 2024-05-08T05:32:03.542 INFO:tasks.workunit.client.0.smithi087.stdout:4/217: mkdir d4/d13/d32/d42/d4a 0 2024-05-08T05:32:03.543 INFO:tasks.workunit.client.0.smithi087.stdout:5/230: dread da/dd/d10/d17/f3a [0,4194304] 0 2024-05-08T05:32:03.543 INFO:tasks.workunit.client.0.smithi087.stdout:7/227: rename d2/da/f31 to d2/d6/d12/d15/f42 0 2024-05-08T05:32:03.544 INFO:tasks.workunit.client.0.smithi087.stdout:5/231: creat da/f4b x:0 0 0 2024-05-08T05:32:03.546 INFO:tasks.workunit.client.0.smithi087.stdout:1/184: dwrite df/d12/f29 [0,4194304] 0 2024-05-08T05:32:03.546 INFO:tasks.workunit.client.0.smithi087.stdout:1/185: fsync df/d12/f1a 0 2024-05-08T05:32:03.546 INFO:tasks.workunit.client.0.smithi087.stdout:7/228: creat d2/d6/d12/f43 x:0 0 0 2024-05-08T05:32:03.546 INFO:tasks.workunit.client.0.smithi087.stdout:8/245: dwrite db/d23/f38 [0,4194304] 0 2024-05-08T05:32:03.547 INFO:tasks.workunit.client.0.smithi087.stdout:5/232: mknod da/db/d2a/d46/c4c 0 2024-05-08T05:32:03.547 INFO:tasks.workunit.client.0.smithi087.stdout:5/233: chown da/db/f25 6 1 2024-05-08T05:32:03.551 INFO:tasks.workunit.client.0.smithi087.stdout:1/186: creat df/f3b x:0 0 0 2024-05-08T05:32:03.552 INFO:tasks.workunit.client.0.smithi087.stdout:8/246: creat db/d23/d15/d29/d4d/f55 x:0 0 0 2024-05-08T05:32:03.552 INFO:tasks.workunit.client.0.smithi087.stdout:8/247: dread - db/d23/d1b/d35/d43/f44 zero size 2024-05-08T05:32:03.553 INFO:tasks.workunit.client.0.smithi087.stdout:1/187: creat df/d2f/f3c x:0 0 0 2024-05-08T05:32:03.554 INFO:tasks.workunit.client.0.smithi087.stdout:8/248: mkdir db/d23/d15/d29/d33/d3b/d56 0 2024-05-08T05:32:03.555 INFO:tasks.workunit.client.0.smithi087.stdout:1/188: creat df/f3d x:0 0 0 2024-05-08T05:32:03.557 INFO:tasks.workunit.client.0.smithi087.stdout:8/249: rename f9 to db/d23/f57 0 2024-05-08T05:32:03.557 INFO:tasks.workunit.client.0.smithi087.stdout:4/218: dread d4/d13/f23 [0,4194304] 0 2024-05-08T05:32:03.558 INFO:tasks.workunit.client.0.smithi087.stdout:1/189: creat df/f3e x:0 0 0 2024-05-08T05:32:03.559 INFO:tasks.workunit.client.0.smithi087.stdout:7/229: dread d2/d6/f25 [0,4194304] 0 2024-05-08T05:32:03.560 INFO:tasks.workunit.client.0.smithi087.stdout:5/234: write da/dd/d13/d16/f26 [592461,11395] 0 2024-05-08T05:32:03.560 INFO:tasks.workunit.client.0.smithi087.stdout:8/250: creat db/d23/d54/f58 x:0 0 0 2024-05-08T05:32:03.560 INFO:tasks.workunit.client.0.smithi087.stdout:5/235: getdents da/dd/d10/d41 0 2024-05-08T05:32:03.561 INFO:tasks.workunit.client.0.smithi087.stdout:4/219: getdents d4/d13/d3e/d28/d35 0 2024-05-08T05:32:03.562 INFO:tasks.workunit.client.0.smithi087.stdout:1/190: symlink df/d18/d1d/d32/l3f 0 2024-05-08T05:32:03.566 INFO:tasks.workunit.client.0.smithi087.stdout:7/230: creat d2/d6/f44 x:0 0 0 2024-05-08T05:32:03.566 INFO:tasks.workunit.client.0.smithi087.stdout:8/251: creat db/f59 x:0 0 0 2024-05-08T05:32:03.566 INFO:tasks.workunit.client.0.smithi087.stdout:8/252: dread - db/d23/d1b/d35/d43/f44 zero size 2024-05-08T05:32:03.566 INFO:tasks.workunit.client.0.smithi087.stdout:5/236: creat da/dd/d10/d36/d45/f4d x:0 0 0 2024-05-08T05:32:03.567 INFO:tasks.workunit.client.0.smithi087.stdout:4/220: link d4/d13/d3e/f36 d4/f4b 0 2024-05-08T05:32:03.568 INFO:tasks.workunit.client.0.smithi087.stdout:8/253: creat db/d23/d15/d29/d4d/f5a x:0 0 0 2024-05-08T05:32:03.605 INFO:tasks.workunit.client.0.smithi087.stdout:1/191: dwrite df/f3e [0,4194304] 0 2024-05-08T05:32:03.610 INFO:tasks.workunit.client.0.smithi087.stdout:1/192: creat df/f40 x:0 0 0 2024-05-08T05:32:03.612 INFO:tasks.workunit.client.0.smithi087.stdout:8/254: dwrite db/f25 [0,4194304] 0 2024-05-08T05:32:03.612 INFO:tasks.workunit.client.0.smithi087.stdout:1/193: mkdir df/d2f/d41 0 2024-05-08T05:32:03.613 INFO:tasks.workunit.client.0.smithi087.stdout:5/237: dwrite da/f4b [0,4194304] 0 2024-05-08T05:32:03.617 INFO:tasks.workunit.client.0.smithi087.stdout:8/255: rename db/d23/d3a/f51 to db/d23/d15/d29/d33/d4a/f5b 0 2024-05-08T05:32:03.619 INFO:tasks.workunit.client.0.smithi087.stdout:2/222: sync 2024-05-08T05:32:03.621 INFO:tasks.workunit.client.0.smithi087.stdout:1/194: rmdir df 39 2024-05-08T05:32:03.621 INFO:tasks.workunit.client.0.smithi087.stdout:1/195: readlink df/d18/l2b 0 2024-05-08T05:32:03.622 INFO:tasks.workunit.client.0.smithi087.stdout:2/223: rename d7/de/l3f to d7/de/d27/l46 0 2024-05-08T05:32:03.623 INFO:tasks.workunit.client.0.smithi087.stdout:2/224: getdents d7/de/d2c 0 2024-05-08T05:32:03.623 INFO:tasks.workunit.client.0.smithi087.stdout:2/225: chown d7/de/d2c/d43 0 1 2024-05-08T05:32:03.623 INFO:tasks.workunit.client.0.smithi087.stdout:2/226: fdatasync d7/de/d27/d33/f1c 0 2024-05-08T05:32:03.624 INFO:tasks.workunit.client.0.smithi087.stdout:2/227: unlink d7/cb 0 2024-05-08T05:32:03.625 INFO:tasks.workunit.client.0.smithi087.stdout:2/228: creat d7/de/d27/d33/f47 x:0 0 0 2024-05-08T05:32:03.628 INFO:tasks.workunit.client.0.smithi087.stdout:4/221: dwrite d4/fe [0,4194304] 0 2024-05-08T05:32:03.628 INFO:tasks.workunit.client.0.smithi087.stdout:4/222: chown d4/d13/f2e 0 1 2024-05-08T05:32:03.629 INFO:tasks.workunit.client.0.smithi087.stdout:4/223: mknod d4/d13/d3e/d28/c4c 0 2024-05-08T05:32:03.638 INFO:tasks.workunit.client.0.smithi087.stdout:7/231: dwrite d2/d6/d12/d1d/f17 [0,4194304] 0 2024-05-08T05:32:03.641 INFO:tasks.workunit.client.0.smithi087.stdout:4/224: mknod d4/d13/c4d 0 2024-05-08T05:32:03.641 INFO:tasks.workunit.client.0.smithi087.stdout:4/225: chown d4/c3b 0 1 2024-05-08T05:32:03.643 INFO:tasks.workunit.client.0.smithi087.stdout:4/226: mkdir d4/d13/d32/d42/d4e 0 2024-05-08T05:32:03.644 INFO:tasks.workunit.client.0.smithi087.stdout:4/227: stat d4/d13/c20 0 2024-05-08T05:32:03.644 INFO:tasks.workunit.client.0.smithi087.stdout:4/228: write d4/d13/f2e [44318,119493] 0 2024-05-08T05:32:03.645 INFO:tasks.workunit.client.0.smithi087.stdout:4/229: fsync d4/fe 0 2024-05-08T05:32:03.645 INFO:tasks.workunit.client.0.smithi087.stdout:4/230: readlink d4/l5 0 2024-05-08T05:32:03.645 INFO:tasks.workunit.client.0.smithi087.stdout:4/231: write d4/f2f [1162510,101296] 0 2024-05-08T05:32:03.645 INFO:tasks.workunit.client.0.smithi087.stdout:4/232: dread - d4/d13/d3e/d28/d35/f41 zero size 2024-05-08T05:32:03.652 INFO:tasks.workunit.client.0.smithi087.stdout:0/222: sync 2024-05-08T05:32:03.652 INFO:tasks.workunit.client.0.smithi087.stdout:6/219: sync 2024-05-08T05:32:03.652 INFO:tasks.workunit.client.0.smithi087.stdout:3/238: sync 2024-05-08T05:32:03.652 INFO:tasks.workunit.client.0.smithi087.stdout:9/229: sync 2024-05-08T05:32:03.652 INFO:tasks.workunit.client.0.smithi087.stdout:3/239: readlink d4/l37 0 2024-05-08T05:32:03.652 INFO:tasks.workunit.client.0.smithi087.stdout:0/223: truncate d0/da/f30 1107602 0 2024-05-08T05:32:03.652 INFO:tasks.workunit.client.0.smithi087.stdout:9/230: write d1/df/d37/d3e/f26 [936527,40226] 0 2024-05-08T05:32:03.653 INFO:tasks.workunit.client.0.smithi087.stdout:3/240: mkdir d4/d11/d24/d25/d3e/d58 0 2024-05-08T05:32:03.654 INFO:tasks.workunit.client.0.smithi087.stdout:0/224: getdents d0/da/d35 0 2024-05-08T05:32:03.654 INFO:tasks.workunit.client.0.smithi087.stdout:0/225: fsync d0/da/f3a 0 2024-05-08T05:32:03.656 INFO:tasks.workunit.client.0.smithi087.stdout:9/231: link d1/db/d28/f2e d1/df/f3f 0 2024-05-08T05:32:03.656 INFO:tasks.workunit.client.0.smithi087.stdout:9/232: dread - d1/df/d14/f2f zero size 2024-05-08T05:32:03.656 INFO:tasks.workunit.client.0.smithi087.stdout:7/232: write d2/d6/d12/d1d/f17 [3325910,104881] 0 2024-05-08T05:32:03.656 INFO:tasks.workunit.client.0.smithi087.stdout:7/233: chown d2/d6/d12/d15 42 1 2024-05-08T05:32:03.657 INFO:tasks.workunit.client.0.smithi087.stdout:5/238: dwrite da/f48 [0,4194304] 0 2024-05-08T05:32:03.660 INFO:tasks.workunit.client.0.smithi087.stdout:3/241: rename d4/l8 to d4/d11/d24/d25/d3e/l59 0 2024-05-08T05:32:03.660 INFO:tasks.workunit.client.0.smithi087.stdout:3/242: fdatasync d4/d11/f38 0 2024-05-08T05:32:03.660 INFO:tasks.workunit.client.0.smithi087.stdout:0/226: mkdir d0/d9/d23/d4f/d51 0 2024-05-08T05:32:03.660 INFO:tasks.workunit.client.0.smithi087.stdout:9/233: truncate d1/db/fc 3196933 0 2024-05-08T05:32:03.660 INFO:tasks.workunit.client.0.smithi087.stdout:9/234: write d1/df/f3f [290249,48274] 0 2024-05-08T05:32:03.661 INFO:tasks.workunit.client.0.smithi087.stdout:9/235: chown d1/df/d37/d3e/f26 26407525 1 2024-05-08T05:32:03.661 INFO:tasks.workunit.client.0.smithi087.stdout:4/233: write d4/d13/d3e/f36 [3759798,82709] 0 2024-05-08T05:32:03.662 INFO:tasks.workunit.client.0.smithi087.stdout:1/196: dwrite fa [4194304,4194304] 0 2024-05-08T05:32:03.666 INFO:tasks.workunit.client.0.smithi087.stdout:7/234: creat d2/d6/d12/d19/d34/f45 x:0 0 0 2024-05-08T05:32:03.666 INFO:tasks.workunit.client.0.smithi087.stdout:8/256: write f3 [5977988,124366] 0 2024-05-08T05:32:03.672 INFO:tasks.workunit.client.0.smithi087.stdout:6/220: dread d4/d6/f1b [0,4194304] 0 2024-05-08T05:32:03.672 INFO:tasks.workunit.client.0.smithi087.stdout:6/221: readlink d4/d8/df/l29 0 2024-05-08T05:32:03.675 INFO:tasks.workunit.client.0.smithi087.stdout:5/239: dread da/f2e [0,4194304] 0 2024-05-08T05:32:03.675 INFO:tasks.workunit.client.0.smithi087.stdout:4/234: creat d4/d13/d3e/f4f x:0 0 0 2024-05-08T05:32:03.675 INFO:tasks.workunit.client.0.smithi087.stdout:4/235: chown d4/d13/d3e/d28/f39 5 1 2024-05-08T05:32:03.675 INFO:tasks.workunit.client.0.smithi087.stdout:7/235: creat d2/d6/d12/d15/f46 x:0 0 0 2024-05-08T05:32:03.676 INFO:tasks.workunit.client.0.smithi087.stdout:4/236: write d4/d13/d32/d42/f44 [137531,9848] 0 2024-05-08T05:32:03.676 INFO:tasks.workunit.client.0.smithi087.stdout:7/236: fdatasync d2/d6/d12/d1d/f3a 0 2024-05-08T05:32:03.676 INFO:tasks.workunit.client.0.smithi087.stdout:4/237: chown d4/d13/d3e/l47 6 1 2024-05-08T05:32:03.676 INFO:tasks.workunit.client.0.smithi087.stdout:1/197: symlink df/d18/d1d/d27/l42 0 2024-05-08T05:32:03.676 INFO:tasks.workunit.client.0.smithi087.stdout:1/198: dread - df/f40 zero size 2024-05-08T05:32:03.676 INFO:tasks.workunit.client.0.smithi087.stdout:6/222: symlink d4/d8/df/d1e/d25/l46 0 2024-05-08T05:32:03.677 INFO:tasks.workunit.client.0.smithi087.stdout:6/223: chown d4/d8/df/d39 2407156 1 2024-05-08T05:32:03.677 INFO:tasks.workunit.client.0.smithi087.stdout:6/224: write d4/fd [2558194,57906] 0 2024-05-08T05:32:03.678 INFO:tasks.workunit.client.0.smithi087.stdout:7/237: link d2/d6/f25 d2/d6/d12/f47 0 2024-05-08T05:32:03.678 INFO:tasks.workunit.client.0.smithi087.stdout:7/238: stat d2/d6/d12/d15/f42 0 2024-05-08T05:32:03.679 INFO:tasks.workunit.client.0.smithi087.stdout:4/238: mkdir d4/d13/d3e/d28/d50 0 2024-05-08T05:32:03.682 INFO:tasks.workunit.client.0.smithi087.stdout:1/199: rename df/d18/d1d/d27/c37 to df/c43 0 2024-05-08T05:32:03.683 INFO:tasks.workunit.client.0.smithi087.stdout:6/225: mknod d4/d8/df/d39/d42/c47 0 2024-05-08T05:32:03.683 INFO:tasks.workunit.client.0.smithi087.stdout:6/226: chown d4/d8/df/c44 36942 1 2024-05-08T05:32:03.685 INFO:tasks.workunit.client.0.smithi087.stdout:7/239: mkdir d2/d6/d12/d1d/d48 0 2024-05-08T05:32:03.685 INFO:tasks.workunit.client.0.smithi087.stdout:7/240: readlink d2/da/l18 0 2024-05-08T05:32:03.686 INFO:tasks.workunit.client.0.smithi087.stdout:4/239: creat d4/d13/d3e/d28/f51 x:0 0 0 2024-05-08T05:32:03.687 INFO:tasks.workunit.client.0.smithi087.stdout:1/200: symlink df/d39/l44 0 2024-05-08T05:32:03.688 INFO:tasks.workunit.client.0.smithi087.stdout:6/227: rename d4/d8/f21 to d4/d8/df/d1e/d25/d28/d2d/d37/d45/f48 0 2024-05-08T05:32:03.688 INFO:tasks.workunit.client.0.smithi087.stdout:6/228: readlink d4/l19 0 2024-05-08T05:32:03.689 INFO:tasks.workunit.client.0.smithi087.stdout:7/241: mkdir d2/da/d3f/d49 0 2024-05-08T05:32:03.689 INFO:tasks.workunit.client.0.smithi087.stdout:2/229: dwrite d7/f18 [0,4194304] 0 2024-05-08T05:32:03.690 INFO:tasks.workunit.client.0.smithi087.stdout:2/230: dread - d7/de/d27/d33/f47 zero size 2024-05-08T05:32:03.690 INFO:tasks.workunit.client.0.smithi087.stdout:4/240: creat d4/d13/d3e/f52 x:0 0 0 2024-05-08T05:32:03.691 INFO:tasks.workunit.client.0.smithi087.stdout:1/201: truncate df/d18/f1b 1881012 0 2024-05-08T05:32:03.693 INFO:tasks.workunit.client.0.smithi087.stdout:7/242: rmdir d2/d6/d12/d19/d34 39 2024-05-08T05:32:03.699 INFO:tasks.workunit.client.0.smithi087.stdout:2/231: truncate f6 371877 0 2024-05-08T05:32:03.699 INFO:tasks.workunit.client.0.smithi087.stdout:4/241: symlink d4/d13/d32/d42/d4a/l53 0 2024-05-08T05:32:03.699 INFO:tasks.workunit.client.0.smithi087.stdout:4/242: stat d4/d13/d3e/d28/c4c 0 2024-05-08T05:32:03.700 INFO:tasks.workunit.client.0.smithi087.stdout:1/202: creat df/d12/f45 x:0 0 0 2024-05-08T05:32:03.705 INFO:tasks.workunit.client.0.smithi087.stdout:4/243: creat d4/d13/d32/d42/d4e/f54 x:0 0 0 2024-05-08T05:32:03.706 INFO:tasks.workunit.client.0.smithi087.stdout:4/244: dread - d4/d13/d3e/d28/f39 zero size 2024-05-08T05:32:03.707 INFO:tasks.workunit.client.0.smithi087.stdout:7/243: rmdir d2/da 39 2024-05-08T05:32:03.707 INFO:tasks.workunit.client.0.smithi087.stdout:7/244: chown d2/d6/d12/d15/l37 505614 1 2024-05-08T05:32:03.707 INFO:tasks.workunit.client.0.smithi087.stdout:7/245: truncate d2/d6/d12/d15/f42 56251 0 2024-05-08T05:32:03.707 INFO:tasks.workunit.client.0.smithi087.stdout:7/246: fdatasync d2/d6/d12/d1d/f13 0 2024-05-08T05:32:03.708 INFO:tasks.workunit.client.0.smithi087.stdout:1/203: rename df/d18/l2b to df/d2f/d41/l46 0 2024-05-08T05:32:03.711 INFO:tasks.workunit.client.0.smithi087.stdout:4/245: link d4/d13/l1b d4/d13/d3e/l55 0 2024-05-08T05:32:03.711 INFO:tasks.workunit.client.0.smithi087.stdout:6/229: rmdir d4/d2a 0 2024-05-08T05:32:03.712 INFO:tasks.workunit.client.0.smithi087.stdout:7/247: creat d2/d6/d12/d1d/f4a x:0 0 0 2024-05-08T05:32:03.712 INFO:tasks.workunit.client.0.smithi087.stdout:7/248: write d2/d6/f25 [5161412,76286] 0 2024-05-08T05:32:03.712 INFO:tasks.workunit.client.0.smithi087.stdout:7/249: stat d2/d6 0 2024-05-08T05:32:03.713 INFO:tasks.workunit.client.0.smithi087.stdout:1/204: creat df/d18/f47 x:0 0 0 2024-05-08T05:32:03.714 INFO:tasks.workunit.client.0.smithi087.stdout:0/227: dread d0/d9/f10 [0,4194304] 0 2024-05-08T05:32:03.717 INFO:tasks.workunit.client.0.smithi087.stdout:6/230: mknod d4/d8/df/d39/d42/c49 0 2024-05-08T05:32:03.717 INFO:tasks.workunit.client.0.smithi087.stdout:7/250: symlink d2/d6/d12/d1d/l4b 0 2024-05-08T05:32:03.717 INFO:tasks.workunit.client.0.smithi087.stdout:4/246: mkdir d4/d13/d3e/d28/d35/d56 0 2024-05-08T05:32:03.718 INFO:tasks.workunit.client.0.smithi087.stdout:6/231: creat d4/f4a x:0 0 0 2024-05-08T05:32:03.718 INFO:tasks.workunit.client.0.smithi087.stdout:6/232: chown d4/d8/df/d1e/d25/l46 47291 1 2024-05-08T05:32:03.719 INFO:tasks.workunit.client.0.smithi087.stdout:4/247: symlink d4/d13/d32/d42/d4a/l57 0 2024-05-08T05:32:03.721 INFO:tasks.workunit.client.0.smithi087.stdout:4/248: creat d4/d13/d3e/d28/d35/f58 x:0 0 0 2024-05-08T05:32:03.722 INFO:tasks.workunit.client.0.smithi087.stdout:4/249: symlink d4/d13/d32/d42/l59 0 2024-05-08T05:32:03.724 INFO:tasks.workunit.client.0.smithi087.stdout:4/250: truncate d4/d13/f23 1739503 0 2024-05-08T05:32:03.726 INFO:tasks.workunit.client.0.smithi087.stdout:4/251: mkdir d4/d13/d3e/d28/d50/d5a 0 2024-05-08T05:32:03.734 INFO:tasks.workunit.client.0.smithi087.stdout:1/205: dread df/d12/f1a [4194304,4194304] 0 2024-05-08T05:32:03.736 INFO:tasks.workunit.client.0.smithi087.stdout:8/257: dwrite db/d23/d54/f58 [0,4194304] 0 2024-05-08T05:32:03.737 INFO:tasks.workunit.client.0.smithi087.stdout:9/236: dwrite d1/db/d28/f2e [0,4194304] 0 2024-05-08T05:32:03.754 INFO:tasks.workunit.client.0.smithi087.stdout:6/233: write f1 [8178000,44008] 0 2024-05-08T05:32:03.754 INFO:tasks.workunit.client.0.smithi087.stdout:6/234: write d4/d8/df/d1e/d25/d28/d2d/d37/d45/f48 [201488,105286] 0 2024-05-08T05:32:03.754 INFO:tasks.workunit.client.0.smithi087.stdout:0/228: dread d0/f2 [0,4194304] 0 2024-05-08T05:32:03.756 INFO:tasks.workunit.client.0.smithi087.stdout:9/237: dread d1/fa [0,4194304] 0 2024-05-08T05:32:03.756 INFO:tasks.workunit.client.0.smithi087.stdout:9/238: readlink d1/df/d14/d18/l2b 0 2024-05-08T05:32:03.757 INFO:tasks.workunit.client.0.smithi087.stdout:8/258: dread db/f41 [0,4194304] 0 2024-05-08T05:32:03.757 INFO:tasks.workunit.client.0.smithi087.stdout:0/229: unlink d0/d9/d1b/d2f/l31 0 2024-05-08T05:32:03.757 INFO:tasks.workunit.client.0.smithi087.stdout:8/259: chown db/d23/d3a/l4e 285993157 1 2024-05-08T05:32:03.757 INFO:tasks.workunit.client.0.smithi087.stdout:8/260: stat db/d23/d1b/d4f 0 2024-05-08T05:32:03.757 INFO:tasks.workunit.client.0.smithi087.stdout:8/261: fsync db/d23/d1b/f26 0 2024-05-08T05:32:03.758 INFO:tasks.workunit.client.0.smithi087.stdout:9/239: creat d1/df/d37/d3e/f40 x:0 0 0 2024-05-08T05:32:03.758 INFO:tasks.workunit.client.0.smithi087.stdout:9/240: readlink d1/df/d37/d3e/l32 0 2024-05-08T05:32:03.758 INFO:tasks.workunit.client.0.smithi087.stdout:9/241: chown d1/f21 140 1 2024-05-08T05:32:03.760 INFO:tasks.workunit.client.0.smithi087.stdout:6/235: dread d4/d8/df/d1e/d25/f2f [0,4194304] 0 2024-05-08T05:32:03.761 INFO:tasks.workunit.client.0.smithi087.stdout:6/236: write d4/d8/df/f31 [4611093,54759] 0 2024-05-08T05:32:03.762 INFO:tasks.workunit.client.0.smithi087.stdout:2/232: dwrite d7/f17 [0,4194304] 0 2024-05-08T05:32:03.762 INFO:tasks.workunit.client.0.smithi087.stdout:2/233: fdatasync d7/f17 0 2024-05-08T05:32:03.763 INFO:tasks.workunit.client.0.smithi087.stdout:6/237: creat d4/d8/df/d1e/d25/f4b x:0 0 0 2024-05-08T05:32:03.763 INFO:tasks.workunit.client.0.smithi087.stdout:6/238: write d4/d8/df/d1e/d25/d28/d2d/d37/d45/f48 [210553,107188] 0 2024-05-08T05:32:03.763 INFO:tasks.workunit.client.0.smithi087.stdout:6/239: read d4/f12 [2284363,46321] 0 2024-05-08T05:32:03.763 INFO:tasks.workunit.client.0.smithi087.stdout:6/240: chown d4/d8/df/d1e/d25/d28/d2d/d37/d45 0 1 2024-05-08T05:32:03.768 INFO:tasks.workunit.client.0.smithi087.stdout:2/234: creat d7/de/d2c/f48 x:0 0 0 2024-05-08T05:32:03.768 INFO:tasks.workunit.client.0.smithi087.stdout:6/241: mknod d4/c4c 0 2024-05-08T05:32:03.769 INFO:tasks.workunit.client.0.smithi087.stdout:7/251: dwrite d2/f27 [0,4194304] 0 2024-05-08T05:32:03.772 INFO:tasks.workunit.client.0.smithi087.stdout:3/243: dwrite d4/d11/d24/d25/d3e/f46 [0,4194304] 0 2024-05-08T05:32:03.772 INFO:tasks.workunit.client.0.smithi087.stdout:3/244: fdatasync d4/d11/d3d/f45 0 2024-05-08T05:32:03.773 INFO:tasks.workunit.client.0.smithi087.stdout:6/242: getdents d4/d8/df/d1e/d25/d28 0 2024-05-08T05:32:03.773 INFO:tasks.workunit.client.0.smithi087.stdout:2/235: truncate d7/de/d27/d33/f30 462743 0 2024-05-08T05:32:03.773 INFO:tasks.workunit.client.0.smithi087.stdout:6/243: write d4/d8/fb [3886243,39800] 0 2024-05-08T05:32:03.776 INFO:tasks.workunit.client.0.smithi087.stdout:3/245: mkdir d4/d11/d24/d39/d5a 0 2024-05-08T05:32:03.776 INFO:tasks.workunit.client.0.smithi087.stdout:4/252: dread d4/d13/f2e [0,4194304] 0 2024-05-08T05:32:03.776 INFO:tasks.workunit.client.0.smithi087.stdout:4/253: rename d4 to d4/d13/d32/d42/d5b 22 2024-05-08T05:32:03.777 INFO:tasks.workunit.client.0.smithi087.stdout:2/236: mkdir d7/de/d27/d33/d49 0 2024-05-08T05:32:03.778 INFO:tasks.workunit.client.0.smithi087.stdout:3/246: creat d4/d11/d3d/f5b x:0 0 0 2024-05-08T05:32:03.779 INFO:tasks.workunit.client.0.smithi087.stdout:4/254: mkdir d4/d13/d32/d42/d5c 0 2024-05-08T05:32:03.779 INFO:tasks.workunit.client.0.smithi087.stdout:6/244: rmdir d4/d8/df/d1e/d25 39 2024-05-08T05:32:03.781 INFO:tasks.workunit.client.0.smithi087.stdout:4/255: mkdir d4/d13/d32/d42/d4a/d5d 0 2024-05-08T05:32:03.784 INFO:tasks.workunit.client.0.smithi087.stdout:7/252: dread d2/da/f11 [0,4194304] 0 2024-05-08T05:32:03.789 INFO:tasks.workunit.client.0.smithi087.stdout:7/253: creat d2/da/f4c x:0 0 0 2024-05-08T05:32:03.794 INFO:tasks.workunit.client.0.smithi087.stdout:7/254: dread d2/d6/d12/d19/f22 [0,4194304] 0 2024-05-08T05:32:03.794 INFO:tasks.workunit.client.0.smithi087.stdout:2/237: dread d7/d2d/f39 [0,4194304] 0 2024-05-08T05:32:03.794 INFO:tasks.workunit.client.0.smithi087.stdout:2/238: stat d7/de/d2c/l45 0 2024-05-08T05:32:03.795 INFO:tasks.workunit.client.0.smithi087.stdout:7/255: mkdir d2/d6/d12/d1d/d48/d4d 0 2024-05-08T05:32:03.795 INFO:tasks.workunit.client.0.smithi087.stdout:7/256: rmdir d2/d6/d12/d1d/d48 39 2024-05-08T05:32:03.796 INFO:tasks.workunit.client.0.smithi087.stdout:7/257: mknod d2/d6/d12/d19/d2a/c4e 0 2024-05-08T05:32:03.797 INFO:tasks.workunit.client.0.smithi087.stdout:7/258: mkdir d2/da/d3f/d4f 0 2024-05-08T05:32:03.803 INFO:tasks.workunit.client.0.smithi087.stdout:1/206: dwrite df/f3d [0,4194304] 0 2024-05-08T05:32:03.803 INFO:tasks.workunit.client.0.smithi087.stdout:9/242: dwrite d1/f30 [0,4194304] 0 2024-05-08T05:32:03.803 INFO:tasks.workunit.client.0.smithi087.stdout:9/243: readlink d1/db/d28/l39 0 2024-05-08T05:32:03.804 INFO:tasks.workunit.client.0.smithi087.stdout:9/244: fdatasync d1/db/f1b 0 2024-05-08T05:32:03.804 INFO:tasks.workunit.client.0.smithi087.stdout:9/245: fsync d1/db/fc 0 2024-05-08T05:32:03.804 INFO:tasks.workunit.client.0.smithi087.stdout:1/207: rmdir df/d18/d1d 39 2024-05-08T05:32:03.808 INFO:tasks.workunit.client.0.smithi087.stdout:9/246: rmdir d1/db 39 2024-05-08T05:32:03.808 INFO:tasks.workunit.client.0.smithi087.stdout:0/230: dwrite d0/d9/df/f15 [0,4194304] 0 2024-05-08T05:32:03.808 INFO:tasks.workunit.client.0.smithi087.stdout:0/231: dread - d0/d9/f48 zero size 2024-05-08T05:32:03.808 INFO:tasks.workunit.client.0.smithi087.stdout:0/232: chown d0/da/d11/l3f 2184322 1 2024-05-08T05:32:03.808 INFO:tasks.workunit.client.0.smithi087.stdout:9/247: getdents d1/df/d14 0 2024-05-08T05:32:03.809 INFO:tasks.workunit.client.0.smithi087.stdout:1/208: creat df/d18/d1d/f48 x:0 0 0 2024-05-08T05:32:03.810 INFO:tasks.workunit.client.0.smithi087.stdout:2/239: dread d7/d2d/f39 [0,4194304] 0 2024-05-08T05:32:03.812 INFO:tasks.workunit.client.0.smithi087.stdout:9/248: rename d1/df/d14/l16 to d1/db/l41 0 2024-05-08T05:32:03.812 INFO:tasks.workunit.client.0.smithi087.stdout:9/249: stat d1/db 0 2024-05-08T05:32:03.812 INFO:tasks.workunit.client.0.smithi087.stdout:9/250: fdatasync d1/df/d37/d3e/f2d 0 2024-05-08T05:32:03.812 INFO:tasks.workunit.client.0.smithi087.stdout:9/251: fdatasync d1/df/d37/d3e/f26 0 2024-05-08T05:32:03.813 INFO:tasks.workunit.client.0.smithi087.stdout:1/209: link df/d18/d1d/d27/c34 df/d18/d1d/c49 0 2024-05-08T05:32:03.814 INFO:tasks.workunit.client.0.smithi087.stdout:9/252: creat d1/db/d28/f42 x:0 0 0 2024-05-08T05:32:03.814 INFO:tasks.workunit.client.0.smithi087.stdout:9/253: write d1/f1a [2320851,16138] 0 2024-05-08T05:32:03.833 INFO:tasks.workunit.client.0.smithi087.stdout:1/210: write df/f1f [777920,101696] 0 2024-05-08T05:32:03.834 INFO:tasks.workunit.client.0.smithi087.stdout:0/233: write d0/d9/df/f15 [977010,130784] 0 2024-05-08T05:32:03.835 INFO:tasks.workunit.client.0.smithi087.stdout:7/259: dread d2/d6/d12/d19/f2d [0,4194304] 0 2024-05-08T05:32:03.836 INFO:tasks.workunit.client.0.smithi087.stdout:0/234: mknod d0/d9/d23/d4f/c52 0 2024-05-08T05:32:03.836 INFO:tasks.workunit.client.0.smithi087.stdout:0/235: read - d0/d9/d1b/f3e zero size 2024-05-08T05:32:03.836 INFO:tasks.workunit.client.0.smithi087.stdout:0/236: read - d0/d9/f48 zero size 2024-05-08T05:32:03.837 INFO:tasks.workunit.client.0.smithi087.stdout:4/256: dwrite d4/d13/d3e/d28/d35/f3a [0,4194304] 0 2024-05-08T05:32:03.838 INFO:tasks.workunit.client.0.smithi087.stdout:3/247: dwrite d4/d11/d24/f26 [0,4194304] 0 2024-05-08T05:32:03.839 INFO:tasks.workunit.client.0.smithi087.stdout:4/257: creat d4/d13/d3e/d28/d50/d5a/f5e x:0 0 0 2024-05-08T05:32:03.839 INFO:tasks.workunit.client.0.smithi087.stdout:3/248: rmdir d4/d11/d3d/d48 39 2024-05-08T05:32:03.841 INFO:tasks.workunit.client.0.smithi087.stdout:6/245: dwrite d4/d8/df/f31 [4194304,4194304] 0 2024-05-08T05:32:03.842 INFO:tasks.workunit.client.0.smithi087.stdout:7/260: dread d2/d6/d12/f39 [0,4194304] 0 2024-05-08T05:32:03.843 INFO:tasks.workunit.client.0.smithi087.stdout:4/258: rmdir d4/d13/d32/d42/d5c 0 2024-05-08T05:32:03.844 INFO:tasks.workunit.client.0.smithi087.stdout:7/261: rename d2/d6/d12/d1d/d48/d4d to d2/d6/d12/d1d/d32/d50 0 2024-05-08T05:32:03.845 INFO:tasks.workunit.client.0.smithi087.stdout:4/259: mknod d4/d13/d32/d42/c5f 0 2024-05-08T05:32:03.845 INFO:tasks.workunit.client.0.smithi087.stdout:4/260: fsync d4/d13/f16 0 2024-05-08T05:32:03.846 INFO:tasks.workunit.client.0.smithi087.stdout:7/262: creat d2/d6/d12/f51 x:0 0 0 2024-05-08T05:32:03.851 INFO:tasks.workunit.client.0.smithi087.stdout:0/237: dread d0/f2 [0,4194304] 0 2024-05-08T05:32:03.851 INFO:tasks.workunit.client.0.smithi087.stdout:0/238: readlink d0/da/d35/l4c 0 2024-05-08T05:32:03.852 INFO:tasks.workunit.client.0.smithi087.stdout:1/211: write df/d12/f1a [4874468,89064] 0 2024-05-08T05:32:03.853 INFO:tasks.workunit.client.0.smithi087.stdout:1/212: stat df/c17 0 2024-05-08T05:32:03.853 INFO:tasks.workunit.client.0.smithi087.stdout:1/213: write df/f11 [251048,19534] 0 2024-05-08T05:32:03.853 INFO:tasks.workunit.client.0.smithi087.stdout:1/214: chown df/d18/d1d/d27/l42 5845784 1 2024-05-08T05:32:03.868 INFO:tasks.workunit.client.0.smithi087.stdout:4/261: write d4/d13/d3e/f38 [1580142,114879] 0 2024-05-08T05:32:03.868 INFO:tasks.workunit.client.0.smithi087.stdout:4/262: dread - d4/d13/d3e/f52 zero size 2024-05-08T05:32:03.872 INFO:tasks.workunit.client.0.smithi087.stdout:1/215: write df/f3e [3894302,121040] 0 2024-05-08T05:32:03.872 INFO:tasks.workunit.client.0.smithi087.stdout:1/216: dread - df/f3b zero size 2024-05-08T05:32:03.875 INFO:tasks.workunit.client.0.smithi087.stdout:1/217: rename df/d12/f1a to df/f4a 0 2024-05-08T05:32:03.875 INFO:tasks.workunit.client.0.smithi087.stdout:1/218: read - df/d18/f28 zero size 2024-05-08T05:32:03.875 INFO:tasks.workunit.client.0.smithi087.stdout:1/219: dread - df/d18/d1d/f48 zero size 2024-05-08T05:32:03.877 INFO:tasks.workunit.client.0.smithi087.stdout:9/254: dwrite d1/db/f10 [0,4194304] 0 2024-05-08T05:32:03.877 INFO:tasks.workunit.client.0.smithi087.stdout:3/249: dread d4/fb [0,4194304] 0 2024-05-08T05:32:03.896 INFO:tasks.workunit.client.0.smithi087.stdout:0/239: dwrite d0/da/f47 [0,4194304] 0 2024-05-08T05:32:03.897 INFO:tasks.workunit.client.0.smithi087.stdout:0/240: write d0/d9/f48 [254439,128911] 0 2024-05-08T05:32:03.901 INFO:tasks.workunit.client.0.smithi087.stdout:0/241: unlink d0/d9/f1a 0 2024-05-08T05:32:03.905 INFO:tasks.workunit.client.0.smithi087.stdout:9/255: dread d1/df/d14/d18/f1e [0,4194304] 0 2024-05-08T05:32:03.905 INFO:tasks.workunit.client.0.smithi087.stdout:9/256: fdatasync d1/fd 0 2024-05-08T05:32:03.905 INFO:tasks.workunit.client.0.smithi087.stdout:1/220: dread df/f1f [0,4194304] 0 2024-05-08T05:32:03.906 INFO:tasks.workunit.client.0.smithi087.stdout:9/257: read d1/df/d37/d3e/f2d [304867,69631] 0 2024-05-08T05:32:03.907 INFO:tasks.workunit.client.0.smithi087.stdout:1/221: mkdir df/d18/d4b 0 2024-05-08T05:32:03.907 INFO:tasks.workunit.client.0.smithi087.stdout:9/258: mknod d1/df/d37/c43 0 2024-05-08T05:32:03.908 INFO:tasks.workunit.client.0.smithi087.stdout:9/259: write d1/df/f35 [797120,96812] 0 2024-05-08T05:32:03.908 INFO:tasks.workunit.client.0.smithi087.stdout:9/260: write d1/db/f1b [909050,65846] 0 2024-05-08T05:32:03.912 INFO:tasks.workunit.client.0.smithi087.stdout:0/242: dread d0/d9/f48 [0,4194304] 0 2024-05-08T05:32:03.917 INFO:tasks.workunit.client.0.smithi087.stdout:7/263: dwrite d2/d6/d12/d19/f22 [0,4194304] 0 2024-05-08T05:32:03.917 INFO:tasks.workunit.client.0.smithi087.stdout:7/264: dread - d2/d6/d12/d1d/f3a zero size 2024-05-08T05:32:03.917 INFO:tasks.workunit.client.0.smithi087.stdout:6/246: dwrite d4/fd [4194304,4194304] 0 2024-05-08T05:32:03.917 INFO:tasks.workunit.client.0.smithi087.stdout:7/265: chown d2/d6/d12/c24 2022 1 2024-05-08T05:32:03.917 INFO:tasks.workunit.client.0.smithi087.stdout:7/266: dread - d2/d6/d12/d1d/f3a zero size 2024-05-08T05:32:03.917 INFO:tasks.workunit.client.0.smithi087.stdout:7/267: chown d2/d6/d12/f51 974681 1 2024-05-08T05:32:03.917 INFO:tasks.workunit.client.0.smithi087.stdout:7/268: rename d2/d6/d12/d1d/d32 to d2/d6/d12/d1d/d32/d50/d52 22 2024-05-08T05:32:03.919 INFO:tasks.workunit.client.0.smithi087.stdout:7/269: symlink d2/d6/d12/d19/d2a/l53 0 2024-05-08T05:32:03.919 INFO:tasks.workunit.client.0.smithi087.stdout:4/263: dwrite d4/d13/d32/d42/f44 [0,4194304] 0 2024-05-08T05:32:03.920 INFO:tasks.workunit.client.0.smithi087.stdout:0/243: dread d0/d9/f10 [0,4194304] 0 2024-05-08T05:32:03.935 INFO:tasks.workunit.client.0.smithi087.stdout:6/247: truncate d4/d8/df/d1e/d25/f3f 8674959 0 2024-05-08T05:32:03.935 INFO:tasks.workunit.client.0.smithi087.stdout:0/244: creat d0/d9/d23/d4f/f53 x:0 0 0 2024-05-08T05:32:03.936 INFO:tasks.workunit.client.0.smithi087.stdout:0/245: mkdir d0/d9/d1b/d2f/d54 0 2024-05-08T05:32:03.964 INFO:tasks.workunit.client.0.smithi087.stdout:4/264: dwrite f1 [4194304,4194304] 0 2024-05-08T05:32:03.966 INFO:tasks.workunit.client.0.smithi087.stdout:4/265: mknod d4/d13/d32/d42/d4a/c60 0 2024-05-08T05:32:03.968 INFO:tasks.workunit.client.0.smithi087.stdout:4/266: unlink d4/d13/d3e/d28/f51 0 2024-05-08T05:32:03.969 INFO:tasks.workunit.client.0.smithi087.stdout:4/267: symlink d4/d13/d32/d42/d4e/l61 0 2024-05-08T05:32:03.989 INFO:tasks.workunit.client.0.smithi087.stdout:6/248: dwrite d4/d6/f1b [4194304,4194304] 0 2024-05-08T05:32:03.990 INFO:tasks.workunit.client.0.smithi087.stdout:6/249: chown d4/d8/df/d1e/d25/f3f 151124 1 2024-05-08T05:32:03.992 INFO:tasks.workunit.client.0.smithi087.stdout:6/250: mknod d4/d8/df/d1e/d25/d28/c4d 0 2024-05-08T05:32:03.992 INFO:tasks.workunit.client.0.smithi087.stdout:6/251: read - d4/f38 zero size 2024-05-08T05:32:03.992 INFO:tasks.workunit.client.0.smithi087.stdout:6/252: dread - d4/d8/f3c zero size 2024-05-08T05:32:03.993 INFO:tasks.workunit.client.0.smithi087.stdout:6/253: unlink d4/d8/df/d1e/c2b 0 2024-05-08T05:32:03.993 INFO:tasks.workunit.client.0.smithi087.stdout:7/270: dwrite d2/d6/f25 [0,4194304] 0 2024-05-08T05:32:03.994 INFO:tasks.workunit.client.0.smithi087.stdout:0/246: dwrite d0/da/d11/f20 [0,4194304] 0 2024-05-08T05:32:03.994 INFO:tasks.workunit.client.0.smithi087.stdout:6/254: creat d4/d8/df/d1e/d25/f4e x:0 0 0 2024-05-08T05:32:03.995 INFO:tasks.workunit.client.0.smithi087.stdout:6/255: write d4/d8/f3c [570226,3716] 0 2024-05-08T05:32:03.995 INFO:tasks.workunit.client.0.smithi087.stdout:6/256: chown d4/d8/df/d1e/d25/d28/c4d 84925 1 2024-05-08T05:32:03.995 INFO:tasks.workunit.client.0.smithi087.stdout:6/257: readlink d4/d8/df/d1e/d25/l46 0 2024-05-08T05:32:03.995 INFO:tasks.workunit.client.0.smithi087.stdout:7/271: unlink d2/f27 0 2024-05-08T05:32:03.996 INFO:tasks.workunit.client.0.smithi087.stdout:6/258: truncate d4/d8/df/d1e/d25/d28/d2d/d37/d45/f48 31845 0 2024-05-08T05:32:03.998 INFO:tasks.workunit.client.0.smithi087.stdout:7/272: rename d2/d6/d12/d1d/d32 to d2/d6/d12/d19/d34/d54 0 2024-05-08T05:32:04.000 INFO:tasks.workunit.client.0.smithi087.stdout:6/259: rename d4/d8/df/c24 to d4/d8/df/d1e/d25/c4f 0 2024-05-08T05:32:04.001 INFO:tasks.workunit.client.0.smithi087.stdout:7/273: mkdir d2/d6/d12/d19/d34/d54/d55 0 2024-05-08T05:32:04.002 INFO:tasks.workunit.client.0.smithi087.stdout:2/240: dwrite d7/fd [0,4194304] 0 2024-05-08T05:32:04.005 INFO:tasks.workunit.client.0.smithi087.stdout:6/260: mknod d4/d8/df/d1e/c50 0 2024-05-08T05:32:04.005 INFO:tasks.workunit.client.0.smithi087.stdout:6/261: truncate d4/d8/df/d1e/d25/f4b 952675 0 2024-05-08T05:32:04.006 INFO:tasks.workunit.client.0.smithi087.stdout:8/262: dwrite db/d23/d15/f21 [0,4194304] 0 2024-05-08T05:32:04.006 INFO:tasks.workunit.client.0.smithi087.stdout:8/263: fsync db/d23/d1b/f3d 0 2024-05-08T05:32:04.008 INFO:tasks.workunit.client.0.smithi087.stdout:0/247: write d0/da/d35/f3d [2381123,66605] 0 2024-05-08T05:32:04.019 INFO:tasks.workunit.client.0.smithi087.stdout:5/240: sync 2024-05-08T05:32:04.020 INFO:tasks.workunit.client.0.smithi087.stdout:3/250: sync 2024-05-08T05:32:04.020 INFO:tasks.workunit.client.0.smithi087.stdout:1/222: sync 2024-05-08T05:32:04.020 INFO:tasks.workunit.client.0.smithi087.stdout:7/274: write d2/da/d3f/f30 [1663244,1079] 0 2024-05-08T05:32:04.020 INFO:tasks.workunit.client.0.smithi087.stdout:7/275: write d2/d6/d12/d15/f46 [866320,6749] 0 2024-05-08T05:32:04.021 INFO:tasks.workunit.client.0.smithi087.stdout:7/276: write d2/d6/d12/d15/f28 [4599814,117045] 0 2024-05-08T05:32:04.021 INFO:tasks.workunit.client.0.smithi087.stdout:5/241: mknod da/dd/d13/d16/c4e 0 2024-05-08T05:32:04.021 INFO:tasks.workunit.client.0.smithi087.stdout:5/242: dread - da/db/d2a/f31 zero size 2024-05-08T05:32:04.022 INFO:tasks.workunit.client.0.smithi087.stdout:6/262: dread d4/d6/f1b [4194304,4194304] 0 2024-05-08T05:32:04.022 INFO:tasks.workunit.client.0.smithi087.stdout:9/261: sync 2024-05-08T05:32:04.024 INFO:tasks.workunit.client.0.smithi087.stdout:5/243: read da/dd/d10/d17/f3a [483767,107034] 0 2024-05-08T05:32:04.025 INFO:tasks.workunit.client.0.smithi087.stdout:7/277: getdents d2/d6/d12/d19 0 2024-05-08T05:32:04.025 INFO:tasks.workunit.client.0.smithi087.stdout:7/278: dread - d2/d6/f44 zero size 2024-05-08T05:32:04.025 INFO:tasks.workunit.client.0.smithi087.stdout:3/251: rmdir d4/d14 39 2024-05-08T05:32:04.027 INFO:tasks.workunit.client.0.smithi087.stdout:6/263: rename d4/d6/l15 to d4/d8/df/d39/l51 0 2024-05-08T05:32:04.029 INFO:tasks.workunit.client.0.smithi087.stdout:3/252: rename d4/d11/d24/d25/d3e/f4c to d4/f5c 0 2024-05-08T05:32:04.029 INFO:tasks.workunit.client.0.smithi087.stdout:7/279: creat d2/d6/d12/d19/d34/d54/d50/f56 x:0 0 0 2024-05-08T05:32:04.029 INFO:tasks.workunit.client.0.smithi087.stdout:7/280: dread - d2/d6/d12/d1d/f4a zero size 2024-05-08T05:32:04.029 INFO:tasks.workunit.client.0.smithi087.stdout:7/281: fsync d2/d6/d12/d1d/f13 0 2024-05-08T05:32:04.030 INFO:tasks.workunit.client.0.smithi087.stdout:7/282: write d2/d6/d12/d19/d34/d54/f3e [755787,77082] 0 2024-05-08T05:32:04.030 INFO:tasks.workunit.client.0.smithi087.stdout:6/264: unlink d4/d8/df/d1e/c20 0 2024-05-08T05:32:04.031 INFO:tasks.workunit.client.0.smithi087.stdout:3/253: unlink d4/d11/f23 0 2024-05-08T05:32:04.031 INFO:tasks.workunit.client.0.smithi087.stdout:3/254: read d4/d14/f1a [56514,82935] 0 2024-05-08T05:32:04.037 INFO:tasks.workunit.client.0.smithi087.stdout:7/283: fsync d2/d6/d12/d15/f28 0 2024-05-08T05:32:04.037 INFO:tasks.workunit.client.0.smithi087.stdout:7/284: chown d2/d6/d12/d15/f46 11 1 2024-05-08T05:32:04.037 INFO:tasks.workunit.client.0.smithi087.stdout:7/285: chown d2/d6/f25 593418995 1 2024-05-08T05:32:04.037 INFO:tasks.workunit.client.0.smithi087.stdout:7/286: dread - d2/d6/d12/f51 zero size 2024-05-08T05:32:04.041 INFO:tasks.workunit.client.0.smithi087.stdout:3/255: mknod d4/c5d 0 2024-05-08T05:32:04.041 INFO:tasks.workunit.client.0.smithi087.stdout:9/262: dread d1/f1a [0,4194304] 0 2024-05-08T05:32:04.044 INFO:tasks.workunit.client.0.smithi087.stdout:2/241: dwrite d7/de/d27/d33/f30 [0,4194304] 0 2024-05-08T05:32:04.051 INFO:tasks.workunit.client.0.smithi087.stdout:3/256: truncate d4/f5 2535505 0 2024-05-08T05:32:04.051 INFO:tasks.workunit.client.0.smithi087.stdout:7/287: creat d2/d6/d12/d1d/f57 x:0 0 0 2024-05-08T05:32:04.051 INFO:tasks.workunit.client.0.smithi087.stdout:7/288: truncate d2/da/f4c 784888 0 2024-05-08T05:32:04.053 INFO:tasks.workunit.client.0.smithi087.stdout:9/263: link d1/db/f1f d1/df/d14/d18/f44 0 2024-05-08T05:32:04.058 INFO:tasks.workunit.client.0.smithi087.stdout:3/257: mknod d4/d11/d24/d39/c5e 0 2024-05-08T05:32:04.060 INFO:tasks.workunit.client.0.smithi087.stdout:9/264: symlink d1/df/d37/l45 0 2024-05-08T05:32:04.062 INFO:tasks.workunit.client.0.smithi087.stdout:3/258: rmdir d4/d11/d24/d39 39 2024-05-08T05:32:04.065 INFO:tasks.workunit.client.0.smithi087.stdout:2/242: dread d7/de/d27/d33/f30 [0,4194304] 0 2024-05-08T05:32:04.066 INFO:tasks.workunit.client.0.smithi087.stdout:2/243: symlink d7/de/d27/d33/d49/l4a 0 2024-05-08T05:32:04.071 INFO:tasks.workunit.client.0.smithi087.stdout:5/244: dwrite da/dd/d10/d36/d45/f4d [0,4194304] 0 2024-05-08T05:32:04.077 INFO:tasks.workunit.client.0.smithi087.stdout:1/223: dwrite df/d18/d1d/f48 [0,4194304] 0 2024-05-08T05:32:04.084 INFO:tasks.workunit.client.0.smithi087.stdout:2/244: dread d7/de/d27/f2e [0,4194304] 0 2024-05-08T05:32:04.084 INFO:tasks.workunit.client.0.smithi087.stdout:2/245: chown d7/de/d27/d33/f47 0 1 2024-05-08T05:32:04.097 INFO:tasks.workunit.client.0.smithi087.stdout:0/248: dwrite d0/da/f30 [0,4194304] 0 2024-05-08T05:32:04.097 INFO:tasks.workunit.client.0.smithi087.stdout:8/264: dread db/d23/d15/d29/d33/d4a/f5b [0,4194304] 0 2024-05-08T05:32:04.097 INFO:tasks.workunit.client.0.smithi087.stdout:7/289: dwrite d2/da/f4c [0,4194304] 0 2024-05-08T05:32:04.097 INFO:tasks.workunit.client.0.smithi087.stdout:7/290: read - d2/d6/d12/d1d/f57 zero size 2024-05-08T05:32:04.097 INFO:tasks.workunit.client.0.smithi087.stdout:0/249: link d0/da/d11/c18 d0/da/d11/c55 0 2024-05-08T05:32:04.097 INFO:tasks.workunit.client.0.smithi087.stdout:0/250: chown d0/d9/d23/c42 138540 1 2024-05-08T05:32:04.097 INFO:tasks.workunit.client.0.smithi087.stdout:7/291: mknod d2/d6/d12/d19/c58 0 2024-05-08T05:32:04.098 INFO:tasks.workunit.client.0.smithi087.stdout:7/292: mkdir d2/da/d3f/d49/d59 0 2024-05-08T05:32:04.099 INFO:tasks.workunit.client.0.smithi087.stdout:7/293: creat d2/d6/d12/d19/d34/f5a x:0 0 0 2024-05-08T05:32:04.101 INFO:tasks.workunit.client.0.smithi087.stdout:7/294: mkdir d2/d6/d12/d15/d5b 0 2024-05-08T05:32:04.101 INFO:tasks.workunit.client.0.smithi087.stdout:2/246: write d7/de/d27/d33/f30 [4167605,61046] 0 2024-05-08T05:32:04.102 INFO:tasks.workunit.client.0.smithi087.stdout:1/224: write df/d2f/f35 [1625891,113820] 0 2024-05-08T05:32:04.106 INFO:tasks.workunit.client.0.smithi087.stdout:7/295: link d2/da/f11 d2/d6/d12/d15/f5c 0 2024-05-08T05:32:04.106 INFO:tasks.workunit.client.0.smithi087.stdout:2/247: symlink d7/de/d27/d33/l4b 0 2024-05-08T05:32:04.107 INFO:tasks.workunit.client.0.smithi087.stdout:2/248: truncate d7/de/f24 3366430 0 2024-05-08T05:32:04.107 INFO:tasks.workunit.client.0.smithi087.stdout:7/296: rmdir d2 39 2024-05-08T05:32:04.108 INFO:tasks.workunit.client.0.smithi087.stdout:3/259: dwrite d4/f3c [0,4194304] 0 2024-05-08T05:32:04.108 INFO:tasks.workunit.client.0.smithi087.stdout:3/260: stat d4/d11/d24/d25/d3e/d3f/f4a 0 2024-05-08T05:32:04.109 INFO:tasks.workunit.client.0.smithi087.stdout:2/249: creat d7/de/d2c/f4c x:0 0 0 2024-05-08T05:32:04.109 INFO:tasks.workunit.client.0.smithi087.stdout:4/268: sync 2024-05-08T05:32:04.109 INFO:tasks.workunit.client.0.smithi087.stdout:4/269: truncate d4/f40 478063 0 2024-05-08T05:32:04.112 INFO:tasks.workunit.client.0.smithi087.stdout:3/261: mkdir d4/d5f 0 2024-05-08T05:32:04.113 INFO:tasks.workunit.client.0.smithi087.stdout:2/250: rmdir d7/d2d 39 2024-05-08T05:32:04.113 INFO:tasks.workunit.client.0.smithi087.stdout:2/251: chown d7/de/f24 644 1 2024-05-08T05:32:04.113 INFO:tasks.workunit.client.0.smithi087.stdout:2/252: fsync d7/f42 0 2024-05-08T05:32:04.113 INFO:tasks.workunit.client.0.smithi087.stdout:2/253: chown d7/la 1821 1 2024-05-08T05:32:04.114 INFO:tasks.workunit.client.0.smithi087.stdout:8/265: read db/d23/d1b/f3d [6078292,32825] 0 2024-05-08T05:32:04.114 INFO:tasks.workunit.client.0.smithi087.stdout:4/270: creat d4/d13/d3e/f62 x:0 0 0 2024-05-08T05:32:04.114 INFO:tasks.workunit.client.0.smithi087.stdout:1/225: dread df/f4a [4194304,4194304] 0 2024-05-08T05:32:04.115 INFO:tasks.workunit.client.0.smithi087.stdout:3/262: dread - d4/d11/d3d/d48/f52 zero size 2024-05-08T05:32:04.116 INFO:tasks.workunit.client.0.smithi087.stdout:2/254: mknod d7/de/d27/d33/d49/c4d 0 2024-05-08T05:32:04.118 INFO:tasks.workunit.client.0.smithi087.stdout:8/266: rename db/d23/d1b/d4f to db/d23/d15/d29/d33/d5c 0 2024-05-08T05:32:04.123 INFO:tasks.workunit.client.0.smithi087.stdout:4/271: mkdir d4/d13/d32/d42/d4e/d63 0 2024-05-08T05:32:04.123 INFO:tasks.workunit.client.0.smithi087.stdout:3/263: mkdir d4/d11/d24/d39/d60 0 2024-05-08T05:32:04.124 INFO:tasks.workunit.client.0.smithi087.stdout:6/265: dwrite d4/f38 [0,4194304] 0 2024-05-08T05:32:04.127 INFO:tasks.workunit.client.0.smithi087.stdout:1/226: dread fa [4194304,4194304] 0 2024-05-08T05:32:04.127 INFO:tasks.workunit.client.0.smithi087.stdout:1/227: dread - df/d18/f47 zero size 2024-05-08T05:32:04.128 INFO:tasks.workunit.client.0.smithi087.stdout:8/267: mknod db/d23/d15/d29/d4d/c5d 0 2024-05-08T05:32:04.128 INFO:tasks.workunit.client.0.smithi087.stdout:4/272: link d4/d13/d32/d42/d4a/l57 d4/l64 0 2024-05-08T05:32:04.128 INFO:tasks.workunit.client.0.smithi087.stdout:8/268: fsync db/d23/d1b/f2a 0 2024-05-08T05:32:04.130 INFO:tasks.workunit.client.0.smithi087.stdout:1/228: creat df/d39/f4c x:0 0 0 2024-05-08T05:32:04.133 INFO:tasks.workunit.client.0.smithi087.stdout:3/264: mknod d4/d11/d3d/d4e/c61 0 2024-05-08T05:32:04.133 INFO:tasks.workunit.client.0.smithi087.stdout:3/265: truncate d4/d11/d24/d25/f54 230571 0 2024-05-08T05:32:04.135 INFO:tasks.workunit.client.0.smithi087.stdout:4/273: rename d4/d13/d32/d42 to d4/d13/d65 0 2024-05-08T05:32:04.136 INFO:tasks.workunit.client.0.smithi087.stdout:8/269: rmdir db/d23 39 2024-05-08T05:32:04.136 INFO:tasks.workunit.client.0.smithi087.stdout:8/270: truncate db/d23/d15/d3c/f3e 1014259 0 2024-05-08T05:32:04.137 INFO:tasks.workunit.client.0.smithi087.stdout:1/229: creat df/f4d x:0 0 0 2024-05-08T05:32:04.138 INFO:tasks.workunit.client.0.smithi087.stdout:3/266: link d4/d11/d24/d25/l2d d4/d11/d24/d25/l62 0 2024-05-08T05:32:04.138 INFO:tasks.workunit.client.0.smithi087.stdout:3/267: chown d4/le 221 1 2024-05-08T05:32:04.141 INFO:tasks.workunit.client.0.smithi087.stdout:8/271: rmdir db/d23/d15/d29/d33/d5c 0 2024-05-08T05:32:04.141 INFO:tasks.workunit.client.0.smithi087.stdout:8/272: write db/d23/d15/d3c/f3e [1727090,38430] 0 2024-05-08T05:32:04.141 INFO:tasks.workunit.client.0.smithi087.stdout:8/273: chown db/d23/c47 12 1 2024-05-08T05:32:04.141 INFO:tasks.workunit.client.0.smithi087.stdout:3/268: creat d4/d14/f63 x:0 0 0 2024-05-08T05:32:04.143 INFO:tasks.workunit.client.0.smithi087.stdout:8/274: creat db/f5e x:0 0 0 2024-05-08T05:32:04.143 INFO:tasks.workunit.client.0.smithi087.stdout:8/275: dread - db/d23/d1b/d35/d43/f44 zero size 2024-05-08T05:32:04.144 INFO:tasks.workunit.client.0.smithi087.stdout:5/245: dwrite da/f2e [0,4194304] 0 2024-05-08T05:32:04.145 INFO:tasks.workunit.client.0.smithi087.stdout:5/246: getdents da/dd 0 2024-05-08T05:32:04.148 INFO:tasks.workunit.client.0.smithi087.stdout:5/247: truncate f9 4562052 0 2024-05-08T05:32:04.148 INFO:tasks.workunit.client.0.smithi087.stdout:5/248: chown da/db/c3d 1375695757 1 2024-05-08T05:32:04.149 INFO:tasks.workunit.client.0.smithi087.stdout:5/249: creat da/dd/d10/d36/d45/f4f x:0 0 0 2024-05-08T05:32:04.150 INFO:tasks.workunit.client.0.smithi087.stdout:5/250: rmdir da/db/d2a/d46 39 2024-05-08T05:32:04.153 INFO:tasks.workunit.client.0.smithi087.stdout:5/251: unlink da/dd/d13/l3e 0 2024-05-08T05:32:04.171 INFO:tasks.workunit.client.0.smithi087.stdout:2/255: dwrite f6 [0,4194304] 0 2024-05-08T05:32:04.173 INFO:tasks.workunit.client.0.smithi087.stdout:2/256: symlink d7/de/d2c/d43/l4e 0 2024-05-08T05:32:04.179 INFO:tasks.workunit.client.0.smithi087.stdout:3/269: write d4/d11/d3d/f51 [3918182,112852] 0 2024-05-08T05:32:04.179 INFO:tasks.workunit.client.0.smithi087.stdout:3/270: dread - d4/f1d zero size 2024-05-08T05:32:04.179 INFO:tasks.workunit.client.0.smithi087.stdout:3/271: write d4/f5c [490186,128754] 0 2024-05-08T05:32:04.179 INFO:tasks.workunit.client.0.smithi087.stdout:4/274: dwrite d4/d13/d3e/f38 [0,4194304] 0 2024-05-08T05:32:04.179 INFO:tasks.workunit.client.0.smithi087.stdout:3/272: fdatasync d4/d14/f1a 0 2024-05-08T05:32:04.188 INFO:tasks.workunit.client.0.smithi087.stdout:3/273: write d4/d11/d3d/f56 [205674,18682] 0 2024-05-08T05:32:04.190 INFO:tasks.workunit.client.0.smithi087.stdout:4/275: dread d4/d13/f23 [0,4194304] 0 2024-05-08T05:32:04.192 INFO:tasks.workunit.client.0.smithi087.stdout:4/276: mkdir d4/d13/d32/d66 0 2024-05-08T05:32:04.193 INFO:tasks.workunit.client.0.smithi087.stdout:4/277: mknod d4/d13/d32/c67 0 2024-05-08T05:32:04.193 INFO:tasks.workunit.client.0.smithi087.stdout:4/278: chown d4/d13/d3e/d28/d50 91791276 1 2024-05-08T05:32:04.195 INFO:tasks.workunit.client.0.smithi087.stdout:8/276: dread db/d23/d1b/f3d [0,4194304] 0 2024-05-08T05:32:04.195 INFO:tasks.workunit.client.0.smithi087.stdout:1/230: dwrite df/d12/f31 [0,4194304] 0 2024-05-08T05:32:04.195 INFO:tasks.workunit.client.0.smithi087.stdout:1/231: readlink df/d12/l1e 0 2024-05-08T05:32:04.195 INFO:tasks.workunit.client.0.smithi087.stdout:1/232: dread - df/d39/f4c zero size 2024-05-08T05:32:04.195 INFO:tasks.workunit.client.0.smithi087.stdout:1/233: truncate df/d2f/f3c 936242 0 2024-05-08T05:32:04.195 INFO:tasks.workunit.client.0.smithi087.stdout:4/279: creat d4/d13/d65/d4e/f68 x:0 0 0 2024-05-08T05:32:04.195 INFO:tasks.workunit.client.0.smithi087.stdout:2/257: dread d7/f18 [0,4194304] 0 2024-05-08T05:32:04.198 INFO:tasks.workunit.client.0.smithi087.stdout:8/277: link db/ld db/d23/d15/d29/d33/d3b/l5f 0 2024-05-08T05:32:04.199 INFO:tasks.workunit.client.0.smithi087.stdout:1/234: link df/c2c df/d39/c4e 0 2024-05-08T05:32:04.200 INFO:tasks.workunit.client.0.smithi087.stdout:4/280: truncate f1 2367219 0 2024-05-08T05:32:04.201 INFO:tasks.workunit.client.0.smithi087.stdout:2/258: rename d7/de/f3a to d7/de/d27/f4f 0 2024-05-08T05:32:04.201 INFO:tasks.workunit.client.0.smithi087.stdout:2/259: dread - d7/f37 zero size 2024-05-08T05:32:04.202 INFO:tasks.workunit.client.0.smithi087.stdout:8/278: unlink db/l10 0 2024-05-08T05:32:04.202 INFO:tasks.workunit.client.0.smithi087.stdout:8/279: chown db/d23/d1b/f26 102196242 1 2024-05-08T05:32:04.203 INFO:tasks.workunit.client.0.smithi087.stdout:1/235: mkdir df/d2f/d4f 0 2024-05-08T05:32:04.203 INFO:tasks.workunit.client.0.smithi087.stdout:1/236: write df/f3e [62803,47658] 0 2024-05-08T05:32:04.204 INFO:tasks.workunit.client.0.smithi087.stdout:4/281: mknod d4/d13/d3e/d28/c69 0 2024-05-08T05:32:04.204 INFO:tasks.workunit.client.0.smithi087.stdout:4/282: chown d4/d13/d3e/l55 11 1 2024-05-08T05:32:04.206 INFO:tasks.workunit.client.0.smithi087.stdout:5/252: dwrite da/db/f25 [0,4194304] 0 2024-05-08T05:32:04.206 INFO:tasks.workunit.client.0.smithi087.stdout:5/253: write da/dd/d10/d36/d45/f4d [4957779,111097] 0 2024-05-08T05:32:04.206 INFO:tasks.workunit.client.0.smithi087.stdout:5/254: chown da/db/l1b 0 1 2024-05-08T05:32:04.207 INFO:tasks.workunit.client.0.smithi087.stdout:5/255: chown c4 572259 1 2024-05-08T05:32:04.207 INFO:tasks.workunit.client.0.smithi087.stdout:5/256: write da/f3c [794234,125610] 0 2024-05-08T05:32:04.207 INFO:tasks.workunit.client.0.smithi087.stdout:4/283: symlink d4/d13/d3e/d28/d50/l6a 0 2024-05-08T05:32:04.212 INFO:tasks.workunit.client.0.smithi087.stdout:3/274: dread d4/d11/d24/d25/d3e/f46 [0,4194304] 0 2024-05-08T05:32:04.220 INFO:tasks.workunit.client.0.smithi087.stdout:8/280: dread db/d23/f38 [0,4194304] 0 2024-05-08T05:32:04.222 INFO:tasks.workunit.client.0.smithi087.stdout:4/284: rename d4/d13/d3e/d28/d50/l6a to d4/d13/d65/d4a/d5d/l6b 0 2024-05-08T05:32:04.222 INFO:tasks.workunit.client.0.smithi087.stdout:5/257: mkdir da/dd/d10/d42/d50 0 2024-05-08T05:32:04.222 INFO:tasks.workunit.client.0.smithi087.stdout:4/285: readlink d4/lf 0 2024-05-08T05:32:04.223 INFO:tasks.workunit.client.0.smithi087.stdout:4/286: readlink d4/d13/d3e/l55 0 2024-05-08T05:32:04.223 INFO:tasks.workunit.client.0.smithi087.stdout:0/251: sync 2024-05-08T05:32:04.223 INFO:tasks.workunit.client.0.smithi087.stdout:9/265: sync 2024-05-08T05:32:04.229 INFO:tasks.workunit.client.0.smithi087.stdout:8/281: creat db/d23/d1b/d35/f60 x:0 0 0 2024-05-08T05:32:04.229 INFO:tasks.workunit.client.0.smithi087.stdout:4/287: mkdir d4/d6c 0 2024-05-08T05:32:04.229 INFO:tasks.workunit.client.0.smithi087.stdout:0/252: symlink d0/da/d11/l56 0 2024-05-08T05:32:04.229 INFO:tasks.workunit.client.0.smithi087.stdout:4/288: chown d4/d13/d3e/d28/d50/d5a/f5e 57 1 2024-05-08T05:32:04.229 INFO:tasks.workunit.client.0.smithi087.stdout:1/237: dread df/f11 [0,4194304] 0 2024-05-08T05:32:04.230 INFO:tasks.workunit.client.0.smithi087.stdout:0/253: rename d0/d9/d23 to d0/d57 0 2024-05-08T05:32:04.232 INFO:tasks.workunit.client.0.smithi087.stdout:4/289: truncate d4/f10 2186543 0 2024-05-08T05:32:04.232 INFO:tasks.workunit.client.0.smithi087.stdout:8/282: symlink db/l61 0 2024-05-08T05:32:04.234 INFO:tasks.workunit.client.0.smithi087.stdout:1/238: unlink df/d39/f4c 0 2024-05-08T05:32:04.235 INFO:tasks.workunit.client.0.smithi087.stdout:0/254: truncate d0/d9/df/f34 1720769 0 2024-05-08T05:32:04.237 INFO:tasks.workunit.client.0.smithi087.stdout:4/290: creat d4/d13/d65/d4a/d5d/f6d x:0 0 0 2024-05-08T05:32:04.238 INFO:tasks.workunit.client.0.smithi087.stdout:5/258: dread da/dd/d10/d17/f2b [0,4194304] 0 2024-05-08T05:32:04.238 INFO:tasks.workunit.client.0.smithi087.stdout:1/239: creat df/d2f/f50 x:0 0 0 2024-05-08T05:32:04.239 INFO:tasks.workunit.client.0.smithi087.stdout:4/291: rename d4/d13/d3e/d28/d35/f58 to d4/f6e 0 2024-05-08T05:32:04.240 INFO:tasks.workunit.client.0.smithi087.stdout:4/292: dread - d4/d13/d32/f45 zero size 2024-05-08T05:32:04.240 INFO:tasks.workunit.client.0.smithi087.stdout:4/293: write d4/d13/d3e/f62 [776896,116956] 0 2024-05-08T05:32:04.240 INFO:tasks.workunit.client.0.smithi087.stdout:4/294: write d4/d13/d65/d4e/f68 [967412,60226] 0 2024-05-08T05:32:04.240 INFO:tasks.workunit.client.0.smithi087.stdout:9/266: write d1/f30 [1883881,46590] 0 2024-05-08T05:32:04.240 INFO:tasks.workunit.client.0.smithi087.stdout:9/267: chown d1/df/d14/d18 0 1 2024-05-08T05:32:04.242 INFO:tasks.workunit.client.0.smithi087.stdout:4/295: creat d4/d13/d65/f6f x:0 0 0 2024-05-08T05:32:04.243 INFO:tasks.workunit.client.0.smithi087.stdout:2/260: dwrite d7/de/f2b [0,4194304] 0 2024-05-08T05:32:04.244 INFO:tasks.workunit.client.0.smithi087.stdout:9/268: mknod d1/df/d14/c46 0 2024-05-08T05:32:04.250 INFO:tasks.workunit.client.0.smithi087.stdout:4/296: creat d4/d6c/f70 x:0 0 0 2024-05-08T05:32:04.254 INFO:tasks.workunit.client.0.smithi087.stdout:9/269: link d1/df/d14/f2f d1/db/f47 0 2024-05-08T05:32:04.254 INFO:tasks.workunit.client.0.smithi087.stdout:9/270: chown d1/df/d37 270758 1 2024-05-08T05:32:04.254 INFO:tasks.workunit.client.0.smithi087.stdout:9/271: chown d1/f30 2083 1 2024-05-08T05:32:04.255 INFO:tasks.workunit.client.0.smithi087.stdout:0/255: dread d0/da/fe [0,4194304] 0 2024-05-08T05:32:04.255 INFO:tasks.workunit.client.0.smithi087.stdout:4/297: symlink d4/d13/d3e/d28/d35/d56/l71 0 2024-05-08T05:32:04.256 INFO:tasks.workunit.client.0.smithi087.stdout:9/272: fdatasync d1/f30 0 2024-05-08T05:32:04.256 INFO:tasks.workunit.client.0.smithi087.stdout:9/273: write d1/df/d14/d18/f1e [4677724,1606] 0 2024-05-08T05:32:04.257 INFO:tasks.workunit.client.0.smithi087.stdout:0/256: read d0/d9/f48 [46594,122120] 0 2024-05-08T05:32:04.264 INFO:tasks.workunit.client.0.smithi087.stdout:4/298: mknod d4/d13/d3e/d28/c72 0 2024-05-08T05:32:04.264 INFO:tasks.workunit.client.0.smithi087.stdout:6/266: sync 2024-05-08T05:32:04.264 INFO:tasks.workunit.client.0.smithi087.stdout:7/297: sync 2024-05-08T05:32:04.264 INFO:tasks.workunit.client.0.smithi087.stdout:7/298: chown d2/d6/d12/d1d 3190878 1 2024-05-08T05:32:04.266 INFO:tasks.workunit.client.0.smithi087.stdout:9/274: creat d1/db/d28/f48 x:0 0 0 2024-05-08T05:32:04.268 INFO:tasks.workunit.client.0.smithi087.stdout:4/299: truncate d4/f4b 591488 0 2024-05-08T05:32:04.269 INFO:tasks.workunit.client.0.smithi087.stdout:4/300: truncate d4/d13/d3e/d28/f39 965332 0 2024-05-08T05:32:04.270 INFO:tasks.workunit.client.0.smithi087.stdout:8/283: dwrite db/d23/d15/f36 [0,4194304] 0 2024-05-08T05:32:04.270 INFO:tasks.workunit.client.0.smithi087.stdout:4/301: truncate d4/d13/d3e/f62 282552 0 2024-05-08T05:32:04.271 INFO:tasks.workunit.client.0.smithi087.stdout:4/302: truncate d4/d6c/f70 167304 0 2024-05-08T05:32:04.272 INFO:tasks.workunit.client.0.smithi087.stdout:8/284: creat db/d23/d15/d29/f62 x:0 0 0 2024-05-08T05:32:04.275 INFO:tasks.workunit.client.0.smithi087.stdout:8/285: creat db/d23/f63 x:0 0 0 2024-05-08T05:32:04.283 INFO:tasks.workunit.client.0.smithi087.stdout:8/286: creat db/d23/f64 x:0 0 0 2024-05-08T05:32:04.284 INFO:tasks.workunit.client.0.smithi087.stdout:9/275: dread d1/fa [0,4194304] 0 2024-05-08T05:32:04.284 INFO:tasks.workunit.client.0.smithi087.stdout:9/276: fdatasync d1/df/d37/d3e/f26 0 2024-05-08T05:32:04.285 INFO:tasks.workunit.client.0.smithi087.stdout:8/287: mkdir db/d23/d3a/d65 0 2024-05-08T05:32:04.286 INFO:tasks.workunit.client.0.smithi087.stdout:9/277: mknod d1/db/c49 0 2024-05-08T05:32:04.286 INFO:tasks.workunit.client.0.smithi087.stdout:9/278: fdatasync d1/f1a 0 2024-05-08T05:32:04.286 INFO:tasks.workunit.client.0.smithi087.stdout:9/279: fdatasync d1/df/d37/d3e/f40 0 2024-05-08T05:32:04.288 INFO:tasks.workunit.client.0.smithi087.stdout:9/280: creat d1/db/d28/f4a x:0 0 0 2024-05-08T05:32:04.296 INFO:tasks.workunit.client.0.smithi087.stdout:4/303: dread d4/d13/f16 [0,4194304] 0 2024-05-08T05:32:04.297 INFO:tasks.workunit.client.0.smithi087.stdout:2/261: dwrite d7/de/d27/d33/f38 [0,4194304] 0 2024-05-08T05:32:04.299 INFO:tasks.workunit.client.0.smithi087.stdout:9/281: dread d1/df/f35 [0,4194304] 0 2024-05-08T05:32:04.299 INFO:tasks.workunit.client.0.smithi087.stdout:9/282: write d1/df/d37/d3e/f26 [1953089,16921] 0 2024-05-08T05:32:04.299 INFO:tasks.workunit.client.0.smithi087.stdout:9/283: write d1/df/d14/d18/f44 [4670539,39950] 0 2024-05-08T05:32:04.299 INFO:tasks.workunit.client.0.smithi087.stdout:9/284: read d1/f8 [1889789,93591] 0 2024-05-08T05:32:04.299 INFO:tasks.workunit.client.0.smithi087.stdout:4/304: rename d4/d13/d3e/l47 to d4/d13/d3e/d28/l73 0 2024-05-08T05:32:04.301 INFO:tasks.workunit.client.0.smithi087.stdout:2/262: truncate d7/d2d/f39 4027689 0 2024-05-08T05:32:04.301 INFO:tasks.workunit.client.0.smithi087.stdout:2/263: chown d7/de/d27/d33/c3d 122762 1 2024-05-08T05:32:04.303 INFO:tasks.workunit.client.0.smithi087.stdout:4/305: link d4/f4b d4/d13/d32/d66/f74 0 2024-05-08T05:32:04.303 INFO:tasks.workunit.client.0.smithi087.stdout:4/306: fdatasync d4/f6e 0 2024-05-08T05:32:04.303 INFO:tasks.workunit.client.0.smithi087.stdout:4/307: fdatasync d4/d13/d3e/f27 0 2024-05-08T05:32:04.303 INFO:tasks.workunit.client.0.smithi087.stdout:4/308: write d4/f6e [782139,39758] 0 2024-05-08T05:32:04.304 INFO:tasks.workunit.client.0.smithi087.stdout:2/264: mknod d7/c50 0 2024-05-08T05:32:04.304 INFO:tasks.workunit.client.0.smithi087.stdout:9/285: dread d1/f21 [4194304,4194304] 0 2024-05-08T05:32:04.306 INFO:tasks.workunit.client.0.smithi087.stdout:6/267: dwrite d4/d8/df/d1e/d25/d28/d2d/d37/d45/f48 [0,4194304] 0 2024-05-08T05:32:04.307 INFO:tasks.workunit.client.0.smithi087.stdout:2/265: symlink d7/d2d/l51 0 2024-05-08T05:32:04.310 INFO:tasks.workunit.client.0.smithi087.stdout:6/268: mkdir d4/d8/df/d1e/d52 0 2024-05-08T05:32:04.311 INFO:tasks.workunit.client.0.smithi087.stdout:2/266: symlink d7/de/d27/l52 0 2024-05-08T05:32:04.312 INFO:tasks.workunit.client.0.smithi087.stdout:6/269: truncate d4/d6/fa 1805435 0 2024-05-08T05:32:04.313 INFO:tasks.workunit.client.0.smithi087.stdout:2/267: creat d7/de/d27/f53 x:0 0 0 2024-05-08T05:32:04.315 INFO:tasks.workunit.client.0.smithi087.stdout:2/268: mknod d7/d2d/c54 0 2024-05-08T05:32:04.315 INFO:tasks.workunit.client.0.smithi087.stdout:2/269: write d7/de/f15 [4069049,125423] 0 2024-05-08T05:32:04.316 INFO:tasks.workunit.client.0.smithi087.stdout:7/299: dwrite d2/d6/d12/d19/d34/f5a [0,4194304] 0 2024-05-08T05:32:04.320 INFO:tasks.workunit.client.0.smithi087.stdout:6/270: write d4/d6/fa [2077609,15698] 0 2024-05-08T05:32:04.320 INFO:tasks.workunit.client.0.smithi087.stdout:6/271: fdatasync d4/d8/df/d1e/d25/d28/d2d/d37/d45/f48 0 2024-05-08T05:32:04.323 INFO:tasks.workunit.client.0.smithi087.stdout:7/300: mknod d2/d6/d12/d19/d34/d54/c5d 0 2024-05-08T05:32:04.324 INFO:tasks.workunit.client.0.smithi087.stdout:7/301: write d2/d6/d12/d19/d34/d54/d50/f56 [488467,11683] 0 2024-05-08T05:32:04.324 INFO:tasks.workunit.client.0.smithi087.stdout:7/302: dread - d2/d6/d12/f43 zero size 2024-05-08T05:32:04.329 INFO:tasks.workunit.client.0.smithi087.stdout:6/272: rmdir d4/d8/df/d1e 39 2024-05-08T05:32:04.332 INFO:tasks.workunit.client.0.smithi087.stdout:2/270: write f6 [1615855,29775] 0 2024-05-08T05:32:04.337 INFO:tasks.workunit.client.0.smithi087.stdout:4/309: dwrite d4/d13/d3e/d28/d35/f3a [0,4194304] 0 2024-05-08T05:32:04.338 INFO:tasks.workunit.client.0.smithi087.stdout:7/303: dread d2/d6/d12/d15/f5c [0,4194304] 0 2024-05-08T05:32:04.338 INFO:tasks.workunit.client.0.smithi087.stdout:7/304: readlink d2/d6/d12/d19/d2a/l53 0 2024-05-08T05:32:04.338 INFO:tasks.workunit.client.0.smithi087.stdout:4/310: symlink d4/d13/d65/l75 0 2024-05-08T05:32:04.340 INFO:tasks.workunit.client.0.smithi087.stdout:4/311: mknod d4/d13/d65/d4a/c76 0 2024-05-08T05:32:04.340 INFO:tasks.workunit.client.0.smithi087.stdout:4/312: truncate d4/d6c/f70 1178001 0 2024-05-08T05:32:04.340 INFO:tasks.workunit.client.0.smithi087.stdout:2/271: truncate f6 2877572 0 2024-05-08T05:32:04.342 INFO:tasks.workunit.client.0.smithi087.stdout:9/286: dwrite d1/f8 [0,4194304] 0 2024-05-08T05:32:04.348 INFO:tasks.workunit.client.0.smithi087.stdout:9/287: mkdir d1/db/d28/d4b 0 2024-05-08T05:32:04.349 INFO:tasks.workunit.client.0.smithi087.stdout:9/288: rename d1/df/d14/d18/l2b to d1/df/d14/l4c 0 2024-05-08T05:32:04.349 INFO:tasks.workunit.client.0.smithi087.stdout:9/289: dread - d1/df/d37/d3e/f40 zero size 2024-05-08T05:32:04.350 INFO:tasks.workunit.client.0.smithi087.stdout:9/290: mknod d1/db/d28/d4b/c4d 0 2024-05-08T05:32:04.350 INFO:tasks.workunit.client.0.smithi087.stdout:9/291: readlink d1/df/d37/d3e/l32 0 2024-05-08T05:32:04.351 INFO:tasks.workunit.client.0.smithi087.stdout:9/292: creat d1/db/f4e x:0 0 0 2024-05-08T05:32:04.351 INFO:tasks.workunit.client.0.smithi087.stdout:9/293: write d1/db/d28/f48 [279976,13864] 0 2024-05-08T05:32:04.352 INFO:tasks.workunit.client.0.smithi087.stdout:9/294: getdents d1/df/d37/d3e 0 2024-05-08T05:32:04.352 INFO:tasks.workunit.client.0.smithi087.stdout:9/295: fsync d1/fd 0 2024-05-08T05:32:04.352 INFO:tasks.workunit.client.0.smithi087.stdout:9/296: stat d1/df/d37/d3e/c27 0 2024-05-08T05:32:04.354 INFO:tasks.workunit.client.0.smithi087.stdout:9/297: creat d1/db/d28/f4f x:0 0 0 2024-05-08T05:32:04.356 INFO:tasks.workunit.client.0.smithi087.stdout:9/298: rename d1/db/c49 to d1/c50 0 2024-05-08T05:32:04.358 INFO:tasks.workunit.client.0.smithi087.stdout:9/299: creat d1/df/d37/f51 x:0 0 0 2024-05-08T05:32:04.358 INFO:tasks.workunit.client.0.smithi087.stdout:9/300: read d1/f13 [2001360,89866] 0 2024-05-08T05:32:04.358 INFO:tasks.workunit.client.0.smithi087.stdout:9/301: stat d1/f1a 0 2024-05-08T05:32:04.361 INFO:tasks.workunit.client.0.smithi087.stdout:3/275: sync 2024-05-08T05:32:04.361 INFO:tasks.workunit.client.0.smithi087.stdout:3/276: dread - d4/d11/d24/d25/d3e/d3f/f4a zero size 2024-05-08T05:32:04.363 INFO:tasks.workunit.client.0.smithi087.stdout:3/277: mkdir d4/d11/d3d/d64 0 2024-05-08T05:32:04.364 INFO:tasks.workunit.client.0.smithi087.stdout:3/278: stat d4/d11 0 2024-05-08T05:32:04.364 INFO:tasks.workunit.client.0.smithi087.stdout:3/279: read - d4/d11/f50 zero size 2024-05-08T05:32:04.369 INFO:tasks.workunit.client.0.smithi087.stdout:2/272: write d7/de/d27/f2e [6864001,50825] 0 2024-05-08T05:32:04.376 INFO:tasks.workunit.client.0.smithi087.stdout:3/280: dread d4/d11/d3d/f47 [0,4194304] 0 2024-05-08T05:32:04.378 INFO:tasks.workunit.client.0.smithi087.stdout:3/281: creat d4/d11/d24/d25/d3e/f65 x:0 0 0 2024-05-08T05:32:04.379 INFO:tasks.workunit.client.0.smithi087.stdout:9/302: dread d1/df/d37/d3e/f2d [0,4194304] 0 2024-05-08T05:32:04.382 INFO:tasks.workunit.client.0.smithi087.stdout:3/282: unlink d4/d11/d24/d25/d3e/c43 0 2024-05-08T05:32:04.382 INFO:tasks.workunit.client.0.smithi087.stdout:3/283: chown d4/d11/d24/d25/d3e/d3f/l44 6737890 1 2024-05-08T05:32:04.382 INFO:tasks.workunit.client.0.smithi087.stdout:3/284: fsync d4/d14/f28 0 2024-05-08T05:32:04.383 INFO:tasks.workunit.client.0.smithi087.stdout:9/303: creat d1/df/f52 x:0 0 0 2024-05-08T05:32:04.384 INFO:tasks.workunit.client.0.smithi087.stdout:3/285: mknod d4/d11/d24/d39/c66 0 2024-05-08T05:32:04.387 INFO:tasks.workunit.client.0.smithi087.stdout:9/304: unlink d1/df/f3f 0 2024-05-08T05:32:04.389 INFO:tasks.workunit.client.0.smithi087.stdout:3/286: symlink d4/d11/l67 0 2024-05-08T05:32:04.389 INFO:tasks.workunit.client.0.smithi087.stdout:3/287: chown d4/f5c 1697 1 2024-05-08T05:32:04.389 INFO:tasks.workunit.client.0.smithi087.stdout:3/288: truncate d4/d14/f29 4654796 0 2024-05-08T05:32:04.391 INFO:tasks.workunit.client.0.smithi087.stdout:9/305: creat d1/df/d37/d3e/f53 x:0 0 0 2024-05-08T05:32:04.391 INFO:tasks.workunit.client.0.smithi087.stdout:9/306: read - d1/f19 zero size 2024-05-08T05:32:04.392 INFO:tasks.workunit.client.0.smithi087.stdout:4/313: dwrite d4/d6c/f70 [0,4194304] 0 2024-05-08T05:32:04.392 INFO:tasks.workunit.client.0.smithi087.stdout:3/289: rmdir d4/d11/d3d/d48 39 2024-05-08T05:32:04.392 INFO:tasks.workunit.client.0.smithi087.stdout:3/290: readlink d4/lf 0 2024-05-08T05:32:04.396 INFO:tasks.workunit.client.0.smithi087.stdout:4/314: unlink d4/f2f 0 2024-05-08T05:32:04.397 INFO:tasks.workunit.client.0.smithi087.stdout:4/315: symlink d4/d6c/l77 0 2024-05-08T05:32:04.399 INFO:tasks.workunit.client.0.smithi087.stdout:4/316: creat d4/d13/d65/d4e/f78 x:0 0 0 2024-05-08T05:32:04.401 INFO:tasks.workunit.client.0.smithi087.stdout:4/317: unlink d4/d13/d65/d4a/l57 0 2024-05-08T05:32:04.401 INFO:tasks.workunit.client.0.smithi087.stdout:4/318: write d4/f4b [658834,118557] 0 2024-05-08T05:32:04.402 INFO:tasks.workunit.client.0.smithi087.stdout:6/273: dwrite f1 [4194304,4194304] 0 2024-05-08T05:32:04.403 INFO:tasks.workunit.client.0.smithi087.stdout:3/291: dread d4/d14/f28 [0,4194304] 0 2024-05-08T05:32:04.404 INFO:tasks.workunit.client.0.smithi087.stdout:4/319: link d4/d13/d65/d4a/c60 d4/d13/c79 0 2024-05-08T05:32:04.404 INFO:tasks.workunit.client.0.smithi087.stdout:4/320: write d4/f10 [2971722,120905] 0 2024-05-08T05:32:04.404 INFO:tasks.workunit.client.0.smithi087.stdout:4/321: truncate d4/d13/d3e/d28/d35/f41 473269 0 2024-05-08T05:32:04.406 INFO:tasks.workunit.client.0.smithi087.stdout:6/274: mknod d4/d8/df/d1e/d25/c53 0 2024-05-08T05:32:04.407 INFO:tasks.workunit.client.0.smithi087.stdout:3/292: getdents d4/d11/d3d 0 2024-05-08T05:32:04.409 INFO:tasks.workunit.client.0.smithi087.stdout:4/322: getdents d4/d13/d32/d66 0 2024-05-08T05:32:04.409 INFO:tasks.workunit.client.0.smithi087.stdout:4/323: stat d4/d13/d3e/f4f 0 2024-05-08T05:32:04.409 INFO:tasks.workunit.client.0.smithi087.stdout:4/324: truncate d4/d13/f3f 328254 0 2024-05-08T05:32:04.411 INFO:tasks.workunit.client.0.smithi087.stdout:2/273: dwrite d7/fd [0,4194304] 0 2024-05-08T05:32:04.411 INFO:tasks.workunit.client.0.smithi087.stdout:2/274: chown d7/de/d2c/d43 212847537 1 2024-05-08T05:32:04.411 INFO:tasks.workunit.client.0.smithi087.stdout:3/293: rename d4/fb to d4/d11/d24/d25/d4d/f68 0 2024-05-08T05:32:04.412 INFO:tasks.workunit.client.0.smithi087.stdout:3/294: write d4/d14/f28 [4639228,118183] 0 2024-05-08T05:32:04.412 INFO:tasks.workunit.client.0.smithi087.stdout:3/295: chown d4/le 113917 1 2024-05-08T05:32:04.419 INFO:tasks.workunit.client.0.smithi087.stdout:2/275: mkdir d7/de/d55 0 2024-05-08T05:32:04.432 INFO:tasks.workunit.client.0.smithi087.stdout:9/307: dwrite d1/f21 [0,4194304] 0 2024-05-08T05:32:04.433 INFO:tasks.workunit.client.0.smithi087.stdout:9/308: getdents d1 0 2024-05-08T05:32:04.445 INFO:tasks.workunit.client.0.smithi087.stdout:5/259: sync 2024-05-08T05:32:04.448 INFO:tasks.workunit.client.0.smithi087.stdout:5/260: mknod da/dd/d10/d17/c51 0 2024-05-08T05:32:04.450 INFO:tasks.workunit.client.0.smithi087.stdout:5/261: creat da/dd/d10/d42/d50/f52 x:0 0 0 2024-05-08T05:32:04.452 INFO:tasks.workunit.client.0.smithi087.stdout:5/262: rename da/db/c1f to da/dd/d10/d36/c53 0 2024-05-08T05:32:04.452 INFO:tasks.workunit.client.0.smithi087.stdout:9/309: write d1/f8 [773761,2119] 0 2024-05-08T05:32:04.453 INFO:tasks.workunit.client.0.smithi087.stdout:5/263: truncate da/f48 3627603 0 2024-05-08T05:32:04.460 INFO:tasks.workunit.client.0.smithi087.stdout:4/325: dwrite d4/d13/d3e/f52 [0,4194304] 0 2024-05-08T05:32:04.463 INFO:tasks.workunit.client.0.smithi087.stdout:6/275: dwrite d4/d8/df/d1e/d25/f4b [0,4194304] 0 2024-05-08T05:32:04.463 INFO:tasks.workunit.client.0.smithi087.stdout:2/276: dwrite d7/de/d27/d33/f30 [0,4194304] 0 2024-05-08T05:32:04.466 INFO:tasks.workunit.client.0.smithi087.stdout:2/277: creat d7/de/d55/f56 x:0 0 0 2024-05-08T05:32:04.470 INFO:tasks.workunit.client.0.smithi087.stdout:4/326: mknod d4/c7a 0 2024-05-08T05:32:04.472 INFO:tasks.workunit.client.0.smithi087.stdout:4/327: rename d4/d13/l1b to d4/d13/d3e/d28/d35/l7b 0 2024-05-08T05:32:04.478 INFO:tasks.workunit.client.0.smithi087.stdout:9/310: dread d1/f8 [0,4194304] 0 2024-05-08T05:32:04.479 INFO:tasks.workunit.client.0.smithi087.stdout:4/328: dread d4/d13/d3e/f27 [0,4194304] 0 2024-05-08T05:32:04.479 INFO:tasks.workunit.client.0.smithi087.stdout:9/311: mkdir d1/df/d14/d54 0 2024-05-08T05:32:04.480 INFO:tasks.workunit.client.0.smithi087.stdout:9/312: creat d1/df/d14/f55 x:0 0 0 2024-05-08T05:32:04.480 INFO:tasks.workunit.client.0.smithi087.stdout:9/313: stat d1/f8 0 2024-05-08T05:32:04.481 INFO:tasks.workunit.client.0.smithi087.stdout:9/314: unlink d1/db/d28/f3d 0 2024-05-08T05:32:04.482 INFO:tasks.workunit.client.0.smithi087.stdout:9/315: truncate d1/db/d28/f2e 2160075 0 2024-05-08T05:32:04.485 INFO:tasks.workunit.client.0.smithi087.stdout:9/316: read d1/df/d37/d3e/f31 [723829,70514] 0 2024-05-08T05:32:04.486 INFO:tasks.workunit.client.0.smithi087.stdout:9/317: symlink d1/df/d14/l56 0 2024-05-08T05:32:04.488 INFO:tasks.workunit.client.0.smithi087.stdout:9/318: mknod d1/c57 0 2024-05-08T05:32:04.488 INFO:tasks.workunit.client.0.smithi087.stdout:9/319: stat d1/df/d14/d54 0 2024-05-08T05:32:04.489 INFO:tasks.workunit.client.0.smithi087.stdout:9/320: mkdir d1/df/d58 0 2024-05-08T05:32:04.491 INFO:tasks.workunit.client.0.smithi087.stdout:9/321: symlink d1/df/l59 0 2024-05-08T05:32:04.492 INFO:tasks.workunit.client.0.smithi087.stdout:9/322: getdents d1/db/d28 0 2024-05-08T05:32:04.522 INFO:tasks.workunit.client.0.smithi087.stdout:6/276: dwrite d4/d8/df/d1e/d25/f3f [0,4194304] 0 2024-05-08T05:32:04.523 INFO:tasks.workunit.client.0.smithi087.stdout:6/277: stat d4/d8/c32 0 2024-05-08T05:32:04.523 INFO:tasks.workunit.client.0.smithi087.stdout:6/278: chown d4/d8/df/d1e/d52 5301717 1 2024-05-08T05:32:04.526 INFO:tasks.workunit.client.0.smithi087.stdout:2/278: dwrite d7/de/d27/f2e [4194304,4194304] 0 2024-05-08T05:32:04.526 INFO:tasks.workunit.client.0.smithi087.stdout:5/264: dwrite da/dd/d10/f40 [0,4194304] 0 2024-05-08T05:32:04.528 INFO:tasks.workunit.client.0.smithi087.stdout:2/279: symlink d7/de/l57 0 2024-05-08T05:32:04.529 INFO:tasks.workunit.client.0.smithi087.stdout:5/265: stat da/c35 0 2024-05-08T05:32:04.530 INFO:tasks.workunit.client.0.smithi087.stdout:2/280: getdents d7/de/d27/d33 0 2024-05-08T05:32:04.530 INFO:tasks.workunit.client.0.smithi087.stdout:2/281: write d7/de/d2c/f48 [971191,13570] 0 2024-05-08T05:32:04.530 INFO:tasks.workunit.client.0.smithi087.stdout:2/282: fsync d7/de/d27/f2e 0 2024-05-08T05:32:04.530 INFO:tasks.workunit.client.0.smithi087.stdout:2/283: stat d7/de/d27/f2e 0 2024-05-08T05:32:04.531 INFO:tasks.workunit.client.0.smithi087.stdout:5/266: creat da/dd/d13/d16/f54 x:0 0 0 2024-05-08T05:32:04.531 INFO:tasks.workunit.client.0.smithi087.stdout:5/267: dread - da/dd/d13/d16/f54 zero size 2024-05-08T05:32:04.531 INFO:tasks.workunit.client.0.smithi087.stdout:5/268: read - da/db/d2a/f31 zero size 2024-05-08T05:32:04.532 INFO:tasks.workunit.client.0.smithi087.stdout:5/269: chown da/f3c 57273 1 2024-05-08T05:32:04.532 INFO:tasks.workunit.client.0.smithi087.stdout:2/284: symlink d7/de/d27/d33/l58 0 2024-05-08T05:32:04.532 INFO:tasks.workunit.client.0.smithi087.stdout:5/270: getdents da/dd/d13 0 2024-05-08T05:32:04.540 INFO:tasks.workunit.client.0.smithi087.stdout:0/257: sync 2024-05-08T05:32:04.540 INFO:tasks.workunit.client.0.smithi087.stdout:1/240: sync 2024-05-08T05:32:04.540 INFO:tasks.workunit.client.0.smithi087.stdout:8/288: sync 2024-05-08T05:32:04.540 INFO:tasks.workunit.client.0.smithi087.stdout:1/241: chown df/d18/f47 0 1 2024-05-08T05:32:04.540 INFO:tasks.workunit.client.0.smithi087.stdout:8/289: dread - db/d23/d1b/d35/d43/f44 zero size 2024-05-08T05:32:04.540 INFO:tasks.workunit.client.0.smithi087.stdout:0/258: write d0/da/d11/f43 [755885,127871] 0 2024-05-08T05:32:04.540 INFO:tasks.workunit.client.0.smithi087.stdout:0/259: write d0/d57/f2a [4461108,29420] 0 2024-05-08T05:32:04.541 INFO:tasks.workunit.client.0.smithi087.stdout:0/260: creat d0/da/d35/f58 x:0 0 0 2024-05-08T05:32:04.541 INFO:tasks.workunit.client.0.smithi087.stdout:0/261: chown d0/da/d35/f58 288321141 1 2024-05-08T05:32:04.541 INFO:tasks.workunit.client.0.smithi087.stdout:0/262: truncate d0/d22/d3c/f44 759897 0 2024-05-08T05:32:04.543 INFO:tasks.workunit.client.0.smithi087.stdout:0/263: rename d0/da/d35/l4a to d0/d9/l59 0 2024-05-08T05:32:04.543 INFO:tasks.workunit.client.0.smithi087.stdout:0/264: chown d0/da/d35 33480373 1 2024-05-08T05:32:04.544 INFO:tasks.workunit.client.0.smithi087.stdout:0/265: mknod d0/c5a 0 2024-05-08T05:32:04.545 INFO:tasks.workunit.client.0.smithi087.stdout:0/266: mknod d0/d57/c5b 0 2024-05-08T05:32:04.546 INFO:tasks.workunit.client.0.smithi087.stdout:0/267: fsync d0/da/f16 0 2024-05-08T05:32:04.547 INFO:tasks.workunit.client.0.smithi087.stdout:0/268: creat d0/d57/d4f/d51/f5c x:0 0 0 2024-05-08T05:32:04.549 INFO:tasks.workunit.client.0.smithi087.stdout:8/290: read db/d23/f38 [2951762,121097] 0 2024-05-08T05:32:04.551 INFO:tasks.workunit.client.0.smithi087.stdout:8/291: symlink db/d23/d1b/d35/d43/l66 0 2024-05-08T05:32:04.553 INFO:tasks.workunit.client.0.smithi087.stdout:6/279: write d4/d8/f18 [8002776,72998] 0 2024-05-08T05:32:04.553 INFO:tasks.workunit.client.0.smithi087.stdout:6/280: chown d4/d8/df/d1e/d25/f4b 801 1 2024-05-08T05:32:04.553 INFO:tasks.workunit.client.0.smithi087.stdout:6/281: fsync d4/d8/df/d1e/f23 0 2024-05-08T05:32:04.553 INFO:tasks.workunit.client.0.smithi087.stdout:6/282: readlink d4/d8/l3a 0 2024-05-08T05:32:04.553 INFO:tasks.workunit.client.0.smithi087.stdout:6/283: truncate d4/d8/fb 2359078 0 2024-05-08T05:32:04.553 INFO:tasks.workunit.client.0.smithi087.stdout:9/323: dwrite d1/f13 [0,4194304] 0 2024-05-08T05:32:04.553 INFO:tasks.workunit.client.0.smithi087.stdout:8/292: write f5 [12837198,116445] 0 2024-05-08T05:32:04.554 INFO:tasks.workunit.client.0.smithi087.stdout:6/284: creat d4/d8/df/d1e/d25/d28/d2d/d37/f54 x:0 0 0 2024-05-08T05:32:04.554 INFO:tasks.workunit.client.0.smithi087.stdout:6/285: chown d4/d6/f3d 5 1 2024-05-08T05:32:04.554 INFO:tasks.workunit.client.0.smithi087.stdout:6/286: getdents d4/d8/df/d1e/d52 0 2024-05-08T05:32:04.557 INFO:tasks.workunit.client.0.smithi087.stdout:8/293: getdents db/d23/d15/d29/d33/d3b 0 2024-05-08T05:32:04.559 INFO:tasks.workunit.client.0.smithi087.stdout:8/294: rename db/ld to db/d23/d1b/l67 0 2024-05-08T05:32:04.561 INFO:tasks.workunit.client.0.smithi087.stdout:8/295: mkdir db/d23/d1b/d35/d43/d68 0 2024-05-08T05:32:04.561 INFO:tasks.workunit.client.0.smithi087.stdout:8/296: chown db/d23/d15 820 1 2024-05-08T05:32:04.561 INFO:tasks.workunit.client.0.smithi087.stdout:8/297: chown db/d23 0 1 2024-05-08T05:32:04.561 INFO:tasks.workunit.client.0.smithi087.stdout:8/298: chown db/d23/d1b/c2f 82487 1 2024-05-08T05:32:04.563 INFO:tasks.workunit.client.0.smithi087.stdout:1/242: write fa [3558537,44267] 0 2024-05-08T05:32:04.563 INFO:tasks.workunit.client.0.smithi087.stdout:8/299: rename fa to db/d23/d1b/d4b/f69 0 2024-05-08T05:32:04.564 INFO:tasks.workunit.client.0.smithi087.stdout:1/243: getdents df/d39 0 2024-05-08T05:32:04.565 INFO:tasks.workunit.client.0.smithi087.stdout:1/244: mknod df/d18/d1d/d27/c51 0 2024-05-08T05:32:04.566 INFO:tasks.workunit.client.0.smithi087.stdout:1/245: mkdir df/d2f/d4f/d52 0 2024-05-08T05:32:04.567 INFO:tasks.workunit.client.0.smithi087.stdout:1/246: symlink df/d18/d4b/l53 0 2024-05-08T05:32:04.569 INFO:tasks.workunit.client.0.smithi087.stdout:5/271: write da/f4b [350716,15988] 0 2024-05-08T05:32:04.587 INFO:tasks.workunit.client.0.smithi087.stdout:5/272: dread da/db/f25 [0,4194304] 0 2024-05-08T05:32:04.598 INFO:tasks.workunit.client.0.smithi087.stdout:1/247: write df/d18/d1d/f48 [2537213,116828] 0 2024-05-08T05:32:04.598 INFO:tasks.workunit.client.0.smithi087.stdout:0/269: dread d0/da/fe [0,4194304] 0 2024-05-08T05:32:04.599 INFO:tasks.workunit.client.0.smithi087.stdout:1/248: mknod df/d12/c54 0 2024-05-08T05:32:04.603 INFO:tasks.workunit.client.0.smithi087.stdout:0/270: creat d0/da/f5d x:0 0 0 2024-05-08T05:32:04.605 INFO:tasks.workunit.client.0.smithi087.stdout:5/273: write da/f48 [1696426,61541] 0 2024-05-08T05:32:04.606 INFO:tasks.workunit.client.0.smithi087.stdout:0/271: write d0/da/d11/f43 [470002,106008] 0 2024-05-08T05:32:04.608 INFO:tasks.workunit.client.0.smithi087.stdout:2/285: dwrite f6 [0,4194304] 0 2024-05-08T05:32:04.608 INFO:tasks.workunit.client.0.smithi087.stdout:5/274: symlink da/db/d2a/d46/l55 0 2024-05-08T05:32:04.608 INFO:tasks.workunit.client.0.smithi087.stdout:0/272: rmdir d0/da/d35 39 2024-05-08T05:32:04.612 INFO:tasks.workunit.client.0.smithi087.stdout:7/305: sync 2024-05-08T05:32:04.612 INFO:tasks.workunit.client.0.smithi087.stdout:3/296: sync 2024-05-08T05:32:04.617 INFO:tasks.workunit.client.0.smithi087.stdout:2/286: creat d7/f59 x:0 0 0 2024-05-08T05:32:04.617 INFO:tasks.workunit.client.0.smithi087.stdout:2/287: dread - d7/de/d2c/f31 zero size 2024-05-08T05:32:04.617 INFO:tasks.workunit.client.0.smithi087.stdout:2/288: chown d7/de/d55/f56 0 1 2024-05-08T05:32:04.618 INFO:tasks.workunit.client.0.smithi087.stdout:6/287: dwrite d4/d8/df/d1e/d25/f2f [0,4194304] 0 2024-05-08T05:32:04.618 INFO:tasks.workunit.client.0.smithi087.stdout:6/288: fsync d4/f12 0 2024-05-08T05:32:04.621 INFO:tasks.workunit.client.0.smithi087.stdout:2/289: creat d7/de/d27/d33/d49/f5a x:0 0 0 2024-05-08T05:32:04.621 INFO:tasks.workunit.client.0.smithi087.stdout:7/306: truncate d2/d6/d12/d15/f46 224470 0 2024-05-08T05:32:04.621 INFO:tasks.workunit.client.0.smithi087.stdout:7/307: readlink d2/d6/d12/d19/d2a/l53 0 2024-05-08T05:32:04.628 INFO:tasks.workunit.client.0.smithi087.stdout:7/308: mknod d2/d6/d12/d19/d2a/c5e 0 2024-05-08T05:32:04.629 INFO:tasks.workunit.client.0.smithi087.stdout:4/329: sync 2024-05-08T05:32:04.630 INFO:tasks.workunit.client.0.smithi087.stdout:4/330: creat d4/d13/d32/d66/f7c x:0 0 0 2024-05-08T05:32:04.633 INFO:tasks.workunit.client.0.smithi087.stdout:3/297: dread d4/d11/d3d/f56 [0,4194304] 0 2024-05-08T05:32:04.633 INFO:tasks.workunit.client.0.smithi087.stdout:3/298: dread - d4/f1d zero size 2024-05-08T05:32:04.656 INFO:tasks.workunit.client.0.smithi087.stdout:1/249: dwrite df/d2f/f3c [0,4194304] 0 2024-05-08T05:32:04.658 INFO:tasks.workunit.client.0.smithi087.stdout:2/290: write d7/de/f24 [3146692,102191] 0 2024-05-08T05:32:04.659 INFO:tasks.workunit.client.0.smithi087.stdout:1/250: stat l8 0 2024-05-08T05:32:04.674 INFO:tasks.workunit.client.0.smithi087.stdout:0/273: dwrite d0/d22/d3c/f44 [0,4194304] 0 2024-05-08T05:32:04.675 INFO:tasks.workunit.client.0.smithi087.stdout:0/274: read - d0/d9/df/f4d zero size 2024-05-08T05:32:04.675 INFO:tasks.workunit.client.0.smithi087.stdout:6/289: dwrite d4/f12 [0,4194304] 0 2024-05-08T05:32:04.675 INFO:tasks.workunit.client.0.smithi087.stdout:5/275: dwrite da/dd/d10/d36/d45/f4d [0,4194304] 0 2024-05-08T05:32:04.677 INFO:tasks.workunit.client.0.smithi087.stdout:0/275: mkdir d0/d9/d1b/d5e 0 2024-05-08T05:32:04.678 INFO:tasks.workunit.client.0.smithi087.stdout:5/276: truncate da/dd/d10/f40 1219297 0 2024-05-08T05:32:04.678 INFO:tasks.workunit.client.0.smithi087.stdout:5/277: chown da/db 659600294 1 2024-05-08T05:32:04.678 INFO:tasks.workunit.client.0.smithi087.stdout:5/278: fsync da/f4b 0 2024-05-08T05:32:04.678 INFO:tasks.workunit.client.0.smithi087.stdout:5/279: write da/dd/d10/d17/f28 [4745280,94869] 0 2024-05-08T05:32:04.679 INFO:tasks.workunit.client.0.smithi087.stdout:5/280: chown f2 1058641520 1 2024-05-08T05:32:04.679 INFO:tasks.workunit.client.0.smithi087.stdout:0/276: creat d0/da/f5f x:0 0 0 2024-05-08T05:32:04.679 INFO:tasks.workunit.client.0.smithi087.stdout:7/309: dwrite d2/da/f4c [0,4194304] 0 2024-05-08T05:32:04.680 INFO:tasks.workunit.client.0.smithi087.stdout:7/310: write d2/d6/d12/d15/f46 [808897,103039] 0 2024-05-08T05:32:04.680 INFO:tasks.workunit.client.0.smithi087.stdout:2/291: read f5 [4800909,48016] 0 2024-05-08T05:32:04.682 INFO:tasks.workunit.client.0.smithi087.stdout:5/281: mkdir da/dd/d56 0 2024-05-08T05:32:04.682 INFO:tasks.workunit.client.0.smithi087.stdout:5/282: fdatasync da/dd/d10/d42/d50/f52 0 2024-05-08T05:32:04.685 INFO:tasks.workunit.client.0.smithi087.stdout:0/277: rename d0/da/d11/c1f to d0/d22/d3c/c60 0 2024-05-08T05:32:04.687 INFO:tasks.workunit.client.0.smithi087.stdout:2/292: creat d7/f5b x:0 0 0 2024-05-08T05:32:04.689 INFO:tasks.workunit.client.0.smithi087.stdout:7/311: rename d2/d6/d12/d1d/d48 to d2/d6/d12/d19/d5f 0 2024-05-08T05:32:04.693 INFO:tasks.workunit.client.0.smithi087.stdout:7/312: truncate d2/d6/d12/d19/f2d 623969 0 2024-05-08T05:32:04.694 INFO:tasks.workunit.client.0.smithi087.stdout:7/313: read d2/d6/d12/d19/f1e [298797,127711] 0 2024-05-08T05:32:04.694 INFO:tasks.workunit.client.0.smithi087.stdout:8/300: sync 2024-05-08T05:32:04.694 INFO:tasks.workunit.client.0.smithi087.stdout:5/283: rename da/dd/d10/d41 to da/dd/d13/d57 0 2024-05-08T05:32:04.694 INFO:tasks.workunit.client.0.smithi087.stdout:9/324: sync 2024-05-08T05:32:04.694 INFO:tasks.workunit.client.0.smithi087.stdout:9/325: write d1/f30 [1595382,33590] 0 2024-05-08T05:32:04.694 INFO:tasks.workunit.client.0.smithi087.stdout:6/290: dread d4/d8/df/d1e/d25/f3f [0,4194304] 0 2024-05-08T05:32:04.694 INFO:tasks.workunit.client.0.smithi087.stdout:5/284: symlink da/dd/d13/d16/l58 0 2024-05-08T05:32:04.697 INFO:tasks.workunit.client.0.smithi087.stdout:0/278: rename d0/da/f3a to d0/d22/f61 0 2024-05-08T05:32:04.697 INFO:tasks.workunit.client.0.smithi087.stdout:0/279: read - d0/d9/d1b/f3e zero size 2024-05-08T05:32:04.699 INFO:tasks.workunit.client.0.smithi087.stdout:5/285: creat da/dd/f59 x:0 0 0 2024-05-08T05:32:04.700 INFO:tasks.workunit.client.0.smithi087.stdout:4/331: dwrite d4/d13/d32/f45 [0,4194304] 0 2024-05-08T05:32:04.701 INFO:tasks.workunit.client.0.smithi087.stdout:8/301: rename db/d23/d15/d29/d33/d4a to db/d23/d1b/d35/d43/d68/d6a 0 2024-05-08T05:32:04.701 INFO:tasks.workunit.client.0.smithi087.stdout:8/302: dread - db/d23/d1b/d35/d43/f44 zero size 2024-05-08T05:32:04.704 INFO:tasks.workunit.client.0.smithi087.stdout:0/280: rename d0/d9/df/f4d to d0/d57/d4f/d51/f62 0 2024-05-08T05:32:04.705 INFO:tasks.workunit.client.0.smithi087.stdout:4/332: link d4/lf d4/d13/d32/d66/l7d 0 2024-05-08T05:32:04.705 INFO:tasks.workunit.client.0.smithi087.stdout:4/333: chown d4/d13/d32/d66 132280119 1 2024-05-08T05:32:04.706 INFO:tasks.workunit.client.0.smithi087.stdout:0/281: symlink d0/d57/d4f/l63 0 2024-05-08T05:32:04.707 INFO:tasks.workunit.client.0.smithi087.stdout:2/293: dread f3 [0,4194304] 0 2024-05-08T05:32:04.707 INFO:tasks.workunit.client.0.smithi087.stdout:4/334: readlink d4/l1d 0 2024-05-08T05:32:04.708 INFO:tasks.workunit.client.0.smithi087.stdout:1/251: dwrite df/d2f/f35 [4194304,4194304] 0 2024-05-08T05:32:04.708 INFO:tasks.workunit.client.0.smithi087.stdout:0/282: mknod d0/d9/df/c64 0 2024-05-08T05:32:04.708 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:32:04 smithi087 ceph-mon[29523]: pgmap v512: 97 pgs: 97 active+clean; 253 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 19 MiB/s rd, 26 MiB/s wr, 766 op/s 2024-05-08T05:32:04.709 INFO:tasks.workunit.client.0.smithi087.stdout:2/294: creat d7/de/d27/f5c x:0 0 0 2024-05-08T05:32:04.710 INFO:tasks.workunit.client.0.smithi087.stdout:6/291: dread d4/d8/fb [0,4194304] 0 2024-05-08T05:32:04.711 INFO:tasks.workunit.client.0.smithi087.stdout:4/335: mknod d4/d13/d65/c7e 0 2024-05-08T05:32:04.715 INFO:tasks.workunit.client.0.smithi087.stdout:6/292: mkdir d4/d8/d55 0 2024-05-08T05:32:04.715 INFO:tasks.workunit.client.0.smithi087.stdout:6/293: chown d4/d6/f3d 408087338 1 2024-05-08T05:32:04.721 INFO:tasks.workunit.client.0.smithi087.stdout:5/286: dread da/f4b [0,4194304] 0 2024-05-08T05:32:04.727 INFO:tasks.workunit.client.0.smithi087.stdout:9/326: dwrite d1/f21 [4194304,4194304] 0 2024-05-08T05:32:04.727 INFO:tasks.workunit.client.0.smithi087.stdout:1/252: rmdir df 39 2024-05-08T05:32:04.728 INFO:tasks.workunit.client.0.smithi087.stdout:1/253: chown l8 28 1 2024-05-08T05:32:04.728 INFO:tasks.workunit.client.0.smithi087.stdout:0/283: mknod d0/d9/c65 0 2024-05-08T05:32:04.728 INFO:tasks.workunit.client.0.smithi087.stdout:4/336: creat d4/f7f x:0 0 0 2024-05-08T05:32:04.728 INFO:tasks.workunit.client.0.smithi087.stdout:1/254: write df/d2f/f35 [3587330,93167] 0 2024-05-08T05:32:04.728 INFO:tasks.workunit.client.0.smithi087.stdout:6/294: creat d4/d8/df/d1e/d25/d28/d2d/d37/d45/f56 x:0 0 0 2024-05-08T05:32:04.728 INFO:tasks.workunit.client.0.smithi087.stdout:1/255: getdents df/d39 0 2024-05-08T05:32:04.728 INFO:tasks.workunit.client.0.smithi087.stdout:6/295: chown d4/d8/df/d1e/l2c 21 1 2024-05-08T05:32:04.728 INFO:tasks.workunit.client.0.smithi087.stdout:1/256: chown df/f3e 12 1 2024-05-08T05:32:04.728 INFO:tasks.workunit.client.0.smithi087.stdout:1/257: fsync df/d18/f30 0 2024-05-08T05:32:04.728 INFO:tasks.workunit.client.0.smithi087.stdout:4/337: write d4/d13/d3e/d28/d35/f43 [606911,87781] 0 2024-05-08T05:32:04.728 INFO:tasks.workunit.client.0.smithi087.stdout:6/296: write d4/d8/df/d1e/f43 [2146463,101818] 0 2024-05-08T05:32:04.728 INFO:tasks.workunit.client.0.smithi087.stdout:1/258: write df/d18/f47 [556471,25146] 0 2024-05-08T05:32:04.730 INFO:tasks.workunit.client.0.smithi087.stdout:5/287: rename da/dd/d13/d57 to da/db/d2a/d5a 0 2024-05-08T05:32:04.730 INFO:tasks.workunit.client.0.smithi087.stdout:5/288: chown da/dd/d10/d17/c51 28392 1 2024-05-08T05:32:04.730 INFO:tasks.workunit.client.0.smithi087.stdout:5/289: fdatasync da/f30 0 2024-05-08T05:32:04.731 INFO:tasks.workunit.client.0.smithi087.stdout:0/284: rmdir d0/d9/d1b/d2f 39 2024-05-08T05:32:04.731 INFO:tasks.workunit.client.0.smithi087.stdout:0/285: dread - d0/da/f5f zero size 2024-05-08T05:32:04.733 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:32:04 smithi090 ceph-mon[34526]: pgmap v512: 97 pgs: 97 active+clean; 253 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 19 MiB/s rd, 26 MiB/s wr, 766 op/s 2024-05-08T05:32:04.734 INFO:tasks.workunit.client.0.smithi087.stdout:1/259: creat df/d2f/d4f/f55 x:0 0 0 2024-05-08T05:32:04.735 INFO:tasks.workunit.client.0.smithi087.stdout:9/327: read d1/db/d28/f2e [1816818,112323] 0 2024-05-08T05:32:04.735 INFO:tasks.workunit.client.0.smithi087.stdout:9/328: write d1/db/f1b [5097067,57246] 0 2024-05-08T05:32:04.735 INFO:tasks.workunit.client.0.smithi087.stdout:9/329: chown d1/df/d14/d18/f34 5358 1 2024-05-08T05:32:04.735 INFO:tasks.workunit.client.0.smithi087.stdout:9/330: fdatasync d1/db/d28/f48 0 2024-05-08T05:32:04.739 INFO:tasks.workunit.client.0.smithi087.stdout:5/290: unlink f9 0 2024-05-08T05:32:04.739 INFO:tasks.workunit.client.0.smithi087.stdout:1/260: rename df/d12/c15 to df/d12/c56 0 2024-05-08T05:32:04.741 INFO:tasks.workunit.client.0.smithi087.stdout:4/338: rename d4/l5 to d4/d13/d3e/l80 0 2024-05-08T05:32:04.741 INFO:tasks.workunit.client.0.smithi087.stdout:3/299: sync 2024-05-08T05:32:04.743 INFO:tasks.workunit.client.0.smithi087.stdout:7/314: dwrite d2/d6/d12/d19/f2d [0,4194304] 0 2024-05-08T05:32:04.743 INFO:tasks.workunit.client.0.smithi087.stdout:7/315: chown d2/d6/d12/d15/f5c 141270594 1 2024-05-08T05:32:04.746 INFO:tasks.workunit.client.0.smithi087.stdout:9/331: mknod d1/df/d14/d54/c5a 0 2024-05-08T05:32:04.746 INFO:tasks.workunit.client.0.smithi087.stdout:5/291: unlink da/dd/d13/d16/l21 0 2024-05-08T05:32:04.747 INFO:tasks.workunit.client.0.smithi087.stdout:3/300: creat d4/d11/d24/f69 x:0 0 0 2024-05-08T05:32:04.748 INFO:tasks.workunit.client.0.smithi087.stdout:3/301: chown d4/d11/d3d/f5b 3 1 2024-05-08T05:32:04.750 INFO:tasks.workunit.client.0.smithi087.stdout:5/292: creat da/db/d2a/d5a/f5b x:0 0 0 2024-05-08T05:32:04.751 INFO:tasks.workunit.client.0.smithi087.stdout:9/332: mkdir d1/df/d37/d5b 0 2024-05-08T05:32:04.753 INFO:tasks.workunit.client.0.smithi087.stdout:3/302: mkdir d4/d11/d3d/d4e/d6a 0 2024-05-08T05:32:04.753 INFO:tasks.workunit.client.0.smithi087.stdout:3/303: stat d4/f1d 0 2024-05-08T05:32:04.754 INFO:tasks.workunit.client.0.smithi087.stdout:5/293: mkdir da/dd/d10/d36/d45/d5c 0 2024-05-08T05:32:04.756 INFO:tasks.workunit.client.0.smithi087.stdout:9/333: link d1/df/d14/f17 d1/df/d14/d18/f5c 0 2024-05-08T05:32:04.760 INFO:tasks.workunit.client.0.smithi087.stdout:3/304: creat d4/d11/d24/d39/d5a/f6b x:0 0 0 2024-05-08T05:32:04.760 INFO:tasks.workunit.client.0.smithi087.stdout:3/305: chown d4 21 1 2024-05-08T05:32:04.760 INFO:tasks.workunit.client.0.smithi087.stdout:4/339: dread d4/f10 [0,4194304] 0 2024-05-08T05:32:04.765 INFO:tasks.workunit.client.0.smithi087.stdout:9/334: link d1/df/d14/d18/f23 d1/db/f5d 0 2024-05-08T05:32:04.768 INFO:tasks.workunit.client.0.smithi087.stdout:1/261: rename df/d39 to df/d2f/d57 0 2024-05-08T05:32:04.768 INFO:tasks.workunit.client.0.smithi087.stdout:1/262: fsync df/f3b 0 2024-05-08T05:32:04.768 INFO:tasks.workunit.client.0.smithi087.stdout:1/263: fdatasync df/d18/f30 0 2024-05-08T05:32:04.769 INFO:tasks.workunit.client.0.smithi087.stdout:9/335: mkdir d1/df/d58/d5e 0 2024-05-08T05:32:04.771 INFO:tasks.workunit.client.0.smithi087.stdout:1/264: mkdir df/d18/d1d/d58 0 2024-05-08T05:32:04.772 INFO:tasks.workunit.client.0.smithi087.stdout:1/265: symlink df/d18/d4b/l59 0 2024-05-08T05:32:04.772 INFO:tasks.workunit.client.0.smithi087.stdout:1/266: truncate df/f3e 4816941 0 2024-05-08T05:32:04.772 INFO:tasks.workunit.client.0.smithi087.stdout:1/267: dread - df/f3b zero size 2024-05-08T05:32:04.776 INFO:tasks.workunit.client.0.smithi087.stdout:1/268: creat df/d2f/d4f/f5a x:0 0 0 2024-05-08T05:32:04.777 INFO:tasks.workunit.client.0.smithi087.stdout:2/295: dwrite d7/de/d2c/f4c [0,4194304] 0 2024-05-08T05:32:04.777 INFO:tasks.workunit.client.0.smithi087.stdout:1/269: symlink df/d18/d1d/l5b 0 2024-05-08T05:32:04.778 INFO:tasks.workunit.client.0.smithi087.stdout:3/306: read d4/d11/d24/f26 [29374,89423] 0 2024-05-08T05:32:04.779 INFO:tasks.workunit.client.0.smithi087.stdout:2/296: mkdir d7/de/d5d 0 2024-05-08T05:32:04.779 INFO:tasks.workunit.client.0.smithi087.stdout:2/297: chown d7/fd 178867 1 2024-05-08T05:32:04.780 INFO:tasks.workunit.client.0.smithi087.stdout:1/270: creat df/f5c x:0 0 0 2024-05-08T05:32:04.781 INFO:tasks.workunit.client.0.smithi087.stdout:1/271: creat df/d2f/d57/f5d x:0 0 0 2024-05-08T05:32:04.782 INFO:tasks.workunit.client.0.smithi087.stdout:1/272: mknod df/d18/d1d/d27/c5e 0 2024-05-08T05:32:04.783 INFO:tasks.workunit.client.0.smithi087.stdout:1/273: fsync df/d18/d1d/f2d 0 2024-05-08T05:32:04.783 INFO:tasks.workunit.client.0.smithi087.stdout:6/297: dwrite d4/d8/f2e [4194304,4194304] 0 2024-05-08T05:32:04.784 INFO:tasks.workunit.client.0.smithi087.stdout:1/274: creat df/d2f/d41/f5f x:0 0 0 2024-05-08T05:32:04.785 INFO:tasks.workunit.client.0.smithi087.stdout:6/298: rename d4/d8/d55 to d4/d8/df/d1e/d25/d28/d57 0 2024-05-08T05:32:04.786 INFO:tasks.workunit.client.0.smithi087.stdout:7/316: dwrite d2/d6/d12/f47 [0,4194304] 0 2024-05-08T05:32:04.786 INFO:tasks.workunit.client.0.smithi087.stdout:7/317: stat d2/da/d3f/f30 0 2024-05-08T05:32:04.787 INFO:tasks.workunit.client.0.smithi087.stdout:6/299: creat d4/f58 x:0 0 0 2024-05-08T05:32:04.788 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:32:04 smithi160 ceph-mon[34827]: pgmap v512: 97 pgs: 97 active+clean; 253 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 19 MiB/s rd, 26 MiB/s wr, 766 op/s 2024-05-08T05:32:04.789 INFO:tasks.workunit.client.0.smithi087.stdout:7/318: creat d2/d6/d12/d19/d2a/f60 x:0 0 0 2024-05-08T05:32:04.791 INFO:tasks.workunit.client.0.smithi087.stdout:0/286: dwrite d0/d9/f48 [0,4194304] 0 2024-05-08T05:32:04.792 INFO:tasks.workunit.client.0.smithi087.stdout:6/300: rename d4/d6/fa to d4/d8/df/d1e/d25/f59 0 2024-05-08T05:32:04.792 INFO:tasks.workunit.client.0.smithi087.stdout:6/301: fsync d4/f38 0 2024-05-08T05:32:04.799 INFO:tasks.workunit.client.0.smithi087.stdout:0/287: mkdir d0/d57/d24/d66 0 2024-05-08T05:32:04.801 INFO:tasks.workunit.client.0.smithi087.stdout:3/307: dread d4/d11/f38 [0,4194304] 0 2024-05-08T05:32:04.802 INFO:tasks.workunit.client.0.smithi087.stdout:7/319: rename d2/d6/d12/d1d/f2e to d2/da/d3f/d4f/f61 0 2024-05-08T05:32:04.804 INFO:tasks.workunit.client.0.smithi087.stdout:6/302: symlink d4/d8/df/d1e/d52/l5a 0 2024-05-08T05:32:04.804 INFO:tasks.workunit.client.0.smithi087.stdout:6/303: chown d4/d8/df/d1e/d25/d28 326 1 2024-05-08T05:32:04.804 INFO:tasks.workunit.client.0.smithi087.stdout:6/304: chown d4/d8/df/d1e/c30 1 1 2024-05-08T05:32:04.805 INFO:tasks.workunit.client.0.smithi087.stdout:0/288: creat d0/d9/f67 x:0 0 0 2024-05-08T05:32:04.805 INFO:tasks.workunit.client.0.smithi087.stdout:0/289: readlink d0/l41 0 2024-05-08T05:32:04.807 INFO:tasks.workunit.client.0.smithi087.stdout:3/308: creat d4/d11/d3d/d48/f6c x:0 0 0 2024-05-08T05:32:04.808 INFO:tasks.workunit.client.0.smithi087.stdout:7/320: creat d2/da/d3f/d49/d59/f62 x:0 0 0 2024-05-08T05:32:04.812 INFO:tasks.workunit.client.0.smithi087.stdout:3/309: creat d4/d11/d24/d25/d3e/d58/f6d x:0 0 0 2024-05-08T05:32:04.814 INFO:tasks.workunit.client.0.smithi087.stdout:7/321: creat d2/d6/d12/d15/d5b/f63 x:0 0 0 2024-05-08T05:32:04.816 INFO:tasks.workunit.client.0.smithi087.stdout:7/322: mknod d2/da/d3f/d49/d59/c64 0 2024-05-08T05:32:04.817 INFO:tasks.workunit.client.0.smithi087.stdout:5/294: dwrite f7 [0,4194304] 0 2024-05-08T05:32:04.818 INFO:tasks.workunit.client.0.smithi087.stdout:6/305: dread d4/d8/df/d1e/d25/f3f [0,4194304] 0 2024-05-08T05:32:04.819 INFO:tasks.workunit.client.0.smithi087.stdout:7/323: mkdir d2/d6/d12/d19/d34/d54/d55/d65 0 2024-05-08T05:32:04.819 INFO:tasks.workunit.client.0.smithi087.stdout:7/324: dread - d2/d6/d12/d19/d34/f45 zero size 2024-05-08T05:32:04.827 INFO:tasks.workunit.client.0.smithi087.stdout:6/306: mkdir d4/d8/df/d1e/d25/d28/d2d/d37/d5b 0 2024-05-08T05:32:04.827 INFO:tasks.workunit.client.0.smithi087.stdout:6/307: read d4/d8/df/d1e/f43 [1964434,6767] 0 2024-05-08T05:32:04.828 INFO:tasks.workunit.client.0.smithi087.stdout:2/298: dwrite d7/de/f24 [0,4194304] 0 2024-05-08T05:32:04.830 INFO:tasks.workunit.client.0.smithi087.stdout:4/340: dwrite d4/d13/d3e/f38 [4194304,4194304] 0 2024-05-08T05:32:04.831 INFO:tasks.workunit.client.0.smithi087.stdout:7/325: mkdir d2/da/d3f/d66 0 2024-05-08T05:32:04.832 INFO:tasks.workunit.client.0.smithi087.stdout:2/299: getdents d7/de/d2c 0 2024-05-08T05:32:04.835 INFO:tasks.workunit.client.0.smithi087.stdout:9/336: dwrite d1/db/fc [0,4194304] 0 2024-05-08T05:32:04.838 INFO:tasks.workunit.client.0.smithi087.stdout:1/275: dwrite df/f3d [0,4194304] 0 2024-05-08T05:32:04.838 INFO:tasks.workunit.client.0.smithi087.stdout:7/326: rmdir d2/da/d3f/d49/d59 39 2024-05-08T05:32:04.838 INFO:tasks.workunit.client.0.smithi087.stdout:2/300: mknod d7/de/d2c/d43/c5e 0 2024-05-08T05:32:04.838 INFO:tasks.workunit.client.0.smithi087.stdout:2/301: chown d7/de/d27/f5c 3037230 1 2024-05-08T05:32:04.841 INFO:tasks.workunit.client.0.smithi087.stdout:1/276: mknod df/d18/d1d/c60 0 2024-05-08T05:32:04.841 INFO:tasks.workunit.client.0.smithi087.stdout:1/277: write df/d18/f28 [380618,93070] 0 2024-05-08T05:32:04.841 INFO:tasks.workunit.client.0.smithi087.stdout:1/278: readlink df/d2f/d57/l44 0 2024-05-08T05:32:04.841 INFO:tasks.workunit.client.0.smithi087.stdout:1/279: getdents df/d2f/d4f/d52 0 2024-05-08T05:32:04.841 INFO:tasks.workunit.client.0.smithi087.stdout:1/280: truncate df/d2f/d57/f5d 34988 0 2024-05-08T05:32:04.842 INFO:tasks.workunit.client.0.smithi087.stdout:9/337: dread d1/db/d28/f48 [0,4194304] 0 2024-05-08T05:32:04.845 INFO:tasks.workunit.client.0.smithi087.stdout:2/302: mknod d7/de/d5d/c5f 0 2024-05-08T05:32:04.845 INFO:tasks.workunit.client.0.smithi087.stdout:2/303: dread - d7/de/d55/f56 zero size 2024-05-08T05:32:04.845 INFO:tasks.workunit.client.0.smithi087.stdout:2/304: readlink d7/de/d2c/l45 0 2024-05-08T05:32:04.850 INFO:tasks.workunit.client.0.smithi087.stdout:1/281: mkdir df/d18/d1d/d27/d61 0 2024-05-08T05:32:04.850 INFO:tasks.workunit.client.0.smithi087.stdout:9/338: mknod d1/db/c5f 0 2024-05-08T05:32:04.850 INFO:tasks.workunit.client.0.smithi087.stdout:9/339: read d1/db/f1b [2564491,107839] 0 2024-05-08T05:32:04.850 INFO:tasks.workunit.client.0.smithi087.stdout:9/340: mknod d1/df/d37/d3e/c60 0 2024-05-08T05:32:04.850 INFO:tasks.workunit.client.0.smithi087.stdout:9/341: readlink d1/db/le 0 2024-05-08T05:32:04.850 INFO:tasks.workunit.client.0.smithi087.stdout:9/342: chown d1/db/l41 5887559 1 2024-05-08T05:32:04.850 INFO:tasks.workunit.client.0.smithi087.stdout:9/343: truncate d1/df/d14/d18/f23 463299 0 2024-05-08T05:32:04.851 INFO:tasks.workunit.client.0.smithi087.stdout:9/344: write d1/f8 [3169939,36299] 0 2024-05-08T05:32:04.851 INFO:tasks.workunit.client.0.smithi087.stdout:8/303: sync 2024-05-08T05:32:04.852 INFO:tasks.workunit.client.0.smithi087.stdout:8/304: link db/d23/d1b/f30 db/d23/d15/d29/d33/d3b/f6b 0 2024-05-08T05:32:04.852 INFO:tasks.workunit.client.0.smithi087.stdout:9/345: rmdir d1/df/d37/d3e 39 2024-05-08T05:32:04.853 INFO:tasks.workunit.client.0.smithi087.stdout:9/346: chown d1/db/d28/f2e 504714617 1 2024-05-08T05:32:04.853 INFO:tasks.workunit.client.0.smithi087.stdout:8/305: mkdir db/d23/d15/d29/d33/d6c 0 2024-05-08T05:32:04.854 INFO:tasks.workunit.client.0.smithi087.stdout:6/308: dread d4/d6/f1b [0,4194304] 0 2024-05-08T05:32:04.854 INFO:tasks.workunit.client.0.smithi087.stdout:8/306: creat db/d23/d15/d29/d33/d6c/f6d x:0 0 0 2024-05-08T05:32:04.855 INFO:tasks.workunit.client.0.smithi087.stdout:2/305: read d7/f1e [15918,127897] 0 2024-05-08T05:32:04.856 INFO:tasks.workunit.client.0.smithi087.stdout:0/290: dwrite d0/d57/d4f/f53 [0,4194304] 0 2024-05-08T05:32:04.856 INFO:tasks.workunit.client.0.smithi087.stdout:6/309: rename d4/d8/df/d1e/d25/d28/d2d/d37/d45/f56 to d4/d8/df/d1e/d25/d28/d2d/d37/d45/f5c 0 2024-05-08T05:32:04.861 INFO:tasks.workunit.client.0.smithi087.stdout:0/291: unlink d0/d22/d3c/c60 0 2024-05-08T05:32:04.862 INFO:tasks.workunit.client.0.smithi087.stdout:6/310: creat d4/d8/df/d1e/d25/d28/d2d/d37/d5b/f5d x:0 0 0 2024-05-08T05:32:04.866 INFO:tasks.workunit.client.0.smithi087.stdout:5/295: dwrite da/dd/d10/d36/f39 [0,4194304] 0 2024-05-08T05:32:04.866 INFO:tasks.workunit.client.0.smithi087.stdout:5/296: write da/dd/d13/d16/f54 [761778,12113] 0 2024-05-08T05:32:04.868 INFO:tasks.workunit.client.0.smithi087.stdout:5/297: mknod da/dd/d10/d36/d45/c5d 0 2024-05-08T05:32:04.871 INFO:tasks.workunit.client.0.smithi087.stdout:5/298: mknod da/dd/d13/c5e 0 2024-05-08T05:32:04.872 INFO:tasks.workunit.client.0.smithi087.stdout:5/299: chown da/dd/d10/d17/f2b 665 1 2024-05-08T05:32:04.873 INFO:tasks.workunit.client.0.smithi087.stdout:3/310: dwrite d4/d14/f28 [0,4194304] 0 2024-05-08T05:32:04.873 INFO:tasks.workunit.client.0.smithi087.stdout:8/307: dread db/d23/d1b/d35/d43/d68/d6a/f5b [4194304,4194304] 0 2024-05-08T05:32:04.875 INFO:tasks.workunit.client.0.smithi087.stdout:5/300: creat da/dd/d10/d36/f5f x:0 0 0 2024-05-08T05:32:04.878 INFO:tasks.workunit.client.0.smithi087.stdout:3/311: rmdir d4/d11/d24/d25/d3e/d3f 39 2024-05-08T05:32:04.878 INFO:tasks.workunit.client.0.smithi087.stdout:3/312: truncate d4/f5 2587956 0 2024-05-08T05:32:04.878 INFO:tasks.workunit.client.0.smithi087.stdout:3/313: stat d4/d11/d3d/d64 0 2024-05-08T05:32:04.878 INFO:tasks.workunit.client.0.smithi087.stdout:3/314: chown d4/d11/d3d/f5b 0 1 2024-05-08T05:32:04.878 INFO:tasks.workunit.client.0.smithi087.stdout:0/292: write d0/da/f1e [4138695,122913] 0 2024-05-08T05:32:04.879 INFO:tasks.workunit.client.0.smithi087.stdout:0/293: readlink d0/d22/l36 0 2024-05-08T05:32:04.879 INFO:tasks.workunit.client.0.smithi087.stdout:0/294: stat d0/d9/d1b/d2f 0 2024-05-08T05:32:04.879 INFO:tasks.workunit.client.0.smithi087.stdout:4/341: dwrite d4/d6c/f70 [4194304,4194304] 0 2024-05-08T05:32:04.879 INFO:tasks.workunit.client.0.smithi087.stdout:8/308: creat db/d23/d3a/d65/f6e x:0 0 0 2024-05-08T05:32:04.879 INFO:tasks.workunit.client.0.smithi087.stdout:5/301: creat da/dd/d10/f60 x:0 0 0 2024-05-08T05:32:04.879 INFO:tasks.workunit.client.0.smithi087.stdout:9/347: rename d1/df/d37/d3e to d1/df/d14/d54/d61 0 2024-05-08T05:32:04.880 INFO:tasks.workunit.client.0.smithi087.stdout:3/315: mknod d4/d11/d24/d39/d5a/c6e 0 2024-05-08T05:32:04.881 INFO:tasks.workunit.client.0.smithi087.stdout:0/295: mkdir d0/d68 0 2024-05-08T05:32:04.881 INFO:tasks.workunit.client.0.smithi087.stdout:4/342: truncate d4/f40 1379440 0 2024-05-08T05:32:04.882 INFO:tasks.workunit.client.0.smithi087.stdout:8/309: mkdir db/d23/d1b/d35/d43/d68/d6f 0 2024-05-08T05:32:04.883 INFO:tasks.workunit.client.0.smithi087.stdout:5/302: truncate da/dd/d10/f40 1181979 0 2024-05-08T05:32:04.884 INFO:tasks.workunit.client.0.smithi087.stdout:6/311: rename d4/d8/f2e to d4/f5e 0 2024-05-08T05:32:04.884 INFO:tasks.workunit.client.0.smithi087.stdout:6/312: fsync f1 0 2024-05-08T05:32:04.884 INFO:tasks.workunit.client.0.smithi087.stdout:5/303: rename da to da/dd/d10/d42/d50/d61 22 2024-05-08T05:32:04.885 INFO:tasks.workunit.client.0.smithi087.stdout:3/316: getdents d4/d11/d24/d25/d3e 0 2024-05-08T05:32:04.886 INFO:tasks.workunit.client.0.smithi087.stdout:0/296: symlink d0/d57/d4f/d51/l69 0 2024-05-08T05:32:04.888 INFO:tasks.workunit.client.0.smithi087.stdout:4/343: link d4/d13/d3e/d28/d35/d56/l71 d4/d6c/l81 0 2024-05-08T05:32:04.891 INFO:tasks.workunit.client.0.smithi087.stdout:6/313: unlink d4/d8/df/d39/d42/c47 0 2024-05-08T05:32:04.892 INFO:tasks.workunit.client.0.smithi087.stdout:9/348: write d1/df/d14/d18/f1e [3109560,13601] 0 2024-05-08T05:32:04.892 INFO:tasks.workunit.client.0.smithi087.stdout:9/349: write d1/db/d28/f42 [974468,76147] 0 2024-05-08T05:32:04.892 INFO:tasks.workunit.client.0.smithi087.stdout:5/304: creat da/db/d2a/d5a/f62 x:0 0 0 2024-05-08T05:32:04.895 INFO:tasks.workunit.client.0.smithi087.stdout:3/317: creat d4/d11/d24/d25/d3e/d3f/f6f x:0 0 0 2024-05-08T05:32:04.896 INFO:tasks.workunit.client.0.smithi087.stdout:3/318: write d4/d11/d3d/f5b [735089,35765] 0 2024-05-08T05:32:04.896 INFO:tasks.workunit.client.0.smithi087.stdout:3/319: chown d4/d11/d3d/f5b 189036250 1 2024-05-08T05:32:04.897 INFO:tasks.workunit.client.0.smithi087.stdout:8/310: dread db/d23/d1b/d35/d43/d68/d6a/f5b [0,4194304] 0 2024-05-08T05:32:04.897 INFO:tasks.workunit.client.0.smithi087.stdout:0/297: chown d0/d9/f13 182633 1 2024-05-08T05:32:04.897 INFO:tasks.workunit.client.0.smithi087.stdout:0/298: dread - d0/d57/d4f/d51/f62 zero size 2024-05-08T05:32:04.898 INFO:tasks.workunit.client.0.smithi087.stdout:6/314: creat d4/d8/df/d1e/d25/d28/d2d/d37/d5b/f5f x:0 0 0 2024-05-08T05:32:04.903 INFO:tasks.workunit.client.0.smithi087.stdout:9/350: unlink d1/df/d14/d54/d61/f40 0 2024-05-08T05:32:04.903 INFO:tasks.workunit.client.0.smithi087.stdout:9/351: stat d1/df/d14/d18/f34 0 2024-05-08T05:32:04.904 INFO:tasks.workunit.client.0.smithi087.stdout:7/327: dwrite d2/d6/d12/d19/d34/f45 [0,4194304] 0 2024-05-08T05:32:04.904 INFO:tasks.workunit.client.0.smithi087.stdout:5/305: truncate da/db/d2a/f32 4858357 0 2024-05-08T05:32:04.904 INFO:tasks.workunit.client.0.smithi087.stdout:3/320: mknod d4/d11/d24/c70 0 2024-05-08T05:32:04.905 INFO:tasks.workunit.client.0.smithi087.stdout:8/311: symlink db/d23/d1b/d35/d43/d68/d6a/l70 0 2024-05-08T05:32:04.907 INFO:tasks.workunit.client.0.smithi087.stdout:7/328: mkdir d2/da/d3f/d4f/d67 0 2024-05-08T05:32:04.908 INFO:tasks.workunit.client.0.smithi087.stdout:7/329: write d2/da/d3f/f30 [147962,65454] 0 2024-05-08T05:32:04.913 INFO:tasks.workunit.client.0.smithi087.stdout:5/306: mknod da/db/d2a/c63 0 2024-05-08T05:32:04.913 INFO:tasks.workunit.client.0.smithi087.stdout:3/321: creat d4/f71 x:0 0 0 2024-05-08T05:32:04.913 INFO:tasks.workunit.client.0.smithi087.stdout:3/322: truncate d4/d11/d24/d25/d3e/d58/f6d 556309 0 2024-05-08T05:32:04.915 INFO:tasks.workunit.client.0.smithi087.stdout:3/323: read d4/d11/d24/d25/f54 [74496,50239] 0 2024-05-08T05:32:04.915 INFO:tasks.workunit.client.0.smithi087.stdout:3/324: read - d4/d11/d24/d25/d3e/f65 zero size 2024-05-08T05:32:04.915 INFO:tasks.workunit.client.0.smithi087.stdout:3/325: readlink d4/l3a 0 2024-05-08T05:32:04.918 INFO:tasks.workunit.client.0.smithi087.stdout:7/330: dread d2/d6/d12/d19/d34/d54/d50/f56 [0,4194304] 0 2024-05-08T05:32:04.919 INFO:tasks.workunit.client.0.smithi087.stdout:8/312: creat db/d23/d15/f71 x:0 0 0 2024-05-08T05:32:04.921 INFO:tasks.workunit.client.0.smithi087.stdout:0/299: dread d0/d57/d4f/f53 [0,4194304] 0 2024-05-08T05:32:04.921 INFO:tasks.workunit.client.0.smithi087.stdout:0/300: readlink d0/d9/l59 0 2024-05-08T05:32:04.921 INFO:tasks.workunit.client.0.smithi087.stdout:0/301: readlink d0/d9/df/l38 0 2024-05-08T05:32:04.924 INFO:tasks.workunit.client.0.smithi087.stdout:7/331: rename d2/c2b to d2/da/d3f/d4f/c68 0 2024-05-08T05:32:04.924 INFO:tasks.workunit.client.0.smithi087.stdout:8/313: creat db/d23/d15/f72 x:0 0 0 2024-05-08T05:32:04.925 INFO:tasks.workunit.client.0.smithi087.stdout:7/332: write d2/d6/d12/f39 [789500,100103] 0 2024-05-08T05:32:04.926 INFO:tasks.workunit.client.0.smithi087.stdout:0/302: unlink d0/d9/df/f34 0 2024-05-08T05:32:04.928 INFO:tasks.workunit.client.0.smithi087.stdout:2/306: dwrite d7/de/d27/d33/f1c [0,4194304] 0 2024-05-08T05:32:04.931 INFO:tasks.workunit.client.0.smithi087.stdout:7/333: symlink d2/l69 0 2024-05-08T05:32:04.931 INFO:tasks.workunit.client.0.smithi087.stdout:7/334: chown d2/d6/d12/d19/d34/f45 1267072 1 2024-05-08T05:32:04.932 INFO:tasks.workunit.client.0.smithi087.stdout:0/303: truncate d0/d9/df/f15 4170207 0 2024-05-08T05:32:04.941 INFO:tasks.workunit.client.0.smithi087.stdout:2/307: creat d7/d2d/f60 x:0 0 0 2024-05-08T05:32:04.941 INFO:tasks.workunit.client.0.smithi087.stdout:7/335: mknod d2/d6/d12/d1d/c6a 0 2024-05-08T05:32:04.942 INFO:tasks.workunit.client.0.smithi087.stdout:7/336: read - d2/d6/d12/d1d/f57 zero size 2024-05-08T05:32:04.943 INFO:tasks.workunit.client.0.smithi087.stdout:1/282: dwrite df/d2f/f35 [8388608,4194304] 0 2024-05-08T05:32:04.943 INFO:tasks.workunit.client.0.smithi087.stdout:6/315: dread d4/d8/df/d1e/f43 [0,4194304] 0 2024-05-08T05:32:04.943 INFO:tasks.workunit.client.0.smithi087.stdout:6/316: chown d4/d6 210973139 1 2024-05-08T05:32:04.943 INFO:tasks.workunit.client.0.smithi087.stdout:6/317: fsync d4/d8/df/d1e/d25/f4b 0 2024-05-08T05:32:04.943 INFO:tasks.workunit.client.0.smithi087.stdout:6/318: stat d4/d8/df/d39 0 2024-05-08T05:32:04.943 INFO:tasks.workunit.client.0.smithi087.stdout:0/304: symlink d0/d9/d1b/d2f/d54/l6a 0 2024-05-08T05:32:04.947 INFO:tasks.workunit.client.0.smithi087.stdout:7/337: creat d2/f6b x:0 0 0 2024-05-08T05:32:04.947 INFO:tasks.workunit.client.0.smithi087.stdout:7/338: chown d2/d6/d12/d15/f42 9019 1 2024-05-08T05:32:04.947 INFO:tasks.workunit.client.0.smithi087.stdout:7/339: truncate d2/da/d3f/d49/d59/f62 936811 0 2024-05-08T05:32:04.947 INFO:tasks.workunit.client.0.smithi087.stdout:7/340: write d2/da/d3f/d4f/f61 [898772,4570] 0 2024-05-08T05:32:04.948 INFO:tasks.workunit.client.0.smithi087.stdout:7/341: fdatasync d2/d6/d12/d1d/f3a 0 2024-05-08T05:32:04.948 INFO:tasks.workunit.client.0.smithi087.stdout:6/319: truncate d4/d8/df/d1e/d25/f59 778194 0 2024-05-08T05:32:04.948 INFO:tasks.workunit.client.0.smithi087.stdout:6/320: chown d4/d8/df/f31 115 1 2024-05-08T05:32:04.948 INFO:tasks.workunit.client.0.smithi087.stdout:6/321: readlink d4/d8/df/d1e/d52/l5a 0 2024-05-08T05:32:04.951 INFO:tasks.workunit.client.0.smithi087.stdout:7/342: symlink d2/da/d3f/l6c 0 2024-05-08T05:32:04.951 INFO:tasks.workunit.client.0.smithi087.stdout:7/343: dread - d2/d6/d12/d1d/f3a zero size 2024-05-08T05:32:04.952 INFO:tasks.workunit.client.0.smithi087.stdout:4/344: dwrite d4/d13/f23 [0,4194304] 0 2024-05-08T05:32:04.956 INFO:tasks.workunit.client.0.smithi087.stdout:8/314: dread f5 [4194304,4194304] 0 2024-05-08T05:32:04.961 INFO:tasks.workunit.client.0.smithi087.stdout:1/283: dread df/d12/f23 [0,4194304] 0 2024-05-08T05:32:04.962 INFO:tasks.workunit.client.0.smithi087.stdout:6/322: creat d4/d6/f60 x:0 0 0 2024-05-08T05:32:04.962 INFO:tasks.workunit.client.0.smithi087.stdout:6/323: chown d4/d8/df/d1e/d25/d28 8400452 1 2024-05-08T05:32:04.962 INFO:tasks.workunit.client.0.smithi087.stdout:7/344: mkdir d2/d6/d12/d15/d5b/d6d 0 2024-05-08T05:32:04.963 INFO:tasks.workunit.client.0.smithi087.stdout:9/352: dwrite d1/db/d28/f4a [0,4194304] 0 2024-05-08T05:32:04.963 INFO:tasks.workunit.client.0.smithi087.stdout:5/307: dwrite da/dd/d10/d17/f2b [0,4194304] 0 2024-05-08T05:32:04.964 INFO:tasks.workunit.client.0.smithi087.stdout:5/308: fsync da/dd/d13/d16/f26 0 2024-05-08T05:32:04.964 INFO:tasks.workunit.client.0.smithi087.stdout:4/345: fsync d4/f6e 0 2024-05-08T05:32:04.967 INFO:tasks.workunit.client.0.smithi087.stdout:7/345: creat d2/da/d3f/d49/d59/f6e x:0 0 0 2024-05-08T05:32:04.967 INFO:tasks.workunit.client.0.smithi087.stdout:6/324: mkdir d4/d8/d61 0 2024-05-08T05:32:04.967 INFO:tasks.workunit.client.0.smithi087.stdout:6/325: fsync d4/d6/f3d 0 2024-05-08T05:32:04.969 INFO:tasks.workunit.client.0.smithi087.stdout:7/346: write d2/d6/d12/d19/d34/d54/f3e [75203,128227] 0 2024-05-08T05:32:04.975 INFO:tasks.workunit.client.0.smithi087.stdout:8/315: dread db/d23/d1b/f2a [0,4194304] 0 2024-05-08T05:32:04.975 INFO:tasks.workunit.client.0.smithi087.stdout:8/316: fsync db/d23/f2e 0 2024-05-08T05:32:04.979 INFO:tasks.workunit.client.0.smithi087.stdout:0/305: dread d0/d9/df/f15 [0,4194304] 0 2024-05-08T05:32:04.979 INFO:tasks.workunit.client.0.smithi087.stdout:0/306: fdatasync d0/da/f1e 0 2024-05-08T05:32:04.980 INFO:tasks.workunit.client.0.smithi087.stdout:1/284: dread df/d2f/f3c [0,4194304] 0 2024-05-08T05:32:04.980 INFO:tasks.workunit.client.0.smithi087.stdout:1/285: write df/d12/f23 [4108830,33249] 0 2024-05-08T05:32:04.983 INFO:tasks.workunit.client.0.smithi087.stdout:4/346: creat d4/d13/d65/d4a/d5d/f82 x:0 0 0 2024-05-08T05:32:04.983 INFO:tasks.workunit.client.0.smithi087.stdout:2/308: dwrite d7/de/d2c/f4c [0,4194304] 0 2024-05-08T05:32:04.984 INFO:tasks.workunit.client.0.smithi087.stdout:7/347: getdents d2/d6 0 2024-05-08T05:32:04.984 INFO:tasks.workunit.client.0.smithi087.stdout:7/348: truncate d2/d6/d12/d1d/f57 169413 0 2024-05-08T05:32:04.984 INFO:tasks.workunit.client.0.smithi087.stdout:8/317: link f4 db/d23/d1b/d35/d43/d68/d6a/f73 0 2024-05-08T05:32:04.987 INFO:tasks.workunit.client.0.smithi087.stdout:7/349: write d2/d6/d12/f47 [4652116,56502] 0 2024-05-08T05:32:04.987 INFO:tasks.workunit.client.0.smithi087.stdout:0/307: creat d0/d9/d1b/d5e/f6b x:0 0 0 2024-05-08T05:32:04.987 INFO:tasks.workunit.client.0.smithi087.stdout:9/353: dread d1/df/f12 [0,4194304] 0 2024-05-08T05:32:04.989 INFO:tasks.workunit.client.0.smithi087.stdout:6/326: write d4/f38 [4079219,56846] 0 2024-05-08T05:32:04.991 INFO:tasks.workunit.client.0.smithi087.stdout:1/286: dread df/d18/f28 [0,4194304] 0 2024-05-08T05:32:04.991 INFO:tasks.workunit.client.0.smithi087.stdout:2/309: mknod d7/de/d27/d33/c61 0 2024-05-08T05:32:04.991 INFO:tasks.workunit.client.0.smithi087.stdout:8/318: read f2 [291525,116182] 0 2024-05-08T05:32:04.992 INFO:tasks.workunit.client.0.smithi087.stdout:7/350: getdents d2/d6/d12/d19/d34/d54/d55 0 2024-05-08T05:32:04.996 INFO:tasks.workunit.client.0.smithi087.stdout:9/354: creat d1/db/d28/f62 x:0 0 0 2024-05-08T05:32:04.996 INFO:tasks.workunit.client.0.smithi087.stdout:6/327: link d4/d8/l3a d4/d8/l62 0 2024-05-08T05:32:05.002 INFO:tasks.workunit.client.0.smithi087.stdout:8/319: link db/d23/d1b/f3d db/d23/d54/f74 0 2024-05-08T05:32:05.003 INFO:tasks.workunit.client.0.smithi087.stdout:4/347: write d4/d13/d3e/d28/d35/f3a [3596959,103971] 0 2024-05-08T05:32:05.006 INFO:tasks.workunit.client.0.smithi087.stdout:6/328: link d4/d8/df/d1e/d25/f4e d4/d8/df/d1e/d25/d28/d57/f63 0 2024-05-08T05:32:05.006 INFO:tasks.workunit.client.0.smithi087.stdout:0/308: write d0/d57/d4f/f53 [246934,23101] 0 2024-05-08T05:32:05.019 INFO:tasks.workunit.client.0.smithi087.stdout:8/320: link db/cf db/d23/d15/d29/c75 0 2024-05-08T05:32:05.020 INFO:tasks.workunit.client.0.smithi087.stdout:4/348: rmdir d4/d13/d32 39 2024-05-08T05:32:05.020 INFO:tasks.workunit.client.0.smithi087.stdout:4/349: chown d4/d13/d3e/d28/d50 251217 1 2024-05-08T05:32:05.020 INFO:tasks.workunit.client.0.smithi087.stdout:8/321: write db/d23/d15/f71 [477587,77200] 0 2024-05-08T05:32:05.020 INFO:tasks.workunit.client.0.smithi087.stdout:4/350: mknod d4/d13/d3e/d28/d50/d5a/c83 0 2024-05-08T05:32:05.026 INFO:tasks.workunit.client.0.smithi087.stdout:5/309: dwrite da/dd/d10/d36/d45/f4d [0,4194304] 0 2024-05-08T05:32:05.026 INFO:tasks.workunit.client.0.smithi087.stdout:5/310: read da/dd/d10/d17/f3a [568159,76758] 0 2024-05-08T05:32:05.027 INFO:tasks.workunit.client.0.smithi087.stdout:5/311: write da/dd/d13/d16/f54 [1129225,127309] 0 2024-05-08T05:32:05.027 INFO:tasks.workunit.client.0.smithi087.stdout:5/312: chown da/db/d2a/d46/l55 163 1 2024-05-08T05:32:05.029 INFO:tasks.workunit.client.0.smithi087.stdout:5/313: unlink da/dd/d10/d36/f47 0 2024-05-08T05:32:05.029 INFO:tasks.workunit.client.0.smithi087.stdout:5/314: truncate da/dd/d13/d16/f26 5033071 0 2024-05-08T05:32:05.031 INFO:tasks.workunit.client.0.smithi087.stdout:5/315: rename da/db/d2a/d5a/f62 to da/dd/d10/d42/f64 0 2024-05-08T05:32:05.031 INFO:tasks.workunit.client.0.smithi087.stdout:5/316: stat da/dd/d10/d17/c33 0 2024-05-08T05:32:05.032 INFO:tasks.workunit.client.0.smithi087.stdout:5/317: write da/dd/d10/d36/f5f [436062,18904] 0 2024-05-08T05:32:05.033 INFO:tasks.workunit.client.0.smithi087.stdout:5/318: mkdir da/dd/d65 0 2024-05-08T05:32:05.038 INFO:tasks.workunit.client.0.smithi087.stdout:7/351: dread d2/d6/d12/d15/f46 [0,4194304] 0 2024-05-08T05:32:05.039 INFO:tasks.workunit.client.0.smithi087.stdout:4/351: dread d4/d13/d32/f45 [0,4194304] 0 2024-05-08T05:32:05.042 INFO:tasks.workunit.client.0.smithi087.stdout:4/352: truncate d4/fe 381116 0 2024-05-08T05:32:05.043 INFO:tasks.workunit.client.0.smithi087.stdout:9/355: dwrite d1/df/d14/d18/f5c [0,4194304] 0 2024-05-08T05:32:05.048 INFO:tasks.workunit.client.0.smithi087.stdout:4/353: rename d4/d13/d65/d4a to d4/d13/d32/d66/d84 0 2024-05-08T05:32:05.053 INFO:tasks.workunit.client.0.smithi087.stdout:4/354: rmdir d4/d13/d32 39 2024-05-08T05:32:05.055 INFO:tasks.workunit.client.0.smithi087.stdout:5/319: dread da/dd/d13/d16/f54 [0,4194304] 0 2024-05-08T05:32:05.055 INFO:tasks.workunit.client.0.smithi087.stdout:5/320: stat da/dd 0 2024-05-08T05:32:05.055 INFO:tasks.workunit.client.0.smithi087.stdout:7/352: dread d2/da/d3f/d4f/f61 [0,4194304] 0 2024-05-08T05:32:05.056 INFO:tasks.workunit.client.0.smithi087.stdout:0/309: dwrite d0/da/fe [0,4194304] 0 2024-05-08T05:32:05.057 INFO:tasks.workunit.client.0.smithi087.stdout:0/310: fsync d0/d9/f48 0 2024-05-08T05:32:05.060 INFO:tasks.workunit.client.0.smithi087.stdout:4/355: mknod d4/d13/d32/d66/d84/c85 0 2024-05-08T05:32:05.062 INFO:tasks.workunit.client.0.smithi087.stdout:5/321: stat f2 0 2024-05-08T05:32:05.062 INFO:tasks.workunit.client.0.smithi087.stdout:3/326: sync 2024-05-08T05:32:05.066 INFO:tasks.workunit.client.0.smithi087.stdout:1/287: dwrite df/d2f/f50 [0,4194304] 0 2024-05-08T05:32:05.066 INFO:tasks.workunit.client.0.smithi087.stdout:9/356: dread d1/db/fc [0,4194304] 0 2024-05-08T05:32:05.066 INFO:tasks.workunit.client.0.smithi087.stdout:3/327: rename d4/d11/d24/d39/l53 to d4/d11/d3d/d4e/l72 0 2024-05-08T05:32:05.066 INFO:tasks.workunit.client.0.smithi087.stdout:9/357: write d1/db/d28/f48 [1234827,115492] 0 2024-05-08T05:32:05.066 INFO:tasks.workunit.client.0.smithi087.stdout:4/356: dread d4/d13/d3e/d28/f39 [0,4194304] 0 2024-05-08T05:32:05.066 INFO:tasks.workunit.client.0.smithi087.stdout:5/322: creat da/f66 x:0 0 0 2024-05-08T05:32:05.066 INFO:tasks.workunit.client.0.smithi087.stdout:4/357: fsync d4/d13/d65/d4e/f54 0 2024-05-08T05:32:05.068 INFO:tasks.workunit.client.0.smithi087.stdout:1/288: getdents df/d18/d1d 0 2024-05-08T05:32:05.068 INFO:tasks.workunit.client.0.smithi087.stdout:1/289: chown df/d18/d1d/l33 2047076 1 2024-05-08T05:32:05.070 INFO:tasks.workunit.client.0.smithi087.stdout:9/358: mknod d1/db/d28/d4b/c63 0 2024-05-08T05:32:05.070 INFO:tasks.workunit.client.0.smithi087.stdout:9/359: chown d1/fd 1050134 1 2024-05-08T05:32:05.070 INFO:tasks.workunit.client.0.smithi087.stdout:6/329: dwrite d4/d8/df/d1e/f43 [0,4194304] 0 2024-05-08T05:32:05.074 INFO:tasks.workunit.client.0.smithi087.stdout:5/323: truncate f7 1317715 0 2024-05-08T05:32:05.074 INFO:tasks.workunit.client.0.smithi087.stdout:1/290: mknod df/d2f/d4f/c62 0 2024-05-08T05:32:05.075 INFO:tasks.workunit.client.0.smithi087.stdout:9/360: creat d1/df/d14/d54/f64 x:0 0 0 2024-05-08T05:32:05.075 INFO:tasks.workunit.client.0.smithi087.stdout:9/361: stat d1/f8 0 2024-05-08T05:32:05.078 INFO:tasks.workunit.client.0.smithi087.stdout:1/291: link l8 df/d2f/d4f/l63 0 2024-05-08T05:32:05.079 INFO:tasks.workunit.client.0.smithi087.stdout:9/362: unlink d1/db/d28/f48 0 2024-05-08T05:32:05.084 INFO:tasks.workunit.client.0.smithi087.stdout:0/311: write d0/d9/f48 [2607279,81540] 0 2024-05-08T05:32:05.087 INFO:tasks.workunit.client.0.smithi087.stdout:0/312: truncate d0/da/d11/f20 2904998 0 2024-05-08T05:32:05.087 INFO:tasks.workunit.client.0.smithi087.stdout:5/324: dread da/dd/d13/d16/f54 [0,4194304] 0 2024-05-08T05:32:05.087 INFO:tasks.workunit.client.0.smithi087.stdout:5/325: fsync da/dd/d10/d42/f64 0 2024-05-08T05:32:05.092 INFO:tasks.workunit.client.0.smithi087.stdout:1/292: rename df/d12 to df/d2f/d57/d64 0 2024-05-08T05:32:05.104 INFO:tasks.workunit.client.0.smithi087.stdout:7/353: dwrite d2/d6/d12/d19/d34/d54/d50/f56 [0,4194304] 0 2024-05-08T05:32:05.105 INFO:tasks.workunit.client.0.smithi087.stdout:7/354: stat d2/d6/d12/d19/d2a/l38 0 2024-05-08T05:32:05.105 INFO:tasks.workunit.client.0.smithi087.stdout:7/355: chown d2/d6/d12/d1d/l4b 132245935 1 2024-05-08T05:32:05.113 INFO:tasks.workunit.client.0.smithi087.stdout:6/330: write d4/d8/df/d1e/d25/f2f [1895539,37859] 0 2024-05-08T05:32:05.113 INFO:tasks.workunit.client.0.smithi087.stdout:4/358: dwrite d4/d13/d65/d4e/f78 [0,4194304] 0 2024-05-08T05:32:05.116 INFO:tasks.workunit.client.0.smithi087.stdout:5/326: dread f2 [0,4194304] 0 2024-05-08T05:32:05.120 INFO:tasks.workunit.client.0.smithi087.stdout:6/331: rename d4/d8/df/d1e/d25/d28/d2d/d37/d45/f5c to d4/d8/df/d1e/d25/d28/d2d/d37/d45/f64 0 2024-05-08T05:32:05.120 INFO:tasks.workunit.client.0.smithi087.stdout:6/332: fdatasync d4/d6/f60 0 2024-05-08T05:32:05.120 INFO:tasks.workunit.client.0.smithi087.stdout:6/333: dread - d4/d8/df/d1e/d25/d28/f36 zero size 2024-05-08T05:32:05.120 INFO:tasks.workunit.client.0.smithi087.stdout:0/313: dread d0/da/fe [0,4194304] 0 2024-05-08T05:32:05.120 INFO:tasks.workunit.client.0.smithi087.stdout:4/359: creat d4/d13/d3e/d28/d50/f86 x:0 0 0 2024-05-08T05:32:05.120 INFO:tasks.workunit.client.0.smithi087.stdout:5/327: rename da/dd/d10/d36/d45/f4f to da/db/d2a/f67 0 2024-05-08T05:32:05.120 INFO:tasks.workunit.client.0.smithi087.stdout:5/328: chown da/dd/d10/d42/d50/f52 125244658 1 2024-05-08T05:32:05.120 INFO:tasks.workunit.client.0.smithi087.stdout:5/329: chown da/f3c 19904 1 2024-05-08T05:32:05.120 INFO:tasks.workunit.client.0.smithi087.stdout:0/314: link d0/d9/d1b/d5e/f6b d0/f6c 0 2024-05-08T05:32:05.120 INFO:tasks.workunit.client.0.smithi087.stdout:0/315: readlink d0/da/d11/l56 0 2024-05-08T05:32:05.121 INFO:tasks.workunit.client.0.smithi087.stdout:4/360: truncate d4/d13/d3e/f52 3712422 0 2024-05-08T05:32:05.124 INFO:tasks.workunit.client.0.smithi087.stdout:5/330: rename f7 to da/dd/d65/f68 0 2024-05-08T05:32:05.127 INFO:tasks.workunit.client.0.smithi087.stdout:5/331: mkdir da/db/d2a/d46/d69 0 2024-05-08T05:32:05.127 INFO:tasks.workunit.client.0.smithi087.stdout:5/332: truncate da/dd/d10/d42/f64 82434 0 2024-05-08T05:32:05.133 INFO:tasks.workunit.client.0.smithi087.stdout:5/333: truncate da/dd/d13/d16/f54 625250 0 2024-05-08T05:32:05.133 INFO:tasks.workunit.client.0.smithi087.stdout:5/334: chown da/dd/d10/d42 11 1 2024-05-08T05:32:05.137 INFO:tasks.workunit.client.0.smithi087.stdout:9/363: dwrite d1/db/d28/f42 [0,4194304] 0 2024-05-08T05:32:05.137 INFO:tasks.workunit.client.0.smithi087.stdout:3/328: dwrite d4/d11/d24/f26 [4194304,4194304] 0 2024-05-08T05:32:05.139 INFO:tasks.workunit.client.0.smithi087.stdout:3/329: link d4/d11/l67 d4/d11/d3d/d64/l73 0 2024-05-08T05:32:05.140 INFO:tasks.workunit.client.0.smithi087.stdout:3/330: mknod d4/d11/d24/d39/d60/c74 0 2024-05-08T05:32:05.151 INFO:tasks.workunit.client.0.smithi087.stdout:5/335: dread da/db/d2a/f32 [0,4194304] 0 2024-05-08T05:32:05.153 INFO:tasks.workunit.client.0.smithi087.stdout:5/336: link da/dd/d10/d42/f64 da/dd/d10/d42/d50/f6a 0 2024-05-08T05:32:05.153 INFO:tasks.workunit.client.0.smithi087.stdout:5/337: write da/dd/d10/f40 [1197988,50913] 0 2024-05-08T05:32:05.154 INFO:tasks.workunit.client.0.smithi087.stdout:5/338: mkdir da/dd/d56/d6b 0 2024-05-08T05:32:05.155 INFO:tasks.workunit.client.0.smithi087.stdout:5/339: mknod da/c6c 0 2024-05-08T05:32:05.168 INFO:tasks.workunit.client.0.smithi087.stdout:9/364: dread d1/f21 [4194304,4194304] 0 2024-05-08T05:32:05.173 INFO:tasks.workunit.client.0.smithi087.stdout:9/365: truncate d1/df/f12 166691 0 2024-05-08T05:32:05.174 INFO:tasks.workunit.client.0.smithi087.stdout:0/316: dwrite d0/d57/d4f/d51/f5c [0,4194304] 0 2024-05-08T05:32:05.175 INFO:tasks.workunit.client.0.smithi087.stdout:9/366: creat d1/df/d58/d5e/f65 x:0 0 0 2024-05-08T05:32:05.176 INFO:tasks.workunit.client.0.smithi087.stdout:1/293: dwrite df/f3d [0,4194304] 0 2024-05-08T05:32:05.176 INFO:tasks.workunit.client.0.smithi087.stdout:1/294: dread - df/d2f/d4f/f5a zero size 2024-05-08T05:32:05.178 INFO:tasks.workunit.client.0.smithi087.stdout:0/317: mkdir d0/d9/df/d6d 0 2024-05-08T05:32:05.178 INFO:tasks.workunit.client.0.smithi087.stdout:9/367: mkdir d1/df/d14/d18/d66 0 2024-05-08T05:32:05.180 INFO:tasks.workunit.client.0.smithi087.stdout:0/318: creat d0/d57/d24/d66/f6e x:0 0 0 2024-05-08T05:32:05.181 INFO:tasks.workunit.client.0.smithi087.stdout:9/368: link d1/db/f1b d1/df/d14/d18/f67 0 2024-05-08T05:32:05.182 INFO:tasks.workunit.client.0.smithi087.stdout:0/319: creat d0/d57/d24/d66/f6f x:0 0 0 2024-05-08T05:32:05.182 INFO:tasks.workunit.client.0.smithi087.stdout:9/369: mkdir d1/df/d14/d68 0 2024-05-08T05:32:05.184 INFO:tasks.workunit.client.0.smithi087.stdout:7/356: dwrite d2/d6/d12/d15/f42 [0,4194304] 0 2024-05-08T05:32:05.184 INFO:tasks.workunit.client.0.smithi087.stdout:7/357: write d2/da/d3f/d49/d59/f62 [1438890,71342] 0 2024-05-08T05:32:05.187 INFO:tasks.workunit.client.0.smithi087.stdout:2/310: sync 2024-05-08T05:32:05.189 INFO:tasks.workunit.client.0.smithi087.stdout:7/358: creat d2/d6/d12/d19/d34/d54/d50/f6f x:0 0 0 2024-05-08T05:32:05.189 INFO:tasks.workunit.client.0.smithi087.stdout:7/359: truncate d2/f6b 178650 0 2024-05-08T05:32:05.189 INFO:tasks.workunit.client.0.smithi087.stdout:2/311: getdents d7/d2d 0 2024-05-08T05:32:05.191 INFO:tasks.workunit.client.0.smithi087.stdout:6/334: dwrite d4/d8/df/d1e/d25/d28/d2d/d37/f54 [0,4194304] 0 2024-05-08T05:32:05.192 INFO:tasks.workunit.client.0.smithi087.stdout:7/360: mknod d2/da/d3f/c70 0 2024-05-08T05:32:05.192 INFO:tasks.workunit.client.0.smithi087.stdout:7/361: chown d2/da/d3f/d49/d59 9 1 2024-05-08T05:32:05.192 INFO:tasks.workunit.client.0.smithi087.stdout:2/312: stat d7/de/c16 0 2024-05-08T05:32:05.195 INFO:tasks.workunit.client.0.smithi087.stdout:6/335: creat d4/d8/d61/f65 x:0 0 0 2024-05-08T05:32:05.196 INFO:tasks.workunit.client.0.smithi087.stdout:7/362: mknod d2/da/d3f/d4f/c71 0 2024-05-08T05:32:05.197 INFO:tasks.workunit.client.0.smithi087.stdout:6/336: creat d4/f66 x:0 0 0 2024-05-08T05:32:05.198 INFO:tasks.workunit.client.0.smithi087.stdout:7/363: rename d2/d6/d12/d1d/d23 to d2/da/d3f/d72 0 2024-05-08T05:32:05.198 INFO:tasks.workunit.client.0.smithi087.stdout:1/295: dread df/f3e [0,4194304] 0 2024-05-08T05:32:05.199 INFO:tasks.workunit.client.0.smithi087.stdout:6/337: getdents d4/d8/df 0 2024-05-08T05:32:05.201 INFO:tasks.workunit.client.0.smithi087.stdout:7/364: rename d2/da/d3f/d49/d59/f6e to d2/d6/d12/d19/f73 0 2024-05-08T05:32:05.202 INFO:tasks.workunit.client.0.smithi087.stdout:1/296: rename df/d2f/d57/d64/f31 to df/d2f/d4f/f65 0 2024-05-08T05:32:05.202 INFO:tasks.workunit.client.0.smithi087.stdout:1/297: chown df/d2f/f35 15 1 2024-05-08T05:32:05.202 INFO:tasks.workunit.client.0.smithi087.stdout:1/298: write df/d2f/d57/d64/f29 [4412679,76058] 0 2024-05-08T05:32:05.203 INFO:tasks.workunit.client.0.smithi087.stdout:7/365: mknod d2/d6/d12/d19/d34/c74 0 2024-05-08T05:32:05.204 INFO:tasks.workunit.client.0.smithi087.stdout:1/299: truncate df/d2f/f35 2972501 0 2024-05-08T05:32:05.205 INFO:tasks.workunit.client.0.smithi087.stdout:4/361: dwrite d4/d13/d32/d66/f7c [0,4194304] 0 2024-05-08T05:32:05.211 INFO:tasks.workunit.client.0.smithi087.stdout:8/322: sync 2024-05-08T05:32:05.221 INFO:tasks.workunit.client.0.smithi087.stdout:7/366: getdents d2/da/d3f/d49/d59 0 2024-05-08T05:32:05.223 INFO:tasks.workunit.client.0.smithi087.stdout:7/367: getdents d2/d6/d12/d19 0 2024-05-08T05:32:05.223 INFO:tasks.workunit.client.0.smithi087.stdout:7/368: dread - d2/d6/d12/f43 zero size 2024-05-08T05:32:05.225 INFO:tasks.workunit.client.0.smithi087.stdout:3/331: dwrite d4/d14/f63 [0,4194304] 0 2024-05-08T05:32:05.230 INFO:tasks.workunit.client.0.smithi087.stdout:7/369: rename d2/l69 to d2/d6/d12/d19/l75 0 2024-05-08T05:32:05.234 INFO:tasks.workunit.client.0.smithi087.stdout:3/332: rename d4/d14/l27 to d4/d11/d24/d39/l75 0 2024-05-08T05:32:05.234 INFO:tasks.workunit.client.0.smithi087.stdout:3/333: read - d4/d11/d3d/d48/f6c zero size 2024-05-08T05:32:05.236 INFO:tasks.workunit.client.0.smithi087.stdout:3/334: readlink d4/lf 0 2024-05-08T05:32:05.239 INFO:tasks.workunit.client.0.smithi087.stdout:7/370: link d2/da/d3f/d72/c35 d2/d6/d12/d19/d34/d54/c76 0 2024-05-08T05:32:05.240 INFO:tasks.workunit.client.0.smithi087.stdout:7/371: chown d2/d6/d12/f51 180 1 2024-05-08T05:32:05.247 INFO:tasks.workunit.client.0.smithi087.stdout:7/372: dread d2/d6/d12/d15/f46 [0,4194304] 0 2024-05-08T05:32:05.247 INFO:tasks.workunit.client.0.smithi087.stdout:0/320: dwrite d0/d22/d3c/f49 [0,4194304] 0 2024-05-08T05:32:05.250 INFO:tasks.workunit.client.0.smithi087.stdout:0/321: creat d0/d57/d4f/d51/f70 x:0 0 0 2024-05-08T05:32:05.250 INFO:tasks.workunit.client.0.smithi087.stdout:0/322: chown d0/da/c2e 123639556 1 2024-05-08T05:32:05.251 INFO:tasks.workunit.client.0.smithi087.stdout:0/323: mknod d0/d57/c71 0 2024-05-08T05:32:05.252 INFO:tasks.workunit.client.0.smithi087.stdout:0/324: write d0/d57/d4f/f53 [41477,67264] 0 2024-05-08T05:32:05.253 INFO:tasks.workunit.client.0.smithi087.stdout:1/300: dwrite df/d2f/d57/d64/f45 [0,4194304] 0 2024-05-08T05:32:05.253 INFO:tasks.workunit.client.0.smithi087.stdout:0/325: getdents d0/d57/d4f 0 2024-05-08T05:32:05.253 INFO:tasks.workunit.client.0.smithi087.stdout:0/326: write d0/da/f16 [2012080,100184] 0 2024-05-08T05:32:05.258 INFO:tasks.workunit.client.0.smithi087.stdout:1/301: truncate df/d2f/f3c 517396 0 2024-05-08T05:32:05.258 INFO:tasks.workunit.client.0.smithi087.stdout:1/302: write df/d18/d1d/f3a [488563,52854] 0 2024-05-08T05:32:05.258 INFO:tasks.workunit.client.0.smithi087.stdout:3/335: write d4/d11/d24/d25/f34 [1742873,130782] 0 2024-05-08T05:32:05.258 INFO:tasks.workunit.client.0.smithi087.stdout:0/327: creat d0/d9/d1b/d5e/f72 x:0 0 0 2024-05-08T05:32:05.258 INFO:tasks.workunit.client.0.smithi087.stdout:0/328: readlink d0/d9/d1b/d2f/d54/l6a 0 2024-05-08T05:32:05.258 INFO:tasks.workunit.client.0.smithi087.stdout:0/329: truncate d0/d9/f10 2661158 0 2024-05-08T05:32:05.260 INFO:tasks.workunit.client.0.smithi087.stdout:0/330: symlink d0/d9/d1b/l73 0 2024-05-08T05:32:05.260 INFO:tasks.workunit.client.0.smithi087.stdout:0/331: readlink d0/d9/d1b/l73 0 2024-05-08T05:32:05.266 INFO:tasks.workunit.client.0.smithi087.stdout:3/336: write d4/d11/d24/d25/d3e/f46 [3922578,61489] 0 2024-05-08T05:32:05.267 INFO:tasks.workunit.client.0.smithi087.stdout:2/313: dwrite f6 [4194304,4194304] 0 2024-05-08T05:32:05.270 INFO:tasks.workunit.client.0.smithi087.stdout:2/314: mknod d7/de/d27/d33/c62 0 2024-05-08T05:32:05.273 INFO:tasks.workunit.client.0.smithi087.stdout:8/323: dwrite db/d23/d15/d29/f52 [0,4194304] 0 2024-05-08T05:32:05.276 INFO:tasks.workunit.client.0.smithi087.stdout:7/373: write d2/d6/d12/d19/d34/f45 [2378163,73194] 0 2024-05-08T05:32:05.276 INFO:tasks.workunit.client.0.smithi087.stdout:7/374: chown d2/d6/d12/d19/d34/d54/f3e 2026853470 1 2024-05-08T05:32:05.276 INFO:tasks.workunit.client.0.smithi087.stdout:7/375: dread - d2/d6/d12/f43 zero size 2024-05-08T05:32:05.278 INFO:tasks.workunit.client.0.smithi087.stdout:9/370: dwrite d1/df/d14/d18/f67 [0,4194304] 0 2024-05-08T05:32:05.286 INFO:tasks.workunit.client.0.smithi087.stdout:8/324: mkdir db/d23/d1b/d35/d43/d68/d6a/d76 0 2024-05-08T05:32:05.286 INFO:tasks.workunit.client.0.smithi087.stdout:7/376: rename d2/d6/d12/d19/d34 to d2/da/d3f/d72/d77 0 2024-05-08T05:32:05.286 INFO:tasks.workunit.client.0.smithi087.stdout:7/377: write d2/d6/d12/d1d/f57 [1185736,78819] 0 2024-05-08T05:32:05.288 INFO:tasks.workunit.client.0.smithi087.stdout:8/325: rmdir db/d23 39 2024-05-08T05:32:05.288 INFO:tasks.workunit.client.0.smithi087.stdout:8/326: fdatasync db/d23/f2d 0 2024-05-08T05:32:05.288 INFO:tasks.workunit.client.0.smithi087.stdout:8/327: truncate db/d23/f38 4543905 0 2024-05-08T05:32:05.293 INFO:tasks.workunit.client.0.smithi087.stdout:8/328: creat db/d23/d15/d29/d33/f77 x:0 0 0 2024-05-08T05:32:05.297 INFO:tasks.workunit.client.0.smithi087.stdout:8/329: unlink db/d23/d1b/d35/d43/f44 0 2024-05-08T05:32:05.297 INFO:tasks.workunit.client.0.smithi087.stdout:7/378: dread d2/d6/d12/f39 [0,4194304] 0 2024-05-08T05:32:05.298 INFO:tasks.workunit.client.0.smithi087.stdout:7/379: mknod d2/da/c78 0 2024-05-08T05:32:05.299 INFO:tasks.workunit.client.0.smithi087.stdout:7/380: readlink d2/da/lc 0 2024-05-08T05:32:05.299 INFO:tasks.workunit.client.0.smithi087.stdout:7/381: rename d2 to d2/da/d79 22 2024-05-08T05:32:05.300 INFO:tasks.workunit.client.0.smithi087.stdout:7/382: mknod d2/da/d3f/d72/d77/d54/d50/c7a 0 2024-05-08T05:32:05.302 INFO:tasks.workunit.client.0.smithi087.stdout:7/383: creat d2/d6/d12/d19/d2a/f7b x:0 0 0 2024-05-08T05:32:05.306 INFO:tasks.workunit.client.0.smithi087.stdout:2/315: dread d7/de/d27/f4f [0,4194304] 0 2024-05-08T05:32:05.321 INFO:tasks.workunit.client.0.smithi087.stdout:0/332: dwrite d0/f2 [0,4194304] 0 2024-05-08T05:32:05.321 INFO:tasks.workunit.client.0.smithi087.stdout:0/333: stat d0/da 0 2024-05-08T05:32:05.321 INFO:tasks.workunit.client.0.smithi087.stdout:0/334: stat d0/da/f30 0 2024-05-08T05:32:05.321 INFO:tasks.workunit.client.0.smithi087.stdout:2/316: dread d7/d2d/f39 [0,4194304] 0 2024-05-08T05:32:05.321 INFO:tasks.workunit.client.0.smithi087.stdout:2/317: dread - d7/de/d27/f44 zero size 2024-05-08T05:32:05.328 INFO:tasks.workunit.client.0.smithi087.stdout:0/335: rename d0/d57/d4f to d0/d9/df/d74 0 2024-05-08T05:32:05.328 INFO:tasks.workunit.client.0.smithi087.stdout:0/336: getdents d0/d9/df/d74 0 2024-05-08T05:32:05.328 INFO:tasks.workunit.client.0.smithi087.stdout:0/337: write d0/d57/d24/d66/f6e [304504,117489] 0 2024-05-08T05:32:05.328 INFO:tasks.workunit.client.0.smithi087.stdout:2/318: rename d7/d2d to d7/d63 0 2024-05-08T05:32:05.329 INFO:tasks.workunit.client.0.smithi087.stdout:2/319: write d7/de/d2c/f31 [320350,96302] 0 2024-05-08T05:32:05.329 INFO:tasks.workunit.client.0.smithi087.stdout:7/384: dread d2/f4 [0,4194304] 0 2024-05-08T05:32:05.330 INFO:tasks.workunit.client.0.smithi087.stdout:0/338: rename d0/d57/c42 to d0/d22/d3c/c75 0 2024-05-08T05:32:05.331 INFO:tasks.workunit.client.0.smithi087.stdout:2/320: creat d7/de/f64 x:0 0 0 2024-05-08T05:32:05.332 INFO:tasks.workunit.client.0.smithi087.stdout:2/321: write d7/de/d2c/f31 [1350956,44668] 0 2024-05-08T05:32:05.333 INFO:tasks.workunit.client.0.smithi087.stdout:1/303: dwrite df/d2f/f35 [0,4194304] 0 2024-05-08T05:32:05.333 INFO:tasks.workunit.client.0.smithi087.stdout:9/371: dwrite d1/df/f35 [0,4194304] 0 2024-05-08T05:32:05.334 INFO:tasks.workunit.client.0.smithi087.stdout:1/304: creat df/d2f/f66 x:0 0 0 2024-05-08T05:32:05.335 INFO:tasks.workunit.client.0.smithi087.stdout:9/372: getdents d1/db/d28/d4b 0 2024-05-08T05:32:05.335 INFO:tasks.workunit.client.0.smithi087.stdout:9/373: read d1/df/d14/d18/f34 [50623,63531] 0 2024-05-08T05:32:05.336 INFO:tasks.workunit.client.0.smithi087.stdout:2/322: read d7/de/d2c/f48 [413726,104877] 0 2024-05-08T05:32:05.336 INFO:tasks.workunit.client.0.smithi087.stdout:2/323: readlink d7/la 0 2024-05-08T05:32:05.336 INFO:tasks.workunit.client.0.smithi087.stdout:2/324: dread - d7/f59 zero size 2024-05-08T05:32:05.336 INFO:tasks.workunit.client.0.smithi087.stdout:0/339: dread d0/da/d35/f37 [0,4194304] 0 2024-05-08T05:32:05.337 INFO:tasks.workunit.client.0.smithi087.stdout:3/337: dwrite d4/d11/d24/f69 [0,4194304] 0 2024-05-08T05:32:05.337 INFO:tasks.workunit.client.0.smithi087.stdout:3/338: readlink d4/l35 0 2024-05-08T05:32:05.339 INFO:tasks.workunit.client.0.smithi087.stdout:1/305: mknod df/d2f/d57/d64/c67 0 2024-05-08T05:32:05.340 INFO:tasks.workunit.client.0.smithi087.stdout:2/325: mkdir d7/de/d27/d33/d65 0 2024-05-08T05:32:05.342 INFO:tasks.workunit.client.0.smithi087.stdout:0/340: rename d0/f2 to d0/d22/f76 0 2024-05-08T05:32:05.345 INFO:tasks.workunit.client.0.smithi087.stdout:9/374: dread d1/db/d28/f2e [0,4194304] 0 2024-05-08T05:32:05.345 INFO:tasks.workunit.client.0.smithi087.stdout:9/375: write d1/df/d37/f51 [882415,109765] 0 2024-05-08T05:32:05.351 INFO:tasks.workunit.client.0.smithi087.stdout:7/385: dread d2/d6/d12/d19/f22 [0,4194304] 0 2024-05-08T05:32:05.354 INFO:tasks.workunit.client.0.smithi087.stdout:8/330: dwrite db/d23/d15/d29/d33/f77 [0,4194304] 0 2024-05-08T05:32:05.354 INFO:tasks.workunit.client.0.smithi087.stdout:3/339: write d4/d14/f63 [3994543,124399] 0 2024-05-08T05:32:05.354 INFO:tasks.workunit.client.0.smithi087.stdout:3/340: readlink d4/d11/d24/d39/l75 0 2024-05-08T05:32:05.355 INFO:tasks.workunit.client.0.smithi087.stdout:3/341: chown d4/l35 6957 1 2024-05-08T05:32:05.355 INFO:tasks.workunit.client.0.smithi087.stdout:3/342: getdents d4/d5f 0 2024-05-08T05:32:05.359 INFO:tasks.workunit.client.0.smithi087.stdout:1/306: mknod df/d18/d1d/d58/c68 0 2024-05-08T05:32:05.360 INFO:tasks.workunit.client.0.smithi087.stdout:2/326: creat d7/de/d27/f66 x:0 0 0 2024-05-08T05:32:05.361 INFO:tasks.workunit.client.0.smithi087.stdout:9/376: creat d1/df/d37/d5b/f69 x:0 0 0 2024-05-08T05:32:05.365 INFO:tasks.workunit.client.0.smithi087.stdout:7/386: mkdir d2/da/d3f/d72/d77/d54/d55/d65/d7c 0 2024-05-08T05:32:05.365 INFO:tasks.workunit.client.0.smithi087.stdout:7/387: write d2/d6/f25 [4417388,103816] 0 2024-05-08T05:32:05.366 INFO:tasks.workunit.client.0.smithi087.stdout:8/331: getdents db/d23/d3a/d65 0 2024-05-08T05:32:05.366 INFO:tasks.workunit.client.0.smithi087.stdout:3/343: dread d4/f5 [0,4194304] 0 2024-05-08T05:32:05.369 INFO:tasks.workunit.client.0.smithi087.stdout:1/307: dread df/d18/f1b [0,4194304] 0 2024-05-08T05:32:05.369 INFO:tasks.workunit.client.0.smithi087.stdout:1/308: dread - df/f4d zero size 2024-05-08T05:32:05.370 INFO:tasks.workunit.client.0.smithi087.stdout:7/388: rename d2/da/d3f/d72/c35 to d2/da/d3f/d72/d77/d54/d55/d65/d7c/c7d 0 2024-05-08T05:32:05.372 INFO:tasks.workunit.client.0.smithi087.stdout:9/377: dread d1/df/d14/d54/d61/f31 [0,4194304] 0 2024-05-08T05:32:05.373 INFO:tasks.workunit.client.0.smithi087.stdout:9/378: stat d1/df/d14/d54/d61/f53 0 2024-05-08T05:32:05.377 INFO:tasks.workunit.client.0.smithi087.stdout:6/338: sync 2024-05-08T05:32:05.377 INFO:tasks.workunit.client.0.smithi087.stdout:5/340: sync 2024-05-08T05:32:05.380 INFO:tasks.workunit.client.0.smithi087.stdout:4/362: sync 2024-05-08T05:32:05.381 INFO:tasks.workunit.client.0.smithi087.stdout:4/363: dread - d4/d13/d65/f6f zero size 2024-05-08T05:32:05.393 INFO:tasks.workunit.client.0.smithi087.stdout:5/341: dread da/db/d2a/f32 [0,4194304] 0 2024-05-08T05:32:05.395 INFO:tasks.workunit.client.0.smithi087.stdout:5/342: mknod da/db/d2a/d46/c6d 0 2024-05-08T05:32:05.395 INFO:tasks.workunit.client.0.smithi087.stdout:5/343: stat da/db/d2a/f32 0 2024-05-08T05:32:05.399 INFO:tasks.workunit.client.0.smithi087.stdout:9/379: dread d1/f30 [0,4194304] 0 2024-05-08T05:32:05.399 INFO:tasks.workunit.client.0.smithi087.stdout:9/380: chown d1/db/f5d 2318 1 2024-05-08T05:32:05.399 INFO:tasks.workunit.client.0.smithi087.stdout:9/381: chown d1/df/d37/f51 25562 1 2024-05-08T05:32:05.400 INFO:tasks.workunit.client.0.smithi087.stdout:9/382: getdents d1/db 0 2024-05-08T05:32:05.408 INFO:tasks.workunit.client.0.smithi087.stdout:6/339: dread d4/d8/f35 [0,4194304] 0 2024-05-08T05:32:05.412 INFO:tasks.workunit.client.0.smithi087.stdout:9/383: rename d1/df/d14/d54/d61/c60 to d1/df/c6a 0 2024-05-08T05:32:05.414 INFO:tasks.workunit.client.0.smithi087.stdout:6/340: creat d4/d8/f67 x:0 0 0 2024-05-08T05:32:05.414 INFO:tasks.workunit.client.0.smithi087.stdout:6/341: chown d4/d8/df/d1e/l2c 699781 1 2024-05-08T05:32:05.415 INFO:tasks.workunit.client.0.smithi087.stdout:9/384: creat d1/df/d14/d68/f6b x:0 0 0 2024-05-08T05:32:05.416 INFO:tasks.workunit.client.0.smithi087.stdout:6/342: creat d4/d8/df/d1e/d25/d28/d2d/d37/d45/f68 x:0 0 0 2024-05-08T05:32:05.417 INFO:tasks.workunit.client.0.smithi087.stdout:6/343: write d4/d8/f67 [560413,123713] 0 2024-05-08T05:32:05.417 INFO:tasks.workunit.client.0.smithi087.stdout:9/385: mknod d1/df/d58/d5e/c6c 0 2024-05-08T05:32:05.417 INFO:tasks.workunit.client.0.smithi087.stdout:9/386: stat d1/df/d14/f17 0 2024-05-08T05:32:05.418 INFO:tasks.workunit.client.0.smithi087.stdout:6/344: getdents d4/d6 0 2024-05-08T05:32:05.420 INFO:tasks.workunit.client.0.smithi087.stdout:9/387: creat d1/df/d37/f6d x:0 0 0 2024-05-08T05:32:05.420 INFO:tasks.workunit.client.0.smithi087.stdout:7/389: dread d2/da/d3f/d72/d77/d54/d50/f56 [0,4194304] 0 2024-05-08T05:32:05.421 INFO:tasks.workunit.client.0.smithi087.stdout:6/345: truncate d4/d6/f1b 5947511 0 2024-05-08T05:32:05.421 INFO:tasks.workunit.client.0.smithi087.stdout:6/346: fdatasync d4/d8/df/d1e/d25/d28/d2d/d37/d45/f48 0 2024-05-08T05:32:05.422 INFO:tasks.workunit.client.0.smithi087.stdout:9/388: creat d1/df/d14/f6e x:0 0 0 2024-05-08T05:32:05.424 INFO:tasks.workunit.client.0.smithi087.stdout:7/390: link d2/d6/f25 d2/da/d3f/d72/d77/d54/d55/f7e 0 2024-05-08T05:32:05.424 INFO:tasks.workunit.client.0.smithi087.stdout:7/391: chown d2/d6/d12/d19/f22 630441 1 2024-05-08T05:32:05.424 INFO:tasks.workunit.client.0.smithi087.stdout:7/392: fdatasync d2/d6/d12/d1d/f17 0 2024-05-08T05:32:05.425 INFO:tasks.workunit.client.0.smithi087.stdout:9/389: creat d1/df/d37/d5b/f6f x:0 0 0 2024-05-08T05:32:05.425 INFO:tasks.workunit.client.0.smithi087.stdout:9/390: fsync d1/db/f4e 0 2024-05-08T05:32:05.426 INFO:tasks.workunit.client.0.smithi087.stdout:7/393: symlink d2/d6/d12/d15/l7f 0 2024-05-08T05:32:05.426 INFO:tasks.workunit.client.0.smithi087.stdout:7/394: dread - d2/d6/d12/f43 zero size 2024-05-08T05:32:05.428 INFO:tasks.workunit.client.0.smithi087.stdout:9/391: mkdir d1/d70 0 2024-05-08T05:32:05.428 INFO:tasks.workunit.client.0.smithi087.stdout:9/392: write d1/df/d14/d18/f1e [720579,34610] 0 2024-05-08T05:32:05.428 INFO:tasks.workunit.client.0.smithi087.stdout:9/393: dread - d1/df/d14/f6e zero size 2024-05-08T05:32:05.428 INFO:tasks.workunit.client.0.smithi087.stdout:8/332: dwrite db/d23/d15/d29/f52 [0,4194304] 0 2024-05-08T05:32:05.429 INFO:tasks.workunit.client.0.smithi087.stdout:7/395: link d2/d6/d12/d1d/c16 d2/c80 0 2024-05-08T05:32:05.430 INFO:tasks.workunit.client.0.smithi087.stdout:9/394: truncate d1/df/d14/d18/f44 2393952 0 2024-05-08T05:32:05.431 INFO:tasks.workunit.client.0.smithi087.stdout:8/333: mkdir db/d23/d15/d29/d33/d3b/d56/d78 0 2024-05-08T05:32:05.434 INFO:tasks.workunit.client.0.smithi087.stdout:9/395: creat d1/db/d28/d4b/f71 x:0 0 0 2024-05-08T05:32:05.434 INFO:tasks.workunit.client.0.smithi087.stdout:3/344: dwrite d4/d14/f29 [0,4194304] 0 2024-05-08T05:32:05.435 INFO:tasks.workunit.client.0.smithi087.stdout:4/364: dwrite d4/f6e [0,4194304] 0 2024-05-08T05:32:05.435 INFO:tasks.workunit.client.0.smithi087.stdout:4/365: chown d4/d13/d65/d4e/f54 764490 1 2024-05-08T05:32:05.435 INFO:tasks.workunit.client.0.smithi087.stdout:4/366: write d4/d13/d32/d66/f74 [864901,87279] 0 2024-05-08T05:32:05.435 INFO:tasks.workunit.client.0.smithi087.stdout:4/367: write d4/d13/d32/d66/d84/d5d/f6d [917469,14851] 0 2024-05-08T05:32:05.436 INFO:tasks.workunit.client.0.smithi087.stdout:8/334: rename db/d23/d1b/d35/d43/d68/d6a/d76 to db/d23/d15/d29/d79 0 2024-05-08T05:32:05.439 INFO:tasks.workunit.client.0.smithi087.stdout:3/345: creat d4/d11/d24/d25/d3e/d58/f76 x:0 0 0 2024-05-08T05:32:05.445 INFO:tasks.workunit.client.0.smithi087.stdout:7/396: dread d2/d6/d12/d19/f1e [0,4194304] 0 2024-05-08T05:32:05.449 INFO:tasks.workunit.client.0.smithi087.stdout:4/368: unlink d4/d13/d3e/f62 0 2024-05-08T05:32:05.455 INFO:tasks.workunit.client.0.smithi087.stdout:8/335: creat db/d23/d1b/d35/d43/d68/f7a x:0 0 0 2024-05-08T05:32:05.455 INFO:tasks.workunit.client.0.smithi087.stdout:5/344: dwrite da/dd/d10/d42/d50/f52 [0,4194304] 0 2024-05-08T05:32:05.455 INFO:tasks.workunit.client.0.smithi087.stdout:3/346: symlink d4/d11/d3d/l77 0 2024-05-08T05:32:05.455 INFO:tasks.workunit.client.0.smithi087.stdout:3/347: write d4/d11/d24/d25/d3e/d58/f76 [980206,102471] 0 2024-05-08T05:32:05.461 INFO:tasks.workunit.client.0.smithi087.stdout:5/345: mknod da/dd/d10/d36/d45/c6e 0 2024-05-08T05:32:05.472 INFO:tasks.workunit.client.0.smithi087.stdout:3/348: symlink d4/d11/d3d/d4e/d6a/l78 0 2024-05-08T05:32:05.472 INFO:tasks.workunit.client.0.smithi087.stdout:5/346: symlink da/dd/d10/l6f 0 2024-05-08T05:32:05.475 INFO:tasks.workunit.client.0.smithi087.stdout:3/349: creat d4/d11/d24/d25/d3e/d3f/f79 x:0 0 0 2024-05-08T05:32:05.475 INFO:tasks.workunit.client.0.smithi087.stdout:3/350: readlink d4/d11/l67 0 2024-05-08T05:32:05.493 INFO:tasks.workunit.client.0.smithi087.stdout:8/336: dread db/d23/d15/f21 [0,4194304] 0 2024-05-08T05:32:05.494 INFO:tasks.workunit.client.0.smithi087.stdout:8/337: truncate db/d23/f38 5458395 0 2024-05-08T05:32:05.495 INFO:tasks.workunit.client.0.smithi087.stdout:5/347: dread da/dd/d65/f68 [0,4194304] 0 2024-05-08T05:32:05.495 INFO:tasks.workunit.client.0.smithi087.stdout:7/397: dwrite d2/da/f4c [0,4194304] 0 2024-05-08T05:32:05.496 INFO:tasks.workunit.client.0.smithi087.stdout:8/338: rmdir db/d23/d1b/d35/d43/d68 39 2024-05-08T05:32:05.497 INFO:tasks.workunit.client.0.smithi087.stdout:7/398: symlink d2/d6/l81 0 2024-05-08T05:32:05.497 INFO:tasks.workunit.client.0.smithi087.stdout:8/339: rmdir db/d23/d1b/d35/d43 39 2024-05-08T05:32:05.498 INFO:tasks.workunit.client.0.smithi087.stdout:7/399: mkdir d2/da/d3f/d4f/d67/d82 0 2024-05-08T05:32:05.499 INFO:tasks.workunit.client.0.smithi087.stdout:8/340: chown db/d23/d15/c27 22632832 1 2024-05-08T05:32:05.499 INFO:tasks.workunit.client.0.smithi087.stdout:8/341: rename db/d23/d15 to db/d23/d15/d29/d33/d3b/d56/d7b 22 2024-05-08T05:32:05.499 INFO:tasks.workunit.client.0.smithi087.stdout:8/342: write db/d23/f2d [1568750,54663] 0 2024-05-08T05:32:05.499 INFO:tasks.workunit.client.0.smithi087.stdout:8/343: fsync db/d23/d15/d29/f62 0 2024-05-08T05:32:05.499 INFO:tasks.workunit.client.0.smithi087.stdout:3/351: dread d4/d11/d24/f69 [0,4194304] 0 2024-05-08T05:32:05.499 INFO:tasks.workunit.client.0.smithi087.stdout:3/352: chown d4/d11/d24/d25/l62 2658595 1 2024-05-08T05:32:05.500 INFO:tasks.workunit.client.0.smithi087.stdout:7/400: mknod d2/c83 0 2024-05-08T05:32:05.500 INFO:tasks.workunit.client.0.smithi087.stdout:7/401: dread - d2/d6/d12/f51 zero size 2024-05-08T05:32:05.500 INFO:tasks.workunit.client.0.smithi087.stdout:7/402: fdatasync d2/d6/d12/f51 0 2024-05-08T05:32:05.500 INFO:tasks.workunit.client.0.smithi087.stdout:8/344: mkdir db/d23/d1b/d7c 0 2024-05-08T05:32:05.501 INFO:tasks.workunit.client.0.smithi087.stdout:7/403: unlink d2/d6/d12/d19/d2a/f60 0 2024-05-08T05:32:05.501 INFO:tasks.workunit.client.0.smithi087.stdout:7/404: chown d2/c80 691038 1 2024-05-08T05:32:05.502 INFO:tasks.workunit.client.0.smithi087.stdout:8/345: symlink db/d23/d15/d29/d33/d6c/l7d 0 2024-05-08T05:32:05.502 INFO:tasks.workunit.client.0.smithi087.stdout:8/346: dread - db/d23/d15/d29/d33/d3b/f4c zero size 2024-05-08T05:32:05.502 INFO:tasks.workunit.client.0.smithi087.stdout:8/347: fsync db/d23/d1b/d35/d43/d68/d6a/f73 0 2024-05-08T05:32:05.503 INFO:tasks.workunit.client.0.smithi087.stdout:8/348: creat db/d23/d15/d29/d33/d6c/f7e x:0 0 0 2024-05-08T05:32:05.504 INFO:tasks.workunit.client.0.smithi087.stdout:8/349: unlink db/f37 0 2024-05-08T05:32:05.505 INFO:tasks.workunit.client.0.smithi087.stdout:8/350: creat db/d23/d15/d29/d33/f7f x:0 0 0 2024-05-08T05:32:05.506 INFO:tasks.workunit.client.0.smithi087.stdout:8/351: dread - db/d23/d15/d29/f32 zero size 2024-05-08T05:32:05.506 INFO:tasks.workunit.client.0.smithi087.stdout:8/352: fdatasync db/d23/d1b/f30 0 2024-05-08T05:32:05.506 INFO:tasks.workunit.client.0.smithi087.stdout:8/353: write db/d23/d1b/d35/d43/d68/d6a/f5b [955410,45570] 0 2024-05-08T05:32:05.507 INFO:tasks.workunit.client.0.smithi087.stdout:5/348: dread da/db/f25 [0,4194304] 0 2024-05-08T05:32:05.507 INFO:tasks.workunit.client.0.smithi087.stdout:5/349: fsync da/db/d2a/f67 0 2024-05-08T05:32:05.507 INFO:tasks.workunit.client.0.smithi087.stdout:5/350: fsync da/dd/d10/d42/d50/f6a 0 2024-05-08T05:32:05.507 INFO:tasks.workunit.client.0.smithi087.stdout:8/354: rmdir db/d23/d1b 39 2024-05-08T05:32:05.509 INFO:tasks.workunit.client.0.smithi087.stdout:9/396: dwrite d1/f1a [0,4194304] 0 2024-05-08T05:32:05.511 INFO:tasks.workunit.client.0.smithi087.stdout:6/347: dwrite d4/f4a [0,4194304] 0 2024-05-08T05:32:05.511 INFO:tasks.workunit.client.0.smithi087.stdout:6/348: write d4/d8/df/d1e/d25/d28/d57/f63 [625416,22805] 0 2024-05-08T05:32:05.512 INFO:tasks.workunit.client.0.smithi087.stdout:4/369: dwrite d4/f6e [0,4194304] 0 2024-05-08T05:32:05.512 INFO:tasks.workunit.client.0.smithi087.stdout:4/370: write d4/d13/d3e/f4f [234314,6409] 0 2024-05-08T05:32:05.517 INFO:tasks.workunit.client.0.smithi087.stdout:5/351: symlink da/dd/d10/d42/d50/l70 0 2024-05-08T05:32:05.517 INFO:tasks.workunit.client.0.smithi087.stdout:5/352: chown da/db/c12 5605506 1 2024-05-08T05:32:05.517 INFO:tasks.workunit.client.0.smithi087.stdout:8/355: creat db/d23/d15/d29/d33/f80 x:0 0 0 2024-05-08T05:32:05.517 INFO:tasks.workunit.client.0.smithi087.stdout:9/397: mkdir d1/df/d14/d54/d61/d72 0 2024-05-08T05:32:05.529 INFO:tasks.workunit.client.0.smithi087.stdout:4/371: link d4/d13/d3e/c34 d4/d13/d3e/d28/d35/d56/c87 0 2024-05-08T05:32:05.529 INFO:tasks.workunit.client.0.smithi087.stdout:4/372: readlink d4/lf 0 2024-05-08T05:32:05.531 INFO:tasks.workunit.client.0.smithi087.stdout:6/349: dread d4/f4a [0,4194304] 0 2024-05-08T05:32:05.532 INFO:tasks.workunit.client.0.smithi087.stdout:5/353: creat da/db/f71 x:0 0 0 2024-05-08T05:32:05.532 INFO:tasks.workunit.client.0.smithi087.stdout:5/354: chown da/dd/d13/l3f 635098 1 2024-05-08T05:32:05.533 INFO:tasks.workunit.client.0.smithi087.stdout:8/356: symlink db/d23/d1b/d7c/l81 0 2024-05-08T05:32:05.535 INFO:tasks.workunit.client.0.smithi087.stdout:9/398: mkdir d1/df/d73 0 2024-05-08T05:32:05.537 INFO:tasks.workunit.client.0.smithi087.stdout:4/373: rename d4/d13/d3e/d28/d35/f41 to d4/d13/d3e/f88 0 2024-05-08T05:32:05.538 INFO:tasks.workunit.client.0.smithi087.stdout:6/350: unlink d4/d8/f35 0 2024-05-08T05:32:05.539 INFO:tasks.workunit.client.0.smithi087.stdout:9/399: rmdir d1/df/d14/d68 39 2024-05-08T05:32:05.539 INFO:tasks.workunit.client.0.smithi087.stdout:9/400: write d1/db/d28/f62 [198203,71630] 0 2024-05-08T05:32:05.540 INFO:tasks.workunit.client.0.smithi087.stdout:6/351: truncate d4/f5e 8194595 0 2024-05-08T05:32:05.541 INFO:tasks.workunit.client.0.smithi087.stdout:9/401: getdents d1/df/d37 0 2024-05-08T05:32:05.545 INFO:tasks.workunit.client.0.smithi087.stdout:7/405: dwrite d2/da/d3f/d49/d59/f62 [0,4194304] 0 2024-05-08T05:32:05.552 INFO:tasks.workunit.client.0.smithi087.stdout:6/352: rename d4/fd to d4/d6/f69 0 2024-05-08T05:32:05.552 INFO:tasks.workunit.client.0.smithi087.stdout:0/341: sync 2024-05-08T05:32:05.552 INFO:tasks.workunit.client.0.smithi087.stdout:0/342: readlink d0/da/d11/l56 0 2024-05-08T05:32:05.552 INFO:tasks.workunit.client.0.smithi087.stdout:0/343: getdents d0/d9/df/d6d 0 2024-05-08T05:32:05.556 INFO:tasks.workunit.client.0.smithi087.stdout:7/406: rmdir d2 39 2024-05-08T05:32:05.560 INFO:tasks.workunit.client.0.smithi087.stdout:7/407: stat d2/d6/d12/d19/c58 0 2024-05-08T05:32:05.561 INFO:tasks.workunit.client.0.smithi087.stdout:7/408: fsync d2/da/d3f/d72/d77/d54/d55/f7e 0 2024-05-08T05:32:05.561 INFO:tasks.workunit.client.0.smithi087.stdout:3/353: dwrite d4/f71 [0,4194304] 0 2024-05-08T05:32:05.562 INFO:tasks.workunit.client.0.smithi087.stdout:3/354: creat d4/d11/d24/d25/d3e/d58/f7a x:0 0 0 2024-05-08T05:32:05.563 INFO:tasks.workunit.client.0.smithi087.stdout:3/355: creat d4/d11/d24/d25/d3e/d3f/f7b x:0 0 0 2024-05-08T05:32:05.568 INFO:tasks.workunit.client.0.smithi087.stdout:3/356: rename d4/d11/d24/d25/l62 to d4/d11/d3d/d64/l7c 0 2024-05-08T05:32:05.573 INFO:tasks.workunit.client.0.smithi087.stdout:6/353: dread d4/d6/f13 [0,4194304] 0 2024-05-08T05:32:05.574 INFO:tasks.workunit.client.0.smithi087.stdout:8/357: dwrite db/d23/d15/f1e [0,4194304] 0 2024-05-08T05:32:05.583 INFO:tasks.workunit.client.0.smithi087.stdout:6/354: rmdir d4/d8/df/d1e 39 2024-05-08T05:32:05.583 INFO:tasks.workunit.client.0.smithi087.stdout:6/355: write d4/d8/d61/f65 [503048,101794] 0 2024-05-08T05:32:05.583 INFO:tasks.workunit.client.0.smithi087.stdout:6/356: write d4/d8/f3c [1338696,98878] 0 2024-05-08T05:32:05.585 INFO:tasks.workunit.client.0.smithi087.stdout:5/355: dwrite da/dd/d10/f40 [0,4194304] 0 2024-05-08T05:32:05.585 INFO:tasks.workunit.client.0.smithi087.stdout:5/356: dread - da/dd/f59 zero size 2024-05-08T05:32:05.587 INFO:tasks.workunit.client.0.smithi087.stdout:7/409: write d2/d6/d12/f47 [1811563,64439] 0 2024-05-08T05:32:05.588 INFO:tasks.workunit.client.0.smithi087.stdout:1/309: sync 2024-05-08T05:32:05.588 INFO:tasks.workunit.client.0.smithi087.stdout:2/327: sync 2024-05-08T05:32:05.588 INFO:tasks.workunit.client.0.smithi087.stdout:6/357: mkdir d4/d8/df/d39/d42/d6a 0 2024-05-08T05:32:05.591 INFO:tasks.workunit.client.0.smithi087.stdout:1/310: rename df/d2f/d4f/l63 to df/d2f/l69 0 2024-05-08T05:32:05.591 INFO:tasks.workunit.client.0.smithi087.stdout:2/328: mknod d7/de/d55/c67 0 2024-05-08T05:32:05.591 INFO:tasks.workunit.client.0.smithi087.stdout:2/329: fsync d7/f18 0 2024-05-08T05:32:05.591 INFO:tasks.workunit.client.0.smithi087.stdout:2/330: truncate d7/de/d27/d33/d49/f5a 926276 0 2024-05-08T05:32:05.592 INFO:tasks.workunit.client.0.smithi087.stdout:6/358: unlink d4/d8/df/d1e/f43 0 2024-05-08T05:32:05.594 INFO:tasks.workunit.client.0.smithi087.stdout:1/311: mkdir df/d2f/d6a 0 2024-05-08T05:32:05.594 INFO:tasks.workunit.client.0.smithi087.stdout:6/359: stat d4/d8/l3a 0 2024-05-08T05:32:05.595 INFO:tasks.workunit.client.0.smithi087.stdout:2/331: mknod d7/de/d27/d33/d65/c68 0 2024-05-08T05:32:05.596 INFO:tasks.workunit.client.0.smithi087.stdout:1/312: symlink df/d18/d1d/d27/l6b 0 2024-05-08T05:32:05.596 INFO:tasks.workunit.client.0.smithi087.stdout:1/313: chown df/d2f/d4f/f65 1 1 2024-05-08T05:32:05.596 INFO:tasks.workunit.client.0.smithi087.stdout:1/314: write df/f3b [1023018,10599] 0 2024-05-08T05:32:05.597 INFO:tasks.workunit.client.0.smithi087.stdout:7/410: rmdir d2/d6/d12/d19/d5f 0 2024-05-08T05:32:05.598 INFO:tasks.workunit.client.0.smithi087.stdout:1/315: link df/d18/d1d/d27/c34 df/d18/d1d/d27/d61/c6c 0 2024-05-08T05:32:05.600 INFO:tasks.workunit.client.0.smithi087.stdout:7/411: symlink d2/d6/d12/d15/d5b/l84 0 2024-05-08T05:32:05.600 INFO:tasks.workunit.client.0.smithi087.stdout:4/374: dwrite d4/d13/f31 [0,4194304] 0 2024-05-08T05:32:05.600 INFO:tasks.workunit.client.0.smithi087.stdout:7/412: write d2/d6/d12/d15/f46 [1720385,7609] 0 2024-05-08T05:32:05.600 INFO:tasks.workunit.client.0.smithi087.stdout:6/360: rmdir d4/d8/df/d1e/d25/d28 39 2024-05-08T05:32:05.602 INFO:tasks.workunit.client.0.smithi087.stdout:2/332: dread d7/de/d27/d33/d49/f5a [0,4194304] 0 2024-05-08T05:32:05.603 INFO:tasks.workunit.client.0.smithi087.stdout:1/316: stat df/d18/d1d/d27/d61/c6c 0 2024-05-08T05:32:05.603 INFO:tasks.workunit.client.0.smithi087.stdout:1/317: chown df/d18/d1d/l33 7241872 1 2024-05-08T05:32:05.603 INFO:tasks.workunit.client.0.smithi087.stdout:7/413: link d2/d6/d12/d19/f1e d2/da/f85 0 2024-05-08T05:32:05.603 INFO:tasks.workunit.client.0.smithi087.stdout:7/414: write d2/d6/d12/f51 [446726,51857] 0 2024-05-08T05:32:05.604 INFO:tasks.workunit.client.0.smithi087.stdout:8/358: write f3 [10075313,59370] 0 2024-05-08T05:32:05.604 INFO:tasks.workunit.client.0.smithi087.stdout:8/359: chown db/d23/d1b 1419 1 2024-05-08T05:32:05.605 INFO:tasks.workunit.client.0.smithi087.stdout:5/357: dread da/dd/d13/d16/f54 [0,4194304] 0 2024-05-08T05:32:05.605 INFO:tasks.workunit.client.0.smithi087.stdout:5/358: chown da/f48 13 1 2024-05-08T05:32:05.606 INFO:tasks.workunit.client.0.smithi087.stdout:2/333: rename d7/de/d27/d33/d49/l4a to d7/de/d5d/l69 0 2024-05-08T05:32:05.606 INFO:tasks.workunit.client.0.smithi087.stdout:1/318: creat df/d18/d1d/d27/f6d x:0 0 0 2024-05-08T05:32:05.608 INFO:tasks.workunit.client.0.smithi087.stdout:5/359: symlink da/dd/d10/d17/l72 0 2024-05-08T05:32:05.610 INFO:tasks.workunit.client.0.smithi087.stdout:2/334: mkdir d7/d6a 0 2024-05-08T05:32:05.611 INFO:tasks.workunit.client.0.smithi087.stdout:8/360: dread db/f12 [0,4194304] 0 2024-05-08T05:32:05.612 INFO:tasks.workunit.client.0.smithi087.stdout:5/360: unlink da/dd/d10/d42/f64 0 2024-05-08T05:32:05.612 INFO:tasks.workunit.client.0.smithi087.stdout:5/361: fsync da/dd/d10/d42/d50/f6a 0 2024-05-08T05:32:05.612 INFO:tasks.workunit.client.0.smithi087.stdout:5/362: truncate da/dd/d10/d17/f3a 1574753 0 2024-05-08T05:32:05.613 INFO:tasks.workunit.client.0.smithi087.stdout:2/335: rmdir d7/de/d27/d33/d65 39 2024-05-08T05:32:05.614 INFO:tasks.workunit.client.0.smithi087.stdout:8/361: symlink db/d23/l82 0 2024-05-08T05:32:05.616 INFO:tasks.workunit.client.0.smithi087.stdout:5/363: mknod da/c73 0 2024-05-08T05:32:05.616 INFO:tasks.workunit.client.0.smithi087.stdout:5/364: write da/db/d2a/d5a/f5b [923544,130676] 0 2024-05-08T05:32:05.618 INFO:tasks.workunit.client.0.smithi087.stdout:2/336: creat d7/de/d55/f6b x:0 0 0 2024-05-08T05:32:05.619 INFO:tasks.workunit.client.0.smithi087.stdout:4/375: write d4/d13/d3e/f38 [6398401,53367] 0 2024-05-08T05:32:05.619 INFO:tasks.workunit.client.0.smithi087.stdout:4/376: readlink d4/d13/d3e/d28/l73 0 2024-05-08T05:32:05.621 INFO:tasks.workunit.client.0.smithi087.stdout:0/344: dwrite d0/f6c [0,4194304] 0 2024-05-08T05:32:05.621 INFO:tasks.workunit.client.0.smithi087.stdout:1/319: write df/d18/d1d/f2d [496821,51302] 0 2024-05-08T05:32:05.624 INFO:tasks.workunit.client.0.smithi087.stdout:8/362: mkdir db/d23/d3a/d65/d83 0 2024-05-08T05:32:05.624 INFO:tasks.workunit.client.0.smithi087.stdout:2/337: mknod d7/de/d27/d33/c6c 0 2024-05-08T05:32:05.624 INFO:tasks.workunit.client.0.smithi087.stdout:2/338: fsync d7/de/d2c/f4c 0 2024-05-08T05:32:05.624 INFO:tasks.workunit.client.0.smithi087.stdout:2/339: stat d7/de/d2c/c3e 0 2024-05-08T05:32:05.624 INFO:tasks.workunit.client.0.smithi087.stdout:7/415: dread d2/d6/d12/d19/f2d [0,4194304] 0 2024-05-08T05:32:05.625 INFO:tasks.workunit.client.0.smithi087.stdout:4/377: mkdir d4/d13/d3e/d28/d89 0 2024-05-08T05:32:05.626 INFO:tasks.workunit.client.0.smithi087.stdout:6/361: write d4/f12 [1601943,61714] 0 2024-05-08T05:32:05.626 INFO:tasks.workunit.client.0.smithi087.stdout:6/362: truncate d4/d8/df/d1e/d25/d28/d2d/d37/d45/f64 160353 0 2024-05-08T05:32:05.626 INFO:tasks.workunit.client.0.smithi087.stdout:5/365: read da/dd/d13/d16/f54 [453439,13785] 0 2024-05-08T05:32:05.627 INFO:tasks.workunit.client.0.smithi087.stdout:3/357: dwrite d4/d11/d24/d25/f54 [0,4194304] 0 2024-05-08T05:32:05.631 INFO:tasks.workunit.client.0.smithi087.stdout:8/363: link db/d23/d15/d29/f32 db/d23/d15/d29/d4d/f84 0 2024-05-08T05:32:05.631 INFO:tasks.workunit.client.0.smithi087.stdout:2/340: link d7/f18 d7/de/d27/d33/d49/f6d 0 2024-05-08T05:32:05.631 INFO:tasks.workunit.client.0.smithi087.stdout:0/345: truncate d0/da/d11/f43 470532 0 2024-05-08T05:32:05.632 INFO:tasks.workunit.client.0.smithi087.stdout:7/416: unlink d2/d6/f44 0 2024-05-08T05:32:05.635 INFO:tasks.workunit.client.0.smithi087.stdout:6/363: creat d4/d8/df/d1e/d25/d28/d2d/d37/d45/f6b x:0 0 0 2024-05-08T05:32:05.635 INFO:tasks.workunit.client.0.smithi087.stdout:6/364: read d4/d8/d61/f65 [530069,110610] 0 2024-05-08T05:32:05.635 INFO:tasks.workunit.client.0.smithi087.stdout:6/365: truncate d4/d8/df/d1e/d25/d28/d2d/d37/d45/f68 634116 0 2024-05-08T05:32:05.638 INFO:tasks.workunit.client.0.smithi087.stdout:5/366: symlink da/db/d2a/d5a/l74 0 2024-05-08T05:32:05.642 INFO:tasks.workunit.client.0.smithi087.stdout:2/341: unlink d7/de/d2c/d43/l4e 0 2024-05-08T05:32:05.642 INFO:tasks.workunit.client.0.smithi087.stdout:8/364: creat db/d23/d15/f85 x:0 0 0 2024-05-08T05:32:05.645 INFO:tasks.workunit.client.0.smithi087.stdout:6/366: creat d4/f6c x:0 0 0 2024-05-08T05:32:05.646 INFO:tasks.workunit.client.0.smithi087.stdout:6/367: chown d4/d8/df/d1e/d25/c4f 101 1 2024-05-08T05:32:05.647 INFO:tasks.workunit.client.0.smithi087.stdout:2/342: rename d7/de/d27/d33/c6c to d7/de/d2c/c6e 0 2024-05-08T05:32:05.649 INFO:tasks.workunit.client.0.smithi087.stdout:0/346: read d0/da/f30 [2391810,55926] 0 2024-05-08T05:32:05.649 INFO:tasks.workunit.client.0.smithi087.stdout:8/365: creat db/d23/d1b/d35/d43/d68/f86 x:0 0 0 2024-05-08T05:32:05.653 INFO:tasks.workunit.client.0.smithi087.stdout:6/368: mkdir d4/d8/df/d1e/d25/d28/d57/d6d 0 2024-05-08T05:32:05.655 INFO:tasks.workunit.client.0.smithi087.stdout:2/343: rename d7/c2f to d7/de/d2c/c6f 0 2024-05-08T05:32:05.656 INFO:tasks.workunit.client.0.smithi087.stdout:2/344: write d7/de/d27/d33/d49/f6d [4308215,61155] 0 2024-05-08T05:32:05.656 INFO:tasks.workunit.client.0.smithi087.stdout:4/378: dread d4/d13/d3e/f38 [4194304,4194304] 0 2024-05-08T05:32:05.659 INFO:tasks.workunit.client.0.smithi087.stdout:6/369: creat d4/d8/df/d39/d42/f6e x:0 0 0 2024-05-08T05:32:05.659 INFO:tasks.workunit.client.0.smithi087.stdout:0/347: creat d0/d57/f77 x:0 0 0 2024-05-08T05:32:05.659 INFO:tasks.workunit.client.0.smithi087.stdout:0/348: chown d0/d57/d24 1703539313 1 2024-05-08T05:32:05.659 INFO:tasks.workunit.client.0.smithi087.stdout:0/349: write d0/d9/df/d74/d51/f62 [642356,49160] 0 2024-05-08T05:32:05.659 INFO:tasks.workunit.client.0.smithi087.stdout:0/350: chown d0/da/d11/l3f 8380 1 2024-05-08T05:32:05.661 INFO:tasks.workunit.client.0.smithi087.stdout:4/379: symlink d4/d13/d3e/d28/l8a 0 2024-05-08T05:32:05.663 INFO:tasks.workunit.client.0.smithi087.stdout:6/370: mkdir d4/d8/d61/d6f 0 2024-05-08T05:32:05.663 INFO:tasks.workunit.client.0.smithi087.stdout:6/371: chown d4/d8/df/d1e/d25/d28/d57/d6d 16 1 2024-05-08T05:32:05.664 INFO:tasks.workunit.client.0.smithi087.stdout:0/351: creat d0/da/f78 x:0 0 0 2024-05-08T05:32:05.664 INFO:tasks.workunit.client.0.smithi087.stdout:0/352: chown d0/da/fe 2 1 2024-05-08T05:32:05.665 INFO:tasks.workunit.client.0.smithi087.stdout:3/358: dwrite d4/d11/d24/d25/d3e/d58/f6d [0,4194304] 0 2024-05-08T05:32:05.668 INFO:tasks.workunit.client.0.smithi087.stdout:4/380: rmdir d4/d13/d32/d66/d84/d5d 39 2024-05-08T05:32:05.668 INFO:tasks.workunit.client.0.smithi087.stdout:6/372: symlink d4/d8/l70 0 2024-05-08T05:32:05.672 INFO:tasks.workunit.client.0.smithi087.stdout:3/359: creat d4/d11/d24/d25/d3e/d58/f7d x:0 0 0 2024-05-08T05:32:05.672 INFO:tasks.workunit.client.0.smithi087.stdout:3/360: chown d4/d11/d3d/d48/f6c 79 1 2024-05-08T05:32:05.672 INFO:tasks.workunit.client.0.smithi087.stdout:3/361: write d4/f71 [4882573,37022] 0 2024-05-08T05:32:05.672 INFO:tasks.workunit.client.0.smithi087.stdout:3/362: dread - d4/d11/d24/d25/d3e/d58/f7a zero size 2024-05-08T05:32:05.672 INFO:tasks.workunit.client.0.smithi087.stdout:3/363: chown d4/d11/d24/d39/c5e 55066758 1 2024-05-08T05:32:05.674 INFO:tasks.workunit.client.0.smithi087.stdout:6/373: rename d4/d8/c26 to d4/d8/df/d1e/d25/d28/d2d/d37/c71 0 2024-05-08T05:32:05.676 INFO:tasks.workunit.client.0.smithi087.stdout:3/364: creat d4/d11/f7e x:0 0 0 2024-05-08T05:32:05.676 INFO:tasks.workunit.client.0.smithi087.stdout:3/365: write d4/f1d [318122,91690] 0 2024-05-08T05:32:05.679 INFO:tasks.workunit.client.0.smithi087.stdout:1/320: dwrite df/d2f/d41/f5f [0,4194304] 0 2024-05-08T05:32:05.680 INFO:tasks.workunit.client.0.smithi087.stdout:3/366: mknod d4/d11/d3d/c7f 0 2024-05-08T05:32:05.680 INFO:tasks.workunit.client.0.smithi087.stdout:3/367: chown d4/d11 414657979 1 2024-05-08T05:32:05.690 INFO:tasks.workunit.client.0.smithi087.stdout:0/353: write d0/d9/d1b/d5e/f6b [3369718,83930] 0 2024-05-08T05:32:05.692 INFO:tasks.workunit.client.0.smithi087.stdout:7/417: truncate d2/da/d3f/d72/d77/d54/d55/f7e 2043028 0 2024-05-08T05:32:05.692 INFO:tasks.workunit.client.0.smithi087.stdout:3/368: rename d4/d14/f63 to d4/d11/d3d/d4e/f80 0 2024-05-08T05:32:05.692 INFO:tasks.workunit.client.0.smithi087.stdout:3/369: stat d4/d11/d3d/c41 0 2024-05-08T05:32:05.692 INFO:tasks.workunit.client.0.smithi087.stdout:3/370: chown d4/d11/d24/c70 710566 1 2024-05-08T05:32:05.692 INFO:tasks.workunit.client.0.smithi087.stdout:3/371: dread - d4/d11/d24/d39/d5a/f6b zero size 2024-05-08T05:32:05.697 INFO:tasks.workunit.client.0.smithi087.stdout:6/374: dread d4/d8/d61/f65 [0,4194304] 0 2024-05-08T05:32:05.702 INFO:tasks.workunit.client.0.smithi087.stdout:0/354: creat d0/d22/d3c/f79 x:0 0 0 2024-05-08T05:32:05.702 INFO:tasks.workunit.client.0.smithi087.stdout:7/418: unlink d2/da/d3f/d72/d77/d54/d50/c7a 0 2024-05-08T05:32:05.702 INFO:tasks.workunit.client.0.smithi087.stdout:7/419: fdatasync d2/da/d3f/d72/d77/d54/d50/f56 0 2024-05-08T05:32:05.703 INFO:tasks.workunit.client.0.smithi087.stdout:3/372: rename d4/d11/d3d/d48/f6c to d4/d11/d3d/d4e/d6a/f81 0 2024-05-08T05:32:05.703 INFO:tasks.workunit.client.0.smithi087.stdout:3/373: fdatasync d4/d11/d3d/f5b 0 2024-05-08T05:32:05.706 INFO:tasks.workunit.client.0.smithi087.stdout:6/375: creat d4/d8/df/d1e/d25/f72 x:0 0 0 2024-05-08T05:32:05.707 INFO:tasks.workunit.client.0.smithi087.stdout:0/355: symlink d0/d9/d1b/d2f/l7a 0 2024-05-08T05:32:05.709 INFO:tasks.workunit.client.0.smithi087.stdout:3/374: rename d4/l35 to d4/d11/d24/d25/d4d/l82 0 2024-05-08T05:32:05.709 INFO:tasks.workunit.client.0.smithi087.stdout:3/375: chown d4/d11/d3d/f47 7666 1 2024-05-08T05:32:05.710 INFO:tasks.workunit.client.0.smithi087.stdout:6/376: truncate d4/d8/f67 334020 0 2024-05-08T05:32:05.710 INFO:tasks.workunit.client.0.smithi087.stdout:6/377: write d4/d8/df/d1e/d25/f3f [6193294,69949] 0 2024-05-08T05:32:05.710 INFO:tasks.workunit.client.0.smithi087.stdout:6/378: stat d4/d8/d61 0 2024-05-08T05:32:05.711 INFO:tasks.workunit.client.0.smithi087.stdout:5/367: dwrite da/dd/d10/d17/f3a [0,4194304] 0 2024-05-08T05:32:05.711 INFO:tasks.workunit.client.0.smithi087.stdout:5/368: chown da/db/d2a/d46/c4c 31 1 2024-05-08T05:32:05.711 INFO:tasks.workunit.client.0.smithi087.stdout:0/356: unlink d0/da/fe 0 2024-05-08T05:32:05.712 INFO:tasks.workunit.client.0.smithi087.stdout:6/379: creat d4/d8/f73 x:0 0 0 2024-05-08T05:32:05.712 INFO:tasks.workunit.client.0.smithi087.stdout:6/380: dread - d4/d6/f60 zero size 2024-05-08T05:32:05.712 INFO:tasks.workunit.client.0.smithi087.stdout:6/381: fdatasync d4/d8/df/d1e/d25/f59 0 2024-05-08T05:32:05.715 INFO:tasks.workunit.client.0.smithi087.stdout:4/381: dwrite f1 [0,4194304] 0 2024-05-08T05:32:05.720 INFO:tasks.workunit.client.0.smithi087.stdout:5/369: getdents da/dd/d13 0 2024-05-08T05:32:05.722 INFO:tasks.workunit.client.0.smithi087.stdout:0/357: mknod d0/d57/d24/c7b 0 2024-05-08T05:32:05.728 INFO:tasks.workunit.client.0.smithi087.stdout:6/382: rename d4/d8/df/d1e/d25/f59 to d4/d8/df/d1e/d25/d28/f74 0 2024-05-08T05:32:05.728 INFO:tasks.workunit.client.0.smithi087.stdout:4/382: creat d4/f8b x:0 0 0 2024-05-08T05:32:05.729 INFO:tasks.workunit.client.0.smithi087.stdout:4/383: chown d4/d13/f31 0 1 2024-05-08T05:32:05.730 INFO:tasks.workunit.client.0.smithi087.stdout:3/376: dread d4/d11/d3d/f51 [0,4194304] 0 2024-05-08T05:32:05.730 INFO:tasks.workunit.client.0.smithi087.stdout:3/377: truncate d4/f3c 4846942 0 2024-05-08T05:32:05.730 INFO:tasks.workunit.client.0.smithi087.stdout:3/378: chown d4/d11/f7e 27331792 1 2024-05-08T05:32:05.731 INFO:tasks.workunit.client.0.smithi087.stdout:0/358: creat d0/d9/f7c x:0 0 0 2024-05-08T05:32:05.731 INFO:tasks.workunit.client.0.smithi087.stdout:0/359: rename d0/d9/d1b/d5e to d0/d9/d1b/d5e/d7d 22 2024-05-08T05:32:05.735 INFO:tasks.workunit.client.0.smithi087.stdout:3/379: creat d4/d11/d24/d25/d4d/f83 x:0 0 0 2024-05-08T05:32:05.735 INFO:tasks.workunit.client.0.smithi087.stdout:3/380: chown d4/d11/d24/f69 948643 1 2024-05-08T05:32:05.736 INFO:tasks.workunit.client.0.smithi087.stdout:6/383: getdents d4/d8 0 2024-05-08T05:32:05.736 INFO:tasks.workunit.client.0.smithi087.stdout:6/384: truncate d4/d8/f3c 1696536 0 2024-05-08T05:32:05.736 INFO:tasks.workunit.client.0.smithi087.stdout:6/385: chown d4/d6/f60 384465 1 2024-05-08T05:32:05.736 INFO:tasks.workunit.client.0.smithi087.stdout:6/386: write d4/f12 [3429793,19192] 0 2024-05-08T05:32:05.736 INFO:tasks.workunit.client.0.smithi087.stdout:6/387: write d4/f66 [602310,86383] 0 2024-05-08T05:32:05.737 INFO:tasks.workunit.client.0.smithi087.stdout:0/360: link d0/da/f47 d0/d9/f7e 0 2024-05-08T05:32:05.742 INFO:tasks.workunit.client.0.smithi087.stdout:0/361: creat d0/d9/d1b/f7f x:0 0 0 2024-05-08T05:32:05.750 INFO:tasks.workunit.client.0.smithi087.stdout:9/402: sync 2024-05-08T05:32:05.750 INFO:tasks.workunit.client.0.smithi087.stdout:8/366: dwrite db/d23/d1b/d35/d43/d68/d6a/f73 [0,4194304] 0 2024-05-08T05:32:05.752 INFO:tasks.workunit.client.0.smithi087.stdout:8/367: creat db/d23/d15/d29/d33/d3b/d56/f87 x:0 0 0 2024-05-08T05:32:05.764 INFO:tasks.workunit.client.0.smithi087.stdout:8/368: mknod db/d23/d15/d29/d79/c88 0 2024-05-08T05:32:05.764 INFO:tasks.workunit.client.0.smithi087.stdout:8/369: fdatasync db/d23/f64 0 2024-05-08T05:32:05.767 INFO:tasks.workunit.client.0.smithi087.stdout:8/370: unlink db/f5e 0 2024-05-08T05:32:05.769 INFO:tasks.workunit.client.0.smithi087.stdout:7/420: dwrite d2/da/f85 [4194304,4194304] 0 2024-05-08T05:32:05.772 INFO:tasks.workunit.client.0.smithi087.stdout:2/345: dwrite d7/de/d27/d33/f1c [0,4194304] 0 2024-05-08T05:32:05.774 INFO:tasks.workunit.client.0.smithi087.stdout:7/421: link d2/d6/d12/d1d/f3a d2/da/f86 0 2024-05-08T05:32:05.776 INFO:tasks.workunit.client.0.smithi087.stdout:2/346: link d7/de/d27/d33/c61 d7/de/d2c/c70 0 2024-05-08T05:32:05.780 INFO:tasks.workunit.client.0.smithi087.stdout:7/422: rename d2/da/d3f/d72/d77/c74 to d2/d6/d12/c87 0 2024-05-08T05:32:05.780 INFO:tasks.workunit.client.0.smithi087.stdout:2/347: creat d7/de/d27/d33/f71 x:0 0 0 2024-05-08T05:32:05.781 INFO:tasks.workunit.client.0.smithi087.stdout:8/371: dread db/d23/d15/d3c/f3f [0,4194304] 0 2024-05-08T05:32:05.781 INFO:tasks.workunit.client.0.smithi087.stdout:8/372: fsync db/d23/d1b/d35/d43/f50 0 2024-05-08T05:32:05.785 INFO:tasks.workunit.client.0.smithi087.stdout:9/403: write d1/df/d14/d18/f67 [180095,87589] 0 2024-05-08T05:32:05.785 INFO:tasks.workunit.client.0.smithi087.stdout:9/404: chown d1/d70 4906 1 2024-05-08T05:32:05.785 INFO:tasks.workunit.client.0.smithi087.stdout:4/384: dwrite d4/d13/d3e/d28/d50/d5a/f5e [0,4194304] 0 2024-05-08T05:32:05.788 INFO:tasks.workunit.client.0.smithi087.stdout:4/385: link l3 d4/d6c/l8c 0 2024-05-08T05:32:05.789 INFO:tasks.workunit.client.0.smithi087.stdout:4/386: write d4/d13/d32/d66/f74 [1733853,36350] 0 2024-05-08T05:32:05.791 INFO:tasks.workunit.client.0.smithi087.stdout:4/387: mkdir d4/d13/d32/d8d 0 2024-05-08T05:32:05.791 INFO:tasks.workunit.client.0.smithi087.stdout:4/388: dread - d4/f7f zero size 2024-05-08T05:32:05.792 INFO:tasks.workunit.client.0.smithi087.stdout:4/389: creat d4/f8e x:0 0 0 2024-05-08T05:32:05.793 INFO:tasks.workunit.client.0.smithi087.stdout:9/405: dread d1/db/f5d [0,4194304] 0 2024-05-08T05:32:05.793 INFO:tasks.workunit.client.0.smithi087.stdout:9/406: chown d1/df/d14/f2f 554863072 1 2024-05-08T05:32:05.796 INFO:tasks.workunit.client.0.smithi087.stdout:9/407: mkdir d1/df/d37/d74 0 2024-05-08T05:32:05.797 INFO:tasks.workunit.client.0.smithi087.stdout:9/408: creat d1/db/d28/f75 x:0 0 0 2024-05-08T05:32:05.798 INFO:tasks.workunit.client.0.smithi087.stdout:9/409: write d1/db/fc [5202440,116834] 0 2024-05-08T05:32:05.798 INFO:tasks.workunit.client.0.smithi087.stdout:9/410: write d1/f30 [2454907,61621] 0 2024-05-08T05:32:05.798 INFO:tasks.workunit.client.0.smithi087.stdout:9/411: dread - d1/df/d58/d5e/f65 zero size 2024-05-08T05:32:05.800 INFO:tasks.workunit.client.0.smithi087.stdout:9/412: rename d1/df/d14/d54/d61/f2d to d1/df/d58/f76 0 2024-05-08T05:32:05.805 INFO:tasks.workunit.client.0.smithi087.stdout:0/362: dwrite d0/da/f30 [0,4194304] 0 2024-05-08T05:32:05.806 INFO:tasks.workunit.client.0.smithi087.stdout:5/370: dwrite da/dd/d10/d36/f5f [0,4194304] 0 2024-05-08T05:32:05.806 INFO:tasks.workunit.client.0.smithi087.stdout:2/348: dread d7/fd [0,4194304] 0 2024-05-08T05:32:05.807 INFO:tasks.workunit.client.0.smithi087.stdout:0/363: write d0/d22/d3c/f79 [953133,116147] 0 2024-05-08T05:32:05.807 INFO:tasks.workunit.client.0.smithi087.stdout:0/364: write d0/da/f5f [498992,57981] 0 2024-05-08T05:32:05.810 INFO:tasks.workunit.client.0.smithi087.stdout:5/371: unlink da/dd/d13/c29 0 2024-05-08T05:32:05.810 INFO:tasks.workunit.client.0.smithi087.stdout:5/372: chown da/db/d2a/d5a 0 1 2024-05-08T05:32:05.810 INFO:tasks.workunit.client.0.smithi087.stdout:5/373: truncate da/f30 581128 0 2024-05-08T05:32:05.811 INFO:tasks.workunit.client.0.smithi087.stdout:2/349: creat d7/de/d27/f72 x:0 0 0 2024-05-08T05:32:05.812 INFO:tasks.workunit.client.0.smithi087.stdout:2/350: write d7/de/d27/f66 [838246,39047] 0 2024-05-08T05:32:05.815 INFO:tasks.workunit.client.0.smithi087.stdout:5/374: getdents da/dd 0 2024-05-08T05:32:05.818 INFO:tasks.workunit.client.0.smithi087.stdout:6/388: dwrite d4/d8/df/f31 [0,4194304] 0 2024-05-08T05:32:05.819 INFO:tasks.workunit.client.0.smithi087.stdout:2/351: rename d7/de/d27/d33/l4b to d7/de/d27/d33/d49/l73 0 2024-05-08T05:32:05.819 INFO:tasks.workunit.client.0.smithi087.stdout:2/352: write d7/de/d27/d33/d49/f5a [1436499,130158] 0 2024-05-08T05:32:05.821 INFO:tasks.workunit.client.0.smithi087.stdout:0/365: getdents d0/d57 0 2024-05-08T05:32:05.823 INFO:tasks.workunit.client.0.smithi087.stdout:5/375: truncate da/dd/d10/f40 616537 0 2024-05-08T05:32:05.824 INFO:tasks.workunit.client.0.smithi087.stdout:6/389: creat d4/d6/f75 x:0 0 0 2024-05-08T05:32:05.825 INFO:tasks.workunit.client.0.smithi087.stdout:6/390: creat d4/d8/df/d1e/d25/d28/d57/f76 x:0 0 0 2024-05-08T05:32:05.826 INFO:tasks.workunit.client.0.smithi087.stdout:6/391: mknod d4/d8/df/d1e/d25/d28/d2d/d37/c77 0 2024-05-08T05:32:05.827 INFO:tasks.workunit.client.0.smithi087.stdout:6/392: rmdir d4/d8/df/d1e/d25/d28/d2d/d37/d5b 39 2024-05-08T05:32:05.832 INFO:tasks.workunit.client.0.smithi087.stdout:2/353: write d7/de/d27/d33/f30 [1647747,21223] 0 2024-05-08T05:32:05.837 INFO:tasks.workunit.client.0.smithi087.stdout:5/376: read da/db/f25 [2244220,14865] 0 2024-05-08T05:32:05.837 INFO:tasks.workunit.client.0.smithi087.stdout:6/393: link d4/d8/l22 d4/d8/df/d39/d42/l78 0 2024-05-08T05:32:05.837 INFO:tasks.workunit.client.0.smithi087.stdout:6/394: write d4/f5e [8633716,99352] 0 2024-05-08T05:32:05.838 INFO:tasks.workunit.client.0.smithi087.stdout:7/423: dwrite d2/d6/d12/d15/f5c [0,4194304] 0 2024-05-08T05:32:05.842 INFO:tasks.workunit.client.0.smithi087.stdout:5/377: link da/dd/d10/d17/l72 da/dd/d56/l75 0 2024-05-08T05:32:05.842 INFO:tasks.workunit.client.0.smithi087.stdout:5/378: readlink da/dd/d56/l75 0 2024-05-08T05:32:05.845 INFO:tasks.workunit.client.0.smithi087.stdout:6/395: creat d4/d8/df/d1e/d25/d28/f79 x:0 0 0 2024-05-08T05:32:05.848 INFO:tasks.workunit.client.0.smithi087.stdout:6/396: fdatasync d4/d8/df/f31 0 2024-05-08T05:32:05.848 INFO:tasks.workunit.client.0.smithi087.stdout:5/379: dread da/f30 [0,4194304] 0 2024-05-08T05:32:05.849 INFO:tasks.workunit.client.0.smithi087.stdout:5/380: truncate da/db/f71 108786 0 2024-05-08T05:32:05.850 INFO:tasks.workunit.client.0.smithi087.stdout:6/397: write d4/d8/df/d1e/d25/d28/d2d/d37/d45/f68 [246325,52848] 0 2024-05-08T05:32:05.850 INFO:tasks.workunit.client.0.smithi087.stdout:6/398: fdatasync d4/d8/fb 0 2024-05-08T05:32:05.850 INFO:tasks.workunit.client.0.smithi087.stdout:6/399: write d4/d8/df/d1e/d25/f3f [6443360,60685] 0 2024-05-08T05:32:05.850 INFO:tasks.workunit.client.0.smithi087.stdout:6/400: write d4/f12 [1644807,104454] 0 2024-05-08T05:32:05.850 INFO:tasks.workunit.client.0.smithi087.stdout:6/401: dread - d4/d8/df/d1e/d25/d28/d2d/d37/d5b/f5f zero size 2024-05-08T05:32:05.850 INFO:tasks.workunit.client.0.smithi087.stdout:5/381: creat da/dd/d10/d36/f76 x:0 0 0 2024-05-08T05:32:05.852 INFO:tasks.workunit.client.0.smithi087.stdout:6/402: link d4/d8/df/d1e/d25/d28/d2d/d37/d45/f68 d4/d8/df/d39/f7a 0 2024-05-08T05:32:05.852 INFO:tasks.workunit.client.0.smithi087.stdout:6/403: fsync d4/f4a 0 2024-05-08T05:32:05.854 INFO:tasks.workunit.client.0.smithi087.stdout:5/382: creat da/db/d2a/f77 x:0 0 0 2024-05-08T05:32:05.854 INFO:tasks.workunit.client.0.smithi087.stdout:5/383: readlink da/db/l34 0 2024-05-08T05:32:05.855 INFO:tasks.workunit.client.0.smithi087.stdout:6/404: symlink d4/d8/df/d1e/d25/d28/d2d/d37/d45/l7b 0 2024-05-08T05:32:05.857 INFO:tasks.workunit.client.0.smithi087.stdout:5/384: creat da/dd/d10/d36/d45/d5c/f78 x:0 0 0 2024-05-08T05:32:05.857 INFO:tasks.workunit.client.0.smithi087.stdout:5/385: chown da/dd 2 1 2024-05-08T05:32:05.858 INFO:tasks.workunit.client.0.smithi087.stdout:6/405: mknod d4/d8/df/d1e/d25/d28/d57/c7c 0 2024-05-08T05:32:05.858 INFO:tasks.workunit.client.0.smithi087.stdout:6/406: dread - d4/d8/df/d1e/d25/d28/d2d/d37/d45/f6b zero size 2024-05-08T05:32:05.862 INFO:tasks.workunit.client.0.smithi087.stdout:5/386: symlink da/db/l79 0 2024-05-08T05:32:05.863 INFO:tasks.workunit.client.0.smithi087.stdout:7/424: truncate d2/d6/d12/d19/f1e 1251176 0 2024-05-08T05:32:05.863 INFO:tasks.workunit.client.0.smithi087.stdout:7/425: stat d2/d6/d12/d1d/f3a 0 2024-05-08T05:32:05.863 INFO:tasks.workunit.client.0.smithi087.stdout:1/321: sync 2024-05-08T05:32:05.864 INFO:tasks.workunit.client.0.smithi087.stdout:5/387: creat da/dd/d56/f7a x:0 0 0 2024-05-08T05:32:05.865 INFO:tasks.workunit.client.0.smithi087.stdout:7/426: mkdir d2/da/d3f/d72/d77/d54/d50/d88 0 2024-05-08T05:32:05.876 INFO:tasks.workunit.client.0.smithi087.stdout:2/354: dwrite d7/de/d27/d33/f30 [0,4194304] 0 2024-05-08T05:32:05.877 INFO:tasks.workunit.client.0.smithi087.stdout:5/388: rename da/dd/d10/d17/c51 to da/dd/d10/d42/c7b 0 2024-05-08T05:32:05.877 INFO:tasks.workunit.client.0.smithi087.stdout:7/427: mkdir d2/d6/d12/d19/d2a/d89 0 2024-05-08T05:32:05.877 INFO:tasks.workunit.client.0.smithi087.stdout:7/428: write d2/da/d3f/f30 [4829813,12945] 0 2024-05-08T05:32:05.880 INFO:tasks.workunit.client.0.smithi087.stdout:2/355: creat d7/d63/f74 x:0 0 0 2024-05-08T05:32:05.880 INFO:tasks.workunit.client.0.smithi087.stdout:2/356: dread - d7/d63/f60 zero size 2024-05-08T05:32:05.882 INFO:tasks.workunit.client.0.smithi087.stdout:5/389: dread da/db/f71 [0,4194304] 0 2024-05-08T05:32:05.882 INFO:tasks.workunit.client.0.smithi087.stdout:5/390: readlink da/db/d2a/d5a/l74 0 2024-05-08T05:32:05.882 INFO:tasks.workunit.client.0.smithi087.stdout:7/429: unlink d2/d6/d12/d19/f22 0 2024-05-08T05:32:05.883 INFO:tasks.workunit.client.0.smithi087.stdout:5/391: creat da/dd/d13/f7c x:0 0 0 2024-05-08T05:32:05.884 INFO:tasks.workunit.client.0.smithi087.stdout:3/381: sync 2024-05-08T05:32:05.885 INFO:tasks.workunit.client.0.smithi087.stdout:3/382: write d4/d11/d24/d25/d3e/f65 [30521,30254] 0 2024-05-08T05:32:05.886 INFO:tasks.workunit.client.0.smithi087.stdout:7/430: link d2/d6/d12/d19/f73 d2/da/d3f/d66/f8a 0 2024-05-08T05:32:05.888 INFO:tasks.workunit.client.0.smithi087.stdout:3/383: mkdir d4/d14/d84 0 2024-05-08T05:32:05.891 INFO:tasks.workunit.client.0.smithi087.stdout:7/431: rename d2/da/d3f/d72/d77/f45 to d2/da/d3f/d72/f8b 0 2024-05-08T05:32:05.891 INFO:tasks.workunit.client.0.smithi087.stdout:7/432: chown d2/da/d3f/d72/d77/d54/d50/f56 2484644 1 2024-05-08T05:32:05.892 INFO:tasks.workunit.client.0.smithi087.stdout:3/384: creat d4/d14/f85 x:0 0 0 2024-05-08T05:32:05.892 INFO:tasks.workunit.client.0.smithi087.stdout:3/385: chown d4/d11/d24/d25/d4d/f68 13894 1 2024-05-08T05:32:05.892 INFO:tasks.workunit.client.0.smithi087.stdout:3/386: mknod d4/d14/d84/c86 0 2024-05-08T05:32:05.893 INFO:tasks.workunit.client.0.smithi087.stdout:3/387: write d4/d11/d3d/d4e/d6a/f81 [643884,122178] 0 2024-05-08T05:32:05.893 INFO:tasks.workunit.client.0.smithi087.stdout:3/388: dread - d4/d11/d24/d25/d3e/d58/f7d zero size 2024-05-08T05:32:05.893 INFO:tasks.workunit.client.0.smithi087.stdout:2/357: dread f5 [4194304,4194304] 0 2024-05-08T05:32:05.893 INFO:tasks.workunit.client.0.smithi087.stdout:2/358: fsync d7/f17 0 2024-05-08T05:32:05.894 INFO:tasks.workunit.client.0.smithi087.stdout:3/389: truncate d4/d11/f19 742748 0 2024-05-08T05:32:05.895 INFO:tasks.workunit.client.0.smithi087.stdout:2/359: creat d7/de/d27/f75 x:0 0 0 2024-05-08T05:32:05.895 INFO:tasks.workunit.client.0.smithi087.stdout:2/360: write d7/f37 [623771,129113] 0 2024-05-08T05:32:05.895 INFO:tasks.workunit.client.0.smithi087.stdout:2/361: chown d7/de/d27/d33/d49/f5a 6 1 2024-05-08T05:32:05.895 INFO:tasks.workunit.client.0.smithi087.stdout:2/362: fdatasync d7/de/d27/f72 0 2024-05-08T05:32:05.896 INFO:tasks.workunit.client.0.smithi087.stdout:2/363: fdatasync d7/de/d27/d33/f47 0 2024-05-08T05:32:05.899 INFO:tasks.workunit.client.0.smithi087.stdout:3/390: mkdir d4/d11/d24/d39/d60/d87 0 2024-05-08T05:32:05.899 INFO:tasks.workunit.client.0.smithi087.stdout:2/364: creat d7/de/d27/d33/f76 x:0 0 0 2024-05-08T05:32:05.899 INFO:tasks.workunit.client.0.smithi087.stdout:3/391: truncate d4/d11/d24/d25/d3e/d58/f7a 798932 0 2024-05-08T05:32:05.899 INFO:tasks.workunit.client.0.smithi087.stdout:3/392: write d4/d11/d24/d25/d3e/f46 [1147142,116510] 0 2024-05-08T05:32:05.902 INFO:tasks.workunit.client.0.smithi087.stdout:2/365: creat d7/de/d27/d33/f77 x:0 0 0 2024-05-08T05:32:05.902 INFO:tasks.workunit.client.0.smithi087.stdout:2/366: read - d7/de/d27/f44 zero size 2024-05-08T05:32:05.906 INFO:tasks.workunit.client.0.smithi087.stdout:2/367: mkdir d7/de/d78 0 2024-05-08T05:32:05.906 INFO:tasks.workunit.client.0.smithi087.stdout:2/368: chown d7/c50 8063432 1 2024-05-08T05:32:05.918 INFO:tasks.workunit.client.0.smithi087.stdout:1/322: dwrite df/d2f/f3c [0,4194304] 0 2024-05-08T05:32:05.918 INFO:tasks.workunit.client.0.smithi087.stdout:6/407: dwrite d4/d8/df/d1e/d25/d28/d2d/d37/d45/f64 [0,4194304] 0 2024-05-08T05:32:05.931 INFO:tasks.workunit.client.0.smithi087.stdout:6/408: dread d4/d8/df/d39/f7a [0,4194304] 0 2024-05-08T05:32:05.952 INFO:tasks.workunit.client.0.smithi087.stdout:7/433: dwrite d2/d6/d12/d15/d5b/f63 [0,4194304] 0 2024-05-08T05:32:05.952 INFO:tasks.workunit.client.0.smithi087.stdout:2/369: dwrite d7/f22 [4194304,4194304] 0 2024-05-08T05:32:05.952 INFO:tasks.workunit.client.0.smithi087.stdout:7/434: getdents d2/d6/d12/d15/d5b/d6d 0 2024-05-08T05:32:05.952 INFO:tasks.workunit.client.0.smithi087.stdout:7/435: fdatasync d2/da/d3f/d72/d77/d54/d55/f7e 0 2024-05-08T05:32:05.954 INFO:tasks.workunit.client.0.smithi087.stdout:5/392: dwrite da/dd/d10/d36/f39 [0,4194304] 0 2024-05-08T05:32:05.956 INFO:tasks.workunit.client.0.smithi087.stdout:5/393: rename da/dd/d13/f7c to da/dd/d56/f7d 0 2024-05-08T05:32:05.957 INFO:tasks.workunit.client.0.smithi087.stdout:5/394: getdents da/dd/d10/d17 0 2024-05-08T05:32:05.958 INFO:tasks.workunit.client.0.smithi087.stdout:5/395: getdents da/db/d2a 0 2024-05-08T05:32:05.960 INFO:tasks.workunit.client.0.smithi087.stdout:5/396: creat da/dd/d10/d36/d45/f7e x:0 0 0 2024-05-08T05:32:05.965 INFO:tasks.workunit.client.0.smithi087.stdout:1/323: dwrite df/f24 [0,4194304] 0 2024-05-08T05:32:05.967 INFO:tasks.workunit.client.0.smithi087.stdout:1/324: creat df/d18/d1d/d32/f6e x:0 0 0 2024-05-08T05:32:05.969 INFO:tasks.workunit.client.0.smithi087.stdout:1/325: rename df/c25 to df/d18/d1d/d27/d61/c6f 0 2024-05-08T05:32:05.973 INFO:tasks.workunit.client.0.smithi087.stdout:1/326: symlink df/d2f/d6a/l70 0 2024-05-08T05:32:05.974 INFO:tasks.workunit.client.0.smithi087.stdout:1/327: truncate df/d18/d1d/f3a 802692 0 2024-05-08T05:32:05.975 INFO:tasks.workunit.client.0.smithi087.stdout:2/370: write d7/de/d27/d33/f1c [1256355,63754] 0 2024-05-08T05:32:05.975 INFO:tasks.workunit.client.0.smithi087.stdout:2/371: dread - d7/de/d27/f72 zero size 2024-05-08T05:32:05.977 INFO:tasks.workunit.client.0.smithi087.stdout:2/372: mknod d7/de/d5d/c79 0 2024-05-08T05:32:05.977 INFO:tasks.workunit.client.0.smithi087.stdout:2/373: chown d7/de/d27/f4f 2586116 1 2024-05-08T05:32:05.978 INFO:tasks.workunit.client.0.smithi087.stdout:2/374: write d7/de/d27/f75 [256621,7499] 0 2024-05-08T05:32:05.981 INFO:tasks.workunit.client.0.smithi087.stdout:7/436: truncate d2/d6/d12/d15/d5b/f63 308210 0 2024-05-08T05:32:05.986 INFO:tasks.workunit.client.0.smithi087.stdout:3/393: dwrite d4/d11/d3d/f5b [0,4194304] 0 2024-05-08T05:32:05.995 INFO:tasks.workunit.client.0.smithi087.stdout:6/409: dwrite d4/d8/df/d1e/d25/d28/d2d/d37/f54 [0,4194304] 0 2024-05-08T05:32:05.995 INFO:tasks.workunit.client.0.smithi087.stdout:6/410: chown d4/d8/df/d1e/f23 7329 1 2024-05-08T05:32:05.996 INFO:tasks.workunit.client.0.smithi087.stdout:6/411: getdents d4/d8/df/d39 0 2024-05-08T05:32:05.997 INFO:tasks.workunit.client.0.smithi087.stdout:6/412: unlink d4/d8/df/d1e/d25/c53 0 2024-05-08T05:32:05.998 INFO:tasks.workunit.client.0.smithi087.stdout:6/413: stat d4/f38 0 2024-05-08T05:32:05.998 INFO:tasks.workunit.client.0.smithi087.stdout:5/397: dwrite da/dd/d10/d42/d50/f6a [0,4194304] 0 2024-05-08T05:32:05.999 INFO:tasks.workunit.client.0.smithi087.stdout:6/414: link d4/d8/df/d1e/d25/l46 d4/d8/df/d1e/d52/l7d 0 2024-05-08T05:32:05.999 INFO:tasks.workunit.client.0.smithi087.stdout:6/415: write d4/f12 [2161065,30544] 0 2024-05-08T05:32:06.001 INFO:tasks.workunit.client.0.smithi087.stdout:5/398: creat da/dd/d10/d36/f7f x:0 0 0 2024-05-08T05:32:06.002 INFO:tasks.workunit.client.0.smithi087.stdout:6/416: link d4/d8/df/d1e/d25/d28/d2d/d37/d5b/f5d d4/d8/d61/d6f/f7e 0 2024-05-08T05:32:06.002 INFO:tasks.workunit.client.0.smithi087.stdout:6/417: getdents d4/d8/df/d1e/d25/d28/d2d 0 2024-05-08T05:32:06.002 INFO:tasks.workunit.client.0.smithi087.stdout:6/418: write d4/d8/df/d1e/d25/f2f [2342965,121868] 0 2024-05-08T05:32:06.002 INFO:tasks.workunit.client.0.smithi087.stdout:6/419: write d4/d6/f75 [211129,73839] 0 2024-05-08T05:32:06.005 INFO:tasks.workunit.client.0.smithi087.stdout:5/399: rmdir da/dd/d10 39 2024-05-08T05:32:06.007 INFO:tasks.workunit.client.0.smithi087.stdout:6/420: mkdir d4/d8/d61/d6f/d7f 0 2024-05-08T05:32:06.008 INFO:tasks.workunit.client.0.smithi087.stdout:5/400: creat da/dd/d56/d6b/f80 x:0 0 0 2024-05-08T05:32:06.008 INFO:tasks.workunit.client.0.smithi087.stdout:5/401: chown da/dd/d13/l3f 4799104 1 2024-05-08T05:32:06.008 INFO:tasks.workunit.client.0.smithi087.stdout:5/402: write da/dd/f59 [220096,113648] 0 2024-05-08T05:32:06.009 INFO:tasks.workunit.client.0.smithi087.stdout:6/421: creat d4/d8/df/d1e/d52/f80 x:0 0 0 2024-05-08T05:32:06.009 INFO:tasks.workunit.client.0.smithi087.stdout:5/403: unlink da/db/d2a/d46/l55 0 2024-05-08T05:32:06.012 INFO:tasks.workunit.client.0.smithi087.stdout:6/422: unlink d4/d6/f3d 0 2024-05-08T05:32:06.016 INFO:tasks.workunit.client.0.smithi087.stdout:2/375: dwrite d7/de/d27/d33/d49/f5a [0,4194304] 0 2024-05-08T05:32:06.025 INFO:tasks.workunit.client.0.smithi087.stdout:1/328: dwrite df/d2f/f3c [0,4194304] 0 2024-05-08T05:32:06.026 INFO:tasks.workunit.client.0.smithi087.stdout:3/394: dread d4/d11/d3d/d4e/d6a/f81 [0,4194304] 0 2024-05-08T05:32:06.027 INFO:tasks.workunit.client.0.smithi087.stdout:6/423: creat d4/d8/d61/f81 x:0 0 0 2024-05-08T05:32:06.028 INFO:tasks.workunit.client.0.smithi087.stdout:1/329: creat df/d2f/d57/d64/f71 x:0 0 0 2024-05-08T05:32:06.029 INFO:tasks.workunit.client.0.smithi087.stdout:3/395: creat d4/d14/d84/f88 x:0 0 0 2024-05-08T05:32:06.030 INFO:tasks.workunit.client.0.smithi087.stdout:6/424: creat d4/d8/df/d1e/d25/d28/d57/d6d/f82 x:0 0 0 2024-05-08T05:32:06.030 INFO:tasks.workunit.client.0.smithi087.stdout:6/425: truncate d4/d6/f60 301573 0 2024-05-08T05:32:06.030 INFO:tasks.workunit.client.0.smithi087.stdout:6/426: stat d4/d8/df/d39/c40 0 2024-05-08T05:32:06.032 INFO:tasks.workunit.client.0.smithi087.stdout:1/330: rename df/d2f/d41 to df/d18/d1d/d58/d72 0 2024-05-08T05:32:06.033 INFO:tasks.workunit.client.0.smithi087.stdout:3/396: creat d4/d11/d24/d25/d3e/f89 x:0 0 0 2024-05-08T05:32:06.035 INFO:tasks.workunit.client.0.smithi087.stdout:1/331: link df/d18/d4b/l59 df/d18/d1d/d27/d61/l73 0 2024-05-08T05:32:06.037 INFO:tasks.workunit.client.0.smithi087.stdout:3/397: creat d4/d14/f8a x:0 0 0 2024-05-08T05:32:06.037 INFO:tasks.workunit.client.0.smithi087.stdout:3/398: chown d4/f6 1 1 2024-05-08T05:32:06.037 INFO:tasks.workunit.client.0.smithi087.stdout:3/399: fdatasync d4/d11/d24/d39/d5a/f6b 0 2024-05-08T05:32:06.037 INFO:tasks.workunit.client.0.smithi087.stdout:1/332: symlink df/l74 0 2024-05-08T05:32:06.039 INFO:tasks.workunit.client.0.smithi087.stdout:1/333: creat df/d18/d1d/d58/d72/f75 x:0 0 0 2024-05-08T05:32:06.041 INFO:tasks.workunit.client.0.smithi087.stdout:0/366: sync 2024-05-08T05:32:06.041 INFO:tasks.workunit.client.0.smithi087.stdout:9/413: sync 2024-05-08T05:32:06.041 INFO:tasks.workunit.client.0.smithi087.stdout:8/373: sync 2024-05-08T05:32:06.041 INFO:tasks.workunit.client.0.smithi087.stdout:0/367: chown d0/d9/d1b/l73 77009 1 2024-05-08T05:32:06.044 INFO:tasks.workunit.client.0.smithi087.stdout:4/390: sync 2024-05-08T05:32:06.044 INFO:tasks.workunit.client.0.smithi087.stdout:4/391: chown d4/d13/d3e/d28/d35/d56/l71 553731832 1 2024-05-08T05:32:06.044 INFO:tasks.workunit.client.0.smithi087.stdout:8/374: creat db/d23/d1b/d35/f89 x:0 0 0 2024-05-08T05:32:06.044 INFO:tasks.workunit.client.0.smithi087.stdout:0/368: creat d0/da/d35/f80 x:0 0 0 2024-05-08T05:32:06.044 INFO:tasks.workunit.client.0.smithi087.stdout:4/392: readlink d4/l64 0 2024-05-08T05:32:06.057 INFO:tasks.workunit.client.0.smithi087.stdout:1/334: dread df/d2f/d57/d64/f29 [0,4194304] 0 2024-05-08T05:32:06.059 INFO:tasks.workunit.client.0.smithi087.stdout:3/400: dread d4/d11/d24/d25/d3e/d58/f7a [0,4194304] 0 2024-05-08T05:32:06.074 INFO:tasks.workunit.client.0.smithi087.stdout:5/404: dwrite da/db/d2a/f67 [0,4194304] 0 2024-05-08T05:32:06.083 INFO:tasks.workunit.client.0.smithi087.stdout:3/401: write d4/d11/d24/d25/d3e/d58/f76 [426148,121978] 0 2024-05-08T05:32:06.084 INFO:tasks.workunit.client.0.smithi087.stdout:6/427: dwrite d4/d8/df/d1e/d25/f2f [0,4194304] 0 2024-05-08T05:32:06.088 INFO:tasks.workunit.client.0.smithi087.stdout:6/428: truncate d4/d8/df/d1e/d25/d28/f79 246268 0 2024-05-08T05:32:06.088 INFO:tasks.workunit.client.0.smithi087.stdout:6/429: chown d4/d8/df/l29 29189707 1 2024-05-08T05:32:06.103 INFO:tasks.workunit.client.0.smithi087.stdout:8/375: dwrite db/d23/d15/f36 [0,4194304] 0 2024-05-08T05:32:06.103 INFO:tasks.workunit.client.0.smithi087.stdout:8/376: write db/d23/d1b/d4b/f69 [9070524,15867] 0 2024-05-08T05:32:06.103 INFO:tasks.workunit.client.0.smithi087.stdout:8/377: chown db/d23/d1b/d35/f89 298079 1 2024-05-08T05:32:06.103 INFO:tasks.workunit.client.0.smithi087.stdout:8/378: write db/d23/d1b/f30 [4301355,119227] 0 2024-05-08T05:32:06.104 INFO:tasks.workunit.client.0.smithi087.stdout:6/430: write d4/d8/df/d1e/d25/d28/d2d/d37/d45/f48 [900280,50923] 0 2024-05-08T05:32:06.104 INFO:tasks.workunit.client.0.smithi087.stdout:8/379: rmdir db/d23/d1b/d35 39 2024-05-08T05:32:06.105 INFO:tasks.workunit.client.0.smithi087.stdout:3/402: dread d4/d11/d3d/f45 [0,4194304] 0 2024-05-08T05:32:06.105 INFO:tasks.workunit.client.0.smithi087.stdout:9/414: dwrite d1/fd [0,4194304] 0 2024-05-08T05:32:06.105 INFO:tasks.workunit.client.0.smithi087.stdout:6/431: mknod d4/d8/df/d1e/d25/d28/d2d/d37/c83 0 2024-05-08T05:32:06.106 INFO:tasks.workunit.client.0.smithi087.stdout:1/335: dwrite df/d18/f1b [0,4194304] 0 2024-05-08T05:32:06.106 INFO:tasks.workunit.client.0.smithi087.stdout:3/403: mkdir d4/d14/d84/d8b 0 2024-05-08T05:32:06.107 INFO:tasks.workunit.client.0.smithi087.stdout:9/415: rename d1/f13 to d1/df/d14/d18/f77 0 2024-05-08T05:32:06.109 INFO:tasks.workunit.client.0.smithi087.stdout:3/404: rename d4/d11/d24/c70 to d4/d11/d24/d25/d3e/d58/c8c 0 2024-05-08T05:32:06.114 INFO:tasks.workunit.client.0.smithi087.stdout:8/380: write f8 [2952415,49541] 0 2024-05-08T05:32:06.139 INFO:tasks.workunit.client.0.smithi087.stdout:1/336: dread df/d2f/d57/d64/f45 [0,4194304] 0 2024-05-08T05:32:06.146 INFO:tasks.workunit.client.0.smithi087.stdout:1/337: creat df/d2f/d4f/f76 x:0 0 0 2024-05-08T05:32:06.147 INFO:tasks.workunit.client.0.smithi087.stdout:1/338: mkdir df/d18/d1d/d27/d61/d77 0 2024-05-08T05:32:06.149 INFO:tasks.workunit.client.0.smithi087.stdout:6/432: dwrite d4/d8/f67 [0,4194304] 0 2024-05-08T05:32:06.167 INFO:tasks.workunit.client.0.smithi087.stdout:9/416: dwrite d1/df/d14/d18/f44 [0,4194304] 0 2024-05-08T05:32:06.167 INFO:tasks.workunit.client.0.smithi087.stdout:9/417: chown d1/df/d14/d18/f77 54 1 2024-05-08T05:32:06.168 INFO:tasks.workunit.client.0.smithi087.stdout:3/405: dwrite d4/d14/f1a [0,4194304] 0 2024-05-08T05:32:06.168 INFO:tasks.workunit.client.0.smithi087.stdout:3/406: readlink d4/d11/d24/d25/l2d 0 2024-05-08T05:32:06.169 INFO:tasks.workunit.client.0.smithi087.stdout:9/418: creat d1/df/d14/d54/f78 x:0 0 0 2024-05-08T05:32:06.171 INFO:tasks.workunit.client.0.smithi087.stdout:8/381: dwrite db/d23/d1b/d35/d43/f50 [0,4194304] 0 2024-05-08T05:32:06.176 INFO:tasks.workunit.client.0.smithi087.stdout:8/382: mknod db/d23/d1b/d7c/c8a 0 2024-05-08T05:32:06.183 INFO:tasks.workunit.client.0.smithi087.stdout:9/419: dread d1/f7 [0,4194304] 0 2024-05-08T05:32:06.184 INFO:tasks.workunit.client.0.smithi087.stdout:2/376: sync 2024-05-08T05:32:06.184 INFO:tasks.workunit.client.0.smithi087.stdout:0/369: sync 2024-05-08T05:32:06.184 INFO:tasks.workunit.client.0.smithi087.stdout:5/405: sync 2024-05-08T05:32:06.184 INFO:tasks.workunit.client.0.smithi087.stdout:7/437: sync 2024-05-08T05:32:06.184 INFO:tasks.workunit.client.0.smithi087.stdout:7/438: fdatasync d2/d6/d12/d15/d5b/f63 0 2024-05-08T05:32:06.184 INFO:tasks.workunit.client.0.smithi087.stdout:0/370: write d0/d9/f7e [2479462,3955] 0 2024-05-08T05:32:06.184 INFO:tasks.workunit.client.0.smithi087.stdout:4/393: sync 2024-05-08T05:32:06.184 INFO:tasks.workunit.client.0.smithi087.stdout:4/394: chown l3 75624 1 2024-05-08T05:32:06.188 INFO:tasks.workunit.client.0.smithi087.stdout:9/420: link d1/l36 d1/d70/l79 0 2024-05-08T05:32:06.188 INFO:tasks.workunit.client.0.smithi087.stdout:5/406: creat da/dd/d10/d42/d43/f81 x:0 0 0 2024-05-08T05:32:06.188 INFO:tasks.workunit.client.0.smithi087.stdout:5/407: fdatasync da/dd/d10/d17/f2b 0 2024-05-08T05:32:06.188 INFO:tasks.workunit.client.0.smithi087.stdout:5/408: chown da/dd/d56/f7a 504102581 1 2024-05-08T05:32:06.189 INFO:tasks.workunit.client.0.smithi087.stdout:2/377: getdents d7/de/d55 0 2024-05-08T05:32:06.189 INFO:tasks.workunit.client.0.smithi087.stdout:5/409: creat da/dd/d10/d17/f82 x:0 0 0 2024-05-08T05:32:06.189 INFO:tasks.workunit.client.0.smithi087.stdout:5/410: chown da/dd/d56/d6b 35624633 1 2024-05-08T05:32:06.190 INFO:tasks.workunit.client.0.smithi087.stdout:5/411: chown da/dd/d10 22261 1 2024-05-08T05:32:06.192 INFO:tasks.workunit.client.0.smithi087.stdout:2/378: symlink d7/de/d78/l7a 0 2024-05-08T05:32:06.192 INFO:tasks.workunit.client.0.smithi087.stdout:6/433: dwrite d4/d6/f75 [0,4194304] 0 2024-05-08T05:32:06.192 INFO:tasks.workunit.client.0.smithi087.stdout:6/434: write d4/d8/df/d1e/d25/d28/d2d/d37/d45/f6b [205756,129125] 0 2024-05-08T05:32:06.193 INFO:tasks.workunit.client.0.smithi087.stdout:5/412: rename da/dd/d56 to da/dd/d10/d42/d43/d83 0 2024-05-08T05:32:06.193 INFO:tasks.workunit.client.0.smithi087.stdout:5/413: readlink da/db/l34 0 2024-05-08T05:32:06.193 INFO:tasks.workunit.client.0.smithi087.stdout:6/435: mkdir d4/d8/d61/d6f/d84 0 2024-05-08T05:32:06.195 INFO:tasks.workunit.client.0.smithi087.stdout:7/439: dread d2/da/d3f/d4f/f61 [0,4194304] 0 2024-05-08T05:32:06.208 INFO:tasks.workunit.client.0.smithi087.stdout:6/436: creat d4/d8/d61/d6f/f85 x:0 0 0 2024-05-08T05:32:06.208 INFO:tasks.workunit.client.0.smithi087.stdout:6/437: stat d4/d8/d61 0 2024-05-08T05:32:06.210 INFO:tasks.workunit.client.0.smithi087.stdout:2/379: dread d7/fd [0,4194304] 0 2024-05-08T05:32:06.217 INFO:tasks.workunit.client.0.smithi087.stdout:8/383: dwrite db/d23/f2e [0,4194304] 0 2024-05-08T05:32:06.217 INFO:tasks.workunit.client.0.smithi087.stdout:3/407: dwrite d4/d14/f8a [0,4194304] 0 2024-05-08T05:32:06.219 INFO:tasks.workunit.client.0.smithi087.stdout:7/440: creat d2/d6/d12/d19/d2a/f8c x:0 0 0 2024-05-08T05:32:06.219 INFO:tasks.workunit.client.0.smithi087.stdout:6/438: symlink d4/d8/df/d1e/d52/l86 0 2024-05-08T05:32:06.219 INFO:tasks.workunit.client.0.smithi087.stdout:6/439: getdents d4/d8/d61/d6f/d84 0 2024-05-08T05:32:06.219 INFO:tasks.workunit.client.0.smithi087.stdout:6/440: truncate d4/d8/df/d39/d42/f6e 816801 0 2024-05-08T05:32:06.219 INFO:tasks.workunit.client.0.smithi087.stdout:6/441: write d4/d8/df/d1e/d25/f4b [4261550,42066] 0 2024-05-08T05:32:06.219 INFO:tasks.workunit.client.0.smithi087.stdout:1/339: dwrite df/f3e [4194304,4194304] 0 2024-05-08T05:32:06.219 INFO:tasks.workunit.client.0.smithi087.stdout:6/442: chown d4/d8/df/d1e/d25/d28/d2d/d37/d5b 9154199 1 2024-05-08T05:32:06.219 INFO:tasks.workunit.client.0.smithi087.stdout:6/443: stat d4/f58 0 2024-05-08T05:32:06.219 INFO:tasks.workunit.client.0.smithi087.stdout:1/340: write df/d2f/d57/d64/f71 [678745,63442] 0 2024-05-08T05:32:06.219 INFO:tasks.workunit.client.0.smithi087.stdout:9/421: dread d1/db/d28/f4a [0,4194304] 0 2024-05-08T05:32:06.221 INFO:tasks.workunit.client.0.smithi087.stdout:2/380: mkdir d7/de/d5d/d7b 0 2024-05-08T05:32:06.223 INFO:tasks.workunit.client.0.smithi087.stdout:8/384: link db/d23/c47 db/d23/d15/d29/d33/d3b/d56/d78/c8b 0 2024-05-08T05:32:06.224 INFO:tasks.workunit.client.0.smithi087.stdout:5/414: dread da/dd/d10/d36/d45/f4d [4194304,4194304] 0 2024-05-08T05:32:06.224 INFO:tasks.workunit.client.0.smithi087.stdout:3/408: creat d4/d11/d24/d25/d3e/f8d x:0 0 0 2024-05-08T05:32:06.224 INFO:tasks.workunit.client.0.smithi087.stdout:5/415: write da/db/d2a/f77 [444094,51132] 0 2024-05-08T05:32:06.224 INFO:tasks.workunit.client.0.smithi087.stdout:3/409: write d4/d11/f50 [902907,111109] 0 2024-05-08T05:32:06.225 INFO:tasks.workunit.client.0.smithi087.stdout:7/441: mkdir d2/da/d3f/d72/d77/d54/d8d 0 2024-05-08T05:32:06.227 INFO:tasks.workunit.client.0.smithi087.stdout:1/341: rmdir df/d18/d4b 39 2024-05-08T05:32:06.229 INFO:tasks.workunit.client.0.smithi087.stdout:9/422: symlink d1/df/d14/d18/d66/l7a 0 2024-05-08T05:32:06.231 INFO:tasks.workunit.client.0.smithi087.stdout:2/381: mknod d7/de/d27/c7c 0 2024-05-08T05:32:06.231 INFO:tasks.workunit.client.0.smithi087.stdout:2/382: truncate d7/de/d27/f53 1019726 0 2024-05-08T05:32:06.233 INFO:tasks.workunit.client.0.smithi087.stdout:5/416: mknod da/db/c84 0 2024-05-08T05:32:06.233 INFO:tasks.workunit.client.0.smithi087.stdout:5/417: write da/f2e [4518541,65167] 0 2024-05-08T05:32:06.233 INFO:tasks.workunit.client.0.smithi087.stdout:5/418: dread - da/dd/d10/d17/f82 zero size 2024-05-08T05:32:06.233 INFO:tasks.workunit.client.0.smithi087.stdout:5/419: readlink da/dd/d13/d16/l58 0 2024-05-08T05:32:06.234 INFO:tasks.workunit.client.0.smithi087.stdout:3/410: creat d4/d11/d3d/f8e x:0 0 0 2024-05-08T05:32:06.236 INFO:tasks.workunit.client.0.smithi087.stdout:7/442: mkdir d2/da/d3f/d49/d59/d8e 0 2024-05-08T05:32:06.240 INFO:tasks.workunit.client.0.smithi087.stdout:9/423: symlink d1/db/l7b 0 2024-05-08T05:32:06.240 INFO:tasks.workunit.client.0.smithi087.stdout:9/424: stat d1/db/l7b 0 2024-05-08T05:32:06.240 INFO:tasks.workunit.client.0.smithi087.stdout:2/383: rmdir d7/d6a 0 2024-05-08T05:32:06.240 INFO:tasks.workunit.client.0.smithi087.stdout:2/384: read d7/de/d27/d33/f1c [2149525,128301] 0 2024-05-08T05:32:06.240 INFO:tasks.workunit.client.0.smithi087.stdout:8/385: link db/d23/f2e db/d23/f8c 0 2024-05-08T05:32:06.242 INFO:tasks.workunit.client.0.smithi087.stdout:3/411: mkdir d4/d14/d84/d8b/d8f 0 2024-05-08T05:32:06.245 INFO:tasks.workunit.client.0.smithi087.stdout:2/385: rename d7/de/d27/f75 to d7/d63/f7d 0 2024-05-08T05:32:06.245 INFO:tasks.workunit.client.0.smithi087.stdout:2/386: fdatasync d7/de/d27/d33/d49/f5a 0 2024-05-08T05:32:06.245 INFO:tasks.workunit.client.0.smithi087.stdout:2/387: chown d7/l32 492901263 1 2024-05-08T05:32:06.246 INFO:tasks.workunit.client.0.smithi087.stdout:5/420: rmdir da 39 2024-05-08T05:32:06.248 INFO:tasks.workunit.client.0.smithi087.stdout:8/386: link db/d23/d1b/d35/c40 db/d23/d3a/d65/d83/c8d 0 2024-05-08T05:32:06.248 INFO:tasks.workunit.client.0.smithi087.stdout:8/387: truncate f8 5078952 0 2024-05-08T05:32:06.249 INFO:tasks.workunit.client.0.smithi087.stdout:3/412: symlink d4/d11/d24/d39/d5a/l90 0 2024-05-08T05:32:06.249 INFO:tasks.workunit.client.0.smithi087.stdout:3/413: write d4/d11/d24/d25/d3e/f46 [1205992,80442] 0 2024-05-08T05:32:06.249 INFO:tasks.workunit.client.0.smithi087.stdout:3/414: fdatasync d4/f3c 0 2024-05-08T05:32:06.250 INFO:tasks.workunit.client.0.smithi087.stdout:5/421: creat da/dd/d10/d36/d45/f85 x:0 0 0 2024-05-08T05:32:06.250 INFO:tasks.workunit.client.0.smithi087.stdout:6/444: dread d4/f12 [0,4194304] 0 2024-05-08T05:32:06.251 INFO:tasks.workunit.client.0.smithi087.stdout:8/388: mknod db/d23/d15/d29/d4d/c8e 0 2024-05-08T05:32:06.251 INFO:tasks.workunit.client.0.smithi087.stdout:8/389: truncate db/d23/d15/d29/d33/f80 949715 0 2024-05-08T05:32:06.252 INFO:tasks.workunit.client.0.smithi087.stdout:7/443: dread d2/da/d3f/d72/f8b [0,4194304] 0 2024-05-08T05:32:06.253 INFO:tasks.workunit.client.0.smithi087.stdout:8/390: rmdir db/d23/d3a 39 2024-05-08T05:32:06.255 INFO:tasks.workunit.client.0.smithi087.stdout:7/444: mknod d2/da/d3f/d49/d59/c8f 0 2024-05-08T05:32:06.255 INFO:tasks.workunit.client.0.smithi087.stdout:8/391: symlink db/d23/d54/l8f 0 2024-05-08T05:32:06.255 INFO:tasks.workunit.client.0.smithi087.stdout:8/392: chown db/f11 770031 1 2024-05-08T05:32:06.255 INFO:tasks.workunit.client.0.smithi087.stdout:7/445: creat d2/d6/f90 x:0 0 0 2024-05-08T05:32:06.256 INFO:tasks.workunit.client.0.smithi087.stdout:7/446: mkdir d2/d6/d12/d19/d2a/d91 0 2024-05-08T05:32:06.258 INFO:tasks.workunit.client.0.smithi087.stdout:7/447: unlink d2/da/d3f/d72/d77/d54/l41 0 2024-05-08T05:32:06.258 INFO:tasks.workunit.client.0.smithi087.stdout:7/448: truncate d2/d6/d12/f47 2317871 0 2024-05-08T05:32:06.259 INFO:tasks.workunit.client.0.smithi087.stdout:7/449: dread - d2/d6/f90 zero size 2024-05-08T05:32:06.277 INFO:tasks.workunit.client.0.smithi087.stdout:6/445: read d4/f5e [3904607,82442] 0 2024-05-08T05:32:06.279 INFO:tasks.workunit.client.0.smithi087.stdout:0/371: dwrite d0/d9/d1b/f7f [0,4194304] 0 2024-05-08T05:32:06.280 INFO:tasks.workunit.client.0.smithi087.stdout:0/372: chown d0/d9/df/d74/d51/f70 89375 1 2024-05-08T05:32:06.283 INFO:tasks.workunit.client.0.smithi087.stdout:0/373: creat d0/d9/df/f81 x:0 0 0 2024-05-08T05:32:06.295 INFO:tasks.workunit.client.0.smithi087.stdout:1/342: dwrite df/d18/d1d/d58/d72/f5f [0,4194304] 0 2024-05-08T05:32:06.296 INFO:tasks.workunit.client.0.smithi087.stdout:0/374: mkdir d0/d9/d1b/d82 0 2024-05-08T05:32:06.296 INFO:tasks.workunit.client.0.smithi087.stdout:0/375: fsync d0/d22/d3c/f79 0 2024-05-08T05:32:06.296 INFO:tasks.workunit.client.0.smithi087.stdout:0/376: chown d0/d9/df/l38 7 1 2024-05-08T05:32:06.296 INFO:tasks.workunit.client.0.smithi087.stdout:0/377: fsync d0/d9/d1b/d5e/f72 0 2024-05-08T05:32:06.296 INFO:tasks.workunit.client.0.smithi087.stdout:0/378: write d0/da/d35/f58 [283007,28935] 0 2024-05-08T05:32:06.297 INFO:tasks.workunit.client.0.smithi087.stdout:7/450: dwrite d2/da/d3f/d72/d77/d54/d55/f7e [0,4194304] 0 2024-05-08T05:32:06.301 INFO:tasks.workunit.client.0.smithi087.stdout:1/343: creat df/d2f/f78 x:0 0 0 2024-05-08T05:32:06.301 INFO:tasks.workunit.client.0.smithi087.stdout:8/393: dread db/f12 [0,4194304] 0 2024-05-08T05:32:06.302 INFO:tasks.workunit.client.0.smithi087.stdout:8/394: write db/d23/d15/f85 [446006,92007] 0 2024-05-08T05:32:06.302 INFO:tasks.workunit.client.0.smithi087.stdout:8/395: dread - db/d23/d1b/f2b zero size 2024-05-08T05:32:06.302 INFO:tasks.workunit.client.0.smithi087.stdout:5/422: dwrite da/dd/d10/d36/f76 [0,4194304] 0 2024-05-08T05:32:06.304 INFO:tasks.workunit.client.0.smithi087.stdout:0/379: rename d0/d9/df/f81 to d0/d9/df/d74/d51/f83 0 2024-05-08T05:32:06.304 INFO:tasks.workunit.client.0.smithi087.stdout:0/380: chown d0/d9/df/f15 253091277 1 2024-05-08T05:32:06.304 INFO:tasks.workunit.client.0.smithi087.stdout:0/381: chown d0/da/d35 33247278 1 2024-05-08T05:32:06.305 INFO:tasks.workunit.client.0.smithi087.stdout:7/451: mknod d2/da/d3f/d72/d77/c92 0 2024-05-08T05:32:06.306 INFO:tasks.workunit.client.0.smithi087.stdout:5/423: mkdir da/dd/d10/d36/d45/d5c/d86 0 2024-05-08T05:32:06.308 INFO:tasks.workunit.client.0.smithi087.stdout:7/452: rmdir d2/da/d3f/d72/d77/d54/d8d 0 2024-05-08T05:32:06.311 INFO:tasks.workunit.client.0.smithi087.stdout:8/396: truncate db/d23/d1b/f2a 4657105 0 2024-05-08T05:32:06.311 INFO:tasks.workunit.client.0.smithi087.stdout:8/397: dread - db/d23/d15/f72 zero size 2024-05-08T05:32:06.312 INFO:tasks.workunit.client.0.smithi087.stdout:3/415: dwrite d4/d11/d3d/f47 [0,4194304] 0 2024-05-08T05:32:06.313 INFO:tasks.workunit.client.0.smithi087.stdout:3/416: getdents d4/d11/d24/d25/d3e/d3f 0 2024-05-08T05:32:06.315 INFO:tasks.workunit.client.0.smithi087.stdout:8/398: rmdir db/d23/d15/d3c 39 2024-05-08T05:32:06.319 INFO:tasks.workunit.client.0.smithi087.stdout:3/417: mknod d4/d11/d3d/d4e/d6a/c91 0 2024-05-08T05:32:06.321 INFO:tasks.workunit.client.0.smithi087.stdout:3/418: mknod d4/d11/d24/d25/d4d/c92 0 2024-05-08T05:32:06.321 INFO:tasks.workunit.client.0.smithi087.stdout:3/419: write d4/d11/d24/f26 [901594,42865] 0 2024-05-08T05:32:06.321 INFO:tasks.workunit.client.0.smithi087.stdout:3/420: readlink d4/d11/d3d/d64/l7c 0 2024-05-08T05:32:06.322 INFO:tasks.workunit.client.0.smithi087.stdout:3/421: mknod d4/d11/d3d/d64/c93 0 2024-05-08T05:32:06.334 INFO:tasks.workunit.client.0.smithi087.stdout:6/446: dwrite d4/d8/df/d1e/d25/f3f [4194304,4194304] 0 2024-05-08T05:32:06.334 INFO:tasks.workunit.client.0.smithi087.stdout:8/399: write db/d23/d1b/d35/d43/d68/d6a/f73 [403960,107818] 0 2024-05-08T05:32:06.335 INFO:tasks.workunit.client.0.smithi087.stdout:6/447: mknod d4/d8/df/d1e/d25/d28/c87 0 2024-05-08T05:32:06.336 INFO:tasks.workunit.client.0.smithi087.stdout:8/400: creat db/d23/d15/f90 x:0 0 0 2024-05-08T05:32:06.337 INFO:tasks.workunit.client.0.smithi087.stdout:8/401: creat db/d23/d1b/d4b/f91 x:0 0 0 2024-05-08T05:32:06.338 INFO:tasks.workunit.client.0.smithi087.stdout:8/402: mknod db/d23/d15/c92 0 2024-05-08T05:32:06.340 INFO:tasks.workunit.client.0.smithi087.stdout:8/403: rename db/l61 to db/l93 0 2024-05-08T05:32:06.340 INFO:tasks.workunit.client.0.smithi087.stdout:8/404: chown db/f25 0 1 2024-05-08T05:32:06.340 INFO:tasks.workunit.client.0.smithi087.stdout:8/405: stat db/d23/d15/c27 0 2024-05-08T05:32:06.340 INFO:tasks.workunit.client.0.smithi087.stdout:4/395: sync 2024-05-08T05:32:06.341 INFO:tasks.workunit.client.0.smithi087.stdout:8/406: mknod db/d23/d15/d3c/c94 0 2024-05-08T05:32:06.343 INFO:tasks.workunit.client.0.smithi087.stdout:4/396: creat d4/d13/d3e/d28/d50/d5a/f8f x:0 0 0 2024-05-08T05:32:06.343 INFO:tasks.workunit.client.0.smithi087.stdout:4/397: readlink d4/d6c/l81 0 2024-05-08T05:32:06.343 INFO:tasks.workunit.client.0.smithi087.stdout:6/448: dread d4/d8/df/d1e/d25/f4e [0,4194304] 0 2024-05-08T05:32:06.344 INFO:tasks.workunit.client.0.smithi087.stdout:4/398: rename d4/d13/d3e/d28/d89 to d4/d13/d3e/d28/d35/d90 0 2024-05-08T05:32:06.344 INFO:tasks.workunit.client.0.smithi087.stdout:4/399: fsync d4/d13/f31 0 2024-05-08T05:32:06.346 INFO:tasks.workunit.client.0.smithi087.stdout:7/453: dwrite d2/d6/d12/f51 [0,4194304] 0 2024-05-08T05:32:06.350 INFO:tasks.workunit.client.0.smithi087.stdout:7/454: link d2/c83 d2/d6/d12/d19/d2a/d91/c93 0 2024-05-08T05:32:06.350 INFO:tasks.workunit.client.0.smithi087.stdout:7/455: chown d2/d6/f25 1076 1 2024-05-08T05:32:06.351 INFO:tasks.workunit.client.0.smithi087.stdout:4/400: rename d4/d13/d32/d66 to d4/d13/d32/d8d/d91 0 2024-05-08T05:32:06.354 INFO:tasks.workunit.client.0.smithi087.stdout:4/401: creat d4/d13/d32/f92 x:0 0 0 2024-05-08T05:32:06.354 INFO:tasks.workunit.client.0.smithi087.stdout:4/402: stat d4/d13/d65/c5f 0 2024-05-08T05:32:06.359 INFO:tasks.workunit.client.0.smithi087.stdout:8/407: dread f2 [0,4194304] 0 2024-05-08T05:32:06.360 INFO:tasks.workunit.client.0.smithi087.stdout:8/408: mkdir db/d23/d15/d29/d79/d95 0 2024-05-08T05:32:06.361 INFO:tasks.workunit.client.0.smithi087.stdout:8/409: fsync db/d23/d15/d29/d33/f77 0 2024-05-08T05:32:06.361 INFO:tasks.workunit.client.0.smithi087.stdout:8/410: chown db/d23/d1b/d35/d43/f50 859383083 1 2024-05-08T05:32:06.361 INFO:tasks.workunit.client.0.smithi087.stdout:8/411: mkdir db/d23/d15/d29/d4d/d96 0 2024-05-08T05:32:06.363 INFO:tasks.workunit.client.0.smithi087.stdout:1/344: dwrite df/d18/d1d/f2d [0,4194304] 0 2024-05-08T05:32:06.363 INFO:tasks.workunit.client.0.smithi087.stdout:1/345: readlink df/d18/l2a 0 2024-05-08T05:32:06.364 INFO:tasks.workunit.client.0.smithi087.stdout:1/346: creat df/d2f/d4f/f79 x:0 0 0 2024-05-08T05:32:06.364 INFO:tasks.workunit.client.0.smithi087.stdout:1/347: dread - df/d2f/f78 zero size 2024-05-08T05:32:06.369 INFO:tasks.workunit.client.0.smithi087.stdout:8/412: dread db/f12 [0,4194304] 0 2024-05-08T05:32:06.370 INFO:tasks.workunit.client.0.smithi087.stdout:8/413: write db/d23/d1b/d35/d43/d68/f86 [221231,38838] 0 2024-05-08T05:32:06.372 INFO:tasks.workunit.client.0.smithi087.stdout:8/414: rename db/d23/d15/d29/d4d/f84 to db/d23/d1b/d7c/f97 0 2024-05-08T05:32:06.375 INFO:tasks.workunit.client.0.smithi087.stdout:3/422: dwrite d4/d11/d3d/f56 [0,4194304] 0 2024-05-08T05:32:06.394 INFO:tasks.workunit.client.0.smithi087.stdout:6/449: dwrite d4/d8/df/d1e/d25/f72 [0,4194304] 0 2024-05-08T05:32:06.397 INFO:tasks.workunit.client.0.smithi087.stdout:6/450: unlink d4/d8/df/d1e/c30 0 2024-05-08T05:32:06.397 INFO:tasks.workunit.client.0.smithi087.stdout:6/451: symlink d4/d8/df/d1e/d25/d28/d2d/d37/l88 0 2024-05-08T05:32:06.399 INFO:tasks.workunit.client.0.smithi087.stdout:6/452: symlink d4/d8/df/d1e/d25/d28/d57/d6d/l89 0 2024-05-08T05:32:06.399 INFO:tasks.workunit.client.0.smithi087.stdout:7/456: dwrite d2/d6/d12/f47 [0,4194304] 0 2024-05-08T05:32:06.399 INFO:tasks.workunit.client.0.smithi087.stdout:7/457: readlink d2/d6/d12/d19/d2a/l38 0 2024-05-08T05:32:06.400 INFO:tasks.workunit.client.0.smithi087.stdout:4/403: dread d4/f6e [0,4194304] 0 2024-05-08T05:32:06.400 INFO:tasks.workunit.client.0.smithi087.stdout:4/404: stat d4/f10 0 2024-05-08T05:32:06.400 INFO:tasks.workunit.client.0.smithi087.stdout:4/405: dread - d4/d13/d32/f92 zero size 2024-05-08T05:32:06.400 INFO:tasks.workunit.client.0.smithi087.stdout:4/406: chown d4/d13/d32/f45 256 1 2024-05-08T05:32:06.400 INFO:tasks.workunit.client.0.smithi087.stdout:6/453: truncate d4/d8/df/d1e/d25/d28/f74 290808 0 2024-05-08T05:32:06.401 INFO:tasks.workunit.client.0.smithi087.stdout:7/458: getdents d2/da/d3f/d72/d77/d54/d55 0 2024-05-08T05:32:06.402 INFO:tasks.workunit.client.0.smithi087.stdout:4/407: rename d4/d13/d3e/d28/d35/d56 to d4/d6c/d93 0 2024-05-08T05:32:06.403 INFO:tasks.workunit.client.0.smithi087.stdout:6/454: creat d4/d8/df/d1e/d25/f8a x:0 0 0 2024-05-08T05:32:06.406 INFO:tasks.workunit.client.0.smithi087.stdout:7/459: mknod d2/d6/d12/d19/d2a/c94 0 2024-05-08T05:32:06.408 INFO:tasks.workunit.client.0.smithi087.stdout:4/408: rename d4/fe to d4/d13/d32/d8d/d91/f94 0 2024-05-08T05:32:06.411 INFO:tasks.workunit.client.0.smithi087.stdout:3/423: dread d4/f5 [0,4194304] 0 2024-05-08T05:32:06.412 INFO:tasks.workunit.client.0.smithi087.stdout:3/424: read d4/d11/d24/d25/d3e/f46 [1712823,111333] 0 2024-05-08T05:32:06.412 INFO:tasks.workunit.client.0.smithi087.stdout:7/460: rename d2/da/d3f/d72/d77/d54/d50/f56 to d2/da/d3f/d4f/f95 0 2024-05-08T05:32:06.425 INFO:tasks.workunit.client.0.smithi087.stdout:3/425: mkdir d4/d11/d24/d39/d94 0 2024-05-08T05:32:06.425 INFO:tasks.workunit.client.0.smithi087.stdout:7/461: creat d2/da/d3f/d72/d77/d54/d55/f96 x:0 0 0 2024-05-08T05:32:06.425 INFO:tasks.workunit.client.0.smithi087.stdout:7/462: readlink d2/da/d3f/l6c 0 2024-05-08T05:32:06.425 INFO:tasks.workunit.client.0.smithi087.stdout:3/426: mknod d4/d11/d24/d25/c95 0 2024-05-08T05:32:06.427 INFO:tasks.workunit.client.0.smithi087.stdout:8/415: dwrite f4 [0,4194304] 0 2024-05-08T05:32:06.427 INFO:tasks.workunit.client.0.smithi087.stdout:7/463: creat d2/d6/d12/f97 x:0 0 0 2024-05-08T05:32:06.429 INFO:tasks.workunit.client.0.smithi087.stdout:7/464: getdents d2/da/d3f/d49/d59 0 2024-05-08T05:32:06.430 INFO:tasks.workunit.client.0.smithi087.stdout:7/465: rmdir d2/da/d3f/d66 39 2024-05-08T05:32:06.432 INFO:tasks.workunit.client.0.smithi087.stdout:3/427: dread d4/f6 [0,4194304] 0 2024-05-08T05:32:06.432 INFO:tasks.workunit.client.0.smithi087.stdout:1/348: dwrite df/d18/d1d/f2d [0,4194304] 0 2024-05-08T05:32:06.433 INFO:tasks.workunit.client.0.smithi087.stdout:7/466: rename d2/d6/d12/d15/d5b/d6d to d2/da/d3f/d4f/d67/d82/d98 0 2024-05-08T05:32:06.433 INFO:tasks.workunit.client.0.smithi087.stdout:7/467: fsync d2/da/d3f/d66/f8a 0 2024-05-08T05:32:06.433 INFO:tasks.workunit.client.0.smithi087.stdout:7/468: chown d2/d6/c3c 2481 1 2024-05-08T05:32:06.436 INFO:tasks.workunit.client.0.smithi087.stdout:7/469: getdents d2/d6/d12/d19/d2a/d91 0 2024-05-08T05:32:06.443 INFO:tasks.workunit.client.0.smithi087.stdout:4/409: dwrite d4/d13/f3f [0,4194304] 0 2024-05-08T05:32:06.445 INFO:tasks.workunit.client.0.smithi087.stdout:4/410: readlink d4/l1e 0 2024-05-08T05:32:06.445 INFO:tasks.workunit.client.0.smithi087.stdout:4/411: stat d4/d6c/d93 0 2024-05-08T05:32:06.459 INFO:tasks.workunit.client.0.smithi087.stdout:8/416: dread db/f25 [0,4194304] 0 2024-05-08T05:32:06.461 INFO:tasks.workunit.client.0.smithi087.stdout:4/412: dread d4/d13/d3e/d28/d35/f43 [0,4194304] 0 2024-05-08T05:32:06.465 INFO:tasks.workunit.client.0.smithi087.stdout:8/417: creat db/d23/d15/d29/d33/d3b/f98 x:0 0 0 2024-05-08T05:32:06.465 INFO:tasks.workunit.client.0.smithi087.stdout:8/418: chown db/d23/d1b/c2f 66992341 1 2024-05-08T05:32:06.466 INFO:tasks.workunit.client.0.smithi087.stdout:4/413: creat d4/d13/f95 x:0 0 0 2024-05-08T05:32:06.468 INFO:tasks.workunit.client.0.smithi087.stdout:8/419: creat db/d23/d15/f99 x:0 0 0 2024-05-08T05:32:06.481 INFO:tasks.workunit.client.0.smithi087.stdout:7/470: dwrite d2/d6/d12/d1d/f17 [0,4194304] 0 2024-05-08T05:32:06.481 INFO:tasks.workunit.client.0.smithi087.stdout:7/471: write d2/da/f86 [497329,34128] 0 2024-05-08T05:32:06.482 INFO:tasks.workunit.client.0.smithi087.stdout:7/472: symlink d2/d6/l99 0 2024-05-08T05:32:06.482 INFO:tasks.workunit.client.0.smithi087.stdout:7/473: chown d2/da/d3f/d72/d77/d54/d55/d65 2 1 2024-05-08T05:32:06.489 INFO:tasks.workunit.client.0.smithi087.stdout:8/420: write db/d23/d1b/f3d [1815300,120646] 0 2024-05-08T05:32:06.492 INFO:tasks.workunit.client.0.smithi087.stdout:8/421: symlink db/d23/d1b/d7c/l9a 0 2024-05-08T05:32:06.494 INFO:tasks.workunit.client.0.smithi087.stdout:3/428: dwrite d4/d11/d24/f69 [4194304,4194304] 0 2024-05-08T05:32:06.495 INFO:tasks.workunit.client.0.smithi087.stdout:8/422: link db/d23/d1b/d35/c40 db/d23/d15/d3c/c9b 0 2024-05-08T05:32:06.497 INFO:tasks.workunit.client.0.smithi087.stdout:8/423: link db/f59 db/d23/d1b/d7c/f9c 0 2024-05-08T05:32:06.497 INFO:tasks.workunit.client.0.smithi087.stdout:8/424: chown db/d23 890535617 1 2024-05-08T05:32:06.497 INFO:tasks.workunit.client.0.smithi087.stdout:8/425: dread - db/d23/d15/d29/d4d/f55 zero size 2024-05-08T05:32:06.497 INFO:tasks.workunit.client.0.smithi087.stdout:4/414: dwrite d4/f10 [0,4194304] 0 2024-05-08T05:32:06.497 INFO:tasks.workunit.client.0.smithi087.stdout:7/474: dread d2/d6/d12/d15/f5c [0,4194304] 0 2024-05-08T05:32:06.498 INFO:tasks.workunit.client.0.smithi087.stdout:8/426: mkdir db/d23/d54/d9d 0 2024-05-08T05:32:06.499 INFO:tasks.workunit.client.0.smithi087.stdout:4/415: mkdir d4/d13/d65/d4e/d96 0 2024-05-08T05:32:06.499 INFO:tasks.workunit.client.0.smithi087.stdout:4/416: truncate d4/f8e 126657 0 2024-05-08T05:32:06.500 INFO:tasks.workunit.client.0.smithi087.stdout:7/475: mkdir d2/d6/d12/d19/d2a/d89/d9a 0 2024-05-08T05:32:06.502 INFO:tasks.workunit.client.0.smithi087.stdout:4/417: mknod d4/d13/d65/d4e/d96/c97 0 2024-05-08T05:32:06.502 INFO:tasks.workunit.client.0.smithi087.stdout:4/418: write d4/d13/d3e/f38 [7333158,54718] 0 2024-05-08T05:32:06.503 INFO:tasks.workunit.client.0.smithi087.stdout:7/476: symlink d2/da/d3f/d72/d77/d54/d55/d65/l9b 0 2024-05-08T05:32:06.513 INFO:tasks.workunit.client.0.smithi087.stdout:1/349: dwrite df/d2f/f35 [0,4194304] 0 2024-05-08T05:32:06.513 INFO:tasks.workunit.client.0.smithi087.stdout:1/350: stat df/d18 0 2024-05-08T05:32:06.514 INFO:tasks.workunit.client.0.smithi087.stdout:1/351: mknod df/d18/d1d/d27/d61/c7a 0 2024-05-08T05:32:06.515 INFO:tasks.workunit.client.0.smithi087.stdout:1/352: symlink df/d18/d4b/l7b 0 2024-05-08T05:32:06.528 INFO:tasks.workunit.client.0.smithi087.stdout:7/477: dread d2/d6/d12/f47 [0,4194304] 0 2024-05-08T05:32:06.529 INFO:tasks.workunit.client.0.smithi087.stdout:7/478: creat d2/da/d3f/d4f/d67/d82/d98/f9c x:0 0 0 2024-05-08T05:32:06.534 INFO:tasks.workunit.client.0.smithi087.stdout:4/419: dwrite d4/d13/f95 [0,4194304] 0 2024-05-08T05:32:06.534 INFO:tasks.workunit.client.0.smithi087.stdout:4/420: chown d4/d13/d3e 20 1 2024-05-08T05:32:06.534 INFO:tasks.workunit.client.0.smithi087.stdout:4/421: truncate d4/d13/f23 4625384 0 2024-05-08T05:32:06.536 INFO:tasks.workunit.client.0.smithi087.stdout:4/422: mkdir d4/d13/d65/d4e/d63/d98 0 2024-05-08T05:32:06.537 INFO:tasks.workunit.client.0.smithi087.stdout:4/423: creat d4/d6c/f99 x:0 0 0 2024-05-08T05:32:06.546 INFO:tasks.workunit.client.0.smithi087.stdout:9/425: sync 2024-05-08T05:32:06.546 INFO:tasks.workunit.client.0.smithi087.stdout:2/388: sync 2024-05-08T05:32:06.546 INFO:tasks.workunit.client.0.smithi087.stdout:0/382: sync 2024-05-08T05:32:06.546 INFO:tasks.workunit.client.0.smithi087.stdout:9/426: read d1/df/d58/f76 [115547,38607] 0 2024-05-08T05:32:06.548 INFO:tasks.workunit.client.0.smithi087.stdout:2/389: link d7/f17 d7/de/d27/d33/d65/f7e 0 2024-05-08T05:32:06.548 INFO:tasks.workunit.client.0.smithi087.stdout:0/383: mknod d0/d9/df/d74/c84 0 2024-05-08T05:32:06.550 INFO:tasks.workunit.client.0.smithi087.stdout:9/427: link d1/f21 d1/db/d28/f7c 0 2024-05-08T05:32:06.552 INFO:tasks.workunit.client.0.smithi087.stdout:9/428: getdents d1/df/d14/d18/d66 0 2024-05-08T05:32:06.553 INFO:tasks.workunit.client.0.smithi087.stdout:4/424: dread d4/d13/d32/d8d/d91/f74 [0,4194304] 0 2024-05-08T05:32:06.554 INFO:tasks.workunit.client.0.smithi087.stdout:9/429: unlink d1/df/d14/d54/f78 0 2024-05-08T05:32:06.554 INFO:tasks.workunit.client.0.smithi087.stdout:9/430: readlink d1/df/d14/d18/d66/l7a 0 2024-05-08T05:32:06.554 INFO:tasks.workunit.client.0.smithi087.stdout:9/431: fdatasync d1/df/d14/d54/d61/f53 0 2024-05-08T05:32:06.556 INFO:tasks.workunit.client.0.smithi087.stdout:4/425: rename d4/f7f to d4/d13/d3e/d28/d50/f9a 0 2024-05-08T05:32:06.556 INFO:tasks.workunit.client.0.smithi087.stdout:4/426: write d4/d13/d3e/d28/d50/f9a [286257,121848] 0 2024-05-08T05:32:06.556 INFO:tasks.workunit.client.0.smithi087.stdout:4/427: write d4/d13/d3e/d28/d35/f43 [1163705,3313] 0 2024-05-08T05:32:06.557 INFO:tasks.workunit.client.0.smithi087.stdout:4/428: symlink d4/d6c/l9b 0 2024-05-08T05:32:06.558 INFO:tasks.workunit.client.0.smithi087.stdout:0/384: dread d0/da/d11/f43 [0,4194304] 0 2024-05-08T05:32:06.558 INFO:tasks.workunit.client.0.smithi087.stdout:0/385: truncate d0/d22/d3c/f79 1603094 0 2024-05-08T05:32:06.558 INFO:tasks.workunit.client.0.smithi087.stdout:0/386: stat d0/d22/d3c/f44 0 2024-05-08T05:32:06.558 INFO:tasks.workunit.client.0.smithi087.stdout:0/387: dread - d0/d9/f67 zero size 2024-05-08T05:32:06.558 INFO:tasks.workunit.client.0.smithi087.stdout:0/388: write d0/d57/d24/f4e [247933,99779] 0 2024-05-08T05:32:06.559 INFO:tasks.workunit.client.0.smithi087.stdout:0/389: symlink d0/d9/d1b/d5e/l85 0 2024-05-08T05:32:06.568 INFO:tasks.workunit.client.0.smithi087.stdout:0/390: rename d0/d9/df to d0/da/d35/d86 0 2024-05-08T05:32:06.568 INFO:tasks.workunit.client.0.smithi087.stdout:0/391: write d0/d57/f2a [4902745,5221] 0 2024-05-08T05:32:06.569 INFO:tasks.workunit.client.0.smithi087.stdout:2/390: write d7/de/d27/d33/f30 [2034714,78895] 0 2024-05-08T05:32:06.569 INFO:tasks.workunit.client.0.smithi087.stdout:2/391: dread - d7/f59 zero size 2024-05-08T05:32:06.569 INFO:tasks.workunit.client.0.smithi087.stdout:0/392: creat d0/d57/d24/d66/f87 x:0 0 0 2024-05-08T05:32:06.571 INFO:tasks.workunit.client.0.smithi087.stdout:7/479: dwrite d2/d6/d12/d19/f73 [0,4194304] 0 2024-05-08T05:32:06.571 INFO:tasks.workunit.client.0.smithi087.stdout:7/480: write d2/da/f86 [1343771,22280] 0 2024-05-08T05:32:06.573 INFO:tasks.workunit.client.0.smithi087.stdout:7/481: mknod d2/da/d3f/d66/c9d 0 2024-05-08T05:32:06.574 INFO:tasks.workunit.client.0.smithi087.stdout:7/482: symlink d2/da/d3f/d72/d77/d54/d50/l9e 0 2024-05-08T05:32:06.574 INFO:tasks.workunit.client.0.smithi087.stdout:7/483: fsync d2/da/d3f/d66/f8a 0 2024-05-08T05:32:06.575 INFO:tasks.workunit.client.0.smithi087.stdout:7/484: chown d2/da/d3f/d72/d77/d54/f3e 12349 1 2024-05-08T05:32:06.575 INFO:tasks.workunit.client.0.smithi087.stdout:7/485: getdents d2/da/d3f/d4f 0 2024-05-08T05:32:06.579 INFO:tasks.workunit.client.0.smithi087.stdout:7/486: rename d2/da/d3f/d72/d77/d54/c5d to d2/d6/d12/d19/d2a/d91/c9f 0 2024-05-08T05:32:06.581 INFO:tasks.workunit.client.0.smithi087.stdout:0/393: dread d0/d57/d24/f4e [0,4194304] 0 2024-05-08T05:32:06.583 INFO:tasks.workunit.client.0.smithi087.stdout:2/392: dread d7/de/d27/d33/d49/f6d [0,4194304] 0 2024-05-08T05:32:06.585 INFO:tasks.workunit.client.0.smithi087.stdout:0/394: creat d0/da/d35/d86/d74/d51/f88 x:0 0 0 2024-05-08T05:32:06.586 INFO:tasks.workunit.client.0.smithi087.stdout:0/395: creat d0/d9/d1b/d2f/d54/f89 x:0 0 0 2024-05-08T05:32:06.586 INFO:tasks.workunit.client.0.smithi087.stdout:0/396: readlink d0/l41 0 2024-05-08T05:32:06.588 INFO:tasks.workunit.client.0.smithi087.stdout:7/487: rename d2/da/d3f/d4f to d2/d6/da0 0 2024-05-08T05:32:06.590 INFO:tasks.workunit.client.0.smithi087.stdout:7/488: symlink d2/d6/la1 0 2024-05-08T05:32:06.590 INFO:tasks.workunit.client.0.smithi087.stdout:7/489: truncate d2/d6/da0/f61 1522724 0 2024-05-08T05:32:06.590 INFO:tasks.workunit.client.0.smithi087.stdout:0/397: rmdir d0/da/d35/d86/d74 39 2024-05-08T05:32:06.591 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:32:06 smithi160 ceph-mon[34827]: pgmap v513: 97 pgs: 97 active+clean; 522 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 65 MiB/s rd, 78 MiB/s wr, 798 op/s 2024-05-08T05:32:06.591 INFO:tasks.workunit.client.0.smithi087.stdout:0/398: unlink d0/d57/c25 0 2024-05-08T05:32:06.617 INFO:tasks.workunit.client.0.smithi087.stdout:4/429: dwrite d4/d13/d65/d4e/f54 [0,4194304] 0 2024-05-08T05:32:06.619 INFO:tasks.workunit.client.0.smithi087.stdout:4/430: creat d4/d13/d3e/f9c x:0 0 0 2024-05-08T05:32:06.626 INFO:tasks.workunit.client.0.smithi087.stdout:9/432: dwrite d1/db/d28/f4a [0,4194304] 0 2024-05-08T05:32:06.626 INFO:tasks.workunit.client.0.smithi087.stdout:9/433: chown d1/df/l1d 1720 1 2024-05-08T05:32:06.627 INFO:tasks.workunit.client.0.smithi087.stdout:9/434: mknod d1/df/d14/d54/d61/c7d 0 2024-05-08T05:32:06.629 INFO:tasks.workunit.client.0.smithi087.stdout:9/435: mkdir d1/df/d37/d5b/d7e 0 2024-05-08T05:32:06.630 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:32:06 smithi087 ceph-mon[29523]: pgmap v513: 97 pgs: 97 active+clean; 522 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 65 MiB/s rd, 78 MiB/s wr, 798 op/s 2024-05-08T05:32:06.632 INFO:tasks.workunit.client.0.smithi087.stdout:9/436: mkdir d1/df/d14/d18/d66/d7f 0 2024-05-08T05:32:06.632 INFO:tasks.workunit.client.0.smithi087.stdout:9/437: dread - d1/df/d14/f55 zero size 2024-05-08T05:32:06.647 INFO:tasks.workunit.client.0.smithi087.stdout:7/490: dwrite d2/d6/d12/d1d/f17 [4194304,4194304] 0 2024-05-08T05:32:06.650 INFO:tasks.workunit.client.0.smithi087.stdout:7/491: rmdir d2/d6/da0/d67/d82 39 2024-05-08T05:32:06.650 INFO:tasks.workunit.client.0.smithi087.stdout:0/399: dwrite d0/da/d35/d86/d74/f53 [0,4194304] 0 2024-05-08T05:32:06.650 INFO:tasks.workunit.client.0.smithi087.stdout:0/400: read d0/da/d35/f3d [2339203,125598] 0 2024-05-08T05:32:06.651 INFO:tasks.workunit.client.0.smithi087.stdout:7/492: rename d2/d6/d12/d1d/f4a to d2/d6/d12/d15/fa2 0 2024-05-08T05:32:06.652 INFO:tasks.workunit.client.0.smithi087.stdout:7/493: chown d2/d6 146883 1 2024-05-08T05:32:06.653 INFO:tasks.workunit.client.0.smithi087.stdout:7/494: rename d2/da/d3f/d72/d77/d54/d55/d65/d7c to d2/d6/d12/d19/d2a/d89/da3 0 2024-05-08T05:32:06.653 INFO:tasks.workunit.client.0.smithi087.stdout:7/495: write d2/f4 [3474863,320] 0 2024-05-08T05:32:06.654 INFO:tasks.workunit.client.0.smithi087.stdout:2/393: dwrite d7/de/d27/d33/f38 [0,4194304] 0 2024-05-08T05:32:06.654 INFO:tasks.workunit.client.0.smithi087.stdout:0/401: rmdir d0/d68 0 2024-05-08T05:32:06.655 INFO:tasks.workunit.client.0.smithi087.stdout:0/402: write d0/d9/d1b/d5e/f72 [1039758,26928] 0 2024-05-08T05:32:06.657 INFO:tasks.workunit.client.0.smithi087.stdout:7/496: creat d2/d6/d12/d1d/fa4 x:0 0 0 2024-05-08T05:32:06.658 INFO:tasks.workunit.client.0.smithi087.stdout:4/431: dwrite d4/d13/d32/d8d/d91/f94 [0,4194304] 0 2024-05-08T05:32:06.675 INFO:tasks.workunit.client.0.smithi087.stdout:8/427: sync 2024-05-08T05:32:06.675 INFO:tasks.workunit.client.0.smithi087.stdout:5/424: sync 2024-05-08T05:32:06.675 INFO:tasks.workunit.client.0.smithi087.stdout:6/455: sync 2024-05-08T05:32:06.675 INFO:tasks.workunit.client.0.smithi087.stdout:1/353: sync 2024-05-08T05:32:06.675 INFO:tasks.workunit.client.0.smithi087.stdout:8/428: chown db/d23/d54/f74 2023605 1 2024-05-08T05:32:06.675 INFO:tasks.workunit.client.0.smithi087.stdout:3/429: sync 2024-05-08T05:32:06.675 INFO:tasks.workunit.client.0.smithi087.stdout:6/456: creat d4/d8/d61/d6f/f8b x:0 0 0 2024-05-08T05:32:06.675 INFO:tasks.workunit.client.0.smithi087.stdout:1/354: symlink df/d2f/d4f/l7c 0 2024-05-08T05:32:06.675 INFO:tasks.workunit.client.0.smithi087.stdout:3/430: creat d4/d11/d24/d25/d3e/d58/f96 x:0 0 0 2024-05-08T05:32:06.676 INFO:tasks.workunit.client.0.smithi087.stdout:3/431: write d4/d11/d24/d25/d3e/d58/f7a [1456840,78479] 0 2024-05-08T05:32:06.676 INFO:tasks.workunit.client.0.smithi087.stdout:3/432: write d4/f5c [495922,44540] 0 2024-05-08T05:32:06.676 INFO:tasks.workunit.client.0.smithi087.stdout:6/457: mknod d4/d8/df/d1e/d25/d28/d2d/d37/d5b/c8c 0 2024-05-08T05:32:06.676 INFO:tasks.workunit.client.0.smithi087.stdout:6/458: chown d4/d8/f73 12701018 1 2024-05-08T05:32:06.676 INFO:tasks.workunit.client.0.smithi087.stdout:1/355: mknod df/d18/c7d 0 2024-05-08T05:32:06.678 INFO:tasks.workunit.client.0.smithi087.stdout:3/433: link d4/d11/d24/c3b d4/d11/d3d/d64/c97 0 2024-05-08T05:32:06.679 INFO:tasks.workunit.client.0.smithi087.stdout:6/459: rename d4/f12 to d4/d8/d61/d6f/f8d 0 2024-05-08T05:32:06.679 INFO:tasks.workunit.client.0.smithi087.stdout:3/434: rmdir d4/d11/d24/d39/d60 39 2024-05-08T05:32:06.680 INFO:tasks.workunit.client.0.smithi087.stdout:3/435: truncate d4/d11/d3d/d4e/f80 4882742 0 2024-05-08T05:32:06.681 INFO:tasks.workunit.client.0.smithi087.stdout:9/438: dwrite d1/fa [0,4194304] 0 2024-05-08T05:32:06.681 INFO:tasks.workunit.client.0.smithi087.stdout:9/439: truncate d1/df/d14/f6e 99538 0 2024-05-08T05:32:06.681 INFO:tasks.workunit.client.0.smithi087.stdout:9/440: stat d1/f8 0 2024-05-08T05:32:06.681 INFO:tasks.workunit.client.0.smithi087.stdout:1/356: rename c6 to df/d2f/d57/d64/c7e 0 2024-05-08T05:32:06.681 INFO:tasks.workunit.client.0.smithi087.stdout:6/460: getdents d4/d8/df/d1e/d25/d28/d57 0 2024-05-08T05:32:06.685 INFO:tasks.workunit.client.0.smithi087.stdout:3/436: link d4/d11/d24/d25/d3e/d58/f7d d4/d11/d24/d25/d4d/f98 0 2024-05-08T05:32:06.685 INFO:tasks.workunit.client.0.smithi087.stdout:9/441: mkdir d1/df/d14/d68/d80 0 2024-05-08T05:32:06.685 INFO:tasks.workunit.client.0.smithi087.stdout:1/357: symlink df/d18/d1d/d58/d72/l7f 0 2024-05-08T05:32:06.686 INFO:tasks.workunit.client.0.smithi087.stdout:3/437: mkdir d4/d11/d24/d25/d99 0 2024-05-08T05:32:06.699 INFO:tasks.workunit.client.0.smithi087.stdout:1/358: creat df/d2f/d6a/f80 x:0 0 0 2024-05-08T05:32:06.699 INFO:tasks.workunit.client.0.smithi087.stdout:0/403: dwrite d0/d57/d24/d66/f6e [0,4194304] 0 2024-05-08T05:32:06.699 INFO:tasks.workunit.client.0.smithi087.stdout:7/497: dread d2/da/f86 [0,4194304] 0 2024-05-08T05:32:06.699 INFO:tasks.workunit.client.0.smithi087.stdout:0/404: write d0/da/f78 [611644,105602] 0 2024-05-08T05:32:06.705 INFO:tasks.workunit.client.0.smithi087.stdout:8/429: dread db/d23/d1b/d4b/f69 [0,4194304] 0 2024-05-08T05:32:06.705 INFO:tasks.workunit.client.0.smithi087.stdout:8/430: chown db/d23/d15/f72 466421 1 2024-05-08T05:32:06.707 INFO:tasks.workunit.client.0.smithi087.stdout:0/405: mknod d0/c8a 0 2024-05-08T05:32:06.708 INFO:tasks.workunit.client.0.smithi087.stdout:0/406: readlink d0/d9/d1b/l73 0 2024-05-08T05:32:06.708 INFO:tasks.workunit.client.0.smithi087.stdout:0/407: dread - d0/da/d35/d86/d74/d51/f88 zero size 2024-05-08T05:32:06.712 INFO:tasks.workunit.client.0.smithi087.stdout:0/408: mknod d0/d57/c8b 0 2024-05-08T05:32:06.713 INFO:tasks.workunit.client.0.smithi087.stdout:7/498: mknod d2/da/d3f/ca5 0 2024-05-08T05:32:06.713 INFO:tasks.workunit.client.0.smithi087.stdout:5/425: read da/dd/d10/d42/d50/f6a [2058244,49540] 0 2024-05-08T05:32:06.716 INFO:tasks.workunit.client.0.smithi087.stdout:5/426: symlink da/db/l87 0 2024-05-08T05:32:06.718 INFO:tasks.workunit.client.0.smithi087.stdout:5/427: link da/dd/d10/f60 da/dd/d13/f88 0 2024-05-08T05:32:06.723 INFO:tasks.workunit.client.0.smithi087.stdout:7/499: write d2/da/d3f/f30 [4293913,26809] 0 2024-05-08T05:32:06.723 INFO:tasks.workunit.client.0.smithi087.stdout:7/500: write d2/d6/d12/f97 [405858,94711] 0 2024-05-08T05:32:06.724 INFO:tasks.workunit.client.0.smithi087.stdout:4/432: dwrite d4/f8e [0,4194304] 0 2024-05-08T05:32:06.731 INFO:tasks.workunit.client.0.smithi087.stdout:4/433: mkdir d4/d13/d3e/d28/d50/d9d 0 2024-05-08T05:32:06.732 INFO:tasks.workunit.client.0.smithi087.stdout:0/409: dread d0/da/f1e [0,4194304] 0 2024-05-08T05:32:06.733 INFO:tasks.workunit.client.0.smithi087.stdout:0/410: dread - d0/d9/d1b/f3e zero size 2024-05-08T05:32:06.733 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:32:06 smithi090 ceph-mon[34526]: pgmap v513: 97 pgs: 97 active+clean; 522 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 65 MiB/s rd, 78 MiB/s wr, 798 op/s 2024-05-08T05:32:06.739 INFO:tasks.workunit.client.0.smithi087.stdout:4/434: mknod d4/d13/d65/d4e/d63/c9e 0 2024-05-08T05:32:06.741 INFO:tasks.workunit.client.0.smithi087.stdout:3/438: dwrite d4/d11/d24/d25/d4d/f68 [0,4194304] 0 2024-05-08T05:32:06.741 INFO:tasks.workunit.client.0.smithi087.stdout:3/439: write d4/d11/d3d/d4e/d6a/f81 [804080,92373] 0 2024-05-08T05:32:06.744 INFO:tasks.workunit.client.0.smithi087.stdout:6/461: dwrite d4/d8/df/d1e/d25/d28/d57/f76 [0,4194304] 0 2024-05-08T05:32:06.745 INFO:tasks.workunit.client.0.smithi087.stdout:1/359: dwrite df/f3e [4194304,4194304] 0 2024-05-08T05:32:06.747 INFO:tasks.workunit.client.0.smithi087.stdout:7/501: write d2/d6/d12/d1d/f17 [1333158,119836] 0 2024-05-08T05:32:06.748 INFO:tasks.workunit.client.0.smithi087.stdout:3/440: truncate d4/d11/d3d/f45 2014191 0 2024-05-08T05:32:06.748 INFO:tasks.workunit.client.0.smithi087.stdout:3/441: write d4/d11/d24/d25/d3e/d3f/f4a [332175,61390] 0 2024-05-08T05:32:06.748 INFO:tasks.workunit.client.0.smithi087.stdout:3/442: dread - d4/d11/d24/d39/d5a/f6b zero size 2024-05-08T05:32:06.748 INFO:tasks.workunit.client.0.smithi087.stdout:3/443: dread - d4/d11/d3d/f8e zero size 2024-05-08T05:32:06.748 INFO:tasks.workunit.client.0.smithi087.stdout:3/444: stat d4/d11/f7e 0 2024-05-08T05:32:06.749 INFO:tasks.workunit.client.0.smithi087.stdout:6/462: creat d4/d8/df/d39/f8e x:0 0 0 2024-05-08T05:32:06.750 INFO:tasks.workunit.client.0.smithi087.stdout:5/428: write da/dd/d10/d36/d45/f4d [84065,92188] 0 2024-05-08T05:32:06.750 INFO:tasks.workunit.client.0.smithi087.stdout:5/429: fsync da/dd/d65/f68 0 2024-05-08T05:32:06.752 INFO:tasks.workunit.client.0.smithi087.stdout:7/502: link d2/d6/l99 d2/da/d3f/d72/d77/d54/d50/d88/la6 0 2024-05-08T05:32:06.752 INFO:tasks.workunit.client.0.smithi087.stdout:1/360: unlink df/d18/d1d/l21 0 2024-05-08T05:32:06.752 INFO:tasks.workunit.client.0.smithi087.stdout:1/361: chown df/d2f/d57/d64/l1e 8251 1 2024-05-08T05:32:06.752 INFO:tasks.workunit.client.0.smithi087.stdout:4/435: dread d4/f4b [0,4194304] 0 2024-05-08T05:32:06.755 INFO:tasks.workunit.client.0.smithi087.stdout:3/445: symlink d4/d11/d24/d25/d3e/l9a 0 2024-05-08T05:32:06.756 INFO:tasks.workunit.client.0.smithi087.stdout:4/436: getdents d4/d13/d65 0 2024-05-08T05:32:06.757 INFO:tasks.workunit.client.0.smithi087.stdout:3/446: mkdir d4/d11/d24/d25/d3e/d58/d9b 0 2024-05-08T05:32:06.758 INFO:tasks.workunit.client.0.smithi087.stdout:4/437: mknod d4/d13/d3e/d28/d50/d9d/c9f 0 2024-05-08T05:32:06.759 INFO:tasks.workunit.client.0.smithi087.stdout:4/438: creat d4/d13/d32/d8d/d91/d84/d5d/fa0 x:0 0 0 2024-05-08T05:32:06.772 INFO:tasks.workunit.client.0.smithi087.stdout:9/442: dwrite d1/db/d28/f7c [0,4194304] 0 2024-05-08T05:32:06.772 INFO:tasks.workunit.client.0.smithi087.stdout:9/443: dread - d1/df/d37/f6d zero size 2024-05-08T05:32:06.778 INFO:tasks.workunit.client.0.smithi087.stdout:0/411: dread d0/d57/f2a [4194304,4194304] 0 2024-05-08T05:32:06.780 INFO:tasks.workunit.client.0.smithi087.stdout:0/412: fdatasync d0/da/f30 0 2024-05-08T05:32:06.780 INFO:tasks.workunit.client.0.smithi087.stdout:0/413: readlink d0/d9/d1b/d2f/l7a 0 2024-05-08T05:32:06.780 INFO:tasks.workunit.client.0.smithi087.stdout:0/414: fdatasync d0/da/f16 0 2024-05-08T05:32:06.781 INFO:tasks.workunit.client.0.smithi087.stdout:8/431: dwrite db/d23/d15/d29/d33/d3b/d56/f87 [0,4194304] 0 2024-05-08T05:32:06.781 INFO:tasks.workunit.client.0.smithi087.stdout:8/432: dread - db/d23/d15/d29/d4d/f5a zero size 2024-05-08T05:32:06.782 INFO:tasks.workunit.client.0.smithi087.stdout:0/415: write d0/d57/f2a [4356027,102079] 0 2024-05-08T05:32:06.782 INFO:tasks.workunit.client.0.smithi087.stdout:4/439: read d4/d13/d32/d8d/d91/f94 [1649972,38065] 0 2024-05-08T05:32:06.785 INFO:tasks.workunit.client.0.smithi087.stdout:7/503: dread d2/d6/da0/f95 [0,4194304] 0 2024-05-08T05:32:06.786 INFO:tasks.workunit.client.0.smithi087.stdout:8/433: mknod db/d23/d1b/d7c/c9e 0 2024-05-08T05:32:06.788 INFO:tasks.workunit.client.0.smithi087.stdout:4/440: creat d4/d13/fa1 x:0 0 0 2024-05-08T05:32:06.788 INFO:tasks.workunit.client.0.smithi087.stdout:4/441: fsync d4/d13/d65/f6f 0 2024-05-08T05:32:06.789 INFO:tasks.workunit.client.0.smithi087.stdout:7/504: mknod d2/da/d3f/d66/ca7 0 2024-05-08T05:32:06.790 INFO:tasks.workunit.client.0.smithi087.stdout:4/442: rmdir d4/d13/d3e/d28/d35/d90 0 2024-05-08T05:32:06.791 INFO:tasks.workunit.client.0.smithi087.stdout:4/443: symlink d4/d13/la2 0 2024-05-08T05:32:06.793 INFO:tasks.workunit.client.0.smithi087.stdout:4/444: mknod d4/d13/d3e/d28/ca3 0 2024-05-08T05:32:06.794 INFO:tasks.workunit.client.0.smithi087.stdout:4/445: symlink d4/d13/d65/d4e/la4 0 2024-05-08T05:32:06.794 INFO:tasks.workunit.client.0.smithi087.stdout:6/463: dwrite d4/d8/d61/f81 [0,4194304] 0 2024-05-08T05:32:06.795 INFO:tasks.workunit.client.0.smithi087.stdout:9/444: dread d1/db/f10 [0,4194304] 0 2024-05-08T05:32:06.797 INFO:tasks.workunit.client.0.smithi087.stdout:4/446: rename d4/d13/c79 to d4/d13/d32/d8d/ca5 0 2024-05-08T05:32:06.798 INFO:tasks.workunit.client.0.smithi087.stdout:6/464: mknod d4/d8/df/d1e/d25/c8f 0 2024-05-08T05:32:06.798 INFO:tasks.workunit.client.0.smithi087.stdout:6/465: readlink d4/d8/df/d1e/d25/d28/d57/d6d/l89 0 2024-05-08T05:32:06.800 INFO:tasks.workunit.client.0.smithi087.stdout:9/445: mknod d1/df/d37/d5b/d7e/c81 0 2024-05-08T05:32:06.800 INFO:tasks.workunit.client.0.smithi087.stdout:9/446: fsync d1/f30 0 2024-05-08T05:32:06.800 INFO:tasks.workunit.client.0.smithi087.stdout:9/447: fsync d1/df/d58/d5e/f65 0 2024-05-08T05:32:06.800 INFO:tasks.workunit.client.0.smithi087.stdout:9/448: dread - d1/df/d37/d5b/f6f zero size 2024-05-08T05:32:06.801 INFO:tasks.workunit.client.0.smithi087.stdout:0/416: dread d0/d9/f48 [0,4194304] 0 2024-05-08T05:32:06.801 INFO:tasks.workunit.client.0.smithi087.stdout:4/447: link d4/d13/f95 d4/d13/d65/fa6 0 2024-05-08T05:32:06.801 INFO:tasks.workunit.client.0.smithi087.stdout:4/448: rename d4/d13/d32/d8d to d4/d13/d32/d8d/da7 22 2024-05-08T05:32:06.802 INFO:tasks.workunit.client.0.smithi087.stdout:1/362: dwrite fa [0,4194304] 0 2024-05-08T05:32:06.803 INFO:tasks.workunit.client.0.smithi087.stdout:0/417: rmdir d0/d9/d1b/d82 0 2024-05-08T05:32:06.805 INFO:tasks.workunit.client.0.smithi087.stdout:8/434: dread db/d23/d1b/f30 [0,4194304] 0 2024-05-08T05:32:06.807 INFO:tasks.workunit.client.0.smithi087.stdout:4/449: symlink d4/d13/d65/d4e/la8 0 2024-05-08T05:32:06.807 INFO:tasks.workunit.client.0.smithi087.stdout:2/394: sync 2024-05-08T05:32:06.809 INFO:tasks.workunit.client.0.smithi087.stdout:8/435: mknod db/d23/d15/d29/d33/d3b/c9f 0 2024-05-08T05:32:06.810 INFO:tasks.workunit.client.0.smithi087.stdout:7/505: read d2/da/f4c [2248021,33712] 0 2024-05-08T05:32:06.811 INFO:tasks.workunit.client.0.smithi087.stdout:0/418: mknod d0/d22/c8c 0 2024-05-08T05:32:06.812 INFO:tasks.workunit.client.0.smithi087.stdout:4/450: creat d4/d13/d65/fa9 x:0 0 0 2024-05-08T05:32:06.812 INFO:tasks.workunit.client.0.smithi087.stdout:2/395: creat d7/de/d27/d33/d49/f7f x:0 0 0 2024-05-08T05:32:06.816 INFO:tasks.workunit.client.0.smithi087.stdout:3/447: dwrite d4/d11/d3d/f5b [4194304,4194304] 0 2024-05-08T05:32:06.816 INFO:tasks.workunit.client.0.smithi087.stdout:3/448: readlink d4/d11/d24/d25/d3e/l59 0 2024-05-08T05:32:06.816 INFO:tasks.workunit.client.0.smithi087.stdout:3/449: fsync d4/d11/f50 0 2024-05-08T05:32:06.817 INFO:tasks.workunit.client.0.smithi087.stdout:3/450: write d4/d11/d24/d25/d4d/f98 [82878,119649] 0 2024-05-08T05:32:06.817 INFO:tasks.workunit.client.0.smithi087.stdout:6/466: dread d4/d8/df/d1e/d25/d28/d57/f76 [0,4194304] 0 2024-05-08T05:32:06.817 INFO:tasks.workunit.client.0.smithi087.stdout:6/467: chown d4/d8/df/d1e/d25/d28/d57 8 1 2024-05-08T05:32:06.817 INFO:tasks.workunit.client.0.smithi087.stdout:6/468: chown d4/d8/df/d1e/d25/c4f 12241338 1 2024-05-08T05:32:06.817 INFO:tasks.workunit.client.0.smithi087.stdout:6/469: write d4/d8/f67 [4979928,95749] 0 2024-05-08T05:32:06.817 INFO:tasks.workunit.client.0.smithi087.stdout:6/470: truncate d4/d8/d61/d6f/f7e 504176 0 2024-05-08T05:32:06.818 INFO:tasks.workunit.client.0.smithi087.stdout:4/451: symlink d4/d13/d65/d4e/d63/d98/laa 0 2024-05-08T05:32:06.818 INFO:tasks.workunit.client.0.smithi087.stdout:2/396: rename d7/de/c2a to d7/de/d5d/c80 0 2024-05-08T05:32:06.819 INFO:tasks.workunit.client.0.smithi087.stdout:0/419: symlink d0/d57/d24/d66/l8d 0 2024-05-08T05:32:06.819 INFO:tasks.workunit.client.0.smithi087.stdout:0/420: fdatasync d0/d9/f7e 0 2024-05-08T05:32:06.822 INFO:tasks.workunit.client.0.smithi087.stdout:3/451: symlink d4/d11/d24/d25/d4d/l9c 0 2024-05-08T05:32:06.822 INFO:tasks.workunit.client.0.smithi087.stdout:0/421: mknod d0/d9/d1b/c8e 0 2024-05-08T05:32:06.822 INFO:tasks.workunit.client.0.smithi087.stdout:0/422: fsync d0/d9/f67 0 2024-05-08T05:32:06.823 INFO:tasks.workunit.client.0.smithi087.stdout:8/436: dread db/d23/d54/f74 [0,4194304] 0 2024-05-08T05:32:06.824 INFO:tasks.workunit.client.0.smithi087.stdout:0/423: symlink d0/da/d35/d86/d74/l8f 0 2024-05-08T05:32:06.828 INFO:tasks.workunit.client.0.smithi087.stdout:0/424: mkdir d0/d9/d90 0 2024-05-08T05:32:06.832 INFO:tasks.workunit.client.0.smithi087.stdout:3/452: rmdir d4/d11/d24/d25 39 2024-05-08T05:32:06.832 INFO:tasks.workunit.client.0.smithi087.stdout:3/453: write d4/d11/d3d/d48/f52 [627331,61333] 0 2024-05-08T05:32:06.832 INFO:tasks.workunit.client.0.smithi087.stdout:0/425: symlink d0/d9/d1b/d5e/l91 0 2024-05-08T05:32:06.841 INFO:tasks.workunit.client.0.smithi087.stdout:4/452: read d4/d13/d3e/f38 [1307991,46061] 0 2024-05-08T05:32:06.842 INFO:tasks.workunit.client.0.smithi087.stdout:3/454: rename d4/d14/c30 to d4/d11/d3d/c9d 0 2024-05-08T05:32:06.842 INFO:tasks.workunit.client.0.smithi087.stdout:0/426: link d0/d57/d24/d66/l8d d0/d9/l92 0 2024-05-08T05:32:06.842 INFO:tasks.workunit.client.0.smithi087.stdout:0/427: fsync d0/d22/f76 0 2024-05-08T05:32:06.842 INFO:tasks.workunit.client.0.smithi087.stdout:8/437: dread db/d23/d1b/d35/d43/d68/d6a/f5b [0,4194304] 0 2024-05-08T05:32:06.843 INFO:tasks.workunit.client.0.smithi087.stdout:8/438: truncate db/d23/d15/d3c/f3e 2628055 0 2024-05-08T05:32:06.843 INFO:tasks.workunit.client.0.smithi087.stdout:4/453: creat d4/d13/d3e/d28/fab x:0 0 0 2024-05-08T05:32:06.843 INFO:tasks.workunit.client.0.smithi087.stdout:7/506: write d2/d6/d12/d15/f28 [1571712,57583] 0 2024-05-08T05:32:06.843 INFO:tasks.workunit.client.0.smithi087.stdout:3/455: mknod d4/d14/c9e 0 2024-05-08T05:32:06.846 INFO:tasks.workunit.client.0.smithi087.stdout:1/363: dwrite df/d2f/d4f/f55 [0,4194304] 0 2024-05-08T05:32:06.846 INFO:tasks.workunit.client.0.smithi087.stdout:0/428: rename d0/d9/f48 to d0/da/d35/f93 0 2024-05-08T05:32:06.847 INFO:tasks.workunit.client.0.smithi087.stdout:4/454: creat d4/d6c/d93/fac x:0 0 0 2024-05-08T05:32:06.847 INFO:tasks.workunit.client.0.smithi087.stdout:4/455: chown d4/d13/d3e/d28/d50 992 1 2024-05-08T05:32:06.847 INFO:tasks.workunit.client.0.smithi087.stdout:7/507: symlink d2/da/d3f/d72/d77/d54/d50/la8 0 2024-05-08T05:32:06.848 INFO:tasks.workunit.client.0.smithi087.stdout:3/456: getdents d4/d11/d24 0 2024-05-08T05:32:06.848 INFO:tasks.workunit.client.0.smithi087.stdout:3/457: fdatasync d4/d11/d24/d39/d5a/f6b 0 2024-05-08T05:32:06.848 INFO:tasks.workunit.client.0.smithi087.stdout:3/458: dread - d4/d11/d24/d25/d3e/d3f/f6f zero size 2024-05-08T05:32:06.848 INFO:tasks.workunit.client.0.smithi087.stdout:3/459: chown d4/le 2923 1 2024-05-08T05:32:06.851 INFO:tasks.workunit.client.0.smithi087.stdout:1/364: symlink df/d18/d1d/l81 0 2024-05-08T05:32:06.851 INFO:tasks.workunit.client.0.smithi087.stdout:0/429: mkdir d0/da/d35/d86/d74/d51/d94 0 2024-05-08T05:32:06.852 INFO:tasks.workunit.client.0.smithi087.stdout:4/456: rename d4/d13/d65/fa9 to d4/d13/d65/d4e/d63/fad 0 2024-05-08T05:32:06.853 INFO:tasks.workunit.client.0.smithi087.stdout:3/460: creat d4/d11/d24/d39/d60/d87/f9f x:0 0 0 2024-05-08T05:32:06.854 INFO:tasks.workunit.client.0.smithi087.stdout:3/461: write d4/d11/d24/d39/d5a/f6b [95707,119028] 0 2024-05-08T05:32:06.854 INFO:tasks.workunit.client.0.smithi087.stdout:3/462: truncate d4/d11/d24/d25/d3e/d3f/f6f 1030407 0 2024-05-08T05:32:06.856 INFO:tasks.workunit.client.0.smithi087.stdout:0/430: link d0/d22/c8c d0/da/c95 0 2024-05-08T05:32:06.860 INFO:tasks.workunit.client.0.smithi087.stdout:3/463: dread d4/d11/d24/d25/d3e/d3f/f6f [0,4194304] 0 2024-05-08T05:32:06.860 INFO:tasks.workunit.client.0.smithi087.stdout:3/464: truncate d4/f6 654606 0 2024-05-08T05:32:06.864 INFO:tasks.workunit.client.0.smithi087.stdout:8/439: dread db/d23/d15/f1e [0,4194304] 0 2024-05-08T05:32:06.868 INFO:tasks.workunit.client.0.smithi087.stdout:7/508: rename d2/f6b to d2/da/d3f/d72/fa9 0 2024-05-08T05:32:06.868 INFO:tasks.workunit.client.0.smithi087.stdout:7/509: read d2/da/f85 [665644,64828] 0 2024-05-08T05:32:06.868 INFO:tasks.workunit.client.0.smithi087.stdout:2/397: dwrite d7/f18 [4194304,4194304] 0 2024-05-08T05:32:06.868 INFO:tasks.workunit.client.0.smithi087.stdout:2/398: fsync d7/f17 0 2024-05-08T05:32:06.871 INFO:tasks.workunit.client.0.smithi087.stdout:3/465: creat d4/d11/d24/d25/d99/fa0 x:0 0 0 2024-05-08T05:32:06.871 INFO:tasks.workunit.client.0.smithi087.stdout:9/449: dwrite d1/db/d28/f62 [0,4194304] 0 2024-05-08T05:32:06.871 INFO:tasks.workunit.client.0.smithi087.stdout:9/450: fdatasync d1/f1a 0 2024-05-08T05:32:06.872 INFO:tasks.workunit.client.0.smithi087.stdout:8/440: symlink db/d23/d1b/la0 0 2024-05-08T05:32:06.872 INFO:tasks.workunit.client.0.smithi087.stdout:6/471: dwrite d4/d8/df/d1e/d25/d28/d2d/d37/d45/f6b [0,4194304] 0 2024-05-08T05:32:06.876 INFO:tasks.workunit.client.0.smithi087.stdout:1/365: rename l8 to df/d18/d1d/d27/d61/l82 0 2024-05-08T05:32:06.876 INFO:tasks.workunit.client.0.smithi087.stdout:1/366: write df/d2f/d57/d64/f71 [703844,663] 0 2024-05-08T05:32:06.877 INFO:tasks.workunit.client.0.smithi087.stdout:7/510: getdents d2/da/d3f/d72/d77 0 2024-05-08T05:32:06.877 INFO:tasks.workunit.client.0.smithi087.stdout:7/511: stat d2/c83 0 2024-05-08T05:32:06.882 INFO:tasks.workunit.client.0.smithi087.stdout:2/399: mkdir d7/de/d27/d33/d81 0 2024-05-08T05:32:06.883 INFO:tasks.workunit.client.0.smithi087.stdout:2/400: dread - d7/f5b zero size 2024-05-08T05:32:06.884 INFO:tasks.workunit.client.0.smithi087.stdout:9/451: creat d1/df/d37/d5b/d7e/f82 x:0 0 0 2024-05-08T05:32:06.886 INFO:tasks.workunit.client.0.smithi087.stdout:3/466: creat d4/d11/d24/d25/d3e/d58/fa1 x:0 0 0 2024-05-08T05:32:06.886 INFO:tasks.workunit.client.0.smithi087.stdout:3/467: write d4/d11/d24/d25/d3e/f89 [996039,125627] 0 2024-05-08T05:32:06.886 INFO:tasks.workunit.client.0.smithi087.stdout:3/468: chown d4/d11/d24/d39/d60 1040003225 1 2024-05-08T05:32:06.890 INFO:tasks.workunit.client.0.smithi087.stdout:4/457: dwrite d4/d13/d3e/f4f [0,4194304] 0 2024-05-08T05:32:06.890 INFO:tasks.workunit.client.0.smithi087.stdout:6/472: dread d4/d8/d61/d6f/f8d [0,4194304] 0 2024-05-08T05:32:06.890 INFO:tasks.workunit.client.0.smithi087.stdout:4/458: fdatasync d4/d13/d65/d4e/f54 0 2024-05-08T05:32:06.890 INFO:tasks.workunit.client.0.smithi087.stdout:4/459: truncate d4/d13/d32/d8d/d91/d84/d5d/f82 559657 0 2024-05-08T05:32:06.893 INFO:tasks.workunit.client.0.smithi087.stdout:7/512: symlink d2/d6/d12/laa 0 2024-05-08T05:32:06.893 INFO:tasks.workunit.client.0.smithi087.stdout:7/513: truncate d2/d6/d12/d15/f5c 4981170 0 2024-05-08T05:32:06.893 INFO:tasks.workunit.client.0.smithi087.stdout:2/401: mkdir d7/de/d82 0 2024-05-08T05:32:06.894 INFO:tasks.workunit.client.0.smithi087.stdout:1/367: rmdir df/d18/d1d 39 2024-05-08T05:32:06.894 INFO:tasks.workunit.client.0.smithi087.stdout:9/452: mkdir d1/db/d83 0 2024-05-08T05:32:06.895 INFO:tasks.workunit.client.0.smithi087.stdout:3/469: mkdir d4/d11/d24/d25/d99/da2 0 2024-05-08T05:32:06.897 INFO:tasks.workunit.client.0.smithi087.stdout:6/473: link d4/f66 d4/d8/d61/d6f/f90 0 2024-05-08T05:32:06.897 INFO:tasks.workunit.client.0.smithi087.stdout:6/474: truncate d4/d8/d61/d6f/f8d 4303878 0 2024-05-08T05:32:06.898 INFO:tasks.workunit.client.0.smithi087.stdout:8/441: dwrite db/d23/d15/f85 [0,4194304] 0 2024-05-08T05:32:06.898 INFO:tasks.workunit.client.0.smithi087.stdout:8/442: fsync db/d23/d1b/d35/d43/d68/d6a/f5b 0 2024-05-08T05:32:06.898 INFO:tasks.workunit.client.0.smithi087.stdout:4/460: mknod d4/d6c/cae 0 2024-05-08T05:32:06.898 INFO:tasks.workunit.client.0.smithi087.stdout:4/461: write d4/d13/d3e/f38 [8283195,129156] 0 2024-05-08T05:32:06.899 INFO:tasks.workunit.client.0.smithi087.stdout:2/402: mknod d7/de/d2c/c83 0 2024-05-08T05:32:06.901 INFO:tasks.workunit.client.0.smithi087.stdout:9/453: creat d1/df/d14/d68/d80/f84 x:0 0 0 2024-05-08T05:32:06.902 INFO:tasks.workunit.client.0.smithi087.stdout:9/454: stat d1/db 0 2024-05-08T05:32:06.902 INFO:tasks.workunit.client.0.smithi087.stdout:9/455: dread - d1/df/f52 zero size 2024-05-08T05:32:06.903 INFO:tasks.workunit.client.0.smithi087.stdout:3/470: link d4/d11/d24/f26 d4/d11/d24/d25/fa3 0 2024-05-08T05:32:06.903 INFO:tasks.workunit.client.0.smithi087.stdout:3/471: chown d4/d11/d3d/d4e/d6a/f81 789854 1 2024-05-08T05:32:06.906 INFO:tasks.workunit.client.0.smithi087.stdout:1/368: rmdir df/d18 39 2024-05-08T05:32:06.908 INFO:tasks.workunit.client.0.smithi087.stdout:6/475: rename d4/d6/f75 to d4/d8/df/d1e/d25/d28/f91 0 2024-05-08T05:32:06.908 INFO:tasks.workunit.client.0.smithi087.stdout:8/443: symlink db/d23/d1b/d35/d43/la1 0 2024-05-08T05:32:06.910 INFO:tasks.workunit.client.0.smithi087.stdout:4/462: creat d4/d6c/faf x:0 0 0 2024-05-08T05:32:06.910 INFO:tasks.workunit.client.0.smithi087.stdout:5/430: sync 2024-05-08T05:32:06.910 INFO:tasks.workunit.client.0.smithi087.stdout:9/456: mkdir d1/df/d37/d5b/d7e/d85 0 2024-05-08T05:32:06.912 INFO:tasks.workunit.client.0.smithi087.stdout:3/472: mkdir d4/d11/d24/d25/da4 0 2024-05-08T05:32:06.912 INFO:tasks.workunit.client.0.smithi087.stdout:9/457: write d1/df/d14/d18/f23 [206878,57677] 0 2024-05-08T05:32:06.914 INFO:tasks.workunit.client.0.smithi087.stdout:8/444: creat db/d23/d1b/d35/d43/d68/d6f/fa2 x:0 0 0 2024-05-08T05:32:06.916 INFO:tasks.workunit.client.0.smithi087.stdout:3/473: mkdir d4/d11/d24/d39/d60/d87/da5 0 2024-05-08T05:32:06.917 INFO:tasks.workunit.client.0.smithi087.stdout:8/445: creat db/fa3 x:0 0 0 2024-05-08T05:32:06.919 INFO:tasks.workunit.client.0.smithi087.stdout:3/474: creat d4/d11/d24/fa6 x:0 0 0 2024-05-08T05:32:06.920 INFO:tasks.workunit.client.0.smithi087.stdout:8/446: mknod db/ca4 0 2024-05-08T05:32:06.922 INFO:tasks.workunit.client.0.smithi087.stdout:3/475: symlink d4/d11/la7 0 2024-05-08T05:32:06.922 INFO:tasks.workunit.client.0.smithi087.stdout:3/476: readlink d4/l2c 0 2024-05-08T05:32:06.922 INFO:tasks.workunit.client.0.smithi087.stdout:3/477: write d4/d11/d24/d25/d3e/d3f/f4a [747994,80261] 0 2024-05-08T05:32:06.922 INFO:tasks.workunit.client.0.smithi087.stdout:3/478: fdatasync d4/d11/d24/d25/d3e/d58/f96 0 2024-05-08T05:32:06.926 INFO:tasks.workunit.client.0.smithi087.stdout:3/479: creat d4/d11/d24/d25/d3e/d58/fa8 x:0 0 0 2024-05-08T05:32:06.928 INFO:tasks.workunit.client.0.smithi087.stdout:3/480: unlink d4/d11/l2b 0 2024-05-08T05:32:06.931 INFO:tasks.workunit.client.0.smithi087.stdout:3/481: link d4/d11/d24/d25/c2e d4/d5f/ca9 0 2024-05-08T05:32:06.931 INFO:tasks.workunit.client.0.smithi087.stdout:4/463: getdents d4/d6c 0 2024-05-08T05:32:06.933 INFO:tasks.workunit.client.0.smithi087.stdout:3/482: fsync d4/d11/d24/d25/d3e/d3f/f4a 0 2024-05-08T05:32:06.934 INFO:tasks.workunit.client.0.smithi087.stdout:4/464: link d4/d6c/faf d4/d13/fb0 0 2024-05-08T05:32:06.937 INFO:tasks.workunit.client.0.smithi087.stdout:3/483: mknod d4/d14/d84/d8b/caa 0 2024-05-08T05:32:06.938 INFO:tasks.workunit.client.0.smithi087.stdout:3/484: chown d4/d11/d3d/c7f 25876 1 2024-05-08T05:32:06.938 INFO:tasks.workunit.client.0.smithi087.stdout:4/465: getdents d4/d13/d3e/d28/d35 0 2024-05-08T05:32:06.939 INFO:tasks.workunit.client.0.smithi087.stdout:3/485: symlink d4/d14/lab 0 2024-05-08T05:32:06.940 INFO:tasks.workunit.client.0.smithi087.stdout:4/466: symlink d4/d13/d32/d8d/d91/lb1 0 2024-05-08T05:32:06.940 INFO:tasks.workunit.client.0.smithi087.stdout:4/467: write d4/d13/d65/d4e/d63/fad [636902,48058] 0 2024-05-08T05:32:06.942 INFO:tasks.workunit.client.0.smithi087.stdout:3/486: mknod d4/d11/d24/d39/d60/d87/da5/cac 0 2024-05-08T05:32:06.942 INFO:tasks.workunit.client.0.smithi087.stdout:3/487: readlink d4/d14/lab 0 2024-05-08T05:32:06.945 INFO:tasks.workunit.client.0.smithi087.stdout:1/369: dwrite df/d2f/d4f/f76 [0,4194304] 0 2024-05-08T05:32:06.948 INFO:tasks.workunit.client.0.smithi087.stdout:1/370: rename df/d18/d1d/d27/d61/d77 to df/d2f/d57/d64/d83 0 2024-05-08T05:32:06.948 INFO:tasks.workunit.client.0.smithi087.stdout:1/371: dread - df/f4d zero size 2024-05-08T05:32:06.948 INFO:tasks.workunit.client.0.smithi087.stdout:3/488: dread d4/f5c [0,4194304] 0 2024-05-08T05:32:06.949 INFO:tasks.workunit.client.0.smithi087.stdout:1/372: creat df/d2f/d4f/f84 x:0 0 0 2024-05-08T05:32:06.949 INFO:tasks.workunit.client.0.smithi087.stdout:3/489: stat d4/d11/d24/d25/c2e 0 2024-05-08T05:32:06.950 INFO:tasks.workunit.client.0.smithi087.stdout:1/373: truncate df/f3b 30211 0 2024-05-08T05:32:06.951 INFO:tasks.workunit.client.0.smithi087.stdout:1/374: creat df/d18/d1d/d58/d72/f85 x:0 0 0 2024-05-08T05:32:06.951 INFO:tasks.workunit.client.0.smithi087.stdout:1/375: dread - df/d18/d1d/d32/f6e zero size 2024-05-08T05:32:06.964 INFO:tasks.workunit.client.0.smithi087.stdout:7/514: dwrite d2/d6/d12/d19/d2a/f7b [0,4194304] 0 2024-05-08T05:32:06.966 INFO:tasks.workunit.client.0.smithi087.stdout:7/515: mknod d2/d6/da0/d67/d82/d98/cab 0 2024-05-08T05:32:06.975 INFO:tasks.workunit.client.0.smithi087.stdout:8/447: dwrite db/d23/d15/d29/d33/d6c/f7e [0,4194304] 0 2024-05-08T05:32:06.976 INFO:tasks.workunit.client.0.smithi087.stdout:7/516: dread d2/d6/da0/f61 [0,4194304] 0 2024-05-08T05:32:06.977 INFO:tasks.workunit.client.0.smithi087.stdout:8/448: rename db/d23/d3a/f46 to db/d23/d15/d29/d33/d3b/d56/d78/fa5 0 2024-05-08T05:32:06.977 INFO:tasks.workunit.client.0.smithi087.stdout:8/449: fsync db/d23/d15/d29/d33/d3b/d56/f87 0 2024-05-08T05:32:06.979 INFO:tasks.workunit.client.0.smithi087.stdout:8/450: creat db/d23/d15/d29/fa6 x:0 0 0 2024-05-08T05:32:06.979 INFO:tasks.workunit.client.0.smithi087.stdout:8/451: fsync db/d23/d1b/f2a 0 2024-05-08T05:32:06.979 INFO:tasks.workunit.client.0.smithi087.stdout:8/452: chown db/d23/d1b/c48 258570 1 2024-05-08T05:32:06.979 INFO:tasks.workunit.client.0.smithi087.stdout:8/453: stat db/d23/d15/f1e 0 2024-05-08T05:32:06.979 INFO:tasks.workunit.client.0.smithi087.stdout:8/454: fsync db/d23/d15/f99 0 2024-05-08T05:32:06.979 INFO:tasks.workunit.client.0.smithi087.stdout:8/455: fdatasync db/d23/d1b/f3d 0 2024-05-08T05:32:06.980 INFO:tasks.workunit.client.0.smithi087.stdout:7/517: truncate d2/da/f4c 853313 0 2024-05-08T05:32:06.980 INFO:tasks.workunit.client.0.smithi087.stdout:8/456: getdents db/d23/d54 0 2024-05-08T05:32:06.981 INFO:tasks.workunit.client.0.smithi087.stdout:7/518: creat d2/d6/d12/d19/fac x:0 0 0 2024-05-08T05:32:06.985 INFO:tasks.workunit.client.0.smithi087.stdout:8/457: truncate f8 3536914 0 2024-05-08T05:32:06.990 INFO:tasks.workunit.client.0.smithi087.stdout:0/431: sync 2024-05-08T05:32:06.997 INFO:tasks.workunit.client.0.smithi087.stdout:7/519: write d2/d6/d12/d19/f1e [4798117,92692] 0 2024-05-08T05:32:06.998 INFO:tasks.workunit.client.0.smithi087.stdout:7/520: dread - d2/d6/d12/d1d/fa4 zero size 2024-05-08T05:32:06.998 INFO:tasks.workunit.client.0.smithi087.stdout:7/521: dread - d2/d6/d12/d15/fa2 zero size 2024-05-08T05:32:07.000 INFO:tasks.workunit.client.0.smithi087.stdout:7/522: creat d2/da/fad x:0 0 0 2024-05-08T05:32:07.000 INFO:tasks.workunit.client.0.smithi087.stdout:7/523: truncate d2/d6/d12/d1d/fa4 688839 0 2024-05-08T05:32:07.000 INFO:tasks.workunit.client.0.smithi087.stdout:7/524: chown d2/d6/da0/d67/d82 7 1 2024-05-08T05:32:07.001 INFO:tasks.workunit.client.0.smithi087.stdout:7/525: creat d2/d6/d12/d1d/fae x:0 0 0 2024-05-08T05:32:07.001 INFO:tasks.workunit.client.0.smithi087.stdout:3/490: dwrite d4/d11/d3d/f5b [0,4194304] 0 2024-05-08T05:32:07.002 INFO:tasks.workunit.client.0.smithi087.stdout:7/526: truncate d2/da/d3f/d72/d77/f5a 1929033 0 2024-05-08T05:32:07.003 INFO:tasks.workunit.client.0.smithi087.stdout:3/491: creat d4/d11/fad x:0 0 0 2024-05-08T05:32:07.004 INFO:tasks.workunit.client.0.smithi087.stdout:7/527: mkdir d2/da/d3f/d49/daf 0 2024-05-08T05:32:07.005 INFO:tasks.workunit.client.0.smithi087.stdout:3/492: symlink d4/d11/d24/d25/d99/da2/lae 0 2024-05-08T05:32:07.006 INFO:tasks.workunit.client.0.smithi087.stdout:3/493: dread - d4/d11/fad zero size 2024-05-08T05:32:07.006 INFO:tasks.workunit.client.0.smithi087.stdout:3/494: read d4/d11/d24/d25/d3e/f65 [29204,100162] 0 2024-05-08T05:32:07.008 INFO:tasks.workunit.client.0.smithi087.stdout:3/495: write d4/d11/d24/d25/d3e/d3f/f6f [200350,123336] 0 2024-05-08T05:32:07.009 INFO:tasks.workunit.client.0.smithi087.stdout:3/496: creat d4/d11/d24/d39/faf x:0 0 0 2024-05-08T05:32:07.013 INFO:tasks.workunit.client.0.smithi087.stdout:0/432: dread d0/da/d35/d86/f15 [0,4194304] 0 2024-05-08T05:32:07.013 INFO:tasks.workunit.client.0.smithi087.stdout:0/433: write d0/da/d35/f3d [2813081,101365] 0 2024-05-08T05:32:07.016 INFO:tasks.workunit.client.0.smithi087.stdout:3/497: dread d4/d11/d24/d25/d3e/f65 [0,4194304] 0 2024-05-08T05:32:07.017 INFO:tasks.workunit.client.0.smithi087.stdout:3/498: symlink d4/d11/d24/d25/lb0 0 2024-05-08T05:32:07.024 INFO:tasks.workunit.client.0.smithi087.stdout:8/458: dwrite db/d23/d1b/d35/d43/d68/f86 [0,4194304] 0 2024-05-08T05:32:07.032 INFO:tasks.workunit.client.0.smithi087.stdout:2/403: sync 2024-05-08T05:32:07.033 INFO:tasks.workunit.client.0.smithi087.stdout:2/404: creat d7/de/d27/d33/d49/f84 x:0 0 0 2024-05-08T05:32:07.033 INFO:tasks.workunit.client.0.smithi087.stdout:2/405: fdatasync d7/de/d27/d33/f38 0 2024-05-08T05:32:07.033 INFO:tasks.workunit.client.0.smithi087.stdout:2/406: chown d7/de/d27/d33/f47 1 1 2024-05-08T05:32:07.052 INFO:tasks.workunit.client.0.smithi087.stdout:0/434: dwrite d0/d57/d24/d66/f87 [0,4194304] 0 2024-05-08T05:32:07.052 INFO:tasks.workunit.client.0.smithi087.stdout:2/407: write d7/de/f24 [894982,92839] 0 2024-05-08T05:32:07.052 INFO:tasks.workunit.client.0.smithi087.stdout:7/528: dwrite d2/d6/d12/d1d/fa4 [0,4194304] 0 2024-05-08T05:32:07.058 INFO:tasks.workunit.client.0.smithi087.stdout:7/529: unlink d2/da/d3f/d72/d77/d54/d50/d88/la6 0 2024-05-08T05:32:07.060 INFO:tasks.workunit.client.0.smithi087.stdout:2/408: getdents d7/de/d27/d33/d49 0 2024-05-08T05:32:07.061 INFO:tasks.workunit.client.0.smithi087.stdout:7/530: unlink d2/d6/da0/d67/d82/d98/cab 0 2024-05-08T05:32:07.061 INFO:tasks.workunit.client.0.smithi087.stdout:7/531: chown d2/da/d3f/f30 6198 1 2024-05-08T05:32:07.061 INFO:tasks.workunit.client.0.smithi087.stdout:4/468: sync 2024-05-08T05:32:07.061 INFO:tasks.workunit.client.0.smithi087.stdout:9/458: sync 2024-05-08T05:32:07.061 INFO:tasks.workunit.client.0.smithi087.stdout:6/476: sync 2024-05-08T05:32:07.061 INFO:tasks.workunit.client.0.smithi087.stdout:1/376: sync 2024-05-08T05:32:07.062 INFO:tasks.workunit.client.0.smithi087.stdout:6/477: write d4/d8/df/d1e/d52/f80 [971808,129388] 0 2024-05-08T05:32:07.062 INFO:tasks.workunit.client.0.smithi087.stdout:6/478: stat d4/d8/df/d1e/d25/d28/d2d/d37/c83 0 2024-05-08T05:32:07.062 INFO:tasks.workunit.client.0.smithi087.stdout:6/479: chown d4/d8/df/l1f 1 1 2024-05-08T05:32:07.065 INFO:tasks.workunit.client.0.smithi087.stdout:5/431: sync 2024-05-08T05:32:07.066 INFO:tasks.workunit.client.0.smithi087.stdout:4/469: symlink d4/d13/d65/lb2 0 2024-05-08T05:32:07.067 INFO:tasks.workunit.client.0.smithi087.stdout:3/499: dwrite d4/d11/d3d/d48/f52 [0,4194304] 0 2024-05-08T05:32:07.070 INFO:tasks.workunit.client.0.smithi087.stdout:9/459: symlink d1/df/d37/d74/l86 0 2024-05-08T05:32:07.070 INFO:tasks.workunit.client.0.smithi087.stdout:4/470: mknod d4/d13/d3e/d28/d35/cb3 0 2024-05-08T05:32:07.070 INFO:tasks.workunit.client.0.smithi087.stdout:6/480: rmdir d4/d6 39 2024-05-08T05:32:07.070 INFO:tasks.workunit.client.0.smithi087.stdout:9/460: write d1/df/d14/d68/f6b [472213,9778] 0 2024-05-08T05:32:07.072 INFO:tasks.workunit.client.0.smithi087.stdout:4/471: link d4/d13/d65/l75 d4/d13/d32/d8d/d91/lb4 0 2024-05-08T05:32:07.073 INFO:tasks.workunit.client.0.smithi087.stdout:9/461: link d1/db/d28/f2e d1/df/d37/d5b/d7e/d85/f87 0 2024-05-08T05:32:07.074 INFO:tasks.workunit.client.0.smithi087.stdout:4/472: rmdir d4/d13/d3e/d28/d50/d5a 39 2024-05-08T05:32:07.074 INFO:tasks.workunit.client.0.smithi087.stdout:4/473: write d4/d13/fa1 [508601,112545] 0 2024-05-08T05:32:07.074 INFO:tasks.workunit.client.0.smithi087.stdout:5/432: dread da/dd/d10/f40 [0,4194304] 0 2024-05-08T05:32:07.075 INFO:tasks.workunit.client.0.smithi087.stdout:9/462: mkdir d1/df/d14/d54/d61/d88 0 2024-05-08T05:32:07.077 INFO:tasks.workunit.client.0.smithi087.stdout:4/474: mknod d4/d13/d3e/d28/d50/cb5 0 2024-05-08T05:32:07.078 INFO:tasks.workunit.client.0.smithi087.stdout:5/433: mkdir da/dd/d10/d36/d45/d5c/d89 0 2024-05-08T05:32:07.080 INFO:tasks.workunit.client.0.smithi087.stdout:2/409: dread d7/de/d27/d33/d49/f5a [0,4194304] 0 2024-05-08T05:32:07.093 INFO:tasks.workunit.client.0.smithi087.stdout:4/475: chown d4/l2c 1750 1 2024-05-08T05:32:07.093 INFO:tasks.workunit.client.0.smithi087.stdout:5/434: symlink da/db/d2a/d46/d69/l8a 0 2024-05-08T05:32:07.094 INFO:tasks.workunit.client.0.smithi087.stdout:5/435: fdatasync da/dd/d10/d36/f76 0 2024-05-08T05:32:07.094 INFO:tasks.workunit.client.0.smithi087.stdout:1/377: dread df/d2f/d4f/f76 [0,4194304] 0 2024-05-08T05:32:07.094 INFO:tasks.workunit.client.0.smithi087.stdout:1/378: fsync df/f40 0 2024-05-08T05:32:07.094 INFO:tasks.workunit.client.0.smithi087.stdout:2/410: symlink d7/l85 0 2024-05-08T05:32:07.095 INFO:tasks.workunit.client.0.smithi087.stdout:4/476: symlink d4/d13/d32/lb6 0 2024-05-08T05:32:07.095 INFO:tasks.workunit.client.0.smithi087.stdout:5/436: mknod da/dd/d13/d16/c8b 0 2024-05-08T05:32:07.096 INFO:tasks.workunit.client.0.smithi087.stdout:4/477: link d4/d13/d3e/f4f d4/d6c/fb7 0 2024-05-08T05:32:07.097 INFO:tasks.workunit.client.0.smithi087.stdout:5/437: getdents da/dd/d10/d42/d43/d83/d6b 0 2024-05-08T05:32:07.098 INFO:tasks.workunit.client.0.smithi087.stdout:4/478: mkdir d4/d13/d32/d8d/d91/db8 0 2024-05-08T05:32:07.098 INFO:tasks.workunit.client.0.smithi087.stdout:5/438: symlink da/db/d2a/d5a/l8c 0 2024-05-08T05:32:07.099 INFO:tasks.workunit.client.0.smithi087.stdout:5/439: write da/dd/d10/d42/d43/d83/d6b/f80 [273196,128012] 0 2024-05-08T05:32:07.101 INFO:tasks.workunit.client.0.smithi087.stdout:5/440: mknod da/dd/d10/d42/d43/c8d 0 2024-05-08T05:32:07.102 INFO:tasks.workunit.client.0.smithi087.stdout:5/441: fsync da/dd/d10/f40 0 2024-05-08T05:32:07.102 INFO:tasks.workunit.client.0.smithi087.stdout:5/442: write da/dd/d10/d36/d45/f85 [914609,14637] 0 2024-05-08T05:32:07.102 INFO:tasks.workunit.client.0.smithi087.stdout:5/443: chown da/dd/d10/d36/d45/d5c/d89 27885401 1 2024-05-08T05:32:07.103 INFO:tasks.workunit.client.0.smithi087.stdout:5/444: creat da/dd/d10/d36/d45/d5c/d86/f8e x:0 0 0 2024-05-08T05:32:07.103 INFO:tasks.workunit.client.0.smithi087.stdout:5/445: write da/dd/d13/d16/f26 [5699492,15010] 0 2024-05-08T05:32:07.106 INFO:tasks.workunit.client.0.smithi087.stdout:4/479: getdents d4/d13/d3e/d28/d50 0 2024-05-08T05:32:07.108 INFO:tasks.workunit.client.0.smithi087.stdout:4/480: creat d4/d13/d32/d8d/d91/d84/fb9 x:0 0 0 2024-05-08T05:32:07.111 INFO:tasks.workunit.client.0.smithi087.stdout:1/379: dread df/d18/d1d/f48 [0,4194304] 0 2024-05-08T05:32:07.112 INFO:tasks.workunit.client.0.smithi087.stdout:0/435: dwrite d0/d22/d3c/f44 [0,4194304] 0 2024-05-08T05:32:07.112 INFO:tasks.workunit.client.0.smithi087.stdout:0/436: readlink d0/d9/d1b/l73 0 2024-05-08T05:32:07.112 INFO:tasks.workunit.client.0.smithi087.stdout:1/380: creat df/d18/d1d/d32/f86 x:0 0 0 2024-05-08T05:32:07.112 INFO:tasks.workunit.client.0.smithi087.stdout:0/437: write d0/da/d35/f37 [922229,85415] 0 2024-05-08T05:32:07.114 INFO:tasks.workunit.client.0.smithi087.stdout:0/438: creat d0/da/d35/d86/d74/d51/f96 x:0 0 0 2024-05-08T05:32:07.138 INFO:tasks.workunit.client.0.smithi087.stdout:1/381: dread df/d2f/d57/d64/f23 [0,4194304] 0 2024-05-08T05:32:07.138 INFO:tasks.workunit.client.0.smithi087.stdout:1/382: dread - df/d18/d1d/d27/f6d zero size 2024-05-08T05:32:07.138 INFO:tasks.workunit.client.0.smithi087.stdout:6/481: dwrite d4/d8/d61/d6f/f90 [0,4194304] 0 2024-05-08T05:32:07.139 INFO:tasks.workunit.client.0.smithi087.stdout:2/411: write d7/de/d27/d33/d65/f7e [659936,13405] 0 2024-05-08T05:32:07.140 INFO:tasks.workunit.client.0.smithi087.stdout:1/383: symlink df/d18/d1d/d27/l87 0 2024-05-08T05:32:07.141 INFO:tasks.workunit.client.0.smithi087.stdout:6/482: creat d4/d8/df/d1e/d25/f92 x:0 0 0 2024-05-08T05:32:07.141 INFO:tasks.workunit.client.0.smithi087.stdout:6/483: read d4/f38 [1041001,57161] 0 2024-05-08T05:32:07.142 INFO:tasks.workunit.client.0.smithi087.stdout:6/484: chown d4/d6/f60 331785 1 2024-05-08T05:32:07.142 INFO:tasks.workunit.client.0.smithi087.stdout:9/463: dwrite d1/db/d28/f42 [0,4194304] 0 2024-05-08T05:32:07.143 INFO:tasks.workunit.client.0.smithi087.stdout:6/485: rename d4/d6/f1b to d4/d8/df/d1e/d25/d28/d2d/d37/d5b/f93 0 2024-05-08T05:32:07.145 INFO:tasks.workunit.client.0.smithi087.stdout:3/500: dwrite d4/d11/f7e [0,4194304] 0 2024-05-08T05:32:07.145 INFO:tasks.workunit.client.0.smithi087.stdout:3/501: chown d4/d11/d24/d25/d3e/d3f 1192961385 1 2024-05-08T05:32:07.145 INFO:tasks.workunit.client.0.smithi087.stdout:3/502: stat d4/d11/d24/d39/d5a/f6b 0 2024-05-08T05:32:07.145 INFO:tasks.workunit.client.0.smithi087.stdout:6/486: truncate d4/d8/df/d1e/d25/f4b 2168598 0 2024-05-08T05:32:07.160 INFO:tasks.workunit.client.0.smithi087.stdout:3/503: creat d4/d11/d24/d25/d4d/fb1 x:0 0 0 2024-05-08T05:32:07.160 INFO:tasks.workunit.client.0.smithi087.stdout:6/487: mkdir d4/d8/df/d39/d42/d94 0 2024-05-08T05:32:07.176 INFO:tasks.workunit.client.0.smithi087.stdout:8/459: sync 2024-05-08T05:32:07.177 INFO:tasks.workunit.client.0.smithi087.stdout:5/446: dwrite da/f4b [0,4194304] 0 2024-05-08T05:32:07.191 INFO:tasks.workunit.client.0.smithi087.stdout:1/384: dwrite df/d18/d1d/f3a [0,4194304] 0 2024-05-08T05:32:07.198 INFO:tasks.workunit.client.0.smithi087.stdout:9/464: dwrite d1/df/f2c [0,4194304] 0 2024-05-08T05:32:07.199 INFO:tasks.workunit.client.0.smithi087.stdout:0/439: dwrite d0/da/f47 [0,4194304] 0 2024-05-08T05:32:07.200 INFO:tasks.workunit.client.0.smithi087.stdout:9/465: mknod d1/db/c89 0 2024-05-08T05:32:07.200 INFO:tasks.workunit.client.0.smithi087.stdout:9/466: write d1/df/d14/f2f [898345,57749] 0 2024-05-08T05:32:07.204 INFO:tasks.workunit.client.0.smithi087.stdout:9/467: symlink d1/df/d37/d5b/d7e/l8a 0 2024-05-08T05:32:07.213 INFO:tasks.workunit.client.0.smithi087.stdout:6/488: dwrite d4/d8/f67 [0,4194304] 0 2024-05-08T05:32:07.213 INFO:tasks.workunit.client.0.smithi087.stdout:1/385: write df/d18/d1d/f2d [1127194,82734] 0 2024-05-08T05:32:07.214 INFO:tasks.workunit.client.0.smithi087.stdout:8/460: dread f2 [0,4194304] 0 2024-05-08T05:32:07.215 INFO:tasks.workunit.client.0.smithi087.stdout:6/489: link d4/d8/df/d1e/d25/d28/d2d/d37/d45/f68 d4/d8/f95 0 2024-05-08T05:32:07.216 INFO:tasks.workunit.client.0.smithi087.stdout:8/461: creat db/d23/d15/d29/d79/fa7 x:0 0 0 2024-05-08T05:32:07.216 INFO:tasks.workunit.client.0.smithi087.stdout:8/462: fdatasync db/d23/d15/f21 0 2024-05-08T05:32:07.219 INFO:tasks.workunit.client.0.smithi087.stdout:6/490: creat d4/d8/df/d1e/f96 x:0 0 0 2024-05-08T05:32:07.219 INFO:tasks.workunit.client.0.smithi087.stdout:6/491: chown d4/d8/df/d1e/d25/d28/d57/c7c 37493 1 2024-05-08T05:32:07.219 INFO:tasks.workunit.client.0.smithi087.stdout:6/492: fdatasync d4/d8/d61/d6f/f8b 0 2024-05-08T05:32:07.220 INFO:tasks.workunit.client.0.smithi087.stdout:6/493: creat d4/f97 x:0 0 0 2024-05-08T05:32:07.227 INFO:tasks.workunit.client.0.smithi087.stdout:2/412: dwrite d7/f37 [0,4194304] 0 2024-05-08T05:32:07.228 INFO:tasks.workunit.client.0.smithi087.stdout:2/413: chown d7/de/f64 346 1 2024-05-08T05:32:07.228 INFO:tasks.workunit.client.0.smithi087.stdout:2/414: chown d7/de/d5d/l69 12627393 1 2024-05-08T05:32:07.230 INFO:tasks.workunit.client.0.smithi087.stdout:2/415: creat d7/de/d5d/f86 x:0 0 0 2024-05-08T05:32:07.241 INFO:tasks.workunit.client.0.smithi087.stdout:8/463: dread db/d23/f2e [0,4194304] 0 2024-05-08T05:32:07.241 INFO:tasks.workunit.client.0.smithi087.stdout:6/494: dread d4/d6/f13 [0,4194304] 0 2024-05-08T05:32:07.241 INFO:tasks.workunit.client.0.smithi087.stdout:6/495: chown d4/d8/f67 257085120 1 2024-05-08T05:32:07.241 INFO:tasks.workunit.client.0.smithi087.stdout:6/496: creat d4/d8/df/d39/d42/f98 x:0 0 0 2024-05-08T05:32:07.241 INFO:tasks.workunit.client.0.smithi087.stdout:5/447: dwrite da/dd/d10/d36/f39 [4194304,4194304] 0 2024-05-08T05:32:07.241 INFO:tasks.workunit.client.0.smithi087.stdout:6/497: truncate d4/d8/f18 7832001 0 2024-05-08T05:32:07.245 INFO:tasks.workunit.client.0.smithi087.stdout:5/448: creat da/db/f8f x:0 0 0 2024-05-08T05:32:07.245 INFO:tasks.workunit.client.0.smithi087.stdout:5/449: read - da/dd/d13/f88 zero size 2024-05-08T05:32:07.245 INFO:tasks.workunit.client.0.smithi087.stdout:5/450: creat da/dd/d10/d42/d43/f90 x:0 0 0 2024-05-08T05:32:07.250 INFO:tasks.workunit.client.0.smithi087.stdout:2/416: dread d7/d63/f7d [0,4194304] 0 2024-05-08T05:32:07.250 INFO:tasks.workunit.client.0.smithi087.stdout:5/451: creat da/dd/d65/f91 x:0 0 0 2024-05-08T05:32:07.264 INFO:tasks.workunit.client.0.smithi087.stdout:0/440: dwrite d0/da/d11/f43 [0,4194304] 0 2024-05-08T05:32:07.270 INFO:tasks.workunit.client.0.smithi087.stdout:1/386: dwrite df/d2f/d57/f5d [0,4194304] 0 2024-05-08T05:32:07.275 INFO:tasks.workunit.client.0.smithi087.stdout:1/387: rename df/d2f/d57/d64/f71 to df/d18/d1d/f88 0 2024-05-08T05:32:07.282 INFO:tasks.workunit.client.0.smithi087.stdout:1/388: dread df/d18/f47 [0,4194304] 0 2024-05-08T05:32:07.283 INFO:tasks.workunit.client.0.smithi087.stdout:9/468: dwrite d1/db/d28/f7c [4194304,4194304] 0 2024-05-08T05:32:07.284 INFO:tasks.workunit.client.0.smithi087.stdout:1/389: unlink df/d18/d1d/d27/d61/c6f 0 2024-05-08T05:32:07.287 INFO:tasks.workunit.client.0.smithi087.stdout:9/469: unlink d1/df/f52 0 2024-05-08T05:32:07.287 INFO:tasks.workunit.client.0.smithi087.stdout:1/390: mkdir df/d18/d1d/d27/d61/d89 0 2024-05-08T05:32:07.287 INFO:tasks.workunit.client.0.smithi087.stdout:1/391: write df/d18/d1d/d32/f86 [808839,81841] 0 2024-05-08T05:32:07.288 INFO:tasks.workunit.client.0.smithi087.stdout:1/392: write df/d2f/d57/d64/f29 [5380603,118840] 0 2024-05-08T05:32:07.289 INFO:tasks.workunit.client.0.smithi087.stdout:8/464: dwrite f8 [4194304,4194304] 0 2024-05-08T05:32:07.289 INFO:tasks.workunit.client.0.smithi087.stdout:1/393: mknod df/d18/c8a 0 2024-05-08T05:32:07.289 INFO:tasks.workunit.client.0.smithi087.stdout:9/470: mkdir d1/df/d14/d68/d80/d8b 0 2024-05-08T05:32:07.289 INFO:tasks.workunit.client.0.smithi087.stdout:9/471: truncate d1/df/d14/d68/d80/f84 756649 0 2024-05-08T05:32:07.291 INFO:tasks.workunit.client.0.smithi087.stdout:4/481: sync 2024-05-08T05:32:07.291 INFO:tasks.workunit.client.0.smithi087.stdout:4/482: stat d4/d6c/cae 0 2024-05-08T05:32:07.292 INFO:tasks.workunit.client.0.smithi087.stdout:5/452: dwrite da/dd/d10/d42/d43/d83/d6b/f80 [0,4194304] 0 2024-05-08T05:32:07.292 INFO:tasks.workunit.client.0.smithi087.stdout:8/465: mknod db/d23/d15/d29/ca8 0 2024-05-08T05:32:07.292 INFO:tasks.workunit.client.0.smithi087.stdout:7/532: sync 2024-05-08T05:32:07.293 INFO:tasks.workunit.client.0.smithi087.stdout:1/394: mkdir df/d18/d8b 0 2024-05-08T05:32:07.293 INFO:tasks.workunit.client.0.smithi087.stdout:1/395: chown df/d18/d1d/d27/d61/c6c 25667 1 2024-05-08T05:32:07.297 INFO:tasks.workunit.client.0.smithi087.stdout:5/453: mknod da/c92 0 2024-05-08T05:32:07.297 INFO:tasks.workunit.client.0.smithi087.stdout:8/466: link db/d23/d15/d29/d33/d3b/f6b db/d23/d1b/d35/d43/d68/fa9 0 2024-05-08T05:32:07.298 INFO:tasks.workunit.client.0.smithi087.stdout:7/533: mkdir d2/db0 0 2024-05-08T05:32:07.298 INFO:tasks.workunit.client.0.smithi087.stdout:7/534: fsync d2/d6/d12/d19/d2a/f7b 0 2024-05-08T05:32:07.302 INFO:tasks.workunit.client.0.smithi087.stdout:0/441: dwrite d0/da/f1e [0,4194304] 0 2024-05-08T05:32:07.310 INFO:tasks.workunit.client.0.smithi087.stdout:8/467: symlink db/d23/d15/d29/d79/d95/laa 0 2024-05-08T05:32:07.310 INFO:tasks.workunit.client.0.smithi087.stdout:8/468: truncate f6 4829178 0 2024-05-08T05:32:07.310 INFO:tasks.workunit.client.0.smithi087.stdout:7/535: truncate d2/d6/d12/d1d/f3a 38499 0 2024-05-08T05:32:07.310 INFO:tasks.workunit.client.0.smithi087.stdout:7/536: readlink d2/da/d3f/l6c 0 2024-05-08T05:32:07.310 INFO:tasks.workunit.client.0.smithi087.stdout:5/454: rename da/dd/d10 to da/db/d2a/d5a/d93 0 2024-05-08T05:32:07.311 INFO:tasks.workunit.client.0.smithi087.stdout:7/537: write d2/d6/d12/f39 [60230,44712] 0 2024-05-08T05:32:07.311 INFO:tasks.workunit.client.0.smithi087.stdout:8/469: write db/d23/d15/d29/d33/d6c/f6d [644398,70151] 0 2024-05-08T05:32:07.314 INFO:tasks.workunit.client.0.smithi087.stdout:0/442: creat d0/da/f97 x:0 0 0 2024-05-08T05:32:07.315 INFO:tasks.workunit.client.0.smithi087.stdout:9/472: write d1/df/f12 [2385622,18660] 0 2024-05-08T05:32:07.315 INFO:tasks.workunit.client.0.smithi087.stdout:5/455: mkdir da/dd/d94 0 2024-05-08T05:32:07.315 INFO:tasks.workunit.client.0.smithi087.stdout:5/456: fdatasync da/db/f71 0 2024-05-08T05:32:07.315 INFO:tasks.workunit.client.0.smithi087.stdout:9/473: write d1/db/f4e [960689,130965] 0 2024-05-08T05:32:07.315 INFO:tasks.workunit.client.0.smithi087.stdout:9/474: chown d1/df/d14/f6e 744449 1 2024-05-08T05:32:07.315 INFO:tasks.workunit.client.0.smithi087.stdout:9/475: fdatasync d1/db/d28/f75 0 2024-05-08T05:32:07.315 INFO:tasks.workunit.client.0.smithi087.stdout:9/476: chown d1/df/d14/f17 0 1 2024-05-08T05:32:07.315 INFO:tasks.workunit.client.0.smithi087.stdout:9/477: read d1/df/d14/d18/f34 [84908,17255] 0 2024-05-08T05:32:07.316 INFO:tasks.workunit.client.0.smithi087.stdout:8/470: unlink db/d23/d15/d29/d33/f77 0 2024-05-08T05:32:07.316 INFO:tasks.workunit.client.0.smithi087.stdout:8/471: fdatasync db/f41 0 2024-05-08T05:32:07.318 INFO:tasks.workunit.client.0.smithi087.stdout:9/478: unlink d1/df/f2c 0 2024-05-08T05:32:07.320 INFO:tasks.workunit.client.0.smithi087.stdout:8/472: getdents db/d23/d15/d29/d4d 0 2024-05-08T05:32:07.320 INFO:tasks.workunit.client.0.smithi087.stdout:8/473: readlink db/d23/l18 0 2024-05-08T05:32:07.322 INFO:tasks.workunit.client.0.smithi087.stdout:9/479: mknod d1/c8c 0 2024-05-08T05:32:07.325 INFO:tasks.workunit.client.0.smithi087.stdout:8/474: creat db/d23/d15/d29/d33/d3b/d56/fab x:0 0 0 2024-05-08T05:32:07.325 INFO:tasks.workunit.client.0.smithi087.stdout:9/480: mknod d1/db/d28/c8d 0 2024-05-08T05:32:07.326 INFO:tasks.workunit.client.0.smithi087.stdout:9/481: rmdir d1/d70 39 2024-05-08T05:32:07.327 INFO:tasks.workunit.client.0.smithi087.stdout:7/538: write d2/d6/d12/d1d/f13 [3628285,65921] 0 2024-05-08T05:32:07.327 INFO:tasks.workunit.client.0.smithi087.stdout:7/539: write d2/da/d3f/d72/d77/d54/f3e [572583,14668] 0 2024-05-08T05:32:07.329 INFO:tasks.workunit.client.0.smithi087.stdout:7/540: mknod d2/d6/d12/cb1 0 2024-05-08T05:32:07.335 INFO:tasks.workunit.client.0.smithi087.stdout:5/457: write da/db/d2a/d5a/d93/d17/f2b [2311199,90937] 0 2024-05-08T05:32:07.336 INFO:tasks.workunit.client.0.smithi087.stdout:5/458: getdents da/dd/d94 0 2024-05-08T05:32:07.339 INFO:tasks.workunit.client.0.smithi087.stdout:4/483: dwrite d4/d13/d3e/f38 [4194304,4194304] 0 2024-05-08T05:32:07.339 INFO:tasks.workunit.client.0.smithi087.stdout:4/484: chown d4/d13/d65/d4e/f78 1284637518 1 2024-05-08T05:32:07.341 INFO:tasks.workunit.client.0.smithi087.stdout:4/485: rename d4/d13/d65/d4e to d4/d13/d32/d8d/d91/db8/dba 0 2024-05-08T05:32:07.342 INFO:tasks.workunit.client.0.smithi087.stdout:4/486: rmdir d4/d13/d3e/d28/d50/d9d 39 2024-05-08T05:32:07.344 INFO:tasks.workunit.client.0.smithi087.stdout:4/487: rename d4/d6c/l77 to d4/d13/d32/d8d/d91/d84/d5d/lbb 0 2024-05-08T05:32:07.352 INFO:tasks.workunit.client.0.smithi087.stdout:8/475: read db/d23/d15/d29/d33/d6c/f6d [205236,119207] 0 2024-05-08T05:32:07.353 INFO:tasks.workunit.client.0.smithi087.stdout:4/488: mknod d4/cbc 0 2024-05-08T05:32:07.353 INFO:tasks.workunit.client.0.smithi087.stdout:4/489: chown d4/d13/d3e/f36 718930827 1 2024-05-08T05:32:07.353 INFO:tasks.workunit.client.0.smithi087.stdout:4/490: write d4/d13/d32/d8d/d91/d84/d5d/fa0 [915405,8998] 0 2024-05-08T05:32:07.353 INFO:tasks.workunit.client.0.smithi087.stdout:8/476: truncate db/d23/d54/f74 6455070 0 2024-05-08T05:32:07.353 INFO:tasks.workunit.client.0.smithi087.stdout:4/491: mkdir d4/d13/d32/d8d/d91/db8/dba/dbd 0 2024-05-08T05:32:07.353 INFO:tasks.workunit.client.0.smithi087.stdout:4/492: mknod d4/d13/d3e/cbe 0 2024-05-08T05:32:07.353 INFO:tasks.workunit.client.0.smithi087.stdout:1/396: dwrite df/f3d [0,4194304] 0 2024-05-08T05:32:07.359 INFO:tasks.workunit.client.0.smithi087.stdout:8/477: mkdir db/d23/d15/d29/d79/d95/dac 0 2024-05-08T05:32:07.360 INFO:tasks.workunit.client.0.smithi087.stdout:1/397: creat df/d18/d8b/f8c x:0 0 0 2024-05-08T05:32:07.360 INFO:tasks.workunit.client.0.smithi087.stdout:8/478: stat db/f12 0 2024-05-08T05:32:07.365 INFO:tasks.workunit.client.0.smithi087.stdout:4/493: dread d4/f4b [0,4194304] 0 2024-05-08T05:32:07.369 INFO:tasks.workunit.client.0.smithi087.stdout:1/398: link df/l26 df/d18/d1d/d32/l8d 0 2024-05-08T05:32:07.371 INFO:tasks.workunit.client.0.smithi087.stdout:4/494: rename d4/d13/d3e/d28/d50/d9d/c9f to d4/d6c/cbf 0 2024-05-08T05:32:07.371 INFO:tasks.workunit.client.0.smithi087.stdout:4/495: chown d4/d13/f23 1685 1 2024-05-08T05:32:07.372 INFO:tasks.workunit.client.0.smithi087.stdout:1/399: symlink df/d18/d4b/l8e 0 2024-05-08T05:32:07.374 INFO:tasks.workunit.client.0.smithi087.stdout:4/496: rename d4/d13/d32/d8d/d91/db8/dba/d63/d98/laa to d4/d13/d32/d8d/d91/d84/d5d/lc0 0 2024-05-08T05:32:07.375 INFO:tasks.workunit.client.0.smithi087.stdout:4/497: write d4/d13/d3e/d28/fab [282939,61018] 0 2024-05-08T05:32:07.375 INFO:tasks.workunit.client.0.smithi087.stdout:4/498: write d4/d6c/f99 [1019424,87404] 0 2024-05-08T05:32:07.375 INFO:tasks.workunit.client.0.smithi087.stdout:1/400: symlink df/d18/d1d/d32/l8f 0 2024-05-08T05:32:07.378 INFO:tasks.workunit.client.0.smithi087.stdout:1/401: unlink df/d18/f28 0 2024-05-08T05:32:07.379 INFO:tasks.workunit.client.0.smithi087.stdout:1/402: write df/d18/d1d/d32/f6e [293389,45656] 0 2024-05-08T05:32:07.381 INFO:tasks.workunit.client.0.smithi087.stdout:1/403: mkdir df/d18/d1d/d27/d90 0 2024-05-08T05:32:07.381 INFO:tasks.workunit.client.0.smithi087.stdout:1/404: truncate df/d2f/d4f/f84 741844 0 2024-05-08T05:32:07.381 INFO:tasks.workunit.client.0.smithi087.stdout:1/405: truncate df/d18/f47 1061785 0 2024-05-08T05:32:07.384 INFO:tasks.workunit.client.0.smithi087.stdout:1/406: write df/d2f/d57/f5d [5089806,108846] 0 2024-05-08T05:32:07.385 INFO:tasks.workunit.client.0.smithi087.stdout:7/541: dwrite d2/da/f4c [0,4194304] 0 2024-05-08T05:32:07.386 INFO:tasks.workunit.client.0.smithi087.stdout:7/542: symlink d2/d6/da0/d67/d82/lb2 0 2024-05-08T05:32:07.388 INFO:tasks.workunit.client.0.smithi087.stdout:8/479: dread db/d23/d1b/d35/d43/d68/d6a/f73 [0,4194304] 0 2024-05-08T05:32:07.389 INFO:tasks.workunit.client.0.smithi087.stdout:8/480: creat db/d23/d1b/fad x:0 0 0 2024-05-08T05:32:07.391 INFO:tasks.workunit.client.0.smithi087.stdout:0/443: dwrite d0/d22/d3c/f44 [0,4194304] 0 2024-05-08T05:32:07.392 INFO:tasks.workunit.client.0.smithi087.stdout:0/444: creat d0/d57/d24/d66/f98 x:0 0 0 2024-05-08T05:32:07.394 INFO:tasks.workunit.client.0.smithi087.stdout:0/445: creat d0/da/d35/d86/d74/d51/f99 x:0 0 0 2024-05-08T05:32:07.399 INFO:tasks.workunit.client.0.smithi087.stdout:3/504: sync 2024-05-08T05:32:07.403 INFO:tasks.workunit.client.0.smithi087.stdout:5/459: dwrite da/db/d2a/d5a/d93/f40 [0,4194304] 0 2024-05-08T05:32:07.403 INFO:tasks.workunit.client.0.smithi087.stdout:5/460: write da/dd/d65/f68 [1635535,14163] 0 2024-05-08T05:32:07.404 INFO:tasks.workunit.client.0.smithi087.stdout:5/461: creat da/db/d2a/f95 x:0 0 0 2024-05-08T05:32:07.415 INFO:tasks.workunit.client.0.smithi087.stdout:0/446: write d0/da/d35/d86/d74/d51/f5c [3961975,51952] 0 2024-05-08T05:32:07.415 INFO:tasks.workunit.client.0.smithi087.stdout:0/447: truncate d0/da/f5f 37315 0 2024-05-08T05:32:07.418 INFO:tasks.workunit.client.0.smithi087.stdout:0/448: chown d0/f29 90487160 1 2024-05-08T05:32:07.420 INFO:tasks.workunit.client.0.smithi087.stdout:8/481: dread db/d23/f57 [4194304,4194304] 0 2024-05-08T05:32:07.423 INFO:tasks.workunit.client.0.smithi087.stdout:8/482: creat db/d23/d15/d29/d79/d95/fae x:0 0 0 2024-05-08T05:32:07.424 INFO:tasks.workunit.client.0.smithi087.stdout:8/483: chown db/d23/d15/c20 243690 1 2024-05-08T05:32:07.427 INFO:tasks.workunit.client.0.smithi087.stdout:8/484: mkdir db/d23/d1b/d35/d43/daf 0 2024-05-08T05:32:07.428 INFO:tasks.workunit.client.0.smithi087.stdout:9/482: dwrite d1/fa [0,4194304] 0 2024-05-08T05:32:07.429 INFO:tasks.workunit.client.0.smithi087.stdout:4/499: write d4/d13/d32/f3c [2754790,101374] 0 2024-05-08T05:32:07.433 INFO:tasks.workunit.client.0.smithi087.stdout:9/483: mkdir d1/df/d14/d18/d8e 0 2024-05-08T05:32:07.435 INFO:tasks.workunit.client.0.smithi087.stdout:4/500: rename d4/d13/d32/d8d/d91/f74 to d4/d13/d32/fc1 0 2024-05-08T05:32:07.436 INFO:tasks.workunit.client.0.smithi087.stdout:9/484: creat d1/df/d37/d5b/d7e/f8f x:0 0 0 2024-05-08T05:32:07.439 INFO:tasks.workunit.client.0.smithi087.stdout:4/501: rename d4/d13/d3e/f52 to d4/d13/d32/d8d/d91/db8/dba/fc2 0 2024-05-08T05:32:07.439 INFO:tasks.workunit.client.0.smithi087.stdout:4/502: chown d4/cbc 1325 1 2024-05-08T05:32:07.439 INFO:tasks.workunit.client.0.smithi087.stdout:9/485: creat d1/df/d37/f90 x:0 0 0 2024-05-08T05:32:07.442 INFO:tasks.workunit.client.0.smithi087.stdout:4/503: mkdir d4/d13/d32/d8d/d91/d84/d5d/dc3 0 2024-05-08T05:32:07.444 INFO:tasks.workunit.client.0.smithi087.stdout:9/486: creat d1/df/f91 x:0 0 0 2024-05-08T05:32:07.448 INFO:tasks.workunit.client.0.smithi087.stdout:9/487: symlink d1/df/d14/l92 0 2024-05-08T05:32:07.449 INFO:tasks.workunit.client.0.smithi087.stdout:1/407: dwrite df/d18/d1d/f48 [4194304,4194304] 0 2024-05-08T05:32:07.456 INFO:tasks.workunit.client.0.smithi087.stdout:5/462: fsync da/db/d2a/d5a/d93/d17/f2b 0 2024-05-08T05:32:07.456 INFO:tasks.workunit.client.0.smithi087.stdout:9/488: unlink d1/df/f35 0 2024-05-08T05:32:07.456 INFO:tasks.workunit.client.0.smithi087.stdout:5/463: write da/db/d2a/f95 [829967,68247] 0 2024-05-08T05:32:07.456 INFO:tasks.workunit.client.0.smithi087.stdout:2/417: sync 2024-05-08T05:32:07.456 INFO:tasks.workunit.client.0.smithi087.stdout:6/498: sync 2024-05-08T05:32:07.456 INFO:tasks.workunit.client.0.smithi087.stdout:6/499: chown d4/d8/df/d1e/d25/d28/d2d/d37 4 1 2024-05-08T05:32:07.457 INFO:tasks.workunit.client.0.smithi087.stdout:7/543: dwrite d2/d6/d12/d19/f2d [0,4194304] 0 2024-05-08T05:32:07.457 INFO:tasks.workunit.client.0.smithi087.stdout:7/544: dread - d2/da/d3f/d72/d77/d54/d55/f96 zero size 2024-05-08T05:32:07.457 INFO:tasks.workunit.client.0.smithi087.stdout:5/464: symlink da/db/l96 0 2024-05-08T05:32:07.457 INFO:tasks.workunit.client.0.smithi087.stdout:7/545: dread - d2/d6/d12/d19/fac zero size 2024-05-08T05:32:07.458 INFO:tasks.workunit.client.0.smithi087.stdout:2/418: mknod d7/de/d27/d33/d65/c87 0 2024-05-08T05:32:07.459 INFO:tasks.workunit.client.0.smithi087.stdout:2/419: chown d7/c28 98 1 2024-05-08T05:32:07.460 INFO:tasks.workunit.client.0.smithi087.stdout:5/465: unlink da/db/l2c 0 2024-05-08T05:32:07.460 INFO:tasks.workunit.client.0.smithi087.stdout:3/505: dwrite d4/d11/d24/d25/d4d/f68 [0,4194304] 0 2024-05-08T05:32:07.465 INFO:tasks.workunit.client.0.smithi087.stdout:7/546: symlink d2/d6/d12/d15/lb3 0 2024-05-08T05:32:07.465 INFO:tasks.workunit.client.0.smithi087.stdout:7/547: chown d2/da/d3f/d72/fa9 101 1 2024-05-08T05:32:07.466 INFO:tasks.workunit.client.0.smithi087.stdout:2/420: symlink d7/de/d2c/l88 0 2024-05-08T05:32:07.466 INFO:tasks.workunit.client.0.smithi087.stdout:2/421: truncate d7/de/d27/f5c 158109 0 2024-05-08T05:32:07.466 INFO:tasks.workunit.client.0.smithi087.stdout:0/449: dwrite d0/d9/f67 [0,4194304] 0 2024-05-08T05:32:07.466 INFO:tasks.workunit.client.0.smithi087.stdout:5/466: symlink da/db/d2a/d5a/d93/d36/d45/l97 0 2024-05-08T05:32:07.467 INFO:tasks.workunit.client.0.smithi087.stdout:5/467: fsync da/db/d2a/d5a/d93/d36/d45/d5c/d86/f8e 0 2024-05-08T05:32:07.469 INFO:tasks.workunit.client.0.smithi087.stdout:7/548: creat d2/d6/d12/d19/fb4 x:0 0 0 2024-05-08T05:32:07.470 INFO:tasks.workunit.client.0.smithi087.stdout:5/468: mknod da/dd/d94/c98 0 2024-05-08T05:32:07.471 INFO:tasks.workunit.client.0.smithi087.stdout:7/549: creat d2/da/d3f/d72/d77/d54/d55/d65/fb5 x:0 0 0 2024-05-08T05:32:07.474 INFO:tasks.workunit.client.0.smithi087.stdout:1/408: dread df/f11 [0,4194304] 0 2024-05-08T05:32:07.486 INFO:tasks.workunit.client.0.smithi087.stdout:0/450: write d0/da/d11/f20 [2251719,11231] 0 2024-05-08T05:32:07.490 INFO:tasks.workunit.client.0.smithi087.stdout:2/422: dread d7/de/d27/d33/f38 [0,4194304] 0 2024-05-08T05:32:07.490 INFO:tasks.workunit.client.0.smithi087.stdout:2/423: chown d7/de/d2c/c83 1395165415 1 2024-05-08T05:32:07.490 INFO:tasks.workunit.client.0.smithi087.stdout:7/550: dread d2/d6/d12/d19/f1e [0,4194304] 0 2024-05-08T05:32:07.491 INFO:tasks.workunit.client.0.smithi087.stdout:2/424: creat d7/de/d2c/f89 x:0 0 0 2024-05-08T05:32:07.498 INFO:tasks.workunit.client.0.smithi087.stdout:0/451: write d0/d22/f61 [2048529,640] 0 2024-05-08T05:32:07.498 INFO:tasks.workunit.client.0.smithi087.stdout:0/452: chown d0/c8a 1717 1 2024-05-08T05:32:07.504 INFO:tasks.workunit.client.0.smithi087.stdout:0/453: mkdir d0/da/d35/d86/d9a 0 2024-05-08T05:32:07.504 INFO:tasks.workunit.client.0.smithi087.stdout:0/454: getdents d0/da/d35/d86/d9a 0 2024-05-08T05:32:07.506 INFO:tasks.workunit.client.0.smithi087.stdout:0/455: symlink d0/da/l9b 0 2024-05-08T05:32:07.506 INFO:tasks.workunit.client.0.smithi087.stdout:0/456: stat d0/d22/d3c/f79 0 2024-05-08T05:32:07.508 INFO:tasks.workunit.client.0.smithi087.stdout:0/457: link d0/da/d35/d86/c19 d0/da/d35/d86/d74/c9c 0 2024-05-08T05:32:07.510 INFO:tasks.workunit.client.0.smithi087.stdout:0/458: symlink d0/d9/d1b/d2f/d54/l9d 0 2024-05-08T05:32:07.510 INFO:tasks.workunit.client.0.smithi087.stdout:5/469: dwrite da/db/d2a/d5a/d93/d42/d43/f90 [0,4194304] 0 2024-05-08T05:32:07.514 INFO:tasks.workunit.client.0.smithi087.stdout:5/470: mkdir da/db/d2a/d5a/d93/d17/d99 0 2024-05-08T05:32:07.515 INFO:tasks.workunit.client.0.smithi087.stdout:3/506: dwrite d4/d11/d24/d25/d4d/f68 [4194304,4194304] 0 2024-05-08T05:32:07.515 INFO:tasks.workunit.client.0.smithi087.stdout:0/459: mkdir d0/d9e 0 2024-05-08T05:32:07.517 INFO:tasks.workunit.client.0.smithi087.stdout:5/471: mkdir da/db/d2a/d46/d9a 0 2024-05-08T05:32:07.519 INFO:tasks.workunit.client.0.smithi087.stdout:5/472: truncate da/db/d2a/d5a/d93/d36/d45/f4d 992169 0 2024-05-08T05:32:07.521 INFO:tasks.workunit.client.0.smithi087.stdout:5/473: rmdir da/db/d2a/d5a/d93/d36 39 2024-05-08T05:32:07.525 INFO:tasks.workunit.client.0.smithi087.stdout:5/474: rename da/db/d2a/d5a/d93/d42/d43/f90 to da/dd/d94/f9b 0 2024-05-08T05:32:07.525 INFO:tasks.workunit.client.0.smithi087.stdout:5/475: write da/dd/d13/d16/f26 [5771911,37741] 0 2024-05-08T05:32:07.529 INFO:tasks.workunit.client.0.smithi087.stdout:5/476: unlink da/dd/d13/d16/f54 0 2024-05-08T05:32:07.530 INFO:tasks.workunit.client.0.smithi087.stdout:5/477: chown da/f3c 223592 1 2024-05-08T05:32:07.530 INFO:tasks.workunit.client.0.smithi087.stdout:0/460: dread d0/da/d35/d86/f15 [0,4194304] 0 2024-05-08T05:32:07.532 INFO:tasks.workunit.client.0.smithi087.stdout:0/461: rename d0/d9/d1b/d5e/l85 to d0/d9/d1b/l9f 0 2024-05-08T05:32:07.538 INFO:tasks.workunit.client.0.smithi087.stdout:5/478: dread da/db/d2a/f77 [0,4194304] 0 2024-05-08T05:32:07.538 INFO:tasks.workunit.client.0.smithi087.stdout:5/479: write da/dd/d65/f68 [1742777,69008] 0 2024-05-08T05:32:07.539 INFO:tasks.workunit.client.0.smithi087.stdout:3/507: dread d4/d11/d3d/d48/f52 [0,4194304] 0 2024-05-08T05:32:07.539 INFO:tasks.workunit.client.0.smithi087.stdout:3/508: fdatasync d4/d11/d3d/d4e/d6a/f81 0 2024-05-08T05:32:07.540 INFO:tasks.workunit.client.0.smithi087.stdout:5/480: mkdir da/db/d2a/d5a/d93/d42/d43/d83/d6b/d9c 0 2024-05-08T05:32:07.545 INFO:tasks.workunit.client.0.smithi087.stdout:1/409: dwrite df/f3b [0,4194304] 0 2024-05-08T05:32:07.546 INFO:tasks.workunit.client.0.smithi087.stdout:9/489: dwrite d1/df/d37/f51 [0,4194304] 0 2024-05-08T05:32:07.550 INFO:tasks.workunit.client.0.smithi087.stdout:7/551: dwrite d2/da/d3f/d49/d59/f62 [0,4194304] 0 2024-05-08T05:32:07.550 INFO:tasks.workunit.client.0.smithi087.stdout:7/552: truncate d2/d6/d12/d1d/fae 518038 0 2024-05-08T05:32:07.550 INFO:tasks.workunit.client.0.smithi087.stdout:7/553: chown d2/d6/d12/d19/fac 25526749 1 2024-05-08T05:32:07.550 INFO:tasks.workunit.client.0.smithi087.stdout:6/500: dwrite d4/d8/df/d39/d42/f98 [0,4194304] 0 2024-05-08T05:32:07.558 INFO:tasks.workunit.client.0.smithi087.stdout:3/509: write d4/d11/d24/d25/d4d/f68 [4485721,71322] 0 2024-05-08T05:32:07.561 INFO:tasks.workunit.client.0.smithi087.stdout:2/425: dwrite d7/f22 [4194304,4194304] 0 2024-05-08T05:32:07.561 INFO:tasks.workunit.client.0.smithi087.stdout:2/426: readlink d7/de/d27/l46 0 2024-05-08T05:32:07.565 INFO:tasks.workunit.client.0.smithi087.stdout:9/490: getdents d1/df/d58 0 2024-05-08T05:32:07.565 INFO:tasks.workunit.client.0.smithi087.stdout:7/554: truncate d2/da/d3f/d72/d77/d54/d55/f7e 2055590 0 2024-05-08T05:32:07.565 INFO:tasks.workunit.client.0.smithi087.stdout:0/462: truncate d0/da/f1e 3014196 0 2024-05-08T05:32:07.572 INFO:tasks.workunit.client.0.smithi087.stdout:5/481: dread da/db/d2a/d5a/d93/d36/f76 [0,4194304] 0 2024-05-08T05:32:07.572 INFO:tasks.workunit.client.0.smithi087.stdout:2/427: link d7/de/d2c/f89 d7/f8a 0 2024-05-08T05:32:07.574 INFO:tasks.workunit.client.0.smithi087.stdout:9/491: unlink d1/df/d14/d18/d66/l7a 0 2024-05-08T05:32:07.574 INFO:tasks.workunit.client.0.smithi087.stdout:9/492: read d1/df/d14/d18/f67 [646871,24095] 0 2024-05-08T05:32:07.574 INFO:tasks.workunit.client.0.smithi087.stdout:9/493: truncate d1/db/d28/f4f 296179 0 2024-05-08T05:32:07.574 INFO:tasks.workunit.client.0.smithi087.stdout:9/494: fsync d1/db/d28/d4b/f71 0 2024-05-08T05:32:07.575 INFO:tasks.workunit.client.0.smithi087.stdout:7/555: getdents d2/da/d3f/d66 0 2024-05-08T05:32:07.575 INFO:tasks.workunit.client.0.smithi087.stdout:3/510: write d4/d11/f20 [3896496,17518] 0 2024-05-08T05:32:07.575 INFO:tasks.workunit.client.0.smithi087.stdout:7/556: truncate d2/d6/d12/d15/f5c 5891445 0 2024-05-08T05:32:07.577 INFO:tasks.workunit.client.0.smithi087.stdout:0/463: symlink d0/d57/d24/d66/la0 0 2024-05-08T05:32:07.577 INFO:tasks.workunit.client.0.smithi087.stdout:5/482: dread da/f30 [0,4194304] 0 2024-05-08T05:32:07.577 INFO:tasks.workunit.client.0.smithi087.stdout:2/428: creat d7/de/d27/d33/d49/f8b x:0 0 0 2024-05-08T05:32:07.579 INFO:tasks.workunit.client.0.smithi087.stdout:9/495: mknod d1/df/d37/d74/c93 0 2024-05-08T05:32:07.579 INFO:tasks.workunit.client.0.smithi087.stdout:9/496: chown d1/db/le 2340 1 2024-05-08T05:32:07.581 INFO:tasks.workunit.client.0.smithi087.stdout:3/511: rename d4/d14/f28 to d4/d11/d24/d25/fb2 0 2024-05-08T05:32:07.582 INFO:tasks.workunit.client.0.smithi087.stdout:8/485: sync 2024-05-08T05:32:07.582 INFO:tasks.workunit.client.0.smithi087.stdout:4/504: sync 2024-05-08T05:32:07.582 INFO:tasks.workunit.client.0.smithi087.stdout:8/486: fsync db/d23/d15/d3c/f3f 0 2024-05-08T05:32:07.582 INFO:tasks.workunit.client.0.smithi087.stdout:4/505: chown d4/d13/d3e/d28/d50/d9d 147 1 2024-05-08T05:32:07.582 INFO:tasks.workunit.client.0.smithi087.stdout:5/483: creat da/db/d2a/d5a/d93/d42/f9d x:0 0 0 2024-05-08T05:32:07.585 INFO:tasks.workunit.client.0.smithi087.stdout:0/464: rename d0/da/d35/d86/d74/d51 to d0/d9/d1b/d2f/d54/da1 0 2024-05-08T05:32:07.585 INFO:tasks.workunit.client.0.smithi087.stdout:0/465: fdatasync d0/d9/d1b/d2f/d54/da1/f96 0 2024-05-08T05:32:07.586 INFO:tasks.workunit.client.0.smithi087.stdout:3/512: rmdir d4/d11/d24/d25/d99/da2 39 2024-05-08T05:32:07.587 INFO:tasks.workunit.client.0.smithi087.stdout:8/487: symlink db/d23/d15/d29/d33/d3b/lb0 0 2024-05-08T05:32:07.588 INFO:tasks.workunit.client.0.smithi087.stdout:7/557: dread d2/da/d3f/d72/d77/d54/d55/f7e [0,4194304] 0 2024-05-08T05:32:07.588 INFO:tasks.workunit.client.0.smithi087.stdout:7/558: stat d2/da/d3f/d72/d77/d54/d50/l9e 0 2024-05-08T05:32:07.589 INFO:tasks.workunit.client.0.smithi087.stdout:3/513: creat d4/d11/d24/d39/d60/d87/da5/fb3 x:0 0 0 2024-05-08T05:32:07.589 INFO:tasks.workunit.client.0.smithi087.stdout:1/410: dwrite df/d18/d1d/f48 [4194304,4194304] 0 2024-05-08T05:32:07.590 INFO:tasks.workunit.client.0.smithi087.stdout:3/514: write d4/d11/d24/d25/d3e/f8d [980695,46282] 0 2024-05-08T05:32:07.590 INFO:tasks.workunit.client.0.smithi087.stdout:1/411: write df/f40 [834388,52814] 0 2024-05-08T05:32:07.590 INFO:tasks.workunit.client.0.smithi087.stdout:3/515: chown d4/d14/f8a 0 1 2024-05-08T05:32:07.590 INFO:tasks.workunit.client.0.smithi087.stdout:1/412: fdatasync df/f5c 0 2024-05-08T05:32:07.590 INFO:tasks.workunit.client.0.smithi087.stdout:1/413: stat df/d18/d1d/d32 0 2024-05-08T05:32:07.590 INFO:tasks.workunit.client.0.smithi087.stdout:9/497: rmdir d1/db 39 2024-05-08T05:32:07.591 INFO:tasks.workunit.client.0.smithi087.stdout:8/488: write db/d23/d15/f71 [73416,53484] 0 2024-05-08T05:32:07.591 INFO:tasks.workunit.client.0.smithi087.stdout:8/489: chown db/d23/d15/d29/d33/d3b/d56/d78/fa5 409250186 1 2024-05-08T05:32:07.592 INFO:tasks.workunit.client.0.smithi087.stdout:7/559: creat d2/da/d3f/d72/d77/d54/fb6 x:0 0 0 2024-05-08T05:32:07.592 INFO:tasks.workunit.client.0.smithi087.stdout:4/506: dread d4/d13/d3e/d28/fab [0,4194304] 0 2024-05-08T05:32:07.593 INFO:tasks.workunit.client.0.smithi087.stdout:3/516: mknod d4/d11/d3d/cb4 0 2024-05-08T05:32:07.593 INFO:tasks.workunit.client.0.smithi087.stdout:1/414: getdents df/d2f/d57 0 2024-05-08T05:32:07.593 INFO:tasks.workunit.client.0.smithi087.stdout:1/415: write fa [6460406,66107] 0 2024-05-08T05:32:07.595 INFO:tasks.workunit.client.0.smithi087.stdout:9/498: rename d1/df/c6a to d1/c94 0 2024-05-08T05:32:07.595 INFO:tasks.workunit.client.0.smithi087.stdout:9/499: write d1/db/d28/d4b/f71 [761843,67676] 0 2024-05-08T05:32:07.596 INFO:tasks.workunit.client.0.smithi087.stdout:0/466: fsync d0/da/d11/f20 0 2024-05-08T05:32:07.597 INFO:tasks.workunit.client.0.smithi087.stdout:4/507: link d4/l64 d4/d13/d3e/d28/d50/d5a/lc4 0 2024-05-08T05:32:07.597 INFO:tasks.workunit.client.0.smithi087.stdout:7/560: truncate d2/d6/d12/d15/d5b/f63 5663 0 2024-05-08T05:32:07.598 INFO:tasks.workunit.client.0.smithi087.stdout:3/517: truncate d4/d11/f38 258448 0 2024-05-08T05:32:07.600 INFO:tasks.workunit.client.0.smithi087.stdout:9/500: mknod d1/df/d14/d18/d66/c95 0 2024-05-08T05:32:07.600 INFO:tasks.workunit.client.0.smithi087.stdout:9/501: chown d1/df/d37/d5b/f6f 2 1 2024-05-08T05:32:07.600 INFO:tasks.workunit.client.0.smithi087.stdout:9/502: readlink d1/df/d14/l56 0 2024-05-08T05:32:07.600 INFO:tasks.workunit.client.0.smithi087.stdout:9/503: write d1/fd [3572348,8581] 0 2024-05-08T05:32:07.601 INFO:tasks.workunit.client.0.smithi087.stdout:7/561: getdents d2/d6/da0/d67/d82/d98 0 2024-05-08T05:32:07.601 INFO:tasks.workunit.client.0.smithi087.stdout:7/562: fdatasync d2/d6/d12/d19/fac 0 2024-05-08T05:32:07.603 INFO:tasks.workunit.client.0.smithi087.stdout:6/501: dwrite d4/d8/df/d1e/d25/d28/f91 [4194304,4194304] 0 2024-05-08T05:32:07.608 INFO:tasks.workunit.client.0.smithi087.stdout:7/563: write d2/d6/f25 [1601980,78008] 0 2024-05-08T05:32:07.609 INFO:tasks.workunit.client.0.smithi087.stdout:6/502: creat d4/f99 x:0 0 0 2024-05-08T05:32:07.611 INFO:tasks.workunit.client.0.smithi087.stdout:6/503: rename d4/d8/f73 to d4/d8/df/d1e/f9a 0 2024-05-08T05:32:07.614 INFO:tasks.workunit.client.0.smithi087.stdout:6/504: link d4/d8/df/d1e/d25/d28/d2d/d37/d45/f6b d4/d8/df/d39/f9b 0 2024-05-08T05:32:07.615 INFO:tasks.workunit.client.0.smithi087.stdout:1/416: write df/d18/d1d/d58/d72/f5f [3501728,107833] 0 2024-05-08T05:32:07.615 INFO:tasks.workunit.client.0.smithi087.stdout:6/505: chown d4/d8/d61/d6f/f8b 1 1 2024-05-08T05:32:07.615 INFO:tasks.workunit.client.0.smithi087.stdout:9/504: dread d1/db/d28/d4b/f71 [0,4194304] 0 2024-05-08T05:32:07.615 INFO:tasks.workunit.client.0.smithi087.stdout:9/505: truncate d1/fa 5124660 0 2024-05-08T05:32:07.620 INFO:tasks.workunit.client.0.smithi087.stdout:1/417: mknod df/c91 0 2024-05-08T05:32:07.620 INFO:tasks.workunit.client.0.smithi087.stdout:1/418: chown df 143 1 2024-05-08T05:32:07.620 INFO:tasks.workunit.client.0.smithi087.stdout:6/506: mkdir d4/d8/df/d1e/d25/d28/d2d/d37/d9c 0 2024-05-08T05:32:07.622 INFO:tasks.workunit.client.0.smithi087.stdout:6/507: write d4/d8/df/d1e/d25/d28/d2d/d37/d5b/f5d [307346,18581] 0 2024-05-08T05:32:07.622 INFO:tasks.workunit.client.0.smithi087.stdout:6/508: fsync d4/d8/df/d39/f8e 0 2024-05-08T05:32:07.622 INFO:tasks.workunit.client.0.smithi087.stdout:6/509: fsync d4/d8/df/d1e/f96 0 2024-05-08T05:32:07.631 INFO:tasks.workunit.client.0.smithi087.stdout:3/518: dread d4/d11/f7e [0,4194304] 0 2024-05-08T05:32:07.632 INFO:tasks.workunit.client.0.smithi087.stdout:3/519: fdatasync d4/d11/d3d/f56 0 2024-05-08T05:32:07.632 INFO:tasks.workunit.client.0.smithi087.stdout:3/520: fsync d4/d11/d24/d25/d3e/f65 0 2024-05-08T05:32:07.632 INFO:tasks.workunit.client.0.smithi087.stdout:3/521: write d4/f5c [842997,80969] 0 2024-05-08T05:32:07.636 INFO:tasks.workunit.client.0.smithi087.stdout:1/419: creat df/d18/d1d/d27/d61/f92 x:0 0 0 2024-05-08T05:32:07.651 INFO:tasks.workunit.client.0.smithi087.stdout:5/484: dwrite da/dd/d65/f68 [0,4194304] 0 2024-05-08T05:32:07.651 INFO:tasks.workunit.client.0.smithi087.stdout:5/485: chown da/db/d2a/d5a/d93/d36/d45/d5c/f78 27210113 1 2024-05-08T05:32:07.653 INFO:tasks.workunit.client.0.smithi087.stdout:5/486: rename da/dd/f59 to da/f9e 0 2024-05-08T05:32:07.655 INFO:tasks.workunit.client.0.smithi087.stdout:5/487: mknod da/db/d2a/d5a/d93/d36/d45/d5c/c9f 0 2024-05-08T05:32:07.656 INFO:tasks.workunit.client.0.smithi087.stdout:5/488: symlink da/dd/d94/la0 0 2024-05-08T05:32:07.656 INFO:tasks.workunit.client.0.smithi087.stdout:5/489: dread - da/f66 zero size 2024-05-08T05:32:07.656 INFO:tasks.workunit.client.0.smithi087.stdout:5/490: fsync da/db/d2a/d5a/d93/d36/f76 0 2024-05-08T05:32:07.656 INFO:tasks.workunit.client.0.smithi087.stdout:5/491: fsync da/db/d2a/d5a/d93/d36/f39 0 2024-05-08T05:32:07.662 INFO:tasks.workunit.client.0.smithi087.stdout:1/420: dread df/d18/f47 [0,4194304] 0 2024-05-08T05:32:07.664 INFO:tasks.workunit.client.0.smithi087.stdout:1/421: getdents df/d18/d1d/d27/d61 0 2024-05-08T05:32:07.664 INFO:tasks.workunit.client.0.smithi087.stdout:1/422: truncate df/d18/d1d/d27/f6d 801386 0 2024-05-08T05:32:07.666 INFO:tasks.workunit.client.0.smithi087.stdout:1/423: creat df/d2f/d4f/f93 x:0 0 0 2024-05-08T05:32:07.666 INFO:tasks.workunit.client.0.smithi087.stdout:1/424: fdatasync df/d18/d1d/d27/f6d 0 2024-05-08T05:32:07.671 INFO:tasks.workunit.client.0.smithi087.stdout:0/467: dwrite d0/da/d35/f37 [0,4194304] 0 2024-05-08T05:32:07.671 INFO:tasks.workunit.client.0.smithi087.stdout:4/508: dwrite d4/d13/f2e [0,4194304] 0 2024-05-08T05:32:07.671 INFO:tasks.workunit.client.0.smithi087.stdout:4/509: dread - d4/f8b zero size 2024-05-08T05:32:07.671 INFO:tasks.workunit.client.0.smithi087.stdout:4/510: chown d4/d13/f31 149575503 1 2024-05-08T05:32:07.672 INFO:tasks.workunit.client.0.smithi087.stdout:3/522: dwrite d4/d14/f85 [0,4194304] 0 2024-05-08T05:32:07.677 INFO:tasks.workunit.client.0.smithi087.stdout:5/492: write da/db/d2a/d5a/d93/f40 [59652,47566] 0 2024-05-08T05:32:07.678 INFO:tasks.workunit.client.0.smithi087.stdout:1/425: getdents df/d2f/d4f 0 2024-05-08T05:32:07.678 INFO:tasks.workunit.client.0.smithi087.stdout:1/426: dread - df/f4d zero size 2024-05-08T05:32:07.678 INFO:tasks.workunit.client.0.smithi087.stdout:1/427: stat df/d18/d1d/d32 0 2024-05-08T05:32:07.679 INFO:tasks.workunit.client.0.smithi087.stdout:0/468: symlink d0/d9/d1b/d5e/la2 0 2024-05-08T05:32:07.680 INFO:tasks.workunit.client.0.smithi087.stdout:4/511: mknod d4/d13/d32/d8d/d91/d84/cc5 0 2024-05-08T05:32:07.680 INFO:tasks.workunit.client.0.smithi087.stdout:4/512: truncate d4/d13/f3f 4244172 0 2024-05-08T05:32:07.681 INFO:tasks.workunit.client.0.smithi087.stdout:3/523: mknod d4/cb5 0 2024-05-08T05:32:07.681 INFO:tasks.workunit.client.0.smithi087.stdout:3/524: chown d4/c5d 188226 1 2024-05-08T05:32:07.685 INFO:tasks.workunit.client.0.smithi087.stdout:1/428: symlink df/d18/d1d/l94 0 2024-05-08T05:32:07.686 INFO:tasks.workunit.client.0.smithi087.stdout:4/513: creat d4/d13/d32/d8d/d91/db8/dba/d96/fc6 x:0 0 0 2024-05-08T05:32:07.687 INFO:tasks.workunit.client.0.smithi087.stdout:3/525: creat d4/d11/d24/d25/d3e/d58/d9b/fb6 x:0 0 0 2024-05-08T05:32:07.687 INFO:tasks.workunit.client.0.smithi087.stdout:1/429: mknod df/d18/d1d/d32/c95 0 2024-05-08T05:32:07.688 INFO:tasks.workunit.client.0.smithi087.stdout:1/430: chown df/f4a 7976354 1 2024-05-08T05:32:07.690 INFO:tasks.workunit.client.0.smithi087.stdout:7/564: dwrite d2/d6/d12/d19/fb4 [0,4194304] 0 2024-05-08T05:32:07.692 INFO:tasks.workunit.client.0.smithi087.stdout:7/565: creat d2/d6/d12/d1d/fb7 x:0 0 0 2024-05-08T05:32:07.694 INFO:tasks.workunit.client.0.smithi087.stdout:7/566: unlink d2/d6/d12/d1d/f13 0 2024-05-08T05:32:07.695 INFO:tasks.workunit.client.0.smithi087.stdout:5/493: read da/db/d2a/f67 [3799022,59683] 0 2024-05-08T05:32:07.699 INFO:tasks.workunit.client.0.smithi087.stdout:7/567: fsync d2/d6/d12/d1d/fb7 0 2024-05-08T05:32:07.700 INFO:tasks.workunit.client.0.smithi087.stdout:4/514: write d4/d13/d32/d8d/d91/db8/dba/f78 [659581,56689] 0 2024-05-08T05:32:07.702 INFO:tasks.workunit.client.0.smithi087.stdout:7/568: symlink d2/d6/d12/d15/d5b/lb8 0 2024-05-08T05:32:07.702 INFO:tasks.workunit.client.0.smithi087.stdout:7/569: dread - d2/da/d3f/d72/d77/d54/d50/f6f zero size 2024-05-08T05:32:07.702 INFO:tasks.workunit.client.0.smithi087.stdout:7/570: truncate d2/d6/d12/d15/d5b/f63 365859 0 2024-05-08T05:32:07.702 INFO:tasks.workunit.client.0.smithi087.stdout:4/515: stat d4/d13/d32/d8d/d91/d84/c60 0 2024-05-08T05:32:07.704 INFO:tasks.workunit.client.0.smithi087.stdout:7/571: creat d2/da/d3f/d72/d77/fb9 x:0 0 0 2024-05-08T05:32:07.704 INFO:tasks.workunit.client.0.smithi087.stdout:7/572: read - d2/da/d3f/d72/d77/fb9 zero size 2024-05-08T05:32:07.704 INFO:tasks.workunit.client.0.smithi087.stdout:7/573: chown d2/d6/la1 87084 1 2024-05-08T05:32:07.704 INFO:tasks.workunit.client.0.smithi087.stdout:7/574: chown d2/da/d3f/d72/d77/d54/fb6 492648 1 2024-05-08T05:32:07.705 INFO:tasks.workunit.client.0.smithi087.stdout:4/516: symlink d4/d13/d32/d8d/d91/d84/lc7 0 2024-05-08T05:32:07.705 INFO:tasks.workunit.client.0.smithi087.stdout:4/517: fsync d4/d13/f16 0 2024-05-08T05:32:07.706 INFO:tasks.workunit.client.0.smithi087.stdout:7/575: mknod d2/d6/d12/d19/d2a/d89/d9a/cba 0 2024-05-08T05:32:07.706 INFO:tasks.workunit.client.0.smithi087.stdout:4/518: creat d4/d13/d3e/d28/fc8 x:0 0 0 2024-05-08T05:32:07.707 INFO:tasks.workunit.client.0.smithi087.stdout:7/576: mkdir d2/da/d3f/d49/daf/dbb 0 2024-05-08T05:32:07.707 INFO:tasks.workunit.client.0.smithi087.stdout:7/577: fdatasync d2/da/d3f/d66/f8a 0 2024-05-08T05:32:07.707 INFO:tasks.workunit.client.0.smithi087.stdout:7/578: readlink d2/d6/d12/d1d/l4b 0 2024-05-08T05:32:07.707 INFO:tasks.workunit.client.0.smithi087.stdout:7/579: truncate d2/d6/d12/d1d/fb7 548621 0 2024-05-08T05:32:07.709 INFO:tasks.workunit.client.0.smithi087.stdout:6/510: dwrite d4/d8/df/d1e/d25/f3f [0,4194304] 0 2024-05-08T05:32:07.710 INFO:tasks.workunit.client.0.smithi087.stdout:4/519: rmdir d4/d13/d65 39 2024-05-08T05:32:07.712 INFO:tasks.workunit.client.0.smithi087.stdout:6/511: symlink d4/d8/df/d1e/d25/d28/d57/l9d 0 2024-05-08T05:32:07.712 INFO:tasks.workunit.client.0.smithi087.stdout:1/431: dread df/d18/d1d/d58/d72/f5f [0,4194304] 0 2024-05-08T05:32:07.712 INFO:tasks.workunit.client.0.smithi087.stdout:1/432: truncate df/d2f/f35 4937329 0 2024-05-08T05:32:07.713 INFO:tasks.workunit.client.0.smithi087.stdout:1/433: dread - df/d2f/f66 zero size 2024-05-08T05:32:07.713 INFO:tasks.workunit.client.0.smithi087.stdout:5/494: write da/db/d2a/f32 [3915951,63445] 0 2024-05-08T05:32:07.713 INFO:tasks.workunit.client.0.smithi087.stdout:5/495: chown da/db/d2a/d5a/d93/d42/d43/d83/f7d 135870572 1 2024-05-08T05:32:07.731 INFO:tasks.workunit.client.0.smithi087.stdout:6/512: rename d4/d8/d61 to d4/d8/df/d39/d42/d9e 0 2024-05-08T05:32:07.731 INFO:tasks.workunit.client.0.smithi087.stdout:1/434: truncate df/f3d 578006 0 2024-05-08T05:32:07.731 INFO:tasks.workunit.client.0.smithi087.stdout:5/496: symlink da/db/d2a/d5a/d93/d17/la1 0 2024-05-08T05:32:07.732 INFO:tasks.workunit.client.0.smithi087.stdout:6/513: truncate d4/d8/df/d39/d42/f6e 686859 0 2024-05-08T05:32:07.734 INFO:tasks.workunit.client.0.smithi087.stdout:1/435: mkdir df/d2f/d57/d64/d83/d96 0 2024-05-08T05:32:07.734 INFO:tasks.workunit.client.0.smithi087.stdout:1/436: stat df/c91 0 2024-05-08T05:32:07.734 INFO:tasks.workunit.client.0.smithi087.stdout:1/437: write df/d18/d1d/f88 [1167122,85306] 0 2024-05-08T05:32:07.734 INFO:tasks.workunit.client.0.smithi087.stdout:1/438: chown l7 3 1 2024-05-08T05:32:07.734 INFO:tasks.workunit.client.0.smithi087.stdout:5/497: mkdir da/dd/d13/da2 0 2024-05-08T05:32:07.734 INFO:tasks.workunit.client.0.smithi087.stdout:5/498: write da/db/d2a/f77 [1140613,37924] 0 2024-05-08T05:32:07.736 INFO:tasks.workunit.client.0.smithi087.stdout:5/499: symlink da/db/d2a/d5a/d93/d36/d45/d5c/la3 0 2024-05-08T05:32:07.737 INFO:tasks.workunit.client.0.smithi087.stdout:5/500: creat da/db/d2a/d5a/d93/d42/d43/d83/d6b/d9c/fa4 x:0 0 0 2024-05-08T05:32:07.737 INFO:tasks.workunit.client.0.smithi087.stdout:0/469: dwrite d0/d57/d24/f4e [0,4194304] 0 2024-05-08T05:32:07.743 INFO:tasks.workunit.client.0.smithi087.stdout:5/501: mknod da/db/d2a/d5a/d93/d42/d43/d83/ca5 0 2024-05-08T05:32:07.745 INFO:tasks.workunit.client.0.smithi087.stdout:0/470: creat d0/fa3 x:0 0 0 2024-05-08T05:32:07.747 INFO:tasks.workunit.client.0.smithi087.stdout:1/439: dread df/d2f/d57/d64/f23 [0,4194304] 0 2024-05-08T05:32:07.748 INFO:tasks.workunit.client.0.smithi087.stdout:1/440: creat df/d2f/f97 x:0 0 0 2024-05-08T05:32:07.749 INFO:tasks.workunit.client.0.smithi087.stdout:1/441: mknod df/d18/d8b/c98 0 2024-05-08T05:32:07.751 INFO:tasks.workunit.client.0.smithi087.stdout:4/520: dwrite d4/d13/d32/d8d/d91/d84/d5d/f82 [0,4194304] 0 2024-05-08T05:32:07.754 INFO:tasks.workunit.client.0.smithi087.stdout:2/429: sync 2024-05-08T05:32:07.754 INFO:tasks.workunit.client.0.smithi087.stdout:2/430: dread - d7/de/d27/f72 zero size 2024-05-08T05:32:07.754 INFO:tasks.workunit.client.0.smithi087.stdout:8/490: sync 2024-05-08T05:32:07.754 INFO:tasks.workunit.client.0.smithi087.stdout:8/491: getdents db/d23/d54/d9d 0 2024-05-08T05:32:07.755 INFO:tasks.workunit.client.0.smithi087.stdout:8/492: chown db/d23/d1b/d35/d43/d68/d6a/f5b 449171 1 2024-05-08T05:32:07.756 INFO:tasks.workunit.client.0.smithi087.stdout:2/431: getdents d7/de/d27 0 2024-05-08T05:32:07.757 INFO:tasks.workunit.client.0.smithi087.stdout:7/580: dwrite d2/da/d3f/f30 [0,4194304] 0 2024-05-08T05:32:07.758 INFO:tasks.workunit.client.0.smithi087.stdout:2/432: symlink d7/de/d78/l8c 0 2024-05-08T05:32:07.759 INFO:tasks.workunit.client.0.smithi087.stdout:7/581: truncate d2/da/d3f/d49/d59/f62 14273 0 2024-05-08T05:32:07.760 INFO:tasks.workunit.client.0.smithi087.stdout:2/433: symlink d7/l8d 0 2024-05-08T05:32:07.762 INFO:tasks.workunit.client.0.smithi087.stdout:7/582: rename d2/d6/d12/d15/f42 to d2/db0/fbc 0 2024-05-08T05:32:07.762 INFO:tasks.workunit.client.0.smithi087.stdout:7/583: chown d2/d6/d12/d19/d2a/d91 463 1 2024-05-08T05:32:07.764 INFO:tasks.workunit.client.0.smithi087.stdout:2/434: creat d7/de/d27/f8e x:0 0 0 2024-05-08T05:32:07.766 INFO:tasks.workunit.client.0.smithi087.stdout:7/584: mknod d2/d6/da0/cbd 0 2024-05-08T05:32:07.766 INFO:tasks.workunit.client.0.smithi087.stdout:7/585: truncate d2/d6/d12/d1d/f3a 323711 0 2024-05-08T05:32:07.767 INFO:tasks.workunit.client.0.smithi087.stdout:2/435: creat d7/de/d27/d33/d49/f8f x:0 0 0 2024-05-08T05:32:07.768 INFO:tasks.workunit.client.0.smithi087.stdout:7/586: mknod d2/da/cbe 0 2024-05-08T05:32:07.769 INFO:tasks.workunit.client.0.smithi087.stdout:7/587: symlink d2/da/d3f/d72/d77/d54/d50/d88/lbf 0 2024-05-08T05:32:07.788 INFO:tasks.workunit.client.0.smithi087.stdout:4/521: dread d4/d6c/fb7 [0,4194304] 0 2024-05-08T05:32:07.789 INFO:tasks.workunit.client.0.smithi087.stdout:4/522: creat d4/d13/d32/d8d/fc9 x:0 0 0 2024-05-08T05:32:07.790 INFO:tasks.workunit.client.0.smithi087.stdout:5/502: dwrite da/db/d2a/d5a/d93/d42/d50/f52 [0,4194304] 0 2024-05-08T05:32:07.798 INFO:tasks.workunit.client.0.smithi087.stdout:1/442: dwrite df/d18/d1d/d32/f6e [0,4194304] 0 2024-05-08T05:32:07.799 INFO:tasks.workunit.client.0.smithi087.stdout:0/471: dwrite d0/d9/f7c [0,4194304] 0 2024-05-08T05:32:07.801 INFO:tasks.workunit.client.0.smithi087.stdout:8/493: write db/d23/d15/d29/d33/d3b/f6b [159416,113481] 0 2024-05-08T05:32:07.808 INFO:tasks.workunit.client.0.smithi087.stdout:5/503: link da/db/l34 da/db/d2a/d5a/d93/d42/d43/d83/d6b/d9c/la6 0 2024-05-08T05:32:07.816 INFO:tasks.workunit.client.0.smithi087.stdout:7/588: dwrite d2/da/d3f/d72/d77/fb9 [0,4194304] 0 2024-05-08T05:32:07.817 INFO:tasks.workunit.client.0.smithi087.stdout:1/443: unlink df/d2f/d4f/c62 0 2024-05-08T05:32:07.825 INFO:tasks.workunit.client.0.smithi087.stdout:5/504: getdents da/db/d2a/d5a/d93/d36/d45 0 2024-05-08T05:32:07.832 INFO:tasks.workunit.client.0.smithi087.stdout:7/589: mknod d2/cc0 0 2024-05-08T05:32:07.841 INFO:tasks.workunit.client.0.smithi087.stdout:2/436: dwrite f3 [4194304,4194304] 0 2024-05-08T05:32:07.841 INFO:tasks.workunit.client.0.smithi087.stdout:5/505: creat da/db/d2a/d46/d69/fa7 x:0 0 0 2024-05-08T05:32:07.841 INFO:tasks.workunit.client.0.smithi087.stdout:5/506: rename da/db/d2a to da/db/d2a/d5a/d93/d36/d45/d5c/d89/da8 22 2024-05-08T05:32:07.845 INFO:tasks.workunit.client.0.smithi087.stdout:4/523: dwrite d4/d13/d3e/f38 [4194304,4194304] 0 2024-05-08T05:32:07.845 INFO:tasks.workunit.client.0.smithi087.stdout:4/524: write d4/d13/fa1 [895590,10928] 0 2024-05-08T05:32:07.850 INFO:tasks.workunit.client.0.smithi087.stdout:7/590: write d2/f4 [2167755,6523] 0 2024-05-08T05:32:07.850 INFO:tasks.workunit.client.0.smithi087.stdout:2/437: mkdir d7/de/d5d/d90 0 2024-05-08T05:32:07.851 INFO:tasks.workunit.client.0.smithi087.stdout:7/591: fdatasync d2/da/d3f/d72/d77/fb9 0 2024-05-08T05:32:07.854 INFO:tasks.workunit.client.0.smithi087.stdout:5/507: mknod da/db/d2a/d5a/ca9 0 2024-05-08T05:32:07.854 INFO:tasks.workunit.client.0.smithi087.stdout:5/508: truncate da/db/d2a/d5a/d93/d36/d45/d5c/d86/f8e 310011 0 2024-05-08T05:32:07.854 INFO:tasks.workunit.client.0.smithi087.stdout:5/509: chown da/f30 85790 1 2024-05-08T05:32:07.860 INFO:tasks.workunit.client.0.smithi087.stdout:4/525: mknod d4/d13/d32/d8d/d91/db8/dba/d63/cca 0 2024-05-08T05:32:07.865 INFO:tasks.workunit.client.0.smithi087.stdout:4/526: creat d4/d13/d32/d8d/d91/db8/dba/dbd/fcb x:0 0 0 2024-05-08T05:32:07.866 INFO:tasks.workunit.client.0.smithi087.stdout:0/472: creat d0/d57/fa4 x:0 0 0 2024-05-08T05:32:07.869 INFO:tasks.workunit.client.0.smithi087.stdout:0/473: truncate d0/d9/f67 1336407 0 2024-05-08T05:32:07.874 INFO:tasks.workunit.client.0.smithi087.stdout:0/474: rename d0/d22/d3c/f79 to d0/d9/d1b/d2f/d54/da1/fa5 0 2024-05-08T05:32:07.877 INFO:tasks.workunit.client.0.smithi087.stdout:7/592: unlink d2/d6/d12/f47 0 2024-05-08T05:32:07.882 INFO:tasks.workunit.client.0.smithi087.stdout:0/475: symlink d0/d22/d3c/la6 0 2024-05-08T05:32:07.882 INFO:tasks.workunit.client.0.smithi087.stdout:7/593: rename d2/d6/la1 to d2/db0/lc1 0 2024-05-08T05:32:07.888 INFO:tasks.workunit.client.0.smithi087.stdout:0/476: rename d0/d9/c39 to d0/d9e/ca7 0 2024-05-08T05:32:07.891 INFO:tasks.workunit.client.0.smithi087.stdout:2/438: dwrite d7/de/d27/d33/f30 [0,4194304] 0 2024-05-08T05:32:07.896 INFO:tasks.workunit.client.0.smithi087.stdout:2/439: rename d7/de/d27/d33/f71 to d7/de/d5d/f91 0 2024-05-08T05:32:07.898 INFO:tasks.workunit.client.0.smithi087.stdout:0/477: symlink d0/la8 0 2024-05-08T05:32:07.901 INFO:tasks.workunit.client.0.smithi087.stdout:2/440: creat d7/de/d2c/d43/f92 x:0 0 0 2024-05-08T05:32:07.903 INFO:tasks.workunit.client.0.smithi087.stdout:2/441: mkdir d7/d93 0 2024-05-08T05:32:07.903 INFO:tasks.workunit.client.0.smithi087.stdout:7/594: dread d2/d6/d12/d19/d2a/f7b [0,4194304] 0 2024-05-08T05:32:07.903 INFO:tasks.workunit.client.0.smithi087.stdout:7/595: fdatasync d2/d6/d12/f43 0 2024-05-08T05:32:07.904 INFO:tasks.workunit.client.0.smithi087.stdout:2/442: creat d7/d93/f94 x:0 0 0 2024-05-08T05:32:07.904 INFO:tasks.workunit.client.0.smithi087.stdout:2/443: getdents d7/de/d5d/d7b 0 2024-05-08T05:32:07.912 INFO:tasks.workunit.client.0.smithi087.stdout:4/527: dwrite d4/d13/d32/f92 [0,4194304] 0 2024-05-08T05:32:07.913 INFO:tasks.workunit.client.0.smithi087.stdout:5/510: dwrite da/f66 [0,4194304] 0 2024-05-08T05:32:07.913 INFO:tasks.workunit.client.0.smithi087.stdout:5/511: write da/dd/d13/d16/f26 [102089,129072] 0 2024-05-08T05:32:07.916 INFO:tasks.workunit.client.0.smithi087.stdout:7/596: mkdir d2/da/d3f/d72/d77/dc2 0 2024-05-08T05:32:07.916 INFO:tasks.workunit.client.0.smithi087.stdout:2/444: symlink d7/d63/l95 0 2024-05-08T05:32:07.916 INFO:tasks.workunit.client.0.smithi087.stdout:8/494: mkdir db/d23/d15/d29/db1 0 2024-05-08T05:32:07.916 INFO:tasks.workunit.client.0.smithi087.stdout:8/495: dread - db/d23/d15/d29/d4d/f55 zero size 2024-05-08T05:32:07.916 INFO:tasks.workunit.client.0.smithi087.stdout:2/445: write d7/de/d27/d33/d49/f8f [40106,67494] 0 2024-05-08T05:32:07.917 INFO:tasks.workunit.client.0.smithi087.stdout:4/528: symlink d4/d13/d3e/d28/d50/d9d/lcc 0 2024-05-08T05:32:07.921 INFO:tasks.workunit.client.0.smithi087.stdout:5/512: mkdir da/dd/d65/daa 0 2024-05-08T05:32:07.921 INFO:tasks.workunit.client.0.smithi087.stdout:5/513: chown da/db/d2a/d46/d69/fa7 53 1 2024-05-08T05:32:07.922 INFO:tasks.workunit.client.0.smithi087.stdout:7/597: mkdir d2/da/d3f/d72/d77/d54/d55/d65/dc3 0 2024-05-08T05:32:07.922 INFO:tasks.workunit.client.0.smithi087.stdout:7/598: write d2/da/d3f/d66/f8a [4376606,91514] 0 2024-05-08T05:32:07.924 INFO:tasks.workunit.client.0.smithi087.stdout:8/496: unlink db/d23/l18 0 2024-05-08T05:32:07.924 INFO:tasks.workunit.client.0.smithi087.stdout:8/497: chown db/d23/d15/d29/f52 24761 1 2024-05-08T05:32:07.924 INFO:tasks.workunit.client.0.smithi087.stdout:8/498: fdatasync db/d23/d1b/d35/d43/d68/f86 0 2024-05-08T05:32:07.924 INFO:tasks.workunit.client.0.smithi087.stdout:8/499: chown db/d23/d1b/f2b 1401 1 2024-05-08T05:32:07.924 INFO:tasks.workunit.client.0.smithi087.stdout:8/500: write db/d23/d1b/fad [295583,86095] 0 2024-05-08T05:32:07.924 INFO:tasks.workunit.client.0.smithi087.stdout:8/501: fsync db/d23/d1b/d35/d43/f53 0 2024-05-08T05:32:07.924 INFO:tasks.workunit.client.0.smithi087.stdout:8/502: write db/d23/d15/d29/d33/d3b/d56/fab [846858,63867] 0 2024-05-08T05:32:07.925 INFO:tasks.workunit.client.0.smithi087.stdout:2/446: mknod d7/d63/c96 0 2024-05-08T05:32:07.926 INFO:tasks.workunit.client.0.smithi087.stdout:4/529: symlink d4/d13/d3e/lcd 0 2024-05-08T05:32:07.928 INFO:tasks.workunit.client.0.smithi087.stdout:6/514: sync 2024-05-08T05:32:07.928 INFO:tasks.workunit.client.0.smithi087.stdout:9/506: sync 2024-05-08T05:32:07.928 INFO:tasks.workunit.client.0.smithi087.stdout:3/526: sync 2024-05-08T05:32:07.929 INFO:tasks.workunit.client.0.smithi087.stdout:5/514: rename da/db/d2a/d5a/d93/d36/d45/f85 to da/db/d2a/fab 0 2024-05-08T05:32:07.930 INFO:tasks.workunit.client.0.smithi087.stdout:7/599: getdents d2/db0 0 2024-05-08T05:32:07.930 INFO:tasks.workunit.client.0.smithi087.stdout:7/600: readlink d2/d6/d12/d19/d2a/l38 0 2024-05-08T05:32:07.931 INFO:tasks.workunit.client.0.smithi087.stdout:4/530: mknod d4/d13/d32/d8d/d91/db8/dba/d63/cce 0 2024-05-08T05:32:07.932 INFO:tasks.workunit.client.0.smithi087.stdout:6/515: mknod d4/d8/df/d39/d42/d9e/d6f/c9f 0 2024-05-08T05:32:07.933 INFO:tasks.workunit.client.0.smithi087.stdout:1/444: sync 2024-05-08T05:32:07.934 INFO:tasks.workunit.client.0.smithi087.stdout:9/507: mknod d1/df/d14/d54/d61/d72/c96 0 2024-05-08T05:32:07.936 INFO:tasks.workunit.client.0.smithi087.stdout:2/447: rename d7/de/d2c/c83 to d7/d93/c97 0 2024-05-08T05:32:07.936 INFO:tasks.workunit.client.0.smithi087.stdout:2/448: dread - d7/de/d27/f8e zero size 2024-05-08T05:32:07.937 INFO:tasks.workunit.client.0.smithi087.stdout:5/515: creat da/dd/d13/d16/fac x:0 0 0 2024-05-08T05:32:07.938 INFO:tasks.workunit.client.0.smithi087.stdout:7/601: creat d2/da/d3f/d72/d77/dc2/fc4 x:0 0 0 2024-05-08T05:32:07.940 INFO:tasks.workunit.client.0.smithi087.stdout:4/531: creat d4/d13/d3e/d28/fcf x:0 0 0 2024-05-08T05:32:07.940 INFO:tasks.workunit.client.0.smithi087.stdout:8/503: dread db/d23/d15/d29/d33/d3b/f6b [0,4194304] 0 2024-05-08T05:32:07.941 INFO:tasks.workunit.client.0.smithi087.stdout:6/516: mknod d4/d8/df/d39/d42/ca0 0 2024-05-08T05:32:07.941 INFO:tasks.workunit.client.0.smithi087.stdout:6/517: getdents d4/d8/df/d39/d42/d94 0 2024-05-08T05:32:07.941 INFO:tasks.workunit.client.0.smithi087.stdout:9/508: creat d1/db/d83/f97 x:0 0 0 2024-05-08T05:32:07.945 INFO:tasks.workunit.client.0.smithi087.stdout:5/516: link da/dd/d13/l3f da/db/d2a/d5a/d93/d36/lad 0 2024-05-08T05:32:07.945 INFO:tasks.workunit.client.0.smithi087.stdout:4/532: symlink d4/d13/d32/ld0 0 2024-05-08T05:32:07.945 INFO:tasks.workunit.client.0.smithi087.stdout:8/504: creat db/d23/d1b/d35/d43/d68/fb2 x:0 0 0 2024-05-08T05:32:07.945 INFO:tasks.workunit.client.0.smithi087.stdout:6/518: creat d4/d8/df/d1e/d25/d28/fa1 x:0 0 0 2024-05-08T05:32:07.946 INFO:tasks.workunit.client.0.smithi087.stdout:9/509: getdents d1/db 0 2024-05-08T05:32:07.955 INFO:tasks.workunit.client.0.smithi087.stdout:1/445: dread df/f24 [0,4194304] 0 2024-05-08T05:32:07.959 INFO:tasks.workunit.client.0.smithi087.stdout:2/449: dread d7/de/d27/d33/f1c [0,4194304] 0 2024-05-08T05:32:07.961 INFO:tasks.workunit.client.0.smithi087.stdout:5/517: creat da/db/d2a/d5a/d93/d36/d45/fae x:0 0 0 2024-05-08T05:32:07.961 INFO:tasks.workunit.client.0.smithi087.stdout:4/533: stat d4/d13/d32/d8d/d91/d84/d5d/lc0 0 2024-05-08T05:32:07.961 INFO:tasks.workunit.client.0.smithi087.stdout:8/505: truncate db/d23/d15/f36 2064376 0 2024-05-08T05:32:07.961 INFO:tasks.workunit.client.0.smithi087.stdout:8/506: fdatasync db/d23/d15/d29/d79/fa7 0 2024-05-08T05:32:07.961 INFO:tasks.workunit.client.0.smithi087.stdout:8/507: write db/d23/f63 [635526,73168] 0 2024-05-08T05:32:07.965 INFO:tasks.workunit.client.0.smithi087.stdout:0/478: dwrite d0/d9/f67 [0,4194304] 0 2024-05-08T05:32:07.965 INFO:tasks.workunit.client.0.smithi087.stdout:2/450: getdents d7/de/d2c/d43 0 2024-05-08T05:32:07.965 INFO:tasks.workunit.client.0.smithi087.stdout:1/446: getdents df 0 2024-05-08T05:32:07.965 INFO:tasks.workunit.client.0.smithi087.stdout:1/447: read df/d18/d1d/f2d [1617509,62193] 0 2024-05-08T05:32:07.965 INFO:tasks.workunit.client.0.smithi087.stdout:4/534: link d4/d13/d32/d8d/d91/d84/d5d/f6d d4/d13/d32/d8d/fd1 0 2024-05-08T05:32:07.969 INFO:tasks.workunit.client.0.smithi087.stdout:2/451: symlink d7/de/d5d/l98 0 2024-05-08T05:32:07.969 INFO:tasks.workunit.client.0.smithi087.stdout:2/452: write d7/de/d27/f72 [792638,99325] 0 2024-05-08T05:32:07.970 INFO:tasks.workunit.client.0.smithi087.stdout:2/453: readlink d7/de/d27/l46 0 2024-05-08T05:32:07.978 INFO:tasks.workunit.client.0.smithi087.stdout:1/448: unlink c9 0 2024-05-08T05:32:07.978 INFO:tasks.workunit.client.0.smithi087.stdout:4/535: link d4/d13/d3e/d28/c69 d4/d13/d65/cd2 0 2024-05-08T05:32:07.983 INFO:tasks.workunit.client.0.smithi087.stdout:4/536: symlink d4/d13/d32/d8d/d91/db8/dba/d96/ld3 0 2024-05-08T05:32:07.985 INFO:tasks.workunit.client.0.smithi087.stdout:5/518: dread da/db/d2a/d5a/d93/d42/d50/f52 [0,4194304] 0 2024-05-08T05:32:07.985 INFO:tasks.workunit.client.0.smithi087.stdout:5/519: chown da/db/d2a/d5a/d93/d36/d45/d5c 29521 1 2024-05-08T05:32:07.986 INFO:tasks.workunit.client.0.smithi087.stdout:0/479: dread d0/d57/f2a [0,4194304] 0 2024-05-08T05:32:07.990 INFO:tasks.workunit.client.0.smithi087.stdout:6/519: dread d4/d8/df/d39/d42/d9e/f81 [0,4194304] 0 2024-05-08T05:32:07.990 INFO:tasks.workunit.client.0.smithi087.stdout:7/602: dwrite d2/da/d3f/d72/f8b [4194304,4194304] 0 2024-05-08T05:32:07.995 INFO:tasks.workunit.client.0.smithi087.stdout:4/537: truncate d4/d13/f3f 1195846 0 2024-05-08T05:32:07.995 INFO:tasks.workunit.client.0.smithi087.stdout:5/520: mknod da/db/d2a/d5a/d93/d36/d45/caf 0 2024-05-08T05:32:07.996 INFO:tasks.workunit.client.0.smithi087.stdout:0/480: symlink d0/d9e/la9 0 2024-05-08T05:32:07.996 INFO:tasks.workunit.client.0.smithi087.stdout:0/481: readlink d0/da/d35/d86/d74/l63 0 2024-05-08T05:32:08.000 INFO:tasks.workunit.client.0.smithi087.stdout:6/520: dread d4/d8/df/d1e/d52/f80 [0,4194304] 0 2024-05-08T05:32:08.000 INFO:tasks.workunit.client.0.smithi087.stdout:4/538: mknod d4/d13/d32/d8d/d91/d84/d5d/dc3/cd4 0 2024-05-08T05:32:08.001 INFO:tasks.workunit.client.0.smithi087.stdout:5/521: rename da/dd/d94/f9b to da/dd/d94/fb0 0 2024-05-08T05:32:08.001 INFO:tasks.workunit.client.0.smithi087.stdout:5/522: truncate da/dd/d13/f88 944215 0 2024-05-08T05:32:08.002 INFO:tasks.workunit.client.0.smithi087.stdout:0/482: mkdir d0/da/d35/daa 0 2024-05-08T05:32:08.004 INFO:tasks.workunit.client.0.smithi087.stdout:5/523: truncate da/db/d2a/d5a/f5b 826740 0 2024-05-08T05:32:08.004 INFO:tasks.workunit.client.0.smithi087.stdout:6/521: mkdir d4/d8/df/d1e/d25/d28/d2d/d37/d45/da2 0 2024-05-08T05:32:08.005 INFO:tasks.workunit.client.0.smithi087.stdout:6/522: getdents d4/d8/df/d39/d42/d9e/d6f/d84 0 2024-05-08T05:32:08.006 INFO:tasks.workunit.client.0.smithi087.stdout:6/523: getdents d4 0 2024-05-08T05:32:08.007 INFO:tasks.workunit.client.0.smithi087.stdout:3/527: dwrite d4/d11/d24/d25/f2f [0,4194304] 0 2024-05-08T05:32:08.007 INFO:tasks.workunit.client.0.smithi087.stdout:1/449: dread df/d2f/d4f/f55 [0,4194304] 0 2024-05-08T05:32:08.013 INFO:tasks.workunit.client.0.smithi087.stdout:6/524: creat d4/d8/df/d1e/d25/d28/fa3 x:0 0 0 2024-05-08T05:32:08.013 INFO:tasks.workunit.client.0.smithi087.stdout:5/524: symlink da/db/d2a/d5a/d93/d42/d50/lb1 0 2024-05-08T05:32:08.013 INFO:tasks.workunit.client.0.smithi087.stdout:3/528: mknod d4/d11/d24/d39/d60/cb7 0 2024-05-08T05:32:08.013 INFO:tasks.workunit.client.0.smithi087.stdout:3/529: stat d4/d11/d24/c32 0 2024-05-08T05:32:08.013 INFO:tasks.workunit.client.0.smithi087.stdout:3/530: write d4/d11/d24/d25/d3e/d3f/f79 [18842,41560] 0 2024-05-08T05:32:08.013 INFO:tasks.workunit.client.0.smithi087.stdout:1/450: creat df/d18/d1d/f99 x:0 0 0 2024-05-08T05:32:08.016 INFO:tasks.workunit.client.0.smithi087.stdout:1/451: creat df/d2f/f9a x:0 0 0 2024-05-08T05:32:08.018 INFO:tasks.workunit.client.0.smithi087.stdout:5/525: getdents da/db/d2a/d5a/d93/d42/d50 0 2024-05-08T05:32:08.031 INFO:tasks.workunit.client.0.smithi087.stdout:1/452: dread df/d18/f47 [0,4194304] 0 2024-05-08T05:32:08.031 INFO:tasks.workunit.client.0.smithi087.stdout:1/453: dread - df/d18/d1d/d27/d61/f92 zero size 2024-05-08T05:32:08.035 INFO:tasks.workunit.client.0.smithi087.stdout:7/603: dwrite d2/d6/d12/d1d/f3a [0,4194304] 0 2024-05-08T05:32:08.036 INFO:tasks.workunit.client.0.smithi087.stdout:7/604: mkdir d2/d6/d12/dc5 0 2024-05-08T05:32:08.041 INFO:tasks.workunit.client.0.smithi087.stdout:9/510: dwrite d1/fa [4194304,4194304] 0 2024-05-08T05:32:08.043 INFO:tasks.workunit.client.0.smithi087.stdout:2/454: dwrite d7/de/d55/f56 [0,4194304] 0 2024-05-08T05:32:08.049 INFO:tasks.workunit.client.0.smithi087.stdout:6/525: dwrite d4/d8/df/d1e/d25/d28/d57/f63 [0,4194304] 0 2024-05-08T05:32:08.049 INFO:tasks.workunit.client.0.smithi087.stdout:6/526: write d4/d8/df/d39/d42/d9e/d6f/f8d [4889168,83925] 0 2024-05-08T05:32:08.051 INFO:tasks.workunit.client.0.smithi087.stdout:9/511: rename d1/db to d1/df/d14/d68/d80/d98 0 2024-05-08T05:32:08.058 INFO:tasks.workunit.client.0.smithi087.stdout:6/527: truncate d4/d8/df/d1e/d25/d28/d2d/d37/f54 1551220 0 2024-05-08T05:32:08.058 INFO:tasks.workunit.client.0.smithi087.stdout:6/528: fdatasync d4/d8/df/d39/d42/f98 0 2024-05-08T05:32:08.070 INFO:tasks.workunit.client.0.smithi087.stdout:4/539: dread d4/f10 [0,4194304] 0 2024-05-08T05:32:08.071 INFO:tasks.workunit.client.0.smithi087.stdout:3/531: dwrite d4/d11/d24/d39/faf [0,4194304] 0 2024-05-08T05:32:08.073 INFO:tasks.workunit.client.0.smithi087.stdout:7/605: dread d2/db0/fbc [0,4194304] 0 2024-05-08T05:32:08.075 INFO:tasks.workunit.client.0.smithi087.stdout:4/540: mkdir d4/d13/d32/d8d/d91/db8/dba/d96/dd5 0 2024-05-08T05:32:08.079 INFO:tasks.workunit.client.0.smithi087.stdout:0/483: dwrite d0/d9/d1b/d5e/f72 [0,4194304] 0 2024-05-08T05:32:08.092 INFO:tasks.workunit.client.0.smithi087.stdout:8/508: sync 2024-05-08T05:32:08.092 INFO:tasks.workunit.client.0.smithi087.stdout:8/509: write f5 [12420924,107561] 0 2024-05-08T05:32:08.092 INFO:tasks.workunit.client.0.smithi087.stdout:8/510: readlink db/d23/d15/d29/l49 0 2024-05-08T05:32:08.092 INFO:tasks.workunit.client.0.smithi087.stdout:3/532: dread d4/d11/d24/d25/d3e/d3f/f6f [0,4194304] 0 2024-05-08T05:32:08.095 INFO:tasks.workunit.client.0.smithi087.stdout:5/526: dwrite da/dd/d13/d16/fac [0,4194304] 0 2024-05-08T05:32:08.095 INFO:tasks.workunit.client.0.smithi087.stdout:5/527: chown da/dd/d94/c98 3287755 1 2024-05-08T05:32:08.096 INFO:tasks.workunit.client.0.smithi087.stdout:9/512: dread d1/f8 [0,4194304] 0 2024-05-08T05:32:08.097 INFO:tasks.workunit.client.0.smithi087.stdout:8/511: rename db/d23/d1b/d35/d43/d68/d6f/fa2 to db/d23/d1b/d35/d43/daf/fb3 0 2024-05-08T05:32:08.097 INFO:tasks.workunit.client.0.smithi087.stdout:3/533: getdents d4/d11/d3d 0 2024-05-08T05:32:08.097 INFO:tasks.workunit.client.0.smithi087.stdout:1/454: dwrite df/d18/d1d/d58/d72/f75 [0,4194304] 0 2024-05-08T05:32:08.099 INFO:tasks.workunit.client.0.smithi087.stdout:9/513: mknod d1/df/d37/d5b/c99 0 2024-05-08T05:32:08.099 INFO:tasks.workunit.client.0.smithi087.stdout:9/514: fdatasync d1/df/d37/f51 0 2024-05-08T05:32:08.099 INFO:tasks.workunit.client.0.smithi087.stdout:9/515: write d1/df/d14/d18/f34 [423668,107741] 0 2024-05-08T05:32:08.104 INFO:tasks.workunit.client.0.smithi087.stdout:8/512: getdents db/d23/d1b/d35/d43/d68 0 2024-05-08T05:32:08.104 INFO:tasks.workunit.client.0.smithi087.stdout:3/534: creat d4/d14/d84/fb8 x:0 0 0 2024-05-08T05:32:08.104 INFO:tasks.workunit.client.0.smithi087.stdout:3/535: chown d4/d11/d24/d25/d3e/f8d 157596 1 2024-05-08T05:32:08.105 INFO:tasks.workunit.client.0.smithi087.stdout:9/516: mkdir d1/df/d14/d18/d9a 0 2024-05-08T05:32:08.107 INFO:tasks.workunit.client.0.smithi087.stdout:9/517: write d1/df/d37/d5b/d7e/d85/f87 [2399602,50991] 0 2024-05-08T05:32:08.109 INFO:tasks.workunit.client.0.smithi087.stdout:1/455: creat df/d2f/d57/d64/d83/d96/f9b x:0 0 0 2024-05-08T05:32:08.111 INFO:tasks.workunit.client.0.smithi087.stdout:1/456: mkdir df/d18/d1d/d32/d9c 0 2024-05-08T05:32:08.117 INFO:tasks.workunit.client.0.smithi087.stdout:2/455: dwrite d7/de/d5d/f86 [0,4194304] 0 2024-05-08T05:32:08.118 INFO:tasks.workunit.client.0.smithi087.stdout:2/456: creat d7/de/d27/d33/f99 x:0 0 0 2024-05-08T05:32:08.119 INFO:tasks.workunit.client.0.smithi087.stdout:2/457: read - d7/de/d27/d33/d49/f84 zero size 2024-05-08T05:32:08.120 INFO:tasks.workunit.client.0.smithi087.stdout:5/528: dread da/dd/d13/f88 [0,4194304] 0 2024-05-08T05:32:08.122 INFO:tasks.workunit.client.0.smithi087.stdout:5/529: mknod da/db/d2a/d5a/d93/d42/d43/cb2 0 2024-05-08T05:32:08.122 INFO:tasks.workunit.client.0.smithi087.stdout:5/530: fdatasync da/db/d2a/d5a/d93/d36/d45/d5c/d86/f8e 0 2024-05-08T05:32:08.123 INFO:tasks.workunit.client.0.smithi087.stdout:3/536: dread d4/d11/d24/d25/d4d/f68 [4194304,4194304] 0 2024-05-08T05:32:08.132 INFO:tasks.workunit.client.0.smithi087.stdout:8/513: dread db/d23/d15/f34 [0,4194304] 0 2024-05-08T05:32:08.133 INFO:tasks.workunit.client.0.smithi087.stdout:8/514: fdatasync db/d23/f38 0 2024-05-08T05:32:08.133 INFO:tasks.workunit.client.0.smithi087.stdout:4/541: dwrite d4/d13/d32/f92 [0,4194304] 0 2024-05-08T05:32:08.133 INFO:tasks.workunit.client.0.smithi087.stdout:4/542: readlink d4/d13/d32/d8d/d91/lb1 0 2024-05-08T05:32:08.138 INFO:tasks.workunit.client.0.smithi087.stdout:0/484: dwrite d0/da/f1e [0,4194304] 0 2024-05-08T05:32:08.138 INFO:tasks.workunit.client.0.smithi087.stdout:0/485: write d0/d9/d1b/d2f/d54/da1/f99 [213386,115164] 0 2024-05-08T05:32:08.139 INFO:tasks.workunit.client.0.smithi087.stdout:0/486: rmdir d0/d9/d1b/d2f/d54 39 2024-05-08T05:32:08.140 INFO:tasks.workunit.client.0.smithi087.stdout:2/458: write d7/f37 [584489,55587] 0 2024-05-08T05:32:08.140 INFO:tasks.workunit.client.0.smithi087.stdout:2/459: readlink d7/d63/l40 0 2024-05-08T05:32:08.141 INFO:tasks.workunit.client.0.smithi087.stdout:0/487: mknod d0/d22/d3c/cab 0 2024-05-08T05:32:08.147 INFO:tasks.workunit.client.0.smithi087.stdout:6/529: dwrite d4/d8/df/f31 [0,4194304] 0 2024-05-08T05:32:08.149 INFO:tasks.workunit.client.0.smithi087.stdout:6/530: mkdir d4/d8/df/d39/d42/d9e/da4 0 2024-05-08T05:32:08.150 INFO:tasks.workunit.client.0.smithi087.stdout:7/606: dwrite d2/d6/d12/d19/d2a/f8c [0,4194304] 0 2024-05-08T05:32:08.167 INFO:tasks.workunit.client.0.smithi087.stdout:6/531: mknod d4/d8/df/d39/d42/d9e/d6f/ca5 0 2024-05-08T05:32:08.171 INFO:tasks.workunit.client.0.smithi087.stdout:6/532: rename d4/d6/c41 to d4/d8/df/d39/d42/ca6 0 2024-05-08T05:32:08.177 INFO:tasks.workunit.client.0.smithi087.stdout:6/533: truncate d4/d8/df/d1e/d25/f72 3012710 0 2024-05-08T05:32:08.178 INFO:tasks.workunit.client.0.smithi087.stdout:4/543: dread d4/f8e [0,4194304] 0 2024-05-08T05:32:08.178 INFO:tasks.workunit.client.0.smithi087.stdout:3/537: dwrite d4/f3c [0,4194304] 0 2024-05-08T05:32:08.179 INFO:tasks.workunit.client.0.smithi087.stdout:7/607: dread d2/da/d3f/d72/d77/f5a [0,4194304] 0 2024-05-08T05:32:08.180 INFO:tasks.workunit.client.0.smithi087.stdout:3/538: creat d4/d11/d24/d25/d3e/fb9 x:0 0 0 2024-05-08T05:32:08.182 INFO:tasks.workunit.client.0.smithi087.stdout:4/544: creat d4/d13/d32/d8d/d91/db8/dba/d96/dd5/fd6 x:0 0 0 2024-05-08T05:32:08.186 INFO:tasks.workunit.client.0.smithi087.stdout:9/518: dwrite d1/df/f12 [0,4194304] 0 2024-05-08T05:32:08.186 INFO:tasks.workunit.client.0.smithi087.stdout:3/539: mknod d4/d11/d24/d25/d3e/d3f/cba 0 2024-05-08T05:32:08.186 INFO:tasks.workunit.client.0.smithi087.stdout:4/545: rename d4/d13/d32/d8d/d91/d84/d5d/dc3 to d4/d13/d65/dd7 0 2024-05-08T05:32:08.186 INFO:tasks.workunit.client.0.smithi087.stdout:4/546: write d4/d13/d65/f6f [563038,43027] 0 2024-05-08T05:32:08.187 INFO:tasks.workunit.client.0.smithi087.stdout:3/540: mkdir d4/d11/d24/d25/d4d/dbb 0 2024-05-08T05:32:08.188 INFO:tasks.workunit.client.0.smithi087.stdout:7/608: rmdir d2/d6/da0 39 2024-05-08T05:32:08.188 INFO:tasks.workunit.client.0.smithi087.stdout:4/547: rmdir d4/d13/d3e/d28/d50/d9d 39 2024-05-08T05:32:08.190 INFO:tasks.workunit.client.0.smithi087.stdout:7/609: creat d2/d6/d12/d1d/fc6 x:0 0 0 2024-05-08T05:32:08.190 INFO:tasks.workunit.client.0.smithi087.stdout:4/548: creat d4/d13/d3e/d28/d50/d9d/fd8 x:0 0 0 2024-05-08T05:32:08.191 INFO:tasks.workunit.client.0.smithi087.stdout:7/610: symlink d2/d6/d12/d1d/lc7 0 2024-05-08T05:32:08.192 INFO:tasks.workunit.client.0.smithi087.stdout:7/611: fsync d2/d6/d12/f39 0 2024-05-08T05:32:08.192 INFO:tasks.workunit.client.0.smithi087.stdout:7/612: truncate d2/da/d3f/d72/d77/d54/f3e 1646305 0 2024-05-08T05:32:08.192 INFO:tasks.workunit.client.0.smithi087.stdout:7/613: write d2/d6/d12/f43 [614512,11803] 0 2024-05-08T05:32:08.192 INFO:tasks.workunit.client.0.smithi087.stdout:4/549: symlink d4/d13/d3e/d28/ld9 0 2024-05-08T05:32:08.200 INFO:tasks.workunit.client.0.smithi087.stdout:3/541: getdents d4/d11/d24/d25/d3e 0 2024-05-08T05:32:08.202 INFO:tasks.workunit.client.0.smithi087.stdout:3/542: mknod d4/d11/d3d/cbc 0 2024-05-08T05:32:08.205 INFO:tasks.workunit.client.0.smithi087.stdout:3/543: mkdir d4/d5f/dbd 0 2024-05-08T05:32:08.205 INFO:tasks.workunit.client.0.smithi087.stdout:3/544: stat d4/d11/d24/d39/d60/c74 0 2024-05-08T05:32:08.206 INFO:tasks.workunit.client.0.smithi087.stdout:5/531: dwrite da/f2e [4194304,4194304] 0 2024-05-08T05:32:08.206 INFO:tasks.workunit.client.0.smithi087.stdout:9/519: write d1/f21 [3989531,20017] 0 2024-05-08T05:32:08.207 INFO:tasks.workunit.client.0.smithi087.stdout:2/460: dwrite d7/de/d27/f66 [0,4194304] 0 2024-05-08T05:32:08.208 INFO:tasks.workunit.client.0.smithi087.stdout:5/532: rename da/dd/d94/fb0 to da/db/d2a/d46/d9a/fb3 0 2024-05-08T05:32:08.209 INFO:tasks.workunit.client.0.smithi087.stdout:9/520: creat d1/df/d37/d5b/d7e/f9b x:0 0 0 2024-05-08T05:32:08.213 INFO:tasks.workunit.client.0.smithi087.stdout:1/457: dwrite df/d18/f30 [0,4194304] 0 2024-05-08T05:32:08.213 INFO:tasks.workunit.client.0.smithi087.stdout:2/461: rename d7/de/l25 to d7/de/d5d/d7b/l9a 0 2024-05-08T05:32:08.214 INFO:tasks.workunit.client.0.smithi087.stdout:7/614: write d2/d6/d12/f51 [2718497,52418] 0 2024-05-08T05:32:08.214 INFO:tasks.workunit.client.0.smithi087.stdout:7/615: write d2/da/d3f/d72/f8b [1644611,12663] 0 2024-05-08T05:32:08.214 INFO:tasks.workunit.client.0.smithi087.stdout:7/616: readlink d2/d6/da0/d67/d82/lb2 0 2024-05-08T05:32:08.215 INFO:tasks.workunit.client.0.smithi087.stdout:8/515: dwrite db/d23/d15/d29/f32 [0,4194304] 0 2024-05-08T05:32:08.217 INFO:tasks.workunit.client.0.smithi087.stdout:5/533: creat da/db/d2a/d5a/d93/d42/d43/d83/d6b/fb4 x:0 0 0 2024-05-08T05:32:08.217 INFO:tasks.workunit.client.0.smithi087.stdout:5/534: dread - da/db/d2a/d5a/d93/d36/d45/d5c/f78 zero size 2024-05-08T05:32:08.218 INFO:tasks.workunit.client.0.smithi087.stdout:5/535: write da/db/f25 [4169508,8472] 0 2024-05-08T05:32:08.218 INFO:tasks.workunit.client.0.smithi087.stdout:5/536: fdatasync da/db/d2a/f95 0 2024-05-08T05:32:08.218 INFO:tasks.workunit.client.0.smithi087.stdout:5/537: write da/db/d2a/f95 [1336182,28953] 0 2024-05-08T05:32:08.218 INFO:tasks.workunit.client.0.smithi087.stdout:9/521: rename d1/df/d14/d68/d80/d98/d28/c8d to d1/df/d58/d5e/c9c 0 2024-05-08T05:32:08.220 INFO:tasks.workunit.client.0.smithi087.stdout:1/458: dread df/d18/d1d/f88 [0,4194304] 0 2024-05-08T05:32:08.220 INFO:tasks.workunit.client.0.smithi087.stdout:1/459: dread - df/d18/d1d/d58/d72/f85 zero size 2024-05-08T05:32:08.221 INFO:tasks.workunit.client.0.smithi087.stdout:7/617: mknod d2/da/d3f/d72/d77/d54/d50/cc8 0 2024-05-08T05:32:08.221 INFO:tasks.workunit.client.0.smithi087.stdout:7/618: chown d2/d6/d12/d1d/l4b 96 1 2024-05-08T05:32:08.224 INFO:tasks.workunit.client.0.smithi087.stdout:4/550: dwrite d4/d13/d32/d8d/fc9 [0,4194304] 0 2024-05-08T05:32:08.225 INFO:tasks.workunit.client.0.smithi087.stdout:4/551: write d4/d13/d3e/f9c [477375,19832] 0 2024-05-08T05:32:08.225 INFO:tasks.workunit.client.0.smithi087.stdout:4/552: fsync d4/d13/d32/f3c 0 2024-05-08T05:32:08.225 INFO:tasks.workunit.client.0.smithi087.stdout:1/460: link df/d18/d1d/l94 df/d18/d1d/d27/l9d 0 2024-05-08T05:32:08.225 INFO:tasks.workunit.client.0.smithi087.stdout:1/461: getdents df/d18/d1d/d27/d61 0 2024-05-08T05:32:08.226 INFO:tasks.workunit.client.0.smithi087.stdout:5/538: truncate da/dd/d13/d16/f26 1249707 0 2024-05-08T05:32:08.226 INFO:tasks.workunit.client.0.smithi087.stdout:1/462: fsync df/d18/d1d/d58/d72/f5f 0 2024-05-08T05:32:08.226 INFO:tasks.workunit.client.0.smithi087.stdout:1/463: write df/f3d [1052438,64965] 0 2024-05-08T05:32:08.226 INFO:tasks.workunit.client.0.smithi087.stdout:1/464: getdents df/d2f/d57 0 2024-05-08T05:32:08.226 INFO:tasks.workunit.client.0.smithi087.stdout:1/465: chown df/d18/d1d/d58/c68 720829 1 2024-05-08T05:32:08.226 INFO:tasks.workunit.client.0.smithi087.stdout:7/619: unlink d2/d6/d12/d1d/c6a 0 2024-05-08T05:32:08.226 INFO:tasks.workunit.client.0.smithi087.stdout:7/620: write d2/d6/d12/d19/f1e [1445351,70563] 0 2024-05-08T05:32:08.229 INFO:tasks.workunit.client.0.smithi087.stdout:4/553: creat d4/fda x:0 0 0 2024-05-08T05:32:08.230 INFO:tasks.workunit.client.0.smithi087.stdout:5/539: truncate f2 1712134 0 2024-05-08T05:32:08.233 INFO:tasks.workunit.client.0.smithi087.stdout:1/466: creat df/d18/d1d/f9e x:0 0 0 2024-05-08T05:32:08.233 INFO:tasks.workunit.client.0.smithi087.stdout:1/467: truncate df/f4d 62102 0 2024-05-08T05:32:08.236 INFO:tasks.workunit.client.0.smithi087.stdout:7/621: rename d2/d6/da0/cbd to d2/da/d3f/d72/cc9 0 2024-05-08T05:32:08.241 INFO:tasks.workunit.client.0.smithi087.stdout:2/462: write d7/de/d27/d33/f30 [1258452,25679] 0 2024-05-08T05:32:08.242 INFO:tasks.workunit.client.0.smithi087.stdout:2/463: fsync f5 0 2024-05-08T05:32:08.242 INFO:tasks.workunit.client.0.smithi087.stdout:4/554: unlink d4/d13/d32/d8d/d91/db8/dba/d63/cca 0 2024-05-08T05:32:08.242 INFO:tasks.workunit.client.0.smithi087.stdout:4/555: read - d4/d6c/d93/fac zero size 2024-05-08T05:32:08.242 INFO:tasks.workunit.client.0.smithi087.stdout:1/468: truncate df/d18/f1b 2844480 0 2024-05-08T05:32:08.242 INFO:tasks.workunit.client.0.smithi087.stdout:1/469: chown df/f24 169 1 2024-05-08T05:32:08.243 INFO:tasks.workunit.client.0.smithi087.stdout:5/540: dread da/db/d2a/f67 [0,4194304] 0 2024-05-08T05:32:08.243 INFO:tasks.workunit.client.0.smithi087.stdout:8/516: dread db/d23/d1b/d35/d43/d68/f86 [0,4194304] 0 2024-05-08T05:32:08.246 INFO:tasks.workunit.client.0.smithi087.stdout:6/534: dwrite d4/d8/df/d1e/d25/f72 [0,4194304] 0 2024-05-08T05:32:08.247 INFO:tasks.workunit.client.0.smithi087.stdout:9/522: dread d1/df/d14/d68/d80/d98/d28/f42 [0,4194304] 0 2024-05-08T05:32:08.248 INFO:tasks.workunit.client.0.smithi087.stdout:5/541: link da/db/d2a/f31 da/db/d2a/d5a/d93/d17/d99/fb5 0 2024-05-08T05:32:08.248 INFO:tasks.workunit.client.0.smithi087.stdout:6/535: getdents d4/d8/df/d39/d42/d9e 0 2024-05-08T05:32:08.248 INFO:tasks.workunit.client.0.smithi087.stdout:6/536: stat d4/d8/df/d1e/d52 0 2024-05-08T05:32:08.249 INFO:tasks.workunit.client.0.smithi087.stdout:2/464: dread d7/de/d27/f72 [0,4194304] 0 2024-05-08T05:32:08.255 INFO:tasks.workunit.client.0.smithi087.stdout:4/556: rename d4/d13/d32/d8d/d91/d84/d5d to d4/d13/d32/ddb 0 2024-05-08T05:32:08.259 INFO:tasks.workunit.client.0.smithi087.stdout:9/523: link d1/df/d14/f55 d1/df/d14/d68/d80/d98/f9d 0 2024-05-08T05:32:08.259 INFO:tasks.workunit.client.0.smithi087.stdout:9/524: write d1/df/d14/f55 [930039,56345] 0 2024-05-08T05:32:08.259 INFO:tasks.workunit.client.0.smithi087.stdout:9/525: fdatasync d1/f8 0 2024-05-08T05:32:08.261 INFO:tasks.workunit.client.0.smithi087.stdout:5/542: creat da/db/d2a/d5a/d93/d42/fb6 x:0 0 0 2024-05-08T05:32:08.261 INFO:tasks.workunit.client.0.smithi087.stdout:5/543: write da/f9e [414473,40470] 0 2024-05-08T05:32:08.261 INFO:tasks.workunit.client.0.smithi087.stdout:5/544: fsync da/f66 0 2024-05-08T05:32:08.261 INFO:tasks.workunit.client.0.smithi087.stdout:5/545: chown da/db/d2a/d5a/d93/d36/f39 53250547 1 2024-05-08T05:32:08.261 INFO:tasks.workunit.client.0.smithi087.stdout:5/546: chown da/db/d2a/d46/d9a 832 1 2024-05-08T05:32:08.261 INFO:tasks.workunit.client.0.smithi087.stdout:5/547: fdatasync da/db/d2a/d5a/d93/d36/d45/f4d 0 2024-05-08T05:32:08.261 INFO:tasks.workunit.client.0.smithi087.stdout:6/537: mknod d4/d8/df/d1e/d25/d28/d2d/d37/d45/ca7 0 2024-05-08T05:32:08.261 INFO:tasks.workunit.client.0.smithi087.stdout:2/465: truncate d7/de/d27/d33/d49/f5a 3107112 0 2024-05-08T05:32:08.261 INFO:tasks.workunit.client.0.smithi087.stdout:2/466: fdatasync d7/de/d2c/f4c 0 2024-05-08T05:32:08.263 INFO:tasks.workunit.client.0.smithi087.stdout:4/557: truncate f1 2370803 0 2024-05-08T05:32:08.265 INFO:tasks.workunit.client.0.smithi087.stdout:5/548: rename da/db/d2a/d5a/d93/d36/d45/d5c/d86/f8e to da/db/d2a/d5a/d93/d42/d50/fb7 0 2024-05-08T05:32:08.266 INFO:tasks.workunit.client.0.smithi087.stdout:2/467: getdents d7/de/d27/d33/d49 0 2024-05-08T05:32:08.266 INFO:tasks.workunit.client.0.smithi087.stdout:2/468: fsync d7/de/f2b 0 2024-05-08T05:32:08.266 INFO:tasks.workunit.client.0.smithi087.stdout:2/469: getdents d7/de/d2c/d43 0 2024-05-08T05:32:08.268 INFO:tasks.workunit.client.0.smithi087.stdout:5/549: mknod da/dd/d13/d16/cb8 0 2024-05-08T05:32:08.270 INFO:tasks.workunit.client.0.smithi087.stdout:2/470: stat d7/de/d2c/c70 0 2024-05-08T05:32:08.271 INFO:tasks.workunit.client.0.smithi087.stdout:4/558: link d4/c18 d4/d13/d3e/d28/d50/cdc 0 2024-05-08T05:32:08.272 INFO:tasks.workunit.client.0.smithi087.stdout:4/559: dread - d4/d13/d32/d8d/d91/db8/dba/d96/dd5/fd6 zero size 2024-05-08T05:32:08.272 INFO:tasks.workunit.client.0.smithi087.stdout:4/560: dread - d4/d13/d32/d8d/d91/d84/fb9 zero size 2024-05-08T05:32:08.273 INFO:tasks.workunit.client.0.smithi087.stdout:7/622: dread d2/d6/d12/f51 [0,4194304] 0 2024-05-08T05:32:08.273 INFO:tasks.workunit.client.0.smithi087.stdout:5/550: getdents da/db/d2a/d5a/d93/d17/d99 0 2024-05-08T05:32:08.274 INFO:tasks.workunit.client.0.smithi087.stdout:0/488: sync 2024-05-08T05:32:08.276 INFO:tasks.workunit.client.0.smithi087.stdout:2/471: mknod d7/de/d5d/d7b/c9b 0 2024-05-08T05:32:08.276 INFO:tasks.workunit.client.0.smithi087.stdout:3/545: dwrite d4/d11/f7e [0,4194304] 0 2024-05-08T05:32:08.278 INFO:tasks.workunit.client.0.smithi087.stdout:4/561: mknod d4/d13/d32/d8d/d91/db8/dba/d96/cdd 0 2024-05-08T05:32:08.282 INFO:tasks.workunit.client.0.smithi087.stdout:7/623: getdents d2/d6/d12 0 2024-05-08T05:32:08.283 INFO:tasks.workunit.client.0.smithi087.stdout:0/489: creat d0/da/d11/fac x:0 0 0 2024-05-08T05:32:08.283 INFO:tasks.workunit.client.0.smithi087.stdout:0/490: dread - d0/d57/d24/d66/f6f zero size 2024-05-08T05:32:08.283 INFO:tasks.workunit.client.0.smithi087.stdout:0/491: chown d0/da/d11/c1c 14193 1 2024-05-08T05:32:08.289 INFO:tasks.workunit.client.0.smithi087.stdout:2/472: unlink d7/de/d27/f72 0 2024-05-08T05:32:08.289 INFO:tasks.workunit.client.0.smithi087.stdout:2/473: stat d7/f1e 0 2024-05-08T05:32:08.289 INFO:tasks.workunit.client.0.smithi087.stdout:2/474: stat d7/de/d5d/f86 0 2024-05-08T05:32:08.289 INFO:tasks.workunit.client.0.smithi087.stdout:2/475: dread - d7/d63/f60 zero size 2024-05-08T05:32:08.290 INFO:tasks.workunit.client.0.smithi087.stdout:3/546: mkdir d4/d14/dbe 0 2024-05-08T05:32:08.290 INFO:tasks.workunit.client.0.smithi087.stdout:4/562: creat d4/d13/d3e/d28/fde x:0 0 0 2024-05-08T05:32:08.291 INFO:tasks.workunit.client.0.smithi087.stdout:0/492: getdents d0/da 0 2024-05-08T05:32:08.292 INFO:tasks.workunit.client.0.smithi087.stdout:2/476: mkdir d7/de/d78/d9c 0 2024-05-08T05:32:08.294 INFO:tasks.workunit.client.0.smithi087.stdout:3/547: link d4/d11/f38 d4/d11/d24/d39/d60/d87/da5/fbf 0 2024-05-08T05:32:08.294 INFO:tasks.workunit.client.0.smithi087.stdout:7/624: rmdir d2/da/d3f 39 2024-05-08T05:32:08.294 INFO:tasks.workunit.client.0.smithi087.stdout:7/625: write d2/d6/d12/d15/fa2 [211614,18416] 0 2024-05-08T05:32:08.296 INFO:tasks.workunit.client.0.smithi087.stdout:4/563: truncate d4/d13/f16 1109458 0 2024-05-08T05:32:08.296 INFO:tasks.workunit.client.0.smithi087.stdout:8/517: dread db/d23/d15/d3c/f3f [0,4194304] 0 2024-05-08T05:32:08.296 INFO:tasks.workunit.client.0.smithi087.stdout:3/548: mkdir d4/d11/d24/d25/d3e/d3f/dc0 0 2024-05-08T05:32:08.297 INFO:tasks.workunit.client.0.smithi087.stdout:2/477: getdents d7/de/d2c 0 2024-05-08T05:32:08.298 INFO:tasks.workunit.client.0.smithi087.stdout:2/478: getdents d7/de/d55 0 2024-05-08T05:32:08.298 INFO:tasks.workunit.client.0.smithi087.stdout:7/626: symlink d2/da/d3f/d49/lca 0 2024-05-08T05:32:08.302 INFO:tasks.workunit.client.0.smithi087.stdout:1/470: dwrite df/d2f/d57/d64/f45 [4194304,4194304] 0 2024-05-08T05:32:08.303 INFO:tasks.workunit.client.0.smithi087.stdout:4/564: creat d4/d6c/d93/fdf x:0 0 0 2024-05-08T05:32:08.303 INFO:tasks.workunit.client.0.smithi087.stdout:4/565: write d4/d13/d32/f3c [203340,102043] 0 2024-05-08T05:32:08.303 INFO:tasks.workunit.client.0.smithi087.stdout:4/566: readlink d4/d13/d32/d8d/d91/db8/dba/la4 0 2024-05-08T05:32:08.303 INFO:tasks.workunit.client.0.smithi087.stdout:4/567: write d4/f4b [2019177,67991] 0 2024-05-08T05:32:08.303 INFO:tasks.workunit.client.0.smithi087.stdout:8/518: getdents db/d23/d15/d29/d33/d6c 0 2024-05-08T05:32:08.304 INFO:tasks.workunit.client.0.smithi087.stdout:3/549: link d4/d11/d24/d25/d99/da2/lae d4/d11/d24/d25/d4d/dbb/lc1 0 2024-05-08T05:32:08.304 INFO:tasks.workunit.client.0.smithi087.stdout:8/519: truncate db/d23/d15/d29/d4d/f55 491973 0 2024-05-08T05:32:08.305 INFO:tasks.workunit.client.0.smithi087.stdout:8/520: write db/d23/d1b/f30 [4726038,96184] 0 2024-05-08T05:32:08.307 INFO:tasks.workunit.client.0.smithi087.stdout:2/479: creat d7/de/d27/d33/d49/f9d x:0 0 0 2024-05-08T05:32:08.308 INFO:tasks.workunit.client.0.smithi087.stdout:7/627: symlink d2/da/d3f/d49/d59/lcb 0 2024-05-08T05:32:08.310 INFO:tasks.workunit.client.0.smithi087.stdout:4/568: getdents d4/d13/d32/d8d/d91/db8/dba/d96/dd5 0 2024-05-08T05:32:08.311 INFO:tasks.workunit.client.0.smithi087.stdout:3/550: creat d4/d11/d3d/d48/fc2 x:0 0 0 2024-05-08T05:32:08.313 INFO:tasks.workunit.client.0.smithi087.stdout:8/521: symlink db/lb4 0 2024-05-08T05:32:08.315 INFO:tasks.workunit.client.0.smithi087.stdout:2/480: unlink d7/c50 0 2024-05-08T05:32:08.317 INFO:tasks.workunit.client.0.smithi087.stdout:0/493: write d0/d9/f7c [2342180,64726] 0 2024-05-08T05:32:08.320 INFO:tasks.workunit.client.0.smithi087.stdout:3/551: creat d4/fc3 x:0 0 0 2024-05-08T05:32:08.320 INFO:tasks.workunit.client.0.smithi087.stdout:3/552: fdatasync d4/d11/d24/d25/d3e/d3f/f7b 0 2024-05-08T05:32:08.320 INFO:tasks.workunit.client.0.smithi087.stdout:7/628: dread d2/da/d3f/d72/d77/d54/f3e [0,4194304] 0 2024-05-08T05:32:08.321 INFO:tasks.workunit.client.0.smithi087.stdout:7/629: readlink d2/d6/da0/d67/d82/lb2 0 2024-05-08T05:32:08.321 INFO:tasks.workunit.client.0.smithi087.stdout:3/553: creat d4/d14/d84/d8b/d8f/fc4 x:0 0 0 2024-05-08T05:32:08.322 INFO:tasks.workunit.client.0.smithi087.stdout:8/522: creat db/d23/d15/d3c/fb5 x:0 0 0 2024-05-08T05:32:08.323 INFO:tasks.workunit.client.0.smithi087.stdout:1/471: dread df/d18/d1d/d32/f86 [0,4194304] 0 2024-05-08T05:32:08.324 INFO:tasks.workunit.client.0.smithi087.stdout:1/472: readlink df/d18/d1d/d58/d72/l46 0 2024-05-08T05:32:08.324 INFO:tasks.workunit.client.0.smithi087.stdout:1/473: chown df/d18/d1d/d58/d72/f85 8798325 1 2024-05-08T05:32:08.324 INFO:tasks.workunit.client.0.smithi087.stdout:7/630: rename d2/da/d3f/d72/d77/fb9 to d2/da/fcc 0 2024-05-08T05:32:08.329 INFO:tasks.workunit.client.0.smithi087.stdout:3/554: creat d4/d5f/fc5 x:0 0 0 2024-05-08T05:32:08.329 INFO:tasks.workunit.client.0.smithi087.stdout:1/474: rename df/d18/c8a to df/d2f/d57/d64/d83/c9f 0 2024-05-08T05:32:08.329 INFO:tasks.workunit.client.0.smithi087.stdout:7/631: write d2/d6/f25 [1415954,20096] 0 2024-05-08T05:32:08.332 INFO:tasks.workunit.client.0.smithi087.stdout:1/475: mkdir df/d2f/d57/da0 0 2024-05-08T05:32:08.342 INFO:tasks.workunit.client.0.smithi087.stdout:8/523: write db/d23/d1b/d35/d43/d68/f86 [506228,22850] 0 2024-05-08T05:32:08.342 INFO:tasks.workunit.client.0.smithi087.stdout:8/524: chown db/d23/d15/f34 1999 1 2024-05-08T05:32:08.342 INFO:tasks.workunit.client.0.smithi087.stdout:7/632: unlink d2/d6/d12/d19/fac 0 2024-05-08T05:32:08.344 INFO:tasks.workunit.client.0.smithi087.stdout:7/633: creat d2/da/d3f/d72/d77/d54/d55/fcd x:0 0 0 2024-05-08T05:32:08.347 INFO:tasks.workunit.client.0.smithi087.stdout:7/634: rmdir d2/da/d3f/d49/daf/dbb 0 2024-05-08T05:32:08.352 INFO:tasks.workunit.client.0.smithi087.stdout:7/635: mknod d2/d6/d12/d19/d2a/d89/d9a/cce 0 2024-05-08T05:32:08.357 INFO:tasks.workunit.client.0.smithi087.stdout:9/526: dwrite d1/df/d14/d68/d80/d98/f4e [0,4194304] 0 2024-05-08T05:32:08.359 INFO:tasks.workunit.client.0.smithi087.stdout:6/538: dwrite d4/d8/df/d1e/d25/f72 [0,4194304] 0 2024-05-08T05:32:08.362 INFO:tasks.workunit.client.0.smithi087.stdout:9/527: mknod d1/d70/c9e 0 2024-05-08T05:32:08.365 INFO:tasks.workunit.client.0.smithi087.stdout:4/569: dwrite d4/d13/d3e/d28/d50/d9d/fd8 [0,4194304] 0 2024-05-08T05:32:08.365 INFO:tasks.workunit.client.0.smithi087.stdout:6/539: link d4/f5e d4/d8/df/d1e/d25/d28/d2d/d37/fa8 0 2024-05-08T05:32:08.365 INFO:tasks.workunit.client.0.smithi087.stdout:4/570: fdatasync d4/d13/d32/d8d/d91/db8/dba/f54 0 2024-05-08T05:32:08.367 INFO:tasks.workunit.client.0.smithi087.stdout:4/571: write d4/d13/d32/d8d/d91/db8/dba/f68 [498994,12839] 0 2024-05-08T05:32:08.372 INFO:tasks.workunit.client.0.smithi087.stdout:5/551: dwrite da/db/d2a/f77 [0,4194304] 0 2024-05-08T05:32:08.377 INFO:tasks.workunit.client.0.smithi087.stdout:5/552: link da/db/d2a/f77 da/db/d2a/d5a/d93/fb9 0 2024-05-08T05:32:08.377 INFO:tasks.workunit.client.0.smithi087.stdout:5/553: dread - da/db/d2a/d5a/d93/d17/d99/fb5 zero size 2024-05-08T05:32:08.380 INFO:tasks.workunit.client.0.smithi087.stdout:5/554: rename da/db/d2a/d5a/d93/d36/lad to da/db/d2a/d5a/d93/d42/lba 0 2024-05-08T05:32:08.384 INFO:tasks.workunit.client.0.smithi087.stdout:7/636: dread d2/d6/d12/d1d/f57 [0,4194304] 0 2024-05-08T05:32:08.387 INFO:tasks.workunit.client.0.smithi087.stdout:7/637: creat d2/d6/d12/d19/d2a/fcf x:0 0 0 2024-05-08T05:32:08.387 INFO:tasks.workunit.client.0.smithi087.stdout:4/572: write d4/d13/d3e/d28/d50/d9d/fd8 [925367,90849] 0 2024-05-08T05:32:08.389 INFO:tasks.workunit.client.0.smithi087.stdout:7/638: creat d2/d6/d12/dc5/fd0 x:0 0 0 2024-05-08T05:32:08.391 INFO:tasks.workunit.client.0.smithi087.stdout:4/573: creat d4/d6c/fe0 x:0 0 0 2024-05-08T05:32:08.393 INFO:tasks.workunit.client.0.smithi087.stdout:4/574: truncate d4/f6e 1331250 0 2024-05-08T05:32:08.393 INFO:tasks.workunit.client.0.smithi087.stdout:4/575: stat d4/d13/d32/d8d/d91/d84 0 2024-05-08T05:32:08.399 INFO:tasks.workunit.client.0.smithi087.stdout:3/555: dwrite d4/d11/d24/d25/d3e/d3f/f79 [0,4194304] 0 2024-05-08T05:32:08.400 INFO:tasks.workunit.client.0.smithi087.stdout:0/494: dwrite d0/da/f78 [0,4194304] 0 2024-05-08T05:32:08.400 INFO:tasks.workunit.client.0.smithi087.stdout:0/495: dread - d0/d57/d24/d66/f6f zero size 2024-05-08T05:32:08.401 INFO:tasks.workunit.client.0.smithi087.stdout:5/555: dread da/f48 [0,4194304] 0 2024-05-08T05:32:08.401 INFO:tasks.workunit.client.0.smithi087.stdout:2/481: dwrite d7/de/d55/f6b [0,4194304] 0 2024-05-08T05:32:08.401 INFO:tasks.workunit.client.0.smithi087.stdout:7/639: fdatasync d2/d6/d12/d19/f1e 0 2024-05-08T05:32:08.401 INFO:tasks.workunit.client.0.smithi087.stdout:5/556: getdents da/db/d2a/d5a/d93/d17/d99 0 2024-05-08T05:32:08.401 INFO:tasks.workunit.client.0.smithi087.stdout:7/640: write d2/d6/da0/f61 [367767,89821] 0 2024-05-08T05:32:08.401 INFO:tasks.workunit.client.0.smithi087.stdout:7/641: chown d2/d6/d12/d19/f1e 714 1 2024-05-08T05:32:08.401 INFO:tasks.workunit.client.0.smithi087.stdout:7/642: fsync d2/da/d3f/d72/d77/d54/d55/d65/fb5 0 2024-05-08T05:32:08.404 INFO:tasks.workunit.client.0.smithi087.stdout:3/556: unlink d4/d11/d24/d25/d4d/l9c 0 2024-05-08T05:32:08.404 INFO:tasks.workunit.client.0.smithi087.stdout:1/476: dwrite df/d2f/d57/d64/f45 [4194304,4194304] 0 2024-05-08T05:32:08.404 INFO:tasks.workunit.client.0.smithi087.stdout:1/477: truncate df/f40 1297602 0 2024-05-08T05:32:08.405 INFO:tasks.workunit.client.0.smithi087.stdout:8/525: dwrite db/d23/d15/f72 [0,4194304] 0 2024-05-08T05:32:08.407 INFO:tasks.workunit.client.0.smithi087.stdout:0/496: mknod d0/da/cad 0 2024-05-08T05:32:08.411 INFO:tasks.workunit.client.0.smithi087.stdout:2/482: rename d7/de/d5d/c80 to d7/de/d78/c9e 0 2024-05-08T05:32:08.413 INFO:tasks.workunit.client.0.smithi087.stdout:5/557: mkdir da/db/d2a/d46/dbb 0 2024-05-08T05:32:08.413 INFO:tasks.workunit.client.0.smithi087.stdout:5/558: readlink da/db/d2a/d5a/l74 0 2024-05-08T05:32:08.414 INFO:tasks.workunit.client.0.smithi087.stdout:7/643: link d2/d6/c3c d2/da/d3f/d72/d77/dc2/cd1 0 2024-05-08T05:32:08.416 INFO:tasks.workunit.client.0.smithi087.stdout:9/528: dread d1/f21 [4194304,4194304] 0 2024-05-08T05:32:08.420 INFO:tasks.workunit.client.0.smithi087.stdout:8/526: mkdir db/d23/d15/d29/d33/d6c/db6 0 2024-05-08T05:32:08.422 INFO:tasks.workunit.client.0.smithi087.stdout:0/497: creat d0/d9/d1b/fae x:0 0 0 2024-05-08T05:32:08.422 INFO:tasks.workunit.client.0.smithi087.stdout:0/498: write d0/d9/d1b/fae [938675,67984] 0 2024-05-08T05:32:08.422 INFO:tasks.workunit.client.0.smithi087.stdout:0/499: fsync d0/d9/d1b/d2f/d54/da1/f70 0 2024-05-08T05:32:08.424 INFO:tasks.workunit.client.0.smithi087.stdout:3/557: rename d4/d11/d24/d25/d3e/c49 to d4/d14/d84/cc6 0 2024-05-08T05:32:08.424 INFO:tasks.workunit.client.0.smithi087.stdout:3/558: readlink d4/d11/d24/d25/d3e/d3f/l42 0 2024-05-08T05:32:08.424 INFO:tasks.workunit.client.0.smithi087.stdout:2/483: creat d7/de/d27/f9f x:0 0 0 2024-05-08T05:32:08.424 INFO:tasks.workunit.client.0.smithi087.stdout:2/484: dread - d7/de/d27/d33/d49/f8b zero size 2024-05-08T05:32:08.424 INFO:tasks.workunit.client.0.smithi087.stdout:2/485: chown d7/de/l35 26693687 1 2024-05-08T05:32:08.426 INFO:tasks.workunit.client.0.smithi087.stdout:5/559: unlink da/db/d2a/d5a/d93/d42/d43/d83/d6b/d9c/la6 0 2024-05-08T05:32:08.430 INFO:tasks.workunit.client.0.smithi087.stdout:7/644: mknod d2/da/d3f/d49/d59/cd2 0 2024-05-08T05:32:08.430 INFO:tasks.workunit.client.0.smithi087.stdout:7/645: chown d2/d6/d12/laa 44968 1 2024-05-08T05:32:08.430 INFO:tasks.workunit.client.0.smithi087.stdout:8/527: truncate db/d23/f2e 1867350 0 2024-05-08T05:32:08.430 INFO:tasks.workunit.client.0.smithi087.stdout:7/646: readlink d2/d6/d12/d15/d5b/l84 0 2024-05-08T05:32:08.430 INFO:tasks.workunit.client.0.smithi087.stdout:0/500: rename d0/d57/d24/d66/f98 to d0/da/d35/daa/faf 0 2024-05-08T05:32:08.430 INFO:tasks.workunit.client.0.smithi087.stdout:7/647: chown d2/da/d3f 36855137 1 2024-05-08T05:32:08.431 INFO:tasks.workunit.client.0.smithi087.stdout:7/648: write d2/d6/d12/d15/fa2 [772080,113658] 0 2024-05-08T05:32:08.431 INFO:tasks.workunit.client.0.smithi087.stdout:0/501: mknod d0/d9/d90/cb0 0 2024-05-08T05:32:08.433 INFO:tasks.workunit.client.0.smithi087.stdout:5/560: dread da/db/d2a/fab [0,4194304] 0 2024-05-08T05:32:08.433 INFO:tasks.workunit.client.0.smithi087.stdout:8/528: symlink db/d23/d15/d29/d79/d95/lb7 0 2024-05-08T05:32:08.435 INFO:tasks.workunit.client.0.smithi087.stdout:2/486: rename d7/l32 to d7/d93/la0 0 2024-05-08T05:32:08.436 INFO:tasks.workunit.client.0.smithi087.stdout:7/649: unlink d2/d6/da0/c71 0 2024-05-08T05:32:08.438 INFO:tasks.workunit.client.0.smithi087.stdout:0/502: creat d0/d9/d1b/d2f/d54/da1/fb1 x:0 0 0 2024-05-08T05:32:08.438 INFO:tasks.workunit.client.0.smithi087.stdout:0/503: stat d0/d22/d3c 0 2024-05-08T05:32:08.438 INFO:tasks.workunit.client.0.smithi087.stdout:5/561: creat da/dd/d13/d16/fbc x:0 0 0 2024-05-08T05:32:08.439 INFO:tasks.workunit.client.0.smithi087.stdout:8/529: creat db/d23/d15/d29/d33/d6c/fb8 x:0 0 0 2024-05-08T05:32:08.439 INFO:tasks.workunit.client.0.smithi087.stdout:8/530: chown db/d23/d15/f36 34092 1 2024-05-08T05:32:08.440 INFO:tasks.workunit.client.0.smithi087.stdout:2/487: mknod d7/de/d82/ca1 0 2024-05-08T05:32:08.442 INFO:tasks.workunit.client.0.smithi087.stdout:0/504: mknod d0/d9/d90/cb2 0 2024-05-08T05:32:08.442 INFO:tasks.workunit.client.0.smithi087.stdout:0/505: write d0/d9/d1b/d5e/f6b [2119111,66613] 0 2024-05-08T05:32:08.442 INFO:tasks.workunit.client.0.smithi087.stdout:0/506: chown d0/da/d35/d86/d9a 26282053 1 2024-05-08T05:32:08.442 INFO:tasks.workunit.client.0.smithi087.stdout:0/507: dread - d0/d9/d1b/d2f/d54/f89 zero size 2024-05-08T05:32:08.442 INFO:tasks.workunit.client.0.smithi087.stdout:0/508: stat d0/da/f5d 0 2024-05-08T05:32:08.445 INFO:tasks.workunit.client.0.smithi087.stdout:5/562: rmdir da/db/d2a/d46/d69 39 2024-05-08T05:32:08.445 INFO:tasks.workunit.client.0.smithi087.stdout:5/563: readlink da/db/d2a/d5a/d93/d36/d45/l97 0 2024-05-08T05:32:08.448 INFO:tasks.workunit.client.0.smithi087.stdout:8/531: rename db/fa3 to db/d23/d15/d29/d33/d3b/fb9 0 2024-05-08T05:32:08.449 INFO:tasks.workunit.client.0.smithi087.stdout:2/488: creat d7/de/d82/fa2 x:0 0 0 2024-05-08T05:32:08.452 INFO:tasks.workunit.client.0.smithi087.stdout:0/509: creat d0/fb3 x:0 0 0 2024-05-08T05:32:08.452 INFO:tasks.workunit.client.0.smithi087.stdout:5/564: unlink da/f48 0 2024-05-08T05:32:08.452 INFO:tasks.workunit.client.0.smithi087.stdout:5/565: chown da/db/d2a/d5a/d93/d42/d43 2130597 1 2024-05-08T05:32:08.454 INFO:tasks.workunit.client.0.smithi087.stdout:2/489: rename d7/de/d27/l41 to d7/de/d78/la3 0 2024-05-08T05:32:08.454 INFO:tasks.workunit.client.0.smithi087.stdout:2/490: truncate d7/d63/f74 206619 0 2024-05-08T05:32:08.454 INFO:tasks.workunit.client.0.smithi087.stdout:2/491: write d7/de/d27/d33/f76 [620449,20768] 0 2024-05-08T05:32:08.454 INFO:tasks.workunit.client.0.smithi087.stdout:2/492: dread - d7/f8a zero size 2024-05-08T05:32:08.456 INFO:tasks.workunit.client.0.smithi087.stdout:0/510: mkdir d0/da/db4 0 2024-05-08T05:32:08.465 INFO:tasks.workunit.client.0.smithi087.stdout:5/566: unlink da/db/d2a/d5a/d93/d36/d45/caf 0 2024-05-08T05:32:08.465 INFO:tasks.workunit.client.0.smithi087.stdout:5/567: dread - da/db/f8f zero size 2024-05-08T05:32:08.473 INFO:tasks.workunit.client.0.smithi087.stdout:5/568: dread da/dd/d13/d16/f26 [0,4194304] 0 2024-05-08T05:32:08.474 INFO:tasks.workunit.client.0.smithi087.stdout:5/569: getdents da/db/d2a/d5a/d93/d17 0 2024-05-08T05:32:08.485 INFO:tasks.workunit.client.0.smithi087.stdout:9/529: dwrite d1/df/d14/d18/f77 [0,4194304] 0 2024-05-08T05:32:08.489 INFO:tasks.workunit.client.0.smithi087.stdout:2/493: read d7/de/d5d/f86 [829330,117145] 0 2024-05-08T05:32:08.490 INFO:tasks.workunit.client.0.smithi087.stdout:2/494: creat d7/de/d2c/fa4 x:0 0 0 2024-05-08T05:32:08.491 INFO:tasks.workunit.client.0.smithi087.stdout:5/570: dread da/db/d2a/f67 [0,4194304] 0 2024-05-08T05:32:08.491 INFO:tasks.workunit.client.0.smithi087.stdout:5/571: fsync da/db/d2a/d5a/d93/d17/f2b 0 2024-05-08T05:32:08.491 INFO:tasks.workunit.client.0.smithi087.stdout:5/572: dread - da/db/d2a/d46/d69/fa7 zero size 2024-05-08T05:32:08.500 INFO:tasks.workunit.client.0.smithi087.stdout:2/495: creat d7/de/d5d/fa5 x:0 0 0 2024-05-08T05:32:08.501 INFO:tasks.workunit.client.0.smithi087.stdout:2/496: truncate d7/f37 4993557 0 2024-05-08T05:32:08.501 INFO:tasks.workunit.client.0.smithi087.stdout:2/497: stat d7/f8a 0 2024-05-08T05:32:08.501 INFO:tasks.workunit.client.0.smithi087.stdout:8/532: dwrite db/d23/f2d [0,4194304] 0 2024-05-08T05:32:08.501 INFO:tasks.workunit.client.0.smithi087.stdout:8/533: write db/d23/d15/f19 [1778066,72750] 0 2024-05-08T05:32:08.501 INFO:tasks.workunit.client.0.smithi087.stdout:2/498: mknod d7/de/d27/d33/d65/ca6 0 2024-05-08T05:32:08.501 INFO:tasks.workunit.client.0.smithi087.stdout:2/499: chown d7/de/d55 7228520 1 2024-05-08T05:32:08.503 INFO:tasks.workunit.client.0.smithi087.stdout:2/500: rename d7/de/d27/f66 to d7/d93/fa7 0 2024-05-08T05:32:08.503 INFO:tasks.workunit.client.0.smithi087.stdout:2/501: readlink d7/d93/la0 0 2024-05-08T05:32:08.505 INFO:tasks.workunit.client.0.smithi087.stdout:2/502: link d7/d93/c97 d7/de/d27/d33/d65/ca8 0 2024-05-08T05:32:08.506 INFO:tasks.workunit.client.0.smithi087.stdout:2/503: rename d7/de/d27/d33/d49/f7f to d7/de/d27/d33/d81/fa9 0 2024-05-08T05:32:08.513 INFO:tasks.workunit.client.0.smithi087.stdout:8/534: write f6 [5565465,86337] 0 2024-05-08T05:32:08.513 INFO:tasks.workunit.client.0.smithi087.stdout:8/535: dread - db/f59 zero size 2024-05-08T05:32:08.513 INFO:tasks.workunit.client.0.smithi087.stdout:8/536: truncate db/d23/d1b/d7c/f9c 349905 0 2024-05-08T05:32:08.515 INFO:tasks.workunit.client.0.smithi087.stdout:3/559: dwrite d4/d11/d24/d39/d5a/f6b [0,4194304] 0 2024-05-08T05:32:08.520 INFO:tasks.workunit.client.0.smithi087.stdout:3/560: creat d4/d11/d24/d25/d4d/fc7 x:0 0 0 2024-05-08T05:32:08.529 INFO:tasks.workunit.client.0.smithi087.stdout:8/537: write db/d23/d15/f85 [933289,87118] 0 2024-05-08T05:32:08.532 INFO:tasks.workunit.client.0.smithi087.stdout:3/561: unlink d4/d11/d24/d25/d3e/l59 0 2024-05-08T05:32:08.534 INFO:tasks.workunit.client.0.smithi087.stdout:3/562: symlink d4/d11/d24/d25/d4d/lc8 0 2024-05-08T05:32:08.535 INFO:tasks.workunit.client.0.smithi087.stdout:3/563: creat d4/d11/d24/d25/d99/da2/fc9 x:0 0 0 2024-05-08T05:32:08.535 INFO:tasks.workunit.client.0.smithi087.stdout:3/564: chown d4/d11/l67 15 1 2024-05-08T05:32:08.536 INFO:tasks.workunit.client.0.smithi087.stdout:7/650: dwrite d2/da/fcc [0,4194304] 0 2024-05-08T05:32:08.537 INFO:tasks.workunit.client.0.smithi087.stdout:3/565: link d4/c33 d4/d14/cca 0 2024-05-08T05:32:08.537 INFO:tasks.workunit.client.0.smithi087.stdout:3/566: fsync d4/d11/d24/d25/d3e/fb9 0 2024-05-08T05:32:08.539 INFO:tasks.workunit.client.0.smithi087.stdout:7/651: creat d2/d6/fd3 x:0 0 0 2024-05-08T05:32:08.545 INFO:tasks.workunit.client.0.smithi087.stdout:6/540: sync 2024-05-08T05:32:08.547 INFO:tasks.workunit.client.0.smithi087.stdout:6/541: creat d4/d8/df/d1e/d25/d28/d2d/d37/d5b/fa9 x:0 0 0 2024-05-08T05:32:08.554 INFO:tasks.workunit.client.0.smithi087.stdout:9/530: dwrite d1/df/d14/d68/d80/d98/fc [0,4194304] 0 2024-05-08T05:32:08.554 INFO:tasks.workunit.client.0.smithi087.stdout:9/531: chown d1/df/d14/d18/f44 406761300 1 2024-05-08T05:32:08.554 INFO:tasks.workunit.client.0.smithi087.stdout:9/532: write d1/df/d14/d68/d80/d98/d28/d4b/f71 [1396247,39329] 0 2024-05-08T05:32:08.559 INFO:tasks.workunit.client.0.smithi087.stdout:7/652: write d2/d6/d12/d1d/fa4 [1565897,48287] 0 2024-05-08T05:32:08.560 INFO:tasks.workunit.client.0.smithi087.stdout:3/567: read d4/f1d [27925,69500] 0 2024-05-08T05:32:08.561 INFO:tasks.workunit.client.0.smithi087.stdout:7/653: truncate d2/da/f4c 1523559 0 2024-05-08T05:32:08.563 INFO:tasks.workunit.client.0.smithi087.stdout:6/542: write d4/d8/f3b [982998,4083] 0 2024-05-08T05:32:08.565 INFO:tasks.workunit.client.0.smithi087.stdout:6/543: unlink d4/d8/df/d1e/d25/d28/d2d/d37/c77 0 2024-05-08T05:32:08.569 INFO:tasks.workunit.client.0.smithi087.stdout:6/544: link d4/f6c d4/d8/faa 0 2024-05-08T05:32:08.570 INFO:tasks.workunit.client.0.smithi087.stdout:8/538: dwrite db/d23/d1b/f3d [0,4194304] 0 2024-05-08T05:32:08.573 INFO:tasks.workunit.client.0.smithi087.stdout:3/568: dread d4/d11/d24/d25/d3e/d58/f7a [0,4194304] 0 2024-05-08T05:32:08.577 INFO:tasks.workunit.client.0.smithi087.stdout:9/533: dread d1/df/d14/d68/d80/d98/f4e [0,4194304] 0 2024-05-08T05:32:08.580 INFO:tasks.workunit.client.0.smithi087.stdout:6/545: creat d4/d8/df/d39/d42/fab x:0 0 0 2024-05-08T05:32:08.581 INFO:tasks.workunit.client.0.smithi087.stdout:6/546: symlink d4/d8/df/d39/d42/lac 0 2024-05-08T05:32:08.585 INFO:tasks.workunit.client.0.smithi087.stdout:6/547: mkdir d4/d8/df/d39/d42/d9e/da4/dad 0 2024-05-08T05:32:08.586 INFO:tasks.workunit.client.0.smithi087.stdout:6/548: unlink d4/d8/l70 0 2024-05-08T05:32:08.586 INFO:tasks.workunit.client.0.smithi087.stdout:6/549: chown d4/f97 138886 1 2024-05-08T05:32:08.586 INFO:tasks.workunit.client.0.smithi087.stdout:6/550: truncate d4/f99 300039 0 2024-05-08T05:32:08.586 INFO:tasks.workunit.client.0.smithi087.stdout:4/576: sync 2024-05-08T05:32:08.586 INFO:tasks.workunit.client.0.smithi087.stdout:6/551: read d4/d8/df/d39/f7a [509873,109158] 0 2024-05-08T05:32:08.597 INFO:tasks.workunit.client.0.smithi087.stdout:9/534: dread d1/df/d14/f17 [0,4194304] 0 2024-05-08T05:32:08.603 INFO:tasks.workunit.client.0.smithi087.stdout:6/552: dread d4/d8/fb [0,4194304] 0 2024-05-08T05:32:08.605 INFO:tasks.workunit.client.0.smithi087.stdout:8/539: dwrite db/d23/d15/f36 [0,4194304] 0 2024-05-08T05:32:08.614 INFO:tasks.workunit.client.0.smithi087.stdout:6/553: link d4/d8/df/d39/d42/d9e/d6f/f8d d4/d8/df/d39/d42/d9e/d6f/d7f/fae 0 2024-05-08T05:32:08.614 INFO:tasks.workunit.client.0.smithi087.stdout:6/554: chown d4/d8/df/d39/f9b 3318729 1 2024-05-08T05:32:08.615 INFO:tasks.workunit.client.0.smithi087.stdout:7/654: dwrite d2/d6/d12/d19/d2a/fcf [0,4194304] 0 2024-05-08T05:32:08.615 INFO:tasks.workunit.client.0.smithi087.stdout:8/540: creat db/d23/d15/d29/fba x:0 0 0 2024-05-08T05:32:08.615 INFO:tasks.workunit.client.0.smithi087.stdout:8/541: stat db/d23/d1b/la0 0 2024-05-08T05:32:08.617 INFO:tasks.workunit.client.0.smithi087.stdout:4/577: write d4/d13/d32/d8d/d91/db8/dba/f54 [635525,112285] 0 2024-05-08T05:32:08.617 INFO:tasks.workunit.client.0.smithi087.stdout:4/578: write d4/d13/d3e/d28/fde [168188,109488] 0 2024-05-08T05:32:08.617 INFO:tasks.workunit.client.0.smithi087.stdout:7/655: unlink d2/d6/d12/d15/l37 0 2024-05-08T05:32:08.622 INFO:tasks.workunit.client.0.smithi087.stdout:4/579: creat d4/d13/d65/fe1 x:0 0 0 2024-05-08T05:32:08.622 INFO:tasks.workunit.client.0.smithi087.stdout:4/580: read - d4/d6c/d93/fac zero size 2024-05-08T05:32:08.625 INFO:tasks.workunit.client.0.smithi087.stdout:3/569: dwrite d4/d11/d3d/d48/f52 [0,4194304] 0 2024-05-08T05:32:08.625 INFO:tasks.workunit.client.0.smithi087.stdout:3/570: chown d4/lf 16 1 2024-05-08T05:32:08.634 INFO:tasks.workunit.client.0.smithi087.stdout:7/656: write d2/d6/d12/d19/d2a/f7b [2791293,52592] 0 2024-05-08T05:32:08.634 INFO:tasks.workunit.client.0.smithi087.stdout:0/511: sync 2024-05-08T05:32:08.634 INFO:tasks.workunit.client.0.smithi087.stdout:1/478: sync 2024-05-08T05:32:08.634 INFO:tasks.workunit.client.0.smithi087.stdout:0/512: chown d0/d9/d1b/d5e/l91 464 1 2024-05-08T05:32:08.635 INFO:tasks.workunit.client.0.smithi087.stdout:0/513: chown d0/d9/d1b/d2f/d54/da1/f5c 1271668 1 2024-05-08T05:32:08.635 INFO:tasks.workunit.client.0.smithi087.stdout:0/514: chown d0/da/l9b 118113 1 2024-05-08T05:32:08.636 INFO:tasks.workunit.client.0.smithi087.stdout:7/657: fsync d2/d6/d12/d19/d2a/f7b 0 2024-05-08T05:32:08.636 INFO:tasks.workunit.client.0.smithi087.stdout:1/479: rename df/d18/l1c to df/d18/d1d/d58/d72/la1 0 2024-05-08T05:32:08.636 INFO:tasks.workunit.client.0.smithi087.stdout:0/515: creat d0/d9/fb5 x:0 0 0 2024-05-08T05:32:08.637 INFO:tasks.workunit.client.0.smithi087.stdout:5/573: sync 2024-05-08T05:32:08.637 INFO:tasks.workunit.client.0.smithi087.stdout:3/571: rmdir d4 39 2024-05-08T05:32:08.637 INFO:tasks.workunit.client.0.smithi087.stdout:3/572: write d4/d11/d3d/f51 [2211406,31410] 0 2024-05-08T05:32:08.638 INFO:tasks.workunit.client.0.smithi087.stdout:1/480: creat df/d18/d1d/d27/fa2 x:0 0 0 2024-05-08T05:32:08.638 INFO:tasks.workunit.client.0.smithi087.stdout:0/516: creat d0/d22/d3c/fb6 x:0 0 0 2024-05-08T05:32:08.640 INFO:tasks.workunit.client.0.smithi087.stdout:5/574: truncate da/dd/d13/d16/f26 66627 0 2024-05-08T05:32:08.642 INFO:tasks.workunit.client.0.smithi087.stdout:3/573: creat d4/d11/d24/d39/d60/d87/da5/fcb x:0 0 0 2024-05-08T05:32:08.642 INFO:tasks.workunit.client.0.smithi087.stdout:1/481: mkdir df/d18/d1d/d27/da3 0 2024-05-08T05:32:08.644 INFO:tasks.workunit.client.0.smithi087.stdout:0/517: unlink d0/da/c95 0 2024-05-08T05:32:08.646 INFO:tasks.workunit.client.0.smithi087.stdout:5/575: link da/db/d2a/d5a/d93/d17/la1 da/db/d2a/d5a/d93/d36/lbd 0 2024-05-08T05:32:08.653 INFO:tasks.workunit.client.0.smithi087.stdout:1/482: truncate df/f3e 4633946 0 2024-05-08T05:32:08.653 INFO:tasks.workunit.client.0.smithi087.stdout:3/574: creat d4/d14/dbe/fcc x:0 0 0 2024-05-08T05:32:08.653 INFO:tasks.workunit.client.0.smithi087.stdout:1/483: stat df/d2f/d57/d64/c67 0 2024-05-08T05:32:08.653 INFO:tasks.workunit.client.0.smithi087.stdout:6/555: dread f1 [4194304,4194304] 0 2024-05-08T05:32:08.653 INFO:tasks.workunit.client.0.smithi087.stdout:6/556: readlink d4/d8/df/d1e/d25/l27 0 2024-05-08T05:32:08.653 INFO:tasks.workunit.client.0.smithi087.stdout:9/535: dwrite d1/df/d14/d18/f77 [0,4194304] 0 2024-05-08T05:32:08.658 INFO:tasks.workunit.client.0.smithi087.stdout:1/484: rmdir df/d18/d1d/d27/da3 0 2024-05-08T05:32:08.658 INFO:tasks.workunit.client.0.smithi087.stdout:2/504: sync 2024-05-08T05:32:08.658 INFO:tasks.workunit.client.0.smithi087.stdout:1/485: chown df/d18/d1d/f3a 921 1 2024-05-08T05:32:08.658 INFO:tasks.workunit.client.0.smithi087.stdout:6/557: unlink d4/d8/df/c44 0 2024-05-08T05:32:08.658 INFO:tasks.workunit.client.0.smithi087.stdout:5/576: dread da/db/d2a/d5a/d93/d36/d45/f4d [0,4194304] 0 2024-05-08T05:32:08.659 INFO:tasks.workunit.client.0.smithi087.stdout:2/505: creat d7/de/d5d/d90/faa x:0 0 0 2024-05-08T05:32:08.659 INFO:tasks.workunit.client.0.smithi087.stdout:2/506: readlink d7/de/d78/l8c 0 2024-05-08T05:32:08.660 INFO:tasks.workunit.client.0.smithi087.stdout:1/486: rename df/d2f/d57/d64/c67 to df/d2f/d4f/d52/ca4 0 2024-05-08T05:32:08.661 INFO:tasks.workunit.client.0.smithi087.stdout:1/487: getdents df/d2f/d57/da0 0 2024-05-08T05:32:08.663 INFO:tasks.workunit.client.0.smithi087.stdout:2/507: rename d7/de/d27/d33/d65/ca6 to d7/de/d27/cab 0 2024-05-08T05:32:08.663 INFO:tasks.workunit.client.0.smithi087.stdout:2/508: truncate d7/de/d2c/d43/f92 244833 0 2024-05-08T05:32:08.664 INFO:tasks.workunit.client.0.smithi087.stdout:1/488: creat df/fa5 x:0 0 0 2024-05-08T05:32:08.665 INFO:tasks.workunit.client.0.smithi087.stdout:2/509: mkdir d7/d63/dac 0 2024-05-08T05:32:08.667 INFO:tasks.workunit.client.0.smithi087.stdout:2/510: chown d7/de/d5d/d7b/c9b 397324 1 2024-05-08T05:32:08.668 INFO:tasks.workunit.client.0.smithi087.stdout:1/489: mknod df/d18/d1d/d32/d9c/ca6 0 2024-05-08T05:32:08.668 INFO:tasks.workunit.client.0.smithi087.stdout:2/511: unlink d7/de/d27/d33/c62 0 2024-05-08T05:32:08.669 INFO:tasks.workunit.client.0.smithi087.stdout:1/490: mknod df/d2f/d6a/ca7 0 2024-05-08T05:32:08.673 INFO:tasks.workunit.client.0.smithi087.stdout:1/491: mknod df/d2f/d57/d64/d83/ca8 0 2024-05-08T05:32:08.696 INFO:tasks.workunit.client.0.smithi087.stdout:6/558: dwrite d4/d8/f67 [0,4194304] 0 2024-05-08T05:32:08.696 INFO:tasks.workunit.client.0.smithi087.stdout:6/559: chown d4/d8/df/d1e/d25/f72 334 1 2024-05-08T05:32:08.696 INFO:tasks.workunit.client.0.smithi087.stdout:6/560: chown d4/d8/df/d39/d42/d9e/d6f/c9f 8425067 1 2024-05-08T05:32:08.698 INFO:tasks.workunit.client.0.smithi087.stdout:6/561: rename d4/d8/df/d39/d42/ca0 to d4/d6/caf 0 2024-05-08T05:32:08.698 INFO:tasks.workunit.client.0.smithi087.stdout:6/562: stat d4/d8/df/d39/d42/d9e 0 2024-05-08T05:32:08.698 INFO:tasks.workunit.client.0.smithi087.stdout:6/563: stat d4/d8/df/d39/d42/d9e 0 2024-05-08T05:32:08.699 INFO:tasks.workunit.client.0.smithi087.stdout:6/564: symlink d4/d8/df/d39/d42/lb0 0 2024-05-08T05:32:08.700 INFO:tasks.workunit.client.0.smithi087.stdout:6/565: mknod d4/d8/df/d1e/d25/d28/d2d/d37/d5b/cb1 0 2024-05-08T05:32:08.704 INFO:tasks.workunit.client.0.smithi087.stdout:6/566: symlink d4/d8/df/d39/d42/d9e/lb2 0 2024-05-08T05:32:08.704 INFO:tasks.workunit.client.0.smithi087.stdout:6/567: fsync d4/d8/df/d39/d42/d9e/f81 0 2024-05-08T05:32:08.708 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:32:08 smithi087 ceph-mon[29523]: pgmap v514: 97 pgs: 97 active+clean; 654 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 76 MiB/s rd, 96 MiB/s wr, 737 op/s 2024-05-08T05:32:08.714 INFO:tasks.workunit.client.0.smithi087.stdout:9/536: read d1/df/d14/d18/f77 [1292758,70745] 0 2024-05-08T05:32:08.714 INFO:tasks.workunit.client.0.smithi087.stdout:5/577: dwrite da/db/d2a/d5a/d93/d42/fb6 [0,4194304] 0 2024-05-08T05:32:08.722 INFO:tasks.workunit.client.0.smithi087.stdout:6/568: write d4/f5e [2570130,43774] 0 2024-05-08T05:32:08.723 INFO:tasks.workunit.client.0.smithi087.stdout:6/569: truncate d4/d8/df/d1e/d25/d28/d2d/d37/d5b/f5d 340636 0 2024-05-08T05:32:08.724 INFO:tasks.workunit.client.0.smithi087.stdout:6/570: fdatasync d4/d8/df/d1e/d25/d28/d57/f76 0 2024-05-08T05:32:08.725 INFO:tasks.workunit.client.0.smithi087.stdout:6/571: symlink d4/d8/df/d39/d42/lb3 0 2024-05-08T05:32:08.726 INFO:tasks.workunit.client.0.smithi087.stdout:6/572: link d4/d8/df/d39/d42/d9e/d6f/f85 d4/d8/df/d1e/fb4 0 2024-05-08T05:32:08.727 INFO:tasks.workunit.client.0.smithi087.stdout:6/573: write d4/d8/df/d1e/d25/d28/d2d/d37/d5b/f5d [85981,50104] 0 2024-05-08T05:32:08.729 INFO:tasks.workunit.client.0.smithi087.stdout:6/574: mkdir d4/d8/df/d39/d42/d94/db5 0 2024-05-08T05:32:08.729 INFO:tasks.workunit.client.0.smithi087.stdout:5/578: read da/db/d2a/d5a/d93/fb9 [2913892,48578] 0 2024-05-08T05:32:08.729 INFO:tasks.workunit.client.0.smithi087.stdout:5/579: truncate da/db/d2a/d5a/d93/d36/d45/d5c/f78 227548 0 2024-05-08T05:32:08.733 INFO:tasks.workunit.client.0.smithi087.stdout:0/518: dwrite d0/da/d11/f43 [0,4194304] 0 2024-05-08T05:32:08.733 INFO:tasks.workunit.client.0.smithi087.stdout:2/512: dwrite d7/de/d2c/d43/f92 [0,4194304] 0 2024-05-08T05:32:08.733 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:32:08 smithi090 ceph-mon[34526]: pgmap v514: 97 pgs: 97 active+clean; 654 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 76 MiB/s rd, 96 MiB/s wr, 737 op/s 2024-05-08T05:32:08.734 INFO:tasks.workunit.client.0.smithi087.stdout:1/492: dwrite df/d18/d1d/f3a [0,4194304] 0 2024-05-08T05:32:08.737 INFO:tasks.workunit.client.0.smithi087.stdout:0/519: mknod d0/da/db4/cb7 0 2024-05-08T05:32:08.737 INFO:tasks.workunit.client.0.smithi087.stdout:1/493: rmdir df/d18/d1d 39 2024-05-08T05:32:08.739 INFO:tasks.workunit.client.0.smithi087.stdout:1/494: truncate df/f3e 1716783 0 2024-05-08T05:32:08.741 INFO:tasks.workunit.client.0.smithi087.stdout:1/495: creat df/d2f/d57/d64/fa9 x:0 0 0 2024-05-08T05:32:08.745 INFO:tasks.workunit.client.0.smithi087.stdout:3/575: dwrite d4/d11/d24/d39/d5a/f6b [0,4194304] 0 2024-05-08T05:32:08.758 INFO:tasks.workunit.client.0.smithi087.stdout:9/537: dwrite d1/df/d14/d68/d80/d98/fc [4194304,4194304] 0 2024-05-08T05:32:08.760 INFO:tasks.workunit.client.0.smithi087.stdout:9/538: read d1/df/d14/d68/d80/d98/f9d [682331,30643] 0 2024-05-08T05:32:08.766 INFO:tasks.workunit.client.0.smithi087.stdout:9/539: creat d1/df/d14/d68/d80/d98/d83/f9f x:0 0 0 2024-05-08T05:32:08.767 INFO:tasks.workunit.client.0.smithi087.stdout:9/540: rmdir d1/df/d14/d68/d80/d98 39 2024-05-08T05:32:08.769 INFO:tasks.workunit.client.0.smithi087.stdout:1/496: read df/d2f/d4f/f55 [1799005,52642] 0 2024-05-08T05:32:08.769 INFO:tasks.workunit.client.0.smithi087.stdout:9/541: link d1/df/l1d d1/df/d37/d5b/d7e/la0 0 2024-05-08T05:32:08.770 INFO:tasks.workunit.client.0.smithi087.stdout:9/542: link d1/df/d14/d54/c5a d1/df/d37/d74/ca1 0 2024-05-08T05:32:08.771 INFO:tasks.workunit.client.0.smithi087.stdout:9/543: mkdir d1/df/d14/d18/d8e/da2 0 2024-05-08T05:32:08.774 INFO:tasks.workunit.client.0.smithi087.stdout:8/542: sync 2024-05-08T05:32:08.774 INFO:tasks.workunit.client.0.smithi087.stdout:4/581: sync 2024-05-08T05:32:08.774 INFO:tasks.workunit.client.0.smithi087.stdout:4/582: fsync d4/d13/f2e 0 2024-05-08T05:32:08.774 INFO:tasks.workunit.client.0.smithi087.stdout:8/543: fdatasync db/d23/d15/d3c/f3e 0 2024-05-08T05:32:08.775 INFO:tasks.workunit.client.0.smithi087.stdout:8/544: symlink db/d23/d15/d29/d33/d6c/db6/lbb 0 2024-05-08T05:32:08.775 INFO:tasks.workunit.client.0.smithi087.stdout:8/545: chown db/d23/d15/f90 15 1 2024-05-08T05:32:08.785 INFO:tasks.workunit.client.0.smithi087.stdout:9/544: dread d1/df/d14/d18/f77 [4194304,4194304] 0 2024-05-08T05:32:08.787 INFO:tasks.workunit.client.0.smithi087.stdout:9/545: getdents d1/df 0 2024-05-08T05:32:08.788 INFO:tasks.workunit.client.0.smithi087.stdout:9/546: rename d1/df/d14/d54/d61/c27 to d1/df/d14/d54/d61/ca3 0 2024-05-08T05:32:08.789 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:32:08 smithi160 ceph-mon[34827]: pgmap v514: 97 pgs: 97 active+clean; 654 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 76 MiB/s rd, 96 MiB/s wr, 737 op/s 2024-05-08T05:32:08.789 INFO:tasks.workunit.client.0.smithi087.stdout:9/547: symlink d1/df/d14/d68/d80/d98/d28/la4 0 2024-05-08T05:32:08.790 INFO:tasks.workunit.client.0.smithi087.stdout:9/548: creat d1/df/d37/d74/fa5 x:0 0 0 2024-05-08T05:32:08.790 INFO:tasks.workunit.client.0.smithi087.stdout:9/549: read - d1/df/d37/d74/fa5 zero size 2024-05-08T05:32:08.791 INFO:tasks.workunit.client.0.smithi087.stdout:9/550: write d1/f19 [506362,124588] 0 2024-05-08T05:32:08.792 INFO:tasks.workunit.client.0.smithi087.stdout:9/551: mknod d1/df/d14/d68/d80/d98/d28/ca6 0 2024-05-08T05:32:08.793 INFO:tasks.workunit.client.0.smithi087.stdout:9/552: creat d1/df/d14/d54/d61/d88/fa7 x:0 0 0 2024-05-08T05:32:08.801 INFO:tasks.workunit.client.0.smithi087.stdout:2/513: dwrite d7/de/d55/f56 [0,4194304] 0 2024-05-08T05:32:08.801 INFO:tasks.workunit.client.0.smithi087.stdout:2/514: chown d7/de/d27/c7c 3657 1 2024-05-08T05:32:08.801 INFO:tasks.workunit.client.0.smithi087.stdout:2/515: truncate d7/de/d2c/f89 554025 0 2024-05-08T05:32:08.801 INFO:tasks.workunit.client.0.smithi087.stdout:2/516: fsync f5 0 2024-05-08T05:32:08.801 INFO:tasks.workunit.client.0.smithi087.stdout:2/517: chown d7/de/d27/d33/f77 169820 1 2024-05-08T05:32:08.802 INFO:tasks.workunit.client.0.smithi087.stdout:5/580: dread da/db/d2a/d5a/d93/fb9 [0,4194304] 0 2024-05-08T05:32:08.802 INFO:tasks.workunit.client.0.smithi087.stdout:6/575: dwrite d4/d8/f3c [0,4194304] 0 2024-05-08T05:32:08.802 INFO:tasks.workunit.client.0.smithi087.stdout:1/497: read df/f40 [1289651,117333] 0 2024-05-08T05:32:08.802 INFO:tasks.workunit.client.0.smithi087.stdout:2/518: link d7/de/d27/f8e d7/de/d27/d33/d65/fad 0 2024-05-08T05:32:08.803 INFO:tasks.workunit.client.0.smithi087.stdout:5/581: truncate da/dd/d65/f68 31148 0 2024-05-08T05:32:08.804 INFO:tasks.workunit.client.0.smithi087.stdout:6/576: getdents d4/d8/df/d1e/d25/d28/d57/d6d 0 2024-05-08T05:32:08.804 INFO:tasks.workunit.client.0.smithi087.stdout:6/577: write d4/d8/df/d1e/d25/d28/fa3 [111116,23637] 0 2024-05-08T05:32:08.808 INFO:tasks.workunit.client.0.smithi087.stdout:1/498: rename df/d18/d1d/d27/d61/l82 to df/d18/d1d/d27/d61/laa 0 2024-05-08T05:32:08.808 INFO:tasks.workunit.client.0.smithi087.stdout:5/582: creat da/db/d2a/d46/dbb/fbe x:0 0 0 2024-05-08T05:32:08.808 INFO:tasks.workunit.client.0.smithi087.stdout:5/583: chown da/db/d2a/d5a/d93/d17/f28 1476304 1 2024-05-08T05:32:08.809 INFO:tasks.workunit.client.0.smithi087.stdout:3/576: dwrite d4/d11/d24/d25/d3e/fb9 [0,4194304] 0 2024-05-08T05:32:08.809 INFO:tasks.workunit.client.0.smithi087.stdout:5/584: creat da/db/d2a/d5a/d93/d36/d45/d5c/d86/fbf x:0 0 0 2024-05-08T05:32:08.813 INFO:tasks.workunit.client.0.smithi087.stdout:0/520: dwrite d0/da/d35/f80 [0,4194304] 0 2024-05-08T05:32:08.813 INFO:tasks.workunit.client.0.smithi087.stdout:0/521: read - d0/da/f5d zero size 2024-05-08T05:32:08.813 INFO:tasks.workunit.client.0.smithi087.stdout:0/522: read - d0/da/d11/fac zero size 2024-05-08T05:32:08.813 INFO:tasks.workunit.client.0.smithi087.stdout:3/577: unlink d4/f71 0 2024-05-08T05:32:08.818 INFO:tasks.workunit.client.0.smithi087.stdout:0/523: symlink d0/da/lb8 0 2024-05-08T05:32:08.818 INFO:tasks.workunit.client.0.smithi087.stdout:1/499: dread df/f3e [0,4194304] 0 2024-05-08T05:32:08.820 INFO:tasks.workunit.client.0.smithi087.stdout:3/578: rename d4/d11/d24/d25/d3e/d58/f76 to d4/d11/d24/d25/d3e/fcd 0 2024-05-08T05:32:08.822 INFO:tasks.workunit.client.0.smithi087.stdout:0/524: unlink d0/da/d35/c46 0 2024-05-08T05:32:08.822 INFO:tasks.workunit.client.0.smithi087.stdout:0/525: dread - d0/fa3 zero size 2024-05-08T05:32:08.824 INFO:tasks.workunit.client.0.smithi087.stdout:1/500: mknod df/d2f/d57/da0/cab 0 2024-05-08T05:32:08.827 INFO:tasks.workunit.client.0.smithi087.stdout:3/579: rmdir d4/d11/d24/d25/da4 0 2024-05-08T05:32:08.831 INFO:tasks.workunit.client.0.smithi087.stdout:3/580: creat d4/d14/d84/d8b/d8f/fce x:0 0 0 2024-05-08T05:32:08.831 INFO:tasks.workunit.client.0.smithi087.stdout:3/581: write d4/d11/d3d/f56 [4700607,69825] 0 2024-05-08T05:32:08.832 INFO:tasks.workunit.client.0.smithi087.stdout:3/582: mknod d4/d14/dbe/ccf 0 2024-05-08T05:32:08.841 INFO:tasks.workunit.client.0.smithi087.stdout:1/501: dread df/d18/d1d/f3a [0,4194304] 0 2024-05-08T05:32:08.849 INFO:tasks.workunit.client.0.smithi087.stdout:5/585: read da/db/d2a/d5a/d93/d36/f39 [1913126,119692] 0 2024-05-08T05:32:08.849 INFO:tasks.workunit.client.0.smithi087.stdout:5/586: chown da/db/d2a/d5a/d93/d42/d43/c8d 14265198 1 2024-05-08T05:32:08.850 INFO:tasks.workunit.client.0.smithi087.stdout:8/546: dwrite db/d23/d3a/d65/f6e [0,4194304] 0 2024-05-08T05:32:08.850 INFO:tasks.workunit.client.0.smithi087.stdout:8/547: fdatasync db/d23/f38 0 2024-05-08T05:32:08.850 INFO:tasks.workunit.client.0.smithi087.stdout:4/583: dwrite d4/fda [0,4194304] 0 2024-05-08T05:32:08.850 INFO:tasks.workunit.client.0.smithi087.stdout:4/584: fdatasync d4/d13/d3e/f4f 0 2024-05-08T05:32:08.852 INFO:tasks.workunit.client.0.smithi087.stdout:2/519: dwrite d7/de/d82/fa2 [0,4194304] 0 2024-05-08T05:32:08.854 INFO:tasks.workunit.client.0.smithi087.stdout:8/548: write db/d23/d15/d29/d33/d3b/d56/d78/fa5 [833055,41146] 0 2024-05-08T05:32:08.865 INFO:tasks.workunit.client.0.smithi087.stdout:5/587: unlink da/db/f71 0 2024-05-08T05:32:08.865 INFO:tasks.workunit.client.0.smithi087.stdout:2/520: mknod d7/de/cae 0 2024-05-08T05:32:08.866 INFO:tasks.workunit.client.0.smithi087.stdout:8/549: creat db/d23/d15/d29/db1/fbc x:0 0 0 2024-05-08T05:32:08.867 INFO:tasks.workunit.client.0.smithi087.stdout:2/521: creat d7/de/d27/d33/faf x:0 0 0 2024-05-08T05:32:08.867 INFO:tasks.workunit.client.0.smithi087.stdout:2/522: chown d7/de/cae 3 1 2024-05-08T05:32:08.869 INFO:tasks.workunit.client.0.smithi087.stdout:8/550: creat db/d23/d1b/d7c/fbd x:0 0 0 2024-05-08T05:32:08.870 INFO:tasks.workunit.client.0.smithi087.stdout:8/551: mkdir db/d23/d15/d29/d33/d6c/dbe 0 2024-05-08T05:32:08.870 INFO:tasks.workunit.client.0.smithi087.stdout:8/552: write db/d23/d15/f34 [1786069,45875] 0 2024-05-08T05:32:08.870 INFO:tasks.workunit.client.0.smithi087.stdout:8/553: write f5 [5164299,36136] 0 2024-05-08T05:32:08.871 INFO:tasks.workunit.client.0.smithi087.stdout:8/554: write db/d23/d15/d3c/fb5 [1039863,68969] 0 2024-05-08T05:32:08.871 INFO:tasks.workunit.client.0.smithi087.stdout:8/555: readlink db/d23/d15/d29/d33/d3b/l5f 0 2024-05-08T05:32:08.871 INFO:tasks.workunit.client.0.smithi087.stdout:8/556: write db/d23/f64 [282610,22901] 0 2024-05-08T05:32:08.871 INFO:tasks.workunit.client.0.smithi087.stdout:7/658: sync 2024-05-08T05:32:08.871 INFO:tasks.workunit.client.0.smithi087.stdout:7/659: write d2/d6/d12/d15/f46 [2192771,18408] 0 2024-05-08T05:32:08.872 INFO:tasks.workunit.client.0.smithi087.stdout:8/557: mknod db/cbf 0 2024-05-08T05:32:08.873 INFO:tasks.workunit.client.0.smithi087.stdout:8/558: mknod db/d23/d1b/d35/d43/d68/cc0 0 2024-05-08T05:32:08.873 INFO:tasks.workunit.client.0.smithi087.stdout:8/559: write db/d23/d15/d29/fa6 [568381,6467] 0 2024-05-08T05:32:08.874 INFO:tasks.workunit.client.0.smithi087.stdout:7/660: rmdir d2/db0 39 2024-05-08T05:32:08.874 INFO:tasks.workunit.client.0.smithi087.stdout:7/661: chown d2/da/d3f/d72/d77/c92 115 1 2024-05-08T05:32:08.876 INFO:tasks.workunit.client.0.smithi087.stdout:3/583: dwrite d4/d11/d24/d25/d3e/d58/fa8 [0,4194304] 0 2024-05-08T05:32:08.892 INFO:tasks.workunit.client.0.smithi087.stdout:3/584: write d4/f3c [3331634,45924] 0 2024-05-08T05:32:08.893 INFO:tasks.workunit.client.0.smithi087.stdout:3/585: write d4/d11/d24/d25/fa3 [2946078,102238] 0 2024-05-08T05:32:08.893 INFO:tasks.workunit.client.0.smithi087.stdout:3/586: dread - d4/d11/d3d/d48/fc2 zero size 2024-05-08T05:32:08.899 INFO:tasks.workunit.client.0.smithi087.stdout:2/523: dread f5 [4194304,4194304] 0 2024-05-08T05:32:08.899 INFO:tasks.workunit.client.0.smithi087.stdout:6/578: write f1 [4429161,94609] 0 2024-05-08T05:32:08.899 INFO:tasks.workunit.client.0.smithi087.stdout:6/579: chown d4/d8/df/d39/d42 2244210 1 2024-05-08T05:32:08.899 INFO:tasks.workunit.client.0.smithi087.stdout:8/560: rename db/d23/d15/c92 to db/d23/d15/d29/d33/d3b/d56/cc1 0 2024-05-08T05:32:08.899 INFO:tasks.workunit.client.0.smithi087.stdout:8/561: write db/d23/d15/d29/d33/d6c/f6d [579870,5909] 0 2024-05-08T05:32:08.900 INFO:tasks.workunit.client.0.smithi087.stdout:9/553: dwrite d1/df/d14/f55 [0,4194304] 0 2024-05-08T05:32:08.900 INFO:tasks.workunit.client.0.smithi087.stdout:7/662: truncate d2/d6/d12/d19/f2d 126358 0 2024-05-08T05:32:08.900 INFO:tasks.workunit.client.0.smithi087.stdout:7/663: stat d2/db0/fbc 0 2024-05-08T05:32:08.904 INFO:tasks.workunit.client.0.smithi087.stdout:8/562: rename db/d23/l31 to db/d23/d1b/d7c/lc2 0 2024-05-08T05:32:08.906 INFO:tasks.workunit.client.0.smithi087.stdout:9/554: creat d1/d70/fa8 x:0 0 0 2024-05-08T05:32:08.906 INFO:tasks.workunit.client.0.smithi087.stdout:9/555: fdatasync d1/df/d14/d54/f64 0 2024-05-08T05:32:08.907 INFO:tasks.workunit.client.0.smithi087.stdout:2/524: dread d7/d63/f7d [0,4194304] 0 2024-05-08T05:32:08.909 INFO:tasks.workunit.client.0.smithi087.stdout:9/556: link d1/df/d58/d5e/c9c d1/df/d14/d68/d80/d98/d83/ca9 0 2024-05-08T05:32:08.912 INFO:tasks.workunit.client.0.smithi087.stdout:9/557: creat d1/df/d14/d68/faa x:0 0 0 2024-05-08T05:32:08.912 INFO:tasks.workunit.client.0.smithi087.stdout:9/558: truncate d1/df/d14/d54/d61/d88/fa7 721586 0 2024-05-08T05:32:08.915 INFO:tasks.workunit.client.0.smithi087.stdout:9/559: getdents d1/df/d37/d5b/d7e/d85 0 2024-05-08T05:32:08.915 INFO:tasks.workunit.client.0.smithi087.stdout:9/560: write d1/df/d14/d68/d80/d98/d28/f4f [1004456,96472] 0 2024-05-08T05:32:08.916 INFO:tasks.workunit.client.0.smithi087.stdout:9/561: getdents d1/df/d14/d54/d61/d72 0 2024-05-08T05:32:08.916 INFO:tasks.workunit.client.0.smithi087.stdout:9/562: truncate d1/df/d14/d68/d80/d98/d28/f4f 1810969 0 2024-05-08T05:32:08.916 INFO:tasks.workunit.client.0.smithi087.stdout:9/563: rmdir d1/df/d14/d18/d8e 39 2024-05-08T05:32:08.918 INFO:tasks.workunit.client.0.smithi087.stdout:9/564: mknod d1/df/d58/cab 0 2024-05-08T05:32:08.919 INFO:tasks.workunit.client.0.smithi087.stdout:9/565: symlink d1/df/d14/d68/d80/d98/d28/d4b/lac 0 2024-05-08T05:32:08.920 INFO:tasks.workunit.client.0.smithi087.stdout:9/566: creat d1/df/d14/d18/d8e/da2/fad x:0 0 0 2024-05-08T05:32:08.923 INFO:tasks.workunit.client.0.smithi087.stdout:5/588: dwrite da/db/f25 [0,4194304] 0 2024-05-08T05:32:08.925 INFO:tasks.workunit.client.0.smithi087.stdout:5/589: creat da/db/d2a/d5a/d93/d42/d43/d83/fc0 x:0 0 0 2024-05-08T05:32:08.935 INFO:tasks.workunit.client.0.smithi087.stdout:2/525: dread d7/de/d2c/d43/f92 [0,4194304] 0 2024-05-08T05:32:08.935 INFO:tasks.workunit.client.0.smithi087.stdout:6/580: dwrite d4/d8/f67 [0,4194304] 0 2024-05-08T05:32:08.945 INFO:tasks.workunit.client.0.smithi087.stdout:0/526: dwrite d0/f6c [0,4194304] 0 2024-05-08T05:32:08.945 INFO:tasks.workunit.client.0.smithi087.stdout:2/526: mkdir d7/de/d2c/db0 0 2024-05-08T05:32:08.945 INFO:tasks.workunit.client.0.smithi087.stdout:2/527: dread - d7/de/d27/f9f zero size 2024-05-08T05:32:08.950 INFO:tasks.workunit.client.0.smithi087.stdout:0/527: creat d0/fb9 x:0 0 0 2024-05-08T05:32:08.951 INFO:tasks.workunit.client.0.smithi087.stdout:2/528: truncate d7/de/d27/d33/f38 3078132 0 2024-05-08T05:32:08.951 INFO:tasks.workunit.client.0.smithi087.stdout:2/529: fsync f3 0 2024-05-08T05:32:08.953 INFO:tasks.workunit.client.0.smithi087.stdout:3/587: dwrite d4/d14/d84/d8b/d8f/fce [0,4194304] 0 2024-05-08T05:32:08.956 INFO:tasks.workunit.client.0.smithi087.stdout:8/563: dwrite db/d23/d15/d29/d4d/f55 [0,4194304] 0 2024-05-08T05:32:08.956 INFO:tasks.workunit.client.0.smithi087.stdout:8/564: chown db/d23/d1b/d35/d43/daf 3675 1 2024-05-08T05:32:08.956 INFO:tasks.workunit.client.0.smithi087.stdout:8/565: write db/d23/d15/f99 [14292,509] 0 2024-05-08T05:32:08.956 INFO:tasks.workunit.client.0.smithi087.stdout:8/566: chown db/d23/d1b/d7c/f97 0 1 2024-05-08T05:32:08.956 INFO:tasks.workunit.client.0.smithi087.stdout:8/567: write db/d23/d15/d29/d33/d3b/f4c [762488,94889] 0 2024-05-08T05:32:08.956 INFO:tasks.workunit.client.0.smithi087.stdout:8/568: stat db/d23/d15/f99 0 2024-05-08T05:32:08.959 INFO:tasks.workunit.client.0.smithi087.stdout:3/588: getdents d4/d11/d24/d25/d99 0 2024-05-08T05:32:08.963 INFO:tasks.workunit.client.0.smithi087.stdout:7/664: dwrite d2/d6/d12/d15/d5b/f63 [0,4194304] 0 2024-05-08T05:32:08.963 INFO:tasks.workunit.client.0.smithi087.stdout:8/569: dread db/f12 [0,4194304] 0 2024-05-08T05:32:08.963 INFO:tasks.workunit.client.0.smithi087.stdout:6/581: truncate d4/d8/f3b 2724383 0 2024-05-08T05:32:08.964 INFO:tasks.workunit.client.0.smithi087.stdout:6/582: fsync d4/d8/df/d1e/d25/d28/d2d/d37/d45/f64 0 2024-05-08T05:32:08.964 INFO:tasks.workunit.client.0.smithi087.stdout:6/583: dread - d4/d8/df/d1e/d25/d28/f36 zero size 2024-05-08T05:32:08.964 INFO:tasks.workunit.client.0.smithi087.stdout:7/665: stat d2/d6/da0/c68 0 2024-05-08T05:32:08.966 INFO:tasks.workunit.client.0.smithi087.stdout:5/590: dread da/f30 [0,4194304] 0 2024-05-08T05:32:08.966 INFO:tasks.workunit.client.0.smithi087.stdout:5/591: read da/db/d2a/d5a/d93/d36/d45/f4d [72470,120555] 0 2024-05-08T05:32:08.967 INFO:tasks.workunit.client.0.smithi087.stdout:8/570: rename db/d23/d1b/d35/d43/d68/d6a/l70 to db/d23/d1b/d35/lc3 0 2024-05-08T05:32:08.968 INFO:tasks.workunit.client.0.smithi087.stdout:6/584: creat d4/d8/fb6 x:0 0 0 2024-05-08T05:32:08.969 INFO:tasks.workunit.client.0.smithi087.stdout:0/528: write d0/da/f1e [2325927,7363] 0 2024-05-08T05:32:08.974 INFO:tasks.workunit.client.0.smithi087.stdout:7/666: rename d2/da/d3f/d72/fa9 to d2/d6/da0/fd4 0 2024-05-08T05:32:08.978 INFO:tasks.workunit.client.0.smithi087.stdout:6/585: unlink d4/f4a 0 2024-05-08T05:32:08.978 INFO:tasks.workunit.client.0.smithi087.stdout:0/529: mknod d0/d9e/cba 0 2024-05-08T05:32:08.980 INFO:tasks.workunit.client.0.smithi087.stdout:6/586: creat d4/d8/df/d1e/d25/fb7 x:0 0 0 2024-05-08T05:32:08.980 INFO:tasks.workunit.client.0.smithi087.stdout:6/587: chown d4/d8/df/d1e/d25/f8a 17582932 1 2024-05-08T05:32:08.980 INFO:tasks.workunit.client.0.smithi087.stdout:6/588: write d4/d8/df/d39/d42/d9e/d6f/f90 [4763774,117731] 0 2024-05-08T05:32:08.980 INFO:tasks.workunit.client.0.smithi087.stdout:9/567: dwrite d1/df/d14/d68/faa [0,4194304] 0 2024-05-08T05:32:08.981 INFO:tasks.workunit.client.0.smithi087.stdout:3/589: dread d4/d14/d84/d8b/d8f/fce [0,4194304] 0 2024-05-08T05:32:08.984 INFO:tasks.workunit.client.0.smithi087.stdout:1/502: sync 2024-05-08T05:32:08.985 INFO:tasks.workunit.client.0.smithi087.stdout:6/589: unlink d4/f66 0 2024-05-08T05:32:08.986 INFO:tasks.workunit.client.0.smithi087.stdout:6/590: readlink d4/d8/df/d1e/d25/d28/d57/d6d/l89 0 2024-05-08T05:32:08.988 INFO:tasks.workunit.client.0.smithi087.stdout:6/591: mknod d4/d8/df/d1e/d25/d28/cb8 0 2024-05-08T05:32:08.989 INFO:tasks.workunit.client.0.smithi087.stdout:6/592: creat d4/d8/df/d1e/d52/fb9 x:0 0 0 2024-05-08T05:32:08.990 INFO:tasks.workunit.client.0.smithi087.stdout:5/592: rename da/dd/d13/d16 to da/db/d2a/d5a/d93/d36/dc1 0 2024-05-08T05:32:08.990 INFO:tasks.workunit.client.0.smithi087.stdout:5/593: write da/db/d2a/d5a/d93/d42/d43/d83/d6b/fb4 [137341,48619] 0 2024-05-08T05:32:08.991 INFO:tasks.workunit.client.0.smithi087.stdout:6/593: mkdir d4/d8/df/d39/d42/d9e/d6f/dba 0 2024-05-08T05:32:08.992 INFO:tasks.workunit.client.0.smithi087.stdout:9/568: rename d1/df/d14/d68/d80/d98/d28/d4b/c4d to d1/df/d14/d18/d66/cae 0 2024-05-08T05:32:08.992 INFO:tasks.workunit.client.0.smithi087.stdout:9/569: stat d1/df/d14/d68/d80 0 2024-05-08T05:32:08.992 INFO:tasks.workunit.client.0.smithi087.stdout:3/590: dread d4/f5 [0,4194304] 0 2024-05-08T05:32:08.994 INFO:tasks.workunit.client.0.smithi087.stdout:6/594: unlink d4/d8/df/d1e/d25/d28/f36 0 2024-05-08T05:32:08.994 INFO:tasks.workunit.client.0.smithi087.stdout:6/595: fsync d4/d8/df/d1e/f23 0 2024-05-08T05:32:08.995 INFO:tasks.workunit.client.0.smithi087.stdout:9/570: rename d1/df/d14/l92 to d1/df/d14/d18/d66/d7f/laf 0 2024-05-08T05:32:08.995 INFO:tasks.workunit.client.0.smithi087.stdout:9/571: truncate d1/df/d14/d18/d8e/da2/fad 957372 0 2024-05-08T05:32:08.996 INFO:tasks.workunit.client.0.smithi087.stdout:6/596: truncate d4/d8/df/d1e/d25/f3f 227855 0 2024-05-08T05:32:08.997 INFO:tasks.workunit.client.0.smithi087.stdout:9/572: mknod d1/df/d14/d68/cb0 0 2024-05-08T05:32:08.999 INFO:tasks.workunit.client.0.smithi087.stdout:6/597: link d4/d8/df/d1e/d25/d28/fa1 d4/d8/df/d39/d42/d9e/d6f/d84/fbb 0 2024-05-08T05:32:09.010 INFO:tasks.workunit.client.0.smithi087.stdout:6/598: dread d4/d8/df/d1e/d25/d28/d2d/d37/d5b/f93 [4194304,4194304] 0 2024-05-08T05:32:09.010 INFO:tasks.workunit.client.0.smithi087.stdout:6/599: fdatasync d4/d8/df/d1e/f9a 0 2024-05-08T05:32:09.010 INFO:tasks.workunit.client.0.smithi087.stdout:6/600: write d4/f97 [852373,71138] 0 2024-05-08T05:32:09.020 INFO:tasks.workunit.client.0.smithi087.stdout:6/601: dread d4/d8/df/d1e/d25/d28/d2d/d37/d45/f48 [0,4194304] 0 2024-05-08T05:32:09.022 INFO:tasks.workunit.client.0.smithi087.stdout:6/602: rename d4/d8/df/d1e/d25/l27 to d4/d8/df/d39/d42/d94/lbc 0 2024-05-08T05:32:09.023 INFO:tasks.workunit.client.0.smithi087.stdout:6/603: mkdir d4/d8/df/d39/d42/dbd 0 2024-05-08T05:32:09.023 INFO:tasks.workunit.client.0.smithi087.stdout:6/604: chown d4/d8/f3b 1759935 1 2024-05-08T05:32:09.023 INFO:tasks.workunit.client.0.smithi087.stdout:6/605: chown d4/d8/df/d1e/d52/fb9 460 1 2024-05-08T05:32:09.023 INFO:tasks.workunit.client.0.smithi087.stdout:6/606: readlink d4/d8/df/d1e/d52/l86 0 2024-05-08T05:32:09.024 INFO:tasks.workunit.client.0.smithi087.stdout:6/607: rename d4/d8/df/d1e/d25/d28/d57/l9d to d4/d8/df/d39/lbe 0 2024-05-08T05:32:09.025 INFO:tasks.workunit.client.0.smithi087.stdout:6/608: read d4/d8/df/d1e/d25/d28/d2d/d37/d5b/f5d [18711,44353] 0 2024-05-08T05:32:09.028 INFO:tasks.workunit.client.0.smithi087.stdout:8/571: dwrite db/d23/d15/f34 [0,4194304] 0 2024-05-08T05:32:09.030 INFO:tasks.workunit.client.0.smithi087.stdout:0/530: dread d0/da/d35/f58 [0,4194304] 0 2024-05-08T05:32:09.030 INFO:tasks.workunit.client.0.smithi087.stdout:0/531: mkdir d0/d22/d3c/dbb 0 2024-05-08T05:32:09.032 INFO:tasks.workunit.client.0.smithi087.stdout:0/532: unlink d0/d9/f10 0 2024-05-08T05:32:09.032 INFO:tasks.workunit.client.0.smithi087.stdout:0/533: stat d0/d22/d3c/cab 0 2024-05-08T05:32:09.032 INFO:tasks.workunit.client.0.smithi087.stdout:0/534: fsync d0/d9/f13 0 2024-05-08T05:32:09.033 INFO:tasks.workunit.client.0.smithi087.stdout:0/535: write d0/d9/d1b/d2f/d54/da1/f88 [604654,42708] 0 2024-05-08T05:32:09.033 INFO:tasks.workunit.client.0.smithi087.stdout:0/536: write d0/d57/f77 [949458,106162] 0 2024-05-08T05:32:09.034 INFO:tasks.workunit.client.0.smithi087.stdout:0/537: symlink d0/d22/d3c/dbb/lbc 0 2024-05-08T05:32:09.035 INFO:tasks.workunit.client.0.smithi087.stdout:0/538: creat d0/da/d35/fbd x:0 0 0 2024-05-08T05:32:09.052 INFO:tasks.workunit.client.0.smithi087.stdout:1/503: dwrite df/d18/d1d/d58/d72/f85 [0,4194304] 0 2024-05-08T05:32:09.055 INFO:tasks.workunit.client.0.smithi087.stdout:1/504: creat df/d2f/d57/d64/fac x:0 0 0 2024-05-08T05:32:09.057 INFO:tasks.workunit.client.0.smithi087.stdout:1/505: rename c4 to df/d18/d1d/d32/cad 0 2024-05-08T05:32:09.071 INFO:tasks.workunit.client.0.smithi087.stdout:9/573: dwrite d1/df/d37/f6d [0,4194304] 0 2024-05-08T05:32:09.088 INFO:tasks.workunit.client.0.smithi087.stdout:0/539: dwrite d0/d57/d24/d66/f6f [0,4194304] 0 2024-05-08T05:32:09.088 INFO:tasks.workunit.client.0.smithi087.stdout:6/609: dwrite d4/d8/f3b [0,4194304] 0 2024-05-08T05:32:09.088 INFO:tasks.workunit.client.0.smithi087.stdout:9/574: dread d1/df/d14/d68/d80/d98/d28/f2e [0,4194304] 0 2024-05-08T05:32:09.088 INFO:tasks.workunit.client.0.smithi087.stdout:9/575: truncate d1/df/d14/d68/f6b 867996 0 2024-05-08T05:32:09.094 INFO:tasks.workunit.client.0.smithi087.stdout:6/610: creat d4/d8/df/d1e/d25/d28/d57/d6d/fbf x:0 0 0 2024-05-08T05:32:09.094 INFO:tasks.workunit.client.0.smithi087.stdout:6/611: fsync d4/d8/df/d1e/d52/fb9 0 2024-05-08T05:32:09.096 INFO:tasks.workunit.client.0.smithi087.stdout:9/576: truncate d1/df/d14/d68/d80/d98/f1b 1328951 0 2024-05-08T05:32:09.100 INFO:tasks.workunit.client.0.smithi087.stdout:4/585: sync 2024-05-08T05:32:09.100 INFO:tasks.workunit.client.0.smithi087.stdout:4/586: dread - d4/d6c/faf zero size 2024-05-08T05:32:09.101 INFO:tasks.workunit.client.0.smithi087.stdout:4/587: creat d4/d13/d32/d8d/d91/db8/fe2 x:0 0 0 2024-05-08T05:32:09.101 INFO:tasks.workunit.client.0.smithi087.stdout:4/588: truncate d4/f8b 1041837 0 2024-05-08T05:32:09.103 INFO:tasks.workunit.client.0.smithi087.stdout:4/589: creat d4/d13/d32/d8d/d91/db8/dba/d96/fe3 x:0 0 0 2024-05-08T05:32:09.103 INFO:tasks.workunit.client.0.smithi087.stdout:4/590: chown d4/d13/d32/d8d/d91/db8/dba/fc2 14528878 1 2024-05-08T05:32:09.105 INFO:tasks.workunit.client.0.smithi087.stdout:0/540: write d0/da/f78 [2438058,102966] 0 2024-05-08T05:32:09.114 INFO:tasks.workunit.client.0.smithi087.stdout:0/541: dread d0/d9/d1b/d2f/d54/da1/f88 [0,4194304] 0 2024-05-08T05:32:09.117 INFO:tasks.workunit.client.0.smithi087.stdout:1/506: dwrite df/d18/f47 [0,4194304] 0 2024-05-08T05:32:09.118 INFO:tasks.workunit.client.0.smithi087.stdout:4/591: dread d4/f8b [0,4194304] 0 2024-05-08T05:32:09.120 INFO:tasks.workunit.client.0.smithi087.stdout:4/592: unlink d4/d13/f2e 0 2024-05-08T05:32:09.120 INFO:tasks.workunit.client.0.smithi087.stdout:4/593: dread - d4/d13/d3e/d28/fcf zero size 2024-05-08T05:32:09.120 INFO:tasks.workunit.client.0.smithi087.stdout:3/591: sync 2024-05-08T05:32:09.121 INFO:tasks.workunit.client.0.smithi087.stdout:7/667: sync 2024-05-08T05:32:09.121 INFO:tasks.workunit.client.0.smithi087.stdout:2/530: sync 2024-05-08T05:32:09.122 INFO:tasks.workunit.client.0.smithi087.stdout:2/531: fdatasync d7/de/f2b 0 2024-05-08T05:32:09.122 INFO:tasks.workunit.client.0.smithi087.stdout:8/572: sync 2024-05-08T05:32:09.122 INFO:tasks.workunit.client.0.smithi087.stdout:2/532: readlink d7/de/d2c/l88 0 2024-05-08T05:32:09.122 INFO:tasks.workunit.client.0.smithi087.stdout:8/573: read - db/d23/d1b/d4b/f91 zero size 2024-05-08T05:32:09.122 INFO:tasks.workunit.client.0.smithi087.stdout:8/574: chown db/d23/d15/d29/d33/d3b/d56/fab 1450502637 1 2024-05-08T05:32:09.122 INFO:tasks.workunit.client.0.smithi087.stdout:7/668: getdents d2/da/d3f/d72/d77/d54/d50 0 2024-05-08T05:32:09.122 INFO:tasks.workunit.client.0.smithi087.stdout:7/669: fsync d2/d6/da0/fd4 0 2024-05-08T05:32:09.123 INFO:tasks.workunit.client.0.smithi087.stdout:5/594: sync 2024-05-08T05:32:09.123 INFO:tasks.workunit.client.0.smithi087.stdout:5/595: dread - da/db/d2a/d46/dbb/fbe zero size 2024-05-08T05:32:09.123 INFO:tasks.workunit.client.0.smithi087.stdout:3/592: mkdir d4/d14/dbe/dd0 0 2024-05-08T05:32:09.123 INFO:tasks.workunit.client.0.smithi087.stdout:3/593: write d4/d14/d84/f88 [343717,35785] 0 2024-05-08T05:32:09.123 INFO:tasks.workunit.client.0.smithi087.stdout:2/533: mkdir d7/de/db1 0 2024-05-08T05:32:09.128 INFO:tasks.workunit.client.0.smithi087.stdout:7/670: unlink d2/d6/l99 0 2024-05-08T05:32:09.128 INFO:tasks.workunit.client.0.smithi087.stdout:0/542: dread d0/d9/d1b/fae [0,4194304] 0 2024-05-08T05:32:09.128 INFO:tasks.workunit.client.0.smithi087.stdout:5/596: mknod da/dd/d13/cc2 0 2024-05-08T05:32:09.128 INFO:tasks.workunit.client.0.smithi087.stdout:0/543: write d0/da/f97 [1038905,125214] 0 2024-05-08T05:32:09.128 INFO:tasks.workunit.client.0.smithi087.stdout:3/594: mkdir d4/d11/d24/d25/dd1 0 2024-05-08T05:32:09.128 INFO:tasks.workunit.client.0.smithi087.stdout:3/595: truncate d4/d11/d3d/f56 5362920 0 2024-05-08T05:32:09.129 INFO:tasks.workunit.client.0.smithi087.stdout:5/597: mkdir da/db/d2a/d5a/dc3 0 2024-05-08T05:32:09.131 INFO:tasks.workunit.client.0.smithi087.stdout:0/544: creat d0/d9/d1b/fbe x:0 0 0 2024-05-08T05:32:09.132 INFO:tasks.workunit.client.0.smithi087.stdout:5/598: creat da/db/d2a/d5a/d93/d36/d45/d5c/d86/fc4 x:0 0 0 2024-05-08T05:32:09.132 INFO:tasks.workunit.client.0.smithi087.stdout:5/599: stat da/db/d2a/d5a/d93/d17/c33 0 2024-05-08T05:32:09.132 INFO:tasks.workunit.client.0.smithi087.stdout:5/600: write da/db/d2a/d5a/d93/fb9 [1706164,126814] 0 2024-05-08T05:32:09.133 INFO:tasks.workunit.client.0.smithi087.stdout:5/601: truncate da/db/d2a/d5a/d93/d36/d45/f7e 1028017 0 2024-05-08T05:32:09.133 INFO:tasks.workunit.client.0.smithi087.stdout:5/602: readlink da/db/d2a/d5a/d93/d42/d43/d83/l75 0 2024-05-08T05:32:09.133 INFO:tasks.workunit.client.0.smithi087.stdout:5/603: readlink da/db/d2a/d5a/d93/d42/lba 0 2024-05-08T05:32:09.137 INFO:tasks.workunit.client.0.smithi087.stdout:0/545: getdents d0/d22/d3c 0 2024-05-08T05:32:09.137 INFO:tasks.workunit.client.0.smithi087.stdout:5/604: symlink da/dd/d13/da2/lc5 0 2024-05-08T05:32:09.137 INFO:tasks.workunit.client.0.smithi087.stdout:0/546: write d0/da/d35/fbd [121405,41147] 0 2024-05-08T05:32:09.139 INFO:tasks.workunit.client.0.smithi087.stdout:5/605: mkdir da/db/d2a/d46/dc6 0 2024-05-08T05:32:09.139 INFO:tasks.workunit.client.0.smithi087.stdout:0/547: rmdir d0/d57/d24 39 2024-05-08T05:32:09.146 INFO:tasks.workunit.client.0.smithi087.stdout:5/606: unlink da/db/d2a/d5a/d93/fb9 0 2024-05-08T05:32:09.146 INFO:tasks.workunit.client.0.smithi087.stdout:7/671: write d2/da/f86 [174431,87530] 0 2024-05-08T05:32:09.148 INFO:tasks.workunit.client.0.smithi087.stdout:5/607: creat da/db/d2a/d5a/d93/d42/fc7 x:0 0 0 2024-05-08T05:32:09.152 INFO:tasks.workunit.client.0.smithi087.stdout:6/612: dwrite d4/d8/df/d39/d42/d9e/d6f/f8d [4194304,4194304] 0 2024-05-08T05:32:09.152 INFO:tasks.workunit.client.0.smithi087.stdout:6/613: readlink d4/d8/df/d39/d42/lb3 0 2024-05-08T05:32:09.152 INFO:tasks.workunit.client.0.smithi087.stdout:3/596: write d4/d11/d24/d25/d3e/fb9 [178286,114526] 0 2024-05-08T05:32:09.152 INFO:tasks.workunit.client.0.smithi087.stdout:3/597: dread - d4/d14/d84/d8b/d8f/fc4 zero size 2024-05-08T05:32:09.156 INFO:tasks.workunit.client.0.smithi087.stdout:7/672: read d2/da/f4c [822114,60266] 0 2024-05-08T05:32:09.156 INFO:tasks.workunit.client.0.smithi087.stdout:6/614: rmdir d4/d8/df/d1e/d25/d28/d2d/d37 39 2024-05-08T05:32:09.157 INFO:tasks.workunit.client.0.smithi087.stdout:6/615: chown d4/d8/df/l29 9397 1 2024-05-08T05:32:09.162 INFO:tasks.workunit.client.0.smithi087.stdout:5/608: getdents da/db/d2a/d5a/d93/d42 0 2024-05-08T05:32:09.165 INFO:tasks.workunit.client.0.smithi087.stdout:5/609: unlink da/db/d2a/d5a/d93/d17/f82 0 2024-05-08T05:32:09.165 INFO:tasks.workunit.client.0.smithi087.stdout:5/610: truncate da/db/d2a/d5a/d93/d42/d43/d83/d6b/fb4 1081509 0 2024-05-08T05:32:09.166 INFO:tasks.workunit.client.0.smithi087.stdout:5/611: write da/db/d2a/f77 [2212276,130639] 0 2024-05-08T05:32:09.167 INFO:tasks.workunit.client.0.smithi087.stdout:5/612: mknod da/db/d2a/d46/dbb/cc8 0 2024-05-08T05:32:09.168 INFO:tasks.workunit.client.0.smithi087.stdout:5/613: mknod da/db/d2a/d5a/d93/d36/dc1/cc9 0 2024-05-08T05:32:09.169 INFO:tasks.workunit.client.0.smithi087.stdout:5/614: mknod da/db/d2a/d5a/d93/d36/d45/d5c/d89/cca 0 2024-05-08T05:32:09.170 INFO:tasks.workunit.client.0.smithi087.stdout:5/615: creat da/dd/d65/daa/fcb x:0 0 0 2024-05-08T05:32:09.170 INFO:tasks.workunit.client.0.smithi087.stdout:5/616: chown da/dd/d65/daa/fcb 168 1 2024-05-08T05:32:09.171 INFO:tasks.workunit.client.0.smithi087.stdout:4/594: dwrite d4/d13/d3e/f88 [0,4194304] 0 2024-05-08T05:32:09.174 INFO:tasks.workunit.client.0.smithi087.stdout:5/617: creat da/dd/d65/fcc x:0 0 0 2024-05-08T05:32:09.174 INFO:tasks.workunit.client.0.smithi087.stdout:1/507: dwrite df/d2f/f3c [0,4194304] 0 2024-05-08T05:32:09.174 INFO:tasks.workunit.client.0.smithi087.stdout:7/673: write d2/da/fcc [2767212,29420] 0 2024-05-08T05:32:09.175 INFO:tasks.workunit.client.0.smithi087.stdout:7/674: write d2/d6/d12/d1d/fc6 [434485,64616] 0 2024-05-08T05:32:09.177 INFO:tasks.workunit.client.0.smithi087.stdout:5/618: symlink da/db/d2a/d5a/d93/d17/d99/lcd 0 2024-05-08T05:32:09.179 INFO:tasks.workunit.client.0.smithi087.stdout:1/508: rename df/d18/d1d/d27/l9d to df/d2f/d57/da0/lae 0 2024-05-08T05:32:09.180 INFO:tasks.workunit.client.0.smithi087.stdout:5/619: read da/db/d2a/d5a/f5b [382673,63801] 0 2024-05-08T05:32:09.180 INFO:tasks.workunit.client.0.smithi087.stdout:7/675: creat d2/d6/da0/d67/d82/fd5 x:0 0 0 2024-05-08T05:32:09.182 INFO:tasks.workunit.client.0.smithi087.stdout:1/509: link df/d18/d8b/c98 df/d18/caf 0 2024-05-08T05:32:09.184 INFO:tasks.workunit.client.0.smithi087.stdout:7/676: creat d2/da/d3f/d49/fd6 x:0 0 0 2024-05-08T05:32:09.186 INFO:tasks.workunit.client.0.smithi087.stdout:1/510: creat df/d18/d1d/fb0 x:0 0 0 2024-05-08T05:32:09.187 INFO:tasks.workunit.client.0.smithi087.stdout:7/677: creat d2/da/d3f/d72/d77/d54/d55/d65/fd7 x:0 0 0 2024-05-08T05:32:09.188 INFO:tasks.workunit.client.0.smithi087.stdout:1/511: symlink df/d2f/d57/d64/d83/d96/lb1 0 2024-05-08T05:32:09.188 INFO:tasks.workunit.client.0.smithi087.stdout:1/512: chown df/d2f/d57/da0 15533 1 2024-05-08T05:32:09.190 INFO:tasks.workunit.client.0.smithi087.stdout:1/513: creat df/d18/d1d/d27/d61/fb2 x:0 0 0 2024-05-08T05:32:09.192 INFO:tasks.workunit.client.0.smithi087.stdout:1/514: unlink df/l26 0 2024-05-08T05:32:09.192 INFO:tasks.workunit.client.0.smithi087.stdout:1/515: chown df/f5c 1928 1 2024-05-08T05:32:09.197 INFO:tasks.workunit.client.0.smithi087.stdout:4/595: read d4/d13/d32/d8d/d91/f7c [99354,63757] 0 2024-05-08T05:32:09.197 INFO:tasks.workunit.client.0.smithi087.stdout:6/616: dwrite d4/d8/fb6 [0,4194304] 0 2024-05-08T05:32:09.198 INFO:tasks.workunit.client.0.smithi087.stdout:2/534: dwrite d7/fd [0,4194304] 0 2024-05-08T05:32:09.200 INFO:tasks.workunit.client.0.smithi087.stdout:6/617: creat d4/d8/df/d39/d42/d94/db5/fc0 x:0 0 0 2024-05-08T05:32:09.200 INFO:tasks.workunit.client.0.smithi087.stdout:6/618: fsync d4/d8/f3c 0 2024-05-08T05:32:09.200 INFO:tasks.workunit.client.0.smithi087.stdout:6/619: write d4/d8/df/d1e/d25/f2f [5068617,113642] 0 2024-05-08T05:32:09.201 INFO:tasks.workunit.client.0.smithi087.stdout:4/596: symlink d4/d13/d32/d8d/d91/db8/dba/d96/le4 0 2024-05-08T05:32:09.204 INFO:tasks.workunit.client.0.smithi087.stdout:7/678: write d2/d6/d12/d19/fb4 [1702399,16652] 0 2024-05-08T05:32:09.204 INFO:tasks.workunit.client.0.smithi087.stdout:2/535: symlink d7/de/d78/d9c/lb2 0 2024-05-08T05:32:09.204 INFO:tasks.workunit.client.0.smithi087.stdout:6/620: creat d4/d8/df/d39/d42/dbd/fc1 x:0 0 0 2024-05-08T05:32:09.204 INFO:tasks.workunit.client.0.smithi087.stdout:2/536: write d7/de/d27/f44 [583743,75176] 0 2024-05-08T05:32:09.204 INFO:tasks.workunit.client.0.smithi087.stdout:2/537: write d7/f5b [312872,30978] 0 2024-05-08T05:32:09.217 INFO:tasks.workunit.client.0.smithi087.stdout:1/516: read df/d18/f47 [894313,124252] 0 2024-05-08T05:32:09.219 INFO:tasks.workunit.client.0.smithi087.stdout:7/679: dread d2/da/d3f/d72/d77/f5a [0,4194304] 0 2024-05-08T05:32:09.221 INFO:tasks.workunit.client.0.smithi087.stdout:7/680: creat d2/d6/d12/d19/fd8 x:0 0 0 2024-05-08T05:32:09.228 INFO:tasks.workunit.client.0.smithi087.stdout:6/621: dread d4/d8/df/d1e/f23 [0,4194304] 0 2024-05-08T05:32:09.228 INFO:tasks.workunit.client.0.smithi087.stdout:7/681: mkdir d2/da/d3f/d72/d77/d54/dd9 0 2024-05-08T05:32:09.228 INFO:tasks.workunit.client.0.smithi087.stdout:6/622: write d4/d8/df/d1e/d25/d28/f74 [1333379,39375] 0 2024-05-08T05:32:09.228 INFO:tasks.workunit.client.0.smithi087.stdout:6/623: chown d4/d8/df/d39/lbe 322 1 2024-05-08T05:32:09.229 INFO:tasks.workunit.client.0.smithi087.stdout:2/538: dread d7/f17 [0,4194304] 0 2024-05-08T05:32:09.229 INFO:tasks.workunit.client.0.smithi087.stdout:4/597: dread d4/d13/f3f [0,4194304] 0 2024-05-08T05:32:09.229 INFO:tasks.workunit.client.0.smithi087.stdout:4/598: fdatasync d4/d13/d32/ddb/f82 0 2024-05-08T05:32:09.231 INFO:tasks.workunit.client.0.smithi087.stdout:2/539: unlink d7/de/d2c/c70 0 2024-05-08T05:32:09.232 INFO:tasks.workunit.client.0.smithi087.stdout:4/599: link d4/d13/f16 d4/d13/d32/d8d/d91/fe5 0 2024-05-08T05:32:09.232 INFO:tasks.workunit.client.0.smithi087.stdout:4/600: write d4/d13/d3e/d28/d50/d9d/fd8 [5135500,17159] 0 2024-05-08T05:32:09.233 INFO:tasks.workunit.client.0.smithi087.stdout:4/601: stat d4 0 2024-05-08T05:32:09.233 INFO:tasks.workunit.client.0.smithi087.stdout:4/602: readlink d4/d13/d65/l59 0 2024-05-08T05:32:09.233 INFO:tasks.workunit.client.0.smithi087.stdout:4/603: truncate d4/d13/d32/ddb/f6d 1621369 0 2024-05-08T05:32:09.234 INFO:tasks.workunit.client.0.smithi087.stdout:2/540: creat d7/de/d5d/d7b/fb3 x:0 0 0 2024-05-08T05:32:09.234 INFO:tasks.workunit.client.0.smithi087.stdout:2/541: mkdir d7/de/d2c/d43/db4 0 2024-05-08T05:32:09.236 INFO:tasks.workunit.client.0.smithi087.stdout:2/542: rename d7/de/d27/d33/d65/c68 to d7/de/d2c/d43/cb5 0 2024-05-08T05:32:09.236 INFO:tasks.workunit.client.0.smithi087.stdout:4/604: write d4/d13/f3f [148326,37960] 0 2024-05-08T05:32:09.237 INFO:tasks.workunit.client.0.smithi087.stdout:2/543: mkdir d7/de/d2c/db6 0 2024-05-08T05:32:09.237 INFO:tasks.workunit.client.0.smithi087.stdout:2/544: chown d7/de/d82/ca1 225308 1 2024-05-08T05:32:09.237 INFO:tasks.workunit.client.0.smithi087.stdout:2/545: chown d7/de/d5d 616464470 1 2024-05-08T05:32:09.238 INFO:tasks.workunit.client.0.smithi087.stdout:2/546: mkdir d7/de/d78/d9c/db7 0 2024-05-08T05:32:09.239 INFO:tasks.workunit.client.0.smithi087.stdout:4/605: getdents d4/d13/d32/d8d/d91/db8/dba/d63 0 2024-05-08T05:32:09.241 INFO:tasks.workunit.client.0.smithi087.stdout:7/682: write d2/da/f11 [1737988,29874] 0 2024-05-08T05:32:09.242 INFO:tasks.workunit.client.0.smithi087.stdout:2/547: mkdir d7/de/d5d/db8 0 2024-05-08T05:32:09.244 INFO:tasks.workunit.client.0.smithi087.stdout:7/683: creat d2/d6/da0/d67/d82/d98/fda x:0 0 0 2024-05-08T05:32:09.245 INFO:tasks.workunit.client.0.smithi087.stdout:2/548: mkdir d7/de/d27/d33/d49/db9 0 2024-05-08T05:32:09.245 INFO:tasks.workunit.client.0.smithi087.stdout:2/549: chown d7/de/d27/d33/f76 25346569 1 2024-05-08T05:32:09.246 INFO:tasks.workunit.client.0.smithi087.stdout:2/550: truncate f5 4582706 0 2024-05-08T05:32:09.247 INFO:tasks.workunit.client.0.smithi087.stdout:2/551: write d7/de/d27/d33/d49/f84 [27821,106280] 0 2024-05-08T05:32:09.247 INFO:tasks.workunit.client.0.smithi087.stdout:2/552: chown d7/de/d27/d33/d65/c87 1850 1 2024-05-08T05:32:09.252 INFO:tasks.workunit.client.0.smithi087.stdout:3/598: dwrite d4/d11/d3d/f51 [0,4194304] 0 2024-05-08T05:32:09.272 INFO:tasks.workunit.client.0.smithi087.stdout:3/599: creat d4/d11/d3d/d4e/d6a/fd2 x:0 0 0 2024-05-08T05:32:09.272 INFO:tasks.workunit.client.0.smithi087.stdout:3/600: rmdir d4/d14/dbe 39 2024-05-08T05:32:09.274 INFO:tasks.workunit.client.0.smithi087.stdout:3/601: rename d4/d11/d24/d39/l55 to d4/d11/d24/d39/d60/ld3 0 2024-05-08T05:32:09.275 INFO:tasks.workunit.client.0.smithi087.stdout:9/577: sync 2024-05-08T05:32:09.280 INFO:tasks.workunit.client.0.smithi087.stdout:9/578: rmdir d1/df/d14/d54 39 2024-05-08T05:32:09.290 INFO:tasks.workunit.client.0.smithi087.stdout:7/684: dwrite d2/d6/d12/d15/fa2 [0,4194304] 0 2024-05-08T05:32:09.292 INFO:tasks.workunit.client.0.smithi087.stdout:6/624: dwrite d4/d6/f69 [0,4194304] 0 2024-05-08T05:32:09.292 INFO:tasks.workunit.client.0.smithi087.stdout:6/625: chown d4/d8/df/d1e/d52/l86 6 1 2024-05-08T05:32:09.293 INFO:tasks.workunit.client.0.smithi087.stdout:7/685: symlink d2/d6/d12/d15/d5b/ldb 0 2024-05-08T05:32:09.294 INFO:tasks.workunit.client.0.smithi087.stdout:5/620: dwrite da/db/d2a/d5a/d93/f60 [0,4194304] 0 2024-05-08T05:32:09.294 INFO:tasks.workunit.client.0.smithi087.stdout:5/621: truncate da/db/d2a/f32 5167076 0 2024-05-08T05:32:09.294 INFO:tasks.workunit.client.0.smithi087.stdout:9/579: dread d1/df/f12 [0,4194304] 0 2024-05-08T05:32:09.294 INFO:tasks.workunit.client.0.smithi087.stdout:5/622: write da/db/d2a/d5a/d93/d17/f2b [424931,108873] 0 2024-05-08T05:32:09.298 INFO:tasks.workunit.client.0.smithi087.stdout:6/626: rename d4/d8/df/d1e/d25/d28/f91 to d4/d8/df/d1e/d25/d28/fc2 0 2024-05-08T05:32:09.298 INFO:tasks.workunit.client.0.smithi087.stdout:6/627: read - d4/d8/df/d1e/f96 zero size 2024-05-08T05:32:09.298 INFO:tasks.workunit.client.0.smithi087.stdout:6/628: read - d4/d8/df/d1e/f96 zero size 2024-05-08T05:32:09.298 INFO:tasks.workunit.client.0.smithi087.stdout:3/602: write d4/d11/d3d/f47 [3340532,127450] 0 2024-05-08T05:32:09.305 INFO:tasks.workunit.client.0.smithi087.stdout:9/580: mkdir d1/df/d14/db1 0 2024-05-08T05:32:09.306 INFO:tasks.workunit.client.0.smithi087.stdout:5/623: mkdir da/dd/d13/da2/dce 0 2024-05-08T05:32:09.306 INFO:tasks.workunit.client.0.smithi087.stdout:6/629: mknod d4/d8/df/d1e/cc3 0 2024-05-08T05:32:09.306 INFO:tasks.workunit.client.0.smithi087.stdout:7/686: write d2/d6/da0/f95 [2863564,122452] 0 2024-05-08T05:32:09.306 INFO:tasks.workunit.client.0.smithi087.stdout:3/603: stat d4/l37 0 2024-05-08T05:32:09.306 INFO:tasks.workunit.client.0.smithi087.stdout:3/604: write d4/d11/d24/d25/d4d/f83 [278106,41386] 0 2024-05-08T05:32:09.306 INFO:tasks.workunit.client.0.smithi087.stdout:3/605: chown d4/d11/d24/d25/d99 0 1 2024-05-08T05:32:09.307 INFO:tasks.workunit.client.0.smithi087.stdout:5/624: creat da/db/d2a/d5a/d93/d36/d45/d5c/fcf x:0 0 0 2024-05-08T05:32:09.308 INFO:tasks.workunit.client.0.smithi087.stdout:7/687: symlink d2/d6/d12/d19/d2a/d89/da3/ldc 0 2024-05-08T05:32:09.309 INFO:tasks.workunit.client.0.smithi087.stdout:6/630: symlink d4/d8/df/d39/d42/d9e/d6f/dba/lc4 0 2024-05-08T05:32:09.309 INFO:tasks.workunit.client.0.smithi087.stdout:5/625: mkdir da/db/d2a/d5a/d93/d42/d50/dd0 0 2024-05-08T05:32:09.310 INFO:tasks.workunit.client.0.smithi087.stdout:7/688: mknod d2/da/d3f/d66/cdd 0 2024-05-08T05:32:09.311 INFO:tasks.workunit.client.0.smithi087.stdout:6/631: creat d4/d8/df/d1e/d25/fc5 x:0 0 0 2024-05-08T05:32:09.311 INFO:tasks.workunit.client.0.smithi087.stdout:5/626: getdents da/db/d2a/d5a/d93/d36/d45/d5c/d89 0 2024-05-08T05:32:09.312 INFO:tasks.workunit.client.0.smithi087.stdout:5/627: write da/db/d2a/d5a/d93/d42/d43/d83/fc0 [826207,77480] 0 2024-05-08T05:32:09.312 INFO:tasks.workunit.client.0.smithi087.stdout:7/689: creat d2/da/d3f/d72/d77/d54/fde x:0 0 0 2024-05-08T05:32:09.312 INFO:tasks.workunit.client.0.smithi087.stdout:7/690: fsync d2/d6/d12/f97 0 2024-05-08T05:32:09.314 INFO:tasks.workunit.client.0.smithi087.stdout:5/628: symlink da/db/ld1 0 2024-05-08T05:32:09.315 INFO:tasks.workunit.client.0.smithi087.stdout:7/691: link d2/d6/d12/d19/d2a/l38 d2/da/d3f/d66/ldf 0 2024-05-08T05:32:09.315 INFO:tasks.workunit.client.0.smithi087.stdout:7/692: readlink d2/d6/l81 0 2024-05-08T05:32:09.316 INFO:tasks.workunit.client.0.smithi087.stdout:6/632: mknod d4/d8/df/d39/d42/d9e/d6f/cc6 0 2024-05-08T05:32:09.316 INFO:tasks.workunit.client.0.smithi087.stdout:6/633: chown d4/d8/df/d1e/d25/d28/d57/d6d 2 1 2024-05-08T05:32:09.316 INFO:tasks.workunit.client.0.smithi087.stdout:6/634: fsync d4/d8/df/d1e/f9a 0 2024-05-08T05:32:09.316 INFO:tasks.workunit.client.0.smithi087.stdout:6/635: write d4/d8/df/d39/d42/d94/db5/fc0 [32207,33043] 0 2024-05-08T05:32:09.318 INFO:tasks.workunit.client.0.smithi087.stdout:5/629: rmdir da/db 39 2024-05-08T05:32:09.319 INFO:tasks.workunit.client.0.smithi087.stdout:6/636: symlink d4/d8/df/d39/d42/d94/lc7 0 2024-05-08T05:32:09.319 INFO:tasks.workunit.client.0.smithi087.stdout:6/637: dread - d4/d8/df/d1e/d25/d28/d2d/d37/d5b/f5f zero size 2024-05-08T05:32:09.319 INFO:tasks.workunit.client.0.smithi087.stdout:1/517: dwrite df/d18/d1d/fb0 [0,4194304] 0 2024-05-08T05:32:09.320 INFO:tasks.workunit.client.0.smithi087.stdout:6/638: truncate d4/d8/df/d1e/d25/d28/d2d/d37/d45/f48 4116046 0 2024-05-08T05:32:09.323 INFO:tasks.workunit.client.0.smithi087.stdout:1/518: symlink df/d2f/d57/d64/lb3 0 2024-05-08T05:32:09.323 INFO:tasks.workunit.client.0.smithi087.stdout:1/519: chown df/d2f/d4f/f55 1457 1 2024-05-08T05:32:09.323 INFO:tasks.workunit.client.0.smithi087.stdout:1/520: write df/f4d [1064704,16369] 0 2024-05-08T05:32:09.331 INFO:tasks.workunit.client.0.smithi087.stdout:1/521: creat df/d2f/fb4 x:0 0 0 2024-05-08T05:32:09.331 INFO:tasks.workunit.client.0.smithi087.stdout:1/522: fdatasync df/d18/d1d/d58/d72/f5f 0 2024-05-08T05:32:09.351 INFO:tasks.workunit.client.0.smithi087.stdout:2/553: dwrite f6 [4194304,4194304] 0 2024-05-08T05:32:09.352 INFO:tasks.workunit.client.0.smithi087.stdout:2/554: write d7/d63/f74 [782282,10672] 0 2024-05-08T05:32:09.353 INFO:tasks.workunit.client.0.smithi087.stdout:3/606: dwrite d4/d11/d24/d39/d5a/f6b [0,4194304] 0 2024-05-08T05:32:09.353 INFO:tasks.workunit.client.0.smithi087.stdout:5/630: fdatasync da/db/d2a/d5a/d93/d17/f2b 0 2024-05-08T05:32:09.353 INFO:tasks.workunit.client.0.smithi087.stdout:5/631: readlink da/dd/d13/da2/lc5 0 2024-05-08T05:32:09.353 INFO:tasks.workunit.client.0.smithi087.stdout:2/555: creat d7/de/d2c/db0/fba x:0 0 0 2024-05-08T05:32:09.355 INFO:tasks.workunit.client.0.smithi087.stdout:3/607: creat d4/d11/d24/d25/d3e/d58/fd4 x:0 0 0 2024-05-08T05:32:09.357 INFO:tasks.workunit.client.0.smithi087.stdout:5/632: rename da/db/d2a/d5a/d93/d36/d45/f7e to da/db/d2a/d5a/d93/d36/d45/d5c/fd2 0 2024-05-08T05:32:09.357 INFO:tasks.workunit.client.0.smithi087.stdout:5/633: chown da/db/f8f 0 1 2024-05-08T05:32:09.359 INFO:tasks.workunit.client.0.smithi087.stdout:2/556: creat d7/de/d27/fbb x:0 0 0 2024-05-08T05:32:09.361 INFO:tasks.workunit.client.0.smithi087.stdout:3/608: rmdir d4/d11/d24/d25/dd1 0 2024-05-08T05:32:09.362 INFO:tasks.workunit.client.0.smithi087.stdout:5/634: truncate da/f66 1666065 0 2024-05-08T05:32:09.363 INFO:tasks.workunit.client.0.smithi087.stdout:2/557: mknod d7/de/d78/d9c/db7/cbc 0 2024-05-08T05:32:09.365 INFO:tasks.workunit.client.0.smithi087.stdout:3/609: unlink d4/d11/d24/d25/d3e/d58/d9b/fb6 0 2024-05-08T05:32:09.367 INFO:tasks.workunit.client.0.smithi087.stdout:5/635: mkdir da/db/dd3 0 2024-05-08T05:32:09.368 INFO:tasks.workunit.client.0.smithi087.stdout:2/558: link d7/de/d27/d33/d49/f9d d7/de/d27/d33/d49/fbd 0 2024-05-08T05:32:09.369 INFO:tasks.workunit.client.0.smithi087.stdout:3/610: symlink d4/d11/d24/d25/d3e/ld5 0 2024-05-08T05:32:09.371 INFO:tasks.workunit.client.0.smithi087.stdout:5/636: symlink da/dd/d65/daa/ld4 0 2024-05-08T05:32:09.371 INFO:tasks.workunit.client.0.smithi087.stdout:5/637: chown da/dd/d65/daa 0 1 2024-05-08T05:32:09.374 INFO:tasks.workunit.client.0.smithi087.stdout:1/523: write df/d2f/d57/d64/f29 [4895383,118133] 0 2024-05-08T05:32:09.377 INFO:tasks.workunit.client.0.smithi087.stdout:9/581: dwrite d1/df/d37/f51 [0,4194304] 0 2024-05-08T05:32:09.377 INFO:tasks.workunit.client.0.smithi087.stdout:9/582: truncate d1/df/d37/d5b/f69 681500 0 2024-05-08T05:32:09.377 INFO:tasks.workunit.client.0.smithi087.stdout:1/524: unlink df/d2f/d57/d64/d83/d96/f9b 0 2024-05-08T05:32:09.379 INFO:tasks.workunit.client.0.smithi087.stdout:9/583: creat d1/df/d14/d68/d80/d98/d83/fb2 x:0 0 0 2024-05-08T05:32:09.387 INFO:tasks.workunit.client.0.smithi087.stdout:7/693: dwrite d2/d6/da0/fd4 [0,4194304] 0 2024-05-08T05:32:09.387 INFO:tasks.workunit.client.0.smithi087.stdout:7/694: fdatasync d2/d6/d12/d19/f1e 0 2024-05-08T05:32:09.391 INFO:tasks.workunit.client.0.smithi087.stdout:1/525: unlink df/d2f/d57/d64/f45 0 2024-05-08T05:32:09.391 INFO:tasks.workunit.client.0.smithi087.stdout:9/584: creat d1/df/d14/d54/d61/d72/fb3 x:0 0 0 2024-05-08T05:32:09.391 INFO:tasks.workunit.client.0.smithi087.stdout:9/585: getdents d1/df/d14/d18/d9a 0 2024-05-08T05:32:09.393 INFO:tasks.workunit.client.0.smithi087.stdout:6/639: dwrite d4/d8/df/d1e/d25/d28/d57/d6d/f82 [0,4194304] 0 2024-05-08T05:32:09.394 INFO:tasks.workunit.client.0.smithi087.stdout:7/695: unlink d2/d6/da0/f95 0 2024-05-08T05:32:09.398 INFO:tasks.workunit.client.0.smithi087.stdout:1/526: symlink df/d18/d1d/d58/lb5 0 2024-05-08T05:32:09.401 INFO:tasks.workunit.client.0.smithi087.stdout:9/586: mknod d1/df/d14/d68/d80/d98/cb4 0 2024-05-08T05:32:09.401 INFO:tasks.workunit.client.0.smithi087.stdout:9/587: chown d1/df/d14/d68/d80/d98/l20 716286 1 2024-05-08T05:32:09.401 INFO:tasks.workunit.client.0.smithi087.stdout:6/640: dread d4/d8/df/d39/d42/f6e [0,4194304] 0 2024-05-08T05:32:09.411 INFO:tasks.workunit.client.0.smithi087.stdout:7/696: mknod d2/ce0 0 2024-05-08T05:32:09.413 INFO:tasks.workunit.client.0.smithi087.stdout:7/697: creat d2/d6/d12/dc5/fe1 x:0 0 0 2024-05-08T05:32:09.413 INFO:tasks.workunit.client.0.smithi087.stdout:7/698: write d2/d6/fd3 [389496,3724] 0 2024-05-08T05:32:09.415 INFO:tasks.workunit.client.0.smithi087.stdout:7/699: rmdir d2/da/d3f/d49/d59/d8e 0 2024-05-08T05:32:09.416 INFO:tasks.workunit.client.0.smithi087.stdout:7/700: creat d2/da/d3f/d49/daf/fe2 x:0 0 0 2024-05-08T05:32:09.417 INFO:tasks.workunit.client.0.smithi087.stdout:7/701: creat d2/da/d3f/d72/d77/d54/d55/d65/dc3/fe3 x:0 0 0 2024-05-08T05:32:09.418 INFO:tasks.workunit.client.0.smithi087.stdout:7/702: write d2/da/d3f/d72/d77/d54/d55/f96 [282237,57090] 0 2024-05-08T05:32:09.419 INFO:tasks.workunit.client.0.smithi087.stdout:7/703: unlink d2/d6/d12/d1d/f3a 0 2024-05-08T05:32:09.419 INFO:tasks.workunit.client.0.smithi087.stdout:7/704: chown d2/da/d3f/ca5 3499099 1 2024-05-08T05:32:09.423 INFO:tasks.workunit.client.0.smithi087.stdout:5/638: dwrite da/db/d2a/d5a/d93/d17/f28 [4194304,4194304] 0 2024-05-08T05:32:09.423 INFO:tasks.workunit.client.0.smithi087.stdout:5/639: fdatasync da/dd/d65/fcc 0 2024-05-08T05:32:09.424 INFO:tasks.workunit.client.0.smithi087.stdout:4/606: sync 2024-05-08T05:32:09.424 INFO:tasks.workunit.client.0.smithi087.stdout:8/575: sync 2024-05-08T05:32:09.424 INFO:tasks.workunit.client.0.smithi087.stdout:0/548: sync 2024-05-08T05:32:09.425 INFO:tasks.workunit.client.0.smithi087.stdout:0/549: truncate d0/da/d11/f43 4085839 0 2024-05-08T05:32:09.430 INFO:tasks.workunit.client.0.smithi087.stdout:8/576: link db/d23/d15/d29/d33/d3b/c9f db/d23/d15/d29/d33/d6c/dbe/cc4 0 2024-05-08T05:32:09.431 INFO:tasks.workunit.client.0.smithi087.stdout:8/577: mkdir db/d23/d3a/d65/d83/dc5 0 2024-05-08T05:32:09.432 INFO:tasks.workunit.client.0.smithi087.stdout:8/578: chown db/cbf 1124676 1 2024-05-08T05:32:09.433 INFO:tasks.workunit.client.0.smithi087.stdout:4/607: dread d4/d13/f3f [0,4194304] 0 2024-05-08T05:32:09.440 INFO:tasks.workunit.client.0.smithi087.stdout:2/559: dwrite d7/de/f15 [4194304,4194304] 0 2024-05-08T05:32:09.448 INFO:tasks.workunit.client.0.smithi087.stdout:2/560: mkdir d7/de/db1/dbe 0 2024-05-08T05:32:09.448 INFO:tasks.workunit.client.0.smithi087.stdout:4/608: write d4/d13/d32/ddb/fa0 [275091,72841] 0 2024-05-08T05:32:09.448 INFO:tasks.workunit.client.0.smithi087.stdout:4/609: truncate d4/d13/d32/d8d/d91/db8/dba/d96/fe3 360788 0 2024-05-08T05:32:09.448 INFO:tasks.workunit.client.0.smithi087.stdout:4/610: fdatasync d4/d13/d3e/d28/fde 0 2024-05-08T05:32:09.449 INFO:tasks.workunit.client.0.smithi087.stdout:7/705: dread d2/d6/d12/d15/f5c [0,4194304] 0 2024-05-08T05:32:09.449 INFO:tasks.workunit.client.0.smithi087.stdout:4/611: write d4/d13/d65/f6f [183802,101867] 0 2024-05-08T05:32:09.450 INFO:tasks.workunit.client.0.smithi087.stdout:7/706: write d2/da/d3f/d72/d77/d54/d55/f7e [2666215,123658] 0 2024-05-08T05:32:09.460 INFO:tasks.workunit.client.0.smithi087.stdout:7/707: dread d2/da/f11 [4194304,4194304] 0 2024-05-08T05:32:09.460 INFO:tasks.workunit.client.0.smithi087.stdout:4/612: dread d4/d13/d3e/d28/fde [0,4194304] 0 2024-05-08T05:32:09.462 INFO:tasks.workunit.client.0.smithi087.stdout:7/708: write d2/da/fad [425343,85812] 0 2024-05-08T05:32:09.462 INFO:tasks.workunit.client.0.smithi087.stdout:7/709: chown d2/da/d3f/d66/ca7 89787 1 2024-05-08T05:32:09.462 INFO:tasks.workunit.client.0.smithi087.stdout:7/710: readlink d2/d6/d12/d15/d5b/lb8 0 2024-05-08T05:32:09.463 INFO:tasks.workunit.client.0.smithi087.stdout:4/613: rmdir d4/d13/d32/d8d/d91/db8/dba/dbd 39 2024-05-08T05:32:09.464 INFO:tasks.workunit.client.0.smithi087.stdout:7/711: getdents d2/d6/d12/d1d 0 2024-05-08T05:32:09.464 INFO:tasks.workunit.client.0.smithi087.stdout:7/712: chown d2/d6/d12/d1d/fa4 0 1 2024-05-08T05:32:09.465 INFO:tasks.workunit.client.0.smithi087.stdout:7/713: creat d2/da/d3f/d49/d59/fe4 x:0 0 0 2024-05-08T05:32:09.467 INFO:tasks.workunit.client.0.smithi087.stdout:6/641: dwrite d4/d8/df/d39/d42/d9e/d6f/f8d [4194304,4194304] 0 2024-05-08T05:32:09.470 INFO:tasks.workunit.client.0.smithi087.stdout:1/527: dwrite df/d18/d1d/d27/f6d [0,4194304] 0 2024-05-08T05:32:09.471 INFO:tasks.workunit.client.0.smithi087.stdout:1/528: fdatasync df/d18/d1d/d27/d61/fb2 0 2024-05-08T05:32:09.471 INFO:tasks.workunit.client.0.smithi087.stdout:6/642: mknod d4/d8/df/d39/d42/d9e/d6f/d7f/cc8 0 2024-05-08T05:32:09.473 INFO:tasks.workunit.client.0.smithi087.stdout:1/529: symlink df/d2f/d4f/d52/lb6 0 2024-05-08T05:32:09.476 INFO:tasks.workunit.client.0.smithi087.stdout:1/530: link df/c2c df/d18/d1d/d58/d72/cb7 0 2024-05-08T05:32:09.480 INFO:tasks.workunit.client.0.smithi087.stdout:9/588: dwrite d1/df/d14/d18/f23 [0,4194304] 0 2024-05-08T05:32:09.482 INFO:tasks.workunit.client.0.smithi087.stdout:6/643: dread d4/d8/f95 [0,4194304] 0 2024-05-08T05:32:09.482 INFO:tasks.workunit.client.0.smithi087.stdout:9/589: mkdir d1/df/d14/d18/db5 0 2024-05-08T05:32:09.484 INFO:tasks.workunit.client.0.smithi087.stdout:6/644: creat d4/d8/df/d1e/fc9 x:0 0 0 2024-05-08T05:32:09.485 INFO:tasks.workunit.client.0.smithi087.stdout:9/590: symlink d1/df/d14/lb6 0 2024-05-08T05:32:09.485 INFO:tasks.workunit.client.0.smithi087.stdout:9/591: truncate d1/df/d14/d68/d80/d98/d83/fb2 251109 0 2024-05-08T05:32:09.486 INFO:tasks.workunit.client.0.smithi087.stdout:6/645: mkdir d4/d8/df/d1e/d25/d28/d2d/dca 0 2024-05-08T05:32:09.486 INFO:tasks.workunit.client.0.smithi087.stdout:6/646: write d4/d8/faa [591748,52863] 0 2024-05-08T05:32:09.486 INFO:tasks.workunit.client.0.smithi087.stdout:6/647: dread - d4/d8/df/d1e/d25/d28/d2d/d37/d5b/f5f zero size 2024-05-08T05:32:09.487 INFO:tasks.workunit.client.0.smithi087.stdout:8/579: dread f5 [4194304,4194304] 0 2024-05-08T05:32:09.487 INFO:tasks.workunit.client.0.smithi087.stdout:0/550: dwrite d0/d9/f13 [0,4194304] 0 2024-05-08T05:32:09.487 INFO:tasks.workunit.client.0.smithi087.stdout:0/551: chown d0/d22/d3c/f44 177582045 1 2024-05-08T05:32:09.487 INFO:tasks.workunit.client.0.smithi087.stdout:0/552: truncate d0/da/d35/d86/f15 4259656 0 2024-05-08T05:32:09.490 INFO:tasks.workunit.client.0.smithi087.stdout:9/592: getdents d1/df/d37/d5b/d7e 0 2024-05-08T05:32:09.490 INFO:tasks.workunit.client.0.smithi087.stdout:9/593: dread - d1/df/d14/d54/f64 zero size 2024-05-08T05:32:09.491 INFO:tasks.workunit.client.0.smithi087.stdout:8/580: symlink db/d23/d3a/lc6 0 2024-05-08T05:32:09.492 INFO:tasks.workunit.client.0.smithi087.stdout:0/553: link d0/d9/d1b/f7f d0/d9/d1b/d2f/d54/da1/fbf 0 2024-05-08T05:32:09.492 INFO:tasks.workunit.client.0.smithi087.stdout:0/554: write d0/d9/d1b/d2f/d54/f89 [441737,72449] 0 2024-05-08T05:32:09.493 INFO:tasks.workunit.client.0.smithi087.stdout:8/581: creat db/d23/d15/d29/d79/fc7 x:0 0 0 2024-05-08T05:32:09.494 INFO:tasks.workunit.client.0.smithi087.stdout:2/561: dwrite d7/f18 [0,4194304] 0 2024-05-08T05:32:09.494 INFO:tasks.workunit.client.0.smithi087.stdout:0/555: unlink d0/da/d35/d86/d74/l63 0 2024-05-08T05:32:09.495 INFO:tasks.workunit.client.0.smithi087.stdout:9/594: rmdir d1/df/d14/d68/d80/d98 39 2024-05-08T05:32:09.495 INFO:tasks.workunit.client.0.smithi087.stdout:8/582: truncate db/f12 1148023 0 2024-05-08T05:32:09.496 INFO:tasks.workunit.client.0.smithi087.stdout:2/562: mknod d7/de/d2c/cbf 0 2024-05-08T05:32:09.498 INFO:tasks.workunit.client.0.smithi087.stdout:0/556: rename d0/da/cad to d0/d57/cc0 0 2024-05-08T05:32:09.498 INFO:tasks.workunit.client.0.smithi087.stdout:9/595: rename d1/df/d14 to d1/df/d14/d68/d80/d98/d28/db7 22 2024-05-08T05:32:09.499 INFO:tasks.workunit.client.0.smithi087.stdout:2/563: creat d7/de/d27/d33/d49/db9/fc0 x:0 0 0 2024-05-08T05:32:09.500 INFO:tasks.workunit.client.0.smithi087.stdout:0/557: getdents d0/d9/d1b/d5e 0 2024-05-08T05:32:09.502 INFO:tasks.workunit.client.0.smithi087.stdout:9/596: creat d1/df/d14/d18/db5/fb8 x:0 0 0 2024-05-08T05:32:09.503 INFO:tasks.workunit.client.0.smithi087.stdout:2/564: mkdir d7/de/d78/d9c/db7/dc1 0 2024-05-08T05:32:09.503 INFO:tasks.workunit.client.0.smithi087.stdout:2/565: readlink d7/de/d2c/l45 0 2024-05-08T05:32:09.507 INFO:tasks.workunit.client.0.smithi087.stdout:0/558: mknod d0/d22/cc1 0 2024-05-08T05:32:09.507 INFO:tasks.workunit.client.0.smithi087.stdout:0/559: fdatasync d0/d22/d3c/f49 0 2024-05-08T05:32:09.507 INFO:tasks.workunit.client.0.smithi087.stdout:9/597: creat d1/df/d73/fb9 x:0 0 0 2024-05-08T05:32:09.507 INFO:tasks.workunit.client.0.smithi087.stdout:9/598: readlink d1/df/d37/d74/l86 0 2024-05-08T05:32:09.507 INFO:tasks.workunit.client.0.smithi087.stdout:5/640: dwrite da/dd/d65/fcc [0,4194304] 0 2024-05-08T05:32:09.509 INFO:tasks.workunit.client.0.smithi087.stdout:0/560: mknod d0/d57/cc2 0 2024-05-08T05:32:09.509 INFO:tasks.workunit.client.0.smithi087.stdout:0/561: readlink d0/d57/d24/d66/l8d 0 2024-05-08T05:32:09.509 INFO:tasks.workunit.client.0.smithi087.stdout:9/599: creat d1/df/d14/d18/fba x:0 0 0 2024-05-08T05:32:09.510 INFO:tasks.workunit.client.0.smithi087.stdout:5/641: mkdir da/dd/d65/daa/dd5 0 2024-05-08T05:32:09.510 INFO:tasks.workunit.client.0.smithi087.stdout:5/642: write da/dd/d65/f68 [179605,12472] 0 2024-05-08T05:32:09.511 INFO:tasks.workunit.client.0.smithi087.stdout:0/562: getdents d0/da/d35/daa 0 2024-05-08T05:32:09.514 INFO:tasks.workunit.client.0.smithi087.stdout:1/531: write df/f4d [322912,105856] 0 2024-05-08T05:32:09.519 INFO:tasks.workunit.client.0.smithi087.stdout:1/532: stat df/d18/d1d/d58/d72/cb7 0 2024-05-08T05:32:09.525 INFO:tasks.workunit.client.0.smithi087.stdout:2/566: dread d7/f42 [0,4194304] 0 2024-05-08T05:32:09.525 INFO:tasks.workunit.client.0.smithi087.stdout:2/567: chown d7/de/db1 2487 1 2024-05-08T05:32:09.525 INFO:tasks.workunit.client.0.smithi087.stdout:2/568: fsync d7/de/d27/d33/f21 0 2024-05-08T05:32:09.533 INFO:tasks.workunit.client.0.smithi087.stdout:7/714: dread d2/db0/fbc [0,4194304] 0 2024-05-08T05:32:09.533 INFO:tasks.workunit.client.0.smithi087.stdout:2/569: mkdir d7/de/d27/d33/d65/dc2 0 2024-05-08T05:32:09.533 INFO:tasks.workunit.client.0.smithi087.stdout:2/570: creat d7/de/d2c/d43/db4/fc3 x:0 0 0 2024-05-08T05:32:09.533 INFO:tasks.workunit.client.0.smithi087.stdout:2/571: fsync d7/de/f2b 0 2024-05-08T05:32:09.533 INFO:tasks.workunit.client.0.smithi087.stdout:2/572: mknod d7/de/d78/cc4 0 2024-05-08T05:32:09.533 INFO:tasks.workunit.client.0.smithi087.stdout:9/600: truncate d1/df/d14/d68/d80/d98/d83/fb2 44328 0 2024-05-08T05:32:09.536 INFO:tasks.workunit.client.0.smithi087.stdout:3/611: sync 2024-05-08T05:32:09.537 INFO:tasks.workunit.client.0.smithi087.stdout:4/614: dwrite d4/d13/d32/d8d/d91/db8/dba/d63/fad [0,4194304] 0 2024-05-08T05:32:09.541 INFO:tasks.workunit.client.0.smithi087.stdout:3/612: mkdir d4/d11/d24/d25/d4d/dd6 0 2024-05-08T05:32:09.543 INFO:tasks.workunit.client.0.smithi087.stdout:4/615: link d4/d6c/d93/c87 d4/d13/d3e/ce6 0 2024-05-08T05:32:09.545 INFO:tasks.workunit.client.0.smithi087.stdout:4/616: fsync d4/d13/d32/ddb/fa0 0 2024-05-08T05:32:09.545 INFO:tasks.workunit.client.0.smithi087.stdout:4/617: readlink d4/d13/l2a 0 2024-05-08T05:32:09.547 INFO:tasks.workunit.client.0.smithi087.stdout:4/618: mknod d4/ce7 0 2024-05-08T05:32:09.553 INFO:tasks.workunit.client.0.smithi087.stdout:7/715: dread d2/d6/d12/f39 [0,4194304] 0 2024-05-08T05:32:09.554 INFO:tasks.workunit.client.0.smithi087.stdout:4/619: unlink d4/d13/d3e/f9c 0 2024-05-08T05:32:09.566 INFO:tasks.workunit.client.0.smithi087.stdout:4/620: symlink d4/d13/d32/d8d/le8 0 2024-05-08T05:32:09.568 INFO:tasks.workunit.client.0.smithi087.stdout:4/621: rename d4/d13/d3e/d28/fc8 to d4/d13/d65/dd7/fe9 0 2024-05-08T05:32:09.570 INFO:tasks.workunit.client.0.smithi087.stdout:4/622: rename d4/d13/d3e/d28/fab to d4/d13/d3e/d28/d50/d5a/fea 0 2024-05-08T05:32:09.573 INFO:tasks.workunit.client.0.smithi087.stdout:4/623: rmdir d4/d13/d32/d8d/d91/db8/dba/d63/d98 0 2024-05-08T05:32:09.574 INFO:tasks.workunit.client.0.smithi087.stdout:6/648: dwrite d4/d8/f3b [0,4194304] 0 2024-05-08T05:32:09.575 INFO:tasks.workunit.client.0.smithi087.stdout:4/624: link d4/d13/d3e/c34 d4/d13/d32/d8d/d91/db8/dba/d96/dd5/ceb 0 2024-05-08T05:32:09.577 INFO:tasks.workunit.client.0.smithi087.stdout:6/649: rename d4/d8/f95 to d4/d8/df/d1e/fcb 0 2024-05-08T05:32:09.577 INFO:tasks.workunit.client.0.smithi087.stdout:4/625: symlink d4/d13/d3e/d28/d35/lec 0 2024-05-08T05:32:09.578 INFO:tasks.workunit.client.0.smithi087.stdout:6/650: write d4/d8/df/d39/d42/d9e/d6f/f85 [94215,25673] 0 2024-05-08T05:32:09.579 INFO:tasks.workunit.client.0.smithi087.stdout:8/583: dwrite db/d23/d3a/d65/f6e [0,4194304] 0 2024-05-08T05:32:09.582 INFO:tasks.workunit.client.0.smithi087.stdout:4/626: link d4/d6c/f70 d4/d13/d32/ddb/fed 0 2024-05-08T05:32:09.584 INFO:tasks.workunit.client.0.smithi087.stdout:4/627: rename d4/d13/d3e/d28/c4c to d4/d13/d32/d8d/d91/db8/dba/d96/dd5/cee 0 2024-05-08T05:32:09.595 INFO:tasks.workunit.client.0.smithi087.stdout:5/643: dwrite da/db/d2a/d5a/d93/d42/d43/d83/f7d [0,4194304] 0 2024-05-08T05:32:09.595 INFO:tasks.workunit.client.0.smithi087.stdout:5/644: chown da/db/d2a/d5a/d93/l6f 196 1 2024-05-08T05:32:09.595 INFO:tasks.workunit.client.0.smithi087.stdout:5/645: fdatasync da/db/d2a/d5a/d93/d36/d45/fae 0 2024-05-08T05:32:09.595 INFO:tasks.workunit.client.0.smithi087.stdout:5/646: chown da/db/d2a/d46/d69 7184299 1 2024-05-08T05:32:09.596 INFO:tasks.workunit.client.0.smithi087.stdout:6/651: write d4/d8/df/d1e/d25/d28/d2d/d37/fa8 [7608253,125997] 0 2024-05-08T05:32:09.597 INFO:tasks.workunit.client.0.smithi087.stdout:5/647: rename da/c6c to da/cd6 0 2024-05-08T05:32:09.598 INFO:tasks.workunit.client.0.smithi087.stdout:6/652: creat d4/d8/df/d1e/d25/d28/d2d/dca/fcc x:0 0 0 2024-05-08T05:32:09.600 INFO:tasks.workunit.client.0.smithi087.stdout:0/563: dwrite d0/da/d35/daa/faf [0,4194304] 0 2024-05-08T05:32:09.604 INFO:tasks.workunit.client.0.smithi087.stdout:6/653: link d4/d8/df/d1e/d25/d28/d57/f76 d4/d8/df/d1e/d52/fcd 0 2024-05-08T05:32:09.604 INFO:tasks.workunit.client.0.smithi087.stdout:2/573: dwrite d7/de/d2c/f31 [0,4194304] 0 2024-05-08T05:32:09.607 INFO:tasks.workunit.client.0.smithi087.stdout:6/654: mknod d4/d8/df/d1e/d25/d28/d2d/d37/d45/da2/cce 0 2024-05-08T05:32:09.612 INFO:tasks.workunit.client.0.smithi087.stdout:2/574: rmdir d7/de/d27/d33/d49 39 2024-05-08T05:32:09.614 INFO:tasks.workunit.client.0.smithi087.stdout:2/575: mknod d7/de/d78/d9c/db7/cc5 0 2024-05-08T05:32:09.614 INFO:tasks.workunit.client.0.smithi087.stdout:2/576: chown d7/de/d2c/fa4 35691 1 2024-05-08T05:32:09.617 INFO:tasks.workunit.client.0.smithi087.stdout:3/613: dwrite d4/d11/d24/f26 [4194304,4194304] 0 2024-05-08T05:32:09.618 INFO:tasks.workunit.client.0.smithi087.stdout:3/614: creat d4/d11/d24/d25/d3e/d3f/dc0/fd7 x:0 0 0 2024-05-08T05:32:09.619 INFO:tasks.workunit.client.0.smithi087.stdout:3/615: symlink d4/d11/d24/d25/d3e/d58/d9b/ld8 0 2024-05-08T05:32:09.619 INFO:tasks.workunit.client.0.smithi087.stdout:3/616: write d4/f5c [941919,69277] 0 2024-05-08T05:32:09.621 INFO:tasks.workunit.client.0.smithi087.stdout:3/617: link d4/fc3 d4/d11/d24/d25/d4d/dbb/fd9 0 2024-05-08T05:32:09.630 INFO:tasks.workunit.client.0.smithi087.stdout:7/716: dwrite d2/d6/d12/d15/d5b/f63 [0,4194304] 0 2024-05-08T05:32:09.630 INFO:tasks.workunit.client.0.smithi087.stdout:7/717: fsync d2/da/d3f/d72/d77/d54/fde 0 2024-05-08T05:32:09.637 INFO:tasks.workunit.client.0.smithi087.stdout:6/655: write d4/d8/f18 [2048573,121939] 0 2024-05-08T05:32:09.637 INFO:tasks.workunit.client.0.smithi087.stdout:6/656: fdatasync d4/f38 0 2024-05-08T05:32:09.643 INFO:tasks.workunit.client.0.smithi087.stdout:7/718: rmdir d2/da/d3f/d72/d77/d54/d50 39 2024-05-08T05:32:09.646 INFO:tasks.workunit.client.0.smithi087.stdout:7/719: rename d2/d6/d12/d19/fd8 to d2/da/d3f/d72/d77/d54/d50/d88/fe5 0 2024-05-08T05:32:09.651 INFO:tasks.workunit.client.0.smithi087.stdout:8/584: dwrite db/d23/d15/f19 [0,4194304] 0 2024-05-08T05:32:09.651 INFO:tasks.workunit.client.0.smithi087.stdout:8/585: fsync db/d23/f64 0 2024-05-08T05:32:09.651 INFO:tasks.workunit.client.0.smithi087.stdout:2/577: dread d7/de/d27/d33/f1c [4194304,4194304] 0 2024-05-08T05:32:09.661 INFO:tasks.workunit.client.0.smithi087.stdout:8/586: dread db/d23/d15/d3c/fb5 [0,4194304] 0 2024-05-08T05:32:09.662 INFO:tasks.workunit.client.0.smithi087.stdout:7/720: dread d2/d6/d12/d19/d2a/fcf [0,4194304] 0 2024-05-08T05:32:09.664 INFO:tasks.workunit.client.0.smithi087.stdout:7/721: write d2/da/fad [28416,16988] 0 2024-05-08T05:32:09.666 INFO:tasks.workunit.client.0.smithi087.stdout:3/618: dwrite d4/d11/d24/d25/d4d/fc7 [0,4194304] 0 2024-05-08T05:32:09.666 INFO:tasks.workunit.client.0.smithi087.stdout:3/619: stat d4/d11/d24/d25/d3e/d58/fa8 0 2024-05-08T05:32:09.669 INFO:tasks.workunit.client.0.smithi087.stdout:8/587: creat db/d23/d15/d29/d4d/d96/fc8 x:0 0 0 2024-05-08T05:32:09.670 INFO:tasks.workunit.client.0.smithi087.stdout:7/722: mknod d2/d6/da0/d67/ce6 0 2024-05-08T05:32:09.670 INFO:tasks.workunit.client.0.smithi087.stdout:7/723: readlink d2/d6/d12/l36 0 2024-05-08T05:32:09.670 INFO:tasks.workunit.client.0.smithi087.stdout:6/657: dread d4/d8/f67 [0,4194304] 0 2024-05-08T05:32:09.671 INFO:tasks.workunit.client.0.smithi087.stdout:3/620: rmdir d4/d11/d3d/d48 39 2024-05-08T05:32:09.673 INFO:tasks.workunit.client.0.smithi087.stdout:7/724: creat d2/da/d3f/d72/d77/d54/d55/d65/fe7 x:0 0 0 2024-05-08T05:32:09.673 INFO:tasks.workunit.client.0.smithi087.stdout:5/648: dwrite da/db/d2a/d5a/d93/d36/d45/f4d [0,4194304] 0 2024-05-08T05:32:09.676 INFO:tasks.workunit.client.0.smithi087.stdout:0/564: dwrite d0/da/d35/f37 [0,4194304] 0 2024-05-08T05:32:09.676 INFO:tasks.workunit.client.0.smithi087.stdout:5/649: mkdir da/dd/dd7 0 2024-05-08T05:32:09.677 INFO:tasks.workunit.client.0.smithi087.stdout:6/658: dread d4/d8/df/d1e/d25/d28/fa3 [0,4194304] 0 2024-05-08T05:32:09.677 INFO:tasks.workunit.client.0.smithi087.stdout:7/725: symlink d2/d6/d12/d19/le8 0 2024-05-08T05:32:09.677 INFO:tasks.workunit.client.0.smithi087.stdout:7/726: truncate d2/da/d3f/d72/d77/d54/d55/d65/fb5 328216 0 2024-05-08T05:32:09.680 INFO:tasks.workunit.client.0.smithi087.stdout:0/565: rename d0/da/d11/c55 to d0/da/db4/cc3 0 2024-05-08T05:32:09.681 INFO:tasks.workunit.client.0.smithi087.stdout:5/650: mknod da/dd/cd8 0 2024-05-08T05:32:09.682 INFO:tasks.workunit.client.0.smithi087.stdout:7/727: mknod d2/d6/d12/d15/d5b/ce9 0 2024-05-08T05:32:09.683 INFO:tasks.workunit.client.0.smithi087.stdout:0/566: rename d0/d9/d1b/fae to d0/da/d35/daa/fc4 0 2024-05-08T05:32:09.684 INFO:tasks.workunit.client.0.smithi087.stdout:5/651: mkdir da/db/dd3/dd9 0 2024-05-08T05:32:09.687 INFO:tasks.workunit.client.0.smithi087.stdout:5/652: creat da/db/d2a/d5a/d93/d36/dc1/fda x:0 0 0 2024-05-08T05:32:09.687 INFO:tasks.workunit.client.0.smithi087.stdout:5/653: write da/db/d2a/f67 [1059704,90003] 0 2024-05-08T05:32:09.687 INFO:tasks.workunit.client.0.smithi087.stdout:5/654: truncate da/db/f8f 615612 0 2024-05-08T05:32:09.687 INFO:tasks.workunit.client.0.smithi087.stdout:5/655: stat da/db/d2a/d5a/d93/d36/f7f 0 2024-05-08T05:32:09.688 INFO:tasks.workunit.client.0.smithi087.stdout:7/728: mknod d2/d6/d12/d19/cea 0 2024-05-08T05:32:09.688 INFO:tasks.workunit.client.0.smithi087.stdout:7/729: truncate d2/d6/da0/d67/d82/d98/fda 916659 0 2024-05-08T05:32:09.690 INFO:tasks.workunit.client.0.smithi087.stdout:5/656: rmdir da/dd/dd7 0 2024-05-08T05:32:09.694 INFO:tasks.workunit.client.0.smithi087.stdout:1/533: sync 2024-05-08T05:32:09.694 INFO:tasks.workunit.client.0.smithi087.stdout:5/657: symlink da/db/d2a/d5a/d93/d42/d43/ldb 0 2024-05-08T05:32:09.695 INFO:tasks.workunit.client.0.smithi087.stdout:9/601: sync 2024-05-08T05:32:09.695 INFO:tasks.workunit.client.0.smithi087.stdout:9/602: stat d1/df/d14/d18/d66/d7f 0 2024-05-08T05:32:09.708 INFO:tasks.workunit.client.0.smithi087.stdout:3/621: write d4/d11/d24/d25/f2f [674709,82608] 0 2024-05-08T05:32:09.709 INFO:tasks.workunit.client.0.smithi087.stdout:2/578: dwrite d7/d63/f7d [0,4194304] 0 2024-05-08T05:32:09.709 INFO:tasks.workunit.client.0.smithi087.stdout:2/579: chown d7/de/d78/c9e 14745 1 2024-05-08T05:32:09.709 INFO:tasks.workunit.client.0.smithi087.stdout:2/580: dread - d7/de/d27/d33/f77 zero size 2024-05-08T05:32:09.709 INFO:tasks.workunit.client.0.smithi087.stdout:2/581: chown d7/de/d27/d33/d65/dc2 19231775 1 2024-05-08T05:32:09.713 INFO:tasks.workunit.client.0.smithi087.stdout:3/622: read d4/d11/d24/d25/d3e/d58/f7a [309907,59747] 0 2024-05-08T05:32:09.715 INFO:tasks.workunit.client.0.smithi087.stdout:3/623: mknod d4/d11/d3d/d48/cda 0 2024-05-08T05:32:09.716 INFO:tasks.workunit.client.0.smithi087.stdout:3/624: truncate d4/d11/d24/fa6 475261 0 2024-05-08T05:32:09.720 INFO:tasks.workunit.client.0.smithi087.stdout:9/603: dread d1/f30 [0,4194304] 0 2024-05-08T05:32:09.721 INFO:tasks.workunit.client.0.smithi087.stdout:0/567: dwrite d0/da/f78 [4194304,4194304] 0 2024-05-08T05:32:09.723 INFO:tasks.workunit.client.0.smithi087.stdout:8/588: dwrite db/d23/d15/d29/d33/d3b/d56/fab [0,4194304] 0 2024-05-08T05:32:09.724 INFO:tasks.workunit.client.0.smithi087.stdout:0/568: truncate d0/d9/f7e 2528039 0 2024-05-08T05:32:09.724 INFO:tasks.workunit.client.0.smithi087.stdout:0/569: chown d0/d9e 14017444 1 2024-05-08T05:32:09.727 INFO:tasks.workunit.client.0.smithi087.stdout:0/570: mkdir d0/da/d35/daa/dc5 0 2024-05-08T05:32:09.727 INFO:tasks.workunit.client.0.smithi087.stdout:0/571: chown d0/d22/f61 5902 1 2024-05-08T05:32:09.733 INFO:tasks.workunit.client.0.smithi087.stdout:0/572: rmdir d0/da 39 2024-05-08T05:32:09.733 INFO:tasks.workunit.client.0.smithi087.stdout:3/625: read d4/d11/d24/d25/d3e/d58/fa8 [2971900,112174] 0 2024-05-08T05:32:09.733 INFO:tasks.workunit.client.0.smithi087.stdout:4/628: sync 2024-05-08T05:32:09.733 INFO:tasks.workunit.client.0.smithi087.stdout:4/629: rename d4/f8b to d4/d13/d32/d8d/d91/d84/fef 0 2024-05-08T05:32:09.733 INFO:tasks.workunit.client.0.smithi087.stdout:4/630: truncate d4/d13/d32/ddb/fa0 1849551 0 2024-05-08T05:32:09.735 INFO:tasks.workunit.client.0.smithi087.stdout:4/631: unlink d4/d13/d3e/d28/d50/d5a/f8f 0 2024-05-08T05:32:09.737 INFO:tasks.workunit.client.0.smithi087.stdout:9/604: read d1/df/d14/f55 [3237635,35505] 0 2024-05-08T05:32:09.737 INFO:tasks.workunit.client.0.smithi087.stdout:9/605: dread - d1/df/d37/f90 zero size 2024-05-08T05:32:09.738 INFO:tasks.workunit.client.0.smithi087.stdout:9/606: write d1/df/d14/d18/f1e [4893942,112576] 0 2024-05-08T05:32:09.738 INFO:tasks.workunit.client.0.smithi087.stdout:4/632: rename d4/d13/d32/d8d/d91/db8/dba/la8 to d4/d13/d3e/d28/d50/d5a/lf0 0 2024-05-08T05:32:09.739 INFO:tasks.workunit.client.0.smithi087.stdout:8/589: dread f8 [0,4194304] 0 2024-05-08T05:32:09.744 INFO:tasks.workunit.client.0.smithi087.stdout:9/607: getdents d1/df/d14/d68/d80/d98/d28 0 2024-05-08T05:32:09.745 INFO:tasks.workunit.client.0.smithi087.stdout:8/590: mknod db/d23/d15/d29/d33/cc9 0 2024-05-08T05:32:09.746 INFO:tasks.workunit.client.0.smithi087.stdout:9/608: symlink d1/df/d14/d18/d66/lbb 0 2024-05-08T05:32:09.750 INFO:tasks.workunit.client.0.smithi087.stdout:8/591: getdents db/d23/d1b/d35/d43/d68/d6a 0 2024-05-08T05:32:09.750 INFO:tasks.workunit.client.0.smithi087.stdout:9/609: rename d1/df/d14/d68/cb0 to d1/df/d14/d68/d80/d8b/cbc 0 2024-05-08T05:32:09.750 INFO:tasks.workunit.client.0.smithi087.stdout:9/610: readlink d1/df/d14/d54/d61/l32 0 2024-05-08T05:32:09.750 INFO:tasks.workunit.client.0.smithi087.stdout:8/592: mknod db/d23/d54/cca 0 2024-05-08T05:32:09.751 INFO:tasks.workunit.client.0.smithi087.stdout:9/611: symlink d1/df/d14/d68/lbd 0 2024-05-08T05:32:09.752 INFO:tasks.workunit.client.0.smithi087.stdout:9/612: symlink d1/df/d37/lbe 0 2024-05-08T05:32:09.753 INFO:tasks.workunit.client.0.smithi087.stdout:9/613: mknod d1/df/d14/d68/d80/d98/d83/cbf 0 2024-05-08T05:32:09.753 INFO:tasks.workunit.client.0.smithi087.stdout:9/614: dread - d1/df/d14/d18/db5/fb8 zero size 2024-05-08T05:32:09.754 INFO:tasks.workunit.client.0.smithi087.stdout:0/573: read d0/d22/d3c/f49 [1615407,111438] 0 2024-05-08T05:32:09.754 INFO:tasks.workunit.client.0.smithi087.stdout:0/574: chown d0/fb3 125538557 1 2024-05-08T05:32:09.754 INFO:tasks.workunit.client.0.smithi087.stdout:9/615: symlink d1/df/d58/lc0 0 2024-05-08T05:32:09.754 INFO:tasks.workunit.client.0.smithi087.stdout:9/616: stat d1/df/d37/d5b/d7e/c81 0 2024-05-08T05:32:09.755 INFO:tasks.workunit.client.0.smithi087.stdout:1/534: dwrite df/d18/d1d/f3a [0,4194304] 0 2024-05-08T05:32:09.755 INFO:tasks.workunit.client.0.smithi087.stdout:1/535: fdatasync df/fa5 0 2024-05-08T05:32:09.755 INFO:tasks.workunit.client.0.smithi087.stdout:1/536: chown df/d18/d1d/d27/d61/f92 0 1 2024-05-08T05:32:09.755 INFO:tasks.workunit.client.0.smithi087.stdout:1/537: stat df/d2f/d57/d64/d83/d96/lb1 0 2024-05-08T05:32:09.755 INFO:tasks.workunit.client.0.smithi087.stdout:1/538: truncate df/d18/d1d/d27/fa2 509342 0 2024-05-08T05:32:09.756 INFO:tasks.workunit.client.0.smithi087.stdout:9/617: creat d1/df/d14/d54/d61/d88/fc1 x:0 0 0 2024-05-08T05:32:09.756 INFO:tasks.workunit.client.0.smithi087.stdout:9/618: read d1/df/d58/f76 [246508,102039] 0 2024-05-08T05:32:09.757 INFO:tasks.workunit.client.0.smithi087.stdout:0/575: symlink d0/da/d35/d86/d6d/lc6 0 2024-05-08T05:32:09.757 INFO:tasks.workunit.client.0.smithi087.stdout:0/576: chown d0/d57/d24/f4e 153 1 2024-05-08T05:32:09.757 INFO:tasks.workunit.client.0.smithi087.stdout:0/577: write d0/d9/d1b/d2f/d54/da1/f96 [192660,75097] 0 2024-05-08T05:32:09.757 INFO:tasks.workunit.client.0.smithi087.stdout:3/626: write d4/d11/d24/f26 [5545780,118229] 0 2024-05-08T05:32:09.757 INFO:tasks.workunit.client.0.smithi087.stdout:3/627: write d4/d11/d24/d39/d60/d87/da5/fb3 [703779,77221] 0 2024-05-08T05:32:09.758 INFO:tasks.workunit.client.0.smithi087.stdout:3/628: mkdir d4/d11/d24/d25/d3e/d58/d9b/ddb 0 2024-05-08T05:32:09.761 INFO:tasks.workunit.client.0.smithi087.stdout:3/629: symlink d4/d14/dbe/dd0/ldc 0 2024-05-08T05:32:09.762 INFO:tasks.workunit.client.0.smithi087.stdout:3/630: creat d4/d11/d24/d39/d94/fdd x:0 0 0 2024-05-08T05:32:09.762 INFO:tasks.workunit.client.0.smithi087.stdout:3/631: chown d4/d11/d3d/d48/cda 38 1 2024-05-08T05:32:09.763 INFO:tasks.workunit.client.0.smithi087.stdout:3/632: symlink d4/d11/d24/d25/d4d/dd6/lde 0 2024-05-08T05:32:09.765 INFO:tasks.workunit.client.0.smithi087.stdout:1/539: read df/f24 [2625752,44306] 0 2024-05-08T05:32:09.766 INFO:tasks.workunit.client.0.smithi087.stdout:1/540: symlink df/d18/d1d/d27/d61/d89/lb8 0 2024-05-08T05:32:09.768 INFO:tasks.workunit.client.0.smithi087.stdout:1/541: symlink df/d2f/d57/da0/lb9 0 2024-05-08T05:32:09.769 INFO:tasks.workunit.client.0.smithi087.stdout:1/542: rmdir df/d18/d1d/d27/d61/d89 39 2024-05-08T05:32:09.769 INFO:tasks.workunit.client.0.smithi087.stdout:8/593: dread f4 [0,4194304] 0 2024-05-08T05:32:09.769 INFO:tasks.workunit.client.0.smithi087.stdout:5/658: dwrite da/f9e [0,4194304] 0 2024-05-08T05:32:09.772 INFO:tasks.workunit.client.0.smithi087.stdout:8/594: rename db/d23/d15/d29/d79/d95 to db/d23/d3a/dcb 0 2024-05-08T05:32:09.772 INFO:tasks.workunit.client.0.smithi087.stdout:8/595: readlink db/d23/d1b/d35/lc3 0 2024-05-08T05:32:09.778 INFO:tasks.workunit.client.0.smithi087.stdout:3/633: dread d4/d14/f29 [0,4194304] 0 2024-05-08T05:32:09.779 INFO:tasks.workunit.client.0.smithi087.stdout:2/582: dwrite d7/de/d5d/d7b/fb3 [0,4194304] 0 2024-05-08T05:32:09.779 INFO:tasks.workunit.client.0.smithi087.stdout:3/634: chown d4/d11/d24/d25/d3e/d3f 8064 1 2024-05-08T05:32:09.779 INFO:tasks.workunit.client.0.smithi087.stdout:3/635: chown d4/d11/d24/d25/d4d/fc7 1571 1 2024-05-08T05:32:09.779 INFO:tasks.workunit.client.0.smithi087.stdout:4/633: dwrite d4/d13/d3e/d28/d50/d9d/fd8 [0,4194304] 0 2024-05-08T05:32:09.784 INFO:tasks.workunit.client.0.smithi087.stdout:8/596: creat db/d23/d15/d29/d33/d3b/d56/fcc x:0 0 0 2024-05-08T05:32:09.784 INFO:tasks.workunit.client.0.smithi087.stdout:5/659: rename da/dd/d65/daa to da/db/d2a/d5a/d93/d42/d43/d83/ddc 0 2024-05-08T05:32:09.784 INFO:tasks.workunit.client.0.smithi087.stdout:9/619: getdents d1/df/d14/d68/d80/d8b 0 2024-05-08T05:32:09.788 INFO:tasks.workunit.client.0.smithi087.stdout:2/583: mkdir d7/de/d5d/d90/dc6 0 2024-05-08T05:32:09.790 INFO:tasks.workunit.client.0.smithi087.stdout:5/660: rename da/db/d2a/d46/c6d to da/db/cdd 0 2024-05-08T05:32:09.791 INFO:tasks.workunit.client.0.smithi087.stdout:8/597: creat db/d23/d15/d29/db1/fcd x:0 0 0 2024-05-08T05:32:09.795 INFO:tasks.workunit.client.0.smithi087.stdout:9/620: mknod d1/df/d14/d68/cc2 0 2024-05-08T05:32:09.795 INFO:tasks.workunit.client.0.smithi087.stdout:2/584: mknod d7/de/d2c/cc7 0 2024-05-08T05:32:09.795 INFO:tasks.workunit.client.0.smithi087.stdout:9/621: write d1/f1a [5100729,40459] 0 2024-05-08T05:32:09.795 INFO:tasks.workunit.client.0.smithi087.stdout:9/622: truncate d1/df/d14/d18/f23 4594593 0 2024-05-08T05:32:09.796 INFO:tasks.workunit.client.0.smithi087.stdout:9/623: stat d1/df/d14/d68/d80/d98/l20 0 2024-05-08T05:32:09.796 INFO:tasks.workunit.client.0.smithi087.stdout:2/585: write d7/de/d2c/d43/f92 [5068996,77719] 0 2024-05-08T05:32:09.796 INFO:tasks.workunit.client.0.smithi087.stdout:4/634: dread d4/d13/d32/f92 [0,4194304] 0 2024-05-08T05:32:09.796 INFO:tasks.workunit.client.0.smithi087.stdout:4/635: readlink d4/d13/d65/lb2 0 2024-05-08T05:32:09.799 INFO:tasks.workunit.client.0.smithi087.stdout:5/661: unlink da/db/f25 0 2024-05-08T05:32:09.799 INFO:tasks.workunit.client.0.smithi087.stdout:5/662: truncate da/db/d2a/d5a/d93/d36/d45/d5c/f78 1141052 0 2024-05-08T05:32:09.801 INFO:tasks.workunit.client.0.smithi087.stdout:9/624: unlink d1/df/d14/d18/d8e/da2/fad 0 2024-05-08T05:32:09.802 INFO:tasks.workunit.client.0.smithi087.stdout:3/636: write d4/d14/f1a [572365,102688] 0 2024-05-08T05:32:09.802 INFO:tasks.workunit.client.0.smithi087.stdout:4/636: getdents d4/d13/d32/d8d/d91/db8/dba/dbd 0 2024-05-08T05:32:09.803 INFO:tasks.workunit.client.0.smithi087.stdout:5/663: rmdir da/db/d2a/d5a/d93/d42/d43/d83/d6b/d9c 39 2024-05-08T05:32:09.803 INFO:tasks.workunit.client.0.smithi087.stdout:5/664: fsync da/db/d2a/d5a/d93/d36/dc1/fda 0 2024-05-08T05:32:09.804 INFO:tasks.workunit.client.0.smithi087.stdout:9/625: rename d1/df/d14/d68/d80/f84 to d1/df/d14/d18/d9a/fc3 0 2024-05-08T05:32:09.806 INFO:tasks.workunit.client.0.smithi087.stdout:3/637: creat d4/d11/fdf x:0 0 0 2024-05-08T05:32:09.807 INFO:tasks.workunit.client.0.smithi087.stdout:4/637: mknod d4/d13/d32/d8d/d91/db8/dba/dbd/cf1 0 2024-05-08T05:32:09.808 INFO:tasks.workunit.client.0.smithi087.stdout:5/665: truncate da/db/d2a/fab 236698 0 2024-05-08T05:32:09.810 INFO:tasks.workunit.client.0.smithi087.stdout:9/626: creat d1/df/d14/d54/d61/d72/fc4 x:0 0 0 2024-05-08T05:32:09.811 INFO:tasks.workunit.client.0.smithi087.stdout:3/638: mkdir d4/d11/de0 0 2024-05-08T05:32:09.812 INFO:tasks.workunit.client.0.smithi087.stdout:4/638: mkdir d4/d13/d3e/d28/d50/d9d/df2 0 2024-05-08T05:32:09.814 INFO:tasks.workunit.client.0.smithi087.stdout:5/666: mkdir da/db/d2a/d5a/d93/d42/d43/d83/ddc/dde 0 2024-05-08T05:32:09.815 INFO:tasks.workunit.client.0.smithi087.stdout:9/627: getdents d1/df/d14/d18/db5 0 2024-05-08T05:32:09.815 INFO:tasks.workunit.client.0.smithi087.stdout:1/543: dwrite df/d2f/d57/f5d [4194304,4194304] 0 2024-05-08T05:32:09.817 INFO:tasks.workunit.client.0.smithi087.stdout:2/586: write d7/de/d55/f56 [3270087,60577] 0 2024-05-08T05:32:09.819 INFO:tasks.workunit.client.0.smithi087.stdout:3/639: creat d4/d11/d24/fe1 x:0 0 0 2024-05-08T05:32:09.820 INFO:tasks.workunit.client.0.smithi087.stdout:5/667: getdents da/db/d2a/d5a/d93/d36/dc1 0 2024-05-08T05:32:09.820 INFO:tasks.workunit.client.0.smithi087.stdout:8/598: dread db/f25 [0,4194304] 0 2024-05-08T05:32:09.820 INFO:tasks.workunit.client.0.smithi087.stdout:0/578: dwrite d0/da/d11/f20 [4194304,4194304] 0 2024-05-08T05:32:09.823 INFO:tasks.workunit.client.0.smithi087.stdout:2/587: rmdir d7/de/d27/d33/d49/db9 39 2024-05-08T05:32:09.825 INFO:tasks.workunit.client.0.smithi087.stdout:5/668: mkdir da/dd/d13/ddf 0 2024-05-08T05:32:09.834 INFO:tasks.workunit.client.0.smithi087.stdout:3/640: dread d4/d11/d24/d25/d3e/d58/fa8 [0,4194304] 0 2024-05-08T05:32:09.838 INFO:tasks.workunit.client.0.smithi087.stdout:2/588: symlink d7/de/d5d/d7b/lc8 0 2024-05-08T05:32:09.838 INFO:tasks.workunit.client.0.smithi087.stdout:2/589: dread - d7/de/d27/d33/d49/fbd zero size 2024-05-08T05:32:09.839 INFO:tasks.workunit.client.0.smithi087.stdout:5/669: mknod da/db/d2a/d5a/d93/d42/d43/d83/ddc/ce0 0 2024-05-08T05:32:09.840 INFO:tasks.workunit.client.0.smithi087.stdout:2/590: creat d7/de/d27/d33/fc9 x:0 0 0 2024-05-08T05:32:09.840 INFO:tasks.workunit.client.0.smithi087.stdout:2/591: dread - d7/de/f64 zero size 2024-05-08T05:32:09.841 INFO:tasks.workunit.client.0.smithi087.stdout:5/670: creat da/fe1 x:0 0 0 2024-05-08T05:32:09.841 INFO:tasks.workunit.client.0.smithi087.stdout:5/671: fdatasync da/db/d2a/d5a/d93/d36/d45/d5c/fcf 0 2024-05-08T05:32:09.842 INFO:tasks.workunit.client.0.smithi087.stdout:2/592: creat d7/d63/fca x:0 0 0 2024-05-08T05:32:09.842 INFO:tasks.workunit.client.0.smithi087.stdout:8/599: write db/d23/d15/d29/d33/d3b/d56/f87 [351378,93316] 0 2024-05-08T05:32:09.843 INFO:tasks.workunit.client.0.smithi087.stdout:8/600: readlink db/d23/d1b/d35/d43/l66 0 2024-05-08T05:32:09.843 INFO:tasks.workunit.client.0.smithi087.stdout:8/601: readlink db/d23/d15/d29/d33/d6c/db6/lbb 0 2024-05-08T05:32:09.843 INFO:tasks.workunit.client.0.smithi087.stdout:8/602: stat db/d23/d3a/lc6 0 2024-05-08T05:32:09.843 INFO:tasks.workunit.client.0.smithi087.stdout:8/603: fsync db/d23/d15/d29/d33/d3b/f6b 0 2024-05-08T05:32:09.843 INFO:tasks.workunit.client.0.smithi087.stdout:5/672: unlink da/db/d2a/d5a/d93/d42/d43/d83/ddc/ce0 0 2024-05-08T05:32:09.846 INFO:tasks.workunit.client.0.smithi087.stdout:2/593: rename d7/de/d78/d9c to d7/de/d2c/db6/dcb 0 2024-05-08T05:32:09.846 INFO:tasks.workunit.client.0.smithi087.stdout:2/594: write d7/de/d2c/db0/fba [210761,23855] 0 2024-05-08T05:32:09.847 INFO:tasks.workunit.client.0.smithi087.stdout:8/604: mknod db/d23/d15/d29/d79/cce 0 2024-05-08T05:32:09.847 INFO:tasks.workunit.client.0.smithi087.stdout:8/605: truncate db/d23/d15/d29/db1/fbc 136376 0 2024-05-08T05:32:09.847 INFO:tasks.workunit.client.0.smithi087.stdout:8/606: readlink db/l93 0 2024-05-08T05:32:09.847 INFO:tasks.workunit.client.0.smithi087.stdout:8/607: write db/d23/d1b/d35/d43/daf/fb3 [307348,15845] 0 2024-05-08T05:32:09.848 INFO:tasks.workunit.client.0.smithi087.stdout:5/673: creat da/db/d2a/d5a/d93/d42/d43/d83/d6b/fe2 x:0 0 0 2024-05-08T05:32:09.852 INFO:tasks.workunit.client.0.smithi087.stdout:2/595: mkdir d7/de/d82/dcc 0 2024-05-08T05:32:09.855 INFO:tasks.workunit.client.0.smithi087.stdout:5/674: creat da/db/d2a/d5a/d93/d42/d43/fe3 x:0 0 0 2024-05-08T05:32:09.856 INFO:tasks.workunit.client.0.smithi087.stdout:3/641: dread d4/f3c [0,4194304] 0 2024-05-08T05:32:09.856 INFO:tasks.workunit.client.0.smithi087.stdout:5/675: creat da/db/d2a/d46/d9a/fe4 x:0 0 0 2024-05-08T05:32:09.859 INFO:tasks.workunit.client.0.smithi087.stdout:7/730: sync 2024-05-08T05:32:09.861 INFO:tasks.workunit.client.0.smithi087.stdout:3/642: link d4/c22 d4/d11/d24/d25/ce2 0 2024-05-08T05:32:09.862 INFO:tasks.workunit.client.0.smithi087.stdout:3/643: chown d4/d11/d24/d25/d3e/d3f/cba 454683718 1 2024-05-08T05:32:09.863 INFO:tasks.workunit.client.0.smithi087.stdout:3/644: truncate d4/f5 149064 0 2024-05-08T05:32:09.864 INFO:tasks.workunit.client.0.smithi087.stdout:3/645: symlink d4/d11/d24/d39/le3 0 2024-05-08T05:32:09.864 INFO:tasks.workunit.client.0.smithi087.stdout:3/646: write d4/d11/d24/d25/d4d/fb1 [196955,17486] 0 2024-05-08T05:32:09.868 INFO:tasks.workunit.client.0.smithi087.stdout:6/659: sync 2024-05-08T05:32:09.870 INFO:tasks.workunit.client.0.smithi087.stdout:1/544: dread df/d18/d1d/f3a [0,4194304] 0 2024-05-08T05:32:09.870 INFO:tasks.workunit.client.0.smithi087.stdout:5/676: write f2 [1469922,62995] 0 2024-05-08T05:32:09.870 INFO:tasks.workunit.client.0.smithi087.stdout:5/677: dread - da/db/d2a/d46/d9a/fe4 zero size 2024-05-08T05:32:09.871 INFO:tasks.workunit.client.0.smithi087.stdout:6/660: truncate d4/d6/f13 2699087 0 2024-05-08T05:32:09.871 INFO:tasks.workunit.client.0.smithi087.stdout:9/628: dwrite d1/df/d14/f6e [0,4194304] 0 2024-05-08T05:32:09.872 INFO:tasks.workunit.client.0.smithi087.stdout:4/639: dwrite f1 [0,4194304] 0 2024-05-08T05:32:09.872 INFO:tasks.workunit.client.0.smithi087.stdout:4/640: chown d4/d13/f95 196372 1 2024-05-08T05:32:09.872 INFO:tasks.workunit.client.0.smithi087.stdout:4/641: write d4/d13/f3f [2099229,13122] 0 2024-05-08T05:32:09.872 INFO:tasks.workunit.client.0.smithi087.stdout:1/545: mknod df/d2f/d57/d64/cba 0 2024-05-08T05:32:09.877 INFO:tasks.workunit.client.0.smithi087.stdout:0/579: dwrite d0/fa3 [0,4194304] 0 2024-05-08T05:32:09.881 INFO:tasks.workunit.client.0.smithi087.stdout:9/629: rename d1/df/d14/d68/d80/d98/f4e to d1/df/d58/fc5 0 2024-05-08T05:32:09.894 INFO:tasks.workunit.client.0.smithi087.stdout:8/608: dwrite db/d23/f8c [0,4194304] 0 2024-05-08T05:32:09.895 INFO:tasks.workunit.client.0.smithi087.stdout:7/731: dread d2/d6/fd3 [0,4194304] 0 2024-05-08T05:32:09.896 INFO:tasks.workunit.client.0.smithi087.stdout:4/642: rename d4/d13/d32/lb6 to d4/d13/lf3 0 2024-05-08T05:32:09.900 INFO:tasks.workunit.client.0.smithi087.stdout:9/630: creat d1/df/d14/d54/d61/d88/fc6 x:0 0 0 2024-05-08T05:32:09.900 INFO:tasks.workunit.client.0.smithi087.stdout:7/732: creat d2/d6/da0/d67/d82/d98/feb x:0 0 0 2024-05-08T05:32:09.900 INFO:tasks.workunit.client.0.smithi087.stdout:9/631: chown d1/c50 0 1 2024-05-08T05:32:09.900 INFO:tasks.workunit.client.0.smithi087.stdout:9/632: chown d1/df/d14 1 1 2024-05-08T05:32:09.900 INFO:tasks.workunit.client.0.smithi087.stdout:9/633: fdatasync d1/df/d14/d68/d80/d98/d28/f75 0 2024-05-08T05:32:09.901 INFO:tasks.workunit.client.0.smithi087.stdout:7/733: stat d2/da/d3f/d66/ldf 0 2024-05-08T05:32:09.901 INFO:tasks.workunit.client.0.smithi087.stdout:7/734: truncate d2/d6/f90 858033 0 2024-05-08T05:32:09.903 INFO:tasks.workunit.client.0.smithi087.stdout:9/634: link d1/df/d14/d68/d80/d98/d28/f4a d1/df/d58/fc7 0 2024-05-08T05:32:09.905 INFO:tasks.workunit.client.0.smithi087.stdout:5/678: dread da/db/d2a/d5a/d93/d42/d43/d83/d6b/f80 [0,4194304] 0 2024-05-08T05:32:09.905 INFO:tasks.workunit.client.0.smithi087.stdout:1/546: rename df/d18/d1d/d32/l38 to df/d18/d8b/lbb 0 2024-05-08T05:32:09.907 INFO:tasks.workunit.client.0.smithi087.stdout:7/735: stat d2/d6/d12/d19/l75 0 2024-05-08T05:32:09.907 INFO:tasks.workunit.client.0.smithi087.stdout:7/736: readlink d2/d6/d12/l3b 0 2024-05-08T05:32:09.907 INFO:tasks.workunit.client.0.smithi087.stdout:0/580: dread d0/da/f30 [0,4194304] 0 2024-05-08T05:32:09.908 INFO:tasks.workunit.client.0.smithi087.stdout:4/643: dread d4/d13/d32/d8d/d91/fe5 [0,4194304] 0 2024-05-08T05:32:09.908 INFO:tasks.workunit.client.0.smithi087.stdout:4/644: fdatasync d4/d6c/d93/fdf 0 2024-05-08T05:32:09.908 INFO:tasks.workunit.client.0.smithi087.stdout:7/737: write d2/d6/d12/d1d/f57 [1879754,77469] 0 2024-05-08T05:32:09.908 INFO:tasks.workunit.client.0.smithi087.stdout:7/738: chown d2/d6/da0/d67/ce6 705 1 2024-05-08T05:32:09.911 INFO:tasks.workunit.client.0.smithi087.stdout:3/647: dread d4/d11/d3d/f5b [4194304,4194304] 0 2024-05-08T05:32:09.912 INFO:tasks.workunit.client.0.smithi087.stdout:4/645: creat d4/d13/d32/d8d/d91/ff4 x:0 0 0 2024-05-08T05:32:09.912 INFO:tasks.workunit.client.0.smithi087.stdout:9/635: rmdir d1/df/d14/d54/d61/d72 39 2024-05-08T05:32:09.912 INFO:tasks.workunit.client.0.smithi087.stdout:9/636: fdatasync d1/df/d14/d18/fba 0 2024-05-08T05:32:09.912 INFO:tasks.workunit.client.0.smithi087.stdout:9/637: readlink d1/df/d58/lc0 0 2024-05-08T05:32:09.912 INFO:tasks.workunit.client.0.smithi087.stdout:4/646: write d4/d13/d32/d8d/d91/db8/dba/d96/fe3 [521830,116928] 0 2024-05-08T05:32:09.912 INFO:tasks.workunit.client.0.smithi087.stdout:4/647: fsync d4/d13/d32/d8d/fc9 0 2024-05-08T05:32:09.913 INFO:tasks.workunit.client.0.smithi087.stdout:2/596: dwrite d7/de/d27/f5c [0,4194304] 0 2024-05-08T05:32:09.914 INFO:tasks.workunit.client.0.smithi087.stdout:9/638: mknod d1/d70/cc8 0 2024-05-08T05:32:09.914 INFO:tasks.workunit.client.0.smithi087.stdout:9/639: fdatasync d1/df/d14/d68/f6b 0 2024-05-08T05:32:09.914 INFO:tasks.workunit.client.0.smithi087.stdout:9/640: dread - d1/df/d14/d54/d61/d72/fb3 zero size 2024-05-08T05:32:09.914 INFO:tasks.workunit.client.0.smithi087.stdout:9/641: chown d1/df/d14/d68/d80/d98/d83 1114506 1 2024-05-08T05:32:09.916 INFO:tasks.workunit.client.0.smithi087.stdout:4/648: creat d4/d13/d32/d8d/ff5 x:0 0 0 2024-05-08T05:32:09.916 INFO:tasks.workunit.client.0.smithi087.stdout:4/649: fdatasync d4/d6c/f70 0 2024-05-08T05:32:09.916 INFO:tasks.workunit.client.0.smithi087.stdout:4/650: chown d4/d13/fb0 230490337 1 2024-05-08T05:32:09.916 INFO:tasks.workunit.client.0.smithi087.stdout:7/739: write d2/d6/d12/d1d/fb7 [407287,55697] 0 2024-05-08T05:32:09.917 INFO:tasks.workunit.client.0.smithi087.stdout:9/642: symlink d1/df/d14/d18/d8e/da2/lc9 0 2024-05-08T05:32:09.924 INFO:tasks.workunit.client.0.smithi087.stdout:4/651: truncate d4/d13/d32/d8d/fd1 144245 0 2024-05-08T05:32:09.924 INFO:tasks.workunit.client.0.smithi087.stdout:7/740: creat d2/d6/d12/d19/d2a/d91/fec x:0 0 0 2024-05-08T05:32:09.924 INFO:tasks.workunit.client.0.smithi087.stdout:9/643: mkdir d1/df/d14/d54/d61/d88/dca 0 2024-05-08T05:32:09.924 INFO:tasks.workunit.client.0.smithi087.stdout:3/648: dread d4/d11/d24/d25/d3e/d58/f7a [0,4194304] 0 2024-05-08T05:32:09.924 INFO:tasks.workunit.client.0.smithi087.stdout:9/644: stat d1/df/d14/d54/d61/d72/fb3 0 2024-05-08T05:32:09.924 INFO:tasks.workunit.client.0.smithi087.stdout:3/649: truncate d4/d11/d24/d25/d3e/d3f/f6f 1474821 0 2024-05-08T05:32:09.924 INFO:tasks.workunit.client.0.smithi087.stdout:9/645: readlink d1/df/d14/l29 0 2024-05-08T05:32:09.924 INFO:tasks.workunit.client.0.smithi087.stdout:9/646: chown d1/df/d14/d18/d9a/fc3 68 1 2024-05-08T05:32:09.924 INFO:tasks.workunit.client.0.smithi087.stdout:8/609: dread db/d23/f2e [0,4194304] 0 2024-05-08T05:32:09.925 INFO:tasks.workunit.client.0.smithi087.stdout:0/581: read d0/d57/d24/d66/f87 [2870572,25397] 0 2024-05-08T05:32:09.934 INFO:tasks.workunit.client.0.smithi087.stdout:3/650: symlink d4/d11/d24/d39/d60/le4 0 2024-05-08T05:32:09.934 INFO:tasks.workunit.client.0.smithi087.stdout:9/647: truncate d1/df/f12 2630629 0 2024-05-08T05:32:09.934 INFO:tasks.workunit.client.0.smithi087.stdout:7/741: creat d2/d6/d12/d15/d5b/fed x:0 0 0 2024-05-08T05:32:09.935 INFO:tasks.workunit.client.0.smithi087.stdout:9/648: read - d1/df/d14/d54/d61/d72/fc4 zero size 2024-05-08T05:32:09.935 INFO:tasks.workunit.client.0.smithi087.stdout:9/649: fdatasync d1/df/d14/d54/d61/f53 0 2024-05-08T05:32:09.935 INFO:tasks.workunit.client.0.smithi087.stdout:6/661: dwrite d4/d8/faa [0,4194304] 0 2024-05-08T05:32:09.935 INFO:tasks.workunit.client.0.smithi087.stdout:8/610: creat db/d23/d15/d3c/fcf x:0 0 0 2024-05-08T05:32:09.935 INFO:tasks.workunit.client.0.smithi087.stdout:6/662: truncate d4/d8/df/d39/f7a 1253513 0 2024-05-08T05:32:09.936 INFO:tasks.workunit.client.0.smithi087.stdout:2/597: dread d7/f37 [0,4194304] 0 2024-05-08T05:32:09.937 INFO:tasks.workunit.client.0.smithi087.stdout:0/582: symlink d0/d9/d1b/d2f/lc7 0 2024-05-08T05:32:09.938 INFO:tasks.workunit.client.0.smithi087.stdout:4/652: link d4/d13/d32/d8d/d91/db8/dba/dbd/cf1 d4/d13/d32/d8d/d91/db8/dba/dbd/cf6 0 2024-05-08T05:32:09.938 INFO:tasks.workunit.client.0.smithi087.stdout:4/653: stat d4 0 2024-05-08T05:32:09.939 INFO:tasks.workunit.client.0.smithi087.stdout:7/742: mkdir d2/d6/d12/d15/d5b/dee 0 2024-05-08T05:32:09.941 INFO:tasks.workunit.client.0.smithi087.stdout:8/611: creat db/d23/d1b/d35/d43/fd0 x:0 0 0 2024-05-08T05:32:09.941 INFO:tasks.workunit.client.0.smithi087.stdout:8/612: chown db/d23/d54 5 1 2024-05-08T05:32:09.941 INFO:tasks.workunit.client.0.smithi087.stdout:8/613: readlink db/d23/d1b/d35/lc3 0 2024-05-08T05:32:09.944 INFO:tasks.workunit.client.0.smithi087.stdout:5/679: dwrite da/db/d2a/d5a/d93/d42/d43/f81 [0,4194304] 0 2024-05-08T05:32:09.944 INFO:tasks.workunit.client.0.smithi087.stdout:2/598: creat d7/de/d2c/db6/dcb/db7/dc1/fcd x:0 0 0 2024-05-08T05:32:09.945 INFO:tasks.workunit.client.0.smithi087.stdout:2/599: write d7/f17 [2687557,122579] 0 2024-05-08T05:32:09.945 INFO:tasks.workunit.client.0.smithi087.stdout:2/600: truncate d7/de/d27/f44 961380 0 2024-05-08T05:32:09.947 INFO:tasks.workunit.client.0.smithi087.stdout:4/654: dread d4/d13/d3e/d28/fde [0,4194304] 0 2024-05-08T05:32:09.947 INFO:tasks.workunit.client.0.smithi087.stdout:0/583: truncate d0/da/d35/f93 3569759 0 2024-05-08T05:32:09.947 INFO:tasks.workunit.client.0.smithi087.stdout:0/584: read - d0/d22/d3c/fb6 zero size 2024-05-08T05:32:09.949 INFO:tasks.workunit.client.0.smithi087.stdout:4/655: stat d4/d13/d3e/f88 0 2024-05-08T05:32:09.949 INFO:tasks.workunit.client.0.smithi087.stdout:7/743: rename d2/d6/da0/d67/d82/lb2 to d2/da/d3f/d72/d77/dc2/lef 0 2024-05-08T05:32:09.961 INFO:tasks.workunit.client.0.smithi087.stdout:4/656: write d4/d13/f31 [314119,23151] 0 2024-05-08T05:32:09.962 INFO:tasks.workunit.client.0.smithi087.stdout:2/601: link d7/de/d27/d33/f1c d7/d93/fce 0 2024-05-08T05:32:09.962 INFO:tasks.workunit.client.0.smithi087.stdout:2/602: fsync d7/de/d5d/f86 0 2024-05-08T05:32:09.962 INFO:tasks.workunit.client.0.smithi087.stdout:0/585: creat d0/da/db4/fc8 x:0 0 0 2024-05-08T05:32:09.963 INFO:tasks.workunit.client.0.smithi087.stdout:5/680: rename da/db/c12 to da/db/dd3/ce5 0 2024-05-08T05:32:09.964 INFO:tasks.workunit.client.0.smithi087.stdout:7/744: mkdir d2/d6/d12/d19/d2a/d91/df0 0 2024-05-08T05:32:09.967 INFO:tasks.workunit.client.0.smithi087.stdout:4/657: creat d4/d13/d32/d8d/d91/db8/ff7 x:0 0 0 2024-05-08T05:32:09.967 INFO:tasks.workunit.client.0.smithi087.stdout:4/658: write d4/d6c/fe0 [606283,100609] 0 2024-05-08T05:32:09.969 INFO:tasks.workunit.client.0.smithi087.stdout:5/681: rename da/f4b to da/db/fe6 0 2024-05-08T05:32:09.970 INFO:tasks.workunit.client.0.smithi087.stdout:6/663: write d4/d8/df/d1e/d25/f72 [3334456,10248] 0 2024-05-08T05:32:09.971 INFO:tasks.workunit.client.0.smithi087.stdout:0/586: rmdir d0/da/d35 39 2024-05-08T05:32:09.973 INFO:tasks.workunit.client.0.smithi087.stdout:4/659: rename d4/d13/d3e/d28/d50/f9a to d4/d13/d65/dd7/ff8 0 2024-05-08T05:32:09.973 INFO:tasks.workunit.client.0.smithi087.stdout:4/660: dread - d4/d13/d32/d8d/d91/db8/ff7 zero size 2024-05-08T05:32:09.974 INFO:tasks.workunit.client.0.smithi087.stdout:7/745: rmdir d2/d6/da0 39 2024-05-08T05:32:09.975 INFO:tasks.workunit.client.0.smithi087.stdout:2/603: write d7/de/d2c/d43/f92 [2570474,118833] 0 2024-05-08T05:32:09.975 INFO:tasks.workunit.client.0.smithi087.stdout:5/682: mkdir da/db/d2a/d5a/d93/d36/dc1/de7 0 2024-05-08T05:32:09.976 INFO:tasks.workunit.client.0.smithi087.stdout:6/664: creat d4/d8/df/d39/d42/d94/db5/fcf x:0 0 0 2024-05-08T05:32:09.976 INFO:tasks.workunit.client.0.smithi087.stdout:6/665: fsync d4/d8/df/d1e/f96 0 2024-05-08T05:32:09.977 INFO:tasks.workunit.client.0.smithi087.stdout:2/604: read d7/de/d27/f53 [344096,117284] 0 2024-05-08T05:32:09.977 INFO:tasks.workunit.client.0.smithi087.stdout:4/661: creat d4/d13/d32/ff9 x:0 0 0 2024-05-08T05:32:09.977 INFO:tasks.workunit.client.0.smithi087.stdout:2/605: chown d7/de/d27/c7c 151227681 1 2024-05-08T05:32:09.978 INFO:tasks.workunit.client.0.smithi087.stdout:7/746: getdents d2/d6/da0/d67/d82/d98 0 2024-05-08T05:32:09.979 INFO:tasks.workunit.client.0.smithi087.stdout:5/683: mkdir da/db/d2a/d5a/d93/d42/de8 0 2024-05-08T05:32:09.980 INFO:tasks.workunit.client.0.smithi087.stdout:7/747: mkdir d2/da/d3f/d72/d77/d54/d55/d65/df1 0 2024-05-08T05:32:09.981 INFO:tasks.workunit.client.0.smithi087.stdout:7/748: stat d2/d6 0 2024-05-08T05:32:09.984 INFO:tasks.workunit.client.0.smithi087.stdout:5/684: mkdir da/db/d2a/d5a/d93/d42/d43/d83/de9 0 2024-05-08T05:32:09.984 INFO:tasks.workunit.client.0.smithi087.stdout:5/685: getdents da/db/d2a/d46/dc6 0 2024-05-08T05:32:09.985 INFO:tasks.workunit.client.0.smithi087.stdout:4/662: dread d4/d13/d3e/f27 [0,4194304] 0 2024-05-08T05:32:09.986 INFO:tasks.workunit.client.0.smithi087.stdout:5/686: unlink da/db/d2a/d5a/l74 0 2024-05-08T05:32:09.989 INFO:tasks.workunit.client.0.smithi087.stdout:0/587: dread d0/da/d11/f20 [4194304,4194304] 0 2024-05-08T05:32:09.991 INFO:tasks.workunit.client.0.smithi087.stdout:3/651: dwrite d4/d11/f19 [0,4194304] 0 2024-05-08T05:32:09.991 INFO:tasks.workunit.client.0.smithi087.stdout:9/650: dwrite d1/df/d37/d5b/d7e/d85/f87 [0,4194304] 0 2024-05-08T05:32:09.991 INFO:tasks.workunit.client.0.smithi087.stdout:9/651: write d1/df/d14/d18/f67 [1220775,77065] 0 2024-05-08T05:32:09.993 INFO:tasks.workunit.client.0.smithi087.stdout:3/652: creat d4/d11/d24/d39/d60/fe5 x:0 0 0 2024-05-08T05:32:09.993 INFO:tasks.workunit.client.0.smithi087.stdout:3/653: stat d4/l2c 0 2024-05-08T05:32:09.993 INFO:tasks.workunit.client.0.smithi087.stdout:4/663: dread d4/d13/d32/d8d/fd1 [0,4194304] 0 2024-05-08T05:32:09.994 INFO:tasks.workunit.client.0.smithi087.stdout:4/664: rename d4/d6c to d4/d6c/d93/dfa 22 2024-05-08T05:32:09.997 INFO:tasks.workunit.client.0.smithi087.stdout:4/665: stat d4/d13/d65/cd2 0 2024-05-08T05:32:09.997 INFO:tasks.workunit.client.0.smithi087.stdout:4/666: write d4/f4b [280240,11515] 0 2024-05-08T05:32:10.016 INFO:tasks.workunit.client.0.smithi087.stdout:8/614: dwrite db/d23/d1b/d4b/f69 [4194304,4194304] 0 2024-05-08T05:32:10.025 INFO:tasks.workunit.client.0.smithi087.stdout:8/615: mknod db/d23/d3a/d65/d83/dc5/cd1 0 2024-05-08T05:32:10.025 INFO:tasks.workunit.client.0.smithi087.stdout:7/749: dread d2/f4 [0,4194304] 0 2024-05-08T05:32:10.025 INFO:tasks.workunit.client.0.smithi087.stdout:7/750: chown d2/d6/da0/f61 2849 1 2024-05-08T05:32:10.025 INFO:tasks.workunit.client.0.smithi087.stdout:7/751: write d2/da/d3f/d72/d77/d54/d55/f96 [1299349,52302] 0 2024-05-08T05:32:10.027 INFO:tasks.workunit.client.0.smithi087.stdout:7/752: chown d2/da/f85 24 1 2024-05-08T05:32:10.027 INFO:tasks.workunit.client.0.smithi087.stdout:7/753: fsync d2/d6/d12/d19/f73 0 2024-05-08T05:32:10.029 INFO:tasks.workunit.client.0.smithi087.stdout:6/666: dwrite d4/f5e [4194304,4194304] 0 2024-05-08T05:32:10.029 INFO:tasks.workunit.client.0.smithi087.stdout:7/754: symlink d2/da/d3f/d66/lf2 0 2024-05-08T05:32:10.029 INFO:tasks.workunit.client.0.smithi087.stdout:9/652: read d1/df/d14/d68/d80/d98/d28/f2e [841717,26149] 0 2024-05-08T05:32:10.032 INFO:tasks.workunit.client.0.smithi087.stdout:2/606: dwrite d7/de/d27/d33/faf [0,4194304] 0 2024-05-08T05:32:10.032 INFO:tasks.workunit.client.0.smithi087.stdout:7/755: link d2/da/f86 d2/da/d3f/d72/d77/d54/d55/d65/ff3 0 2024-05-08T05:32:10.032 INFO:tasks.workunit.client.0.smithi087.stdout:7/756: write d2/da/f85 [2396563,38262] 0 2024-05-08T05:32:10.034 INFO:tasks.workunit.client.0.smithi087.stdout:9/653: getdents d1/df/d14 0 2024-05-08T05:32:10.034 INFO:tasks.workunit.client.0.smithi087.stdout:9/654: write d1/df/d14/d68/d80/d98/d83/f9f [503931,130034] 0 2024-05-08T05:32:10.042 INFO:tasks.workunit.client.0.smithi087.stdout:2/607: rename d7/de/d27/l52 to d7/de/d27/d33/lcf 0 2024-05-08T05:32:10.042 INFO:tasks.workunit.client.0.smithi087.stdout:9/655: mknod d1/df/d14/d68/d80/d8b/ccb 0 2024-05-08T05:32:10.044 INFO:tasks.workunit.client.0.smithi087.stdout:8/616: dread db/d23/d15/d29/d33/d3b/f4c [0,4194304] 0 2024-05-08T05:32:10.044 INFO:tasks.workunit.client.0.smithi087.stdout:9/656: rename d1/df/d14/d54/d61/d88/fc1 to d1/df/d14/d18/db5/fcc 0 2024-05-08T05:32:10.047 INFO:tasks.workunit.client.0.smithi087.stdout:9/657: write d1/df/d14/d18/d9a/fc3 [399341,40865] 0 2024-05-08T05:32:10.047 INFO:tasks.workunit.client.0.smithi087.stdout:9/658: chown d1/df/d14/d68/d80/d98/d28/d4b/c63 93 1 2024-05-08T05:32:10.049 INFO:tasks.workunit.client.0.smithi087.stdout:8/617: truncate db/d23/d15/d3c/f3f 1248773 0 2024-05-08T05:32:10.051 INFO:tasks.workunit.client.0.smithi087.stdout:1/547: sync 2024-05-08T05:32:10.051 INFO:tasks.workunit.client.0.smithi087.stdout:1/548: dread - df/d2f/d4f/f93 zero size 2024-05-08T05:32:10.051 INFO:tasks.workunit.client.0.smithi087.stdout:6/667: dread d4/d8/f3b [0,4194304] 0 2024-05-08T05:32:10.055 INFO:tasks.workunit.client.0.smithi087.stdout:1/549: creat df/fbc x:0 0 0 2024-05-08T05:32:10.056 INFO:tasks.workunit.client.0.smithi087.stdout:4/667: dwrite d4/d13/f16 [0,4194304] 0 2024-05-08T05:32:10.057 INFO:tasks.workunit.client.0.smithi087.stdout:1/550: creat df/d2f/d4f/d52/fbd x:0 0 0 2024-05-08T05:32:10.058 INFO:tasks.workunit.client.0.smithi087.stdout:4/668: rename d4/d6c/l81 to d4/d13/d3e/d28/lfb 0 2024-05-08T05:32:10.059 INFO:tasks.workunit.client.0.smithi087.stdout:1/551: mkdir df/d18/dbe 0 2024-05-08T05:32:10.060 INFO:tasks.workunit.client.0.smithi087.stdout:7/757: dread d2/f4 [0,4194304] 0 2024-05-08T05:32:10.061 INFO:tasks.workunit.client.0.smithi087.stdout:4/669: link d4/f4b d4/d13/d3e/d28/d50/d9d/df2/ffc 0 2024-05-08T05:32:10.062 INFO:tasks.workunit.client.0.smithi087.stdout:1/552: rename df/d2f/d57/d64/f23 to df/d2f/d57/d64/fbf 0 2024-05-08T05:32:10.063 INFO:tasks.workunit.client.0.smithi087.stdout:7/758: symlink d2/d6/lf4 0 2024-05-08T05:32:10.064 INFO:tasks.workunit.client.0.smithi087.stdout:2/608: dread d7/de/d27/d33/f38 [0,4194304] 0 2024-05-08T05:32:10.064 INFO:tasks.workunit.client.0.smithi087.stdout:4/670: link d4/d6c/d93/fac d4/d6c/d93/ffd 0 2024-05-08T05:32:10.065 INFO:tasks.workunit.client.0.smithi087.stdout:5/687: dwrite da/db/d2a/d5a/d93/d36/f7f [0,4194304] 0 2024-05-08T05:32:10.065 INFO:tasks.workunit.client.0.smithi087.stdout:2/609: symlink d7/de/db1/ld0 0 2024-05-08T05:32:10.066 INFO:tasks.workunit.client.0.smithi087.stdout:4/671: creat d4/d13/d32/d8d/ffe x:0 0 0 2024-05-08T05:32:10.066 INFO:tasks.workunit.client.0.smithi087.stdout:4/672: truncate d4/d6c/d93/ffd 400615 0 2024-05-08T05:32:10.069 INFO:tasks.workunit.client.0.smithi087.stdout:8/618: dread db/d23/d1b/d35/d43/d68/d6a/f73 [0,4194304] 0 2024-05-08T05:32:10.075 INFO:tasks.workunit.client.0.smithi087.stdout:7/759: mkdir d2/da/df5 0 2024-05-08T05:32:10.077 INFO:tasks.workunit.client.0.smithi087.stdout:9/659: dread d1/df/d14/d68/d80/d98/d28/f62 [0,4194304] 0 2024-05-08T05:32:10.077 INFO:tasks.workunit.client.0.smithi087.stdout:9/660: stat d1/f7 0 2024-05-08T05:32:10.081 INFO:tasks.workunit.client.0.smithi087.stdout:9/661: mknod d1/df/d14/d18/db5/ccd 0 2024-05-08T05:32:10.085 INFO:tasks.workunit.client.0.smithi087.stdout:3/654: dwrite d4/d11/d24/d25/d4d/f68 [4194304,4194304] 0 2024-05-08T05:32:10.087 INFO:tasks.workunit.client.0.smithi087.stdout:3/655: symlink d4/d14/d84/le6 0 2024-05-08T05:32:10.088 INFO:tasks.workunit.client.0.smithi087.stdout:3/656: write d4/d11/d24/d25/d3e/f65 [264681,4223] 0 2024-05-08T05:32:10.098 INFO:tasks.workunit.client.0.smithi087.stdout:6/668: dread d4/d8/df/d39/d42/d9e/d6f/f8d [4194304,4194304] 0 2024-05-08T05:32:10.098 INFO:tasks.workunit.client.0.smithi087.stdout:2/610: read f5 [2796102,35691] 0 2024-05-08T05:32:10.098 INFO:tasks.workunit.client.0.smithi087.stdout:2/611: dread - d7/d93/f94 zero size 2024-05-08T05:32:10.100 INFO:tasks.workunit.client.0.smithi087.stdout:2/612: rmdir d7/de/d27/d33 39 2024-05-08T05:32:10.100 INFO:tasks.workunit.client.0.smithi087.stdout:0/588: dwrite d0/d9/d1b/d2f/d54/da1/f70 [0,4194304] 0 2024-05-08T05:32:10.102 INFO:tasks.workunit.client.0.smithi087.stdout:2/613: link d7/de/d27/d33/d49/l73 d7/de/d27/d33/d49/ld1 0 2024-05-08T05:32:10.103 INFO:tasks.workunit.client.0.smithi087.stdout:0/589: mkdir d0/da/d35/d86/d9a/dc9 0 2024-05-08T05:32:10.104 INFO:tasks.workunit.client.0.smithi087.stdout:2/614: symlink d7/de/d82/dcc/ld2 0 2024-05-08T05:32:10.104 INFO:tasks.workunit.client.0.smithi087.stdout:0/590: write d0/d9/d1b/d2f/d54/da1/f5c [4053871,90806] 0 2024-05-08T05:32:10.106 INFO:tasks.workunit.client.0.smithi087.stdout:0/591: stat d0/d9/d1b/d5e 0 2024-05-08T05:32:10.107 INFO:tasks.workunit.client.0.smithi087.stdout:2/615: truncate d7/de/d27/d33/f21 2697992 0 2024-05-08T05:32:10.107 INFO:tasks.workunit.client.0.smithi087.stdout:2/616: mkdir d7/de/d2c/db0/dd3 0 2024-05-08T05:32:10.109 INFO:tasks.workunit.client.0.smithi087.stdout:2/617: truncate d7/de/d27/f44 573254 0 2024-05-08T05:32:10.140 INFO:tasks.workunit.client.0.smithi087.stdout:1/553: dwrite df/d18/d1d/f99 [0,4194304] 0 2024-05-08T05:32:10.143 INFO:tasks.workunit.client.0.smithi087.stdout:1/554: creat df/d18/d4b/fc0 x:0 0 0 2024-05-08T05:32:10.143 INFO:tasks.workunit.client.0.smithi087.stdout:1/555: truncate df/fbc 281111 0 2024-05-08T05:32:10.143 INFO:tasks.workunit.client.0.smithi087.stdout:1/556: chown df/d18/d1d/f99 358 1 2024-05-08T05:32:10.144 INFO:tasks.workunit.client.0.smithi087.stdout:5/688: dwrite da/db/d2a/f77 [0,4194304] 0 2024-05-08T05:32:10.144 INFO:tasks.workunit.client.0.smithi087.stdout:5/689: chown da/db/d2a/d5a/d93/d36/dc1/c2d 0 1 2024-05-08T05:32:10.144 INFO:tasks.workunit.client.0.smithi087.stdout:5/690: fsync da/db/d2a/d5a/d93/d36/d45/d5c/f78 0 2024-05-08T05:32:10.144 INFO:tasks.workunit.client.0.smithi087.stdout:8/619: dwrite db/d23/d15/d3c/f3e [0,4194304] 0 2024-05-08T05:32:10.145 INFO:tasks.workunit.client.0.smithi087.stdout:0/592: dread d0/da/d35/f58 [0,4194304] 0 2024-05-08T05:32:10.149 INFO:tasks.workunit.client.0.smithi087.stdout:8/620: rename db/d23/d3a/dcb/dac to db/d23/d15/d29/d33/dd2 0 2024-05-08T05:32:10.149 INFO:tasks.workunit.client.0.smithi087.stdout:0/593: creat d0/d9/d1b/fca x:0 0 0 2024-05-08T05:32:10.150 INFO:tasks.workunit.client.0.smithi087.stdout:0/594: chown d0/da/d11/c28 106064209 1 2024-05-08T05:32:10.157 INFO:tasks.workunit.client.0.smithi087.stdout:4/673: dwrite d4/d13/d3e/f4f [0,4194304] 0 2024-05-08T05:32:10.157 INFO:tasks.workunit.client.0.smithi087.stdout:4/674: chown d4/d13/d32/d8d/d91/db8/dba/dbd/cf6 22 1 2024-05-08T05:32:10.164 INFO:tasks.workunit.client.0.smithi087.stdout:9/662: dwrite d1/df/d37/d5b/d7e/f9b [0,4194304] 0 2024-05-08T05:32:10.164 INFO:tasks.workunit.client.0.smithi087.stdout:9/663: stat d1/df/d14/f17 0 2024-05-08T05:32:10.167 INFO:tasks.workunit.client.0.smithi087.stdout:2/618: dwrite d7/d63/fca [0,4194304] 0 2024-05-08T05:32:10.168 INFO:tasks.workunit.client.0.smithi087.stdout:5/691: read da/db/d2a/d5a/d93/d42/d43/d83/f7d [2364165,100301] 0 2024-05-08T05:32:10.168 INFO:tasks.workunit.client.0.smithi087.stdout:3/657: dwrite d4/d11/d24/d39/d5a/f6b [0,4194304] 0 2024-05-08T05:32:10.168 INFO:tasks.workunit.client.0.smithi087.stdout:5/692: chown da/db/d2a/d5a/d93/d42/d43/d83/d6b/fb4 519 1 2024-05-08T05:32:10.170 INFO:tasks.workunit.client.0.smithi087.stdout:9/664: getdents d1/df/d14/d54/d61/d72 0 2024-05-08T05:32:10.170 INFO:tasks.workunit.client.0.smithi087.stdout:9/665: stat d1/df/d14/d54 0 2024-05-08T05:32:10.173 INFO:tasks.workunit.client.0.smithi087.stdout:0/595: dread d0/d9/d1b/d2f/d54/da1/f62 [0,4194304] 0 2024-05-08T05:32:10.173 INFO:tasks.workunit.client.0.smithi087.stdout:7/760: dwrite d2/d6/d12/f39 [0,4194304] 0 2024-05-08T05:32:10.173 INFO:tasks.workunit.client.0.smithi087.stdout:7/761: truncate d2/d6/d12/dc5/fd0 833306 0 2024-05-08T05:32:10.179 INFO:tasks.workunit.client.0.smithi087.stdout:5/693: unlink c4 0 2024-05-08T05:32:10.180 INFO:tasks.workunit.client.0.smithi087.stdout:3/658: link d4/d11/d24/f26 d4/d11/d24/fe7 0 2024-05-08T05:32:10.180 INFO:tasks.workunit.client.0.smithi087.stdout:9/666: creat d1/df/d14/d68/d80/d8b/fce x:0 0 0 2024-05-08T05:32:10.180 INFO:tasks.workunit.client.0.smithi087.stdout:6/669: dwrite d4/d8/df/d39/d42/d9e/d6f/d7f/fae [8388608,4194304] 0 2024-05-08T05:32:10.189 INFO:tasks.workunit.client.0.smithi087.stdout:5/694: creat da/db/d2a/d5a/d93/d42/d43/d83/ddc/dd5/fea x:0 0 0 2024-05-08T05:32:10.190 INFO:tasks.workunit.client.0.smithi087.stdout:9/667: symlink d1/df/d37/d74/lcf 0 2024-05-08T05:32:10.193 INFO:tasks.workunit.client.0.smithi087.stdout:6/670: link d4/d8/df/d39/d42/d9e/f65 d4/d8/df/d1e/fd0 0 2024-05-08T05:32:10.201 INFO:tasks.workunit.client.0.smithi087.stdout:8/621: dwrite db/d23/d15/d3c/f3f [0,4194304] 0 2024-05-08T05:32:10.201 INFO:tasks.workunit.client.0.smithi087.stdout:1/557: dwrite df/d2f/d4f/f79 [0,4194304] 0 2024-05-08T05:32:10.202 INFO:tasks.workunit.client.0.smithi087.stdout:5/695: link da/db/d2a/d5a/d93/d36/f7f da/db/d2a/d46/feb 0 2024-05-08T05:32:10.202 INFO:tasks.workunit.client.0.smithi087.stdout:6/671: mkdir d4/d8/df/d39/d42/d9e/dd1 0 2024-05-08T05:32:10.215 INFO:tasks.workunit.client.0.smithi087.stdout:0/596: dread d0/da/f1e [4194304,4194304] 0 2024-05-08T05:32:10.219 INFO:tasks.workunit.client.0.smithi087.stdout:0/597: symlink d0/da/lcb 0 2024-05-08T05:32:10.219 INFO:tasks.workunit.client.0.smithi087.stdout:0/598: fsync d0/d9/d1b/f3e 0 2024-05-08T05:32:10.221 INFO:tasks.workunit.client.0.smithi087.stdout:0/599: mkdir d0/d9/d1b/d2f/dcc 0 2024-05-08T05:32:10.222 INFO:tasks.workunit.client.0.smithi087.stdout:0/600: creat d0/d9/d1b/fcd x:0 0 0 2024-05-08T05:32:10.223 INFO:tasks.workunit.client.0.smithi087.stdout:0/601: mknod d0/d9/d1b/d2f/dcc/cce 0 2024-05-08T05:32:10.245 INFO:tasks.workunit.client.0.smithi087.stdout:9/668: dwrite d1/df/d14/d68/d80/d98/d28/f7c [0,4194304] 0 2024-05-08T05:32:10.245 INFO:tasks.workunit.client.0.smithi087.stdout:8/622: dread db/d23/d1b/fad [0,4194304] 0 2024-05-08T05:32:10.245 INFO:tasks.workunit.client.0.smithi087.stdout:2/619: dwrite d7/de/d27/d33/d49/fbd [0,4194304] 0 2024-05-08T05:32:10.245 INFO:tasks.workunit.client.0.smithi087.stdout:7/762: dwrite d2/db0/fbc [0,4194304] 0 2024-05-08T05:32:10.254 INFO:tasks.workunit.client.0.smithi087.stdout:7/763: creat d2/d6/ff6 x:0 0 0 2024-05-08T05:32:10.263 INFO:tasks.workunit.client.0.smithi087.stdout:2/620: dread d7/de/d55/f56 [0,4194304] 0 2024-05-08T05:32:10.263 INFO:tasks.workunit.client.0.smithi087.stdout:2/621: chown d7/de/d27/d33/d49/db9 634 1 2024-05-08T05:32:10.265 INFO:tasks.workunit.client.0.smithi087.stdout:1/558: dwrite df/d2f/f97 [0,4194304] 0 2024-05-08T05:32:10.266 INFO:tasks.workunit.client.0.smithi087.stdout:7/764: rename d2/da/d3f/d49/daf/fe2 to d2/d6/d12/ff7 0 2024-05-08T05:32:10.267 INFO:tasks.workunit.client.0.smithi087.stdout:2/622: truncate d7/de/d5d/d7b/fb3 1896353 0 2024-05-08T05:32:10.267 INFO:tasks.workunit.client.0.smithi087.stdout:2/623: fdatasync f3 0 2024-05-08T05:32:10.270 INFO:tasks.workunit.client.0.smithi087.stdout:1/559: creat df/d2f/d57/d64/d83/fc1 x:0 0 0 2024-05-08T05:32:10.271 INFO:tasks.workunit.client.0.smithi087.stdout:3/659: dwrite d4/d11/d3d/f47 [0,4194304] 0 2024-05-08T05:32:10.272 INFO:tasks.workunit.client.0.smithi087.stdout:7/765: creat d2/d6/d12/ff8 x:0 0 0 2024-05-08T05:32:10.274 INFO:tasks.workunit.client.0.smithi087.stdout:5/696: dwrite da/db/d2a/d5a/d93/d36/d45/d5c/fcf [0,4194304] 0 2024-05-08T05:32:10.275 INFO:tasks.workunit.client.0.smithi087.stdout:2/624: rename d7/de/d2c/c6e to d7/de/d5d/d90/dc6/cd4 0 2024-05-08T05:32:10.277 INFO:tasks.workunit.client.0.smithi087.stdout:7/766: mkdir d2/da/d3f/d72/d77/d54/d50/d88/df9 0 2024-05-08T05:32:10.279 INFO:tasks.workunit.client.0.smithi087.stdout:5/697: fsync da/db/d2a/d5a/d93/d42/d43/d83/f7a 0 2024-05-08T05:32:10.279 INFO:tasks.workunit.client.0.smithi087.stdout:5/698: fsync da/db/d2a/d5a/d93/d42/d43/fe3 0 2024-05-08T05:32:10.280 INFO:tasks.workunit.client.0.smithi087.stdout:2/625: mknod d7/de/d2c/db0/cd5 0 2024-05-08T05:32:10.280 INFO:tasks.workunit.client.0.smithi087.stdout:2/626: fsync d7/de/d27/d33/f30 0 2024-05-08T05:32:10.281 INFO:tasks.workunit.client.0.smithi087.stdout:7/767: unlink d2/da/d3f/d72/d77/d54/d55/d65/ff3 0 2024-05-08T05:32:10.286 INFO:tasks.workunit.client.0.smithi087.stdout:9/669: dwrite d1/df/d37/f51 [0,4194304] 0 2024-05-08T05:32:10.286 INFO:tasks.workunit.client.0.smithi087.stdout:9/670: chown d1/df/d14/d68/d80/d98/d83/cbf 0 1 2024-05-08T05:32:10.288 INFO:tasks.workunit.client.0.smithi087.stdout:2/627: dread d7/f1e [0,4194304] 0 2024-05-08T05:32:10.288 INFO:tasks.workunit.client.0.smithi087.stdout:2/628: readlink d7/de/d78/l7a 0 2024-05-08T05:32:10.289 INFO:tasks.workunit.client.0.smithi087.stdout:2/629: chown d7/de/db1/dbe 397215147 1 2024-05-08T05:32:10.289 INFO:tasks.workunit.client.0.smithi087.stdout:9/671: mkdir d1/df/d14/d68/d80/d98/d28/d4b/dd0 0 2024-05-08T05:32:10.289 INFO:tasks.workunit.client.0.smithi087.stdout:2/630: dread - d7/de/d27/d33/d49/f8b zero size 2024-05-08T05:32:10.291 INFO:tasks.workunit.client.0.smithi087.stdout:7/768: dread d2/d6/d12/f97 [0,4194304] 0 2024-05-08T05:32:10.296 INFO:tasks.workunit.client.0.smithi087.stdout:6/672: dwrite d4/d8/df/d1e/d25/d28/fa1 [0,4194304] 0 2024-05-08T05:32:10.303 INFO:tasks.workunit.client.0.smithi087.stdout:1/560: read df/d2f/d4f/f79 [630928,18304] 0 2024-05-08T05:32:10.303 INFO:tasks.workunit.client.0.smithi087.stdout:7/769: link d2/da/d3f/d72/cc9 d2/da/d3f/d72/d77/d54/d55/d65/df1/cfa 0 2024-05-08T05:32:10.304 INFO:tasks.workunit.client.0.smithi087.stdout:1/561: readlink df/d18/d4b/l53 0 2024-05-08T05:32:10.304 INFO:tasks.workunit.client.0.smithi087.stdout:6/673: mkdir d4/d8/df/d39/d42/d9e/da4/dad/dd2 0 2024-05-08T05:32:10.306 INFO:tasks.workunit.client.0.smithi087.stdout:7/770: mknod d2/d6/da0/d67/cfb 0 2024-05-08T05:32:10.306 INFO:tasks.workunit.client.0.smithi087.stdout:7/771: stat d2/d6/d12 0 2024-05-08T05:32:10.312 INFO:tasks.workunit.client.0.smithi087.stdout:6/674: mknod d4/d8/df/d1e/d25/d28/d2d/d37/cd3 0 2024-05-08T05:32:10.312 INFO:tasks.workunit.client.0.smithi087.stdout:7/772: unlink d2/da/d3f/d66/ca7 0 2024-05-08T05:32:10.312 INFO:tasks.workunit.client.0.smithi087.stdout:7/773: chown d2/d6/d12/d19/d2a/d89/d9a 13 1 2024-05-08T05:32:10.312 INFO:tasks.workunit.client.0.smithi087.stdout:1/562: getdents df/d18/d1d/d32/d9c 0 2024-05-08T05:32:10.312 INFO:tasks.workunit.client.0.smithi087.stdout:1/563: write df/d2f/d4f/f76 [4270473,52543] 0 2024-05-08T05:32:10.317 INFO:tasks.workunit.client.0.smithi087.stdout:7/774: mkdir d2/da/d3f/d72/d77/d54/d55/dfc 0 2024-05-08T05:32:10.321 INFO:tasks.workunit.client.0.smithi087.stdout:2/631: dread d7/f42 [0,4194304] 0 2024-05-08T05:32:10.322 INFO:tasks.workunit.client.0.smithi087.stdout:2/632: chown d7/d63/l3c 56777 1 2024-05-08T05:32:10.322 INFO:tasks.workunit.client.0.smithi087.stdout:7/775: symlink d2/da/lfd 0 2024-05-08T05:32:10.324 INFO:tasks.workunit.client.0.smithi087.stdout:4/675: sync 2024-05-08T05:32:10.324 INFO:tasks.workunit.client.0.smithi087.stdout:4/676: write d4/d13/d3e/d28/d50/d5a/fea [959120,38026] 0 2024-05-08T05:32:10.324 INFO:tasks.workunit.client.0.smithi087.stdout:4/677: stat d4/d13/d32/ddb/f82 0 2024-05-08T05:32:10.324 INFO:tasks.workunit.client.0.smithi087.stdout:4/678: fdatasync d4/d6c/d93/ffd 0 2024-05-08T05:32:10.324 INFO:tasks.workunit.client.0.smithi087.stdout:4/679: fdatasync d4/d13/d32/ddb/f6d 0 2024-05-08T05:32:10.339 INFO:tasks.workunit.client.0.smithi087.stdout:2/633: write d7/de/d27/d33/d49/f6d [4986277,66326] 0 2024-05-08T05:32:10.340 INFO:tasks.workunit.client.0.smithi087.stdout:8/623: dwrite db/d23/d15/d29/db1/fbc [0,4194304] 0 2024-05-08T05:32:10.340 INFO:tasks.workunit.client.0.smithi087.stdout:6/675: write d4/f6c [1055085,110817] 0 2024-05-08T05:32:10.347 INFO:tasks.workunit.client.0.smithi087.stdout:6/676: unlink d4/d8/df/d39/f8e 0 2024-05-08T05:32:10.347 INFO:tasks.workunit.client.0.smithi087.stdout:8/624: getdents db/d23/d15/d29/db1 0 2024-05-08T05:32:10.349 INFO:tasks.workunit.client.0.smithi087.stdout:6/677: symlink d4/d8/df/d39/d42/dbd/ld4 0 2024-05-08T05:32:10.349 INFO:tasks.workunit.client.0.smithi087.stdout:6/678: chown d4/d8/df/d1e/d52/l5a 11 1 2024-05-08T05:32:10.350 INFO:tasks.workunit.client.0.smithi087.stdout:6/679: stat d4/d8/df/d39/d42/d9e/d6f/ca5 0 2024-05-08T05:32:10.352 INFO:tasks.workunit.client.0.smithi087.stdout:6/680: unlink d4/d8/df/d1e/d25/c8f 0 2024-05-08T05:32:10.353 INFO:tasks.workunit.client.0.smithi087.stdout:1/564: dread df/f3b [0,4194304] 0 2024-05-08T05:32:10.354 INFO:tasks.workunit.client.0.smithi087.stdout:1/565: dread - df/d2f/d57/d64/fac zero size 2024-05-08T05:32:10.355 INFO:tasks.workunit.client.0.smithi087.stdout:6/681: rename d4/d8/df/d1e/d25/d28/d57/f76 to d4/d8/df/d39/d42/d6a/fd5 0 2024-05-08T05:32:10.356 INFO:tasks.workunit.client.0.smithi087.stdout:9/672: dwrite d1/df/d14/d18/f1e [0,4194304] 0 2024-05-08T05:32:10.359 INFO:tasks.workunit.client.0.smithi087.stdout:5/699: dwrite da/db/d2a/f67 [0,4194304] 0 2024-05-08T05:32:10.359 INFO:tasks.workunit.client.0.smithi087.stdout:5/700: truncate da/db/d2a/d5a/d93/f40 4971484 0 2024-05-08T05:32:10.359 INFO:tasks.workunit.client.0.smithi087.stdout:9/673: mknod d1/df/d14/d68/cd1 0 2024-05-08T05:32:10.360 INFO:tasks.workunit.client.0.smithi087.stdout:6/682: rmdir d4/d8/df 39 2024-05-08T05:32:10.360 INFO:tasks.workunit.client.0.smithi087.stdout:5/701: unlink da/c14 0 2024-05-08T05:32:10.360 INFO:tasks.workunit.client.0.smithi087.stdout:9/674: mknod d1/df/d14/db1/cd2 0 2024-05-08T05:32:10.361 INFO:tasks.workunit.client.0.smithi087.stdout:6/683: creat d4/d8/fd6 x:0 0 0 2024-05-08T05:32:10.361 INFO:tasks.workunit.client.0.smithi087.stdout:6/684: write d4/d8/fb [1990603,87788] 0 2024-05-08T05:32:10.361 INFO:tasks.workunit.client.0.smithi087.stdout:6/685: truncate d4/d8/df/d1e/d25/d28/d2d/d37/d45/f6b 4380592 0 2024-05-08T05:32:10.362 INFO:tasks.workunit.client.0.smithi087.stdout:5/702: symlink da/db/d2a/d5a/d93/d42/d43/lec 0 2024-05-08T05:32:10.362 INFO:tasks.workunit.client.0.smithi087.stdout:9/675: mknod d1/df/d37/d5b/d7e/cd3 0 2024-05-08T05:32:10.364 INFO:tasks.workunit.client.0.smithi087.stdout:8/625: write db/d23/f2e [1846916,79462] 0 2024-05-08T05:32:10.365 INFO:tasks.workunit.client.0.smithi087.stdout:9/676: rmdir d1/df/d58 39 2024-05-08T05:32:10.365 INFO:tasks.workunit.client.0.smithi087.stdout:9/677: stat d1/f30 0 2024-05-08T05:32:10.366 INFO:tasks.workunit.client.0.smithi087.stdout:8/626: creat db/d23/d3a/fd3 x:0 0 0 2024-05-08T05:32:10.366 INFO:tasks.workunit.client.0.smithi087.stdout:9/678: getdents d1/df/d14/d68/d80/d98/d83 0 2024-05-08T05:32:10.371 INFO:tasks.workunit.client.0.smithi087.stdout:8/627: mknod db/d23/d1b/d35/d43/d68/d6a/cd4 0 2024-05-08T05:32:10.371 INFO:tasks.workunit.client.0.smithi087.stdout:8/628: dread - db/d23/d15/d29/fba zero size 2024-05-08T05:32:10.371 INFO:tasks.workunit.client.0.smithi087.stdout:8/629: fsync db/d23/d15/d29/d4d/f5a 0 2024-05-08T05:32:10.371 INFO:tasks.workunit.client.0.smithi087.stdout:9/679: creat d1/d70/fd4 x:0 0 0 2024-05-08T05:32:10.371 INFO:tasks.workunit.client.0.smithi087.stdout:9/680: read - d1/df/d14/d54/d61/d72/fb3 zero size 2024-05-08T05:32:10.371 INFO:tasks.workunit.client.0.smithi087.stdout:4/680: dwrite d4/d13/d32/d8d/d91/ff4 [0,4194304] 0 2024-05-08T05:32:10.371 INFO:tasks.workunit.client.0.smithi087.stdout:7/776: dwrite d2/d6/d12/d15/f46 [0,4194304] 0 2024-05-08T05:32:10.372 INFO:tasks.workunit.client.0.smithi087.stdout:7/777: chown d2/da/f11 0 1 2024-05-08T05:32:10.373 INFO:tasks.workunit.client.0.smithi087.stdout:9/681: mknod d1/df/d14/d18/db5/cd5 0 2024-05-08T05:32:10.374 INFO:tasks.workunit.client.0.smithi087.stdout:7/778: getdents d2/da/d3f/d72/d77/d54/d55/d65 0 2024-05-08T05:32:10.375 INFO:tasks.workunit.client.0.smithi087.stdout:7/779: write d2/d6/da0/d67/d82/d98/f9c [672234,103756] 0 2024-05-08T05:32:10.375 INFO:tasks.workunit.client.0.smithi087.stdout:9/682: stat d1/d70/l79 0 2024-05-08T05:32:10.376 INFO:tasks.workunit.client.0.smithi087.stdout:3/660: dwrite d4/d11/d24/d39/d5a/f6b [0,4194304] 0 2024-05-08T05:32:10.388 INFO:tasks.workunit.client.0.smithi087.stdout:3/661: rename d4/lf to d4/d5f/dbd/le8 0 2024-05-08T05:32:10.388 INFO:tasks.workunit.client.0.smithi087.stdout:7/780: mkdir d2/d6/da0/dfe 0 2024-05-08T05:32:10.388 INFO:tasks.workunit.client.0.smithi087.stdout:6/686: dread d4/d8/df/d39/d42/d9e/d6f/d84/fbb [0,4194304] 0 2024-05-08T05:32:10.395 INFO:tasks.workunit.client.0.smithi087.stdout:9/683: mknod d1/df/d37/d5b/d7e/d85/cd6 0 2024-05-08T05:32:10.401 INFO:tasks.workunit.client.0.smithi087.stdout:3/662: unlink d4/c33 0 2024-05-08T05:32:10.406 INFO:tasks.workunit.client.0.smithi087.stdout:0/602: sync 2024-05-08T05:32:10.408 INFO:tasks.workunit.client.0.smithi087.stdout:1/566: dwrite df/f24 [0,4194304] 0 2024-05-08T05:32:10.409 INFO:tasks.workunit.client.0.smithi087.stdout:0/603: rename d0/f6c to d0/da/d35/daa/fcf 0 2024-05-08T05:32:10.410 INFO:tasks.workunit.client.0.smithi087.stdout:1/567: chown df/d2f/d4f 3 1 2024-05-08T05:32:10.417 INFO:tasks.workunit.client.0.smithi087.stdout:2/634: dwrite d7/de/d27/d33/faf [0,4194304] 0 2024-05-08T05:32:10.418 INFO:tasks.workunit.client.0.smithi087.stdout:2/635: fdatasync d7/de/d27/d33/f1c 0 2024-05-08T05:32:10.418 INFO:tasks.workunit.client.0.smithi087.stdout:6/687: dread d4/d8/df/d1e/d25/d28/d2d/d37/d45/f6b [0,4194304] 0 2024-05-08T05:32:10.418 INFO:tasks.workunit.client.0.smithi087.stdout:2/636: mkdir d7/de/d27/dd6 0 2024-05-08T05:32:10.419 INFO:tasks.workunit.client.0.smithi087.stdout:6/688: creat d4/d8/df/d39/d42/d94/fd7 x:0 0 0 2024-05-08T05:32:10.423 INFO:tasks.workunit.client.0.smithi087.stdout:2/637: mknod d7/de/d2c/cd7 0 2024-05-08T05:32:10.423 INFO:tasks.workunit.client.0.smithi087.stdout:0/604: mkdir d0/dd0 0 2024-05-08T05:32:10.424 INFO:tasks.workunit.client.0.smithi087.stdout:2/638: mknod d7/de/d27/d33/d65/cd8 0 2024-05-08T05:32:10.424 INFO:tasks.workunit.client.0.smithi087.stdout:2/639: truncate d7/de/d2c/db6/dcb/db7/dc1/fcd 785187 0 2024-05-08T05:32:10.424 INFO:tasks.workunit.client.0.smithi087.stdout:2/640: fdatasync d7/de/d27/d33/d49/db9/fc0 0 2024-05-08T05:32:10.426 INFO:tasks.workunit.client.0.smithi087.stdout:2/641: creat d7/de/d27/d33/d81/fd9 x:0 0 0 2024-05-08T05:32:10.444 INFO:tasks.workunit.client.0.smithi087.stdout:1/568: dread df/d2f/d57/f5d [0,4194304] 0 2024-05-08T05:32:10.445 INFO:tasks.workunit.client.0.smithi087.stdout:1/569: fdatasync df/d2f/d4f/f84 0 2024-05-08T05:32:10.446 INFO:tasks.workunit.client.0.smithi087.stdout:4/681: dwrite d4/d13/d3e/d28/d35/f3a [0,4194304] 0 2024-05-08T05:32:10.447 INFO:tasks.workunit.client.0.smithi087.stdout:4/682: fsync d4/d13/d32/d8d/d91/db8/dba/f68 0 2024-05-08T05:32:10.448 INFO:tasks.workunit.client.0.smithi087.stdout:8/630: dwrite db/d23/d1b/f26 [0,4194304] 0 2024-05-08T05:32:10.451 INFO:tasks.workunit.client.0.smithi087.stdout:8/631: mknod db/d23/d1b/d35/d43/d68/d6f/cd5 0 2024-05-08T05:32:10.452 INFO:tasks.workunit.client.0.smithi087.stdout:8/632: write db/d23/d15/d29/d33/f7f [738468,42654] 0 2024-05-08T05:32:10.463 INFO:tasks.workunit.client.0.smithi087.stdout:4/683: write d4/d13/d3e/d28/d35/f43 [770331,128819] 0 2024-05-08T05:32:10.465 INFO:tasks.workunit.client.0.smithi087.stdout:8/633: dread db/d23/d15/d29/d33/d3b/d56/f87 [0,4194304] 0 2024-05-08T05:32:10.468 INFO:tasks.workunit.client.0.smithi087.stdout:3/663: dwrite d4/d11/d3d/f51 [0,4194304] 0 2024-05-08T05:32:10.471 INFO:tasks.workunit.client.0.smithi087.stdout:9/684: dwrite d1/df/d14/d54/d61/d88/fc6 [0,4194304] 0 2024-05-08T05:32:10.472 INFO:tasks.workunit.client.0.smithi087.stdout:9/685: chown d1/df/d37/d74/l86 92663 1 2024-05-08T05:32:10.472 INFO:tasks.workunit.client.0.smithi087.stdout:7/781: dwrite d2/da/d3f/d72/d77/d54/d55/d65/fe7 [0,4194304] 0 2024-05-08T05:32:10.472 INFO:tasks.workunit.client.0.smithi087.stdout:2/642: dwrite d7/de/d27/d33/d49/f8f [0,4194304] 0 2024-05-08T05:32:10.472 INFO:tasks.workunit.client.0.smithi087.stdout:2/643: chown d7/de/d2c/l88 6830 1 2024-05-08T05:32:10.472 INFO:tasks.workunit.client.0.smithi087.stdout:2/644: chown d7/de/d2c/db0/fba 422 1 2024-05-08T05:32:10.473 INFO:tasks.workunit.client.0.smithi087.stdout:1/570: dread df/d2f/f97 [0,4194304] 0 2024-05-08T05:32:10.473 INFO:tasks.workunit.client.0.smithi087.stdout:3/664: mkdir d4/d11/d24/d25/d4d/dbb/de9 0 2024-05-08T05:32:10.475 INFO:tasks.workunit.client.0.smithi087.stdout:8/634: rmdir db/d23 39 2024-05-08T05:32:10.478 INFO:tasks.workunit.client.0.smithi087.stdout:4/684: dread d4/f4b [0,4194304] 0 2024-05-08T05:32:10.479 INFO:tasks.workunit.client.0.smithi087.stdout:7/782: dread d2/d6/d12/d19/f1e [0,4194304] 0 2024-05-08T05:32:10.479 INFO:tasks.workunit.client.0.smithi087.stdout:6/689: dwrite d4/f97 [0,4194304] 0 2024-05-08T05:32:10.482 INFO:tasks.workunit.client.0.smithi087.stdout:2/645: rmdir d7/de/d2c/db6/dcb/db7/dc1 39 2024-05-08T05:32:10.482 INFO:tasks.workunit.client.0.smithi087.stdout:1/571: creat df/d2f/d57/d64/d83/d96/fc2 x:0 0 0 2024-05-08T05:32:10.483 INFO:tasks.workunit.client.0.smithi087.stdout:1/572: readlink df/d18/d1d/d58/lb5 0 2024-05-08T05:32:10.483 INFO:tasks.workunit.client.0.smithi087.stdout:3/665: truncate d4/d14/dbe/fcc 485601 0 2024-05-08T05:32:10.484 INFO:tasks.workunit.client.0.smithi087.stdout:8/635: mkdir db/d23/d54/dd6 0 2024-05-08T05:32:10.485 INFO:tasks.workunit.client.0.smithi087.stdout:4/685: creat d4/d13/d32/d8d/d91/db8/dba/fff x:0 0 0 2024-05-08T05:32:10.496 INFO:tasks.workunit.client.0.smithi087.stdout:2/646: link d7/de/d55/f56 d7/d63/dac/fda 0 2024-05-08T05:32:10.496 INFO:tasks.workunit.client.0.smithi087.stdout:7/783: creat d2/da/d3f/d72/d77/d54/d55/d65/fff x:0 0 0 2024-05-08T05:32:10.497 INFO:tasks.workunit.client.0.smithi087.stdout:3/666: mkdir d4/d11/d24/d39/dea 0 2024-05-08T05:32:10.497 INFO:tasks.workunit.client.0.smithi087.stdout:2/647: stat d7/de/d2c/db6/dcb/lb2 0 2024-05-08T05:32:10.497 INFO:tasks.workunit.client.0.smithi087.stdout:7/784: dread - d2/da/d3f/d72/d77/d54/fb6 zero size 2024-05-08T05:32:10.497 INFO:tasks.workunit.client.0.smithi087.stdout:4/686: unlink l3 0 2024-05-08T05:32:10.498 INFO:tasks.workunit.client.0.smithi087.stdout:8/636: rmdir db/d23/d1b/d35 39 2024-05-08T05:32:10.499 INFO:tasks.workunit.client.0.smithi087.stdout:8/637: dread - db/d23/d15/f90 zero size 2024-05-08T05:32:10.499 INFO:tasks.workunit.client.0.smithi087.stdout:4/687: write d4/d13/d3e/f36 [1069019,47307] 0 2024-05-08T05:32:10.501 INFO:tasks.workunit.client.0.smithi087.stdout:7/785: mkdir d2/da/d3f/d72/d77/d54/d55/d65/dc3/d100 0 2024-05-08T05:32:10.502 INFO:tasks.workunit.client.0.smithi087.stdout:8/638: creat db/d23/d15/d29/d33/fd7 x:0 0 0 2024-05-08T05:32:10.505 INFO:tasks.workunit.client.0.smithi087.stdout:3/667: rename d4/d14/lab to d4/d5f/dbd/leb 0 2024-05-08T05:32:10.505 INFO:tasks.workunit.client.0.smithi087.stdout:3/668: write d4/d11/d24/d25/d3e/f46 [447349,738] 0 2024-05-08T05:32:10.505 INFO:tasks.workunit.client.0.smithi087.stdout:3/669: write d4/d11/d24/d25/fa3 [3820562,25893] 0 2024-05-08T05:32:10.506 INFO:tasks.workunit.client.0.smithi087.stdout:8/639: mknod db/d23/d3a/d65/d83/cd8 0 2024-05-08T05:32:10.508 INFO:tasks.workunit.client.0.smithi087.stdout:7/786: rmdir d2/db0 39 2024-05-08T05:32:10.511 INFO:tasks.workunit.client.0.smithi087.stdout:7/787: write d2/d6/da0/d67/d82/d98/f9c [304814,39203] 0 2024-05-08T05:32:10.511 INFO:tasks.workunit.client.0.smithi087.stdout:1/573: dread df/d18/d1d/fb0 [0,4194304] 0 2024-05-08T05:32:10.512 INFO:tasks.workunit.client.0.smithi087.stdout:8/640: creat db/d23/d15/d29/fd9 x:0 0 0 2024-05-08T05:32:10.512 INFO:tasks.workunit.client.0.smithi087.stdout:8/641: readlink db/d23/l82 0 2024-05-08T05:32:10.512 INFO:tasks.workunit.client.0.smithi087.stdout:3/670: mkdir d4/d14/d84/d8b/d8f/dec 0 2024-05-08T05:32:10.513 INFO:tasks.workunit.client.0.smithi087.stdout:4/688: dread d4/d13/d32/d8d/d91/fe5 [0,4194304] 0 2024-05-08T05:32:10.513 INFO:tasks.workunit.client.0.smithi087.stdout:1/574: symlink df/d2f/d4f/d52/lc3 0 2024-05-08T05:32:10.513 INFO:tasks.workunit.client.0.smithi087.stdout:1/575: fdatasync df/d2f/d4f/f79 0 2024-05-08T05:32:10.513 INFO:tasks.workunit.client.0.smithi087.stdout:9/686: dwrite d1/df/d14/d54/d61/f53 [0,4194304] 0 2024-05-08T05:32:10.514 INFO:tasks.workunit.client.0.smithi087.stdout:8/642: link db/lb4 db/d23/d1b/d35/d43/daf/lda 0 2024-05-08T05:32:10.514 INFO:tasks.workunit.client.0.smithi087.stdout:8/643: chown db/d23/d15/d29/d4d/c8e 5 1 2024-05-08T05:32:10.515 INFO:tasks.workunit.client.0.smithi087.stdout:3/671: symlink d4/d14/d84/led 0 2024-05-08T05:32:10.515 INFO:tasks.workunit.client.0.smithi087.stdout:3/672: chown d4/d5f/dbd 2814 1 2024-05-08T05:32:10.515 INFO:tasks.workunit.client.0.smithi087.stdout:3/673: getdents d4/d11/d24/d25/d3e/d58/d9b/ddb 0 2024-05-08T05:32:10.517 INFO:tasks.workunit.client.0.smithi087.stdout:4/689: mkdir d4/d13/d3e/d28/d50/d9d/df2/d100 0 2024-05-08T05:32:10.519 INFO:tasks.workunit.client.0.smithi087.stdout:6/690: dwrite d4/d8/df/d39/d42/d9e/d6f/d84/fbb [4194304,4194304] 0 2024-05-08T05:32:10.525 INFO:tasks.workunit.client.0.smithi087.stdout:8/644: dread db/f12 [0,4194304] 0 2024-05-08T05:32:10.527 INFO:tasks.workunit.client.0.smithi087.stdout:8/645: creat db/d23/d1b/d35/d43/fdb x:0 0 0 2024-05-08T05:32:10.529 INFO:tasks.workunit.client.0.smithi087.stdout:9/687: read d1/df/d14/f6e [2720991,27127] 0 2024-05-08T05:32:10.535 INFO:tasks.workunit.client.0.smithi087.stdout:8/646: mkdir db/d23/d15/d29/d33/d6c/dbe/ddc 0 2024-05-08T05:32:10.535 INFO:tasks.workunit.client.0.smithi087.stdout:9/688: rename d1/df/d14/lb6 to d1/df/d14/d18/d8e/da2/ld7 0 2024-05-08T05:32:10.535 INFO:tasks.workunit.client.0.smithi087.stdout:7/788: write d2/da/d3f/d72/d77/d54/d55/d65/fe7 [3643938,31584] 0 2024-05-08T05:32:10.535 INFO:tasks.workunit.client.0.smithi087.stdout:7/789: write d2/d6/d12/d15/f28 [588127,113253] 0 2024-05-08T05:32:10.535 INFO:tasks.workunit.client.0.smithi087.stdout:7/790: getdents d2/da/d3f/d72/d77/d54/d50/d88/df9 0 2024-05-08T05:32:10.535 INFO:tasks.workunit.client.0.smithi087.stdout:7/791: chown d2/d6/d12/c24 3415306 1 2024-05-08T05:32:10.537 INFO:tasks.workunit.client.0.smithi087.stdout:7/792: truncate d2/d6/d12/d1d/fb7 140348 0 2024-05-08T05:32:10.539 INFO:tasks.workunit.client.0.smithi087.stdout:5/703: sync 2024-05-08T05:32:10.540 INFO:tasks.workunit.client.0.smithi087.stdout:0/605: sync 2024-05-08T05:32:10.540 INFO:tasks.workunit.client.0.smithi087.stdout:0/606: write d0/da/d11/f20 [9327159,17155] 0 2024-05-08T05:32:10.542 INFO:tasks.workunit.client.0.smithi087.stdout:7/793: mkdir d2/d6/d12/d15/d5b/dee/d101 0 2024-05-08T05:32:10.543 INFO:tasks.workunit.client.0.smithi087.stdout:7/794: write d2/da/fad [794517,43077] 0 2024-05-08T05:32:10.543 INFO:tasks.workunit.client.0.smithi087.stdout:5/704: chown da/db/d2a/d5a/d93/d42/d50/fb7 52 1 2024-05-08T05:32:10.543 INFO:tasks.workunit.client.0.smithi087.stdout:6/691: dread d4/d8/df/d39/d42/d6a/fd5 [0,4194304] 0 2024-05-08T05:32:10.552 INFO:tasks.workunit.client.0.smithi087.stdout:2/648: dwrite d7/f37 [0,4194304] 0 2024-05-08T05:32:10.554 INFO:tasks.workunit.client.0.smithi087.stdout:2/649: mknod d7/de/d27/dd6/cdb 0 2024-05-08T05:32:10.557 INFO:tasks.workunit.client.0.smithi087.stdout:2/650: mknod d7/cdc 0 2024-05-08T05:32:10.558 INFO:tasks.workunit.client.0.smithi087.stdout:2/651: truncate d7/d63/dac/fda 5065413 0 2024-05-08T05:32:10.559 INFO:tasks.workunit.client.0.smithi087.stdout:7/795: dread d2/d6/d12/d19/d2a/fcf [0,4194304] 0 2024-05-08T05:32:10.560 INFO:tasks.workunit.client.0.smithi087.stdout:7/796: mknod d2/d6/da0/d67/c102 0 2024-05-08T05:32:10.561 INFO:tasks.workunit.client.0.smithi087.stdout:7/797: write d2/da/fcc [4049419,98044] 0 2024-05-08T05:32:10.561 INFO:tasks.workunit.client.0.smithi087.stdout:7/798: chown d2/da/d3f/d72/d77/d54/fde 440 1 2024-05-08T05:32:10.561 INFO:tasks.workunit.client.0.smithi087.stdout:7/799: stat d2/da/d3f/d72/d77/d54/d55/dfc 0 2024-05-08T05:32:10.562 INFO:tasks.workunit.client.0.smithi087.stdout:7/800: fdatasync d2/da/d3f/d49/d59/fe4 0 2024-05-08T05:32:10.562 INFO:tasks.workunit.client.0.smithi087.stdout:7/801: getdents d2/da/d3f/d72/d77/d54 0 2024-05-08T05:32:10.564 INFO:tasks.workunit.client.0.smithi087.stdout:7/802: rename d2/da/f4c to d2/d6/d12/d15/d5b/f103 0 2024-05-08T05:32:10.566 INFO:tasks.workunit.client.0.smithi087.stdout:7/803: rmdir d2/d6/da0/d67/d82 39 2024-05-08T05:32:10.567 INFO:tasks.workunit.client.0.smithi087.stdout:7/804: write d2/da/d3f/d72/d77/d54/d55/d65/dc3/fe3 [105763,75222] 0 2024-05-08T05:32:10.568 INFO:tasks.workunit.client.0.smithi087.stdout:7/805: creat d2/da/d3f/d49/d59/f104 x:0 0 0 2024-05-08T05:32:10.572 INFO:tasks.workunit.client.0.smithi087.stdout:0/607: read d0/da/d35/f80 [3562041,122372] 0 2024-05-08T05:32:10.576 INFO:tasks.workunit.client.0.smithi087.stdout:5/705: dread da/db/d2a/d5a/d93/d42/d50/f6a [0,4194304] 0 2024-05-08T05:32:10.577 INFO:tasks.workunit.client.0.smithi087.stdout:5/706: creat da/dd/d13/da2/dce/fed x:0 0 0 2024-05-08T05:32:10.579 INFO:tasks.workunit.client.0.smithi087.stdout:5/707: getdents da/db/d2a/d46/dbb 0 2024-05-08T05:32:10.579 INFO:tasks.workunit.client.0.smithi087.stdout:2/652: dread d7/f37 [0,4194304] 0 2024-05-08T05:32:10.580 INFO:tasks.workunit.client.0.smithi087.stdout:5/708: mknod da/db/d2a/d5a/d93/d42/d43/d83/de9/cee 0 2024-05-08T05:32:10.580 INFO:tasks.workunit.client.0.smithi087.stdout:5/709: stat da/db/f8f 0 2024-05-08T05:32:10.581 INFO:tasks.workunit.client.0.smithi087.stdout:4/690: dwrite d4/d13/d32/ddb/f82 [0,4194304] 0 2024-05-08T05:32:10.582 INFO:tasks.workunit.client.0.smithi087.stdout:5/710: rename da/db/d2a/d5a/d93/f60 to da/db/d2a/d5a/d93/d36/fef 0 2024-05-08T05:32:10.584 INFO:tasks.workunit.client.0.smithi087.stdout:4/691: chown d4/d13/d32/d8d/d91/db8/dba/dbd/fcb 463 1 2024-05-08T05:32:10.584 INFO:tasks.workunit.client.0.smithi087.stdout:3/674: dwrite d4/d14/f85 [0,4194304] 0 2024-05-08T05:32:10.586 INFO:tasks.workunit.client.0.smithi087.stdout:1/576: dwrite df/d18/d1d/d27/f6d [0,4194304] 0 2024-05-08T05:32:10.586 INFO:tasks.workunit.client.0.smithi087.stdout:1/577: readlink l7 0 2024-05-08T05:32:10.587 INFO:tasks.workunit.client.0.smithi087.stdout:9/689: dread d1/df/d14/f17 [0,4194304] 0 2024-05-08T05:32:10.588 INFO:tasks.workunit.client.0.smithi087.stdout:3/675: rename c0 to d4/d14/dbe/cee 0 2024-05-08T05:32:10.588 INFO:tasks.workunit.client.0.smithi087.stdout:1/578: unlink l1 0 2024-05-08T05:32:10.590 INFO:tasks.workunit.client.0.smithi087.stdout:9/690: creat d1/df/d14/d54/d61/d88/fd8 x:0 0 0 2024-05-08T05:32:10.593 INFO:tasks.workunit.client.0.smithi087.stdout:1/579: unlink df/d18/f30 0 2024-05-08T05:32:10.596 INFO:tasks.workunit.client.0.smithi087.stdout:2/653: write d7/de/d27/f5c [668595,95834] 0 2024-05-08T05:32:10.598 INFO:tasks.workunit.client.0.smithi087.stdout:2/654: getdents d7/de/d5d 0 2024-05-08T05:32:10.598 INFO:tasks.workunit.client.0.smithi087.stdout:2/655: chown d7/de/d27/f8e 91 1 2024-05-08T05:32:10.600 INFO:tasks.workunit.client.0.smithi087.stdout:2/656: rename d7/de/d27/f5c to d7/de/d2c/db6/dcb/db7/fdd 0 2024-05-08T05:32:10.601 INFO:tasks.workunit.client.0.smithi087.stdout:8/647: dwrite db/d23/d15/d29/db1/fbc [0,4194304] 0 2024-05-08T05:32:10.602 INFO:tasks.workunit.client.0.smithi087.stdout:2/657: rename d7/d63/c96 to d7/cde 0 2024-05-08T05:32:10.602 INFO:tasks.workunit.client.0.smithi087.stdout:5/711: dread da/db/d2a/f67 [0,4194304] 0 2024-05-08T05:32:10.603 INFO:tasks.workunit.client.0.smithi087.stdout:8/648: creat db/d23/d15/d29/d33/d6c/fdd x:0 0 0 2024-05-08T05:32:10.604 INFO:tasks.workunit.client.0.smithi087.stdout:2/658: creat d7/de/d5d/d7b/fdf x:0 0 0 2024-05-08T05:32:10.605 INFO:tasks.workunit.client.0.smithi087.stdout:7/806: dread d2/d6/d12/d15/f28 [0,4194304] 0 2024-05-08T05:32:10.606 INFO:tasks.workunit.client.0.smithi087.stdout:2/659: link d7/de/d27/d33/d65/c87 d7/d63/ce0 0 2024-05-08T05:32:10.606 INFO:tasks.workunit.client.0.smithi087.stdout:4/692: dread d4/d13/d65/f6f [0,4194304] 0 2024-05-08T05:32:10.608 INFO:tasks.workunit.client.0.smithi087.stdout:5/712: mkdir da/dd/d13/df0 0 2024-05-08T05:32:10.617 INFO:tasks.workunit.client.0.smithi087.stdout:4/693: creat d4/d13/d32/f101 x:0 0 0 2024-05-08T05:32:10.624 INFO:tasks.workunit.client.0.smithi087.stdout:9/691: write d1/df/d14/d68/d80/d98/f5d [3333514,33924] 0 2024-05-08T05:32:10.626 INFO:tasks.workunit.client.0.smithi087.stdout:5/713: write da/db/d2a/d5a/d93/d36/dc1/f26 [473028,24280] 0 2024-05-08T05:32:10.626 INFO:tasks.workunit.client.0.smithi087.stdout:4/694: link d4/d13/d3e/l55 d4/d13/d65/l102 0 2024-05-08T05:32:10.628 INFO:tasks.workunit.client.0.smithi087.stdout:9/692: creat d1/df/d14/d54/d61/d72/fd9 x:0 0 0 2024-05-08T05:32:10.632 INFO:tasks.workunit.client.0.smithi087.stdout:7/807: dread d2/d6/d12/d19/d2a/fcf [0,4194304] 0 2024-05-08T05:32:10.632 INFO:tasks.workunit.client.0.smithi087.stdout:7/808: fsync d2/d6/d12/dc5/fd0 0 2024-05-08T05:32:10.632 INFO:tasks.workunit.client.0.smithi087.stdout:4/695: creat d4/d13/d32/f103 x:0 0 0 2024-05-08T05:32:10.636 INFO:tasks.workunit.client.0.smithi087.stdout:9/693: rename d1/df/d14/d68/d80/d98/l41 to d1/df/d37/d74/lda 0 2024-05-08T05:32:10.636 INFO:tasks.workunit.client.0.smithi087.stdout:4/696: mknod d4/d13/d3e/d28/d50/d9d/c104 0 2024-05-08T05:32:10.636 INFO:tasks.workunit.client.0.smithi087.stdout:5/714: dread da/db/d2a/f32 [4194304,4194304] 0 2024-05-08T05:32:10.636 INFO:tasks.workunit.client.0.smithi087.stdout:5/715: dread - da/db/d2a/d46/d69/fa7 zero size 2024-05-08T05:32:10.636 INFO:tasks.workunit.client.0.smithi087.stdout:5/716: stat da/db/d2a/d5a/d93/d17/f28 0 2024-05-08T05:32:10.637 INFO:tasks.workunit.client.0.smithi087.stdout:5/717: mkdir da/db/d2a/d46/dc6/df1 0 2024-05-08T05:32:10.638 INFO:tasks.workunit.client.0.smithi087.stdout:5/718: truncate da/db/d2a/d5a/d93/d36/dc1/fda 195444 0 2024-05-08T05:32:10.639 INFO:tasks.workunit.client.0.smithi087.stdout:5/719: write da/db/d2a/d5a/d93/d42/f9d [618693,119252] 0 2024-05-08T05:32:10.639 INFO:tasks.workunit.client.0.smithi087.stdout:5/720: fdatasync da/db/d2a/d5a/d93/d42/d50/f52 0 2024-05-08T05:32:10.642 INFO:tasks.workunit.client.0.smithi087.stdout:7/809: rename d2/d6/d12/d19/d2a/d89/da3/ldc to d2/da/l105 0 2024-05-08T05:32:10.644 INFO:tasks.workunit.client.0.smithi087.stdout:7/810: creat d2/da/d3f/d66/f106 x:0 0 0 2024-05-08T05:32:10.646 INFO:tasks.workunit.client.0.smithi087.stdout:1/580: read df/d18/d1d/d32/f6e [637261,34416] 0 2024-05-08T05:32:10.647 INFO:tasks.workunit.client.0.smithi087.stdout:5/721: rename da/dd/d94/la0 to da/db/d2a/d5a/d93/d36/d45/d5c/d86/lf2 0 2024-05-08T05:32:10.652 INFO:tasks.workunit.client.0.smithi087.stdout:9/694: dread d1/df/d14/d18/f67 [0,4194304] 0 2024-05-08T05:32:10.653 INFO:tasks.workunit.client.0.smithi087.stdout:6/692: dwrite d4/d8/f3b [0,4194304] 0 2024-05-08T05:32:10.653 INFO:tasks.workunit.client.0.smithi087.stdout:9/695: dread - d1/df/d14/d18/db5/fcc zero size 2024-05-08T05:32:10.653 INFO:tasks.workunit.client.0.smithi087.stdout:1/581: rename df/f5c to df/d2f/d57/da0/fc4 0 2024-05-08T05:32:10.653 INFO:tasks.workunit.client.0.smithi087.stdout:0/608: dwrite d0/f29 [0,4194304] 0 2024-05-08T05:32:10.653 INFO:tasks.workunit.client.0.smithi087.stdout:0/609: truncate d0/d9/d1b/d2f/d54/da1/fa5 2256186 0 2024-05-08T05:32:10.655 INFO:tasks.workunit.client.0.smithi087.stdout:6/693: mknod d4/d8/df/d39/d42/cd8 0 2024-05-08T05:32:10.658 INFO:tasks.workunit.client.0.smithi087.stdout:9/696: mknod d1/df/d14/d68/cdb 0 2024-05-08T05:32:10.658 INFO:tasks.workunit.client.0.smithi087.stdout:0/610: rename d0/da/d35/f58 to d0/da/d35/fd1 0 2024-05-08T05:32:10.663 INFO:tasks.workunit.client.0.smithi087.stdout:9/697: creat d1/df/d14/d68/d80/d98/d28/fdc x:0 0 0 2024-05-08T05:32:10.666 INFO:tasks.workunit.client.0.smithi087.stdout:3/676: dwrite d4/d11/d24/d25/d3e/f46 [0,4194304] 0 2024-05-08T05:32:10.666 INFO:tasks.workunit.client.0.smithi087.stdout:3/677: write d4/d11/d24/d39/d60/fe5 [972063,107055] 0 2024-05-08T05:32:10.666 INFO:tasks.workunit.client.0.smithi087.stdout:3/678: chown d4/d11/d24/d39/d60/d87/da5 2 1 2024-05-08T05:32:10.666 INFO:tasks.workunit.client.0.smithi087.stdout:3/679: readlink d4/d11/d24/d25/d3e/d3f/l44 0 2024-05-08T05:32:10.666 INFO:tasks.workunit.client.0.smithi087.stdout:8/649: dwrite db/d23/f2e [0,4194304] 0 2024-05-08T05:32:10.667 INFO:tasks.workunit.client.0.smithi087.stdout:8/650: chown f3 3098328 1 2024-05-08T05:32:10.667 INFO:tasks.workunit.client.0.smithi087.stdout:8/651: getdents db/d23/d54/d9d 0 2024-05-08T05:32:10.668 INFO:tasks.workunit.client.0.smithi087.stdout:1/582: write df/f3b [1184847,88578] 0 2024-05-08T05:32:10.671 INFO:tasks.workunit.client.0.smithi087.stdout:0/611: link d0/da/d35/d86/d74/c52 d0/da/cd2 0 2024-05-08T05:32:10.672 INFO:tasks.workunit.client.0.smithi087.stdout:9/698: truncate d1/fa 6088880 0 2024-05-08T05:32:10.675 INFO:tasks.workunit.client.0.smithi087.stdout:3/680: link d4/d11/d24/d39/d5a/l90 d4/d5f/dbd/lef 0 2024-05-08T05:32:10.679 INFO:tasks.workunit.client.0.smithi087.stdout:1/583: mkdir df/d18/d1d/d58/d72/dc5 0 2024-05-08T05:32:10.680 INFO:tasks.workunit.client.0.smithi087.stdout:0/612: rename d0/d22/d3c/dbb/lbc to d0/da/d35/d86/d9a/dc9/ld3 0 2024-05-08T05:32:10.680 INFO:tasks.workunit.client.0.smithi087.stdout:0/613: truncate d0/d57/d24/d66/f6e 4226899 0 2024-05-08T05:32:10.681 INFO:tasks.workunit.client.0.smithi087.stdout:3/681: mknod d4/d14/d84/d8b/d8f/cf0 0 2024-05-08T05:32:10.681 INFO:tasks.workunit.client.0.smithi087.stdout:7/811: dread d2/d6/d12/d19/d2a/f8c [0,4194304] 0 2024-05-08T05:32:10.681 INFO:tasks.workunit.client.0.smithi087.stdout:7/812: chown d2/d6/fd3 115 1 2024-05-08T05:32:10.682 INFO:tasks.workunit.client.0.smithi087.stdout:7/813: read d2/d6/d12/d1d/fae [194211,71308] 0 2024-05-08T05:32:10.682 INFO:tasks.workunit.client.0.smithi087.stdout:2/660: dwrite d7/de/d5d/f91 [0,4194304] 0 2024-05-08T05:32:10.682 INFO:tasks.workunit.client.0.smithi087.stdout:9/699: rmdir d1/df/d58 39 2024-05-08T05:32:10.683 INFO:tasks.workunit.client.0.smithi087.stdout:8/652: dread f4 [0,4194304] 0 2024-05-08T05:32:10.687 INFO:tasks.workunit.client.0.smithi087.stdout:7/814: dread d2/da/d3f/d72/d77/d54/d55/d65/fb5 [0,4194304] 0 2024-05-08T05:32:10.687 INFO:tasks.workunit.client.0.smithi087.stdout:6/694: dread d4/d8/df/d39/f7a [0,4194304] 0 2024-05-08T05:32:10.701 INFO:tasks.workunit.client.0.smithi087.stdout:0/614: creat d0/dd0/fd4 x:0 0 0 2024-05-08T05:32:10.701 INFO:tasks.workunit.client.0.smithi087.stdout:0/615: write d0/da/f78 [2935204,21085] 0 2024-05-08T05:32:10.701 INFO:tasks.workunit.client.0.smithi087.stdout:0/616: dread - d0/d9/fb5 zero size 2024-05-08T05:32:10.705 INFO:tasks.workunit.client.0.smithi087.stdout:2/661: link d7/de/l35 d7/de/d2c/le1 0 2024-05-08T05:32:10.706 INFO:tasks.workunit.client.0.smithi087.stdout:8/653: truncate db/d23/d15/d3c/f3e 4023338 0 2024-05-08T05:32:10.706 INFO:tasks.workunit.client.0.smithi087.stdout:8/654: fdatasync db/d23/d15/d29/d33/d3b/d56/d78/fa5 0 2024-05-08T05:32:10.708 INFO:tasks.workunit.client.0.smithi087.stdout:7/815: mkdir d2/da/d3f/d72/d77/d54/dd9/d107 0 2024-05-08T05:32:10.708 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:32:10 smithi087 ceph-mon[29523]: pgmap v515: 97 pgs: 97 active+clean; 971 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 120 MiB/s rd, 146 MiB/s wr, 652 op/s 2024-05-08T05:32:10.708 INFO:tasks.workunit.client.0.smithi087.stdout:0/617: dread d0/da/d35/fbd [0,4194304] 0 2024-05-08T05:32:10.708 INFO:tasks.workunit.client.0.smithi087.stdout:7/816: fsync d2/da/d3f/d72/d77/d54/d50/d88/fe5 0 2024-05-08T05:32:10.708 INFO:tasks.workunit.client.0.smithi087.stdout:0/618: chown d0/d9/d1b/d2f/d54/f89 12137191 1 2024-05-08T05:32:10.709 INFO:tasks.workunit.client.0.smithi087.stdout:1/584: rename df/d18/d1d/d27/fa2 to df/d18/d1d/d32/fc6 0 2024-05-08T05:32:10.710 INFO:tasks.workunit.client.0.smithi087.stdout:2/662: symlink d7/de/db1/dbe/le2 0 2024-05-08T05:32:10.711 INFO:tasks.workunit.client.0.smithi087.stdout:8/655: creat db/d23/d1b/d35/d43/fde x:0 0 0 2024-05-08T05:32:10.713 INFO:tasks.workunit.client.0.smithi087.stdout:0/619: creat d0/d9/d1b/d2f/d54/fd5 x:0 0 0 2024-05-08T05:32:10.714 INFO:tasks.workunit.client.0.smithi087.stdout:1/585: creat df/d18/d1d/d27/d90/fc7 x:0 0 0 2024-05-08T05:32:10.714 INFO:tasks.workunit.client.0.smithi087.stdout:1/586: chown df/c17 123628 1 2024-05-08T05:32:10.716 INFO:tasks.workunit.client.0.smithi087.stdout:2/663: creat d7/de/d2c/db0/fe3 x:0 0 0 2024-05-08T05:32:10.717 INFO:tasks.workunit.client.0.smithi087.stdout:8/656: rename db/d23/d15/d29/d33/d6c/l7d to db/d23/d3a/d65/d83/dc5/ldf 0 2024-05-08T05:32:10.717 INFO:tasks.workunit.client.0.smithi087.stdout:8/657: stat db/d23/d1b/d7c/c8a 0 2024-05-08T05:32:10.718 INFO:tasks.workunit.client.0.smithi087.stdout:7/817: mkdir d2/d6/d12/d19/d108 0 2024-05-08T05:32:10.719 INFO:tasks.workunit.client.0.smithi087.stdout:7/818: stat d2/d6/d12/d19/d2a/d91 0 2024-05-08T05:32:10.719 INFO:tasks.workunit.client.0.smithi087.stdout:5/722: dwrite da/db/d2a/d5a/d93/d17/f2b [0,4194304] 0 2024-05-08T05:32:10.719 INFO:tasks.workunit.client.0.smithi087.stdout:3/682: dread d4/d11/d24/f26 [0,4194304] 0 2024-05-08T05:32:10.719 INFO:tasks.workunit.client.0.smithi087.stdout:3/683: chown d4/d11/d3d/c7f 1401685 1 2024-05-08T05:32:10.720 INFO:tasks.workunit.client.0.smithi087.stdout:0/620: mknod d0/d9/d1b/d2f/d54/da1/cd6 0 2024-05-08T05:32:10.722 INFO:tasks.workunit.client.0.smithi087.stdout:1/587: link df/c17 df/d2f/d57/d64/d83/d96/cc8 0 2024-05-08T05:32:10.722 INFO:tasks.workunit.client.0.smithi087.stdout:1/588: chown df/d18/d1d/d27/d61/f92 86 1 2024-05-08T05:32:10.722 INFO:tasks.workunit.client.0.smithi087.stdout:1/589: dread - df/d2f/d4f/f93 zero size 2024-05-08T05:32:10.727 INFO:tasks.workunit.client.0.smithi087.stdout:2/664: mkdir d7/de/d55/de4 0 2024-05-08T05:32:10.727 INFO:tasks.workunit.client.0.smithi087.stdout:8/658: mknod db/d23/d54/dd6/ce0 0 2024-05-08T05:32:10.727 INFO:tasks.workunit.client.0.smithi087.stdout:8/659: dread - db/d23/d15/d29/d33/fd7 zero size 2024-05-08T05:32:10.727 INFO:tasks.workunit.client.0.smithi087.stdout:5/723: symlink da/db/d2a/d5a/d93/d42/d50/dd0/lf3 0 2024-05-08T05:32:10.727 INFO:tasks.workunit.client.0.smithi087.stdout:3/684: truncate d4/f5c 282557 0 2024-05-08T05:32:10.728 INFO:tasks.workunit.client.0.smithi087.stdout:7/819: rmdir d2/da/d3f/d49/d59 39 2024-05-08T05:32:10.730 INFO:tasks.workunit.client.0.smithi087.stdout:0/621: mknod d0/d22/d3c/cd7 0 2024-05-08T05:32:10.730 INFO:tasks.workunit.client.0.smithi087.stdout:0/622: stat d0/d9/d90 0 2024-05-08T05:32:10.732 INFO:tasks.workunit.client.0.smithi087.stdout:6/695: dwrite d4/d8/df/d39/f7a [0,4194304] 0 2024-05-08T05:32:10.732 INFO:tasks.workunit.client.0.smithi087.stdout:8/660: link db/d23/d15/d29/d33/fd7 db/d23/d15/d29/d33/fe1 0 2024-05-08T05:32:10.733 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:32:10 smithi090 ceph-mon[34526]: pgmap v515: 97 pgs: 97 active+clean; 971 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 120 MiB/s rd, 146 MiB/s wr, 652 op/s 2024-05-08T05:32:10.736 INFO:tasks.workunit.client.0.smithi087.stdout:0/623: link d0/da/d35/f37 d0/da/d35/d86/d74/fd8 0 2024-05-08T05:32:10.737 INFO:tasks.workunit.client.0.smithi087.stdout:5/724: rmdir da/db/d2a/d5a 39 2024-05-08T05:32:10.737 INFO:tasks.workunit.client.0.smithi087.stdout:5/725: truncate da/db/d2a/d5a/d93/d36/d45/d5c/d86/fbf 606940 0 2024-05-08T05:32:10.739 INFO:tasks.workunit.client.0.smithi087.stdout:7/820: rmdir d2/da/d3f/d72/d77/d54 39 2024-05-08T05:32:10.739 INFO:tasks.workunit.client.0.smithi087.stdout:9/700: dwrite d1/f30 [0,4194304] 0 2024-05-08T05:32:10.739 INFO:tasks.workunit.client.0.smithi087.stdout:9/701: read - d1/df/d14/d54/f64 zero size 2024-05-08T05:32:10.739 INFO:tasks.workunit.client.0.smithi087.stdout:9/702: chown d1/df/d37/d74/c93 426360712 1 2024-05-08T05:32:10.741 INFO:tasks.workunit.client.0.smithi087.stdout:2/665: dread d7/de/d82/fa2 [0,4194304] 0 2024-05-08T05:32:10.742 INFO:tasks.workunit.client.0.smithi087.stdout:6/696: symlink d4/ld9 0 2024-05-08T05:32:10.742 INFO:tasks.workunit.client.0.smithi087.stdout:6/697: readlink d4/d8/l62 0 2024-05-08T05:32:10.743 INFO:tasks.workunit.client.0.smithi087.stdout:8/661: dread db/d23/f64 [0,4194304] 0 2024-05-08T05:32:10.749 INFO:tasks.workunit.client.0.smithi087.stdout:9/703: write d1/df/f12 [1519603,101501] 0 2024-05-08T05:32:10.749 INFO:tasks.workunit.client.0.smithi087.stdout:9/704: truncate d1/df/d37/d5b/d7e/f9b 4453564 0 2024-05-08T05:32:10.755 INFO:tasks.workunit.client.0.smithi087.stdout:7/821: symlink d2/da/d3f/d49/daf/l109 0 2024-05-08T05:32:10.755 INFO:tasks.workunit.client.0.smithi087.stdout:7/822: readlink d2/d6/d12/d15/d5b/lb8 0 2024-05-08T05:32:10.755 INFO:tasks.workunit.client.0.smithi087.stdout:7/823: truncate d2/d6/d12/f97 761003 0 2024-05-08T05:32:10.755 INFO:tasks.workunit.client.0.smithi087.stdout:7/824: read d2/da/fad [828470,3523] 0 2024-05-08T05:32:10.755 INFO:tasks.workunit.client.0.smithi087.stdout:8/662: creat db/d23/d54/d9d/fe2 x:0 0 0 2024-05-08T05:32:10.755 INFO:tasks.workunit.client.0.smithi087.stdout:6/698: rmdir d4/d8/df/d39/d42/d9e/d6f 39 2024-05-08T05:32:10.756 INFO:tasks.workunit.client.0.smithi087.stdout:9/705: creat d1/fdd x:0 0 0 2024-05-08T05:32:10.756 INFO:tasks.workunit.client.0.smithi087.stdout:9/706: dread - d1/df/d14/d18/db5/fb8 zero size 2024-05-08T05:32:10.761 INFO:tasks.workunit.client.0.smithi087.stdout:8/663: rmdir db/d23/d1b/d35/d43 39 2024-05-08T05:32:10.763 INFO:tasks.workunit.client.0.smithi087.stdout:2/666: read d7/de/d2c/f4c [3342089,124567] 0 2024-05-08T05:32:10.765 INFO:tasks.workunit.client.0.smithi087.stdout:2/667: write d7/de/d2c/f89 [206336,118741] 0 2024-05-08T05:32:10.773 INFO:tasks.workunit.client.0.smithi087.stdout:9/707: dread d1/df/d14/d68/d80/d98/d83/fb2 [0,4194304] 0 2024-05-08T05:32:10.773 INFO:tasks.workunit.client.0.smithi087.stdout:9/708: fsync d1/df/d14/d54/d61/d72/fc4 0 2024-05-08T05:32:10.773 INFO:tasks.workunit.client.0.smithi087.stdout:9/709: write d1/f1a [5166089,125764] 0 2024-05-08T05:32:10.780 INFO:tasks.workunit.client.0.smithi087.stdout:4/697: sync 2024-05-08T05:32:10.781 INFO:tasks.workunit.client.0.smithi087.stdout:4/698: creat d4/d13/d3e/d28/d35/f105 x:0 0 0 2024-05-08T05:32:10.784 INFO:tasks.workunit.client.0.smithi087.stdout:5/726: dwrite da/db/d2a/d5a/d93/d42/d50/f6a [0,4194304] 0 2024-05-08T05:32:10.788 INFO:tasks.workunit.client.0.smithi087.stdout:9/710: dread d1/df/d14/d18/f67 [0,4194304] 0 2024-05-08T05:32:10.788 INFO:tasks.workunit.client.0.smithi087.stdout:9/711: dread - d1/df/d14/d54/d61/d72/fc4 zero size 2024-05-08T05:32:10.788 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:32:10 smithi160 ceph-mon[34827]: pgmap v515: 97 pgs: 97 active+clean; 971 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 120 MiB/s rd, 146 MiB/s wr, 652 op/s 2024-05-08T05:32:10.793 INFO:tasks.workunit.client.0.smithi087.stdout:9/712: mkdir d1/df/d14/d54/d61/d88/dde 0 2024-05-08T05:32:10.794 INFO:tasks.workunit.client.0.smithi087.stdout:6/699: dread d4/d8/df/d1e/d25/f3f [0,4194304] 0 2024-05-08T05:32:10.795 INFO:tasks.workunit.client.0.smithi087.stdout:9/713: write d1/df/d14/d68/d80/d98/f10 [4867642,43352] 0 2024-05-08T05:32:10.796 INFO:tasks.workunit.client.0.smithi087.stdout:9/714: truncate d1/f30 2364086 0 2024-05-08T05:32:10.799 INFO:tasks.workunit.client.0.smithi087.stdout:9/715: rename d1/df/d14/d18/db5/fcc to d1/df/d14/d68/fdf 0 2024-05-08T05:32:10.799 INFO:tasks.workunit.client.0.smithi087.stdout:9/716: fdatasync d1/df/d37/f6d 0 2024-05-08T05:32:10.799 INFO:tasks.workunit.client.0.smithi087.stdout:9/717: write d1/fd [2243701,24870] 0 2024-05-08T05:32:10.800 INFO:tasks.workunit.client.0.smithi087.stdout:9/718: symlink d1/df/d14/d54/d61/d88/le0 0 2024-05-08T05:32:10.801 INFO:tasks.workunit.client.0.smithi087.stdout:9/719: write d1/df/d14/d68/d80/d98/d28/d4b/f71 [1527504,119530] 0 2024-05-08T05:32:10.802 INFO:tasks.workunit.client.0.smithi087.stdout:9/720: stat d1/df/d14/d18/db5/ccd 0 2024-05-08T05:32:10.802 INFO:tasks.workunit.client.0.smithi087.stdout:1/590: dwrite df/f3b [0,4194304] 0 2024-05-08T05:32:10.807 INFO:tasks.workunit.client.0.smithi087.stdout:1/591: symlink df/d2f/d4f/lc9 0 2024-05-08T05:32:10.807 INFO:tasks.workunit.client.0.smithi087.stdout:1/592: truncate df/d2f/d4f/f5a 30706 0 2024-05-08T05:32:10.807 INFO:tasks.workunit.client.0.smithi087.stdout:9/721: creat d1/df/d37/d5b/d7e/d85/fe1 x:0 0 0 2024-05-08T05:32:10.810 INFO:tasks.workunit.client.0.smithi087.stdout:1/593: symlink df/d18/d1d/d27/d61/lca 0 2024-05-08T05:32:10.816 INFO:tasks.workunit.client.0.smithi087.stdout:9/722: creat d1/df/d14/d68/d80/d98/fe2 x:0 0 0 2024-05-08T05:32:10.816 INFO:tasks.workunit.client.0.smithi087.stdout:6/700: dread d4/d8/df/d39/d42/d9e/f81 [0,4194304] 0 2024-05-08T05:32:10.817 INFO:tasks.workunit.client.0.smithi087.stdout:6/701: creat d4/d8/df/d1e/d25/fda x:0 0 0 2024-05-08T05:32:10.817 INFO:tasks.workunit.client.0.smithi087.stdout:6/702: write d4/d8/df/d1e/d25/f92 [1014628,89328] 0 2024-05-08T05:32:10.817 INFO:tasks.workunit.client.0.smithi087.stdout:1/594: mkdir df/d2f/d57/dcb 0 2024-05-08T05:32:10.819 INFO:tasks.workunit.client.0.smithi087.stdout:1/595: rename df/d2f/d4f/f55 to df/d18/d1d/d32/d9c/fcc 0 2024-05-08T05:32:10.823 INFO:tasks.workunit.client.0.smithi087.stdout:6/703: mknod d4/d8/df/d39/d42/d9e/d6f/cdb 0 2024-05-08T05:32:10.823 INFO:tasks.workunit.client.0.smithi087.stdout:1/596: link df/d18/d1d/c60 df/d2f/d57/d64/ccd 0 2024-05-08T05:32:10.824 INFO:tasks.workunit.client.0.smithi087.stdout:1/597: unlink df/d18/d8b/c98 0 2024-05-08T05:32:10.824 INFO:tasks.workunit.client.0.smithi087.stdout:1/598: chown df/d2f/d57/d64/d83 87 1 2024-05-08T05:32:10.824 INFO:tasks.workunit.client.0.smithi087.stdout:1/599: fdatasync df/d18/d1d/d58/d72/f75 0 2024-05-08T05:32:10.826 INFO:tasks.workunit.client.0.smithi087.stdout:1/600: creat df/d2f/d57/d64/d83/d96/fce x:0 0 0 2024-05-08T05:32:10.827 INFO:tasks.workunit.client.0.smithi087.stdout:1/601: write df/d18/d1d/d32/fc6 [746859,74619] 0 2024-05-08T05:32:10.829 INFO:tasks.workunit.client.0.smithi087.stdout:1/602: mkdir df/d2f/d57/d64/d83/d96/dcf 0 2024-05-08T05:32:10.832 INFO:tasks.workunit.client.0.smithi087.stdout:1/603: rename df/d18/d4b to df/d2f/d57/dd0 0 2024-05-08T05:32:10.840 INFO:tasks.workunit.client.0.smithi087.stdout:5/727: write da/db/d2a/d5a/d93/d17/f2b [878335,53925] 0 2024-05-08T05:32:10.841 INFO:tasks.workunit.client.0.smithi087.stdout:5/728: fsync da/db/d2a/d5a/d93/d36/d45/f4d 0 2024-05-08T05:32:10.841 INFO:tasks.workunit.client.0.smithi087.stdout:8/664: dwrite db/d23/d1b/d35/d43/f50 [0,4194304] 0 2024-05-08T05:32:10.841 INFO:tasks.workunit.client.0.smithi087.stdout:8/665: chown db/d23/d15/d29/d33/d3b/c9f 9858 1 2024-05-08T05:32:10.841 INFO:tasks.workunit.client.0.smithi087.stdout:1/604: creat df/d2f/d57/da0/fd1 x:0 0 0 2024-05-08T05:32:10.841 INFO:tasks.workunit.client.0.smithi087.stdout:7/825: dwrite d2/d6/d12/dc5/fe1 [0,4194304] 0 2024-05-08T05:32:10.846 INFO:tasks.workunit.client.0.smithi087.stdout:5/729: creat da/db/d2a/d5a/d93/d42/d43/ff4 x:0 0 0 2024-05-08T05:32:10.846 INFO:tasks.workunit.client.0.smithi087.stdout:2/668: dwrite f3 [0,4194304] 0 2024-05-08T05:32:10.848 INFO:tasks.workunit.client.0.smithi087.stdout:8/666: mknod db/d23/d1b/d35/d43/d68/ce3 0 2024-05-08T05:32:10.849 INFO:tasks.workunit.client.0.smithi087.stdout:7/826: creat d2/da/d3f/d49/f10a x:0 0 0 2024-05-08T05:32:10.852 INFO:tasks.workunit.client.0.smithi087.stdout:2/669: mknod d7/ce5 0 2024-05-08T05:32:10.853 INFO:tasks.workunit.client.0.smithi087.stdout:8/667: rmdir db/d23/d15/d29/d4d/d96 39 2024-05-08T05:32:10.855 INFO:tasks.workunit.client.0.smithi087.stdout:7/827: creat d2/d6/d12/d1d/f10b x:0 0 0 2024-05-08T05:32:10.857 INFO:tasks.workunit.client.0.smithi087.stdout:8/668: rename db/d23/d3a/l4e to db/d23/d15/d29/d33/d6c/db6/le4 0 2024-05-08T05:32:10.857 INFO:tasks.workunit.client.0.smithi087.stdout:8/669: truncate db/d23/d15/d29/d4d/f5a 1003153 0 2024-05-08T05:32:10.857 INFO:tasks.workunit.client.0.smithi087.stdout:8/670: fdatasync db/d23/d15/d29/d33/d6c/fb8 0 2024-05-08T05:32:10.857 INFO:tasks.workunit.client.0.smithi087.stdout:8/671: dread - db/d23/d15/d29/d4d/d96/fc8 zero size 2024-05-08T05:32:10.857 INFO:tasks.workunit.client.0.smithi087.stdout:8/672: chown db/d23/d1b/d35/d43/d68/ce3 0 1 2024-05-08T05:32:10.859 INFO:tasks.workunit.client.0.smithi087.stdout:8/673: unlink db/d23/c1a 0 2024-05-08T05:32:10.861 INFO:tasks.workunit.client.0.smithi087.stdout:8/674: mknod db/d23/d15/d29/ce5 0 2024-05-08T05:32:10.862 INFO:tasks.workunit.client.0.smithi087.stdout:8/675: unlink db/d23/d54/dd6/ce0 0 2024-05-08T05:32:10.864 INFO:tasks.workunit.client.0.smithi087.stdout:4/699: dwrite d4/d13/d32/d8d/d91/fe5 [0,4194304] 0 2024-05-08T05:32:10.864 INFO:tasks.workunit.client.0.smithi087.stdout:8/676: link db/lb4 db/d23/d15/d3c/le6 0 2024-05-08T05:32:10.865 INFO:tasks.workunit.client.0.smithi087.stdout:5/730: write da/db/d2a/d5a/d93/d36/f76 [2960157,46534] 0 2024-05-08T05:32:10.865 INFO:tasks.workunit.client.0.smithi087.stdout:7/828: dread d2/d6/d12/d1d/fae [0,4194304] 0 2024-05-08T05:32:10.866 INFO:tasks.workunit.client.0.smithi087.stdout:8/677: creat db/d23/d3a/d65/d83/fe7 x:0 0 0 2024-05-08T05:32:10.866 INFO:tasks.workunit.client.0.smithi087.stdout:8/678: write db/d23/d15/f85 [1595626,104947] 0 2024-05-08T05:32:10.868 INFO:tasks.workunit.client.0.smithi087.stdout:7/829: mknod d2/d6/d12/d19/d2a/c10c 0 2024-05-08T05:32:10.868 INFO:tasks.workunit.client.0.smithi087.stdout:5/731: truncate da/db/d2a/d5a/d93/d42/d50/fb7 265210 0 2024-05-08T05:32:10.869 INFO:tasks.workunit.client.0.smithi087.stdout:8/679: rename db/d23/d15/d29/d33/d3b/d56/fab to db/d23/d1b/d35/d43/d68/d6a/fe8 0 2024-05-08T05:32:10.870 INFO:tasks.workunit.client.0.smithi087.stdout:6/704: dwrite d4/d8/fb6 [0,4194304] 0 2024-05-08T05:32:10.874 INFO:tasks.workunit.client.0.smithi087.stdout:2/670: dread d7/de/d27/d33/f21 [0,4194304] 0 2024-05-08T05:32:10.874 INFO:tasks.workunit.client.0.smithi087.stdout:2/671: dread - d7/de/d2c/fa4 zero size 2024-05-08T05:32:10.874 INFO:tasks.workunit.client.0.smithi087.stdout:2/672: readlink d7/de/d27/d33/d49/ld1 0 2024-05-08T05:32:10.874 INFO:tasks.workunit.client.0.smithi087.stdout:2/673: truncate d7/de/d27/d33/f76 1495688 0 2024-05-08T05:32:10.874 INFO:tasks.workunit.client.0.smithi087.stdout:7/830: symlink d2/d6/l10d 0 2024-05-08T05:32:10.874 INFO:tasks.workunit.client.0.smithi087.stdout:5/732: symlink da/db/d2a/d5a/d93/d42/de8/lf5 0 2024-05-08T05:32:10.876 INFO:tasks.workunit.client.0.smithi087.stdout:6/705: creat d4/d8/df/d1e/d25/d28/d57/d6d/fdc x:0 0 0 2024-05-08T05:32:10.876 INFO:tasks.workunit.client.0.smithi087.stdout:6/706: dread - d4/d8/df/d1e/d25/d28/d57/d6d/fbf zero size 2024-05-08T05:32:10.877 INFO:tasks.workunit.client.0.smithi087.stdout:9/723: dwrite d1/df/d14/d68/d80/d98/d28/f4a [0,4194304] 0 2024-05-08T05:32:10.877 INFO:tasks.workunit.client.0.smithi087.stdout:9/724: write d1/df/d37/d5b/f6f [308192,23977] 0 2024-05-08T05:32:10.877 INFO:tasks.workunit.client.0.smithi087.stdout:4/700: dread d4/d13/fa1 [0,4194304] 0 2024-05-08T05:32:10.880 INFO:tasks.workunit.client.0.smithi087.stdout:2/674: creat d7/de/fe6 x:0 0 0 2024-05-08T05:32:10.880 INFO:tasks.workunit.client.0.smithi087.stdout:5/733: getdents da/db/d2a/d5a/d93 0 2024-05-08T05:32:10.880 INFO:tasks.workunit.client.0.smithi087.stdout:2/675: write d7/de/d2c/f48 [1122137,36231] 0 2024-05-08T05:32:10.880 INFO:tasks.workunit.client.0.smithi087.stdout:7/831: truncate d2/da/d3f/d72/d77/d54/d55/d65/fe7 3151264 0 2024-05-08T05:32:10.880 INFO:tasks.workunit.client.0.smithi087.stdout:5/734: write da/db/d2a/d5a/d93/d42/d50/f52 [4462686,129907] 0 2024-05-08T05:32:10.881 INFO:tasks.workunit.client.0.smithi087.stdout:1/605: dwrite df/d2f/d4f/f93 [0,4194304] 0 2024-05-08T05:32:10.881 INFO:tasks.workunit.client.0.smithi087.stdout:1/606: chown df/d2f/d57/d64/fa9 513996492 1 2024-05-08T05:32:10.888 INFO:tasks.workunit.client.0.smithi087.stdout:8/680: dread db/d23/f2e [0,4194304] 0 2024-05-08T05:32:10.888 INFO:tasks.workunit.client.0.smithi087.stdout:8/681: chown db/d23/d1b/d35 157332859 1 2024-05-08T05:32:10.888 INFO:tasks.workunit.client.0.smithi087.stdout:8/682: write db/d23/d15/d3c/fb5 [1735474,106086] 0 2024-05-08T05:32:10.889 INFO:tasks.workunit.client.0.smithi087.stdout:8/683: write db/d23/f38 [2610347,108967] 0 2024-05-08T05:32:10.891 INFO:tasks.workunit.client.0.smithi087.stdout:9/725: write d1/df/d14/d18/f1e [2700746,83837] 0 2024-05-08T05:32:10.893 INFO:tasks.workunit.client.0.smithi087.stdout:4/701: unlink d4/d13/d32/d8d/d91/d84/l53 0 2024-05-08T05:32:10.893 INFO:tasks.workunit.client.0.smithi087.stdout:4/702: write d4/d13/f16 [5143531,106599] 0 2024-05-08T05:32:10.893 INFO:tasks.workunit.client.0.smithi087.stdout:4/703: write d4/d13/f31 [1803646,78225] 0 2024-05-08T05:32:10.893 INFO:tasks.workunit.client.0.smithi087.stdout:2/676: creat d7/fe7 x:0 0 0 2024-05-08T05:32:10.896 INFO:tasks.workunit.client.0.smithi087.stdout:5/735: creat da/db/d2a/d5a/d93/d42/d43/d83/d6b/ff6 x:0 0 0 2024-05-08T05:32:10.896 INFO:tasks.workunit.client.0.smithi087.stdout:5/736: fsync da/f3c 0 2024-05-08T05:32:10.896 INFO:tasks.workunit.client.0.smithi087.stdout:5/737: fdatasync da/f3c 0 2024-05-08T05:32:10.896 INFO:tasks.workunit.client.0.smithi087.stdout:5/738: chown da/db/d2a/d5a/d93/d42/d43/d83/d6b/f80 18966 1 2024-05-08T05:32:10.897 INFO:tasks.workunit.client.0.smithi087.stdout:5/739: chown da/db/fe6 170265570 1 2024-05-08T05:32:10.897 INFO:tasks.workunit.client.0.smithi087.stdout:5/740: write da/db/d2a/d46/d9a/fe4 [969718,112542] 0 2024-05-08T05:32:10.897 INFO:tasks.workunit.client.0.smithi087.stdout:5/741: chown da/f3c 51106 1 2024-05-08T05:32:10.897 INFO:tasks.workunit.client.0.smithi087.stdout:5/742: truncate da/f30 673100 0 2024-05-08T05:32:10.897 INFO:tasks.workunit.client.0.smithi087.stdout:5/743: dread - da/db/d2a/d5a/d93/d42/d43/ff4 zero size 2024-05-08T05:32:10.897 INFO:tasks.workunit.client.0.smithi087.stdout:5/744: dread - da/db/d2a/d5a/d93/d42/d43/d83/d6b/fe2 zero size 2024-05-08T05:32:10.899 INFO:tasks.workunit.client.0.smithi087.stdout:3/685: sync 2024-05-08T05:32:10.899 INFO:tasks.workunit.client.0.smithi087.stdout:3/686: chown d4/d11/d24/d25/d3e/f65 20000 1 2024-05-08T05:32:10.899 INFO:tasks.workunit.client.0.smithi087.stdout:3/687: dread - d4/d11/d24/d25/d3e/d58/f96 zero size 2024-05-08T05:32:10.899 INFO:tasks.workunit.client.0.smithi087.stdout:1/607: symlink df/d2f/d57/d64/d83/ld2 0 2024-05-08T05:32:10.900 INFO:tasks.workunit.client.0.smithi087.stdout:1/608: write df/d2f/f66 [615802,106823] 0 2024-05-08T05:32:10.901 INFO:tasks.workunit.client.0.smithi087.stdout:8/684: link db/d23/d1b/d35/f60 db/d23/d1b/d35/d43/d68/fe9 0 2024-05-08T05:32:10.903 INFO:tasks.workunit.client.0.smithi087.stdout:9/726: truncate d1/fd 2263027 0 2024-05-08T05:32:10.903 INFO:tasks.workunit.client.0.smithi087.stdout:9/727: dread - d1/df/d14/d68/d80/d98/d28/fdc zero size 2024-05-08T05:32:10.903 INFO:tasks.workunit.client.0.smithi087.stdout:9/728: write d1/df/d14/d68/d80/d98/fe2 [634901,8860] 0 2024-05-08T05:32:10.903 INFO:tasks.workunit.client.0.smithi087.stdout:9/729: fdatasync d1/fd 0 2024-05-08T05:32:10.904 INFO:tasks.workunit.client.0.smithi087.stdout:2/677: creat d7/de/d2c/db0/fe8 x:0 0 0 2024-05-08T05:32:10.904 INFO:tasks.workunit.client.0.smithi087.stdout:2/678: chown d7/d93/c97 68 1 2024-05-08T05:32:10.906 INFO:tasks.workunit.client.0.smithi087.stdout:7/832: rename d2/da/cbe to d2/d6/d12/d19/d2a/d91/df0/c10e 0 2024-05-08T05:32:10.906 INFO:tasks.workunit.client.0.smithi087.stdout:7/833: dread - d2/da/d3f/d72/d77/d54/d50/f6f zero size 2024-05-08T05:32:10.906 INFO:tasks.workunit.client.0.smithi087.stdout:0/624: sync 2024-05-08T05:32:10.907 INFO:tasks.workunit.client.0.smithi087.stdout:3/688: mknod d4/d14/dbe/dd0/cf1 0 2024-05-08T05:32:10.907 INFO:tasks.workunit.client.0.smithi087.stdout:7/834: read d2/d6/d12/dc5/fd0 [580723,59953] 0 2024-05-08T05:32:10.908 INFO:tasks.workunit.client.0.smithi087.stdout:5/745: rmdir da/dd/d13 39 2024-05-08T05:32:10.909 INFO:tasks.workunit.client.0.smithi087.stdout:9/730: creat d1/df/d14/d54/d61/fe3 x:0 0 0 2024-05-08T05:32:10.909 INFO:tasks.workunit.client.0.smithi087.stdout:9/731: chown d1/df/d14/d68/d80/d8b 0 1 2024-05-08T05:32:10.912 INFO:tasks.workunit.client.0.smithi087.stdout:0/625: creat d0/da/d35/d86/fd9 x:0 0 0 2024-05-08T05:32:10.912 INFO:tasks.workunit.client.0.smithi087.stdout:0/626: getdents d0/d9/d1b/d5e 0 2024-05-08T05:32:10.912 INFO:tasks.workunit.client.0.smithi087.stdout:0/627: read d0/d9/d1b/d2f/d54/da1/f96 [225606,121047] 0 2024-05-08T05:32:10.913 INFO:tasks.workunit.client.0.smithi087.stdout:3/689: mknod d4/d11/d24/d39/d60/d87/da5/cf2 0 2024-05-08T05:32:10.913 INFO:tasks.workunit.client.0.smithi087.stdout:3/690: write d4/f6 [886979,67219] 0 2024-05-08T05:32:10.913 INFO:tasks.workunit.client.0.smithi087.stdout:3/691: truncate d4/d11/f50 1576344 0 2024-05-08T05:32:10.913 INFO:tasks.workunit.client.0.smithi087.stdout:3/692: write d4/d11/d24/d25/d3e/d58/fd4 [246425,86762] 0 2024-05-08T05:32:10.913 INFO:tasks.workunit.client.0.smithi087.stdout:3/693: truncate d4/d11/d24/d25/d4d/f83 442995 0 2024-05-08T05:32:10.914 INFO:tasks.workunit.client.0.smithi087.stdout:5/746: symlink da/db/d2a/d46/dc6/lf7 0 2024-05-08T05:32:10.914 INFO:tasks.workunit.client.0.smithi087.stdout:9/732: creat d1/df/d58/fe4 x:0 0 0 2024-05-08T05:32:10.916 INFO:tasks.workunit.client.0.smithi087.stdout:3/694: creat d4/d14/d84/d8b/d8f/dec/ff3 x:0 0 0 2024-05-08T05:32:10.917 INFO:tasks.workunit.client.0.smithi087.stdout:5/747: mkdir da/db/d2a/d5a/d93/d42/d43/d83/ddc/dde/df8 0 2024-05-08T05:32:10.917 INFO:tasks.workunit.client.0.smithi087.stdout:5/748: fsync da/db/d2a/f77 0 2024-05-08T05:32:10.919 INFO:tasks.workunit.client.0.smithi087.stdout:3/695: creat d4/d14/d84/ff4 x:0 0 0 2024-05-08T05:32:10.920 INFO:tasks.workunit.client.0.smithi087.stdout:8/685: dread db/f25 [0,4194304] 0 2024-05-08T05:32:10.920 INFO:tasks.workunit.client.0.smithi087.stdout:8/686: stat db/d23/d3a/dcb 0 2024-05-08T05:32:10.922 INFO:tasks.workunit.client.0.smithi087.stdout:5/749: mknod da/db/d2a/d5a/d93/d17/cf9 0 2024-05-08T05:32:10.922 INFO:tasks.workunit.client.0.smithi087.stdout:3/696: stat d4/d11/d3d/d64/l7c 0 2024-05-08T05:32:10.922 INFO:tasks.workunit.client.0.smithi087.stdout:3/697: read - d4/d11/d24/d39/d60/d87/f9f zero size 2024-05-08T05:32:10.924 INFO:tasks.workunit.client.0.smithi087.stdout:8/687: unlink db/d23/d1b/d35/d43/l66 0 2024-05-08T05:32:10.925 INFO:tasks.workunit.client.0.smithi087.stdout:9/733: dread d1/df/d14/d68/d80/d98/f1b [0,4194304] 0 2024-05-08T05:32:10.925 INFO:tasks.workunit.client.0.smithi087.stdout:5/750: truncate da/db/d2a/d5a/d93/d36/d45/d5c/d86/fbf 331391 0 2024-05-08T05:32:10.925 INFO:tasks.workunit.client.0.smithi087.stdout:5/751: write da/db/d2a/d5a/d93/d36/d45/d5c/fd2 [1282145,116961] 0 2024-05-08T05:32:10.926 INFO:tasks.workunit.client.0.smithi087.stdout:4/704: rename d4/d13/d32/d8d to d4/d13/d3e/d28/d50/d9d/df2/d106 0 2024-05-08T05:32:10.927 INFO:tasks.workunit.client.0.smithi087.stdout:3/698: creat d4/d11/d24/d25/d4d/dbb/ff5 x:0 0 0 2024-05-08T05:32:10.927 INFO:tasks.workunit.client.0.smithi087.stdout:0/628: write d0/d9/d1b/d2f/d54/da1/f70 [44596,7380] 0 2024-05-08T05:32:10.927 INFO:tasks.workunit.client.0.smithi087.stdout:0/629: read d0/da/d35/fbd [125752,94602] 0 2024-05-08T05:32:10.930 INFO:tasks.workunit.client.0.smithi087.stdout:9/734: creat d1/df/d14/db1/fe5 x:0 0 0 2024-05-08T05:32:10.930 INFO:tasks.workunit.client.0.smithi087.stdout:9/735: chown d1/df/d14/d54 26140594 1 2024-05-08T05:32:10.931 INFO:tasks.workunit.client.0.smithi087.stdout:5/752: unlink da/db/d2a/d46/c4c 0 2024-05-08T05:32:10.932 INFO:tasks.workunit.client.0.smithi087.stdout:6/707: dwrite d4/d8/df/d1e/d25/d28/d2d/d37/f54 [0,4194304] 0 2024-05-08T05:32:10.932 INFO:tasks.workunit.client.0.smithi087.stdout:6/708: stat d4/d8/df/d1e/d25/d28/d2d/d37/d5b/fa9 0 2024-05-08T05:32:10.932 INFO:tasks.workunit.client.0.smithi087.stdout:8/688: getdents db/d23/d1b/d35/d43 0 2024-05-08T05:32:10.933 INFO:tasks.workunit.client.0.smithi087.stdout:8/689: chown db/d23/d3a/d65/f6e 32606 1 2024-05-08T05:32:10.944 INFO:tasks.workunit.client.0.smithi087.stdout:2/679: rename d7/de/d27/d33/d49/c4d to d7/de/d55/de4/ce9 0 2024-05-08T05:32:10.945 INFO:tasks.workunit.client.0.smithi087.stdout:9/736: mkdir d1/df/d14/d18/d8e/da2/de6 0 2024-05-08T05:32:10.945 INFO:tasks.workunit.client.0.smithi087.stdout:8/690: unlink db/d23/d3a/dcb/lb7 0 2024-05-08T05:32:10.945 INFO:tasks.workunit.client.0.smithi087.stdout:9/737: mkdir d1/df/d14/d68/d80/d98/d83/de7 0 2024-05-08T05:32:10.945 INFO:tasks.workunit.client.0.smithi087.stdout:5/753: read da/db/d2a/d5a/d93/d42/d50/f6a [2422421,83753] 0 2024-05-08T05:32:10.948 INFO:tasks.workunit.client.0.smithi087.stdout:9/738: mkdir d1/df/d14/d68/d80/d98/d28/de8 0 2024-05-08T05:32:10.949 INFO:tasks.workunit.client.0.smithi087.stdout:8/691: mknod db/d23/d54/dd6/cea 0 2024-05-08T05:32:10.949 INFO:tasks.workunit.client.0.smithi087.stdout:8/692: chown db/d23/d15/f99 0 1 2024-05-08T05:32:10.949 INFO:tasks.workunit.client.0.smithi087.stdout:9/739: write d1/df/f91 [604362,61548] 0 2024-05-08T05:32:10.949 INFO:tasks.workunit.client.0.smithi087.stdout:9/740: fdatasync d1/df/d14/d54/d61/fe3 0 2024-05-08T05:32:10.949 INFO:tasks.workunit.client.0.smithi087.stdout:5/754: getdents da/db/d2a/d5a/d93/d42/d43/d83/ddc/dd5 0 2024-05-08T05:32:10.949 INFO:tasks.workunit.client.0.smithi087.stdout:5/755: dread - da/dd/d13/da2/dce/fed zero size 2024-05-08T05:32:10.949 INFO:tasks.workunit.client.0.smithi087.stdout:8/693: mknod db/d23/d15/d29/d33/d6c/dbe/ceb 0 2024-05-08T05:32:10.949 INFO:tasks.workunit.client.0.smithi087.stdout:5/756: creat da/db/d2a/d5a/ffa x:0 0 0 2024-05-08T05:32:10.950 INFO:tasks.workunit.client.0.smithi087.stdout:8/694: link db/d23/d1b/d7c/fbd db/d23/d15/d29/d4d/fec 0 2024-05-08T05:32:10.950 INFO:tasks.workunit.client.0.smithi087.stdout:8/695: write db/d23/d1b/d35/d43/fd0 [960866,25289] 0 2024-05-08T05:32:10.950 INFO:tasks.workunit.client.0.smithi087.stdout:8/696: read - db/d23/d1b/d35/d43/d68/fb2 zero size 2024-05-08T05:32:10.950 INFO:tasks.workunit.client.0.smithi087.stdout:8/697: chown db/d23/d1b/d35/d43/fd0 7750 1 2024-05-08T05:32:10.950 INFO:tasks.workunit.client.0.smithi087.stdout:7/835: rename d2/da to d2/d6/da0/d10f 0 2024-05-08T05:32:10.951 INFO:tasks.workunit.client.0.smithi087.stdout:8/698: rmdir db/d23/d15/d29/d79 39 2024-05-08T05:32:10.955 INFO:tasks.workunit.client.0.smithi087.stdout:7/836: symlink d2/d6/da0/d10f/d3f/l110 0 2024-05-08T05:32:10.955 INFO:tasks.workunit.client.0.smithi087.stdout:7/837: chown d2/d6/da0/d10f/d3f/d72/d77/d54/d50/d88 3766968 1 2024-05-08T05:32:10.960 INFO:tasks.workunit.client.0.smithi087.stdout:7/838: mkdir d2/d6/d12/d19/d2a/d111 0 2024-05-08T05:32:10.960 INFO:tasks.workunit.client.0.smithi087.stdout:7/839: fdatasync d2/d6/da0/d10f/d3f/d72/d77/f5a 0 2024-05-08T05:32:10.961 INFO:tasks.workunit.client.0.smithi087.stdout:7/840: creat d2/d6/da0/f112 x:0 0 0 2024-05-08T05:32:10.961 INFO:tasks.workunit.client.0.smithi087.stdout:7/841: chown d2/d6/da0/d10f/d3f/d66 248866635 1 2024-05-08T05:32:10.961 INFO:tasks.workunit.client.0.smithi087.stdout:7/842: chown d2/d6/da0/d10f/d3f/d72/d77/d54/d55/d65/df1 2188 1 2024-05-08T05:32:10.962 INFO:tasks.workunit.client.0.smithi087.stdout:7/843: creat d2/d6/da0/f113 x:0 0 0 2024-05-08T05:32:10.964 INFO:tasks.workunit.client.0.smithi087.stdout:7/844: mkdir d2/d6/d12/d19/d2a/d91/df0/d114 0 2024-05-08T05:32:10.965 INFO:tasks.workunit.client.0.smithi087.stdout:7/845: mkdir d2/d6/d12/d19/d2a/d89/d9a/d115 0 2024-05-08T05:32:10.967 INFO:tasks.workunit.client.0.smithi087.stdout:1/609: dwrite df/d2f/d57/d64/fa9 [0,4194304] 0 2024-05-08T05:32:10.967 INFO:tasks.workunit.client.0.smithi087.stdout:7/846: symlink d2/d6/da0/d10f/d3f/d72/d77/d54/dd9/d107/l116 0 2024-05-08T05:32:10.968 INFO:tasks.workunit.client.0.smithi087.stdout:4/705: write d4/f6e [248086,34499] 0 2024-05-08T05:32:10.968 INFO:tasks.workunit.client.0.smithi087.stdout:4/706: chown d4/d13/d3e/d28/d35/cb3 4046 1 2024-05-08T05:32:10.976 INFO:tasks.workunit.client.0.smithi087.stdout:3/699: dwrite d4/d11/d24/d25/d3e/d58/f7d [0,4194304] 0 2024-05-08T05:32:10.983 INFO:tasks.workunit.client.0.smithi087.stdout:0/630: dwrite d0/d57/fa4 [0,4194304] 0 2024-05-08T05:32:10.989 INFO:tasks.workunit.client.0.smithi087.stdout:8/699: dread db/d23/d15/f85 [0,4194304] 0 2024-05-08T05:32:10.991 INFO:tasks.workunit.client.0.smithi087.stdout:4/707: rmdir d4/d13/d3e/d28/d50/d9d/df2/d106/d91/db8/dba 39 2024-05-08T05:32:10.993 INFO:tasks.workunit.client.0.smithi087.stdout:3/700: mknod d4/d11/d24/d39/d94/cf6 0 2024-05-08T05:32:10.998 INFO:tasks.workunit.client.0.smithi087.stdout:1/610: creat df/d18/d1d/d58/fd3 x:0 0 0 2024-05-08T05:32:10.998 INFO:tasks.workunit.client.0.smithi087.stdout:5/757: dread da/f2e [4194304,4194304] 0 2024-05-08T05:32:10.998 INFO:tasks.workunit.client.0.smithi087.stdout:8/700: getdents db/d23/d15/d29/d33/d6c 0 2024-05-08T05:32:10.998 INFO:tasks.workunit.client.0.smithi087.stdout:8/701: truncate db/d23/d1b/d35/d43/fdb 64527 0 2024-05-08T05:32:10.998 INFO:tasks.workunit.client.0.smithi087.stdout:8/702: chown db/d23/d15/d29/db1 0 1 2024-05-08T05:32:10.998 INFO:tasks.workunit.client.0.smithi087.stdout:4/708: mkdir d4/d13/d3e/d28/d35/d107 0 2024-05-08T05:32:11.002 INFO:tasks.workunit.client.0.smithi087.stdout:3/701: mkdir d4/d11/d24/d39/d94/df7 0 2024-05-08T05:32:11.002 INFO:tasks.workunit.client.0.smithi087.stdout:5/758: symlink da/db/d2a/d5a/d93/d17/lfb 0 2024-05-08T05:32:11.008 INFO:tasks.workunit.client.0.smithi087.stdout:2/680: read d7/de/f15 [4929232,71070] 0 2024-05-08T05:32:11.008 INFO:tasks.workunit.client.0.smithi087.stdout:3/702: symlink d4/lf8 0 2024-05-08T05:32:11.008 INFO:tasks.workunit.client.0.smithi087.stdout:2/681: dread - d7/de/d27/d33/d65/fad zero size 2024-05-08T05:32:11.008 INFO:tasks.workunit.client.0.smithi087.stdout:3/703: stat d4/d11/d24/d25/d3e/ld5 0 2024-05-08T05:32:11.008 INFO:tasks.workunit.client.0.smithi087.stdout:3/704: stat d4/d5f/fc5 0 2024-05-08T05:32:11.008 INFO:tasks.workunit.client.0.smithi087.stdout:9/741: dwrite d1/fd [0,4194304] 0 2024-05-08T05:32:11.008 INFO:tasks.workunit.client.0.smithi087.stdout:9/742: chown d1/df/d14/d18/d66/lbb 60928 1 2024-05-08T05:32:11.009 INFO:tasks.workunit.client.0.smithi087.stdout:3/705: rename d4/d11/d24/d25/d3e/d58/d9b/ddb to d4/d11/d24/d25/d99/da2/df9 0 2024-05-08T05:32:11.010 INFO:tasks.workunit.client.0.smithi087.stdout:9/743: mknod d1/df/d14/d54/d61/d72/ce9 0 2024-05-08T05:32:11.010 INFO:tasks.workunit.client.0.smithi087.stdout:9/744: readlink d1/df/d14/d68/d80/d98/le 0 2024-05-08T05:32:11.011 INFO:tasks.workunit.client.0.smithi087.stdout:3/706: creat d4/d11/d24/d39/d94/df7/ffa x:0 0 0 2024-05-08T05:32:11.012 INFO:tasks.workunit.client.0.smithi087.stdout:9/745: creat d1/df/d14/d18/d66/fea x:0 0 0 2024-05-08T05:32:11.012 INFO:tasks.workunit.client.0.smithi087.stdout:9/746: chown d1/df/f12 1103373 1 2024-05-08T05:32:11.014 INFO:tasks.workunit.client.0.smithi087.stdout:0/631: write d0/da/f30 [2109764,92165] 0 2024-05-08T05:32:11.014 INFO:tasks.workunit.client.0.smithi087.stdout:9/747: creat d1/df/d14/d68/d80/d98/feb x:0 0 0 2024-05-08T05:32:11.014 INFO:tasks.workunit.client.0.smithi087.stdout:6/709: dwrite d4/d8/df/d39/d42/d9e/d6f/d84/fbb [0,4194304] 0 2024-05-08T05:32:11.014 INFO:tasks.workunit.client.0.smithi087.stdout:3/707: mkdir d4/d14/dfb 0 2024-05-08T05:32:11.014 INFO:tasks.workunit.client.0.smithi087.stdout:3/708: write d4/d11/d24/d25/d3e/f65 [280188,87047] 0 2024-05-08T05:32:11.014 INFO:tasks.workunit.client.0.smithi087.stdout:0/632: creat d0/d9/fda x:0 0 0 2024-05-08T05:32:11.016 INFO:tasks.workunit.client.0.smithi087.stdout:9/748: symlink d1/df/d14/d54/d61/d88/lec 0 2024-05-08T05:32:11.017 INFO:tasks.workunit.client.0.smithi087.stdout:6/710: creat d4/d8/df/d39/d42/d9e/dd1/fdd x:0 0 0 2024-05-08T05:32:11.019 INFO:tasks.workunit.client.0.smithi087.stdout:2/682: write d7/de/d2c/db6/dcb/db7/dc1/fcd [107814,115311] 0 2024-05-08T05:32:11.025 INFO:tasks.workunit.client.0.smithi087.stdout:9/749: link d1/df/d14/d68/d80/d98/d28/d4b/f71 d1/df/d14/db1/fed 0 2024-05-08T05:32:11.026 INFO:tasks.workunit.client.0.smithi087.stdout:0/633: mkdir d0/d22/d3c/dbb/ddb 0 2024-05-08T05:32:11.026 INFO:tasks.workunit.client.0.smithi087.stdout:6/711: creat d4/d8/df/d1e/d25/d28/d2d/d37/d45/da2/fde x:0 0 0 2024-05-08T05:32:11.026 INFO:tasks.workunit.client.0.smithi087.stdout:6/712: chown d4/d8/df/d39/d42/d94/db5 31388699 1 2024-05-08T05:32:11.026 INFO:tasks.workunit.client.0.smithi087.stdout:8/703: dread db/d23/d15/d29/d4d/f55 [0,4194304] 0 2024-05-08T05:32:11.026 INFO:tasks.workunit.client.0.smithi087.stdout:3/709: dread d4/d11/d24/d25/d4d/f68 [0,4194304] 0 2024-05-08T05:32:11.027 INFO:tasks.workunit.client.0.smithi087.stdout:3/710: write d4/d11/d24/fe1 [496829,30948] 0 2024-05-08T05:32:11.027 INFO:tasks.workunit.client.0.smithi087.stdout:3/711: dread - d4/d11/d24/d25/d4d/dbb/fd9 zero size 2024-05-08T05:32:11.027 INFO:tasks.workunit.client.0.smithi087.stdout:3/712: write d4/d11/d3d/d4e/d6a/fd2 [800785,52406] 0 2024-05-08T05:32:11.027 INFO:tasks.workunit.client.0.smithi087.stdout:2/683: creat d7/d63/fea x:0 0 0 2024-05-08T05:32:11.028 INFO:tasks.workunit.client.0.smithi087.stdout:9/750: creat d1/df/d14/d54/d61/d88/dca/fee x:0 0 0 2024-05-08T05:32:11.028 INFO:tasks.workunit.client.0.smithi087.stdout:2/684: write d7/de/d27/d33/f47 [119685,88549] 0 2024-05-08T05:32:11.029 INFO:tasks.workunit.client.0.smithi087.stdout:2/685: creat d7/de/db1/dbe/feb x:0 0 0 2024-05-08T05:32:11.031 INFO:tasks.workunit.client.0.smithi087.stdout:6/713: rename d4/d8/df/d1e/d25/f3f to d4/d8/df/d39/d42/d9e/d6f/fdf 0 2024-05-08T05:32:11.031 INFO:tasks.workunit.client.0.smithi087.stdout:3/713: mkdir d4/d14/dfc 0 2024-05-08T05:32:11.032 INFO:tasks.workunit.client.0.smithi087.stdout:2/686: mknod d7/de/d2c/cec 0 2024-05-08T05:32:11.033 INFO:tasks.workunit.client.0.smithi087.stdout:8/704: rename db/d23/d3a/d65/d83/dc5/ldf to db/d23/d1b/d35/led 0 2024-05-08T05:32:11.037 INFO:tasks.workunit.client.0.smithi087.stdout:6/714: rmdir d4/d8/df/d1e/d25/d28/d2d/d37/d45 39 2024-05-08T05:32:11.037 INFO:tasks.workunit.client.0.smithi087.stdout:3/714: mkdir d4/d11/d24/d25/d4d/dbb/dfd 0 2024-05-08T05:32:11.037 INFO:tasks.workunit.client.0.smithi087.stdout:2/687: mknod d7/de/d55/de4/ced 0 2024-05-08T05:32:11.037 INFO:tasks.workunit.client.0.smithi087.stdout:3/715: write d4/d11/d24/d25/f34 [559283,3110] 0 2024-05-08T05:32:11.037 INFO:tasks.workunit.client.0.smithi087.stdout:3/716: chown d4/d11/d24/d39/d60/d87/da5/cf2 1916 1 2024-05-08T05:32:11.038 INFO:tasks.workunit.client.0.smithi087.stdout:5/759: write da/db/d2a/d5a/d93/d36/d45/d5c/fcf [3333530,122376] 0 2024-05-08T05:32:11.041 INFO:tasks.workunit.client.0.smithi087.stdout:6/715: mknod d4/d8/df/d39/d42/d9e/dd1/ce0 0 2024-05-08T05:32:11.042 INFO:tasks.workunit.client.0.smithi087.stdout:5/760: mknod da/db/d2a/d46/d9a/cfc 0 2024-05-08T05:32:11.043 INFO:tasks.workunit.client.0.smithi087.stdout:5/761: mkdir da/db/dd3/dfd 0 2024-05-08T05:32:11.048 INFO:tasks.workunit.client.0.smithi087.stdout:5/762: fsync da/db/d2a/d46/d9a/fe4 0 2024-05-08T05:32:11.049 INFO:tasks.workunit.client.0.smithi087.stdout:2/688: dread d7/de/d27/d33/f38 [0,4194304] 0 2024-05-08T05:32:11.050 INFO:tasks.workunit.client.0.smithi087.stdout:8/705: write db/d23/d1b/d35/d43/f50 [1542879,115383] 0 2024-05-08T05:32:11.052 INFO:tasks.workunit.client.0.smithi087.stdout:8/706: symlink db/d23/d15/lee 0 2024-05-08T05:32:11.052 INFO:tasks.workunit.client.0.smithi087.stdout:5/763: creat da/db/d2a/d5a/d93/d42/d43/d83/ddc/dd5/ffe x:0 0 0 2024-05-08T05:32:11.054 INFO:tasks.workunit.client.0.smithi087.stdout:8/707: rename db/d23/d15/d29/d33/d6c/dbe/ddc to db/d23/d15/d29/d33/d6c/def 0 2024-05-08T05:32:11.054 INFO:tasks.workunit.client.0.smithi087.stdout:8/708: write db/d23/d1b/d35/f89 [993209,113662] 0 2024-05-08T05:32:11.055 INFO:tasks.workunit.client.0.smithi087.stdout:0/634: write d0/da/f1e [5972296,2677] 0 2024-05-08T05:32:11.055 INFO:tasks.workunit.client.0.smithi087.stdout:5/764: mkdir da/db/d2a/d5a/d93/d36/d45/d5c/dff 0 2024-05-08T05:32:11.057 INFO:tasks.workunit.client.0.smithi087.stdout:6/716: dread d4/d8/fb6 [0,4194304] 0 2024-05-08T05:32:11.058 INFO:tasks.workunit.client.0.smithi087.stdout:0/635: getdents d0/d9/d90 0 2024-05-08T05:32:11.058 INFO:tasks.workunit.client.0.smithi087.stdout:0/636: chown d0/da/db4 16279 1 2024-05-08T05:32:11.059 INFO:tasks.workunit.client.0.smithi087.stdout:5/765: mkdir da/db/d2a/d5a/d93/d36/d45/d5c/d100 0 2024-05-08T05:32:11.061 INFO:tasks.workunit.client.0.smithi087.stdout:6/717: truncate d4/d8/df/d39/f7a 3489382 0 2024-05-08T05:32:11.064 INFO:tasks.workunit.client.0.smithi087.stdout:7/847: dwrite d2/d6/da0/d67/d82/d98/feb [0,4194304] 0 2024-05-08T05:32:11.079 INFO:tasks.workunit.client.0.smithi087.stdout:0/637: unlink d0/d9/d1b/d2f/d54/da1/cd6 0 2024-05-08T05:32:11.080 INFO:tasks.workunit.client.0.smithi087.stdout:0/638: readlink d0/d57/d24/d66/la0 0 2024-05-08T05:32:11.080 INFO:tasks.workunit.client.0.smithi087.stdout:5/766: symlink da/db/d2a/d46/d69/l101 0 2024-05-08T05:32:11.080 INFO:tasks.workunit.client.0.smithi087.stdout:8/709: dread db/d23/d15/d3c/f3f [0,4194304] 0 2024-05-08T05:32:11.083 INFO:tasks.workunit.client.0.smithi087.stdout:8/710: mknod db/d23/d15/d29/d33/d6c/cf0 0 2024-05-08T05:32:11.083 INFO:tasks.workunit.client.0.smithi087.stdout:8/711: chown db/d23/d3a/d65/d83/c8d 100459 1 2024-05-08T05:32:11.083 INFO:tasks.workunit.client.0.smithi087.stdout:5/767: mknod da/dd/d13/da2/dce/c102 0 2024-05-08T05:32:11.084 INFO:tasks.workunit.client.0.smithi087.stdout:6/718: write d4/d8/df/d1e/f23 [2540175,9382] 0 2024-05-08T05:32:11.085 INFO:tasks.workunit.client.0.smithi087.stdout:5/768: link da/dd/d13/da2/lc5 da/dd/l103 0 2024-05-08T05:32:11.086 INFO:tasks.workunit.client.0.smithi087.stdout:5/769: truncate da/db/d2a/d5a/d93/d36/dc1/fda 353797 0 2024-05-08T05:32:11.086 INFO:tasks.workunit.client.0.smithi087.stdout:5/770: chown da/db/d2a/d5a/d93/d42/d43/ff4 0 1 2024-05-08T05:32:11.087 INFO:tasks.workunit.client.0.smithi087.stdout:6/719: unlink d4/d8/df/d1e/d25/d28/d2d/d37/d45/f64 0 2024-05-08T05:32:11.087 INFO:tasks.workunit.client.0.smithi087.stdout:6/720: write d4/d8/fd6 [194055,39382] 0 2024-05-08T05:32:11.091 INFO:tasks.workunit.client.0.smithi087.stdout:5/771: creat da/dd/d13/f104 x:0 0 0 2024-05-08T05:32:11.091 INFO:tasks.workunit.client.0.smithi087.stdout:6/721: rmdir d4/d8/df 39 2024-05-08T05:32:11.091 INFO:tasks.workunit.client.0.smithi087.stdout:7/848: dread d2/d6/da0/d67/d82/d98/f9c [0,4194304] 0 2024-05-08T05:32:11.092 INFO:tasks.workunit.client.0.smithi087.stdout:7/849: readlink d2/d6/d12/d15/lb3 0 2024-05-08T05:32:11.092 INFO:tasks.workunit.client.0.smithi087.stdout:7/850: chown d2/d6/da0/d10f/d3f/d72/d77/d54/dd9 18275 1 2024-05-08T05:32:11.094 INFO:tasks.workunit.client.0.smithi087.stdout:7/851: mkdir d2/d6/da0/d10f/d3f/d72/d77/d54/d55/d117 0 2024-05-08T05:32:11.096 INFO:tasks.workunit.client.0.smithi087.stdout:7/852: mkdir d2/d6/d12/d15/d5b/dee/d118 0 2024-05-08T05:32:11.097 INFO:tasks.workunit.client.0.smithi087.stdout:7/853: mknod d2/d6/d12/d1d/c119 0 2024-05-08T05:32:11.099 INFO:tasks.workunit.client.0.smithi087.stdout:7/854: creat d2/d6/da0/d10f/d3f/d72/d77/dc2/f11a x:0 0 0 2024-05-08T05:32:11.099 INFO:tasks.workunit.client.0.smithi087.stdout:7/855: write d2/d6/f25 [1074711,84349] 0 2024-05-08T05:32:11.099 INFO:tasks.workunit.client.0.smithi087.stdout:7/856: fdatasync d2/d6/da0/d10f/d3f/d72/d77/d54/d55/d65/fb5 0 2024-05-08T05:32:11.099 INFO:tasks.workunit.client.0.smithi087.stdout:7/857: stat d2/d6/da0 0 2024-05-08T05:32:11.101 INFO:tasks.workunit.client.0.smithi087.stdout:7/858: mknod d2/d6/da0/d67/d82/c11b 0 2024-05-08T05:32:11.102 INFO:tasks.workunit.client.0.smithi087.stdout:0/639: dread d0/da/d35/d86/f15 [0,4194304] 0 2024-05-08T05:32:11.103 INFO:tasks.workunit.client.0.smithi087.stdout:0/640: symlink d0/d57/d24/ldc 0 2024-05-08T05:32:11.113 INFO:tasks.workunit.client.0.smithi087.stdout:0/641: dread d0/da/d35/fd1 [0,4194304] 0 2024-05-08T05:32:11.113 INFO:tasks.workunit.client.0.smithi087.stdout:3/717: dwrite d4/d11/d24/d25/d3e/d3f/f7b [0,4194304] 0 2024-05-08T05:32:11.114 INFO:tasks.workunit.client.0.smithi087.stdout:1/611: dwrite df/d2f/d57/d64/fa9 [0,4194304] 0 2024-05-08T05:32:11.114 INFO:tasks.workunit.client.0.smithi087.stdout:5/772: dread da/f66 [0,4194304] 0 2024-05-08T05:32:11.114 INFO:tasks.workunit.client.0.smithi087.stdout:5/773: chown da/db/d2a/d5a/d93/d17 2934 1 2024-05-08T05:32:11.115 INFO:tasks.workunit.client.0.smithi087.stdout:5/774: chown da/db/d2a/d5a/d93/d42/d43/d83/f7d 182 1 2024-05-08T05:32:11.115 INFO:tasks.workunit.client.0.smithi087.stdout:2/689: dwrite d7/f59 [0,4194304] 0 2024-05-08T05:32:11.120 INFO:tasks.workunit.client.0.smithi087.stdout:8/712: fsync db/d23/d1b/d35/d43/fd0 0 2024-05-08T05:32:11.120 INFO:tasks.workunit.client.0.smithi087.stdout:8/713: fdatasync db/d23/d15/d29/d33/f80 0 2024-05-08T05:32:11.120 INFO:tasks.workunit.client.0.smithi087.stdout:3/718: unlink d4/d11/d24/d39/d60/d87/da5/fbf 0 2024-05-08T05:32:11.121 INFO:tasks.workunit.client.0.smithi087.stdout:3/719: fdatasync d4/d14/f85 0 2024-05-08T05:32:11.121 INFO:tasks.workunit.client.0.smithi087.stdout:3/720: stat d4/d11/d24/d39/c66 0 2024-05-08T05:32:11.121 INFO:tasks.workunit.client.0.smithi087.stdout:7/859: dread d2/d6/d12/d15/f46 [0,4194304] 0 2024-05-08T05:32:11.121 INFO:tasks.workunit.client.0.smithi087.stdout:7/860: truncate d2/d6/d12/f51 5112062 0 2024-05-08T05:32:11.122 INFO:tasks.workunit.client.0.smithi087.stdout:6/722: dread d4/f38 [0,4194304] 0 2024-05-08T05:32:11.123 INFO:tasks.workunit.client.0.smithi087.stdout:0/642: read d0/d9/f13 [200276,14429] 0 2024-05-08T05:32:11.125 INFO:tasks.workunit.client.0.smithi087.stdout:1/612: unlink df/d2f/d57/l44 0 2024-05-08T05:32:11.125 INFO:tasks.workunit.client.0.smithi087.stdout:1/613: stat df/d18/d1d/d27/d61/c7a 0 2024-05-08T05:32:11.125 INFO:tasks.workunit.client.0.smithi087.stdout:9/751: dwrite d1/df/d14/d68/d80/d98/d83/f9f [0,4194304] 0 2024-05-08T05:32:11.125 INFO:tasks.workunit.client.0.smithi087.stdout:5/775: creat da/db/d2a/d5a/f105 x:0 0 0 2024-05-08T05:32:11.125 INFO:tasks.workunit.client.0.smithi087.stdout:3/721: dread d4/f5c [0,4194304] 0 2024-05-08T05:32:11.129 INFO:tasks.workunit.client.0.smithi087.stdout:2/690: truncate d7/f17 846673 0 2024-05-08T05:32:11.130 INFO:tasks.workunit.client.0.smithi087.stdout:8/714: creat db/d23/d54/d9d/ff1 x:0 0 0 2024-05-08T05:32:11.131 INFO:tasks.workunit.client.0.smithi087.stdout:8/715: chown db/d23/d3a/fd3 188984 1 2024-05-08T05:32:11.131 INFO:tasks.workunit.client.0.smithi087.stdout:8/716: readlink db/d23/d1b/d35/led 0 2024-05-08T05:32:11.131 INFO:tasks.workunit.client.0.smithi087.stdout:8/717: dread - db/d23/d1b/d35/d43/f53 zero size 2024-05-08T05:32:11.131 INFO:tasks.workunit.client.0.smithi087.stdout:7/861: truncate d2/d6/d12/d15/fa2 3528695 0 2024-05-08T05:32:11.136 INFO:tasks.workunit.client.0.smithi087.stdout:0/643: dread d0/d9/f13 [0,4194304] 0 2024-05-08T05:32:11.137 INFO:tasks.workunit.client.0.smithi087.stdout:9/752: dread d1/df/d14/d18/f34 [0,4194304] 0 2024-05-08T05:32:11.142 INFO:tasks.workunit.client.0.smithi087.stdout:1/614: mkdir df/d18/d1d/d27/dd4 0 2024-05-08T05:32:11.143 INFO:tasks.workunit.client.0.smithi087.stdout:1/615: write df/d2f/d57/d64/fbf [5045898,75737] 0 2024-05-08T05:32:11.143 INFO:tasks.workunit.client.0.smithi087.stdout:6/723: dread d4/d8/df/d39/d42/f98 [0,4194304] 0 2024-05-08T05:32:11.143 INFO:tasks.workunit.client.0.smithi087.stdout:6/724: write d4/d8/f3c [4721075,9813] 0 2024-05-08T05:32:11.144 INFO:tasks.workunit.client.0.smithi087.stdout:2/691: creat d7/de/d5d/d90/fee x:0 0 0 2024-05-08T05:32:11.145 INFO:tasks.workunit.client.0.smithi087.stdout:9/753: dread d1/df/d58/f76 [0,4194304] 0 2024-05-08T05:32:11.145 INFO:tasks.workunit.client.0.smithi087.stdout:8/718: creat db/d23/d15/d29/d4d/d96/ff2 x:0 0 0 2024-05-08T05:32:11.145 INFO:tasks.workunit.client.0.smithi087.stdout:9/754: dread - d1/df/d73/fb9 zero size 2024-05-08T05:32:11.145 INFO:tasks.workunit.client.0.smithi087.stdout:9/755: fdatasync d1/f7 0 2024-05-08T05:32:11.146 INFO:tasks.workunit.client.0.smithi087.stdout:7/862: creat d2/d6/d12/d15/d5b/f11c x:0 0 0 2024-05-08T05:32:11.146 INFO:tasks.workunit.client.0.smithi087.stdout:7/863: fdatasync d2/d6/d12/d15/d5b/f103 0 2024-05-08T05:32:11.150 INFO:tasks.workunit.client.0.smithi087.stdout:7/864: write d2/d6/d12/d15/d5b/fed [752174,14006] 0 2024-05-08T05:32:11.150 INFO:tasks.workunit.client.0.smithi087.stdout:7/865: chown d2/d6/da0/d10f/d3f/d72/d77/f5a 42565681 1 2024-05-08T05:32:11.150 INFO:tasks.workunit.client.0.smithi087.stdout:2/692: write d7/de/d27/f44 [24808,111874] 0 2024-05-08T05:32:11.151 INFO:tasks.workunit.client.0.smithi087.stdout:1/616: creat df/d18/d1d/d27/fd5 x:0 0 0 2024-05-08T05:32:11.151 INFO:tasks.workunit.client.0.smithi087.stdout:6/725: rmdir d4/d8/df/d39/d42/d9e/da4/dad 39 2024-05-08T05:32:11.151 INFO:tasks.workunit.client.0.smithi087.stdout:2/693: symlink d7/de/d2c/db6/dcb/db7/dc1/lef 0 2024-05-08T05:32:11.152 INFO:tasks.workunit.client.0.smithi087.stdout:6/726: write d4/d8/fd6 [1059455,36573] 0 2024-05-08T05:32:11.153 INFO:tasks.workunit.client.0.smithi087.stdout:2/694: rmdir d7 39 2024-05-08T05:32:11.153 INFO:tasks.workunit.client.0.smithi087.stdout:2/695: fsync d7/de/d27/d33/f76 0 2024-05-08T05:32:11.154 INFO:tasks.workunit.client.0.smithi087.stdout:6/727: mknod d4/d8/df/d39/ce1 0 2024-05-08T05:32:11.154 INFO:tasks.workunit.client.0.smithi087.stdout:6/728: chown d4/d8/faa 981761 1 2024-05-08T05:32:11.155 INFO:tasks.workunit.client.0.smithi087.stdout:6/729: fdatasync d4/d8/df/d1e/d52/f80 0 2024-05-08T05:32:11.156 INFO:tasks.workunit.client.0.smithi087.stdout:6/730: truncate d4/d8/df/d39/f7a 3192196 0 2024-05-08T05:32:11.156 INFO:tasks.workunit.client.0.smithi087.stdout:5/776: read da/db/d2a/d46/feb [2932506,60741] 0 2024-05-08T05:32:11.156 INFO:tasks.workunit.client.0.smithi087.stdout:5/777: chown da/db/d2a/d5a/d93/d36/lbd 144 1 2024-05-08T05:32:11.156 INFO:tasks.workunit.client.0.smithi087.stdout:5/778: write da/db/d2a/d5a/d93/d42/fc7 [856773,16737] 0 2024-05-08T05:32:11.161 INFO:tasks.workunit.client.0.smithi087.stdout:6/731: rename d4/d8/df/d39/d42/d9e/d6f/d84 to d4/d8/df/d39/d42/d9e/da4/dad/dd2/de2 0 2024-05-08T05:32:11.164 INFO:tasks.workunit.client.0.smithi087.stdout:5/779: dread da/db/d2a/d5a/d93/d36/d45/d5c/d86/fbf [0,4194304] 0 2024-05-08T05:32:11.173 INFO:tasks.workunit.client.0.smithi087.stdout:5/780: rename da/db/d2a/d5a/d93/d42/d43/d83/de9/cee to da/db/d2a/d5a/d93/d42/d43/d83/ddc/dde/df8/c106 0 2024-05-08T05:32:11.176 INFO:tasks.workunit.client.0.smithi087.stdout:5/781: creat da/db/d2a/d5a/d93/d36/d45/d5c/d100/f107 x:0 0 0 2024-05-08T05:32:11.176 INFO:tasks.workunit.client.0.smithi087.stdout:5/782: chown da/db/d2a/d5a/d93/d42/d50/f6a 177 1 2024-05-08T05:32:11.177 INFO:tasks.workunit.client.0.smithi087.stdout:0/644: read d0/d57/fa4 [2901636,1135] 0 2024-05-08T05:32:11.177 INFO:tasks.workunit.client.0.smithi087.stdout:5/783: creat da/db/dd3/f108 x:0 0 0 2024-05-08T05:32:11.180 INFO:tasks.workunit.client.0.smithi087.stdout:0/645: rename d0/d9/d1b/d2f/c33 to d0/da/d35/d86/d6d/cdd 0 2024-05-08T05:32:11.182 INFO:tasks.workunit.client.0.smithi087.stdout:5/784: creat da/db/d2a/d5a/d93/d42/d43/d83/de9/f109 x:0 0 0 2024-05-08T05:32:11.182 INFO:tasks.workunit.client.0.smithi087.stdout:5/785: dread - da/db/d2a/d5a/d93/d42/d43/d83/ddc/dd5/fea zero size 2024-05-08T05:32:11.183 INFO:tasks.workunit.client.0.smithi087.stdout:0/646: mknod d0/da/d35/d86/d74/cde 0 2024-05-08T05:32:11.184 INFO:tasks.workunit.client.0.smithi087.stdout:5/786: creat da/db/dd3/dd9/f10a x:0 0 0 2024-05-08T05:32:11.184 INFO:tasks.workunit.client.0.smithi087.stdout:5/787: dread - da/db/d2a/d5a/d93/d36/d45/d5c/d86/fc4 zero size 2024-05-08T05:32:11.184 INFO:tasks.workunit.client.0.smithi087.stdout:5/788: rename da/db/d2a/d5a/d93 to da/db/d2a/d5a/d93/d42/d10b 22 2024-05-08T05:32:11.186 INFO:tasks.workunit.client.0.smithi087.stdout:0/647: unlink d0/d9/d1b/d2f/d54/l9d 0 2024-05-08T05:32:11.188 INFO:tasks.workunit.client.0.smithi087.stdout:5/789: read da/db/d2a/d46/d9a/fe4 [755810,16846] 0 2024-05-08T05:32:11.189 INFO:tasks.workunit.client.0.smithi087.stdout:0/648: rename d0/da/d35/d86/d74/c84 to d0/d9/d1b/d5e/cdf 0 2024-05-08T05:32:11.189 INFO:tasks.workunit.client.0.smithi087.stdout:5/790: fsync da/db/d2a/d5a/d93/d42/d43/fe3 0 2024-05-08T05:32:11.191 INFO:tasks.workunit.client.0.smithi087.stdout:3/722: dwrite d4/d14/f85 [0,4194304] 0 2024-05-08T05:32:11.192 INFO:tasks.workunit.client.0.smithi087.stdout:8/719: dwrite db/f41 [0,4194304] 0 2024-05-08T05:32:11.195 INFO:tasks.workunit.client.0.smithi087.stdout:3/723: symlink d4/d11/d24/d39/d60/d87/da5/lfe 0 2024-05-08T05:32:11.197 INFO:tasks.workunit.client.0.smithi087.stdout:3/724: creat d4/d5f/fff x:0 0 0 2024-05-08T05:32:11.199 INFO:tasks.workunit.client.0.smithi087.stdout:3/725: creat d4/d11/d24/d25/f100 x:0 0 0 2024-05-08T05:32:11.201 INFO:tasks.workunit.client.0.smithi087.stdout:3/726: creat d4/d14/d84/d8b/d8f/dec/f101 x:0 0 0 2024-05-08T05:32:11.223 INFO:tasks.workunit.client.0.smithi087.stdout:0/649: write d0/d57/d24/d66/f6f [1190176,44837] 0 2024-05-08T05:32:11.223 INFO:tasks.workunit.client.0.smithi087.stdout:0/650: write d0/da/d11/f20 [2819454,73247] 0 2024-05-08T05:32:11.224 INFO:tasks.workunit.client.0.smithi087.stdout:7/866: dwrite d2/d6/da0/d10f/f11 [0,4194304] 0 2024-05-08T05:32:11.224 INFO:tasks.workunit.client.0.smithi087.stdout:7/867: chown d2/d6/da0/d10f/d3f/d49/fd6 1291 1 2024-05-08T05:32:11.224 INFO:tasks.workunit.client.0.smithi087.stdout:7/868: chown d2/d6/da0/d10f/d3f/d72/d77/d54/d50/l9e 1057817 1 2024-05-08T05:32:11.224 INFO:tasks.workunit.client.0.smithi087.stdout:7/869: chown d2/d6/d12/d15/d5b/dee 4440291 1 2024-05-08T05:32:11.226 INFO:tasks.workunit.client.0.smithi087.stdout:0/651: unlink d0/da/d35/daa/faf 0 2024-05-08T05:32:11.226 INFO:tasks.workunit.client.0.smithi087.stdout:0/652: fsync d0/d9/fb5 0 2024-05-08T05:32:11.229 INFO:tasks.workunit.client.0.smithi087.stdout:7/870: unlink d2/d6/da0/d67/d82/d98/feb 0 2024-05-08T05:32:11.230 INFO:tasks.workunit.client.0.smithi087.stdout:7/871: read d2/d6/da0/d10f/d3f/d72/d77/d54/d55/d65/dc3/fe3 [65676,91472] 0 2024-05-08T05:32:11.230 INFO:tasks.workunit.client.0.smithi087.stdout:0/653: mkdir d0/de0 0 2024-05-08T05:32:11.230 INFO:tasks.workunit.client.0.smithi087.stdout:0/654: chown d0/d9/d1b/d2f/d54/da1/fb1 21538050 1 2024-05-08T05:32:11.230 INFO:tasks.workunit.client.0.smithi087.stdout:7/872: symlink d2/d6/da0/d10f/d3f/d72/d77/d54/d55/d65/l11d 0 2024-05-08T05:32:11.233 INFO:tasks.workunit.client.0.smithi087.stdout:7/873: symlink d2/d6/da0/d10f/l11e 0 2024-05-08T05:32:11.237 INFO:tasks.workunit.client.0.smithi087.stdout:7/874: unlink d2/d6/d12/d1d/f57 0 2024-05-08T05:32:11.237 INFO:tasks.workunit.client.0.smithi087.stdout:7/875: readlink d2/d6/da0/d10f/d3f/d66/lf2 0 2024-05-08T05:32:11.244 INFO:tasks.workunit.client.0.smithi087.stdout:7/876: rename d2/d6/da0/d10f/d3f/d72/d77/d54/d55/f96 to d2/d6/d12/dc5/f11f 0 2024-05-08T05:32:11.245 INFO:tasks.workunit.client.0.smithi087.stdout:0/655: dread d0/d9/f7c [0,4194304] 0 2024-05-08T05:32:11.245 INFO:tasks.workunit.client.0.smithi087.stdout:6/732: dwrite d4/f6c [4194304,4194304] 0 2024-05-08T05:32:11.246 INFO:tasks.workunit.client.0.smithi087.stdout:6/733: fdatasync d4/d8/df/d1e/d52/f80 0 2024-05-08T05:32:11.246 INFO:tasks.workunit.client.0.smithi087.stdout:6/734: readlink d4/d8/df/d39/d42/lac 0 2024-05-08T05:32:11.247 INFO:tasks.workunit.client.0.smithi087.stdout:5/791: dread da/db/fe6 [0,4194304] 0 2024-05-08T05:32:11.248 INFO:tasks.workunit.client.0.smithi087.stdout:4/709: sync 2024-05-08T05:32:11.249 INFO:tasks.workunit.client.0.smithi087.stdout:0/656: mkdir d0/d57/de1 0 2024-05-08T05:32:11.249 INFO:tasks.workunit.client.0.smithi087.stdout:7/877: getdents d2/d6/d12/d15/d5b 0 2024-05-08T05:32:11.249 INFO:tasks.workunit.client.0.smithi087.stdout:7/878: chown d2/d6/d12/d19 0 1 2024-05-08T05:32:11.249 INFO:tasks.workunit.client.0.smithi087.stdout:0/657: write d0/d9/d1b/d2f/d54/da1/f83 [478420,76165] 0 2024-05-08T05:32:11.251 INFO:tasks.workunit.client.0.smithi087.stdout:5/792: symlink da/dd/d65/l10c 0 2024-05-08T05:32:11.251 INFO:tasks.workunit.client.0.smithi087.stdout:5/793: fdatasync da/db/d2a/d5a/d93/d17/f2b 0 2024-05-08T05:32:11.251 INFO:tasks.workunit.client.0.smithi087.stdout:5/794: readlink da/dd/d65/l10c 0 2024-05-08T05:32:11.251 INFO:tasks.workunit.client.0.smithi087.stdout:5/795: dread - da/db/d2a/d5a/d93/d42/d43/d83/ddc/dd5/fea zero size 2024-05-08T05:32:11.251 INFO:tasks.workunit.client.0.smithi087.stdout:5/796: read - da/db/d2a/d5a/d93/d42/d43/d83/d6b/d9c/fa4 zero size 2024-05-08T05:32:11.251 INFO:tasks.workunit.client.0.smithi087.stdout:4/710: symlink d4/d13/d3e/d28/d50/d9d/df2/d106/d91/d84/l108 0 2024-05-08T05:32:11.251 INFO:tasks.workunit.client.0.smithi087.stdout:4/711: fdatasync d4/d13/d32/ddb/fa0 0 2024-05-08T05:32:11.251 INFO:tasks.workunit.client.0.smithi087.stdout:4/712: stat d4/d13/d32/fc1 0 2024-05-08T05:32:11.252 INFO:tasks.workunit.client.0.smithi087.stdout:7/879: mknod d2/d6/da0/d10f/d3f/d49/c120 0 2024-05-08T05:32:11.253 INFO:tasks.workunit.client.0.smithi087.stdout:5/797: write da/db/d2a/d5a/d93/d36/dc1/fbc [1005497,70639] 0 2024-05-08T05:32:11.255 INFO:tasks.workunit.client.0.smithi087.stdout:4/713: creat d4/d13/d3e/d28/d50/d9d/f109 x:0 0 0 2024-05-08T05:32:11.256 INFO:tasks.workunit.client.0.smithi087.stdout:8/720: dwrite db/d23/d1b/fad [0,4194304] 0 2024-05-08T05:32:11.256 INFO:tasks.workunit.client.0.smithi087.stdout:8/721: chown db/d23/d3a/d65/d83 509 1 2024-05-08T05:32:11.256 INFO:tasks.workunit.client.0.smithi087.stdout:7/880: truncate d2/d6/d12/dc5/f11f 29703 0 2024-05-08T05:32:11.257 INFO:tasks.workunit.client.0.smithi087.stdout:5/798: truncate da/db/d2a/d5a/d93/d42/d43/d83/d6b/f80 2830850 0 2024-05-08T05:32:11.259 INFO:tasks.workunit.client.0.smithi087.stdout:6/735: write d4/d8/df/d1e/d25/d28/d2d/d37/d45/f68 [1858323,80268] 0 2024-05-08T05:32:11.259 INFO:tasks.workunit.client.0.smithi087.stdout:4/714: creat d4/d13/d3e/d28/f10a x:0 0 0 2024-05-08T05:32:11.261 INFO:tasks.workunit.client.0.smithi087.stdout:8/722: mknod db/d23/d54/dd6/cf3 0 2024-05-08T05:32:11.263 INFO:tasks.workunit.client.0.smithi087.stdout:7/881: mknod d2/d6/c121 0 2024-05-08T05:32:11.263 INFO:tasks.workunit.client.0.smithi087.stdout:7/882: fsync d2/d6/d12/d15/f5c 0 2024-05-08T05:32:11.263 INFO:tasks.workunit.client.0.smithi087.stdout:5/799: creat da/db/d2a/d5a/dc3/f10d x:0 0 0 2024-05-08T05:32:11.266 INFO:tasks.workunit.client.0.smithi087.stdout:4/715: unlink d4/d13/d3e/d28/d35/c3d 0 2024-05-08T05:32:11.267 INFO:tasks.workunit.client.0.smithi087.stdout:6/736: mkdir d4/d8/df/d39/d42/d9e/d6f/d7f/de3 0 2024-05-08T05:32:11.269 INFO:tasks.workunit.client.0.smithi087.stdout:7/883: symlink d2/d6/d12/d19/d108/l122 0 2024-05-08T05:32:11.269 INFO:tasks.workunit.client.0.smithi087.stdout:7/884: truncate d2/d6/da0/d10f/fcc 4401846 0 2024-05-08T05:32:11.270 INFO:tasks.workunit.client.0.smithi087.stdout:5/800: truncate da/db/d2a/d46/d9a/fb3 3627239 0 2024-05-08T05:32:11.271 INFO:tasks.workunit.client.0.smithi087.stdout:8/723: rmdir db/d23/d1b/d35/d43 39 2024-05-08T05:32:11.271 INFO:tasks.workunit.client.0.smithi087.stdout:8/724: chown db/d23/d15/d29/d4d/f5a 2655 1 2024-05-08T05:32:11.272 INFO:tasks.workunit.client.0.smithi087.stdout:4/716: getdents d4/d13/d3e/d28/d50/d9d/df2/d106/d91/db8/dba/dbd 0 2024-05-08T05:32:11.274 INFO:tasks.workunit.client.0.smithi087.stdout:5/801: mkdir da/d10e 0 2024-05-08T05:32:11.274 INFO:tasks.workunit.client.0.smithi087.stdout:5/802: stat da/db/l96 0 2024-05-08T05:32:11.277 INFO:tasks.workunit.client.0.smithi087.stdout:8/725: link db/d23/d15/d3c/f3e db/d23/d15/d29/d33/d3b/d56/ff4 0 2024-05-08T05:32:11.278 INFO:tasks.workunit.client.0.smithi087.stdout:8/726: truncate db/d23/d15/d3c/f3f 1014024 0 2024-05-08T05:32:11.309 INFO:tasks.workunit.client.0.smithi087.stdout:6/737: dwrite d4/d8/df/d39/d42/d9e/dd1/fdd [0,4194304] 0 2024-05-08T05:32:11.310 INFO:tasks.workunit.client.0.smithi087.stdout:6/738: creat d4/d8/df/d1e/d52/fe4 x:0 0 0 2024-05-08T05:32:11.311 INFO:tasks.workunit.client.0.smithi087.stdout:6/739: creat d4/fe5 x:0 0 0 2024-05-08T05:32:11.324 INFO:tasks.workunit.client.0.smithi087.stdout:4/717: dwrite d4/d13/f3f [0,4194304] 0 2024-05-08T05:32:11.325 INFO:tasks.workunit.client.0.smithi087.stdout:7/885: dwrite d2/d6/d12/d15/d5b/f11c [0,4194304] 0 2024-05-08T05:32:11.325 INFO:tasks.workunit.client.0.smithi087.stdout:7/886: chown d2/cc0 250 1 2024-05-08T05:32:11.327 INFO:tasks.workunit.client.0.smithi087.stdout:4/718: rename d4/d13/d3e/d28/d50/d9d/df2/d106/ca5 to d4/d13/d3e/d28/d50/d9d/df2/d106/d91/db8/dba/dbd/c10b 0 2024-05-08T05:32:11.329 INFO:tasks.workunit.client.0.smithi087.stdout:4/719: mkdir d4/d13/d3e/d28/d50/d9d/df2/d106/d91/d84/d10c 0 2024-05-08T05:32:11.342 INFO:tasks.workunit.client.0.smithi087.stdout:7/887: read d2/d6/d12/d19/f73 [929294,4837] 0 2024-05-08T05:32:11.344 INFO:tasks.workunit.client.0.smithi087.stdout:6/740: dwrite d4/d8/df/d1e/d25/d28/d57/d6d/fdc [0,4194304] 0 2024-05-08T05:32:11.358 INFO:tasks.workunit.client.0.smithi087.stdout:6/741: dread d4/d8/df/d1e/d52/fcd [0,4194304] 0 2024-05-08T05:32:11.360 INFO:tasks.workunit.client.0.smithi087.stdout:6/742: unlink d4/d8/df/d1e/d25/fb7 0 2024-05-08T05:32:11.362 INFO:tasks.workunit.client.0.smithi087.stdout:6/743: getdents d4/d8/df/d39/d42/d9e/da4/dad 0 2024-05-08T05:32:11.364 INFO:tasks.workunit.client.0.smithi087.stdout:1/617: sync 2024-05-08T05:32:11.364 INFO:tasks.workunit.client.0.smithi087.stdout:9/756: sync 2024-05-08T05:32:11.364 INFO:tasks.workunit.client.0.smithi087.stdout:2/696: sync 2024-05-08T05:32:11.364 INFO:tasks.workunit.client.0.smithi087.stdout:2/697: truncate d7/d63/f74 1428527 0 2024-05-08T05:32:11.364 INFO:tasks.workunit.client.0.smithi087.stdout:2/698: dread - d7/de/d27/d33/d49/db9/fc0 zero size 2024-05-08T05:32:11.365 INFO:tasks.workunit.client.0.smithi087.stdout:2/699: readlink d7/de/db1/dbe/le2 0 2024-05-08T05:32:11.365 INFO:tasks.workunit.client.0.smithi087.stdout:3/727: sync 2024-05-08T05:32:11.365 INFO:tasks.workunit.client.0.smithi087.stdout:3/728: fdatasync d4/d11/d24/fe7 0 2024-05-08T05:32:11.365 INFO:tasks.workunit.client.0.smithi087.stdout:1/618: rmdir df/d18/d1d/d27/d61/d89 39 2024-05-08T05:32:11.366 INFO:tasks.workunit.client.0.smithi087.stdout:2/700: link d7/d63/fea d7/de/d5d/d7b/ff0 0 2024-05-08T05:32:11.366 INFO:tasks.workunit.client.0.smithi087.stdout:2/701: chown d7/d63/l3c 60806861 1 2024-05-08T05:32:11.366 INFO:tasks.workunit.client.0.smithi087.stdout:1/619: creat df/d2f/d57/dcb/fd6 x:0 0 0 2024-05-08T05:32:11.367 INFO:tasks.workunit.client.0.smithi087.stdout:1/620: creat df/d18/d1d/d27/d61/fd7 x:0 0 0 2024-05-08T05:32:11.368 INFO:tasks.workunit.client.0.smithi087.stdout:1/621: mknod df/d2f/d57/d64/d83/d96/cd8 0 2024-05-08T05:32:11.377 INFO:tasks.workunit.client.0.smithi087.stdout:4/720: dwrite d4/f40 [0,4194304] 0 2024-05-08T05:32:11.381 INFO:tasks.workunit.client.0.smithi087.stdout:9/757: write d1/f30 [233238,87056] 0 2024-05-08T05:32:11.382 INFO:tasks.workunit.client.0.smithi087.stdout:4/721: unlink d4/d13/d3e/d28/d50/d9d/df2/d106/d91/db8/dba/dbd/fcb 0 2024-05-08T05:32:11.382 INFO:tasks.workunit.client.0.smithi087.stdout:2/702: dread d7/de/d5d/f86 [0,4194304] 0 2024-05-08T05:32:11.384 INFO:tasks.workunit.client.0.smithi087.stdout:3/729: dread d4/d11/d24/d25/d4d/fc7 [0,4194304] 0 2024-05-08T05:32:11.385 INFO:tasks.workunit.client.0.smithi087.stdout:2/703: unlink d7/de/d5d/d7b/fb3 0 2024-05-08T05:32:11.387 INFO:tasks.workunit.client.0.smithi087.stdout:4/722: creat d4/d6c/d93/f10d x:0 0 0 2024-05-08T05:32:11.388 INFO:tasks.workunit.client.0.smithi087.stdout:6/744: read d4/d8/df/d1e/d25/d28/d57/d6d/f82 [1375209,75428] 0 2024-05-08T05:32:11.389 INFO:tasks.workunit.client.0.smithi087.stdout:3/730: symlink d4/d11/d24/d25/d99/da2/l102 0 2024-05-08T05:32:11.389 INFO:tasks.workunit.client.0.smithi087.stdout:3/731: write d4/d11/d24/d25/d3e/d58/fd4 [1280494,64900] 0 2024-05-08T05:32:11.389 INFO:tasks.workunit.client.0.smithi087.stdout:3/732: write d4/d11/d24/d39/d94/df7/ffa [118922,84537] 0 2024-05-08T05:32:11.389 INFO:tasks.workunit.client.0.smithi087.stdout:3/733: getdents d4/d11/d24/d25/d4d/dbb/de9 0 2024-05-08T05:32:11.390 INFO:tasks.workunit.client.0.smithi087.stdout:3/734: fdatasync d4/d11/d3d/f8e 0 2024-05-08T05:32:11.390 INFO:tasks.workunit.client.0.smithi087.stdout:2/704: mkdir d7/de/d5d/d90/df1 0 2024-05-08T05:32:11.391 INFO:tasks.workunit.client.0.smithi087.stdout:4/723: unlink d4/d13/d65/cd2 0 2024-05-08T05:32:11.391 INFO:tasks.workunit.client.0.smithi087.stdout:4/724: dread - d4/d13/d3e/d28/d50/d9d/f109 zero size 2024-05-08T05:32:11.392 INFO:tasks.workunit.client.0.smithi087.stdout:3/735: creat d4/d11/d24/d39/d94/f103 x:0 0 0 2024-05-08T05:32:11.397 INFO:tasks.workunit.client.0.smithi087.stdout:2/705: dread d7/de/d27/d33/f76 [0,4194304] 0 2024-05-08T05:32:11.410 INFO:tasks.workunit.client.0.smithi087.stdout:1/622: write df/d2f/f3c [1621429,125323] 0 2024-05-08T05:32:11.414 INFO:tasks.workunit.client.0.smithi087.stdout:4/725: dread d4/d13/d3e/d28/d50/d9d/df2/d106/d91/db8/dba/f78 [0,4194304] 0 2024-05-08T05:32:11.415 INFO:tasks.workunit.client.0.smithi087.stdout:7/888: dwrite d2/d6/da0/d10f/f11 [0,4194304] 0 2024-05-08T05:32:11.415 INFO:tasks.workunit.client.0.smithi087.stdout:7/889: write d2/d6/d12/d15/f28 [5599440,22576] 0 2024-05-08T05:32:11.415 INFO:tasks.workunit.client.0.smithi087.stdout:7/890: chown d2/d6/d12/d1d 112 1 2024-05-08T05:32:11.417 INFO:tasks.workunit.client.0.smithi087.stdout:4/726: creat d4/d13/d3e/d28/d50/d5a/f10e x:0 0 0 2024-05-08T05:32:11.418 INFO:tasks.workunit.client.0.smithi087.stdout:4/727: creat d4/d13/d3e/d28/d50/d9d/f10f x:0 0 0 2024-05-08T05:32:11.419 INFO:tasks.workunit.client.0.smithi087.stdout:4/728: mknod d4/d13/d3e/d28/d50/c110 0 2024-05-08T05:32:11.421 INFO:tasks.workunit.client.0.smithi087.stdout:7/891: dread d2/d6/da0/d10f/d3f/d72/d77/d54/d55/d65/dc3/fe3 [0,4194304] 0 2024-05-08T05:32:11.425 INFO:tasks.workunit.client.0.smithi087.stdout:7/892: rename d2/d6/d12/d19/d2a/fcf to d2/d6/da0/d10f/d3f/d72/d77/d54/d55/d65/f123 0 2024-05-08T05:32:11.425 INFO:tasks.workunit.client.0.smithi087.stdout:7/893: rmdir d2/d6/da0/d10f/d3f/d72/d77/d54/d50/d88 39 2024-05-08T05:32:11.425 INFO:tasks.workunit.client.0.smithi087.stdout:7/894: fsync d2/d6/d12/f51 0 2024-05-08T05:32:11.426 INFO:tasks.workunit.client.0.smithi087.stdout:7/895: mkdir d2/d6/da0/d10f/d3f/d72/d77/d124 0 2024-05-08T05:32:11.426 INFO:tasks.workunit.client.0.smithi087.stdout:7/896: write d2/d6/da0/d10f/d3f/d66/f8a [535218,74798] 0 2024-05-08T05:32:11.430 INFO:tasks.workunit.client.0.smithi087.stdout:7/897: creat d2/d6/d12/d1d/f125 x:0 0 0 2024-05-08T05:32:11.432 INFO:tasks.workunit.client.0.smithi087.stdout:7/898: creat d2/d6/da0/d10f/d3f/d72/d77/dc2/f126 x:0 0 0 2024-05-08T05:32:11.433 INFO:tasks.workunit.client.0.smithi087.stdout:7/899: truncate d2/d6/d12/dc5/f11f 303413 0 2024-05-08T05:32:11.438 INFO:tasks.workunit.client.0.smithi087.stdout:3/736: dread d4/d11/d24/d25/f2f [0,4194304] 0 2024-05-08T05:32:11.438 INFO:tasks.workunit.client.0.smithi087.stdout:7/900: creat d2/d6/d12/d19/d108/f127 x:0 0 0 2024-05-08T05:32:11.450 INFO:tasks.workunit.client.0.smithi087.stdout:7/901: dread d2/d6/da0/d10f/fad [0,4194304] 0 2024-05-08T05:32:11.450 INFO:tasks.workunit.client.0.smithi087.stdout:1/623: read df/f3b [196958,28260] 0 2024-05-08T05:32:11.453 INFO:tasks.workunit.client.0.smithi087.stdout:7/902: rename d2/d6/da0/d10f/d3f/d72/d77/d54/d55/d65/df1/cfa to d2/d6/d12/d19/d2a/d91/c128 0 2024-05-08T05:32:11.454 INFO:tasks.workunit.client.0.smithi087.stdout:9/758: dwrite d1/df/d37/d74/fa5 [0,4194304] 0 2024-05-08T05:32:11.455 INFO:tasks.workunit.client.0.smithi087.stdout:2/706: dwrite d7/d63/f7d [4194304,4194304] 0 2024-05-08T05:32:11.455 INFO:tasks.workunit.client.0.smithi087.stdout:2/707: write d7/de/d27/f4f [1399816,79238] 0 2024-05-08T05:32:11.455 INFO:tasks.workunit.client.0.smithi087.stdout:2/708: chown d7/de/d27/d33/f99 65354 1 2024-05-08T05:32:11.458 INFO:tasks.workunit.client.0.smithi087.stdout:1/624: mknod df/d2f/d57/da0/cd9 0 2024-05-08T05:32:11.458 INFO:tasks.workunit.client.0.smithi087.stdout:1/625: truncate df/d2f/d57/dcb/fd6 115522 0 2024-05-08T05:32:11.459 INFO:tasks.workunit.client.0.smithi087.stdout:3/737: dread d4/d11/f20 [0,4194304] 0 2024-05-08T05:32:11.460 INFO:tasks.workunit.client.0.smithi087.stdout:6/745: dwrite d4/d8/f18 [0,4194304] 0 2024-05-08T05:32:11.465 INFO:tasks.workunit.client.0.smithi087.stdout:6/746: dread d4/d6/f60 [0,4194304] 0 2024-05-08T05:32:11.467 INFO:tasks.workunit.client.0.smithi087.stdout:2/709: creat d7/de/d2c/db0/dd3/ff2 x:0 0 0 2024-05-08T05:32:11.467 INFO:tasks.workunit.client.0.smithi087.stdout:0/658: sync 2024-05-08T05:32:11.467 INFO:tasks.workunit.client.0.smithi087.stdout:8/727: sync 2024-05-08T05:32:11.468 INFO:tasks.workunit.client.0.smithi087.stdout:2/710: fdatasync d7/de/d27/d33/d81/fa9 0 2024-05-08T05:32:11.468 INFO:tasks.workunit.client.0.smithi087.stdout:2/711: dread - d7/de/d2c/db0/dd3/ff2 zero size 2024-05-08T05:32:11.468 INFO:tasks.workunit.client.0.smithi087.stdout:0/659: truncate d0/d9/d1b/fbe 843485 0 2024-05-08T05:32:11.468 INFO:tasks.workunit.client.0.smithi087.stdout:5/803: sync 2024-05-08T05:32:11.469 INFO:tasks.workunit.client.0.smithi087.stdout:5/804: truncate da/db/d2a/d5a/dc3/f10d 920544 0 2024-05-08T05:32:11.469 INFO:tasks.workunit.client.0.smithi087.stdout:1/626: symlink df/d18/d1d/d32/d9c/lda 0 2024-05-08T05:32:11.470 INFO:tasks.workunit.client.0.smithi087.stdout:3/738: unlink d4/d11/d24/d25/d4d/l82 0 2024-05-08T05:32:11.470 INFO:tasks.workunit.client.0.smithi087.stdout:3/739: dread - d4/d11/d24/d39/d60/d87/da5/fcb zero size 2024-05-08T05:32:11.471 INFO:tasks.workunit.client.0.smithi087.stdout:8/728: rename db/d23/d15/d29/d33/d3b/d56/f87 to db/d23/d54/ff5 0 2024-05-08T05:32:11.471 INFO:tasks.workunit.client.0.smithi087.stdout:0/660: symlink d0/d9/d1b/d5e/le2 0 2024-05-08T05:32:11.472 INFO:tasks.workunit.client.0.smithi087.stdout:2/712: rmdir d7/de/d27 39 2024-05-08T05:32:11.475 INFO:tasks.workunit.client.0.smithi087.stdout:9/759: write d1/df/d14/d68/d80/d98/d28/f7c [4735671,4665] 0 2024-05-08T05:32:11.480 INFO:tasks.workunit.client.0.smithi087.stdout:2/713: dread d7/de/d27/d33/d49/f84 [0,4194304] 0 2024-05-08T05:32:11.480 INFO:tasks.workunit.client.0.smithi087.stdout:2/714: chown d7/de/d2c/db6/dcb/db7/fdd 1707576428 1 2024-05-08T05:32:11.482 INFO:tasks.workunit.client.0.smithi087.stdout:2/715: rename d7/de/d2c/c34 to d7/de/d2c/d43/db4/cf3 0 2024-05-08T05:32:11.483 INFO:tasks.workunit.client.0.smithi087.stdout:2/716: rename d7/de/f24 to d7/d93/ff4 0 2024-05-08T05:32:11.484 INFO:tasks.workunit.client.0.smithi087.stdout:2/717: unlink d7/f8a 0 2024-05-08T05:32:11.513 INFO:tasks.workunit.client.0.smithi087.stdout:1/627: write df/d18/d1d/fb0 [541317,118706] 0 2024-05-08T05:32:11.521 INFO:tasks.workunit.client.0.smithi087.stdout:9/760: dread d1/df/d14/d68/f6b [0,4194304] 0 2024-05-08T05:32:11.523 INFO:tasks.workunit.client.0.smithi087.stdout:9/761: mkdir d1/df/d37/d5b/def 0 2024-05-08T05:32:11.523 INFO:tasks.workunit.client.0.smithi087.stdout:9/762: truncate d1/df/d14/d68/d80/d98/f47 1606615 0 2024-05-08T05:32:11.530 INFO:tasks.workunit.client.0.smithi087.stdout:8/729: dwrite db/d23/d1b/d7c/f97 [4194304,4194304] 0 2024-05-08T05:32:11.534 INFO:tasks.workunit.client.0.smithi087.stdout:0/661: dwrite d0/d57/d24/f4e [4194304,4194304] 0 2024-05-08T05:32:11.535 INFO:tasks.workunit.client.0.smithi087.stdout:5/805: dwrite da/f66 [0,4194304] 0 2024-05-08T05:32:11.535 INFO:tasks.workunit.client.0.smithi087.stdout:7/903: dwrite d2/d6/da0/d10f/d3f/d72/f8b [4194304,4194304] 0 2024-05-08T05:32:11.536 INFO:tasks.workunit.client.0.smithi087.stdout:3/740: dwrite d4/d11/d3d/f5b [4194304,4194304] 0 2024-05-08T05:32:11.536 INFO:tasks.workunit.client.0.smithi087.stdout:3/741: readlink d4/d11/d24/d25/d4d/dd6/lde 0 2024-05-08T05:32:11.537 INFO:tasks.workunit.client.0.smithi087.stdout:3/742: dread - d4/d11/d24/d39/d60/d87/da5/fcb zero size 2024-05-08T05:32:11.540 INFO:tasks.workunit.client.0.smithi087.stdout:5/806: mkdir da/dd/d10f 0 2024-05-08T05:32:11.542 INFO:tasks.workunit.client.0.smithi087.stdout:9/763: dread d1/f19 [0,4194304] 0 2024-05-08T05:32:11.543 INFO:tasks.workunit.client.0.smithi087.stdout:3/743: link d4/l3a d4/d11/d24/d25/d4d/dbb/dfd/l104 0 2024-05-08T05:32:11.544 INFO:tasks.workunit.client.0.smithi087.stdout:5/807: mknod da/db/d2a/d5a/d93/c110 0 2024-05-08T05:32:11.544 INFO:tasks.workunit.client.0.smithi087.stdout:5/808: fdatasync da/db/d2a/d5a/f105 0 2024-05-08T05:32:11.547 INFO:tasks.workunit.client.0.smithi087.stdout:3/744: symlink d4/d5f/dbd/l105 0 2024-05-08T05:32:11.547 INFO:tasks.workunit.client.0.smithi087.stdout:3/745: write d4/d11/d3d/f8e [213936,6377] 0 2024-05-08T05:32:11.547 INFO:tasks.workunit.client.0.smithi087.stdout:9/764: rmdir d1/df/d14/d68/d80/d98/d28/d4b 39 2024-05-08T05:32:11.548 INFO:tasks.workunit.client.0.smithi087.stdout:9/765: write d1/df/d14/d68/d80/d98/d28/fdc [231517,63754] 0 2024-05-08T05:32:11.548 INFO:tasks.workunit.client.0.smithi087.stdout:9/766: dread - d1/d70/fa8 zero size 2024-05-08T05:32:11.549 INFO:tasks.workunit.client.0.smithi087.stdout:3/746: rename d4/d11/d24/d25/d3e/d3f/l44 to d4/d11/d24/d25/d4d/dd6/l106 0 2024-05-08T05:32:11.549 INFO:tasks.workunit.client.0.smithi087.stdout:3/747: read - d4/d11/fdf zero size 2024-05-08T05:32:11.550 INFO:tasks.workunit.client.0.smithi087.stdout:9/767: mkdir d1/df/d14/d18/db5/df0 0 2024-05-08T05:32:11.551 INFO:tasks.workunit.client.0.smithi087.stdout:3/748: mkdir d4/d11/d24/d25/d99/d107 0 2024-05-08T05:32:11.551 INFO:tasks.workunit.client.0.smithi087.stdout:3/749: truncate d4/d11/d24/d39/faf 4964862 0 2024-05-08T05:32:11.551 INFO:tasks.workunit.client.0.smithi087.stdout:3/750: truncate d4/d11/d24/fa6 1108852 0 2024-05-08T05:32:11.551 INFO:tasks.workunit.client.0.smithi087.stdout:5/809: dread da/f30 [0,4194304] 0 2024-05-08T05:32:11.551 INFO:tasks.workunit.client.0.smithi087.stdout:0/662: dread d0/da/f78 [0,4194304] 0 2024-05-08T05:32:11.552 INFO:tasks.workunit.client.0.smithi087.stdout:9/768: symlink d1/df/d14/d18/d66/d7f/lf1 0 2024-05-08T05:32:11.552 INFO:tasks.workunit.client.0.smithi087.stdout:9/769: fdatasync d1/df/d58/fc5 0 2024-05-08T05:32:11.552 INFO:tasks.workunit.client.0.smithi087.stdout:9/770: mkdir d1/df/d37/d5b/def/df2 0 2024-05-08T05:32:11.554 INFO:tasks.workunit.client.0.smithi087.stdout:9/771: symlink d1/df/d14/d54/lf3 0 2024-05-08T05:32:11.554 INFO:tasks.workunit.client.0.smithi087.stdout:9/772: chown d1/df/d14/d68/d80/d98/d83/ca9 14577 1 2024-05-08T05:32:11.557 INFO:tasks.workunit.client.0.smithi087.stdout:9/773: unlink d1/df/d14/d68/f6b 0 2024-05-08T05:32:11.558 INFO:tasks.workunit.client.0.smithi087.stdout:9/774: write d1/df/d37/d5b/d7e/f8f [92073,124729] 0 2024-05-08T05:32:11.558 INFO:tasks.workunit.client.0.smithi087.stdout:9/775: truncate d1/df/d14/d54/d61/d72/fc4 394395 0 2024-05-08T05:32:11.560 INFO:tasks.workunit.client.0.smithi087.stdout:0/663: dread d0/d9/d1b/d2f/d54/da1/f83 [0,4194304] 0 2024-05-08T05:32:11.560 INFO:tasks.workunit.client.0.smithi087.stdout:1/628: dwrite df/d2f/d57/da0/fd1 [0,4194304] 0 2024-05-08T05:32:11.562 INFO:tasks.workunit.client.0.smithi087.stdout:1/629: symlink df/d18/d1d/d27/dd4/ldb 0 2024-05-08T05:32:11.563 INFO:tasks.workunit.client.0.smithi087.stdout:1/630: creat df/d2f/d57/d64/fdc x:0 0 0 2024-05-08T05:32:11.563 INFO:tasks.workunit.client.0.smithi087.stdout:1/631: readlink df/d18/d1d/l81 0 2024-05-08T05:32:11.563 INFO:tasks.workunit.client.0.smithi087.stdout:1/632: write df/d2f/d4f/f84 [1541242,89408] 0 2024-05-08T05:32:11.566 INFO:tasks.workunit.client.0.smithi087.stdout:1/633: creat df/d2f/fdd x:0 0 0 2024-05-08T05:32:11.579 INFO:tasks.workunit.client.0.smithi087.stdout:6/747: dwrite d4/d8/f3b [0,4194304] 0 2024-05-08T05:32:11.584 INFO:tasks.workunit.client.0.smithi087.stdout:9/776: dread d1/df/d14/d18/f77 [4194304,4194304] 0 2024-05-08T05:32:11.595 INFO:tasks.workunit.client.0.smithi087.stdout:7/904: dread d2/d6/d12/d19/f73 [0,4194304] 0 2024-05-08T05:32:11.596 INFO:tasks.workunit.client.0.smithi087.stdout:9/777: rmdir d1/df/d14/d68/d80/d98/d83/de7 0 2024-05-08T05:32:11.597 INFO:tasks.workunit.client.0.smithi087.stdout:7/905: mkdir d2/d6/d129 0 2024-05-08T05:32:11.598 INFO:tasks.workunit.client.0.smithi087.stdout:9/778: mkdir d1/df/d14/d54/d61/d88/dca/df4 0 2024-05-08T05:32:11.598 INFO:tasks.workunit.client.0.smithi087.stdout:1/634: dread df/d2f/d4f/f65 [0,4194304] 0 2024-05-08T05:32:11.599 INFO:tasks.workunit.client.0.smithi087.stdout:7/906: mkdir d2/d6/da0/d10f/d3f/d72/d77/d54/d55/dfc/d12a 0 2024-05-08T05:32:11.599 INFO:tasks.workunit.client.0.smithi087.stdout:8/730: dwrite db/d23/f57 [0,4194304] 0 2024-05-08T05:32:11.599 INFO:tasks.workunit.client.0.smithi087.stdout:8/731: stat db/d23/d15/d29/d33/d6c/f7e 0 2024-05-08T05:32:11.600 INFO:tasks.workunit.client.0.smithi087.stdout:8/732: fdatasync db/d23/d15/d29/d33/fd7 0 2024-05-08T05:32:11.600 INFO:tasks.workunit.client.0.smithi087.stdout:8/733: dread - db/d23/d15/d29/fd9 zero size 2024-05-08T05:32:11.600 INFO:tasks.workunit.client.0.smithi087.stdout:9/779: mknod d1/df/d14/d68/d80/d98/d28/cf5 0 2024-05-08T05:32:11.600 INFO:tasks.workunit.client.0.smithi087.stdout:6/748: dread d4/d8/df/d1e/d25/d28/fa1 [4194304,4194304] 0 2024-05-08T05:32:11.600 INFO:tasks.workunit.client.0.smithi087.stdout:6/749: readlink d4/d8/df/d1e/d25/d28/d57/d6d/l89 0 2024-05-08T05:32:11.601 INFO:tasks.workunit.client.0.smithi087.stdout:1/635: getdents df/d18/d1d 0 2024-05-08T05:32:11.602 INFO:tasks.workunit.client.0.smithi087.stdout:0/664: dwrite d0/d9/d1b/d2f/d54/da1/fbf [4194304,4194304] 0 2024-05-08T05:32:11.604 INFO:tasks.workunit.client.0.smithi087.stdout:5/810: dwrite da/db/d2a/d5a/d93/d36/d45/d5c/d100/f107 [0,4194304] 0 2024-05-08T05:32:11.604 INFO:tasks.workunit.client.0.smithi087.stdout:5/811: chown da/db/c23 346533480 1 2024-05-08T05:32:11.604 INFO:tasks.workunit.client.0.smithi087.stdout:5/812: dread - da/dd/d13/da2/dce/fed zero size 2024-05-08T05:32:11.606 INFO:tasks.workunit.client.0.smithi087.stdout:7/907: rename d2/d6/da0/d10f/d3f/d72/d77/d54/d55/d65/dc3 to d2/d6/da0/d10f/d3f/d49/d59/d12b 0 2024-05-08T05:32:11.606 INFO:tasks.workunit.client.0.smithi087.stdout:8/734: getdents db/d23/d1b/d35 0 2024-05-08T05:32:11.609 INFO:tasks.workunit.client.0.smithi087.stdout:5/813: creat da/db/d2a/d5a/d93/d36/d45/d5c/dff/f111 x:0 0 0 2024-05-08T05:32:11.609 INFO:tasks.workunit.client.0.smithi087.stdout:5/814: chown da/db/d2a/d5a/d93/d17/d99/fb5 4123698 1 2024-05-08T05:32:11.615 INFO:tasks.workunit.client.0.smithi087.stdout:6/750: rename d4/d8/df/d1e/d25/d28/d2d/d37/d5b/fa9 to d4/d8/df/d1e/d25/fe6 0 2024-05-08T05:32:11.616 INFO:tasks.workunit.client.0.smithi087.stdout:3/751: dwrite d4/d11/d24/d25/d3e/f8d [0,4194304] 0 2024-05-08T05:32:11.616 INFO:tasks.workunit.client.0.smithi087.stdout:8/735: unlink db/d23/d1b/d35/d43/f53 0 2024-05-08T05:32:11.616 INFO:tasks.workunit.client.0.smithi087.stdout:8/736: write db/d23/d15/d3c/fcf [284588,90111] 0 2024-05-08T05:32:11.616 INFO:tasks.workunit.client.0.smithi087.stdout:1/636: dread df/f40 [0,4194304] 0 2024-05-08T05:32:11.616 INFO:tasks.workunit.client.0.smithi087.stdout:7/908: dread d2/d6/da0/f61 [0,4194304] 0 2024-05-08T05:32:11.616 INFO:tasks.workunit.client.0.smithi087.stdout:7/909: write d2/d6/da0/d10f/d3f/d72/d77/d54/fde [686133,70985] 0 2024-05-08T05:32:11.618 INFO:tasks.workunit.client.0.smithi087.stdout:3/752: unlink d4/d11/d3d/d4e/d6a/fd2 0 2024-05-08T05:32:11.618 INFO:tasks.workunit.client.0.smithi087.stdout:8/737: mknod db/d23/d3a/d65/d83/cf6 0 2024-05-08T05:32:11.619 INFO:tasks.workunit.client.0.smithi087.stdout:8/738: fdatasync db/f59 0 2024-05-08T05:32:11.619 INFO:tasks.workunit.client.0.smithi087.stdout:3/753: write d4/d11/d24/d25/d99/fa0 [456838,11638] 0 2024-05-08T05:32:11.619 INFO:tasks.workunit.client.0.smithi087.stdout:8/739: chown db/d23/f8c 1276 1 2024-05-08T05:32:11.619 INFO:tasks.workunit.client.0.smithi087.stdout:3/754: write d4/d11/d24/d25/d3e/d58/f96 [983844,72693] 0 2024-05-08T05:32:11.619 INFO:tasks.workunit.client.0.smithi087.stdout:1/637: creat df/d18/d1d/d58/d72/fde x:0 0 0 2024-05-08T05:32:11.619 INFO:tasks.workunit.client.0.smithi087.stdout:1/638: fdatasync df/d2f/d57/d64/f29 0 2024-05-08T05:32:11.619 INFO:tasks.workunit.client.0.smithi087.stdout:1/639: write df/d18/d1d/d27/d61/fb2 [401617,106522] 0 2024-05-08T05:32:11.619 INFO:tasks.workunit.client.0.smithi087.stdout:1/640: dread - df/d18/d1d/f9e zero size 2024-05-08T05:32:11.620 INFO:tasks.workunit.client.0.smithi087.stdout:7/910: creat d2/d6/da0/d10f/d3f/d72/d77/f12c x:0 0 0 2024-05-08T05:32:11.621 INFO:tasks.workunit.client.0.smithi087.stdout:8/740: mknod db/d23/d1b/d35/d43/d68/cf7 0 2024-05-08T05:32:11.621 INFO:tasks.workunit.client.0.smithi087.stdout:4/729: sync 2024-05-08T05:32:11.621 INFO:tasks.workunit.client.0.smithi087.stdout:4/730: truncate d4/d6c/d93/ffd 826934 0 2024-05-08T05:32:11.621 INFO:tasks.workunit.client.0.smithi087.stdout:4/731: write d4/d13/d3e/d28/fcf [247106,42700] 0 2024-05-08T05:32:11.621 INFO:tasks.workunit.client.0.smithi087.stdout:3/755: symlink d4/d11/de0/l108 0 2024-05-08T05:32:11.623 INFO:tasks.workunit.client.0.smithi087.stdout:7/911: creat d2/d6/d12/d19/d2a/d91/f12d x:0 0 0 2024-05-08T05:32:11.623 INFO:tasks.workunit.client.0.smithi087.stdout:7/912: fdatasync d2/d6/da0/d10f/d3f/d66/f8a 0 2024-05-08T05:32:11.624 INFO:tasks.workunit.client.0.smithi087.stdout:4/732: mkdir d4/d13/d3e/d28/d50/d9d/df2/d106/d91/db8/dba/dbd/d111 0 2024-05-08T05:32:11.625 INFO:tasks.workunit.client.0.smithi087.stdout:3/756: symlink d4/d5f/dbd/l109 0 2024-05-08T05:32:11.627 INFO:tasks.workunit.client.0.smithi087.stdout:7/913: mkdir d2/d6/d12/d15/d5b/dee/d118/d12e 0 2024-05-08T05:32:11.629 INFO:tasks.workunit.client.0.smithi087.stdout:4/733: symlink d4/d13/d3e/d28/d50/d9d/df2/l112 0 2024-05-08T05:32:11.640 INFO:tasks.workunit.client.0.smithi087.stdout:1/641: write df/d2f/f35 [3604180,117368] 0 2024-05-08T05:32:11.644 INFO:tasks.workunit.client.0.smithi087.stdout:8/741: dread db/d23/d1b/d35/d43/d68/f86 [0,4194304] 0 2024-05-08T05:32:11.644 INFO:tasks.workunit.client.0.smithi087.stdout:8/742: write db/f11 [2184344,16870] 0 2024-05-08T05:32:11.644 INFO:tasks.workunit.client.0.smithi087.stdout:8/743: write db/d23/d15/d29/fd9 [996029,59596] 0 2024-05-08T05:32:11.652 INFO:tasks.workunit.client.0.smithi087.stdout:8/744: symlink db/d23/d15/d29/lf8 0 2024-05-08T05:32:11.656 INFO:tasks.workunit.client.0.smithi087.stdout:6/751: write d4/d8/faa [4751275,88231] 0 2024-05-08T05:32:11.657 INFO:tasks.workunit.client.0.smithi087.stdout:0/665: dwrite d0/da/f78 [4194304,4194304] 0 2024-05-08T05:32:11.663 INFO:tasks.workunit.client.0.smithi087.stdout:0/666: symlink d0/d9/d1b/d5e/le3 0 2024-05-08T05:32:11.676 INFO:tasks.workunit.client.0.smithi087.stdout:9/780: dwrite d1/df/d58/fe4 [0,4194304] 0 2024-05-08T05:32:11.677 INFO:tasks.workunit.client.0.smithi087.stdout:0/667: dread d0/d22/f61 [0,4194304] 0 2024-05-08T05:32:11.679 INFO:tasks.workunit.client.0.smithi087.stdout:6/752: rename d4/d8/df/d1e/d25/d28 to d4/d8/df/d39/d42/d9e/d6f/d7f/de7 0 2024-05-08T05:32:11.679 INFO:tasks.workunit.client.0.smithi087.stdout:2/718: sync 2024-05-08T05:32:11.680 INFO:tasks.workunit.client.0.smithi087.stdout:0/668: chown d0/c5a 71740579 1 2024-05-08T05:32:11.680 INFO:tasks.workunit.client.0.smithi087.stdout:4/734: dwrite d4/d13/d65/dd7/fe9 [0,4194304] 0 2024-05-08T05:32:11.682 INFO:tasks.workunit.client.0.smithi087.stdout:2/719: creat d7/de/d82/ff5 x:0 0 0 2024-05-08T05:32:11.683 INFO:tasks.workunit.client.0.smithi087.stdout:0/669: getdents d0/dd0 0 2024-05-08T05:32:11.685 INFO:tasks.workunit.client.0.smithi087.stdout:8/745: dread db/d23/d15/d29/d33/f7f [0,4194304] 0 2024-05-08T05:32:11.685 INFO:tasks.workunit.client.0.smithi087.stdout:2/720: rmdir d7/de/d2c/db6/dcb/db7 39 2024-05-08T05:32:11.692 INFO:tasks.workunit.client.0.smithi087.stdout:7/914: dwrite d2/d6/da0/d10f/d3f/d49/d59/f104 [0,4194304] 0 2024-05-08T05:32:11.696 INFO:tasks.workunit.client.0.smithi087.stdout:0/670: mkdir d0/da/db4/de4 0 2024-05-08T05:32:11.696 INFO:tasks.workunit.client.0.smithi087.stdout:8/746: creat db/d23/d15/d3c/ff9 x:0 0 0 2024-05-08T05:32:11.696 INFO:tasks.workunit.client.0.smithi087.stdout:8/747: chown db/ca4 17 1 2024-05-08T05:32:11.696 INFO:tasks.workunit.client.0.smithi087.stdout:2/721: rename d7/de/d2c/d43/cb5 to d7/de/d5d/d90/df1/cf6 0 2024-05-08T05:32:11.700 INFO:tasks.workunit.client.0.smithi087.stdout:2/722: rmdir d7/de/d5d/d90 39 2024-05-08T05:32:11.700 INFO:tasks.workunit.client.0.smithi087.stdout:8/748: mknod db/d23/d15/d29/d33/d3b/cfa 0 2024-05-08T05:32:11.700 INFO:tasks.workunit.client.0.smithi087.stdout:8/749: write db/d23/d15/d3c/f3e [4843085,37300] 0 2024-05-08T05:32:11.701 INFO:tasks.workunit.client.0.smithi087.stdout:3/757: dwrite d4/d11/d24/d25/d4d/f68 [8388608,4194304] 0 2024-05-08T05:32:11.703 INFO:tasks.workunit.client.0.smithi087.stdout:3/758: symlink d4/d11/d24/d25/d4d/dd6/l10a 0 2024-05-08T05:32:11.705 INFO:tasks.workunit.client.0.smithi087.stdout:3/759: creat d4/f10b x:0 0 0 2024-05-08T05:32:11.705 INFO:tasks.workunit.client.0.smithi087.stdout:3/760: dread - d4/d11/d24/d39/d94/fdd zero size 2024-05-08T05:32:11.706 INFO:tasks.workunit.client.0.smithi087.stdout:2/723: rmdir d7/de/d5d 39 2024-05-08T05:32:11.715 INFO:tasks.workunit.client.0.smithi087.stdout:1/642: dwrite df/d18/d1d/d58/d72/fde [0,4194304] 0 2024-05-08T05:32:11.715 INFO:tasks.workunit.client.0.smithi087.stdout:9/781: dread d1/df/d14/d68/faa [0,4194304] 0 2024-05-08T05:32:11.715 INFO:tasks.workunit.client.0.smithi087.stdout:9/782: chown d1/df/d14/d18 114 1 2024-05-08T05:32:11.715 INFO:tasks.workunit.client.0.smithi087.stdout:9/783: fsync d1/df/d14/d54/d61/f31 0 2024-05-08T05:32:11.717 INFO:tasks.workunit.client.0.smithi087.stdout:2/724: dread d7/de/d27/f53 [0,4194304] 0 2024-05-08T05:32:11.718 INFO:tasks.workunit.client.0.smithi087.stdout:9/784: creat d1/df/d37/d5b/def/ff6 x:0 0 0 2024-05-08T05:32:11.720 INFO:tasks.workunit.client.0.smithi087.stdout:9/785: truncate d1/df/d37/d5b/d7e/f82 631831 0 2024-05-08T05:32:11.720 INFO:tasks.workunit.client.0.smithi087.stdout:9/786: truncate d1/df/d37/d5b/d7e/d85/f87 5221204 0 2024-05-08T05:32:11.720 INFO:tasks.workunit.client.0.smithi087.stdout:9/787: readlink d1/df/d14/d68/d80/d98/d28/la4 0 2024-05-08T05:32:11.721 INFO:tasks.workunit.client.0.smithi087.stdout:1/643: truncate df/d2f/d57/d64/f29 3627131 0 2024-05-08T05:32:11.722 INFO:tasks.workunit.client.0.smithi087.stdout:1/644: symlink df/d18/d1d/d27/d90/ldf 0 2024-05-08T05:32:11.725 INFO:tasks.workunit.client.0.smithi087.stdout:1/645: read df/fbc [133184,109162] 0 2024-05-08T05:32:11.729 INFO:tasks.workunit.client.0.smithi087.stdout:4/735: dwrite d4/d13/d3e/d28/d50/d9d/df2/d106/d91/d84/fef [0,4194304] 0 2024-05-08T05:32:11.738 INFO:tasks.workunit.client.0.smithi087.stdout:0/671: dwrite d0/d9/d1b/d2f/d54/da1/f88 [0,4194304] 0 2024-05-08T05:32:11.738 INFO:tasks.workunit.client.0.smithi087.stdout:0/672: readlink d0/d9/d1b/l9f 0 2024-05-08T05:32:11.761 INFO:tasks.workunit.client.0.smithi087.stdout:8/750: read db/d23/d1b/d35/d43/d68/d6a/f5b [145278,64874] 0 2024-05-08T05:32:11.761 INFO:tasks.workunit.client.0.smithi087.stdout:8/751: stat db/d23/d15/d29/d79/fc7 0 2024-05-08T05:32:11.761 INFO:tasks.workunit.client.0.smithi087.stdout:8/752: write db/d23/d15/d29/d33/f80 [652126,31377] 0 2024-05-08T05:32:11.761 INFO:tasks.workunit.client.0.smithi087.stdout:8/753: stat db/d23/d1b/d4b 0 2024-05-08T05:32:11.763 INFO:tasks.workunit.client.0.smithi087.stdout:8/754: rename db/d23/d15/d29/d33/d6c/f7e to db/d23/d15/d29/d33/d6c/ffb 0 2024-05-08T05:32:11.763 INFO:tasks.workunit.client.0.smithi087.stdout:8/755: read - db/d23/d15/d29/d33/d3b/fb9 zero size 2024-05-08T05:32:11.763 INFO:tasks.workunit.client.0.smithi087.stdout:2/725: dwrite d7/f59 [0,4194304] 0 2024-05-08T05:32:11.763 INFO:tasks.workunit.client.0.smithi087.stdout:2/726: readlink d7/de/d2c/l88 0 2024-05-08T05:32:11.764 INFO:tasks.workunit.client.0.smithi087.stdout:2/727: symlink d7/de/d27/lf7 0 2024-05-08T05:32:11.764 INFO:tasks.workunit.client.0.smithi087.stdout:8/756: symlink db/d23/d1b/d35/d43/d68/d6a/lfc 0 2024-05-08T05:32:11.766 INFO:tasks.workunit.client.0.smithi087.stdout:3/761: dread d4/d11/d24/d39/d5a/f6b [0,4194304] 0 2024-05-08T05:32:11.766 INFO:tasks.workunit.client.0.smithi087.stdout:6/753: dwrite d4/d8/df/d1e/d25/f4b [0,4194304] 0 2024-05-08T05:32:11.766 INFO:tasks.workunit.client.0.smithi087.stdout:8/757: rename db/d23/d15/d29/d33/d6c/fb8 to db/d23/d15/d29/d33/dd2/ffd 0 2024-05-08T05:32:11.769 INFO:tasks.workunit.client.0.smithi087.stdout:6/754: creat d4/d8/df/d39/d42/d9e/d6f/d7f/de7/d2d/d37/d45/da2/fe8 x:0 0 0 2024-05-08T05:32:11.769 INFO:tasks.workunit.client.0.smithi087.stdout:3/762: rename d4/d11/d24/d25/fa3 to d4/d14/d84/f10c 0 2024-05-08T05:32:11.770 INFO:tasks.workunit.client.0.smithi087.stdout:4/736: read d4/d13/f16 [442131,104213] 0 2024-05-08T05:32:11.770 INFO:tasks.workunit.client.0.smithi087.stdout:8/758: mkdir db/d23/d54/d9d/dfe 0 2024-05-08T05:32:11.770 INFO:tasks.workunit.client.0.smithi087.stdout:8/759: chown db/d23/f2d 0 1 2024-05-08T05:32:11.770 INFO:tasks.workunit.client.0.smithi087.stdout:8/760: fsync db/d23/d1b/d35/d43/daf/fb3 0 2024-05-08T05:32:11.770 INFO:tasks.workunit.client.0.smithi087.stdout:4/737: creat d4/d13/d3e/d28/d50/f113 x:0 0 0 2024-05-08T05:32:11.771 INFO:tasks.workunit.client.0.smithi087.stdout:8/761: truncate db/d23/d15/d29/d33/d6c/ffb 2196633 0 2024-05-08T05:32:11.771 INFO:tasks.workunit.client.0.smithi087.stdout:8/762: fdatasync db/d23/d15/d29/d4d/d96/fc8 0 2024-05-08T05:32:11.773 INFO:tasks.workunit.client.0.smithi087.stdout:4/738: creat d4/d13/d3e/f114 x:0 0 0 2024-05-08T05:32:11.773 INFO:tasks.workunit.client.0.smithi087.stdout:4/739: stat d4/d6c/l9b 0 2024-05-08T05:32:11.774 INFO:tasks.workunit.client.0.smithi087.stdout:4/740: write d4/d13/d32/ddb/fa0 [2225627,121986] 0 2024-05-08T05:32:11.774 INFO:tasks.workunit.client.0.smithi087.stdout:4/741: fsync d4/d13/d3e/d28/d50/d9d/df2/d106/fd1 0 2024-05-08T05:32:11.774 INFO:tasks.workunit.client.0.smithi087.stdout:4/742: fsync d4/d13/d3e/d28/d50/d9d/df2/d106/d91/d84/fb9 0 2024-05-08T05:32:11.774 INFO:tasks.workunit.client.0.smithi087.stdout:7/915: dwrite d2/d6/da0/d10f/d3f/d72/d77/d54/d55/d65/fb5 [0,4194304] 0 2024-05-08T05:32:11.781 INFO:tasks.workunit.client.0.smithi087.stdout:8/763: readlink db/d23/d15/l28 0 2024-05-08T05:32:11.781 INFO:tasks.workunit.client.0.smithi087.stdout:4/743: getdents d4/d13/d3e/d28/d50/d9d/df2/d106/d91 0 2024-05-08T05:32:11.781 INFO:tasks.workunit.client.0.smithi087.stdout:4/744: chown d4/d13/d3e/d28/d50/d9d/df2/d106/d91/ff4 335434362 1 2024-05-08T05:32:11.781 INFO:tasks.workunit.client.0.smithi087.stdout:4/745: getdents d4/d13/d3e/d28/d35/d107 0 2024-05-08T05:32:11.781 INFO:tasks.workunit.client.0.smithi087.stdout:7/916: creat d2/d6/da0/d10f/d3f/d72/d77/f12f x:0 0 0 2024-05-08T05:32:11.785 INFO:tasks.workunit.client.0.smithi087.stdout:7/917: creat d2/d6/da0/d10f/d3f/d72/d77/d54/d55/dfc/d12a/f130 x:0 0 0 2024-05-08T05:32:11.786 INFO:tasks.workunit.client.0.smithi087.stdout:7/918: mknod d2/d6/d12/d19/d2a/d111/c131 0 2024-05-08T05:32:11.786 INFO:tasks.workunit.client.0.smithi087.stdout:7/919: write d2/d6/d12/d15/fa2 [3883617,50596] 0 2024-05-08T05:32:11.787 INFO:tasks.workunit.client.0.smithi087.stdout:7/920: write d2/d6/da0/d10f/d3f/d72/d77/f12f [280401,106628] 0 2024-05-08T05:32:11.790 INFO:tasks.workunit.client.0.smithi087.stdout:6/755: write d4/d8/df/f31 [5697079,24499] 0 2024-05-08T05:32:11.790 INFO:tasks.workunit.client.0.smithi087.stdout:6/756: dread - d4/fe5 zero size 2024-05-08T05:32:11.790 INFO:tasks.workunit.client.0.smithi087.stdout:6/757: read d4/f38 [2032017,98373] 0 2024-05-08T05:32:11.791 INFO:tasks.workunit.client.0.smithi087.stdout:0/673: dwrite d0/da/f78 [4194304,4194304] 0 2024-05-08T05:32:11.791 INFO:tasks.workunit.client.0.smithi087.stdout:0/674: truncate d0/d9/d1b/d2f/d54/da1/f62 1721081 0 2024-05-08T05:32:11.795 INFO:tasks.workunit.client.0.smithi087.stdout:6/758: symlink d4/d8/le9 0 2024-05-08T05:32:11.798 INFO:tasks.workunit.client.0.smithi087.stdout:8/764: dread db/d23/d1b/fad [0,4194304] 0 2024-05-08T05:32:11.798 INFO:tasks.workunit.client.0.smithi087.stdout:8/765: write db/d23/d15/d29/d33/fd7 [979942,2593] 0 2024-05-08T05:32:11.798 INFO:tasks.workunit.client.0.smithi087.stdout:8/766: write db/d23/f64 [1243316,60591] 0 2024-05-08T05:32:11.798 INFO:tasks.workunit.client.0.smithi087.stdout:5/815: sync 2024-05-08T05:32:11.798 INFO:tasks.workunit.client.0.smithi087.stdout:9/788: dwrite d1/fdd [0,4194304] 0 2024-05-08T05:32:11.801 INFO:tasks.workunit.client.0.smithi087.stdout:8/767: mknod db/d23/d3a/d65/d83/dc5/cff 0 2024-05-08T05:32:11.803 INFO:tasks.workunit.client.0.smithi087.stdout:9/789: symlink d1/df/d37/d5b/def/df2/lf7 0 2024-05-08T05:32:11.803 INFO:tasks.workunit.client.0.smithi087.stdout:9/790: write d1/df/d58/fe4 [4671822,124967] 0 2024-05-08T05:32:11.807 INFO:tasks.workunit.client.0.smithi087.stdout:5/816: rename da/db/dd3/ce5 to da/db/d2a/d46/d9a/c112 0 2024-05-08T05:32:11.814 INFO:tasks.workunit.client.0.smithi087.stdout:2/728: dwrite d7/de/d27/d33/d65/f7e [0,4194304] 0 2024-05-08T05:32:11.816 INFO:tasks.workunit.client.0.smithi087.stdout:5/817: dread da/db/d2a/d5a/d93/d36/dc1/fbc [0,4194304] 0 2024-05-08T05:32:11.821 INFO:tasks.workunit.client.0.smithi087.stdout:9/791: dread d1/df/d14/d68/d80/d98/d28/d4b/f71 [0,4194304] 0 2024-05-08T05:32:11.823 INFO:tasks.workunit.client.0.smithi087.stdout:9/792: mknod d1/df/d58/d5e/cf8 0 2024-05-08T05:32:11.824 INFO:tasks.workunit.client.0.smithi087.stdout:9/793: symlink d1/d70/lf9 0 2024-05-08T05:32:11.829 INFO:tasks.workunit.client.0.smithi087.stdout:4/746: read d4/f4b [1372029,29450] 0 2024-05-08T05:32:11.831 INFO:tasks.workunit.client.0.smithi087.stdout:4/747: rmdir d4/d13/d65/dd7 39 2024-05-08T05:32:11.833 INFO:tasks.workunit.client.0.smithi087.stdout:4/748: mkdir d4/d13/d3e/d28/d50/d9d/df2/d106/d91/db8/dba/d115 0 2024-05-08T05:32:11.833 INFO:tasks.workunit.client.0.smithi087.stdout:4/749: dread - d4/d13/d3e/d28/d50/d9d/f109 zero size 2024-05-08T05:32:11.837 INFO:tasks.workunit.client.0.smithi087.stdout:4/750: truncate d4/d13/f3f 2559558 0 2024-05-08T05:32:11.837 INFO:tasks.workunit.client.0.smithi087.stdout:4/751: readlink d4/d13/lf3 0 2024-05-08T05:32:11.849 INFO:tasks.workunit.client.0.smithi087.stdout:3/763: dwrite d4/d11/d3d/f8e [0,4194304] 0 2024-05-08T05:32:11.850 INFO:tasks.workunit.client.0.smithi087.stdout:1/646: dwrite df/d18/d1d/d58/d72/f5f [0,4194304] 0 2024-05-08T05:32:11.850 INFO:tasks.workunit.client.0.smithi087.stdout:1/647: chown df/d2f/d4f/f79 130815 1 2024-05-08T05:32:11.850 INFO:tasks.workunit.client.0.smithi087.stdout:1/648: chown df/d18/d1d/d58/d72/dc5 200630156 1 2024-05-08T05:32:11.850 INFO:tasks.workunit.client.0.smithi087.stdout:3/764: creat d4/d11/f10d x:0 0 0 2024-05-08T05:32:11.850 INFO:tasks.workunit.client.0.smithi087.stdout:3/765: write d4/d11/d24/d39/d94/fdd [382146,38810] 0 2024-05-08T05:32:11.854 INFO:tasks.workunit.client.0.smithi087.stdout:1/649: mknod df/d2f/d57/da0/ce0 0 2024-05-08T05:32:11.855 INFO:tasks.workunit.client.0.smithi087.stdout:1/650: mkdir df/d2f/d57/dcb/de1 0 2024-05-08T05:32:11.864 INFO:tasks.workunit.client.0.smithi087.stdout:0/675: dwrite d0/d57/d24/d66/f87 [0,4194304] 0 2024-05-08T05:32:11.866 INFO:tasks.workunit.client.0.smithi087.stdout:0/676: unlink d0/dd0/fd4 0 2024-05-08T05:32:11.876 INFO:tasks.workunit.client.0.smithi087.stdout:5/818: write da/db/d2a/d5a/d93/d36/f5f [4027587,31112] 0 2024-05-08T05:32:11.876 INFO:tasks.workunit.client.0.smithi087.stdout:7/921: dwrite d2/d6/da0/f113 [0,4194304] 0 2024-05-08T05:32:11.876 INFO:tasks.workunit.client.0.smithi087.stdout:7/922: readlink d2/d6/da0/d10f/d3f/d66/lf2 0 2024-05-08T05:32:11.876 INFO:tasks.workunit.client.0.smithi087.stdout:2/729: dwrite d7/de/d27/d33/d49/f8b [0,4194304] 0 2024-05-08T05:32:11.876 INFO:tasks.workunit.client.0.smithi087.stdout:2/730: write d7/de/d2c/db6/dcb/db7/fdd [601786,109659] 0 2024-05-08T05:32:11.876 INFO:tasks.workunit.client.0.smithi087.stdout:7/923: unlink d2/d6/d12/d19/f2d 0 2024-05-08T05:32:11.877 INFO:tasks.workunit.client.0.smithi087.stdout:2/731: mkdir d7/de/d2c/db0/df8 0 2024-05-08T05:32:11.877 INFO:tasks.workunit.client.0.smithi087.stdout:2/732: write d7/d63/f74 [2427487,88359] 0 2024-05-08T05:32:11.879 INFO:tasks.workunit.client.0.smithi087.stdout:7/924: unlink d2/d6/d12/d19/d2a/d89/d9a/cba 0 2024-05-08T05:32:11.879 INFO:tasks.workunit.client.0.smithi087.stdout:7/925: stat d2/d6/da0/d10f/d3f/l6c 0 2024-05-08T05:32:11.880 INFO:tasks.workunit.client.0.smithi087.stdout:2/733: truncate d7/de/d2c/f31 2599663 0 2024-05-08T05:32:11.882 INFO:tasks.workunit.client.0.smithi087.stdout:7/926: link d2/d6/da0/d10f/d3f/d72/cc9 d2/d6/d12/c132 0 2024-05-08T05:32:11.882 INFO:tasks.workunit.client.0.smithi087.stdout:7/927: chown d2/d6/d12/dc5/f11f 3 1 2024-05-08T05:32:11.884 INFO:tasks.workunit.client.0.smithi087.stdout:8/768: dread db/d23/d3a/d65/f6e [0,4194304] 0 2024-05-08T05:32:11.884 INFO:tasks.workunit.client.0.smithi087.stdout:5/819: dread da/db/d2a/f95 [0,4194304] 0 2024-05-08T05:32:11.887 INFO:tasks.workunit.client.0.smithi087.stdout:5/820: rename da/db/d2a/d5a/d93/d17/lfb to da/db/d2a/l113 0 2024-05-08T05:32:11.888 INFO:tasks.workunit.client.0.smithi087.stdout:5/821: truncate da/db/d2a/d5a/d93/d36/d45/d5c/dff/f111 686196 0 2024-05-08T05:32:11.888 INFO:tasks.workunit.client.0.smithi087.stdout:5/822: readlink da/db/d2a/d5a/d93/d42/lba 0 2024-05-08T05:32:11.890 INFO:tasks.workunit.client.0.smithi087.stdout:3/766: read d4/d11/d3d/d48/f52 [678027,24949] 0 2024-05-08T05:32:11.894 INFO:tasks.workunit.client.0.smithi087.stdout:0/677: write d0/da/d35/f37 [3070258,30146] 0 2024-05-08T05:32:11.894 INFO:tasks.workunit.client.0.smithi087.stdout:6/759: dwrite d4/d8/df/d39/d42/d9e/d6f/d7f/de7/f74 [0,4194304] 0 2024-05-08T05:32:11.894 INFO:tasks.workunit.client.0.smithi087.stdout:6/760: write d4/d8/df/d1e/d25/fda [270721,8065] 0 2024-05-08T05:32:11.894 INFO:tasks.workunit.client.0.smithi087.stdout:6/761: fdatasync d4/d8/df/d1e/d25/f4b 0 2024-05-08T05:32:11.906 INFO:tasks.workunit.client.0.smithi087.stdout:2/734: truncate d7/d63/f39 718898 0 2024-05-08T05:32:11.908 INFO:tasks.workunit.client.0.smithi087.stdout:3/767: write d4/d14/f85 [669238,60238] 0 2024-05-08T05:32:11.914 INFO:tasks.workunit.client.0.smithi087.stdout:6/762: unlink d4/d8/df/d1e/fc9 0 2024-05-08T05:32:11.917 INFO:tasks.workunit.client.0.smithi087.stdout:2/735: write d7/de/d27/d33/d49/f5a [2040775,66697] 0 2024-05-08T05:32:11.919 INFO:tasks.workunit.client.0.smithi087.stdout:0/678: dread d0/da/f97 [0,4194304] 0 2024-05-08T05:32:11.919 INFO:tasks.workunit.client.0.smithi087.stdout:0/679: chown d0/d9/d1b/f3e 216 1 2024-05-08T05:32:11.919 INFO:tasks.workunit.client.0.smithi087.stdout:2/736: truncate d7/de/d2c/f4c 2682866 0 2024-05-08T05:32:11.920 INFO:tasks.workunit.client.0.smithi087.stdout:0/680: symlink d0/d57/d24/d66/le5 0 2024-05-08T05:32:11.930 INFO:tasks.workunit.client.0.smithi087.stdout:7/928: dwrite d2/d6/d12/d15/fa2 [4194304,4194304] 0 2024-05-08T05:32:11.931 INFO:tasks.workunit.client.0.smithi087.stdout:7/929: fsync d2/d6/da0/d67/d82/d98/f9c 0 2024-05-08T05:32:11.934 INFO:tasks.workunit.client.0.smithi087.stdout:7/930: creat d2/d6/da0/d10f/d3f/d49/daf/f133 x:0 0 0 2024-05-08T05:32:11.935 INFO:tasks.workunit.client.0.smithi087.stdout:7/931: mkdir d2/d6/d12/d19/d2a/d89/d134 0 2024-05-08T05:32:11.937 INFO:tasks.workunit.client.0.smithi087.stdout:7/932: rename d2/d6/da0/d10f/d3f/d72/d77/dc2/f11a to d2/d6/d12/f135 0 2024-05-08T05:32:11.937 INFO:tasks.workunit.client.0.smithi087.stdout:0/681: dread d0/da/d11/f20 [4194304,4194304] 0 2024-05-08T05:32:11.938 INFO:tasks.workunit.client.0.smithi087.stdout:1/651: dwrite df/d2f/d57/d64/d83/d96/fce [0,4194304] 0 2024-05-08T05:32:11.941 INFO:tasks.workunit.client.0.smithi087.stdout:7/933: mkdir d2/d6/d12/d15/d5b/dee/d101/d136 0 2024-05-08T05:32:11.941 INFO:tasks.workunit.client.0.smithi087.stdout:7/934: write d2/d6/da0/d10f/d3f/d49/d59/fe4 [200661,83882] 0 2024-05-08T05:32:11.946 INFO:tasks.workunit.client.0.smithi087.stdout:0/682: rename d0/da/db4/fc8 to d0/d9/d1b/d2f/dcc/fe6 0 2024-05-08T05:32:11.946 INFO:tasks.workunit.client.0.smithi087.stdout:0/683: getdents d0/d9/d90 0 2024-05-08T05:32:11.946 INFO:tasks.workunit.client.0.smithi087.stdout:1/652: getdents df/d18/d1d/d27/dd4 0 2024-05-08T05:32:11.948 INFO:tasks.workunit.client.0.smithi087.stdout:0/684: truncate d0/d9/d1b/d5e/f6b 1202385 0 2024-05-08T05:32:11.948 INFO:tasks.workunit.client.0.smithi087.stdout:5/823: dwrite da/db/d2a/f32 [0,4194304] 0 2024-05-08T05:32:11.950 INFO:tasks.workunit.client.0.smithi087.stdout:1/653: symlink df/d18/d1d/le2 0 2024-05-08T05:32:11.951 INFO:tasks.workunit.client.0.smithi087.stdout:3/768: write d4/d14/f1a [11460464,602] 0 2024-05-08T05:32:11.953 INFO:tasks.workunit.client.0.smithi087.stdout:5/824: mknod da/db/d2a/d46/dc6/df1/c114 0 2024-05-08T05:32:11.953 INFO:tasks.workunit.client.0.smithi087.stdout:5/825: chown da/db/d2a/d5a/d93/d42/d43/d83/de9/f109 303914856 1 2024-05-08T05:32:11.954 INFO:tasks.workunit.client.0.smithi087.stdout:3/769: mknod d4/d11/d24/d25/d4d/c10e 0 2024-05-08T05:32:11.954 INFO:tasks.workunit.client.0.smithi087.stdout:3/770: truncate d4/d14/dbe/fcc 1175482 0 2024-05-08T05:32:11.956 INFO:tasks.workunit.client.0.smithi087.stdout:6/763: dwrite d4/d8/df/d39/d42/d9e/d6f/d7f/de7/d2d/d37/d5b/f5f [0,4194304] 0 2024-05-08T05:32:11.956 INFO:tasks.workunit.client.0.smithi087.stdout:1/654: rmdir df/d2f/d57 39 2024-05-08T05:32:11.958 INFO:tasks.workunit.client.0.smithi087.stdout:5/826: getdents da/db/d2a/d5a/d93/d42/d43/d83/ddc 0 2024-05-08T05:32:11.960 INFO:tasks.workunit.client.0.smithi087.stdout:3/771: rename d4/d11/d3d/d64/l7c to d4/d11/d24/d25/d3e/d3f/l10f 0 2024-05-08T05:32:11.962 INFO:tasks.workunit.client.0.smithi087.stdout:6/764: mkdir d4/d8/df/d39/d42/d9e/d6f/d7f/de7/d2d/d37/dea 0 2024-05-08T05:32:11.963 INFO:tasks.workunit.client.0.smithi087.stdout:5/827: creat da/db/d2a/d5a/dc3/f115 x:0 0 0 2024-05-08T05:32:11.964 INFO:tasks.workunit.client.0.smithi087.stdout:3/772: mkdir d4/d11/d3d/d110 0 2024-05-08T05:32:11.965 INFO:tasks.workunit.client.0.smithi087.stdout:6/765: creat d4/d8/df/d39/d42/d9e/d6f/d7f/de7/d2d/d37/d5b/feb x:0 0 0 2024-05-08T05:32:11.965 INFO:tasks.workunit.client.0.smithi087.stdout:6/766: read d4/d8/df/d39/d42/d9e/d6f/d7f/de7/d2d/d37/fa8 [5132982,87514] 0 2024-05-08T05:32:11.966 INFO:tasks.workunit.client.0.smithi087.stdout:5/828: creat da/dd/d94/f116 x:0 0 0 2024-05-08T05:32:11.966 INFO:tasks.workunit.client.0.smithi087.stdout:2/737: dwrite d7/de/d27/d33/d49/f8b [0,4194304] 0 2024-05-08T05:32:11.969 INFO:tasks.workunit.client.0.smithi087.stdout:5/829: creat da/db/d2a/d5a/f117 x:0 0 0 2024-05-08T05:32:11.970 INFO:tasks.workunit.client.0.smithi087.stdout:5/830: write da/db/d2a/d5a/d93/d36/f76 [2606566,24271] 0 2024-05-08T05:32:11.970 INFO:tasks.workunit.client.0.smithi087.stdout:6/767: rmdir d4/d8/df/d39 39 2024-05-08T05:32:11.973 INFO:tasks.workunit.client.0.smithi087.stdout:2/738: getdents d7/de/db1 0 2024-05-08T05:32:11.974 INFO:tasks.workunit.client.0.smithi087.stdout:5/831: symlink da/db/d2a/d5a/d93/d42/de8/l118 0 2024-05-08T05:32:11.974 INFO:tasks.workunit.client.0.smithi087.stdout:5/832: fsync da/db/d2a/d5a/d93/d36/d45/d5c/fd2 0 2024-05-08T05:32:11.975 INFO:tasks.workunit.client.0.smithi087.stdout:2/739: creat d7/de/ff9 x:0 0 0 2024-05-08T05:32:11.975 INFO:tasks.workunit.client.0.smithi087.stdout:2/740: dread - d7/d63/fea zero size 2024-05-08T05:32:11.975 INFO:tasks.workunit.client.0.smithi087.stdout:5/833: mknod da/db/d2a/d46/d69/c119 0 2024-05-08T05:32:11.976 INFO:tasks.workunit.client.0.smithi087.stdout:5/834: mknod da/d10e/c11a 0 2024-05-08T05:32:11.976 INFO:tasks.workunit.client.0.smithi087.stdout:5/835: write da/db/d2a/d5a/d93/d36/f7f [2435053,125719] 0 2024-05-08T05:32:11.977 INFO:tasks.workunit.client.0.smithi087.stdout:5/836: dread - da/db/d2a/d5a/dc3/f115 zero size 2024-05-08T05:32:11.982 INFO:tasks.workunit.client.0.smithi087.stdout:5/837: mknod da/db/d2a/d5a/d93/d42/d43/d83/de9/c11b 0 2024-05-08T05:32:11.983 INFO:tasks.workunit.client.0.smithi087.stdout:6/768: write d4/d8/f3b [2974001,20282] 0 2024-05-08T05:32:11.983 INFO:tasks.workunit.client.0.smithi087.stdout:6/769: write d4/d8/df/d39/d42/d9e/dd1/fdd [4535109,69476] 0 2024-05-08T05:32:11.983 INFO:tasks.workunit.client.0.smithi087.stdout:6/770: chown d4/d8/df/d1e/d25/f4b 148648 1 2024-05-08T05:32:11.983 INFO:tasks.workunit.client.0.smithi087.stdout:5/838: symlink da/db/d2a/d5a/d93/d42/d43/l11c 0 2024-05-08T05:32:11.984 INFO:tasks.workunit.client.0.smithi087.stdout:5/839: fsync da/dd/d65/f91 0 2024-05-08T05:32:11.985 INFO:tasks.workunit.client.0.smithi087.stdout:6/771: creat d4/d8/df/d39/d42/d9e/d6f/fec x:0 0 0 2024-05-08T05:32:11.985 INFO:tasks.workunit.client.0.smithi087.stdout:6/772: write d4/d6/f13 [4282927,46545] 0 2024-05-08T05:32:11.998 INFO:tasks.workunit.client.0.smithi087.stdout:2/741: dread d7/de/d27/d33/d49/f8f [0,4194304] 0 2024-05-08T05:32:11.999 INFO:tasks.workunit.client.0.smithi087.stdout:2/742: mknod d7/de/d5d/d90/dc6/cfa 0 2024-05-08T05:32:12.001 INFO:tasks.workunit.client.0.smithi087.stdout:2/743: truncate d7/de/d27/d33/f21 2224318 0 2024-05-08T05:32:12.001 INFO:tasks.workunit.client.0.smithi087.stdout:2/744: dread - d7/de/d27/d33/d81/fa9 zero size 2024-05-08T05:32:12.017 INFO:tasks.workunit.client.0.smithi087.stdout:0/685: dwrite d0/d9/d1b/d2f/d54/da1/f83 [0,4194304] 0 2024-05-08T05:32:12.023 INFO:tasks.workunit.client.0.smithi087.stdout:0/686: mkdir d0/dd0/de7 0 2024-05-08T05:32:12.023 INFO:tasks.workunit.client.0.smithi087.stdout:0/687: fdatasync d0/d9/d1b/fca 0 2024-05-08T05:32:12.025 INFO:tasks.workunit.client.0.smithi087.stdout:0/688: creat d0/da/d35/d86/d9a/dc9/fe8 x:0 0 0 2024-05-08T05:32:12.025 INFO:tasks.workunit.client.0.smithi087.stdout:0/689: fsync d0/fb9 0 2024-05-08T05:32:12.026 INFO:tasks.workunit.client.0.smithi087.stdout:0/690: creat d0/da/d35/d86/d9a/fe9 x:0 0 0 2024-05-08T05:32:12.026 INFO:tasks.workunit.client.0.smithi087.stdout:0/691: readlink d0/d57/d24/ldc 0 2024-05-08T05:32:12.027 INFO:tasks.workunit.client.0.smithi087.stdout:0/692: creat d0/d9/d90/fea x:0 0 0 2024-05-08T05:32:12.029 INFO:tasks.workunit.client.0.smithi087.stdout:0/693: rmdir d0/da/d35/d86/d74 39 2024-05-08T05:32:12.031 INFO:tasks.workunit.client.0.smithi087.stdout:6/773: dwrite d4/d8/df/d1e/d25/f4b [0,4194304] 0 2024-05-08T05:32:12.032 INFO:tasks.workunit.client.0.smithi087.stdout:5/840: dwrite da/f30 [0,4194304] 0 2024-05-08T05:32:12.042 INFO:tasks.workunit.client.0.smithi087.stdout:5/841: truncate da/f66 1254089 0 2024-05-08T05:32:12.048 INFO:tasks.workunit.client.0.smithi087.stdout:6/774: dread d4/d8/df/d39/d42/d9e/d6f/f90 [0,4194304] 0 2024-05-08T05:32:12.048 INFO:tasks.workunit.client.0.smithi087.stdout:6/775: truncate d4/d8/df/d39/d42/d9e/d6f/d7f/de7/f79 1241051 0 2024-05-08T05:32:12.048 INFO:tasks.workunit.client.0.smithi087.stdout:6/776: dread - d4/d8/df/d39/d42/d9e/d6f/d7f/de7/d2d/d37/d45/da2/fde zero size 2024-05-08T05:32:12.049 INFO:tasks.workunit.client.0.smithi087.stdout:6/777: creat d4/d8/df/d39/d42/d9e/d6f/d7f/de7/d2d/d37/d9c/fed x:0 0 0 2024-05-08T05:32:12.050 INFO:tasks.workunit.client.0.smithi087.stdout:6/778: mkdir d4/d8/df/d39/d42/dbd/dee 0 2024-05-08T05:32:12.051 INFO:tasks.workunit.client.0.smithi087.stdout:6/779: mknod d4/d8/df/d39/cef 0 2024-05-08T05:32:12.052 INFO:tasks.workunit.client.0.smithi087.stdout:6/780: rename d4/d8/df/d39/d42/d9e/d6f/cdb to d4/d8/cf0 0 2024-05-08T05:32:12.059 INFO:tasks.workunit.client.0.smithi087.stdout:2/745: dwrite d7/de/ff9 [0,4194304] 0 2024-05-08T05:32:12.061 INFO:tasks.workunit.client.0.smithi087.stdout:6/781: dread d4/d8/df/d39/d42/d9e/d6f/f7e [0,4194304] 0 2024-05-08T05:32:12.063 INFO:tasks.workunit.client.0.smithi087.stdout:6/782: unlink d4/d8/df/d39/f9b 0 2024-05-08T05:32:12.064 INFO:tasks.workunit.client.0.smithi087.stdout:6/783: symlink d4/d8/df/d39/d42/d94/lf1 0 2024-05-08T05:32:12.065 INFO:tasks.workunit.client.0.smithi087.stdout:8/769: sync 2024-05-08T05:32:12.065 INFO:tasks.workunit.client.0.smithi087.stdout:9/794: sync 2024-05-08T05:32:12.065 INFO:tasks.workunit.client.0.smithi087.stdout:4/752: sync 2024-05-08T05:32:12.065 INFO:tasks.workunit.client.0.smithi087.stdout:4/753: readlink d4/d13/d3e/d28/d50/d9d/lcc 0 2024-05-08T05:32:12.066 INFO:tasks.workunit.client.0.smithi087.stdout:6/784: rename d4/d8/df/d1e/d25/f2f to d4/d8/df/d39/d42/d9e/dd1/ff2 0 2024-05-08T05:32:12.070 INFO:tasks.workunit.client.0.smithi087.stdout:9/795: symlink d1/df/d14/d18/d8e/lfa 0 2024-05-08T05:32:12.070 INFO:tasks.workunit.client.0.smithi087.stdout:4/754: rmdir d4/d6c 39 2024-05-08T05:32:12.070 INFO:tasks.workunit.client.0.smithi087.stdout:4/755: stat d4/d13/d3e/f36 0 2024-05-08T05:32:12.070 INFO:tasks.workunit.client.0.smithi087.stdout:9/796: chown d1/df/d14/f17 1720914192 1 2024-05-08T05:32:12.082 INFO:tasks.workunit.client.0.smithi087.stdout:0/694: dwrite d0/d9/d1b/d2f/d54/da1/fb1 [0,4194304] 0 2024-05-08T05:32:12.082 INFO:tasks.workunit.client.0.smithi087.stdout:4/756: dread d4/d13/d32/ddb/fa0 [0,4194304] 0 2024-05-08T05:32:12.082 INFO:tasks.workunit.client.0.smithi087.stdout:4/757: chown d4/d13/d65/dd7/ff8 1 1 2024-05-08T05:32:12.084 INFO:tasks.workunit.client.0.smithi087.stdout:0/695: mkdir d0/d22/d3c/dbb/ddb/deb 0 2024-05-08T05:32:12.085 INFO:tasks.workunit.client.0.smithi087.stdout:0/696: write d0/da/d11/fac [397374,37719] 0 2024-05-08T05:32:12.085 INFO:tasks.workunit.client.0.smithi087.stdout:0/697: fsync d0/da/f97 0 2024-05-08T05:32:12.085 INFO:tasks.workunit.client.0.smithi087.stdout:4/758: mknod d4/d13/d3e/d28/d35/c116 0 2024-05-08T05:32:12.088 INFO:tasks.workunit.client.0.smithi087.stdout:4/759: creat d4/d13/d3e/d28/d50/d9d/df2/d106/d91/db8/dba/d96/f117 x:0 0 0 2024-05-08T05:32:12.091 INFO:tasks.workunit.client.0.smithi087.stdout:5/842: dwrite da/f30 [0,4194304] 0 2024-05-08T05:32:12.091 INFO:tasks.workunit.client.0.smithi087.stdout:5/843: readlink da/db/d2a/d5a/d93/d42/lba 0 2024-05-08T05:32:12.094 INFO:tasks.workunit.client.0.smithi087.stdout:5/844: creat da/db/d2a/d5a/d93/d36/dc1/f11d x:0 0 0 2024-05-08T05:32:12.095 INFO:tasks.workunit.client.0.smithi087.stdout:4/760: dread d4/d13/d65/f6f [0,4194304] 0 2024-05-08T05:32:12.097 INFO:tasks.workunit.client.0.smithi087.stdout:5/845: mkdir da/db/d2a/d5a/d93/d42/d50/dd0/d11e 0 2024-05-08T05:32:12.097 INFO:tasks.workunit.client.0.smithi087.stdout:5/846: readlink da/db/d2a/d5a/d93/d42/d43/l11c 0 2024-05-08T05:32:12.097 INFO:tasks.workunit.client.0.smithi087.stdout:5/847: readlink da/db/d2a/d5a/d93/d36/lbd 0 2024-05-08T05:32:12.097 INFO:tasks.workunit.client.0.smithi087.stdout:5/848: fdatasync da/db/d2a/d5a/d93/d36/d45/d5c/d86/fc4 0 2024-05-08T05:32:12.097 INFO:tasks.workunit.client.0.smithi087.stdout:5/849: fdatasync da/db/d2a/d5a/d93/d42/d43/d83/d6b/ff6 0 2024-05-08T05:32:12.097 INFO:tasks.workunit.client.0.smithi087.stdout:5/850: truncate da/db/d2a/f67 4201318 0 2024-05-08T05:32:12.097 INFO:tasks.workunit.client.0.smithi087.stdout:5/851: fdatasync da/db/d2a/d5a/d93/d36/d45/d5c/dff/f111 0 2024-05-08T05:32:12.097 INFO:tasks.workunit.client.0.smithi087.stdout:5/852: dread - da/db/d2a/d5a/d93/d42/d43/d83/ddc/fcb zero size 2024-05-08T05:32:12.097 INFO:tasks.workunit.client.0.smithi087.stdout:5/853: readlink da/db/d2a/d5a/d93/l2f 0 2024-05-08T05:32:12.097 INFO:tasks.workunit.client.0.smithi087.stdout:5/854: chown da/db/d2a/c44 32462 1 2024-05-08T05:32:12.098 INFO:tasks.workunit.client.0.smithi087.stdout:4/761: link d4/d6c/d93/f10d d4/d13/f118 0 2024-05-08T05:32:12.099 INFO:tasks.workunit.client.0.smithi087.stdout:5/855: truncate da/db/d2a/d5a/d93/d42/d43/d83/d6b/f80 1860664 0 2024-05-08T05:32:12.099 INFO:tasks.workunit.client.0.smithi087.stdout:4/762: truncate d4/d13/d3e/d28/d50/d5a/f5e 3464249 0 2024-05-08T05:32:12.099 INFO:tasks.workunit.client.0.smithi087.stdout:5/856: read - da/db/d2a/d5a/f117 zero size 2024-05-08T05:32:12.099 INFO:tasks.workunit.client.0.smithi087.stdout:0/698: dread d0/da/d35/f37 [0,4194304] 0 2024-05-08T05:32:12.100 INFO:tasks.workunit.client.0.smithi087.stdout:4/763: rename d4/d6c/cbf to d4/d13/d3e/d28/d50/c119 0 2024-05-08T05:32:12.100 INFO:tasks.workunit.client.0.smithi087.stdout:4/764: truncate d4/d13/d3e/f114 287846 0 2024-05-08T05:32:12.101 INFO:tasks.workunit.client.0.smithi087.stdout:0/699: mknod d0/d9/d1b/cec 0 2024-05-08T05:32:12.101 INFO:tasks.workunit.client.0.smithi087.stdout:0/700: read d0/d57/fa4 [3929903,12715] 0 2024-05-08T05:32:12.101 INFO:tasks.workunit.client.0.smithi087.stdout:0/701: chown d0/da/d35/d86 12 1 2024-05-08T05:32:12.102 INFO:tasks.workunit.client.0.smithi087.stdout:6/785: dwrite d4/d8/f3c [0,4194304] 0 2024-05-08T05:32:12.102 INFO:tasks.workunit.client.0.smithi087.stdout:6/786: stat d4/d8/df/d39/d42/d6a/fd5 0 2024-05-08T05:32:12.103 INFO:tasks.workunit.client.0.smithi087.stdout:6/787: write d4/d8/df/d39/d42/d9e/d6f/f8b [236750,22360] 0 2024-05-08T05:32:12.106 INFO:tasks.workunit.client.0.smithi087.stdout:6/788: mkdir d4/d8/df/d39/df3 0 2024-05-08T05:32:12.133 INFO:tasks.workunit.client.0.smithi087.stdout:8/770: dwrite db/d23/d15/d29/d33/d3b/fb9 [0,4194304] 0 2024-05-08T05:32:12.135 INFO:tasks.workunit.client.0.smithi087.stdout:8/771: mkdir db/d23/d54/dd6/d100 0 2024-05-08T05:32:12.137 INFO:tasks.workunit.client.0.smithi087.stdout:0/702: dwrite d0/da/d35/f80 [0,4194304] 0 2024-05-08T05:32:12.138 INFO:tasks.workunit.client.0.smithi087.stdout:8/772: symlink db/d23/d3a/d65/l101 0 2024-05-08T05:32:12.150 INFO:tasks.workunit.client.0.smithi087.stdout:6/789: dwrite d4/d8/df/d1e/d25/f72 [0,4194304] 0 2024-05-08T05:32:12.151 INFO:tasks.workunit.client.0.smithi087.stdout:6/790: creat d4/d8/df/d39/ff4 x:0 0 0 2024-05-08T05:32:12.151 INFO:tasks.workunit.client.0.smithi087.stdout:6/791: fsync d4/d8/df/d39/d42/d94/db5/fc0 0 2024-05-08T05:32:12.152 INFO:tasks.workunit.client.0.smithi087.stdout:6/792: creat d4/d8/df/d39/d42/d9e/ff5 x:0 0 0 2024-05-08T05:32:12.153 INFO:tasks.workunit.client.0.smithi087.stdout:6/793: truncate d4/d8/df/d39/d42/d9e/d6f/d7f/de7/d2d/d37/f54 2487187 0 2024-05-08T05:32:12.154 INFO:tasks.workunit.client.0.smithi087.stdout:6/794: getdents d4/d8/df/d39/d42/d94 0 2024-05-08T05:32:12.155 INFO:tasks.workunit.client.0.smithi087.stdout:6/795: mknod d4/d8/df/d39/d42/dbd/cf6 0 2024-05-08T05:32:12.159 INFO:tasks.workunit.client.0.smithi087.stdout:6/796: rmdir d4 39 2024-05-08T05:32:12.168 INFO:tasks.workunit.client.0.smithi087.stdout:6/797: dread d4/d8/df/d39/f7a [0,4194304] 0 2024-05-08T05:32:12.187 INFO:tasks.workunit.client.0.smithi087.stdout:3/773: sync 2024-05-08T05:32:12.192 INFO:tasks.workunit.client.0.smithi087.stdout:1/655: sync 2024-05-08T05:32:12.192 INFO:tasks.workunit.client.0.smithi087.stdout:6/798: write d4/d8/df/d39/d42/d9e/d6f/d7f/de7/d2d/d37/d45/f6b [2581320,49027] 0 2024-05-08T05:32:12.192 INFO:tasks.workunit.client.0.smithi087.stdout:6/799: creat d4/d8/df/d39/d42/d9e/da4/ff7 x:0 0 0 2024-05-08T05:32:12.192 INFO:tasks.workunit.client.0.smithi087.stdout:6/800: write d4/d8/faa [4285388,16297] 0 2024-05-08T05:32:12.192 INFO:tasks.workunit.client.0.smithi087.stdout:7/935: sync 2024-05-08T05:32:12.195 INFO:tasks.workunit.client.0.smithi087.stdout:6/801: creat d4/d8/df/ff8 x:0 0 0 2024-05-08T05:32:12.199 INFO:tasks.workunit.client.0.smithi087.stdout:7/936: rmdir d2/d6/da0 39 2024-05-08T05:32:12.200 INFO:tasks.workunit.client.0.smithi087.stdout:8/773: dwrite db/d23/d3a/dcb/fae [0,4194304] 0 2024-05-08T05:32:12.213 INFO:tasks.workunit.client.0.smithi087.stdout:1/656: dread df/d18/d1d/f99 [0,4194304] 0 2024-05-08T05:32:12.213 INFO:tasks.workunit.client.0.smithi087.stdout:1/657: stat df/d18/d1d/d27/d61/fb2 0 2024-05-08T05:32:12.215 INFO:tasks.workunit.client.0.smithi087.stdout:6/802: dread d4/d8/df/d39/d42/d9e/d6f/d7f/de7/d2d/d37/d5b/f5f [0,4194304] 0 2024-05-08T05:32:12.215 INFO:tasks.workunit.client.0.smithi087.stdout:6/803: chown d4/d8/df/d39/d42/d9e/d6f/d7f/de7/d57/d6d/l89 39126 1 2024-05-08T05:32:12.215 INFO:tasks.workunit.client.0.smithi087.stdout:6/804: read d4/d8/df/d39/d42/d9e/d6f/d7f/de7/d2d/d37/d45/f68 [1050633,3772] 0 2024-05-08T05:32:12.219 INFO:tasks.workunit.client.0.smithi087.stdout:3/774: dread d4/d11/d24/d39/faf [0,4194304] 0 2024-05-08T05:32:12.219 INFO:tasks.workunit.client.0.smithi087.stdout:3/775: write d4/d11/d24/d25/d3e/fb9 [2091452,121753] 0 2024-05-08T05:32:12.219 INFO:tasks.workunit.client.0.smithi087.stdout:3/776: read - d4/f10b zero size 2024-05-08T05:32:12.232 INFO:tasks.workunit.client.0.smithi087.stdout:1/658: write df/d18/d1d/d27/f6d [1956091,1781] 0 2024-05-08T05:32:12.233 INFO:tasks.workunit.client.0.smithi087.stdout:1/659: dread - df/d2f/d57/d64/d83/d96/fc2 zero size 2024-05-08T05:32:12.234 INFO:tasks.workunit.client.0.smithi087.stdout:1/660: symlink df/d18/d1d/d27/d61/le3 0 2024-05-08T05:32:12.234 INFO:tasks.workunit.client.0.smithi087.stdout:1/661: truncate df/d2f/d57/da0/fc4 933586 0 2024-05-08T05:32:12.235 INFO:tasks.workunit.client.0.smithi087.stdout:1/662: mkdir df/d2f/d57/dcb/de1/de4 0 2024-05-08T05:32:12.236 INFO:tasks.workunit.client.0.smithi087.stdout:1/663: mknod df/d2f/d4f/d52/ce5 0 2024-05-08T05:32:12.277 INFO:tasks.workunit.client.0.smithi087.stdout:6/805: dwrite d4/d8/df/d39/d42/fab [0,4194304] 0 2024-05-08T05:32:12.279 INFO:tasks.workunit.client.0.smithi087.stdout:6/806: mkdir d4/d8/df/d39/d42/dbd/df9 0 2024-05-08T05:32:12.279 INFO:tasks.workunit.client.0.smithi087.stdout:8/774: dwrite db/d23/d15/d29/fd9 [0,4194304] 0 2024-05-08T05:32:12.287 INFO:tasks.workunit.client.0.smithi087.stdout:6/807: link d4/d8/df/d1e/d25/f4e d4/d8/df/d39/d42/d9e/d6f/d7f/de7/d2d/d37/d9c/ffa 0 2024-05-08T05:32:12.289 INFO:tasks.workunit.client.0.smithi087.stdout:7/937: dwrite d2/d6/fd3 [0,4194304] 0 2024-05-08T05:32:12.289 INFO:tasks.workunit.client.0.smithi087.stdout:3/777: dread d4/d11/d24/d25/f2f [0,4194304] 0 2024-05-08T05:32:12.289 INFO:tasks.workunit.client.0.smithi087.stdout:6/808: getdents d4/d8/df/d1e/d52 0 2024-05-08T05:32:12.299 INFO:tasks.workunit.client.0.smithi087.stdout:7/938: rename d2/d6/d12/d19/d2a/d91/c128 to d2/d6/d12/d15/d5b/dee/d118/c137 0 2024-05-08T05:32:12.299 INFO:tasks.workunit.client.0.smithi087.stdout:1/664: dwrite df/d2f/f97 [0,4194304] 0 2024-05-08T05:32:12.299 INFO:tasks.workunit.client.0.smithi087.stdout:8/775: truncate db/d23/d15/d29/fd9 2662708 0 2024-05-08T05:32:12.301 INFO:tasks.workunit.client.0.smithi087.stdout:3/778: mknod d4/d11/d24/d25/d3e/d58/d9b/c111 0 2024-05-08T05:32:12.303 INFO:tasks.workunit.client.0.smithi087.stdout:6/809: symlink d4/d8/df/d39/d42/d9e/d6f/d7f/de3/lfb 0 2024-05-08T05:32:12.303 INFO:tasks.workunit.client.0.smithi087.stdout:6/810: write f1 [1868565,22956] 0 2024-05-08T05:32:12.304 INFO:tasks.workunit.client.0.smithi087.stdout:1/665: mknod df/d2f/d4f/ce6 0 2024-05-08T05:32:12.305 INFO:tasks.workunit.client.0.smithi087.stdout:8/776: symlink db/d23/d15/d29/d33/d6c/def/l102 0 2024-05-08T05:32:12.306 INFO:tasks.workunit.client.0.smithi087.stdout:3/779: mkdir d4/d11/d24/d25/d3e/d58/d112 0 2024-05-08T05:32:12.307 INFO:tasks.workunit.client.0.smithi087.stdout:1/666: write df/d18/d1d/f88 [555488,83573] 0 2024-05-08T05:32:12.307 INFO:tasks.workunit.client.0.smithi087.stdout:8/777: symlink db/d23/d1b/d7c/l103 0 2024-05-08T05:32:12.307 INFO:tasks.workunit.client.0.smithi087.stdout:8/778: readlink db/d23/d1b/d35/d43/la1 0 2024-05-08T05:32:12.307 INFO:tasks.workunit.client.0.smithi087.stdout:8/779: write db/d23/d54/f58 [5167179,99775] 0 2024-05-08T05:32:12.309 INFO:tasks.workunit.client.0.smithi087.stdout:3/780: rename d4/d11/d24/d25/d4d/dbb/ff5 to d4/d11/d24/d39/d60/d87/f113 0 2024-05-08T05:32:12.309 INFO:tasks.workunit.client.0.smithi087.stdout:3/781: chown d4/d11/d24/d39/d60/cb7 9711975 1 2024-05-08T05:32:12.309 INFO:tasks.workunit.client.0.smithi087.stdout:3/782: dread - d4/d11/fdf zero size 2024-05-08T05:32:12.309 INFO:tasks.workunit.client.0.smithi087.stdout:1/667: getdents df/d2f/d57/dcb 0 2024-05-08T05:32:12.315 INFO:tasks.workunit.client.0.smithi087.stdout:3/783: mknod d4/d11/d24/d25/d4d/dbb/dfd/c114 0 2024-05-08T05:32:12.315 INFO:tasks.workunit.client.0.smithi087.stdout:1/668: symlink df/d2f/d57/d64/le7 0 2024-05-08T05:32:12.315 INFO:tasks.workunit.client.0.smithi087.stdout:3/784: readlink d4/d11/d24/d25/d3e/ld5 0 2024-05-08T05:32:12.316 INFO:tasks.workunit.client.0.smithi087.stdout:6/811: dread d4/d8/f67 [0,4194304] 0 2024-05-08T05:32:12.318 INFO:tasks.workunit.client.0.smithi087.stdout:6/812: creat d4/d8/df/d39/d42/d9e/d6f/d7f/de7/d2d/d37/d45/ffc x:0 0 0 2024-05-08T05:32:12.318 INFO:tasks.workunit.client.0.smithi087.stdout:1/669: rmdir df 39 2024-05-08T05:32:12.319 INFO:tasks.workunit.client.0.smithi087.stdout:4/765: sync 2024-05-08T05:32:12.319 INFO:tasks.workunit.client.0.smithi087.stdout:9/797: sync 2024-05-08T05:32:12.319 INFO:tasks.workunit.client.0.smithi087.stdout:2/746: sync 2024-05-08T05:32:12.319 INFO:tasks.workunit.client.0.smithi087.stdout:5/857: sync 2024-05-08T05:32:12.319 INFO:tasks.workunit.client.0.smithi087.stdout:0/703: sync 2024-05-08T05:32:12.320 INFO:tasks.workunit.client.0.smithi087.stdout:2/747: chown d7/de/d2c/l45 6153413 1 2024-05-08T05:32:12.320 INFO:tasks.workunit.client.0.smithi087.stdout:5/858: chown da/db/d2a/d46/dc6/df1 11 1 2024-05-08T05:32:12.320 INFO:tasks.workunit.client.0.smithi087.stdout:0/704: truncate d0/da/f5d 330406 0 2024-05-08T05:32:12.320 INFO:tasks.workunit.client.0.smithi087.stdout:5/859: chown da/db/d2a/d5a/d93/d36/dc1/f11d 3 1 2024-05-08T05:32:12.321 INFO:tasks.workunit.client.0.smithi087.stdout:1/670: link df/d18/d1d/fb0 df/d18/d1d/d27/d61/fe8 0 2024-05-08T05:32:12.322 INFO:tasks.workunit.client.0.smithi087.stdout:9/798: mkdir d1/df/d14/d68/d80/d98/d28/de8/dfb 0 2024-05-08T05:32:12.323 INFO:tasks.workunit.client.0.smithi087.stdout:4/766: symlink d4/d13/d3e/d28/d50/d9d/df2/d106/d91/db8/dba/d96/l11a 0 2024-05-08T05:32:12.323 INFO:tasks.workunit.client.0.smithi087.stdout:4/767: getdents d4/d13/d3e/d28/d50/d9d/df2/d106/d91/db8/dba/dbd/d111 0 2024-05-08T05:32:12.323 INFO:tasks.workunit.client.0.smithi087.stdout:4/768: chown d4/d13/d3e/d28/f39 0 1 2024-05-08T05:32:12.324 INFO:tasks.workunit.client.0.smithi087.stdout:9/799: write d1/df/d14/d54/d61/d88/fa7 [213454,40132] 0 2024-05-08T05:32:12.328 INFO:tasks.workunit.client.0.smithi087.stdout:2/748: mkdir d7/de/d27/dd6/dfb 0 2024-05-08T05:32:12.328 INFO:tasks.workunit.client.0.smithi087.stdout:2/749: write d7/fe7 [159184,106910] 0 2024-05-08T05:32:12.328 INFO:tasks.workunit.client.0.smithi087.stdout:2/750: chown d7/de/d2c/d43/f92 758188 1 2024-05-08T05:32:12.328 INFO:tasks.workunit.client.0.smithi087.stdout:5/860: mknod da/db/d2a/d5a/d93/d42/d43/d83/ddc/dd5/c11f 0 2024-05-08T05:32:12.328 INFO:tasks.workunit.client.0.smithi087.stdout:8/780: dread db/d23/f2d [0,4194304] 0 2024-05-08T05:32:12.328 INFO:tasks.workunit.client.0.smithi087.stdout:8/781: chown db/d23/d3a/d65/d83/dc5 9718728 1 2024-05-08T05:32:12.328 INFO:tasks.workunit.client.0.smithi087.stdout:0/705: mkdir d0/da/d35/d86/d6d/ded 0 2024-05-08T05:32:12.328 INFO:tasks.workunit.client.0.smithi087.stdout:8/782: write db/d23/d15/d29/d4d/fec [219112,129507] 0 2024-05-08T05:32:12.333 INFO:tasks.workunit.client.0.smithi087.stdout:0/706: getdents d0/d22/d3c/dbb/ddb 0 2024-05-08T05:32:12.333 INFO:tasks.workunit.client.0.smithi087.stdout:3/785: write d4/d11/d3d/f47 [1704045,83579] 0 2024-05-08T05:32:12.333 INFO:tasks.workunit.client.0.smithi087.stdout:3/786: truncate d4/d14/f85 5179891 0 2024-05-08T05:32:12.333 INFO:tasks.workunit.client.0.smithi087.stdout:3/787: chown d4/d11/d3d/d4e/l72 77578036 1 2024-05-08T05:32:12.334 INFO:tasks.workunit.client.0.smithi087.stdout:3/788: truncate d4/f5 244003 0 2024-05-08T05:32:12.336 INFO:tasks.workunit.client.0.smithi087.stdout:6/813: dread d4/d8/df/d39/d42/d9e/d6f/d7f/de7/fa3 [0,4194304] 0 2024-05-08T05:32:12.336 INFO:tasks.workunit.client.0.smithi087.stdout:2/751: dread d7/f5b [0,4194304] 0 2024-05-08T05:32:12.343 INFO:tasks.workunit.client.0.smithi087.stdout:0/707: mknod d0/de0/cee 0 2024-05-08T05:32:12.343 INFO:tasks.workunit.client.0.smithi087.stdout:0/708: write d0/d9/d1b/d2f/d54/da1/f96 [438814,114170] 0 2024-05-08T05:32:12.344 INFO:tasks.workunit.client.0.smithi087.stdout:1/671: write fa [2353041,119617] 0 2024-05-08T05:32:12.345 INFO:tasks.workunit.client.0.smithi087.stdout:0/709: mknod d0/de0/cef 0 2024-05-08T05:32:12.347 INFO:tasks.workunit.client.0.smithi087.stdout:2/752: dread d7/de/d27/f53 [0,4194304] 0 2024-05-08T05:32:12.347 INFO:tasks.workunit.client.0.smithi087.stdout:2/753: readlink d7/de/d82/dcc/ld2 0 2024-05-08T05:32:12.354 INFO:tasks.workunit.client.0.smithi087.stdout:1/672: truncate df/f1f 193829 0 2024-05-08T05:32:12.354 INFO:tasks.workunit.client.0.smithi087.stdout:6/814: dread d4/d8/df/d39/d42/d9e/d6f/d7f/de7/f79 [0,4194304] 0 2024-05-08T05:32:12.355 INFO:tasks.workunit.client.0.smithi087.stdout:8/783: dread db/d23/d1b/f3d [4194304,4194304] 0 2024-05-08T05:32:12.355 INFO:tasks.workunit.client.0.smithi087.stdout:8/784: dread - db/d23/d15/d29/db1/fcd zero size 2024-05-08T05:32:12.356 INFO:tasks.workunit.client.0.smithi087.stdout:2/754: rename d7/de/d2c/db0/cd5 to d7/de/d5d/d90/df1/cfc 0 2024-05-08T05:32:12.357 INFO:tasks.workunit.client.0.smithi087.stdout:2/755: chown d7/de/d27/c29 870 1 2024-05-08T05:32:12.357 INFO:tasks.workunit.client.0.smithi087.stdout:2/756: chown d7/de/d2c/db0/df8 154374 1 2024-05-08T05:32:12.364 INFO:tasks.workunit.client.0.smithi087.stdout:8/785: rmdir db/d23/d3a 39 2024-05-08T05:32:12.364 INFO:tasks.workunit.client.0.smithi087.stdout:8/786: readlink db/d23/d1b/d7c/l103 0 2024-05-08T05:32:12.364 INFO:tasks.workunit.client.0.smithi087.stdout:1/673: rename df/d2f/d57/d64/d83/ld2 to df/d18/d1d/d27/le9 0 2024-05-08T05:32:12.364 INFO:tasks.workunit.client.0.smithi087.stdout:1/674: write df/d18/d1d/f48 [3710099,78813] 0 2024-05-08T05:32:12.364 INFO:tasks.workunit.client.0.smithi087.stdout:1/675: creat df/d2f/d57/fea x:0 0 0 2024-05-08T05:32:12.364 INFO:tasks.workunit.client.0.smithi087.stdout:1/676: mkdir df/d18/deb 0 2024-05-08T05:32:12.365 INFO:tasks.workunit.client.0.smithi087.stdout:1/677: getdents df/d2f/d6a 0 2024-05-08T05:32:12.378 INFO:tasks.workunit.client.0.smithi087.stdout:6/815: write d4/f99 [143313,94462] 0 2024-05-08T05:32:12.384 INFO:tasks.workunit.client.0.smithi087.stdout:5/861: dread da/db/d2a/d5a/d93/d42/f9d [0,4194304] 0 2024-05-08T05:32:12.385 INFO:tasks.workunit.client.0.smithi087.stdout:5/862: write da/f30 [4413975,121126] 0 2024-05-08T05:32:12.386 INFO:tasks.workunit.client.0.smithi087.stdout:5/863: mkdir da/db/d120 0 2024-05-08T05:32:12.389 INFO:tasks.workunit.client.0.smithi087.stdout:8/787: dread db/d23/d15/d29/d4d/f5a [0,4194304] 0 2024-05-08T05:32:12.394 INFO:tasks.workunit.client.0.smithi087.stdout:1/678: dread df/d18/d1d/d58/d72/f5f [0,4194304] 0 2024-05-08T05:32:12.394 INFO:tasks.workunit.client.0.smithi087.stdout:0/710: dwrite d0/d9/d1b/d5e/f72 [0,4194304] 0 2024-05-08T05:32:12.394 INFO:tasks.workunit.client.0.smithi087.stdout:0/711: symlink d0/da/db4/lf0 0 2024-05-08T05:32:12.394 INFO:tasks.workunit.client.0.smithi087.stdout:0/712: chown d0/d9/l59 30291 1 2024-05-08T05:32:12.394 INFO:tasks.workunit.client.0.smithi087.stdout:0/713: read d0/da/d35/d86/f15 [2444742,26052] 0 2024-05-08T05:32:12.394 INFO:tasks.workunit.client.0.smithi087.stdout:0/714: fsync d0/da/d35/d86/d9a/fe9 0 2024-05-08T05:32:12.396 INFO:tasks.workunit.client.0.smithi087.stdout:0/715: mkdir d0/d9/d1b/d2f/d54/da1/d94/df1 0 2024-05-08T05:32:12.397 INFO:tasks.workunit.client.0.smithi087.stdout:0/716: creat d0/d9e/ff2 x:0 0 0 2024-05-08T05:32:12.399 INFO:tasks.workunit.client.0.smithi087.stdout:0/717: rename d0/da/db4/de4 to d0/d57/d24/d66/df3 0 2024-05-08T05:32:12.399 INFO:tasks.workunit.client.0.smithi087.stdout:0/718: readlink d0/d9e/la9 0 2024-05-08T05:32:12.400 INFO:tasks.workunit.client.0.smithi087.stdout:9/800: dwrite d1/df/d14/d68/d80/d98/f9d [0,4194304] 0 2024-05-08T05:32:12.400 INFO:tasks.workunit.client.0.smithi087.stdout:8/788: dread db/d23/d1b/d35/f89 [0,4194304] 0 2024-05-08T05:32:12.401 INFO:tasks.workunit.client.0.smithi087.stdout:0/719: rename d0/d57/d24/d66/la0 to d0/da/d35/d86/d6d/ded/lf4 0 2024-05-08T05:32:12.403 INFO:tasks.workunit.client.0.smithi087.stdout:8/789: mknod db/d23/d1b/d35/d43/d68/c104 0 2024-05-08T05:32:12.406 INFO:tasks.workunit.client.0.smithi087.stdout:4/769: dwrite d4/d13/d3e/d28/d50/d9d/df2/d106/ff5 [0,4194304] 0 2024-05-08T05:32:12.408 INFO:tasks.workunit.client.0.smithi087.stdout:0/720: rmdir d0/da/d35/daa 39 2024-05-08T05:32:12.409 INFO:tasks.workunit.client.0.smithi087.stdout:4/770: mkdir d4/d6c/d93/d11b 0 2024-05-08T05:32:12.410 INFO:tasks.workunit.client.0.smithi087.stdout:4/771: write d4/d13/d3e/d28/d50/d9d/df2/d106/d91/db8/dba/f54 [2644468,38828] 0 2024-05-08T05:32:12.412 INFO:tasks.workunit.client.0.smithi087.stdout:0/721: rmdir d0/da 39 2024-05-08T05:32:12.414 INFO:tasks.workunit.client.0.smithi087.stdout:4/772: rename d4/d13/d3e/d28/lfb to d4/l11c 0 2024-05-08T05:32:12.419 INFO:tasks.workunit.client.0.smithi087.stdout:0/722: mkdir d0/d9/d1b/d2f/df5 0 2024-05-08T05:32:12.419 INFO:tasks.workunit.client.0.smithi087.stdout:4/773: creat d4/d13/d32/f11d x:0 0 0 2024-05-08T05:32:12.422 INFO:tasks.workunit.client.0.smithi087.stdout:4/774: symlink d4/d13/d65/dd7/l11e 0 2024-05-08T05:32:12.424 INFO:tasks.workunit.client.0.smithi087.stdout:4/775: mknod d4/d13/d3e/d28/d50/d9d/df2/d106/d91/db8/dba/d96/dd5/c11f 0 2024-05-08T05:32:12.424 INFO:tasks.workunit.client.0.smithi087.stdout:4/776: fsync d4/d13/f16 0 2024-05-08T05:32:12.426 INFO:tasks.workunit.client.0.smithi087.stdout:4/777: write d4/d13/d3e/d28/d50/d9d/df2/d106/d91/db8/dba/d96/f117 [816794,101673] 0 2024-05-08T05:32:12.428 INFO:tasks.workunit.client.0.smithi087.stdout:4/778: symlink d4/d13/d65/dd7/l120 0 2024-05-08T05:32:12.442 INFO:tasks.workunit.client.0.smithi087.stdout:2/757: dwrite d7/d63/fea [0,4194304] 0 2024-05-08T05:32:12.443 INFO:tasks.workunit.client.0.smithi087.stdout:8/790: dread db/d23/d1b/d7c/f9c [0,4194304] 0 2024-05-08T05:32:12.445 INFO:tasks.workunit.client.0.smithi087.stdout:2/758: unlink d7/de/d27/d33/d49/f5a 0 2024-05-08T05:32:12.447 INFO:tasks.workunit.client.0.smithi087.stdout:8/791: mknod db/d23/d1b/d35/d43/d68/d6f/c105 0 2024-05-08T05:32:12.447 INFO:tasks.workunit.client.0.smithi087.stdout:3/789: dwrite d4/f5c [0,4194304] 0 2024-05-08T05:32:12.447 INFO:tasks.workunit.client.0.smithi087.stdout:8/792: chown db/d23/d1b/d35 1821086839 1 2024-05-08T05:32:12.447 INFO:tasks.workunit.client.0.smithi087.stdout:8/793: chown db/d23/d1b/d35/d43/d68/fb2 298357 1 2024-05-08T05:32:12.450 INFO:tasks.workunit.client.0.smithi087.stdout:2/759: unlink d7/cdc 0 2024-05-08T05:32:12.450 INFO:tasks.workunit.client.0.smithi087.stdout:2/760: fdatasync d7/de/d27/d33/f21 0 2024-05-08T05:32:12.454 INFO:tasks.workunit.client.0.smithi087.stdout:3/790: creat d4/d11/d24/f115 x:0 0 0 2024-05-08T05:32:12.455 INFO:tasks.workunit.client.0.smithi087.stdout:3/791: write d4/f1d [1054864,45123] 0 2024-05-08T05:32:12.455 INFO:tasks.workunit.client.0.smithi087.stdout:8/794: rmdir db/d23/d54/dd6 39 2024-05-08T05:32:12.457 INFO:tasks.workunit.client.0.smithi087.stdout:2/761: mknod d7/de/d78/cfd 0 2024-05-08T05:32:12.460 INFO:tasks.workunit.client.0.smithi087.stdout:3/792: rename d4/f5c to d4/d14/dfc/f116 0 2024-05-08T05:32:12.461 INFO:tasks.workunit.client.0.smithi087.stdout:8/795: creat db/f106 x:0 0 0 2024-05-08T05:32:12.462 INFO:tasks.workunit.client.0.smithi087.stdout:0/723: write d0/d9/d1b/d2f/d54/da1/f88 [1381888,119882] 0 2024-05-08T05:32:12.462 INFO:tasks.workunit.client.0.smithi087.stdout:0/724: chown d0/da/d35/daa 506662945 1 2024-05-08T05:32:12.462 INFO:tasks.workunit.client.0.smithi087.stdout:0/725: fdatasync d0/d9/fb5 0 2024-05-08T05:32:12.462 INFO:tasks.workunit.client.0.smithi087.stdout:2/762: symlink d7/de/d2c/db6/dcb/lfe 0 2024-05-08T05:32:12.462 INFO:tasks.workunit.client.0.smithi087.stdout:2/763: fdatasync d7/d63/dac/fda 0 2024-05-08T05:32:12.464 INFO:tasks.workunit.client.0.smithi087.stdout:6/816: dwrite d4/d8/f18 [0,4194304] 0 2024-05-08T05:32:12.466 INFO:tasks.workunit.client.0.smithi087.stdout:3/793: write d4/d11/d24/d25/d3e/f89 [488328,77576] 0 2024-05-08T05:32:12.472 INFO:tasks.workunit.client.0.smithi087.stdout:5/864: dwrite da/db/d2a/d5a/d93/d36/d45/d5c/dff/f111 [0,4194304] 0 2024-05-08T05:32:12.472 INFO:tasks.workunit.client.0.smithi087.stdout:5/865: write da/dd/d65/fcc [4427276,81723] 0 2024-05-08T05:32:12.480 INFO:tasks.workunit.client.0.smithi087.stdout:2/764: mknod d7/d63/cff 0 2024-05-08T05:32:12.480 INFO:tasks.workunit.client.0.smithi087.stdout:3/794: mkdir d4/d14/d84/d117 0 2024-05-08T05:32:12.480 INFO:tasks.workunit.client.0.smithi087.stdout:0/726: truncate d0/d57/f2a 1716381 0 2024-05-08T05:32:12.481 INFO:tasks.workunit.client.0.smithi087.stdout:5/866: mkdir da/db/d2a/d5a/d93/d42/de8/d121 0 2024-05-08T05:32:12.481 INFO:tasks.workunit.client.0.smithi087.stdout:5/867: chown da/db/d2a/d5a/d93/d36/d45/fae 9379 1 2024-05-08T05:32:12.481 INFO:tasks.workunit.client.0.smithi087.stdout:5/868: stat da/db/d2a/d46/dc6 0 2024-05-08T05:32:12.481 INFO:tasks.workunit.client.0.smithi087.stdout:5/869: chown da/db/d2a/d5a/d93/d42/fc7 1587 1 2024-05-08T05:32:12.481 INFO:tasks.workunit.client.0.smithi087.stdout:5/870: chown da/db/d2a/fab 0 1 2024-05-08T05:32:12.481 INFO:tasks.workunit.client.0.smithi087.stdout:5/871: fdatasync da/db/d2a/f32 0 2024-05-08T05:32:12.482 INFO:tasks.workunit.client.0.smithi087.stdout:2/765: mkdir d7/d93/d100 0 2024-05-08T05:32:12.482 INFO:tasks.workunit.client.0.smithi087.stdout:2/766: readlink d7/d93/la0 0 2024-05-08T05:32:12.483 INFO:tasks.workunit.client.0.smithi087.stdout:3/795: creat d4/d11/d24/d25/d4d/dbb/f118 x:0 0 0 2024-05-08T05:32:12.483 INFO:tasks.workunit.client.0.smithi087.stdout:0/727: symlink d0/da/d35/d86/d9a/lf6 0 2024-05-08T05:32:12.484 INFO:tasks.workunit.client.0.smithi087.stdout:9/801: dwrite d1/f30 [0,4194304] 0 2024-05-08T05:32:12.484 INFO:tasks.workunit.client.0.smithi087.stdout:5/872: truncate da/db/d2a/d5a/d93/d36/d45/f4d 533148 0 2024-05-08T05:32:12.484 INFO:tasks.workunit.client.0.smithi087.stdout:5/873: write da/db/d2a/d5a/d93/d42/d43/ff4 [1029817,20917] 0 2024-05-08T05:32:12.485 INFO:tasks.workunit.client.0.smithi087.stdout:2/767: mknod d7/d93/d100/c101 0 2024-05-08T05:32:12.487 INFO:tasks.workunit.client.0.smithi087.stdout:3/796: symlink d4/d11/d3d/d110/l119 0 2024-05-08T05:32:12.488 INFO:tasks.workunit.client.0.smithi087.stdout:5/874: creat da/db/d2a/d5a/d93/d42/d43/d83/d6b/f122 x:0 0 0 2024-05-08T05:32:12.491 INFO:tasks.workunit.client.0.smithi087.stdout:4/779: dwrite d4/d13/fa1 [0,4194304] 0 2024-05-08T05:32:12.493 INFO:tasks.workunit.client.0.smithi087.stdout:1/679: dwrite df/d2f/d57/da0/fc4 [0,4194304] 0 2024-05-08T05:32:12.509 INFO:tasks.workunit.client.0.smithi087.stdout:6/817: dwrite d4/d8/df/d1e/d25/fe6 [0,4194304] 0 2024-05-08T05:32:12.509 INFO:tasks.workunit.client.0.smithi087.stdout:6/818: write d4/d8/df/d39/d42/d9e/d6f/d7f/de7/fa3 [575632,36404] 0 2024-05-08T05:32:12.509 INFO:tasks.workunit.client.0.smithi087.stdout:6/819: chown d4/d8/df/d39/d42 0 1 2024-05-08T05:32:12.509 INFO:tasks.workunit.client.0.smithi087.stdout:7/939: sync 2024-05-08T05:32:12.509 INFO:tasks.workunit.client.0.smithi087.stdout:4/780: rename d4/d13/d65/c46 to d4/d6c/d93/d11b/c121 0 2024-05-08T05:32:12.510 INFO:tasks.workunit.client.0.smithi087.stdout:5/875: link da/db/d2a/d5a/d93/d36/d45/l97 da/db/d2a/d5a/d93/d36/dc1/l123 0 2024-05-08T05:32:12.510 INFO:tasks.workunit.client.0.smithi087.stdout:8/796: dwrite db/d23/f63 [0,4194304] 0 2024-05-08T05:32:12.510 INFO:tasks.workunit.client.0.smithi087.stdout:8/797: write f8 [3157815,39220] 0 2024-05-08T05:32:12.510 INFO:tasks.workunit.client.0.smithi087.stdout:8/798: stat db/d23/d15/d29/fd9 0 2024-05-08T05:32:12.513 INFO:tasks.workunit.client.0.smithi087.stdout:1/680: creat df/d18/deb/fec x:0 0 0 2024-05-08T05:32:12.516 INFO:tasks.workunit.client.0.smithi087.stdout:7/940: creat d2/d6/d12/d19/d2a/f138 x:0 0 0 2024-05-08T05:32:12.516 INFO:tasks.workunit.client.0.smithi087.stdout:6/820: truncate d4/d8/df/f31 758814 0 2024-05-08T05:32:12.518 INFO:tasks.workunit.client.0.smithi087.stdout:1/681: creat df/d2f/d57/dcb/de1/fed x:0 0 0 2024-05-08T05:32:12.518 INFO:tasks.workunit.client.0.smithi087.stdout:1/682: write df/f40 [1710044,72255] 0 2024-05-08T05:32:12.519 INFO:tasks.workunit.client.0.smithi087.stdout:4/781: link d4/d13/d3e/f114 d4/d13/d3e/d28/d50/d9d/df2/d106/f122 0 2024-05-08T05:32:12.519 INFO:tasks.workunit.client.0.smithi087.stdout:6/821: creat d4/d8/df/d39/d42/d9e/d6f/d7f/de7/d2d/d37/d45/da2/ffd x:0 0 0 2024-05-08T05:32:12.521 INFO:tasks.workunit.client.0.smithi087.stdout:1/683: rename df/l74 to df/d2f/d57/dcb/lee 0 2024-05-08T05:32:12.522 INFO:tasks.workunit.client.0.smithi087.stdout:4/782: creat d4/d13/d3e/d28/d50/f123 x:0 0 0 2024-05-08T05:32:12.523 INFO:tasks.workunit.client.0.smithi087.stdout:4/783: stat d4/d13/d3e/d28/d50/d9d/df2/d106/d91/d84/d10c 0 2024-05-08T05:32:12.526 INFO:tasks.workunit.client.0.smithi087.stdout:1/684: symlink df/d2f/d57/d64/d83/d96/dcf/lef 0 2024-05-08T05:32:12.526 INFO:tasks.workunit.client.0.smithi087.stdout:6/822: creat d4/d8/df/d39/d42/d9e/d6f/d7f/de7/d2d/d37/d45/ffe x:0 0 0 2024-05-08T05:32:12.526 INFO:tasks.workunit.client.0.smithi087.stdout:6/823: chown d4/d8/df/d1e/d52/l7d 2 1 2024-05-08T05:32:12.526 INFO:tasks.workunit.client.0.smithi087.stdout:6/824: stat d4/d8/df/d39/d42/d9e/d6f/d7f/de7/d2d/d37/d45/ffc 0 2024-05-08T05:32:12.527 INFO:tasks.workunit.client.0.smithi087.stdout:4/784: creat d4/d6c/f124 x:0 0 0 2024-05-08T05:32:12.527 INFO:tasks.workunit.client.0.smithi087.stdout:4/785: truncate d4/d13/d3e/d28/d50/d5a/f10e 165062 0 2024-05-08T05:32:12.530 INFO:tasks.workunit.client.0.smithi087.stdout:1/685: truncate df/f4a 641046 0 2024-05-08T05:32:12.531 INFO:tasks.workunit.client.0.smithi087.stdout:4/786: creat d4/d13/d3e/d28/d50/d9d/df2/d106/f125 x:0 0 0 2024-05-08T05:32:12.532 INFO:tasks.workunit.client.0.smithi087.stdout:2/768: dwrite d7/de/d27/d33/fc9 [0,4194304] 0 2024-05-08T05:32:12.532 INFO:tasks.workunit.client.0.smithi087.stdout:8/799: dread db/d23/d1b/d35/d43/d68/d6a/fe8 [0,4194304] 0 2024-05-08T05:32:12.532 INFO:tasks.workunit.client.0.smithi087.stdout:2/769: chown d7/de/d27/d33/d65/ca8 2 1 2024-05-08T05:32:12.537 INFO:tasks.workunit.client.0.smithi087.stdout:1/686: creat df/ff0 x:0 0 0 2024-05-08T05:32:12.537 INFO:tasks.workunit.client.0.smithi087.stdout:8/800: mknod db/d23/d15/d29/d33/d3b/d56/c107 0 2024-05-08T05:32:12.537 INFO:tasks.workunit.client.0.smithi087.stdout:8/801: write db/d23/d15/f71 [445154,120266] 0 2024-05-08T05:32:12.537 INFO:tasks.workunit.client.0.smithi087.stdout:8/802: rmdir db/d23/d15/d29/d33/d6c/dbe 39 2024-05-08T05:32:12.545 INFO:tasks.workunit.client.0.smithi087.stdout:8/803: write db/d23/d15/d29/d33/fe1 [684100,15972] 0 2024-05-08T05:32:12.547 INFO:tasks.workunit.client.0.smithi087.stdout:8/804: creat db/d23/d3a/d65/f108 x:0 0 0 2024-05-08T05:32:12.548 INFO:tasks.workunit.client.0.smithi087.stdout:8/805: mknod db/d23/d15/d3c/c109 0 2024-05-08T05:32:12.549 INFO:tasks.workunit.client.0.smithi087.stdout:6/825: write d4/d8/df/d39/d42/fab [2709718,44962] 0 2024-05-08T05:32:12.549 INFO:tasks.workunit.client.0.smithi087.stdout:6/826: chown d4/d8/df/d1e/d25/f4e 7285892 1 2024-05-08T05:32:12.550 INFO:tasks.workunit.client.0.smithi087.stdout:8/806: creat db/d23/d15/d29/d4d/d96/f10a x:0 0 0 2024-05-08T05:32:12.550 INFO:tasks.workunit.client.0.smithi087.stdout:8/807: dread - db/d23/d54/d9d/ff1 zero size 2024-05-08T05:32:12.551 INFO:tasks.workunit.client.0.smithi087.stdout:6/827: creat d4/d8/df/d39/d42/dbd/dee/fff x:0 0 0 2024-05-08T05:32:12.551 INFO:tasks.workunit.client.0.smithi087.stdout:6/828: readlink d4/d8/l22 0 2024-05-08T05:32:12.551 INFO:tasks.workunit.client.0.smithi087.stdout:6/829: write d4/d8/df/d39/d42/d9e/d6f/d7f/de7/d2d/d37/d45/ffc [154246,26210] 0 2024-05-08T05:32:12.554 INFO:tasks.workunit.client.0.smithi087.stdout:8/808: rename db/d23/d54/dd6 to db/d23/d15/d10b 0 2024-05-08T05:32:12.554 INFO:tasks.workunit.client.0.smithi087.stdout:8/809: dread - db/d23/d3a/fd3 zero size 2024-05-08T05:32:12.554 INFO:tasks.workunit.client.0.smithi087.stdout:8/810: readlink db/d23/d3a/lc6 0 2024-05-08T05:32:12.554 INFO:tasks.workunit.client.0.smithi087.stdout:6/830: rmdir d4/d8/df/d39/d42/d9e/d6f/d7f/de7/d2d/d37/d45 39 2024-05-08T05:32:12.556 INFO:tasks.workunit.client.0.smithi087.stdout:8/811: link db/d23/f38 db/d23/d15/d29/d33/d3b/d56/d78/f10c 0 2024-05-08T05:32:12.557 INFO:tasks.workunit.client.0.smithi087.stdout:6/831: symlink d4/d8/df/d39/d42/d94/l100 0 2024-05-08T05:32:12.557 INFO:tasks.workunit.client.0.smithi087.stdout:6/832: truncate d4/d8/df/d39/d42/d94/db5/fc0 1035237 0 2024-05-08T05:32:12.559 INFO:tasks.workunit.client.0.smithi087.stdout:8/812: creat db/d23/d15/d29/d4d/d96/f10d x:0 0 0 2024-05-08T05:32:12.559 INFO:tasks.workunit.client.0.smithi087.stdout:8/813: truncate db/d23/d15/d3c/f3f 1588802 0 2024-05-08T05:32:12.559 INFO:tasks.workunit.client.0.smithi087.stdout:8/814: dread - db/d23/d15/d29/d33/dd2/ffd zero size 2024-05-08T05:32:12.564 INFO:tasks.workunit.client.0.smithi087.stdout:8/815: write db/d23/d1b/d35/d43/fd0 [454487,75680] 0 2024-05-08T05:32:12.567 INFO:tasks.workunit.client.0.smithi087.stdout:8/816: mkdir db/d23/d1b/d7c/d10e 0 2024-05-08T05:32:12.571 INFO:tasks.workunit.client.0.smithi087.stdout:8/817: link db/d23/d15/d29/d33/d3b/d56/d78/fa5 db/d23/d15/d10b/d100/f10f 0 2024-05-08T05:32:12.571 INFO:tasks.workunit.client.0.smithi087.stdout:8/818: fdatasync db/d23/d15/d29/f52 0 2024-05-08T05:32:12.572 INFO:tasks.workunit.client.0.smithi087.stdout:6/833: write d4/d8/df/d39/d42/d9e/d6f/d7f/de7/d2d/d37/d5b/f93 [5173792,25582] 0 2024-05-08T05:32:12.572 INFO:tasks.workunit.client.0.smithi087.stdout:6/834: write d4/d8/fb [4221522,64540] 0 2024-05-08T05:32:12.572 INFO:tasks.workunit.client.0.smithi087.stdout:6/835: chown d4/d8/df/d39/d42/dbd/ld4 3 1 2024-05-08T05:32:12.572 INFO:tasks.workunit.client.0.smithi087.stdout:6/836: readlink d4/d8/df/d39/d42/d94/lf1 0 2024-05-08T05:32:12.573 INFO:tasks.workunit.client.0.smithi087.stdout:3/797: read d4/d11/d24/d25/d3e/d3f/f7b [488875,1359] 0 2024-05-08T05:32:12.574 INFO:tasks.workunit.client.0.smithi087.stdout:3/798: write d4/d14/d84/d8b/d8f/fc4 [283777,7899] 0 2024-05-08T05:32:12.574 INFO:tasks.workunit.client.0.smithi087.stdout:0/728: dwrite d0/da/d35/daa/fcf [0,4194304] 0 2024-05-08T05:32:12.575 INFO:tasks.workunit.client.0.smithi087.stdout:8/819: truncate db/d23/d1b/fad 2617235 0 2024-05-08T05:32:12.576 INFO:tasks.workunit.client.0.smithi087.stdout:8/820: write db/d23/d1b/d4b/f91 [172660,98617] 0 2024-05-08T05:32:12.577 INFO:tasks.workunit.client.0.smithi087.stdout:3/799: mkdir d4/d14/dfb/d11a 0 2024-05-08T05:32:12.578 INFO:tasks.workunit.client.0.smithi087.stdout:0/729: symlink d0/d9/d1b/d2f/d54/da1/d94/df1/lf7 0 2024-05-08T05:32:12.583 INFO:tasks.workunit.client.0.smithi087.stdout:5/876: dwrite da/db/d2a/d5a/d93/d42/d43/d83/d6b/d9c/fa4 [0,4194304] 0 2024-05-08T05:32:12.588 INFO:tasks.workunit.client.0.smithi087.stdout:7/941: dwrite d2/d6/da0/d67/d82/d98/fda [0,4194304] 0 2024-05-08T05:32:12.592 INFO:tasks.workunit.client.0.smithi087.stdout:8/821: rename db/d23/d54/d9d to db/d23/d15/d29/d33/d6c/d110 0 2024-05-08T05:32:12.593 INFO:tasks.workunit.client.0.smithi087.stdout:0/730: creat d0/d9/d1b/ff8 x:0 0 0 2024-05-08T05:32:12.593 INFO:tasks.workunit.client.0.smithi087.stdout:0/731: write d0/da/d11/f20 [8330076,6574] 0 2024-05-08T05:32:12.594 INFO:tasks.workunit.client.0.smithi087.stdout:1/687: dwrite df/d18/d1d/d58/d72/fde [0,4194304] 0 2024-05-08T05:32:12.594 INFO:tasks.workunit.client.0.smithi087.stdout:1/688: readlink df/d18/d1d/d58/d72/l46 0 2024-05-08T05:32:12.594 INFO:tasks.workunit.client.0.smithi087.stdout:1/689: stat df/d18/d1d/l81 0 2024-05-08T05:32:12.597 INFO:tasks.workunit.client.0.smithi087.stdout:5/877: symlink da/db/dd3/dfd/l124 0 2024-05-08T05:32:12.602 INFO:tasks.workunit.client.0.smithi087.stdout:8/822: creat db/d23/d15/d29/d33/f111 x:0 0 0 2024-05-08T05:32:12.604 INFO:tasks.workunit.client.0.smithi087.stdout:0/732: mkdir d0/d9/d1b/d2f/d54/df9 0 2024-05-08T05:32:12.604 INFO:tasks.workunit.client.0.smithi087.stdout:7/942: read d2/d6/d12/d15/fa2 [1665211,71394] 0 2024-05-08T05:32:12.604 INFO:tasks.workunit.client.0.smithi087.stdout:7/943: readlink d2/d6/da0/d10f/d3f/d72/d77/d54/d50/d88/lbf 0 2024-05-08T05:32:12.604 INFO:tasks.workunit.client.0.smithi087.stdout:5/878: getdents da/db/d2a/d5a/d93/d17/d99 0 2024-05-08T05:32:12.604 INFO:tasks.workunit.client.0.smithi087.stdout:5/879: write da/db/d2a/d5a/d93/d36/d45/d5c/d86/fc4 [503819,18100] 0 2024-05-08T05:32:12.606 INFO:tasks.workunit.client.0.smithi087.stdout:8/823: mknod db/d23/d1b/d4b/c112 0 2024-05-08T05:32:12.608 INFO:tasks.workunit.client.0.smithi087.stdout:0/733: link d0/d9/f13 d0/d9/d1b/d2f/dcc/ffa 0 2024-05-08T05:32:12.608 INFO:tasks.workunit.client.0.smithi087.stdout:0/734: fdatasync d0/d9/d1b/ff8 0 2024-05-08T05:32:12.609 INFO:tasks.workunit.client.0.smithi087.stdout:3/800: dwrite d4/d11/d24/d25/f54 [4194304,4194304] 0 2024-05-08T05:32:12.610 INFO:tasks.workunit.client.0.smithi087.stdout:7/944: mknod d2/d6/d12/d19/d108/c139 0 2024-05-08T05:32:12.612 INFO:tasks.workunit.client.0.smithi087.stdout:5/880: rename da/db/dd3/dfd/l124 to da/db/dd3/l125 0 2024-05-08T05:32:12.615 INFO:tasks.workunit.client.0.smithi087.stdout:8/824: mkdir db/d23/d15/d29/d33/d3b/d56/d113 0 2024-05-08T05:32:12.615 INFO:tasks.workunit.client.0.smithi087.stdout:0/735: truncate d0/da/d35/f80 4168148 0 2024-05-08T05:32:12.617 INFO:tasks.workunit.client.0.smithi087.stdout:3/801: symlink d4/d11/d24/d25/d3e/d58/d9b/l11b 0 2024-05-08T05:32:12.618 INFO:tasks.workunit.client.0.smithi087.stdout:7/945: rmdir d2/d6/d12/d19/d2a/d91/df0 39 2024-05-08T05:32:12.622 INFO:tasks.workunit.client.0.smithi087.stdout:8/825: creat db/d23/d15/d29/d33/f114 x:0 0 0 2024-05-08T05:32:12.622 INFO:tasks.workunit.client.0.smithi087.stdout:0/736: mkdir d0/d9/d1b/d5e/dfb 0 2024-05-08T05:32:12.622 INFO:tasks.workunit.client.0.smithi087.stdout:8/826: truncate db/d23/d1b/d35/d43/fde 964623 0 2024-05-08T05:32:12.622 INFO:tasks.workunit.client.0.smithi087.stdout:8/827: stat db/d23/d15/d3c/fb5 0 2024-05-08T05:32:12.622 INFO:tasks.workunit.client.0.smithi087.stdout:8/828: dread - db/d23/d15/d29/d33/f111 zero size 2024-05-08T05:32:12.622 INFO:tasks.workunit.client.0.smithi087.stdout:0/737: write d0/da/d35/fd1 [942972,52820] 0 2024-05-08T05:32:12.622 INFO:tasks.workunit.client.0.smithi087.stdout:0/738: chown d0/da/cd2 137 1 2024-05-08T05:32:12.623 INFO:tasks.workunit.client.0.smithi087.stdout:3/802: mknod d4/d11/d24/d25/d3e/d58/c11c 0 2024-05-08T05:32:12.624 INFO:tasks.workunit.client.0.smithi087.stdout:8/829: creat db/d23/d3a/d65/d83/dc5/f115 x:0 0 0 2024-05-08T05:32:12.626 INFO:tasks.workunit.client.0.smithi087.stdout:3/803: unlink d4/d14/d84/d8b/d8f/dec/f101 0 2024-05-08T05:32:12.631 INFO:tasks.workunit.client.0.smithi087.stdout:5/881: write da/f9e [4025357,104296] 0 2024-05-08T05:32:12.632 INFO:tasks.workunit.client.0.smithi087.stdout:7/946: dread d2/d6/d12/d1d/f17 [4194304,4194304] 0 2024-05-08T05:32:12.633 INFO:tasks.workunit.client.0.smithi087.stdout:7/947: fsync d2/d6/da0/fd4 0 2024-05-08T05:32:12.633 INFO:tasks.workunit.client.0.smithi087.stdout:5/882: mkdir da/db/d2a/d5a/d93/d17/d126 0 2024-05-08T05:32:12.633 INFO:tasks.workunit.client.0.smithi087.stdout:0/739: dread d0/da/d35/daa/fc4 [0,4194304] 0 2024-05-08T05:32:12.634 INFO:tasks.workunit.client.0.smithi087.stdout:1/690: dwrite df/d2f/d6a/f80 [0,4194304] 0 2024-05-08T05:32:12.635 INFO:tasks.workunit.client.0.smithi087.stdout:7/948: rename d2/d6/da0/d10f/d3f/d66/lf2 to d2/d6/da0/d10f/d3f/d66/l13a 0 2024-05-08T05:32:12.635 INFO:tasks.workunit.client.0.smithi087.stdout:7/949: truncate d2/d6/d12/d1d/fc6 1499887 0 2024-05-08T05:32:12.637 INFO:tasks.workunit.client.0.smithi087.stdout:5/883: mkdir da/dd/d13/ddf/d127 0 2024-05-08T05:32:12.637 INFO:tasks.workunit.client.0.smithi087.stdout:5/884: stat da/db/ld1 0 2024-05-08T05:32:12.646 INFO:tasks.workunit.client.0.smithi087.stdout:8/830: write f8 [7233279,26589] 0 2024-05-08T05:32:12.647 INFO:tasks.workunit.client.0.smithi087.stdout:8/831: fsync db/d23/d15/d29/d33/d6c/ffb 0 2024-05-08T05:32:12.647 INFO:tasks.workunit.client.0.smithi087.stdout:1/691: getdents df/d18 0 2024-05-08T05:32:12.647 INFO:tasks.workunit.client.0.smithi087.stdout:1/692: stat df/d2f/d6a/ca7 0 2024-05-08T05:32:12.652 INFO:tasks.workunit.client.0.smithi087.stdout:5/885: symlink da/db/d2a/d5a/d93/d42/d43/d83/ddc/dde/df8/l128 0 2024-05-08T05:32:12.652 INFO:tasks.workunit.client.0.smithi087.stdout:7/950: mknod d2/d6/da0/c13b 0 2024-05-08T05:32:12.652 INFO:tasks.workunit.client.0.smithi087.stdout:5/886: stat da/db/d2a/d5a/d93/d42/d43/d83/fc0 0 2024-05-08T05:32:12.652 INFO:tasks.workunit.client.0.smithi087.stdout:5/887: chown da/db/d2a/d46/dc6/df1/c114 177 1 2024-05-08T05:32:12.652 INFO:tasks.workunit.client.0.smithi087.stdout:7/951: write d2/d6/d12/d19/f1e [1871827,75422] 0 2024-05-08T05:32:12.652 INFO:tasks.workunit.client.0.smithi087.stdout:1/693: creat df/d2f/d57/dcb/ff1 x:0 0 0 2024-05-08T05:32:12.653 INFO:tasks.workunit.client.0.smithi087.stdout:1/694: dread - df/d2f/fb4 zero size 2024-05-08T05:32:12.656 INFO:tasks.workunit.client.0.smithi087.stdout:5/888: truncate da/db/d2a/d5a/d93/d42/d50/f6a 4179979 0 2024-05-08T05:32:12.656 INFO:tasks.workunit.client.0.smithi087.stdout:1/695: truncate df/d18/d1d/d58/d72/f85 602736 0 2024-05-08T05:32:12.656 INFO:tasks.workunit.client.0.smithi087.stdout:5/889: write da/db/dd3/f108 [354017,97976] 0 2024-05-08T05:32:12.659 INFO:tasks.workunit.client.0.smithi087.stdout:1/696: rename df/d2f/d57/dd0 to df/d18/d8b/df2 0 2024-05-08T05:32:12.663 INFO:tasks.workunit.client.0.smithi087.stdout:9/802: sync 2024-05-08T05:32:12.664 INFO:tasks.workunit.client.0.smithi087.stdout:9/803: write d1/d70/fa8 [405855,110448] 0 2024-05-08T05:32:12.664 INFO:tasks.workunit.client.0.smithi087.stdout:7/952: dread d2/d6/d12/d1d/fae [0,4194304] 0 2024-05-08T05:32:12.664 INFO:tasks.workunit.client.0.smithi087.stdout:5/890: rename da/db/d2a/d5a/d93/d36/dc1/fda to da/dd/d13/da2/dce/f129 0 2024-05-08T05:32:12.664 INFO:tasks.workunit.client.0.smithi087.stdout:1/697: mkdir df/df3 0 2024-05-08T05:32:12.664 INFO:tasks.workunit.client.0.smithi087.stdout:1/698: chown df/d2f/d6a 2657501 1 2024-05-08T05:32:12.664 INFO:tasks.workunit.client.0.smithi087.stdout:7/953: mknod d2/d6/da0/d10f/d3f/d72/d77/d124/c13c 0 2024-05-08T05:32:12.666 INFO:tasks.workunit.client.0.smithi087.stdout:5/891: creat da/f12a x:0 0 0 2024-05-08T05:32:12.667 INFO:tasks.workunit.client.0.smithi087.stdout:8/832: read db/d23/d15/f72 [3718928,2951] 0 2024-05-08T05:32:12.667 INFO:tasks.workunit.client.0.smithi087.stdout:8/833: dread - db/d23/d15/d29/d33/f114 zero size 2024-05-08T05:32:12.667 INFO:tasks.workunit.client.0.smithi087.stdout:8/834: fdatasync db/d23/d15/f72 0 2024-05-08T05:32:12.668 INFO:tasks.workunit.client.0.smithi087.stdout:1/699: creat df/d2f/d4f/ff4 x:0 0 0 2024-05-08T05:32:12.668 INFO:tasks.workunit.client.0.smithi087.stdout:7/954: symlink d2/d6/d12/d19/d2a/d89/d9a/l13d 0 2024-05-08T05:32:12.668 INFO:tasks.workunit.client.0.smithi087.stdout:7/955: write d2/d6/da0/d67/d82/d98/f9c [545660,1716] 0 2024-05-08T05:32:12.671 INFO:tasks.workunit.client.0.smithi087.stdout:5/892: symlink da/db/d2a/d5a/d93/d42/d43/d83/ddc/dd5/l12b 0 2024-05-08T05:32:12.671 INFO:tasks.workunit.client.0.smithi087.stdout:5/893: write da/f3c [1327578,106778] 0 2024-05-08T05:32:12.671 INFO:tasks.workunit.client.0.smithi087.stdout:8/835: mkdir db/d23/d3a/d65/d83/d116 0 2024-05-08T05:32:12.671 INFO:tasks.workunit.client.0.smithi087.stdout:8/836: chown db/d23/d15/d29/d33/d6c/d110/fe2 111 1 2024-05-08T05:32:12.671 INFO:tasks.workunit.client.0.smithi087.stdout:3/804: dwrite d4/d11/d24/d25/d99/da2/fc9 [0,4194304] 0 2024-05-08T05:32:12.671 INFO:tasks.workunit.client.0.smithi087.stdout:3/805: fdatasync d4/d11/d24/d25/d3e/d3f/dc0/fd7 0 2024-05-08T05:32:12.671 INFO:tasks.workunit.client.0.smithi087.stdout:1/700: creat df/d18/d1d/d58/ff5 x:0 0 0 2024-05-08T05:32:12.671 INFO:tasks.workunit.client.0.smithi087.stdout:1/701: chown df/d18/d1d/d27/c5e 24545 1 2024-05-08T05:32:12.675 INFO:tasks.workunit.client.0.smithi087.stdout:0/740: dwrite d0/da/d11/fac [0,4194304] 0 2024-05-08T05:32:12.676 INFO:tasks.workunit.client.0.smithi087.stdout:1/702: dread df/fbc [0,4194304] 0 2024-05-08T05:32:12.680 INFO:tasks.workunit.client.0.smithi087.stdout:7/956: symlink d2/d6/da0/d10f/d3f/d72/d77/d54/d55/d117/l13e 0 2024-05-08T05:32:12.680 INFO:tasks.workunit.client.0.smithi087.stdout:7/957: read - d2/d6/d12/d1d/f125 zero size 2024-05-08T05:32:12.680 INFO:tasks.workunit.client.0.smithi087.stdout:7/958: write d2/d6/d12/d15/fa2 [2319863,122149] 0 2024-05-08T05:32:12.680 INFO:tasks.workunit.client.0.smithi087.stdout:8/837: creat db/d23/d1b/d35/d43/f117 x:0 0 0 2024-05-08T05:32:12.680 INFO:tasks.workunit.client.0.smithi087.stdout:8/838: readlink db/d23/d1b/d7c/l103 0 2024-05-08T05:32:12.681 INFO:tasks.workunit.client.0.smithi087.stdout:3/806: creat d4/d11/d24/d25/d4d/dd6/f11d x:0 0 0 2024-05-08T05:32:12.686 INFO:tasks.workunit.client.0.smithi087.stdout:0/741: mknod d0/d57/d24/d66/df3/cfc 0 2024-05-08T05:32:12.686 INFO:tasks.workunit.client.0.smithi087.stdout:1/703: symlink df/d2f/d57/dcb/lf6 0 2024-05-08T05:32:12.686 INFO:tasks.workunit.client.0.smithi087.stdout:1/704: write df/d2f/d4f/f79 [1581420,47682] 0 2024-05-08T05:32:12.688 INFO:tasks.workunit.client.0.smithi087.stdout:7/959: creat d2/d6/da0/d10f/d3f/d66/f13f x:0 0 0 2024-05-08T05:32:12.688 INFO:tasks.workunit.client.0.smithi087.stdout:7/960: chown d2/d6/da0/d10f/d3f/d72 157704327 1 2024-05-08T05:32:12.688 INFO:tasks.workunit.client.0.smithi087.stdout:7/961: truncate d2/d6/da0/d10f/d3f/d72/d77/d54/d50/f6f 739603 0 2024-05-08T05:32:12.689 INFO:tasks.workunit.client.0.smithi087.stdout:8/839: symlink db/d23/d15/d29/d33/d3b/d56/d113/l118 0 2024-05-08T05:32:12.690 INFO:tasks.workunit.client.0.smithi087.stdout:3/807: mkdir d4/d14/dfb/d11e 0 2024-05-08T05:32:12.691 INFO:tasks.workunit.client.0.smithi087.stdout:0/742: truncate d0/d9/d1b/d2f/d54/da1/f83 3676667 0 2024-05-08T05:32:12.693 INFO:tasks.workunit.client.0.smithi087.stdout:8/840: mknod db/d23/d1b/d35/d43/c119 0 2024-05-08T05:32:12.694 INFO:tasks.workunit.client.0.smithi087.stdout:3/808: symlink d4/d11/d24/d39/d5a/l11f 0 2024-05-08T05:32:12.695 INFO:tasks.workunit.client.0.smithi087.stdout:0/743: mkdir d0/da/d35/d86/dfd 0 2024-05-08T05:32:12.697 INFO:tasks.workunit.client.0.smithi087.stdout:1/705: dread df/f1f [0,4194304] 0 2024-05-08T05:32:12.698 INFO:tasks.workunit.client.0.smithi087.stdout:8/841: rename db/d23/d1b/d7c/d10e to db/d23/d15/d29/d33/d6c/d110/dfe/d11a 0 2024-05-08T05:32:12.698 INFO:tasks.workunit.client.0.smithi087.stdout:8/842: fsync db/d23/d15/d29/d33/d6c/ffb 0 2024-05-08T05:32:12.698 INFO:tasks.workunit.client.0.smithi087.stdout:4/787: sync 2024-05-08T05:32:12.698 INFO:tasks.workunit.client.0.smithi087.stdout:4/788: readlink d4/d13/d3e/d28/d35/l7b 0 2024-05-08T05:32:12.700 INFO:tasks.workunit.client.0.smithi087.stdout:7/962: dread d2/d6/da0/d10f/d3f/d72/d77/f5a [0,4194304] 0 2024-05-08T05:32:12.701 INFO:tasks.workunit.client.0.smithi087.stdout:0/744: link d0/d57/cc2 d0/d9/d1b/d2f/d54/cfe 0 2024-05-08T05:32:12.701 INFO:tasks.workunit.client.0.smithi087.stdout:2/770: sync 2024-05-08T05:32:12.701 INFO:tasks.workunit.client.0.smithi087.stdout:6/837: sync 2024-05-08T05:32:12.701 INFO:tasks.workunit.client.0.smithi087.stdout:0/745: truncate d0/d9/d1b/d2f/d54/f89 1438829 0 2024-05-08T05:32:12.702 INFO:tasks.workunit.client.0.smithi087.stdout:3/809: rename d4/d11/d24/d25/d4d/dbb/dfd to d4/d11/d24/d39/d60/d87/da5/d120 0 2024-05-08T05:32:12.706 INFO:tasks.workunit.client.0.smithi087.stdout:9/804: dwrite d1/df/d14/d68/d80/d98/f10 [0,4194304] 0 2024-05-08T05:32:12.706 INFO:tasks.workunit.client.0.smithi087.stdout:9/805: getdents d1/df/d14/d68/d80/d98/d28/de8/dfb 0 2024-05-08T05:32:12.707 INFO:tasks.workunit.client.0.smithi087.stdout:8/843: link db/d23/d15/d29/d33/fd7 db/d23/d15/d29/d79/f11b 0 2024-05-08T05:32:12.707 INFO:tasks.workunit.client.0.smithi087.stdout:4/789: mkdir d4/d13/d3e/d28/d35/d126 0 2024-05-08T05:32:12.707 INFO:tasks.workunit.client.0.smithi087.stdout:4/790: stat d4/d6c/f99 0 2024-05-08T05:32:12.707 INFO:tasks.workunit.client.0.smithi087.stdout:4/791: fdatasync d4/d13/d3e/d28/f39 0 2024-05-08T05:32:12.707 INFO:tasks.workunit.client.0.smithi087.stdout:4/792: write d4/d13/d65/f6f [569102,55797] 0 2024-05-08T05:32:12.707 INFO:tasks.workunit.client.0.smithi087.stdout:4/793: readlink d4/d13/l30 0 2024-05-08T05:32:12.708 INFO:tasks.workunit.client.0.smithi087.stdout:2/771: getdents d7/de/d82 0 2024-05-08T05:32:12.711 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:32:12 smithi087 ceph-mon[29523]: pgmap v516: 97 pgs: 97 active+clean; 1.1 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 144 MiB/s rd, 179 MiB/s wr, 395 op/s 2024-05-08T05:32:12.711 INFO:tasks.workunit.client.0.smithi087.stdout:2/772: read d7/d93/ff4 [3457835,96540] 0 2024-05-08T05:32:12.711 INFO:tasks.workunit.client.0.smithi087.stdout:2/773: chown d7/de/d55/de4 3039 1 2024-05-08T05:32:12.711 INFO:tasks.workunit.client.0.smithi087.stdout:0/746: getdents d0/d57/d24 0 2024-05-08T05:32:12.711 INFO:tasks.workunit.client.0.smithi087.stdout:3/810: unlink d4/d11/d24/d25/d99/da2/fc9 0 2024-05-08T05:32:12.712 INFO:tasks.workunit.client.0.smithi087.stdout:9/806: mkdir d1/df/d14/d18/d66/d7f/dfc 0 2024-05-08T05:32:12.713 INFO:tasks.workunit.client.0.smithi087.stdout:8/844: mkdir db/d23/d1b/d35/d43/d68/d11c 0 2024-05-08T05:32:12.715 INFO:tasks.workunit.client.0.smithi087.stdout:4/794: truncate d4/d13/d3e/d28/d50/d9d/df2/d106/ff5 500476 0 2024-05-08T05:32:12.727 INFO:tasks.workunit.client.0.smithi087.stdout:0/747: mkdir d0/da/d35/d86/d6d/ded/dff 0 2024-05-08T05:32:12.727 INFO:tasks.workunit.client.0.smithi087.stdout:9/807: symlink d1/df/d14/d18/d8e/da2/lfd 0 2024-05-08T05:32:12.727 INFO:tasks.workunit.client.0.smithi087.stdout:8/845: mkdir db/d23/d15/d29/d79/d11d 0 2024-05-08T05:32:12.727 INFO:tasks.workunit.client.0.smithi087.stdout:8/846: chown db/d23/d1b/d35/d43/d68/f7a 242302223 1 2024-05-08T05:32:12.728 INFO:tasks.workunit.client.0.smithi087.stdout:8/847: chown db/d23/d1b/d4b/f69 176852 1 2024-05-08T05:32:12.728 INFO:tasks.workunit.client.0.smithi087.stdout:3/811: rename d4/d11/d24/d39/d60 to d4/d11/d24/d25/d4d/dd6/d121 0 2024-05-08T05:32:12.731 INFO:tasks.workunit.client.0.smithi087.stdout:0/748: creat d0/d9/f100 x:0 0 0 2024-05-08T05:32:12.733 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:32:12 smithi090 ceph-mon[34526]: pgmap v516: 97 pgs: 97 active+clean; 1.1 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 144 MiB/s rd, 179 MiB/s wr, 395 op/s 2024-05-08T05:32:12.737 INFO:tasks.workunit.client.0.smithi087.stdout:9/808: creat d1/df/d14/d18/db5/df0/ffe x:0 0 0 2024-05-08T05:32:12.737 INFO:tasks.workunit.client.0.smithi087.stdout:9/809: fdatasync d1/df/d14/d54/d61/d72/fc4 0 2024-05-08T05:32:12.737 INFO:tasks.workunit.client.0.smithi087.stdout:8/848: mknod db/d23/d1b/c11e 0 2024-05-08T05:32:12.737 INFO:tasks.workunit.client.0.smithi087.stdout:3/812: creat d4/d11/d24/d25/d3e/d58/d112/f122 x:0 0 0 2024-05-08T05:32:12.738 INFO:tasks.workunit.client.0.smithi087.stdout:3/813: symlink d4/d11/d24/d25/d4d/dbb/de9/l123 0 2024-05-08T05:32:12.738 INFO:tasks.workunit.client.0.smithi087.stdout:3/814: chown d4/d11/d24/d25/d3e/d58/d9b/l11b 3 1 2024-05-08T05:32:12.738 INFO:tasks.workunit.client.0.smithi087.stdout:3/815: chown d4/d11/d24 1 1 2024-05-08T05:32:12.740 INFO:tasks.workunit.client.0.smithi087.stdout:3/816: rename d4/d11/d3d/cbc to d4/d11/d24/d39/d94/c124 0 2024-05-08T05:32:12.744 INFO:tasks.workunit.client.0.smithi087.stdout:9/810: creat d1/df/d14/d54/d61/d88/dca/fff x:0 0 0 2024-05-08T05:32:12.744 INFO:tasks.workunit.client.0.smithi087.stdout:3/817: mknod d4/d14/dfc/c125 0 2024-05-08T05:32:12.745 INFO:tasks.workunit.client.0.smithi087.stdout:5/894: dwrite da/db/d2a/d5a/d93/d36/dc1/f26 [0,4194304] 0 2024-05-08T05:32:12.745 INFO:tasks.workunit.client.0.smithi087.stdout:5/895: chown da/db/d2a/f77 34 1 2024-05-08T05:32:12.748 INFO:tasks.workunit.client.0.smithi087.stdout:5/896: mknod da/db/d2a/d46/dc6/c12c 0 2024-05-08T05:32:12.749 INFO:tasks.workunit.client.0.smithi087.stdout:9/811: dread d1/df/d14/d68/d80/d98/d83/fb2 [0,4194304] 0 2024-05-08T05:32:12.750 INFO:tasks.workunit.client.0.smithi087.stdout:5/897: symlink da/db/d2a/l12d 0 2024-05-08T05:32:12.750 INFO:tasks.workunit.client.0.smithi087.stdout:5/898: dread - da/db/d2a/d46/d69/fa7 zero size 2024-05-08T05:32:12.751 INFO:tasks.workunit.client.0.smithi087.stdout:9/812: mkdir d1/df/d37/d100 0 2024-05-08T05:32:12.756 INFO:tasks.workunit.client.0.smithi087.stdout:5/899: mkdir da/db/d2a/d5a/d93/d36/dc1/de7/d12e 0 2024-05-08T05:32:12.757 INFO:tasks.workunit.client.0.smithi087.stdout:5/900: symlink da/db/d2a/d5a/d93/d42/de8/d121/l12f 0 2024-05-08T05:32:12.759 INFO:tasks.workunit.client.0.smithi087.stdout:5/901: truncate da/dd/d65/fcc 4223773 0 2024-05-08T05:32:12.761 INFO:tasks.workunit.client.0.smithi087.stdout:5/902: rename da/db/d2a/d5a/d93/d42/d43/d83/ddc/ld4 to da/db/d2a/d5a/d93/d42/d43/d83/ddc/dd5/l130 0 2024-05-08T05:32:12.762 INFO:tasks.workunit.client.0.smithi087.stdout:8/849: dread db/d23/d15/f1e [0,4194304] 0 2024-05-08T05:32:12.763 INFO:tasks.workunit.client.0.smithi087.stdout:1/706: dwrite df/d18/d1d/fb0 [0,4194304] 0 2024-05-08T05:32:12.764 INFO:tasks.workunit.client.0.smithi087.stdout:5/903: mkdir da/dd/d131 0 2024-05-08T05:32:12.765 INFO:tasks.workunit.client.0.smithi087.stdout:8/850: creat db/d23/d1b/d35/d43/f11f x:0 0 0 2024-05-08T05:32:12.766 INFO:tasks.workunit.client.0.smithi087.stdout:7/963: dwrite d2/d6/d12/d15/d5b/f63 [0,4194304] 0 2024-05-08T05:32:12.767 INFO:tasks.workunit.client.0.smithi087.stdout:8/851: truncate db/d23/d15/d29/fd9 319999 0 2024-05-08T05:32:12.767 INFO:tasks.workunit.client.0.smithi087.stdout:8/852: chown db/d23/d15/f19 522 1 2024-05-08T05:32:12.767 INFO:tasks.workunit.client.0.smithi087.stdout:8/853: chown db/cf 17830652 1 2024-05-08T05:32:12.769 INFO:tasks.workunit.client.0.smithi087.stdout:8/854: symlink db/d23/d15/d10b/l120 0 2024-05-08T05:32:12.769 INFO:tasks.workunit.client.0.smithi087.stdout:8/855: chown db/d23/d3a/dcb 17 1 2024-05-08T05:32:12.770 INFO:tasks.workunit.client.0.smithi087.stdout:8/856: mkdir db/d23/d121 0 2024-05-08T05:32:12.773 INFO:tasks.workunit.client.0.smithi087.stdout:9/813: dread d1/df/d14/f17 [0,4194304] 0 2024-05-08T05:32:12.773 INFO:tasks.workunit.client.0.smithi087.stdout:9/814: write d1/df/d14/d68/d80/d98/d28/f2e [1311131,86137] 0 2024-05-08T05:32:12.782 INFO:tasks.workunit.client.0.smithi087.stdout:4/795: dwrite d4/d13/d3e/f38 [0,4194304] 0 2024-05-08T05:32:12.784 INFO:tasks.workunit.client.0.smithi087.stdout:5/904: read da/db/d2a/d5a/d93/d17/f28 [7698721,23652] 0 2024-05-08T05:32:12.786 INFO:tasks.workunit.client.0.smithi087.stdout:8/857: dread db/d23/d15/d10b/d100/f10f [0,4194304] 0 2024-05-08T05:32:12.786 INFO:tasks.workunit.client.0.smithi087.stdout:1/707: write df/d2f/d57/da0/fc4 [2937107,118842] 0 2024-05-08T05:32:12.788 INFO:tasks.workunit.client.0.smithi087.stdout:6/838: dwrite d4/d8/df/d39/d42/d9e/da4/ff7 [0,4194304] 0 2024-05-08T05:32:12.788 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:32:12 smithi160 ceph-mon[34827]: pgmap v516: 97 pgs: 97 active+clean; 1.1 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 144 MiB/s rd, 179 MiB/s wr, 395 op/s 2024-05-08T05:32:12.806 INFO:tasks.workunit.client.0.smithi087.stdout:1/708: mknod df/d18/d1d/d27/d90/cf7 0 2024-05-08T05:32:12.810 INFO:tasks.workunit.client.0.smithi087.stdout:8/858: dread db/d23/d54/ff5 [0,4194304] 0 2024-05-08T05:32:12.810 INFO:tasks.workunit.client.0.smithi087.stdout:8/859: stat db/d23/d1b/d35/d43/f117 0 2024-05-08T05:32:12.815 INFO:tasks.workunit.client.0.smithi087.stdout:6/839: truncate d4/d8/df/d39/d42/f6e 597223 0 2024-05-08T05:32:12.818 INFO:tasks.workunit.client.0.smithi087.stdout:1/709: unlink df/c19 0 2024-05-08T05:32:12.823 INFO:tasks.workunit.client.0.smithi087.stdout:2/774: dwrite d7/d93/f94 [0,4194304] 0 2024-05-08T05:32:12.823 INFO:tasks.workunit.client.0.smithi087.stdout:6/840: mkdir d4/d8/df/d39/d42/d9e/d6f/d7f/de7/d2d/d37/d45/d101 0 2024-05-08T05:32:12.823 INFO:tasks.workunit.client.0.smithi087.stdout:6/841: write d4/d8/df/d39/d42/f98 [4857686,67797] 0 2024-05-08T05:32:12.826 INFO:tasks.workunit.client.0.smithi087.stdout:1/710: getdents df/d18/d1d/d58/d72 0 2024-05-08T05:32:12.829 INFO:tasks.workunit.client.0.smithi087.stdout:6/842: dread d4/d8/df/d39/d42/d9e/d6f/f85 [0,4194304] 0 2024-05-08T05:32:12.829 INFO:tasks.workunit.client.0.smithi087.stdout:6/843: truncate d4/f5e 1168535 0 2024-05-08T05:32:12.834 INFO:tasks.workunit.client.0.smithi087.stdout:9/815: dwrite d1/df/d14/d18/f77 [0,4194304] 0 2024-05-08T05:32:12.844 INFO:tasks.workunit.client.0.smithi087.stdout:7/964: dwrite d2/d6/d12/dc5/f11f [0,4194304] 0 2024-05-08T05:32:12.844 INFO:tasks.workunit.client.0.smithi087.stdout:1/711: dread df/d18/d1d/d27/d61/fe8 [0,4194304] 0 2024-05-08T05:32:12.844 INFO:tasks.workunit.client.0.smithi087.stdout:1/712: chown df/c91 1076 1 2024-05-08T05:32:12.845 INFO:tasks.workunit.client.0.smithi087.stdout:5/905: dwrite da/db/d2a/d5a/d93/d17/f28 [4194304,4194304] 0 2024-05-08T05:32:12.847 INFO:tasks.workunit.client.0.smithi087.stdout:2/775: link d7/de/d5d/d90/dc6/cd4 d7/de/d27/d33/d49/c102 0 2024-05-08T05:32:12.847 INFO:tasks.workunit.client.0.smithi087.stdout:9/816: rename d1/df/d14/d54/d61/d72/ce9 to d1/df/d14/d18/d66/c101 0 2024-05-08T05:32:12.856 INFO:tasks.workunit.client.0.smithi087.stdout:1/713: getdents df/d2f/d57/dcb/de1 0 2024-05-08T05:32:12.859 INFO:tasks.workunit.client.0.smithi087.stdout:2/776: mknod d7/de/d82/c103 0 2024-05-08T05:32:12.860 INFO:tasks.workunit.client.0.smithi087.stdout:2/777: fsync d7/de/d27/fbb 0 2024-05-08T05:32:12.862 INFO:tasks.workunit.client.0.smithi087.stdout:1/714: rename df/d18/d1d/f99 to df/d18/d1d/d32/d9c/ff8 0 2024-05-08T05:32:12.863 INFO:tasks.workunit.client.0.smithi087.stdout:5/906: read da/db/d2a/d5a/d93/d36/fef [1843345,5196] 0 2024-05-08T05:32:12.864 INFO:tasks.workunit.client.0.smithi087.stdout:2/778: mkdir d7/de/d2c/db6/dcb/db7/dc1/d104 0 2024-05-08T05:32:12.866 INFO:tasks.workunit.client.0.smithi087.stdout:1/715: creat df/d2f/d57/d64/d83/d96/dcf/ff9 x:0 0 0 2024-05-08T05:32:12.868 INFO:tasks.workunit.client.0.smithi087.stdout:5/907: getdents da/dd/d13 0 2024-05-08T05:32:12.868 INFO:tasks.workunit.client.0.smithi087.stdout:5/908: truncate da/dd/d65/f91 678240 0 2024-05-08T05:32:12.869 INFO:tasks.workunit.client.0.smithi087.stdout:2/779: truncate d7/de/d27/f2e 3738908 0 2024-05-08T05:32:12.872 INFO:tasks.workunit.client.0.smithi087.stdout:1/716: creat df/d18/d1d/ffa x:0 0 0 2024-05-08T05:32:12.873 INFO:tasks.workunit.client.0.smithi087.stdout:5/909: rmdir da/db/d2a/d46/d9a 39 2024-05-08T05:32:12.876 INFO:tasks.workunit.client.0.smithi087.stdout:2/780: rmdir d7/de/d2c/db0/df8 0 2024-05-08T05:32:12.879 INFO:tasks.workunit.client.0.smithi087.stdout:5/910: creat da/dd/d94/f132 x:0 0 0 2024-05-08T05:32:12.879 INFO:tasks.workunit.client.0.smithi087.stdout:5/911: chown da/db/dd3/dd9/f10a 1 1 2024-05-08T05:32:12.880 INFO:tasks.workunit.client.0.smithi087.stdout:5/912: chown da/dd/d65/fcc 522466870 1 2024-05-08T05:32:12.880 INFO:tasks.workunit.client.0.smithi087.stdout:5/913: truncate da/dd/d94/f132 532565 0 2024-05-08T05:32:12.880 INFO:tasks.workunit.client.0.smithi087.stdout:5/914: read - da/db/d2a/d5a/f117 zero size 2024-05-08T05:32:12.881 INFO:tasks.workunit.client.0.smithi087.stdout:2/781: symlink d7/de/d55/de4/l105 0 2024-05-08T05:32:12.881 INFO:tasks.workunit.client.0.smithi087.stdout:5/915: mknod da/db/d2a/d46/dc6/c133 0 2024-05-08T05:32:12.890 INFO:tasks.workunit.client.0.smithi087.stdout:1/717: dread df/d18/d1d/d58/d72/f75 [0,4194304] 0 2024-05-08T05:32:12.916 INFO:tasks.workunit.client.0.smithi087.stdout:7/965: dwrite d2/d6/d12/ff8 [0,4194304] 0 2024-05-08T05:32:12.921 INFO:tasks.workunit.client.0.smithi087.stdout:8/860: link db/d23/d15/d29/l49 db/d23/d1b/d35/d43/d68/l122 0 2024-05-08T05:32:12.928 INFO:tasks.workunit.client.0.smithi087.stdout:8/861: unlink db/d23/d15/d29/fba 0 2024-05-08T05:32:12.931 INFO:tasks.workunit.client.0.smithi087.stdout:8/862: creat db/d23/d15/d29/d33/dd2/f123 x:0 0 0 2024-05-08T05:32:12.939 INFO:tasks.workunit.client.0.smithi087.stdout:4/796: sync 2024-05-08T05:32:12.939 INFO:tasks.workunit.client.0.smithi087.stdout:0/749: sync 2024-05-08T05:32:12.939 INFO:tasks.workunit.client.0.smithi087.stdout:0/750: stat d0/d9/d1b/d5e/le3 0 2024-05-08T05:32:12.941 INFO:tasks.workunit.client.0.smithi087.stdout:4/797: symlink d4/d13/d3e/d28/d50/d9d/df2/d106/d91/db8/dba/dbd/d111/l127 0 2024-05-08T05:32:12.944 INFO:tasks.workunit.client.0.smithi087.stdout:3/818: sync 2024-05-08T05:32:12.944 INFO:tasks.workunit.client.0.smithi087.stdout:0/751: creat d0/d57/d24/d66/f101 x:0 0 0 2024-05-08T05:32:12.949 INFO:tasks.workunit.client.0.smithi087.stdout:4/798: mknod d4/d13/d32/c128 0 2024-05-08T05:32:12.951 INFO:tasks.workunit.client.0.smithi087.stdout:4/799: truncate d4/d13/d3e/d28/d50/d9d/df2/d106/d91/ff4 1912098 0 2024-05-08T05:32:12.952 INFO:tasks.workunit.client.0.smithi087.stdout:0/752: dread d0/d57/f77 [0,4194304] 0 2024-05-08T05:32:12.953 INFO:tasks.workunit.client.0.smithi087.stdout:4/800: creat d4/d13/d32/ddb/f129 x:0 0 0 2024-05-08T05:32:12.954 INFO:tasks.workunit.client.0.smithi087.stdout:0/753: creat d0/da/d35/d86/d74/f102 x:0 0 0 2024-05-08T05:32:12.955 INFO:tasks.workunit.client.0.smithi087.stdout:0/754: mknod d0/d9/d1b/d2f/d54/da1/d94/df1/c103 0 2024-05-08T05:32:12.955 INFO:tasks.workunit.client.0.smithi087.stdout:0/755: truncate d0/da/f5f 258763 0 2024-05-08T05:32:12.956 INFO:tasks.workunit.client.0.smithi087.stdout:0/756: mknod d0/dd0/c104 0 2024-05-08T05:32:12.958 INFO:tasks.workunit.client.0.smithi087.stdout:0/757: creat d0/da/d35/daa/dc5/f105 x:0 0 0 2024-05-08T05:32:12.958 INFO:tasks.workunit.client.0.smithi087.stdout:0/758: chown d0/da/d11/c28 90138373 1 2024-05-08T05:32:12.959 INFO:tasks.workunit.client.0.smithi087.stdout:0/759: creat d0/da/f106 x:0 0 0 2024-05-08T05:32:12.960 INFO:tasks.workunit.client.0.smithi087.stdout:0/760: creat d0/da/d35/d86/f107 x:0 0 0 2024-05-08T05:32:12.963 INFO:tasks.workunit.client.0.smithi087.stdout:0/761: mkdir d0/da/d35/d86/d6d/ded/d108 0 2024-05-08T05:32:12.969 INFO:tasks.workunit.client.0.smithi087.stdout:0/762: mknod d0/d9/d1b/d2f/d54/da1/c109 0 2024-05-08T05:32:12.969 INFO:tasks.workunit.client.0.smithi087.stdout:0/763: stat d0/d22/d3c/cab 0 2024-05-08T05:32:12.969 INFO:tasks.workunit.client.0.smithi087.stdout:0/764: readlink d0/d9/l92 0 2024-05-08T05:32:12.977 INFO:tasks.workunit.client.0.smithi087.stdout:2/782: dwrite d7/de/f64 [0,4194304] 0 2024-05-08T05:32:12.977 INFO:tasks.workunit.client.0.smithi087.stdout:2/783: chown d7/l85 249 1 2024-05-08T05:32:12.977 INFO:tasks.workunit.client.0.smithi087.stdout:2/784: write d7/de/fe6 [410460,34002] 0 2024-05-08T05:32:12.977 INFO:tasks.workunit.client.0.smithi087.stdout:2/785: write d7/d63/dac/fda [4041902,84779] 0 2024-05-08T05:32:12.977 INFO:tasks.workunit.client.0.smithi087.stdout:5/916: dwrite da/fe1 [0,4194304] 0 2024-05-08T05:32:12.980 INFO:tasks.workunit.client.0.smithi087.stdout:2/786: creat d7/de/d5d/d7b/f106 x:0 0 0 2024-05-08T05:32:12.980 INFO:tasks.workunit.client.0.smithi087.stdout:2/787: stat d7/d93/fa7 0 2024-05-08T05:32:13.004 INFO:tasks.workunit.client.0.smithi087.stdout:7/966: dread d2/d6/d12/d19/f1e [0,4194304] 0 2024-05-08T05:32:13.004 INFO:tasks.workunit.client.0.smithi087.stdout:1/718: dwrite df/d2f/d57/d64/fa9 [4194304,4194304] 0 2024-05-08T05:32:13.012 INFO:tasks.workunit.client.0.smithi087.stdout:2/788: dread d7/d93/fa7 [0,4194304] 0 2024-05-08T05:32:13.015 INFO:tasks.workunit.client.0.smithi087.stdout:4/801: dwrite d4/d13/d32/ddb/fa0 [0,4194304] 0 2024-05-08T05:32:13.021 INFO:tasks.workunit.client.0.smithi087.stdout:0/765: dwrite d0/d9/d1b/d2f/d54/da1/fbf [0,4194304] 0 2024-05-08T05:32:13.021 INFO:tasks.workunit.client.0.smithi087.stdout:0/766: write d0/d9/d1b/d2f/d54/da1/f96 [484505,78864] 0 2024-05-08T05:32:13.028 INFO:tasks.workunit.client.0.smithi087.stdout:7/967: fdatasync d2/d6/da0/d10f/fcc 0 2024-05-08T05:32:13.028 INFO:tasks.workunit.client.0.smithi087.stdout:4/802: dread d4/d13/d3e/d28/d35/f3a [0,4194304] 0 2024-05-08T05:32:13.028 INFO:tasks.workunit.client.0.smithi087.stdout:1/719: mknod df/d18/d8b/cfb 0 2024-05-08T05:32:13.028 INFO:tasks.workunit.client.0.smithi087.stdout:1/720: write df/d18/d1d/f9e [745718,91782] 0 2024-05-08T05:32:13.028 INFO:tasks.workunit.client.0.smithi087.stdout:4/803: write d4/d13/d3e/d28/d50/d9d/df2/d106/d91/db8/ff7 [295384,130843] 0 2024-05-08T05:32:13.028 INFO:tasks.workunit.client.0.smithi087.stdout:1/721: write df/d18/d1d/d32/d9c/fcc [4874754,108065] 0 2024-05-08T05:32:13.029 INFO:tasks.workunit.client.0.smithi087.stdout:2/789: truncate d7/de/d27/d33/d49/fbd 1438019 0 2024-05-08T05:32:13.029 INFO:tasks.workunit.client.0.smithi087.stdout:2/790: chown d7/de/d27/d33/d49/f8b 784 1 2024-05-08T05:32:13.047 INFO:tasks.workunit.client.0.smithi087.stdout:4/804: dread d4/d13/d32/f45 [0,4194304] 0 2024-05-08T05:32:13.048 INFO:tasks.workunit.client.0.smithi087.stdout:2/791: dread d7/de/d27/d33/d49/f8b [0,4194304] 0 2024-05-08T05:32:13.051 INFO:tasks.workunit.client.0.smithi087.stdout:7/968: mkdir d2/d6/da0/d10f/d3f/d72/d77/dc2/d140 0 2024-05-08T05:32:13.051 INFO:tasks.workunit.client.0.smithi087.stdout:7/969: readlink d2/d6/da0/d10f/d3f/d72/d77/d54/d55/d65/l9b 0 2024-05-08T05:32:13.054 INFO:tasks.workunit.client.0.smithi087.stdout:7/970: mknod d2/d6/d12/d19/d2a/d91/df0/c141 0 2024-05-08T05:32:13.066 INFO:tasks.workunit.client.0.smithi087.stdout:5/917: write da/db/d2a/d5a/d93/d42/d43/f81 [4390952,41383] 0 2024-05-08T05:32:13.074 INFO:tasks.workunit.client.0.smithi087.stdout:0/767: creat d0/d22/f10a x:0 0 0 2024-05-08T05:32:13.077 INFO:tasks.workunit.client.0.smithi087.stdout:1/722: rename df/d2f/d57/da0/ce0 to df/d18/dbe/cfc 0 2024-05-08T05:32:13.078 INFO:tasks.workunit.client.0.smithi087.stdout:5/918: creat da/dd/d65/f134 x:0 0 0 2024-05-08T05:32:13.078 INFO:tasks.workunit.client.0.smithi087.stdout:5/919: dread - da/db/d2a/d5a/ffa zero size 2024-05-08T05:32:13.079 INFO:tasks.workunit.client.0.smithi087.stdout:4/805: dwrite d4/d13/d3e/d28/d50/d9d/df2/d106/ff5 [0,4194304] 0 2024-05-08T05:32:13.079 INFO:tasks.workunit.client.0.smithi087.stdout:4/806: readlink d4/d13/d3e/d28/l73 0 2024-05-08T05:32:13.082 INFO:tasks.workunit.client.0.smithi087.stdout:5/920: mkdir da/db/d2a/d5a/d93/d36/dc1/d135 0 2024-05-08T05:32:13.082 INFO:tasks.workunit.client.0.smithi087.stdout:0/768: mknod d0/d9e/c10b 0 2024-05-08T05:32:13.085 INFO:tasks.workunit.client.0.smithi087.stdout:4/807: mkdir d4/d13/d3e/d28/d35/d12a 0 2024-05-08T05:32:13.085 INFO:tasks.workunit.client.0.smithi087.stdout:7/971: rename d2/d6/d12/d1d to d2/d6/da0/d10f/d3f/d72/d77/d54/d55/dfc/d12a/d142 0 2024-05-08T05:32:13.085 INFO:tasks.workunit.client.0.smithi087.stdout:9/817: sync 2024-05-08T05:32:13.086 INFO:tasks.workunit.client.0.smithi087.stdout:6/844: sync 2024-05-08T05:32:13.086 INFO:tasks.workunit.client.0.smithi087.stdout:8/863: sync 2024-05-08T05:32:13.086 INFO:tasks.workunit.client.0.smithi087.stdout:7/972: rmdir d2/d6/d12/d15/d5b/dee 39 2024-05-08T05:32:13.086 INFO:tasks.workunit.client.0.smithi087.stdout:4/808: creat d4/d13/d3e/d28/d35/d12a/f12b x:0 0 0 2024-05-08T05:32:13.088 INFO:tasks.workunit.client.0.smithi087.stdout:2/792: dwrite d7/d63/f60 [0,4194304] 0 2024-05-08T05:32:13.088 INFO:tasks.workunit.client.0.smithi087.stdout:7/973: mkdir d2/d6/d12/d15/d5b/d143 0 2024-05-08T05:32:13.088 INFO:tasks.workunit.client.0.smithi087.stdout:3/819: sync 2024-05-08T05:32:13.091 INFO:tasks.workunit.client.0.smithi087.stdout:9/818: mkdir d1/df/d37/d74/d102 0 2024-05-08T05:32:13.097 INFO:tasks.workunit.client.0.smithi087.stdout:0/769: write d0/da/d35/d86/d74/f53 [1119074,35649] 0 2024-05-08T05:32:13.098 INFO:tasks.workunit.client.0.smithi087.stdout:0/770: getdents d0/da/d35/d86/dfd 0 2024-05-08T05:32:13.098 INFO:tasks.workunit.client.0.smithi087.stdout:4/809: mknod d4/d13/d3e/d28/d50/d9d/df2/d106/d91/db8/dba/dbd/c12c 0 2024-05-08T05:32:13.098 INFO:tasks.workunit.client.0.smithi087.stdout:4/810: chown d4/d13/d3e/d28/d50/d9d/df2/d106/d91/db8/ff7 5123 1 2024-05-08T05:32:13.108 INFO:tasks.workunit.client.0.smithi087.stdout:2/793: creat d7/d63/f107 x:0 0 0 2024-05-08T05:32:13.108 INFO:tasks.workunit.client.0.smithi087.stdout:2/794: readlink d7/de/d2c/l88 0 2024-05-08T05:32:13.109 INFO:tasks.workunit.client.0.smithi087.stdout:2/795: chown d7/de/d2c/d43/db4/fc3 1916159 1 2024-05-08T05:32:13.109 INFO:tasks.workunit.client.0.smithi087.stdout:3/820: creat d4/f126 x:0 0 0 2024-05-08T05:32:13.110 INFO:tasks.workunit.client.0.smithi087.stdout:9/819: symlink d1/df/d37/d100/l103 0 2024-05-08T05:32:13.112 INFO:tasks.workunit.client.0.smithi087.stdout:0/771: symlink d0/da/d35/d86/d6d/ded/l10c 0 2024-05-08T05:32:13.112 INFO:tasks.workunit.client.0.smithi087.stdout:0/772: fdatasync d0/d57/d24/d66/f101 0 2024-05-08T05:32:13.112 INFO:tasks.workunit.client.0.smithi087.stdout:0/773: readlink d0/d9/l59 0 2024-05-08T05:32:13.113 INFO:tasks.workunit.client.0.smithi087.stdout:4/811: rename d4/d13/d3e/d28/l73 to d4/d13/d3e/d28/d50/d9d/df2/d106/d91/d84/d10c/l12d 0 2024-05-08T05:32:13.114 INFO:tasks.workunit.client.0.smithi087.stdout:2/796: truncate d7/d63/dac/fda 3955115 0 2024-05-08T05:32:13.115 INFO:tasks.workunit.client.0.smithi087.stdout:1/723: dwrite df/d2f/d57/d64/fac [0,4194304] 0 2024-05-08T05:32:13.116 INFO:tasks.workunit.client.0.smithi087.stdout:9/820: rename d1/df/d14/d18/d66/d7f/lf1 to d1/d70/l104 0 2024-05-08T05:32:13.118 INFO:tasks.workunit.client.0.smithi087.stdout:5/921: rmdir da/dd/d13/da2 39 2024-05-08T05:32:13.118 INFO:tasks.workunit.client.0.smithi087.stdout:4/812: creat d4/d13/d3e/d28/d50/d9d/df2/f12e x:0 0 0 2024-05-08T05:32:13.121 INFO:tasks.workunit.client.0.smithi087.stdout:2/797: unlink d7/de/d27/f4f 0 2024-05-08T05:32:13.126 INFO:tasks.workunit.client.0.smithi087.stdout:5/922: write da/db/d2a/d5a/d93/d36/d45/d5c/fd2 [258798,86950] 0 2024-05-08T05:32:13.126 INFO:tasks.workunit.client.0.smithi087.stdout:5/923: write da/db/d2a/d5a/d93/d36/d45/d5c/dff/f111 [4326327,24023] 0 2024-05-08T05:32:13.130 INFO:tasks.workunit.client.0.smithi087.stdout:5/924: rmdir da/db/d2a/d5a/d93/d36/dc1/de7 39 2024-05-08T05:32:13.130 INFO:tasks.workunit.client.0.smithi087.stdout:5/925: chown da/db/d2a/d5a/ca9 100 1 2024-05-08T05:32:13.131 INFO:tasks.workunit.client.0.smithi087.stdout:3/821: dread d4/d11/d24/f69 [4194304,4194304] 0 2024-05-08T05:32:13.134 INFO:tasks.workunit.client.0.smithi087.stdout:5/926: mkdir da/dd/d13/da2/dce/d136 0 2024-05-08T05:32:13.139 INFO:tasks.workunit.client.0.smithi087.stdout:5/927: getdents da/db/d2a/d5a/d93/d36/d45/d5c/d86 0 2024-05-08T05:32:13.141 INFO:tasks.workunit.client.0.smithi087.stdout:5/928: link da/d10e/c11a da/db/d120/c137 0 2024-05-08T05:32:13.143 INFO:tasks.workunit.client.0.smithi087.stdout:3/822: dread d4/d11/d24/d25/d3e/d58/f7a [0,4194304] 0 2024-05-08T05:32:13.144 INFO:tasks.workunit.client.0.smithi087.stdout:0/774: rename d0/da/d35/d86/d74/fd8 to d0/da/d35/d86/d9a/f10d 0 2024-05-08T05:32:13.144 INFO:tasks.workunit.client.0.smithi087.stdout:6/845: creat d4/d8/df/d39/d42/d9e/d6f/d7f/de7/d2d/d37/d45/d101/f102 x:0 0 0 2024-05-08T05:32:13.144 INFO:tasks.workunit.client.0.smithi087.stdout:6/846: stat d4/d8/df/d39/d42/lb3 0 2024-05-08T05:32:13.147 INFO:tasks.workunit.client.0.smithi087.stdout:9/821: creat d1/df/d37/d100/f105 x:0 0 0 2024-05-08T05:32:13.148 INFO:tasks.workunit.client.0.smithi087.stdout:4/813: mkdir d4/d13/d3e/d28/d12f 0 2024-05-08T05:32:13.151 INFO:tasks.workunit.client.0.smithi087.stdout:2/798: creat d7/de/d2c/db6/f108 x:0 0 0 2024-05-08T05:32:13.160 INFO:tasks.workunit.client.0.smithi087.stdout:5/929: mknod da/db/d2a/d5a/d93/d36/d45/d5c/c138 0 2024-05-08T05:32:13.166 INFO:tasks.workunit.client.0.smithi087.stdout:6/847: dread d4/d8/df/d39/d42/d9e/da4/ff7 [0,4194304] 0 2024-05-08T05:32:13.166 INFO:tasks.workunit.client.0.smithi087.stdout:0/775: write d0/d9/f67 [1671578,13305] 0 2024-05-08T05:32:13.169 INFO:tasks.workunit.client.0.smithi087.stdout:2/799: dread d7/de/d27/d33/d49/f8f [0,4194304] 0 2024-05-08T05:32:13.172 INFO:tasks.workunit.client.0.smithi087.stdout:9/822: mkdir d1/df/d14/d54/d61/d72/d106 0 2024-05-08T05:32:13.177 INFO:tasks.workunit.client.0.smithi087.stdout:5/930: symlink da/dd/d13/ddf/l139 0 2024-05-08T05:32:13.178 INFO:tasks.workunit.client.0.smithi087.stdout:4/814: link d4/d13/d3e/d28/d35/c116 d4/d13/d3e/d28/d50/d9d/df2/d106/d91/db8/dba/dbd/d111/c130 0 2024-05-08T05:32:13.178 INFO:tasks.workunit.client.0.smithi087.stdout:0/776: creat d0/da/d35/d86/d6d/ded/f10e x:0 0 0 2024-05-08T05:32:13.178 INFO:tasks.workunit.client.0.smithi087.stdout:0/777: chown d0/da/d35/d86/d6d/ded 15179345 1 2024-05-08T05:32:13.178 INFO:tasks.workunit.client.0.smithi087.stdout:0/778: read - d0/da/d35/d86/d6d/ded/f10e zero size 2024-05-08T05:32:13.178 INFO:tasks.workunit.client.0.smithi087.stdout:2/800: creat d7/de/d27/dd6/dfb/f109 x:0 0 0 2024-05-08T05:32:13.178 INFO:tasks.workunit.client.0.smithi087.stdout:2/801: chown d7/d93 238426 1 2024-05-08T05:32:13.178 INFO:tasks.workunit.client.0.smithi087.stdout:9/823: mkdir d1/d70/d107 0 2024-05-08T05:32:13.179 INFO:tasks.workunit.client.0.smithi087.stdout:7/974: unlink d2/d6/fd3 0 2024-05-08T05:32:13.180 INFO:tasks.workunit.client.0.smithi087.stdout:9/824: link d1/df/d14/d68/d80/d98/d83/cbf d1/df/d14/d68/d80/c108 0 2024-05-08T05:32:13.180 INFO:tasks.workunit.client.0.smithi087.stdout:9/825: write d1/df/d58/d5e/f65 [644240,119939] 0 2024-05-08T05:32:13.181 INFO:tasks.workunit.client.0.smithi087.stdout:8/864: mknod db/d23/d121/c124 0 2024-05-08T05:32:13.181 INFO:tasks.workunit.client.0.smithi087.stdout:1/724: dwrite df/d2f/d4f/f5a [0,4194304] 0 2024-05-08T05:32:13.183 INFO:tasks.workunit.client.0.smithi087.stdout:5/931: rename da/db/d2a/d5a/d93/d17/f3a to da/db/d2a/d5a/dc3/f13a 0 2024-05-08T05:32:13.186 INFO:tasks.workunit.client.0.smithi087.stdout:5/932: mknod da/db/d2a/d5a/dc3/c13b 0 2024-05-08T05:32:13.187 INFO:tasks.workunit.client.0.smithi087.stdout:2/802: rename d7/de/d27/lf7 to d7/de/l10a 0 2024-05-08T05:32:13.188 INFO:tasks.workunit.client.0.smithi087.stdout:5/933: symlink da/db/d2a/d5a/d93/d42/d50/dd0/d11e/l13c 0 2024-05-08T05:32:13.188 INFO:tasks.workunit.client.0.smithi087.stdout:5/934: fsync da/db/d2a/d5a/d93/d42/d50/f52 0 2024-05-08T05:32:13.191 INFO:tasks.workunit.client.0.smithi087.stdout:6/848: link d4/d8/df/d39/d42/d9e/d6f/d7f/de7/d2d/d37/d45/l7b d4/d8/df/d39/d42/d9e/d6f/d7f/de7/d57/l103 0 2024-05-08T05:32:13.192 INFO:tasks.workunit.client.0.smithi087.stdout:5/935: symlink da/db/d2a/d46/dbb/l13d 0 2024-05-08T05:32:13.198 INFO:tasks.workunit.client.0.smithi087.stdout:0/779: write d0/d9/d1b/d5e/f72 [2679536,73447] 0 2024-05-08T05:32:13.198 INFO:tasks.workunit.client.0.smithi087.stdout:2/803: creat d7/de/d78/f10b x:0 0 0 2024-05-08T05:32:13.204 INFO:tasks.workunit.client.0.smithi087.stdout:6/849: dread d4/d8/df/d39/d42/fab [0,4194304] 0 2024-05-08T05:32:13.205 INFO:tasks.workunit.client.0.smithi087.stdout:9/826: dread d1/df/d58/fe4 [0,4194304] 0 2024-05-08T05:32:13.205 INFO:tasks.workunit.client.0.smithi087.stdout:9/827: chown d1/df/d14/d68/d80/d98/d28/d4b 59 1 2024-05-08T05:32:13.206 INFO:tasks.workunit.client.0.smithi087.stdout:7/975: dread d2/d6/da0/d10f/f86 [0,4194304] 0 2024-05-08T05:32:13.206 INFO:tasks.workunit.client.0.smithi087.stdout:7/976: write d2/d6/da0/d10f/d3f/d72/d77/d54/d55/dfc/d12a/d142/fa4 [4865592,46033] 0 2024-05-08T05:32:13.206 INFO:tasks.workunit.client.0.smithi087.stdout:0/780: mkdir d0/da/d11/d10f 0 2024-05-08T05:32:13.206 INFO:tasks.workunit.client.0.smithi087.stdout:2/804: mkdir d7/d63/d10c 0 2024-05-08T05:32:13.208 INFO:tasks.workunit.client.0.smithi087.stdout:9/828: rename d1/df/d37/d74/d102 to d1/df/d14/d18/d8e/d109 0 2024-05-08T05:32:13.209 INFO:tasks.workunit.client.0.smithi087.stdout:8/865: rmdir db/d23/d15/d29/d4d/d96 39 2024-05-08T05:32:13.209 INFO:tasks.workunit.client.0.smithi087.stdout:8/866: readlink db/d23/d15/d29/l49 0 2024-05-08T05:32:13.209 INFO:tasks.workunit.client.0.smithi087.stdout:8/867: chown db/d23/f2d 809703349 1 2024-05-08T05:32:13.212 INFO:tasks.workunit.client.0.smithi087.stdout:5/936: dread da/db/d2a/d5a/d93/d36/f7f [0,4194304] 0 2024-05-08T05:32:13.212 INFO:tasks.workunit.client.0.smithi087.stdout:5/937: stat da/dd/d94/c98 0 2024-05-08T05:32:13.214 INFO:tasks.workunit.client.0.smithi087.stdout:0/781: symlink d0/d9/l110 0 2024-05-08T05:32:13.214 INFO:tasks.workunit.client.0.smithi087.stdout:5/938: truncate da/db/d2a/d5a/f5b 311137 0 2024-05-08T05:32:13.214 INFO:tasks.workunit.client.0.smithi087.stdout:0/782: stat d0/d9/d1b/d5e/cdf 0 2024-05-08T05:32:13.216 INFO:tasks.workunit.client.0.smithi087.stdout:5/939: link da/db/d2a/d5a/d93/d36/dc1/c8b da/dd/d13/da2/dce/d136/c13e 0 2024-05-08T05:32:13.216 INFO:tasks.workunit.client.0.smithi087.stdout:5/940: dread - da/f12a zero size 2024-05-08T05:32:13.218 INFO:tasks.workunit.client.0.smithi087.stdout:6/850: mknod d4/d8/df/d39/d42/d9e/da4/dad/dd2/de2/c104 0 2024-05-08T05:32:13.226 INFO:tasks.workunit.client.0.smithi087.stdout:2/805: dread d7/de/f64 [0,4194304] 0 2024-05-08T05:32:13.227 INFO:tasks.workunit.client.0.smithi087.stdout:2/806: write d7/de/d27/fbb [482128,113318] 0 2024-05-08T05:32:13.227 INFO:tasks.workunit.client.0.smithi087.stdout:2/807: chown d7/de/d27/d33 902 1 2024-05-08T05:32:13.227 INFO:tasks.workunit.client.0.smithi087.stdout:2/808: chown d7/de/d2c/db6/dcb/db7/dc1 25730 1 2024-05-08T05:32:13.229 INFO:tasks.workunit.client.0.smithi087.stdout:4/815: dwrite d4/d13/d3e/d28/d50/d9d/df2/d106/d91/db8/dba/d96/dd5/fd6 [0,4194304] 0 2024-05-08T05:32:13.229 INFO:tasks.workunit.client.0.smithi087.stdout:4/816: fsync d4/d13/d32/fc1 0 2024-05-08T05:32:13.229 INFO:tasks.workunit.client.0.smithi087.stdout:2/809: getdents d7/de/d82/dcc 0 2024-05-08T05:32:13.229 INFO:tasks.workunit.client.0.smithi087.stdout:2/810: stat d7/de/d5d/d7b/c9b 0 2024-05-08T05:32:13.231 INFO:tasks.workunit.client.0.smithi087.stdout:5/941: symlink da/l13f 0 2024-05-08T05:32:13.232 INFO:tasks.workunit.client.0.smithi087.stdout:7/977: dread d2/db0/fbc [0,4194304] 0 2024-05-08T05:32:13.233 INFO:tasks.workunit.client.0.smithi087.stdout:7/978: dread - d2/d6/d12/ff7 zero size 2024-05-08T05:32:13.234 INFO:tasks.workunit.client.0.smithi087.stdout:4/817: mknod d4/d6c/d93/d11b/c131 0 2024-05-08T05:32:13.234 INFO:tasks.workunit.client.0.smithi087.stdout:4/818: read - d4/d13/d32/ddb/f129 zero size 2024-05-08T05:32:13.234 INFO:tasks.workunit.client.0.smithi087.stdout:2/811: creat d7/de/d2c/d43/db4/f10d x:0 0 0 2024-05-08T05:32:13.235 INFO:tasks.workunit.client.0.smithi087.stdout:4/819: creat d4/d13/d3e/d28/f132 x:0 0 0 2024-05-08T05:32:13.236 INFO:tasks.workunit.client.0.smithi087.stdout:5/942: rename da/db/d2a/d5a/d93/d42/c7b to da/db/d2a/d5a/d93/d36/d45/d5c/d86/c140 0 2024-05-08T05:32:13.237 INFO:tasks.workunit.client.0.smithi087.stdout:2/812: unlink d7/de/d5d/d7b/f106 0 2024-05-08T05:32:13.238 INFO:tasks.workunit.client.0.smithi087.stdout:2/813: link d7/de/d5d/f86 d7/d93/f10e 0 2024-05-08T05:32:13.252 INFO:tasks.workunit.client.0.smithi087.stdout:7/979: rename d2/d6/da0/d10f/d3f/d72/d77/d54/d55/d65/fb5 to d2/d6/d12/d19/d2a/d89/da3/f144 0 2024-05-08T05:32:13.258 INFO:tasks.workunit.client.0.smithi087.stdout:9/829: dwrite d1/df/d14/d68/d80/d98/d28/f4f [0,4194304] 0 2024-05-08T05:32:13.258 INFO:tasks.workunit.client.0.smithi087.stdout:9/830: chown d1/df/d14/d54/d61/d88/le0 41 1 2024-05-08T05:32:13.262 INFO:tasks.workunit.client.0.smithi087.stdout:8/868: dwrite db/d23/d1b/d35/d43/d68/f7a [0,4194304] 0 2024-05-08T05:32:13.266 INFO:tasks.workunit.client.0.smithi087.stdout:8/869: creat db/d23/d15/d10b/f125 x:0 0 0 2024-05-08T05:32:13.267 INFO:tasks.workunit.client.0.smithi087.stdout:8/870: write db/d23/d15/d29/d33/d3b/fb9 [4556824,1645] 0 2024-05-08T05:32:13.269 INFO:tasks.workunit.client.0.smithi087.stdout:5/943: rmdir da/db/d2a/d5a/d93/d36/dc1 39 2024-05-08T05:32:13.269 INFO:tasks.workunit.client.0.smithi087.stdout:5/944: truncate da/db/d2a/d5a/d93/d42/d43/d83/d6b/f80 2364632 0 2024-05-08T05:32:13.271 INFO:tasks.workunit.client.0.smithi087.stdout:5/945: write da/db/d2a/d5a/dc3/f10d [605558,130433] 0 2024-05-08T05:32:13.271 INFO:tasks.workunit.client.0.smithi087.stdout:5/946: fdatasync da/db/d2a/d5a/d93/d42/f9d 0 2024-05-08T05:32:13.272 INFO:tasks.workunit.client.0.smithi087.stdout:0/783: dwrite d0/d9/d1b/d2f/d54/da1/f99 [0,4194304] 0 2024-05-08T05:32:13.276 INFO:tasks.workunit.client.0.smithi087.stdout:5/947: symlink da/db/d2a/d46/dc6/l141 0 2024-05-08T05:32:13.277 INFO:tasks.workunit.client.0.smithi087.stdout:3/823: dread d4/d11/d24/d25/d3e/f89 [0,4194304] 0 2024-05-08T05:32:13.287 INFO:tasks.workunit.client.0.smithi087.stdout:7/980: dread d2/d6/da0/d67/d82/d98/fda [0,4194304] 0 2024-05-08T05:32:13.287 INFO:tasks.workunit.client.0.smithi087.stdout:7/981: chown d2/d6/da0/d10f/d3f/f30 2777 1 2024-05-08T05:32:13.287 INFO:tasks.workunit.client.0.smithi087.stdout:7/982: dread - d2/d6/da0/d10f/d3f/d49/fd6 zero size 2024-05-08T05:32:13.287 INFO:tasks.workunit.client.0.smithi087.stdout:7/983: fsync d2/d6/da0/d10f/f85 0 2024-05-08T05:32:13.287 INFO:tasks.workunit.client.0.smithi087.stdout:7/984: stat d2/d6/d12/d19/d2a/c5e 0 2024-05-08T05:32:13.288 INFO:tasks.workunit.client.0.smithi087.stdout:1/725: chown df/d2f 465562814 1 2024-05-08T05:32:13.288 INFO:tasks.workunit.client.0.smithi087.stdout:1/726: chown df/d18/d1d/d27/dd4/ldb 118 1 2024-05-08T05:32:13.288 INFO:tasks.workunit.client.0.smithi087.stdout:2/814: rmdir d7/de/d27/d33/d65 39 2024-05-08T05:32:13.289 INFO:tasks.workunit.client.0.smithi087.stdout:7/985: link d2/d6/d12/dc5/f11f d2/d6/d12/dc5/f145 0 2024-05-08T05:32:13.290 INFO:tasks.workunit.client.0.smithi087.stdout:4/820: rename d4/d13/d32/c128 to d4/d13/d3e/d28/d50/d9d/df2/d106/d91/db8/dba/d115/c133 0 2024-05-08T05:32:13.293 INFO:tasks.workunit.client.0.smithi087.stdout:6/851: dwrite d4/d8/df/d39/d42/f98 [0,4194304] 0 2024-05-08T05:32:13.299 INFO:tasks.workunit.client.0.smithi087.stdout:9/831: rename d1/df/d37/d5b/d7e/c81 to d1/df/d14/d54/d61/c10a 0 2024-05-08T05:32:13.300 INFO:tasks.workunit.client.0.smithi087.stdout:4/821: dread d4/d13/d3e/d28/d50/d9d/df2/d106/d91/db8/dba/d96/fe3 [0,4194304] 0 2024-05-08T05:32:13.307 INFO:tasks.workunit.client.0.smithi087.stdout:2/815: rename d7/de/d55/de4/ced to d7/de/d5d/d90/c10f 0 2024-05-08T05:32:13.307 INFO:tasks.workunit.client.0.smithi087.stdout:2/816: chown d7/de/d5d/d90/dc6/cd4 19780 1 2024-05-08T05:32:13.307 INFO:tasks.workunit.client.0.smithi087.stdout:2/817: fdatasync d7/de/d55/f56 0 2024-05-08T05:32:13.307 INFO:tasks.workunit.client.0.smithi087.stdout:8/871: creat db/d23/d15/d29/d33/d3b/f126 x:0 0 0 2024-05-08T05:32:13.307 INFO:tasks.workunit.client.0.smithi087.stdout:9/832: symlink d1/df/d14/d68/d80/d98/d28/l10b 0 2024-05-08T05:32:13.307 INFO:tasks.workunit.client.0.smithi087.stdout:9/833: stat d1/f30 0 2024-05-08T05:32:13.308 INFO:tasks.workunit.client.0.smithi087.stdout:9/834: creat d1/df/d14/d54/d61/d88/f10c x:0 0 0 2024-05-08T05:32:13.309 INFO:tasks.workunit.client.0.smithi087.stdout:9/835: chown d1/df/d14/db1/fed 64252 1 2024-05-08T05:32:13.311 INFO:tasks.workunit.client.0.smithi087.stdout:7/986: rename d2/d6/da0/d10f/d3f/d72/d77/d54/f3e to d2/d6/d12/d15/f146 0 2024-05-08T05:32:13.313 INFO:tasks.workunit.client.0.smithi087.stdout:3/824: mkdir d4/d11/d24/d25/d3e/d3f/d127 0 2024-05-08T05:32:13.313 INFO:tasks.workunit.client.0.smithi087.stdout:6/852: write d4/d8/df/d1e/d25/f4e [2607390,44793] 0 2024-05-08T05:32:13.313 INFO:tasks.workunit.client.0.smithi087.stdout:1/727: creat df/d18/ffd x:0 0 0 2024-05-08T05:32:13.314 INFO:tasks.workunit.client.0.smithi087.stdout:3/825: creat d4/d11/d24/d25/d4d/dbb/f128 x:0 0 0 2024-05-08T05:32:13.314 INFO:tasks.workunit.client.0.smithi087.stdout:7/987: mknod d2/d6/d12/d19/d2a/d89/d134/c147 0 2024-05-08T05:32:13.315 INFO:tasks.workunit.client.0.smithi087.stdout:6/853: mknod d4/d8/df/d39/d42/d9e/d6f/d7f/de7/d2d/d37/c105 0 2024-05-08T05:32:13.316 INFO:tasks.workunit.client.0.smithi087.stdout:2/818: dread d7/de/d27/d33/d49/f9d [0,4194304] 0 2024-05-08T05:32:13.316 INFO:tasks.workunit.client.0.smithi087.stdout:2/819: fsync d7/de/d5d/f86 0 2024-05-08T05:32:13.317 INFO:tasks.workunit.client.0.smithi087.stdout:8/872: symlink db/d23/d54/l127 0 2024-05-08T05:32:13.317 INFO:tasks.workunit.client.0.smithi087.stdout:8/873: truncate db/d23/d3a/d65/d83/dc5/f115 149303 0 2024-05-08T05:32:13.318 INFO:tasks.workunit.client.0.smithi087.stdout:9/836: dread d1/d70/fa8 [0,4194304] 0 2024-05-08T05:32:13.320 INFO:tasks.workunit.client.0.smithi087.stdout:2/820: write d7/f17 [504969,60586] 0 2024-05-08T05:32:13.320 INFO:tasks.workunit.client.0.smithi087.stdout:2/821: fsync d7/de/d2c/db6/dcb/db7/fdd 0 2024-05-08T05:32:13.320 INFO:tasks.workunit.client.0.smithi087.stdout:2/822: fsync d7/de/d27/d33/f30 0 2024-05-08T05:32:13.320 INFO:tasks.workunit.client.0.smithi087.stdout:9/837: creat d1/df/d14/d54/d61/d72/d106/f10d x:0 0 0 2024-05-08T05:32:13.320 INFO:tasks.workunit.client.0.smithi087.stdout:1/728: rename df/d18/d1d/d27/d61/fd7 to df/d2f/d6a/ffe 0 2024-05-08T05:32:13.320 INFO:tasks.workunit.client.0.smithi087.stdout:3/826: rename d4 to d4/d14/dbe/d129 22 2024-05-08T05:32:13.325 INFO:tasks.workunit.client.0.smithi087.stdout:2/823: creat d7/de/d2c/db6/dcb/db7/f110 x:0 0 0 2024-05-08T05:32:13.325 INFO:tasks.workunit.client.0.smithi087.stdout:2/824: chown d7/de/d82/dcc 60 1 2024-05-08T05:32:13.325 INFO:tasks.workunit.client.0.smithi087.stdout:7/988: fsync d2/d6/d12/dc5/f11f 0 2024-05-08T05:32:13.325 INFO:tasks.workunit.client.0.smithi087.stdout:8/874: rename db/d23/d1b/d35/d43/d68/d6a/fe8 to db/d23/d15/d29/d4d/d96/f128 0 2024-05-08T05:32:13.329 INFO:tasks.workunit.client.0.smithi087.stdout:8/875: mkdir db/d23/d1b/d35/d43/d68/d11c/d129 0 2024-05-08T05:32:13.329 INFO:tasks.workunit.client.0.smithi087.stdout:8/876: readlink db/d23/d1b/d7c/l103 0 2024-05-08T05:32:13.329 INFO:tasks.workunit.client.0.smithi087.stdout:8/877: truncate db/d23/d1b/fad 3569268 0 2024-05-08T05:32:13.329 INFO:tasks.workunit.client.0.smithi087.stdout:9/838: dread d1/d70/fa8 [0,4194304] 0 2024-05-08T05:32:13.330 INFO:tasks.workunit.client.0.smithi087.stdout:8/878: creat db/d23/d15/d29/d33/d6c/d110/dfe/d11a/f12a x:0 0 0 2024-05-08T05:32:13.330 INFO:tasks.workunit.client.0.smithi087.stdout:5/948: dwrite da/dd/d65/f134 [0,4194304] 0 2024-05-08T05:32:13.333 INFO:tasks.workunit.client.0.smithi087.stdout:8/879: mknod db/d23/d15/d29/d33/d3b/c12b 0 2024-05-08T05:32:13.339 INFO:tasks.workunit.client.0.smithi087.stdout:6/854: write d4/d8/df/d39/d42/d9e/d6f/fdf [1723995,122335] 0 2024-05-08T05:32:13.339 INFO:tasks.workunit.client.0.smithi087.stdout:8/880: rename db/d23/d15/d29/lf8 to db/d23/d15/d29/d4d/d96/l12c 0 2024-05-08T05:32:13.350 INFO:tasks.workunit.client.0.smithi087.stdout:7/989: dread d2/f4 [0,4194304] 0 2024-05-08T05:32:13.350 INFO:tasks.workunit.client.0.smithi087.stdout:3/827: dread d4/d11/f38 [0,4194304] 0 2024-05-08T05:32:13.351 INFO:tasks.workunit.client.0.smithi087.stdout:2/825: dread d7/de/d27/f44 [0,4194304] 0 2024-05-08T05:32:13.352 INFO:tasks.workunit.client.0.smithi087.stdout:3/828: mknod d4/d14/dbe/dd0/c12a 0 2024-05-08T05:32:13.353 INFO:tasks.workunit.client.0.smithi087.stdout:2/826: mkdir d7/de/d55/de4/d111 0 2024-05-08T05:32:13.354 INFO:tasks.workunit.client.0.smithi087.stdout:2/827: stat d7/de/d27/l46 0 2024-05-08T05:32:13.355 INFO:tasks.workunit.client.0.smithi087.stdout:8/881: read db/d23/d1b/d4b/f69 [5540474,6559] 0 2024-05-08T05:32:13.355 INFO:tasks.workunit.client.0.smithi087.stdout:2/828: truncate d7/d63/fca 2017618 0 2024-05-08T05:32:13.360 INFO:tasks.workunit.client.0.smithi087.stdout:6/855: dread d4/d8/df/d1e/d25/fda [0,4194304] 0 2024-05-08T05:32:13.361 INFO:tasks.workunit.client.0.smithi087.stdout:5/949: link da/db/d2a/f95 da/dd/f142 0 2024-05-08T05:32:13.361 INFO:tasks.workunit.client.0.smithi087.stdout:5/950: readlink da/db/l96 0 2024-05-08T05:32:13.364 INFO:tasks.workunit.client.0.smithi087.stdout:4/822: dwrite d4/d13/d32/f103 [0,4194304] 0 2024-05-08T05:32:13.381 INFO:tasks.workunit.client.0.smithi087.stdout:7/990: rmdir d2/d6/da0/d67/d82 39 2024-05-08T05:32:13.381 INFO:tasks.workunit.client.0.smithi087.stdout:7/991: stat d2/d6/da0/d10f/d3f/d72/d77/d54/d55/d65/fff 0 2024-05-08T05:32:13.382 INFO:tasks.workunit.client.0.smithi087.stdout:4/823: link d4/d13/l2a d4/l134 0 2024-05-08T05:32:13.395 INFO:tasks.workunit.client.0.smithi087.stdout:5/951: creat da/db/d2a/d5a/d93/d42/d43/d83/ddc/dd5/f143 x:0 0 0 2024-05-08T05:32:13.395 INFO:tasks.workunit.client.0.smithi087.stdout:5/952: chown da/db/d2a/d5a/d93/d36/f7f 1632 1 2024-05-08T05:32:13.395 INFO:tasks.workunit.client.0.smithi087.stdout:5/953: chown da/db/d2a/d5a/d93/d42/d43/d83/ddc/dd5/c11f 20225334 1 2024-05-08T05:32:13.395 INFO:tasks.workunit.client.0.smithi087.stdout:8/882: rename db/d23/d3a/fd3 to db/d23/d1b/d35/d43/f12d 0 2024-05-08T05:32:13.400 INFO:tasks.workunit.client.0.smithi087.stdout:6/856: write d4/d8/df/d1e/d25/f72 [1629221,78033] 0 2024-05-08T05:32:13.401 INFO:tasks.workunit.client.0.smithi087.stdout:3/829: dwrite d4/f5 [0,4194304] 0 2024-05-08T05:32:13.404 INFO:tasks.workunit.client.0.smithi087.stdout:9/839: dwrite d1/df/d58/fe4 [0,4194304] 0 2024-05-08T05:32:13.404 INFO:tasks.workunit.client.0.smithi087.stdout:9/840: chown d1/df/d14/d68/d80/d98/c5f 10777860 1 2024-05-08T05:32:13.405 INFO:tasks.workunit.client.0.smithi087.stdout:9/841: mknod d1/d70/d107/c10e 0 2024-05-08T05:32:13.407 INFO:tasks.workunit.client.0.smithi087.stdout:8/883: rename db/d23/d1b/d35/d43/d68/d6a to db/d23/d3a/d65/d12e 0 2024-05-08T05:32:13.407 INFO:tasks.workunit.client.0.smithi087.stdout:8/884: fsync db/d23/d1b/d35/d43/d68/fa9 0 2024-05-08T05:32:13.408 INFO:tasks.workunit.client.0.smithi087.stdout:8/885: stat f6 0 2024-05-08T05:32:13.409 INFO:tasks.workunit.client.0.smithi087.stdout:3/830: rename d4/d14 to d4/d14/dfb/d11a/d12b 22 2024-05-08T05:32:13.409 INFO:tasks.workunit.client.0.smithi087.stdout:3/831: rename d4/d11/d24 to d4/d11/d24/d25/d4d/dbb/d12c 22 2024-05-08T05:32:13.411 INFO:tasks.workunit.client.0.smithi087.stdout:1/729: dwrite df/d2f/d57/da0/fd1 [0,4194304] 0 2024-05-08T05:32:13.412 INFO:tasks.workunit.client.0.smithi087.stdout:1/730: write df/d2f/f97 [5005336,117736] 0 2024-05-08T05:32:13.413 INFO:tasks.workunit.client.0.smithi087.stdout:1/731: chown df/d2f/d6a 1041101887 1 2024-05-08T05:32:13.413 INFO:tasks.workunit.client.0.smithi087.stdout:3/832: creat d4/d11/d24/d25/d4d/dd6/d121/d87/da5/f12d x:0 0 0 2024-05-08T05:32:13.413 INFO:tasks.workunit.client.0.smithi087.stdout:3/833: write d4/d5f/fc5 [856054,69619] 0 2024-05-08T05:32:13.413 INFO:tasks.workunit.client.0.smithi087.stdout:3/834: readlink d4/d11/d24/d39/d5a/l90 0 2024-05-08T05:32:13.413 INFO:tasks.workunit.client.0.smithi087.stdout:2/829: dwrite d7/de/d27/d33/f99 [0,4194304] 0 2024-05-08T05:32:13.413 INFO:tasks.workunit.client.0.smithi087.stdout:8/886: mknod db/d23/d3a/d65/c12f 0 2024-05-08T05:32:13.414 INFO:tasks.workunit.client.0.smithi087.stdout:9/842: dread d1/df/d14/d54/d61/d72/fc4 [0,4194304] 0 2024-05-08T05:32:13.415 INFO:tasks.workunit.client.0.smithi087.stdout:2/830: rename d7/d93/d100/c101 to d7/de/d55/de4/c112 0 2024-05-08T05:32:13.416 INFO:tasks.workunit.client.0.smithi087.stdout:3/835: creat d4/f12e x:0 0 0 2024-05-08T05:32:13.416 INFO:tasks.workunit.client.0.smithi087.stdout:3/836: chown d4/d11/d3d/f8e 29161684 1 2024-05-08T05:32:13.416 INFO:tasks.workunit.client.0.smithi087.stdout:3/837: write d4/d11/f50 [2054001,6133] 0 2024-05-08T05:32:13.417 INFO:tasks.workunit.client.0.smithi087.stdout:2/831: creat d7/de/d2c/db6/dcb/db7/dc1/d104/f113 x:0 0 0 2024-05-08T05:32:13.419 INFO:tasks.workunit.client.0.smithi087.stdout:5/954: dread da/db/d2a/d46/d9a/fb3 [0,4194304] 0 2024-05-08T05:32:13.419 INFO:tasks.workunit.client.0.smithi087.stdout:5/955: fdatasync da/db/d2a/d5a/d93/f40 0 2024-05-08T05:32:13.422 INFO:tasks.workunit.client.0.smithi087.stdout:7/992: dwrite d2/d6/da0/d10f/d3f/d66/f13f [0,4194304] 0 2024-05-08T05:32:13.436 INFO:tasks.workunit.client.0.smithi087.stdout:5/956: creat da/db/d2a/d5a/d93/d36/d45/d5c/dff/f144 x:0 0 0 2024-05-08T05:32:13.438 INFO:tasks.workunit.client.0.smithi087.stdout:7/993: dread d2/d6/da0/d10f/d3f/d49/d59/f62 [0,4194304] 0 2024-05-08T05:32:13.451 INFO:tasks.workunit.client.0.smithi087.stdout:7/994: mkdir d2/d6/d12/d19/d2a/d89/d134/d148 0 2024-05-08T05:32:13.451 INFO:tasks.workunit.client.0.smithi087.stdout:8/887: unlink db/d23/d15/d29/d4d/c5d 0 2024-05-08T05:32:13.454 INFO:tasks.workunit.client.0.smithi087.stdout:7/995: rename d2/d6/da0/d10f/fcc to d2/d6/d12/d15/d5b/dee/f149 0 2024-05-08T05:32:13.454 INFO:tasks.workunit.client.0.smithi087.stdout:7/996: chown d2/d6/da0/d10f/d3f/d72/d77/d54/c76 9956 1 2024-05-08T05:32:13.454 INFO:tasks.workunit.client.0.smithi087.stdout:7/997: chown d2/d6/d12/d19/d2a/d111/c131 6 1 2024-05-08T05:32:13.457 INFO:tasks.workunit.client.0.smithi087.stdout:8/888: dread db/d23/d1b/d4b/f91 [0,4194304] 0 2024-05-08T05:32:13.460 INFO:tasks.workunit.client.0.smithi087.stdout:7/998: rename d2/d6/d12/ff7 to d2/d6/da0/d10f/d3f/d72/d77/d54/d55/d65/df1/f14a 0 2024-05-08T05:32:13.460 INFO:tasks.workunit.client.0.smithi087.stdout:7/999: truncate d2/d6/d12/d15/d5b/f103 2484333 0 2024-05-08T05:32:13.461 INFO:tasks.workunit.client.0.smithi087.stdout:6/857: write d4/d8/df/d39/d42/f98 [2608350,116019] 0 2024-05-08T05:32:13.462 INFO:tasks.workunit.client.0.smithi087.stdout:4/824: dwrite d4/d13/d3e/d28/d50/d5a/fea [0,4194304] 0 2024-05-08T05:32:13.462 INFO:tasks.workunit.client.0.smithi087.stdout:4/825: chown d4/l11c 1 1 2024-05-08T05:32:13.462 INFO:tasks.workunit.client.0.smithi087.stdout:4/826: fsync d4/d13/d3e/d28/d50/d9d/df2/ffc 0 2024-05-08T05:32:13.471 INFO:tasks.workunit.client.0.smithi087.stdout:1/732: dwrite df/d2f/d57/fea [0,4194304] 0 2024-05-08T05:32:13.471 INFO:tasks.workunit.client.0.smithi087.stdout:8/889: rename db/d23/d3a/d65/d12e/lfc to db/d23/d1b/d35/d43/daf/l130 0 2024-05-08T05:32:13.471 INFO:tasks.workunit.client.0.smithi087.stdout:8/890: dread - db/d23/d15/d29/d33/d3b/f126 zero size 2024-05-08T05:32:13.471 INFO:tasks.workunit.client.0.smithi087.stdout:1/733: getdents df/d18/d8b 0 2024-05-08T05:32:13.472 INFO:tasks.workunit.client.0.smithi087.stdout:9/843: dwrite d1/df/d14/d54/d61/d72/fb3 [0,4194304] 0 2024-05-08T05:32:13.472 INFO:tasks.workunit.client.0.smithi087.stdout:9/844: write d1/df/d14/d68/d80/d98/d28/f7c [4614905,47854] 0 2024-05-08T05:32:13.472 INFO:tasks.workunit.client.0.smithi087.stdout:9/845: write d1/df/d14/d54/d61/d72/d106/f10d [906074,64058] 0 2024-05-08T05:32:13.473 INFO:tasks.workunit.client.0.smithi087.stdout:9/846: write d1/df/d14/d68/d80/d98/feb [553605,22021] 0 2024-05-08T05:32:13.473 INFO:tasks.workunit.client.0.smithi087.stdout:6/858: dread d4/d8/df/d39/d42/d9e/d6f/f7e [0,4194304] 0 2024-05-08T05:32:13.473 INFO:tasks.workunit.client.0.smithi087.stdout:6/859: chown d4/d8/l22 114 1 2024-05-08T05:32:13.473 INFO:tasks.workunit.client.0.smithi087.stdout:6/860: chown d4/d8/df/d39/d42/d9e/d6f/d7f/de7/d2d/d37 30677426 1 2024-05-08T05:32:13.473 INFO:tasks.workunit.client.0.smithi087.stdout:6/861: truncate d4/d8/df/d39/d42/d9e/d6f/f7e 1015922 0 2024-05-08T05:32:13.473 INFO:tasks.workunit.client.0.smithi087.stdout:6/862: chown d4/d8/df/d39/d42/d94/lbc 517383511 1 2024-05-08T05:32:13.475 INFO:tasks.workunit.client.0.smithi087.stdout:6/863: mknod d4/d8/df/d39/d42/d9e/d6f/d7f/de7/d2d/dca/c106 0 2024-05-08T05:32:13.477 INFO:tasks.workunit.client.0.smithi087.stdout:6/864: link d4/d8/df/d39/d42/d9e/d6f/f7e d4/d8/df/d39/d42/d9e/d6f/d7f/de7/d2d/dca/f107 0 2024-05-08T05:32:13.479 INFO:tasks.workunit.client.0.smithi087.stdout:6/865: creat d4/d8/df/d39/d42/d9e/d6f/d7f/de7/d2d/d37/d9c/f108 x:0 0 0 2024-05-08T05:32:13.484 INFO:tasks.workunit.client.0.smithi087.stdout:5/957: dwrite da/db/d2a/d5a/d93/d42/d43/d83/f7a [0,4194304] 0 2024-05-08T05:32:13.484 INFO:tasks.workunit.client.0.smithi087.stdout:2/832: dwrite d7/de/d82/fa2 [0,4194304] 0 2024-05-08T05:32:13.484 INFO:tasks.workunit.client.0.smithi087.stdout:2/833: chown d7/de/d55/de4 466379235 1 2024-05-08T05:32:13.492 INFO:tasks.workunit.client.0.smithi087.stdout:5/958: symlink da/db/d2a/d5a/d93/d42/d50/dd0/d11e/l145 0 2024-05-08T05:32:13.492 INFO:tasks.workunit.client.0.smithi087.stdout:5/959: readlink da/db/d2a/d5a/d93/d42/lba 0 2024-05-08T05:32:13.494 INFO:tasks.workunit.client.0.smithi087.stdout:8/891: rename db/d23/d15/d29/d33/d3b to db/d23/d15/d29/db1/d131 0 2024-05-08T05:32:13.496 INFO:tasks.workunit.client.0.smithi087.stdout:5/960: symlink da/db/d2a/d5a/d93/d42/l146 0 2024-05-08T05:32:13.496 INFO:tasks.workunit.client.0.smithi087.stdout:5/961: readlink da/dd/l103 0 2024-05-08T05:32:13.496 INFO:tasks.workunit.client.0.smithi087.stdout:5/962: fsync da/dd/d65/f68 0 2024-05-08T05:32:13.496 INFO:tasks.workunit.client.0.smithi087.stdout:6/866: rename d4/d8/df/d39/d42/d9e/d6f/d7f/de7/d2d/d37/d45/da2 to d4/d8/df/d39/d42/d9e/d6f/d7f/de7/d2d/d37/d9c/d109 0 2024-05-08T05:32:13.496 INFO:tasks.workunit.client.0.smithi087.stdout:6/867: truncate d4/d8/df/d1e/d52/f80 1422367 0 2024-05-08T05:32:13.498 INFO:tasks.workunit.client.0.smithi087.stdout:8/892: creat db/d23/d121/f132 x:0 0 0 2024-05-08T05:32:13.498 INFO:tasks.workunit.client.0.smithi087.stdout:9/847: read d1/df/d37/f51 [182264,815] 0 2024-05-08T05:32:13.499 INFO:tasks.workunit.client.0.smithi087.stdout:5/963: rename da/db/d2a/d5a/d93/d42/d43/d83/de9/c11b to da/db/d2a/d5a/d93/d36/d45/d5c/d100/c147 0 2024-05-08T05:32:13.500 INFO:tasks.workunit.client.0.smithi087.stdout:9/848: creat d1/df/d14/d68/d80/d98/d28/de8/f10f x:0 0 0 2024-05-08T05:32:13.503 INFO:tasks.workunit.client.0.smithi087.stdout:8/893: creat db/d23/d15/d10b/f133 x:0 0 0 2024-05-08T05:32:13.503 INFO:tasks.workunit.client.0.smithi087.stdout:8/894: chown db/d23/d54/cca 112760082 1 2024-05-08T05:32:13.506 INFO:tasks.workunit.client.0.smithi087.stdout:2/834: read d7/de/d27/d33/f38 [1360079,39209] 0 2024-05-08T05:32:13.508 INFO:tasks.workunit.client.0.smithi087.stdout:2/835: mknod d7/d93/c114 0 2024-05-08T05:32:13.508 INFO:tasks.workunit.client.0.smithi087.stdout:2/836: write d7/de/d27/d33/d49/db9/fc0 [175540,41849] 0 2024-05-08T05:32:13.508 INFO:tasks.workunit.client.0.smithi087.stdout:5/964: read da/db/d2a/d5a/d93/d42/d43/ff4 [599734,37492] 0 2024-05-08T05:32:13.509 INFO:tasks.workunit.client.0.smithi087.stdout:8/895: unlink f3 0 2024-05-08T05:32:13.509 INFO:tasks.workunit.client.0.smithi087.stdout:8/896: truncate db/d23/d15/d3c/ff9 481760 0 2024-05-08T05:32:13.509 INFO:tasks.workunit.client.0.smithi087.stdout:3/838: dwrite d4/d11/d24/d25/d3e/d58/f7a [0,4194304] 0 2024-05-08T05:32:13.509 INFO:tasks.workunit.client.0.smithi087.stdout:3/839: stat d4/d11/f38 0 2024-05-08T05:32:13.509 INFO:tasks.workunit.client.0.smithi087.stdout:8/897: write db/d23/d15/d29/d4d/d96/f10d [680651,36986] 0 2024-05-08T05:32:13.509 INFO:tasks.workunit.client.0.smithi087.stdout:6/868: mknod d4/d8/df/d39/d42/d9e/d6f/d7f/de7/c10a 0 2024-05-08T05:32:13.509 INFO:tasks.workunit.client.0.smithi087.stdout:6/869: write d4/d8/df/d1e/d25/f92 [1683189,5215] 0 2024-05-08T05:32:13.509 INFO:tasks.workunit.client.0.smithi087.stdout:4/827: dwrite d4/d13/d32/ddb/f6d [0,4194304] 0 2024-05-08T05:32:13.510 INFO:tasks.workunit.client.0.smithi087.stdout:2/837: read d7/de/d27/fbb [399573,105099] 0 2024-05-08T05:32:13.512 INFO:tasks.workunit.client.0.smithi087.stdout:5/965: symlink da/l148 0 2024-05-08T05:32:13.512 INFO:tasks.workunit.client.0.smithi087.stdout:5/966: write da/dd/d13/da2/dce/fed [50731,11919] 0 2024-05-08T05:32:13.512 INFO:tasks.workunit.client.0.smithi087.stdout:1/734: dwrite df/d2f/d57/d64/d83/d96/fce [4194304,4194304] 0 2024-05-08T05:32:13.512 INFO:tasks.workunit.client.0.smithi087.stdout:1/735: truncate df/d2f/d57/d64/fbf 5669805 0 2024-05-08T05:32:13.512 INFO:tasks.workunit.client.0.smithi087.stdout:3/840: rename d4/d11/d3d/c9d to d4/d11/d24/d39/d94/c12f 0 2024-05-08T05:32:13.512 INFO:tasks.workunit.client.0.smithi087.stdout:8/898: rename db/d23/d3a/d65/d83/d116 to db/d23/d3a/d65/d83/d116/d134 22 2024-05-08T05:32:13.512 INFO:tasks.workunit.client.0.smithi087.stdout:8/899: write db/d23/d1b/d35/d43/fd0 [1918678,79345] 0 2024-05-08T05:32:13.513 INFO:tasks.workunit.client.0.smithi087.stdout:8/900: symlink db/d23/d15/d29/db1/d131/d56/d113/l135 0 2024-05-08T05:32:13.519 INFO:tasks.workunit.client.0.smithi087.stdout:2/838: mkdir d7/de/d27/d33/d65/dc2/d115 0 2024-05-08T05:32:13.520 INFO:tasks.workunit.client.0.smithi087.stdout:2/839: mknod d7/de/d2c/d43/c116 0 2024-05-08T05:32:13.522 INFO:tasks.workunit.client.0.smithi087.stdout:2/840: creat d7/de/d27/d33/d65/f117 x:0 0 0 2024-05-08T05:32:13.524 INFO:tasks.workunit.client.0.smithi087.stdout:1/736: link df/d2f/d57/d64/c7e df/d2f/d57/dcb/de1/cff 0 2024-05-08T05:32:13.525 INFO:tasks.workunit.client.0.smithi087.stdout:8/901: rename db/d23/f57 to db/d23/f136 0 2024-05-08T05:32:13.526 INFO:tasks.workunit.client.0.smithi087.stdout:3/841: mkdir d4/d11/d24/d25/d130 0 2024-05-08T05:32:13.526 INFO:tasks.workunit.client.0.smithi087.stdout:3/842: stat d4/f5 0 2024-05-08T05:32:13.526 INFO:tasks.workunit.client.0.smithi087.stdout:3/843: write d4/f6 [76999,11520] 0 2024-05-08T05:32:13.527 INFO:tasks.workunit.client.0.smithi087.stdout:5/967: rmdir da/db/d2a/d5a/d93/d42/d43/d83/ddc 39 2024-05-08T05:32:13.529 INFO:tasks.workunit.client.0.smithi087.stdout:8/902: mknod db/d23/d15/d29/c137 0 2024-05-08T05:32:13.530 INFO:tasks.workunit.client.0.smithi087.stdout:6/870: rename d4/d8/df/d39/d42/d9e/d6f/d7f/de7/d2d/d37/d5b/c8c to d4/d8/df/d39/d42/d9e/da4/c10b 0 2024-05-08T05:32:13.531 INFO:tasks.workunit.client.0.smithi087.stdout:6/871: write d4/d6/f60 [566467,52576] 0 2024-05-08T05:32:13.532 INFO:tasks.workunit.client.0.smithi087.stdout:1/737: mkdir df/d18/d1d/d32/d100 0 2024-05-08T05:32:13.532 INFO:tasks.workunit.client.0.smithi087.stdout:0/784: sync 2024-05-08T05:32:13.532 INFO:tasks.workunit.client.0.smithi087.stdout:0/785: getdents d0/d57/d24 0 2024-05-08T05:32:13.535 INFO:tasks.workunit.client.0.smithi087.stdout:2/841: rename d7/de/d2c/db6/dcb/db7/f110 to d7/de/d5d/f118 0 2024-05-08T05:32:13.535 INFO:tasks.workunit.client.0.smithi087.stdout:0/786: symlink d0/d22/d3c/dbb/ddb/deb/l111 0 2024-05-08T05:32:13.535 INFO:tasks.workunit.client.0.smithi087.stdout:6/872: getdents d4/d8/df/d39 0 2024-05-08T05:32:13.536 INFO:tasks.workunit.client.0.smithi087.stdout:2/842: mkdir d7/de/d27/dd6/dfb/d119 0 2024-05-08T05:32:13.536 INFO:tasks.workunit.client.0.smithi087.stdout:0/787: symlink d0/d9/d1b/d2f/df5/l112 0 2024-05-08T05:32:13.538 INFO:tasks.workunit.client.0.smithi087.stdout:2/843: creat d7/de/d2c/db6/dcb/db7/dc1/d104/f11a x:0 0 0 2024-05-08T05:32:13.538 INFO:tasks.workunit.client.0.smithi087.stdout:2/844: chown d7/de/d2c/db6/dcb/db7/dc1 1016919 1 2024-05-08T05:32:13.538 INFO:tasks.workunit.client.0.smithi087.stdout:5/968: dread da/dd/f142 [0,4194304] 0 2024-05-08T05:32:13.542 INFO:tasks.workunit.client.0.smithi087.stdout:2/845: rename d7/d63/c54 to d7/de/d82/c11b 0 2024-05-08T05:32:13.543 INFO:tasks.workunit.client.0.smithi087.stdout:8/903: dread db/d23/d15/d29/d4d/d96/f128 [0,4194304] 0 2024-05-08T05:32:13.543 INFO:tasks.workunit.client.0.smithi087.stdout:8/904: read db/d23/d15/d29/d33/f80 [809190,23541] 0 2024-05-08T05:32:13.543 INFO:tasks.workunit.client.0.smithi087.stdout:8/905: write db/d23/d1b/d35/d43/d68/fb2 [873427,115603] 0 2024-05-08T05:32:13.543 INFO:tasks.workunit.client.0.smithi087.stdout:8/906: write db/d23/d15/d29/d33/d6c/ffb [2351931,34820] 0 2024-05-08T05:32:13.545 INFO:tasks.workunit.client.0.smithi087.stdout:1/738: symlink df/d18/d1d/d32/d9c/l101 0 2024-05-08T05:32:13.548 INFO:tasks.workunit.client.0.smithi087.stdout:6/873: symlink d4/d8/df/l10c 0 2024-05-08T05:32:13.551 INFO:tasks.workunit.client.0.smithi087.stdout:8/907: unlink db/d23/d15/d29/db1/d131/f126 0 2024-05-08T05:32:13.551 INFO:tasks.workunit.client.0.smithi087.stdout:8/908: chown db/d23/d1b/d35/d43/d68/ce3 66927134 1 2024-05-08T05:32:13.551 INFO:tasks.workunit.client.0.smithi087.stdout:8/909: chown db 75 1 2024-05-08T05:32:13.557 INFO:tasks.workunit.client.0.smithi087.stdout:8/910: creat db/d23/d3a/d65/f138 x:0 0 0 2024-05-08T05:32:13.561 INFO:tasks.workunit.client.0.smithi087.stdout:8/911: creat db/d23/d1b/d35/d43/d68/d11c/d129/f139 x:0 0 0 2024-05-08T05:32:13.569 INFO:tasks.workunit.client.0.smithi087.stdout:4/828: dwrite d4/d13/d3e/d28/d50/d5a/fea [0,4194304] 0 2024-05-08T05:32:13.569 INFO:tasks.workunit.client.0.smithi087.stdout:1/739: dread df/d2f/d57/d64/fa9 [4194304,4194304] 0 2024-05-08T05:32:13.570 INFO:tasks.workunit.client.0.smithi087.stdout:4/829: rmdir d4/d13/d3e/d28/d50/d9d/df2 39 2024-05-08T05:32:13.570 INFO:tasks.workunit.client.0.smithi087.stdout:1/740: link df/d18/d8b/cfb df/d18/d8b/c102 0 2024-05-08T05:32:13.575 INFO:tasks.workunit.client.0.smithi087.stdout:8/912: creat db/d23/d15/d29/d79/d11d/f13a x:0 0 0 2024-05-08T05:32:13.575 INFO:tasks.workunit.client.0.smithi087.stdout:3/844: dwrite d4/d11/f50 [0,4194304] 0 2024-05-08T05:32:13.576 INFO:tasks.workunit.client.0.smithi087.stdout:8/913: write db/d23/d1b/d35/d43/daf/fb3 [192595,82153] 0 2024-05-08T05:32:13.577 INFO:tasks.workunit.client.0.smithi087.stdout:3/845: symlink d4/d11/d24/d25/d3e/d58/d112/l131 0 2024-05-08T05:32:13.579 INFO:tasks.workunit.client.0.smithi087.stdout:3/846: rmdir d4/d11/d24/d25/d3e/d3f 39 2024-05-08T05:32:13.580 INFO:tasks.workunit.client.0.smithi087.stdout:3/847: unlink d4/d11/d24/d39/d94/c12f 0 2024-05-08T05:32:13.582 INFO:tasks.workunit.client.0.smithi087.stdout:3/848: mkdir d4/d14/d84/d8b/d8f/dec/d132 0 2024-05-08T05:32:13.584 INFO:tasks.workunit.client.0.smithi087.stdout:3/849: creat d4/d11/d24/d39/d94/df7/f133 x:0 0 0 2024-05-08T05:32:13.584 INFO:tasks.workunit.client.0.smithi087.stdout:8/914: creat db/d23/d15/d29/d33/d6c/f13b x:0 0 0 2024-05-08T05:32:13.584 INFO:tasks.workunit.client.0.smithi087.stdout:8/915: write db/f12 [2128477,82167] 0 2024-05-08T05:32:13.585 INFO:tasks.workunit.client.0.smithi087.stdout:9/849: dwrite d1/df/d14/d54/d61/d88/fd8 [0,4194304] 0 2024-05-08T05:32:13.594 INFO:tasks.workunit.client.0.smithi087.stdout:4/830: dread d4/d13/d3e/d28/d50/d9d/df2/d106/fd1 [0,4194304] 0 2024-05-08T05:32:13.596 INFO:tasks.workunit.client.0.smithi087.stdout:2/846: dwrite d7/de/d27/d33/d49/f8b [0,4194304] 0 2024-05-08T05:32:13.599 INFO:tasks.workunit.client.0.smithi087.stdout:6/874: dwrite d4/d8/df/d39/d42/d9e/d6f/d7f/de7/d2d/d37/d5b/f93 [4194304,4194304] 0 2024-05-08T05:32:13.606 INFO:tasks.workunit.client.0.smithi087.stdout:4/831: rename d4/d13/d3e/d28/d50/d9d/df2/d106/d91/ff4 to d4/d13/d3e/d28/d50/d9d/df2/d106/d91/db8/dba/d115/f135 0 2024-05-08T05:32:13.606 INFO:tasks.workunit.client.0.smithi087.stdout:4/832: chown d4/d13/d3e/d28/fde 143492445 1 2024-05-08T05:32:13.606 INFO:tasks.workunit.client.0.smithi087.stdout:3/850: creat d4/d14/f134 x:0 0 0 2024-05-08T05:32:13.608 INFO:tasks.workunit.client.0.smithi087.stdout:4/833: creat d4/d13/d3e/d28/d50/d9d/df2/d106/d91/db8/dba/d96/dd5/f136 x:0 0 0 2024-05-08T05:32:13.609 INFO:tasks.workunit.client.0.smithi087.stdout:2/847: rmdir d7/de/d5d 39 2024-05-08T05:32:13.609 INFO:tasks.workunit.client.0.smithi087.stdout:6/875: symlink d4/d8/df/d39/d42/d9e/d6f/d7f/de7/l10d 0 2024-05-08T05:32:13.609 INFO:tasks.workunit.client.0.smithi087.stdout:2/848: write d7/de/f15 [7224466,68722] 0 2024-05-08T05:32:13.609 INFO:tasks.workunit.client.0.smithi087.stdout:3/851: symlink d4/d11/d24/d39/l135 0 2024-05-08T05:32:13.609 INFO:tasks.workunit.client.0.smithi087.stdout:1/741: dread df/d18/d1d/d58/d72/fde [0,4194304] 0 2024-05-08T05:32:13.609 INFO:tasks.workunit.client.0.smithi087.stdout:3/852: write d4/d11/d24/d25/d4d/fb1 [530305,12028] 0 2024-05-08T05:32:13.612 INFO:tasks.workunit.client.0.smithi087.stdout:6/876: creat d4/d8/df/d39/d42/d9e/d6f/d7f/de7/d2d/d37/d9c/d109/f10e x:0 0 0 2024-05-08T05:32:13.612 INFO:tasks.workunit.client.0.smithi087.stdout:6/877: fsync d4/d8/fb6 0 2024-05-08T05:32:13.613 INFO:tasks.workunit.client.0.smithi087.stdout:6/878: chown d4/d8/df/d39/d42/ca6 105029671 1 2024-05-08T05:32:13.613 INFO:tasks.workunit.client.0.smithi087.stdout:6/879: chown d4/d8/fb6 6235 1 2024-05-08T05:32:13.613 INFO:tasks.workunit.client.0.smithi087.stdout:4/834: rename d4/d13/d3e/d28/d50/d9d/df2/d106/f122 to d4/d13/d3e/d28/d12f/f137 0 2024-05-08T05:32:13.615 INFO:tasks.workunit.client.0.smithi087.stdout:4/835: creat d4/d13/d3e/d28/d50/d9d/df2/d106/d91/f138 x:0 0 0 2024-05-08T05:32:13.616 INFO:tasks.workunit.client.0.smithi087.stdout:6/880: getdents d4/d8/df/d39/d42/d9e/d6f/d7f 0 2024-05-08T05:32:13.618 INFO:tasks.workunit.client.0.smithi087.stdout:6/881: mknod d4/d8/df/d39/d42/d94/db5/c10f 0 2024-05-08T05:32:13.622 INFO:tasks.workunit.client.0.smithi087.stdout:1/742: dread df/d2f/d4f/f84 [0,4194304] 0 2024-05-08T05:32:13.622 INFO:tasks.workunit.client.0.smithi087.stdout:1/743: getdents df/d18/d1d/d27/dd4 0 2024-05-08T05:32:13.630 INFO:tasks.workunit.client.0.smithi087.stdout:4/836: dread d4/d13/d65/f44 [0,4194304] 0 2024-05-08T05:32:13.637 INFO:tasks.workunit.client.0.smithi087.stdout:6/882: write d4/f97 [2451543,14283] 0 2024-05-08T05:32:13.637 INFO:tasks.workunit.client.0.smithi087.stdout:2/849: dread d7/fd [0,4194304] 0 2024-05-08T05:32:13.637 INFO:tasks.workunit.client.0.smithi087.stdout:9/850: dwrite d1/df/d14/d18/db5/fb8 [0,4194304] 0 2024-05-08T05:32:13.637 INFO:tasks.workunit.client.0.smithi087.stdout:2/850: write d7/de/d2c/db6/dcb/db7/dc1/d104/f113 [409885,119046] 0 2024-05-08T05:32:13.638 INFO:tasks.workunit.client.0.smithi087.stdout:1/744: creat df/d2f/d57/f103 x:0 0 0 2024-05-08T05:32:13.639 INFO:tasks.workunit.client.0.smithi087.stdout:1/745: write df/fbc [720214,79135] 0 2024-05-08T05:32:13.639 INFO:tasks.workunit.client.0.smithi087.stdout:1/746: chown df/d18/d1d/f2d 823731 1 2024-05-08T05:32:13.641 INFO:tasks.workunit.client.0.smithi087.stdout:4/837: rmdir d4/d13/d3e/d28/d50/d9d/df2/d106/d91/db8 39 2024-05-08T05:32:13.641 INFO:tasks.workunit.client.0.smithi087.stdout:1/747: creat df/d18/d1d/d32/d100/f104 x:0 0 0 2024-05-08T05:32:13.647 INFO:tasks.workunit.client.0.smithi087.stdout:8/916: dwrite db/d23/d1b/d4b/f91 [0,4194304] 0 2024-05-08T05:32:13.648 INFO:tasks.workunit.client.0.smithi087.stdout:8/917: chown db/d23/d15/d3c/fcf 112 1 2024-05-08T05:32:13.655 INFO:tasks.workunit.client.0.smithi087.stdout:9/851: dread d1/df/d58/fc7 [0,4194304] 0 2024-05-08T05:32:13.657 INFO:tasks.workunit.client.0.smithi087.stdout:2/851: rename d7/de/d27/d33 to d7/de/d55/de4/d111/d11c 0 2024-05-08T05:32:13.658 INFO:tasks.workunit.client.0.smithi087.stdout:9/852: creat d1/df/d14/d18/d8e/da2/de6/f110 x:0 0 0 2024-05-08T05:32:13.658 INFO:tasks.workunit.client.0.smithi087.stdout:2/852: symlink d7/de/db1/dbe/l11d 0 2024-05-08T05:32:13.660 INFO:tasks.workunit.client.0.smithi087.stdout:1/748: mkdir df/d2f/d57/dcb/d105 0 2024-05-08T05:32:13.660 INFO:tasks.workunit.client.0.smithi087.stdout:1/749: chown df/d2f/d4f/d52/lc3 20 1 2024-05-08T05:32:13.660 INFO:tasks.workunit.client.0.smithi087.stdout:9/853: creat d1/df/d14/d54/d61/d72/f111 x:0 0 0 2024-05-08T05:32:13.660 INFO:tasks.workunit.client.0.smithi087.stdout:8/918: rename db/d23/d1b/d35/d43/d68/cf7 to db/d23/d1b/d35/d43/d68/d11c/c13c 0 2024-05-08T05:32:13.660 INFO:tasks.workunit.client.0.smithi087.stdout:2/853: creat d7/de/d55/de4/d111/d11c/f11e x:0 0 0 2024-05-08T05:32:13.661 INFO:tasks.workunit.client.0.smithi087.stdout:2/854: fsync d7/d63/dac/fda 0 2024-05-08T05:32:13.661 INFO:tasks.workunit.client.0.smithi087.stdout:2/855: chown d7/de/d2c/db6/dcb/db7/dc1/d104 0 1 2024-05-08T05:32:13.664 INFO:tasks.workunit.client.0.smithi087.stdout:1/750: unlink df/d18/d8b/df2/fc0 0 2024-05-08T05:32:13.664 INFO:tasks.workunit.client.0.smithi087.stdout:1/751: write df/d18/ffd [876643,42569] 0 2024-05-08T05:32:13.681 INFO:tasks.workunit.client.0.smithi087.stdout:8/919: dread db/d23/d54/ff5 [0,4194304] 0 2024-05-08T05:32:13.681 INFO:tasks.workunit.client.0.smithi087.stdout:8/920: chown db/d23/d15/d29/d33/d6c/dbe 0 1 2024-05-08T05:32:13.681 INFO:tasks.workunit.client.0.smithi087.stdout:8/921: write db/d23/d1b/d7c/fbd [80954,1977] 0 2024-05-08T05:32:13.681 INFO:tasks.workunit.client.0.smithi087.stdout:8/922: mkdir db/d23/d15/d29/d33/dd2/d13d 0 2024-05-08T05:32:13.681 INFO:tasks.workunit.client.0.smithi087.stdout:8/923: symlink db/d23/d15/d29/d4d/d96/l13e 0 2024-05-08T05:32:13.681 INFO:tasks.workunit.client.0.smithi087.stdout:8/924: creat db/d23/d3a/d65/f13f x:0 0 0 2024-05-08T05:32:13.681 INFO:tasks.workunit.client.0.smithi087.stdout:2/856: dread d7/de/ff9 [0,4194304] 0 2024-05-08T05:32:13.682 INFO:tasks.workunit.client.0.smithi087.stdout:8/925: truncate db/d23/f136 5784617 0 2024-05-08T05:32:13.682 INFO:tasks.workunit.client.0.smithi087.stdout:8/926: chown db/d23/d15/d29/db1/d131/d56/d113/l135 55084112 1 2024-05-08T05:32:13.686 INFO:tasks.workunit.client.0.smithi087.stdout:8/927: truncate db/f25 2033406 0 2024-05-08T05:32:13.687 INFO:tasks.workunit.client.0.smithi087.stdout:8/928: read db/d23/d15/d29/d79/f11b [206302,111867] 0 2024-05-08T05:32:13.692 INFO:tasks.workunit.client.0.smithi087.stdout:2/857: dread d7/de/f64 [0,4194304] 0 2024-05-08T05:32:13.694 INFO:tasks.workunit.client.0.smithi087.stdout:2/858: symlink d7/de/d55/de4/d111/d11c/d65/dc2/l11f 0 2024-05-08T05:32:13.695 INFO:tasks.workunit.client.0.smithi087.stdout:4/838: dwrite d4/d13/d3e/d28/d50/d9d/df2/d106/d91/db8/dba/fff [0,4194304] 0 2024-05-08T05:32:13.695 INFO:tasks.workunit.client.0.smithi087.stdout:4/839: chown d4/d13/d3e/f36 9830 1 2024-05-08T05:32:13.695 INFO:tasks.workunit.client.0.smithi087.stdout:4/840: chown d4/d13/d3e/d28/d50/d9d/f109 20782 1 2024-05-08T05:32:13.697 INFO:tasks.workunit.client.0.smithi087.stdout:4/841: mknod d4/d13/d3e/d28/d50/d5a/c139 0 2024-05-08T05:32:13.699 INFO:tasks.workunit.client.0.smithi087.stdout:4/842: creat d4/d13/d3e/d28/d50/d9d/df2/d106/f13a x:0 0 0 2024-05-08T05:32:13.699 INFO:tasks.workunit.client.0.smithi087.stdout:4/843: chown d4/d13/d3e/d28/d35/f105 0 1 2024-05-08T05:32:13.699 INFO:tasks.workunit.client.0.smithi087.stdout:4/844: readlink d4/d13/d3e/d28/d35/lec 0 2024-05-08T05:32:13.699 INFO:tasks.workunit.client.0.smithi087.stdout:1/752: dwrite df/d2f/f66 [0,4194304] 0 2024-05-08T05:32:13.701 INFO:tasks.workunit.client.0.smithi087.stdout:4/845: truncate d4/d13/d3e/d28/d50/d9d/df2/d106/d91/db8/dba/f54 564745 0 2024-05-08T05:32:13.711 INFO:tasks.workunit.client.0.smithi087.stdout:4/846: mkdir d4/d13/d3e/d28/d50/d13b 0 2024-05-08T05:32:13.714 INFO:tasks.workunit.client.0.smithi087.stdout:4/847: rename d4/d13/f16 to d4/d13/d3e/d28/d50/d9d/df2/d106/d91/db8/dba/d115/f13c 0 2024-05-08T05:32:13.714 INFO:tasks.workunit.client.0.smithi087.stdout:4/848: chown d4/d13/d32/c67 4704 1 2024-05-08T05:32:13.719 INFO:tasks.workunit.client.0.smithi087.stdout:1/753: dread df/d18/d1d/d58/d72/f5f [0,4194304] 0 2024-05-08T05:32:13.723 INFO:tasks.workunit.client.0.smithi087.stdout:1/754: unlink c5 0 2024-05-08T05:32:13.730 INFO:tasks.workunit.client.0.smithi087.stdout:2/859: dwrite d7/de/d2c/f4c [0,4194304] 0 2024-05-08T05:32:13.731 INFO:tasks.workunit.client.0.smithi087.stdout:2/860: truncate d7/f59 4370553 0 2024-05-08T05:32:13.731 INFO:tasks.workunit.client.0.smithi087.stdout:2/861: truncate d7/de/d2c/d43/f92 5990332 0 2024-05-08T05:32:13.731 INFO:tasks.workunit.client.0.smithi087.stdout:2/862: fdatasync d7/de/d55/de4/d111/d11c/f1c 0 2024-05-08T05:32:13.733 INFO:tasks.workunit.client.0.smithi087.stdout:2/863: mkdir d7/de/d5d/db8/d120 0 2024-05-08T05:32:13.737 INFO:tasks.workunit.client.0.smithi087.stdout:8/929: dread db/d23/d15/f19 [0,4194304] 0 2024-05-08T05:32:13.741 INFO:tasks.workunit.client.0.smithi087.stdout:8/930: rename db/d23/d1b/d7c/l81 to db/d23/d3a/l140 0 2024-05-08T05:32:13.741 INFO:tasks.workunit.client.0.smithi087.stdout:8/931: fsync db/d23/d1b/f2a 0 2024-05-08T05:32:13.741 INFO:tasks.workunit.client.0.smithi087.stdout:8/932: chown db/d23/d1b/d35/d43/d68/l122 359 1 2024-05-08T05:32:13.744 INFO:tasks.workunit.client.0.smithi087.stdout:8/933: symlink db/d23/d1b/d35/d43/l141 0 2024-05-08T05:32:13.744 INFO:tasks.workunit.client.0.smithi087.stdout:8/934: fdatasync db/d23/f63 0 2024-05-08T05:32:13.746 INFO:tasks.workunit.client.0.smithi087.stdout:8/935: mkdir db/d23/d1b/d35/d43/d142 0 2024-05-08T05:32:13.746 INFO:tasks.workunit.client.0.smithi087.stdout:8/936: fsync db/d23/d121/f132 0 2024-05-08T05:32:13.747 INFO:tasks.workunit.client.0.smithi087.stdout:8/937: symlink db/d23/d3a/d65/l143 0 2024-05-08T05:32:13.753 INFO:tasks.workunit.client.0.smithi087.stdout:4/849: dwrite d4/d13/d3e/d28/d50/d9d/df2/d106/fd1 [0,4194304] 0 2024-05-08T05:32:13.754 INFO:tasks.workunit.client.0.smithi087.stdout:4/850: mknod d4/d13/d3e/d28/d50/d9d/df2/d106/d91/db8/c13d 0 2024-05-08T05:32:13.760 INFO:tasks.workunit.client.0.smithi087.stdout:1/755: dwrite df/d2f/d57/d64/fac [4194304,4194304] 0 2024-05-08T05:32:13.760 INFO:tasks.workunit.client.0.smithi087.stdout:1/756: chown df/d2f/d57/d64/d83/d96/fce 827 1 2024-05-08T05:32:13.764 INFO:tasks.workunit.client.0.smithi087.stdout:4/851: dread d4/d13/d32/fc1 [0,4194304] 0 2024-05-08T05:32:13.766 INFO:tasks.workunit.client.0.smithi087.stdout:1/757: link df/d18/d1d/d27/c51 df/d2f/d4f/c106 0 2024-05-08T05:32:13.766 INFO:tasks.workunit.client.0.smithi087.stdout:1/758: chown df/d18/d1d/d27/d90 8359233 1 2024-05-08T05:32:13.770 INFO:tasks.workunit.client.0.smithi087.stdout:1/759: creat df/d18/d1d/f107 x:0 0 0 2024-05-08T05:32:13.770 INFO:tasks.workunit.client.0.smithi087.stdout:1/760: fdatasync df/d2f/fb4 0 2024-05-08T05:32:13.770 INFO:tasks.workunit.client.0.smithi087.stdout:1/761: mknod df/df3/c108 0 2024-05-08T05:32:13.776 INFO:tasks.workunit.client.0.smithi087.stdout:1/762: rename df/d2f/d57/d64/d83/d96/lb1 to df/d18/d1d/d27/d61/l109 0 2024-05-08T05:32:13.776 INFO:tasks.workunit.client.0.smithi087.stdout:1/763: chown df/d18/d1d/d27/d61/c6c 414207 1 2024-05-08T05:32:13.778 INFO:tasks.workunit.client.0.smithi087.stdout:1/764: symlink df/d18/d1d/d27/dd4/l10a 0 2024-05-08T05:32:13.779 INFO:tasks.workunit.client.0.smithi087.stdout:3/853: sync 2024-05-08T05:32:13.779 INFO:tasks.workunit.client.0.smithi087.stdout:0/788: sync 2024-05-08T05:32:13.779 INFO:tasks.workunit.client.0.smithi087.stdout:5/969: sync 2024-05-08T05:32:13.779 INFO:tasks.workunit.client.0.smithi087.stdout:5/970: stat da/db/d2a/d5a/d93/d42/f9d 0 2024-05-08T05:32:13.779 INFO:tasks.workunit.client.0.smithi087.stdout:5/971: fsync da/db/d2a/d5a/d93/d36/d45/d5c/dff/f144 0 2024-05-08T05:32:13.779 INFO:tasks.workunit.client.0.smithi087.stdout:5/972: chown da/db/d2a/d5a/d93/d17/c27 76920 1 2024-05-08T05:32:13.779 INFO:tasks.workunit.client.0.smithi087.stdout:4/852: write d4/d13/f95 [3299225,55236] 0 2024-05-08T05:32:13.781 INFO:tasks.workunit.client.0.smithi087.stdout:1/765: mknod df/d18/d1d/c10b 0 2024-05-08T05:32:13.781 INFO:tasks.workunit.client.0.smithi087.stdout:1/766: stat df/d2f/d6a/l70 0 2024-05-08T05:32:13.781 INFO:tasks.workunit.client.0.smithi087.stdout:3/854: rename d4/d11/f50 to d4/d14/d84/d8b/d8f/dec/f136 0 2024-05-08T05:32:13.782 INFO:tasks.workunit.client.0.smithi087.stdout:2/864: dwrite d7/de/d55/de4/d111/d11c/f38 [0,4194304] 0 2024-05-08T05:32:13.782 INFO:tasks.workunit.client.0.smithi087.stdout:3/855: rmdir d4/d11/d24/d25/d4d/dbb/de9 39 2024-05-08T05:32:13.782 INFO:tasks.workunit.client.0.smithi087.stdout:3/856: stat d4/d11/d24/d39/le3 0 2024-05-08T05:32:13.784 INFO:tasks.workunit.client.0.smithi087.stdout:3/857: unlink d4/d11/d24/d25/d4d/f98 0 2024-05-08T05:32:13.785 INFO:tasks.workunit.client.0.smithi087.stdout:3/858: write d4/d11/d24/d25/d4d/dd6/d121/d87/f113 [738186,90703] 0 2024-05-08T05:32:13.785 INFO:tasks.workunit.client.0.smithi087.stdout:3/859: write d4/d5f/fff [254230,557] 0 2024-05-08T05:32:13.786 INFO:tasks.workunit.client.0.smithi087.stdout:2/865: symlink d7/de/d2c/db6/dcb/l121 0 2024-05-08T05:32:13.786 INFO:tasks.workunit.client.0.smithi087.stdout:3/860: getdents d4/d11/d3d/d110 0 2024-05-08T05:32:13.787 INFO:tasks.workunit.client.0.smithi087.stdout:2/866: mkdir d7/de/d122 0 2024-05-08T05:32:13.789 INFO:tasks.workunit.client.0.smithi087.stdout:2/867: symlink d7/de/d55/de4/d111/l123 0 2024-05-08T05:32:13.790 INFO:tasks.workunit.client.0.smithi087.stdout:2/868: symlink d7/de/d55/de4/d111/d11c/l124 0 2024-05-08T05:32:13.790 INFO:tasks.workunit.client.0.smithi087.stdout:4/853: dread d4/d13/d65/f6f [0,4194304] 0 2024-05-08T05:32:13.790 INFO:tasks.workunit.client.0.smithi087.stdout:2/869: write d7/f18 [9039631,25197] 0 2024-05-08T05:32:13.790 INFO:tasks.workunit.client.0.smithi087.stdout:2/870: readlink d7/la 0 2024-05-08T05:32:13.791 INFO:tasks.workunit.client.0.smithi087.stdout:4/854: mkdir d4/d13/d32/d13e 0 2024-05-08T05:32:13.791 INFO:tasks.workunit.client.0.smithi087.stdout:4/855: fsync d4/d13/d3e/f38 0 2024-05-08T05:32:13.792 INFO:tasks.workunit.client.0.smithi087.stdout:2/871: symlink d7/de/d2c/db6/dcb/l125 0 2024-05-08T05:32:13.792 INFO:tasks.workunit.client.0.smithi087.stdout:8/938: dwrite db/d23/d15/d29/d79/f11b [0,4194304] 0 2024-05-08T05:32:13.792 INFO:tasks.workunit.client.0.smithi087.stdout:8/939: stat db/d23/d3a/d65/d12e 0 2024-05-08T05:32:13.793 INFO:tasks.workunit.client.0.smithi087.stdout:2/872: getdents d7/de/d2c/db6/dcb/db7 0 2024-05-08T05:32:13.794 INFO:tasks.workunit.client.0.smithi087.stdout:1/767: dread df/d2f/d6a/f80 [0,4194304] 0 2024-05-08T05:32:13.796 INFO:tasks.workunit.client.0.smithi087.stdout:2/873: symlink d7/de/d55/de4/d111/d11c/d65/dc2/l126 0 2024-05-08T05:32:13.797 INFO:tasks.workunit.client.0.smithi087.stdout:2/874: chown l0 23503 1 2024-05-08T05:32:13.797 INFO:tasks.workunit.client.0.smithi087.stdout:5/973: unlink da/db/d2a/d5a/d93/d36/d45/f4d 0 2024-05-08T05:32:13.799 INFO:tasks.workunit.client.0.smithi087.stdout:3/861: fsync d4/d14/d84/d8b/d8f/dec/f136 0 2024-05-08T05:32:13.800 INFO:tasks.workunit.client.0.smithi087.stdout:5/974: symlink da/db/d2a/d5a/d93/d42/de8/l149 0 2024-05-08T05:32:13.802 INFO:tasks.workunit.client.0.smithi087.stdout:4/856: dread d4/d13/d3e/d28/d50/d9d/df2/d106/d91/db8/ff7 [0,4194304] 0 2024-05-08T05:32:13.803 INFO:tasks.workunit.client.0.smithi087.stdout:4/857: rename d4/d13/d32/ddb/lc0 to d4/d13/d32/d13e/l13f 0 2024-05-08T05:32:13.804 INFO:tasks.workunit.client.0.smithi087.stdout:5/975: mkdir da/db/d2a/d5a/d93/d36/d45/d5c/d100/d14a 0 2024-05-08T05:32:13.806 INFO:tasks.workunit.client.0.smithi087.stdout:3/862: dread d4/d11/d24/fa6 [0,4194304] 0 2024-05-08T05:32:13.807 INFO:tasks.workunit.client.0.smithi087.stdout:4/858: truncate d4/d6c/d93/fac 768514 0 2024-05-08T05:32:13.810 INFO:tasks.workunit.client.0.smithi087.stdout:5/976: dread da/db/f8f [0,4194304] 0 2024-05-08T05:32:13.810 INFO:tasks.workunit.client.0.smithi087.stdout:1/768: mknod df/d18/d1d/d32/d9c/c10c 0 2024-05-08T05:32:13.810 INFO:tasks.workunit.client.0.smithi087.stdout:6/883: sync 2024-05-08T05:32:13.810 INFO:tasks.workunit.client.0.smithi087.stdout:9/854: sync 2024-05-08T05:32:13.810 INFO:tasks.workunit.client.0.smithi087.stdout:9/855: fsync d1/df/d37/d5b/f6f 0 2024-05-08T05:32:13.811 INFO:tasks.workunit.client.0.smithi087.stdout:9/856: unlink d1/df/l38 0 2024-05-08T05:32:13.812 INFO:tasks.workunit.client.0.smithi087.stdout:1/769: link df/c16 df/d18/d1d/d27/c10d 0 2024-05-08T05:32:13.812 INFO:tasks.workunit.client.0.smithi087.stdout:3/863: symlink d4/d11/d24/d25/d99/l137 0 2024-05-08T05:32:13.813 INFO:tasks.workunit.client.0.smithi087.stdout:1/770: mknod df/d18/d8b/df2/c10e 0 2024-05-08T05:32:13.814 INFO:tasks.workunit.client.0.smithi087.stdout:3/864: creat d4/d11/d24/d25/d3e/d3f/d127/f138 x:0 0 0 2024-05-08T05:32:13.815 INFO:tasks.workunit.client.0.smithi087.stdout:5/977: mkdir da/db/d2a/d5a/d93/d42/d43/d83/d6b/d14b 0 2024-05-08T05:32:13.815 INFO:tasks.workunit.client.0.smithi087.stdout:3/865: creat d4/d11/d24/d39/f139 x:0 0 0 2024-05-08T05:32:13.839 INFO:tasks.workunit.client.0.smithi087.stdout:5/978: dread da/db/d2a/d5a/d93/d36/d45/d5c/dff/f111 [0,4194304] 0 2024-05-08T05:32:13.839 INFO:tasks.workunit.client.0.smithi087.stdout:5/979: truncate da/db/d2a/d5a/d93/d42/d43/d83/fc0 1329346 0 2024-05-08T05:32:13.842 INFO:tasks.workunit.client.0.smithi087.stdout:5/980: rename da/dd/cd8 to da/db/d2a/d5a/d93/d42/d43/d83/ddc/dde/c14c 0 2024-05-08T05:32:13.848 INFO:tasks.workunit.client.0.smithi087.stdout:8/940: dwrite db/d23/d15/d29/d33/f7f [0,4194304] 0 2024-05-08T05:32:13.860 INFO:tasks.workunit.client.0.smithi087.stdout:8/941: write db/d23/d15/d29/d33/d6c/ffb [542273,58860] 0 2024-05-08T05:32:13.862 INFO:tasks.workunit.client.0.smithi087.stdout:8/942: rmdir db/d23/d15/d29/d33 39 2024-05-08T05:32:13.862 INFO:tasks.workunit.client.0.smithi087.stdout:8/943: truncate db/d23/d1b/d7c/f9c 1185536 0 2024-05-08T05:32:13.863 INFO:tasks.workunit.client.0.smithi087.stdout:8/944: mkdir db/d23/d144 0 2024-05-08T05:32:13.865 INFO:tasks.workunit.client.0.smithi087.stdout:1/771: dwrite df/d2f/d57/d64/d83/d96/dcf/ff9 [0,4194304] 0 2024-05-08T05:32:13.867 INFO:tasks.workunit.client.0.smithi087.stdout:1/772: symlink df/d2f/d57/da0/l10f 0 2024-05-08T05:32:13.867 INFO:tasks.workunit.client.0.smithi087.stdout:1/773: truncate df/d18/d1d/d27/fd5 615298 0 2024-05-08T05:32:13.868 INFO:tasks.workunit.client.0.smithi087.stdout:1/774: creat df/d18/deb/f110 x:0 0 0 2024-05-08T05:32:13.877 INFO:tasks.workunit.client.0.smithi087.stdout:4/859: dwrite d4/d13/d32/ddb/f129 [0,4194304] 0 2024-05-08T05:32:13.886 INFO:tasks.workunit.client.0.smithi087.stdout:3/866: dwrite d4/d11/d24/d25/d4d/fc7 [0,4194304] 0 2024-05-08T05:32:13.886 INFO:tasks.workunit.client.0.smithi087.stdout:3/867: dread - d4/d11/d24/d25/d4d/dbb/f128 zero size 2024-05-08T05:32:13.887 INFO:tasks.workunit.client.0.smithi087.stdout:9/857: dwrite d1/f30 [0,4194304] 0 2024-05-08T05:32:13.887 INFO:tasks.workunit.client.0.smithi087.stdout:9/858: write d1/df/d14/d68/d80/d98/d28/f4a [5019298,1355] 0 2024-05-08T05:32:13.888 INFO:tasks.workunit.client.0.smithi087.stdout:3/868: link d4/d11/d24/d25/d3e/d58/d9b/ld8 d4/d11/d24/d39/d94/df7/l13a 0 2024-05-08T05:32:13.889 INFO:tasks.workunit.client.0.smithi087.stdout:2/875: dwrite d7/de/d2c/db6/dcb/db7/dc1/d104/f113 [0,4194304] 0 2024-05-08T05:32:13.890 INFO:tasks.workunit.client.0.smithi087.stdout:5/981: dwrite da/db/d2a/d5a/d93/d36/dc1/fac [0,4194304] 0 2024-05-08T05:32:13.890 INFO:tasks.workunit.client.0.smithi087.stdout:5/982: chown da/db/dd3 551537 1 2024-05-08T05:32:13.892 INFO:tasks.workunit.client.0.smithi087.stdout:9/859: rename d1/df/d73 to d1/d70/d107/d112 0 2024-05-08T05:32:13.892 INFO:tasks.workunit.client.0.smithi087.stdout:9/860: read - d1/df/d37/d5b/d7e/d85/fe1 zero size 2024-05-08T05:32:13.894 INFO:tasks.workunit.client.0.smithi087.stdout:2/876: rename d7/de/c16 to d7/d63/d10c/c127 0 2024-05-08T05:32:13.895 INFO:tasks.workunit.client.0.smithi087.stdout:3/869: creat d4/d14/dfb/d11e/f13b x:0 0 0 2024-05-08T05:32:13.895 INFO:tasks.workunit.client.0.smithi087.stdout:3/870: dread - d4/d14/d84/fb8 zero size 2024-05-08T05:32:13.895 INFO:tasks.workunit.client.0.smithi087.stdout:9/861: link d1/df/d37/d74/lcf d1/df/d14/d18/d8e/da2/de6/l113 0 2024-05-08T05:32:13.897 INFO:tasks.workunit.client.0.smithi087.stdout:2/877: mkdir d7/de/d55/de4/d111/d11c/d128 0 2024-05-08T05:32:13.900 INFO:tasks.workunit.client.0.smithi087.stdout:3/871: creat d4/d14/d84/f13c x:0 0 0 2024-05-08T05:32:13.901 INFO:tasks.workunit.client.0.smithi087.stdout:5/983: mkdir da/db/d2a/d5a/d93/d42/d43/d83/ddc/d14d 0 2024-05-08T05:32:13.903 INFO:tasks.workunit.client.0.smithi087.stdout:5/984: truncate da/db/d2a/d5a/d93/d42/d50/f52 235567 0 2024-05-08T05:32:13.907 INFO:tasks.workunit.client.0.smithi087.stdout:5/985: mkdir da/db/d2a/d5a/d93/d42/d14e 0 2024-05-08T05:32:13.907 INFO:tasks.workunit.client.0.smithi087.stdout:5/986: truncate da/db/d2a/d5a/d93/d36/d45/d5c/d86/fc4 546238 0 2024-05-08T05:32:13.921 INFO:tasks.workunit.client.0.smithi087.stdout:8/945: dwrite db/d23/d1b/d35/d43/d68/d11c/d129/f139 [0,4194304] 0 2024-05-08T05:32:13.921 INFO:tasks.workunit.client.0.smithi087.stdout:5/987: mknod da/dd/d65/c14f 0 2024-05-08T05:32:13.926 INFO:tasks.workunit.client.0.smithi087.stdout:2/878: dread d7/fd [0,4194304] 0 2024-05-08T05:32:13.928 INFO:tasks.workunit.client.0.smithi087.stdout:8/946: creat db/d23/d3a/d65/d83/f145 x:0 0 0 2024-05-08T05:32:13.935 INFO:tasks.workunit.client.0.smithi087.stdout:8/947: rmdir db/d23/d15/d29/db1/d131/d56/d113 39 2024-05-08T05:32:13.935 INFO:tasks.workunit.client.0.smithi087.stdout:8/948: truncate db/d23/d1b/fad 4073441 0 2024-05-08T05:32:13.935 INFO:tasks.workunit.client.0.smithi087.stdout:8/949: write db/d23/d15/d29/d33/d6c/d110/dfe/d11a/f12a [315463,85505] 0 2024-05-08T05:32:13.935 INFO:tasks.workunit.client.0.smithi087.stdout:8/950: truncate db/d23/d15/d29/db1/d131/f98 829951 0 2024-05-08T05:32:13.936 INFO:tasks.workunit.client.0.smithi087.stdout:8/951: stat db/d23/d3a/l140 0 2024-05-08T05:32:13.940 INFO:tasks.workunit.client.0.smithi087.stdout:2/879: dread d7/de/d2c/f89 [0,4194304] 0 2024-05-08T05:32:13.941 INFO:tasks.workunit.client.0.smithi087.stdout:2/880: chown d7/de/d82/dcc/ld2 7640638 1 2024-05-08T05:32:13.941 INFO:tasks.workunit.client.0.smithi087.stdout:4/860: dwrite d4/d13/d3e/d28/d50/d9d/df2/d106/d91/f7c [0,4194304] 0 2024-05-08T05:32:13.941 INFO:tasks.workunit.client.0.smithi087.stdout:4/861: truncate d4/d13/d3e/d28/d50/d9d/df2/d106/d91/db8/dba/d96/dd5/f136 680608 0 2024-05-08T05:32:13.947 INFO:tasks.workunit.client.0.smithi087.stdout:1/775: dwrite df/d18/d1d/d27/f6d [4194304,4194304] 0 2024-05-08T05:32:13.947 INFO:tasks.workunit.client.0.smithi087.stdout:3/872: dwrite d4/d11/d24/d25/d4d/dd6/d121/fe5 [0,4194304] 0 2024-05-08T05:32:13.947 INFO:tasks.workunit.client.0.smithi087.stdout:2/881: getdents d7/de/d55/de4/d111/d11c/d65/dc2 0 2024-05-08T05:32:13.947 INFO:tasks.workunit.client.0.smithi087.stdout:2/882: write d7/de/d2c/f89 [466840,74210] 0 2024-05-08T05:32:13.949 INFO:tasks.workunit.client.0.smithi087.stdout:9/862: dwrite d1/df/d14/d18/d9a/fc3 [0,4194304] 0 2024-05-08T05:32:13.949 INFO:tasks.workunit.client.0.smithi087.stdout:9/863: dread - d1/df/d14/d18/db5/df0/ffe zero size 2024-05-08T05:32:13.949 INFO:tasks.workunit.client.0.smithi087.stdout:9/864: fdatasync d1/df/d14/d68/faa 0 2024-05-08T05:32:13.952 INFO:tasks.workunit.client.0.smithi087.stdout:3/873: rename d4/d11/d24/d39/f139 to d4/d11/d24/d25/d4d/dbb/f13d 0 2024-05-08T05:32:13.952 INFO:tasks.workunit.client.0.smithi087.stdout:3/874: fsync d4/d14/dbe/fcc 0 2024-05-08T05:32:13.965 INFO:tasks.workunit.client.0.smithi087.stdout:4/862: dread f1 [0,4194304] 0 2024-05-08T05:32:13.965 INFO:tasks.workunit.client.0.smithi087.stdout:6/884: sync 2024-05-08T05:32:13.965 INFO:tasks.workunit.client.0.smithi087.stdout:0/789: sync 2024-05-08T05:32:13.968 INFO:tasks.workunit.client.0.smithi087.stdout:4/863: rename d4/d6c/fe0 to d4/d13/d3e/d28/d50/d9d/df2/d106/d91/db8/dba/dbd/f140 0 2024-05-08T05:32:13.970 INFO:tasks.workunit.client.0.smithi087.stdout:0/790: dread d0/da/f5d [0,4194304] 0 2024-05-08T05:32:13.972 INFO:tasks.workunit.client.0.smithi087.stdout:3/875: write d4/d11/d24/d25/d4d/f83 [299987,57142] 0 2024-05-08T05:32:13.972 INFO:tasks.workunit.client.0.smithi087.stdout:4/864: mkdir d4/d13/d3e/d28/d35/d12a/d141 0 2024-05-08T05:32:13.972 INFO:tasks.workunit.client.0.smithi087.stdout:5/988: dwrite da/db/d2a/d5a/d93/d36/f39 [4194304,4194304] 0 2024-05-08T05:32:13.972 INFO:tasks.workunit.client.0.smithi087.stdout:5/989: chown da/db/d2a/d5a/d93/d36/d45/d5c/d100/d14a 0 1 2024-05-08T05:32:13.976 INFO:tasks.workunit.client.0.smithi087.stdout:0/791: mkdir d0/da/d35/d86/d6d/ded/d108/d113 0 2024-05-08T05:32:13.976 INFO:tasks.workunit.client.0.smithi087.stdout:3/876: write d4/d11/d24/d25/d99/fa0 [402352,61010] 0 2024-05-08T05:32:13.976 INFO:tasks.workunit.client.0.smithi087.stdout:4/865: symlink d4/d13/d3e/l142 0 2024-05-08T05:32:13.978 INFO:tasks.workunit.client.0.smithi087.stdout:4/866: mknod d4/d13/d3e/d28/d12f/c143 0 2024-05-08T05:32:13.984 INFO:tasks.workunit.client.0.smithi087.stdout:5/990: rename da/dd to da/db/d2a/d5a/d93/d42/d43/d83/d6b/d9c/d150 0 2024-05-08T05:32:13.987 INFO:tasks.workunit.client.0.smithi087.stdout:5/991: truncate da/db/d2a/d5a/d93/d36/dc1/fac 3207550 0 2024-05-08T05:32:13.989 INFO:tasks.workunit.client.0.smithi087.stdout:5/992: mkdir da/db/d2a/d5a/d93/d42/d43/d83/d6b/d9c/d150/d13/df0/d151 0 2024-05-08T05:32:13.989 INFO:tasks.workunit.client.0.smithi087.stdout:5/993: dread - da/db/d2a/f31 zero size 2024-05-08T05:32:13.993 INFO:tasks.workunit.client.0.smithi087.stdout:2/883: dwrite d7/de/d2c/db0/fe3 [0,4194304] 0 2024-05-08T05:32:13.993 INFO:tasks.workunit.client.0.smithi087.stdout:5/994: symlink da/db/d2a/d5a/d93/d42/d43/d83/d6b/l152 0 2024-05-08T05:32:14.002 INFO:tasks.workunit.client.0.smithi087.stdout:1/776: dwrite df/f3d [0,4194304] 0 2024-05-08T05:32:14.002 INFO:tasks.workunit.client.0.smithi087.stdout:1/777: dread - df/d18/d1d/d27/d90/fc7 zero size 2024-05-08T05:32:14.002 INFO:tasks.workunit.client.0.smithi087.stdout:1/778: read df/d2f/d57/da0/fc4 [2200162,31166] 0 2024-05-08T05:32:14.013 INFO:tasks.workunit.client.0.smithi087.stdout:2/884: rename d7/de/d2c/d43 to d7/d93/d100/d129 0 2024-05-08T05:32:14.014 INFO:tasks.workunit.client.0.smithi087.stdout:2/885: creat d7/de/d55/de4/d111/d11c/d49/db9/f12a x:0 0 0 2024-05-08T05:32:14.015 INFO:tasks.workunit.client.0.smithi087.stdout:2/886: write d7/de/d27/fbb [1245592,100897] 0 2024-05-08T05:32:14.015 INFO:tasks.workunit.client.0.smithi087.stdout:2/887: chown d7/de/d27/dd6 41 1 2024-05-08T05:32:14.018 INFO:tasks.workunit.client.0.smithi087.stdout:2/888: link d7/de/d27/f44 d7/de/d2c/db6/dcb/db7/f12b 0 2024-05-08T05:32:14.018 INFO:tasks.workunit.client.0.smithi087.stdout:2/889: stat d7/de/d55/de4/l105 0 2024-05-08T05:32:14.018 INFO:tasks.workunit.client.0.smithi087.stdout:5/995: dread da/db/d2a/d5a/d93/d36/dc1/fbc [0,4194304] 0 2024-05-08T05:32:14.018 INFO:tasks.workunit.client.0.smithi087.stdout:1/779: dread df/d18/d1d/d32/fc6 [0,4194304] 0 2024-05-08T05:32:14.020 INFO:tasks.workunit.client.0.smithi087.stdout:2/890: rename d7/de/d55/de4/d111/d11c/d65/dc2/l126 to d7/de/d2c/db6/dcb/db7/l12c 0 2024-05-08T05:32:14.020 INFO:tasks.workunit.client.0.smithi087.stdout:1/780: getdents df/d2f/d57/dcb/de1 0 2024-05-08T05:32:14.020 INFO:tasks.workunit.client.0.smithi087.stdout:1/781: fsync df/d18/d1d/fb0 0 2024-05-08T05:32:14.020 INFO:tasks.workunit.client.0.smithi087.stdout:5/996: symlink da/db/d2a/d5a/d93/d36/d45/d5c/d86/l153 0 2024-05-08T05:32:14.022 INFO:tasks.workunit.client.0.smithi087.stdout:1/782: truncate df/d2f/d4f/f93 806250 0 2024-05-08T05:32:14.022 INFO:tasks.workunit.client.0.smithi087.stdout:1/783: fsync df/d18/f1b 0 2024-05-08T05:32:14.022 INFO:tasks.workunit.client.0.smithi087.stdout:2/891: unlink d7/de/d5d/c79 0 2024-05-08T05:32:14.022 INFO:tasks.workunit.client.0.smithi087.stdout:2/892: truncate d7/de/d82/ff5 150483 0 2024-05-08T05:32:14.023 INFO:tasks.workunit.client.0.smithi087.stdout:2/893: creat d7/de/d55/de4/d111/f12d x:0 0 0 2024-05-08T05:32:14.026 INFO:tasks.workunit.client.0.smithi087.stdout:2/894: rename d7/de/f2b to d7/de/d5d/db8/d120/f12e 0 2024-05-08T05:32:14.026 INFO:tasks.workunit.client.0.smithi087.stdout:2/895: stat d7/de/d55/de4/d111/d11c/d65/dc2/l11f 0 2024-05-08T05:32:14.027 INFO:tasks.workunit.client.0.smithi087.stdout:2/896: creat d7/de/d55/de4/d111/d11c/d65/dc2/f12f x:0 0 0 2024-05-08T05:32:14.029 INFO:tasks.workunit.client.0.smithi087.stdout:2/897: unlink d7/l85 0 2024-05-08T05:32:14.030 INFO:tasks.workunit.client.0.smithi087.stdout:0/792: dwrite d0/d22/d3c/f44 [0,4194304] 0 2024-05-08T05:32:14.030 INFO:tasks.workunit.client.0.smithi087.stdout:0/793: fsync d0/da/d35/d86/d74/f53 0 2024-05-08T05:32:14.030 INFO:tasks.workunit.client.0.smithi087.stdout:2/898: creat d7/de/d55/de4/d111/d11c/d128/f130 x:0 0 0 2024-05-08T05:32:14.031 INFO:tasks.workunit.client.0.smithi087.stdout:6/885: dwrite d4/d8/df/d1e/d25/fda [0,4194304] 0 2024-05-08T05:32:14.033 INFO:tasks.workunit.client.0.smithi087.stdout:0/794: mkdir d0/da/d35/d86/d6d/ded/dff/d114 0 2024-05-08T05:32:14.033 INFO:tasks.workunit.client.0.smithi087.stdout:2/899: symlink d7/d93/d100/d129/l131 0 2024-05-08T05:32:14.033 INFO:tasks.workunit.client.0.smithi087.stdout:0/795: write d0/d22/d3c/fb6 [342350,78717] 0 2024-05-08T05:32:14.033 INFO:tasks.workunit.client.0.smithi087.stdout:4/867: dwrite d4/d6c/faf [0,4194304] 0 2024-05-08T05:32:14.034 INFO:tasks.workunit.client.0.smithi087.stdout:6/886: rmdir d4/d8/df/d39/d42/d9e/d6f/d7f/de7/d2d/dca 39 2024-05-08T05:32:14.035 INFO:tasks.workunit.client.0.smithi087.stdout:6/887: truncate d4/d8/df/d39/d42/d9e/d6f/d7f/de7/d2d/d37/d5b/f5f 1421461 0 2024-05-08T05:32:14.035 INFO:tasks.workunit.client.0.smithi087.stdout:6/888: write d4/d8/df/d1e/d25/fc5 [585284,33390] 0 2024-05-08T05:32:14.037 INFO:tasks.workunit.client.0.smithi087.stdout:6/889: creat d4/d8/df/d39/d42/d9e/d6f/d7f/de7/d2d/d37/d9c/d109/f110 x:0 0 0 2024-05-08T05:32:14.037 INFO:tasks.workunit.client.0.smithi087.stdout:6/890: chown d4/d8/df/d39/d42/d9e/d6f/fdf 40891791 1 2024-05-08T05:32:14.040 INFO:tasks.workunit.client.0.smithi087.stdout:3/877: dwrite d4/f6 [0,4194304] 0 2024-05-08T05:32:14.040 INFO:tasks.workunit.client.0.smithi087.stdout:3/878: chown d4/d11/d24/d25/d4d/f68 720815 1 2024-05-08T05:32:14.040 INFO:tasks.workunit.client.0.smithi087.stdout:3/879: fsync d4/d11/d24/d25/d4d/f83 0 2024-05-08T05:32:14.069 INFO:tasks.workunit.client.0.smithi087.stdout:2/900: dread d7/fd [0,4194304] 0 2024-05-08T05:32:14.069 INFO:tasks.workunit.client.0.smithi087.stdout:2/901: chown d7/de/d55/de4/d111/d11c/f47 37422 1 2024-05-08T05:32:14.069 INFO:tasks.workunit.client.0.smithi087.stdout:2/902: stat d7/d93/d100/d129/l131 0 2024-05-08T05:32:14.071 INFO:tasks.workunit.client.0.smithi087.stdout:4/868: dread d4/d13/d3e/f38 [4194304,4194304] 0 2024-05-08T05:32:14.071 INFO:tasks.workunit.client.0.smithi087.stdout:4/869: dread - d4/d13/d3e/d28/d50/d9d/df2/d106/d91/db8/fe2 zero size 2024-05-08T05:32:14.071 INFO:tasks.workunit.client.0.smithi087.stdout:1/784: dwrite df/f3e [0,4194304] 0 2024-05-08T05:32:14.073 INFO:tasks.workunit.client.0.smithi087.stdout:4/870: rmdir d4/d13/d3e/d28/d50/d9d/df2/d100 0 2024-05-08T05:32:14.082 INFO:tasks.workunit.client.0.smithi087.stdout:3/880: dwrite d4/d14/f29 [0,4194304] 0 2024-05-08T05:32:14.084 INFO:tasks.workunit.client.0.smithi087.stdout:6/891: dwrite d4/d8/df/d39/d42/d9e/d6f/d7f/de7/d2d/d37/d5b/f5d [0,4194304] 0 2024-05-08T05:32:14.084 INFO:tasks.workunit.client.0.smithi087.stdout:3/881: mkdir d4/d11/d24/d25/d4d/d13e 0 2024-05-08T05:32:14.084 INFO:tasks.workunit.client.0.smithi087.stdout:1/785: dread df/fbc [0,4194304] 0 2024-05-08T05:32:14.084 INFO:tasks.workunit.client.0.smithi087.stdout:1/786: chown df/d2f/f66 64853 1 2024-05-08T05:32:14.085 INFO:tasks.workunit.client.0.smithi087.stdout:1/787: mkdir df/d2f/d57/d64/d83/d96/dcf/d111 0 2024-05-08T05:32:14.085 INFO:tasks.workunit.client.0.smithi087.stdout:1/788: chown df/d18/d1d/d58/d72/cb7 3 1 2024-05-08T05:32:14.088 INFO:tasks.workunit.client.0.smithi087.stdout:6/892: symlink d4/d8/df/d39/d42/d9e/d6f/d7f/de7/d57/d6d/l111 0 2024-05-08T05:32:14.099 INFO:tasks.workunit.client.0.smithi087.stdout:6/893: dread d4/d8/df/d1e/d25/fc5 [0,4194304] 0 2024-05-08T05:32:14.101 INFO:tasks.workunit.client.0.smithi087.stdout:6/894: symlink d4/d8/df/d39/d42/dbd/df9/l112 0 2024-05-08T05:32:14.103 INFO:tasks.workunit.client.0.smithi087.stdout:6/895: readlink d4/d8/df/d39/d42/lb0 0 2024-05-08T05:32:14.103 INFO:tasks.workunit.client.0.smithi087.stdout:6/896: fdatasync d4/d8/df/d39/d42/dbd/dee/fff 0 2024-05-08T05:32:14.103 INFO:tasks.workunit.client.0.smithi087.stdout:6/897: write d4/f97 [4278960,34915] 0 2024-05-08T05:32:14.103 INFO:tasks.workunit.client.0.smithi087.stdout:6/898: write d4/d6/f13 [3808745,58834] 0 2024-05-08T05:32:14.103 INFO:tasks.workunit.client.0.smithi087.stdout:6/899: symlink d4/d8/df/d39/d42/d9e/da4/l113 0 2024-05-08T05:32:14.103 INFO:tasks.workunit.client.0.smithi087.stdout:6/900: stat d4/d8/df/d39/d42/d9e/d6f/d7f/de3 0 2024-05-08T05:32:14.105 INFO:tasks.workunit.client.0.smithi087.stdout:6/901: creat d4/d8/df/d39/d42/d9e/da4/f114 x:0 0 0 2024-05-08T05:32:14.106 INFO:tasks.workunit.client.0.smithi087.stdout:6/902: mkdir d4/d8/df/d39/d42/d9e/d6f/d7f/de7/d2d/d37/d5b/d115 0 2024-05-08T05:32:14.107 INFO:tasks.workunit.client.0.smithi087.stdout:6/903: stat d4/d8/df/d39/d42/d9e/d6f/d7f/de3/lfb 0 2024-05-08T05:32:14.113 INFO:tasks.workunit.client.0.smithi087.stdout:0/796: dwrite d0/da/d11/f20 [8388608,4194304] 0 2024-05-08T05:32:14.124 INFO:tasks.workunit.client.0.smithi087.stdout:4/871: dwrite d4/d13/d65/fa6 [0,4194304] 0 2024-05-08T05:32:14.125 INFO:tasks.workunit.client.0.smithi087.stdout:4/872: chown d4/d13/d3e/d28/d50/d9d/df2/d106/d91/db8/dba/d96 0 1 2024-05-08T05:32:14.125 INFO:tasks.workunit.client.0.smithi087.stdout:2/903: dwrite d7/de/d55/de4/d111/d11c/fc9 [0,4194304] 0 2024-05-08T05:32:14.150 INFO:tasks.workunit.client.0.smithi087.stdout:3/882: dwrite d4/d11/d24/d25/d3e/d3f/d127/f138 [0,4194304] 0 2024-05-08T05:32:14.160 INFO:tasks.workunit.client.0.smithi087.stdout:4/873: dwrite d4/d13/d3e/d28/d50/d9d/f10f [0,4194304] 0 2024-05-08T05:32:14.177 INFO:tasks.workunit.client.0.smithi087.stdout:2/904: dwrite d7/de/d55/de4/d111/d11c/d65/fad [0,4194304] 0 2024-05-08T05:32:14.178 INFO:tasks.workunit.client.0.smithi087.stdout:2/905: stat d7/de/d55/de4/d111/d11c/c3d 0 2024-05-08T05:32:14.179 INFO:tasks.workunit.client.0.smithi087.stdout:2/906: creat d7/de/d27/dd6/f132 x:0 0 0 2024-05-08T05:32:14.180 INFO:tasks.workunit.client.0.smithi087.stdout:2/907: creat d7/de/f133 x:0 0 0 2024-05-08T05:32:14.183 INFO:tasks.workunit.client.0.smithi087.stdout:2/908: creat d7/de/d55/de4/d111/d11c/d65/dc2/d115/f134 x:0 0 0 2024-05-08T05:32:14.187 INFO:tasks.workunit.client.0.smithi087.stdout:0/797: dwrite d0/d9/d1b/d2f/d54/da1/fbf [0,4194304] 0 2024-05-08T05:32:14.192 INFO:tasks.workunit.client.0.smithi087.stdout:2/909: dread d7/de/d55/de4/d111/d11c/d49/db9/fc0 [0,4194304] 0 2024-05-08T05:32:14.192 INFO:tasks.workunit.client.0.smithi087.stdout:2/910: chown d7/de/d27/fbb 0 1 2024-05-08T05:32:14.194 INFO:tasks.workunit.client.0.smithi087.stdout:2/911: getdents d7/de/d27 0 2024-05-08T05:32:14.195 INFO:tasks.workunit.client.0.smithi087.stdout:0/798: dread d0/da/f5d [0,4194304] 0 2024-05-08T05:32:14.196 INFO:tasks.workunit.client.0.smithi087.stdout:0/799: mknod d0/d9/d1b/d2f/dcc/c115 0 2024-05-08T05:32:14.208 INFO:tasks.workunit.client.0.smithi087.stdout:4/874: dwrite d4/d13/d3e/d28/d50/d9d/df2/d106/d91/db8/dba/d115/f13c [0,4194304] 0 2024-05-08T05:32:14.210 INFO:tasks.workunit.client.0.smithi087.stdout:8/952: sync 2024-05-08T05:32:14.210 INFO:tasks.workunit.client.0.smithi087.stdout:9/865: sync 2024-05-08T05:32:14.212 INFO:tasks.workunit.client.0.smithi087.stdout:8/953: creat db/d23/d15/d29/f146 x:0 0 0 2024-05-08T05:32:14.212 INFO:tasks.workunit.client.0.smithi087.stdout:8/954: dread - db/d23/d15/d29/db1/d131/d56/fcc zero size 2024-05-08T05:32:14.212 INFO:tasks.workunit.client.0.smithi087.stdout:8/955: dread - db/d23/d15/d29/d33/d6c/d110/fe2 zero size 2024-05-08T05:32:14.212 INFO:tasks.workunit.client.0.smithi087.stdout:8/956: write db/d23/d15/d29/db1/d131/d56/d78/fa5 [335186,51007] 0 2024-05-08T05:32:14.213 INFO:tasks.workunit.client.0.smithi087.stdout:9/866: read d1/df/f91 [587619,110409] 0 2024-05-08T05:32:14.214 INFO:tasks.workunit.client.0.smithi087.stdout:8/957: link db/d23/l82 db/d23/d15/d29/d4d/l147 0 2024-05-08T05:32:14.214 INFO:tasks.workunit.client.0.smithi087.stdout:8/958: chown db/d23/d15/d3c/f3f 90891 1 2024-05-08T05:32:14.214 INFO:tasks.workunit.client.0.smithi087.stdout:8/959: fdatasync db/d23/d15/d29/d4d/d96/f128 0 2024-05-08T05:32:14.215 INFO:tasks.workunit.client.0.smithi087.stdout:9/867: rename d1/df/d14/d68/d80/d98/f1f to d1/d70/f114 0 2024-05-08T05:32:14.219 INFO:tasks.workunit.client.0.smithi087.stdout:3/883: dwrite d4/d11/f7e [0,4194304] 0 2024-05-08T05:32:14.225 INFO:tasks.workunit.client.0.smithi087.stdout:5/997: sync 2024-05-08T05:32:14.227 INFO:tasks.workunit.client.0.smithi087.stdout:5/998: mknod da/db/d2a/d5a/d93/d42/d43/d83/ddc/c154 0 2024-05-08T05:32:14.228 INFO:tasks.workunit.client.0.smithi087.stdout:3/884: symlink d4/d11/d3d/d4e/d6a/l13f 0 2024-05-08T05:32:14.230 INFO:tasks.workunit.client.0.smithi087.stdout:3/885: creat d4/d11/d24/d25/d3e/d3f/dc0/f140 x:0 0 0 2024-05-08T05:32:14.230 INFO:tasks.workunit.client.0.smithi087.stdout:3/886: fdatasync d4/d11/d24/d25/d3e/d3f/dc0/f140 0 2024-05-08T05:32:14.232 INFO:tasks.workunit.client.0.smithi087.stdout:2/912: dwrite d7/d63/fca [0,4194304] 0 2024-05-08T05:32:14.233 INFO:tasks.workunit.client.0.smithi087.stdout:5/999: rmdir da/db/d2a/d5a/d93/d17/d99 39 2024-05-08T05:32:14.244 INFO:tasks.workunit.client.0.smithi087.stdout:9/868: write d1/df/d14/d18/d9a/fc3 [2220594,18196] 0 2024-05-08T05:32:14.246 INFO:tasks.workunit.client.0.smithi087.stdout:9/869: rmdir d1/df/d14/d54/d61 39 2024-05-08T05:32:14.247 INFO:tasks.workunit.client.0.smithi087.stdout:2/913: write d7/d63/fea [1115155,71159] 0 2024-05-08T05:32:14.247 INFO:tasks.workunit.client.0.smithi087.stdout:2/914: dread - d7/de/d27/f9f zero size 2024-05-08T05:32:14.247 INFO:tasks.workunit.client.0.smithi087.stdout:4/875: dwrite d4/f10 [0,4194304] 0 2024-05-08T05:32:14.247 INFO:tasks.workunit.client.0.smithi087.stdout:9/870: rmdir d1/df 39 2024-05-08T05:32:14.248 INFO:tasks.workunit.client.0.smithi087.stdout:2/915: rename l0 to d7/d63/dac/l135 0 2024-05-08T05:32:14.248 INFO:tasks.workunit.client.0.smithi087.stdout:2/916: write d7/de/d2c/db6/dcb/db7/dc1/d104/f113 [4773570,44882] 0 2024-05-08T05:32:14.249 INFO:tasks.workunit.client.0.smithi087.stdout:4/876: creat d4/f144 x:0 0 0 2024-05-08T05:32:14.250 INFO:tasks.workunit.client.0.smithi087.stdout:9/871: symlink d1/df/d37/d74/l115 0 2024-05-08T05:32:14.251 INFO:tasks.workunit.client.0.smithi087.stdout:2/917: mkdir d7/d63/d10c/d136 0 2024-05-08T05:32:14.252 INFO:tasks.workunit.client.0.smithi087.stdout:4/877: mkdir d4/d13/d65/dd7/d145 0 2024-05-08T05:32:14.253 INFO:tasks.workunit.client.0.smithi087.stdout:9/872: symlink d1/df/d14/d68/d80/d98/d28/d4b/dd0/l116 0 2024-05-08T05:32:14.253 INFO:tasks.workunit.client.0.smithi087.stdout:2/918: getdents d7/de/d55/de4/d111/d11c/d65/dc2/d115 0 2024-05-08T05:32:14.257 INFO:tasks.workunit.client.0.smithi087.stdout:4/878: getdents d4/d13/d3e 0 2024-05-08T05:32:14.258 INFO:tasks.workunit.client.0.smithi087.stdout:2/919: creat d7/de/d5d/d90/df1/f137 x:0 0 0 2024-05-08T05:32:14.258 INFO:tasks.workunit.client.0.smithi087.stdout:9/873: unlink d1/c8c 0 2024-05-08T05:32:14.261 INFO:tasks.workunit.client.0.smithi087.stdout:4/879: creat d4/d13/d3e/d28/d50/d9d/df2/d106/d91/db8/dba/d63/f146 x:0 0 0 2024-05-08T05:32:14.261 INFO:tasks.workunit.client.0.smithi087.stdout:4/880: chown d4/d13/d3e/d28/d50/d9d/df2/d106/d91/db8/dba/d63/f146 76 1 2024-05-08T05:32:14.261 INFO:tasks.workunit.client.0.smithi087.stdout:9/874: rename d1/df/d14/d68/d80/d98/d28/f42 to d1/df/d14/d54/d61/d88/dca/df4/f117 0 2024-05-08T05:32:14.262 INFO:tasks.workunit.client.0.smithi087.stdout:9/875: creat d1/d70/f118 x:0 0 0 2024-05-08T05:32:14.262 INFO:tasks.workunit.client.0.smithi087.stdout:9/876: fsync d1/df/d14/d54/d61/d88/fa7 0 2024-05-08T05:32:14.262 INFO:tasks.workunit.client.0.smithi087.stdout:9/877: readlink d1/df/l59 0 2024-05-08T05:32:14.263 INFO:tasks.workunit.client.0.smithi087.stdout:9/878: creat d1/df/d37/d5b/def/f119 x:0 0 0 2024-05-08T05:32:14.263 INFO:tasks.workunit.client.0.smithi087.stdout:9/879: fsync d1/df/d14/d18/f1e 0 2024-05-08T05:32:14.263 INFO:tasks.workunit.client.0.smithi087.stdout:9/880: fsync d1/fd 0 2024-05-08T05:32:14.265 INFO:tasks.workunit.client.0.smithi087.stdout:9/881: mkdir d1/df/d14/d54/d61/d72/d106/d11a 0 2024-05-08T05:32:14.265 INFO:tasks.workunit.client.0.smithi087.stdout:9/882: read - d1/df/d14/d68/d80/d8b/fce zero size 2024-05-08T05:32:14.266 INFO:tasks.workunit.client.0.smithi087.stdout:9/883: mkdir d1/df/d14/d18/d8e/da2/de6/d11b 0 2024-05-08T05:32:14.271 INFO:tasks.workunit.client.0.smithi087.stdout:8/960: dwrite db/d23/d15/d29/d4d/d96/ff2 [0,4194304] 0 2024-05-08T05:32:14.271 INFO:tasks.workunit.client.0.smithi087.stdout:8/961: chown db/d23/d3a/d65/l101 809485 1 2024-05-08T05:32:14.272 INFO:tasks.workunit.client.0.smithi087.stdout:8/962: write db/d23/d15/f72 [186900,112356] 0 2024-05-08T05:32:14.278 INFO:tasks.workunit.client.0.smithi087.stdout:4/881: dread d4/d13/f23 [0,4194304] 0 2024-05-08T05:32:14.280 INFO:tasks.workunit.client.0.smithi087.stdout:4/882: creat d4/d13/d3e/d28/d50/d9d/df2/d106/d91/db8/dba/d96/f147 x:0 0 0 2024-05-08T05:32:14.281 INFO:tasks.workunit.client.0.smithi087.stdout:4/883: stat d4/d13/d3e/d28/d50/c119 0 2024-05-08T05:32:14.284 INFO:tasks.workunit.client.0.smithi087.stdout:4/884: rename d4/d13/d32/d13e to d4/d6c/d148 0 2024-05-08T05:32:14.286 INFO:tasks.workunit.client.0.smithi087.stdout:4/885: creat d4/d13/d3e/d28/d50/d9d/df2/d106/d91/db8/dba/dbd/f149 x:0 0 0 2024-05-08T05:32:14.287 INFO:tasks.workunit.client.0.smithi087.stdout:4/886: mknod d4/d13/d3e/d28/d50/c14a 0 2024-05-08T05:32:14.287 INFO:tasks.workunit.client.0.smithi087.stdout:4/887: chown d4/d6c/d93/ffd 217 1 2024-05-08T05:32:14.288 INFO:tasks.workunit.client.0.smithi087.stdout:4/888: mkdir d4/d13/d3e/d28/d35/d107/d14b 0 2024-05-08T05:32:14.290 INFO:tasks.workunit.client.0.smithi087.stdout:4/889: mknod d4/d13/d3e/d28/d50/d9d/df2/d106/d91/db8/dba/d96/c14c 0 2024-05-08T05:32:14.291 INFO:tasks.workunit.client.0.smithi087.stdout:8/963: dread db/d23/d1b/d35/d43/d68/f7a [0,4194304] 0 2024-05-08T05:32:14.291 INFO:tasks.workunit.client.0.smithi087.stdout:8/964: fsync db/d23/d1b/d35/d43/fd0 0 2024-05-08T05:32:14.291 INFO:tasks.workunit.client.0.smithi087.stdout:8/965: chown db/d23/d15/d29/c137 214871 1 2024-05-08T05:32:14.292 INFO:tasks.workunit.client.0.smithi087.stdout:4/890: mknod d4/d6c/d93/d11b/c14d 0 2024-05-08T05:32:14.293 INFO:tasks.workunit.client.0.smithi087.stdout:4/891: creat d4/d13/d3e/d28/d50/d9d/df2/d106/d91/db8/dba/d115/f14e x:0 0 0 2024-05-08T05:32:14.295 INFO:tasks.workunit.client.0.smithi087.stdout:6/904: sync 2024-05-08T05:32:14.295 INFO:tasks.workunit.client.0.smithi087.stdout:1/789: sync 2024-05-08T05:32:14.295 INFO:tasks.workunit.client.0.smithi087.stdout:6/905: truncate d4/d8/df/d39/d42/d9e/da4/f114 145859 0 2024-05-08T05:32:14.301 INFO:tasks.workunit.client.0.smithi087.stdout:4/892: dread d4/d13/d3e/d28/f39 [0,4194304] 0 2024-05-08T05:32:14.302 INFO:tasks.workunit.client.0.smithi087.stdout:4/893: mkdir d4/d13/d3e/d28/d35/d107/d14f 0 2024-05-08T05:32:14.304 INFO:tasks.workunit.client.0.smithi087.stdout:9/884: dwrite d1/df/d14/d18/d66/fea [0,4194304] 0 2024-05-08T05:32:14.304 INFO:tasks.workunit.client.0.smithi087.stdout:6/906: dread d4/d8/df/d39/d42/d9e/d6f/f8b [0,4194304] 0 2024-05-08T05:32:14.306 INFO:tasks.workunit.client.0.smithi087.stdout:9/885: creat d1/d70/d107/d112/f11c x:0 0 0 2024-05-08T05:32:14.309 INFO:tasks.workunit.client.0.smithi087.stdout:9/886: creat d1/df/d58/d5e/f11d x:0 0 0 2024-05-08T05:32:14.326 INFO:tasks.workunit.client.0.smithi087.stdout:9/887: dread d1/f21 [0,4194304] 0 2024-05-08T05:32:14.353 INFO:tasks.workunit.client.0.smithi087.stdout:8/966: dwrite db/d23/d15/d3c/f3e [4194304,4194304] 0 2024-05-08T05:32:14.358 INFO:tasks.workunit.client.0.smithi087.stdout:8/967: mknod db/d23/d15/d3c/c148 0 2024-05-08T05:32:14.361 INFO:tasks.workunit.client.0.smithi087.stdout:4/894: dwrite d4/d6c/f99 [0,4194304] 0 2024-05-08T05:32:14.361 INFO:tasks.workunit.client.0.smithi087.stdout:4/895: stat d4/d13/d3e/d28/d50/d9d/df2/d106/d91/db8/dba/d96/f147 0 2024-05-08T05:32:14.364 INFO:tasks.workunit.client.0.smithi087.stdout:4/896: mkdir d4/d13/d3e/d28/d35/d107/d14f/d150 0 2024-05-08T05:32:14.364 INFO:tasks.workunit.client.0.smithi087.stdout:4/897: dread - d4/d13/d3e/d28/f10a zero size 2024-05-08T05:32:14.364 INFO:tasks.workunit.client.0.smithi087.stdout:4/898: chown d4/d13/d3e/d28/d50/d9d/df2/d106/d91/d84/cc5 0 1 2024-05-08T05:32:14.364 INFO:tasks.workunit.client.0.smithi087.stdout:4/899: truncate d4/d6c/f124 636117 0 2024-05-08T05:32:14.366 INFO:tasks.workunit.client.0.smithi087.stdout:4/900: symlink d4/d13/d3e/d28/d50/d9d/df2/d106/d91/db8/dba/d96/l151 0 2024-05-08T05:32:14.372 INFO:tasks.workunit.client.0.smithi087.stdout:9/888: dwrite d1/df/d14/d18/f44 [0,4194304] 0 2024-05-08T05:32:14.386 INFO:tasks.workunit.client.0.smithi087.stdout:4/901: write d4/d13/d3e/d28/d50/d9d/df2/d106/d91/fe5 [1367518,106872] 0 2024-05-08T05:32:14.386 INFO:tasks.workunit.client.0.smithi087.stdout:4/902: chown d4/d13/d3e/d28/d50/d9d/df2/d106/d91/db8/dba/d63/cce 10 1 2024-05-08T05:32:14.387 INFO:tasks.workunit.client.0.smithi087.stdout:4/903: creat d4/d13/d3e/d28/d50/d13b/f152 x:0 0 0 2024-05-08T05:32:14.388 INFO:tasks.workunit.client.0.smithi087.stdout:4/904: getdents d4/d13/d32 0 2024-05-08T05:32:14.389 INFO:tasks.workunit.client.0.smithi087.stdout:4/905: creat d4/d6c/d148/f153 x:0 0 0 2024-05-08T05:32:14.391 INFO:tasks.workunit.client.0.smithi087.stdout:4/906: rename d4/d6c/d148/f153 to d4/d13/d3e/d28/d50/d9d/df2/d106/d91/db8/dba/d115/f154 0 2024-05-08T05:32:14.392 INFO:tasks.workunit.client.0.smithi087.stdout:4/907: unlink d4/d13/d3e/d28/d50/d9d/fd8 0 2024-05-08T05:32:14.392 INFO:tasks.workunit.client.0.smithi087.stdout:4/908: getdents d4/d13/d65/dd7/d145 0 2024-05-08T05:32:14.393 INFO:tasks.workunit.client.0.smithi087.stdout:4/909: link d4/d13/d3e/d28/d12f/f137 d4/d13/d3e/d28/d35/d12a/d141/f155 0 2024-05-08T05:32:14.394 INFO:tasks.workunit.client.0.smithi087.stdout:4/910: mknod d4/d13/d3e/d28/d35/d107/d14b/c156 0 2024-05-08T05:32:14.395 INFO:tasks.workunit.client.0.smithi087.stdout:4/911: truncate d4/d13/d3e/d28/d50/d9d/df2/d106/ff5 2668363 0 2024-05-08T05:32:14.395 INFO:tasks.workunit.client.0.smithi087.stdout:4/912: stat d4/d13/d65/c7e 0 2024-05-08T05:32:14.405 INFO:tasks.workunit.client.0.smithi087.stdout:6/907: dwrite d4/d8/faa [4194304,4194304] 0 2024-05-08T05:32:14.407 INFO:tasks.workunit.client.0.smithi087.stdout:6/908: creat d4/d8/df/d39/d42/d9e/d6f/d7f/de7/d2d/d37/dea/f116 x:0 0 0 2024-05-08T05:32:14.420 INFO:tasks.workunit.client.0.smithi087.stdout:4/913: dread d4/d13/d32/f45 [0,4194304] 0 2024-05-08T05:32:14.421 INFO:tasks.workunit.client.0.smithi087.stdout:4/914: creat d4/d13/d3e/d28/d35/d12a/d141/f157 x:0 0 0 2024-05-08T05:32:14.422 INFO:tasks.workunit.client.0.smithi087.stdout:8/968: dwrite db/d23/f136 [0,4194304] 0 2024-05-08T05:32:14.423 INFO:tasks.workunit.client.0.smithi087.stdout:4/915: symlink d4/d13/d3e/d28/d35/d107/d14f/d150/l158 0 2024-05-08T05:32:14.430 INFO:tasks.workunit.client.0.smithi087.stdout:2/920: sync 2024-05-08T05:32:14.430 INFO:tasks.workunit.client.0.smithi087.stdout:3/887: sync 2024-05-08T05:32:14.430 INFO:tasks.workunit.client.0.smithi087.stdout:0/800: sync 2024-05-08T05:32:14.430 INFO:tasks.workunit.client.0.smithi087.stdout:1/790: sync 2024-05-08T05:32:14.430 INFO:tasks.workunit.client.0.smithi087.stdout:2/921: chown d7/de/d2c/cec 68107767 1 2024-05-08T05:32:14.431 INFO:tasks.workunit.client.0.smithi087.stdout:2/922: mkdir d7/d63/d10c/d136/d138 0 2024-05-08T05:32:14.432 INFO:tasks.workunit.client.0.smithi087.stdout:3/888: rename d4/d11/d3d/d4e/d6a/c91 to d4/d11/d24/d25/d4d/dd6/d121/d87/da5/d120/c141 0 2024-05-08T05:32:14.436 INFO:tasks.workunit.client.0.smithi087.stdout:0/801: truncate d0/da/d11/f20 798762 0 2024-05-08T05:32:14.436 INFO:tasks.workunit.client.0.smithi087.stdout:0/802: fsync d0/d57/d24/d66/f6e 0 2024-05-08T05:32:14.437 INFO:tasks.workunit.client.0.smithi087.stdout:0/803: creat d0/dd0/f116 x:0 0 0 2024-05-08T05:32:14.446 INFO:tasks.workunit.client.0.smithi087.stdout:3/889: symlink d4/l142 0 2024-05-08T05:32:14.447 INFO:tasks.workunit.client.0.smithi087.stdout:3/890: creat d4/d11/d24/d25/d4d/dd6/d121/d87/f143 x:0 0 0 2024-05-08T05:32:14.448 INFO:tasks.workunit.client.0.smithi087.stdout:4/916: write d4/d13/d3e/f38 [2127951,58860] 0 2024-05-08T05:32:14.448 INFO:tasks.workunit.client.0.smithi087.stdout:4/917: write d4/d13/d3e/d28/d50/f123 [329129,52005] 0 2024-05-08T05:32:14.450 INFO:tasks.workunit.client.0.smithi087.stdout:3/891: link d4/d11/d24/d25/d99/da2/l102 d4/d14/dfc/l144 0 2024-05-08T05:32:14.450 INFO:tasks.workunit.client.0.smithi087.stdout:3/892: dread - d4/d11/d24/f115 zero size 2024-05-08T05:32:14.450 INFO:tasks.workunit.client.0.smithi087.stdout:4/918: creat d4/d13/d3e/d28/f159 x:0 0 0 2024-05-08T05:32:14.453 INFO:tasks.workunit.client.0.smithi087.stdout:4/919: creat d4/d13/d3e/d28/d50/d9d/df2/d106/d91/d84/f15a x:0 0 0 2024-05-08T05:32:14.453 INFO:tasks.workunit.client.0.smithi087.stdout:4/920: stat d4/d13/d3e/d28/d35 0 2024-05-08T05:32:14.461 INFO:tasks.workunit.client.0.smithi087.stdout:4/921: dread d4/d13/d3e/d28/d12f/f137 [0,4194304] 0 2024-05-08T05:32:14.486 INFO:tasks.workunit.client.0.smithi087.stdout:1/791: dwrite df/d18/d1d/d58/d72/f5f [0,4194304] 0 2024-05-08T05:32:14.488 INFO:tasks.workunit.client.0.smithi087.stdout:1/792: mkdir df/d18/dbe/d112 0 2024-05-08T05:32:14.488 INFO:tasks.workunit.client.0.smithi087.stdout:1/793: chown df/d2f/f9a 19442 1 2024-05-08T05:32:14.489 INFO:tasks.workunit.client.0.smithi087.stdout:1/794: symlink df/d18/dbe/d112/l113 0 2024-05-08T05:32:14.490 INFO:tasks.workunit.client.0.smithi087.stdout:1/795: mknod df/d2f/d57/c114 0 2024-05-08T05:32:14.490 INFO:tasks.workunit.client.0.smithi087.stdout:1/796: fsync df/d18/d1d/d58/d72/fde 0 2024-05-08T05:32:14.491 INFO:tasks.workunit.client.0.smithi087.stdout:1/797: getdents df/d2f/d57/d64/d83/d96/dcf 0 2024-05-08T05:32:14.493 INFO:tasks.workunit.client.0.smithi087.stdout:1/798: creat df/d18/d8b/f115 x:0 0 0 2024-05-08T05:32:14.494 INFO:tasks.workunit.client.0.smithi087.stdout:1/799: fdatasync df/d2f/d57/d64/f29 0 2024-05-08T05:32:14.508 INFO:tasks.workunit.client.0.smithi087.stdout:8/969: dwrite db/d23/d54/f74 [4194304,4194304] 0 2024-05-08T05:32:14.508 INFO:tasks.workunit.client.0.smithi087.stdout:3/893: dwrite d4/d11/d3d/f8e [4194304,4194304] 0 2024-05-08T05:32:14.508 INFO:tasks.workunit.client.0.smithi087.stdout:3/894: fsync d4/d14/d84/fb8 0 2024-05-08T05:32:14.509 INFO:tasks.workunit.client.0.smithi087.stdout:8/970: mknod db/d23/d15/d29/c149 0 2024-05-08T05:32:14.509 INFO:tasks.workunit.client.0.smithi087.stdout:2/923: dwrite d7/de/f64 [4194304,4194304] 0 2024-05-08T05:32:14.510 INFO:tasks.workunit.client.0.smithi087.stdout:3/895: mknod d4/d11/d24/d25/d3e/d58/d9b/c145 0 2024-05-08T05:32:14.511 INFO:tasks.workunit.client.0.smithi087.stdout:4/922: dwrite d4/d13/d3e/d28/f132 [0,4194304] 0 2024-05-08T05:32:14.511 INFO:tasks.workunit.client.0.smithi087.stdout:4/923: truncate f1 5071803 0 2024-05-08T05:32:14.511 INFO:tasks.workunit.client.0.smithi087.stdout:8/971: getdents db/d23/d1b/d35/d43/d68/d11c/d129 0 2024-05-08T05:32:14.512 INFO:tasks.workunit.client.0.smithi087.stdout:2/924: getdents d7/de/d55/de4/d111/d11c/d65/dc2 0 2024-05-08T05:32:14.512 INFO:tasks.workunit.client.0.smithi087.stdout:8/972: getdents db/d23/d15/d29/d4d 0 2024-05-08T05:32:14.513 INFO:tasks.workunit.client.0.smithi087.stdout:8/973: rmdir db/d23/d15/d29/d79/d11d 39 2024-05-08T05:32:14.515 INFO:tasks.workunit.client.0.smithi087.stdout:3/896: creat d4/f146 x:0 0 0 2024-05-08T05:32:14.515 INFO:tasks.workunit.client.0.smithi087.stdout:1/800: getdents df/d18/dbe/d112 0 2024-05-08T05:32:14.515 INFO:tasks.workunit.client.0.smithi087.stdout:4/924: creat d4/d13/d3e/d28/d50/d13b/f15b x:0 0 0 2024-05-08T05:32:14.519 INFO:tasks.workunit.client.0.smithi087.stdout:8/974: rename db/d23/d1b/d35/d43/f11f to db/d23/d15/d29/d4d/d96/f14a 0 2024-05-08T05:32:14.520 INFO:tasks.workunit.client.0.smithi087.stdout:2/925: mknod d7/de/d55/de4/d111/d11c/d65/dc2/c139 0 2024-05-08T05:32:14.520 INFO:tasks.workunit.client.0.smithi087.stdout:2/926: chown d7/d63/l3c 7 1 2024-05-08T05:32:14.520 INFO:tasks.workunit.client.0.smithi087.stdout:3/897: mknod d4/d11/d24/d39/d5a/c147 0 2024-05-08T05:32:14.520 INFO:tasks.workunit.client.0.smithi087.stdout:3/898: chown d4/d11/d24/d25/d4d/dd6/d121/d87/da5/d120/c141 3 1 2024-05-08T05:32:14.520 INFO:tasks.workunit.client.0.smithi087.stdout:3/899: chown d4/d11/l67 871 1 2024-05-08T05:32:14.520 INFO:tasks.workunit.client.0.smithi087.stdout:3/900: dread - d4/d11/d24/f115 zero size 2024-05-08T05:32:14.520 INFO:tasks.workunit.client.0.smithi087.stdout:2/927: rename d7/d63/d10c/d136 to d7/d63/d10c/d13a 0 2024-05-08T05:32:14.520 INFO:tasks.workunit.client.0.smithi087.stdout:1/801: creat df/d18/d1d/d58/d72/dc5/f116 x:0 0 0 2024-05-08T05:32:14.520 INFO:tasks.workunit.client.0.smithi087.stdout:1/802: fdatasync df/d2f/d57/d64/fac 0 2024-05-08T05:32:14.520 INFO:tasks.workunit.client.0.smithi087.stdout:2/928: mkdir d7/de/d78/d13b 0 2024-05-08T05:32:14.521 INFO:tasks.workunit.client.0.smithi087.stdout:3/901: mknod d4/d11/d24/d25/d3e/d3f/dc0/c148 0 2024-05-08T05:32:14.521 INFO:tasks.workunit.client.0.smithi087.stdout:3/902: chown d4/d11/d24/d25/d4d/dd6/d121/d87/f9f 15332689 1 2024-05-08T05:32:14.521 INFO:tasks.workunit.client.0.smithi087.stdout:3/903: chown d4/d11/d24/d25/d99/da2/df9 80146 1 2024-05-08T05:32:14.522 INFO:tasks.workunit.client.0.smithi087.stdout:2/929: rename d7/de/d5d/d90/df1/f137 to d7/de/d78/f13c 0 2024-05-08T05:32:14.523 INFO:tasks.workunit.client.0.smithi087.stdout:9/889: sync 2024-05-08T05:32:14.523 INFO:tasks.workunit.client.0.smithi087.stdout:9/890: write d1/df/d37/f51 [2322683,115165] 0 2024-05-08T05:32:14.525 INFO:tasks.workunit.client.0.smithi087.stdout:3/904: rename d4/d14/dfb to d4/d11/d24/d25/d4d/d13e/d149 0 2024-05-08T05:32:14.526 INFO:tasks.workunit.client.0.smithi087.stdout:2/930: mkdir d7/d63/d10c/d13d 0 2024-05-08T05:32:14.528 INFO:tasks.workunit.client.0.smithi087.stdout:1/803: write df/f1f [1110698,110022] 0 2024-05-08T05:32:14.533 INFO:tasks.workunit.client.0.smithi087.stdout:2/931: read d7/de/fe6 [349236,21276] 0 2024-05-08T05:32:14.533 INFO:tasks.workunit.client.0.smithi087.stdout:1/804: rename df/d2f/d57/dcb/lf6 to df/d2f/d4f/l117 0 2024-05-08T05:32:14.533 INFO:tasks.workunit.client.0.smithi087.stdout:1/805: fsync df/f4d 0 2024-05-08T05:32:14.533 INFO:tasks.workunit.client.0.smithi087.stdout:1/806: truncate df/d18/d1d/d58/ff5 589093 0 2024-05-08T05:32:14.533 INFO:tasks.workunit.client.0.smithi087.stdout:1/807: write df/d2f/d4f/d52/fbd [977949,80141] 0 2024-05-08T05:32:14.541 INFO:tasks.workunit.client.0.smithi087.stdout:8/975: write db/d23/d15/d29/f32 [6356574,106344] 0 2024-05-08T05:32:14.541 INFO:tasks.workunit.client.0.smithi087.stdout:8/976: fdatasync db/d23/d1b/d4b/f69 0 2024-05-08T05:32:14.541 INFO:tasks.workunit.client.0.smithi087.stdout:8/977: write db/d23/d15/d29/d4d/fec [554870,18547] 0 2024-05-08T05:32:14.547 INFO:tasks.workunit.client.0.smithi087.stdout:8/978: mknod db/d23/d3a/d65/d12e/c14b 0 2024-05-08T05:32:14.548 INFO:tasks.workunit.client.0.smithi087.stdout:1/808: dread df/d18/f1b [0,4194304] 0 2024-05-08T05:32:14.548 INFO:tasks.workunit.client.0.smithi087.stdout:1/809: chown df/d18/d1d/d58/d72/cb7 249 1 2024-05-08T05:32:14.549 INFO:tasks.workunit.client.0.smithi087.stdout:1/810: rmdir df/d2f/d57/dcb/de1 39 2024-05-08T05:32:14.549 INFO:tasks.workunit.client.0.smithi087.stdout:1/811: fdatasync df/d2f/d57/dcb/de1/fed 0 2024-05-08T05:32:14.550 INFO:tasks.workunit.client.0.smithi087.stdout:1/812: mkdir df/d2f/d57/dcb/d118 0 2024-05-08T05:32:14.550 INFO:tasks.workunit.client.0.smithi087.stdout:1/813: read df/d18/d1d/f2d [782265,71984] 0 2024-05-08T05:32:14.552 INFO:tasks.workunit.client.0.smithi087.stdout:1/814: truncate df/d18/d1d/f48 1817995 0 2024-05-08T05:32:14.558 INFO:tasks.workunit.client.0.smithi087.stdout:6/909: sync 2024-05-08T05:32:14.558 INFO:tasks.workunit.client.0.smithi087.stdout:6/910: readlink d4/d8/df/d1e/d25/l46 0 2024-05-08T05:32:14.560 INFO:tasks.workunit.client.0.smithi087.stdout:6/911: mkdir d4/d8/df/d39/d42/d9e/d6f/d7f/de7/d57/d117 0 2024-05-08T05:32:14.560 INFO:tasks.workunit.client.0.smithi087.stdout:6/912: fdatasync d4/d8/df/d39/d42/d9e/d6f/d7f/de7/d2d/d37/d9c/d109/fe8 0 2024-05-08T05:32:14.561 INFO:tasks.workunit.client.0.smithi087.stdout:6/913: mknod d4/d8/df/d39/d42/d9e/d6f/d7f/de7/d2d/d37/c118 0 2024-05-08T05:32:14.563 INFO:tasks.workunit.client.0.smithi087.stdout:8/979: dread db/d23/d15/f19 [0,4194304] 0 2024-05-08T05:32:14.563 INFO:tasks.workunit.client.0.smithi087.stdout:8/980: fdatasync db/d23/d3a/d65/f6e 0 2024-05-08T05:32:14.563 INFO:tasks.workunit.client.0.smithi087.stdout:8/981: write db/d23/d15/d29/d79/fc7 [293125,104669] 0 2024-05-08T05:32:14.563 INFO:tasks.workunit.client.0.smithi087.stdout:8/982: stat db/d23/d1b/f30 0 2024-05-08T05:32:14.564 INFO:tasks.workunit.client.0.smithi087.stdout:6/914: mkdir d4/d8/df/d39/d42/d9e/d6f/d7f/de7/d2d/dca/d119 0 2024-05-08T05:32:14.564 INFO:tasks.workunit.client.0.smithi087.stdout:6/915: chown d4/d8/df/d39/d42/d9e/d6f/d7f/de7/d57/c7c 11389971 1 2024-05-08T05:32:14.564 INFO:tasks.workunit.client.0.smithi087.stdout:6/916: write d4/d8/df/d39/d42/d9e/ff5 [561328,120549] 0 2024-05-08T05:32:14.567 INFO:tasks.workunit.client.0.smithi087.stdout:8/983: getdents db/d23/d1b/d35/d43/d68 0 2024-05-08T05:32:14.567 INFO:tasks.workunit.client.0.smithi087.stdout:8/984: write db/d23/d15/d29/d33/f114 [578622,71792] 0 2024-05-08T05:32:14.569 INFO:tasks.workunit.client.0.smithi087.stdout:1/815: dread df/d2f/d4f/f79 [0,4194304] 0 2024-05-08T05:32:14.569 INFO:tasks.workunit.client.0.smithi087.stdout:1/816: dread - df/d18/d1d/d58/fd3 zero size 2024-05-08T05:32:14.569 INFO:tasks.workunit.client.0.smithi087.stdout:1/817: truncate df/d2f/fdd 493735 0 2024-05-08T05:32:14.571 INFO:tasks.workunit.client.0.smithi087.stdout:4/925: dwrite d4/d6c/f124 [0,4194304] 0 2024-05-08T05:32:14.571 INFO:tasks.workunit.client.0.smithi087.stdout:1/818: mkdir df/d2f/d57/dcb/d119 0 2024-05-08T05:32:14.571 INFO:tasks.workunit.client.0.smithi087.stdout:1/819: dread - df/d18/d8b/f115 zero size 2024-05-08T05:32:14.571 INFO:tasks.workunit.client.0.smithi087.stdout:1/820: fsync df/d2f/d57/d64/d83/d96/fc2 0 2024-05-08T05:32:14.571 INFO:tasks.workunit.client.0.smithi087.stdout:1/821: write df/d2f/f3c [1697267,27181] 0 2024-05-08T05:32:14.572 INFO:tasks.workunit.client.0.smithi087.stdout:1/822: creat df/d18/d1d/d27/dd4/f11a x:0 0 0 2024-05-08T05:32:14.572 INFO:tasks.workunit.client.0.smithi087.stdout:1/823: stat df/d18/d1d/ffa 0 2024-05-08T05:32:14.573 INFO:tasks.workunit.client.0.smithi087.stdout:1/824: readlink df/d2f/d57/da0/lb9 0 2024-05-08T05:32:14.573 INFO:tasks.workunit.client.0.smithi087.stdout:1/825: chown df/d18/d1d/d27/fd5 3577 1 2024-05-08T05:32:14.573 INFO:tasks.workunit.client.0.smithi087.stdout:1/826: read df/d18/d1d/d27/d61/fb2 [430051,12540] 0 2024-05-08T05:32:14.573 INFO:tasks.workunit.client.0.smithi087.stdout:1/827: write df/d2f/d57/dcb/ff1 [624219,62816] 0 2024-05-08T05:32:14.575 INFO:tasks.workunit.client.0.smithi087.stdout:4/926: write d4/d13/d3e/d28/d50/d9d/df2/d106/d91/db8/dba/d115/f13c [4520826,57267] 0 2024-05-08T05:32:14.603 INFO:tasks.workunit.client.0.smithi087.stdout:9/891: dwrite d1/df/d14/d54/d61/f31 [0,4194304] 0 2024-05-08T05:32:14.606 INFO:tasks.workunit.client.0.smithi087.stdout:8/985: dwrite db/d23/d15/f34 [4194304,4194304] 0 2024-05-08T05:32:14.606 INFO:tasks.workunit.client.0.smithi087.stdout:8/986: fdatasync db/d23/d15/d29/d33/f111 0 2024-05-08T05:32:14.606 INFO:tasks.workunit.client.0.smithi087.stdout:4/927: dwrite d4/d13/d3e/d28/d50/d9d/df2/d106/fc9 [0,4194304] 0 2024-05-08T05:32:14.608 INFO:tasks.workunit.client.0.smithi087.stdout:8/987: symlink db/d23/d15/d29/db1/l14c 0 2024-05-08T05:32:14.609 INFO:tasks.workunit.client.0.smithi087.stdout:9/892: creat d1/df/d37/d5b/d7e/f11e x:0 0 0 2024-05-08T05:32:14.610 INFO:tasks.workunit.client.0.smithi087.stdout:9/893: read - d1/df/d37/d5b/def/f119 zero size 2024-05-08T05:32:14.610 INFO:tasks.workunit.client.0.smithi087.stdout:8/988: symlink db/d23/d15/d29/d33/l14d 0 2024-05-08T05:32:14.614 INFO:tasks.workunit.client.0.smithi087.stdout:8/989: rmdir db/d23/d15/d29/d33/d6c 39 2024-05-08T05:32:14.615 INFO:tasks.workunit.client.0.smithi087.stdout:8/990: creat db/d23/d15/d29/f14e x:0 0 0 2024-05-08T05:32:14.615 INFO:tasks.workunit.client.0.smithi087.stdout:8/991: chown db/d23/d15/d29/db1/d131/d56/fcc 1 1 2024-05-08T05:32:14.615 INFO:tasks.workunit.client.0.smithi087.stdout:8/992: stat db/d23/d15/d10b/cea 0 2024-05-08T05:32:14.617 INFO:tasks.workunit.client.0.smithi087.stdout:8/993: read db/d23/d15/d29/fa6 [218249,28036] 0 2024-05-08T05:32:14.625 INFO:tasks.workunit.client.0.smithi087.stdout:2/932: dwrite d7/de/d55/de4/d111/d11c/d49/f9d [0,4194304] 0 2024-05-08T05:32:14.625 INFO:tasks.workunit.client.0.smithi087.stdout:1/828: dwrite df/d18/d1d/f107 [0,4194304] 0 2024-05-08T05:32:14.625 INFO:tasks.workunit.client.0.smithi087.stdout:2/933: chown d7/de/d82/c103 50987689 1 2024-05-08T05:32:14.626 INFO:tasks.workunit.client.0.smithi087.stdout:4/928: write d4/d13/d32/ddb/f82 [3785511,52054] 0 2024-05-08T05:32:14.626 INFO:tasks.workunit.client.0.smithi087.stdout:4/929: dread - d4/d13/d3e/d28/f10a zero size 2024-05-08T05:32:14.627 INFO:tasks.workunit.client.0.smithi087.stdout:2/934: unlink d7/d63/l51 0 2024-05-08T05:32:14.627 INFO:tasks.workunit.client.0.smithi087.stdout:2/935: dread - d7/de/d5d/f118 zero size 2024-05-08T05:32:14.627 INFO:tasks.workunit.client.0.smithi087.stdout:2/936: fdatasync f5 0 2024-05-08T05:32:14.627 INFO:tasks.workunit.client.0.smithi087.stdout:2/937: readlink d7/de/d2c/db6/dcb/lb2 0 2024-05-08T05:32:14.628 INFO:tasks.workunit.client.0.smithi087.stdout:4/930: link d4/f40 d4/d13/d3e/d28/d35/d12a/f15c 0 2024-05-08T05:32:14.631 INFO:tasks.workunit.client.0.smithi087.stdout:1/829: truncate df/d18/d1d/d58/ff5 525129 0 2024-05-08T05:32:14.633 INFO:tasks.workunit.client.0.smithi087.stdout:9/894: write d1/df/d14/d68/d80/d98/d28/f62 [2090817,118999] 0 2024-05-08T05:32:14.633 INFO:tasks.workunit.client.0.smithi087.stdout:2/938: symlink d7/de/d82/dcc/l13e 0 2024-05-08T05:32:14.633 INFO:tasks.workunit.client.0.smithi087.stdout:2/939: stat d7/de/d2c/db0/fba 0 2024-05-08T05:32:14.633 INFO:tasks.workunit.client.0.smithi087.stdout:2/940: write d7/de/d5d/f118 [50015,14254] 0 2024-05-08T05:32:14.633 INFO:tasks.workunit.client.0.smithi087.stdout:2/941: truncate d7/de/d82/ff5 782693 0 2024-05-08T05:32:14.633 INFO:tasks.workunit.client.0.smithi087.stdout:2/942: chown d7/de/d55/de4/d111/f12d 1 1 2024-05-08T05:32:14.635 INFO:tasks.workunit.client.0.smithi087.stdout:0/804: sync 2024-05-08T05:32:14.640 INFO:tasks.workunit.client.0.smithi087.stdout:8/994: write db/d23/d15/d3c/f3e [6851890,72711] 0 2024-05-08T05:32:14.640 INFO:tasks.workunit.client.0.smithi087.stdout:8/995: stat db/d23/d1b/d35/lc3 0 2024-05-08T05:32:14.645 INFO:tasks.workunit.client.0.smithi087.stdout:9/895: creat d1/df/d14/d68/d80/d98/d28/d4b/dd0/f11f x:0 0 0 2024-05-08T05:32:14.646 INFO:tasks.workunit.client.0.smithi087.stdout:0/805: creat d0/da/d35/d86/d74/f117 x:0 0 0 2024-05-08T05:32:14.647 INFO:tasks.workunit.client.0.smithi087.stdout:9/896: symlink d1/df/d14/d68/d80/d98/d28/l120 0 2024-05-08T05:32:14.648 INFO:tasks.workunit.client.0.smithi087.stdout:0/806: write d0/d9/d1b/d2f/d54/da1/f62 [934303,20543] 0 2024-05-08T05:32:14.649 INFO:tasks.workunit.client.0.smithi087.stdout:9/897: creat d1/df/d14/f121 x:0 0 0 2024-05-08T05:32:14.652 INFO:tasks.workunit.client.0.smithi087.stdout:8/996: dread db/d23/d15/d3c/fcf [0,4194304] 0 2024-05-08T05:32:14.660 INFO:tasks.workunit.client.0.smithi087.stdout:2/943: dread d7/f5b [0,4194304] 0 2024-05-08T05:32:14.662 INFO:tasks.workunit.client.0.smithi087.stdout:9/898: dread d1/df/d14/d68/d80/d98/d28/f7c [4194304,4194304] 0 2024-05-08T05:32:14.662 INFO:tasks.workunit.client.0.smithi087.stdout:2/944: unlink d7/lc 0 2024-05-08T05:32:14.663 INFO:tasks.workunit.client.0.smithi087.stdout:9/899: mkdir d1/df/d14/d18/d122 0 2024-05-08T05:32:14.665 INFO:tasks.workunit.client.0.smithi087.stdout:9/900: mkdir d1/df/d14/d18/d8e/da2/de6/d123 0 2024-05-08T05:32:14.665 INFO:tasks.workunit.client.0.smithi087.stdout:9/901: fdatasync d1/df/d58/fe4 0 2024-05-08T05:32:14.666 INFO:tasks.workunit.client.0.smithi087.stdout:9/902: mknod d1/df/d14/d68/d80/d98/d28/c124 0 2024-05-08T05:32:14.666 INFO:tasks.workunit.client.0.smithi087.stdout:9/903: fsync d1/d70/d107/d112/f11c 0 2024-05-08T05:32:14.666 INFO:tasks.workunit.client.0.smithi087.stdout:9/904: write d1/df/d14/d54/d61/fe3 [826195,96760] 0 2024-05-08T05:32:14.667 INFO:tasks.workunit.client.0.smithi087.stdout:9/905: mknod d1/df/d37/d5b/def/df2/c125 0 2024-05-08T05:32:14.668 INFO:tasks.workunit.client.0.smithi087.stdout:9/906: creat d1/df/d14/d18/d66/d7f/f126 x:0 0 0 2024-05-08T05:32:14.668 INFO:tasks.workunit.client.0.smithi087.stdout:9/907: chown d1/df/d14/l4c 164765 1 2024-05-08T05:32:14.673 INFO:tasks.workunit.client.0.smithi087.stdout:8/997: write db/d23/d3a/dcb/fae [3459675,117828] 0 2024-05-08T05:32:14.675 INFO:tasks.workunit.client.0.smithi087.stdout:8/998: creat db/d23/d15/d10b/f14f x:0 0 0 2024-05-08T05:32:14.676 INFO:tasks.workunit.client.0.smithi087.stdout:2/945: dread d7/de/d55/de4/d111/d11c/f76 [0,4194304] 0 2024-05-08T05:32:14.676 INFO:tasks.workunit.client.0.smithi087.stdout:8/999: creat db/d23/d121/f150 x:0 0 0 2024-05-08T05:32:14.677 INFO:tasks.workunit.client.0.smithi087.stdout:1/830: dwrite df/d2f/f97 [0,4194304] 0 2024-05-08T05:32:14.677 INFO:tasks.workunit.client.0.smithi087.stdout:2/946: truncate d7/d63/fca 1333459 0 2024-05-08T05:32:14.677 INFO:tasks.workunit.client.0.smithi087.stdout:2/947: dread - d7/de/d55/de4/d111/d11c/d81/fd9 zero size 2024-05-08T05:32:14.678 INFO:tasks.workunit.client.0.smithi087.stdout:1/831: symlink df/d18/d1d/d27/dd4/l11b 0 2024-05-08T05:32:14.679 INFO:tasks.workunit.client.0.smithi087.stdout:2/948: symlink d7/d93/l13f 0 2024-05-08T05:32:14.680 INFO:tasks.workunit.client.0.smithi087.stdout:1/832: mkdir df/d2f/d57/dcb/d105/d11c 0 2024-05-08T05:32:14.681 INFO:tasks.workunit.client.0.smithi087.stdout:2/949: unlink d7/de/d55/de4/d111/d11c/d65/dc2/d115/f134 0 2024-05-08T05:32:14.684 INFO:tasks.workunit.client.0.smithi087.stdout:2/950: creat d7/de/d122/f140 x:0 0 0 2024-05-08T05:32:14.684 INFO:tasks.workunit.client.0.smithi087.stdout:2/951: readlink d7/d63/l3c 0 2024-05-08T05:32:14.684 INFO:tasks.workunit.client.0.smithi087.stdout:2/952: readlink d7/de/l35 0 2024-05-08T05:32:14.686 INFO:tasks.workunit.client.0.smithi087.stdout:2/953: rename d7/de/d82/c103 to d7/de/d27/dd6/dfb/d119/c141 0 2024-05-08T05:32:14.689 INFO:tasks.workunit.client.0.smithi087.stdout:9/908: read d1/df/d14/d54/d61/d72/fb3 [1282414,33074] 0 2024-05-08T05:32:14.689 INFO:tasks.workunit.client.0.smithi087.stdout:1/833: dread df/f40 [0,4194304] 0 2024-05-08T05:32:14.689 INFO:tasks.workunit.client.0.smithi087.stdout:1/834: chown df/d2f/d4f/f76 203 1 2024-05-08T05:32:14.689 INFO:tasks.workunit.client.0.smithi087.stdout:1/835: chown df/d18/d8b/df2/c10e 263 1 2024-05-08T05:32:14.689 INFO:tasks.workunit.client.0.smithi087.stdout:1/836: truncate df/d2f/d6a/ffe 160002 0 2024-05-08T05:32:14.689 INFO:tasks.workunit.client.0.smithi087.stdout:1/837: chown df/d18/d1d/d58/d72/f85 29941817 1 2024-05-08T05:32:14.689 INFO:tasks.workunit.client.0.smithi087.stdout:1/838: write df/d2f/d6a/ffe [1180687,112656] 0 2024-05-08T05:32:14.689 INFO:tasks.workunit.client.0.smithi087.stdout:1/839: fsync df/d18/d1d/f3a 0 2024-05-08T05:32:14.690 INFO:tasks.workunit.client.0.smithi087.stdout:2/954: link d7/c3b d7/d63/d10c/c142 0 2024-05-08T05:32:14.690 INFO:tasks.workunit.client.0.smithi087.stdout:2/955: dread - d7/de/d122/f140 zero size 2024-05-08T05:32:14.690 INFO:tasks.workunit.client.0.smithi087.stdout:2/956: chown d7/de/d82/dcc/ld2 7086 1 2024-05-08T05:32:14.690 INFO:tasks.workunit.client.0.smithi087.stdout:2/957: fsync d7/f59 0 2024-05-08T05:32:14.690 INFO:tasks.workunit.client.0.smithi087.stdout:4/931: dwrite d4/d6c/fb7 [0,4194304] 0 2024-05-08T05:32:14.690 INFO:tasks.workunit.client.0.smithi087.stdout:1/840: creat df/d2f/d57/dcb/d105/f11d x:0 0 0 2024-05-08T05:32:14.691 INFO:tasks.workunit.client.0.smithi087.stdout:9/909: mknod d1/df/d37/d5b/def/c127 0 2024-05-08T05:32:14.692 INFO:tasks.workunit.client.0.smithi087.stdout:9/910: write d1/df/d37/d5b/d7e/f82 [430765,37684] 0 2024-05-08T05:32:14.692 INFO:tasks.workunit.client.0.smithi087.stdout:9/911: fsync d1/df/d14/d54/d61/d88/fa7 0 2024-05-08T05:32:14.693 INFO:tasks.workunit.client.0.smithi087.stdout:4/932: read d4/d13/d3e/d28/d50/d9d/df2/d106/d91/db8/dba/dbd/f140 [575215,57217] 0 2024-05-08T05:32:14.700 INFO:tasks.workunit.client.0.smithi087.stdout:9/912: unlink d1/df/l1d 0 2024-05-08T05:32:14.700 INFO:tasks.workunit.client.0.smithi087.stdout:9/913: stat d1/df/d37/d5b/d7e/f8f 0 2024-05-08T05:32:14.701 INFO:tasks.workunit.client.0.smithi087.stdout:4/933: mkdir d4/d13/d3e/d28/d35/d12a/d141/d15d 0 2024-05-08T05:32:14.702 INFO:tasks.workunit.client.0.smithi087.stdout:4/934: rmdir d4/d13/d3e/d28/d50/d9d/df2/d106/d91/db8/dba/d96/dd5 39 2024-05-08T05:32:14.703 INFO:tasks.workunit.client.0.smithi087.stdout:4/935: truncate d4/d13/d32/ddb/fa0 2775886 0 2024-05-08T05:32:14.705 INFO:tasks.workunit.client.0.smithi087.stdout:0/807: dwrite d0/d9/d1b/d2f/d54/da1/f99 [0,4194304] 0 2024-05-08T05:32:14.705 INFO:tasks.workunit.client.0.smithi087.stdout:1/841: rmdir df/d18/dbe 39 2024-05-08T05:32:14.707 INFO:tasks.workunit.client.0.smithi087.stdout:4/936: mknod d4/d13/d3e/d28/d50/d9d/df2/d106/d91/db8/dba/d96/dd5/c15e 0 2024-05-08T05:32:14.707 INFO:tasks.workunit.client.0.smithi087.stdout:4/937: dread - d4/d13/d3e/d28/d50/d9d/df2/d106/d91/db8/dba/d63/f146 zero size 2024-05-08T05:32:14.707 INFO:tasks.workunit.client.0.smithi087.stdout:1/842: creat df/d2f/d57/f11e x:0 0 0 2024-05-08T05:32:14.708 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:32:14 smithi087 ceph-mon[29523]: pgmap v517: 97 pgs: 97 active+clean; 1.4 GiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 188 MiB/s rd, 223 MiB/s wr, 314 op/s 2024-05-08T05:32:14.712 INFO:tasks.workunit.client.0.smithi087.stdout:6/917: sync 2024-05-08T05:32:14.712 INFO:tasks.workunit.client.0.smithi087.stdout:3/905: sync 2024-05-08T05:32:14.713 INFO:tasks.workunit.client.0.smithi087.stdout:9/914: dread d1/df/d14/d18/d9a/fc3 [0,4194304] 0 2024-05-08T05:32:14.713 INFO:tasks.workunit.client.0.smithi087.stdout:1/843: rename df/d2f/d57/d64/c7e to df/d2f/d57/d64/c11f 0 2024-05-08T05:32:14.715 INFO:tasks.workunit.client.0.smithi087.stdout:1/844: creat df/d18/dbe/f120 x:0 0 0 2024-05-08T05:32:14.715 INFO:tasks.workunit.client.0.smithi087.stdout:1/845: chown df/d18/d1d/d27/c5e 464993 1 2024-05-08T05:32:14.718 INFO:tasks.workunit.client.0.smithi087.stdout:0/808: write d0/da/d35/daa/fc4 [403621,31537] 0 2024-05-08T05:32:14.721 INFO:tasks.workunit.client.0.smithi087.stdout:0/809: read d0/da/f5f [146944,114849] 0 2024-05-08T05:32:14.721 INFO:tasks.workunit.client.0.smithi087.stdout:3/906: dread d4/d5f/fc5 [0,4194304] 0 2024-05-08T05:32:14.722 INFO:tasks.workunit.client.0.smithi087.stdout:6/918: unlink d4/d8/df/d1e/d25/f92 0 2024-05-08T05:32:14.722 INFO:tasks.workunit.client.0.smithi087.stdout:6/919: readlink d4/d8/df/l1f 0 2024-05-08T05:32:14.722 INFO:tasks.workunit.client.0.smithi087.stdout:0/810: creat d0/d9/d1b/d2f/d54/f118 x:0 0 0 2024-05-08T05:32:14.722 INFO:tasks.workunit.client.0.smithi087.stdout:0/811: chown d0/da/db4 27641 1 2024-05-08T05:32:14.722 INFO:tasks.workunit.client.0.smithi087.stdout:6/920: write d4/d8/df/d1e/f96 [48230,17978] 0 2024-05-08T05:32:14.723 INFO:tasks.workunit.client.0.smithi087.stdout:3/907: creat d4/d11/d24/d25/d4d/dd6/d121/d87/da5/d120/f14a x:0 0 0 2024-05-08T05:32:14.733 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:32:14 smithi090 ceph-mon[34526]: pgmap v517: 97 pgs: 97 active+clean; 1.4 GiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 188 MiB/s rd, 223 MiB/s wr, 314 op/s 2024-05-08T05:32:14.733 INFO:tasks.workunit.client.0.smithi087.stdout:2/958: dwrite d7/de/d55/de4/d111/d11c/fc9 [4194304,4194304] 0 2024-05-08T05:32:14.734 INFO:tasks.workunit.client.0.smithi087.stdout:2/959: stat d7/de/d78/f13c 0 2024-05-08T05:32:14.737 INFO:tasks.workunit.client.0.smithi087.stdout:2/960: link d7/de/d55/de4/d111/d11c/d65/f117 d7/de/d78/f143 0 2024-05-08T05:32:14.737 INFO:tasks.workunit.client.0.smithi087.stdout:2/961: stat d7/de/db1 0 2024-05-08T05:32:14.739 INFO:tasks.workunit.client.0.smithi087.stdout:2/962: unlink d7/de/d5d/d7b/fdf 0 2024-05-08T05:32:14.740 INFO:tasks.workunit.client.0.smithi087.stdout:2/963: creat d7/de/d55/de4/d111/d11c/d65/f144 x:0 0 0 2024-05-08T05:32:14.741 INFO:tasks.workunit.client.0.smithi087.stdout:2/964: creat d7/d93/d100/f145 x:0 0 0 2024-05-08T05:32:14.741 INFO:tasks.workunit.client.0.smithi087.stdout:2/965: write d7/de/d27/dd6/dfb/f109 [493873,13853] 0 2024-05-08T05:32:14.742 INFO:tasks.workunit.client.0.smithi087.stdout:2/966: creat d7/de/d55/de4/d111/d11c/d65/dc2/d115/f146 x:0 0 0 2024-05-08T05:32:14.744 INFO:tasks.workunit.client.0.smithi087.stdout:2/967: creat d7/de/d5d/db8/d120/f147 x:0 0 0 2024-05-08T05:32:14.744 INFO:tasks.workunit.client.0.smithi087.stdout:2/968: fsync d7/f18 0 2024-05-08T05:32:14.744 INFO:tasks.workunit.client.0.smithi087.stdout:2/969: fdatasync d7/de/d5d/db8/d120/f12e 0 2024-05-08T05:32:14.744 INFO:tasks.workunit.client.0.smithi087.stdout:2/970: symlink d7/de/db1/dbe/l148 0 2024-05-08T05:32:14.746 INFO:tasks.workunit.client.0.smithi087.stdout:2/971: rename d7/de/d27/dd6/cdb to d7/de/d55/de4/d111/d11c/d128/c149 0 2024-05-08T05:32:14.767 INFO:tasks.workunit.client.0.smithi087.stdout:1/846: dread df/d18/d1d/d32/f86 [0,4194304] 0 2024-05-08T05:32:14.770 INFO:tasks.workunit.client.0.smithi087.stdout:1/847: rmdir df/d2f/d57 39 2024-05-08T05:32:14.776 INFO:tasks.workunit.client.0.smithi087.stdout:0/812: dwrite d0/d9/d1b/d2f/dcc/fe6 [0,4194304] 0 2024-05-08T05:32:14.788 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:32:14 smithi160 ceph-mon[34827]: pgmap v517: 97 pgs: 97 active+clean; 1.4 GiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 188 MiB/s rd, 223 MiB/s wr, 314 op/s 2024-05-08T05:32:14.789 INFO:tasks.workunit.client.0.smithi087.stdout:1/848: write df/d2f/f66 [2336688,113386] 0 2024-05-08T05:32:14.789 INFO:tasks.workunit.client.0.smithi087.stdout:3/908: dwrite d4/d14/f1a [4194304,4194304] 0 2024-05-08T05:32:14.790 INFO:tasks.workunit.client.0.smithi087.stdout:6/921: dwrite d4/d8/df/d39/d42/d9e/d6f/f90 [0,4194304] 0 2024-05-08T05:32:14.790 INFO:tasks.workunit.client.0.smithi087.stdout:6/922: truncate d4/d8/df/d39/ff4 399052 0 2024-05-08T05:32:14.791 INFO:tasks.workunit.client.0.smithi087.stdout:2/972: dwrite d7/de/d2c/db6/dcb/db7/fdd [0,4194304] 0 2024-05-08T05:32:14.794 INFO:tasks.workunit.client.0.smithi087.stdout:6/923: mkdir d4/d8/df/d39/d42/d9e/d6f/d7f/de7/d2d/d37/d5b/d115/d11a 0 2024-05-08T05:32:14.795 INFO:tasks.workunit.client.0.smithi087.stdout:3/909: symlink d4/d11/d3d/l14b 0 2024-05-08T05:32:14.795 INFO:tasks.workunit.client.0.smithi087.stdout:6/924: mkdir d4/d8/df/d39/d42/d9e/d6f/d7f/de7/d2d/dca/d11b 0 2024-05-08T05:32:14.797 INFO:tasks.workunit.client.0.smithi087.stdout:6/925: creat d4/d8/df/d1e/d52/f11c x:0 0 0 2024-05-08T05:32:14.797 INFO:tasks.workunit.client.0.smithi087.stdout:6/926: stat d4/d8/df/d39/d42/d9e/d6f/d7f/de7/d57/d6d/fbf 0 2024-05-08T05:32:14.797 INFO:tasks.workunit.client.0.smithi087.stdout:6/927: write d4/d8/df/d39/d42/d9e/d6f/d7f/de7/d57/d6d/fdc [4421003,100228] 0 2024-05-08T05:32:14.797 INFO:tasks.workunit.client.0.smithi087.stdout:6/928: fsync d4/d8/df/d39/d42/d94/db5/fcf 0 2024-05-08T05:32:14.798 INFO:tasks.workunit.client.0.smithi087.stdout:6/929: mknod d4/d8/df/d39/d42/d9e/d6f/d7f/de7/d2d/d37/d5b/d115/d11a/c11d 0 2024-05-08T05:32:14.799 INFO:tasks.workunit.client.0.smithi087.stdout:6/930: link d4/d8/df/d39/d42/d94/lbc d4/d8/df/d39/l11e 0 2024-05-08T05:32:14.806 INFO:tasks.workunit.client.0.smithi087.stdout:2/973: dread d7/de/d5d/d7b/ff0 [0,4194304] 0 2024-05-08T05:32:14.806 INFO:tasks.workunit.client.0.smithi087.stdout:2/974: readlink d7/de/d2c/le1 0 2024-05-08T05:32:14.808 INFO:tasks.workunit.client.0.smithi087.stdout:2/975: creat d7/de/d5d/d7b/f14a x:0 0 0 2024-05-08T05:32:14.808 INFO:tasks.workunit.client.0.smithi087.stdout:2/976: readlink d7/de/d27/l46 0 2024-05-08T05:32:14.811 INFO:tasks.workunit.client.0.smithi087.stdout:2/977: mknod d7/d93/d100/d129/c14b 0 2024-05-08T05:32:14.813 INFO:tasks.workunit.client.0.smithi087.stdout:2/978: mkdir d7/de/d55/de4/d14c 0 2024-05-08T05:32:14.813 INFO:tasks.workunit.client.0.smithi087.stdout:2/979: chown d7/de/d82/c11b 0 1 2024-05-08T05:32:14.815 INFO:tasks.workunit.client.0.smithi087.stdout:2/980: unlink d7/de/d55/c67 0 2024-05-08T05:32:14.815 INFO:tasks.workunit.client.0.smithi087.stdout:2/981: fdatasync d7/de/d27/f2e 0 2024-05-08T05:32:14.815 INFO:tasks.workunit.client.0.smithi087.stdout:2/982: stat d7/de/d5d/db8/d120/f12e 0 2024-05-08T05:32:14.815 INFO:tasks.workunit.client.0.smithi087.stdout:2/983: dread - d7/d93/d100/d129/db4/fc3 zero size 2024-05-08T05:32:14.816 INFO:tasks.workunit.client.0.smithi087.stdout:2/984: unlink d7/de/d5d/d90/faa 0 2024-05-08T05:32:14.819 INFO:tasks.workunit.client.0.smithi087.stdout:2/985: link d7/de/l1d d7/de/db1/dbe/l14d 0 2024-05-08T05:32:14.821 INFO:tasks.workunit.client.0.smithi087.stdout:2/986: getdents d7/de/d2c/db0/dd3 0 2024-05-08T05:32:14.821 INFO:tasks.workunit.client.0.smithi087.stdout:2/987: fdatasync d7/de/d55/de4/d111/d11c/d49/f8f 0 2024-05-08T05:32:14.822 INFO:tasks.workunit.client.0.smithi087.stdout:2/988: write d7/de/d78/f143 [275535,49418] 0 2024-05-08T05:32:14.823 INFO:tasks.workunit.client.0.smithi087.stdout:2/989: creat d7/d63/d10c/d13d/f14e x:0 0 0 2024-05-08T05:32:14.823 INFO:tasks.workunit.client.0.smithi087.stdout:2/990: dread - d7/d63/d10c/d13d/f14e zero size 2024-05-08T05:32:14.825 INFO:tasks.workunit.client.0.smithi087.stdout:2/991: symlink d7/de/d122/l14f 0 2024-05-08T05:32:14.825 INFO:tasks.workunit.client.0.smithi087.stdout:2/992: readlink d7/d63/dac/l135 0 2024-05-08T05:32:14.825 INFO:tasks.workunit.client.0.smithi087.stdout:2/993: truncate d7/d93/d100/d129/db4/f10d 919042 0 2024-05-08T05:32:14.825 INFO:tasks.workunit.client.0.smithi087.stdout:2/994: fsync d7/fe7 0 2024-05-08T05:32:14.826 INFO:tasks.workunit.client.0.smithi087.stdout:2/995: link d7/de/d55/de4/d111/d11c/faf d7/de/d27/dd6/dfb/f150 0 2024-05-08T05:32:14.827 INFO:tasks.workunit.client.0.smithi087.stdout:2/996: rmdir d7/de/d122 39 2024-05-08T05:32:14.829 INFO:tasks.workunit.client.0.smithi087.stdout:2/997: mkdir d7/d63/d10c/d13d/d151 0 2024-05-08T05:32:14.831 INFO:tasks.workunit.client.0.smithi087.stdout:2/998: unlink d7/d93/fa7 0 2024-05-08T05:32:14.831 INFO:tasks.workunit.client.0.smithi087.stdout:2/999: write d7/de/d5d/fa5 [206507,83644] 0 2024-05-08T05:32:14.834 INFO:tasks.workunit.client.0.smithi087.stdout:0/813: dwrite d0/d9e/ff2 [0,4194304] 0 2024-05-08T05:32:14.835 INFO:tasks.workunit.client.0.smithi087.stdout:0/814: read d0/d9/d1b/d2f/d54/da1/f96 [437094,10029] 0 2024-05-08T05:32:14.841 INFO:tasks.workunit.client.0.smithi087.stdout:6/931: dwrite d4/d8/df/d39/d42/d94/db5/fc0 [0,4194304] 0 2024-05-08T05:32:14.841 INFO:tasks.workunit.client.0.smithi087.stdout:6/932: write d4/d8/df/d39/d42/dbd/fc1 [232213,127816] 0 2024-05-08T05:32:14.844 INFO:tasks.workunit.client.0.smithi087.stdout:6/933: mkdir d4/d8/df/d39/d42/d9e/d11f 0 2024-05-08T05:32:14.849 INFO:tasks.workunit.client.0.smithi087.stdout:6/934: unlink d4/d8/df/d39/d42/d9e/d6f/d7f/de7/fa1 0 2024-05-08T05:32:14.853 INFO:tasks.workunit.client.0.smithi087.stdout:0/815: dread d0/da/d35/f80 [0,4194304] 0 2024-05-08T05:32:14.853 INFO:tasks.workunit.client.0.smithi087.stdout:3/910: dwrite d4/d11/d24/d25/d3e/d58/fd4 [0,4194304] 0 2024-05-08T05:32:14.853 INFO:tasks.workunit.client.0.smithi087.stdout:3/911: readlink d4/d11/d24/d25/d4d/dd6/l10a 0 2024-05-08T05:32:14.859 INFO:tasks.workunit.client.0.smithi087.stdout:1/849: dwrite df/d2f/d6a/ffe [0,4194304] 0 2024-05-08T05:32:14.869 INFO:tasks.workunit.client.0.smithi087.stdout:1/850: dread df/d2f/fdd [0,4194304] 0 2024-05-08T05:32:14.871 INFO:tasks.workunit.client.0.smithi087.stdout:1/851: symlink df/d18/d1d/d32/l121 0 2024-05-08T05:32:14.872 INFO:tasks.workunit.client.0.smithi087.stdout:1/852: rename df/d18/c7d to df/d2f/d57/d64/c122 0 2024-05-08T05:32:14.873 INFO:tasks.workunit.client.0.smithi087.stdout:1/853: mknod df/d18/c123 0 2024-05-08T05:32:14.876 INFO:tasks.workunit.client.0.smithi087.stdout:9/915: sync 2024-05-08T05:32:14.877 INFO:tasks.workunit.client.0.smithi087.stdout:4/938: sync 2024-05-08T05:32:14.880 INFO:tasks.workunit.client.0.smithi087.stdout:9/916: symlink d1/df/d37/d5b/d7e/l128 0 2024-05-08T05:32:14.881 INFO:tasks.workunit.client.0.smithi087.stdout:4/939: mknod d4/c15f 0 2024-05-08T05:32:14.881 INFO:tasks.workunit.client.0.smithi087.stdout:4/940: fsync d4/d13/fb0 0 2024-05-08T05:32:14.881 INFO:tasks.workunit.client.0.smithi087.stdout:9/917: truncate d1/df/d37/d5b/d7e/d85/fe1 554661 0 2024-05-08T05:32:14.882 INFO:tasks.workunit.client.0.smithi087.stdout:4/941: symlink d4/d13/d3e/d28/d50/l160 0 2024-05-08T05:32:14.883 INFO:tasks.workunit.client.0.smithi087.stdout:4/942: symlink d4/d6c/d148/l161 0 2024-05-08T05:32:14.889 INFO:tasks.workunit.client.0.smithi087.stdout:3/912: dread d4/d14/d84/d8b/d8f/dec/f136 [0,4194304] 0 2024-05-08T05:32:14.890 INFO:tasks.workunit.client.0.smithi087.stdout:3/913: truncate d4/d11/f38 3621629 0 2024-05-08T05:32:14.891 INFO:tasks.workunit.client.0.smithi087.stdout:3/914: mkdir d4/d11/d24/d25/d4d/dbb/de9/d14c 0 2024-05-08T05:32:14.891 INFO:tasks.workunit.client.0.smithi087.stdout:3/915: truncate d4/fc3 227892 0 2024-05-08T05:32:14.896 INFO:tasks.workunit.client.0.smithi087.stdout:3/916: write d4/d11/d24/d25/d3e/fb9 [1328036,13817] 0 2024-05-08T05:32:14.896 INFO:tasks.workunit.client.0.smithi087.stdout:3/917: write d4/d11/d24/d25/d4d/dbb/f128 [641790,80079] 0 2024-05-08T05:32:14.896 INFO:tasks.workunit.client.0.smithi087.stdout:3/918: chown d4/d11/d3d/l77 370 1 2024-05-08T05:32:14.896 INFO:tasks.workunit.client.0.smithi087.stdout:6/935: dwrite d4/d8/faa [4194304,4194304] 0 2024-05-08T05:32:14.896 INFO:tasks.workunit.client.0.smithi087.stdout:6/936: stat d4/d8/df/d39/d42/d9e/d6f/d7f/de7/d2d/dca/f107 0 2024-05-08T05:32:14.896 INFO:tasks.workunit.client.0.smithi087.stdout:6/937: rename d4/d8/df/d39/d42/d9e/dd1/fdd to d4/d8/df/d39/d42/d9e/d6f/d7f/de7/d57/d117/f120 0 2024-05-08T05:32:14.897 INFO:tasks.workunit.client.0.smithi087.stdout:6/938: creat d4/d8/df/d39/d42/d9e/d6f/d7f/de7/d2d/d37/dea/f121 x:0 0 0 2024-05-08T05:32:14.897 INFO:tasks.workunit.client.0.smithi087.stdout:6/939: write d4/d8/df/d39/d42/d9e/d6f/d7f/de7/d2d/d37/d9c/ffa [5201380,119344] 0 2024-05-08T05:32:14.899 INFO:tasks.workunit.client.0.smithi087.stdout:6/940: creat d4/d8/df/d39/d42/d9e/d6f/d7f/de7/d2d/d37/dea/f122 x:0 0 0 2024-05-08T05:32:14.900 INFO:tasks.workunit.client.0.smithi087.stdout:6/941: mknod d4/d8/df/d39/d42/d9e/da4/dad/c123 0 2024-05-08T05:32:14.901 INFO:tasks.workunit.client.0.smithi087.stdout:6/942: symlink d4/d8/df/d39/d42/dbd/l124 0 2024-05-08T05:32:14.903 INFO:tasks.workunit.client.0.smithi087.stdout:9/918: dread d1/df/d58/fe4 [0,4194304] 0 2024-05-08T05:32:14.903 INFO:tasks.workunit.client.0.smithi087.stdout:9/919: fdatasync d1/df/d14/d68/fdf 0 2024-05-08T05:32:14.904 INFO:tasks.workunit.client.0.smithi087.stdout:0/816: dwrite d0/da/d35/d86/d9a/fe9 [0,4194304] 0 2024-05-08T05:32:14.905 INFO:tasks.workunit.client.0.smithi087.stdout:0/817: dread - d0/d57/d24/d66/f101 zero size 2024-05-08T05:32:14.905 INFO:tasks.workunit.client.0.smithi087.stdout:0/818: stat d0/da/d11/c50 0 2024-05-08T05:32:14.905 INFO:tasks.workunit.client.0.smithi087.stdout:0/819: stat d0/d9/f100 0 2024-05-08T05:32:14.905 INFO:tasks.workunit.client.0.smithi087.stdout:9/920: mkdir d1/d70/d107/d129 0 2024-05-08T05:32:14.907 INFO:tasks.workunit.client.0.smithi087.stdout:3/919: dread d4/d11/d24/fe1 [0,4194304] 0 2024-05-08T05:32:14.907 INFO:tasks.workunit.client.0.smithi087.stdout:0/820: symlink d0/da/d35/d86/d6d/ded/d108/d113/l119 0 2024-05-08T05:32:14.908 INFO:tasks.workunit.client.0.smithi087.stdout:0/821: mknod d0/d9e/c11a 0 2024-05-08T05:32:14.909 INFO:tasks.workunit.client.0.smithi087.stdout:6/943: mknod d4/d8/df/d39/d42/d94/c125 0 2024-05-08T05:32:14.910 INFO:tasks.workunit.client.0.smithi087.stdout:0/822: creat d0/d57/d24/d66/f11b x:0 0 0 2024-05-08T05:32:14.911 INFO:tasks.workunit.client.0.smithi087.stdout:6/944: mknod d4/d8/df/d39/d42/d9e/da4/dad/c126 0 2024-05-08T05:32:14.912 INFO:tasks.workunit.client.0.smithi087.stdout:0/823: rename d0/d9/d1b/d2f/dcc/ffa to d0/da/d35/d86/d6d/ded/dff/f11c 0 2024-05-08T05:32:14.912 INFO:tasks.workunit.client.0.smithi087.stdout:0/824: dread - d0/d9/d1b/d2f/d54/f118 zero size 2024-05-08T05:32:14.913 INFO:tasks.workunit.client.0.smithi087.stdout:6/945: link d4/d8/df/d39/d42/d9e/dd1/ff2 d4/d8/df/d39/d42/d9e/d6f/dba/f127 0 2024-05-08T05:32:14.913 INFO:tasks.workunit.client.0.smithi087.stdout:9/921: dread d1/df/d14/d68/d80/d98/d28/d4b/f71 [0,4194304] 0 2024-05-08T05:32:14.914 INFO:tasks.workunit.client.0.smithi087.stdout:9/922: mknod d1/df/d14/d54/c12a 0 2024-05-08T05:32:14.915 INFO:tasks.workunit.client.0.smithi087.stdout:6/946: symlink d4/d8/df/d39/d42/d9e/d6f/d7f/de7/d2d/d37/d5b/d115/l128 0 2024-05-08T05:32:14.917 INFO:tasks.workunit.client.0.smithi087.stdout:9/923: symlink d1/df/d14/d54/d61/d88/l12b 0 2024-05-08T05:32:14.917 INFO:tasks.workunit.client.0.smithi087.stdout:9/924: chown d1/df/d14/d68/d80/d98/d83/f9f 3540391 1 2024-05-08T05:32:14.918 INFO:tasks.workunit.client.0.smithi087.stdout:9/925: rename d1/df/d14/d18/d66/c101 to d1/df/d14/d68/d80/d98/d28/c12c 0 2024-05-08T05:32:14.919 INFO:tasks.workunit.client.0.smithi087.stdout:9/926: symlink d1/df/d58/d5e/l12d 0 2024-05-08T05:32:14.921 INFO:tasks.workunit.client.0.smithi087.stdout:9/927: creat d1/df/d14/d18/d8e/da2/de6/f12e x:0 0 0 2024-05-08T05:32:14.921 INFO:tasks.workunit.client.0.smithi087.stdout:9/928: chown d1/df/d14/d54/d61/d88/f10c 186753 1 2024-05-08T05:32:14.921 INFO:tasks.workunit.client.0.smithi087.stdout:9/929: stat d1/df/d14/d18/d66/fea 0 2024-05-08T05:32:14.922 INFO:tasks.workunit.client.0.smithi087.stdout:6/947: dread d4/d8/df/d39/d42/d9e/d6f/f90 [4194304,4194304] 0 2024-05-08T05:32:14.922 INFO:tasks.workunit.client.0.smithi087.stdout:9/930: rename d1/df/d14/d68/d80/d98/d28/f75 to d1/df/d14/d18/db5/df0/f12f 0 2024-05-08T05:32:14.924 INFO:tasks.workunit.client.0.smithi087.stdout:6/948: creat d4/d8/df/d39/d42/d9e/d6f/d7f/de7/d2d/d37/f129 x:0 0 0 2024-05-08T05:32:14.924 INFO:tasks.workunit.client.0.smithi087.stdout:9/931: unlink d1/df/d14/d68/d80/d98/d83/f97 0 2024-05-08T05:32:14.924 INFO:tasks.workunit.client.0.smithi087.stdout:6/949: mknod d4/d8/df/d39/d42/dbd/c12a 0 2024-05-08T05:32:14.925 INFO:tasks.workunit.client.0.smithi087.stdout:9/932: mkdir d1/df/d14/d18/d9a/d130 0 2024-05-08T05:32:14.926 INFO:tasks.workunit.client.0.smithi087.stdout:9/933: creat d1/df/d14/d18/db5/f131 x:0 0 0 2024-05-08T05:32:14.927 INFO:tasks.workunit.client.0.smithi087.stdout:9/934: symlink d1/d70/d107/d129/l132 0 2024-05-08T05:32:14.927 INFO:tasks.workunit.client.0.smithi087.stdout:9/935: read d1/df/d14/d68/d80/d98/d83/fb2 [15001,104293] 0 2024-05-08T05:32:14.940 INFO:tasks.workunit.client.0.smithi087.stdout:0/825: dread d0/da/d35/f93 [0,4194304] 0 2024-05-08T05:32:14.940 INFO:tasks.workunit.client.0.smithi087.stdout:0/826: chown d0/d9/d1b/d2f/d54/da1/d94/df1/c103 19097756 1 2024-05-08T05:32:14.940 INFO:tasks.workunit.client.0.smithi087.stdout:0/827: chown d0/fb9 8575 1 2024-05-08T05:32:14.943 INFO:tasks.workunit.client.0.smithi087.stdout:4/943: dwrite d4/d6c/f124 [4194304,4194304] 0 2024-05-08T05:32:14.946 INFO:tasks.workunit.client.0.smithi087.stdout:4/944: unlink d4/d13/d3e/d28/d12f/c143 0 2024-05-08T05:32:14.946 INFO:tasks.workunit.client.0.smithi087.stdout:4/945: write d4/d13/d3e/d28/f10a [458031,70200] 0 2024-05-08T05:32:14.947 INFO:tasks.workunit.client.0.smithi087.stdout:4/946: getdents d4/d13/d3e/d28/d50/d9d/df2/d106/d91/d84/d10c 0 2024-05-08T05:32:14.948 INFO:tasks.workunit.client.0.smithi087.stdout:4/947: symlink d4/d13/d3e/d28/d35/d107/d14b/l162 0 2024-05-08T05:32:14.948 INFO:tasks.workunit.client.0.smithi087.stdout:4/948: chown d4/d13/d3e/d28/d50/c14a 122347196 1 2024-05-08T05:32:14.948 INFO:tasks.workunit.client.0.smithi087.stdout:4/949: dread - d4/d13/d32/ff9 zero size 2024-05-08T05:32:14.998 INFO:tasks.workunit.client.0.smithi087.stdout:6/950: dwrite d4/d6/f13 [0,4194304] 0 2024-05-08T05:32:15.000 INFO:tasks.workunit.client.0.smithi087.stdout:6/951: rename d4/d8/df/d1e/f9a to d4/d8/df/d39/d42/d9e/da4/dad/dd2/de2/f12b 0 2024-05-08T05:32:15.001 INFO:tasks.workunit.client.0.smithi087.stdout:0/828: dwrite d0/da/d11/fac [0,4194304] 0 2024-05-08T05:32:15.001 INFO:tasks.workunit.client.0.smithi087.stdout:6/952: write d4/d8/df/d39/d42/d9e/da4/dad/dd2/de2/f12b [952217,82636] 0 2024-05-08T05:32:15.001 INFO:tasks.workunit.client.0.smithi087.stdout:9/936: dwrite d1/df/d14/d54/d61/d88/dca/df4/f117 [4194304,4194304] 0 2024-05-08T05:32:15.002 INFO:tasks.workunit.client.0.smithi087.stdout:4/950: dwrite d4/d6c/d93/ffd [0,4194304] 0 2024-05-08T05:32:15.002 INFO:tasks.workunit.client.0.smithi087.stdout:6/953: symlink d4/d8/df/d39/d42/d9e/d6f/d7f/de7/d2d/d37/dea/l12c 0 2024-05-08T05:32:15.003 INFO:tasks.workunit.client.0.smithi087.stdout:0/829: creat d0/da/d11/d10f/f11d x:0 0 0 2024-05-08T05:32:15.003 INFO:tasks.workunit.client.0.smithi087.stdout:9/937: mknod d1/df/d14/d18/d66/c133 0 2024-05-08T05:32:15.004 INFO:tasks.workunit.client.0.smithi087.stdout:9/938: write d1/df/d14/d18/f34 [883883,118754] 0 2024-05-08T05:32:15.004 INFO:tasks.workunit.client.0.smithi087.stdout:9/939: chown d1/df/d14/d18/d8e 5 1 2024-05-08T05:32:15.004 INFO:tasks.workunit.client.0.smithi087.stdout:9/940: truncate d1/f19 704407 0 2024-05-08T05:32:15.007 INFO:tasks.workunit.client.0.smithi087.stdout:4/951: mknod d4/d13/d3e/d28/d35/d12a/d141/d15d/c163 0 2024-05-08T05:32:15.008 INFO:tasks.workunit.client.0.smithi087.stdout:0/830: rename d0/d9e/cba to d0/da/d35/d86/d6d/ded/dff/d114/c11e 0 2024-05-08T05:32:15.008 INFO:tasks.workunit.client.0.smithi087.stdout:0/831: chown d0/da/f5f 2 1 2024-05-08T05:32:15.009 INFO:tasks.workunit.client.0.smithi087.stdout:9/941: mknod d1/df/d14/d54/d61/d88/dde/c134 0 2024-05-08T05:32:15.011 INFO:tasks.workunit.client.0.smithi087.stdout:4/952: unlink d4/d13/d3e/d28/d50/c14a 0 2024-05-08T05:32:15.013 INFO:tasks.workunit.client.0.smithi087.stdout:0/832: symlink d0/d9/d1b/l11f 0 2024-05-08T05:32:15.013 INFO:tasks.workunit.client.0.smithi087.stdout:0/833: chown d0/d22/d3c/c75 1423162149 1 2024-05-08T05:32:15.014 INFO:tasks.workunit.client.0.smithi087.stdout:9/942: creat d1/df/d14/d18/d66/f135 x:0 0 0 2024-05-08T05:32:15.015 INFO:tasks.workunit.client.0.smithi087.stdout:4/953: rename d4/d13/d3e/d28/d35/d12a/f12b to d4/d13/d3e/d28/d50/d9d/df2/d106/d91/f164 0 2024-05-08T05:32:15.016 INFO:tasks.workunit.client.0.smithi087.stdout:4/954: fsync d4/d13/d3e/d28/d50/d9d/df2/d106/f125 0 2024-05-08T05:32:15.016 INFO:tasks.workunit.client.0.smithi087.stdout:4/955: readlink d4/d13/d3e/d28/l8a 0 2024-05-08T05:32:15.017 INFO:tasks.workunit.client.0.smithi087.stdout:1/854: sync 2024-05-08T05:32:15.017 INFO:tasks.workunit.client.0.smithi087.stdout:3/920: sync 2024-05-08T05:32:15.017 INFO:tasks.workunit.client.0.smithi087.stdout:1/855: truncate df/d2f/d57/dcb/de1/fed 465858 0 2024-05-08T05:32:15.017 INFO:tasks.workunit.client.0.smithi087.stdout:9/943: creat d1/df/d58/d5e/f136 x:0 0 0 2024-05-08T05:32:15.017 INFO:tasks.workunit.client.0.smithi087.stdout:3/921: truncate d4/d14/f29 3149206 0 2024-05-08T05:32:15.020 INFO:tasks.workunit.client.0.smithi087.stdout:4/956: rename d4/d13/d3e/d28/d50/d9d/lcc to d4/d13/d3e/d28/d50/d9d/df2/d106/d91/db8/dba/d63/l165 0 2024-05-08T05:32:15.020 INFO:tasks.workunit.client.0.smithi087.stdout:4/957: dread - d4/d13/d3e/d28/d50/f113 zero size 2024-05-08T05:32:15.021 INFO:tasks.workunit.client.0.smithi087.stdout:1/856: truncate df/d2f/d57/d64/d83/d96/dcf/ff9 3864171 0 2024-05-08T05:32:15.022 INFO:tasks.workunit.client.0.smithi087.stdout:4/958: creat d4/d13/d3e/d28/d50/d9d/df2/d106/d91/db8/dba/dbd/d111/f166 x:0 0 0 2024-05-08T05:32:15.022 INFO:tasks.workunit.client.0.smithi087.stdout:4/959: dread - d4/d13/d32/f11d zero size 2024-05-08T05:32:15.024 INFO:tasks.workunit.client.0.smithi087.stdout:1/857: rmdir df/d18/d1d/d32 39 2024-05-08T05:32:15.027 INFO:tasks.workunit.client.0.smithi087.stdout:6/954: dread d4/d8/df/d39/d42/d9e/d6f/d7f/de7/d2d/dca/f107 [0,4194304] 0 2024-05-08T05:32:15.039 INFO:tasks.workunit.client.0.smithi087.stdout:6/955: unlink d4/d8/df/d39/d42/d9e/lb2 0 2024-05-08T05:32:15.041 INFO:tasks.workunit.client.0.smithi087.stdout:6/956: rmdir d4/d8/df/d39/d42/d9e/d6f/d7f/de7/d2d/dca/d119 0 2024-05-08T05:32:15.041 INFO:tasks.workunit.client.0.smithi087.stdout:6/957: fdatasync d4/d8/df/d39/d42/d9e/d6f/d7f/de7/fa3 0 2024-05-08T05:32:15.043 INFO:tasks.workunit.client.0.smithi087.stdout:6/958: creat d4/d8/df/d39/d42/dbd/dee/f12d x:0 0 0 2024-05-08T05:32:15.044 INFO:tasks.workunit.client.0.smithi087.stdout:6/959: write d4/d8/df/d39/d42/d9e/d6f/d7f/de7/d2d/d37/d45/f68 [770977,19181] 0 2024-05-08T05:32:15.058 INFO:tasks.workunit.client.0.smithi087.stdout:9/944: read d1/df/d37/d5b/d7e/f9b [1788141,44509] 0 2024-05-08T05:32:15.058 INFO:tasks.workunit.client.0.smithi087.stdout:9/945: dread - d1/d70/d107/d112/fb9 zero size 2024-05-08T05:32:15.059 INFO:tasks.workunit.client.0.smithi087.stdout:9/946: stat d1/df/d37/d5b/d7e 0 2024-05-08T05:32:15.059 INFO:tasks.workunit.client.0.smithi087.stdout:3/922: dwrite d4/d11/d24/f69 [4194304,4194304] 0 2024-05-08T05:32:15.060 INFO:tasks.workunit.client.0.smithi087.stdout:9/947: mkdir d1/df/d37/d5b/d7e/d85/d137 0 2024-05-08T05:32:15.060 INFO:tasks.workunit.client.0.smithi087.stdout:3/923: creat d4/d11/d24/d25/d4d/dbb/f14d x:0 0 0 2024-05-08T05:32:15.061 INFO:tasks.workunit.client.0.smithi087.stdout:3/924: read d4/d11/d24/d39/d94/df7/ffa [164185,6351] 0 2024-05-08T05:32:15.061 INFO:tasks.workunit.client.0.smithi087.stdout:9/948: creat d1/df/d14/d18/d66/d7f/dfc/f138 x:0 0 0 2024-05-08T05:32:15.062 INFO:tasks.workunit.client.0.smithi087.stdout:9/949: mknod d1/df/d14/d54/d61/d88/dde/c139 0 2024-05-08T05:32:15.066 INFO:tasks.workunit.client.0.smithi087.stdout:9/950: getdents d1/df/d14/d54/d61/d88/dde 0 2024-05-08T05:32:15.068 INFO:tasks.workunit.client.0.smithi087.stdout:9/951: creat d1/df/d14/d18/d8e/da2/f13a x:0 0 0 2024-05-08T05:32:15.069 INFO:tasks.workunit.client.0.smithi087.stdout:9/952: creat d1/df/d14/d54/d61/d72/d106/d11a/f13b x:0 0 0 2024-05-08T05:32:15.071 INFO:tasks.workunit.client.0.smithi087.stdout:9/953: rename d1/df/d14/d54/d61/f26 to d1/df/d14/d18/db5/df0/f13c 0 2024-05-08T05:32:15.071 INFO:tasks.workunit.client.0.smithi087.stdout:9/954: chown d1/df/d14/d54/d61/d72/d106/d11a/f13b 0 1 2024-05-08T05:32:15.072 INFO:tasks.workunit.client.0.smithi087.stdout:9/955: creat d1/d70/d107/f13d x:0 0 0 2024-05-08T05:32:15.072 INFO:tasks.workunit.client.0.smithi087.stdout:9/956: chown d1/df/d14/d18/f23 112 1 2024-05-08T05:32:15.080 INFO:tasks.workunit.client.0.smithi087.stdout:9/957: dread d1/df/d14/d68/d80/d98/d83/fb2 [0,4194304] 0 2024-05-08T05:32:15.080 INFO:tasks.workunit.client.0.smithi087.stdout:9/958: chown d1/df/f91 493 1 2024-05-08T05:32:15.080 INFO:tasks.workunit.client.0.smithi087.stdout:9/959: truncate d1/df/d37/d5b/def/f119 911886 0 2024-05-08T05:32:15.108 INFO:tasks.workunit.client.0.smithi087.stdout:3/925: dwrite d4/d11/d24/d25/d3e/d3f/f7b [4194304,4194304] 0 2024-05-08T05:32:15.111 INFO:tasks.workunit.client.0.smithi087.stdout:3/926: link d4/d11/d3d/f5b d4/d11/d3d/d64/f14e 0 2024-05-08T05:32:15.111 INFO:tasks.workunit.client.0.smithi087.stdout:3/927: fdatasync d4/f146 0 2024-05-08T05:32:15.131 INFO:tasks.workunit.client.0.smithi087.stdout:9/960: dwrite d1/df/d14/d68/d80/d98/feb [0,4194304] 0 2024-05-08T05:32:15.131 INFO:tasks.workunit.client.0.smithi087.stdout:9/961: fsync d1/d70/f118 0 2024-05-08T05:32:15.131 INFO:tasks.workunit.client.0.smithi087.stdout:9/962: truncate d1/df/d14/d68/d80/d98/f47 1691572 0 2024-05-08T05:32:15.131 INFO:tasks.workunit.client.0.smithi087.stdout:9/963: stat d1/df/d14/d68/d80/d98/d28/de8/f10f 0 2024-05-08T05:32:15.131 INFO:tasks.workunit.client.0.smithi087.stdout:9/964: chown d1/d70/d107/d112/f11c 1056377743 1 2024-05-08T05:32:15.131 INFO:tasks.workunit.client.0.smithi087.stdout:9/965: fsync d1/df/d37/f51 0 2024-05-08T05:32:15.131 INFO:tasks.workunit.client.0.smithi087.stdout:9/966: write d1/df/d37/d74/fa5 [4819261,12245] 0 2024-05-08T05:32:15.143 INFO:tasks.workunit.client.0.smithi087.stdout:6/960: dwrite d4/d8/df/d39/f7a [0,4194304] 0 2024-05-08T05:32:15.145 INFO:tasks.workunit.client.0.smithi087.stdout:6/961: link d4/d8/df/d39/d42/d9e/d6f/d7f/de7/d2d/d37/c118 d4/d8/df/d39/d42/d9e/d6f/d7f/de7/d2d/d37/d9c/d109/c12e 0 2024-05-08T05:32:15.165 INFO:tasks.workunit.client.0.smithi087.stdout:3/928: dwrite d4/d11/d24/d25/d3e/d3f/f7b [0,4194304] 0 2024-05-08T05:32:15.165 INFO:tasks.workunit.client.0.smithi087.stdout:9/967: dread d1/df/d37/f6d [0,4194304] 0 2024-05-08T05:32:15.165 INFO:tasks.workunit.client.0.smithi087.stdout:9/968: chown d1/df/d37/d5b/def/ff6 9028 1 2024-05-08T05:32:15.165 INFO:tasks.workunit.client.0.smithi087.stdout:9/969: readlink d1/df/d37/lbe 0 2024-05-08T05:32:15.166 INFO:tasks.workunit.client.0.smithi087.stdout:3/929: rename d4/d5f/dbd/l109 to d4/d11/d24/d25/d4d/dbb/de9/l14f 0 2024-05-08T05:32:15.167 INFO:tasks.workunit.client.0.smithi087.stdout:3/930: dread - d4/f126 zero size 2024-05-08T05:32:15.168 INFO:tasks.workunit.client.0.smithi087.stdout:3/931: mknod d4/d11/d24/d25/d4d/dd6/d121/d87/da5/d120/c150 0 2024-05-08T05:32:15.168 INFO:tasks.workunit.client.0.smithi087.stdout:3/932: truncate d4/d14/d84/fb8 22777 0 2024-05-08T05:32:15.168 INFO:tasks.workunit.client.0.smithi087.stdout:3/933: truncate d4/fc3 879885 0 2024-05-08T05:32:15.168 INFO:tasks.workunit.client.0.smithi087.stdout:3/934: dread - d4/d14/d84/ff4 zero size 2024-05-08T05:32:15.169 INFO:tasks.workunit.client.0.smithi087.stdout:3/935: chown d4/d14/d84/d117 35906 1 2024-05-08T05:32:15.169 INFO:tasks.workunit.client.0.smithi087.stdout:3/936: chown d4/fc3 13324119 1 2024-05-08T05:32:15.169 INFO:tasks.workunit.client.0.smithi087.stdout:3/937: stat d4/d11/d24/d25/d3e/d3f/f4a 0 2024-05-08T05:32:15.169 INFO:tasks.workunit.client.0.smithi087.stdout:3/938: creat d4/f151 x:0 0 0 2024-05-08T05:32:15.170 INFO:tasks.workunit.client.0.smithi087.stdout:0/834: sync 2024-05-08T05:32:15.170 INFO:tasks.workunit.client.0.smithi087.stdout:0/835: stat d0/da/d35/d86/d9a/lf6 0 2024-05-08T05:32:15.170 INFO:tasks.workunit.client.0.smithi087.stdout:0/836: truncate d0/d57/d24/d66/f6e 4663642 0 2024-05-08T05:32:15.247 INFO:tasks.workunit.client.0.smithi087.stdout:9/970: dwrite d1/df/d14/db1/fe5 [0,4194304] 0 2024-05-08T05:32:15.250 INFO:tasks.workunit.client.0.smithi087.stdout:9/971: getdents d1/df/d14/d68/d80/d98/d28/d4b 0 2024-05-08T05:32:15.250 INFO:tasks.workunit.client.0.smithi087.stdout:9/972: readlink d1/df/d14/d54/d61/d88/le0 0 2024-05-08T05:32:15.251 INFO:tasks.workunit.client.0.smithi087.stdout:9/973: mkdir d1/df/d14/d18/d8e/da2/d13e 0 2024-05-08T05:32:15.251 INFO:tasks.workunit.client.0.smithi087.stdout:3/939: dwrite d4/d11/d24/d25/d4d/dd6/d121/fe5 [0,4194304] 0 2024-05-08T05:32:15.252 INFO:tasks.workunit.client.0.smithi087.stdout:9/974: readlink d1/df/d14/d68/d80/d98/d28/d4b/dd0/l116 0 2024-05-08T05:32:15.254 INFO:tasks.workunit.client.0.smithi087.stdout:3/940: creat d4/d11/d24/d25/d3e/d58/f152 x:0 0 0 2024-05-08T05:32:15.257 INFO:tasks.workunit.client.0.smithi087.stdout:1/858: sync 2024-05-08T05:32:15.257 INFO:tasks.workunit.client.0.smithi087.stdout:6/962: sync 2024-05-08T05:32:15.258 INFO:tasks.workunit.client.0.smithi087.stdout:4/960: sync 2024-05-08T05:32:15.258 INFO:tasks.workunit.client.0.smithi087.stdout:6/963: fsync d4/d8/f3b 0 2024-05-08T05:32:15.258 INFO:tasks.workunit.client.0.smithi087.stdout:0/837: sync 2024-05-08T05:32:15.258 INFO:tasks.workunit.client.0.smithi087.stdout:0/838: dread - d0/da/d35/d86/d6d/ded/f10e zero size 2024-05-08T05:32:15.258 INFO:tasks.workunit.client.0.smithi087.stdout:0/839: fsync d0/fb9 0 2024-05-08T05:32:15.258 INFO:tasks.workunit.client.0.smithi087.stdout:0/840: chown d0/d9/d1b/fcd 30 1 2024-05-08T05:32:15.259 INFO:tasks.workunit.client.0.smithi087.stdout:1/859: creat df/d2f/d57/dcb/d105/d11c/f124 x:0 0 0 2024-05-08T05:32:15.259 INFO:tasks.workunit.client.0.smithi087.stdout:1/860: chown df/d2f/d57/da0/lb9 15854874 1 2024-05-08T05:32:15.259 INFO:tasks.workunit.client.0.smithi087.stdout:4/961: creat d4/d13/d65/dd7/f167 x:0 0 0 2024-05-08T05:32:15.259 INFO:tasks.workunit.client.0.smithi087.stdout:1/861: chown df/d18/d1d/f48 1414 1 2024-05-08T05:32:15.259 INFO:tasks.workunit.client.0.smithi087.stdout:4/962: write d4/d13/d3e/f36 [38144,38810] 0 2024-05-08T05:32:15.260 INFO:tasks.workunit.client.0.smithi087.stdout:6/964: mkdir d4/d8/df/d1e/d25/d12f 0 2024-05-08T05:32:15.260 INFO:tasks.workunit.client.0.smithi087.stdout:0/841: creat d0/d9/d1b/d2f/d54/da1/f120 x:0 0 0 2024-05-08T05:32:15.260 INFO:tasks.workunit.client.0.smithi087.stdout:1/862: truncate df/f3d 251970 0 2024-05-08T05:32:15.261 INFO:tasks.workunit.client.0.smithi087.stdout:1/863: write df/d2f/f9a [645,82900] 0 2024-05-08T05:32:15.265 INFO:tasks.workunit.client.0.smithi087.stdout:1/864: write df/d2f/d57/f11e [946940,96051] 0 2024-05-08T05:32:15.265 INFO:tasks.workunit.client.0.smithi087.stdout:4/963: symlink d4/d13/d3e/d28/d50/d9d/df2/d106/d91/db8/dba/l168 0 2024-05-08T05:32:15.265 INFO:tasks.workunit.client.0.smithi087.stdout:0/842: link d0/da/d35/d86/d74/l8f d0/d57/de1/l121 0 2024-05-08T05:32:15.265 INFO:tasks.workunit.client.0.smithi087.stdout:0/843: creat d0/da/d35/d86/d74/f122 x:0 0 0 2024-05-08T05:32:15.265 INFO:tasks.workunit.client.0.smithi087.stdout:1/865: mkdir df/d2f/d57/da0/d125 0 2024-05-08T05:32:15.265 INFO:tasks.workunit.client.0.smithi087.stdout:1/866: chown df/d18/d1d/d27/c10d 11863 1 2024-05-08T05:32:15.268 INFO:tasks.workunit.client.0.smithi087.stdout:1/867: rename df/d2f/d57/d64/d83/d96/cd8 to df/d18/d1d/d27/dd4/c126 0 2024-05-08T05:32:15.270 INFO:tasks.workunit.client.0.smithi087.stdout:1/868: rename df/f3b to df/d2f/d57/dcb/de1/de4/f127 0 2024-05-08T05:32:15.272 INFO:tasks.workunit.client.0.smithi087.stdout:1/869: creat df/d18/d1d/d58/f128 x:0 0 0 2024-05-08T05:32:15.279 INFO:tasks.workunit.client.0.smithi087.stdout:1/870: symlink df/l129 0 2024-05-08T05:32:15.294 INFO:tasks.workunit.client.0.smithi087.stdout:9/975: dread d1/df/d14/d18/f23 [0,4194304] 0 2024-05-08T05:32:15.296 INFO:tasks.workunit.client.0.smithi087.stdout:9/976: link d1/df/d14/d18/db5/f131 d1/df/d14/d68/d80/d8b/f13f 0 2024-05-08T05:32:15.297 INFO:tasks.workunit.client.0.smithi087.stdout:9/977: mknod d1/df/d14/d68/d80/d98/d83/c140 0 2024-05-08T05:32:15.312 INFO:tasks.workunit.client.0.smithi087.stdout:0/844: dread d0/da/d35/f37 [0,4194304] 0 2024-05-08T05:32:15.312 INFO:tasks.workunit.client.0.smithi087.stdout:0/845: write d0/d9/d1b/d2f/d54/f118 [19012,103993] 0 2024-05-08T05:32:15.312 INFO:tasks.workunit.client.0.smithi087.stdout:0/846: chown d0/d9/d1b/d5e/f72 0 1 2024-05-08T05:32:15.313 INFO:tasks.workunit.client.0.smithi087.stdout:0/847: symlink d0/d9/d1b/d2f/d54/da1/d94/l123 0 2024-05-08T05:32:15.315 INFO:tasks.workunit.client.0.smithi087.stdout:6/965: dwrite d4/d8/df/d39/d42/d9e/d6f/d7f/de7/d2d/d37/dea/f116 [0,4194304] 0 2024-05-08T05:32:15.321 INFO:tasks.workunit.client.0.smithi087.stdout:6/966: link d4/d8/df/d1e/d25/fc5 d4/d8/df/d39/d42/d9e/d6f/d7f/de7/d2d/d37/d45/f130 0 2024-05-08T05:32:15.335 INFO:tasks.workunit.client.0.smithi087.stdout:6/967: unlink d4/d8/c17 0 2024-05-08T05:32:15.335 INFO:tasks.workunit.client.0.smithi087.stdout:6/968: chown d4/d8/df/d39/ff4 115 1 2024-05-08T05:32:15.361 INFO:tasks.workunit.client.0.smithi087.stdout:4/964: dwrite d4/d13/d3e/d28/d50/d9d/df2/d106/ffe [0,4194304] 0 2024-05-08T05:32:15.361 INFO:tasks.workunit.client.0.smithi087.stdout:4/965: write d4/d13/d3e/f36 [1233181,127596] 0 2024-05-08T05:32:15.363 INFO:tasks.workunit.client.0.smithi087.stdout:6/969: dread d4/d8/df/d1e/d25/fe6 [0,4194304] 0 2024-05-08T05:32:15.363 INFO:tasks.workunit.client.0.smithi087.stdout:1/871: dwrite df/d2f/d4f/ff4 [0,4194304] 0 2024-05-08T05:32:15.363 INFO:tasks.workunit.client.0.smithi087.stdout:4/966: mkdir d4/d13/d3e/d28/d50/d9d/df2/d106/d91/db8/dba/d96/dd5/d169 0 2024-05-08T05:32:15.365 INFO:tasks.workunit.client.0.smithi087.stdout:1/872: creat df/d18/d1d/d32/d9c/f12a x:0 0 0 2024-05-08T05:32:15.367 INFO:tasks.workunit.client.0.smithi087.stdout:0/848: dwrite d0/da/f1e [0,4194304] 0 2024-05-08T05:32:15.367 INFO:tasks.workunit.client.0.smithi087.stdout:0/849: chown d0/da/f78 0 1 2024-05-08T05:32:15.367 INFO:tasks.workunit.client.0.smithi087.stdout:0/850: dread - d0/da/d35/d86/fd9 zero size 2024-05-08T05:32:15.370 INFO:tasks.workunit.client.0.smithi087.stdout:1/873: unlink df/d2f/d57/d64/c36 0 2024-05-08T05:32:15.371 INFO:tasks.workunit.client.0.smithi087.stdout:1/874: creat df/d2f/d57/dcb/de1/de4/f12b x:0 0 0 2024-05-08T05:32:15.386 INFO:tasks.workunit.client.0.smithi087.stdout:4/967: dread d4/d13/d65/dd7/fe9 [0,4194304] 0 2024-05-08T05:32:15.387 INFO:tasks.workunit.client.0.smithi087.stdout:4/968: write d4/d13/d32/f92 [4231910,119722] 0 2024-05-08T05:32:15.390 INFO:tasks.workunit.client.0.smithi087.stdout:4/969: symlink d4/d13/d3e/d28/d50/d5a/l16a 0 2024-05-08T05:32:15.390 INFO:tasks.workunit.client.0.smithi087.stdout:4/970: stat d4/d6c/d93/l71 0 2024-05-08T05:32:15.390 INFO:tasks.workunit.client.0.smithi087.stdout:4/971: chown d4/f40 2222312 1 2024-05-08T05:32:15.392 INFO:tasks.workunit.client.0.smithi087.stdout:4/972: mkdir d4/d16b 0 2024-05-08T05:32:15.394 INFO:tasks.workunit.client.0.smithi087.stdout:4/973: creat d4/d13/d3e/d28/d50/d9d/f16c x:0 0 0 2024-05-08T05:32:15.417 INFO:tasks.workunit.client.0.smithi087.stdout:0/851: dwrite d0/d9/d1b/d2f/d54/da1/f96 [0,4194304] 0 2024-05-08T05:32:15.425 INFO:tasks.workunit.client.0.smithi087.stdout:1/875: dwrite df/fa5 [0,4194304] 0 2024-05-08T05:32:15.427 INFO:tasks.workunit.client.0.smithi087.stdout:6/970: dwrite d4/d8/df/d39/d42/d9e/d6f/d7f/de7/d2d/d37/d9c/f108 [0,4194304] 0 2024-05-08T05:32:15.430 INFO:tasks.workunit.client.0.smithi087.stdout:6/971: creat d4/d8/df/d39/d42/d9e/d6f/d7f/de7/d57/d117/f131 x:0 0 0 2024-05-08T05:32:15.437 INFO:tasks.workunit.client.0.smithi087.stdout:9/978: sync 2024-05-08T05:32:15.438 INFO:tasks.workunit.client.0.smithi087.stdout:3/941: sync 2024-05-08T05:32:15.438 INFO:tasks.workunit.client.0.smithi087.stdout:9/979: truncate d1/d70/d107/f13d 443368 0 2024-05-08T05:32:15.444 INFO:tasks.workunit.client.0.smithi087.stdout:4/974: dwrite d4/d13/d3e/d28/d50/d9d/df2/d106/d91/db8/dba/f68 [0,4194304] 0 2024-05-08T05:32:15.447 INFO:tasks.workunit.client.0.smithi087.stdout:3/942: creat d4/d14/d84/d8b/d8f/f153 x:0 0 0 2024-05-08T05:32:15.447 INFO:tasks.workunit.client.0.smithi087.stdout:3/943: stat d4/d11/d3d 0 2024-05-08T05:32:15.448 INFO:tasks.workunit.client.0.smithi087.stdout:1/876: dread df/d2f/d57/fea [0,4194304] 0 2024-05-08T05:32:15.448 INFO:tasks.workunit.client.0.smithi087.stdout:3/944: mknod d4/d11/d24/d25/d3e/d3f/d127/c154 0 2024-05-08T05:32:15.450 INFO:tasks.workunit.client.0.smithi087.stdout:1/877: creat df/d2f/f12c x:0 0 0 2024-05-08T05:32:15.451 INFO:tasks.workunit.client.0.smithi087.stdout:3/945: creat d4/d11/f155 x:0 0 0 2024-05-08T05:32:15.451 INFO:tasks.workunit.client.0.smithi087.stdout:6/972: dread d4/d8/df/d1e/d25/f4b [0,4194304] 0 2024-05-08T05:32:15.451 INFO:tasks.workunit.client.0.smithi087.stdout:6/973: chown d4/d8/df/d39/d42/d9e/d6f/d7f/de7/f74 60134 1 2024-05-08T05:32:15.452 INFO:tasks.workunit.client.0.smithi087.stdout:9/980: write d1/df/d14/f2f [750987,30542] 0 2024-05-08T05:32:15.452 INFO:tasks.workunit.client.0.smithi087.stdout:1/878: getdents df/d18/d8b 0 2024-05-08T05:32:15.452 INFO:tasks.workunit.client.0.smithi087.stdout:1/879: truncate df/d18/d1d/d32/d100/f104 198658 0 2024-05-08T05:32:15.453 INFO:tasks.workunit.client.0.smithi087.stdout:9/981: getdents d1/df/d14/d54/d61/d88/dca/df4 0 2024-05-08T05:32:15.453 INFO:tasks.workunit.client.0.smithi087.stdout:6/974: mknod d4/d8/df/d39/d42/d9e/d6f/d7f/de7/d2d/dca/c132 0 2024-05-08T05:32:15.453 INFO:tasks.workunit.client.0.smithi087.stdout:1/880: mknod df/d18/dbe/c12d 0 2024-05-08T05:32:15.455 INFO:tasks.workunit.client.0.smithi087.stdout:6/975: link d4/d8/f3b d4/d8/df/d39/d42/d9e/d6f/dba/f133 0 2024-05-08T05:32:15.455 INFO:tasks.workunit.client.0.smithi087.stdout:6/976: read d4/d8/df/d1e/d25/f4e [2416391,18328] 0 2024-05-08T05:32:15.455 INFO:tasks.workunit.client.0.smithi087.stdout:6/977: chown d4/d8/df/d39/d42/d9e/d6f/d7f/de7/d57/d6d/f82 2 1 2024-05-08T05:32:15.456 INFO:tasks.workunit.client.0.smithi087.stdout:1/881: rename df/d18/d1d/d27/dd4/l11b to df/d18/d1d/d58/d72/dc5/l12e 0 2024-05-08T05:32:15.458 INFO:tasks.workunit.client.0.smithi087.stdout:1/882: creat df/d2f/d57/dcb/d119/f12f x:0 0 0 2024-05-08T05:32:15.458 INFO:tasks.workunit.client.0.smithi087.stdout:1/883: fdatasync df/d18/d1d/d27/d90/fc7 0 2024-05-08T05:32:15.459 INFO:tasks.workunit.client.0.smithi087.stdout:9/982: unlink d1/df/d14/d54/d61/d72/fb3 0 2024-05-08T05:32:15.459 INFO:tasks.workunit.client.0.smithi087.stdout:9/983: write d1/df/d14/d68/d80/d98/fe2 [786881,67620] 0 2024-05-08T05:32:15.459 INFO:tasks.workunit.client.0.smithi087.stdout:9/984: fdatasync d1/df/d14/d54/d61/f53 0 2024-05-08T05:32:15.461 INFO:tasks.workunit.client.0.smithi087.stdout:9/985: fdatasync d1/df/d58/fe4 0 2024-05-08T05:32:15.465 INFO:tasks.workunit.client.0.smithi087.stdout:4/975: write d4/d13/fa1 [2492185,112858] 0 2024-05-08T05:32:15.466 INFO:tasks.workunit.client.0.smithi087.stdout:4/976: fsync d4/d13/d3e/d28/d50/d9d/df2/d106/d91/db8/dba/fc2 0 2024-05-08T05:32:15.495 INFO:tasks.workunit.client.0.smithi087.stdout:6/978: dread d4/d8/df/d1e/d25/f72 [0,4194304] 0 2024-05-08T05:32:15.496 INFO:tasks.workunit.client.0.smithi087.stdout:6/979: readlink d4/d8/df/d39/l51 0 2024-05-08T05:32:15.496 INFO:tasks.workunit.client.0.smithi087.stdout:9/986: dwrite d1/f19 [0,4194304] 0 2024-05-08T05:32:15.497 INFO:tasks.workunit.client.0.smithi087.stdout:6/980: mknod d4/d8/df/d39/d42/d9e/d6f/d7f/de7/d2d/d37/dea/c134 0 2024-05-08T05:32:15.498 INFO:tasks.workunit.client.0.smithi087.stdout:6/981: link d4/d8/df/d39/d42/d9e/dd1/ce0 d4/d8/df/d39/d42/d94/c135 0 2024-05-08T05:32:15.498 INFO:tasks.workunit.client.0.smithi087.stdout:6/982: chown d4/d8/df/d39/d42/d9e/d6f/d7f/de7/d2d/d37/d5b/f5f 60 1 2024-05-08T05:32:15.499 INFO:tasks.workunit.client.0.smithi087.stdout:6/983: symlink d4/d8/df/d39/d42/d9e/d6f/d7f/de7/d2d/d37/l136 0 2024-05-08T05:32:15.504 INFO:tasks.workunit.client.0.smithi087.stdout:3/946: dwrite d4/d11/d24/d25/d3e/d3f/f6f [0,4194304] 0 2024-05-08T05:32:15.504 INFO:tasks.workunit.client.0.smithi087.stdout:3/947: stat d4/d11/d24/d25/f54 0 2024-05-08T05:32:15.505 INFO:tasks.workunit.client.0.smithi087.stdout:3/948: mknod d4/d11/d24/d39/c156 0 2024-05-08T05:32:15.511 INFO:tasks.workunit.client.0.smithi087.stdout:6/984: dread d4/d8/df/d1e/d52/f80 [0,4194304] 0 2024-05-08T05:32:15.515 INFO:tasks.workunit.client.0.smithi087.stdout:6/985: mkdir d4/d6/d137 0 2024-05-08T05:32:15.516 INFO:tasks.workunit.client.0.smithi087.stdout:6/986: write d4/d8/df/d39/ff4 [1253439,106022] 0 2024-05-08T05:32:15.516 INFO:tasks.workunit.client.0.smithi087.stdout:6/987: readlink d4/d8/df/d39/d42/d9e/d6f/d7f/de7/l10d 0 2024-05-08T05:32:15.516 INFO:tasks.workunit.client.0.smithi087.stdout:6/988: readlink d4/d8/df/d39/d42/d94/lbc 0 2024-05-08T05:32:15.516 INFO:tasks.workunit.client.0.smithi087.stdout:3/949: truncate d4/d11/d24/d25/d3e/d3f/f6f 1682166 0 2024-05-08T05:32:15.531 INFO:tasks.workunit.client.0.smithi087.stdout:9/987: dwrite d1/df/d14/d18/f1e [0,4194304] 0 2024-05-08T05:32:15.537 INFO:tasks.workunit.client.0.smithi087.stdout:6/989: dread d4/d8/df/d1e/d52/fcd [0,4194304] 0 2024-05-08T05:32:15.538 INFO:tasks.workunit.client.0.smithi087.stdout:6/990: truncate d4/d8/df/d39/d42/d9e/d6f/d7f/de7/d2d/d37/d5b/f5f 1823168 0 2024-05-08T05:32:15.556 INFO:tasks.workunit.client.0.smithi087.stdout:3/950: dwrite d4/d14/d84/d8b/d8f/fc4 [0,4194304] 0 2024-05-08T05:32:15.558 INFO:tasks.workunit.client.0.smithi087.stdout:3/951: mknod d4/d11/d24/d39/d5a/c157 0 2024-05-08T05:32:15.559 INFO:tasks.workunit.client.0.smithi087.stdout:6/991: dread d4/d8/df/d39/d42/d9e/da4/ff7 [0,4194304] 0 2024-05-08T05:32:15.559 INFO:tasks.workunit.client.0.smithi087.stdout:6/992: chown d4/d8/f18 3541543 1 2024-05-08T05:32:15.560 INFO:tasks.workunit.client.0.smithi087.stdout:3/952: unlink d4/d11/d24/d25/d3e/d58/d112/l131 0 2024-05-08T05:32:15.561 INFO:tasks.workunit.client.0.smithi087.stdout:6/993: mkdir d4/d8/df/d39/d42/dbd/df9/d138 0 2024-05-08T05:32:15.562 INFO:tasks.workunit.client.0.smithi087.stdout:3/953: rename d4/d14/f29 to d4/d11/d24/d25/d4d/dd6/d121/d87/f158 0 2024-05-08T05:32:15.562 INFO:tasks.workunit.client.0.smithi087.stdout:3/954: fdatasync d4/f146 0 2024-05-08T05:32:15.562 INFO:tasks.workunit.client.0.smithi087.stdout:3/955: chown d4/l3a 14148474 1 2024-05-08T05:32:15.564 INFO:tasks.workunit.client.0.smithi087.stdout:6/994: rename d4/d8/df/d39/d42/d9e/d6f/dba/lc4 to d4/d8/df/d39/d42/d9e/d6f/d7f/de7/d2d/dca/l139 0 2024-05-08T05:32:15.565 INFO:tasks.workunit.client.0.smithi087.stdout:3/956: mkdir d4/d11/d24/d39/d159 0 2024-05-08T05:32:15.565 INFO:tasks.workunit.client.0.smithi087.stdout:3/957: write d4/d11/d24/fe7 [5879560,62810] 0 2024-05-08T05:32:15.566 INFO:tasks.workunit.client.0.smithi087.stdout:6/995: rename d4/d8/df/d39/d42/d9e/d6f/ca5 to d4/d8/df/d39/d42/dbd/df9/c13a 0 2024-05-08T05:32:15.566 INFO:tasks.workunit.client.0.smithi087.stdout:6/996: readlink d4/d8/df/d39/d42/d94/lf1 0 2024-05-08T05:32:15.566 INFO:tasks.workunit.client.0.smithi087.stdout:3/958: creat d4/d11/d3d/d64/f15a x:0 0 0 2024-05-08T05:32:15.568 INFO:tasks.workunit.client.0.smithi087.stdout:3/959: rename d4/d11/d3d/d48/cda to d4/d11/d24/d25/d3e/d3f/d127/c15b 0 2024-05-08T05:32:15.572 INFO:tasks.workunit.client.0.smithi087.stdout:6/997: dread d4/f99 [0,4194304] 0 2024-05-08T05:32:15.573 INFO:tasks.workunit.client.0.smithi087.stdout:6/998: truncate d4/d8/df/d39/d42/fab 2334503 0 2024-05-08T05:32:15.575 INFO:tasks.workunit.client.0.smithi087.stdout:6/999: mknod d4/d8/df/d39/d42/d9e/d6f/d7f/de7/d57/d117/c13b 0 2024-05-08T05:32:15.586 INFO:tasks.workunit.client.0.smithi087.stdout:0/852: sync 2024-05-08T05:32:15.587 INFO:tasks.workunit.client.0.smithi087.stdout:0/853: creat d0/da/d35/d86/d74/f124 x:0 0 0 2024-05-08T05:32:15.588 INFO:tasks.workunit.client.0.smithi087.stdout:0/854: mknod d0/da/d35/d86/d6d/ded/dff/c125 0 2024-05-08T05:32:15.590 INFO:tasks.workunit.client.0.smithi087.stdout:0/855: unlink d0/dd0/c104 0 2024-05-08T05:32:15.620 INFO:tasks.workunit.client.0.smithi087.stdout:0/856: write d0/f29 [401667,58951] 0 2024-05-08T05:32:15.629 INFO:tasks.workunit.client.0.smithi087.stdout:0/857: read d0/d9/d1b/d2f/d54/da1/fa5 [495264,58343] 0 2024-05-08T05:32:15.631 INFO:tasks.workunit.client.0.smithi087.stdout:0/858: rename d0/d9/c65 to d0/d9/d1b/d2f/dcc/c126 0 2024-05-08T05:32:15.632 INFO:tasks.workunit.client.0.smithi087.stdout:0/859: getdents d0/da/d35/d86/d74 0 2024-05-08T05:32:15.632 INFO:tasks.workunit.client.0.smithi087.stdout:0/860: truncate d0/d9/d1b/d2f/d54/fd5 458811 0 2024-05-08T05:32:15.633 INFO:tasks.workunit.client.0.smithi087.stdout:0/861: mkdir d0/da/d35/d86/d9a/d127 0 2024-05-08T05:32:15.635 INFO:tasks.workunit.client.0.smithi087.stdout:0/862: creat d0/d9/d1b/d2f/d54/f128 x:0 0 0 2024-05-08T05:32:15.635 INFO:tasks.workunit.client.0.smithi087.stdout:0/863: write d0/d9/d1b/d2f/dcc/fe6 [4473393,44245] 0 2024-05-08T05:32:15.638 INFO:tasks.workunit.client.0.smithi087.stdout:3/960: dwrite d4/d14/dfc/f116 [0,4194304] 0 2024-05-08T05:32:15.638 INFO:tasks.workunit.client.0.smithi087.stdout:3/961: readlink d4/d11/d3d/l14b 0 2024-05-08T05:32:15.644 INFO:tasks.workunit.client.0.smithi087.stdout:0/864: rename d0/d22/d3c/dbb/ddb to d0/d57/d24/d66/d129 0 2024-05-08T05:32:15.644 INFO:tasks.workunit.client.0.smithi087.stdout:0/865: fdatasync d0/d9/d1b/d2f/d54/da1/fb1 0 2024-05-08T05:32:15.645 INFO:tasks.workunit.client.0.smithi087.stdout:0/866: creat d0/da/d35/d86/f12a x:0 0 0 2024-05-08T05:32:15.645 INFO:tasks.workunit.client.0.smithi087.stdout:0/867: dread - d0/d9/f100 zero size 2024-05-08T05:32:15.646 INFO:tasks.workunit.client.0.smithi087.stdout:0/868: write d0/d9/d1b/d2f/d54/f128 [490965,13756] 0 2024-05-08T05:32:15.647 INFO:tasks.workunit.client.0.smithi087.stdout:0/869: mknod d0/d9/d1b/d2f/d54/da1/d94/df1/c12b 0 2024-05-08T05:32:15.647 INFO:tasks.workunit.client.0.smithi087.stdout:0/870: chown d0 97 1 2024-05-08T05:32:15.647 INFO:tasks.workunit.client.0.smithi087.stdout:0/871: fsync d0/da/d35/d86/d9a/fe9 0 2024-05-08T05:32:15.649 INFO:tasks.workunit.client.0.smithi087.stdout:0/872: rename d0/da/d35/d86/d6d/ded/d108/d113/l119 to d0/dd0/de7/l12c 0 2024-05-08T05:32:15.652 INFO:tasks.workunit.client.0.smithi087.stdout:0/873: mknod d0/d9/c12d 0 2024-05-08T05:32:15.654 INFO:tasks.workunit.client.0.smithi087.stdout:0/874: creat d0/d9/d1b/d2f/d54/df9/f12e x:0 0 0 2024-05-08T05:32:15.666 INFO:tasks.workunit.client.0.smithi087.stdout:3/962: dread d4/d14/dfc/f116 [0,4194304] 0 2024-05-08T05:32:15.668 INFO:tasks.workunit.client.0.smithi087.stdout:3/963: symlink d4/d11/d3d/d4e/d6a/l15c 0 2024-05-08T05:32:15.669 INFO:tasks.workunit.client.0.smithi087.stdout:3/964: truncate d4/d11/d24/d25/d4d/dd6/d121/fe5 1138681 0 2024-05-08T05:32:15.671 INFO:tasks.workunit.client.0.smithi087.stdout:3/965: rmdir d4/d14/d84 39 2024-05-08T05:32:15.693 INFO:tasks.workunit.client.0.smithi087.stdout:0/875: write d0/da/d35/daa/fcf [3485179,98571] 0 2024-05-08T05:32:15.693 INFO:tasks.workunit.client.0.smithi087.stdout:0/876: chown d0/d22/l36 8 1 2024-05-08T05:32:15.694 INFO:tasks.workunit.client.0.smithi087.stdout:0/877: symlink d0/dd0/l12f 0 2024-05-08T05:32:15.698 INFO:tasks.workunit.client.0.smithi087.stdout:3/966: write d4/d11/f38 [2534727,31922] 0 2024-05-08T05:32:15.728 INFO:tasks.workunit.client.0.smithi087.stdout:3/967: write d4/d11/d3d/f8e [2333398,103491] 0 2024-05-08T05:32:15.728 INFO:tasks.workunit.client.0.smithi087.stdout:3/968: fsync d4/d11/d24/d25/d4d/dd6/d121/d87/da5/d120/f14a 0 2024-05-08T05:32:15.730 INFO:tasks.workunit.client.0.smithi087.stdout:3/969: unlink d4/d11/d24/d39/d5a/l11f 0 2024-05-08T05:32:15.768 INFO:tasks.workunit.client.0.smithi087.stdout:0/878: dwrite d0/d9/f7c [0,4194304] 0 2024-05-08T05:32:15.799 INFO:tasks.workunit.client.0.smithi087.stdout:0/879: dread d0/d9/d1b/d2f/d54/da1/f96 [0,4194304] 0 2024-05-08T05:32:15.799 INFO:tasks.workunit.client.0.smithi087.stdout:0/880: readlink d0/da/lcb 0 2024-05-08T05:32:15.824 INFO:tasks.workunit.client.0.smithi087.stdout:9/988: sync 2024-05-08T05:32:15.825 INFO:tasks.workunit.client.0.smithi087.stdout:1/884: sync 2024-05-08T05:32:15.825 INFO:tasks.workunit.client.0.smithi087.stdout:4/977: sync 2024-05-08T05:32:15.825 INFO:tasks.workunit.client.0.smithi087.stdout:3/970: dwrite d4/d11/d24/d25/d4d/dd6/d121/fe5 [0,4194304] 0 2024-05-08T05:32:15.825 INFO:tasks.workunit.client.0.smithi087.stdout:3/971: fsync d4/d11/d24/d39/faf 0 2024-05-08T05:32:15.829 INFO:tasks.workunit.client.0.smithi087.stdout:1/885: symlink df/d2f/d4f/l130 0 2024-05-08T05:32:15.829 INFO:tasks.workunit.client.0.smithi087.stdout:1/886: chown df/d18/d1d 30 1 2024-05-08T05:32:15.831 INFO:tasks.workunit.client.0.smithi087.stdout:1/887: mknod df/d2f/d57/dcb/de1/c131 0 2024-05-08T05:32:15.831 INFO:tasks.workunit.client.0.smithi087.stdout:1/888: truncate df/d18/ffd 1619674 0 2024-05-08T05:32:15.833 INFO:tasks.workunit.client.0.smithi087.stdout:1/889: link df/d18/d1d/d27/d61/f92 df/d2f/f132 0 2024-05-08T05:32:15.833 INFO:tasks.workunit.client.0.smithi087.stdout:1/890: chown df/d18/d1d/d58/d72/dc5/l12e 461919650 1 2024-05-08T05:32:15.834 INFO:tasks.workunit.client.0.smithi087.stdout:1/891: stat df/d18/d1d/d32/l8f 0 2024-05-08T05:32:15.835 INFO:tasks.workunit.client.0.smithi087.stdout:1/892: symlink df/d2f/d6a/l133 0 2024-05-08T05:32:15.836 INFO:tasks.workunit.client.0.smithi087.stdout:1/893: truncate df/f40 2213154 0 2024-05-08T05:32:15.837 INFO:tasks.workunit.client.0.smithi087.stdout:1/894: rename df/d2f/d57/d64/d83/ca8 to df/d2f/d57/d64/d83/d96/dcf/c134 0 2024-05-08T05:32:15.845 INFO:tasks.workunit.client.0.smithi087.stdout:1/895: rename df/d2f/d57/dcb/d105/f11d to df/d2f/d57/da0/d125/f135 0 2024-05-08T05:32:15.845 INFO:tasks.workunit.client.0.smithi087.stdout:1/896: chown df/d18/d8b 65722009 1 2024-05-08T05:32:15.847 INFO:tasks.workunit.client.0.smithi087.stdout:1/897: creat df/d18/d1d/d58/f136 x:0 0 0 2024-05-08T05:32:15.848 INFO:tasks.workunit.client.0.smithi087.stdout:1/898: rename df/d2f/f3c to df/d18/d1d/d27/d61/f137 0 2024-05-08T05:32:15.849 INFO:tasks.workunit.client.0.smithi087.stdout:1/899: truncate df/d18/d1d/d27/dd4/f11a 52250 0 2024-05-08T05:32:15.850 INFO:tasks.workunit.client.0.smithi087.stdout:1/900: rename df/d18/d1d/d27/c34 to df/d2f/d57/da0/d125/c138 0 2024-05-08T05:32:15.852 INFO:tasks.workunit.client.0.smithi087.stdout:1/901: creat df/d2f/d57/d64/d83/f139 x:0 0 0 2024-05-08T05:32:15.854 INFO:tasks.workunit.client.0.smithi087.stdout:1/902: getdents df/d18 0 2024-05-08T05:32:15.854 INFO:tasks.workunit.client.0.smithi087.stdout:1/903: read - df/d2f/d57/dcb/de1/de4/f12b zero size 2024-05-08T05:32:15.866 INFO:tasks.workunit.client.0.smithi087.stdout:4/978: read d4/f8e [2108288,58187] 0 2024-05-08T05:32:15.867 INFO:tasks.workunit.client.0.smithi087.stdout:4/979: mknod d4/d13/d3e/d28/d12f/c16d 0 2024-05-08T05:32:15.867 INFO:tasks.workunit.client.0.smithi087.stdout:4/980: creat d4/d13/d3e/d28/f16e x:0 0 0 2024-05-08T05:32:15.867 INFO:tasks.workunit.client.0.smithi087.stdout:4/981: link d4/d13/d3e/d28/d50/d9d/df2/d106/d91/f7c d4/d13/d65/f16f 0 2024-05-08T05:32:15.881 INFO:tasks.workunit.client.0.smithi087.stdout:3/972: dwrite d4/d11/d24/d25/d3e/f65 [0,4194304] 0 2024-05-08T05:32:15.901 INFO:tasks.workunit.client.0.smithi087.stdout:9/989: dwrite d1/df/d14/d18/f77 [4194304,4194304] 0 2024-05-08T05:32:15.903 INFO:tasks.workunit.client.0.smithi087.stdout:9/990: unlink d1/df/d14/d68/d80/d98/d28/cf5 0 2024-05-08T05:32:15.903 INFO:tasks.workunit.client.0.smithi087.stdout:9/991: truncate d1/df/d37/f90 130222 0 2024-05-08T05:32:15.904 INFO:tasks.workunit.client.0.smithi087.stdout:1/904: dread df/d2f/f66 [0,4194304] 0 2024-05-08T05:32:15.904 INFO:tasks.workunit.client.0.smithi087.stdout:9/992: creat d1/df/d14/d18/db5/df0/f141 x:0 0 0 2024-05-08T05:32:15.905 INFO:tasks.workunit.client.0.smithi087.stdout:4/982: write d4/d13/d3e/d28/d50/d9d/df2/d106/d91/db8/dba/d63/fad [3271393,394] 0 2024-05-08T05:32:15.908 INFO:tasks.workunit.client.0.smithi087.stdout:4/983: rmdir d4/d13/d3e/d28/d35/d126 0 2024-05-08T05:32:15.908 INFO:tasks.workunit.client.0.smithi087.stdout:4/984: chown d4/d13/d3e/d28/d35/d107/d14b/l162 6836 1 2024-05-08T05:32:15.911 INFO:tasks.workunit.client.0.smithi087.stdout:1/905: link df/d18/d8b/df2/l7b df/d18/d1d/d32/d9c/l13a 0 2024-05-08T05:32:15.912 INFO:tasks.workunit.client.0.smithi087.stdout:1/906: getdents df/d18/d1d/d58 0 2024-05-08T05:32:15.912 INFO:tasks.workunit.client.0.smithi087.stdout:1/907: write df/f4a [1420311,41559] 0 2024-05-08T05:32:15.913 INFO:tasks.workunit.client.0.smithi087.stdout:1/908: chown df/d18/d1d/l5b 61 1 2024-05-08T05:32:15.914 INFO:tasks.workunit.client.0.smithi087.stdout:1/909: rmdir df/d18/d1d/d32 39 2024-05-08T05:32:15.915 INFO:tasks.workunit.client.0.smithi087.stdout:1/910: mkdir df/d18/d1d/d13b 0 2024-05-08T05:32:15.918 INFO:tasks.workunit.client.0.smithi087.stdout:1/911: rename df/d18/d1d/l81 to df/d18/d8b/df2/l13c 0 2024-05-08T05:32:15.918 INFO:tasks.workunit.client.0.smithi087.stdout:0/881: sync 2024-05-08T05:32:15.919 INFO:tasks.workunit.client.0.smithi087.stdout:1/912: symlink df/d18/dbe/d112/l13d 0 2024-05-08T05:32:15.931 INFO:tasks.workunit.client.0.smithi087.stdout:9/993: read d1/df/d14/d68/d80/d98/d28/f4a [2013674,3182] 0 2024-05-08T05:32:15.954 INFO:tasks.workunit.client.0.smithi087.stdout:0/882: dread d0/d9/d1b/d5e/f72 [0,4194304] 0 2024-05-08T05:32:15.954 INFO:tasks.workunit.client.0.smithi087.stdout:3/973: dwrite d4/d11/d3d/d48/fc2 [0,4194304] 0 2024-05-08T05:32:15.955 INFO:tasks.workunit.client.0.smithi087.stdout:0/883: unlink d0/d9/d1b/l9f 0 2024-05-08T05:32:15.955 INFO:tasks.workunit.client.0.smithi087.stdout:0/884: rename d0/da/d35 to d0/da/d35/daa/dc5/d130 22 2024-05-08T05:32:15.956 INFO:tasks.workunit.client.0.smithi087.stdout:0/885: rmdir d0/d57/d24/d66/d129 39 2024-05-08T05:32:15.958 INFO:tasks.workunit.client.0.smithi087.stdout:0/886: mknod d0/da/d35/daa/c131 0 2024-05-08T05:32:15.960 INFO:tasks.workunit.client.0.smithi087.stdout:4/985: dwrite f1 [0,4194304] 0 2024-05-08T05:32:15.960 INFO:tasks.workunit.client.0.smithi087.stdout:4/986: chown d4/d13/d3e/d28/d50/d9d/df2/d106/d91/db8/ff7 165766 1 2024-05-08T05:32:15.961 INFO:tasks.workunit.client.0.smithi087.stdout:0/887: symlink d0/da/d35/d86/dfd/l132 0 2024-05-08T05:32:15.962 INFO:tasks.workunit.client.0.smithi087.stdout:0/888: symlink d0/d9/d1b/d2f/l133 0 2024-05-08T05:32:15.963 INFO:tasks.workunit.client.0.smithi087.stdout:0/889: fsync d0/dd0/f116 0 2024-05-08T05:32:15.963 INFO:tasks.workunit.client.0.smithi087.stdout:0/890: truncate d0/da/d35/daa/fcf 4922257 0 2024-05-08T05:32:15.970 INFO:tasks.workunit.client.0.smithi087.stdout:4/987: rename d4/d13/d65 to d4/d13/d3e/d28/d50/d9d/df2/d106/d91/db8/dba/d115/d170 0 2024-05-08T05:32:15.970 INFO:tasks.workunit.client.0.smithi087.stdout:4/988: chown d4/d13/d3e/d28/f16e 424732 1 2024-05-08T05:32:15.970 INFO:tasks.workunit.client.0.smithi087.stdout:4/989: link d4/d13/d3e/d28/f132 d4/d13/d3e/d28/d50/d9d/df2/d106/d91/db8/f171 0 2024-05-08T05:32:15.978 INFO:tasks.workunit.client.0.smithi087.stdout:1/913: dwrite df/d2f/d57/dcb/d119/f12f [0,4194304] 0 2024-05-08T05:32:15.981 INFO:tasks.workunit.client.0.smithi087.stdout:1/914: mkdir df/d2f/d57/dcb/d13e 0 2024-05-08T05:32:15.991 INFO:tasks.workunit.client.0.smithi087.stdout:4/990: dread d4/d13/d32/ddb/f6d [0,4194304] 0 2024-05-08T05:32:15.991 INFO:tasks.workunit.client.0.smithi087.stdout:3/974: dread d4/d11/f7e [0,4194304] 0 2024-05-08T05:32:15.991 INFO:tasks.workunit.client.0.smithi087.stdout:3/975: read d4/d11/f19 [618223,83075] 0 2024-05-08T05:32:15.992 INFO:tasks.workunit.client.0.smithi087.stdout:3/976: mknod d4/d11/d24/d25/d3e/d58/d9b/c15d 0 2024-05-08T05:32:15.994 INFO:tasks.workunit.client.0.smithi087.stdout:3/977: rename d4/f6 to d4/d14/d84/d8b/d8f/f15e 0 2024-05-08T05:32:15.995 INFO:tasks.workunit.client.0.smithi087.stdout:3/978: truncate d4/d11/d3d/f45 278443 0 2024-05-08T05:32:15.995 INFO:tasks.workunit.client.0.smithi087.stdout:3/979: dread - d4/d11/f155 zero size 2024-05-08T05:32:15.995 INFO:tasks.workunit.client.0.smithi087.stdout:3/980: read - d4/d14/d84/d8b/d8f/dec/ff3 zero size 2024-05-08T05:32:15.997 INFO:tasks.workunit.client.0.smithi087.stdout:3/981: creat d4/d14/f15f x:0 0 0 2024-05-08T05:32:15.997 INFO:tasks.workunit.client.0.smithi087.stdout:0/891: dread d0/d9/d1b/d2f/dcc/fe6 [0,4194304] 0 2024-05-08T05:32:16.000 INFO:tasks.workunit.client.0.smithi087.stdout:0/892: mkdir d0/d9e/d134 0 2024-05-08T05:32:16.001 INFO:tasks.workunit.client.0.smithi087.stdout:0/893: symlink d0/d22/d3c/l135 0 2024-05-08T05:32:16.002 INFO:tasks.workunit.client.0.smithi087.stdout:0/894: rename d0/da/lcb to d0/d57/d24/d66/l136 0 2024-05-08T05:32:16.003 INFO:tasks.workunit.client.0.smithi087.stdout:0/895: read d0/da/f47 [1749780,100943] 0 2024-05-08T05:32:16.007 INFO:tasks.workunit.client.0.smithi087.stdout:0/896: getdents d0/d57/de1 0 2024-05-08T05:32:16.018 INFO:tasks.workunit.client.0.smithi087.stdout:0/897: symlink d0/da/d35/daa/dc5/l137 0 2024-05-08T05:32:16.018 INFO:tasks.workunit.client.0.smithi087.stdout:0/898: truncate d0/d9/d1b/d2f/d54/da1/f62 2290914 0 2024-05-08T05:32:16.028 INFO:tasks.workunit.client.0.smithi087.stdout:4/991: write d4/d6c/faf [3976124,31161] 0 2024-05-08T05:32:16.029 INFO:tasks.workunit.client.0.smithi087.stdout:1/915: dwrite df/d2f/d4f/d52/fbd [0,4194304] 0 2024-05-08T05:32:16.029 INFO:tasks.workunit.client.0.smithi087.stdout:1/916: truncate df/d18/d8b/f8c 952134 0 2024-05-08T05:32:16.029 INFO:tasks.workunit.client.0.smithi087.stdout:1/917: fsync df/d18/d1d/d27/d61/fb2 0 2024-05-08T05:32:16.040 INFO:tasks.workunit.client.0.smithi087.stdout:1/918: mknod df/d18/d1d/c13f 0 2024-05-08T05:32:16.041 INFO:tasks.workunit.client.0.smithi087.stdout:0/899: dread d0/d9e/ff2 [0,4194304] 0 2024-05-08T05:32:16.042 INFO:tasks.workunit.client.0.smithi087.stdout:0/900: truncate d0/d57/d24/f4e 1109735 0 2024-05-08T05:32:16.044 INFO:tasks.workunit.client.0.smithi087.stdout:9/994: sync 2024-05-08T05:32:16.044 INFO:tasks.workunit.client.0.smithi087.stdout:9/995: write d1/df/d37/d5b/d7e/f9b [3844125,97608] 0 2024-05-08T05:32:16.044 INFO:tasks.workunit.client.0.smithi087.stdout:9/996: chown d1/df/d14/d68/d80/d98/f9d 0 1 2024-05-08T05:32:16.045 INFO:tasks.workunit.client.0.smithi087.stdout:9/997: write d1/df/d14/d68/d80/d98/feb [4521396,90319] 0 2024-05-08T05:32:16.050 INFO:tasks.workunit.client.0.smithi087.stdout:3/982: dwrite d4/d11/d24/d25/d3e/d58/f96 [0,4194304] 0 2024-05-08T05:32:16.052 INFO:tasks.workunit.client.0.smithi087.stdout:3/983: mkdir d4/d11/d24/d25/d3e/d160 0 2024-05-08T05:32:16.063 INFO:tasks.workunit.client.0.smithi087.stdout:9/998: dread d1/df/d58/fe4 [0,4194304] 0 2024-05-08T05:32:16.063 INFO:tasks.workunit.client.0.smithi087.stdout:9/999: chown d1/d70/d107/d112/fb9 369848657 1 2024-05-08T05:32:16.091 INFO:tasks.workunit.client.0.smithi087.stdout:3/984: dwrite d4/d14/f8a [0,4194304] 0 2024-05-08T05:32:16.091 INFO:tasks.workunit.client.0.smithi087.stdout:3/985: write d4/d11/d24/d25/d3e/d58/d112/f122 [460493,47724] 0 2024-05-08T05:32:16.100 INFO:tasks.workunit.client.0.smithi087.stdout:0/901: dwrite d0/d9/f67 [0,4194304] 0 2024-05-08T05:32:16.100 INFO:tasks.workunit.client.0.smithi087.stdout:0/902: truncate d0/d57/f2a 2198836 0 2024-05-08T05:32:16.101 INFO:tasks.workunit.client.0.smithi087.stdout:0/903: stat d0/d9/d1b/d5e/f6b 0 2024-05-08T05:32:16.102 INFO:tasks.workunit.client.0.smithi087.stdout:0/904: symlink d0/d9/d1b/d2f/l138 0 2024-05-08T05:32:16.110 INFO:tasks.workunit.client.0.smithi087.stdout:3/986: write d4/d11/d24/d25/d3e/f8d [871526,10752] 0 2024-05-08T05:32:16.111 INFO:tasks.workunit.client.0.smithi087.stdout:0/905: unlink d0/da/f30 0 2024-05-08T05:32:16.113 INFO:tasks.workunit.client.0.smithi087.stdout:0/906: symlink d0/da/d35/d86/d6d/ded/d108/d113/l139 0 2024-05-08T05:32:16.114 INFO:tasks.workunit.client.0.smithi087.stdout:3/987: rename d4/d14/dbe/dd0/c12a to d4/d11/d24/d25/d4d/dd6/d121/d87/da5/c161 0 2024-05-08T05:32:16.115 INFO:tasks.workunit.client.0.smithi087.stdout:0/907: creat d0/da/d35/daa/f13a x:0 0 0 2024-05-08T05:32:16.115 INFO:tasks.workunit.client.0.smithi087.stdout:0/908: write d0/d57/fa4 [1467755,105691] 0 2024-05-08T05:32:16.115 INFO:tasks.workunit.client.0.smithi087.stdout:0/909: write d0/da/d35/d86/d9a/dc9/fe8 [924779,14353] 0 2024-05-08T05:32:16.116 INFO:tasks.workunit.client.0.smithi087.stdout:3/988: unlink d4/d11/d24/d25/d3e/ld5 0 2024-05-08T05:32:16.117 INFO:tasks.workunit.client.0.smithi087.stdout:0/910: rename d0/d9/d1b/d2f/d54/da1/fb1 to d0/d57/d24/d66/f13b 0 2024-05-08T05:32:16.134 INFO:tasks.workunit.client.0.smithi087.stdout:0/911: dread d0/da/d35/fd1 [0,4194304] 0 2024-05-08T05:32:16.134 INFO:tasks.workunit.client.0.smithi087.stdout:0/912: dread - d0/d9/d1b/ff8 zero size 2024-05-08T05:32:16.134 INFO:tasks.workunit.client.0.smithi087.stdout:0/913: rename d0/d57/d24/d66/df3 to d0/d57/d24/d66/df3/d13c 22 2024-05-08T05:32:16.136 INFO:tasks.workunit.client.0.smithi087.stdout:0/914: creat d0/d9/d1b/d2f/df5/f13d x:0 0 0 2024-05-08T05:32:16.137 INFO:tasks.workunit.client.0.smithi087.stdout:0/915: dread - d0/d9/d1b/fca zero size 2024-05-08T05:32:16.138 INFO:tasks.workunit.client.0.smithi087.stdout:0/916: mknod d0/dd0/c13e 0 2024-05-08T05:32:16.143 INFO:tasks.workunit.client.0.smithi087.stdout:0/917: rmdir d0/d22/d3c/dbb 0 2024-05-08T05:32:16.145 INFO:tasks.workunit.client.0.smithi087.stdout:0/918: creat d0/d9/d1b/d2f/d54/da1/d94/f13f x:0 0 0 2024-05-08T05:32:16.266 INFO:tasks.workunit.client.0.smithi087.stdout:0/919: dwrite d0/d9/f7c [0,4194304] 0 2024-05-08T05:32:16.266 INFO:tasks.workunit.client.0.smithi087.stdout:0/920: read - d0/d9/d1b/f3e zero size 2024-05-08T05:32:16.275 INFO:tasks.workunit.client.0.smithi087.stdout:4/992: sync 2024-05-08T05:32:16.276 INFO:tasks.workunit.client.0.smithi087.stdout:3/989: sync 2024-05-08T05:32:16.276 INFO:tasks.workunit.client.0.smithi087.stdout:1/919: sync 2024-05-08T05:32:16.276 INFO:tasks.workunit.client.0.smithi087.stdout:3/990: chown d4/d11/d24/d39/d94/df7 65650344 1 2024-05-08T05:32:16.278 INFO:tasks.workunit.client.0.smithi087.stdout:3/991: creat d4/d11/d24/d39/d94/f162 x:0 0 0 2024-05-08T05:32:16.304 INFO:tasks.workunit.client.0.smithi087.stdout:4/993: dread d4/d13/d3e/d28/d35/f43 [0,4194304] 0 2024-05-08T05:32:16.323 INFO:tasks.workunit.client.0.smithi087.stdout:0/921: dwrite d0/d9/d1b/d2f/d54/da1/f70 [0,4194304] 0 2024-05-08T05:32:16.324 INFO:tasks.workunit.client.0.smithi087.stdout:0/922: creat d0/da/d35/d86/d6d/ded/dff/d114/f140 x:0 0 0 2024-05-08T05:32:16.326 INFO:tasks.workunit.client.0.smithi087.stdout:0/923: rename d0/da/db4 to d0/d22/d3c/d141 0 2024-05-08T05:32:16.327 INFO:tasks.workunit.client.0.smithi087.stdout:3/992: read d4/d11/d24/d25/d3e/d58/f6d [792977,107725] 0 2024-05-08T05:32:16.328 INFO:tasks.workunit.client.0.smithi087.stdout:0/924: mknod d0/da/d35/d86/d6d/ded/d108/c142 0 2024-05-08T05:32:16.329 INFO:tasks.workunit.client.0.smithi087.stdout:0/925: link d0/d57/d24/f4e d0/dd0/de7/f143 0 2024-05-08T05:32:16.331 INFO:tasks.workunit.client.0.smithi087.stdout:0/926: creat d0/d57/de1/f144 x:0 0 0 2024-05-08T05:32:16.336 INFO:tasks.workunit.client.0.smithi087.stdout:0/927: write d0/d9/d1b/fbe [506666,39507] 0 2024-05-08T05:32:16.336 INFO:tasks.workunit.client.0.smithi087.stdout:0/928: readlink d0/d9/d1b/d5e/la2 0 2024-05-08T05:32:16.336 INFO:tasks.workunit.client.0.smithi087.stdout:0/929: chown d0/da/d35/d86/dfd 318 1 2024-05-08T05:32:16.338 INFO:tasks.workunit.client.0.smithi087.stdout:0/930: mknod d0/da/d35/c145 0 2024-05-08T05:32:16.340 INFO:tasks.workunit.client.0.smithi087.stdout:0/931: creat d0/d22/d3c/d141/f146 x:0 0 0 2024-05-08T05:32:16.344 INFO:tasks.workunit.client.0.smithi087.stdout:0/932: creat d0/d57/de1/f147 x:0 0 0 2024-05-08T05:32:16.361 INFO:tasks.workunit.client.0.smithi087.stdout:1/920: dwrite df/d2f/d57/f5d [4194304,4194304] 0 2024-05-08T05:32:16.361 INFO:tasks.workunit.client.0.smithi087.stdout:1/921: chown df/d18/d1d/d27/l6b 7 1 2024-05-08T05:32:16.362 INFO:tasks.workunit.client.0.smithi087.stdout:1/922: symlink df/d18/d1d/d58/d72/dc5/l140 0 2024-05-08T05:32:16.364 INFO:tasks.workunit.client.0.smithi087.stdout:1/923: creat df/d2f/d57/d64/d83/d96/dcf/f141 x:0 0 0 2024-05-08T05:32:16.368 INFO:tasks.workunit.client.0.smithi087.stdout:0/933: dread d0/da/f47 [0,4194304] 0 2024-05-08T05:32:16.370 INFO:tasks.workunit.client.0.smithi087.stdout:0/934: link d0/d9/d1b/d2f/df5/l112 d0/da/d35/daa/dc5/l148 0 2024-05-08T05:32:16.370 INFO:tasks.workunit.client.0.smithi087.stdout:0/935: stat d0/da/d11/f20 0 2024-05-08T05:32:16.370 INFO:tasks.workunit.client.0.smithi087.stdout:0/936: chown d0/da/f78 0 1 2024-05-08T05:32:16.370 INFO:tasks.workunit.client.0.smithi087.stdout:0/937: truncate d0/d9/fb5 711823 0 2024-05-08T05:32:16.370 INFO:tasks.workunit.client.0.smithi087.stdout:0/938: dread - d0/d22/d3c/d141/f146 zero size 2024-05-08T05:32:16.370 INFO:tasks.workunit.client.0.smithi087.stdout:0/939: chown d0/d9/d1b/f7f 41 1 2024-05-08T05:32:16.373 INFO:tasks.workunit.client.0.smithi087.stdout:0/940: rename d0/d57/f77 to d0/f149 0 2024-05-08T05:32:16.374 INFO:tasks.workunit.client.0.smithi087.stdout:0/941: symlink d0/d9e/l14a 0 2024-05-08T05:32:16.379 INFO:tasks.workunit.client.0.smithi087.stdout:4/994: dwrite d4/d13/d3e/d28/d50/d9d/df2/d106/d91/db8/dba/d115/f135 [0,4194304] 0 2024-05-08T05:32:16.379 INFO:tasks.workunit.client.0.smithi087.stdout:4/995: write d4/d13/d3e/d28/d50/d9d/df2/ffc [1069599,3342] 0 2024-05-08T05:32:16.380 INFO:tasks.workunit.client.0.smithi087.stdout:4/996: mkdir d4/d6c/d93/d172 0 2024-05-08T05:32:16.382 INFO:tasks.workunit.client.0.smithi087.stdout:4/997: creat d4/d13/d3e/d28/d50/d9d/df2/d106/d91/f173 x:0 0 0 2024-05-08T05:32:16.383 INFO:tasks.workunit.client.0.smithi087.stdout:4/998: chown d4/l24 19 1 2024-05-08T05:32:16.384 INFO:tasks.workunit.client.0.smithi087.stdout:4/999: getdents d4/d13/d3e/d28/d50/d5a 0 2024-05-08T05:32:16.395 INFO:tasks.workunit.client.0.smithi087.stdout:3/993: dwrite d4/d14/d84/f88 [0,4194304] 0 2024-05-08T05:32:16.395 INFO:tasks.workunit.client.0.smithi087.stdout:3/994: stat d4/d11/d24/d25/d4d/fb1 0 2024-05-08T05:32:16.405 INFO:tasks.workunit.client.0.smithi087.stdout:3/995: dread d4/fc3 [0,4194304] 0 2024-05-08T05:32:16.406 INFO:tasks.workunit.client.0.smithi087.stdout:3/996: chown d4/d14/c4f 0 1 2024-05-08T05:32:16.407 INFO:tasks.workunit.client.0.smithi087.stdout:0/942: dread d0/fa3 [0,4194304] 0 2024-05-08T05:32:16.407 INFO:tasks.workunit.client.0.smithi087.stdout:0/943: dread - d0/d57/de1/f144 zero size 2024-05-08T05:32:16.476 INFO:tasks.workunit.client.0.smithi087.stdout:3/997: dwrite d4/d11/d24/d25/d4d/dd6/d121/d87/f158 [0,4194304] 0 2024-05-08T05:32:16.478 INFO:tasks.workunit.client.0.smithi087.stdout:3/998: symlink d4/d11/d24/d25/d4d/dd6/l163 0 2024-05-08T05:32:16.480 INFO:tasks.workunit.client.0.smithi087.stdout:3/999: unlink d4/d11/d24/d25/d3e/d3f/cba 0 2024-05-08T05:32:16.708 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:32:16 smithi087 ceph-mon[29523]: pgmap v518: 97 pgs: 97 active+clean; 1.7 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 221 MiB/s rd, 260 MiB/s wr, 372 op/s 2024-05-08T05:32:16.733 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:32:16 smithi090 ceph-mon[34526]: pgmap v518: 97 pgs: 97 active+clean; 1.7 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 221 MiB/s rd, 260 MiB/s wr, 372 op/s 2024-05-08T05:32:16.788 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:32:16 smithi160 ceph-mon[34827]: pgmap v518: 97 pgs: 97 active+clean; 1.7 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 221 MiB/s rd, 260 MiB/s wr, 372 op/s 2024-05-08T05:32:18.401 DEBUG:teuthology.orchestra.run.smithi087:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid eeeb813e-0cf9-11ef-bc97-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-05-08T05:32:18.458 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:32:18 smithi087 ceph-mon[29523]: pgmap v519: 97 pgs: 97 active+clean; 1.8 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 185 MiB/s rd, 221 MiB/s wr, 308 op/s 2024-05-08T05:32:18.483 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:32:18 smithi090 ceph-mon[34526]: pgmap v519: 97 pgs: 97 active+clean; 1.8 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 185 MiB/s rd, 221 MiB/s wr, 308 op/s 2024-05-08T05:32:18.538 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:32:18 smithi160 ceph-mon[34827]: pgmap v519: 97 pgs: 97 active+clean; 1.8 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 185 MiB/s rd, 221 MiB/s wr, 308 op/s 2024-05-08T05:32:18.868 INFO:teuthology.orchestra.run.smithi087.stderr:Inferring config /var/lib/ceph/eeeb813e-0cf9-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T05:32:20.208 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:32:20 smithi087 ceph-mon[29523]: pgmap v520: 97 pgs: 97 active+clean; 1.9 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 191 MiB/s rd, 229 MiB/s wr, 332 op/s 2024-05-08T05:32:20.483 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:32:20 smithi090 ceph-mon[34526]: pgmap v520: 97 pgs: 97 active+clean; 1.9 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 191 MiB/s rd, 229 MiB/s wr, 332 op/s 2024-05-08T05:32:20.538 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:32:20 smithi160 ceph-mon[34827]: pgmap v520: 97 pgs: 97 active+clean; 1.9 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 191 MiB/s rd, 229 MiB/s wr, 332 op/s 2024-05-08T05:32:20.818 INFO:tasks.workunit.client.0.smithi087.stdout:0/944: sync 2024-05-08T05:32:20.819 INFO:tasks.workunit.client.0.smithi087.stdout:1/924: sync 2024-05-08T05:32:20.820 INFO:tasks.workunit.client.0.smithi087.stdout:0/945: getdents d0/dd0/de7 0 2024-05-08T05:32:20.841 INFO:tasks.workunit.client.0.smithi087.stdout:0/946: unlink d0/d9e/la9 0 2024-05-08T05:32:20.841 INFO:tasks.workunit.client.0.smithi087.stdout:0/947: stat d0/de0/cef 0 2024-05-08T05:32:20.856 INFO:tasks.workunit.client.0.smithi087.stdout:1/925: dread df/d2f/d4f/d52/fbd [0,4194304] 0 2024-05-08T05:32:20.860 INFO:tasks.workunit.client.0.smithi087.stdout:1/926: rename df/d18/d8b/df2/l8e to df/d18/dbe/l142 0 2024-05-08T05:32:20.862 INFO:tasks.workunit.client.0.smithi087.stdout:1/927: creat df/d18/d1d/d27/d90/f143 x:0 0 0 2024-05-08T05:32:20.864 INFO:tasks.workunit.client.0.smithi087.stdout:1/928: mknod df/d18/d1d/d32/c144 0 2024-05-08T05:32:20.866 INFO:tasks.workunit.client.0.smithi087.stdout:1/929: getdents df/d2f/d4f 0 2024-05-08T05:32:20.870 INFO:tasks.workunit.client.0.smithi087.stdout:1/930: rename df/d2f/d4f/f93 to df/d18/d1d/d32/d100/f145 0 2024-05-08T05:32:20.875 INFO:tasks.workunit.client.0.smithi087.stdout:1/931: getdents df/d18/d8b/df2 0 2024-05-08T05:32:20.881 INFO:tasks.workunit.client.0.smithi087.stdout:1/932: rmdir df/d2f/d57/dcb/d105 39 2024-05-08T05:32:20.882 INFO:tasks.workunit.client.0.smithi087.stdout:1/933: mknod df/c146 0 2024-05-08T05:32:20.882 INFO:tasks.workunit.client.0.smithi087.stdout:1/934: truncate df/d2f/f35 5514973 0 2024-05-08T05:32:20.883 INFO:tasks.workunit.client.0.smithi087.stdout:1/935: truncate df/d18/d1d/f3a 914854 0 2024-05-08T05:32:20.889 INFO:tasks.workunit.client.0.smithi087.stdout:1/936: getdents df 0 2024-05-08T05:32:20.890 INFO:tasks.workunit.client.0.smithi087.stdout:1/937: fdatasync df/d18/d1d/d27/d90/f143 0 2024-05-08T05:32:20.891 INFO:tasks.workunit.client.0.smithi087.stdout:1/938: chown df/d2f/d4f/l117 2329 1 2024-05-08T05:32:20.893 INFO:tasks.workunit.client.0.smithi087.stdout:1/939: unlink df/d18/d1d/d58/fd3 0 2024-05-08T05:32:20.907 INFO:tasks.workunit.client.0.smithi087.stdout:1/940: dread df/f40 [0,4194304] 0 2024-05-08T05:32:20.909 INFO:tasks.workunit.client.0.smithi087.stdout:1/941: mkdir df/d18/d8b/df2/d147 0 2024-05-08T05:32:20.981 INFO:tasks.workunit.client.0.smithi087.stdout:1/942: dwrite df/d2f/d57/dcb/de1/fed [0,4194304] 0 2024-05-08T05:32:20.984 INFO:tasks.workunit.client.0.smithi087.stdout:1/943: link df/d18/dbe/cfc df/d2f/d57/dcb/d105/c148 0 2024-05-08T05:32:20.984 INFO:tasks.workunit.client.0.smithi087.stdout:1/944: stat df/d18/d1d/d27/d61/c7a 0 2024-05-08T05:32:20.985 INFO:tasks.workunit.client.0.smithi087.stdout:1/945: mkdir df/d2f/d57/dcb/de1/de4/d149 0 2024-05-08T05:32:20.985 INFO:tasks.workunit.client.0.smithi087.stdout:1/946: stat df/d18/d1d/f9e 0 2024-05-08T05:32:21.231 INFO:tasks.workunit.client.0.smithi087.stdout:0/948: sync 2024-05-08T05:32:21.231 INFO:tasks.workunit.client.0.smithi087.stdout:0/949: write d0/da/d35/f37 [379940,24041] 0 2024-05-08T05:32:21.232 INFO:tasks.workunit.client.0.smithi087.stdout:1/947: sync 2024-05-08T05:32:21.232 INFO:tasks.workunit.client.0.smithi087.stdout:1/948: write df/d18/d1d/d58/d72/fde [4546293,24203] 0 2024-05-08T05:32:21.232 INFO:tasks.workunit.client.0.smithi087.stdout:1/949: fdatasync df/d2f/d57/d64/d83/d96/fce 0 2024-05-08T05:32:21.234 INFO:tasks.workunit.client.0.smithi087.stdout:1/950: read df/d2f/fdd [18464,14953] 0 2024-05-08T05:32:21.234 INFO:tasks.workunit.client.0.smithi087.stdout:1/951: fsync df/f40 0 2024-05-08T05:32:21.235 INFO:tasks.workunit.client.0.smithi087.stdout:1/952: symlink df/d18/l14a 0 2024-05-08T05:32:21.235 INFO:tasks.workunit.client.0.smithi087.stdout:1/953: read - df/d18/d1d/d27/d90/fc7 zero size 2024-05-08T05:32:21.255 INFO:tasks.workunit.client.0.smithi087.stdout:0/950: write d0/da/d35/d86/d9a/fe9 [3823035,126216] 0 2024-05-08T05:32:21.386 INFO:tasks.workunit.client.0.smithi087.stdout:1/954: sync 2024-05-08T05:32:21.388 INFO:tasks.workunit.client.0.smithi087.stdout:1/955: mkdir df/d2f/d57/d64/d83/d96/dcf/d14b 0 2024-05-08T05:32:21.390 INFO:tasks.workunit.client.0.smithi087.stdout:1/956: mkdir df/d18/dbe/d14c 0 2024-05-08T05:32:21.390 INFO:tasks.workunit.client.0.smithi087.stdout:1/957: fsync df/d18/d1d/d58/d72/f85 0 2024-05-08T05:32:21.391 INFO:tasks.workunit.client.0.smithi087.stdout:1/958: getdents df/d2f/d57 0 2024-05-08T05:32:21.399 INFO:tasks.workunit.client.0.smithi087.stdout:1/959: write df/d18/d1d/d32/f86 [403305,2493] 0 2024-05-08T05:32:21.401 INFO:tasks.workunit.client.0.smithi087.stdout:1/960: mkdir df/d14d 0 2024-05-08T05:32:21.418 INFO:tasks.workunit.client.0.smithi087.stdout:1/961: dread df/fbc [0,4194304] 0 2024-05-08T05:32:21.509 INFO:tasks.workunit.client.0.smithi087.stdout:1/962: chown df/d2f/f50 604750876 1 2024-05-08T05:32:21.509 INFO:tasks.workunit.client.0.smithi087.stdout:1/963: stat df/d18/d1d/d32 0 2024-05-08T05:32:21.511 INFO:tasks.workunit.client.0.smithi087.stdout:1/964: mkdir df/d2f/d4f/d14e 0 2024-05-08T05:32:21.511 INFO:tasks.workunit.client.0.smithi087.stdout:1/965: fdatasync df/f1f 0 2024-05-08T05:32:21.511 INFO:tasks.workunit.client.0.smithi087.stdout:0/951: sync 2024-05-08T05:32:21.511 INFO:tasks.workunit.client.0.smithi087.stdout:0/952: rename d0/d9/f67 to d0/f14b 0 2024-05-08T05:32:21.511 INFO:tasks.workunit.client.0.smithi087.stdout:0/953: dread - d0/da/d35/d86/d74/f117 zero size 2024-05-08T05:32:21.511 INFO:tasks.workunit.client.0.smithi087.stdout:0/954: mknod d0/d57/d24/d66/df3/c14c 0 2024-05-08T05:32:21.555 INFO:tasks.workunit.client.0.smithi087.stdout:0/955: dwrite d0/da/d11/f43 [0,4194304] 0 2024-05-08T05:32:21.556 INFO:tasks.workunit.client.0.smithi087.stdout:0/956: write d0/d57/d24/d66/f101 [915621,79266] 0 2024-05-08T05:32:21.559 INFO:tasks.workunit.client.0.smithi087.stdout:0/957: symlink d0/d57/d24/d66/d129/l14d 0 2024-05-08T05:32:21.561 INFO:tasks.workunit.client.0.smithi087.stdout:0/958: mkdir d0/d9e/d14e 0 2024-05-08T05:32:21.561 INFO:tasks.workunit.client.0.smithi087.stdout:0/959: read - d0/da/d35/d86/f107 zero size 2024-05-08T05:32:21.561 INFO:tasks.workunit.client.0.smithi087.stdout:0/960: stat d0/d9e/ff2 0 2024-05-08T05:32:21.572 INFO:tasks.workunit.client.0.smithi087.stdout:1/966: sync 2024-05-08T05:32:21.573 INFO:tasks.workunit.client.0.smithi087.stdout:1/967: write df/f11 [5118511,79648] 0 2024-05-08T05:32:21.576 INFO:tasks.workunit.client.0.smithi087.stdout:1/968: symlink df/d18/d1d/d58/d72/l14f 0 2024-05-08T05:32:21.594 INFO:tasks.workunit.client.0.smithi087.stdout:0/961: dread d0/da/d35/f37 [0,4194304] 0 2024-05-08T05:32:21.595 INFO:tasks.workunit.client.0.smithi087.stdout:0/962: symlink d0/da/d35/d86/d74/l14f 0 2024-05-08T05:32:21.598 INFO:tasks.workunit.client.0.smithi087.stdout:0/963: rename d0/da/c2e to d0/da/d35/d86/d6d/ded/d108/c150 0 2024-05-08T05:32:21.599 INFO:tasks.workunit.client.0.smithi087.stdout:0/964: mknod d0/d9e/c151 0 2024-05-08T05:32:21.603 INFO:tasks.workunit.client.0.smithi087.stdout:1/969: write df/d18/d1d/d58/d72/fde [3246717,56631] 0 2024-05-08T05:32:21.649 INFO:tasks.workunit.client.0.smithi087.stdout:0/965: dwrite d0/da/d11/f43 [4194304,4194304] 0 2024-05-08T05:32:21.649 INFO:tasks.workunit.client.0.smithi087.stdout:0/966: chown d0/d9/d1b/d2f/dcc 5237 1 2024-05-08T05:32:21.649 INFO:tasks.workunit.client.0.smithi087.stdout:0/967: chown d0/d57/d24/d66/f6f 262766 1 2024-05-08T05:32:21.657 INFO:tasks.workunit.client.0.smithi087.stdout:0/968: rename d0/d57/d24/d66 to d0/d9/d1b/d2f/d54/d152 0 2024-05-08T05:32:21.663 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:21.663+0000 7feebb600700 1 -- 172.21.15.87:0/854652453 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7feeb4075ff0 msgr2=0x7feeb410f960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:32:21.664 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:21.663+0000 7feebb600700 1 --2- 172.21.15.87:0/854652453 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7feeb4075ff0 0x7feeb410f960 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7feea0009990 tx=0x7feea0009ca0 comp rx=0 tx=0).stop 2024-05-08T05:32:21.664 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:21.663+0000 7feebb600700 1 -- 172.21.15.87:0/854652453 shutdown_connections 2024-05-08T05:32:21.664 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:21.663+0000 7feebb600700 1 --2- 172.21.15.87:0/854652453 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7feeb410fea0 0x7feeb4112290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:32:21.664 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:21.663+0000 7feebb600700 1 --2- 172.21.15.87:0/854652453 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7feeb40756d0 0x7feeb4075ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:32:21.664 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:21.663+0000 7feebb600700 1 --2- 172.21.15.87:0/854652453 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7feeb4075ff0 0x7feeb410f960 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:32:21.664 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:21.663+0000 7feebb600700 1 -- 172.21.15.87:0/854652453 >> 172.21.15.87:0/854652453 conn(0x7feeb407a600 msgr2=0x7feeb407aa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:32:21.664 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:21.663+0000 7feebb600700 1 -- 172.21.15.87:0/854652453 shutdown_connections 2024-05-08T05:32:21.664 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:21.663+0000 7feebb600700 1 -- 172.21.15.87:0/854652453 wait complete. 2024-05-08T05:32:21.665 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:21.665+0000 7feebb600700 1 Processor -- start 2024-05-08T05:32:21.665 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:21.665+0000 7feebb600700 1 -- start start 2024-05-08T05:32:21.665 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:21.665+0000 7feebb600700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7feeb40756d0 0x7feeb419be30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:32:21.666 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:21.665+0000 7feebb600700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7feeb4075ff0 0x7feeb419c370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:32:21.666 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:21.665+0000 7feebb600700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7feeb410fea0 0x7feeb41a06b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:32:21.666 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:21.665+0000 7feebb600700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7feeb41158c0 con 0x7feeb4075ff0 2024-05-08T05:32:21.666 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:21.665+0000 7feebb600700 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7feeb4115740 con 0x7feeb40756d0 2024-05-08T05:32:21.666 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:21.665+0000 7feebb600700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7feeb4115a40 con 0x7feeb410fea0 2024-05-08T05:32:21.666 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:21.666+0000 7feeb8c00700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7feeb40756d0 0x7feeb419be30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:32:21.666 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:21.666+0000 7feeb8c00700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7feeb40756d0 0x7feeb419be30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.87:45180/0 (socket says 172.21.15.87:45180) 2024-05-08T05:32:21.666 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:21.666+0000 7feeb8c00700 1 -- 172.21.15.87:0/1818971328 learned_addr learned my addr 172.21.15.87:0/1818971328 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T05:32:21.667 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:21.666+0000 7feeb3e00700 1 --2- 172.21.15.87:0/1818971328 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7feeb4075ff0 0x7feeb419c370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:32:21.667 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:21.666+0000 7feeb8c00700 1 -- 172.21.15.87:0/1818971328 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7feeb410fea0 msgr2=0x7feeb41a06b0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-05-08T05:32:21.667 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:21.666+0000 7feeb8c00700 1 --2- 172.21.15.87:0/1818971328 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7feeb410fea0 0x7feeb41a06b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:32:21.668 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:21.666+0000 7feeb8c00700 1 -- 172.21.15.87:0/1818971328 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7feeb4075ff0 msgr2=0x7feeb419c370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:32:21.668 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:21.666+0000 7feeb8c00700 1 --2- 172.21.15.87:0/1818971328 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7feeb4075ff0 0x7feeb419c370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:32:21.668 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:21.666+0000 7feeb8c00700 1 -- 172.21.15.87:0/1818971328 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feeb41a0df0 con 0x7feeb40756d0 2024-05-08T05:32:21.668 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:21.666+0000 7feeb8c00700 1 --2- 172.21.15.87:0/1818971328 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7feeb40756d0 0x7feeb419be30 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7feea800e9c0 tx=0x7feea800ecd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:32:21.668 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:21.667+0000 7feeb1600700 1 -- 172.21.15.87:0/1818971328 <== mon.2 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feea800cbd0 con 0x7feeb40756d0 2024-05-08T05:32:21.668 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:21.667+0000 7feeb1600700 1 -- 172.21.15.87:0/1818971328 <== mon.2 v2:172.21.15.90:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7feea800cd70 con 0x7feeb40756d0 2024-05-08T05:32:21.668 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:21.667+0000 7feeb1600700 1 -- 172.21.15.87:0/1818971328 <== mon.2 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feea8005610 con 0x7feeb40756d0 2024-05-08T05:32:21.668 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:21.667+0000 7feebb600700 1 -- 172.21.15.87:0/1818971328 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feeb41a10e0 con 0x7feeb40756d0 2024-05-08T05:32:21.668 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:21.667+0000 7feebb600700 1 -- 172.21.15.87:0/1818971328 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feeb41a8960 con 0x7feeb40756d0 2024-05-08T05:32:21.670 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:21.670+0000 7feeb1600700 1 -- 172.21.15.87:0/1818971328 <== mon.2 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7feea8004750 con 0x7feeb40756d0 2024-05-08T05:32:21.672 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:21.672+0000 7feec6087b80 1 Processor -- start 2024-05-08T05:32:21.672 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:21.672+0000 7feec6087b80 1 -- start start 2024-05-08T05:32:21.672 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:21.672+0000 7feec6087b80 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5632ea836060 0x5632ea836440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:32:21.673 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:21.672+0000 7feec6087b80 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5632ea836980 0x5632ea83a490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:32:21.673 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:21.672+0000 7feec6087b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5632ea83a9d0 0x5632ea83ae30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:32:21.673 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:21.672+0000 7feec6087b80 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x5632ea788a20 con 0x5632ea836980 2024-05-08T05:32:21.673 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:21.672+0000 7feec6087b80 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x5632ea726760 con 0x5632ea836060 2024-05-08T05:32:21.673 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:21.672+0000 7feec6087b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x5632ea7849e0 con 0x5632ea83a9d0 2024-05-08T05:32:21.673 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:21.672+0000 7feeb9600700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5632ea836060 0x5632ea836440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:32:21.673 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:21.673+0000 7feeb9600700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5632ea836060 0x5632ea836440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.87:45194/0 (socket says 172.21.15.87:45194) 2024-05-08T05:32:21.674 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:21.673+0000 7feeb9600700 1 -- 172.21.15.87:0/1165125810 learned_addr learned my addr 172.21.15.87:0/1165125810 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T05:32:21.674 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:21.673+0000 7feeb8c00700 1 --2- 172.21.15.87:0/1165125810 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5632ea836980 0x5632ea83a490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:32:21.674 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:21.673+0000 7feeb3e00700 1 --2- 172.21.15.87:0/1165125810 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5632ea83a9d0 0x5632ea83ae30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:32:21.674 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:21.673+0000 7feeb9600700 1 -- 172.21.15.87:0/1165125810 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5632ea83a9d0 msgr2=0x5632ea83ae30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:32:21.674 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:21.673+0000 7feeb9600700 1 --2- 172.21.15.87:0/1165125810 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5632ea83a9d0 0x5632ea83ae30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:32:21.674 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:21.673+0000 7feeb9600700 1 -- 172.21.15.87:0/1165125810 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5632ea836980 msgr2=0x5632ea83a490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:32:21.674 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:21.673+0000 7feeb9600700 1 --2- 172.21.15.87:0/1165125810 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5632ea836980 0x5632ea83a490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:32:21.674 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:21.673+0000 7feeb9600700 1 -- 172.21.15.87:0/1165125810 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5632ea6d58d0 con 0x5632ea836060 2024-05-08T05:32:21.674 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:21.673+0000 7feeb3e00700 1 --2- 172.21.15.87:0/1165125810 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5632ea83a9d0 0x5632ea83ae30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T05:32:21.674 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:21.673+0000 7feeb9600700 1 --2- 172.21.15.87:0/1165125810 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5632ea836060 0x5632ea836440 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7feeac009bb0 tx=0x7feeac009ec0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=eddc95432228347d server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:32:21.675 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:21.674+0000 7feeb1600700 1 --2- 172.21.15.87:0/1818971328 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7fee9c0b2900 0x7fee9c0b4dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:32:21.675 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:21.674+0000 7feea6000700 1 -- 172.21.15.87:0/1165125810 <== mon.2 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feeac004bb0 con 0x5632ea836060 2024-05-08T05:32:21.675 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:21.674+0000 7feea6000700 1 -- 172.21.15.87:0/1165125810 <== mon.2 v2:172.21.15.90:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7feeac004d50 con 0x5632ea836060 2024-05-08T05:32:21.675 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:21.674+0000 7feea6000700 1 -- 172.21.15.87:0/1165125810 <== mon.2 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feeac013630 con 0x5632ea836060 2024-05-08T05:32:21.675 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:21.674+0000 7feeb1600700 1 -- 172.21.15.87:0/1818971328 <== mon.2 v2:172.21.15.90:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8190+0+0 (secure 0 0 0) 0x7feea80e24a0 con 0x7feeb40756d0 2024-05-08T05:32:21.675 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:21.674+0000 7feec6087b80 1 -- 172.21.15.87:0/1165125810 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5632ea836060 msgr2=0x5632ea836440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:32:21.675 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:21.674+0000 7feec6087b80 1 --2- 172.21.15.87:0/1165125810 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5632ea836060 0x5632ea836440 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7feeac009bb0 tx=0x7feeac009ec0 comp rx=0 tx=0).stop 2024-05-08T05:32:21.676 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:21.675+0000 7feec6087b80 1 -- 172.21.15.87:0/1165125810 shutdown_connections 2024-05-08T05:32:21.676 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:21.675+0000 7feec6087b80 1 --2- 172.21.15.87:0/1165125810 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5632ea83a9d0 0x5632ea83ae30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:32:21.676 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:21.675+0000 7feec6087b80 1 --2- 172.21.15.87:0/1165125810 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5632ea836060 0x5632ea836440 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:32:21.676 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:21.675+0000 7feec6087b80 1 --2- 172.21.15.87:0/1165125810 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5632ea836980 0x5632ea83a490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:32:21.676 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:21.675+0000 7feec6087b80 1 -- 172.21.15.87:0/1165125810 >> 172.21.15.87:0/1165125810 conn(0x5632ea764b60 msgr2=0x5632ea8307a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:32:21.676 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:21.675+0000 7feec6087b80 1 -- 172.21.15.87:0/1165125810 shutdown_connections 2024-05-08T05:32:21.676 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:21.675+0000 7feec6087b80 1 -- 172.21.15.87:0/1165125810 wait complete. 2024-05-08T05:32:21.676 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:21.675+0000 7feeb8c00700 1 --2- 172.21.15.87:0/1818971328 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7fee9c0b2900 0x7fee9c0b4dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:32:21.677 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:21.675+0000 7feec6087b80 1 -- start start 2024-05-08T05:32:21.677 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:21.675+0000 7feeb8c00700 1 --2- 172.21.15.87:0/1818971328 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7fee9c0b2900 0x7fee9c0b4dc0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7feea80a9a20 tx=0x7feea80050b0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:32:21.677 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:21.676+0000 7feec6087b80 1 Processor -- start 2024-05-08T05:32:21.677 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:21.676+0000 7feec6087b80 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5632ea836060 0x5632ea841e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:32:21.677 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:21.676+0000 7feec6087b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5632ea836980 0x5632ea83f1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:32:21.677 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:21.676+0000 7feec6087b80 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5632ea83a9d0 0x5632ea83f700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:32:21.677 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:21.676+0000 7feec6087b80 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x5632ea842be0 con 0x5632ea83a9d0 2024-05-08T05:32:21.677 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:21.676+0000 7feec6087b80 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x5632ea6eeb20 con 0x5632ea836060 2024-05-08T05:32:21.678 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:21.676+0000 7feec6087b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x5632ea842d60 con 0x5632ea836980 2024-05-08T05:32:21.678 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:21.676+0000 7feec6087b80 10 client.0 _ll_register_callbacks cb 0x5632ea72fc70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T05:32:21.678 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:21.677+0000 7feeb9600700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5632ea836060 0x5632ea841e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:32:21.678 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:21.677+0000 7feeb9600700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5632ea836060 0x5632ea841e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.87:45196/0 (socket says 172.21.15.87:45196) 2024-05-08T05:32:21.678 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:21.677+0000 7feeb9600700 1 -- 172.21.15.87:0/3856844342 learned_addr learned my addr 172.21.15.87:0/3856844342 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T05:32:21.678 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:21.677+0000 7feeb9600700 1 --2- 172.21.15.87:0/3856844342 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5632ea83a9d0 0x5632ea83f700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:32:21.678 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:21.677+0000 7feeb3e00700 1 --2- 172.21.15.87:0/3856844342 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5632ea836980 0x5632ea83f1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:32:21.679 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:21.677+0000 7feeb9600700 1 -- 172.21.15.87:0/3856844342 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5632ea836980 msgr2=0x5632ea83f1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:32:21.680 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:21.677+0000 7feeb9600700 1 --2- 172.21.15.87:0/3856844342 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5632ea836980 0x5632ea83f1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:32:21.680 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:21.677+0000 7feeb9600700 1 -- 172.21.15.87:0/3856844342 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5632ea83a9d0 msgr2=0x5632ea83f700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:32:21.680 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:21.677+0000 7feeb9600700 1 --2- 172.21.15.87:0/3856844342 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5632ea83a9d0 0x5632ea83f700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:32:21.680 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:21.677+0000 7feeb9600700 1 -- 172.21.15.87:0/3856844342 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5632ea74e420 con 0x5632ea836060 2024-05-08T05:32:21.680 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:21.677+0000 7feeb9600700 1 --2- 172.21.15.87:0/3856844342 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5632ea836060 0x5632ea841e20 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7feeac005b50 tx=0x7feeac005a50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3088fe5d21c3d2f7 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:32:21.680 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:21.678+0000 7fee9aa00700 10 client.0 ms_handle_connect on v2:172.21.15.90:3300/0 2024-05-08T05:32:21.680 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:21.678+0000 7fee9aa00700 1 -- 172.21.15.87:0/3856844342 <== mon.2 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feeac003c10 con 0x5632ea836060 2024-05-08T05:32:21.680 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:21.678+0000 7fee9aa00700 1 -- 172.21.15.87:0/3856844342 <== mon.2 v2:172.21.15.90:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8190+0+0 (secure 0 0 0) 0x7feeac003db0 con 0x5632ea836060 2024-05-08T05:32:21.680 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:21.678+0000 7feec6087b80 1 -- 172.21.15.87:0/3856844342 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7feeac004d50 con 0x5632ea836060 2024-05-08T05:32:21.680 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:21.678+0000 7fee9aa00700 1 -- 172.21.15.87:0/3856844342 <== mon.2 v2:172.21.15.90:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7feeac004f00 con 0x5632ea836060 2024-05-08T05:32:21.680 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:21.678+0000 7feec6087b80 10 client.25496 fetch_fsmap learned FSMap version 26 2024-05-08T05:32:21.680 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:21.678+0000 7feec6087b80 1 -- 172.21.15.87:0/3856844342 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x5632ea84d3c0 con 0x5632ea836060 2024-05-08T05:32:21.680 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:21.678+0000 7fee9aa00700 1 -- 172.21.15.87:0/3856844342 <== mon.2 v2:172.21.15.90:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7feeac004d50 con 0x5632ea836060 2024-05-08T05:32:21.681 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:21.679+0000 7fee9aa00700 1 -- 172.21.15.87:0/3856844342 <== mon.2 v2:172.21.15.90:3300/0 5 ==== fsmap(e 26) ==== 8346+0+0 (secure 0 0 0) 0x7feeac012070 con 0x5632ea836060 2024-05-08T05:32:21.681 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:21.679+0000 7feec6087b80 10 client.25496 fetch_fsmap finished waiting for FSMap version 26 2024-05-08T05:32:21.681 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:21.679+0000 7feec6087b80 10 client.25496 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-05-08T05:32:21.681 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:21.679+0000 7feec6087b80 20 client.25496 populate_metadata read hostname 'smithi087' 2024-05-08T05:32:21.681 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:21.679+0000 7feec6087b80 1 --2- 172.21.15.87:0/3856844342 >> [v2:172.21.15.90:6838/160586017,v1:172.21.15.90:6839/160586017] conn(0x5632ea84f8f0 0x5632ea851ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:32:21.681 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:21.679+0000 7feec6087b80 4 client.25496 mds_command: new command op to 24500 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-08T05:32:21.681 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:21.679+0000 7feec6087b80 1 -- 172.21.15.87:0/3856844342 --> [v2:172.21.15.90:6838/160586017,v1:172.21.15.90:6839/160586017] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5632ea8030a0 con 0x5632ea84f8f0 2024-05-08T05:32:21.681 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:21.679+0000 7feeb3e00700 1 --2- 172.21.15.87:0/3856844342 >> [v2:172.21.15.90:6838/160586017,v1:172.21.15.90:6839/160586017] conn(0x5632ea84f8f0 0x5632ea851ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:32:21.682 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:21.680+0000 7feeb3e00700 1 --2- 172.21.15.87:0/3856844342 >> [v2:172.21.15.90:6838/160586017,v1:172.21.15.90:6839/160586017] conn(0x5632ea84f8f0 0x5632ea851ce0 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e14934b19523c908 server_cookie=65a0a0df92c28f98 in_seq=0 out_seq=0 2024-05-08T05:32:21.682 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:21.680+0000 7fee9aa00700 10 client.25496 ms_handle_connect on v2:172.21.15.90:6838/160586017 2024-05-08T05:32:21.682 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:21.681+0000 7fee9aa00700 1 -- 172.21.15.87:0/3856844342 <== mds.0 v2:172.21.15.90:6838/160586017 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x5632ea8030a0 con 0x5632ea84f8f0 2024-05-08T05:32:21.682 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:21.681+0000 7fee9aa00700 10 client.25496 handle_command_reply: tid=0 2024-05-08T05:32:21.682 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:21.681+0000 7feec6087b80 1 client.25496 shutdown 2024-05-08T05:32:21.682 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:21.681+0000 7feec6087b80 1 -- 172.21.15.87:0/3856844342 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5632ea836060 msgr2=0x5632ea841e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:32:21.683 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:21.681+0000 7feec6087b80 1 --2- 172.21.15.87:0/3856844342 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5632ea836060 0x5632ea841e20 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7feeac005b50 tx=0x7feeac005a50 comp rx=0 tx=0).stop 2024-05-08T05:32:21.683 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:21.681+0000 7feec6087b80 1 -- 172.21.15.87:0/3856844342 shutdown_connections 2024-05-08T05:32:21.683 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:21.681+0000 7feec6087b80 1 --2- 172.21.15.87:0/3856844342 >> [v2:172.21.15.90:6838/160586017,v1:172.21.15.90:6839/160586017] conn(0x5632ea84f8f0 0x5632ea851ce0 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:32:21.683 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:21.681+0000 7feec6087b80 1 --2- 172.21.15.87:0/3856844342 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5632ea83a9d0 0x5632ea83f700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:32:21.683 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:21.681+0000 7feec6087b80 1 --2- 172.21.15.87:0/3856844342 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5632ea836060 0x5632ea841e20 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:32:21.683 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:21.681+0000 7feec6087b80 1 --2- 172.21.15.87:0/3856844342 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5632ea836980 0x5632ea83f1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:32:21.683 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:21.681+0000 7fee9aa00700 0 client.25496 ms_handle_reset on v2:172.21.15.90:6838/160586017 2024-05-08T05:32:21.683 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:21.681+0000 7feec6087b80 1 -- 172.21.15.87:0/3856844342 >> 172.21.15.87:0/3856844342 conn(0x5632ea764b60 msgr2=0x5632ea82b2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:32:21.683 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:21.681+0000 7feec6087b80 1 -- 172.21.15.87:0/3856844342 shutdown_connections 2024-05-08T05:32:21.683 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:21.682+0000 7feec6087b80 1 -- 172.21.15.87:0/3856844342 wait complete. 2024-05-08T05:32:21.683 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:21.682+0000 7feec6087b80 20 client.25496 trim_cache size 0 max 16384 2024-05-08T05:32:21.692 INFO:tasks.workunit.client.0.smithi087.stdout:1/970: dwrite df/d18/d1d/f107 [0,4194304] 0 2024-05-08T05:32:21.694 INFO:tasks.workunit.client.0.smithi087.stdout:1/971: symlink df/d2f/d4f/l150 0 2024-05-08T05:32:21.696 INFO:tasks.workunit.client.0.smithi087.stdout:1/972: mkdir df/d18/d1d/d27/d61/d89/d151 0 2024-05-08T05:32:21.707 INFO:tasks.workunit.client.0.smithi087.stdout:0/969: dwrite d0/d9/d1b/fca [0,4194304] 0 2024-05-08T05:32:21.718 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:21.718+0000 7feec6087b80 1 Processor -- start 2024-05-08T05:32:21.718 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:21.718+0000 7feec6087b80 1 -- start start 2024-05-08T05:32:21.719 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:21.718+0000 7feec6087b80 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5632ea836060 0x5632ea83de20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:32:21.719 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:21.718+0000 7feec6087b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5632ea836980 0x5632ea84bca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:32:21.719 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:21.718+0000 7feec6087b80 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5632ea83a9d0 0x5632ea83adb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:32:21.719 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:21.718+0000 7feec6087b80 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7feeb41b2600 con 0x5632ea83a9d0 2024-05-08T05:32:21.720 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:21.718+0000 7feec6087b80 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7feeb41afe90 con 0x5632ea836060 2024-05-08T05:32:21.720 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:21.718+0000 7feec6087b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7feeb41adce0 con 0x5632ea836980 2024-05-08T05:32:21.720 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:21.719+0000 7feeb9600700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5632ea836060 0x5632ea83de20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:32:21.720 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:21.719+0000 7feeb9600700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5632ea836060 0x5632ea83de20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.87:45208/0 (socket says 172.21.15.87:45208) 2024-05-08T05:32:21.720 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:21.719+0000 7feeb3e00700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5632ea836980 0x5632ea84bca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:32:21.720 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:21.719+0000 7feeb9600700 1 -- 172.21.15.87:0/1440058805 learned_addr learned my addr 172.21.15.87:0/1440058805 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T05:32:21.721 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:21.719+0000 7feeb9600700 1 -- 172.21.15.87:0/1440058805 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5632ea836980 msgr2=0x5632ea84bca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:32:21.721 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:21.719+0000 7feeb9600700 1 --2- 172.21.15.87:0/1440058805 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5632ea836980 0x5632ea84bca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:32:21.721 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:21.719+0000 7feeb9600700 1 -- 172.21.15.87:0/1440058805 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5632ea83a9d0 msgr2=0x5632ea83adb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:32:21.721 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:21.719+0000 7feeb9600700 1 --2- 172.21.15.87:0/1440058805 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5632ea83a9d0 0x5632ea83adb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:32:21.721 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:21.720+0000 7feeb9600700 1 -- 172.21.15.87:0/1440058805 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5632ea83ef90 con 0x5632ea836060 2024-05-08T05:32:21.721 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:21.720+0000 7feeb9600700 1 --2- 172.21.15.87:0/1440058805 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5632ea836060 0x5632ea83de20 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7feeac0041e0 tx=0x7feeac009190 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5c775672cbbd3bb0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:32:21.721 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:21.720+0000 7feea5600700 1 -- 172.21.15.87:0/1440058805 <== mon.2 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feeac003e10 con 0x5632ea836060 2024-05-08T05:32:21.722 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:21.720+0000 7feea5600700 1 -- 172.21.15.87:0/1440058805 <== mon.2 v2:172.21.15.90:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7feeac004d30 con 0x5632ea836060 2024-05-08T05:32:21.722 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:21.720+0000 7feea5600700 1 -- 172.21.15.87:0/1440058805 <== mon.2 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feeac004580 con 0x5632ea836060 2024-05-08T05:32:21.722 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:21.721+0000 7feec6087b80 1 -- 172.21.15.87:0/1440058805 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5632ea836060 msgr2=0x5632ea83de20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:32:21.722 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:21.721+0000 7feec6087b80 1 --2- 172.21.15.87:0/1440058805 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5632ea836060 0x5632ea83de20 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7feeac0041e0 tx=0x7feeac009190 comp rx=0 tx=0).stop 2024-05-08T05:32:21.723 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:21.721+0000 7feec6087b80 1 -- 172.21.15.87:0/1440058805 shutdown_connections 2024-05-08T05:32:21.723 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:21.721+0000 7feec6087b80 1 --2- 172.21.15.87:0/1440058805 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5632ea83a9d0 0x5632ea83adb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:32:21.723 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:21.721+0000 7feec6087b80 1 --2- 172.21.15.87:0/1440058805 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5632ea836060 0x5632ea83de20 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:32:21.723 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:21.721+0000 7feec6087b80 1 --2- 172.21.15.87:0/1440058805 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5632ea836980 0x5632ea84bca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:32:21.723 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:21.721+0000 7feec6087b80 1 -- 172.21.15.87:0/1440058805 >> 172.21.15.87:0/1440058805 conn(0x5632ea764b60 msgr2=0x5632ea82b2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:32:21.723 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:21.722+0000 7feec6087b80 1 -- 172.21.15.87:0/1440058805 shutdown_connections 2024-05-08T05:32:21.723 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:21.722+0000 7feec6087b80 1 -- 172.21.15.87:0/1440058805 wait complete. 2024-05-08T05:32:21.723 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:21.722+0000 7feec6087b80 1 -- start start 2024-05-08T05:32:21.723 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:21.723+0000 7feec6087b80 1 Processor -- start 2024-05-08T05:32:21.724 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:21.723+0000 7feec6087b80 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5632ea836060 0x5632ea8443c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:32:21.724 INFO:tasks.workunit.client.0.smithi087.stdout:0/970: dread d0/da/d35/f80 [0,4194304] 0 2024-05-08T05:32:21.725 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:21.723+0000 7feec6087b80 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5632ea836980 0x5632ea844900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:32:21.725 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:21.723+0000 7feec6087b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5632ea83a9d0 0x5632ea8b8e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:32:21.725 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:21.723+0000 7feec6087b80 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7feeb41ae350 con 0x5632ea836980 2024-05-08T05:32:21.725 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:21.723+0000 7feec6087b80 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7feeb41af7c0 con 0x5632ea836060 2024-05-08T05:32:21.725 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:21.723+0000 7feec6087b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7feeb41aea20 con 0x5632ea83a9d0 2024-05-08T05:32:21.725 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:21.723+0000 7feec6087b80 10 client.0 _ll_register_callbacks cb 0x5632ea72fc70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T05:32:21.725 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:21.724+0000 7feeb9600700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5632ea836060 0x5632ea8443c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:32:21.725 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:21.724+0000 7feeb9600700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5632ea836060 0x5632ea8443c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.87:45216/0 (socket says 172.21.15.87:45216) 2024-05-08T05:32:21.725 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:21.724+0000 7feeb9600700 1 -- 172.21.15.87:0/91444731 learned_addr learned my addr 172.21.15.87:0/91444731 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T05:32:21.726 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:21.724+0000 7feeb9600700 1 --2- 172.21.15.87:0/91444731 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5632ea83a9d0 0x5632ea8b8e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:32:21.726 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:21.724+0000 7feeb3e00700 1 --2- 172.21.15.87:0/91444731 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5632ea836980 0x5632ea844900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:32:21.726 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:21.724+0000 7feeb9600700 1 -- 172.21.15.87:0/91444731 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5632ea83a9d0 msgr2=0x5632ea8b8e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:32:21.726 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:21.724+0000 7feeb9600700 1 --2- 172.21.15.87:0/91444731 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5632ea83a9d0 0x5632ea8b8e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:32:21.726 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:21.724+0000 7feeb9600700 1 -- 172.21.15.87:0/91444731 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5632ea836980 msgr2=0x5632ea844900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:32:21.726 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:21.724+0000 7feeb9600700 1 --2- 172.21.15.87:0/91444731 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5632ea836980 0x5632ea844900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:32:21.726 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:21.724+0000 7feeb9600700 1 -- 172.21.15.87:0/91444731 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5632ea8b9450 con 0x5632ea836060 2024-05-08T05:32:21.727 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:21.725+0000 7feeb9600700 1 --2- 172.21.15.87:0/91444731 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5632ea836060 0x5632ea8443c0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7feeac009130 tx=0x7feeac024040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=38b4cf4dea599403 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:32:21.727 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:21.725+0000 7fee9aa00700 10 client.0 ms_handle_connect on v2:172.21.15.90:3300/0 2024-05-08T05:32:21.727 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:21.726+0000 7fee9aa00700 1 -- 172.21.15.87:0/91444731 <== mon.2 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feeac013900 con 0x5632ea836060 2024-05-08T05:32:21.727 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:21.726+0000 7fee9aa00700 1 -- 172.21.15.87:0/91444731 <== mon.2 v2:172.21.15.90:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8190+0+0 (secure 0 0 0) 0x7feeac013aa0 con 0x5632ea836060 2024-05-08T05:32:21.727 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:21.726+0000 7feec6087b80 1 -- 172.21.15.87:0/91444731 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7feeac004d30 con 0x5632ea836060 2024-05-08T05:32:21.727 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:21.726+0000 7fee9aa00700 1 -- 172.21.15.87:0/91444731 <== mon.2 v2:172.21.15.90:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7feeac0050a0 con 0x5632ea836060 2024-05-08T05:32:21.727 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:21.726+0000 7feec6087b80 10 client.25502 fetch_fsmap learned FSMap version 26 2024-05-08T05:32:21.727 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:21.726+0000 7feec6087b80 1 -- 172.21.15.87:0/91444731 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x5632ea8ba740 con 0x5632ea836060 2024-05-08T05:32:21.728 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:21.727+0000 7fee9aa00700 1 -- 172.21.15.87:0/91444731 <== mon.2 v2:172.21.15.90:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7feeac004d30 con 0x5632ea836060 2024-05-08T05:32:21.729 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:21.728+0000 7fee9aa00700 1 -- 172.21.15.87:0/91444731 <== mon.2 v2:172.21.15.90:3300/0 5 ==== fsmap(e 26) ==== 8346+0+0 (secure 0 0 0) 0x7feeac012070 con 0x5632ea836060 2024-05-08T05:32:21.729 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:21.728+0000 7feec6087b80 10 client.25502 fetch_fsmap finished waiting for FSMap version 26 2024-05-08T05:32:21.729 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:21.728+0000 7feec6087b80 10 client.25502 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-05-08T05:32:21.729 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:21.728+0000 7feec6087b80 20 client.25502 populate_metadata read hostname 'smithi087' 2024-05-08T05:32:21.729 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:21.728+0000 7feec6087b80 1 --2- 172.21.15.87:0/91444731 >> [v2:172.21.15.90:6838/160586017,v1:172.21.15.90:6839/160586017] conn(0x5632ea8bac10 0x5632ea8bd030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:32:21.729 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:21.729+0000 7feec6087b80 4 client.25502 mds_command: new command op to 24500 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-05-08T05:32:21.729 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:21.729+0000 7feec6087b80 1 -- 172.21.15.87:0/91444731 --> [v2:172.21.15.90:6838/160586017,v1:172.21.15.90:6839/160586017] -- command(tid 0: {"prefix": "scrub status"}) -- 0x5632ea796400 con 0x5632ea8bac10 2024-05-08T05:32:21.730 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:21.729+0000 7feeb3e00700 1 --2- 172.21.15.87:0/91444731 >> [v2:172.21.15.90:6838/160586017,v1:172.21.15.90:6839/160586017] conn(0x5632ea8bac10 0x5632ea8bd030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:32:21.730 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:21.730+0000 7fee9aa00700 10 client.25502 ms_handle_connect on v2:172.21.15.90:6838/160586017 2024-05-08T05:32:21.730 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:21.730+0000 7feeb3e00700 1 --2- 172.21.15.87:0/91444731 >> [v2:172.21.15.90:6838/160586017,v1:172.21.15.90:6839/160586017] conn(0x5632ea8bac10 0x5632ea8bd030 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c9b318f8f390025c server_cookie=77fa0f69242d344f in_seq=0 out_seq=0 2024-05-08T05:32:21.730 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:21.730+0000 7fee9aa00700 1 -- 172.21.15.87:0/91444731 <== mds.0 v2:172.21.15.90:6838/160586017 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x5632ea796400 con 0x5632ea8bac10 2024-05-08T05:32:21.730 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:21.730+0000 7fee9aa00700 10 client.25502 handle_command_reply: tid=0 2024-05-08T05:32:21.731 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:21.730+0000 7feec6087b80 1 client.25502 shutdown 2024-05-08T05:32:21.731 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:21.731+0000 7feec6087b80 1 -- 172.21.15.87:0/91444731 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5632ea836060 msgr2=0x5632ea8443c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:32:21.731 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:21.731+0000 7feec6087b80 1 --2- 172.21.15.87:0/91444731 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5632ea836060 0x5632ea8443c0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7feeac009130 tx=0x7feeac024040 comp rx=0 tx=0).stop 2024-05-08T05:32:21.732 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:21.731+0000 7feec6087b80 1 -- 172.21.15.87:0/91444731 shutdown_connections 2024-05-08T05:32:21.732 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:21.731+0000 7feec6087b80 1 --2- 172.21.15.87:0/91444731 >> [v2:172.21.15.90:6838/160586017,v1:172.21.15.90:6839/160586017] conn(0x5632ea8bac10 0x5632ea8bd030 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:32:21.732 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:21.731+0000 7feec6087b80 1 --2- 172.21.15.87:0/91444731 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5632ea83a9d0 0x5632ea8b8e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:32:21.732 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:21.731+0000 7feec6087b80 1 --2- 172.21.15.87:0/91444731 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5632ea836060 0x5632ea8443c0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:32:21.732 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:21.731+0000 7feec6087b80 1 --2- 172.21.15.87:0/91444731 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5632ea836980 0x5632ea844900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:32:21.732 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:21.731+0000 7fee9aa00700 0 client.25502 ms_handle_reset on v2:172.21.15.90:6838/160586017 2024-05-08T05:32:21.732 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:21.731+0000 7feec6087b80 1 -- 172.21.15.87:0/91444731 >> 172.21.15.87:0/91444731 conn(0x5632ea764b60 msgr2=0x5632ea8407e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:32:21.732 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:21.731+0000 7feec6087b80 1 -- 172.21.15.87:0/91444731 shutdown_connections 2024-05-08T05:32:21.732 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:21.731+0000 7feec6087b80 1 -- 172.21.15.87:0/91444731 wait complete. 2024-05-08T05:32:21.732 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:21.731+0000 7feec6087b80 20 client.25502 trim_cache size 0 max 16384 2024-05-08T05:32:21.733 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-05-08T05:32:21.733 INFO:teuthology.orchestra.run.smithi087.stdout: "status": "no active scrubs running", 2024-05-08T05:32:21.733 INFO:teuthology.orchestra.run.smithi087.stdout: "scrubs": {} 2024-05-08T05:32:21.733 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-05-08T05:32:21.733 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:21.732+0000 7feebb600700 1 -- 172.21.15.87:0/1818971328 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7fee9c0b2900 msgr2=0x7fee9c0b4dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:32:21.734 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:21.732+0000 7feebb600700 1 --2- 172.21.15.87:0/1818971328 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7fee9c0b2900 0x7fee9c0b4dc0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7feea80a9a20 tx=0x7feea80050b0 comp rx=0 tx=0).stop 2024-05-08T05:32:21.734 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:21.732+0000 7feebb600700 1 -- 172.21.15.87:0/1818971328 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7feeb40756d0 msgr2=0x7feeb419be30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:32:21.734 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:21.732+0000 7feebb600700 1 --2- 172.21.15.87:0/1818971328 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7feeb40756d0 0x7feeb419be30 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7feea800e9c0 tx=0x7feea800ecd0 comp rx=0 tx=0).stop 2024-05-08T05:32:21.734 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:21.732+0000 7feebb600700 1 -- 172.21.15.87:0/1818971328 shutdown_connections 2024-05-08T05:32:21.734 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:21.732+0000 7feebb600700 1 --2- 172.21.15.87:0/1818971328 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7fee9c0b2900 0x7fee9c0b4dc0 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:32:21.734 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:21.732+0000 7feebb600700 1 --2- 172.21.15.87:0/1818971328 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7feeb410fea0 0x7feeb41a06b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:32:21.734 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:21.733+0000 7feebb600700 1 --2- 172.21.15.87:0/1818971328 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7feeb40756d0 0x7feeb419be30 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:32:21.734 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:21.733+0000 7feebb600700 1 --2- 172.21.15.87:0/1818971328 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7feeb4075ff0 0x7feeb419c370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:32:21.734 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:21.733+0000 7feebb600700 1 -- 172.21.15.87:0/1818971328 >> 172.21.15.87:0/1818971328 conn(0x7feeb407a600 msgr2=0x7feeb4100750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:32:21.734 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:21.733+0000 7feebb600700 1 -- 172.21.15.87:0/1818971328 shutdown_connections 2024-05-08T05:32:21.734 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:21.733+0000 7feebb600700 1 -- 172.21.15.87:0/1818971328 wait complete. 2024-05-08T05:32:21.736 INFO:tasks.workunit.client.0.smithi087.stdout:1/973: dwrite df/d2f/d57/f103 [0,4194304] 0 2024-05-08T05:32:21.742 INFO:tasks.workunit.client.0.smithi087.stdout:1/974: getdents df/d18/d1d/d58/d72 0 2024-05-08T05:32:21.742 INFO:tasks.workunit.client.0.smithi087.stdout:1/975: fdatasync df/d2f/d57/dcb/de1/de4/f127 0 2024-05-08T05:32:21.744 INFO:tasks.workunit.client.0.smithi087.stdout:1/976: creat df/d18/d1d/d27/dd4/f152 x:0 0 0 2024-05-08T05:32:21.746 INFO:tasks.workunit.client.0.smithi087.stdout:1/977: symlink df/d2f/d57/d64/d83/d96/l153 0 2024-05-08T05:32:21.747 INFO:tasks.workunit.client.0.smithi087.stdout:1/978: creat df/d2f/d57/d64/d83/d96/f154 x:0 0 0 2024-05-08T05:32:21.748 INFO:tasks.workunit.client.0.smithi087.stdout:1/979: creat df/d18/d8b/df2/d147/f155 x:0 0 0 2024-05-08T05:32:21.748 INFO:tasks.workunit.client.0.smithi087.stdout:1/980: chown df/d2f/d57/da0/lae 3 1 2024-05-08T05:32:21.765 INFO:tasks.workunit.client.0.smithi087.stdout:1/981: write df/d2f/d4f/f76 [1078382,2476] 0 2024-05-08T05:32:21.766 INFO:tasks.workunit.client.0.smithi087.stdout:0/971: dwrite d0/d9/d1b/d2f/d54/f118 [0,4194304] 0 2024-05-08T05:32:21.766 INFO:tasks.workunit.client.0.smithi087.stdout:0/972: write d0/d9/d1b/d2f/d54/da1/f88 [2615245,106155] 0 2024-05-08T05:32:21.768 INFO:tasks.workunit.client.0.smithi087.stdout:0/973: stat d0/d22/d3c/d141/cc3 0 2024-05-08T05:32:21.768 INFO:tasks.workunit.client.0.smithi087.stdout:1/982: rename df/d2f/d4f/f65 to df/d18/dbe/d14c/f156 0 2024-05-08T05:32:21.769 INFO:tasks.workunit.client.0.smithi087.stdout:1/983: symlink df/d2f/d4f/d14e/l157 0 2024-05-08T05:32:21.770 INFO:tasks.workunit.client.0.smithi087.stdout:0/974: creat d0/da/d35/d86/d6d/ded/dff/f153 x:0 0 0 2024-05-08T05:32:21.771 INFO:tasks.workunit.client.0.smithi087.stdout:0/975: chown d0/da/d35/f93 7 1 2024-05-08T05:32:21.771 INFO:tasks.workunit.client.0.smithi087.stdout:1/984: getdents df/d18/d1d/d32/d9c 0 2024-05-08T05:32:21.771 INFO:tasks.workunit.client.0.smithi087.stdout:1/985: fsync df/d18/d1d/d32/d100/f104 0 2024-05-08T05:32:21.771 INFO:tasks.workunit.client.0.smithi087.stdout:0/976: symlink d0/d9e/d134/l154 0 2024-05-08T05:32:21.772 INFO:tasks.workunit.client.0.smithi087.stdout:0/977: creat d0/d57/d24/f155 x:0 0 0 2024-05-08T05:32:21.774 INFO:tasks.workunit.client.0.smithi087.stdout:0/978: unlink d0/d9/d1b/c1d 0 2024-05-08T05:32:21.778 INFO:tasks.workunit.client.0.smithi087.stdout:0/979: getdents d0/da/d35/d86/d6d/ded/dff 0 2024-05-08T05:32:21.778 INFO:tasks.workunit.client.0.smithi087.stdout:0/980: dread - d0/d57/de1/f144 zero size 2024-05-08T05:32:21.780 INFO:tasks.workunit.client.0.smithi087.stdout:0/981: creat d0/da/d35/daa/f156 x:0 0 0 2024-05-08T05:32:21.788 INFO:tasks.workunit.client.0.smithi087.stdout:1/986: dread df/d2f/d6a/f80 [0,4194304] 0 2024-05-08T05:32:21.789 INFO:tasks.workunit.client.0.smithi087.stdout:1/987: symlink df/d2f/d57/dcb/de1/de4/d149/l158 0 2024-05-08T05:32:21.802 INFO:tasks.workunit.client.0.smithi087.stdout:1/988: read df/d2f/d6a/ffe [987536,61411] 0 2024-05-08T05:32:21.802 INFO:tasks.workunit.client.0.smithi087.stdout:1/989: write df/d18/deb/f110 [395857,98247] 0 2024-05-08T05:32:21.803 INFO:tasks.workunit.client.0.smithi087.stdout:1/990: mknod df/d18/d1d/d58/d72/dc5/c159 0 2024-05-08T05:32:21.805 INFO:tasks.workunit.client.0.smithi087.stdout:1/991: unlink df/d18/d1d/d27/le9 0 2024-05-08T05:32:21.806 INFO:tasks.workunit.client.0.smithi087.stdout:1/992: mknod df/d14d/c15a 0 2024-05-08T05:32:21.808 INFO:tasks.workunit.client.0.smithi087.stdout:1/993: rename df/d2f/d57/d64/d83/d96/dcf/ff9 to df/d18/d1d/d27/d61/d89/f15b 0 2024-05-08T05:32:21.808 INFO:tasks.workunit.client.0.smithi087.stdout:1/994: truncate fa 1720856 0 2024-05-08T05:32:21.810 INFO:tasks.workunit.client.0.smithi087.stdout:1/995: creat df/d18/dbe/d14c/f15c x:0 0 0 2024-05-08T05:32:21.811 INFO:tasks.workunit.client.0.smithi087.stdout:1/996: getdents df/d2f/d57/da0/d125 0 2024-05-08T05:32:21.812 INFO:tasks.workunit.client.0.smithi087.stdout:1/997: rmdir df/d18/d1d/d27/d61 39 2024-05-08T05:32:21.813 INFO:tasks.workunit.client.0.smithi087.stdout:1/998: chown df/d2f/d57/f5d 492582600 1 2024-05-08T05:32:21.814 INFO:tasks.workunit.client.0.smithi087.stdout:1/999: unlink df/d18/d1d/d27/dd4/ldb 0 2024-05-08T05:32:21.819 INFO:tasks.workunit.client.0.smithi087.stdout:0/982: dwrite d0/d9/d1b/d5e/f72 [0,4194304] 0 2024-05-08T05:32:21.858 INFO:tasks.workunit.client.0.smithi087.stdout:0/983: dwrite d0/d9/d1b/d2f/d54/da1/f96 [0,4194304] 0 2024-05-08T05:32:21.858 INFO:tasks.workunit.client.0.smithi087.stdout:0/984: getdents d0/d9/d1b/d5e/dfb 0 2024-05-08T05:32:21.859 INFO:tasks.workunit.client.0.smithi087.stdout:0/985: symlink d0/d57/de1/l157 0 2024-05-08T05:32:21.861 INFO:tasks.workunit.client.0.smithi087.stdout:0/986: unlink d0/d9/d90/fea 0 2024-05-08T05:32:21.878 INFO:tasks.workunit.client.0.smithi087.stdout:0/987: dread d0/d9/f13 [0,4194304] 0 2024-05-08T05:32:21.880 INFO:tasks.workunit.client.0.smithi087.stdout:0/988: rmdir d0/d9 39 2024-05-08T05:32:21.940 INFO:tasks.workunit.client.0.smithi087.stdout:0/989: dwrite d0/d22/d3c/d141/f146 [0,4194304] 0 2024-05-08T05:32:21.943 INFO:tasks.workunit.client.0.smithi087.stdout:0/990: mkdir d0/d9/d1b/d2f/d158 0 2024-05-08T05:32:21.944 INFO:tasks.workunit.client.0.smithi087.stdout:0/991: dread - d0/fb3 zero size 2024-05-08T05:32:21.944 INFO:tasks.workunit.client.0.smithi087.stdout:0/992: write d0/da/d35/d86/d74/f124 [867454,2618] 0 2024-05-08T05:32:21.944 INFO:tasks.workunit.client.0.smithi087.stdout:0/993: chown d0/da/d35/daa/f13a 350619 1 2024-05-08T05:32:21.944 INFO:tasks.workunit.client.0.smithi087.stdout:0/994: dread - d0/da/d35/d86/d6d/ded/f10e zero size 2024-05-08T05:32:21.944 INFO:tasks.workunit.client.0.smithi087.stdout:0/995: chown d0/d9/d1b/d5e/cdf 18030605 1 2024-05-08T05:32:21.944 INFO:tasks.workunit.client.0.smithi087.stdout:0/996: creat d0/da/d35/d86/d9a/d127/f159 x:0 0 0 2024-05-08T05:32:21.945 INFO:tasks.workunit.client.0.smithi087.stdout:0/997: readlink d0/d9/d1b/d2f/d54/d152/l136 0 2024-05-08T05:32:21.945 INFO:tasks.workunit.client.0.smithi087.stdout:0/998: mkdir d0/d9e/d14e/d15a 0 2024-05-08T05:32:21.984 INFO:tasks.workunit.client.0.smithi087.stdout:0/999: dwrite d0/da/d35/d86/f107 [0,4194304] 0 2024-05-08T05:32:21.992 INFO:tasks.workunit.client.0.smithi087.stderr:+ rm -rf -- ./tmp.CFEGAHb0bu 2024-05-08T05:32:22.073 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:32:22 smithi087 ceph-mon[29523]: pgmap v521: 97 pgs: 97 active+clean; 2.0 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 152 MiB/s rd, 185 MiB/s wr, 283 op/s 2024-05-08T05:32:22.483 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:32:22 smithi090 ceph-mon[34526]: pgmap v521: 97 pgs: 97 active+clean; 2.0 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 152 MiB/s rd, 185 MiB/s wr, 283 op/s 2024-05-08T05:32:22.538 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:32:22 smithi160 ceph-mon[34827]: pgmap v521: 97 pgs: 97 active+clean; 2.0 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 152 MiB/s rd, 185 MiB/s wr, 283 op/s 2024-05-08T05:32:22.710 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-05-08T05:32:22.711 DEBUG:teuthology.orchestra.run.smithi087:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid eeeb813e-0cf9-11ef-bc97-c7b262605968 -- ceph fs dump --format=json 2024-05-08T05:32:23.176 INFO:teuthology.orchestra.run.smithi087.stderr:Inferring config /var/lib/ceph/eeeb813e-0cf9-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T05:32:24.370 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:32:24 smithi087 ceph-mon[29523]: pgmap v522: 97 pgs: 97 active+clean; 2.0 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 129 MiB/s rd, 150 MiB/s wr, 234 op/s 2024-05-08T05:32:24.483 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:32:24 smithi090 ceph-mon[34526]: pgmap v522: 97 pgs: 97 active+clean; 2.0 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 129 MiB/s rd, 150 MiB/s wr, 234 op/s 2024-05-08T05:32:24.538 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:32:24 smithi160 ceph-mon[34827]: pgmap v522: 97 pgs: 97 active+clean; 2.0 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 129 MiB/s rd, 150 MiB/s wr, 234 op/s 2024-05-08T05:32:25.402 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:25.401+0000 7f1ae2800700 1 -- 172.21.15.87:0/4230349948 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1adc105f90 msgr2=0x7f1adc1124a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:32:25.403 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:25.401+0000 7f1ae2800700 1 --2- 172.21.15.87:0/4230349948 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1adc105f90 0x7f1adc1124a0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f1ad4009f90 tx=0x7f1ad400b330 comp rx=0 tx=0).stop 2024-05-08T05:32:25.403 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:25.401+0000 7f1ae2800700 1 -- 172.21.15.87:0/4230349948 shutdown_connections 2024-05-08T05:32:25.403 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:25.401+0000 7f1ae2800700 1 --2- 172.21.15.87:0/4230349948 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1adc105f90 0x7f1adc1124a0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:32:25.403 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:25.401+0000 7f1ae2800700 1 --2- 172.21.15.87:0/4230349948 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1adc10b660 0x7f1adc10ba40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:32:25.403 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:25.401+0000 7f1ae2800700 1 --2- 172.21.15.87:0/4230349948 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1adc1055d0 0x7f1adc105a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:32:25.403 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:25.401+0000 7f1ae2800700 1 -- 172.21.15.87:0/4230349948 >> 172.21.15.87:0/4230349948 conn(0x7f1adc1010c0 msgr2=0x7f1adc1034e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:32:25.403 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:25.401+0000 7f1ae2800700 1 -- 172.21.15.87:0/4230349948 shutdown_connections 2024-05-08T05:32:25.403 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:25.401+0000 7f1ae2800700 1 -- 172.21.15.87:0/4230349948 wait complete. 2024-05-08T05:32:25.405 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:25.403+0000 7f1ae2800700 1 Processor -- start 2024-05-08T05:32:25.405 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:25.403+0000 7f1ae2800700 1 -- start start 2024-05-08T05:32:25.405 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:25.403+0000 7f1ae2800700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1adc1055d0 0x7f1adc1a1830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:32:25.406 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:25.403+0000 7f1ae2800700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1adc105f90 0x7f1adc1a1d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:32:25.406 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:25.403+0000 7f1ae2800700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1adc10b660 0x7f1adc19ba40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:32:25.406 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:25.403+0000 7f1ae2800700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f1adc115820 con 0x7f1adc105f90 2024-05-08T05:32:25.406 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:25.403+0000 7f1ae2800700 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f1adc1156a0 con 0x7f1adc10b660 2024-05-08T05:32:25.406 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:25.403+0000 7f1ae2800700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f1adc1159a0 con 0x7f1adc1055d0 2024-05-08T05:32:25.406 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:25.404+0000 7f1ae1400700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1adc1055d0 0x7f1adc1a1830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:32:25.406 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:25.404+0000 7f1ae1400700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1adc1055d0 0x7f1adc1a1830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.87:36600/0 (socket says 172.21.15.87:36600) 2024-05-08T05:32:25.406 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:25.404+0000 7f1ae1400700 1 -- 172.21.15.87:0/931708910 learned_addr learned my addr 172.21.15.87:0/931708910 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T05:32:25.406 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:25.404+0000 7f1ae0a00700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1adc105f90 0x7f1adc1a1d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:32:25.406 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:25.404+0000 7f1ae1e00700 1 --2- 172.21.15.87:0/931708910 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1adc10b660 0x7f1adc19ba40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:32:25.406 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:25.404+0000 7f1ae1400700 1 -- 172.21.15.87:0/931708910 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1adc10b660 msgr2=0x7f1adc19ba40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:32:25.406 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:25.404+0000 7f1ae1400700 1 --2- 172.21.15.87:0/931708910 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1adc10b660 0x7f1adc19ba40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:32:25.406 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:25.404+0000 7f1ae1400700 1 -- 172.21.15.87:0/931708910 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1adc105f90 msgr2=0x7f1adc1a1d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:32:25.407 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:25.404+0000 7f1ae1400700 1 --2- 172.21.15.87:0/931708910 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1adc105f90 0x7f1adc1a1d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:32:25.407 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:25.404+0000 7f1ae1400700 1 -- 172.21.15.87:0/931708910 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1adc19c1a0 con 0x7f1adc1055d0 2024-05-08T05:32:25.407 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:25.405+0000 7f1ae1400700 1 --2- 172.21.15.87:0/931708910 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1adc1055d0 0x7f1adc1a1830 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f1acc00ebf0 tx=0x7f1acc00ef00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:32:25.407 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:25.405+0000 7f1ada000700 1 -- 172.21.15.87:0/931708910 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1acc00cc90 con 0x7f1adc1055d0 2024-05-08T05:32:25.407 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:25.405+0000 7f1ae2800700 1 -- 172.21.15.87:0/931708910 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1adc19c490 con 0x7f1adc1055d0 2024-05-08T05:32:25.407 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:25.405+0000 7f1ada000700 1 -- 172.21.15.87:0/931708910 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1acc00ce30 con 0x7f1adc1055d0 2024-05-08T05:32:25.407 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:25.405+0000 7f1ada000700 1 -- 172.21.15.87:0/931708910 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1acc0187e0 con 0x7f1adc1055d0 2024-05-08T05:32:25.407 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:25.405+0000 7f1ae2800700 1 -- 172.21.15.87:0/931708910 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1adc1a8700 con 0x7f1adc1055d0 2024-05-08T05:32:25.408 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:25.406+0000 7f1ad3400700 1 -- 172.21.15.87:0/931708910 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1ab4005330 con 0x7f1adc1055d0 2024-05-08T05:32:25.408 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:25.408+0000 7f1ada000700 1 -- 172.21.15.87:0/931708910 <== mon.1 v2:172.21.15.160:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7f1acc01f020 con 0x7f1adc1055d0 2024-05-08T05:32:25.410 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:25.410+0000 7f1ada000700 1 --2- 172.21.15.87:0/931708910 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f1ac00b2880 0x7f1ac00b4d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:32:25.410 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:25.410+0000 7f1ada000700 1 -- 172.21.15.87:0/931708910 <== mon.1 v2:172.21.15.160:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8190+0+0 (secure 0 0 0) 0x7f1acc0e2460 con 0x7f1adc1055d0 2024-05-08T05:32:25.410 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:25.410+0000 7f1ae0a00700 1 --2- 172.21.15.87:0/931708910 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f1ac00b2880 0x7f1ac00b4d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:32:25.411 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:25.411+0000 7f1ae0a00700 1 --2- 172.21.15.87:0/931708910 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f1ac00b2880 0x7f1ac00b4d40 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f1adc10acc0 tx=0x7f1ac8009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:32:25.414 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:25.414+0000 7f1ada000700 1 -- 172.21.15.87:0/931708910 <== mon.1 v2:172.21.15.160:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f1acc054df0 con 0x7f1adc1055d0 2024-05-08T05:32:25.760 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:25.759+0000 7f1ad3400700 1 -- 172.21.15.87:0/931708910 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f1ab4005620 con 0x7f1adc1055d0 2024-05-08T05:32:25.761 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:25.760+0000 7f1ada000700 1 -- 172.21.15.87:0/931708910 <== mon.1 v2:172.21.15.160:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) ==== 94+0+11861 (secure 0 0 0) 0x7f1acc0b21d0 con 0x7f1adc1055d0 2024-05-08T05:32:25.761 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-05-08T05:32:25.761 INFO:teuthology.orchestra.run.smithi087.stdout:{"epoch":26,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14358,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6835/1183985321","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6834","nonce":1183985321},{"type":"v1","addr":"172.21.15.87:6835","nonce":1183985321}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14370,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6837/1485824316","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6836","nonce":1485824316},{"type":"v1","addr":"172.21.15.87:6837","nonce":1485824316}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14409,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6841/724277538","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6840","nonce":724277538},{"type":"v1","addr":"172.21.15.87:6841","nonce":724277538}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24412,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6833/3339455985","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6832","nonce":3339455985},{"type":"v1","addr":"172.21.15.160:6833","nonce":3339455985}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24413,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6833/3292166873","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6832","nonce":3292166873},{"type":"v1","addr":"172.21.15.90:6833","nonce":3292166873}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24443,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6835/824555459","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6834","nonce":824555459},{"type":"v1","addr":"172.21.15.90:6835","nonce":824555459}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6}],"filesystems":[{"mdsmap":{"epoch":26,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-05-08T05:25:36.816840+0000","modified":"2024-05-08T05:31:42.807015+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24500,"mds_1":24482,"mds_2":24481},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24463":{"gid":24463,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.160:6835/409648357","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6834","nonce":409648357},{"type":"v1","addr":"172.21.15.160:6835","nonce":409648357}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24467":{"gid":24467,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.90:6837/4221919418","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6836","nonce":4221919418},{"type":"v1","addr":"172.21.15.90:6837","nonce":4221919418}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24469":{"gid":24469,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.160:6837/4200018040","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6836","nonce":4200018040},{"type":"v1","addr":"172.21.15.160:6837","nonce":4200018040}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24481":{"gid":24481,"name":"i","rank":2,"incarnation":20,"state":"up:active","state_seq":13,"addr":"172.21.15.160:6839/234657686","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6838","nonce":234657686},{"type":"v1","addr":"172.21.15.160:6839","nonce":234657686}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24482":{"gid":24482,"name":"g","rank":1,"incarnation":18,"state":"up:active","state_seq":12,"addr":"172.21.15.87:6839/2127215876","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6838","nonce":2127215876},{"type":"v1","addr":"172.21.15.87:6839","nonce":2127215876}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24500":{"gid":24500,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.90:6839/160586017","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6838","nonce":160586017},{"type":"v1","addr":"172.21.15.90:6839","nonce":160586017}]},"join_fscid":-1,"export_targets":[1,2],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24500,"qdb_cluster":[24500,24481,24482]},"id":1}]} 2024-05-08T05:32:25.764 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:25.764+0000 7f1ad3400700 1 -- 172.21.15.87:0/931708910 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f1ac00b2880 msgr2=0x7f1ac00b4d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:32:25.764 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:25.764+0000 7f1ad3400700 1 --2- 172.21.15.87:0/931708910 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f1ac00b2880 0x7f1ac00b4d40 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f1adc10acc0 tx=0x7f1ac8009260 comp rx=0 tx=0).stop 2024-05-08T05:32:25.764 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:25.764+0000 7f1ad3400700 1 -- 172.21.15.87:0/931708910 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1adc1055d0 msgr2=0x7f1adc1a1830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:32:25.764 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:25.764+0000 7f1ad3400700 1 --2- 172.21.15.87:0/931708910 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1adc1055d0 0x7f1adc1a1830 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f1acc00ebf0 tx=0x7f1acc00ef00 comp rx=0 tx=0).stop 2024-05-08T05:32:25.765 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:25.764+0000 7f1ad3400700 1 -- 172.21.15.87:0/931708910 shutdown_connections 2024-05-08T05:32:25.765 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:25.764+0000 7f1ad3400700 1 --2- 172.21.15.87:0/931708910 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1adc10b660 0x7f1adc19ba40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:32:25.765 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:25.764+0000 7f1ad3400700 1 --2- 172.21.15.87:0/931708910 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f1ac00b2880 0x7f1ac00b4d40 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:32:25.765 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:25.764+0000 7f1ad3400700 1 --2- 172.21.15.87:0/931708910 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1adc1055d0 0x7f1adc1a1830 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:32:25.765 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:25.764+0000 7f1ad3400700 1 --2- 172.21.15.87:0/931708910 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1adc105f90 0x7f1adc1a1d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:32:25.765 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:25.764+0000 7f1ad3400700 1 -- 172.21.15.87:0/931708910 >> 172.21.15.87:0/931708910 conn(0x7f1adc1010c0 msgr2=0x7f1adc1027a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:32:25.765 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:25.764+0000 7f1ad3400700 1 -- 172.21.15.87:0/931708910 shutdown_connections 2024-05-08T05:32:25.765 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:25.764+0000 7f1ad3400700 1 -- 172.21.15.87:0/931708910 wait complete. 2024-05-08T05:32:25.766 INFO:teuthology.orchestra.run.smithi087.stderr:dumped fsmap epoch 26 2024-05-08T05:32:26.458 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:32:26 smithi087 ceph-mon[29523]: pgmap v523: 97 pgs: 97 active+clean; 1.9 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 85 MiB/s rd, 105 MiB/s wr, 181 op/s 2024-05-08T05:32:26.459 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:32:26 smithi087 ceph-mon[29523]: from='client.? 172.21.15.87:0/931708910' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T05:32:26.483 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:32:26 smithi090 ceph-mon[34526]: pgmap v523: 97 pgs: 97 active+clean; 1.9 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 85 MiB/s rd, 105 MiB/s wr, 181 op/s 2024-05-08T05:32:26.483 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:32:26 smithi090 ceph-mon[34526]: from='client.? 172.21.15.87:0/931708910' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T05:32:26.538 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:32:26 smithi160 ceph-mon[34827]: pgmap v523: 97 pgs: 97 active+clean; 1.9 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 85 MiB/s rd, 105 MiB/s wr, 181 op/s 2024-05-08T05:32:26.538 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:32:26 smithi160 ceph-mon[34827]: from='client.? 172.21.15.87:0/931708910' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T05:32:26.651 DEBUG:teuthology.orchestra.run.smithi087:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid eeeb813e-0cf9-11ef-bc97-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-05-08T05:32:27.100 INFO:teuthology.orchestra.run.smithi087.stderr:Inferring config /var/lib/ceph/eeeb813e-0cf9-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T05:32:27.401 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:32:27 smithi087 ceph-mon[29523]: fsmap cephfs:3 {0=b=up:active,1=g=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-05-08T05:32:27.483 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:32:27 smithi090 ceph-mon[34526]: fsmap cephfs:3 {0=b=up:active,1=g=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-05-08T05:32:27.538 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:32:27 smithi160 ceph-mon[34827]: fsmap cephfs:3 {0=b=up:active,1=g=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-05-08T05:32:28.458 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:32:28 smithi087 ceph-mon[29523]: pgmap v524: 97 pgs: 97 active+clean; 1.8 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 38 MiB/s rd, 52 MiB/s wr, 105 op/s 2024-05-08T05:32:28.483 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:32:28 smithi090 ceph-mon[34526]: pgmap v524: 97 pgs: 97 active+clean; 1.8 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 38 MiB/s rd, 52 MiB/s wr, 105 op/s 2024-05-08T05:32:28.538 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:32:28 smithi160 ceph-mon[34827]: pgmap v524: 97 pgs: 97 active+clean; 1.8 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 38 MiB/s rd, 52 MiB/s wr, 105 op/s 2024-05-08T05:32:29.369 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:29.367+0000 7f4fef600700 1 -- 172.21.15.87:0/1705793991 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4fe8108460 msgr2=0x7f4fe8108840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:32:29.369 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:29.367+0000 7f4fef600700 1 --2- 172.21.15.87:0/1705793991 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4fe8108460 0x7f4fe8108840 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f4fe000f530 tx=0x7f4fe000f840 comp rx=0 tx=0).stop 2024-05-08T05:32:29.369 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:29.367+0000 7f4fef600700 1 -- 172.21.15.87:0/1705793991 shutdown_connections 2024-05-08T05:32:29.369 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:29.367+0000 7f4fef600700 1 --2- 172.21.15.87:0/1705793991 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4fe8103ef0 0x7f4fe81103d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:32:29.369 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:29.367+0000 7f4fef600700 1 --2- 172.21.15.87:0/1705793991 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4fe8108460 0x7f4fe8108840 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:32:29.369 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:29.367+0000 7f4fef600700 1 --2- 172.21.15.87:0/1705793991 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4fe8103550 0x7f4fe81039b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:32:29.369 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:29.367+0000 7f4fef600700 1 -- 172.21.15.87:0/1705793991 >> 172.21.15.87:0/1705793991 conn(0x7f4fe807a600 msgr2=0x7f4fe807aa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:32:29.369 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:29.368+0000 7f4fef600700 1 -- 172.21.15.87:0/1705793991 shutdown_connections 2024-05-08T05:32:29.369 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:29.368+0000 7f4fef600700 1 -- 172.21.15.87:0/1705793991 wait complete. 2024-05-08T05:32:29.370 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:29.370+0000 7f4fef600700 1 Processor -- start 2024-05-08T05:32:29.370 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:29.370+0000 7f4fef600700 1 -- start start 2024-05-08T05:32:29.370 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:29.370+0000 7f4fef600700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4fe8103550 0x7f4fe819e800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:32:29.371 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:29.370+0000 7f4fef600700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4fe8103ef0 0x7f4fe81978e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:32:29.372 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:29.371+0000 7f4fef600700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4fe8108460 0x7f4fe8197e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:32:29.372 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:29.371+0000 7f4fef600700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f4fe81115c0 con 0x7f4fe8108460 2024-05-08T05:32:29.372 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:29.371+0000 7f4fef600700 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f4fe8111440 con 0x7f4fe8103550 2024-05-08T05:32:29.372 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:29.371+0000 7f4fe7e00700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4fe8103ef0 0x7f4fe81978e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:32:29.372 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:29.371+0000 7f4fe7e00700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4fe8103ef0 0x7f4fe81978e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.87:57400/0 (socket says 172.21.15.87:57400) 2024-05-08T05:32:29.372 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:29.371+0000 7f4fe7e00700 1 -- 172.21.15.87:0/3938113024 learned_addr learned my addr 172.21.15.87:0/3938113024 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T05:32:29.372 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:29.371+0000 7f4fed600700 1 --2- 172.21.15.87:0/3938113024 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4fe8108460 0x7f4fe8197e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:32:29.373 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:29.372+0000 7f4fecc00700 1 --2- 172.21.15.87:0/3938113024 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4fe8103550 0x7f4fe819e800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:32:29.373 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:29.372+0000 7f4fef600700 1 -- 172.21.15.87:0/3938113024 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f4fe8111740 con 0x7f4fe8103ef0 2024-05-08T05:32:29.373 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:29.372+0000 7f4fecc00700 1 -- 172.21.15.87:0/3938113024 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4fe8103ef0 msgr2=0x7f4fe81978e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:32:29.373 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:29.372+0000 7f4fecc00700 1 --2- 172.21.15.87:0/3938113024 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4fe8103ef0 0x7f4fe81978e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:32:29.373 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:29.372+0000 7f4fecc00700 1 -- 172.21.15.87:0/3938113024 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4fe8108460 msgr2=0x7f4fe8197e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:32:29.373 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:29.372+0000 7f4fecc00700 1 --2- 172.21.15.87:0/3938113024 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4fe8108460 0x7f4fe8197e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:32:29.373 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:29.372+0000 7f4fecc00700 1 -- 172.21.15.87:0/3938113024 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4fe8198460 con 0x7f4fe8103550 2024-05-08T05:32:29.373 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:29.372+0000 7f4fecc00700 1 --2- 172.21.15.87:0/3938113024 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4fe8103550 0x7f4fe819e800 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f4fe0000f80 tx=0x7f4fe0017890 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:32:29.374 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:29.373+0000 7f4fe5600700 1 -- 172.21.15.87:0/3938113024 <== mon.2 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4fe001c020 con 0x7f4fe8103550 2024-05-08T05:32:29.374 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:29.373+0000 7f4fe5600700 1 -- 172.21.15.87:0/3938113024 <== mon.2 v2:172.21.15.90:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4fe000d070 con 0x7f4fe8103550 2024-05-08T05:32:29.374 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:29.373+0000 7f4fef600700 1 -- 172.21.15.87:0/3938113024 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4fe81986f0 con 0x7f4fe8103550 2024-05-08T05:32:29.374 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:29.373+0000 7f4fe5600700 1 -- 172.21.15.87:0/3938113024 <== mon.2 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4fe0005700 con 0x7f4fe8103550 2024-05-08T05:32:29.374 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:29.373+0000 7f4fef600700 1 -- 172.21.15.87:0/3938113024 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4fe819c5b0 con 0x7f4fe8103550 2024-05-08T05:32:29.382 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:29.381+0000 7f4ff9f5fb80 1 Processor -- start 2024-05-08T05:32:29.383 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:29.381+0000 7f4fe5600700 1 -- 172.21.15.87:0/3938113024 <== mon.2 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7f4fe001f020 con 0x7f4fe8103550 2024-05-08T05:32:29.383 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:29.381+0000 7f4ff9f5fb80 1 -- start start 2024-05-08T05:32:29.384 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:29.382+0000 7f4ff9f5fb80 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55626efd4bc0 0x55626efd4fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:32:29.384 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:29.382+0000 7f4ff9f5fb80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55626efd54e0 0x55626efcf2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:32:29.384 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:29.382+0000 7f4ff9f5fb80 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55626efcf8f0 0x55626efcfd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:32:29.385 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:29.382+0000 7f4ff9f5fb80 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x55626ef21a20 con 0x55626efcf8f0 2024-05-08T05:32:29.385 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:29.382+0000 7f4ff9f5fb80 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x55626eebf760 con 0x55626efd4bc0 2024-05-08T05:32:29.385 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:29.382+0000 7f4ff9f5fb80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x55626ef1d9e0 con 0x55626efd54e0 2024-05-08T05:32:29.385 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:29.383+0000 7f4fed600700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55626efd4bc0 0x55626efd4fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:32:29.385 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:29.383+0000 7f4fed600700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55626efd4bc0 0x55626efd4fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.87:45804/0 (socket says 172.21.15.87:45804) 2024-05-08T05:32:29.385 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:29.383+0000 7f4fed600700 1 -- 172.21.15.87:0/528170369 learned_addr learned my addr 172.21.15.87:0/528170369 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T05:32:29.385 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:29.383+0000 7f4fe7e00700 1 --2- 172.21.15.87:0/528170369 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55626efcf8f0 0x55626efcfd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:32:29.385 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:29.383+0000 7f4fecc00700 1 --2- 172.21.15.87:0/528170369 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55626efd54e0 0x55626efcf2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:32:29.385 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:29.383+0000 7f4fe5600700 1 --2- 172.21.15.87:0/3938113024 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f4fcc0b2940 0x7f4fcc0b4e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:32:29.385 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:29.384+0000 7f4fed600700 1 -- 172.21.15.87:0/528170369 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55626efd54e0 msgr2=0x55626efcf2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:32:29.385 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:29.384+0000 7f4fed600700 1 --2- 172.21.15.87:0/528170369 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55626efd54e0 0x55626efcf2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:32:29.386 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:29.384+0000 7f4fe5600700 1 -- 172.21.15.87:0/3938113024 <== mon.2 v2:172.21.15.90:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8190+0+0 (secure 0 0 0) 0x7f4fe00e1d00 con 0x7f4fe8103550 2024-05-08T05:32:29.386 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:29.384+0000 7f4fed600700 1 -- 172.21.15.87:0/528170369 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55626efcf8f0 msgr2=0x55626efcfd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:32:29.386 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:29.384+0000 7f4fed600700 1 --2- 172.21.15.87:0/528170369 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55626efcf8f0 0x55626efcfd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:32:29.386 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:29.384+0000 7f4fed600700 1 -- 172.21.15.87:0/528170369 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55626ee6e8d0 con 0x55626efd4bc0 2024-05-08T05:32:29.386 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:29.384+0000 7f4fe7e00700 1 --2- 172.21.15.87:0/528170369 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55626efcf8f0 0x55626efcfd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T05:32:29.386 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:29.384+0000 7f4fecc00700 1 --2- 172.21.15.87:0/528170369 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55626efd54e0 0x55626efcf2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T05:32:29.387 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:29.385+0000 7f4fed600700 1 --2- 172.21.15.87:0/3938113024 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f4fcc0b2940 0x7f4fcc0b4e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:32:29.388 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:29.386+0000 7f4fed600700 1 --2- 172.21.15.87:0/528170369 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55626efd4bc0 0x55626efd4fa0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f4fd0009c80 tx=0x7f4fd0009f90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e9399755631a4095 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:32:29.388 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:29.387+0000 7f4fde000700 1 -- 172.21.15.87:0/528170369 <== mon.2 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4fd0022070 con 0x55626efd4bc0 2024-05-08T05:32:29.388 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:29.387+0000 7f4fde000700 1 -- 172.21.15.87:0/528170369 <== mon.2 v2:172.21.15.90:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4fd00118f0 con 0x55626efd4bc0 2024-05-08T05:32:29.388 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:29.387+0000 7f4fde000700 1 -- 172.21.15.87:0/528170369 <== mon.2 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4fd001b9b0 con 0x55626efd4bc0 2024-05-08T05:32:29.390 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:29.389+0000 7f4ff9f5fb80 1 -- 172.21.15.87:0/528170369 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55626efd4bc0 msgr2=0x55626efd4fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:32:29.390 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:29.389+0000 7f4ff9f5fb80 1 --2- 172.21.15.87:0/528170369 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55626efd4bc0 0x55626efd4fa0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f4fd0009c80 tx=0x7f4fd0009f90 comp rx=0 tx=0).stop 2024-05-08T05:32:29.390 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:29.389+0000 7f4fed600700 1 --2- 172.21.15.87:0/3938113024 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f4fcc0b2940 0x7f4fcc0b4e00 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f4fd001f000 tx=0x7f4fd001bc30 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:32:29.391 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:29.390+0000 7f4ff9f5fb80 1 -- 172.21.15.87:0/528170369 shutdown_connections 2024-05-08T05:32:29.391 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:29.390+0000 7f4ff9f5fb80 1 --2- 172.21.15.87:0/528170369 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55626efcf8f0 0x55626efcfd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:32:29.391 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:29.390+0000 7f4ff9f5fb80 1 --2- 172.21.15.87:0/528170369 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55626efd4bc0 0x55626efd4fa0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:32:29.391 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:29.390+0000 7f4ff9f5fb80 1 --2- 172.21.15.87:0/528170369 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55626efd54e0 0x55626efcf2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:32:29.391 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:29.390+0000 7f4ff9f5fb80 1 -- 172.21.15.87:0/528170369 >> 172.21.15.87:0/528170369 conn(0x55626ef476d0 msgr2=0x55626efc9b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:32:29.391 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:29.390+0000 7f4ff9f5fb80 1 -- 172.21.15.87:0/528170369 shutdown_connections 2024-05-08T05:32:29.392 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:29.390+0000 7f4ff9f5fb80 1 -- 172.21.15.87:0/528170369 wait complete. 2024-05-08T05:32:29.392 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:29.391+0000 7f4ff9f5fb80 1 -- start start 2024-05-08T05:32:29.392 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:29.392+0000 7f4ff9f5fb80 1 Processor -- start 2024-05-08T05:32:29.394 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:29.393+0000 7f4ff9f5fb80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55626efcf8f0 0x55626efdb220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:32:29.394 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:29.393+0000 7f4ff9f5fb80 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55626efd4bc0 0x55626efd85c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:32:29.394 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:29.393+0000 7f4ff9f5fb80 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55626efd54e0 0x55626efd8b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:32:29.394 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:29.394+0000 7f4ff9f5fb80 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x55626efdbf20 con 0x55626efd54e0 2024-05-08T05:32:29.394 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:29.394+0000 7f4ff9f5fb80 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x55626ee87b20 con 0x55626efd4bc0 2024-05-08T05:32:29.395 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:29.394+0000 7f4ff9f5fb80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x55626efdc0a0 con 0x55626efcf8f0 2024-05-08T05:32:29.395 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:29.394+0000 7f4ff9f5fb80 10 client.0 _ll_register_callbacks cb 0x55626eec8c70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T05:32:29.395 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:29.394+0000 7f4fecc00700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55626efcf8f0 0x55626efdb220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:32:29.395 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:29.394+0000 7f4fecc00700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55626efcf8f0 0x55626efdb220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.87:57420/0 (socket says 172.21.15.87:57420) 2024-05-08T05:32:29.395 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:29.394+0000 7f4fecc00700 1 -- 172.21.15.87:0/614312122 learned_addr learned my addr 172.21.15.87:0/614312122 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T05:32:29.396 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:29.395+0000 7f4fed600700 1 --2- 172.21.15.87:0/614312122 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55626efd54e0 0x55626efd8b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:32:29.396 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:29.394+0000 7f4fe7e00700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55626efd4bc0 0x55626efd85c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:32:29.396 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:29.395+0000 7f4fecc00700 1 -- 172.21.15.87:0/614312122 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55626efd4bc0 msgr2=0x55626efd85c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:32:29.396 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:29.396+0000 7f4fecc00700 1 --2- 172.21.15.87:0/614312122 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55626efd4bc0 0x55626efd85c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:32:29.396 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:29.396+0000 7f4fecc00700 1 -- 172.21.15.87:0/614312122 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55626efd54e0 msgr2=0x55626efd8b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:32:29.397 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:29.396+0000 7f4fecc00700 1 --2- 172.21.15.87:0/614312122 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55626efd54e0 0x55626efd8b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:32:29.397 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:29.396+0000 7f4fecc00700 1 -- 172.21.15.87:0/614312122 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55626eee7420 con 0x55626efcf8f0 2024-05-08T05:32:29.397 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:29.396+0000 7f4fe7e00700 1 --2- 172.21.15.87:0/614312122 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55626efd4bc0 0x55626efd85c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T05:32:29.397 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:29.396+0000 7f4fed600700 1 --2- 172.21.15.87:0/614312122 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55626efd54e0 0x55626efd8b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T05:32:29.397 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:29.397+0000 7f4fecc00700 1 --2- 172.21.15.87:0/614312122 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55626efcf8f0 0x55626efdb220 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f4fe0009fd0 tx=0x7f4fe000f400 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3729cceed5f445f8 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:32:29.398 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:29.397+0000 7f4fd6a00700 10 client.0 ms_handle_connect on v2:172.21.15.160:3300/0 2024-05-08T05:32:29.398 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:29.397+0000 7f4fd6a00700 1 -- 172.21.15.87:0/614312122 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4fe00a8ef0 con 0x55626efcf8f0 2024-05-08T05:32:29.398 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:29.397+0000 7f4fd6a00700 1 -- 172.21.15.87:0/614312122 <== mon.1 v2:172.21.15.160:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8190+0+0 (secure 0 0 0) 0x7f4fe00a9640 con 0x55626efcf8f0 2024-05-08T05:32:29.398 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:29.397+0000 7f4ff9f5fb80 1 -- 172.21.15.87:0/614312122 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4fd00118f0 con 0x55626efcf8f0 2024-05-08T05:32:29.398 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:29.397+0000 7f4fd6a00700 1 -- 172.21.15.87:0/614312122 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f4fe00a9ae0 con 0x55626efcf8f0 2024-05-08T05:32:29.398 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:29.398+0000 7f4ff9f5fb80 10 client.25510 fetch_fsmap learned FSMap version 27 2024-05-08T05:32:29.398 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:29.398+0000 7f4ff9f5fb80 1 -- 172.21.15.87:0/614312122 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55626efdbf20 con 0x55626efcf8f0 2024-05-08T05:32:29.398 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:29.398+0000 7f4fd6a00700 1 -- 172.21.15.87:0/614312122 <== mon.1 v2:172.21.15.160:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4fd00118f0 con 0x55626efcf8f0 2024-05-08T05:32:29.400 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:29.400+0000 7f4fd6a00700 1 -- 172.21.15.87:0/614312122 <== mon.1 v2:172.21.15.160:3300/0 5 ==== fsmap(e 27) ==== 8350+0+0 (secure 0 0 0) 0x7f4fe00e6040 con 0x55626efcf8f0 2024-05-08T05:32:29.401 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:29.400+0000 7f4ff9f5fb80 10 client.25510 fetch_fsmap finished waiting for FSMap version 27 2024-05-08T05:32:29.401 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:29.400+0000 7f4ff9f5fb80 10 client.25510 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.i 2024-05-08T05:32:29.402 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:29.400+0000 7f4ff9f5fb80 20 client.25510 populate_metadata read hostname 'smithi087' 2024-05-08T05:32:29.402 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:29.400+0000 7f4ff9f5fb80 1 --2- 172.21.15.87:0/614312122 >> [v2:172.21.15.160:6838/234657686,v1:172.21.15.160:6839/234657686] conn(0x55626efe8d20 0x55626efeb140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:32:29.402 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:29.400+0000 7f4ff9f5fb80 4 client.25510 mds_command: new command op to 24481 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-08T05:32:29.402 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:29.400+0000 7f4ff9f5fb80 1 -- 172.21.15.87:0/614312122 --> [v2:172.21.15.160:6838/234657686,v1:172.21.15.160:6839/234657686] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55626ef9c140 con 0x55626efe8d20 2024-05-08T05:32:29.402 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:29.401+0000 7f4fe7e00700 1 --2- 172.21.15.87:0/614312122 >> [v2:172.21.15.160:6838/234657686,v1:172.21.15.160:6839/234657686] conn(0x55626efe8d20 0x55626efeb140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:32:29.402 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:29.401+0000 7f4fe7e00700 1 --2- 172.21.15.87:0/614312122 >> [v2:172.21.15.160:6838/234657686,v1:172.21.15.160:6839/234657686] conn(0x55626efe8d20 0x55626efeb140 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=62920170b4f2a95f server_cookie=c79ca2d75a9e7463 in_seq=0 out_seq=0 2024-05-08T05:32:29.402 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:29.401+0000 7f4fd6a00700 10 client.25510 ms_handle_connect on v2:172.21.15.160:6838/234657686 2024-05-08T05:32:29.403 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:29.403+0000 7f4fd6a00700 1 -- 172.21.15.87:0/614312122 <== mds.2 v2:172.21.15.160:6838/234657686 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55626ef9c140 con 0x55626efe8d20 2024-05-08T05:32:29.403 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:29.403+0000 7f4fd6a00700 10 client.25510 handle_command_reply: tid=0 2024-05-08T05:32:29.403 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:29.403+0000 7f4ff9f5fb80 1 client.25510 shutdown 2024-05-08T05:32:29.405 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:29.405+0000 7f4ff9f5fb80 1 -- 172.21.15.87:0/614312122 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55626efcf8f0 msgr2=0x55626efdb220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:32:29.405 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:29.405+0000 7f4ff9f5fb80 1 --2- 172.21.15.87:0/614312122 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55626efcf8f0 0x55626efdb220 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f4fe0009fd0 tx=0x7f4fe000f400 comp rx=0 tx=0).stop 2024-05-08T05:32:29.405 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:29.405+0000 7f4ff9f5fb80 1 -- 172.21.15.87:0/614312122 shutdown_connections 2024-05-08T05:32:29.406 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:29.405+0000 7f4ff9f5fb80 1 --2- 172.21.15.87:0/614312122 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55626efd54e0 0x55626efd8b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:32:29.406 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:29.405+0000 7f4ff9f5fb80 1 --2- 172.21.15.87:0/614312122 >> [v2:172.21.15.160:6838/234657686,v1:172.21.15.160:6839/234657686] conn(0x55626efe8d20 0x55626efeb140 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:32:29.406 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:29.405+0000 7f4ff9f5fb80 1 --2- 172.21.15.87:0/614312122 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55626efcf8f0 0x55626efdb220 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:32:29.406 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:29.405+0000 7f4ff9f5fb80 1 --2- 172.21.15.87:0/614312122 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55626efd4bc0 0x55626efd85c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:32:29.406 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:29.405+0000 7f4ff9f5fb80 1 -- 172.21.15.87:0/614312122 >> 172.21.15.87:0/614312122 conn(0x55626ef476d0 msgr2=0x55626efc9190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:32:29.406 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:29.405+0000 7f4fd6a00700 0 client.25510 ms_handle_reset on v2:172.21.15.160:6838/234657686 2024-05-08T05:32:29.406 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:29.405+0000 7f4ff9f5fb80 1 -- 172.21.15.87:0/614312122 shutdown_connections 2024-05-08T05:32:29.406 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:29.405+0000 7f4ff9f5fb80 1 -- 172.21.15.87:0/614312122 wait complete. 2024-05-08T05:32:29.406 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:29.406+0000 7f4ff9f5fb80 20 client.25510 trim_cache size 0 max 16384 2024-05-08T05:32:29.427 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:29.426+0000 7f4ff9f5fb80 1 Processor -- start 2024-05-08T05:32:29.427 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:29.426+0000 7f4ff9f5fb80 1 -- start start 2024-05-08T05:32:29.427 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:29.426+0000 7f4ff9f5fb80 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55626efcf8f0 0x55626efcf2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:32:29.427 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:29.426+0000 7f4ff9f5fb80 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55626efd4bc0 0x55626efe4fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:32:29.427 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:29.426+0000 7f4ff9f5fb80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55626efd54e0 0x55626efd5fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:32:29.427 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:29.426+0000 7f4ff9f5fb80 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f4fe81bf090 con 0x55626efd4bc0 2024-05-08T05:32:29.428 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:29.426+0000 7f4ff9f5fb80 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f4fe81bc8f0 con 0x55626efcf8f0 2024-05-08T05:32:29.428 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:29.426+0000 7f4ff9f5fb80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f4fe81ba760 con 0x55626efd54e0 2024-05-08T05:32:29.428 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:29.427+0000 7f4fecc00700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55626efcf8f0 0x55626efcf2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:32:29.428 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:29.427+0000 7f4fecc00700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55626efcf8f0 0x55626efcf2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.87:45830/0 (socket says 172.21.15.87:45830) 2024-05-08T05:32:29.428 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:29.427+0000 7f4fecc00700 1 -- 172.21.15.87:0/105775105 learned_addr learned my addr 172.21.15.87:0/105775105 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T05:32:29.428 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:29.427+0000 7f4fe7e00700 1 --2- 172.21.15.87:0/105775105 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55626efd4bc0 0x55626efe4fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:32:29.428 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:29.427+0000 7f4fed600700 1 --2- 172.21.15.87:0/105775105 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55626efd54e0 0x55626efd5fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:32:29.429 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:29.427+0000 7f4fecc00700 1 -- 172.21.15.87:0/105775105 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55626efd54e0 msgr2=0x55626efd5fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:32:29.429 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:29.427+0000 7f4fecc00700 1 --2- 172.21.15.87:0/105775105 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55626efd54e0 0x55626efd5fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:32:29.429 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:29.427+0000 7f4fecc00700 1 -- 172.21.15.87:0/105775105 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55626efd4bc0 msgr2=0x55626efe4fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:32:29.429 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:29.427+0000 7f4fecc00700 1 --2- 172.21.15.87:0/105775105 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55626efd4bc0 0x55626efe4fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:32:29.429 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:29.427+0000 7f4fecc00700 1 -- 172.21.15.87:0/105775105 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55626efe8b00 con 0x55626efcf8f0 2024-05-08T05:32:29.429 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:29.427+0000 7f4fe7e00700 1 --2- 172.21.15.87:0/105775105 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55626efd4bc0 0x55626efe4fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T05:32:29.429 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:29.428+0000 7f4fecc00700 1 --2- 172.21.15.87:0/105775105 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55626efcf8f0 0x55626efcf2d0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f4fe00062a0 tx=0x7f4fe00a8c80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8bd090e42470e8dd server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:32:29.429 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:29.428+0000 7f4fdd600700 1 -- 172.21.15.87:0/105775105 <== mon.2 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4fe00b1e60 con 0x55626efcf8f0 2024-05-08T05:32:29.431 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:29.428+0000 7f4fdd600700 1 -- 172.21.15.87:0/105775105 <== mon.2 v2:172.21.15.90:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4fe00a93e0 con 0x55626efcf8f0 2024-05-08T05:32:29.431 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:29.428+0000 7f4fdd600700 1 -- 172.21.15.87:0/105775105 <== mon.2 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4fe00a9640 con 0x55626efcf8f0 2024-05-08T05:32:29.431 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:29.429+0000 7f4ff9f5fb80 1 -- 172.21.15.87:0/105775105 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55626efcf8f0 msgr2=0x55626efcf2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:32:29.431 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:29.429+0000 7f4ff9f5fb80 1 --2- 172.21.15.87:0/105775105 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55626efcf8f0 0x55626efcf2d0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f4fe00062a0 tx=0x7f4fe00a8c80 comp rx=0 tx=0).stop 2024-05-08T05:32:29.431 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:29.429+0000 7f4ff9f5fb80 1 -- 172.21.15.87:0/105775105 shutdown_connections 2024-05-08T05:32:29.431 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:29.429+0000 7f4ff9f5fb80 1 --2- 172.21.15.87:0/105775105 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55626efd54e0 0x55626efd5fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:32:29.431 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:29.429+0000 7f4ff9f5fb80 1 --2- 172.21.15.87:0/105775105 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55626efcf8f0 0x55626efcf2d0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:32:29.431 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:29.429+0000 7f4ff9f5fb80 1 --2- 172.21.15.87:0/105775105 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55626efd4bc0 0x55626efe4fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:32:29.431 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:29.429+0000 7f4ff9f5fb80 1 -- 172.21.15.87:0/105775105 >> 172.21.15.87:0/105775105 conn(0x55626ef476d0 msgr2=0x55626efd58c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:32:29.431 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:29.429+0000 7f4ff9f5fb80 1 -- 172.21.15.87:0/105775105 shutdown_connections 2024-05-08T05:32:29.431 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:29.429+0000 7f4ff9f5fb80 1 -- 172.21.15.87:0/105775105 wait complete. 2024-05-08T05:32:29.432 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:29.429+0000 7f4ff9f5fb80 1 -- start start 2024-05-08T05:32:29.432 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:29.430+0000 7f4ff9f5fb80 1 Processor -- start 2024-05-08T05:32:29.432 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:29.430+0000 7f4ff9f5fb80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55626efcf8f0 0x55626efe1510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:32:29.432 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:29.430+0000 7f4ff9f5fb80 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55626efd4bc0 0x55626efe1a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:32:29.432 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:29.430+0000 7f4ff9f5fb80 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55626efd54e0 0x55626efefc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:32:29.432 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:29.430+0000 7f4fe7e00700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55626efd4bc0 0x55626efe1a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:32:29.432 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:29.430+0000 7f4fe7e00700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55626efd4bc0 0x55626efe1a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.87:45840/0 (socket says 172.21.15.87:45840) 2024-05-08T05:32:29.432 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:29.430+0000 7f4fecc00700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55626efcf8f0 0x55626efe1510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:32:29.432 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:29.430+0000 7f4fecc00700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55626efcf8f0 0x55626efe1510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.87:57444/0 (socket says 172.21.15.87:57444) 2024-05-08T05:32:29.432 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:29.431+0000 7f4fed600700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55626efd54e0 0x55626efefc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:32:29.433 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:29.431+0000 7f4fe7e00700 1 -- 172.21.15.87:0/3303115785 learned_addr learned my addr 172.21.15.87:0/3303115785 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T05:32:29.433 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:29.431+0000 7f4ff9f5fb80 1 -- 172.21.15.87:0/3303115785 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f4fe81badb0 con 0x55626efd54e0 2024-05-08T05:32:29.433 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:29.431+0000 7f4ff9f5fb80 1 -- 172.21.15.87:0/3303115785 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f4fe81bc220 con 0x55626efd4bc0 2024-05-08T05:32:29.433 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:29.431+0000 7f4ff9f5fb80 1 -- 172.21.15.87:0/3303115785 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f4fe81bb480 con 0x55626efcf8f0 2024-05-08T05:32:29.434 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:29.431+0000 7f4ff9f5fb80 10 client.0 _ll_register_callbacks cb 0x55626eec8c70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T05:32:29.434 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:29.431+0000 7f4fe7e00700 1 -- 172.21.15.87:0/3303115785 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55626efcf8f0 msgr2=0x55626efe1510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:32:29.434 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:29.431+0000 7f4fe7e00700 1 --2- 172.21.15.87:0/3303115785 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55626efcf8f0 0x55626efe1510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:32:29.434 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:29.431+0000 7f4fe7e00700 1 -- 172.21.15.87:0/3303115785 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55626efd54e0 msgr2=0x55626efefc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:32:29.434 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:29.432+0000 7f4fe7e00700 1 --2- 172.21.15.87:0/3303115785 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55626efd54e0 0x55626efefc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:32:29.434 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:29.432+0000 7f4fe7e00700 1 -- 172.21.15.87:0/3303115785 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55626efc4ab0 con 0x55626efd4bc0 2024-05-08T05:32:29.434 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:29.432+0000 7f4fed600700 1 --2- 172.21.15.87:0/3303115785 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55626efd54e0 0x55626efefc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T05:32:29.434 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:29.432+0000 7f4fe7e00700 1 --2- 172.21.15.87:0/3303115785 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55626efd4bc0 0x55626efe1a50 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f4fe8199050 tx=0x7f4fd8010c20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c03c6f6afe7f09f5 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:32:29.434 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:29.432+0000 7f4fd6a00700 10 client.0 ms_handle_connect on v2:172.21.15.90:3300/0 2024-05-08T05:32:29.434 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:29.432+0000 7f4fd6a00700 1 -- 172.21.15.87:0/3303115785 <== mon.2 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4fd8023070 con 0x55626efd4bc0 2024-05-08T05:32:29.434 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:29.432+0000 7f4ff9f5fb80 1 -- 172.21.15.87:0/3303115785 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4fe00a93e0 con 0x55626efd4bc0 2024-05-08T05:32:29.435 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:29.432+0000 7f4fd6a00700 1 -- 172.21.15.87:0/3303115785 <== mon.2 v2:172.21.15.90:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8190+0+0 (secure 0 0 0) 0x7f4fd8004220 con 0x55626efd4bc0 2024-05-08T05:32:29.435 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:29.432+0000 7f4fd6a00700 1 -- 172.21.15.87:0/3303115785 <== mon.2 v2:172.21.15.90:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f4fd8004420 con 0x55626efd4bc0 2024-05-08T05:32:29.435 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:29.432+0000 7f4ff9f5fb80 10 client.25526 fetch_fsmap learned FSMap version 27 2024-05-08T05:32:29.435 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:29.432+0000 7f4ff9f5fb80 1 -- 172.21.15.87:0/3303115785 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55626f0530d0 con 0x55626efd4bc0 2024-05-08T05:32:29.436 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:29.433+0000 7f4fd6a00700 1 -- 172.21.15.87:0/3303115785 <== mon.2 v2:172.21.15.90:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4fe00a93e0 con 0x55626efd4bc0 2024-05-08T05:32:29.436 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:29.433+0000 7f4fd6a00700 1 -- 172.21.15.87:0/3303115785 <== mon.2 v2:172.21.15.90:3300/0 5 ==== fsmap(e 27) ==== 8350+0+0 (secure 0 0 0) 0x7f4fd8005020 con 0x55626efd4bc0 2024-05-08T05:32:29.436 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:29.433+0000 7f4ff9f5fb80 10 client.25526 fetch_fsmap finished waiting for FSMap version 27 2024-05-08T05:32:29.436 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:29.433+0000 7f4ff9f5fb80 10 client.25526 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.i 2024-05-08T05:32:29.436 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:29.433+0000 7f4ff9f5fb80 20 client.25526 populate_metadata read hostname 'smithi087' 2024-05-08T05:32:29.436 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:29.433+0000 7f4ff9f5fb80 1 --2- 172.21.15.87:0/3303115785 >> [v2:172.21.15.160:6838/234657686,v1:172.21.15.160:6839/234657686] conn(0x55626f053810 0x55626f055c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:32:29.437 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:29.433+0000 7f4ff9f5fb80 4 client.25526 mds_command: new command op to 24481 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-05-08T05:32:29.437 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:29.433+0000 7f4ff9f5fb80 1 -- 172.21.15.87:0/3303115785 --> [v2:172.21.15.160:6838/234657686,v1:172.21.15.160:6839/234657686] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55626ef2f400 con 0x55626f053810 2024-05-08T05:32:29.437 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:29.433+0000 7f4fecc00700 1 --2- 172.21.15.87:0/3303115785 >> [v2:172.21.15.160:6838/234657686,v1:172.21.15.160:6839/234657686] conn(0x55626f053810 0x55626f055c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:32:29.437 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:29.434+0000 7f4fecc00700 1 --2- 172.21.15.87:0/3303115785 >> [v2:172.21.15.160:6838/234657686,v1:172.21.15.160:6839/234657686] conn(0x55626f053810 0x55626f055c30 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=ac60744a2f663965 server_cookie=b349c61a93b59841 in_seq=0 out_seq=0 2024-05-08T05:32:29.437 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:29.434+0000 7f4fd6a00700 10 client.25526 ms_handle_connect on v2:172.21.15.160:6838/234657686 2024-05-08T05:32:29.437 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:29.434+0000 7f4fd6a00700 1 -- 172.21.15.87:0/3303115785 <== mds.2 v2:172.21.15.160:6838/234657686 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55626ef2f400 con 0x55626f053810 2024-05-08T05:32:29.437 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:29.434+0000 7f4fd6a00700 10 client.25526 handle_command_reply: tid=0 2024-05-08T05:32:29.437 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:29.434+0000 7f4ff9f5fb80 1 client.25526 shutdown 2024-05-08T05:32:29.437 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:29.434+0000 7f4ff9f5fb80 1 -- 172.21.15.87:0/3303115785 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55626efd4bc0 msgr2=0x55626efe1a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:32:29.437 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:29.434+0000 7f4ff9f5fb80 1 --2- 172.21.15.87:0/3303115785 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55626efd4bc0 0x55626efe1a50 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f4fe8199050 tx=0x7f4fd8010c20 comp rx=0 tx=0).stop 2024-05-08T05:32:29.437 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:29.434+0000 7f4ff9f5fb80 1 -- 172.21.15.87:0/3303115785 shutdown_connections 2024-05-08T05:32:29.437 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:29.434+0000 7f4ff9f5fb80 1 --2- 172.21.15.87:0/3303115785 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55626efd54e0 0x55626efefc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:32:29.437 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:29.434+0000 7f4ff9f5fb80 1 --2- 172.21.15.87:0/3303115785 >> [v2:172.21.15.160:6838/234657686,v1:172.21.15.160:6839/234657686] conn(0x55626f053810 0x55626f055c30 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:32:29.437 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:29.434+0000 7f4ff9f5fb80 1 --2- 172.21.15.87:0/3303115785 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55626efcf8f0 0x55626efe1510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:32:29.438 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:29.434+0000 7f4ff9f5fb80 1 --2- 172.21.15.87:0/3303115785 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55626efd4bc0 0x55626efe1a50 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:32:29.438 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:29.434+0000 7f4ff9f5fb80 1 -- 172.21.15.87:0/3303115785 >> 172.21.15.87:0/3303115785 conn(0x55626ef476d0 msgr2=0x55626efd6150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:32:29.438 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:29.435+0000 7f4fd6a00700 0 client.25526 ms_handle_reset on v2:172.21.15.160:6838/234657686 2024-05-08T05:32:29.438 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:29.435+0000 7f4ff9f5fb80 1 -- 172.21.15.87:0/3303115785 shutdown_connections 2024-05-08T05:32:29.438 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:29.435+0000 7f4ff9f5fb80 1 -- 172.21.15.87:0/3303115785 wait complete. 2024-05-08T05:32:29.438 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:29.435+0000 7f4ff9f5fb80 20 client.25526 trim_cache size 0 max 16384 2024-05-08T05:32:29.438 INFO:teuthology.orchestra.run.smithi087.stdout:[] 2024-05-08T05:32:29.439 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:29.436+0000 7f4fef600700 1 -- 172.21.15.87:0/3938113024 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f4fcc0b2940 msgr2=0x7f4fcc0b4e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:32:29.439 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:29.436+0000 7f4fef600700 1 --2- 172.21.15.87:0/3938113024 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f4fcc0b2940 0x7f4fcc0b4e00 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f4fd001f000 tx=0x7f4fd001bc30 comp rx=0 tx=0).stop 2024-05-08T05:32:29.439 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:29.436+0000 7f4fef600700 1 -- 172.21.15.87:0/3938113024 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4fe8103550 msgr2=0x7f4fe819e800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:32:29.439 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:29.436+0000 7f4fef600700 1 --2- 172.21.15.87:0/3938113024 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4fe8103550 0x7f4fe819e800 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f4fe0000f80 tx=0x7f4fe0017890 comp rx=0 tx=0).stop 2024-05-08T05:32:29.439 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:29.436+0000 7f4fef600700 1 -- 172.21.15.87:0/3938113024 shutdown_connections 2024-05-08T05:32:29.439 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:29.436+0000 7f4fef600700 1 --2- 172.21.15.87:0/3938113024 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4fe8108460 0x7f4fe8197e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:32:29.439 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:29.436+0000 7f4fef600700 1 --2- 172.21.15.87:0/3938113024 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4fe8103550 0x7f4fe819e800 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:32:29.439 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:29.436+0000 7f4fef600700 1 --2- 172.21.15.87:0/3938113024 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f4fcc0b2940 0x7f4fcc0b4e00 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:32:29.439 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:29.436+0000 7f4fef600700 1 --2- 172.21.15.87:0/3938113024 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4fe8103ef0 0x7f4fe81978e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:32:29.440 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:29.436+0000 7f4fef600700 1 -- 172.21.15.87:0/3938113024 >> 172.21.15.87:0/3938113024 conn(0x7f4fe807a600 msgr2=0x7f4fe8101660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:32:29.440 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:29.436+0000 7f4fef600700 1 -- 172.21.15.87:0/3938113024 shutdown_connections 2024-05-08T05:32:29.440 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:29.436+0000 7f4fef600700 1 -- 172.21.15.87:0/3938113024 wait complete. 2024-05-08T05:32:30.208 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:32:30 smithi087 ceph-mon[29523]: pgmap v525: 97 pgs: 97 active+clean; 1.6 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 27 MiB/s rd, 39 MiB/s wr, 126 op/s 2024-05-08T05:32:30.289 DEBUG:teuthology.orchestra.run.smithi087:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid eeeb813e-0cf9-11ef-bc97-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-05-08T05:32:30.483 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:32:30 smithi090 ceph-mon[34526]: pgmap v525: 97 pgs: 97 active+clean; 1.6 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 27 MiB/s rd, 39 MiB/s wr, 126 op/s 2024-05-08T05:32:30.538 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:32:30 smithi160 ceph-mon[34827]: pgmap v525: 97 pgs: 97 active+clean; 1.6 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 27 MiB/s rd, 39 MiB/s wr, 126 op/s 2024-05-08T05:32:30.764 INFO:teuthology.orchestra.run.smithi087.stderr:Inferring config /var/lib/ceph/eeeb813e-0cf9-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T05:32:32.458 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:32:32 smithi087 ceph-mon[29523]: pgmap v526: 97 pgs: 97 active+clean; 1.4 GiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 8.7 MiB/s rd, 12 MiB/s wr, 96 op/s 2024-05-08T05:32:32.458 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:32:32 smithi087 ceph-mon[29523]: fsmap cephfs:3 {0=b=up:active,1=g=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-05-08T05:32:32.483 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:32:32 smithi090 ceph-mon[34526]: pgmap v526: 97 pgs: 97 active+clean; 1.4 GiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 8.7 MiB/s rd, 12 MiB/s wr, 96 op/s 2024-05-08T05:32:32.483 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:32:32 smithi090 ceph-mon[34526]: fsmap cephfs:3 {0=b=up:active,1=g=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-05-08T05:32:32.538 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:32:32 smithi160 ceph-mon[34827]: pgmap v526: 97 pgs: 97 active+clean; 1.4 GiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 8.7 MiB/s rd, 12 MiB/s wr, 96 op/s 2024-05-08T05:32:32.539 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:32:32 smithi160 ceph-mon[34827]: fsmap cephfs:3 {0=b=up:active,1=g=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-05-08T05:32:33.422 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:33.421+0000 7fbf14800700 1 -- 172.21.15.87:0/2473827858 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fbf0c102450 msgr2=0x7fbf0c110340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:32:33.423 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:33.421+0000 7fbf14800700 1 --2- 172.21.15.87:0/2473827858 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fbf0c102450 0x7fbf0c110340 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fbf0800b0a0 tx=0x7fbf0800b3b0 comp rx=0 tx=0).stop 2024-05-08T05:32:33.423 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:33.421+0000 7fbf14800700 1 -- 172.21.15.87:0/2473827858 shutdown_connections 2024-05-08T05:32:33.423 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:33.421+0000 7fbf14800700 1 --2- 172.21.15.87:0/2473827858 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fbf0c102450 0x7fbf0c110340 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:32:33.423 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:33.421+0000 7fbf14800700 1 --2- 172.21.15.87:0/2473827858 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fbf0c109520 0x7fbf0c109900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:32:33.423 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:33.421+0000 7fbf14800700 1 --2- 172.21.15.87:0/2473827858 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fbf0c101a90 0x7fbf0c101f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:32:33.423 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:33.421+0000 7fbf14800700 1 -- 172.21.15.87:0/2473827858 >> 172.21.15.87:0/2473827858 conn(0x7fbf0c078a10 msgr2=0x7fbf0c0ffdc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:32:33.423 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:33.421+0000 7fbf14800700 1 -- 172.21.15.87:0/2473827858 shutdown_connections 2024-05-08T05:32:33.423 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:33.422+0000 7fbf14800700 1 -- 172.21.15.87:0/2473827858 wait complete. 2024-05-08T05:32:33.425 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:33.423+0000 7fbf14800700 1 Processor -- start 2024-05-08T05:32:33.426 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:33.423+0000 7fbf14800700 1 -- start start 2024-05-08T05:32:33.426 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:33.424+0000 7fbf14800700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fbf0c101a90 0x7fbf0c1a1940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:32:33.426 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:33.424+0000 7fbf14800700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fbf0c102450 0x7fbf0c1a1e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:32:33.426 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:33.424+0000 7fbf14800700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fbf0c109520 0x7fbf0c19bb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:32:33.426 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:33.424+0000 7fbf14800700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fbf0c113630 con 0x7fbf0c101a90 2024-05-08T05:32:33.426 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:33.424+0000 7fbf14800700 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fbf0c1134b0 con 0x7fbf0c102450 2024-05-08T05:32:33.426 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:33.424+0000 7fbf14800700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7fbf0c1137b0 con 0x7fbf0c109520 2024-05-08T05:32:33.426 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:33.424+0000 7fbf11400700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fbf0c102450 0x7fbf0c1a1e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:32:33.426 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:33.424+0000 7fbf11e00700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fbf0c101a90 0x7fbf0c1a1940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:32:33.426 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:33.424+0000 7fbf11400700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fbf0c102450 0x7fbf0c1a1e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.87:45862/0 (socket says 172.21.15.87:45862) 2024-05-08T05:32:33.426 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:33.424+0000 7fbf11400700 1 -- 172.21.15.87:0/3075890094 learned_addr learned my addr 172.21.15.87:0/3075890094 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T05:32:33.426 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:33.424+0000 7fbf12800700 1 --2- 172.21.15.87:0/3075890094 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fbf0c109520 0x7fbf0c19bb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:32:33.427 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:33.425+0000 7fbf11400700 1 -- 172.21.15.87:0/3075890094 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fbf0c109520 msgr2=0x7fbf0c19bb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:32:33.427 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:33.425+0000 7fbf11400700 1 --2- 172.21.15.87:0/3075890094 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fbf0c109520 0x7fbf0c19bb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:32:33.427 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:33.425+0000 7fbf11400700 1 -- 172.21.15.87:0/3075890094 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fbf0c101a90 msgr2=0x7fbf0c1a1940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:32:33.427 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:33.425+0000 7fbf11400700 1 --2- 172.21.15.87:0/3075890094 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fbf0c101a90 0x7fbf0c1a1940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:32:33.427 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:33.425+0000 7fbf11400700 1 -- 172.21.15.87:0/3075890094 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbf0c19c260 con 0x7fbf0c102450 2024-05-08T05:32:33.427 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:33.425+0000 7fbf12800700 1 --2- 172.21.15.87:0/3075890094 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fbf0c109520 0x7fbf0c19bb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T05:32:33.427 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:33.425+0000 7fbf11400700 1 --2- 172.21.15.87:0/3075890094 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fbf0c102450 0x7fbf0c1a1e80 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fbefc00c600 tx=0x7fbefc00c910 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:32:33.427 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:33.425+0000 7fbf06a00700 1 -- 172.21.15.87:0/3075890094 <== mon.2 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbefc023070 con 0x7fbf0c102450 2024-05-08T05:32:33.427 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:33.425+0000 7fbf06a00700 1 -- 172.21.15.87:0/3075890094 <== mon.2 v2:172.21.15.90:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbefc01e8e0 con 0x7fbf0c102450 2024-05-08T05:32:33.427 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:33.425+0000 7fbf06a00700 1 -- 172.21.15.87:0/3075890094 <== mon.2 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbefc016510 con 0x7fbf0c102450 2024-05-08T05:32:33.427 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:33.425+0000 7fbf14800700 1 -- 172.21.15.87:0/3075890094 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbf0c19c550 con 0x7fbf0c102450 2024-05-08T05:32:33.427 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:33.425+0000 7fbf14800700 1 -- 172.21.15.87:0/3075890094 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbf0c10a260 con 0x7fbf0c102450 2024-05-08T05:32:33.429 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:33.429+0000 7fbf06a00700 1 -- 172.21.15.87:0/3075890094 <== mon.2 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7fbefc026070 con 0x7fbf0c102450 2024-05-08T05:32:33.430 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:33.430+0000 7fbf1f146b80 1 Processor -- start 2024-05-08T05:32:33.430 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:33.430+0000 7fbf1f146b80 1 -- start start 2024-05-08T05:32:33.431 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:33.431+0000 7fbf06a00700 1 --2- 172.21.15.87:0/3075890094 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7fbef40b2880 0x7fbef40b4d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:32:33.431 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:33.431+0000 7fbf1f146b80 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x56211500dbc0 0x56211500dfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:32:33.432 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:33.431+0000 7fbf1f146b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x56211500e4e0 0x5621150082d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:32:33.432 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:33.431+0000 7fbf1f146b80 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5621150088f0 0x562115008d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:32:33.432 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:33.431+0000 7fbf1f146b80 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x562114f5aa20 con 0x5621150088f0 2024-05-08T05:32:33.432 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:33.431+0000 7fbf1f146b80 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x562114ef8760 con 0x56211500dbc0 2024-05-08T05:32:33.432 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:33.431+0000 7fbf06a00700 1 -- 172.21.15.87:0/3075890094 <== mon.2 v2:172.21.15.90:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8190+0+0 (secure 0 0 0) 0x7fbefc0ea1d0 con 0x7fbf0c102450 2024-05-08T05:32:33.432 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:33.431+0000 7fbf1f146b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x562114f569e0 con 0x56211500e4e0 2024-05-08T05:32:33.432 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:33.431+0000 7fbf11e00700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x56211500dbc0 0x56211500dfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:32:33.432 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:33.431+0000 7fbf11e00700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x56211500dbc0 0x56211500dfa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.87:45876/0 (socket says 172.21.15.87:45876) 2024-05-08T05:32:33.432 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:33.431+0000 7fbf11e00700 1 -- 172.21.15.87:0/936596811 learned_addr learned my addr 172.21.15.87:0/936596811 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T05:32:33.432 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:33.431+0000 7fbf12800700 1 --2- 172.21.15.87:0/936596811 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5621150088f0 0x562115008d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:32:33.433 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:33.431+0000 7fbf11400700 1 --2- 172.21.15.87:0/936596811 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x56211500e4e0 0x5621150082d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:32:33.433 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:33.432+0000 7fbf12800700 1 --2- 172.21.15.87:0/3075890094 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7fbef40b2880 0x7fbef40b4d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:32:33.433 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:33.432+0000 7fbf11e00700 1 -- 172.21.15.87:0/936596811 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x56211500e4e0 msgr2=0x5621150082d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:32:33.433 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:33.432+0000 7fbf11e00700 1 --2- 172.21.15.87:0/936596811 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x56211500e4e0 0x5621150082d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:32:33.433 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:33.432+0000 7fbf11e00700 1 -- 172.21.15.87:0/936596811 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5621150088f0 msgr2=0x562115008d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:32:33.433 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:33.432+0000 7fbf11e00700 1 --2- 172.21.15.87:0/936596811 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5621150088f0 0x562115008d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:32:33.433 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:33.432+0000 7fbf11e00700 1 -- 172.21.15.87:0/936596811 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562114ea78d0 con 0x56211500dbc0 2024-05-08T05:32:33.434 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:33.432+0000 7fbf11e00700 1 --2- 172.21.15.87:0/936596811 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x56211500dbc0 0x56211500dfa0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fbf00009d00 tx=0x7fbf00011720 comp rx=0 tx=0).ready entity=mon.2 client_cookie=79f484e360b1a04 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:32:33.434 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:33.432+0000 7fbefb400700 1 -- 172.21.15.87:0/936596811 <== mon.2 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf00004230 con 0x56211500dbc0 2024-05-08T05:32:33.434 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:33.432+0000 7fbf12800700 1 --2- 172.21.15.87:0/3075890094 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7fbef40b2880 0x7fbef40b4d40 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fbf08006130 tx=0x7fbf0800b720 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:32:33.434 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:33.432+0000 7fbefb400700 1 -- 172.21.15.87:0/936596811 <== mon.2 v2:172.21.15.90:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbf000043d0 con 0x56211500dbc0 2024-05-08T05:32:33.434 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:33.432+0000 7fbefb400700 1 -- 172.21.15.87:0/936596811 <== mon.2 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf00019920 con 0x56211500dbc0 2024-05-08T05:32:33.435 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:33.433+0000 7fbf1f146b80 1 -- 172.21.15.87:0/936596811 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x56211500dbc0 msgr2=0x56211500dfa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:32:33.436 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:33.433+0000 7fbf1f146b80 1 --2- 172.21.15.87:0/936596811 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x56211500dbc0 0x56211500dfa0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fbf00009d00 tx=0x7fbf00011720 comp rx=0 tx=0).stop 2024-05-08T05:32:33.436 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:33.434+0000 7fbf1f146b80 1 -- 172.21.15.87:0/936596811 shutdown_connections 2024-05-08T05:32:33.436 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:33.434+0000 7fbf1f146b80 1 --2- 172.21.15.87:0/936596811 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5621150088f0 0x562115008d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:32:33.436 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:33.434+0000 7fbf1f146b80 1 --2- 172.21.15.87:0/936596811 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x56211500dbc0 0x56211500dfa0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:32:33.436 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:33.434+0000 7fbf1f146b80 1 --2- 172.21.15.87:0/936596811 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x56211500e4e0 0x5621150082d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:32:33.436 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:33.434+0000 7fbf1f146b80 1 -- 172.21.15.87:0/936596811 >> 172.21.15.87:0/936596811 conn(0x562114f806d0 msgr2=0x562115002b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:32:33.436 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:33.434+0000 7fbf1f146b80 1 -- 172.21.15.87:0/936596811 shutdown_connections 2024-05-08T05:32:33.436 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:33.434+0000 7fbf1f146b80 1 -- 172.21.15.87:0/936596811 wait complete. 2024-05-08T05:32:33.436 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:33.435+0000 7fbf1f146b80 1 -- start start 2024-05-08T05:32:33.436 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:33.435+0000 7fbf1f146b80 1 Processor -- start 2024-05-08T05:32:33.437 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:33.436+0000 7fbf1f146b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5621150088f0 0x5621150141c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:32:33.437 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:33.436+0000 7fbf1f146b80 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x56211500dbc0 0x562115011560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:32:33.438 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:33.436+0000 7fbf1f146b80 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56211500e4e0 0x562115011aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:32:33.438 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:33.436+0000 7fbf1f146b80 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x562115014f20 con 0x56211500e4e0 2024-05-08T05:32:33.438 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:33.436+0000 7fbf1f146b80 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x562114ec0b20 con 0x56211500dbc0 2024-05-08T05:32:33.438 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:33.436+0000 7fbf1f146b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x5621150150a0 con 0x5621150088f0 2024-05-08T05:32:33.438 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:33.436+0000 7fbf1f146b80 10 client.0 _ll_register_callbacks cb 0x562114f01c70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T05:32:33.438 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:33.436+0000 7fbf11400700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x56211500dbc0 0x562115011560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:32:33.438 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:33.436+0000 7fbf11e00700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5621150088f0 0x5621150141c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:32:33.438 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:33.436+0000 7fbf11400700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x56211500dbc0 0x562115011560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.87:45888/0 (socket says 172.21.15.87:45888) 2024-05-08T05:32:33.439 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:33.436+0000 7fbf11400700 1 -- 172.21.15.87:0/3406859155 learned_addr learned my addr 172.21.15.87:0/3406859155 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T05:32:33.439 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:33.437+0000 7fbf11400700 1 -- 172.21.15.87:0/3406859155 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5621150088f0 msgr2=0x5621150141c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:32:33.439 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:33.437+0000 7fbf11400700 1 --2- 172.21.15.87:0/3406859155 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5621150088f0 0x5621150141c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:32:33.439 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:33.437+0000 7fbf12800700 1 --2- 172.21.15.87:0/3406859155 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56211500e4e0 0x562115011aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:32:33.439 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:33.437+0000 7fbf11400700 1 -- 172.21.15.87:0/3406859155 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56211500e4e0 msgr2=0x562115011aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:32:33.439 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:33.437+0000 7fbf11400700 1 --2- 172.21.15.87:0/3406859155 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56211500e4e0 0x562115011aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:32:33.439 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:33.437+0000 7fbf11400700 1 -- 172.21.15.87:0/3406859155 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562114f20420 con 0x56211500dbc0 2024-05-08T05:32:33.439 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:33.437+0000 7fbf11e00700 1 --2- 172.21.15.87:0/3406859155 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5621150088f0 0x5621150141c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T05:32:33.439 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:33.437+0000 7fbf12800700 1 --2- 172.21.15.87:0/3406859155 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56211500e4e0 0x562115011aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T05:32:33.439 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:33.437+0000 7fbf11400700 1 --2- 172.21.15.87:0/3406859155 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x56211500dbc0 0x562115011560 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fbefc00c5d0 tx=0x7fbefc0b1ec0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=714a055220203c27 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:32:33.439 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:33.437+0000 7fbeefe00700 10 client.0 ms_handle_connect on v2:172.21.15.90:3300/0 2024-05-08T05:32:33.439 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:33.437+0000 7fbeefe00700 1 -- 172.21.15.87:0/3406859155 <== mon.2 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbefc0b5b70 con 0x56211500dbc0 2024-05-08T05:32:33.439 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:33.437+0000 7fbeefe00700 1 -- 172.21.15.87:0/3406859155 <== mon.2 v2:172.21.15.90:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8190+0+0 (secure 0 0 0) 0x7fbefc0ba190 con 0x56211500dbc0 2024-05-08T05:32:33.440 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:33.437+0000 7fbf1f146b80 1 -- 172.21.15.87:0/3406859155 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbf000043d0 con 0x56211500dbc0 2024-05-08T05:32:33.442 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:33.438+0000 7fbeefe00700 1 -- 172.21.15.87:0/3406859155 <== mon.2 v2:172.21.15.90:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fbefc0ba620 con 0x56211500dbc0 2024-05-08T05:32:33.442 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:33.438+0000 7fbf1f146b80 10 client.25538 fetch_fsmap learned FSMap version 28 2024-05-08T05:32:33.442 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:33.438+0000 7fbf1f146b80 1 -- 172.21.15.87:0/3406859155 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x56211501f780 con 0x56211500dbc0 2024-05-08T05:32:33.443 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:33.438+0000 7fbeefe00700 1 -- 172.21.15.87:0/3406859155 <== mon.2 v2:172.21.15.90:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbf000043d0 con 0x56211500dbc0 2024-05-08T05:32:33.443 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:33.438+0000 7fbeefe00700 1 -- 172.21.15.87:0/3406859155 <== mon.2 v2:172.21.15.90:3300/0 5 ==== fsmap(e 28) ==== 8358+0+0 (secure 0 0 0) 0x7fbefc0b2af0 con 0x56211500dbc0 2024-05-08T05:32:33.443 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:33.438+0000 7fbf1f146b80 10 client.25538 fetch_fsmap finished waiting for FSMap version 28 2024-05-08T05:32:33.443 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:33.438+0000 7fbf1f146b80 10 client.25538 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.g 2024-05-08T05:32:33.443 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:33.438+0000 7fbf1f146b80 20 client.25538 populate_metadata read hostname 'smithi087' 2024-05-08T05:32:33.443 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:33.438+0000 7fbf1f146b80 1 --2- 172.21.15.87:0/3406859155 >> [v2:172.21.15.87:6838/2127215876,v1:172.21.15.87:6839/2127215876] conn(0x562115021dc0 0x5621150241b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:32:33.443 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:33.438+0000 7fbf1f146b80 4 client.25538 mds_command: new command op to 24482 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-08T05:32:33.443 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:33.438+0000 7fbf1f146b80 1 -- 172.21.15.87:0/3406859155 --> [v2:172.21.15.87:6838/2127215876,v1:172.21.15.87:6839/2127215876] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562114fd5140 con 0x562115021dc0 2024-05-08T05:32:33.443 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:33.439+0000 7fbf11e00700 1 --2- 172.21.15.87:0/3406859155 >> [v2:172.21.15.87:6838/2127215876,v1:172.21.15.87:6839/2127215876] conn(0x562115021dc0 0x5621150241b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:32:33.443 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:33.439+0000 7fbf11e00700 1 --2- 172.21.15.87:0/3406859155 >> [v2:172.21.15.87:6838/2127215876,v1:172.21.15.87:6839/2127215876] conn(0x562115021dc0 0x5621150241b0 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=e185969c8cb35834 server_cookie=48de06232d530075 in_seq=0 out_seq=0 2024-05-08T05:32:33.444 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:33.439+0000 7fbeefe00700 10 client.25538 ms_handle_connect on v2:172.21.15.87:6838/2127215876 2024-05-08T05:32:33.444 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:33.440+0000 7fbeefe00700 1 -- 172.21.15.87:0/3406859155 <== mds.1 v2:172.21.15.87:6838/2127215876 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x562114fd5140 con 0x562115021dc0 2024-05-08T05:32:33.444 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:33.440+0000 7fbeefe00700 10 client.25538 handle_command_reply: tid=0 2024-05-08T05:32:33.444 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:33.440+0000 7fbf1f146b80 1 client.25538 shutdown 2024-05-08T05:32:33.444 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:33.441+0000 7fbf1f146b80 1 -- 172.21.15.87:0/3406859155 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x56211500dbc0 msgr2=0x562115011560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:32:33.444 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:33.441+0000 7fbf1f146b80 1 --2- 172.21.15.87:0/3406859155 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x56211500dbc0 0x562115011560 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fbefc00c5d0 tx=0x7fbefc0b1ec0 comp rx=0 tx=0).stop 2024-05-08T05:32:33.444 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:33.441+0000 7fbf1f146b80 1 -- 172.21.15.87:0/3406859155 shutdown_connections 2024-05-08T05:32:33.444 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:33.441+0000 7fbf1f146b80 1 --2- 172.21.15.87:0/3406859155 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56211500e4e0 0x562115011aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:32:33.444 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:33.441+0000 7fbf1f146b80 1 --2- 172.21.15.87:0/3406859155 >> [v2:172.21.15.87:6838/2127215876,v1:172.21.15.87:6839/2127215876] conn(0x562115021dc0 0x5621150241b0 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:32:33.444 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:33.441+0000 7fbf1f146b80 1 --2- 172.21.15.87:0/3406859155 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5621150088f0 0x5621150141c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:32:33.444 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:33.441+0000 7fbf1f146b80 1 --2- 172.21.15.87:0/3406859155 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x56211500dbc0 0x562115011560 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:32:33.444 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:33.441+0000 7fbeefe00700 0 client.25538 ms_handle_reset on v2:172.21.15.87:6838/2127215876 2024-05-08T05:32:33.444 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:33.441+0000 7fbf1f146b80 1 -- 172.21.15.87:0/3406859155 >> 172.21.15.87:0/3406859155 conn(0x562114f806d0 msgr2=0x562115002190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:32:33.444 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:33.441+0000 7fbf1f146b80 1 -- 172.21.15.87:0/3406859155 shutdown_connections 2024-05-08T05:32:33.444 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:33.441+0000 7fbf1f146b80 1 -- 172.21.15.87:0/3406859155 wait complete. 2024-05-08T05:32:33.445 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:33.441+0000 7fbf1f146b80 20 client.25538 trim_cache size 0 max 16384 2024-05-08T05:32:33.460 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:33.460+0000 7fbf1f146b80 1 Processor -- start 2024-05-08T05:32:33.460 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:33.460+0000 7fbf1f146b80 1 -- start start 2024-05-08T05:32:33.461 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:33.460+0000 7fbf1f146b80 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5621150088f0 0x5621150082d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:32:33.461 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:33.460+0000 7fbf1f146b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x56211500dbc0 0x56211501dfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:32:33.461 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:33.460+0000 7fbf1f146b80 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56211500e4e0 0x56211500f020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:32:33.461 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:33.460+0000 7fbf1f146b80 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fbf0c1ae300 con 0x56211500e4e0 2024-05-08T05:32:33.461 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:33.460+0000 7fbf1f146b80 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fbf0c1abb00 con 0x5621150088f0 2024-05-08T05:32:33.461 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:33.460+0000 7fbf1f146b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7fbf0c1a9a20 con 0x56211500dbc0 2024-05-08T05:32:33.463 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:33.460+0000 7fbf11e00700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5621150088f0 0x5621150082d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:32:33.463 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:33.461+0000 7fbf11e00700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5621150088f0 0x5621150082d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.87:45896/0 (socket says 172.21.15.87:45896) 2024-05-08T05:32:33.464 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:33.461+0000 7fbf11e00700 1 -- 172.21.15.87:0/997403850 learned_addr learned my addr 172.21.15.87:0/997403850 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T05:32:33.464 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:33.461+0000 7fbf12800700 1 --2- 172.21.15.87:0/997403850 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56211500e4e0 0x56211500f020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:32:33.464 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:33.461+0000 7fbf11400700 1 --2- 172.21.15.87:0/997403850 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x56211500dbc0 0x56211501dfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:32:33.464 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:33.461+0000 7fbf11e00700 1 -- 172.21.15.87:0/997403850 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x56211500dbc0 msgr2=0x56211501dfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:32:33.464 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:33.461+0000 7fbf11e00700 1 --2- 172.21.15.87:0/997403850 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x56211500dbc0 0x56211501dfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:32:33.464 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:33.461+0000 7fbf11e00700 1 -- 172.21.15.87:0/997403850 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56211500e4e0 msgr2=0x56211500f020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:32:33.464 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:33.461+0000 7fbf11e00700 1 --2- 172.21.15.87:0/997403850 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56211500e4e0 0x56211500f020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:32:33.464 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:33.461+0000 7fbf11e00700 1 -- 172.21.15.87:0/997403850 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56211500f560 con 0x5621150088f0 2024-05-08T05:32:33.464 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:33.461+0000 7fbf11e00700 1 --2- 172.21.15.87:0/997403850 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5621150088f0 0x5621150082d0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fbf00013010 tx=0x7fbf00005ce0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f8da7284b7c2fad8 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:32:33.464 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:33.461+0000 7fbefaa00700 1 -- 172.21.15.87:0/997403850 <== mon.2 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf00005040 con 0x5621150088f0 2024-05-08T05:32:33.464 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:33.462+0000 7fbefaa00700 1 -- 172.21.15.87:0/997403850 <== mon.2 v2:172.21.15.90:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbf00005690 con 0x5621150088f0 2024-05-08T05:32:33.464 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:33.462+0000 7fbefaa00700 1 -- 172.21.15.87:0/997403850 <== mon.2 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf00003cd0 con 0x5621150088f0 2024-05-08T05:32:33.465 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:33.462+0000 7fbf1f146b80 1 -- 172.21.15.87:0/997403850 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5621150088f0 msgr2=0x5621150082d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:32:33.465 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:33.462+0000 7fbf1f146b80 1 --2- 172.21.15.87:0/997403850 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5621150088f0 0x5621150082d0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fbf00013010 tx=0x7fbf00005ce0 comp rx=0 tx=0).stop 2024-05-08T05:32:33.465 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:33.462+0000 7fbf1f146b80 1 -- 172.21.15.87:0/997403850 shutdown_connections 2024-05-08T05:32:33.465 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:33.462+0000 7fbf1f146b80 1 --2- 172.21.15.87:0/997403850 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56211500e4e0 0x56211500f020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:32:33.465 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:33.462+0000 7fbf1f146b80 1 --2- 172.21.15.87:0/997403850 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5621150088f0 0x5621150082d0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:32:33.465 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:33.462+0000 7fbf1f146b80 1 --2- 172.21.15.87:0/997403850 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x56211500dbc0 0x56211501dfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:32:33.465 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:33.462+0000 7fbf1f146b80 1 -- 172.21.15.87:0/997403850 >> 172.21.15.87:0/997403850 conn(0x562114f806d0 msgr2=0x56211500e910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:32:33.465 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:33.463+0000 7fbf1f146b80 1 -- 172.21.15.87:0/997403850 shutdown_connections 2024-05-08T05:32:33.465 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:33.463+0000 7fbf1f146b80 1 -- 172.21.15.87:0/997403850 wait complete. 2024-05-08T05:32:33.465 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:33.463+0000 7fbf1f146b80 1 -- start start 2024-05-08T05:32:33.465 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:33.463+0000 7fbf1f146b80 1 Processor -- start 2024-05-08T05:32:33.468 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:33.464+0000 7fbf1f146b80 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5621150088f0 0x56211501a510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:32:33.468 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:33.464+0000 7fbf1f146b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x56211500dbc0 0x56211501aa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:32:33.468 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:33.464+0000 7fbf1f146b80 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56211500e4e0 0x562115028ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:32:33.468 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:33.464+0000 7fbf1f146b80 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fbf0c1a9fc0 con 0x56211500e4e0 2024-05-08T05:32:33.468 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:33.464+0000 7fbf1f146b80 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fbf0c1ab430 con 0x5621150088f0 2024-05-08T05:32:33.468 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:33.464+0000 7fbf1f146b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7fbf0c1aa690 con 0x56211500dbc0 2024-05-08T05:32:33.469 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:33.464+0000 7fbf1f146b80 10 client.0 _ll_register_callbacks cb 0x562114f01c70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T05:32:33.469 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:33.464+0000 7fbf11e00700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5621150088f0 0x56211501a510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:32:33.469 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:33.464+0000 7fbf11e00700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5621150088f0 0x56211501a510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.87:45908/0 (socket says 172.21.15.87:45908) 2024-05-08T05:32:33.469 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:33.464+0000 7fbf11e00700 1 -- 172.21.15.87:0/3516222498 learned_addr learned my addr 172.21.15.87:0/3516222498 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T05:32:33.469 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:33.464+0000 7fbf12800700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56211500e4e0 0x562115028ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:32:33.469 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:33.464+0000 7fbf11400700 1 --2- 172.21.15.87:0/3516222498 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x56211500dbc0 0x56211501aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:32:33.469 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:33.465+0000 7fbf12800700 1 -- 172.21.15.87:0/3516222498 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x56211500dbc0 msgr2=0x56211501aa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:32:33.469 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:33.465+0000 7fbf12800700 1 --2- 172.21.15.87:0/3516222498 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x56211500dbc0 0x56211501aa50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:32:33.469 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:33.465+0000 7fbf12800700 1 -- 172.21.15.87:0/3516222498 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5621150088f0 msgr2=0x56211501a510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:32:33.469 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:33.465+0000 7fbf12800700 1 --2- 172.21.15.87:0/3516222498 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5621150088f0 0x56211501a510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:32:33.469 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:33.465+0000 7fbf12800700 1 -- 172.21.15.87:0/3516222498 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5621150296e0 con 0x56211500e4e0 2024-05-08T05:32:33.469 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:33.465+0000 7fbf11e00700 1 --2- 172.21.15.87:0/3516222498 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5621150088f0 0x56211501a510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T05:32:33.470 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:33.465+0000 7fbf12800700 1 --2- 172.21.15.87:0/3516222498 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56211500e4e0 0x562115028ea0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fbf08009fd0 tx=0x7fbf0800b3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5bcaee436098171 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:32:33.470 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:33.465+0000 7fbeefe00700 10 client.0 ms_handle_connect on v2:172.21.15.87:3300/0 2024-05-08T05:32:33.470 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:33.466+0000 7fbeefe00700 1 -- 172.21.15.87:0/3516222498 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf08033680 con 0x56211500e4e0 2024-05-08T05:32:33.470 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:33.466+0000 7fbeefe00700 1 -- 172.21.15.87:0/3516222498 <== mon.0 v2:172.21.15.87:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8190+0+0 (secure 0 0 0) 0x7fbf08033820 con 0x56211500e4e0 2024-05-08T05:32:33.470 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:33.466+0000 7fbf1f146b80 1 -- 172.21.15.87:0/3516222498 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbf00005690 con 0x56211500e4e0 2024-05-08T05:32:33.470 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:33.466+0000 7fbeefe00700 1 -- 172.21.15.87:0/3516222498 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fbf0803a070 con 0x56211500e4e0 2024-05-08T05:32:33.470 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:33.466+0000 7fbf1f146b80 10 client.15435 fetch_fsmap learned FSMap version 28 2024-05-08T05:32:33.470 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:33.466+0000 7fbf1f146b80 1 -- 172.21.15.87:0/3516222498 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x56211508c300 con 0x56211500e4e0 2024-05-08T05:32:33.470 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:33.466+0000 7fbeefe00700 1 -- 172.21.15.87:0/3516222498 <== mon.0 v2:172.21.15.87:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbf00005690 con 0x56211500e4e0 2024-05-08T05:32:33.470 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:33.467+0000 7fbeefe00700 1 -- 172.21.15.87:0/3516222498 <== mon.0 v2:172.21.15.87:3300/0 5 ==== fsmap(e 28) ==== 8358+0+0 (secure 0 0 0) 0x7fbf08011070 con 0x56211500e4e0 2024-05-08T05:32:33.470 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:33.467+0000 7fbf1f146b80 10 client.15435 fetch_fsmap finished waiting for FSMap version 28 2024-05-08T05:32:33.470 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:33.467+0000 7fbf1f146b80 10 client.15435 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.g 2024-05-08T05:32:33.470 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:33.467+0000 7fbf1f146b80 20 client.15435 populate_metadata read hostname 'smithi087' 2024-05-08T05:32:33.470 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:33.467+0000 7fbf1f146b80 1 --2- 172.21.15.87:0/3516222498 >> [v2:172.21.15.87:6838/2127215876,v1:172.21.15.87:6839/2127215876] conn(0x56211508ca10 0x56211508ee30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:32:33.471 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:33.467+0000 7fbf1f146b80 4 client.15435 mds_command: new command op to 24482 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-05-08T05:32:33.471 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:33.467+0000 7fbf1f146b80 1 -- 172.21.15.87:0/3516222498 --> [v2:172.21.15.87:6838/2127215876,v1:172.21.15.87:6839/2127215876] -- command(tid 0: {"prefix": "damage ls"}) -- 0x562114f68400 con 0x56211508ca10 2024-05-08T05:32:33.471 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:33.467+0000 7fbf11e00700 1 --2- 172.21.15.87:0/3516222498 >> [v2:172.21.15.87:6838/2127215876,v1:172.21.15.87:6839/2127215876] conn(0x56211508ca10 0x56211508ee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:32:33.471 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:33.468+0000 7fbf11e00700 1 --2- 172.21.15.87:0/3516222498 >> [v2:172.21.15.87:6838/2127215876,v1:172.21.15.87:6839/2127215876] conn(0x56211508ca10 0x56211508ee30 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=3bef89d766c7df92 server_cookie=abd625c6c13e3c54 in_seq=0 out_seq=0 2024-05-08T05:32:33.471 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:33.468+0000 7fbeefe00700 10 client.15435 ms_handle_connect on v2:172.21.15.87:6838/2127215876 2024-05-08T05:32:33.471 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:33.468+0000 7fbeefe00700 1 -- 172.21.15.87:0/3516222498 <== mds.1 v2:172.21.15.87:6838/2127215876 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x562114f68400 con 0x56211508ca10 2024-05-08T05:32:33.471 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:33.468+0000 7fbeefe00700 10 client.15435 handle_command_reply: tid=0 2024-05-08T05:32:33.471 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:33.468+0000 7fbf1f146b80 1 client.15435 shutdown 2024-05-08T05:32:33.472 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:33.468+0000 7fbf1f146b80 1 -- 172.21.15.87:0/3516222498 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56211500e4e0 msgr2=0x562115028ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:32:33.472 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:33.468+0000 7fbf1f146b80 1 --2- 172.21.15.87:0/3516222498 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56211500e4e0 0x562115028ea0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fbf08009fd0 tx=0x7fbf0800b3b0 comp rx=0 tx=0).stop 2024-05-08T05:32:33.472 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:33.469+0000 7fbf1f146b80 1 -- 172.21.15.87:0/3516222498 shutdown_connections 2024-05-08T05:32:33.472 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:33.469+0000 7fbf1f146b80 1 --2- 172.21.15.87:0/3516222498 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56211500e4e0 0x562115028ea0 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:32:33.472 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:33.469+0000 7fbf1f146b80 1 --2- 172.21.15.87:0/3516222498 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5621150088f0 0x56211501a510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:32:33.472 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:33.469+0000 7fbf1f146b80 1 --2- 172.21.15.87:0/3516222498 >> [v2:172.21.15.87:6838/2127215876,v1:172.21.15.87:6839/2127215876] conn(0x56211508ca10 0x56211508ee30 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:32:33.472 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:33.469+0000 7fbf1f146b80 1 --2- 172.21.15.87:0/3516222498 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x56211500dbc0 0x56211501aa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:32:33.472 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:33.469+0000 7fbf1f146b80 1 -- 172.21.15.87:0/3516222498 >> 172.21.15.87:0/3516222498 conn(0x562114f806d0 msgr2=0x56211500c6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:32:33.472 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:33.469+0000 7fbeefe00700 0 client.15435 ms_handle_reset on v2:172.21.15.87:6838/2127215876 2024-05-08T05:32:33.472 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:33.469+0000 7fbf1f146b80 1 -- 172.21.15.87:0/3516222498 shutdown_connections 2024-05-08T05:32:33.473 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:33.469+0000 7fbf1f146b80 1 -- 172.21.15.87:0/3516222498 wait complete. 2024-05-08T05:32:33.473 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:33.469+0000 7fbf1f146b80 20 client.15435 trim_cache size 0 max 16384 2024-05-08T05:32:33.473 INFO:teuthology.orchestra.run.smithi087.stdout:[] 2024-05-08T05:32:33.474 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:33.470+0000 7fbf14800700 1 -- 172.21.15.87:0/3075890094 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7fbef40b2880 msgr2=0x7fbef40b4d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:32:33.474 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:33.470+0000 7fbf14800700 1 --2- 172.21.15.87:0/3075890094 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7fbef40b2880 0x7fbef40b4d40 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fbf08006130 tx=0x7fbf0800b720 comp rx=0 tx=0).stop 2024-05-08T05:32:33.474 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:33.470+0000 7fbf14800700 1 -- 172.21.15.87:0/3075890094 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fbf0c102450 msgr2=0x7fbf0c1a1e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:32:33.474 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:33.470+0000 7fbf14800700 1 --2- 172.21.15.87:0/3075890094 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fbf0c102450 0x7fbf0c1a1e80 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fbefc00c600 tx=0x7fbefc00c910 comp rx=0 tx=0).stop 2024-05-08T05:32:33.474 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:33.470+0000 7fbf14800700 1 -- 172.21.15.87:0/3075890094 shutdown_connections 2024-05-08T05:32:33.474 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:33.470+0000 7fbf14800700 1 --2- 172.21.15.87:0/3075890094 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7fbef40b2880 0x7fbef40b4d40 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:32:33.475 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:33.470+0000 7fbf14800700 1 --2- 172.21.15.87:0/3075890094 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fbf0c109520 0x7fbf0c19bb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:32:33.475 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:33.470+0000 7fbf14800700 1 --2- 172.21.15.87:0/3075890094 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fbf0c101a90 0x7fbf0c1a1940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:32:33.475 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:33.470+0000 7fbf14800700 1 --2- 172.21.15.87:0/3075890094 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fbf0c102450 0x7fbf0c1a1e80 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:32:33.475 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:33.470+0000 7fbf14800700 1 -- 172.21.15.87:0/3075890094 >> 172.21.15.87:0/3075890094 conn(0x7fbf0c078a10 msgr2=0x7fbf0c0ffea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:32:33.475 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:33.470+0000 7fbf14800700 1 -- 172.21.15.87:0/3075890094 shutdown_connections 2024-05-08T05:32:33.475 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:33.470+0000 7fbf14800700 1 -- 172.21.15.87:0/3075890094 wait complete. 2024-05-08T05:32:34.208 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:32:34 smithi087 ceph-mon[29523]: pgmap v527: 97 pgs: 97 active+clean; 1.1 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 4.6 MiB/s wr, 121 op/s 2024-05-08T05:32:34.414 DEBUG:teuthology.orchestra.run.smithi087:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid eeeb813e-0cf9-11ef-bc97-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-05-08T05:32:34.483 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:32:34 smithi090 ceph-mon[34526]: pgmap v527: 97 pgs: 97 active+clean; 1.1 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 4.6 MiB/s wr, 121 op/s 2024-05-08T05:32:34.538 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:32:34 smithi160 ceph-mon[34827]: pgmap v527: 97 pgs: 97 active+clean; 1.1 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 4.6 MiB/s wr, 121 op/s 2024-05-08T05:32:34.855 INFO:teuthology.orchestra.run.smithi087.stderr:Inferring config /var/lib/ceph/eeeb813e-0cf9-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T05:32:36.459 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:32:36 smithi087 ceph-mon[29523]: pgmap v528: 97 pgs: 97 active+clean; 717 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 2.9 MiB/s wr, 124 op/s 2024-05-08T05:32:36.483 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:32:36 smithi090 ceph-mon[34526]: pgmap v528: 97 pgs: 97 active+clean; 717 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 2.9 MiB/s wr, 124 op/s 2024-05-08T05:32:36.538 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:32:36 smithi160 ceph-mon[34827]: pgmap v528: 97 pgs: 97 active+clean; 717 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 2.9 MiB/s wr, 124 op/s 2024-05-08T05:32:36.865 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-05-08T05:32:36.865 DEBUG:teuthology.orchestra.run.smithi087:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-05-08T05:32:37.128 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:37.125+0000 7f7aea800700 1 -- 172.21.15.87:0/4241183181 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7ae4104100 msgr2=0x7f7ae4108120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:32:37.128 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:37.125+0000 7f7aea800700 1 --2- 172.21.15.87:0/4241183181 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7ae4104100 0x7f7ae4108120 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f7ad0009990 tx=0x7f7ad0009ca0 comp rx=0 tx=0).stop 2024-05-08T05:32:37.128 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:37.126+0000 7f7aea800700 1 -- 172.21.15.87:0/4241183181 shutdown_connections 2024-05-08T05:32:37.128 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:37.126+0000 7f7aea800700 1 --2- 172.21.15.87:0/4241183181 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7ae4108850 0x7f7ae41103d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:32:37.128 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:37.126+0000 7f7aea800700 1 --2- 172.21.15.87:0/4241183181 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7ae4103750 0x7f7ae4103b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:32:37.128 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:37.126+0000 7f7aea800700 1 --2- 172.21.15.87:0/4241183181 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7ae4104100 0x7f7ae4108120 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:32:37.128 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:37.126+0000 7f7aea800700 1 -- 172.21.15.87:0/4241183181 >> 172.21.15.87:0/4241183181 conn(0x7f7ae407a600 msgr2=0x7f7ae407aa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:32:37.128 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:37.126+0000 7f7aea800700 1 -- 172.21.15.87:0/4241183181 shutdown_connections 2024-05-08T05:32:37.128 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:37.126+0000 7f7aea800700 1 -- 172.21.15.87:0/4241183181 wait complete. 2024-05-08T05:32:37.129 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:37.127+0000 7f7aea800700 1 Processor -- start 2024-05-08T05:32:37.129 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:37.128+0000 7f7aea800700 1 -- start start 2024-05-08T05:32:37.130 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:37.128+0000 7f7aea800700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7ae4103750 0x7f7ae419f760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:32:37.130 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:37.128+0000 7f7aea800700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7ae4104100 0x7f7ae419fca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:32:37.130 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:37.128+0000 7f7aea800700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7ae4108850 0x7f7ae4199920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:32:37.130 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:37.128+0000 7f7aea800700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f7ae4113680 con 0x7f7ae4104100 2024-05-08T05:32:37.130 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:37.128+0000 7f7aea800700 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f7ae4113500 con 0x7f7ae4108850 2024-05-08T05:32:37.131 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:37.128+0000 7f7aea800700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f7ae4113800 con 0x7f7ae4103750 2024-05-08T05:32:37.131 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:37.128+0000 7f7ae3400700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7ae4103750 0x7f7ae419f760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:32:37.131 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:37.128+0000 7f7ae3400700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7ae4103750 0x7f7ae419f760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.87:53966/0 (socket says 172.21.15.87:53966) 2024-05-08T05:32:37.131 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:37.128+0000 7f7ae3400700 1 -- 172.21.15.87:0/2029886675 learned_addr learned my addr 172.21.15.87:0/2029886675 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T05:32:37.131 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:37.128+0000 7f7ae3e00700 1 --2- 172.21.15.87:0/2029886675 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7ae4108850 0x7f7ae4199920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:32:37.131 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:37.129+0000 7f7ae3400700 1 -- 172.21.15.87:0/2029886675 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7ae4108850 msgr2=0x7f7ae4199920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:32:37.131 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:37.129+0000 7f7ae3400700 1 --2- 172.21.15.87:0/2029886675 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7ae4108850 0x7f7ae4199920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:32:37.131 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:37.129+0000 7f7ae3400700 1 -- 172.21.15.87:0/2029886675 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7ae4104100 msgr2=0x7f7ae419fca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:32:37.131 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:37.129+0000 7f7ae3400700 1 --2- 172.21.15.87:0/2029886675 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7ae4104100 0x7f7ae419fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:32:37.131 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:37.129+0000 7f7ae3400700 1 -- 172.21.15.87:0/2029886675 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7ae419a080 con 0x7f7ae4103750 2024-05-08T05:32:37.132 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:37.129+0000 7f7ae3400700 1 --2- 172.21.15.87:0/2029886675 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7ae4103750 0x7f7ae419f760 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f7ad400e9a0 tx=0x7f7ad400ecb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:32:37.132 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:37.130+0000 7f7adbe00700 1 -- 172.21.15.87:0/2029886675 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ad400cbd0 con 0x7f7ae4103750 2024-05-08T05:32:37.132 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:37.130+0000 7f7adbe00700 1 -- 172.21.15.87:0/2029886675 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7ad400cd70 con 0x7f7ae4103750 2024-05-08T05:32:37.132 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:37.130+0000 7f7adbe00700 1 -- 172.21.15.87:0/2029886675 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ad4018680 con 0x7f7ae4103750 2024-05-08T05:32:37.132 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:37.130+0000 7f7aea800700 1 -- 172.21.15.87:0/2029886675 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7ae419a370 con 0x7f7ae4103750 2024-05-08T05:32:37.132 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:37.130+0000 7f7aea800700 1 -- 172.21.15.87:0/2029886675 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7ae41a6630 con 0x7f7ae4103750 2024-05-08T05:32:37.137 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:37.136+0000 7f7adbe00700 1 -- 172.21.15.87:0/2029886675 <== mon.1 v2:172.21.15.160:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7f7ad4010430 con 0x7f7ae4103750 2024-05-08T05:32:37.138 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:37.137+0000 7f7af519bb80 1 Processor -- start 2024-05-08T05:32:37.138 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:37.137+0000 7f7adbe00700 1 --2- 172.21.15.87:0/2029886675 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f7ac80b2900 0x7f7ac80b4dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:32:37.139 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:37.138+0000 7f7adbe00700 1 -- 172.21.15.87:0/2029886675 <== mon.1 v2:172.21.15.160:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8190+0+0 (secure 0 0 0) 0x7f7ad40e23b0 con 0x7f7ae4103750 2024-05-08T05:32:37.139 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:37.138+0000 7f7ae3e00700 1 --2- 172.21.15.87:0/2029886675 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f7ac80b2900 0x7f7ac80b4dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:32:37.140 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:37.138+0000 7f7af519bb80 1 -- start start 2024-05-08T05:32:37.141 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:37.139+0000 7f7af519bb80 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55bc956dabd0 0x55bc956dafb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:32:37.141 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:37.139+0000 7f7af519bb80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55bc956d72d0 0x55bc956d7750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:32:37.141 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:37.139+0000 7f7af519bb80 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55bc956d7c90 0x55bc956ebf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:32:37.142 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:37.139+0000 7f7af519bb80 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x55bc95629a20 con 0x55bc956dabd0 2024-05-08T05:32:37.142 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:37.139+0000 7f7af519bb80 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x55bc955c7760 con 0x55bc956d7c90 2024-05-08T05:32:37.142 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:37.139+0000 7f7af519bb80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x55bc956259e0 con 0x55bc956d72d0 2024-05-08T05:32:37.142 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:37.139+0000 7f7ae3e00700 1 --2- 172.21.15.87:0/2029886675 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f7ac80b2900 0x7f7ac80b4dc0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f7adc00f540 tx=0x7f7adc00b040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:32:37.142 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:37.139+0000 7f7ae3400700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55bc956dabd0 0x55bc956dafb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:32:37.142 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:37.139+0000 7f7ae3e00700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55bc956d7c90 0x55bc956ebf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:32:37.142 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:37.139+0000 7f7ae2a00700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55bc956d72d0 0x55bc956d7750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:32:37.142 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:37.139+0000 7f7ae3400700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55bc956dabd0 0x55bc956dafb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:49982/0 (socket says 172.21.15.87:49982) 2024-05-08T05:32:37.142 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:37.139+0000 7f7ae3400700 1 -- 172.21.15.87:0/1073968011 learned_addr learned my addr 172.21.15.87:0/1073968011 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T05:32:37.142 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:37.140+0000 7f7ae2a00700 1 -- 172.21.15.87:0/1073968011 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55bc956d7c90 msgr2=0x55bc956ebf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:32:37.142 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:37.140+0000 7f7ae2a00700 1 --2- 172.21.15.87:0/1073968011 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55bc956d7c90 0x55bc956ebf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:32:37.142 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:37.140+0000 7f7ae2a00700 1 -- 172.21.15.87:0/1073968011 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55bc956dabd0 msgr2=0x55bc956dafb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:32:37.142 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:37.140+0000 7f7ae2a00700 1 --2- 172.21.15.87:0/1073968011 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55bc956dabd0 0x55bc956dafb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:32:37.143 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:37.140+0000 7f7ae2a00700 1 -- 172.21.15.87:0/1073968011 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bc955768d0 con 0x55bc956d72d0 2024-05-08T05:32:37.143 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:37.140+0000 7f7ae3e00700 1 --2- 172.21.15.87:0/1073968011 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55bc956d7c90 0x55bc956ebf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T05:32:37.143 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:37.140+0000 7f7ae2a00700 1 --2- 172.21.15.87:0/1073968011 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55bc956d72d0 0x55bc956d7750 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f7ad0009990 tx=0x7f7ad0005e80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ffa054f16fd3faa7 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:32:37.143 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:37.141+0000 7f7ad8c00700 1 -- 172.21.15.87:0/1073968011 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ad0009510 con 0x55bc956d72d0 2024-05-08T05:32:37.144 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:37.141+0000 7f7ad8c00700 1 -- 172.21.15.87:0/1073968011 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7ad000bca0 con 0x55bc956d72d0 2024-05-08T05:32:37.144 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:37.141+0000 7f7ad8c00700 1 -- 172.21.15.87:0/1073968011 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ad0003970 con 0x55bc956d72d0 2024-05-08T05:32:37.144 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:37.141+0000 7f7af519bb80 1 -- 172.21.15.87:0/1073968011 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55bc956d72d0 msgr2=0x55bc956d7750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:32:37.144 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:37.141+0000 7f7af519bb80 1 --2- 172.21.15.87:0/1073968011 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55bc956d72d0 0x55bc956d7750 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f7ad0009990 tx=0x7f7ad0005e80 comp rx=0 tx=0).stop 2024-05-08T05:32:37.144 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:37.142+0000 7f7af519bb80 1 -- 172.21.15.87:0/1073968011 shutdown_connections 2024-05-08T05:32:37.144 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:37.142+0000 7f7af519bb80 1 --2- 172.21.15.87:0/1073968011 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55bc956d7c90 0x55bc956ebf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:32:37.144 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:37.142+0000 7f7af519bb80 1 --2- 172.21.15.87:0/1073968011 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55bc956dabd0 0x55bc956dafb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:32:37.144 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:37.142+0000 7f7af519bb80 1 --2- 172.21.15.87:0/1073968011 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55bc956d72d0 0x55bc956d7750 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:32:37.144 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:37.142+0000 7f7af519bb80 1 -- 172.21.15.87:0/1073968011 >> 172.21.15.87:0/1073968011 conn(0x55bc9564f6d0 msgr2=0x55bc956d1b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:32:37.144 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:37.142+0000 7f7af519bb80 1 -- 172.21.15.87:0/1073968011 shutdown_connections 2024-05-08T05:32:37.144 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:37.142+0000 7f7af519bb80 1 -- 172.21.15.87:0/1073968011 wait complete. 2024-05-08T05:32:37.145 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:37.143+0000 7f7af519bb80 1 -- start start 2024-05-08T05:32:37.146 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:37.143+0000 7f7af519bb80 1 Processor -- start 2024-05-08T05:32:37.146 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:37.144+0000 7f7af519bb80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55bc956d72d0 0x55bc956e5970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:32:37.146 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:37.144+0000 7f7af519bb80 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55bc956d7c90 0x55bc956e5eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:32:37.146 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:37.144+0000 7f7af519bb80 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55bc956dabd0 0x55bc956eb6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:32:37.146 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:37.144+0000 7f7af519bb80 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x55bc956db980 con 0x55bc956dabd0 2024-05-08T05:32:37.146 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:37.144+0000 7f7af519bb80 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x55bc9558fb20 con 0x55bc956d7c90 2024-05-08T05:32:37.146 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:37.144+0000 7f7af519bb80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x55bc956dbb00 con 0x55bc956d72d0 2024-05-08T05:32:37.146 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:37.144+0000 7f7af519bb80 10 client.0 _ll_register_callbacks cb 0x55bc955d0c70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T05:32:37.146 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:37.144+0000 7f7ae2a00700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55bc956d7c90 0x55bc956e5eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:32:37.146 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:37.144+0000 7f7ae2a00700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55bc956d7c90 0x55bc956e5eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.87:47332/0 (socket says 172.21.15.87:47332) 2024-05-08T05:32:37.146 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:37.144+0000 7f7ae2a00700 1 -- 172.21.15.87:0/431187617 learned_addr learned my addr 172.21.15.87:0/431187617 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T05:32:37.147 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:37.145+0000 7f7ae3e00700 1 --2- 172.21.15.87:0/431187617 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55bc956dabd0 0x55bc956eb6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:32:37.147 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:37.145+0000 7f7ae2a00700 1 -- 172.21.15.87:0/431187617 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55bc956d72d0 msgr2=0x55bc956e5970 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-05-08T05:32:37.148 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:37.145+0000 7f7ae3400700 1 --2- 172.21.15.87:0/431187617 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55bc956d72d0 0x55bc956e5970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:32:37.148 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:37.145+0000 7f7ae2a00700 1 --2- 172.21.15.87:0/431187617 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55bc956d72d0 0x55bc956e5970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:32:37.148 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:37.145+0000 7f7ae2a00700 1 -- 172.21.15.87:0/431187617 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55bc956dabd0 msgr2=0x55bc956eb6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:32:37.148 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:37.145+0000 7f7ae2a00700 1 --2- 172.21.15.87:0/431187617 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55bc956dabd0 0x55bc956eb6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:32:37.148 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:37.145+0000 7f7ae2a00700 1 -- 172.21.15.87:0/431187617 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bc955ef420 con 0x55bc956d7c90 2024-05-08T05:32:37.148 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:37.145+0000 7f7ae3e00700 1 --2- 172.21.15.87:0/431187617 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55bc956dabd0 0x55bc956eb6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T05:32:37.148 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:37.145+0000 7f7ae2a00700 1 --2- 172.21.15.87:0/431187617 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55bc956d7c90 0x55bc956e5eb0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f7ad0006010 tx=0x7f7ad0005c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=775f79fb5d06b7e4 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:32:37.148 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:37.145+0000 7f7acd600700 10 client.0 ms_handle_connect on v2:172.21.15.90:3300/0 2024-05-08T05:32:37.148 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:37.145+0000 7f7acd600700 1 -- 172.21.15.87:0/431187617 <== mon.2 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ad0003680 con 0x55bc956d7c90 2024-05-08T05:32:37.148 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:37.146+0000 7f7acd600700 1 -- 172.21.15.87:0/431187617 <== mon.2 v2:172.21.15.90:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8190+0+0 (secure 0 0 0) 0x7f7ad0027040 con 0x55bc956d7c90 2024-05-08T05:32:37.148 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:37.146+0000 7f7af519bb80 1 -- 172.21.15.87:0/431187617 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7ad000bca0 con 0x55bc956d7c90 2024-05-08T05:32:37.152 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:37.151+0000 7f7acd600700 1 -- 172.21.15.87:0/431187617 <== mon.2 v2:172.21.15.90:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f7ad0003820 con 0x55bc956d7c90 2024-05-08T05:32:37.153 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:37.151+0000 7f7af519bb80 10 client.25556 fetch_fsmap learned FSMap version 29 2024-05-08T05:32:37.153 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:37.151+0000 7f7af519bb80 1 -- 172.21.15.87:0/431187617 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55bc956e1b60 con 0x55bc956d7c90 2024-05-08T05:32:37.153 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:37.151+0000 7f7acd600700 1 -- 172.21.15.87:0/431187617 <== mon.2 v2:172.21.15.90:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7ad000bca0 con 0x55bc956d7c90 2024-05-08T05:32:37.153 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:37.151+0000 7f7acd600700 1 -- 172.21.15.87:0/431187617 <== mon.2 v2:172.21.15.90:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7f7ad0035cd0 con 0x55bc956d7c90 2024-05-08T05:32:37.153 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:37.151+0000 7f7af519bb80 10 client.25556 fetch_fsmap finished waiting for FSMap version 29 2024-05-08T05:32:37.153 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:37.151+0000 7f7af519bb80 10 client.25556 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-05-08T05:32:37.154 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:37.151+0000 7f7af519bb80 20 client.25556 populate_metadata read hostname 'smithi087' 2024-05-08T05:32:37.154 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:37.152+0000 7f7af519bb80 1 --2- 172.21.15.87:0/431187617 >> [v2:172.21.15.90:6838/160586017,v1:172.21.15.90:6839/160586017] conn(0x55bc95701c90 0x55bc95704080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:32:37.154 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:37.152+0000 7f7af519bb80 4 client.25556 mds_command: new command op to 24500 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-08T05:32:37.154 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:37.152+0000 7f7af519bb80 1 -- 172.21.15.87:0/431187617 --> [v2:172.21.15.90:6838/160586017,v1:172.21.15.90:6839/160586017] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55bc956a4140 con 0x55bc95701c90 2024-05-08T05:32:37.154 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:37.152+0000 7f7ae3400700 1 --2- 172.21.15.87:0/431187617 >> [v2:172.21.15.90:6838/160586017,v1:172.21.15.90:6839/160586017] conn(0x55bc95701c90 0x55bc95704080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:32:37.154 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:37.153+0000 7f7ae3400700 1 --2- 172.21.15.87:0/431187617 >> [v2:172.21.15.90:6838/160586017,v1:172.21.15.90:6839/160586017] conn(0x55bc95701c90 0x55bc95704080 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a64c6abd2cb84967 server_cookie=562f57a0a387d4e5 in_seq=0 out_seq=0 2024-05-08T05:32:37.154 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:37.153+0000 7f7acd600700 10 client.25556 ms_handle_connect on v2:172.21.15.90:6838/160586017 2024-05-08T05:32:37.155 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:37.154+0000 7f7acd600700 1 -- 172.21.15.87:0/431187617 <== mds.0 v2:172.21.15.90:6838/160586017 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55bc956a4140 con 0x55bc95701c90 2024-05-08T05:32:37.155 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:37.154+0000 7f7acd600700 10 client.25556 handle_command_reply: tid=0 2024-05-08T05:32:37.155 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:37.154+0000 7f7af519bb80 1 client.25556 shutdown 2024-05-08T05:32:37.155 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:37.154+0000 7f7af519bb80 1 -- 172.21.15.87:0/431187617 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55bc956d7c90 msgr2=0x55bc956e5eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:32:37.156 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:37.154+0000 7f7af519bb80 1 --2- 172.21.15.87:0/431187617 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55bc956d7c90 0x55bc956e5eb0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f7ad0006010 tx=0x7f7ad0005c00 comp rx=0 tx=0).stop 2024-05-08T05:32:37.156 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:37.154+0000 7f7af519bb80 1 -- 172.21.15.87:0/431187617 shutdown_connections 2024-05-08T05:32:37.156 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:37.154+0000 7f7af519bb80 1 --2- 172.21.15.87:0/431187617 >> [v2:172.21.15.90:6838/160586017,v1:172.21.15.90:6839/160586017] conn(0x55bc95701c90 0x55bc95704080 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:32:37.156 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:37.154+0000 7f7af519bb80 1 --2- 172.21.15.87:0/431187617 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55bc956dabd0 0x55bc956eb6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:32:37.156 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:37.154+0000 7f7af519bb80 1 --2- 172.21.15.87:0/431187617 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55bc956d72d0 0x55bc956e5970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:32:37.156 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:37.154+0000 7f7af519bb80 1 --2- 172.21.15.87:0/431187617 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55bc956d7c90 0x55bc956e5eb0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:32:37.156 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:37.154+0000 7f7af519bb80 1 -- 172.21.15.87:0/431187617 >> 172.21.15.87:0/431187617 conn(0x55bc9564f6d0 msgr2=0x55bc956d1190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:32:37.156 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:37.154+0000 7f7acd600700 0 client.25556 ms_handle_reset on v2:172.21.15.90:6838/160586017 2024-05-08T05:32:37.157 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:37.154+0000 7f7af519bb80 1 -- 172.21.15.87:0/431187617 shutdown_connections 2024-05-08T05:32:37.157 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:37.155+0000 7f7af519bb80 1 -- 172.21.15.87:0/431187617 wait complete. 2024-05-08T05:32:37.157 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:37.155+0000 7f7af519bb80 20 client.25556 trim_cache size 0 max 16384 2024-05-08T05:32:37.178 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:37.177+0000 7f7af519bb80 1 Processor -- start 2024-05-08T05:32:37.179 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:32:37 smithi087 ceph-mon[29523]: fsmap cephfs:3 {0=b=up:active,1=g=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-05-08T05:32:37.180 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:37.177+0000 7f7af519bb80 1 -- start start 2024-05-08T05:32:37.180 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:37.177+0000 7f7af519bb80 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55bc956d72d0 0x55bc956dc460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:32:37.180 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:37.177+0000 7f7af519bb80 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55bc956d7c90 0x55bc956d1910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:32:37.180 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:37.178+0000 7f7af519bb80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55bc956dabd0 0x55bc956de0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:32:37.180 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:37.178+0000 7f7af519bb80 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f7ae41ae0e0 con 0x55bc956d7c90 2024-05-08T05:32:37.180 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:37.178+0000 7f7af519bb80 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f7ae41ab8b0 con 0x55bc956d72d0 2024-05-08T05:32:37.180 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:37.178+0000 7f7af519bb80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f7ae41a9720 con 0x55bc956dabd0 2024-05-08T05:32:37.181 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:37.178+0000 7f7ae3400700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55bc956d72d0 0x55bc956dc460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:32:37.181 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:37.178+0000 7f7ae3400700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55bc956d72d0 0x55bc956dc460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.87:47342/0 (socket says 172.21.15.87:47342) 2024-05-08T05:32:37.181 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:37.178+0000 7f7ae3400700 1 -- 172.21.15.87:0/1580895115 learned_addr learned my addr 172.21.15.87:0/1580895115 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T05:32:37.181 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:37.178+0000 7f7ae2a00700 1 --2- 172.21.15.87:0/1580895115 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55bc956d7c90 0x55bc956d1910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:32:37.181 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:37.178+0000 7f7ae3e00700 1 --2- 172.21.15.87:0/1580895115 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55bc956dabd0 0x55bc956de0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:32:37.181 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:37.179+0000 7f7ae3400700 1 -- 172.21.15.87:0/1580895115 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55bc956dabd0 msgr2=0x55bc956de0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:32:37.181 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:37.179+0000 7f7ae3400700 1 --2- 172.21.15.87:0/1580895115 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55bc956dabd0 0x55bc956de0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:32:37.181 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:37.179+0000 7f7ae3400700 1 -- 172.21.15.87:0/1580895115 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55bc956d7c90 msgr2=0x55bc956d1910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:32:37.181 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:37.179+0000 7f7ae3400700 1 --2- 172.21.15.87:0/1580895115 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55bc956d7c90 0x55bc956d1910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:32:37.181 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:37.179+0000 7f7ae3400700 1 -- 172.21.15.87:0/1580895115 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bc956df370 con 0x55bc956d72d0 2024-05-08T05:32:37.181 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:37.179+0000 7f7ae2a00700 1 --2- 172.21.15.87:0/1580895115 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55bc956d7c90 0x55bc956d1910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T05:32:37.181 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:37.179+0000 7f7ae3400700 1 --2- 172.21.15.87:0/1580895115 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55bc956d72d0 0x55bc956dc460 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f7ad40a6c70 tx=0x7f7ad401a040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bf8b5fefb0645d0b server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:32:37.182 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:37.179+0000 7f7acfe00700 1 -- 172.21.15.87:0/1580895115 <== mon.2 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ad40a5190 con 0x55bc956d72d0 2024-05-08T05:32:37.182 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:37.179+0000 7f7acfe00700 1 -- 172.21.15.87:0/1580895115 <== mon.2 v2:172.21.15.90:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7ad40b21a0 con 0x55bc956d72d0 2024-05-08T05:32:37.182 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:37.179+0000 7f7acfe00700 1 -- 172.21.15.87:0/1580895115 <== mon.2 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ad40b2860 con 0x55bc956d72d0 2024-05-08T05:32:37.183 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:37.180+0000 7f7af519bb80 1 -- 172.21.15.87:0/1580895115 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55bc956d72d0 msgr2=0x55bc956dc460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:32:37.183 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:37.180+0000 7f7af519bb80 1 --2- 172.21.15.87:0/1580895115 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55bc956d72d0 0x55bc956dc460 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f7ad40a6c70 tx=0x7f7ad401a040 comp rx=0 tx=0).stop 2024-05-08T05:32:37.183 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:37.181+0000 7f7af519bb80 1 -- 172.21.15.87:0/1580895115 shutdown_connections 2024-05-08T05:32:37.183 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:37.181+0000 7f7af519bb80 1 --2- 172.21.15.87:0/1580895115 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55bc956dabd0 0x55bc956de0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:32:37.183 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:37.181+0000 7f7af519bb80 1 --2- 172.21.15.87:0/1580895115 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55bc956d72d0 0x55bc956dc460 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:32:37.183 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:37.181+0000 7f7af519bb80 1 --2- 172.21.15.87:0/1580895115 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55bc956d7c90 0x55bc956d1910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:32:37.183 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:37.181+0000 7f7af519bb80 1 -- 172.21.15.87:0/1580895115 >> 172.21.15.87:0/1580895115 conn(0x55bc9564f6d0 msgr2=0x55bc956dbd50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:32:37.183 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:37.181+0000 7f7af519bb80 1 -- 172.21.15.87:0/1580895115 shutdown_connections 2024-05-08T05:32:37.183 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:37.181+0000 7f7af519bb80 1 -- 172.21.15.87:0/1580895115 wait complete. 2024-05-08T05:32:37.183 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:37.181+0000 7f7af519bb80 1 -- start start 2024-05-08T05:32:37.184 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:37.182+0000 7f7af519bb80 1 Processor -- start 2024-05-08T05:32:37.185 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:37.182+0000 7f7af519bb80 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55bc956d72d0 0x55bc95707690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:32:37.185 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:37.182+0000 7f7af519bb80 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55bc956d7c90 0x55bc95704a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:32:37.185 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:37.182+0000 7f7af519bb80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55bc956dabd0 0x55bc95705020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:32:37.185 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:37.182+0000 7f7af519bb80 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f7ae41a9d70 con 0x55bc956d72d0 2024-05-08T05:32:37.185 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:37.182+0000 7f7af519bb80 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f7ae41ab1e0 con 0x55bc956d7c90 2024-05-08T05:32:37.185 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:37.182+0000 7f7af519bb80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f7ae41aa440 con 0x55bc956dabd0 2024-05-08T05:32:37.185 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:37.182+0000 7f7af519bb80 10 client.0 _ll_register_callbacks cb 0x55bc955d0c70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T05:32:37.185 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:37.183+0000 7f7ae3400700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55bc956d72d0 0x55bc95707690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:32:37.185 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:37.183+0000 7f7ae3400700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55bc956d72d0 0x55bc95707690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:50000/0 (socket says 172.21.15.87:50000) 2024-05-08T05:32:37.185 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:37.183+0000 7f7ae3400700 1 -- 172.21.15.87:0/986367458 learned_addr learned my addr 172.21.15.87:0/986367458 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T05:32:37.185 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:37.183+0000 7f7ae2a00700 1 --2- 172.21.15.87:0/986367458 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55bc956d7c90 0x55bc95704a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:32:37.185 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:37.183+0000 7f7ae3400700 1 -- 172.21.15.87:0/986367458 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55bc956dabd0 msgr2=0x55bc95705020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:32:37.185 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:37.183+0000 7f7ae3400700 1 --2- 172.21.15.87:0/986367458 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55bc956dabd0 0x55bc95705020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:32:37.185 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:37.183+0000 7f7ae3400700 1 -- 172.21.15.87:0/986367458 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55bc956d7c90 msgr2=0x55bc95704a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:32:37.186 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:37.183+0000 7f7ae3400700 1 --2- 172.21.15.87:0/986367458 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55bc956d7c90 0x55bc95704a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:32:37.186 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:37.183+0000 7f7ae3400700 1 -- 172.21.15.87:0/986367458 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bc95705860 con 0x55bc956d72d0 2024-05-08T05:32:37.186 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:37.183+0000 7f7ae2a00700 1 --2- 172.21.15.87:0/986367458 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55bc956d7c90 0x55bc95704a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T05:32:37.186 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:37.184+0000 7f7ae3400700 1 --2- 172.21.15.87:0/986367458 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55bc956d72d0 0x55bc95707690 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f7ad4005bf0 tx=0x7f7ad40a5240 comp rx=0 tx=0).ready entity=mon.0 client_cookie=41f52adc05ce41d9 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:32:37.186 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:37.184+0000 7f7acd600700 10 client.0 ms_handle_connect on v2:172.21.15.87:3300/0 2024-05-08T05:32:37.187 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:37.184+0000 7f7acd600700 1 -- 172.21.15.87:0/986367458 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ad40c3060 con 0x55bc956d72d0 2024-05-08T05:32:37.188 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:37.184+0000 7f7acd600700 1 -- 172.21.15.87:0/986367458 <== mon.0 v2:172.21.15.87:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8190+0+0 (secure 0 0 0) 0x7f7ad40b25e0 con 0x55bc956d72d0 2024-05-08T05:32:37.188 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:37.184+0000 7f7af519bb80 1 -- 172.21.15.87:0/986367458 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55bc95637400 con 0x55bc956d72d0 2024-05-08T05:32:37.188 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:37.184+0000 7f7acd600700 1 -- 172.21.15.87:0/986367458 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f7ad408e070 con 0x55bc956d72d0 2024-05-08T05:32:37.188 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:37.184+0000 7f7af519bb80 10 client.15447 fetch_fsmap learned FSMap version 29 2024-05-08T05:32:37.188 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:37.184+0000 7f7af519bb80 1 -- 172.21.15.87:0/986367458 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55bc9576c240 con 0x55bc956d72d0 2024-05-08T05:32:37.188 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:37.184+0000 7f7acd600700 1 -- 172.21.15.87:0/986367458 <== mon.0 v2:172.21.15.87:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x55bc95637400 con 0x55bc956d72d0 2024-05-08T05:32:37.188 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:37.185+0000 7f7acd600700 1 -- 172.21.15.87:0/986367458 <== mon.0 v2:172.21.15.87:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7f7ad40c5020 con 0x55bc956d72d0 2024-05-08T05:32:37.188 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:37.185+0000 7f7af519bb80 10 client.15447 fetch_fsmap finished waiting for FSMap version 29 2024-05-08T05:32:37.188 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:37.185+0000 7f7af519bb80 10 client.15447 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-05-08T05:32:37.188 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:37.185+0000 7f7af519bb80 20 client.15447 populate_metadata read hostname 'smithi087' 2024-05-08T05:32:37.188 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:37.185+0000 7f7af519bb80 1 --2- 172.21.15.87:0/986367458 >> [v2:172.21.15.90:6838/160586017,v1:172.21.15.90:6839/160586017] conn(0x55bc9576c840 0x55bc9576ec80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:32:37.188 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:37.185+0000 7f7af519bb80 4 client.15447 mds_command: new command op to 24500 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-05-08T05:32:37.189 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:37.185+0000 7f7af519bb80 1 -- 172.21.15.87:0/986367458 --> [v2:172.21.15.90:6838/160586017,v1:172.21.15.90:6839/160586017] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55bc956314a0 con 0x55bc9576c840 2024-05-08T05:32:37.189 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:37.185+0000 7f7ae2a00700 1 --2- 172.21.15.87:0/986367458 >> [v2:172.21.15.90:6838/160586017,v1:172.21.15.90:6839/160586017] conn(0x55bc9576c840 0x55bc9576ec80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:32:37.189 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:37.186+0000 7f7ae2a00700 1 --2- 172.21.15.87:0/986367458 >> [v2:172.21.15.90:6838/160586017,v1:172.21.15.90:6839/160586017] conn(0x55bc9576c840 0x55bc9576ec80 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ce90e19bd9576f78 server_cookie=734b2486476b20e3 in_seq=0 out_seq=0 2024-05-08T05:32:37.189 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:37.186+0000 7f7acd600700 10 client.15447 ms_handle_connect on v2:172.21.15.90:6838/160586017 2024-05-08T05:32:37.189 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:37.186+0000 7f7acd600700 1 -- 172.21.15.87:0/986367458 <== mds.0 v2:172.21.15.90:6838/160586017 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55bc956314a0 con 0x55bc9576c840 2024-05-08T05:32:37.189 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:37.186+0000 7f7acd600700 10 client.15447 handle_command_reply: tid=0 2024-05-08T05:32:37.189 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:37.187+0000 7f7af519bb80 1 client.15447 shutdown 2024-05-08T05:32:37.190 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:37.187+0000 7f7af519bb80 1 -- 172.21.15.87:0/986367458 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55bc956d72d0 msgr2=0x55bc95707690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:32:37.190 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:37.187+0000 7f7af519bb80 1 --2- 172.21.15.87:0/986367458 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55bc956d72d0 0x55bc95707690 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f7ad4005bf0 tx=0x7f7ad40a5240 comp rx=0 tx=0).stop 2024-05-08T05:32:37.190 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:37.187+0000 7f7af519bb80 1 -- 172.21.15.87:0/986367458 shutdown_connections 2024-05-08T05:32:37.190 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:37.187+0000 7f7af519bb80 1 --2- 172.21.15.87:0/986367458 >> [v2:172.21.15.90:6838/160586017,v1:172.21.15.90:6839/160586017] conn(0x55bc9576c840 0x55bc9576ec80 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:32:37.190 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:37.187+0000 7f7af519bb80 1 --2- 172.21.15.87:0/986367458 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55bc956dabd0 0x55bc95705020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:32:37.190 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:37.187+0000 7f7af519bb80 1 --2- 172.21.15.87:0/986367458 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55bc956d72d0 0x55bc95707690 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:32:37.190 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:37.187+0000 7f7af519bb80 1 --2- 172.21.15.87:0/986367458 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55bc956d7c90 0x55bc95704a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:32:37.191 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:37.187+0000 7f7acd600700 0 client.15447 ms_handle_reset on v2:172.21.15.90:6838/160586017 2024-05-08T05:32:37.191 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:37.187+0000 7f7af519bb80 1 -- 172.21.15.87:0/986367458 >> 172.21.15.87:0/986367458 conn(0x55bc9564f6d0 msgr2=0x55bc956ea600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:32:37.191 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:37.187+0000 7f7af519bb80 1 -- 172.21.15.87:0/986367458 shutdown_connections 2024-05-08T05:32:37.191 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:37.188+0000 7f7af519bb80 1 -- 172.21.15.87:0/986367458 wait complete. 2024-05-08T05:32:37.191 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:37.188+0000 7f7af519bb80 20 client.15447 trim_cache size 0 max 16384 2024-05-08T05:32:37.191 INFO:teuthology.orchestra.run.smithi087.stdout:[] 2024-05-08T05:32:37.192 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:37.189+0000 7f7aea800700 1 -- 172.21.15.87:0/2029886675 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f7ac80b2900 msgr2=0x7f7ac80b4dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:32:37.192 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:37.189+0000 7f7aea800700 1 --2- 172.21.15.87:0/2029886675 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f7ac80b2900 0x7f7ac80b4dc0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f7adc00f540 tx=0x7f7adc00b040 comp rx=0 tx=0).stop 2024-05-08T05:32:37.192 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:37.189+0000 7f7aea800700 1 -- 172.21.15.87:0/2029886675 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7ae4103750 msgr2=0x7f7ae419f760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:32:37.192 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:37.189+0000 7f7aea800700 1 --2- 172.21.15.87:0/2029886675 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7ae4103750 0x7f7ae419f760 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f7ad400e9a0 tx=0x7f7ad400ecb0 comp rx=0 tx=0).stop 2024-05-08T05:32:37.192 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:37.189+0000 7f7aea800700 1 -- 172.21.15.87:0/2029886675 shutdown_connections 2024-05-08T05:32:37.192 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:37.189+0000 7f7aea800700 1 --2- 172.21.15.87:0/2029886675 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7ae4108850 0x7f7ae4199920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:32:37.192 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:37.189+0000 7f7aea800700 1 --2- 172.21.15.87:0/2029886675 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f7ac80b2900 0x7f7ac80b4dc0 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:32:37.192 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:37.189+0000 7f7aea800700 1 --2- 172.21.15.87:0/2029886675 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7ae4103750 0x7f7ae419f760 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:32:37.192 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:37.189+0000 7f7aea800700 1 --2- 172.21.15.87:0/2029886675 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7ae4104100 0x7f7ae419fca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:32:37.192 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:37.189+0000 7f7aea800700 1 -- 172.21.15.87:0/2029886675 >> 172.21.15.87:0/2029886675 conn(0x7f7ae407a600 msgr2=0x7f7ae41017f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:32:37.192 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:37.189+0000 7f7aea800700 1 -- 172.21.15.87:0/2029886675 shutdown_connections 2024-05-08T05:32:37.192 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:37.189+0000 7f7aea800700 1 -- 172.21.15.87:0/2029886675 wait complete. 2024-05-08T05:32:37.483 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:32:37 smithi090 ceph-mon[34526]: fsmap cephfs:3 {0=b=up:active,1=g=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-05-08T05:32:37.538 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:32:37 smithi160 ceph-mon[34827]: fsmap cephfs:3 {0=b=up:active,1=g=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-05-08T05:32:38.208 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:32:38 smithi087 ceph-mon[29523]: pgmap v529: 97 pgs: 97 active+clean; 633 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.8 MiB/s wr, 114 op/s 2024-05-08T05:32:38.483 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:32:38 smithi090 ceph-mon[34526]: pgmap v529: 97 pgs: 97 active+clean; 633 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.8 MiB/s wr, 114 op/s 2024-05-08T05:32:38.538 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:32:38 smithi160 ceph-mon[34827]: pgmap v529: 97 pgs: 97 active+clean; 633 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.8 MiB/s wr, 114 op/s 2024-05-08T05:32:39.459 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-05-08T05:32:39.459 DEBUG:teuthology.orchestra.run.smithi087:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid eeeb813e-0cf9-11ef-bc97-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-05-08T05:32:39.990 INFO:teuthology.orchestra.run.smithi087.stderr:Inferring config /var/lib/ceph/eeeb813e-0cf9-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T05:32:40.426 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:32:40 smithi087 ceph-mon[29523]: pgmap v530: 97 pgs: 97 active+clean; 332 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.2 MiB/s wr, 150 op/s 2024-05-08T05:32:40.483 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:32:40 smithi090 ceph-mon[34526]: pgmap v530: 97 pgs: 97 active+clean; 332 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.2 MiB/s wr, 150 op/s 2024-05-08T05:32:40.538 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:32:40 smithi160 ceph-mon[34827]: pgmap v530: 97 pgs: 97 active+clean; 332 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.2 MiB/s wr, 150 op/s 2024-05-08T05:32:42.311 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:32:42 smithi087 ceph-mon[29523]: pgmap v531: 97 pgs: 97 active+clean; 239 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 890 KiB/s rd, 943 KiB/s wr, 123 op/s 2024-05-08T05:32:42.438 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-05-08T05:32:42.438 INFO:teuthology.orchestra.run.smithi087.stdout: "return_code": 0, 2024-05-08T05:32:42.438 INFO:teuthology.orchestra.run.smithi087.stdout: "scrub_tag": "fbb20204-faff-4f3d-9c9d-838a5da58688", 2024-05-08T05:32:42.438 INFO:teuthology.orchestra.run.smithi087.stdout: "mode": "asynchronous" 2024-05-08T05:32:42.438 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-05-08T05:32:42.439 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:42.241+0000 7f564f400700 1 -- 172.21.15.87:0/1170119572 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f56481056c0 msgr2=0x7f5648105b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:32:42.439 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:42.241+0000 7f564f400700 1 --2- 172.21.15.87:0/1170119572 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f56481056c0 0x7f5648105b40 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f5630009990 tx=0x7f5630009ca0 comp rx=0 tx=0).stop 2024-05-08T05:32:42.439 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:42.241+0000 7f564f400700 1 -- 172.21.15.87:0/1170119572 shutdown_connections 2024-05-08T05:32:42.439 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:42.241+0000 7f564f400700 1 --2- 172.21.15.87:0/1170119572 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5648106080 0x7f5648112590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:32:42.439 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:42.241+0000 7f564f400700 1 --2- 172.21.15.87:0/1170119572 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f564810b6c0 0x7f564810baa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:32:42.440 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:42.241+0000 7f564f400700 1 --2- 172.21.15.87:0/1170119572 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f56481056c0 0x7f5648105b40 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:32:42.440 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:42.241+0000 7f564f400700 1 -- 172.21.15.87:0/1170119572 >> 172.21.15.87:0/1170119572 conn(0x7f56481011b0 msgr2=0x7f56481035d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:32:42.440 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:42.241+0000 7f564f400700 1 -- 172.21.15.87:0/1170119572 shutdown_connections 2024-05-08T05:32:42.440 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:42.241+0000 7f564f400700 1 -- 172.21.15.87:0/1170119572 wait complete. 2024-05-08T05:32:42.440 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:42.243+0000 7f564f400700 1 Processor -- start 2024-05-08T05:32:42.440 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:42.243+0000 7f564f400700 1 -- start start 2024-05-08T05:32:42.440 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:42.243+0000 7f564f400700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f56481056c0 0x7f564819bda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:32:42.440 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:42.243+0000 7f564f400700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5648106080 0x7f564819c2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:32:42.440 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:42.243+0000 7f564f400700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f564810b6c0 0x7f56481a0670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:32:42.440 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:42.244+0000 7f564f400700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f5648115950 con 0x7f564810b6c0 2024-05-08T05:32:42.440 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:42.244+0000 7f564f400700 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f56481157d0 con 0x7f5648106080 2024-05-08T05:32:42.440 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:42.244+0000 7f564f400700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f5648115ad0 con 0x7f56481056c0 2024-05-08T05:32:42.441 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:42.244+0000 7f564ca00700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f56481056c0 0x7f564819bda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:32:42.441 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:42.244+0000 7f564ca00700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f56481056c0 0x7f564819bda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.87:54000/0 (socket says 172.21.15.87:54000) 2024-05-08T05:32:42.441 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:42.244+0000 7f564ca00700 1 -- 172.21.15.87:0/3547044184 learned_addr learned my addr 172.21.15.87:0/3547044184 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T05:32:42.441 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:42.244+0000 7f563fe00700 1 --2- 172.21.15.87:0/3547044184 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5648106080 0x7f564819c2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:32:42.441 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:42.245+0000 7f564ca00700 1 -- 172.21.15.87:0/3547044184 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5648106080 msgr2=0x7f564819c2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:32:42.441 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:42.245+0000 7f564ca00700 1 --2- 172.21.15.87:0/3547044184 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5648106080 0x7f564819c2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:32:42.441 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:42.245+0000 7f564ca00700 1 -- 172.21.15.87:0/3547044184 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f564810b6c0 msgr2=0x7f56481a0670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:32:42.441 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:42.245+0000 7f564ca00700 1 --2- 172.21.15.87:0/3547044184 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f564810b6c0 0x7f56481a0670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:32:42.441 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:42.245+0000 7f564ca00700 1 -- 172.21.15.87:0/3547044184 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f56481a0db0 con 0x7f56481056c0 2024-05-08T05:32:42.441 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:42.245+0000 7f564ca00700 1 --2- 172.21.15.87:0/3547044184 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f56481056c0 0x7f564819bda0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f563800e9c0 tx=0x7f563800ecd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:32:42.441 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:42.245+0000 7f5646000700 1 -- 172.21.15.87:0/3547044184 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f563800cb50 con 0x7f56481056c0 2024-05-08T05:32:42.441 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:42.245+0000 7f5646000700 1 -- 172.21.15.87:0/3547044184 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5638004ce0 con 0x7f56481056c0 2024-05-08T05:32:42.441 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:42.245+0000 7f5646000700 1 -- 172.21.15.87:0/3547044184 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56380055e0 con 0x7f56481056c0 2024-05-08T05:32:42.442 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:42.245+0000 7f564f400700 1 -- 172.21.15.87:0/3547044184 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f56481a10a0 con 0x7f56481056c0 2024-05-08T05:32:42.442 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:42.246+0000 7f564f400700 1 -- 172.21.15.87:0/3547044184 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f56481a8920 con 0x7f56481056c0 2024-05-08T05:32:42.442 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:42.251+0000 7f5646000700 1 -- 172.21.15.87:0/3547044184 <== mon.1 v2:172.21.15.160:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7f563800ccf0 con 0x7f56481056c0 2024-05-08T05:32:42.442 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:42.252+0000 7f5659c92b80 1 Processor -- start 2024-05-08T05:32:42.442 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:42.253+0000 7f5659c92b80 1 -- start start 2024-05-08T05:32:42.442 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:42.253+0000 7f5659c92b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55a701d3f450 0x55a701d3f830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:32:42.442 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:42.253+0000 7f5659c92b80 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55a701d3fd70 0x55a701d39b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:32:42.442 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:42.253+0000 7f5659c92b80 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a701d3a180 0x55a701d3a600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:32:42.442 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:42.253+0000 7f5659c92b80 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x55a701c83aa0 con 0x55a701d3a180 2024-05-08T05:32:42.442 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:42.253+0000 7f5659c92b80 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x55a701c217e0 con 0x55a701d3fd70 2024-05-08T05:32:42.442 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:42.253+0000 7f5659c92b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x55a701c7fa60 con 0x55a701d3f450 2024-05-08T05:32:42.442 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:42.254+0000 7f564ca00700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55a701d3fd70 0x55a701d39b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:32:42.442 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:42.254+0000 7f5646000700 1 --2- 172.21.15.87:0/3547044184 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f562c0b2900 0x7f562c0b4dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:32:42.443 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:42.254+0000 7f564ca00700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55a701d3fd70 0x55a701d39b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.87:47380/0 (socket says 172.21.15.87:47380) 2024-05-08T05:32:42.443 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:42.254+0000 7f564ca00700 1 -- 172.21.15.87:0/1345351166 learned_addr learned my addr 172.21.15.87:0/1345351166 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T05:32:42.443 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:42.254+0000 7f563fe00700 1 --2- 172.21.15.87:0/1345351166 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a701d3a180 0x55a701d3a600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:32:42.443 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:42.254+0000 7f564d400700 1 --2- 172.21.15.87:0/1345351166 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55a701d3f450 0x55a701d3f830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:32:42.443 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:42.254+0000 7f5646000700 1 -- 172.21.15.87:0/3547044184 <== mon.1 v2:172.21.15.160:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8190+0+0 (secure 0 0 0) 0x7f56380e2360 con 0x7f56481056c0 2024-05-08T05:32:42.443 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:42.255+0000 7f563fe00700 1 -- 172.21.15.87:0/1345351166 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55a701d3f450 msgr2=0x55a701d3f830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:32:42.443 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:42.255+0000 7f563fe00700 1 --2- 172.21.15.87:0/1345351166 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55a701d3f450 0x55a701d3f830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:32:42.443 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:42.255+0000 7f563fe00700 1 -- 172.21.15.87:0/1345351166 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55a701d3fd70 msgr2=0x55a701d39b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:32:42.443 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:42.255+0000 7f563fe00700 1 --2- 172.21.15.87:0/1345351166 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55a701d3fd70 0x55a701d39b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:32:42.443 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:42.255+0000 7f563fe00700 1 -- 172.21.15.87:0/1345351166 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a701bd0950 con 0x55a701d3a180 2024-05-08T05:32:42.443 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:42.255+0000 7f564ca00700 1 --2- 172.21.15.87:0/1345351166 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55a701d3fd70 0x55a701d39b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T05:32:42.443 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:42.255+0000 7f563fe00700 1 --2- 172.21.15.87:0/1345351166 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a701d3a180 0x55a701d3a600 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f563000b2e0 tx=0x7f56300096a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d44317f2b0a9af76 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:32:42.443 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:42.255+0000 7f563e000700 1 -- 172.21.15.87:0/1345351166 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5630027070 con 0x55a701d3a180 2024-05-08T05:32:42.444 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:42.255+0000 7f563e000700 1 -- 172.21.15.87:0/1345351166 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f56300056a0 con 0x55a701d3a180 2024-05-08T05:32:42.444 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:42.256+0000 7f564d400700 1 --2- 172.21.15.87:0/3547044184 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f562c0b2900 0x7f562c0b4dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:32:42.444 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:42.256+0000 7f563e000700 1 -- 172.21.15.87:0/1345351166 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5630003a00 con 0x55a701d3a180 2024-05-08T05:32:42.444 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:42.257+0000 7f5659c92b80 1 -- 172.21.15.87:0/1345351166 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a701d3a180 msgr2=0x55a701d3a600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:32:42.444 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:42.257+0000 7f5659c92b80 1 --2- 172.21.15.87:0/1345351166 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a701d3a180 0x55a701d3a600 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f563000b2e0 tx=0x7f56300096a0 comp rx=0 tx=0).stop 2024-05-08T05:32:42.444 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:42.257+0000 7f564d400700 1 --2- 172.21.15.87:0/3547044184 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f562c0b2900 0x7f562c0b4dc0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f5640009fd0 tx=0x7f5640004ad0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:32:42.444 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:42.257+0000 7f5659c92b80 1 -- 172.21.15.87:0/1345351166 shutdown_connections 2024-05-08T05:32:42.444 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:42.257+0000 7f5659c92b80 1 --2- 172.21.15.87:0/1345351166 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a701d3a180 0x55a701d3a600 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:32:42.444 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:42.257+0000 7f5659c92b80 1 --2- 172.21.15.87:0/1345351166 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55a701d3f450 0x55a701d3f830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:32:42.444 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:42.257+0000 7f5659c92b80 1 --2- 172.21.15.87:0/1345351166 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55a701d3fd70 0x55a701d39b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:32:42.444 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:42.257+0000 7f5659c92b80 1 -- 172.21.15.87:0/1345351166 >> 172.21.15.87:0/1345351166 conn(0x55a701ca9750 msgr2=0x55a701d2bb80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:32:42.444 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:42.257+0000 7f5659c92b80 1 -- 172.21.15.87:0/1345351166 shutdown_connections 2024-05-08T05:32:42.444 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:42.257+0000 7f5659c92b80 1 -- 172.21.15.87:0/1345351166 wait complete. 2024-05-08T05:32:42.444 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:42.258+0000 7f5659c92b80 1 -- start start 2024-05-08T05:32:42.445 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:42.258+0000 7f5659c92b80 1 Processor -- start 2024-05-08T05:32:42.445 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:42.259+0000 7f5659c92b80 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a701d3a180 0x55a701d45a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:32:42.445 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:42.259+0000 7f5659c92b80 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55a701d3f450 0x55a701d42e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:32:42.445 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:42.259+0000 7f5659c92b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55a701d3fd70 0x55a701d43370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:32:42.445 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:42.259+0000 7f5659c92b80 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x55a701d467a0 con 0x55a701d3a180 2024-05-08T05:32:42.445 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:42.259+0000 7f5659c92b80 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x55a701be9ba0 con 0x55a701d3f450 2024-05-08T05:32:42.445 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:42.259+0000 7f5659c92b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x55a701d46920 con 0x55a701d3fd70 2024-05-08T05:32:42.445 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:42.259+0000 7f5659c92b80 10 client.0 _ll_register_callbacks cb 0x55a701c2acf0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T05:32:42.445 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:42.259+0000 7f564ca00700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a701d3a180 0x55a701d45a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:32:42.445 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:42.259+0000 7f564ca00700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a701d3a180 0x55a701d45a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:50048/0 (socket says 172.21.15.87:50048) 2024-05-08T05:32:42.445 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:42.259+0000 7f564ca00700 1 -- 172.21.15.87:0/4164475646 learned_addr learned my addr 172.21.15.87:0/4164475646 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T05:32:42.445 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:42.259+0000 7f563fe00700 1 --2- 172.21.15.87:0/4164475646 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55a701d3f450 0x55a701d42e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:32:42.445 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:42.259+0000 7f564d400700 1 --2- 172.21.15.87:0/4164475646 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55a701d3fd70 0x55a701d43370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:32:42.446 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:42.260+0000 7f563fe00700 1 -- 172.21.15.87:0/4164475646 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55a701d3fd70 msgr2=0x55a701d43370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:32:42.446 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:42.260+0000 7f563fe00700 1 --2- 172.21.15.87:0/4164475646 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55a701d3fd70 0x55a701d43370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:32:42.446 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:42.260+0000 7f563fe00700 1 -- 172.21.15.87:0/4164475646 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a701d3a180 msgr2=0x55a701d45a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:32:42.446 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:42.260+0000 7f563fe00700 1 --2- 172.21.15.87:0/4164475646 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a701d3a180 0x55a701d45a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:32:42.446 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:42.260+0000 7f563fe00700 1 -- 172.21.15.87:0/4164475646 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a701c494a0 con 0x55a701d3f450 2024-05-08T05:32:42.446 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:42.260+0000 7f564ca00700 1 --2- 172.21.15.87:0/4164475646 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a701d3a180 0x55a701d45a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T05:32:42.446 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:42.260+0000 7f563fe00700 1 --2- 172.21.15.87:0/4164475646 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55a701d3f450 0x55a701d42e30 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f56300098e0 tx=0x7f563000bb20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d51df4eaef007806 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:32:42.446 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:42.260+0000 7f5636a00700 10 client.0 ms_handle_connect on v2:172.21.15.90:3300/0 2024-05-08T05:32:42.446 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:42.260+0000 7f5636a00700 1 -- 172.21.15.87:0/4164475646 <== mon.2 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5630027040 con 0x55a701d3f450 2024-05-08T05:32:42.446 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:42.260+0000 7f5636a00700 1 -- 172.21.15.87:0/4164475646 <== mon.2 v2:172.21.15.90:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8190+0+0 (secure 0 0 0) 0x7f56300054a0 con 0x55a701d3f450 2024-05-08T05:32:42.446 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:42.260+0000 7f5659c92b80 1 -- 172.21.15.87:0/4164475646 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f56300056a0 con 0x55a701d3f450 2024-05-08T05:32:42.446 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:42.261+0000 7f5636a00700 1 -- 172.21.15.87:0/4164475646 <== mon.2 v2:172.21.15.90:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f5630003680 con 0x55a701d3f450 2024-05-08T05:32:42.446 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:42.261+0000 7f5659c92b80 10 client.25574 fetch_fsmap learned FSMap version 29 2024-05-08T05:32:42.446 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:42.261+0000 7f5659c92b80 1 -- 172.21.15.87:0/4164475646 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55a701d51000 con 0x55a701d3f450 2024-05-08T05:32:42.447 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:42.261+0000 7f5636a00700 1 -- 172.21.15.87:0/4164475646 <== mon.2 v2:172.21.15.90:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f56300056a0 con 0x55a701d3f450 2024-05-08T05:32:42.447 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:42.261+0000 7f5636a00700 1 -- 172.21.15.87:0/4164475646 <== mon.2 v2:172.21.15.90:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7f5630021070 con 0x55a701d3f450 2024-05-08T05:32:42.447 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:42.261+0000 7f5659c92b80 10 client.25574 fetch_fsmap finished waiting for FSMap version 29 2024-05-08T05:32:42.447 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:42.261+0000 7f5659c92b80 10 client.25574 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-05-08T05:32:42.447 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:42.261+0000 7f5659c92b80 20 client.25574 populate_metadata read hostname 'smithi087' 2024-05-08T05:32:42.447 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:42.261+0000 7f5659c92b80 1 --2- 172.21.15.87:0/4164475646 >> [v2:172.21.15.90:6838/160586017,v1:172.21.15.90:6839/160586017] conn(0x55a701d534d0 0x55a701d558c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:32:42.447 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:42.261+0000 7f5659c92b80 4 client.25574 mds_command: new command op to 24500 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-08T05:32:42.447 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:42.261+0000 7f5659c92b80 1 -- 172.21.15.87:0/4164475646 --> [v2:172.21.15.90:6838/160586017,v1:172.21.15.90:6839/160586017] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a701cfe1c0 con 0x55a701d534d0 2024-05-08T05:32:42.447 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:42.262+0000 7f564ca00700 1 --2- 172.21.15.87:0/4164475646 >> [v2:172.21.15.90:6838/160586017,v1:172.21.15.90:6839/160586017] conn(0x55a701d534d0 0x55a701d558c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:32:42.447 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:42.262+0000 7f564ca00700 1 --2- 172.21.15.87:0/4164475646 >> [v2:172.21.15.90:6838/160586017,v1:172.21.15.90:6839/160586017] conn(0x55a701d534d0 0x55a701d558c0 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=18be5b748fd36835 server_cookie=22ec300874dae314 in_seq=0 out_seq=0 2024-05-08T05:32:42.447 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:42.262+0000 7f5636a00700 10 client.25574 ms_handle_connect on v2:172.21.15.90:6838/160586017 2024-05-08T05:32:42.447 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:42.263+0000 7f5636a00700 1 -- 172.21.15.87:0/4164475646 <== mds.0 v2:172.21.15.90:6838/160586017 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55a701cfe1c0 con 0x55a701d534d0 2024-05-08T05:32:42.447 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:42.263+0000 7f5636a00700 10 client.25574 handle_command_reply: tid=0 2024-05-08T05:32:42.447 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:42.263+0000 7f5659c92b80 1 client.25574 shutdown 2024-05-08T05:32:42.447 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:42.263+0000 7f5659c92b80 1 -- 172.21.15.87:0/4164475646 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55a701d3f450 msgr2=0x55a701d42e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:32:42.448 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:42.263+0000 7f5659c92b80 1 --2- 172.21.15.87:0/4164475646 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55a701d3f450 0x55a701d42e30 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f56300098e0 tx=0x7f563000bb20 comp rx=0 tx=0).stop 2024-05-08T05:32:42.448 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:42.263+0000 7f5659c92b80 1 -- 172.21.15.87:0/4164475646 shutdown_connections 2024-05-08T05:32:42.448 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:42.263+0000 7f5659c92b80 1 --2- 172.21.15.87:0/4164475646 >> [v2:172.21.15.90:6838/160586017,v1:172.21.15.90:6839/160586017] conn(0x55a701d534d0 0x55a701d558c0 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:32:42.448 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:42.263+0000 7f5659c92b80 1 --2- 172.21.15.87:0/4164475646 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55a701d3fd70 0x55a701d43370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:32:42.448 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:42.263+0000 7f5659c92b80 1 --2- 172.21.15.87:0/4164475646 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a701d3a180 0x55a701d45a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:32:42.448 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:42.263+0000 7f5659c92b80 1 --2- 172.21.15.87:0/4164475646 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55a701d3f450 0x55a701d42e30 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:32:42.448 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:42.263+0000 7f5659c92b80 1 -- 172.21.15.87:0/4164475646 >> 172.21.15.87:0/4164475646 conn(0x55a701ca9750 msgr2=0x55a701d2b210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:32:42.448 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:42.263+0000 7f5636a00700 0 client.25574 ms_handle_reset on v2:172.21.15.90:6838/160586017 2024-05-08T05:32:42.448 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:42.264+0000 7f5659c92b80 1 -- 172.21.15.87:0/4164475646 shutdown_connections 2024-05-08T05:32:42.448 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:42.264+0000 7f5659c92b80 1 -- 172.21.15.87:0/4164475646 wait complete. 2024-05-08T05:32:42.448 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:42.264+0000 7f5659c92b80 20 client.25574 trim_cache size 0 max 16384 2024-05-08T05:32:42.448 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:42.305+0000 7f5659c92b80 1 Processor -- start 2024-05-08T05:32:42.448 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:42.305+0000 7f5659c92b80 1 -- start start 2024-05-08T05:32:42.449 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:42.305+0000 7f5659c92b80 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55a701d3a180 0x55a701d39b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:32:42.449 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:42.305+0000 7f5659c92b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55a701d3f450 0x55a701d41fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:32:42.449 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:42.305+0000 7f5659c92b80 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a701d3fd70 0x55a701d2b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:32:42.449 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:42.305+0000 7f5659c92b80 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f56481ae190 con 0x55a701d3fd70 2024-05-08T05:32:42.449 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:42.305+0000 7f5659c92b80 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f56481ab960 con 0x55a701d3a180 2024-05-08T05:32:42.449 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:42.305+0000 7f5659c92b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f564807b7c0 con 0x55a701d3f450 2024-05-08T05:32:42.449 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:42.306+0000 7f563fe00700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55a701d3f450 0x55a701d41fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:32:42.449 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:42.306+0000 7f564ca00700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55a701d3a180 0x55a701d39b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:32:42.449 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:42.306+0000 7f563fe00700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55a701d3f450 0x55a701d41fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.87:54036/0 (socket says 172.21.15.87:54036) 2024-05-08T05:32:42.449 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:42.306+0000 7f563fe00700 1 -- 172.21.15.87:0/1991878891 learned_addr learned my addr 172.21.15.87:0/1991878891 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T05:32:42.449 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:42.306+0000 7f564d400700 1 --2- 172.21.15.87:0/1991878891 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a701d3fd70 0x55a701d2b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:32:42.449 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:42.306+0000 7f564ca00700 1 -- 172.21.15.87:0/1991878891 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55a701d3f450 msgr2=0x55a701d41fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:32:42.449 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:42.306+0000 7f564ca00700 1 --2- 172.21.15.87:0/1991878891 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55a701d3f450 0x55a701d41fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:32:42.449 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:42.306+0000 7f564ca00700 1 -- 172.21.15.87:0/1991878891 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a701d3fd70 msgr2=0x55a701d2b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:32:42.450 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:42.306+0000 7f564ca00700 1 --2- 172.21.15.87:0/1991878891 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a701d3fd70 0x55a701d2b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:32:42.450 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:42.306+0000 7f564ca00700 1 -- 172.21.15.87:0/1991878891 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a701d42c00 con 0x55a701d3a180 2024-05-08T05:32:42.450 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:42.307+0000 7f564ca00700 1 --2- 172.21.15.87:0/1991878891 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55a701d3a180 0x55a701d39b60 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f5638009fd0 tx=0x7f5638091040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=24c20c9fec8ded9b server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:32:42.450 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:42.307+0000 7f563d600700 1 -- 172.21.15.87:0/1991878891 <== mon.2 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56380a9950 con 0x55a701d3a180 2024-05-08T05:32:42.450 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:42.307+0000 7f563d600700 1 -- 172.21.15.87:0/1991878891 <== mon.2 v2:172.21.15.90:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f56380b20f0 con 0x55a701d3a180 2024-05-08T05:32:42.450 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:42.307+0000 7f563d600700 1 -- 172.21.15.87:0/1991878891 <== mon.2 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56380a50d0 con 0x55a701d3a180 2024-05-08T05:32:42.450 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:42.308+0000 7f5659c92b80 1 -- 172.21.15.87:0/1991878891 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55a701d3a180 msgr2=0x55a701d39b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:32:42.450 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:42.308+0000 7f5659c92b80 1 --2- 172.21.15.87:0/1991878891 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55a701d3a180 0x55a701d39b60 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f5638009fd0 tx=0x7f5638091040 comp rx=0 tx=0).stop 2024-05-08T05:32:42.450 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:42.308+0000 7f5659c92b80 1 -- 172.21.15.87:0/1991878891 shutdown_connections 2024-05-08T05:32:42.450 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:42.308+0000 7f5659c92b80 1 --2- 172.21.15.87:0/1991878891 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a701d3fd70 0x55a701d2b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:32:42.450 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:42.308+0000 7f5659c92b80 1 --2- 172.21.15.87:0/1991878891 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55a701d3a180 0x55a701d39b60 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:32:42.450 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:42.308+0000 7f5659c92b80 1 --2- 172.21.15.87:0/1991878891 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55a701d3f450 0x55a701d41fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:32:42.450 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:42.308+0000 7f5659c92b80 1 -- 172.21.15.87:0/1991878891 >> 172.21.15.87:0/1991878891 conn(0x55a701ca9750 msgr2=0x55a701d3df20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:32:42.451 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:42.308+0000 7f5659c92b80 1 -- 172.21.15.87:0/1991878891 shutdown_connections 2024-05-08T05:32:42.451 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:42.308+0000 7f5659c92b80 1 -- 172.21.15.87:0/1991878891 wait complete. 2024-05-08T05:32:42.451 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:42.309+0000 7f5659c92b80 1 -- start start 2024-05-08T05:32:42.451 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:42.309+0000 7f5659c92b80 1 Processor -- start 2024-05-08T05:32:42.451 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:42.310+0000 7f5659c92b80 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55a701d3a180 0x55a701d58ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:32:42.451 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:42.310+0000 7f5659c92b80 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a701d3f450 0x55a701d56e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:32:42.451 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:42.310+0000 7f5659c92b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55a701d3fd70 0x55a701d573e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:32:42.451 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:42.310+0000 7f5659c92b80 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f56481a9e20 con 0x55a701d3f450 2024-05-08T05:32:42.451 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:42.310+0000 7f5659c92b80 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f56481ab290 con 0x55a701d3a180 2024-05-08T05:32:42.451 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:42.310+0000 7f5659c92b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f56481aa4f0 con 0x55a701d3fd70 2024-05-08T05:32:42.451 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:42.310+0000 7f5659c92b80 10 client.0 _ll_register_callbacks cb 0x55a701c2acf0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T05:32:42.451 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:42.310+0000 7f563fe00700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a701d3f450 0x55a701d56e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:32:42.451 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:42.310+0000 7f563fe00700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a701d3f450 0x55a701d56e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:50078/0 (socket says 172.21.15.87:50078) 2024-05-08T05:32:42.451 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:42.310+0000 7f563fe00700 1 -- 172.21.15.87:0/1923891801 learned_addr learned my addr 172.21.15.87:0/1923891801 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T05:32:42.451 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:42.310+0000 7f564ca00700 1 --2- 172.21.15.87:0/1923891801 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55a701d3a180 0x55a701d58ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:32:42.452 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:42.310+0000 7f564d400700 1 --2- 172.21.15.87:0/1923891801 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55a701d3fd70 0x55a701d573e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:32:42.452 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:42.311+0000 7f563fe00700 1 -- 172.21.15.87:0/1923891801 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55a701d3fd70 msgr2=0x55a701d573e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:32:42.452 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:42.311+0000 7f563fe00700 1 --2- 172.21.15.87:0/1923891801 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55a701d3fd70 0x55a701d573e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:32:42.452 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:42.311+0000 7f563fe00700 1 -- 172.21.15.87:0/1923891801 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55a701d3a180 msgr2=0x55a701d58ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:32:42.452 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:42.311+0000 7f563fe00700 1 --2- 172.21.15.87:0/1923891801 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55a701d3a180 0x55a701d58ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:32:42.452 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:42.311+0000 7f563fe00700 1 -- 172.21.15.87:0/1923891801 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a701d57c20 con 0x55a701d3f450 2024-05-08T05:32:42.452 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:42.311+0000 7f563fe00700 1 --2- 172.21.15.87:0/1923891801 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a701d3f450 0x55a701d56e80 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f56300098e0 tx=0x7f5630005bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8cb2eee93bfca637 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:32:42.452 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:42.311+0000 7f5636a00700 10 client.0 ms_handle_connect on v2:172.21.15.87:3300/0 2024-05-08T05:32:42.452 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:42.312+0000 7f5636a00700 1 -- 172.21.15.87:0/1923891801 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5630027070 con 0x55a701d3f450 2024-05-08T05:32:42.452 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:42.312+0000 7f5659c92b80 1 -- 172.21.15.87:0/1923891801 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55a701c91480 con 0x55a701d3f450 2024-05-08T05:32:42.452 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:42.312+0000 7f5636a00700 1 -- 172.21.15.87:0/1923891801 <== mon.0 v2:172.21.15.87:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8190+0+0 (secure 0 0 0) 0x7f5630030040 con 0x55a701d3f450 2024-05-08T05:32:42.452 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:42.312+0000 7f5636a00700 1 -- 172.21.15.87:0/1923891801 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f5630027070 con 0x55a701d3f450 2024-05-08T05:32:42.452 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:42.313+0000 7f5659c92b80 10 client.15462 fetch_fsmap learned FSMap version 29 2024-05-08T05:32:42.453 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:42.313+0000 7f5659c92b80 1 -- 172.21.15.87:0/1923891801 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55a701dbead0 con 0x55a701d3f450 2024-05-08T05:32:42.453 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:42.313+0000 7f5636a00700 1 -- 172.21.15.87:0/1923891801 <== mon.0 v2:172.21.15.87:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x55a701c91480 con 0x55a701d3f450 2024-05-08T05:32:42.453 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:42.313+0000 7f5636a00700 1 -- 172.21.15.87:0/1923891801 <== mon.0 v2:172.21.15.87:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7f563003d020 con 0x55a701d3f450 2024-05-08T05:32:42.453 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:42.313+0000 7f5659c92b80 10 client.15462 fetch_fsmap finished waiting for FSMap version 29 2024-05-08T05:32:42.453 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:42.313+0000 7f5659c92b80 10 client.15462 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-05-08T05:32:42.453 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:42.313+0000 7f5659c92b80 20 client.15462 populate_metadata read hostname 'smithi087' 2024-05-08T05:32:42.453 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:42.313+0000 7f5659c92b80 1 --2- 172.21.15.87:0/1923891801 >> [v2:172.21.15.90:6838/160586017,v1:172.21.15.90:6839/160586017] conn(0x55a701dbeed0 0x55a701dc12f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:32:42.453 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:42.313+0000 7f5659c92b80 4 client.15462 mds_command: new command op to 24500 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-05-08T05:32:42.453 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:42.313+0000 7f5659c92b80 1 -- 172.21.15.87:0/1923891801 --> [v2:172.21.15.90:6838/160586017,v1:172.21.15.90:6839/160586017] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x55a701c8b520 con 0x55a701dbeed0 2024-05-08T05:32:42.453 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:42.314+0000 7f564ca00700 1 --2- 172.21.15.87:0/1923891801 >> [v2:172.21.15.90:6838/160586017,v1:172.21.15.90:6839/160586017] conn(0x55a701dbeed0 0x55a701dc12f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:32:42.453 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:42.314+0000 7f5636a00700 10 client.15462 ms_handle_connect on v2:172.21.15.90:6838/160586017 2024-05-08T05:32:42.453 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:42.314+0000 7f564ca00700 1 --2- 172.21.15.87:0/1923891801 >> [v2:172.21.15.90:6838/160586017,v1:172.21.15.90:6839/160586017] conn(0x55a701dbeed0 0x55a701dc12f0 crc :-1 s=READY pgs=62 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1829f512f489eaee server_cookie=cba8dae3c6d511a7 in_seq=0 out_seq=0 2024-05-08T05:32:42.453 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:42.315+0000 7f5636a00700 1 -- 172.21.15.87:0/1923891801 <== mds.0 v2:172.21.15.90:6838/160586017 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55a701c8b520 con 0x55a701dbeed0 2024-05-08T05:32:42.453 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:42.315+0000 7f5636a00700 10 client.15462 handle_command_reply: tid=0 2024-05-08T05:32:42.453 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:42.315+0000 7f5659c92b80 1 client.15462 shutdown 2024-05-08T05:32:42.453 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:42.316+0000 7f5659c92b80 1 -- 172.21.15.87:0/1923891801 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a701d3f450 msgr2=0x55a701d56e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:32:42.453 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:42.316+0000 7f5659c92b80 1 --2- 172.21.15.87:0/1923891801 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a701d3f450 0x55a701d56e80 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f56300098e0 tx=0x7f5630005bc0 comp rx=0 tx=0).stop 2024-05-08T05:32:42.454 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:42.316+0000 7f5659c92b80 1 -- 172.21.15.87:0/1923891801 shutdown_connections 2024-05-08T05:32:42.454 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:42.316+0000 7f5659c92b80 1 --2- 172.21.15.87:0/1923891801 >> [v2:172.21.15.90:6838/160586017,v1:172.21.15.90:6839/160586017] conn(0x55a701dbeed0 0x55a701dc12f0 crc :-1 s=READY pgs=62 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:32:42.454 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:42.316+0000 7f5659c92b80 1 --2- 172.21.15.87:0/1923891801 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55a701d3fd70 0x55a701d573e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:32:42.454 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:42.316+0000 7f5636a00700 0 client.15462 ms_handle_reset on v2:172.21.15.90:6838/160586017 2024-05-08T05:32:42.454 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:42.316+0000 7f5659c92b80 1 --2- 172.21.15.87:0/1923891801 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55a701d3a180 0x55a701d58ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:32:42.454 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:42.316+0000 7f5659c92b80 1 --2- 172.21.15.87:0/1923891801 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a701d3f450 0x55a701d56e80 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:32:42.454 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:42.316+0000 7f5659c92b80 1 -- 172.21.15.87:0/1923891801 >> 172.21.15.87:0/1923891801 conn(0x55a701ca9750 msgr2=0x55a701d44c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:32:42.454 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:42.316+0000 7f5659c92b80 1 -- 172.21.15.87:0/1923891801 shutdown_connections 2024-05-08T05:32:42.454 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:42.316+0000 7f5659c92b80 1 -- 172.21.15.87:0/1923891801 wait complete. 2024-05-08T05:32:42.454 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:42.316+0000 7f5659c92b80 20 client.15462 trim_cache size 0 max 16384 2024-05-08T05:32:42.454 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:42.317+0000 7f564f400700 1 -- 172.21.15.87:0/3547044184 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f562c0b2900 msgr2=0x7f562c0b4dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:32:42.454 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:42.317+0000 7f564f400700 1 --2- 172.21.15.87:0/3547044184 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f562c0b2900 0x7f562c0b4dc0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f5640009fd0 tx=0x7f5640004ad0 comp rx=0 tx=0).stop 2024-05-08T05:32:42.455 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:42.317+0000 7f564f400700 1 -- 172.21.15.87:0/3547044184 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f56481056c0 msgr2=0x7f564819bda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:32:42.455 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:42.317+0000 7f564f400700 1 --2- 172.21.15.87:0/3547044184 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f56481056c0 0x7f564819bda0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f563800e9c0 tx=0x7f563800ecd0 comp rx=0 tx=0).stop 2024-05-08T05:32:42.455 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:42.318+0000 7f564f400700 1 -- 172.21.15.87:0/3547044184 shutdown_connections 2024-05-08T05:32:42.455 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:42.318+0000 7f564f400700 1 --2- 172.21.15.87:0/3547044184 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f564810b6c0 0x7f56481a0670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:32:42.455 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:42.318+0000 7f564f400700 1 --2- 172.21.15.87:0/3547044184 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f562c0b2900 0x7f562c0b4dc0 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:32:42.455 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:42.318+0000 7f564f400700 1 --2- 172.21.15.87:0/3547044184 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f56481056c0 0x7f564819bda0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:32:42.455 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:42.318+0000 7f564f400700 1 --2- 172.21.15.87:0/3547044184 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5648106080 0x7f564819c2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:32:42.455 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:42.318+0000 7f564f400700 1 -- 172.21.15.87:0/3547044184 >> 172.21.15.87:0/3547044184 conn(0x7f56481011b0 msgr2=0x7f5648101990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:32:42.455 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:42.318+0000 7f564f400700 1 -- 172.21.15.87:0/3547044184 shutdown_connections 2024-05-08T05:32:42.455 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:42.318+0000 7f564f400700 1 -- 172.21.15.87:0/3547044184 wait complete. 2024-05-08T05:32:42.483 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:32:42 smithi090 ceph-mon[34526]: pgmap v531: 97 pgs: 97 active+clean; 239 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 890 KiB/s rd, 943 KiB/s wr, 123 op/s 2024-05-08T05:32:42.538 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:32:42 smithi160 ceph-mon[34827]: pgmap v531: 97 pgs: 97 active+clean; 239 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 890 KiB/s rd, 943 KiB/s wr, 123 op/s 2024-05-08T05:32:43.458 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:32:43 smithi087 ceph-mon[29523]: scrub queued for path: / 2024-05-08T05:32:43.458 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:32:43 smithi087 ceph-mon[29523]: scrub summary: idle+waiting paths [/] 2024-05-08T05:32:43.458 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:32:43 smithi087 ceph-mon[29523]: scrub summary: active paths [/] 2024-05-08T05:32:43.458 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:32:43 smithi087 ceph-mon[29523]: scrub summary: active paths [/] 2024-05-08T05:32:43.458 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:32:43 smithi087 ceph-mon[29523]: scrub summary: idle+waiting paths [/] 2024-05-08T05:32:43.458 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:32:43 smithi087 ceph-mon[29523]: scrub summary: active paths [/] 2024-05-08T05:32:43.483 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:32:43 smithi090 ceph-mon[34526]: scrub queued for path: / 2024-05-08T05:32:43.483 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:32:43 smithi090 ceph-mon[34526]: scrub summary: idle+waiting paths [/] 2024-05-08T05:32:43.483 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:32:43 smithi090 ceph-mon[34526]: scrub summary: active paths [/] 2024-05-08T05:32:43.483 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:32:43 smithi090 ceph-mon[34526]: scrub summary: active paths [/] 2024-05-08T05:32:43.483 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:32:43 smithi090 ceph-mon[34526]: scrub summary: idle+waiting paths [/] 2024-05-08T05:32:43.484 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:32:43 smithi090 ceph-mon[34526]: scrub summary: active paths [/] 2024-05-08T05:32:43.538 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:32:43 smithi160 ceph-mon[34827]: scrub queued for path: / 2024-05-08T05:32:43.539 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:32:43 smithi160 ceph-mon[34827]: scrub summary: idle+waiting paths [/] 2024-05-08T05:32:43.539 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:32:43 smithi160 ceph-mon[34827]: scrub summary: active paths [/] 2024-05-08T05:32:43.539 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:32:43 smithi160 ceph-mon[34827]: scrub summary: active paths [/] 2024-05-08T05:32:43.539 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:32:43 smithi160 ceph-mon[34827]: scrub summary: idle+waiting paths [/] 2024-05-08T05:32:43.539 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:32:43 smithi160 ceph-mon[34827]: scrub summary: active paths [/] 2024-05-08T05:32:44.458 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:32:44 smithi087 ceph-mon[29523]: scrub summary: idle+waiting paths [/] 2024-05-08T05:32:44.458 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:32:44 smithi087 ceph-mon[29523]: pgmap v532: 97 pgs: 97 active+clean; 180 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.3 MiB/s wr, 169 op/s 2024-05-08T05:32:44.483 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:32:44 smithi090 ceph-mon[34526]: scrub summary: idle+waiting paths [/] 2024-05-08T05:32:44.483 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:32:44 smithi090 ceph-mon[34526]: pgmap v532: 97 pgs: 97 active+clean; 180 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.3 MiB/s wr, 169 op/s 2024-05-08T05:32:44.538 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:32:44 smithi160 ceph-mon[34827]: scrub summary: idle+waiting paths [/] 2024-05-08T05:32:44.538 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:32:44 smithi160 ceph-mon[34827]: pgmap v532: 97 pgs: 97 active+clean; 180 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.3 MiB/s wr, 169 op/s 2024-05-08T05:32:46.291 DEBUG:teuthology.orchestra.run.smithi087:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid eeeb813e-0cf9-11ef-bc97-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-05-08T05:32:46.458 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:32:46 smithi087 ceph-mon[29523]: pgmap v533: 97 pgs: 97 active+clean; 158 MiB data, 963 MiB used, 1.0 TiB / 1.0 TiB avail; 807 KiB/s rd, 866 KiB/s wr, 170 op/s 2024-05-08T05:32:46.483 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:32:46 smithi090 ceph-mon[34526]: pgmap v533: 97 pgs: 97 active+clean; 158 MiB data, 963 MiB used, 1.0 TiB / 1.0 TiB avail; 807 KiB/s rd, 866 KiB/s wr, 170 op/s 2024-05-08T05:32:46.538 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:32:46 smithi160 ceph-mon[34827]: pgmap v533: 97 pgs: 97 active+clean; 158 MiB data, 963 MiB used, 1.0 TiB / 1.0 TiB avail; 807 KiB/s rd, 866 KiB/s wr, 170 op/s 2024-05-08T05:32:46.821 INFO:teuthology.orchestra.run.smithi087.stderr:Inferring config /var/lib/ceph/eeeb813e-0cf9-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T05:32:48.458 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:32:48 smithi087 ceph-mon[29523]: pgmap v534: 97 pgs: 97 active+clean; 158 MiB data, 954 MiB used, 1.0 TiB / 1.0 TiB avail; 803 KiB/s rd, 879 KiB/s wr, 174 op/s 2024-05-08T05:32:48.458 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:32:48 smithi087 ceph-mon[29523]: scrub summary: idle+waiting paths [/] 2024-05-08T05:32:48.483 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:32:48 smithi090 ceph-mon[34526]: pgmap v534: 97 pgs: 97 active+clean; 158 MiB data, 954 MiB used, 1.0 TiB / 1.0 TiB avail; 803 KiB/s rd, 879 KiB/s wr, 174 op/s 2024-05-08T05:32:48.483 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:32:48 smithi090 ceph-mon[34526]: scrub summary: idle+waiting paths [/] 2024-05-08T05:32:48.538 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:32:48 smithi160 ceph-mon[34827]: pgmap v534: 97 pgs: 97 active+clean; 158 MiB data, 954 MiB used, 1.0 TiB / 1.0 TiB avail; 803 KiB/s rd, 879 KiB/s wr, 174 op/s 2024-05-08T05:32:48.539 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:32:48 smithi160 ceph-mon[34827]: scrub summary: idle+waiting paths [/] 2024-05-08T05:32:49.723 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:49.721+0000 7fa0e9600700 1 -- 172.21.15.87:0/3861638857 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa0e4106080 msgr2=0x7fa0e4112590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:32:49.723 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:49.721+0000 7fa0e9600700 1 --2- 172.21.15.87:0/3861638857 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa0e4106080 0x7fa0e4112590 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fa0dc00b0a0 tx=0x7fa0dc00b3b0 comp rx=0 tx=0).stop 2024-05-08T05:32:49.723 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:49.721+0000 7fa0e9600700 1 -- 172.21.15.87:0/3861638857 shutdown_connections 2024-05-08T05:32:49.723 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:49.721+0000 7fa0e9600700 1 --2- 172.21.15.87:0/3861638857 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa0e4106080 0x7fa0e4112590 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:32:49.723 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:49.721+0000 7fa0e9600700 1 --2- 172.21.15.87:0/3861638857 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa0e410b6c0 0x7fa0e410baa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:32:49.723 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:49.721+0000 7fa0e9600700 1 --2- 172.21.15.87:0/3861638857 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa0e41056c0 0x7fa0e4105b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:32:49.723 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:49.721+0000 7fa0e9600700 1 -- 172.21.15.87:0/3861638857 >> 172.21.15.87:0/3861638857 conn(0x7fa0e41011b0 msgr2=0x7fa0e41035d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:32:49.723 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:49.721+0000 7fa0e9600700 1 -- 172.21.15.87:0/3861638857 shutdown_connections 2024-05-08T05:32:49.724 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:49.721+0000 7fa0e9600700 1 -- 172.21.15.87:0/3861638857 wait complete. 2024-05-08T05:32:49.725 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:49.722+0000 7fa0e9600700 1 Processor -- start 2024-05-08T05:32:49.725 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:49.722+0000 7fa0e9600700 1 -- start start 2024-05-08T05:32:49.725 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:49.723+0000 7fa0e9600700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa0e41056c0 0x7fa0e41a1a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:32:49.725 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:49.723+0000 7fa0e9600700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa0e4106080 0x7fa0e41a1f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:32:49.725 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:49.723+0000 7fa0e9600700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa0e410b6c0 0x7fa0e419bb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:32:49.725 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:49.723+0000 7fa0e9600700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fa0e4115900 con 0x7fa0e41056c0 2024-05-08T05:32:49.725 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:49.723+0000 7fa0e9600700 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fa0e4115780 con 0x7fa0e4106080 2024-05-08T05:32:49.725 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:49.723+0000 7fa0e9600700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7fa0e4115a80 con 0x7fa0e410b6c0 2024-05-08T05:32:49.725 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:49.723+0000 7fa0e2000700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa0e4106080 0x7fa0e41a1f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:32:49.725 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:49.723+0000 7fa0e2000700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa0e4106080 0x7fa0e41a1f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.87:41716/0 (socket says 172.21.15.87:41716) 2024-05-08T05:32:49.726 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:49.723+0000 7fa0e2000700 1 -- 172.21.15.87:0/2648135536 learned_addr learned my addr 172.21.15.87:0/2648135536 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T05:32:49.726 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:49.723+0000 7fa0e3400700 1 --2- 172.21.15.87:0/2648135536 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa0e410b6c0 0x7fa0e419bb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:32:49.726 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:49.724+0000 7fa0e2000700 1 -- 172.21.15.87:0/2648135536 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa0e410b6c0 msgr2=0x7fa0e419bb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:32:49.726 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:49.724+0000 7fa0e2000700 1 --2- 172.21.15.87:0/2648135536 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa0e410b6c0 0x7fa0e419bb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:32:49.726 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:49.724+0000 7fa0e2000700 1 -- 172.21.15.87:0/2648135536 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa0e41056c0 msgr2=0x7fa0e41a1a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:32:49.726 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:49.724+0000 7fa0e2000700 1 --2- 172.21.15.87:0/2648135536 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa0e41056c0 0x7fa0e41a1a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:32:49.726 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:49.724+0000 7fa0e2000700 1 -- 172.21.15.87:0/2648135536 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa0e419c380 con 0x7fa0e4106080 2024-05-08T05:32:49.727 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:49.724+0000 7fa0e2000700 1 --2- 172.21.15.87:0/2648135536 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa0e4106080 0x7fa0e41a1f90 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fa0d000e9a0 tx=0x7fa0d000ecb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:32:49.727 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:49.724+0000 7fa0db400700 1 -- 172.21.15.87:0/2648135536 <== mon.2 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0d000cbd0 con 0x7fa0e4106080 2024-05-08T05:32:49.727 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:49.724+0000 7fa0db400700 1 -- 172.21.15.87:0/2648135536 <== mon.2 v2:172.21.15.90:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa0d000cd70 con 0x7fa0e4106080 2024-05-08T05:32:49.727 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:49.724+0000 7fa0e9600700 1 -- 172.21.15.87:0/2648135536 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa0e419c670 con 0x7fa0e4106080 2024-05-08T05:32:49.727 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:49.724+0000 7fa0db400700 1 -- 172.21.15.87:0/2648135536 <== mon.2 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0d0018680 con 0x7fa0e4106080 2024-05-08T05:32:49.727 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:49.724+0000 7fa0e9600700 1 -- 172.21.15.87:0/2648135536 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa0e4077ab0 con 0x7fa0e4106080 2024-05-08T05:32:49.731 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:49.729+0000 7fa0f3f38b80 1 Processor -- start 2024-05-08T05:32:49.731 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:49.730+0000 7fa0f3f38b80 1 -- start start 2024-05-08T05:32:49.733 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:49.730+0000 7fa0f3f38b80 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f204be1060 0x55f204be1440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:32:49.735 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:49.730+0000 7fa0f3f38b80 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55f204be1980 0x55f204be5490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:32:49.736 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:49.730+0000 7fa0f3f38b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55f204be59d0 0x55f204be5e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:32:49.736 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:49.730+0000 7fa0f3f38b80 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x55f204b33a20 con 0x55f204be1060 2024-05-08T05:32:49.736 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:49.730+0000 7fa0f3f38b80 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x55f204ad1760 con 0x55f204be1980 2024-05-08T05:32:49.736 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:49.730+0000 7fa0f3f38b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x55f204b2f9e0 con 0x55f204be59d0 2024-05-08T05:32:49.736 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:49.730+0000 7fa0db400700 1 -- 172.21.15.87:0/2648135536 <== mon.2 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7fa0d0010430 con 0x7fa0e4106080 2024-05-08T05:32:49.736 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:49.730+0000 7fa0e2a00700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55f204be1980 0x55f204be5490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:32:49.736 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:49.730+0000 7fa0e3400700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f204be1060 0x55f204be1440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:32:49.736 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:49.730+0000 7fa0e2a00700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55f204be1980 0x55f204be5490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.87:41722/0 (socket says 172.21.15.87:41722) 2024-05-08T05:32:49.736 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:49.730+0000 7fa0e2a00700 1 -- 172.21.15.87:0/1752191175 learned_addr learned my addr 172.21.15.87:0/1752191175 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T05:32:49.736 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:49.731+0000 7fa0e2000700 1 --2- 172.21.15.87:0/1752191175 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55f204be59d0 0x55f204be5e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:32:49.736 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:49.731+0000 7fa0e2a00700 1 -- 172.21.15.87:0/1752191175 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55f204be59d0 msgr2=0x55f204be5e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:32:49.736 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:49.731+0000 7fa0e2a00700 1 --2- 172.21.15.87:0/1752191175 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55f204be59d0 0x55f204be5e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:32:49.736 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:49.731+0000 7fa0e2a00700 1 -- 172.21.15.87:0/1752191175 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f204be1060 msgr2=0x55f204be1440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:32:49.737 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:49.731+0000 7fa0e2a00700 1 --2- 172.21.15.87:0/1752191175 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f204be1060 0x55f204be1440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:32:49.737 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:49.731+0000 7fa0e2a00700 1 -- 172.21.15.87:0/1752191175 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f204a808d0 con 0x55f204be1980 2024-05-08T05:32:49.737 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:49.731+0000 7fa0e2000700 1 --2- 172.21.15.87:0/1752191175 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55f204be59d0 0x55f204be5e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T05:32:49.737 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:49.732+0000 7fa0e2a00700 1 --2- 172.21.15.87:0/1752191175 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55f204be1980 0x55f204be5490 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fa0d4009c50 tx=0x7fa0d4009f60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8c37cc5595b32c96 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:32:49.740 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:49.732+0000 7fa0cfe00700 1 -- 172.21.15.87:0/1752191175 <== mon.2 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0d400eb30 con 0x55f204be1980 2024-05-08T05:32:49.740 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:49.732+0000 7fa0cfe00700 1 -- 172.21.15.87:0/1752191175 <== mon.2 v2:172.21.15.90:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa0d4004ce0 con 0x55f204be1980 2024-05-08T05:32:49.740 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:49.732+0000 7fa0cfe00700 1 -- 172.21.15.87:0/1752191175 <== mon.2 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0d40056d0 con 0x55f204be1980 2024-05-08T05:32:49.740 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:49.732+0000 7fa0db400700 1 --2- 172.21.15.87:0/2648135536 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7fa0c80b2980 0x7fa0c80b4e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:32:49.740 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:49.733+0000 7fa0db400700 1 -- 172.21.15.87:0/2648135536 <== mon.2 v2:172.21.15.90:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8190+0+0 (secure 0 0 0) 0x7fa0d00e2400 con 0x7fa0e4106080 2024-05-08T05:32:49.740 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:49.733+0000 7fa0e3400700 1 --2- 172.21.15.87:0/2648135536 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7fa0c80b2980 0x7fa0c80b4e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:32:49.740 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:49.733+0000 7fa0f3f38b80 1 -- 172.21.15.87:0/1752191175 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55f204be1980 msgr2=0x55f204be5490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:32:49.741 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:49.733+0000 7fa0f3f38b80 1 --2- 172.21.15.87:0/1752191175 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55f204be1980 0x55f204be5490 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fa0d4009c50 tx=0x7fa0d4009f60 comp rx=0 tx=0).stop 2024-05-08T05:32:49.741 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:49.734+0000 7fa0f3f38b80 1 -- 172.21.15.87:0/1752191175 shutdown_connections 2024-05-08T05:32:49.741 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:49.734+0000 7fa0f3f38b80 1 --2- 172.21.15.87:0/1752191175 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55f204be59d0 0x55f204be5e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:32:49.741 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:49.734+0000 7fa0f3f38b80 1 --2- 172.21.15.87:0/1752191175 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f204be1060 0x55f204be1440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:32:49.741 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:49.734+0000 7fa0f3f38b80 1 --2- 172.21.15.87:0/1752191175 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55f204be1980 0x55f204be5490 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:32:49.741 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:49.734+0000 7fa0f3f38b80 1 -- 172.21.15.87:0/1752191175 >> 172.21.15.87:0/1752191175 conn(0x55f204b0fb60 msgr2=0x55f204bdb7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:32:49.741 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:49.734+0000 7fa0e3400700 1 --2- 172.21.15.87:0/2648135536 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7fa0c80b2980 0x7fa0c80b4e40 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fa0dc00b780 tx=0x7fa0dc006210 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:32:49.741 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:49.734+0000 7fa0f3f38b80 1 -- 172.21.15.87:0/1752191175 shutdown_connections 2024-05-08T05:32:49.741 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:49.734+0000 7fa0f3f38b80 1 -- 172.21.15.87:0/1752191175 wait complete. 2024-05-08T05:32:49.741 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:49.735+0000 7fa0f3f38b80 1 -- start start 2024-05-08T05:32:49.741 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:49.735+0000 7fa0f3f38b80 1 Processor -- start 2024-05-08T05:32:49.742 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:49.736+0000 7fa0f3f38b80 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55f204be1060 0x55f204bece90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:32:49.742 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:49.736+0000 7fa0f3f38b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55f204be1980 0x55f204bea230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:32:49.742 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:49.736+0000 7fa0f3f38b80 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f204be59d0 0x55f204bea770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:32:49.742 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:49.736+0000 7fa0f3f38b80 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x55f204bedbe0 con 0x55f204be59d0 2024-05-08T05:32:49.742 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:49.736+0000 7fa0f3f38b80 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x55f204a99b20 con 0x55f204be1060 2024-05-08T05:32:49.742 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:49.736+0000 7fa0f3f38b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x55f204bedd60 con 0x55f204be1980 2024-05-08T05:32:49.742 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:49.736+0000 7fa0f3f38b80 10 client.0 _ll_register_callbacks cb 0x55f204adac70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T05:32:49.742 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:49.736+0000 7fa0e2a00700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55f204be1060 0x55f204bece90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:32:49.742 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:49.736+0000 7fa0e2a00700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55f204be1060 0x55f204bece90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.87:41734/0 (socket says 172.21.15.87:41734) 2024-05-08T05:32:49.742 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:49.736+0000 7fa0e2a00700 1 -- 172.21.15.87:0/3768177405 learned_addr learned my addr 172.21.15.87:0/3768177405 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T05:32:49.742 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:49.736+0000 7fa0e2000700 1 --2- 172.21.15.87:0/3768177405 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55f204be1980 0x55f204bea230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:32:49.742 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:49.736+0000 7fa0e2a00700 1 -- 172.21.15.87:0/3768177405 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55f204be1980 msgr2=0x55f204bea230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:32:49.742 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:49.736+0000 7fa0e2a00700 1 --2- 172.21.15.87:0/3768177405 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55f204be1980 0x55f204bea230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:32:49.743 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:49.736+0000 7fa0e2a00700 1 -- 172.21.15.87:0/3768177405 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f204be59d0 msgr2=0x55f204bea770 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-08T05:32:49.743 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:49.737+0000 7fa0e2a00700 1 --2- 172.21.15.87:0/3768177405 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f204be59d0 0x55f204bea770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:32:49.743 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:49.737+0000 7fa0e2a00700 1 -- 172.21.15.87:0/3768177405 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f204af9420 con 0x55f204be1060 2024-05-08T05:32:49.743 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:49.737+0000 7fa0e2000700 1 --2- 172.21.15.87:0/3768177405 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55f204be1980 0x55f204bea230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T05:32:49.743 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:49.737+0000 7fa0e2a00700 1 --2- 172.21.15.87:0/3768177405 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55f204be1060 0x55f204bece90 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fa0d4005950 tx=0x7fa0d4004e90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b465267de7f260a7 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:32:49.743 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:49.737+0000 7fa0ccc00700 10 client.0 ms_handle_connect on v2:172.21.15.90:3300/0 2024-05-08T05:32:49.743 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:49.737+0000 7fa0ccc00700 1 -- 172.21.15.87:0/3768177405 <== mon.2 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0d40055a0 con 0x55f204be1060 2024-05-08T05:32:49.743 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:49.737+0000 7fa0ccc00700 1 -- 172.21.15.87:0/3768177405 <== mon.2 v2:172.21.15.90:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8190+0+0 (secure 0 0 0) 0x7fa0d400e930 con 0x55f204be1060 2024-05-08T05:32:49.743 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:49.737+0000 7fa0f3f38b80 1 -- 172.21.15.87:0/3768177405 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa0d4004ce0 con 0x55f204be1060 2024-05-08T05:32:49.743 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:49.738+0000 7fa0ccc00700 1 -- 172.21.15.87:0/3768177405 <== mon.2 v2:172.21.15.90:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fa0d400eb30 con 0x55f204be1060 2024-05-08T05:32:49.743 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:49.738+0000 7fa0f3f38b80 10 client.25592 fetch_fsmap learned FSMap version 29 2024-05-08T05:32:49.743 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:49.738+0000 7fa0f3f38b80 1 -- 172.21.15.87:0/3768177405 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55f204bf8490 con 0x55f204be1060 2024-05-08T05:32:49.743 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:49.738+0000 7fa0ccc00700 1 -- 172.21.15.87:0/3768177405 <== mon.2 v2:172.21.15.90:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa0d4004ce0 con 0x55f204be1060 2024-05-08T05:32:49.744 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:49.738+0000 7fa0ccc00700 1 -- 172.21.15.87:0/3768177405 <== mon.2 v2:172.21.15.90:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7fa0d40038e0 con 0x55f204be1060 2024-05-08T05:32:49.744 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:49.738+0000 7fa0f3f38b80 10 client.25592 fetch_fsmap finished waiting for FSMap version 29 2024-05-08T05:32:49.744 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:49.738+0000 7fa0f3f38b80 10 client.25592 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-05-08T05:32:49.744 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:49.738+0000 7fa0f3f38b80 20 client.25592 populate_metadata read hostname 'smithi087' 2024-05-08T05:32:49.744 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:49.738+0000 7fa0f3f38b80 1 --2- 172.21.15.87:0/3768177405 >> [v2:172.21.15.90:6838/160586017,v1:172.21.15.90:6839/160586017] conn(0x55f204bfaa10 0x55f204bfce00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:32:49.744 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:49.738+0000 7fa0f3f38b80 4 client.25592 mds_command: new command op to 24500 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-08T05:32:49.744 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:49.738+0000 7fa0f3f38b80 1 -- 172.21.15.87:0/3768177405 --> [v2:172.21.15.90:6838/160586017,v1:172.21.15.90:6839/160586017] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f204bae0a0 con 0x55f204bfaa10 2024-05-08T05:32:49.745 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:49.739+0000 7fa0e2000700 1 --2- 172.21.15.87:0/3768177405 >> [v2:172.21.15.90:6838/160586017,v1:172.21.15.90:6839/160586017] conn(0x55f204bfaa10 0x55f204bfce00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:32:49.745 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:49.740+0000 7fa0e2000700 1 --2- 172.21.15.87:0/3768177405 >> [v2:172.21.15.90:6838/160586017,v1:172.21.15.90:6839/160586017] conn(0x55f204bfaa10 0x55f204bfce00 crc :-1 s=READY pgs=63 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b0ff5e8c5735fcdc server_cookie=9b4c27ac5c532834 in_seq=0 out_seq=0 2024-05-08T05:32:49.745 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:49.740+0000 7fa0ccc00700 10 client.25592 ms_handle_connect on v2:172.21.15.90:6838/160586017 2024-05-08T05:32:49.745 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:49.740+0000 7fa0ccc00700 1 -- 172.21.15.87:0/3768177405 <== mds.0 v2:172.21.15.90:6838/160586017 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55f204bae0a0 con 0x55f204bfaa10 2024-05-08T05:32:49.745 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:49.740+0000 7fa0ccc00700 10 client.25592 handle_command_reply: tid=0 2024-05-08T05:32:49.746 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:49.741+0000 7fa0f3f38b80 1 client.25592 shutdown 2024-05-08T05:32:49.746 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:49.741+0000 7fa0f3f38b80 1 -- 172.21.15.87:0/3768177405 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55f204be1060 msgr2=0x55f204bece90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:32:49.746 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:49.741+0000 7fa0f3f38b80 1 --2- 172.21.15.87:0/3768177405 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55f204be1060 0x55f204bece90 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fa0d4005950 tx=0x7fa0d4004e90 comp rx=0 tx=0).stop 2024-05-08T05:32:49.746 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:49.741+0000 7fa0f3f38b80 1 -- 172.21.15.87:0/3768177405 shutdown_connections 2024-05-08T05:32:49.746 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:49.741+0000 7fa0f3f38b80 1 --2- 172.21.15.87:0/3768177405 >> [v2:172.21.15.90:6838/160586017,v1:172.21.15.90:6839/160586017] conn(0x55f204bfaa10 0x55f204bfce00 crc :-1 s=READY pgs=63 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:32:49.746 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:49.741+0000 7fa0f3f38b80 1 --2- 172.21.15.87:0/3768177405 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f204be59d0 0x55f204bea770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:32:49.746 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:49.741+0000 7fa0f3f38b80 1 --2- 172.21.15.87:0/3768177405 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55f204be1060 0x55f204bece90 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:32:49.746 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:49.741+0000 7fa0f3f38b80 1 --2- 172.21.15.87:0/3768177405 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55f204be1980 0x55f204bea230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:32:49.746 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:49.741+0000 7fa0ccc00700 0 client.25592 ms_handle_reset on v2:172.21.15.90:6838/160586017 2024-05-08T05:32:49.746 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:49.741+0000 7fa0f3f38b80 1 -- 172.21.15.87:0/3768177405 >> 172.21.15.87:0/3768177405 conn(0x55f204b0fb60 msgr2=0x55f204bd62b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:32:49.746 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:49.741+0000 7fa0f3f38b80 1 -- 172.21.15.87:0/3768177405 shutdown_connections 2024-05-08T05:32:49.746 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:49.741+0000 7fa0f3f38b80 1 -- 172.21.15.87:0/3768177405 wait complete. 2024-05-08T05:32:49.747 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:49.741+0000 7fa0f3f38b80 20 client.25592 trim_cache size 0 max 16384 2024-05-08T05:32:49.767 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:49.765+0000 7fa0f3f38b80 1 Processor -- start 2024-05-08T05:32:49.767 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:49.766+0000 7fa0f3f38b80 1 -- start start 2024-05-08T05:32:49.767 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:49.766+0000 7fa0f3f38b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55f204b0fb60 0x55f204be7ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:32:49.767 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:49.766+0000 7fa0f3f38b80 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55f204be1060 0x55f204bf6c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:32:49.767 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:49.766+0000 7fa0f3f38b80 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f204be1980 0x55f204c024b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:32:49.768 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:49.766+0000 7fa0f3f38b80 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fa0e4072a70 con 0x55f204be1980 2024-05-08T05:32:49.768 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:49.766+0000 7fa0f3f38b80 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fa0e4070240 con 0x55f204be1060 2024-05-08T05:32:49.768 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:49.766+0000 7fa0f3f38b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7fa0e406e0b0 con 0x55f204b0fb60 2024-05-08T05:32:49.769 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:49.766+0000 7fa0e2000700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55f204be1060 0x55f204bf6c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:32:49.769 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:49.766+0000 7fa0e3400700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f204be1980 0x55f204c024b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:32:49.769 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:49.766+0000 7fa0e2000700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55f204be1060 0x55f204bf6c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.87:41740/0 (socket says 172.21.15.87:41740) 2024-05-08T05:32:49.769 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:49.767+0000 7fa0e2000700 1 -- 172.21.15.87:0/4088447997 learned_addr learned my addr 172.21.15.87:0/4088447997 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T05:32:49.769 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:49.767+0000 7fa0e2a00700 1 --2- 172.21.15.87:0/4088447997 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55f204b0fb60 0x55f204be7ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:32:49.769 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:49.767+0000 7fa0e2a00700 1 -- 172.21.15.87:0/4088447997 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55f204be1060 msgr2=0x55f204bf6c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:32:49.769 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:49.767+0000 7fa0e2a00700 1 --2- 172.21.15.87:0/4088447997 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55f204be1060 0x55f204bf6c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:32:49.769 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:49.767+0000 7fa0e2a00700 1 -- 172.21.15.87:0/4088447997 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f204be1980 msgr2=0x55f204c024b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:32:49.769 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:49.767+0000 7fa0e2a00700 1 --2- 172.21.15.87:0/4088447997 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f204be1980 0x55f204c024b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:32:49.769 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:49.767+0000 7fa0e2a00700 1 -- 172.21.15.87:0/4088447997 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f204be87a0 con 0x55f204b0fb60 2024-05-08T05:32:49.770 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:49.767+0000 7fa0e2a00700 1 --2- 172.21.15.87:0/4088447997 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55f204b0fb60 0x55f204be7ee0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fa0d4003ef0 tx=0x7fa0d4009440 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d85c9309ea040d50 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:32:49.770 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:49.768+0000 7fa0cf400700 1 -- 172.21.15.87:0/4088447997 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0d403a070 con 0x55f204b0fb60 2024-05-08T05:32:49.770 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:49.768+0000 7fa0cf400700 1 -- 172.21.15.87:0/4088447997 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa0d4004c80 con 0x55f204b0fb60 2024-05-08T05:32:49.770 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:49.768+0000 7fa0cf400700 1 -- 172.21.15.87:0/4088447997 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0d400ecd0 con 0x55f204b0fb60 2024-05-08T05:32:49.770 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:49.769+0000 7fa0f3f38b80 1 -- 172.21.15.87:0/4088447997 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55f204b0fb60 msgr2=0x55f204be7ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:32:49.771 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:49.769+0000 7fa0f3f38b80 1 --2- 172.21.15.87:0/4088447997 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55f204b0fb60 0x55f204be7ee0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fa0d4003ef0 tx=0x7fa0d4009440 comp rx=0 tx=0).stop 2024-05-08T05:32:49.771 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:49.769+0000 7fa0f3f38b80 1 -- 172.21.15.87:0/4088447997 shutdown_connections 2024-05-08T05:32:49.771 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:49.769+0000 7fa0f3f38b80 1 --2- 172.21.15.87:0/4088447997 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f204be1980 0x55f204c024b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:32:49.771 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:49.769+0000 7fa0f3f38b80 1 --2- 172.21.15.87:0/4088447997 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55f204b0fb60 0x55f204be7ee0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:32:49.771 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:49.769+0000 7fa0f3f38b80 1 --2- 172.21.15.87:0/4088447997 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55f204be1060 0x55f204bf6c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:32:49.771 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:49.769+0000 7fa0f3f38b80 1 -- 172.21.15.87:0/4088447997 >> 172.21.15.87:0/4088447997 conn(0x55f204bd5610 msgr2=0x55f204be8b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:32:49.771 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:49.769+0000 7fa0f3f38b80 1 -- 172.21.15.87:0/4088447997 shutdown_connections 2024-05-08T05:32:49.771 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:49.769+0000 7fa0f3f38b80 1 -- 172.21.15.87:0/4088447997 wait complete. 2024-05-08T05:32:49.771 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:49.769+0000 7fa0f3f38b80 1 -- start start 2024-05-08T05:32:49.771 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:49.769+0000 7fa0f3f38b80 1 Processor -- start 2024-05-08T05:32:49.772 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:49.770+0000 7fa0f3f38b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55f204b0fb60 0x55f204bf1740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:32:49.772 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:49.770+0000 7fa0f3f38b80 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55f204be1060 0x55f204bf1c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:32:49.772 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:49.770+0000 7fa0f3f38b80 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f204be1980 0x55f204c020b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:32:49.772 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:49.770+0000 7fa0f3f38b80 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fa0e406e700 con 0x55f204be1980 2024-05-08T05:32:49.773 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:49.770+0000 7fa0f3f38b80 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fa0e406fb70 con 0x55f204be1060 2024-05-08T05:32:49.773 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:49.770+0000 7fa0f3f38b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7fa0e406edd0 con 0x55f204b0fb60 2024-05-08T05:32:49.773 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:49.770+0000 7fa0f3f38b80 10 client.0 _ll_register_callbacks cb 0x55f204adac70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T05:32:49.773 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:49.770+0000 7fa0e2000700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55f204be1060 0x55f204bf1c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:32:49.773 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:49.770+0000 7fa0e2000700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55f204be1060 0x55f204bf1c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.87:41744/0 (socket says 172.21.15.87:41744) 2024-05-08T05:32:49.773 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:49.770+0000 7fa0e2000700 1 -- 172.21.15.87:0/3012637843 learned_addr learned my addr 172.21.15.87:0/3012637843 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T05:32:49.773 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:49.770+0000 7fa0e2a00700 1 --2- 172.21.15.87:0/3012637843 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55f204b0fb60 0x55f204bf1740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:32:49.773 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:49.771+0000 7fa0e2000700 1 -- 172.21.15.87:0/3012637843 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55f204b0fb60 msgr2=0x55f204bf1740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:32:49.773 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:49.771+0000 7fa0e2000700 1 --2- 172.21.15.87:0/3012637843 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55f204b0fb60 0x55f204bf1740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:32:49.773 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:49.771+0000 7fa0e2000700 1 -- 172.21.15.87:0/3012637843 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f204be1980 msgr2=0x55f204c020b0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-08T05:32:49.774 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:49.772+0000 7fa0e2000700 1 --2- 172.21.15.87:0/3012637843 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f204be1980 0x55f204c020b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:32:49.774 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:49.772+0000 7fa0e2000700 1 -- 172.21.15.87:0/3012637843 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f204c025f0 con 0x55f204be1060 2024-05-08T05:32:49.774 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:49.772+0000 7fa0e2000700 1 --2- 172.21.15.87:0/3012637843 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55f204be1060 0x55f204bf1c80 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fa0d000c5b0 tx=0x7fa0d00dfda0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fb97a0fbd139510d server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:32:49.774 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:49.772+0000 7fa0ccc00700 10 client.0 ms_handle_connect on v2:172.21.15.90:3300/0 2024-05-08T05:32:49.774 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:49.772+0000 7fa0ccc00700 1 -- 172.21.15.87:0/3012637843 <== mon.2 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0d008f060 con 0x55f204be1060 2024-05-08T05:32:49.775 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:49.772+0000 7fa0ccc00700 1 -- 172.21.15.87:0/3012637843 <== mon.2 v2:172.21.15.90:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8190+0+0 (secure 0 0 0) 0x7fa0d00a9e60 con 0x55f204be1060 2024-05-08T05:32:49.775 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:49.772+0000 7fa0f3f38b80 1 -- 172.21.15.87:0/3012637843 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa0d4004c80 con 0x55f204be1060 2024-05-08T05:32:49.775 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:49.773+0000 7fa0ccc00700 1 -- 172.21.15.87:0/3012637843 <== mon.2 v2:172.21.15.90:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fa0d00a5180 con 0x55f204be1060 2024-05-08T05:32:49.775 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:49.773+0000 7fa0f3f38b80 10 client.25598 fetch_fsmap learned FSMap version 29 2024-05-08T05:32:49.775 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:49.773+0000 7fa0f3f38b80 1 -- 172.21.15.87:0/3012637843 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55f204c65880 con 0x55f204be1060 2024-05-08T05:32:49.775 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:49.773+0000 7fa0ccc00700 1 -- 172.21.15.87:0/3012637843 <== mon.2 v2:172.21.15.90:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa0d4004c80 con 0x55f204be1060 2024-05-08T05:32:49.776 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:49.774+0000 7fa0ccc00700 1 -- 172.21.15.87:0/3012637843 <== mon.2 v2:172.21.15.90:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7fa0d00b23c0 con 0x55f204be1060 2024-05-08T05:32:49.776 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:49.774+0000 7fa0f3f38b80 10 client.25598 fetch_fsmap finished waiting for FSMap version 29 2024-05-08T05:32:49.776 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:49.774+0000 7fa0f3f38b80 10 client.25598 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-05-08T05:32:49.776 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:49.774+0000 7fa0f3f38b80 20 client.25598 populate_metadata read hostname 'smithi087' 2024-05-08T05:32:49.776 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:49.774+0000 7fa0f3f38b80 1 --2- 172.21.15.87:0/3012637843 >> [v2:172.21.15.90:6838/160586017,v1:172.21.15.90:6839/160586017] conn(0x55f204be59d0 0x55f204c67f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:32:49.776 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:49.774+0000 7fa0f3f38b80 4 client.25598 mds_command: new command op to 24500 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-05-08T05:32:49.776 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:49.774+0000 7fa0f3f38b80 1 -- 172.21.15.87:0/3012637843 --> [v2:172.21.15.90:6838/160586017,v1:172.21.15.90:6839/160586017] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55f204b41400 con 0x55f204be59d0 2024-05-08T05:32:49.776 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:49.775+0000 7fa0e2a00700 1 --2- 172.21.15.87:0/3012637843 >> [v2:172.21.15.90:6838/160586017,v1:172.21.15.90:6839/160586017] conn(0x55f204be59d0 0x55f204c67f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:32:49.777 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:49.775+0000 7fa0e2a00700 1 --2- 172.21.15.87:0/3012637843 >> [v2:172.21.15.90:6838/160586017,v1:172.21.15.90:6839/160586017] conn(0x55f204be59d0 0x55f204c67f90 crc :-1 s=READY pgs=64 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a34780054930451e server_cookie=3877be4098f8bd5d in_seq=0 out_seq=0 2024-05-08T05:32:49.777 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:49.775+0000 7fa0ccc00700 10 client.25598 ms_handle_connect on v2:172.21.15.90:6838/160586017 2024-05-08T05:32:49.777 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:49.776+0000 7fa0ccc00700 1 -- 172.21.15.87:0/3012637843 <== mds.0 v2:172.21.15.90:6838/160586017 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x55f204b41400 con 0x55f204be59d0 2024-05-08T05:32:49.777 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:49.776+0000 7fa0ccc00700 10 client.25598 handle_command_reply: tid=0 2024-05-08T05:32:49.777 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:49.776+0000 7fa0f3f38b80 1 client.25598 shutdown 2024-05-08T05:32:49.777 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:49.776+0000 7fa0f3f38b80 1 -- 172.21.15.87:0/3012637843 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55f204be1060 msgr2=0x55f204bf1c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:32:49.778 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:49.776+0000 7fa0f3f38b80 1 --2- 172.21.15.87:0/3012637843 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55f204be1060 0x55f204bf1c80 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fa0d000c5b0 tx=0x7fa0d00dfda0 comp rx=0 tx=0).stop 2024-05-08T05:32:49.778 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:49.776+0000 7fa0f3f38b80 1 -- 172.21.15.87:0/3012637843 shutdown_connections 2024-05-08T05:32:49.778 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:49.776+0000 7fa0f3f38b80 1 --2- 172.21.15.87:0/3012637843 >> [v2:172.21.15.90:6838/160586017,v1:172.21.15.90:6839/160586017] conn(0x55f204be59d0 0x55f204c67f90 crc :-1 s=READY pgs=64 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:32:49.778 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:49.776+0000 7fa0f3f38b80 1 --2- 172.21.15.87:0/3012637843 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f204be1980 0x55f204c020b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:32:49.778 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:49.776+0000 7fa0f3f38b80 1 --2- 172.21.15.87:0/3012637843 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55f204b0fb60 0x55f204bf1740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:32:49.778 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:49.776+0000 7fa0f3f38b80 1 --2- 172.21.15.87:0/3012637843 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55f204be1060 0x55f204bf1c80 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:32:49.778 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:49.776+0000 7fa0f3f38b80 1 -- 172.21.15.87:0/3012637843 >> 172.21.15.87:0/3012637843 conn(0x55f204bd5610 msgr2=0x55f204bd5a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:32:49.778 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:49.776+0000 7fa0ccc00700 0 client.25598 ms_handle_reset on v2:172.21.15.90:6838/160586017 2024-05-08T05:32:49.779 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:49.777+0000 7fa0f3f38b80 1 -- 172.21.15.87:0/3012637843 shutdown_connections 2024-05-08T05:32:49.779 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:49.777+0000 7fa0f3f38b80 1 -- 172.21.15.87:0/3012637843 wait complete. 2024-05-08T05:32:49.779 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:49.777+0000 7fa0f3f38b80 20 client.25598 trim_cache size 0 max 16384 2024-05-08T05:32:49.779 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-05-08T05:32:49.780 INFO:teuthology.orchestra.run.smithi087.stdout: "status": "IDLE (waiting for more scrubs)", 2024-05-08T05:32:49.780 INFO:teuthology.orchestra.run.smithi087.stdout: "scrubs": { 2024-05-08T05:32:49.780 INFO:teuthology.orchestra.run.smithi087.stdout: "fbb20204-faff-4f3d-9c9d-838a5da58688": { 2024-05-08T05:32:49.780 INFO:teuthology.orchestra.run.smithi087.stdout: "path": "/", 2024-05-08T05:32:49.780 INFO:teuthology.orchestra.run.smithi087.stdout: "tag": "fbb20204-faff-4f3d-9c9d-838a5da58688", 2024-05-08T05:32:49.780 INFO:teuthology.orchestra.run.smithi087.stdout: "options": "recursive,force" 2024-05-08T05:32:49.780 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-05-08T05:32:49.780 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-05-08T05:32:49.780 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-05-08T05:32:49.781 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:49.778+0000 7fa0e9600700 1 -- 172.21.15.87:0/2648135536 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7fa0c80b2980 msgr2=0x7fa0c80b4e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:32:49.781 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:49.778+0000 7fa0e9600700 1 --2- 172.21.15.87:0/2648135536 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7fa0c80b2980 0x7fa0c80b4e40 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fa0dc00b780 tx=0x7fa0dc006210 comp rx=0 tx=0).stop 2024-05-08T05:32:49.781 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:49.778+0000 7fa0e9600700 1 -- 172.21.15.87:0/2648135536 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa0e4106080 msgr2=0x7fa0e41a1f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:32:49.781 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:49.778+0000 7fa0e9600700 1 --2- 172.21.15.87:0/2648135536 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa0e4106080 0x7fa0e41a1f90 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fa0d000e9a0 tx=0x7fa0d000ecb0 comp rx=0 tx=0).stop 2024-05-08T05:32:49.781 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:49.778+0000 7fa0e9600700 1 -- 172.21.15.87:0/2648135536 shutdown_connections 2024-05-08T05:32:49.782 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:49.778+0000 7fa0e9600700 1 --2- 172.21.15.87:0/2648135536 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7fa0c80b2980 0x7fa0c80b4e40 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:32:49.782 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:49.778+0000 7fa0e9600700 1 --2- 172.21.15.87:0/2648135536 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa0e410b6c0 0x7fa0e419bb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:32:49.782 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:49.778+0000 7fa0e9600700 1 --2- 172.21.15.87:0/2648135536 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa0e41056c0 0x7fa0e41a1a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:32:49.782 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:49.778+0000 7fa0e9600700 1 --2- 172.21.15.87:0/2648135536 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa0e4106080 0x7fa0e41a1f90 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:32:49.782 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:49.778+0000 7fa0e9600700 1 -- 172.21.15.87:0/2648135536 >> 172.21.15.87:0/2648135536 conn(0x7fa0e41011b0 msgr2=0x7fa0e41016d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:32:49.782 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:49.779+0000 7fa0e9600700 1 -- 172.21.15.87:0/2648135536 shutdown_connections 2024-05-08T05:32:49.782 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:32:49.779+0000 7fa0e9600700 1 -- 172.21.15.87:0/2648135536 wait complete. 2024-05-08T05:32:50.458 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:32:50 smithi087 ceph-mon[29523]: pgmap v535: 97 pgs: 97 active+clean; 155 MiB data, 943 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.3 MiB/s wr, 222 op/s 2024-05-08T05:32:50.483 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:32:50 smithi090 ceph-mon[34526]: pgmap v535: 97 pgs: 97 active+clean; 155 MiB data, 943 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.3 MiB/s wr, 222 op/s 2024-05-08T05:32:50.538 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:32:50 smithi160 ceph-mon[34827]: pgmap v535: 97 pgs: 97 active+clean; 155 MiB data, 943 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.3 MiB/s wr, 222 op/s 2024-05-08T05:32:50.835 INFO:tasks.cephfs.filesystem:scrub status for tag:fbb20204-faff-4f3d-9c9d-838a5da58688 - {'path': '/', 'tag': 'fbb20204-faff-4f3d-9c9d-838a5da58688', 'options': 'recursive,force'} 2024-05-08T05:32:52.458 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:32:52 smithi087 ceph-mon[29523]: pgmap v536: 97 pgs: 97 active+clean; 154 MiB data, 946 MiB used, 1.0 TiB / 1.0 TiB avail; 849 KiB/s rd, 951 KiB/s wr, 203 op/s 2024-05-08T05:32:52.483 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:32:52 smithi090 ceph-mon[34526]: pgmap v536: 97 pgs: 97 active+clean; 154 MiB data, 946 MiB used, 1.0 TiB / 1.0 TiB avail; 849 KiB/s rd, 951 KiB/s wr, 203 op/s 2024-05-08T05:32:52.538 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:32:52 smithi160 ceph-mon[34827]: pgmap v536: 97 pgs: 97 active+clean; 154 MiB data, 946 MiB used, 1.0 TiB / 1.0 TiB avail; 849 KiB/s rd, 951 KiB/s wr, 203 op/s 2024-05-08T05:32:53.458 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:32:53 smithi087 ceph-mon[29523]: scrub summary: idle 2024-05-08T05:32:53.458 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:32:53 smithi087 ceph-mon[29523]: scrub summary: idle 2024-05-08T05:32:53.458 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:32:53 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T05:32:53.483 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:32:53 smithi090 ceph-mon[34526]: scrub summary: idle 2024-05-08T05:32:53.483 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:32:53 smithi090 ceph-mon[34526]: scrub summary: idle 2024-05-08T05:32:53.483 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:32:53 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T05:32:53.538 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:32:53 smithi160 ceph-mon[34827]: scrub summary: idle 2024-05-08T05:32:53.538 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:32:53 smithi160 ceph-mon[34827]: scrub summary: idle 2024-05-08T05:32:53.539 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:32:53 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T05:32:54.458 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:32:54 smithi087 ceph-mon[29523]: scrub summary: idle 2024-05-08T05:32:54.458 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:32:54 smithi087 ceph-mon[29523]: pgmap v537: 97 pgs: 97 active+clean; 153 MiB data, 952 MiB used, 1.0 TiB / 1.0 TiB avail; 885 KiB/s rd, 965 KiB/s wr, 248 op/s 2024-05-08T05:32:54.483 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:32:54 smithi090 ceph-mon[34526]: scrub summary: idle 2024-05-08T05:32:54.483 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:32:54 smithi090 ceph-mon[34526]: pgmap v537: 97 pgs: 97 active+clean; 153 MiB data, 952 MiB used, 1.0 TiB / 1.0 TiB avail; 885 KiB/s rd, 965 KiB/s wr, 248 op/s 2024-05-08T05:32:54.539 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:32:54 smithi160 ceph-mon[34827]: scrub summary: idle 2024-05-08T05:32:54.539 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:32:54 smithi160 ceph-mon[34827]: pgmap v537: 97 pgs: 97 active+clean; 153 MiB data, 952 MiB used, 1.0 TiB / 1.0 TiB avail; 885 KiB/s rd, 965 KiB/s wr, 248 op/s 2024-05-08T05:32:55.458 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:32:55 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T05:32:55.459 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:32:55 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T05:32:55.459 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:32:55 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:32:55.483 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:32:55 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T05:32:55.483 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:32:55 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T05:32:55.483 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:32:55 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:32:55.538 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:32:55 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T05:32:55.538 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:32:55 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T05:32:55.539 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:32:55 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:32:56.708 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:32:56 smithi087 ceph-mon[29523]: pgmap v538: 97 pgs: 97 active+clean; 158 MiB data, 963 MiB used, 1.0 TiB / 1.0 TiB avail; 1017 KiB/s rd, 1021 KiB/s wr, 244 op/s 2024-05-08T05:32:56.733 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:32:56 smithi090 ceph-mon[34526]: pgmap v538: 97 pgs: 97 active+clean; 158 MiB data, 963 MiB used, 1.0 TiB / 1.0 TiB avail; 1017 KiB/s rd, 1021 KiB/s wr, 244 op/s 2024-05-08T05:32:56.788 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:32:56 smithi160 ceph-mon[34827]: pgmap v538: 97 pgs: 97 active+clean; 158 MiB data, 963 MiB used, 1.0 TiB / 1.0 TiB avail; 1017 KiB/s rd, 1021 KiB/s wr, 244 op/s 2024-05-08T05:32:58.708 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:32:58 smithi087 ceph-mon[29523]: pgmap v539: 97 pgs: 97 active+clean; 157 MiB data, 953 MiB used, 1.0 TiB / 1.0 TiB avail; 1015 KiB/s rd, 999 KiB/s wr, 225 op/s 2024-05-08T05:32:58.733 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:32:58 smithi090 ceph-mon[34526]: pgmap v539: 97 pgs: 97 active+clean; 157 MiB data, 953 MiB used, 1.0 TiB / 1.0 TiB avail; 1015 KiB/s rd, 999 KiB/s wr, 225 op/s 2024-05-08T05:32:58.788 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:32:58 smithi160 ceph-mon[34827]: pgmap v539: 97 pgs: 97 active+clean; 157 MiB data, 953 MiB used, 1.0 TiB / 1.0 TiB avail; 1015 KiB/s rd, 999 KiB/s wr, 225 op/s 2024-05-08T05:33:00.708 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:33:00 smithi087 ceph-mon[29523]: pgmap v540: 97 pgs: 97 active+clean; 160 MiB data, 973 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.3 MiB/s wr, 254 op/s 2024-05-08T05:33:00.733 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:33:00 smithi090 ceph-mon[34526]: pgmap v540: 97 pgs: 97 active+clean; 160 MiB data, 973 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.3 MiB/s wr, 254 op/s 2024-05-08T05:33:00.788 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:33:00 smithi160 ceph-mon[34827]: pgmap v540: 97 pgs: 97 active+clean; 160 MiB data, 973 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.3 MiB/s wr, 254 op/s 2024-05-08T05:33:02.708 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:33:02 smithi087 ceph-mon[29523]: pgmap v541: 97 pgs: 97 active+clean; 159 MiB data, 966 MiB used, 1.0 TiB / 1.0 TiB avail; 931 KiB/s rd, 882 KiB/s wr, 218 op/s 2024-05-08T05:33:02.733 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:33:02 smithi090 ceph-mon[34526]: pgmap v541: 97 pgs: 97 active+clean; 159 MiB data, 966 MiB used, 1.0 TiB / 1.0 TiB avail; 931 KiB/s rd, 882 KiB/s wr, 218 op/s 2024-05-08T05:33:02.788 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:33:02 smithi160 ceph-mon[34827]: pgmap v541: 97 pgs: 97 active+clean; 159 MiB data, 966 MiB used, 1.0 TiB / 1.0 TiB avail; 931 KiB/s rd, 882 KiB/s wr, 218 op/s 2024-05-08T05:33:04.708 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:33:04 smithi087 ceph-mon[29523]: pgmap v542: 97 pgs: 97 active+clean; 156 MiB data, 928 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.4 MiB/s wr, 258 op/s 2024-05-08T05:33:04.733 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:33:04 smithi090 ceph-mon[34526]: pgmap v542: 97 pgs: 97 active+clean; 156 MiB data, 928 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.4 MiB/s wr, 258 op/s 2024-05-08T05:33:04.788 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:33:04 smithi160 ceph-mon[34827]: pgmap v542: 97 pgs: 97 active+clean; 156 MiB data, 928 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.4 MiB/s wr, 258 op/s 2024-05-08T05:33:06.708 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:33:06 smithi087 ceph-mon[29523]: pgmap v543: 97 pgs: 97 active+clean; 152 MiB data, 927 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.5 MiB/s wr, 272 op/s 2024-05-08T05:33:06.733 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:33:06 smithi090 ceph-mon[34526]: pgmap v543: 97 pgs: 97 active+clean; 152 MiB data, 927 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.5 MiB/s wr, 272 op/s 2024-05-08T05:33:06.788 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:33:06 smithi160 ceph-mon[34827]: pgmap v543: 97 pgs: 97 active+clean; 152 MiB data, 927 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.5 MiB/s wr, 272 op/s 2024-05-08T05:33:08.708 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:33:08 smithi087 ceph-mon[29523]: pgmap v544: 97 pgs: 97 active+clean; 152 MiB data, 924 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.1 MiB/s wr, 246 op/s 2024-05-08T05:33:08.733 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:33:08 smithi090 ceph-mon[34526]: pgmap v544: 97 pgs: 97 active+clean; 152 MiB data, 924 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.1 MiB/s wr, 246 op/s 2024-05-08T05:33:08.788 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:33:08 smithi160 ceph-mon[34827]: pgmap v544: 97 pgs: 97 active+clean; 152 MiB data, 924 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.1 MiB/s wr, 246 op/s 2024-05-08T05:33:10.708 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:33:10 smithi087 ceph-mon[29523]: pgmap v545: 97 pgs: 97 active+clean; 152 MiB data, 919 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.4 MiB/s wr, 286 op/s 2024-05-08T05:33:10.733 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:33:10 smithi090 ceph-mon[34526]: pgmap v545: 97 pgs: 97 active+clean; 152 MiB data, 919 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.4 MiB/s wr, 286 op/s 2024-05-08T05:33:10.788 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:33:10 smithi160 ceph-mon[34827]: pgmap v545: 97 pgs: 97 active+clean; 152 MiB data, 919 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.4 MiB/s wr, 286 op/s 2024-05-08T05:33:12.708 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:33:12 smithi087 ceph-mon[29523]: pgmap v546: 97 pgs: 97 active+clean; 151 MiB data, 923 MiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.0 MiB/s wr, 258 op/s 2024-05-08T05:33:12.733 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:33:12 smithi090 ceph-mon[34526]: pgmap v546: 97 pgs: 97 active+clean; 151 MiB data, 923 MiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.0 MiB/s wr, 258 op/s 2024-05-08T05:33:12.788 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:33:12 smithi160 ceph-mon[34827]: pgmap v546: 97 pgs: 97 active+clean; 151 MiB data, 923 MiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.0 MiB/s wr, 258 op/s 2024-05-08T05:33:14.708 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:33:14 smithi087 ceph-mon[29523]: pgmap v547: 97 pgs: 97 active+clean; 153 MiB data, 930 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.3 MiB/s wr, 278 op/s 2024-05-08T05:33:14.733 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:33:14 smithi090 ceph-mon[34526]: pgmap v547: 97 pgs: 97 active+clean; 153 MiB data, 930 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.3 MiB/s wr, 278 op/s 2024-05-08T05:33:14.788 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:33:14 smithi160 ceph-mon[34827]: pgmap v547: 97 pgs: 97 active+clean; 153 MiB data, 930 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.3 MiB/s wr, 278 op/s 2024-05-08T05:33:16.708 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:33:16 smithi087 ceph-mon[29523]: pgmap v548: 97 pgs: 97 active+clean; 155 MiB data, 933 MiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1019 KiB/s wr, 259 op/s 2024-05-08T05:33:16.733 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:33:16 smithi090 ceph-mon[34526]: pgmap v548: 97 pgs: 97 active+clean; 155 MiB data, 933 MiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1019 KiB/s wr, 259 op/s 2024-05-08T05:33:16.788 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:33:16 smithi160 ceph-mon[34827]: pgmap v548: 97 pgs: 97 active+clean; 155 MiB data, 933 MiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1019 KiB/s wr, 259 op/s 2024-05-08T05:33:18.708 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:33:18 smithi087 ceph-mon[29523]: pgmap v549: 97 pgs: 97 active+clean; 154 MiB data, 935 MiB used, 1.0 TiB / 1.0 TiB avail; 869 KiB/s rd, 881 KiB/s wr, 203 op/s 2024-05-08T05:33:18.733 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:33:18 smithi090 ceph-mon[34526]: pgmap v549: 97 pgs: 97 active+clean; 154 MiB data, 935 MiB used, 1.0 TiB / 1.0 TiB avail; 869 KiB/s rd, 881 KiB/s wr, 203 op/s 2024-05-08T05:33:18.788 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:33:18 smithi160 ceph-mon[34827]: pgmap v549: 97 pgs: 97 active+clean; 154 MiB data, 935 MiB used, 1.0 TiB / 1.0 TiB avail; 869 KiB/s rd, 881 KiB/s wr, 203 op/s 2024-05-08T05:33:20.708 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:33:20 smithi087 ceph-mon[29523]: pgmap v550: 97 pgs: 97 active+clean; 156 MiB data, 942 MiB used, 1.0 TiB / 1.0 TiB avail; 993 KiB/s rd, 992 KiB/s wr, 213 op/s 2024-05-08T05:33:20.733 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:33:20 smithi090 ceph-mon[34526]: pgmap v550: 97 pgs: 97 active+clean; 156 MiB data, 942 MiB used, 1.0 TiB / 1.0 TiB avail; 993 KiB/s rd, 992 KiB/s wr, 213 op/s 2024-05-08T05:33:20.788 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:33:20 smithi160 ceph-mon[34827]: pgmap v550: 97 pgs: 97 active+clean; 156 MiB data, 942 MiB used, 1.0 TiB / 1.0 TiB avail; 993 KiB/s rd, 992 KiB/s wr, 213 op/s 2024-05-08T05:33:20.837 DEBUG:teuthology.orchestra.run.smithi087:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid eeeb813e-0cf9-11ef-bc97-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-05-08T05:33:21.316 INFO:teuthology.orchestra.run.smithi087.stderr:Inferring config /var/lib/ceph/eeeb813e-0cf9-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T05:33:22.709 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:33:22 smithi087 ceph-mon[29523]: pgmap v551: 97 pgs: 97 active+clean; 156 MiB data, 943 MiB used, 1.0 TiB / 1.0 TiB avail; 821 KiB/s rd, 822 KiB/s wr, 171 op/s 2024-05-08T05:33:22.733 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:33:22 smithi090 ceph-mon[34526]: pgmap v551: 97 pgs: 97 active+clean; 156 MiB data, 943 MiB used, 1.0 TiB / 1.0 TiB avail; 821 KiB/s rd, 822 KiB/s wr, 171 op/s 2024-05-08T05:33:22.788 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:33:22 smithi160 ceph-mon[34827]: pgmap v551: 97 pgs: 97 active+clean; 156 MiB data, 943 MiB used, 1.0 TiB / 1.0 TiB avail; 821 KiB/s rd, 822 KiB/s wr, 171 op/s 2024-05-08T05:33:23.799 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:23.748+0000 7feff6600700 1 -- 172.21.15.87:0/3078799440 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7feff0103750 msgr2=0x7feff0103b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:33:23.800 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:23.748+0000 7feff6600700 1 --2- 172.21.15.87:0/3078799440 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7feff0103750 0x7feff0103b30 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fefe00098f0 tx=0x7fefe0009c00 comp rx=0 tx=0).stop 2024-05-08T05:33:23.800 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:23.748+0000 7feff6600700 1 -- 172.21.15.87:0/3078799440 shutdown_connections 2024-05-08T05:33:23.800 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:23.748+0000 7feff6600700 1 --2- 172.21.15.87:0/3078799440 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7feff0108850 0x7feff01103d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:33:23.800 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:23.748+0000 7feff6600700 1 --2- 172.21.15.87:0/3078799440 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7feff0103750 0x7feff0103b30 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:33:23.800 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:23.748+0000 7feff6600700 1 --2- 172.21.15.87:0/3078799440 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7feff0104100 0x7feff0108120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:33:23.800 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:23.748+0000 7feff6600700 1 -- 172.21.15.87:0/3078799440 >> 172.21.15.87:0/3078799440 conn(0x7feff007a600 msgr2=0x7feff007aa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:33:23.800 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:23.748+0000 7feff6600700 1 -- 172.21.15.87:0/3078799440 shutdown_connections 2024-05-08T05:33:23.800 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:23.748+0000 7feff6600700 1 -- 172.21.15.87:0/3078799440 wait complete. 2024-05-08T05:33:23.800 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:23.749+0000 7feff6600700 1 Processor -- start 2024-05-08T05:33:23.800 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:23.750+0000 7feff6600700 1 -- start start 2024-05-08T05:33:23.800 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:23.750+0000 7feff6600700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7feff0103750 0x7feff00757a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:33:23.800 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:23.750+0000 7feff6600700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7feff0104100 0x7feff0075ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:33:23.801 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:23.750+0000 7feff6600700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7feff0108850 0x7feff0076220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:33:23.801 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:23.750+0000 7feff6600700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7feff0113670 con 0x7feff0108850 2024-05-08T05:33:23.801 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:23.750+0000 7feff6600700 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7feff01134f0 con 0x7feff0103750 2024-05-08T05:33:23.801 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:23.750+0000 7feff6600700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7feff01137f0 con 0x7feff0104100 2024-05-08T05:33:23.801 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:23.750+0000 7fefefe00700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7feff0108850 0x7feff0076220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:33:23.801 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:23.750+0000 7fefef400700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7feff0103750 0x7feff00757a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:33:23.801 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:23.750+0000 7fefefe00700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7feff0108850 0x7feff0076220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:40778/0 (socket says 172.21.15.87:40778) 2024-05-08T05:33:23.801 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:23.750+0000 7fefefe00700 1 -- 172.21.15.87:0/1661952871 learned_addr learned my addr 172.21.15.87:0/1661952871 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T05:33:23.801 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:23.750+0000 7fefeea00700 1 --2- 172.21.15.87:0/1661952871 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7feff0104100 0x7feff0075ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:33:23.801 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:23.751+0000 7fefef400700 1 -- 172.21.15.87:0/1661952871 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7feff0104100 msgr2=0x7feff0075ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:33:23.801 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:23.751+0000 7fefef400700 1 --2- 172.21.15.87:0/1661952871 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7feff0104100 0x7feff0075ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:33:23.801 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:23.751+0000 7fefef400700 1 -- 172.21.15.87:0/1661952871 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7feff0108850 msgr2=0x7feff0076220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:33:23.801 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:23.751+0000 7fefef400700 1 --2- 172.21.15.87:0/1661952871 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7feff0108850 0x7feff0076220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:33:23.802 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:23.751+0000 7fefef400700 1 -- 172.21.15.87:0/1661952871 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feff01a80f0 con 0x7feff0103750 2024-05-08T05:33:23.802 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:23.751+0000 7fefefe00700 1 --2- 172.21.15.87:0/1661952871 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7feff0108850 0x7feff0076220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T05:33:23.802 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:23.751+0000 7fefef400700 1 --2- 172.21.15.87:0/1661952871 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7feff0103750 0x7feff00757a0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fefe000c010 tx=0x7fefe000fa20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:33:23.802 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:23.751+0000 7fefe7e00700 1 -- 172.21.15.87:0/1661952871 <== mon.2 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fefe00050c0 con 0x7feff0103750 2024-05-08T05:33:23.802 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:23.751+0000 7feff6600700 1 -- 172.21.15.87:0/1661952871 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feff01a8380 con 0x7feff0103750 2024-05-08T05:33:23.802 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:23.752+0000 7fefe7e00700 1 -- 172.21.15.87:0/1661952871 <== mon.2 v2:172.21.15.90:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fefe000b560 con 0x7feff0103750 2024-05-08T05:33:23.802 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:23.752+0000 7fefe7e00700 1 -- 172.21.15.87:0/1661952871 <== mon.2 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fefe00039a0 con 0x7feff0103750 2024-05-08T05:33:23.802 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:23.752+0000 7feff6600700 1 -- 172.21.15.87:0/1661952871 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feff01a8830 con 0x7feff0103750 2024-05-08T05:33:23.802 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:23.755+0000 7fefe7e00700 1 -- 172.21.15.87:0/1661952871 <== mon.2 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7fefe000b710 con 0x7feff0103750 2024-05-08T05:33:23.802 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:23.758+0000 7ff000eb1b80 1 Processor -- start 2024-05-08T05:33:23.802 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:23.758+0000 7fefe7e00700 1 --2- 172.21.15.87:0/1661952871 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7fefd40b2880 0x7fefd40b4d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:33:23.803 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:23.758+0000 7ff000eb1b80 1 -- start start 2024-05-08T05:33:23.803 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:23.758+0000 7fefe7e00700 1 -- 172.21.15.87:0/1661952871 <== mon.2 v2:172.21.15.90:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8190+0+0 (secure 0 0 0) 0x7fefe00e2fe0 con 0x7feff0103750 2024-05-08T05:33:23.803 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:23.758+0000 7fefeea00700 1 --2- 172.21.15.87:0/1661952871 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7fefd40b2880 0x7fefd40b4d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:33:23.803 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:23.759+0000 7ff000eb1b80 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55b405b2fbc0 0x55b405b2ffa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:33:23.803 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:23.759+0000 7ff000eb1b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55b405b304e0 0x55b405b2a2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:33:23.803 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:23.759+0000 7ff000eb1b80 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55b405b2a8f0 0x55b405b2ad70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:33:23.803 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:23.759+0000 7ff000eb1b80 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x55b405a7ca20 con 0x55b405b2a8f0 2024-05-08T05:33:23.803 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:23.759+0000 7ff000eb1b80 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x55b405a1a760 con 0x55b405b2fbc0 2024-05-08T05:33:23.803 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:23.759+0000 7ff000eb1b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x55b405a789e0 con 0x55b405b304e0 2024-05-08T05:33:23.803 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:23.759+0000 7fefefe00700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55b405b2a8f0 0x55b405b2ad70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:33:23.803 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:23.759+0000 7fefeea00700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55b405b304e0 0x55b405b2a2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:33:23.803 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:23.759+0000 7fefef400700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55b405b2fbc0 0x55b405b2ffa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:33:23.803 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:23.759+0000 7fefef400700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55b405b2fbc0 0x55b405b2ffa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.87:37490/0 (socket says 172.21.15.87:37490) 2024-05-08T05:33:23.803 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:23.759+0000 7fefeea00700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55b405b304e0 0x55b405b2a2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.87:56456/0 (socket says 172.21.15.87:56456) 2024-05-08T05:33:23.804 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:23.759+0000 7fefef400700 1 -- 172.21.15.87:0/3177385613 learned_addr learned my addr 172.21.15.87:0/3177385613 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T05:33:23.804 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:23.759+0000 7fefeea00700 1 --2- 172.21.15.87:0/1661952871 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7fefd40b2880 0x7fefd40b4d40 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7feff0103140 tx=0x7fefdc009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:33:23.804 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:23.759+0000 7fefef400700 1 -- 172.21.15.87:0/3177385613 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55b405b304e0 msgr2=0x55b405b2a2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:33:23.804 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:23.759+0000 7fefef400700 1 --2- 172.21.15.87:0/3177385613 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55b405b304e0 0x55b405b2a2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:33:23.804 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:23.759+0000 7fefef400700 1 -- 172.21.15.87:0/3177385613 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55b405b2a8f0 msgr2=0x55b405b2ad70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:33:23.804 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:23.759+0000 7fefef400700 1 --2- 172.21.15.87:0/3177385613 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55b405b2a8f0 0x55b405b2ad70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:33:23.804 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:23.759+0000 7fefef400700 1 -- 172.21.15.87:0/3177385613 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b4059c98d0 con 0x55b405b2fbc0 2024-05-08T05:33:23.804 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:23.760+0000 7fefef400700 1 --2- 172.21.15.87:0/3177385613 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55b405b2fbc0 0x55b405b2ffa0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fefe00a6700 tx=0x7fefe00aa0a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b481efa9ab35c9d7 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:33:23.804 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:23.760+0000 7fefe4c00700 1 -- 172.21.15.87:0/3177385613 <== mon.2 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fefe00aad80 con 0x55b405b2fbc0 2024-05-08T05:33:23.804 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:23.760+0000 7fefe4c00700 1 -- 172.21.15.87:0/3177385613 <== mon.2 v2:172.21.15.90:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fefe00aa680 con 0x55b405b2fbc0 2024-05-08T05:33:23.804 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:23.760+0000 7fefe4c00700 1 -- 172.21.15.87:0/3177385613 <== mon.2 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fefe00920d0 con 0x55b405b2fbc0 2024-05-08T05:33:23.804 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:23.761+0000 7ff000eb1b80 1 -- 172.21.15.87:0/3177385613 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55b405b2fbc0 msgr2=0x55b405b2ffa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:33:23.804 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:23.761+0000 7ff000eb1b80 1 --2- 172.21.15.87:0/3177385613 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55b405b2fbc0 0x55b405b2ffa0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fefe00a6700 tx=0x7fefe00aa0a0 comp rx=0 tx=0).stop 2024-05-08T05:33:23.804 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:23.761+0000 7ff000eb1b80 1 -- 172.21.15.87:0/3177385613 shutdown_connections 2024-05-08T05:33:23.805 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:23.761+0000 7ff000eb1b80 1 --2- 172.21.15.87:0/3177385613 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55b405b2a8f0 0x55b405b2ad70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:33:23.805 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:23.761+0000 7ff000eb1b80 1 --2- 172.21.15.87:0/3177385613 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55b405b2fbc0 0x55b405b2ffa0 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:33:23.805 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:23.761+0000 7ff000eb1b80 1 --2- 172.21.15.87:0/3177385613 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55b405b304e0 0x55b405b2a2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:33:23.805 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:23.761+0000 7ff000eb1b80 1 -- 172.21.15.87:0/3177385613 >> 172.21.15.87:0/3177385613 conn(0x55b405aa26d0 msgr2=0x55b405b24b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:33:23.805 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:23.761+0000 7ff000eb1b80 1 -- 172.21.15.87:0/3177385613 shutdown_connections 2024-05-08T05:33:23.805 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:23.761+0000 7ff000eb1b80 1 -- 172.21.15.87:0/3177385613 wait complete. 2024-05-08T05:33:23.805 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:23.762+0000 7ff000eb1b80 1 -- start start 2024-05-08T05:33:23.805 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:23.762+0000 7ff000eb1b80 1 Processor -- start 2024-05-08T05:33:23.805 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:23.762+0000 7ff000eb1b80 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55b405b2a8f0 0x55b405b361b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:33:23.805 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:23.762+0000 7ff000eb1b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55b405b2fbc0 0x55b405b33550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:33:23.805 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:23.762+0000 7ff000eb1b80 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55b405b304e0 0x55b405b33a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:33:23.805 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:23.762+0000 7ff000eb1b80 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x55b405b36ce0 con 0x55b405b2a8f0 2024-05-08T05:33:23.805 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:23.762+0000 7ff000eb1b80 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x55b4059e2b20 con 0x55b405b304e0 2024-05-08T05:33:23.805 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:23.762+0000 7ff000eb1b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x55b405b36e60 con 0x55b405b2fbc0 2024-05-08T05:33:23.806 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:23.762+0000 7ff000eb1b80 10 client.0 _ll_register_callbacks cb 0x55b405a23c70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T05:33:23.806 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:23.763+0000 7fefef400700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55b405b2a8f0 0x55b405b361b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:33:23.806 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:23.763+0000 7fefef400700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55b405b2a8f0 0x55b405b361b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:40810/0 (socket says 172.21.15.87:40810) 2024-05-08T05:33:23.806 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:23.763+0000 7fefef400700 1 -- 172.21.15.87:0/1249646921 learned_addr learned my addr 172.21.15.87:0/1249646921 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T05:33:23.806 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:23.763+0000 7fefeea00700 1 --2- 172.21.15.87:0/1249646921 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55b405b2fbc0 0x55b405b33550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:33:23.806 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:23.763+0000 7fefefe00700 1 --2- 172.21.15.87:0/1249646921 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55b405b304e0 0x55b405b33a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:33:23.806 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:23.763+0000 7fefef400700 1 -- 172.21.15.87:0/1249646921 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55b405b2fbc0 msgr2=0x55b405b33550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:33:23.806 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:23.763+0000 7fefef400700 1 --2- 172.21.15.87:0/1249646921 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55b405b2fbc0 0x55b405b33550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:33:23.806 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:23.763+0000 7fefef400700 1 -- 172.21.15.87:0/1249646921 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55b405b304e0 msgr2=0x55b405b33a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:33:23.806 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:23.763+0000 7fefef400700 1 --2- 172.21.15.87:0/1249646921 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55b405b304e0 0x55b405b33a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:33:23.806 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:23.763+0000 7fefef400700 1 -- 172.21.15.87:0/1249646921 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b405a42420 con 0x55b405b2a8f0 2024-05-08T05:33:23.806 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:23.763+0000 7fefeea00700 1 --2- 172.21.15.87:0/1249646921 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55b405b2fbc0 0x55b405b33550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T05:33:23.807 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:23.763+0000 7fefef400700 1 --2- 172.21.15.87:0/1249646921 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55b405b2a8f0 0x55b405b361b0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fefe0009810 tx=0x7fefe00b3590 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ab341593a41b73f0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:33:23.807 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:23.763+0000 7fefd9600700 10 client.0 ms_handle_connect on v2:172.21.15.87:3300/0 2024-05-08T05:33:23.807 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:23.764+0000 7fefd9600700 1 -- 172.21.15.87:0/1249646921 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fefe00c3070 con 0x55b405b2a8f0 2024-05-08T05:33:23.807 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:23.764+0000 7fefd9600700 1 -- 172.21.15.87:0/1249646921 <== mon.0 v2:172.21.15.87:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8190+0+0 (secure 0 0 0) 0x7fefe00920d0 con 0x55b405b2a8f0 2024-05-08T05:33:23.807 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:23.764+0000 7ff000eb1b80 1 -- 172.21.15.87:0/1249646921 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fefe00aa680 con 0x55b405b2a8f0 2024-05-08T05:33:23.807 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:23.764+0000 7fefd9600700 1 -- 172.21.15.87:0/1249646921 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fefe00aea30 con 0x55b405b2a8f0 2024-05-08T05:33:23.807 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:23.764+0000 7ff000eb1b80 10 client.15483 fetch_fsmap learned FSMap version 29 2024-05-08T05:33:23.807 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:23.764+0000 7ff000eb1b80 1 -- 172.21.15.87:0/1249646921 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55b405b36ce0 con 0x55b405b2a8f0 2024-05-08T05:33:23.807 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:23.764+0000 7fefd9600700 1 -- 172.21.15.87:0/1249646921 <== mon.0 v2:172.21.15.87:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fefe00aa680 con 0x55b405b2a8f0 2024-05-08T05:33:23.807 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:23.765+0000 7fefd9600700 1 -- 172.21.15.87:0/1249646921 <== mon.0 v2:172.21.15.87:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7fefe00b3050 con 0x55b405b2a8f0 2024-05-08T05:33:23.807 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:23.765+0000 7ff000eb1b80 10 client.15483 fetch_fsmap finished waiting for FSMap version 29 2024-05-08T05:33:23.807 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:23.765+0000 7ff000eb1b80 10 client.15483 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-05-08T05:33:23.807 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:23.765+0000 7ff000eb1b80 20 client.15483 populate_metadata read hostname 'smithi087' 2024-05-08T05:33:23.807 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:23.765+0000 7ff000eb1b80 1 --2- 172.21.15.87:0/1249646921 >> [v2:172.21.15.90:6838/160586017,v1:172.21.15.90:6839/160586017] conn(0x55b405b43770 0x55b405b45b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:33:23.807 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:23.765+0000 7ff000eb1b80 4 client.15483 mds_command: new command op to 24500 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-08T05:33:23.808 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:23.765+0000 7ff000eb1b80 1 -- 172.21.15.87:0/1249646921 --> [v2:172.21.15.90:6838/160586017,v1:172.21.15.90:6839/160586017] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b405af7140 con 0x55b405b43770 2024-05-08T05:33:23.808 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:23.765+0000 7fefeea00700 1 --2- 172.21.15.87:0/1249646921 >> [v2:172.21.15.90:6838/160586017,v1:172.21.15.90:6839/160586017] conn(0x55b405b43770 0x55b405b45b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:33:23.808 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:23.766+0000 7fefeea00700 1 --2- 172.21.15.87:0/1249646921 >> [v2:172.21.15.90:6838/160586017,v1:172.21.15.90:6839/160586017] conn(0x55b405b43770 0x55b405b45b60 crc :-1 s=READY pgs=65 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6209db1f61fbe0c4 server_cookie=746e7b9db1335559 in_seq=0 out_seq=0 2024-05-08T05:33:23.808 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:23.766+0000 7fefd9600700 10 client.15483 ms_handle_connect on v2:172.21.15.90:6838/160586017 2024-05-08T05:33:23.808 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:23.766+0000 7fefd9600700 1 -- 172.21.15.87:0/1249646921 <== mds.0 v2:172.21.15.90:6838/160586017 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55b405af7140 con 0x55b405b43770 2024-05-08T05:33:23.808 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:23.766+0000 7fefd9600700 10 client.15483 handle_command_reply: tid=0 2024-05-08T05:33:23.808 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:23.767+0000 7ff000eb1b80 1 client.15483 shutdown 2024-05-08T05:33:23.808 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:23.767+0000 7ff000eb1b80 1 -- 172.21.15.87:0/1249646921 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55b405b2a8f0 msgr2=0x55b405b361b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:33:23.808 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:23.767+0000 7ff000eb1b80 1 --2- 172.21.15.87:0/1249646921 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55b405b2a8f0 0x55b405b361b0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fefe0009810 tx=0x7fefe00b3590 comp rx=0 tx=0).stop 2024-05-08T05:33:23.808 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:23.767+0000 7ff000eb1b80 1 -- 172.21.15.87:0/1249646921 shutdown_connections 2024-05-08T05:33:23.808 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:23.767+0000 7ff000eb1b80 1 --2- 172.21.15.87:0/1249646921 >> [v2:172.21.15.90:6838/160586017,v1:172.21.15.90:6839/160586017] conn(0x55b405b43770 0x55b405b45b60 crc :-1 s=READY pgs=65 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:33:23.808 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:23.767+0000 7ff000eb1b80 1 --2- 172.21.15.87:0/1249646921 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55b405b304e0 0x55b405b33a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:33:23.808 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:23.767+0000 7ff000eb1b80 1 --2- 172.21.15.87:0/1249646921 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55b405b2a8f0 0x55b405b361b0 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:33:23.808 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:23.767+0000 7ff000eb1b80 1 --2- 172.21.15.87:0/1249646921 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55b405b2fbc0 0x55b405b33550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:33:23.809 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:23.767+0000 7fefd9600700 0 client.15483 ms_handle_reset on v2:172.21.15.90:6838/160586017 2024-05-08T05:33:23.809 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:23.767+0000 7ff000eb1b80 1 -- 172.21.15.87:0/1249646921 >> 172.21.15.87:0/1249646921 conn(0x55b405aa26d0 msgr2=0x55b405b24190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:33:23.809 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:23.767+0000 7ff000eb1b80 1 -- 172.21.15.87:0/1249646921 shutdown_connections 2024-05-08T05:33:23.809 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:23.767+0000 7ff000eb1b80 1 -- 172.21.15.87:0/1249646921 wait complete. 2024-05-08T05:33:23.809 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:23.767+0000 7ff000eb1b80 20 client.15483 trim_cache size 0 max 16384 2024-05-08T05:33:23.809 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:23.789+0000 7ff000eb1b80 1 Processor -- start 2024-05-08T05:33:23.809 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:23.789+0000 7ff000eb1b80 1 -- start start 2024-05-08T05:33:23.809 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:23.790+0000 7ff000eb1b80 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55b405b2a8f0 0x55b405b32540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:33:23.809 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:23.790+0000 7ff000eb1b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55b405b2fbc0 0x55b405b45b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:33:23.809 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:23.790+0000 7ff000eb1b80 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55b405b304e0 0x55b405b3fbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:33:23.809 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:23.790+0000 7ff000eb1b80 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7feff01b2600 con 0x55b405b2a8f0 2024-05-08T05:33:23.809 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:23.790+0000 7ff000eb1b80 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7feff01afdd0 con 0x55b405b304e0 2024-05-08T05:33:23.809 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:23.790+0000 7ff000eb1b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7feff01adc40 con 0x55b405b2fbc0 2024-05-08T05:33:23.810 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:23.790+0000 7fefef400700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55b405b2a8f0 0x55b405b32540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:33:23.810 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:23.790+0000 7fefef400700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55b405b2a8f0 0x55b405b32540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:40824/0 (socket says 172.21.15.87:40824) 2024-05-08T05:33:23.810 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:23.790+0000 7fefef400700 1 -- 172.21.15.87:0/3900223330 learned_addr learned my addr 172.21.15.87:0/3900223330 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T05:33:23.810 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:23.790+0000 7fefeea00700 1 --2- 172.21.15.87:0/3900223330 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55b405b2fbc0 0x55b405b45b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:33:23.810 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:23.790+0000 7fefefe00700 1 --2- 172.21.15.87:0/3900223330 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55b405b304e0 0x55b405b3fbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:33:23.810 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:23.790+0000 7fefeea00700 1 -- 172.21.15.87:0/3900223330 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55b405b304e0 msgr2=0x55b405b3fbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:33:23.810 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:23.790+0000 7fefeea00700 1 --2- 172.21.15.87:0/3900223330 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55b405b304e0 0x55b405b3fbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:33:23.810 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:23.790+0000 7fefeea00700 1 -- 172.21.15.87:0/3900223330 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55b405b2a8f0 msgr2=0x55b405b32540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:33:23.810 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:23.790+0000 7fefeea00700 1 --2- 172.21.15.87:0/3900223330 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55b405b2a8f0 0x55b405b32540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:33:23.810 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:23.791+0000 7fefeea00700 1 -- 172.21.15.87:0/3900223330 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b405b36b20 con 0x55b405b2fbc0 2024-05-08T05:33:23.810 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:23.791+0000 7fefeea00700 1 --2- 172.21.15.87:0/3900223330 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55b405b2fbc0 0x55b405b45b60 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fefdc012fd0 tx=0x7fefdc01c000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9e8e211e900ade25 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:33:23.810 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:23.791+0000 7fefdbe00700 1 -- 172.21.15.87:0/3900223330 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fefdc004560 con 0x55b405b2fbc0 2024-05-08T05:33:23.810 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:23.791+0000 7fefdbe00700 1 -- 172.21.15.87:0/3900223330 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fefdc004ce0 con 0x55b405b2fbc0 2024-05-08T05:33:23.810 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:23.791+0000 7fefdbe00700 1 -- 172.21.15.87:0/3900223330 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fefdc005420 con 0x55b405b2fbc0 2024-05-08T05:33:23.811 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:23.792+0000 7ff000eb1b80 1 -- 172.21.15.87:0/3900223330 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55b405b2fbc0 msgr2=0x55b405b45b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:33:23.811 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:23.792+0000 7ff000eb1b80 1 --2- 172.21.15.87:0/3900223330 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55b405b2fbc0 0x55b405b45b60 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fefdc012fd0 tx=0x7fefdc01c000 comp rx=0 tx=0).stop 2024-05-08T05:33:23.811 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:23.792+0000 7ff000eb1b80 1 -- 172.21.15.87:0/3900223330 shutdown_connections 2024-05-08T05:33:23.811 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:23.792+0000 7ff000eb1b80 1 --2- 172.21.15.87:0/3900223330 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55b405b304e0 0x55b405b3fbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:33:23.811 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:23.792+0000 7ff000eb1b80 1 --2- 172.21.15.87:0/3900223330 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55b405b2a8f0 0x55b405b32540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:33:23.811 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:23.792+0000 7ff000eb1b80 1 --2- 172.21.15.87:0/3900223330 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55b405b2fbc0 0x55b405b45b60 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:33:23.811 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:23.792+0000 7ff000eb1b80 1 -- 172.21.15.87:0/3900223330 >> 172.21.15.87:0/3900223330 conn(0x55b405aa26d0 msgr2=0x55b405b30f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:33:23.811 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:23.792+0000 7ff000eb1b80 1 -- 172.21.15.87:0/3900223330 shutdown_connections 2024-05-08T05:33:23.811 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:23.792+0000 7ff000eb1b80 1 -- 172.21.15.87:0/3900223330 wait complete. 2024-05-08T05:33:23.811 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:23.793+0000 7ff000eb1b80 1 -- start start 2024-05-08T05:33:23.811 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:23.793+0000 7ff000eb1b80 1 Processor -- start 2024-05-08T05:33:23.811 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:23.793+0000 7ff000eb1b80 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55b405b2a8f0 0x55b405b4abe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:33:23.811 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:23.793+0000 7ff000eb1b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55b405b2fbc0 0x55b405b4b120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:33:23.811 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:23.793+0000 7ff000eb1b80 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55b405b304e0 0x55b405b4b660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:33:23.812 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:23.793+0000 7ff000eb1b80 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7feff01ae290 con 0x55b405b2a8f0 2024-05-08T05:33:23.812 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:23.793+0000 7ff000eb1b80 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7feff01af700 con 0x55b405b304e0 2024-05-08T05:33:23.812 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:23.793+0000 7ff000eb1b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7feff01ae960 con 0x55b405b2fbc0 2024-05-08T05:33:23.812 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:23.794+0000 7ff000eb1b80 10 client.0 _ll_register_callbacks cb 0x55b405a23c70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T05:33:23.812 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:23.794+0000 7fefeea00700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55b405b2fbc0 0x55b405b4b120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:33:23.812 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:23.794+0000 7fefef400700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55b405b2a8f0 0x55b405b4abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:33:23.812 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:23.794+0000 7fefeea00700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55b405b2fbc0 0x55b405b4b120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.87:56474/0 (socket says 172.21.15.87:56474) 2024-05-08T05:33:23.812 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:23.794+0000 7fefeea00700 1 -- 172.21.15.87:0/3929833953 learned_addr learned my addr 172.21.15.87:0/3929833953 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T05:33:23.812 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:23.794+0000 7fefefe00700 1 --2- 172.21.15.87:0/3929833953 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55b405b304e0 0x55b405b4b660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:33:23.812 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:23.794+0000 7fefeea00700 1 -- 172.21.15.87:0/3929833953 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55b405b304e0 msgr2=0x55b405b4b660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:33:23.812 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:23.794+0000 7fefeea00700 1 --2- 172.21.15.87:0/3929833953 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55b405b304e0 0x55b405b4b660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:33:23.812 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:23.794+0000 7fefeea00700 1 -- 172.21.15.87:0/3929833953 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55b405b2a8f0 msgr2=0x55b405b4abe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:33:23.812 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:23.794+0000 7fefeea00700 1 --2- 172.21.15.87:0/3929833953 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55b405b2a8f0 0x55b405b4abe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:33:23.812 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:23.794+0000 7fefeea00700 1 -- 172.21.15.87:0/3929833953 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b405bacfa0 con 0x55b405b2fbc0 2024-05-08T05:33:23.813 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:23.794+0000 7fefeea00700 1 --2- 172.21.15.87:0/3929833953 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55b405b2fbc0 0x55b405b4b120 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fefdc029040 tx=0x7fefdc004fa0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b6aecba140bd49c3 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:33:23.813 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:23.795+0000 7fefd9600700 10 client.0 ms_handle_connect on v2:172.21.15.160:3300/0 2024-05-08T05:33:23.813 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:23.795+0000 7fefd9600700 1 -- 172.21.15.87:0/3929833953 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fefdc03a020 con 0x55b405b2fbc0 2024-05-08T05:33:23.813 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:23.795+0000 7fefd9600700 1 -- 172.21.15.87:0/3929833953 <== mon.1 v2:172.21.15.160:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8190+0+0 (secure 0 0 0) 0x7fefdc011d70 con 0x55b405b2fbc0 2024-05-08T05:33:23.813 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:23.795+0000 7ff000eb1b80 1 -- 172.21.15.87:0/3929833953 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fefdc004ce0 con 0x55b405b2fbc0 2024-05-08T05:33:23.813 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:23.795+0000 7fefd9600700 1 -- 172.21.15.87:0/3929833953 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fefdc003d40 con 0x55b405b2fbc0 2024-05-08T05:33:23.813 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:23.795+0000 7ff000eb1b80 10 client.25594 fetch_fsmap learned FSMap version 29 2024-05-08T05:33:23.813 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:23.795+0000 7ff000eb1b80 1 -- 172.21.15.87:0/3929833953 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55b405bae270 con 0x55b405b2fbc0 2024-05-08T05:33:23.813 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:23.795+0000 7fefd9600700 1 -- 172.21.15.87:0/3929833953 <== mon.1 v2:172.21.15.160:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fefdc004ce0 con 0x55b405b2fbc0 2024-05-08T05:33:23.813 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:23.796+0000 7fefd9600700 1 -- 172.21.15.87:0/3929833953 <== mon.1 v2:172.21.15.160:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7fefdc01a040 con 0x55b405b2fbc0 2024-05-08T05:33:23.813 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:23.796+0000 7ff000eb1b80 10 client.25594 fetch_fsmap finished waiting for FSMap version 29 2024-05-08T05:33:23.814 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:23.796+0000 7ff000eb1b80 10 client.25594 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-05-08T05:33:23.814 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:23.796+0000 7ff000eb1b80 20 client.25594 populate_metadata read hostname 'smithi087' 2024-05-08T05:33:23.814 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:23.796+0000 7ff000eb1b80 1 --2- 172.21.15.87:0/3929833953 >> [v2:172.21.15.90:6838/160586017,v1:172.21.15.90:6839/160586017] conn(0x55b405bae950 0x55b405bb0d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:33:23.814 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:23.796+0000 7ff000eb1b80 4 client.25594 mds_command: new command op to 24500 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-05-08T05:33:23.814 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:23.796+0000 7ff000eb1b80 1 -- 172.21.15.87:0/3929833953 --> [v2:172.21.15.90:6838/160586017,v1:172.21.15.90:6839/160586017] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55b405a8a400 con 0x55b405bae950 2024-05-08T05:33:23.814 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:23.796+0000 7fefef400700 1 --2- 172.21.15.87:0/3929833953 >> [v2:172.21.15.90:6838/160586017,v1:172.21.15.90:6839/160586017] conn(0x55b405bae950 0x55b405bb0d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:33:23.814 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:23.797+0000 7fefd9600700 10 client.25594 ms_handle_connect on v2:172.21.15.90:6838/160586017 2024-05-08T05:33:23.814 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:23.797+0000 7fefef400700 1 --2- 172.21.15.87:0/3929833953 >> [v2:172.21.15.90:6838/160586017,v1:172.21.15.90:6839/160586017] conn(0x55b405bae950 0x55b405bb0d70 crc :-1 s=READY pgs=66 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b6b339bb865c6b4b server_cookie=546c10f133e9d781 in_seq=0 out_seq=0 2024-05-08T05:33:23.814 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:23.797+0000 7fefd9600700 1 -- 172.21.15.87:0/3929833953 <== mds.0 v2:172.21.15.90:6838/160586017 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x55b405a8a400 con 0x55b405bae950 2024-05-08T05:33:23.814 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:23.797+0000 7fefd9600700 10 client.25594 handle_command_reply: tid=0 2024-05-08T05:33:23.814 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:23.797+0000 7ff000eb1b80 1 client.25594 shutdown 2024-05-08T05:33:23.814 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:23.797+0000 7ff000eb1b80 1 -- 172.21.15.87:0/3929833953 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55b405b2fbc0 msgr2=0x55b405b4b120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:33:23.814 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:23.797+0000 7ff000eb1b80 1 --2- 172.21.15.87:0/3929833953 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55b405b2fbc0 0x55b405b4b120 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fefdc029040 tx=0x7fefdc004fa0 comp rx=0 tx=0).stop 2024-05-08T05:33:23.815 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:23.797+0000 7ff000eb1b80 1 -- 172.21.15.87:0/3929833953 shutdown_connections 2024-05-08T05:33:23.815 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:23.797+0000 7ff000eb1b80 1 --2- 172.21.15.87:0/3929833953 >> [v2:172.21.15.90:6838/160586017,v1:172.21.15.90:6839/160586017] conn(0x55b405bae950 0x55b405bb0d70 crc :-1 s=READY pgs=66 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:33:23.815 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:23.797+0000 7ff000eb1b80 1 --2- 172.21.15.87:0/3929833953 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55b405b304e0 0x55b405b4b660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:33:23.815 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:23.797+0000 7ff000eb1b80 1 --2- 172.21.15.87:0/3929833953 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55b405b2a8f0 0x55b405b4abe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:33:23.815 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:23.797+0000 7ff000eb1b80 1 --2- 172.21.15.87:0/3929833953 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55b405b2fbc0 0x55b405b4b120 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:33:23.815 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:23.797+0000 7ff000eb1b80 1 -- 172.21.15.87:0/3929833953 >> 172.21.15.87:0/3929833953 conn(0x55b405aa26d0 msgr2=0x55b405b353e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:33:23.815 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:23.797+0000 7fefd9600700 0 client.25594 ms_handle_reset on v2:172.21.15.90:6838/160586017 2024-05-08T05:33:23.815 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:23.798+0000 7ff000eb1b80 1 -- 172.21.15.87:0/3929833953 shutdown_connections 2024-05-08T05:33:23.815 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:23.798+0000 7ff000eb1b80 1 -- 172.21.15.87:0/3929833953 wait complete. 2024-05-08T05:33:23.815 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:23.798+0000 7ff000eb1b80 20 client.25594 trim_cache size 0 max 16384 2024-05-08T05:33:23.816 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-05-08T05:33:23.816 INFO:teuthology.orchestra.run.smithi087.stdout: "status": "no active scrubs running", 2024-05-08T05:33:23.816 INFO:teuthology.orchestra.run.smithi087.stdout: "scrubs": {} 2024-05-08T05:33:23.816 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-05-08T05:33:23.816 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:23.799+0000 7feff6600700 1 -- 172.21.15.87:0/1661952871 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7fefd40b2880 msgr2=0x7fefd40b4d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:33:23.817 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:23.799+0000 7feff6600700 1 --2- 172.21.15.87:0/1661952871 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7fefd40b2880 0x7fefd40b4d40 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7feff0103140 tx=0x7fefdc009260 comp rx=0 tx=0).stop 2024-05-08T05:33:23.817 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:23.799+0000 7feff6600700 1 -- 172.21.15.87:0/1661952871 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7feff0103750 msgr2=0x7feff00757a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:33:23.817 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:23.799+0000 7feff6600700 1 --2- 172.21.15.87:0/1661952871 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7feff0103750 0x7feff00757a0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fefe000c010 tx=0x7fefe000fa20 comp rx=0 tx=0).stop 2024-05-08T05:33:23.817 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:23.799+0000 7feff6600700 1 -- 172.21.15.87:0/1661952871 shutdown_connections 2024-05-08T05:33:23.817 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:23.799+0000 7feff6600700 1 --2- 172.21.15.87:0/1661952871 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7feff0108850 0x7feff0076220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:33:23.817 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:23.799+0000 7feff6600700 1 --2- 172.21.15.87:0/1661952871 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7feff0103750 0x7feff00757a0 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:33:23.817 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:23.799+0000 7feff6600700 1 --2- 172.21.15.87:0/1661952871 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7fefd40b2880 0x7fefd40b4d40 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:33:23.817 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:23.799+0000 7feff6600700 1 --2- 172.21.15.87:0/1661952871 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7feff0104100 0x7feff0075ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:33:23.817 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:23.799+0000 7feff6600700 1 -- 172.21.15.87:0/1661952871 >> 172.21.15.87:0/1661952871 conn(0x7feff007a600 msgr2=0x7feff01018c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:33:23.817 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:23.799+0000 7feff6600700 1 -- 172.21.15.87:0/1661952871 shutdown_connections 2024-05-08T05:33:23.817 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:23.799+0000 7feff6600700 1 -- 172.21.15.87:0/1661952871 wait complete. 2024-05-08T05:33:24.733 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:33:24 smithi090 ceph-mon[34526]: pgmap v552: 97 pgs: 97 active+clean; 159 MiB data, 966 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 206 op/s 2024-05-08T05:33:24.788 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:33:24 smithi160 ceph-mon[34827]: pgmap v552: 97 pgs: 97 active+clean; 159 MiB data, 966 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 206 op/s 2024-05-08T05:33:24.958 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:33:24 smithi087 ceph-mon[29523]: pgmap v552: 97 pgs: 97 active+clean; 159 MiB data, 966 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 206 op/s 2024-05-08T05:33:26.733 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:33:26 smithi090 ceph-mon[34526]: pgmap v553: 97 pgs: 97 active+clean; 157 MiB data, 990 MiB used, 1.0 TiB / 1.0 TiB avail; 885 KiB/s rd, 949 KiB/s wr, 213 op/s 2024-05-08T05:33:26.788 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:33:26 smithi160 ceph-mon[34827]: pgmap v553: 97 pgs: 97 active+clean; 157 MiB data, 990 MiB used, 1.0 TiB / 1.0 TiB avail; 885 KiB/s rd, 949 KiB/s wr, 213 op/s 2024-05-08T05:33:26.958 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:33:26 smithi087 ceph-mon[29523]: pgmap v553: 97 pgs: 97 active+clean; 157 MiB data, 990 MiB used, 1.0 TiB / 1.0 TiB avail; 885 KiB/s rd, 949 KiB/s wr, 213 op/s 2024-05-08T05:33:27.113 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-05-08T05:33:27.113 DEBUG:teuthology.orchestra.run.smithi087:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid eeeb813e-0cf9-11ef-bc97-c7b262605968 -- ceph fs dump --format=json 2024-05-08T05:33:27.599 INFO:teuthology.orchestra.run.smithi087.stderr:Inferring config /var/lib/ceph/eeeb813e-0cf9-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T05:33:28.733 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:33:28 smithi090 ceph-mon[34526]: pgmap v554: 97 pgs: 97 active+clean; 158 MiB data, 991 MiB used, 1.0 TiB / 1.0 TiB avail; 717 KiB/s rd, 776 KiB/s wr, 181 op/s 2024-05-08T05:33:28.787 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:33:28 smithi087 ceph-mon[29523]: pgmap v554: 97 pgs: 97 active+clean; 158 MiB data, 991 MiB used, 1.0 TiB / 1.0 TiB avail; 717 KiB/s rd, 776 KiB/s wr, 181 op/s 2024-05-08T05:33:28.788 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:33:28 smithi160 ceph-mon[34827]: pgmap v554: 97 pgs: 97 active+clean; 158 MiB data, 991 MiB used, 1.0 TiB / 1.0 TiB avail; 717 KiB/s rd, 776 KiB/s wr, 181 op/s 2024-05-08T05:33:30.093 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:30.091+0000 7f6cb5400700 1 -- 172.21.15.87:0/1784945676 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6cb0114250 msgr2=0x7f6cb0116640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:33:30.093 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:30.091+0000 7f6cb5400700 1 --2- 172.21.15.87:0/1784945676 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6cb0114250 0x7f6cb0116640 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f6ca8009990 tx=0x7f6ca8009ca0 comp rx=0 tx=0).stop 2024-05-08T05:33:30.094 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:30.091+0000 7f6cb5400700 1 -- 172.21.15.87:0/1784945676 shutdown_connections 2024-05-08T05:33:30.094 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:30.091+0000 7f6cb5400700 1 --2- 172.21.15.87:0/1784945676 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6cb0114250 0x7f6cb0116640 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:33:30.094 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:30.091+0000 7f6cb5400700 1 --2- 172.21.15.87:0/1784945676 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6cb00779d0 0x7f6cb0077db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:33:30.094 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:30.091+0000 7f6cb5400700 1 --2- 172.21.15.87:0/1784945676 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6cb00782f0 0x7f6cb0113d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:33:30.094 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:30.091+0000 7f6cb5400700 1 -- 172.21.15.87:0/1784945676 >> 172.21.15.87:0/1784945676 conn(0x7f6cb0101080 msgr2=0x7f6cb01034a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:33:30.094 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:30.091+0000 7f6cb5400700 1 -- 172.21.15.87:0/1784945676 shutdown_connections 2024-05-08T05:33:30.094 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:30.091+0000 7f6cb5400700 1 -- 172.21.15.87:0/1784945676 wait complete. 2024-05-08T05:33:30.095 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:30.093+0000 7f6cb5400700 1 Processor -- start 2024-05-08T05:33:30.095 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:30.093+0000 7f6cb5400700 1 -- start start 2024-05-08T05:33:30.095 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:30.093+0000 7f6cb5400700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6cb00779d0 0x7f6cb01a0020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:33:30.095 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:30.093+0000 7f6cb5400700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6cb00782f0 0x7f6cb01a0560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:33:30.095 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:30.093+0000 7f6cb5400700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6cb0114250 0x7f6cb01a48f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:33:30.095 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:30.093+0000 7f6cb5400700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f6cb0119b90 con 0x7f6cb00779d0 2024-05-08T05:33:30.095 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:30.093+0000 7f6cb5400700 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f6cb0119a10 con 0x7f6cb00782f0 2024-05-08T05:33:30.095 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:30.093+0000 7f6cb5400700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f6cb0119d10 con 0x7f6cb0114250 2024-05-08T05:33:30.096 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:30.094+0000 7f6cafe00700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6cb00779d0 0x7f6cb01a0020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:33:30.096 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:30.094+0000 7f6cb4a00700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6cb0114250 0x7f6cb01a48f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:33:30.096 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:30.094+0000 7f6cb4a00700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6cb0114250 0x7f6cb01a48f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.87:48322/0 (socket says 172.21.15.87:48322) 2024-05-08T05:33:30.096 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:30.094+0000 7f6cb4a00700 1 -- 172.21.15.87:0/3895886431 learned_addr learned my addr 172.21.15.87:0/3895886431 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T05:33:30.096 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:30.094+0000 7f6caf400700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6cb00782f0 0x7f6cb01a0560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:33:30.096 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:30.094+0000 7f6cb4a00700 1 -- 172.21.15.87:0/3895886431 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6cb00782f0 msgr2=0x7f6cb01a0560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:33:30.096 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:30.094+0000 7f6cb4a00700 1 --2- 172.21.15.87:0/3895886431 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6cb00782f0 0x7f6cb01a0560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:33:30.097 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:30.094+0000 7f6cb4a00700 1 -- 172.21.15.87:0/3895886431 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6cb00779d0 msgr2=0x7f6cb01a0020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:33:30.097 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:30.094+0000 7f6cb4a00700 1 --2- 172.21.15.87:0/3895886431 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6cb00779d0 0x7f6cb01a0020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:33:30.097 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:30.094+0000 7f6cb4a00700 1 -- 172.21.15.87:0/3895886431 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6cb01a5030 con 0x7f6cb0114250 2024-05-08T05:33:30.097 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:30.094+0000 7f6cb4a00700 1 --2- 172.21.15.87:0/3895886431 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6cb0114250 0x7f6cb01a48f0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f6ca80059d0 tx=0x7f6ca80057c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:33:30.097 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:30.095+0000 7f6cacc00700 1 -- 172.21.15.87:0/3895886431 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ca8026070 con 0x7f6cb0114250 2024-05-08T05:33:30.097 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:30.095+0000 7f6cacc00700 1 -- 172.21.15.87:0/3895886431 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6ca8021410 con 0x7f6cb0114250 2024-05-08T05:33:30.097 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:30.095+0000 7f6cb5400700 1 -- 172.21.15.87:0/3895886431 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6cb01a52c0 con 0x7f6cb0114250 2024-05-08T05:33:30.097 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:30.095+0000 7f6cacc00700 1 -- 172.21.15.87:0/3895886431 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ca8017650 con 0x7f6cb0114250 2024-05-08T05:33:30.098 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:30.095+0000 7f6cb5400700 1 -- 172.21.15.87:0/3895886431 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6cb01acba0 con 0x7f6cb0114250 2024-05-08T05:33:30.098 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:30.096+0000 7f6cb5400700 1 -- 172.21.15.87:0/3895886431 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6cb006a190 con 0x7f6cb0114250 2024-05-08T05:33:30.099 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:30.098+0000 7f6cacc00700 1 -- 172.21.15.87:0/3895886431 <== mon.1 v2:172.21.15.160:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7f6ca8029070 con 0x7f6cb0114250 2024-05-08T05:33:30.101 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:30.100+0000 7f6cacc00700 1 --2- 172.21.15.87:0/3895886431 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f6c940b2900 0x7f6c940b4dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:33:30.101 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:30.100+0000 7f6cacc00700 1 -- 172.21.15.87:0/3895886431 <== mon.1 v2:172.21.15.160:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8190+0+0 (secure 0 0 0) 0x7f6ca80e2e70 con 0x7f6cb0114250 2024-05-08T05:33:30.102 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:30.100+0000 7f6cafe00700 1 --2- 172.21.15.87:0/3895886431 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f6c940b2900 0x7f6c940b4dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:33:30.102 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:30.101+0000 7f6cafe00700 1 --2- 172.21.15.87:0/3895886431 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f6c940b2900 0x7f6c940b4dc0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f6ca0009da0 tx=0x7f6ca000b040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:33:30.105 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:30.104+0000 7f6cacc00700 1 -- 172.21.15.87:0/3895886431 <== mon.1 v2:172.21.15.160:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f6ca8013070 con 0x7f6cb0114250 2024-05-08T05:33:30.437 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:30.436+0000 7f6cb5400700 1 -- 172.21.15.87:0/3895886431 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f6cb002e510 con 0x7f6cb0114250 2024-05-08T05:33:30.438 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:30.437+0000 7f6cacc00700 1 -- 172.21.15.87:0/3895886431 <== mon.1 v2:172.21.15.160:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 29 v29) ==== 94+0+11867 (secure 0 0 0) 0x7f6ca80aabf0 con 0x7f6cb0114250 2024-05-08T05:33:30.438 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-05-08T05:33:30.438 INFO:teuthology.orchestra.run.smithi087.stdout:{"epoch":29,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14358,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6835/1183985321","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6834","nonce":1183985321},{"type":"v1","addr":"172.21.15.87:6835","nonce":1183985321}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14370,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6837/1485824316","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6836","nonce":1485824316},{"type":"v1","addr":"172.21.15.87:6837","nonce":1485824316}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14409,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6841/724277538","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6840","nonce":724277538},{"type":"v1","addr":"172.21.15.87:6841","nonce":724277538}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24412,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6833/3339455985","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6832","nonce":3339455985},{"type":"v1","addr":"172.21.15.160:6833","nonce":3339455985}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24413,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6833/3292166873","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6832","nonce":3292166873},{"type":"v1","addr":"172.21.15.90:6833","nonce":3292166873}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24443,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6835/824555459","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6834","nonce":824555459},{"type":"v1","addr":"172.21.15.90:6835","nonce":824555459}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6}],"filesystems":[{"mdsmap":{"epoch":29,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-05-08T05:25:36.816840+0000","modified":"2024-05-08T05:32:35.804539+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24500,"mds_1":24482,"mds_2":24481},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24463":{"gid":24463,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.160:6835/409648357","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6834","nonce":409648357},{"type":"v1","addr":"172.21.15.160:6835","nonce":409648357}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24467":{"gid":24467,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.90:6837/4221919418","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6836","nonce":4221919418},{"type":"v1","addr":"172.21.15.90:6837","nonce":4221919418}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24469":{"gid":24469,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.160:6837/4200018040","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6836","nonce":4200018040},{"type":"v1","addr":"172.21.15.160:6837","nonce":4200018040}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24481":{"gid":24481,"name":"i","rank":2,"incarnation":20,"state":"up:active","state_seq":13,"addr":"172.21.15.160:6839/234657686","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6838","nonce":234657686},{"type":"v1","addr":"172.21.15.160:6839","nonce":234657686}]},"join_fscid":-1,"export_targets":[0,1],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24482":{"gid":24482,"name":"g","rank":1,"incarnation":18,"state":"up:active","state_seq":12,"addr":"172.21.15.87:6839/2127215876","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6838","nonce":2127215876},{"type":"v1","addr":"172.21.15.87:6839","nonce":2127215876}]},"join_fscid":-1,"export_targets":[0,2],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24500":{"gid":24500,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.90:6839/160586017","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6838","nonce":160586017},{"type":"v1","addr":"172.21.15.90:6839","nonce":160586017}]},"join_fscid":-1,"export_targets":[1,2],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24500,"qdb_cluster":[24500,24481,24482]},"id":1}]} 2024-05-08T05:33:30.441 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:30.440+0000 7f6cb5400700 1 -- 172.21.15.87:0/3895886431 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f6c940b2900 msgr2=0x7f6c940b4dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:33:30.442 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:30.440+0000 7f6cb5400700 1 --2- 172.21.15.87:0/3895886431 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f6c940b2900 0x7f6c940b4dc0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f6ca0009da0 tx=0x7f6ca000b040 comp rx=0 tx=0).stop 2024-05-08T05:33:30.442 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:30.440+0000 7f6cb5400700 1 -- 172.21.15.87:0/3895886431 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6cb0114250 msgr2=0x7f6cb01a48f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:33:30.442 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:30.440+0000 7f6cb5400700 1 --2- 172.21.15.87:0/3895886431 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6cb0114250 0x7f6cb01a48f0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f6ca80059d0 tx=0x7f6ca80057c0 comp rx=0 tx=0).stop 2024-05-08T05:33:30.442 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:30.440+0000 7f6cb5400700 1 -- 172.21.15.87:0/3895886431 shutdown_connections 2024-05-08T05:33:30.442 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:30.440+0000 7f6cb5400700 1 --2- 172.21.15.87:0/3895886431 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f6c940b2900 0x7f6c940b4dc0 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:33:30.442 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:30.440+0000 7f6cb5400700 1 --2- 172.21.15.87:0/3895886431 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6cb0114250 0x7f6cb01a48f0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:33:30.442 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:30.440+0000 7f6cb5400700 1 --2- 172.21.15.87:0/3895886431 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6cb00779d0 0x7f6cb01a0020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:33:30.442 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:30.440+0000 7f6cb5400700 1 --2- 172.21.15.87:0/3895886431 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6cb00782f0 0x7f6cb01a0560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:33:30.442 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:30.440+0000 7f6cb5400700 1 -- 172.21.15.87:0/3895886431 >> 172.21.15.87:0/3895886431 conn(0x7f6cb0101080 msgr2=0x7f6cb0103470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:33:30.442 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:30.440+0000 7f6cb5400700 1 -- 172.21.15.87:0/3895886431 shutdown_connections 2024-05-08T05:33:30.442 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:30.440+0000 7f6cb5400700 1 -- 172.21.15.87:0/3895886431 wait complete. 2024-05-08T05:33:30.443 INFO:teuthology.orchestra.run.smithi087.stderr:dumped fsmap epoch 29 2024-05-08T05:33:30.708 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:33:30 smithi087 ceph-mon[29523]: pgmap v555: 97 pgs: 97 active+clean; 158 MiB data, 977 MiB used, 1.0 TiB / 1.0 TiB avail; 880 KiB/s rd, 905 KiB/s wr, 196 op/s 2024-05-08T05:33:30.708 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:33:30 smithi087 ceph-mon[29523]: from='client.? 172.21.15.87:0/3895886431' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T05:33:30.733 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:33:30 smithi090 ceph-mon[34526]: pgmap v555: 97 pgs: 97 active+clean; 158 MiB data, 977 MiB used, 1.0 TiB / 1.0 TiB avail; 880 KiB/s rd, 905 KiB/s wr, 196 op/s 2024-05-08T05:33:30.733 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:33:30 smithi090 ceph-mon[34526]: from='client.? 172.21.15.87:0/3895886431' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T05:33:30.788 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:33:30 smithi160 ceph-mon[34827]: pgmap v555: 97 pgs: 97 active+clean; 158 MiB data, 977 MiB used, 1.0 TiB / 1.0 TiB avail; 880 KiB/s rd, 905 KiB/s wr, 196 op/s 2024-05-08T05:33:30.788 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:33:30 smithi160 ceph-mon[34827]: from='client.? 172.21.15.87:0/3895886431' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T05:33:31.402 DEBUG:teuthology.orchestra.run.smithi087:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid eeeb813e-0cf9-11ef-bc97-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-05-08T05:33:31.842 INFO:teuthology.orchestra.run.smithi087.stderr:Inferring config /var/lib/ceph/eeeb813e-0cf9-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T05:33:32.709 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:33:32 smithi087 ceph-mon[29523]: pgmap v556: 97 pgs: 97 active+clean; 155 MiB data, 997 MiB used, 1.0 TiB / 1.0 TiB avail; 648 KiB/s rd, 673 KiB/s wr, 173 op/s 2024-05-08T05:33:32.733 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:33:32 smithi090 ceph-mon[34526]: pgmap v556: 97 pgs: 97 active+clean; 155 MiB data, 997 MiB used, 1.0 TiB / 1.0 TiB avail; 648 KiB/s rd, 673 KiB/s wr, 173 op/s 2024-05-08T05:33:32.788 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:33:32 smithi160 ceph-mon[34827]: pgmap v556: 97 pgs: 97 active+clean; 155 MiB data, 997 MiB used, 1.0 TiB / 1.0 TiB avail; 648 KiB/s rd, 673 KiB/s wr, 173 op/s 2024-05-08T05:33:34.256 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:34.254+0000 7fe723a00700 1 -- 172.21.15.87:0/1827191393 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe71c10fea0 msgr2=0x7fe71c112290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:33:34.257 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:34.254+0000 7fe723a00700 1 --2- 172.21.15.87:0/1827191393 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe71c10fea0 0x7fe71c112290 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fe714009f90 tx=0x7fe71400b330 comp rx=0 tx=0).stop 2024-05-08T05:33:34.257 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:34.254+0000 7fe723a00700 1 -- 172.21.15.87:0/1827191393 shutdown_connections 2024-05-08T05:33:34.257 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:34.254+0000 7fe723a00700 1 --2- 172.21.15.87:0/1827191393 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe71c10fea0 0x7fe71c112290 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:33:34.257 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:34.254+0000 7fe723a00700 1 --2- 172.21.15.87:0/1827191393 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe71c0756d0 0x7fe71c075ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:33:34.257 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:34.254+0000 7fe723a00700 1 --2- 172.21.15.87:0/1827191393 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe71c075ff0 0x7fe71c10f960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:33:34.257 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:34.254+0000 7fe723a00700 1 -- 172.21.15.87:0/1827191393 >> 172.21.15.87:0/1827191393 conn(0x7fe71c07a600 msgr2=0x7fe71c07aa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:33:34.258 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:34.255+0000 7fe723a00700 1 -- 172.21.15.87:0/1827191393 shutdown_connections 2024-05-08T05:33:34.258 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:34.255+0000 7fe723a00700 1 -- 172.21.15.87:0/1827191393 wait complete. 2024-05-08T05:33:34.261 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:34.256+0000 7fe723a00700 1 Processor -- start 2024-05-08T05:33:34.261 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:34.256+0000 7fe723a00700 1 -- start start 2024-05-08T05:33:34.261 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:34.257+0000 7fe723a00700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe71c0756d0 0x7fe71c1a1940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:33:34.261 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:34.257+0000 7fe723a00700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe71c075ff0 0x7fe71c1a1e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:33:34.261 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:34.257+0000 7fe723a00700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe71c10fea0 0x7fe71c19bb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:33:34.261 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:34.257+0000 7fe723a00700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fe71c115890 con 0x7fe71c10fea0 2024-05-08T05:33:34.262 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:34.257+0000 7fe723a00700 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fe71c115710 con 0x7fe71c0756d0 2024-05-08T05:33:34.262 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:34.257+0000 7fe723a00700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7fe71c115a10 con 0x7fe71c075ff0 2024-05-08T05:33:34.262 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:34.257+0000 7fe721000700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe71c0756d0 0x7fe71c1a1940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:33:34.262 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:34.257+0000 7fe721000700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe71c0756d0 0x7fe71c1a1940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.87:43402/0 (socket says 172.21.15.87:43402) 2024-05-08T05:33:34.262 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:34.257+0000 7fe721000700 1 -- 172.21.15.87:0/3608620004 learned_addr learned my addr 172.21.15.87:0/3608620004 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T05:33:34.262 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:34.257+0000 7fe71be00700 1 --2- 172.21.15.87:0/3608620004 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe71c075ff0 0x7fe71c1a1e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:33:34.262 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:34.257+0000 7fe721a00700 1 --2- 172.21.15.87:0/3608620004 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe71c10fea0 0x7fe71c19bb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:33:34.263 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:34.258+0000 7fe71be00700 1 -- 172.21.15.87:0/3608620004 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe71c0756d0 msgr2=0x7fe71c1a1940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:33:34.263 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:34.258+0000 7fe71be00700 1 --2- 172.21.15.87:0/3608620004 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe71c0756d0 0x7fe71c1a1940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:33:34.263 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:34.258+0000 7fe71be00700 1 -- 172.21.15.87:0/3608620004 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe71c10fea0 msgr2=0x7fe71c19bb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:33:34.263 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:34.258+0000 7fe71be00700 1 --2- 172.21.15.87:0/3608620004 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe71c10fea0 0x7fe71c19bb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:33:34.263 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:34.258+0000 7fe71be00700 1 -- 172.21.15.87:0/3608620004 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe71c19c2b0 con 0x7fe71c075ff0 2024-05-08T05:33:34.263 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:34.258+0000 7fe71be00700 1 --2- 172.21.15.87:0/3608620004 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe71c075ff0 0x7fe71c1a1e80 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fe70800d740 tx=0x7fe70800da50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:33:34.263 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:34.258+0000 7fe719600700 1 -- 172.21.15.87:0/3608620004 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe708016070 con 0x7fe71c075ff0 2024-05-08T05:33:34.264 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:34.258+0000 7fe719600700 1 -- 172.21.15.87:0/3608620004 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe70800f690 con 0x7fe71c075ff0 2024-05-08T05:33:34.264 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:34.259+0000 7fe723a00700 1 -- 172.21.15.87:0/3608620004 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe71c19c5a0 con 0x7fe71c075ff0 2024-05-08T05:33:34.264 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:34.259+0000 7fe719600700 1 -- 172.21.15.87:0/3608620004 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe708003b50 con 0x7fe71c075ff0 2024-05-08T05:33:34.264 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:34.259+0000 7fe723a00700 1 -- 172.21.15.87:0/3608620004 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe71c1a8810 con 0x7fe71c075ff0 2024-05-08T05:33:34.266 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:34.264+0000 7fe719600700 1 -- 172.21.15.87:0/3608620004 <== mon.1 v2:172.21.15.160:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7fe70800f840 con 0x7fe71c075ff0 2024-05-08T05:33:34.266 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:34.265+0000 7fe72e2a8b80 1 Processor -- start 2024-05-08T05:33:34.267 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:34.266+0000 7fe72e2a8b80 1 -- start start 2024-05-08T05:33:34.267 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:34.266+0000 7fe72e2a8b80 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55564c1f6060 0x55564c1f6440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:33:34.267 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:34.266+0000 7fe72e2a8b80 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55564c1f6980 0x55564c1fa490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:33:34.267 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:34.266+0000 7fe72e2a8b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55564c1fa9d0 0x55564c1fae30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:33:34.268 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:34.266+0000 7fe72e2a8b80 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x55564c148a20 con 0x55564c1f6980 2024-05-08T05:33:34.268 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:34.266+0000 7fe72e2a8b80 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x55564c0e6760 con 0x55564c1f6060 2024-05-08T05:33:34.268 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:34.266+0000 7fe72e2a8b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x55564c1449e0 con 0x55564c1fa9d0 2024-05-08T05:33:34.268 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:34.266+0000 7fe719600700 1 --2- 172.21.15.87:0/3608620004 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7fe7040b2880 0x7fe7040b4d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:33:34.269 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:34.266+0000 7fe721000700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55564c1f6980 0x55564c1fa490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:33:34.269 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:34.266+0000 7fe721a00700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55564c1f6060 0x55564c1f6440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:33:34.269 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:34.267+0000 7fe721000700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55564c1f6980 0x55564c1fa490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:33828/0 (socket says 172.21.15.87:33828) 2024-05-08T05:33:34.269 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:34.267+0000 7fe721000700 1 -- 172.21.15.87:0/3097927908 learned_addr learned my addr 172.21.15.87:0/3097927908 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T05:33:34.269 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:34.267+0000 7fe721a00700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55564c1f6060 0x55564c1f6440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.87:43410/0 (socket says 172.21.15.87:43410) 2024-05-08T05:33:34.269 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:34.267+0000 7fe719600700 1 -- 172.21.15.87:0/3608620004 <== mon.1 v2:172.21.15.160:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8190+0+0 (secure 0 0 0) 0x7fe7080e1ef0 con 0x7fe71c075ff0 2024-05-08T05:33:34.269 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:34.267+0000 7fe71be00700 1 --2- 172.21.15.87:0/3097927908 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55564c1fa9d0 0x55564c1fae30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:33:34.269 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:34.267+0000 7fe721a00700 1 --2- 172.21.15.87:0/3608620004 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7fe7040b2880 0x7fe7040b4d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:33:34.270 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:34.267+0000 7fe721a00700 1 -- 172.21.15.87:0/3097927908 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55564c1fa9d0 msgr2=0x55564c1fae30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:33:34.270 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:34.267+0000 7fe721a00700 1 --2- 172.21.15.87:0/3097927908 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55564c1fa9d0 0x55564c1fae30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:33:34.270 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:34.267+0000 7fe721a00700 1 -- 172.21.15.87:0/3097927908 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55564c1f6980 msgr2=0x55564c1fa490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:33:34.270 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:34.267+0000 7fe721a00700 1 --2- 172.21.15.87:0/3097927908 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55564c1f6980 0x55564c1fa490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:33:34.270 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:34.267+0000 7fe721a00700 1 -- 172.21.15.87:0/3097927908 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55564c0958d0 con 0x55564c1f6060 2024-05-08T05:33:34.270 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:34.267+0000 7fe71be00700 1 --2- 172.21.15.87:0/3097927908 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55564c1fa9d0 0x55564c1fae30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T05:33:34.270 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:34.267+0000 7fe721a00700 1 --2- 172.21.15.87:0/3097927908 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55564c1f6060 0x55564c1f6440 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fe714009790 tx=0x7fe714004a90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=49b912908400a17d server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:33:34.270 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:34.268+0000 7fe70e000700 1 -- 172.21.15.87:0/3097927908 <== mon.2 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe71402d070 con 0x55564c1f6060 2024-05-08T05:33:34.270 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:34.268+0000 7fe70e000700 1 -- 172.21.15.87:0/3097927908 <== mon.2 v2:172.21.15.90:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe714023070 con 0x55564c1f6060 2024-05-08T05:33:34.270 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:34.268+0000 7fe70e000700 1 -- 172.21.15.87:0/3097927908 <== mon.2 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe71401e750 con 0x55564c1f6060 2024-05-08T05:33:34.271 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:34.269+0000 7fe72e2a8b80 1 -- 172.21.15.87:0/3097927908 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55564c1f6060 msgr2=0x55564c1f6440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:33:34.271 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:34.269+0000 7fe721a00700 1 --2- 172.21.15.87:0/3608620004 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7fe7040b2880 0x7fe7040b4d40 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fe714026000 tx=0x7fe714024000 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:33:34.271 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:34.269+0000 7fe72e2a8b80 1 --2- 172.21.15.87:0/3097927908 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55564c1f6060 0x55564c1f6440 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fe714009790 tx=0x7fe714004a90 comp rx=0 tx=0).stop 2024-05-08T05:33:34.271 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:34.269+0000 7fe72e2a8b80 1 -- 172.21.15.87:0/3097927908 shutdown_connections 2024-05-08T05:33:34.272 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:34.269+0000 7fe72e2a8b80 1 --2- 172.21.15.87:0/3097927908 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55564c1fa9d0 0x55564c1fae30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:33:34.272 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:34.269+0000 7fe72e2a8b80 1 --2- 172.21.15.87:0/3097927908 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55564c1f6060 0x55564c1f6440 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:33:34.272 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:34.269+0000 7fe72e2a8b80 1 --2- 172.21.15.87:0/3097927908 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55564c1f6980 0x55564c1fa490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:33:34.272 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:34.269+0000 7fe72e2a8b80 1 -- 172.21.15.87:0/3097927908 >> 172.21.15.87:0/3097927908 conn(0x55564c124b60 msgr2=0x55564c1f07a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:33:34.272 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:34.269+0000 7fe72e2a8b80 1 -- 172.21.15.87:0/3097927908 shutdown_connections 2024-05-08T05:33:34.272 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:34.269+0000 7fe72e2a8b80 1 -- 172.21.15.87:0/3097927908 wait complete. 2024-05-08T05:33:34.272 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:34.269+0000 7fe72e2a8b80 1 -- start start 2024-05-08T05:33:34.272 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:34.269+0000 7fe72e2a8b80 1 Processor -- start 2024-05-08T05:33:34.272 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:34.270+0000 7fe72e2a8b80 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55564c1f6060 0x55564c201e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:33:34.272 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:34.270+0000 7fe72e2a8b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55564c1f6980 0x55564c1ff220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:33:34.272 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:34.270+0000 7fe72e2a8b80 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55564c1fa9d0 0x55564c1ff760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:33:34.272 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:34.270+0000 7fe72e2a8b80 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x55564c202be0 con 0x55564c1f6060 2024-05-08T05:33:34.272 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:34.270+0000 7fe72e2a8b80 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x55564c0aeb20 con 0x55564c1fa9d0 2024-05-08T05:33:34.272 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:34.270+0000 7fe72e2a8b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x55564c202d60 con 0x55564c1f6980 2024-05-08T05:33:34.273 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:34.270+0000 7fe72e2a8b80 10 client.0 _ll_register_callbacks cb 0x55564c0efc70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T05:33:34.275 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:34.270+0000 7fe721a00700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55564c1fa9d0 0x55564c1ff760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:33:34.275 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:34.270+0000 7fe721000700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55564c1f6060 0x55564c201e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:33:34.275 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:34.270+0000 7fe721a00700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55564c1fa9d0 0x55564c1ff760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.87:43422/0 (socket says 172.21.15.87:43422) 2024-05-08T05:33:34.275 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:34.270+0000 7fe721a00700 1 -- 172.21.15.87:0/3328845778 learned_addr learned my addr 172.21.15.87:0/3328845778 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T05:33:34.275 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:34.271+0000 7fe71be00700 1 --2- 172.21.15.87:0/3328845778 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55564c1f6980 0x55564c1ff220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:33:34.275 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:34.271+0000 7fe721a00700 1 -- 172.21.15.87:0/3328845778 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55564c1f6980 msgr2=0x55564c1ff220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:33:34.275 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:34.271+0000 7fe721a00700 1 --2- 172.21.15.87:0/3328845778 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55564c1f6980 0x55564c1ff220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:33:34.276 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:34.271+0000 7fe721a00700 1 -- 172.21.15.87:0/3328845778 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55564c1f6060 msgr2=0x55564c201e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:33:34.276 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:34.271+0000 7fe721a00700 1 --2- 172.21.15.87:0/3328845778 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55564c1f6060 0x55564c201e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:33:34.276 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:34.271+0000 7fe721a00700 1 -- 172.21.15.87:0/3328845778 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55564c10e420 con 0x55564c1fa9d0 2024-05-08T05:33:34.276 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:34.271+0000 7fe71be00700 1 --2- 172.21.15.87:0/3328845778 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55564c1f6980 0x55564c1ff220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T05:33:34.276 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:34.271+0000 7fe721a00700 1 --2- 172.21.15.87:0/3328845778 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55564c1fa9d0 0x55564c1ff760 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fe71400b6c0 tx=0x7fe714004f70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b7fab22df7a7d534 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:33:34.276 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:34.271+0000 7fe702a00700 10 client.0 ms_handle_connect on v2:172.21.15.90:3300/0 2024-05-08T05:33:34.276 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:34.271+0000 7fe702a00700 1 -- 172.21.15.87:0/3328845778 <== mon.2 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe71402d040 con 0x55564c1fa9d0 2024-05-08T05:33:34.276 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:34.271+0000 7fe72e2a8b80 1 -- 172.21.15.87:0/3328845778 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe714023070 con 0x55564c1fa9d0 2024-05-08T05:33:34.276 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:34.271+0000 7fe702a00700 1 -- 172.21.15.87:0/3328845778 <== mon.2 v2:172.21.15.90:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8190+0+0 (secure 0 0 0) 0x7fe7140075e0 con 0x55564c1fa9d0 2024-05-08T05:33:34.276 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:34.272+0000 7fe702a00700 1 -- 172.21.15.87:0/3328845778 <== mon.2 v2:172.21.15.90:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fe714041070 con 0x55564c1fa9d0 2024-05-08T05:33:34.276 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:34.272+0000 7fe72e2a8b80 10 client.25634 fetch_fsmap learned FSMap version 29 2024-05-08T05:33:34.276 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:34.272+0000 7fe72e2a8b80 1 -- 172.21.15.87:0/3328845778 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55564c20d470 con 0x55564c1fa9d0 2024-05-08T05:33:34.276 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:34.272+0000 7fe702a00700 1 -- 172.21.15.87:0/3328845778 <== mon.2 v2:172.21.15.90:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe714023070 con 0x55564c1fa9d0 2024-05-08T05:33:34.276 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:34.272+0000 7fe702a00700 1 -- 172.21.15.87:0/3328845778 <== mon.2 v2:172.21.15.90:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7fe714011070 con 0x55564c1fa9d0 2024-05-08T05:33:34.276 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:34.272+0000 7fe72e2a8b80 10 client.25634 fetch_fsmap finished waiting for FSMap version 29 2024-05-08T05:33:34.277 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:34.272+0000 7fe72e2a8b80 10 client.25634 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.i 2024-05-08T05:33:34.277 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:34.272+0000 7fe72e2a8b80 20 client.25634 populate_metadata read hostname 'smithi087' 2024-05-08T05:33:34.277 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:34.272+0000 7fe72e2a8b80 1 --2- 172.21.15.87:0/3328845778 >> [v2:172.21.15.160:6838/234657686,v1:172.21.15.160:6839/234657686] conn(0x55564c20f940 0x55564c211d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:33:34.277 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:34.272+0000 7fe72e2a8b80 4 client.25634 mds_command: new command op to 24481 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-08T05:33:34.277 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:34.272+0000 7fe72e2a8b80 1 -- 172.21.15.87:0/3328845778 --> [v2:172.21.15.160:6838/234657686,v1:172.21.15.160:6839/234657686] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55564c1c30a0 con 0x55564c20f940 2024-05-08T05:33:34.277 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:34.273+0000 7fe721000700 1 --2- 172.21.15.87:0/3328845778 >> [v2:172.21.15.160:6838/234657686,v1:172.21.15.160:6839/234657686] conn(0x55564c20f940 0x55564c211d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:33:34.277 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:34.273+0000 7fe702a00700 10 client.25634 ms_handle_connect on v2:172.21.15.160:6838/234657686 2024-05-08T05:33:34.277 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:34.273+0000 7fe721000700 1 --2- 172.21.15.87:0/3328845778 >> [v2:172.21.15.160:6838/234657686,v1:172.21.15.160:6839/234657686] conn(0x55564c20f940 0x55564c211d30 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=28707efa417f4f0b server_cookie=a1eb8801d4b0c836 in_seq=0 out_seq=0 2024-05-08T05:33:34.278 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:34.274+0000 7fe702a00700 1 -- 172.21.15.87:0/3328845778 <== mds.2 v2:172.21.15.160:6838/234657686 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55564c1c30a0 con 0x55564c20f940 2024-05-08T05:33:34.278 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:34.274+0000 7fe702a00700 10 client.25634 handle_command_reply: tid=0 2024-05-08T05:33:34.278 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:34.274+0000 7fe72e2a8b80 1 client.25634 shutdown 2024-05-08T05:33:34.278 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:34.274+0000 7fe72e2a8b80 1 -- 172.21.15.87:0/3328845778 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55564c1fa9d0 msgr2=0x55564c1ff760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:33:34.278 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:34.274+0000 7fe72e2a8b80 1 --2- 172.21.15.87:0/3328845778 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55564c1fa9d0 0x55564c1ff760 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fe71400b6c0 tx=0x7fe714004f70 comp rx=0 tx=0).stop 2024-05-08T05:33:34.279 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:34.275+0000 7fe72e2a8b80 1 -- 172.21.15.87:0/3328845778 shutdown_connections 2024-05-08T05:33:34.279 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:34.275+0000 7fe72e2a8b80 1 --2- 172.21.15.87:0/3328845778 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55564c1fa9d0 0x55564c1ff760 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:33:34.279 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:34.275+0000 7fe72e2a8b80 1 --2- 172.21.15.87:0/3328845778 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55564c1f6060 0x55564c201e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:33:34.279 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:34.275+0000 7fe72e2a8b80 1 --2- 172.21.15.87:0/3328845778 >> [v2:172.21.15.160:6838/234657686,v1:172.21.15.160:6839/234657686] conn(0x55564c20f940 0x55564c211d30 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:33:34.279 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:34.275+0000 7fe72e2a8b80 1 --2- 172.21.15.87:0/3328845778 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55564c1f6980 0x55564c1ff220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:33:34.279 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:34.275+0000 7fe72e2a8b80 1 -- 172.21.15.87:0/3328845778 >> 172.21.15.87:0/3328845778 conn(0x55564c124b60 msgr2=0x55564c1eb2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:33:34.279 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:34.275+0000 7fe702a00700 0 client.25634 ms_handle_reset on v2:172.21.15.160:6838/234657686 2024-05-08T05:33:34.279 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:34.275+0000 7fe72e2a8b80 1 -- 172.21.15.87:0/3328845778 shutdown_connections 2024-05-08T05:33:34.279 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:34.275+0000 7fe72e2a8b80 1 -- 172.21.15.87:0/3328845778 wait complete. 2024-05-08T05:33:34.279 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:34.275+0000 7fe72e2a8b80 20 client.25634 trim_cache size 0 max 16384 2024-05-08T05:33:34.295 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:34.293+0000 7fe72e2a8b80 1 Processor -- start 2024-05-08T05:33:34.295 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:34.293+0000 7fe72e2a8b80 1 -- start start 2024-05-08T05:33:34.295 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:34.293+0000 7fe72e2a8b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55564c1f6060 0x55564c1fbdc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:33:34.295 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:34.294+0000 7fe72e2a8b80 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55564c1f6980 0x55564c1fcd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:33:34.295 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:34.294+0000 7fe72e2a8b80 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55564c1fa9d0 0x55564c214d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:33:34.296 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:34.294+0000 7fe72e2a8b80 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fe71c1b2470 con 0x55564c1f6980 2024-05-08T05:33:34.296 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:34.294+0000 7fe72e2a8b80 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fe71c1afc40 con 0x55564c1fa9d0 2024-05-08T05:33:34.296 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:34.294+0000 7fe72e2a8b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7fe71c1ada90 con 0x55564c1f6060 2024-05-08T05:33:34.296 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:34.294+0000 7fe721000700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55564c1f6060 0x55564c1fbdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:33:34.296 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:34.294+0000 7fe721000700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55564c1f6060 0x55564c1fbdc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.87:48376/0 (socket says 172.21.15.87:48376) 2024-05-08T05:33:34.296 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:34.294+0000 7fe721000700 1 -- 172.21.15.87:0/1290304303 learned_addr learned my addr 172.21.15.87:0/1290304303 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T05:33:34.296 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:34.294+0000 7fe71be00700 1 --2- 172.21.15.87:0/1290304303 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55564c1f6980 0x55564c1fcd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:33:34.296 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:34.294+0000 7fe721a00700 1 --2- 172.21.15.87:0/1290304303 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55564c1fa9d0 0x55564c214d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:33:34.298 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:34.294+0000 7fe721000700 1 -- 172.21.15.87:0/1290304303 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55564c1fa9d0 msgr2=0x55564c214d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:33:34.298 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:34.294+0000 7fe721000700 1 --2- 172.21.15.87:0/1290304303 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55564c1fa9d0 0x55564c214d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:33:34.298 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:34.294+0000 7fe721000700 1 -- 172.21.15.87:0/1290304303 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55564c1f6980 msgr2=0x55564c1fcd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:33:34.298 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:34.294+0000 7fe721000700 1 --2- 172.21.15.87:0/1290304303 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55564c1f6980 0x55564c1fcd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:33:34.298 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:34.294+0000 7fe721000700 1 -- 172.21.15.87:0/1290304303 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55564c201ac0 con 0x55564c1f6060 2024-05-08T05:33:34.298 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:34.294+0000 7fe721a00700 1 --2- 172.21.15.87:0/1290304303 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55564c1fa9d0 0x55564c214d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T05:33:34.298 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:34.295+0000 7fe721000700 1 --2- 172.21.15.87:0/1290304303 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55564c1f6060 0x55564c1fbdc0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fe7100046b0 tx=0x7fe710009310 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1ac1b842dd49e977 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:33:34.298 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:34.295+0000 7fe70d600700 1 -- 172.21.15.87:0/1290304303 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe710012cf0 con 0x55564c1f6060 2024-05-08T05:33:34.298 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:34.295+0000 7fe70d600700 1 -- 172.21.15.87:0/1290304303 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe710026070 con 0x55564c1f6060 2024-05-08T05:33:34.299 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:34.295+0000 7fe70d600700 1 -- 172.21.15.87:0/1290304303 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe710005520 con 0x55564c1f6060 2024-05-08T05:33:34.299 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:34.296+0000 7fe72e2a8b80 1 -- 172.21.15.87:0/1290304303 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55564c1f6060 msgr2=0x55564c1fbdc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:33:34.299 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:34.296+0000 7fe72e2a8b80 1 --2- 172.21.15.87:0/1290304303 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55564c1f6060 0x55564c1fbdc0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fe7100046b0 tx=0x7fe710009310 comp rx=0 tx=0).stop 2024-05-08T05:33:34.299 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:34.296+0000 7fe72e2a8b80 1 -- 172.21.15.87:0/1290304303 shutdown_connections 2024-05-08T05:33:34.299 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:34.296+0000 7fe72e2a8b80 1 --2- 172.21.15.87:0/1290304303 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55564c1fa9d0 0x55564c214d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:33:34.299 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:34.296+0000 7fe72e2a8b80 1 --2- 172.21.15.87:0/1290304303 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55564c1f6060 0x55564c1fbdc0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:33:34.299 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:34.296+0000 7fe72e2a8b80 1 --2- 172.21.15.87:0/1290304303 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55564c1f6980 0x55564c1fcd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:33:34.299 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:34.296+0000 7fe72e2a8b80 1 -- 172.21.15.87:0/1290304303 >> 172.21.15.87:0/1290304303 conn(0x55564c124b60 msgr2=0x55564c1fc620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:33:34.299 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:34.296+0000 7fe72e2a8b80 1 -- 172.21.15.87:0/1290304303 shutdown_connections 2024-05-08T05:33:34.299 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:34.296+0000 7fe72e2a8b80 1 -- 172.21.15.87:0/1290304303 wait complete. 2024-05-08T05:33:34.299 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:34.297+0000 7fe72e2a8b80 1 -- start start 2024-05-08T05:33:34.299 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:34.297+0000 7fe72e2a8b80 1 Processor -- start 2024-05-08T05:33:34.300 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:34.297+0000 7fe72e2a8b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55564c1f6060 0x55564c212900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:33:34.301 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:34.297+0000 7fe72e2a8b80 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55564c1f6980 0x55564c212e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:33:34.301 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:34.297+0000 7fe72e2a8b80 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55564c1fa9d0 0x55564c213380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:33:34.301 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:34.297+0000 7fe72e2a8b80 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fe71c1ae100 con 0x55564c1f6980 2024-05-08T05:33:34.301 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:34.297+0000 7fe72e2a8b80 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fe71c1af570 con 0x55564c1fa9d0 2024-05-08T05:33:34.301 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:34.297+0000 7fe72e2a8b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7fe71c1ae7d0 con 0x55564c1f6060 2024-05-08T05:33:34.301 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:34.298+0000 7fe72e2a8b80 10 client.0 _ll_register_callbacks cb 0x55564c0efc70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T05:33:34.301 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:34.298+0000 7fe721000700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55564c1f6060 0x55564c212900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:33:34.301 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:34.298+0000 7fe71be00700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55564c1f6980 0x55564c212e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:33:34.301 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:34.298+0000 7fe721000700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55564c1f6060 0x55564c212900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.87:48392/0 (socket says 172.21.15.87:48392) 2024-05-08T05:33:34.301 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:34.298+0000 7fe721000700 1 -- 172.21.15.87:0/186277316 learned_addr learned my addr 172.21.15.87:0/186277316 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T05:33:34.301 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:34.298+0000 7fe721a00700 1 --2- 172.21.15.87:0/186277316 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55564c1fa9d0 0x55564c213380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:33:34.301 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:34.298+0000 7fe721000700 1 -- 172.21.15.87:0/186277316 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55564c1fa9d0 msgr2=0x55564c213380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:33:34.301 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:34.298+0000 7fe721000700 1 --2- 172.21.15.87:0/186277316 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55564c1fa9d0 0x55564c213380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:33:34.301 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:34.298+0000 7fe721000700 1 -- 172.21.15.87:0/186277316 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55564c1f6980 msgr2=0x55564c212e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:33:34.301 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:34.298+0000 7fe721000700 1 --2- 172.21.15.87:0/186277316 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55564c1f6980 0x55564c212e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:33:34.302 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:34.298+0000 7fe721000700 1 -- 172.21.15.87:0/186277316 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55564c278e60 con 0x55564c1f6060 2024-05-08T05:33:34.302 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:34.299+0000 7fe721000700 1 --2- 172.21.15.87:0/186277316 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55564c1f6060 0x55564c212900 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fe710000c00 tx=0x7fe710012af0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=57b23ed88fb054a2 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:33:34.302 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:34.299+0000 7fe702a00700 10 client.0 ms_handle_connect on v2:172.21.15.160:3300/0 2024-05-08T05:33:34.302 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:34.299+0000 7fe702a00700 1 -- 172.21.15.87:0/186277316 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe71002e070 con 0x55564c1f6060 2024-05-08T05:33:34.302 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:34.299+0000 7fe702a00700 1 -- 172.21.15.87:0/186277316 <== mon.1 v2:172.21.15.160:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8190+0+0 (secure 0 0 0) 0x7fe7100053a0 con 0x55564c1f6060 2024-05-08T05:33:34.302 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:34.299+0000 7fe72e2a8b80 1 -- 172.21.15.87:0/186277316 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe710026070 con 0x55564c1f6060 2024-05-08T05:33:34.302 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:34.299+0000 7fe702a00700 1 -- 172.21.15.87:0/186277316 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fe7100055a0 con 0x55564c1f6060 2024-05-08T05:33:34.302 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:34.300+0000 7fe72e2a8b80 10 client.25615 fetch_fsmap learned FSMap version 29 2024-05-08T05:33:34.302 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:34.300+0000 7fe72e2a8b80 1 -- 172.21.15.87:0/186277316 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55564c27a140 con 0x55564c1f6060 2024-05-08T05:33:34.303 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:34.300+0000 7fe702a00700 1 -- 172.21.15.87:0/186277316 <== mon.1 v2:172.21.15.160:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe710026070 con 0x55564c1f6060 2024-05-08T05:33:34.303 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:34.300+0000 7fe702a00700 1 -- 172.21.15.87:0/186277316 <== mon.1 v2:172.21.15.160:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7fe710022320 con 0x55564c1f6060 2024-05-08T05:33:34.303 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:34.300+0000 7fe72e2a8b80 10 client.25615 fetch_fsmap finished waiting for FSMap version 29 2024-05-08T05:33:34.303 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:34.300+0000 7fe72e2a8b80 10 client.25615 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.i 2024-05-08T05:33:34.303 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:34.300+0000 7fe72e2a8b80 20 client.25615 populate_metadata read hostname 'smithi087' 2024-05-08T05:33:34.304 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:34.300+0000 7fe72e2a8b80 1 --2- 172.21.15.87:0/186277316 >> [v2:172.21.15.160:6838/234657686,v1:172.21.15.160:6839/234657686] conn(0x55564c27a7d0 0x55564c27cbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:33:34.304 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:34.300+0000 7fe72e2a8b80 4 client.25615 mds_command: new command op to 24481 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-05-08T05:33:34.304 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:34.300+0000 7fe72e2a8b80 1 -- 172.21.15.87:0/186277316 --> [v2:172.21.15.160:6838/234657686,v1:172.21.15.160:6839/234657686] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55564c156400 con 0x55564c27a7d0 2024-05-08T05:33:34.304 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:34.300+0000 7fe71be00700 1 --2- 172.21.15.87:0/186277316 >> [v2:172.21.15.160:6838/234657686,v1:172.21.15.160:6839/234657686] conn(0x55564c27a7d0 0x55564c27cbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:33:34.304 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:34.301+0000 7fe71be00700 1 --2- 172.21.15.87:0/186277316 >> [v2:172.21.15.160:6838/234657686,v1:172.21.15.160:6839/234657686] conn(0x55564c27a7d0 0x55564c27cbf0 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=24dc69e071e52581 server_cookie=c6517e0b8711adbd in_seq=0 out_seq=0 2024-05-08T05:33:34.304 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:34.301+0000 7fe702a00700 10 client.25615 ms_handle_connect on v2:172.21.15.160:6838/234657686 2024-05-08T05:33:34.304 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:34.302+0000 7fe702a00700 1 -- 172.21.15.87:0/186277316 <== mds.2 v2:172.21.15.160:6838/234657686 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55564c156400 con 0x55564c27a7d0 2024-05-08T05:33:34.304 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:34.302+0000 7fe702a00700 10 client.25615 handle_command_reply: tid=0 2024-05-08T05:33:34.304 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:34.302+0000 7fe72e2a8b80 1 client.25615 shutdown 2024-05-08T05:33:34.305 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:34.303+0000 7fe72e2a8b80 1 -- 172.21.15.87:0/186277316 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55564c1f6060 msgr2=0x55564c212900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:33:34.305 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:34.303+0000 7fe72e2a8b80 1 --2- 172.21.15.87:0/186277316 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55564c1f6060 0x55564c212900 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fe710000c00 tx=0x7fe710012af0 comp rx=0 tx=0).stop 2024-05-08T05:33:34.306 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:34.303+0000 7fe72e2a8b80 1 -- 172.21.15.87:0/186277316 shutdown_connections 2024-05-08T05:33:34.306 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:34.303+0000 7fe72e2a8b80 1 --2- 172.21.15.87:0/186277316 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55564c1fa9d0 0x55564c213380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:33:34.306 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:34.303+0000 7fe72e2a8b80 1 --2- 172.21.15.87:0/186277316 >> [v2:172.21.15.160:6838/234657686,v1:172.21.15.160:6839/234657686] conn(0x55564c27a7d0 0x55564c27cbf0 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:33:34.306 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:34.303+0000 7fe72e2a8b80 1 --2- 172.21.15.87:0/186277316 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55564c1f6060 0x55564c212900 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:33:34.306 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:34.303+0000 7fe72e2a8b80 1 --2- 172.21.15.87:0/186277316 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55564c1f6980 0x55564c212e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:33:34.306 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:34.303+0000 7fe72e2a8b80 1 -- 172.21.15.87:0/186277316 >> 172.21.15.87:0/186277316 conn(0x55564c124b60 msgr2=0x55564c1eaa20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:33:34.306 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:34.303+0000 7fe702a00700 0 client.25615 ms_handle_reset on v2:172.21.15.160:6838/234657686 2024-05-08T05:33:34.306 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:34.303+0000 7fe72e2a8b80 1 -- 172.21.15.87:0/186277316 shutdown_connections 2024-05-08T05:33:34.306 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:34.303+0000 7fe72e2a8b80 1 -- 172.21.15.87:0/186277316 wait complete. 2024-05-08T05:33:34.306 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:34.303+0000 7fe72e2a8b80 20 client.25615 trim_cache size 0 max 16384 2024-05-08T05:33:34.307 INFO:teuthology.orchestra.run.smithi087.stdout:[] 2024-05-08T05:33:34.307 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:34.304+0000 7fe723a00700 1 -- 172.21.15.87:0/3608620004 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7fe7040b2880 msgr2=0x7fe7040b4d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:33:34.307 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:34.304+0000 7fe723a00700 1 --2- 172.21.15.87:0/3608620004 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7fe7040b2880 0x7fe7040b4d40 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fe714026000 tx=0x7fe714024000 comp rx=0 tx=0).stop 2024-05-08T05:33:34.307 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:34.304+0000 7fe723a00700 1 -- 172.21.15.87:0/3608620004 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe71c075ff0 msgr2=0x7fe71c1a1e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:33:34.308 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:34.304+0000 7fe723a00700 1 --2- 172.21.15.87:0/3608620004 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe71c075ff0 0x7fe71c1a1e80 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fe70800d740 tx=0x7fe70800da50 comp rx=0 tx=0).stop 2024-05-08T05:33:34.308 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:34.304+0000 7fe723a00700 1 -- 172.21.15.87:0/3608620004 shutdown_connections 2024-05-08T05:33:34.308 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:34.304+0000 7fe723a00700 1 --2- 172.21.15.87:0/3608620004 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe71c10fea0 0x7fe71c19bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:33:34.308 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:34.304+0000 7fe723a00700 1 --2- 172.21.15.87:0/3608620004 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe71c0756d0 0x7fe71c1a1940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:33:34.308 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:34.304+0000 7fe723a00700 1 --2- 172.21.15.87:0/3608620004 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7fe7040b2880 0x7fe7040b4d40 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:33:34.308 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:34.304+0000 7fe723a00700 1 --2- 172.21.15.87:0/3608620004 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe71c075ff0 0x7fe71c1a1e80 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:33:34.308 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:34.304+0000 7fe723a00700 1 -- 172.21.15.87:0/3608620004 >> 172.21.15.87:0/3608620004 conn(0x7fe71c07a600 msgr2=0x7fe71c100650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:33:34.308 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:34.304+0000 7fe723a00700 1 -- 172.21.15.87:0/3608620004 shutdown_connections 2024-05-08T05:33:34.308 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:34.304+0000 7fe723a00700 1 -- 172.21.15.87:0/3608620004 wait complete. 2024-05-08T05:33:34.708 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:33:34 smithi087 ceph-mon[29523]: pgmap v557: 97 pgs: 97 active+clean; 157 MiB data, 1000 MiB used, 1.0 TiB / 1.0 TiB avail; 1018 KiB/s rd, 1.1 MiB/s wr, 220 op/s 2024-05-08T05:33:34.788 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:33:34 smithi160 ceph-mon[34827]: pgmap v557: 97 pgs: 97 active+clean; 157 MiB data, 1000 MiB used, 1.0 TiB / 1.0 TiB avail; 1018 KiB/s rd, 1.1 MiB/s wr, 220 op/s 2024-05-08T05:33:34.983 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:33:34 smithi090 ceph-mon[34526]: pgmap v557: 97 pgs: 97 active+clean; 157 MiB data, 1000 MiB used, 1.0 TiB / 1.0 TiB avail; 1018 KiB/s rd, 1.1 MiB/s wr, 220 op/s 2024-05-08T05:33:35.326 DEBUG:teuthology.orchestra.run.smithi087:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid eeeb813e-0cf9-11ef-bc97-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-05-08T05:33:35.802 INFO:teuthology.orchestra.run.smithi087.stderr:Inferring config /var/lib/ceph/eeeb813e-0cf9-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T05:33:36.708 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:33:36 smithi087 ceph-mon[29523]: pgmap v558: 97 pgs: 97 active+clean; 156 MiB data, 983 MiB used, 1.0 TiB / 1.0 TiB avail; 815 KiB/s rd, 818 KiB/s wr, 209 op/s 2024-05-08T05:33:36.788 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:33:36 smithi160 ceph-mon[34827]: pgmap v558: 97 pgs: 97 active+clean; 156 MiB data, 983 MiB used, 1.0 TiB / 1.0 TiB avail; 815 KiB/s rd, 818 KiB/s wr, 209 op/s 2024-05-08T05:33:36.983 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:33:36 smithi090 ceph-mon[34526]: pgmap v558: 97 pgs: 97 active+clean; 156 MiB data, 983 MiB used, 1.0 TiB / 1.0 TiB avail; 815 KiB/s rd, 818 KiB/s wr, 209 op/s 2024-05-08T05:33:37.757 INFO:tasks.workunit:Stopping ['suites/fsstress.sh'] on client.0... 2024-05-08T05:33:37.757 DEBUG:teuthology.orchestra.run.smithi087:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-05-08T05:33:38.547 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:38.546+0000 7fc9f4e00700 1 -- 172.21.15.87:0/682309939 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc9f0109460 msgr2=0x7fc9f0109840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:33:38.547 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:38.546+0000 7fc9f4e00700 1 --2- 172.21.15.87:0/682309939 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc9f0109460 0x7fc9f0109840 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fc9e0009990 tx=0x7fc9e0009ca0 comp rx=0 tx=0).stop 2024-05-08T05:33:38.547 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:38.546+0000 7fc9f4e00700 1 -- 172.21.15.87:0/682309939 shutdown_connections 2024-05-08T05:33:38.547 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:38.546+0000 7fc9f4e00700 1 --2- 172.21.15.87:0/682309939 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc9f0103d90 0x7fc9f01102a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:33:38.547 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:38.546+0000 7fc9f4e00700 1 --2- 172.21.15.87:0/682309939 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc9f0109460 0x7fc9f0109840 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:33:38.547 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:38.546+0000 7fc9f4e00700 1 --2- 172.21.15.87:0/682309939 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc9f01033d0 0x7fc9f0103850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:33:38.547 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:38.546+0000 7fc9f4e00700 1 -- 172.21.15.87:0/682309939 >> 172.21.15.87:0/682309939 conn(0x7fc9f00fef20 msgr2=0x7fc9f0101340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:33:38.547 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:38.546+0000 7fc9f4e00700 1 -- 172.21.15.87:0/682309939 shutdown_connections 2024-05-08T05:33:38.548 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:38.546+0000 7fc9f4e00700 1 -- 172.21.15.87:0/682309939 wait complete. 2024-05-08T05:33:38.549 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:38.547+0000 7fc9f4e00700 1 Processor -- start 2024-05-08T05:33:38.549 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:38.547+0000 7fc9f4e00700 1 -- start start 2024-05-08T05:33:38.549 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:38.548+0000 7fc9f4e00700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc9f01033d0 0x7fc9f019f740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:33:38.549 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:38.548+0000 7fc9f4e00700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc9f0103d90 0x7fc9f019fc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:33:38.549 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:38.548+0000 7fc9f4e00700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc9f0109460 0x7fc9f0199900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:33:38.549 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:38.548+0000 7fc9f4e00700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fc9f01135c0 con 0x7fc9f01033d0 2024-05-08T05:33:38.549 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:38.548+0000 7fc9f4e00700 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fc9f0113440 con 0x7fc9f0103d90 2024-05-08T05:33:38.549 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:38.548+0000 7fc9f4e00700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7fc9f0113740 con 0x7fc9f0109460 2024-05-08T05:33:38.549 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:38.548+0000 7fc9eea00700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc9f0103d90 0x7fc9f019fc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:33:38.550 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:38.548+0000 7fc9ef400700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc9f01033d0 0x7fc9f019f740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:33:38.550 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:38.548+0000 7fc9eea00700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc9f0103d90 0x7fc9f019fc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.87:55132/0 (socket says 172.21.15.87:55132) 2024-05-08T05:33:38.550 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:38.548+0000 7fc9eea00700 1 -- 172.21.15.87:0/3782441415 learned_addr learned my addr 172.21.15.87:0/3782441415 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T05:33:38.550 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:38.548+0000 7fc9efe00700 1 --2- 172.21.15.87:0/3782441415 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc9f0109460 0x7fc9f0199900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:33:38.550 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:38.549+0000 7fc9ef400700 1 -- 172.21.15.87:0/3782441415 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc9f0109460 msgr2=0x7fc9f0199900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:33:38.550 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:38.549+0000 7fc9ef400700 1 --2- 172.21.15.87:0/3782441415 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc9f0109460 0x7fc9f0199900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:33:38.550 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:38.549+0000 7fc9ef400700 1 -- 172.21.15.87:0/3782441415 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc9f0103d90 msgr2=0x7fc9f019fc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:33:38.550 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:38.549+0000 7fc9ef400700 1 --2- 172.21.15.87:0/3782441415 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc9f0103d90 0x7fc9f019fc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:33:38.550 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:38.549+0000 7fc9ef400700 1 -- 172.21.15.87:0/3782441415 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc9f019a060 con 0x7fc9f01033d0 2024-05-08T05:33:38.550 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:38.549+0000 7fc9ef400700 1 --2- 172.21.15.87:0/3782441415 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc9f01033d0 0x7fc9f019f740 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fc9e0000c00 tx=0x7fc9e00047b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:33:38.551 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:38.549+0000 7fc9e7e00700 1 -- 172.21.15.87:0/3782441415 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9e0026070 con 0x7fc9f01033d0 2024-05-08T05:33:38.551 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:38.549+0000 7fc9f4e00700 1 -- 172.21.15.87:0/3782441415 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc9f019a2f0 con 0x7fc9f01033d0 2024-05-08T05:33:38.551 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:38.549+0000 7fc9e7e00700 1 -- 172.21.15.87:0/3782441415 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc9e0021410 con 0x7fc9f01033d0 2024-05-08T05:33:38.551 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:38.549+0000 7fc9e7e00700 1 -- 172.21.15.87:0/3782441415 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9e0017650 con 0x7fc9f01033d0 2024-05-08T05:33:38.551 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:38.549+0000 7fc9f4e00700 1 -- 172.21.15.87:0/3782441415 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc9f01a6610 con 0x7fc9f01033d0 2024-05-08T05:33:38.554 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:38.554+0000 7fc9e7e00700 1 -- 172.21.15.87:0/3782441415 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7fc9e0029070 con 0x7fc9f01033d0 2024-05-08T05:33:38.555 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:38.555+0000 7fca00d22b80 1 Processor -- start 2024-05-08T05:33:38.555 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:38.555+0000 7fca00d22b80 1 -- start start 2024-05-08T05:33:38.556 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:38.556+0000 7fca00d22b80 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x560f144819e0 0x560f14481dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:33:38.557 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:38.556+0000 7fca00d22b80 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x560f14482300 0x560f1447bfe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:33:38.557 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:38.556+0000 7fca00d22b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x560f1447c600 0x560f1447ca80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:33:38.557 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:38.556+0000 7fca00d22b80 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x560f143cea20 con 0x560f14482300 2024-05-08T05:33:38.557 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:38.556+0000 7fca00d22b80 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x560f1436c760 con 0x560f144819e0 2024-05-08T05:33:38.557 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:38.556+0000 7fca00d22b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x560f143ca9e0 con 0x560f1447c600 2024-05-08T05:33:38.557 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:38.556+0000 7fc9e7e00700 1 --2- 172.21.15.87:0/3782441415 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7fc9d40b2880 0x7fc9d40b4d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:33:38.557 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:38.556+0000 7fc9ef400700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x560f14482300 0x560f1447bfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:33:38.557 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:38.556+0000 7fc9ef400700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x560f14482300 0x560f1447bfe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:50094/0 (socket says 172.21.15.87:50094) 2024-05-08T05:33:38.557 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:38.556+0000 7fc9ef400700 1 -- 172.21.15.87:0/332848519 learned_addr learned my addr 172.21.15.87:0/332848519 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T05:33:38.557 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:38.556+0000 7fc9efe00700 1 --2- 172.21.15.87:0/332848519 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x560f144819e0 0x560f14481dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:33:38.557 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:38.556+0000 7fc9eea00700 1 --2- 172.21.15.87:0/332848519 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x560f1447c600 0x560f1447ca80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:33:38.557 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:38.557+0000 7fc9e7e00700 1 -- 172.21.15.87:0/3782441415 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8190+0+0 (secure 0 0 0) 0x7fc9e00e2fd0 con 0x7fc9f01033d0 2024-05-08T05:33:38.559 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:38.557+0000 7fc9ef400700 1 -- 172.21.15.87:0/332848519 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x560f1447c600 msgr2=0x560f1447ca80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:33:38.559 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:38.557+0000 7fc9ef400700 1 --2- 172.21.15.87:0/332848519 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x560f1447c600 0x560f1447ca80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:33:38.559 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:38.557+0000 7fc9ef400700 1 -- 172.21.15.87:0/332848519 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x560f144819e0 msgr2=0x560f14481dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:33:38.559 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:38.557+0000 7fc9ef400700 1 --2- 172.21.15.87:0/332848519 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x560f144819e0 0x560f14481dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:33:38.559 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:38.557+0000 7fc9ef400700 1 -- 172.21.15.87:0/332848519 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560f1431b8d0 con 0x560f14482300 2024-05-08T05:33:38.559 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:38.557+0000 7fc9eea00700 1 --2- 172.21.15.87:0/332848519 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x560f1447c600 0x560f1447ca80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T05:33:38.559 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:38.557+0000 7fc9efe00700 1 --2- 172.21.15.87:0/332848519 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x560f144819e0 0x560f14481dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T05:33:38.559 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:38.557+0000 7fc9efe00700 1 --2- 172.21.15.87:0/3782441415 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7fc9d40b2880 0x7fc9d40b4d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:33:38.559 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:38.557+0000 7fc9ef400700 1 --2- 172.21.15.87:0/332848519 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x560f14482300 0x560f1447bfe0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fc9e00a66d0 tx=0x7fc9e00cd050 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e459e87603f5507a server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:33:38.559 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:38.558+0000 7fc9e4c00700 1 -- 172.21.15.87:0/332848519 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9e00aad50 con 0x560f14482300 2024-05-08T05:33:38.559 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:38.558+0000 7fc9e4c00700 1 -- 172.21.15.87:0/332848519 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc9e00aa650 con 0x560f14482300 2024-05-08T05:33:38.559 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:38.558+0000 7fc9e4c00700 1 -- 172.21.15.87:0/332848519 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9e00aa8b0 con 0x560f14482300 2024-05-08T05:33:38.560 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:38.558+0000 7fca00d22b80 1 -- 172.21.15.87:0/332848519 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x560f14482300 msgr2=0x560f1447bfe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:33:38.560 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:38.558+0000 7fca00d22b80 1 --2- 172.21.15.87:0/332848519 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x560f14482300 0x560f1447bfe0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fc9e00a66d0 tx=0x7fc9e00cd050 comp rx=0 tx=0).stop 2024-05-08T05:33:38.560 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:38.558+0000 7fc9efe00700 1 --2- 172.21.15.87:0/3782441415 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7fc9d40b2880 0x7fc9d40b4d40 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fc9e8009ea0 tx=0x7fc9e8004ad0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:33:38.560 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:38.558+0000 7fca00d22b80 1 -- 172.21.15.87:0/332848519 shutdown_connections 2024-05-08T05:33:38.560 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:38.558+0000 7fca00d22b80 1 --2- 172.21.15.87:0/332848519 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x560f1447c600 0x560f1447ca80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:33:38.560 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:38.558+0000 7fca00d22b80 1 --2- 172.21.15.87:0/332848519 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x560f144819e0 0x560f14481dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:33:38.560 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:38.558+0000 7fca00d22b80 1 --2- 172.21.15.87:0/332848519 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x560f14482300 0x560f1447bfe0 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:33:38.560 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:38.558+0000 7fca00d22b80 1 -- 172.21.15.87:0/332848519 >> 172.21.15.87:0/332848519 conn(0x560f143aab60 msgr2=0x560f144769b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:33:38.560 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:38.559+0000 7fca00d22b80 1 -- 172.21.15.87:0/332848519 shutdown_connections 2024-05-08T05:33:38.560 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:38.559+0000 7fca00d22b80 1 -- 172.21.15.87:0/332848519 wait complete. 2024-05-08T05:33:38.563 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:38.559+0000 7fca00d22b80 1 -- start start 2024-05-08T05:33:38.563 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:38.559+0000 7fca00d22b80 1 Processor -- start 2024-05-08T05:33:38.563 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:38.560+0000 7fca00d22b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x560f1447c600 0x560f1448f7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:33:38.564 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:38.560+0000 7fca00d22b80 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x560f144819e0 0x560f1448fcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:33:38.564 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:38.560+0000 7fca00d22b80 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x560f14482300 0x560f14489bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:33:38.564 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:38.560+0000 7fca00d22b80 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x560f143cea20 con 0x560f144819e0 2024-05-08T05:33:38.564 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:38.560+0000 7fca00d22b80 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x560f14334b20 con 0x560f14482300 2024-05-08T05:33:38.564 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:38.560+0000 7fca00d22b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x560f14488b70 con 0x560f1447c600 2024-05-08T05:33:38.564 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:38.560+0000 7fca00d22b80 10 client.0 _ll_register_callbacks cb 0x560f14375c70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T05:33:38.564 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:38.560+0000 7fc9ef400700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x560f1447c600 0x560f1448f7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:33:38.564 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:38.560+0000 7fc9ef400700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x560f1447c600 0x560f1448f7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.87:57214/0 (socket says 172.21.15.87:57214) 2024-05-08T05:33:38.564 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:38.560+0000 7fc9eea00700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x560f144819e0 0x560f1448fcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:33:38.564 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:38.560+0000 7fc9ef400700 1 -- 172.21.15.87:0/320955994 learned_addr learned my addr 172.21.15.87:0/320955994 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T05:33:38.564 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:38.560+0000 7fc9efe00700 1 --2- 172.21.15.87:0/320955994 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x560f14482300 0x560f14489bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:33:38.564 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:38.561+0000 7fc9ef400700 1 -- 172.21.15.87:0/320955994 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x560f14482300 msgr2=0x560f14489bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:33:38.564 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:38.561+0000 7fc9ef400700 1 --2- 172.21.15.87:0/320955994 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x560f14482300 0x560f14489bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:33:38.564 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:38.561+0000 7fc9ef400700 1 -- 172.21.15.87:0/320955994 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x560f144819e0 msgr2=0x560f1448fcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:33:38.565 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:38.561+0000 7fc9ef400700 1 --2- 172.21.15.87:0/320955994 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x560f144819e0 0x560f1448fcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:33:38.565 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:38.561+0000 7fc9ef400700 1 -- 172.21.15.87:0/320955994 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560f14394420 con 0x560f1447c600 2024-05-08T05:33:38.565 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:38.561+0000 7fc9ef400700 1 --2- 172.21.15.87:0/320955994 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x560f1447c600 0x560f1448f7b0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fc9e00b10d0 tx=0x7fc9e00b3420 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1d1bb0db1581d176 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:33:38.565 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:38.561+0000 7fc9d9600700 10 client.0 ms_handle_connect on v2:172.21.15.160:3300/0 2024-05-08T05:33:38.565 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:38.561+0000 7fc9d9600700 1 -- 172.21.15.87:0/320955994 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9e00aad50 con 0x560f1447c600 2024-05-08T05:33:38.565 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:38.561+0000 7fc9d9600700 1 -- 172.21.15.87:0/320955994 <== mon.1 v2:172.21.15.160:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8190+0+0 (secure 0 0 0) 0x7fc9e00aa8b0 con 0x560f1447c600 2024-05-08T05:33:38.565 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:38.561+0000 7fca00d22b80 1 -- 172.21.15.87:0/320955994 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc9e00aa650 con 0x560f1447c600 2024-05-08T05:33:38.565 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:38.561+0000 7fc9d9600700 1 -- 172.21.15.87:0/320955994 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fc9e00aaab0 con 0x560f1447c600 2024-05-08T05:33:38.565 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:38.561+0000 7fca00d22b80 10 client.25624 fetch_fsmap learned FSMap version 29 2024-05-08T05:33:38.565 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:38.562+0000 7fca00d22b80 1 -- 172.21.15.87:0/320955994 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x560f14497480 con 0x560f1447c600 2024-05-08T05:33:38.565 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:38.562+0000 7fc9d9600700 1 -- 172.21.15.87:0/320955994 <== mon.1 v2:172.21.15.160:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc9e00aa650 con 0x560f1447c600 2024-05-08T05:33:38.565 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:38.562+0000 7fc9d9600700 1 -- 172.21.15.87:0/320955994 <== mon.1 v2:172.21.15.160:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7fc9e0090c50 con 0x560f1447c600 2024-05-08T05:33:38.565 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:38.562+0000 7fca00d22b80 10 client.25624 fetch_fsmap finished waiting for FSMap version 29 2024-05-08T05:33:38.565 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:38.562+0000 7fca00d22b80 10 client.25624 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.g 2024-05-08T05:33:38.565 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:38.562+0000 7fca00d22b80 20 client.25624 populate_metadata read hostname 'smithi087' 2024-05-08T05:33:38.566 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:38.562+0000 7fca00d22b80 1 --2- 172.21.15.87:0/320955994 >> [v2:172.21.15.87:6838/2127215876,v1:172.21.15.87:6839/2127215876] conn(0x560f14499950 0x560f1449bd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:33:38.566 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:38.562+0000 7fca00d22b80 4 client.25624 mds_command: new command op to 24482 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-08T05:33:38.566 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:38.562+0000 7fca00d22b80 1 -- 172.21.15.87:0/320955994 --> [v2:172.21.15.87:6838/2127215876,v1:172.21.15.87:6839/2127215876] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x560f144490a0 con 0x560f14499950 2024-05-08T05:33:38.566 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:38.562+0000 7fc9eea00700 1 --2- 172.21.15.87:0/320955994 >> [v2:172.21.15.87:6838/2127215876,v1:172.21.15.87:6839/2127215876] conn(0x560f14499950 0x560f1449bd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:33:38.566 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:38.563+0000 7fc9eea00700 1 --2- 172.21.15.87:0/320955994 >> [v2:172.21.15.87:6838/2127215876,v1:172.21.15.87:6839/2127215876] conn(0x560f14499950 0x560f1449bd40 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=b6700d30932669d8 server_cookie=bf82c72ec7bd7238 in_seq=0 out_seq=0 2024-05-08T05:33:38.566 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:38.563+0000 7fc9d9600700 10 client.25624 ms_handle_connect on v2:172.21.15.87:6838/2127215876 2024-05-08T05:33:38.567 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:38.564+0000 7fc9d9600700 1 -- 172.21.15.87:0/320955994 <== mds.1 v2:172.21.15.87:6838/2127215876 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x560f144490a0 con 0x560f14499950 2024-05-08T05:33:38.567 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:38.564+0000 7fc9d9600700 10 client.25624 handle_command_reply: tid=0 2024-05-08T05:33:38.567 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:38.564+0000 7fca00d22b80 1 client.25624 shutdown 2024-05-08T05:33:38.567 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:38.564+0000 7fca00d22b80 1 -- 172.21.15.87:0/320955994 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x560f1447c600 msgr2=0x560f1448f7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:33:38.567 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:38.564+0000 7fca00d22b80 1 --2- 172.21.15.87:0/320955994 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x560f1447c600 0x560f1448f7b0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fc9e00b10d0 tx=0x7fc9e00b3420 comp rx=0 tx=0).stop 2024-05-08T05:33:38.567 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:38.564+0000 7fca00d22b80 1 -- 172.21.15.87:0/320955994 shutdown_connections 2024-05-08T05:33:38.567 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:38.564+0000 7fca00d22b80 1 --2- 172.21.15.87:0/320955994 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x560f14482300 0x560f14489bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:33:38.567 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:38.564+0000 7fca00d22b80 1 --2- 172.21.15.87:0/320955994 >> [v2:172.21.15.87:6838/2127215876,v1:172.21.15.87:6839/2127215876] conn(0x560f14499950 0x560f1449bd40 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:33:38.567 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:38.564+0000 7fca00d22b80 1 --2- 172.21.15.87:0/320955994 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x560f1447c600 0x560f1448f7b0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:33:38.567 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:38.564+0000 7fca00d22b80 1 --2- 172.21.15.87:0/320955994 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x560f144819e0 0x560f1448fcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:33:38.567 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:38.564+0000 7fca00d22b80 1 -- 172.21.15.87:0/320955994 >> 172.21.15.87:0/320955994 conn(0x560f143aab60 msgr2=0x560f14471460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:33:38.567 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:38.564+0000 7fc9d9600700 0 client.25624 ms_handle_reset on v2:172.21.15.87:6838/2127215876 2024-05-08T05:33:38.567 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:38.564+0000 7fca00d22b80 1 -- 172.21.15.87:0/320955994 shutdown_connections 2024-05-08T05:33:38.567 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:38.564+0000 7fca00d22b80 1 -- 172.21.15.87:0/320955994 wait complete. 2024-05-08T05:33:38.568 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:38.564+0000 7fca00d22b80 20 client.25624 trim_cache size 0 max 16384 2024-05-08T05:33:38.582 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:38.581+0000 7fca00d22b80 1 Processor -- start 2024-05-08T05:33:38.583 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:38.581+0000 7fca00d22b80 1 -- start start 2024-05-08T05:33:38.583 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:38.581+0000 7fca00d22b80 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x560f1447c600 0x560f1447bfe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:33:38.583 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:38.581+0000 7fca00d22b80 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x560f144819e0 0x560f1447dbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:33:38.583 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:38.581+0000 7fca00d22b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x560f14482300 0x560f144a1460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:33:38.583 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:38.581+0000 7fca00d22b80 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fc9f01ae0a0 con 0x560f144819e0 2024-05-08T05:33:38.583 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:38.581+0000 7fca00d22b80 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fc9f01ab870 con 0x560f1447c600 2024-05-08T05:33:38.583 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:38.581+0000 7fca00d22b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7fc9f01a96c0 con 0x560f14482300 2024-05-08T05:33:38.583 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:38.581+0000 7fc9eea00700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x560f144819e0 0x560f1447dbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:33:38.583 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:38.581+0000 7fc9eea00700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x560f144819e0 0x560f1447dbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:50118/0 (socket says 172.21.15.87:50118) 2024-05-08T05:33:38.583 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:38.581+0000 7fc9eea00700 1 -- 172.21.15.87:0/1076301262 learned_addr learned my addr 172.21.15.87:0/1076301262 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T05:33:38.583 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:38.582+0000 7fc9efe00700 1 --2- 172.21.15.87:0/1076301262 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x560f14482300 0x560f144a1460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:33:38.583 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:38.582+0000 7fc9ef400700 1 --2- 172.21.15.87:0/1076301262 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x560f1447c600 0x560f1447bfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:33:38.583 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:38.582+0000 7fc9ef400700 1 -- 172.21.15.87:0/1076301262 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x560f14482300 msgr2=0x560f144a1460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:33:38.584 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:38.582+0000 7fc9ef400700 1 --2- 172.21.15.87:0/1076301262 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x560f14482300 0x560f144a1460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:33:38.584 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:38.582+0000 7fc9ef400700 1 -- 172.21.15.87:0/1076301262 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x560f144819e0 msgr2=0x560f1447dbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:33:38.584 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:38.582+0000 7fc9ef400700 1 --2- 172.21.15.87:0/1076301262 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x560f144819e0 0x560f1447dbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:33:38.584 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:38.582+0000 7fc9ef400700 1 -- 172.21.15.87:0/1076301262 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560f14480990 con 0x560f1447c600 2024-05-08T05:33:38.584 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:38.582+0000 7fc9eea00700 1 --2- 172.21.15.87:0/1076301262 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x560f144819e0 0x560f1447dbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T05:33:38.584 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:38.582+0000 7fc9ef400700 1 --2- 172.21.15.87:0/1076301262 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x560f1447c600 0x560f1447bfe0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fc9e00213e0 tx=0x7fc9e00217d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cdc521965b2f1c90 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:33:38.584 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:38.582+0000 7fc9dbe00700 1 -- 172.21.15.87:0/1076301262 <== mon.2 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9e00a6510 con 0x560f1447c600 2024-05-08T05:33:38.584 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:38.582+0000 7fc9dbe00700 1 -- 172.21.15.87:0/1076301262 <== mon.2 v2:172.21.15.90:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc9e00aad50 con 0x560f1447c600 2024-05-08T05:33:38.584 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:38.582+0000 7fc9dbe00700 1 -- 172.21.15.87:0/1076301262 <== mon.2 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9e0090bc0 con 0x560f1447c600 2024-05-08T05:33:38.585 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:38.583+0000 7fca00d22b80 1 -- 172.21.15.87:0/1076301262 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x560f1447c600 msgr2=0x560f1447bfe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:33:38.585 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:38.583+0000 7fca00d22b80 1 --2- 172.21.15.87:0/1076301262 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x560f1447c600 0x560f1447bfe0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fc9e00213e0 tx=0x7fc9e00217d0 comp rx=0 tx=0).stop 2024-05-08T05:33:38.585 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:38.583+0000 7fca00d22b80 1 -- 172.21.15.87:0/1076301262 shutdown_connections 2024-05-08T05:33:38.585 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:38.583+0000 7fca00d22b80 1 --2- 172.21.15.87:0/1076301262 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x560f14482300 0x560f144a1460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:33:38.586 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:38.583+0000 7fca00d22b80 1 --2- 172.21.15.87:0/1076301262 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x560f1447c600 0x560f1447bfe0 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:33:38.586 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:38.583+0000 7fca00d22b80 1 --2- 172.21.15.87:0/1076301262 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x560f144819e0 0x560f1447dbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:33:38.586 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:38.583+0000 7fca00d22b80 1 -- 172.21.15.87:0/1076301262 >> 172.21.15.87:0/1076301262 conn(0x560f143aab60 msgr2=0x560f1447d4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:33:38.586 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:38.584+0000 7fca00d22b80 1 -- 172.21.15.87:0/1076301262 shutdown_connections 2024-05-08T05:33:38.586 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:38.584+0000 7fca00d22b80 1 -- 172.21.15.87:0/1076301262 wait complete. 2024-05-08T05:33:38.586 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:38.584+0000 7fca00d22b80 1 -- start start 2024-05-08T05:33:38.586 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:38.584+0000 7fca00d22b80 1 Processor -- start 2024-05-08T05:33:38.586 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:38.585+0000 7fca00d22b80 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x560f1447c600 0x560f1447f2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:33:38.586 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:38.585+0000 7fca00d22b80 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x560f144819e0 0x560f1447f810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:33:38.588 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:38.585+0000 7fca00d22b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x560f14482300 0x560f144fbfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:33:38.588 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:38.585+0000 7fca00d22b80 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fc9f01a9d30 con 0x560f1447c600 2024-05-08T05:33:38.588 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:38.585+0000 7fca00d22b80 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fc9f01ab1a0 con 0x560f144819e0 2024-05-08T05:33:38.588 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:38.585+0000 7fca00d22b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7fc9f01aa400 con 0x560f14482300 2024-05-08T05:33:38.588 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:38.585+0000 7fca00d22b80 10 client.0 _ll_register_callbacks cb 0x560f14375c70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T05:33:38.588 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:38.585+0000 7fc9ef400700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x560f1447c600 0x560f1447f2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:33:38.588 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:38.585+0000 7fc9ef400700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x560f1447c600 0x560f1447f2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:50128/0 (socket says 172.21.15.87:50128) 2024-05-08T05:33:38.588 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:38.585+0000 7fc9ef400700 1 -- 172.21.15.87:0/159781948 learned_addr learned my addr 172.21.15.87:0/159781948 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T05:33:38.588 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:38.585+0000 7fc9eea00700 1 --2- 172.21.15.87:0/159781948 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x560f144819e0 0x560f1447f810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:33:38.589 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:38.586+0000 7fc9efe00700 1 --2- 172.21.15.87:0/159781948 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x560f14482300 0x560f144fbfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:33:38.589 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:38.586+0000 7fc9eea00700 1 -- 172.21.15.87:0/159781948 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x560f14482300 msgr2=0x560f144fbfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:33:38.589 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:38.586+0000 7fc9eea00700 1 --2- 172.21.15.87:0/159781948 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x560f14482300 0x560f144fbfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:33:38.589 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:38.586+0000 7fc9eea00700 1 -- 172.21.15.87:0/159781948 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x560f1447c600 msgr2=0x560f1447f2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:33:38.589 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:38.586+0000 7fc9eea00700 1 --2- 172.21.15.87:0/159781948 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x560f1447c600 0x560f1447f2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:33:38.589 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:38.586+0000 7fc9eea00700 1 -- 172.21.15.87:0/159781948 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560f144fc5c0 con 0x560f144819e0 2024-05-08T05:33:38.589 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:38.586+0000 7fc9eea00700 1 --2- 172.21.15.87:0/159781948 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x560f144819e0 0x560f1447f810 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fc9dc004790 tx=0x7fc9dc004b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b9837d2de91384c7 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:33:38.589 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:38.586+0000 7fc9d9600700 10 client.0 ms_handle_connect on v2:172.21.15.90:3300/0 2024-05-08T05:33:38.589 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:38.586+0000 7fc9d9600700 1 -- 172.21.15.87:0/159781948 <== mon.2 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9dc005650 con 0x560f144819e0 2024-05-08T05:33:38.589 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:38.586+0000 7fc9d9600700 1 -- 172.21.15.87:0/159781948 <== mon.2 v2:172.21.15.90:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8190+0+0 (secure 0 0 0) 0x7fc9dc004020 con 0x560f144819e0 2024-05-08T05:33:38.589 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:38.586+0000 7fca00d22b80 1 -- 172.21.15.87:0/159781948 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc9e00aad50 con 0x560f144819e0 2024-05-08T05:33:38.590 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:38.587+0000 7fc9d9600700 1 -- 172.21.15.87:0/159781948 <== mon.2 v2:172.21.15.90:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fc9dc004220 con 0x560f144819e0 2024-05-08T05:33:38.590 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:38.587+0000 7fca00d22b80 10 client.25658 fetch_fsmap learned FSMap version 29 2024-05-08T05:33:38.590 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:38.587+0000 7fca00d22b80 1 -- 172.21.15.87:0/159781948 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x560f145039a0 con 0x560f144819e0 2024-05-08T05:33:38.590 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:38.587+0000 7fc9d9600700 1 -- 172.21.15.87:0/159781948 <== mon.2 v2:172.21.15.90:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc9e00aad50 con 0x560f144819e0 2024-05-08T05:33:38.590 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:38.587+0000 7fc9d9600700 1 -- 172.21.15.87:0/159781948 <== mon.2 v2:172.21.15.90:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7fc9dc003810 con 0x560f144819e0 2024-05-08T05:33:38.590 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:38.587+0000 7fca00d22b80 10 client.25658 fetch_fsmap finished waiting for FSMap version 29 2024-05-08T05:33:38.590 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:38.587+0000 7fca00d22b80 10 client.25658 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.g 2024-05-08T05:33:38.590 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:38.587+0000 7fca00d22b80 20 client.25658 populate_metadata read hostname 'smithi087' 2024-05-08T05:33:38.590 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:38.587+0000 7fca00d22b80 1 --2- 172.21.15.87:0/159781948 >> [v2:172.21.15.87:6838/2127215876,v1:172.21.15.87:6839/2127215876] conn(0x560f14504110 0x560f14506530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:33:38.590 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:38.587+0000 7fca00d22b80 4 client.25658 mds_command: new command op to 24482 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-05-08T05:33:38.591 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:38.587+0000 7fca00d22b80 1 -- 172.21.15.87:0/159781948 --> [v2:172.21.15.87:6838/2127215876,v1:172.21.15.87:6839/2127215876] -- command(tid 0: {"prefix": "damage ls"}) -- 0x560f143dc400 con 0x560f14504110 2024-05-08T05:33:38.591 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:38.588+0000 7fc9ef400700 1 --2- 172.21.15.87:0/159781948 >> [v2:172.21.15.87:6838/2127215876,v1:172.21.15.87:6839/2127215876] conn(0x560f14504110 0x560f14506530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:33:38.592 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:38.588+0000 7fc9ef400700 1 --2- 172.21.15.87:0/159781948 >> [v2:172.21.15.87:6838/2127215876,v1:172.21.15.87:6839/2127215876] conn(0x560f14504110 0x560f14506530 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=5953d0c636114f1b server_cookie=f9979590b75f061 in_seq=0 out_seq=0 2024-05-08T05:33:38.592 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:38.588+0000 7fc9d9600700 10 client.25658 ms_handle_connect on v2:172.21.15.87:6838/2127215876 2024-05-08T05:33:38.592 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:38.589+0000 7fc9d9600700 1 -- 172.21.15.87:0/159781948 <== mds.1 v2:172.21.15.87:6838/2127215876 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x560f143dc400 con 0x560f14504110 2024-05-08T05:33:38.592 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:38.589+0000 7fc9d9600700 10 client.25658 handle_command_reply: tid=0 2024-05-08T05:33:38.592 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:38.589+0000 7fca00d22b80 1 client.25658 shutdown 2024-05-08T05:33:38.592 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:38.589+0000 7fca00d22b80 1 -- 172.21.15.87:0/159781948 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x560f144819e0 msgr2=0x560f1447f810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:33:38.592 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:38.589+0000 7fca00d22b80 1 --2- 172.21.15.87:0/159781948 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x560f144819e0 0x560f1447f810 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fc9dc004790 tx=0x7fc9dc004b60 comp rx=0 tx=0).stop 2024-05-08T05:33:38.592 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:38.589+0000 7fca00d22b80 1 -- 172.21.15.87:0/159781948 shutdown_connections 2024-05-08T05:33:38.593 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:38.589+0000 7fca00d22b80 1 --2- 172.21.15.87:0/159781948 >> [v2:172.21.15.87:6838/2127215876,v1:172.21.15.87:6839/2127215876] conn(0x560f14504110 0x560f14506530 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:33:38.593 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:38.589+0000 7fc9d9600700 0 client.25658 ms_handle_reset on v2:172.21.15.87:6838/2127215876 2024-05-08T05:33:38.593 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:38.589+0000 7fca00d22b80 1 --2- 172.21.15.87:0/159781948 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x560f14482300 0x560f144fbfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:33:38.593 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:38.589+0000 7fca00d22b80 1 --2- 172.21.15.87:0/159781948 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x560f1447c600 0x560f1447f2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:33:38.593 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:38.589+0000 7fca00d22b80 1 --2- 172.21.15.87:0/159781948 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x560f144819e0 0x560f1447f810 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:33:38.593 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:38.589+0000 7fca00d22b80 1 -- 172.21.15.87:0/159781948 >> 172.21.15.87:0/159781948 conn(0x560f143aab60 msgr2=0x560f144893a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:33:38.593 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:38.589+0000 7fca00d22b80 1 -- 172.21.15.87:0/159781948 shutdown_connections 2024-05-08T05:33:38.593 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:38.589+0000 7fca00d22b80 1 -- 172.21.15.87:0/159781948 wait complete. 2024-05-08T05:33:38.593 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:38.590+0000 7fca00d22b80 20 client.25658 trim_cache size 0 max 16384 2024-05-08T05:33:38.593 INFO:teuthology.orchestra.run.smithi087.stdout:[] 2024-05-08T05:33:38.594 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:38.591+0000 7fc9f4e00700 1 -- 172.21.15.87:0/3782441415 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7fc9d40b2880 msgr2=0x7fc9d40b4d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:33:38.594 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:38.591+0000 7fc9f4e00700 1 --2- 172.21.15.87:0/3782441415 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7fc9d40b2880 0x7fc9d40b4d40 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fc9e8009ea0 tx=0x7fc9e8004ad0 comp rx=0 tx=0).stop 2024-05-08T05:33:38.595 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:38.591+0000 7fc9f4e00700 1 -- 172.21.15.87:0/3782441415 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc9f01033d0 msgr2=0x7fc9f019f740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:33:38.595 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:38.591+0000 7fc9f4e00700 1 --2- 172.21.15.87:0/3782441415 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc9f01033d0 0x7fc9f019f740 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fc9e0000c00 tx=0x7fc9e00047b0 comp rx=0 tx=0).stop 2024-05-08T05:33:38.595 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:38.591+0000 7fc9f4e00700 1 -- 172.21.15.87:0/3782441415 shutdown_connections 2024-05-08T05:33:38.595 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:38.591+0000 7fc9f4e00700 1 --2- 172.21.15.87:0/3782441415 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7fc9d40b2880 0x7fc9d40b4d40 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:33:38.595 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:38.591+0000 7fc9f4e00700 1 --2- 172.21.15.87:0/3782441415 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc9f0109460 0x7fc9f0199900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:33:38.595 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:38.591+0000 7fc9f4e00700 1 --2- 172.21.15.87:0/3782441415 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc9f01033d0 0x7fc9f019f740 secure :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fc9e0000c00 tx=0x7fc9e00047b0 comp rx=0 tx=0).stop 2024-05-08T05:33:38.595 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:38.591+0000 7fc9f4e00700 1 --2- 172.21.15.87:0/3782441415 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc9f0103d90 0x7fc9f019fc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:33:38.595 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:38.591+0000 7fc9f4e00700 1 -- 172.21.15.87:0/3782441415 >> 172.21.15.87:0/3782441415 conn(0x7fc9f00fef20 msgr2=0x7fc9f00ff6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:33:38.595 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:38.591+0000 7fc9f4e00700 1 -- 172.21.15.87:0/3782441415 shutdown_connections 2024-05-08T05:33:38.595 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:38.591+0000 7fc9f4e00700 1 -- 172.21.15.87:0/3782441415 wait complete. 2024-05-08T05:33:38.708 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:33:38 smithi087 ceph-mon[29523]: pgmap v559: 97 pgs: 97 active+clean; 155 MiB data, 987 MiB used, 1.0 TiB / 1.0 TiB avail; 802 KiB/s rd, 807 KiB/s wr, 179 op/s 2024-05-08T05:33:38.788 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:33:38 smithi160 ceph-mon[34827]: pgmap v559: 97 pgs: 97 active+clean; 155 MiB data, 987 MiB used, 1.0 TiB / 1.0 TiB avail; 802 KiB/s rd, 807 KiB/s wr, 179 op/s 2024-05-08T05:33:38.901 DEBUG:teuthology.parallel:result is None 2024-05-08T05:33:38.902 DEBUG:teuthology.orchestra.run.smithi087:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-05-08T05:33:38.983 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:33:38 smithi090 ceph-mon[34526]: pgmap v559: 97 pgs: 97 active+clean; 155 MiB data, 987 MiB used, 1.0 TiB / 1.0 TiB avail; 802 KiB/s rd, 807 KiB/s wr, 179 op/s 2024-05-08T05:33:38.990 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-05-08T05:33:38.990 DEBUG:teuthology.run_tasks:Unwinding manager fwd_scrub 2024-05-08T05:33:39.001 INFO:tasks.fwd_scrub:joining ForwardScrubbers 2024-05-08T05:33:39.603 DEBUG:teuthology.orchestra.run.smithi087:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid eeeb813e-0cf9-11ef-bc97-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-05-08T05:33:40.037 INFO:teuthology.orchestra.run.smithi087.stderr:Inferring config /var/lib/ceph/eeeb813e-0cf9-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T05:33:40.710 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:33:40 smithi087 ceph-mon[29523]: pgmap v560: 97 pgs: 97 active+clean; 155 MiB data, 958 MiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.0 MiB/s wr, 223 op/s 2024-05-08T05:33:40.788 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:33:40 smithi160 ceph-mon[34827]: pgmap v560: 97 pgs: 97 active+clean; 155 MiB data, 958 MiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.0 MiB/s wr, 223 op/s 2024-05-08T05:33:40.983 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:33:40 smithi090 ceph-mon[34526]: pgmap v560: 97 pgs: 97 active+clean; 155 MiB data, 958 MiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.0 MiB/s wr, 223 op/s 2024-05-08T05:33:42.576 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:42.574+0000 7fe8a5a00700 1 -- 172.21.15.87:0/1191688132 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe8a0109460 msgr2=0x7fe8a0109840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:33:42.576 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:42.574+0000 7fe8a5a00700 1 --2- 172.21.15.87:0/1191688132 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe8a0109460 0x7fe8a0109840 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fe8900098f0 tx=0x7fe890009c00 comp rx=0 tx=0).stop 2024-05-08T05:33:42.577 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:42.574+0000 7fe8a5a00700 1 -- 172.21.15.87:0/1191688132 shutdown_connections 2024-05-08T05:33:42.577 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:42.574+0000 7fe8a5a00700 1 --2- 172.21.15.87:0/1191688132 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe8a0103d90 0x7fe8a01102a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:33:42.577 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:42.574+0000 7fe8a5a00700 1 --2- 172.21.15.87:0/1191688132 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe8a0109460 0x7fe8a0109840 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:33:42.577 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:42.574+0000 7fe8a5a00700 1 --2- 172.21.15.87:0/1191688132 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe8a01033d0 0x7fe8a0103850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:33:42.577 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:42.574+0000 7fe8a5a00700 1 -- 172.21.15.87:0/1191688132 >> 172.21.15.87:0/1191688132 conn(0x7fe8a00fef20 msgr2=0x7fe8a0101340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:33:42.577 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:42.574+0000 7fe8a5a00700 1 -- 172.21.15.87:0/1191688132 shutdown_connections 2024-05-08T05:33:42.577 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:42.574+0000 7fe8a5a00700 1 -- 172.21.15.87:0/1191688132 wait complete. 2024-05-08T05:33:42.577 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:42.575+0000 7fe8a5a00700 1 Processor -- start 2024-05-08T05:33:42.577 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:42.576+0000 7fe8a5a00700 1 -- start start 2024-05-08T05:33:42.577 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:42.576+0000 7fe8a5a00700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe8a01033d0 0x7fe8a01a1a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:33:42.577 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:42.576+0000 7fe8a5a00700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe8a0103d90 0x7fe8a01a1f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:33:42.579 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:42.576+0000 7fe8a5a00700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe8a0109460 0x7fe8a019bb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:33:42.579 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:42.576+0000 7fe8a5a00700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fe8a01135c0 con 0x7fe8a0109460 2024-05-08T05:33:42.579 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:42.576+0000 7fe8a5a00700 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fe8a0113440 con 0x7fe8a0103d90 2024-05-08T05:33:42.579 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:42.576+0000 7fe8a5a00700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7fe8a0113740 con 0x7fe8a01033d0 2024-05-08T05:33:42.579 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:42.576+0000 7fe89fe00700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe8a01033d0 0x7fe8a01a1a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:33:42.579 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:42.576+0000 7fe89fe00700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe8a01033d0 0x7fe8a01a1a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.87:57254/0 (socket says 172.21.15.87:57254) 2024-05-08T05:33:42.579 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:42.576+0000 7fe89fe00700 1 -- 172.21.15.87:0/1388605953 learned_addr learned my addr 172.21.15.87:0/1388605953 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T05:33:42.579 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:42.576+0000 7fe89f400700 1 --2- 172.21.15.87:0/1388605953 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe8a0103d90 0x7fe8a01a1f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:33:42.579 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:42.577+0000 7fe89fe00700 1 -- 172.21.15.87:0/1388605953 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe8a0103d90 msgr2=0x7fe8a01a1f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:33:42.580 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:42.577+0000 7fe89fe00700 1 --2- 172.21.15.87:0/1388605953 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe8a0103d90 0x7fe8a01a1f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:33:42.580 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:42.577+0000 7fe89fe00700 1 -- 172.21.15.87:0/1388605953 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe8a0109460 msgr2=0x7fe8a019bb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:33:42.580 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:42.577+0000 7fe89fe00700 1 --2- 172.21.15.87:0/1388605953 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe8a0109460 0x7fe8a019bb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:33:42.580 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:42.577+0000 7fe89fe00700 1 -- 172.21.15.87:0/1388605953 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe8a019c400 con 0x7fe8a01033d0 2024-05-08T05:33:42.580 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:42.577+0000 7fe89f400700 1 --2- 172.21.15.87:0/1388605953 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe8a0103d90 0x7fe8a01a1f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T05:33:42.580 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:42.577+0000 7fe89fe00700 1 --2- 172.21.15.87:0/1388605953 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe8a01033d0 0x7fe8a01a1a50 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fe890009230 tx=0x7fe89000fa70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:33:42.580 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:42.578+0000 7fe89cc00700 1 -- 172.21.15.87:0/1388605953 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8900050c0 con 0x7fe8a01033d0 2024-05-08T05:33:42.580 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:42.578+0000 7fe89cc00700 1 -- 172.21.15.87:0/1388605953 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe89000b560 con 0x7fe8a01033d0 2024-05-08T05:33:42.580 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:42.578+0000 7fe8a5a00700 1 -- 172.21.15.87:0/1388605953 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe8a019c690 con 0x7fe8a01033d0 2024-05-08T05:33:42.580 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:42.578+0000 7fe89cc00700 1 -- 172.21.15.87:0/1388605953 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe890003a40 con 0x7fe8a01033d0 2024-05-08T05:33:42.581 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:42.578+0000 7fe8a5a00700 1 -- 172.21.15.87:0/1388605953 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe8a01a8800 con 0x7fe8a01033d0 2024-05-08T05:33:42.582 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:42.582+0000 7fe89cc00700 1 -- 172.21.15.87:0/1388605953 <== mon.1 v2:172.21.15.160:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7fe890003c00 con 0x7fe8a01033d0 2024-05-08T05:33:42.582 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:42.582+0000 7fe8b18f0b80 1 Processor -- start 2024-05-08T05:33:42.583 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:42.583+0000 7fe8b18f0b80 1 -- start start 2024-05-08T05:33:42.585 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:42.583+0000 7fe8b18f0b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x560198cd1da0 0x560198cd2180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:33:42.585 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:42.583+0000 7fe8b18f0b80 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x560198cd26c0 0x560198ccc430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:33:42.585 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:42.583+0000 7fe8b18f0b80 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x560198ccca50 0x560198ccced0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:33:42.585 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:42.583+0000 7fe8b18f0b80 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x560198c1ea20 con 0x560198cd26c0 2024-05-08T05:33:42.585 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:42.583+0000 7fe8b18f0b80 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x560198bbc760 con 0x560198ccca50 2024-05-08T05:33:42.585 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:42.583+0000 7fe8b18f0b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x560198c1a9e0 con 0x560198cd1da0 2024-05-08T05:33:42.585 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:42.583+0000 7fe89fe00700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x560198cd26c0 0x560198ccc430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:33:42.586 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:42.583+0000 7fe89cc00700 1 --2- 172.21.15.87:0/1388605953 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7fe8840b2880 0x7fe8840b4d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:33:42.586 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:42.583+0000 7fe89fe00700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x560198cd26c0 0x560198ccc430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:50158/0 (socket says 172.21.15.87:50158) 2024-05-08T05:33:42.586 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:42.583+0000 7fe89fe00700 1 -- 172.21.15.87:0/2801060889 learned_addr learned my addr 172.21.15.87:0/2801060889 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T05:33:42.586 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:42.583+0000 7fe89f400700 1 --2- 172.21.15.87:0/2801060889 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x560198ccca50 0x560198ccced0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:33:42.586 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:42.584+0000 7fe8a5000700 1 --2- 172.21.15.87:0/2801060889 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x560198cd1da0 0x560198cd2180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:33:42.586 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:42.584+0000 7fe89cc00700 1 -- 172.21.15.87:0/1388605953 <== mon.1 v2:172.21.15.160:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8190+0+0 (secure 0 0 0) 0x7fe8900e31a0 con 0x7fe8a01033d0 2024-05-08T05:33:42.586 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:42.584+0000 7fe89fe00700 1 -- 172.21.15.87:0/2801060889 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x560198cd1da0 msgr2=0x560198cd2180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:33:42.586 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:42.584+0000 7fe89fe00700 1 --2- 172.21.15.87:0/2801060889 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x560198cd1da0 0x560198cd2180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:33:42.586 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:42.584+0000 7fe89fe00700 1 -- 172.21.15.87:0/2801060889 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x560198ccca50 msgr2=0x560198ccced0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:33:42.586 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:42.584+0000 7fe89fe00700 1 --2- 172.21.15.87:0/2801060889 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x560198ccca50 0x560198ccced0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:33:42.586 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:42.584+0000 7fe89fe00700 1 -- 172.21.15.87:0/2801060889 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560198b6b8d0 con 0x560198cd26c0 2024-05-08T05:33:42.586 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:42.584+0000 7fe8a5000700 1 --2- 172.21.15.87:0/2801060889 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x560198cd1da0 0x560198cd2180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T05:33:42.587 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:42.584+0000 7fe8a5000700 1 --2- 172.21.15.87:0/1388605953 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7fe8840b2880 0x7fe8840b4d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:33:42.587 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:42.584+0000 7fe89fe00700 1 --2- 172.21.15.87:0/2801060889 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x560198cd26c0 0x560198ccc430 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fe890005950 tx=0x7fe890009260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9c0b0db7c3398acb server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:33:42.587 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:42.584+0000 7fe895600700 1 -- 172.21.15.87:0/2801060889 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8900a9f90 con 0x560198cd26c0 2024-05-08T05:33:42.587 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:42.585+0000 7fe895600700 1 -- 172.21.15.87:0/2801060889 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe8900cd0e0 con 0x560198cd26c0 2024-05-08T05:33:42.587 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:42.585+0000 7fe895600700 1 -- 172.21.15.87:0/2801060889 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8900a6ab0 con 0x560198cd26c0 2024-05-08T05:33:42.590 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:42.585+0000 7fe8b18f0b80 1 -- 172.21.15.87:0/2801060889 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x560198cd26c0 msgr2=0x560198ccc430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:33:42.590 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:42.585+0000 7fe8a5000700 1 --2- 172.21.15.87:0/1388605953 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7fe8840b2880 0x7fe8840b4d40 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fe898009c10 tx=0x7fe898004ad0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:33:42.590 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:42.585+0000 7fe8b18f0b80 1 --2- 172.21.15.87:0/2801060889 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x560198cd26c0 0x560198ccc430 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fe890005950 tx=0x7fe890009260 comp rx=0 tx=0).stop 2024-05-08T05:33:42.590 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:42.586+0000 7fe8b18f0b80 1 -- 172.21.15.87:0/2801060889 shutdown_connections 2024-05-08T05:33:42.590 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:42.586+0000 7fe8b18f0b80 1 --2- 172.21.15.87:0/2801060889 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x560198ccca50 0x560198ccced0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:33:42.591 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:42.586+0000 7fe8b18f0b80 1 --2- 172.21.15.87:0/2801060889 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x560198cd1da0 0x560198cd2180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:33:42.591 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:42.586+0000 7fe8b18f0b80 1 --2- 172.21.15.87:0/2801060889 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x560198cd26c0 0x560198ccc430 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:33:42.591 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:42.586+0000 7fe8b18f0b80 1 -- 172.21.15.87:0/2801060889 >> 172.21.15.87:0/2801060889 conn(0x560198c446d0 msgr2=0x560198cc6ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:33:42.591 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:42.586+0000 7fe8b18f0b80 1 -- 172.21.15.87:0/2801060889 shutdown_connections 2024-05-08T05:33:42.591 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:42.586+0000 7fe8b18f0b80 1 -- 172.21.15.87:0/2801060889 wait complete. 2024-05-08T05:33:42.591 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:42.586+0000 7fe8b18f0b80 1 -- start start 2024-05-08T05:33:42.591 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:42.586+0000 7fe8b18f0b80 1 Processor -- start 2024-05-08T05:33:42.591 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:42.587+0000 7fe8b18f0b80 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x560198ccca50 0x560198cd8530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:33:42.591 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:42.587+0000 7fe8b18f0b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x560198cd1da0 0x560198cd58d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:33:42.591 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:42.587+0000 7fe8b18f0b80 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x560198cd26c0 0x560198cd5e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:33:42.591 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:42.587+0000 7fe8b18f0b80 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x560198cd8f10 con 0x560198cd26c0 2024-05-08T05:33:42.592 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:42.587+0000 7fe8b18f0b80 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x560198b84b20 con 0x560198ccca50 2024-05-08T05:33:42.592 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:42.587+0000 7fe8b18f0b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x560198cd9090 con 0x560198cd1da0 2024-05-08T05:33:42.592 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:42.587+0000 7fe8b18f0b80 10 client.0 _ll_register_callbacks cb 0x560198bc5c70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T05:33:42.592 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:42.587+0000 7fe8a5000700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x560198cd26c0 0x560198cd5e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:33:42.592 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:42.587+0000 7fe8a5000700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x560198cd26c0 0x560198cd5e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:50160/0 (socket says 172.21.15.87:50160) 2024-05-08T05:33:42.592 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:42.587+0000 7fe8a5000700 1 -- 172.21.15.87:0/3217638999 learned_addr learned my addr 172.21.15.87:0/3217638999 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T05:33:42.592 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:42.587+0000 7fe89fe00700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x560198ccca50 0x560198cd8530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:33:42.592 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:42.588+0000 7fe89f400700 1 --2- 172.21.15.87:0/3217638999 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x560198cd1da0 0x560198cd58d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:33:42.592 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:42.588+0000 7fe8a5000700 1 -- 172.21.15.87:0/3217638999 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x560198cd1da0 msgr2=0x560198cd58d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:33:42.592 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:42.588+0000 7fe8a5000700 1 --2- 172.21.15.87:0/3217638999 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x560198cd1da0 0x560198cd58d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:33:42.592 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:42.588+0000 7fe8a5000700 1 -- 172.21.15.87:0/3217638999 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x560198ccca50 msgr2=0x560198cd8530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:33:42.592 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:42.588+0000 7fe8a5000700 1 --2- 172.21.15.87:0/3217638999 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x560198ccca50 0x560198cd8530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:33:42.593 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:42.588+0000 7fe8a5000700 1 -- 172.21.15.87:0/3217638999 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560198be4420 con 0x560198cd26c0 2024-05-08T05:33:42.593 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:42.588+0000 7fe8a5000700 1 --2- 172.21.15.87:0/3217638999 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x560198cd26c0 0x560198cd5e10 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fe898015d30 tx=0x7fe898009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5a3f425c753fe768 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:33:42.593 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:42.588+0000 7fe88a000700 10 client.0 ms_handle_connect on v2:172.21.15.87:3300/0 2024-05-08T05:33:42.593 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:42.588+0000 7fe88a000700 1 -- 172.21.15.87:0/3217638999 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe898025060 con 0x560198cd26c0 2024-05-08T05:33:42.593 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:42.588+0000 7fe88a000700 1 -- 172.21.15.87:0/3217638999 <== mon.0 v2:172.21.15.87:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8190+0+0 (secure 0 0 0) 0x7fe8980149e0 con 0x560198cd26c0 2024-05-08T05:33:42.593 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:42.589+0000 7fe8b18f0b80 1 -- 172.21.15.87:0/3217638999 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe8900cd0e0 con 0x560198cd26c0 2024-05-08T05:33:42.593 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:42.589+0000 7fe88a000700 1 -- 172.21.15.87:0/3217638999 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fe898008e40 con 0x560198cd26c0 2024-05-08T05:33:42.593 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:42.589+0000 7fe8b18f0b80 10 client.15540 fetch_fsmap learned FSMap version 29 2024-05-08T05:33:42.593 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:42.589+0000 7fe8b18f0b80 1 -- 172.21.15.87:0/3217638999 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x560198ce3860 con 0x560198cd26c0 2024-05-08T05:33:42.593 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:42.589+0000 7fe88a000700 1 -- 172.21.15.87:0/3217638999 <== mon.0 v2:172.21.15.87:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe8900cd0e0 con 0x560198cd26c0 2024-05-08T05:33:42.593 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:42.589+0000 7fe88a000700 1 -- 172.21.15.87:0/3217638999 <== mon.0 v2:172.21.15.87:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7fe89802bc20 con 0x560198cd26c0 2024-05-08T05:33:42.593 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:42.589+0000 7fe8b18f0b80 10 client.15540 fetch_fsmap finished waiting for FSMap version 29 2024-05-08T05:33:42.593 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:42.589+0000 7fe8b18f0b80 10 client.15540 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-05-08T05:33:42.593 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:42.590+0000 7fe8b18f0b80 20 client.15540 populate_metadata read hostname 'smithi087' 2024-05-08T05:33:42.594 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:42.590+0000 7fe8b18f0b80 1 --2- 172.21.15.87:0/3217638999 >> [v2:172.21.15.90:6838/160586017,v1:172.21.15.90:6839/160586017] conn(0x560198ce5ef0 0x560198ce8320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:33:42.594 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:42.590+0000 7fe8b18f0b80 4 client.15540 mds_command: new command op to 24500 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-08T05:33:42.594 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:42.590+0000 7fe8b18f0b80 1 -- 172.21.15.87:0/3217638999 --> [v2:172.21.15.90:6838/160586017,v1:172.21.15.90:6839/160586017] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x560198c99140 con 0x560198ce5ef0 2024-05-08T05:33:42.594 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:42.590+0000 7fe89fe00700 1 --2- 172.21.15.87:0/3217638999 >> [v2:172.21.15.90:6838/160586017,v1:172.21.15.90:6839/160586017] conn(0x560198ce5ef0 0x560198ce8320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:33:42.595 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:42.590+0000 7fe89fe00700 1 --2- 172.21.15.87:0/3217638999 >> [v2:172.21.15.90:6838/160586017,v1:172.21.15.90:6839/160586017] conn(0x560198ce5ef0 0x560198ce8320 crc :-1 s=READY pgs=67 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c8e42bb254541601 server_cookie=98d8a99a8d6d7e7c in_seq=0 out_seq=0 2024-05-08T05:33:42.595 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:42.590+0000 7fe88a000700 10 client.15540 ms_handle_connect on v2:172.21.15.90:6838/160586017 2024-05-08T05:33:42.595 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:42.591+0000 7fe88a000700 1 -- 172.21.15.87:0/3217638999 <== mds.0 v2:172.21.15.90:6838/160586017 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x560198c99140 con 0x560198ce5ef0 2024-05-08T05:33:42.596 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:42.591+0000 7fe88a000700 10 client.15540 handle_command_reply: tid=0 2024-05-08T05:33:42.596 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:42.591+0000 7fe8b18f0b80 1 client.15540 shutdown 2024-05-08T05:33:42.596 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:42.592+0000 7fe8b18f0b80 1 -- 172.21.15.87:0/3217638999 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x560198cd26c0 msgr2=0x560198cd5e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:33:42.596 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:42.592+0000 7fe8b18f0b80 1 --2- 172.21.15.87:0/3217638999 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x560198cd26c0 0x560198cd5e10 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fe898015d30 tx=0x7fe898009b60 comp rx=0 tx=0).stop 2024-05-08T05:33:42.596 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:42.592+0000 7fe8b18f0b80 1 -- 172.21.15.87:0/3217638999 shutdown_connections 2024-05-08T05:33:42.596 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:42.592+0000 7fe8b18f0b80 1 --2- 172.21.15.87:0/3217638999 >> [v2:172.21.15.90:6838/160586017,v1:172.21.15.90:6839/160586017] conn(0x560198ce5ef0 0x560198ce8320 crc :-1 s=READY pgs=67 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:33:42.596 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:42.592+0000 7fe8b18f0b80 1 --2- 172.21.15.87:0/3217638999 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x560198cd26c0 0x560198cd5e10 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:33:42.596 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:42.592+0000 7fe8b18f0b80 1 --2- 172.21.15.87:0/3217638999 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x560198ccca50 0x560198cd8530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:33:42.596 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:42.592+0000 7fe8b18f0b80 1 --2- 172.21.15.87:0/3217638999 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x560198cd1da0 0x560198cd58d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:33:42.596 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:42.592+0000 7fe8b18f0b80 1 -- 172.21.15.87:0/3217638999 >> 172.21.15.87:0/3217638999 conn(0x560198c446d0 msgr2=0x560198cc1750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:33:42.596 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:42.592+0000 7fe88a000700 0 client.15540 ms_handle_reset on v2:172.21.15.90:6838/160586017 2024-05-08T05:33:42.596 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:42.592+0000 7fe8b18f0b80 1 -- 172.21.15.87:0/3217638999 shutdown_connections 2024-05-08T05:33:42.596 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:42.592+0000 7fe8b18f0b80 1 -- 172.21.15.87:0/3217638999 wait complete. 2024-05-08T05:33:42.596 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:42.592+0000 7fe8b18f0b80 20 client.15540 trim_cache size 0 max 16384 2024-05-08T05:33:42.609 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:42.608+0000 7fe8b18f0b80 1 Processor -- start 2024-05-08T05:33:42.609 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:42.608+0000 7fe8b18f0b80 1 -- start start 2024-05-08T05:33:42.609 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:42.609+0000 7fe8b18f0b80 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x560198ccca50 0x560198ccc430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:33:42.609 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:42.609+0000 7fe8b18f0b80 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x560198cd1da0 0x560198ccff80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:33:42.609 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:42.609+0000 7fe8b18f0b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x560198cd26c0 0x560198cc1860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:33:42.609 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:42.609+0000 7fe8b18f0b80 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fe8a01ae000 con 0x560198cd1da0 2024-05-08T05:33:42.609 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:42.609+0000 7fe8b18f0b80 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fe8a01ab7d0 con 0x560198ccca50 2024-05-08T05:33:42.609 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:42.609+0000 7fe8b18f0b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7fe8a010e080 con 0x560198cd26c0 2024-05-08T05:33:42.611 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:42.609+0000 7fe89f400700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x560198cd1da0 0x560198ccff80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:33:42.611 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:42.609+0000 7fe89f400700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x560198cd1da0 0x560198ccff80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:50176/0 (socket says 172.21.15.87:50176) 2024-05-08T05:33:42.611 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:42.609+0000 7fe89f400700 1 -- 172.21.15.87:0/2652229606 learned_addr learned my addr 172.21.15.87:0/2652229606 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T05:33:42.611 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:42.609+0000 7fe89fe00700 1 --2- 172.21.15.87:0/2652229606 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x560198ccca50 0x560198ccc430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:33:42.611 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:42.609+0000 7fe8a5000700 1 --2- 172.21.15.87:0/2652229606 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x560198cd26c0 0x560198cc1860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:33:42.611 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:42.610+0000 7fe89fe00700 1 -- 172.21.15.87:0/2652229606 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x560198cd26c0 msgr2=0x560198cc1860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:33:42.611 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:42.610+0000 7fe89fe00700 1 --2- 172.21.15.87:0/2652229606 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x560198cd26c0 0x560198cc1860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:33:42.611 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:42.610+0000 7fe89fe00700 1 -- 172.21.15.87:0/2652229606 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x560198cd1da0 msgr2=0x560198ccff80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:33:42.611 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:42.610+0000 7fe89fe00700 1 --2- 172.21.15.87:0/2652229606 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x560198cd1da0 0x560198ccff80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:33:42.612 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:42.610+0000 7fe89fe00700 1 -- 172.21.15.87:0/2652229606 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560198cc8780 con 0x560198ccca50 2024-05-08T05:33:42.612 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:42.610+0000 7fe89fe00700 1 --2- 172.21.15.87:0/2652229606 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x560198ccca50 0x560198ccc430 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x560198cc8970 tx=0x7fe8900a60e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=35c2a897a68afcbc server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:33:42.612 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:42.610+0000 7fe894c00700 1 -- 172.21.15.87:0/2652229606 <== mon.2 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8900b35f0 con 0x560198ccca50 2024-05-08T05:33:42.612 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:42.610+0000 7fe894c00700 1 -- 172.21.15.87:0/2652229606 <== mon.2 v2:172.21.15.90:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe8900aa820 con 0x560198ccca50 2024-05-08T05:33:42.612 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:42.610+0000 7fe894c00700 1 -- 172.21.15.87:0/2652229606 <== mon.2 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8900a6ab0 con 0x560198ccca50 2024-05-08T05:33:42.612 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:42.611+0000 7fe8b18f0b80 1 -- 172.21.15.87:0/2652229606 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x560198ccca50 msgr2=0x560198ccc430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:33:42.612 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:42.611+0000 7fe8b18f0b80 1 --2- 172.21.15.87:0/2652229606 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x560198ccca50 0x560198ccc430 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x560198cc8970 tx=0x7fe8900a60e0 comp rx=0 tx=0).stop 2024-05-08T05:33:42.612 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:42.611+0000 7fe8b18f0b80 1 -- 172.21.15.87:0/2652229606 shutdown_connections 2024-05-08T05:33:42.612 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:42.611+0000 7fe8b18f0b80 1 --2- 172.21.15.87:0/2652229606 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x560198cd26c0 0x560198cc1860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:33:42.612 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:42.611+0000 7fe8b18f0b80 1 --2- 172.21.15.87:0/2652229606 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x560198ccca50 0x560198ccc430 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:33:42.612 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:42.611+0000 7fe8b18f0b80 1 --2- 172.21.15.87:0/2652229606 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x560198cd1da0 0x560198ccff80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:33:42.612 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:42.611+0000 7fe8b18f0b80 1 -- 172.21.15.87:0/2652229606 >> 172.21.15.87:0/2652229606 conn(0x560198c446d0 msgr2=0x560198ccf870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:33:42.613 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:42.611+0000 7fe8b18f0b80 1 -- 172.21.15.87:0/2652229606 shutdown_connections 2024-05-08T05:33:42.613 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:42.611+0000 7fe8b18f0b80 1 -- 172.21.15.87:0/2652229606 wait complete. 2024-05-08T05:33:42.615 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:42.611+0000 7fe8b18f0b80 1 -- start start 2024-05-08T05:33:42.615 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:42.611+0000 7fe8b18f0b80 1 Processor -- start 2024-05-08T05:33:42.615 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:42.612+0000 7fe8b18f0b80 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x560198ccca50 0x560198cde630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:33:42.615 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:42.612+0000 7fe8b18f0b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x560198cd1da0 0x560198ced000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:33:42.615 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:42.612+0000 7fe8b18f0b80 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x560198cd26c0 0x560198ced540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:33:42.615 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:42.612+0000 7fe8b18f0b80 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fe8a01a9cb0 con 0x560198ccca50 2024-05-08T05:33:42.615 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:42.612+0000 7fe8b18f0b80 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fe8a01ab100 con 0x560198cd26c0 2024-05-08T05:33:42.615 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:42.612+0000 7fe8b18f0b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7fe8a01aa360 con 0x560198cd1da0 2024-05-08T05:33:42.615 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:42.612+0000 7fe8b18f0b80 10 client.0 _ll_register_callbacks cb 0x560198bc5c70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T05:33:42.615 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:42.612+0000 7fe89fe00700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x560198ccca50 0x560198cde630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:33:42.616 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:42.612+0000 7fe89fe00700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x560198ccca50 0x560198cde630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:50190/0 (socket says 172.21.15.87:50190) 2024-05-08T05:33:42.616 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:42.612+0000 7fe89fe00700 1 -- 172.21.15.87:0/1524756483 learned_addr learned my addr 172.21.15.87:0/1524756483 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T05:33:42.616 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:42.612+0000 7fe8a5000700 1 --2- 172.21.15.87:0/1524756483 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x560198cd26c0 0x560198ced540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:33:42.616 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:42.612+0000 7fe89f400700 1 --2- 172.21.15.87:0/1524756483 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x560198cd1da0 0x560198ced000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:33:42.616 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:42.613+0000 7fe89fe00700 1 -- 172.21.15.87:0/1524756483 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x560198cd1da0 msgr2=0x560198ced000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:33:42.616 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:42.613+0000 7fe89fe00700 1 --2- 172.21.15.87:0/1524756483 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x560198cd1da0 0x560198ced000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:33:42.616 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:42.613+0000 7fe89fe00700 1 -- 172.21.15.87:0/1524756483 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x560198cd26c0 msgr2=0x560198ced540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:33:42.616 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:42.613+0000 7fe89fe00700 1 --2- 172.21.15.87:0/1524756483 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x560198cd26c0 0x560198ced540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:33:42.617 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:42.613+0000 7fe89fe00700 1 -- 172.21.15.87:0/1524756483 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560198cedb30 con 0x560198ccca50 2024-05-08T05:33:42.617 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:42.613+0000 7fe8a5000700 1 --2- 172.21.15.87:0/1524756483 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x560198cd26c0 0x560198ced540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T05:33:42.617 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:42.613+0000 7fe89fe00700 1 --2- 172.21.15.87:0/1524756483 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x560198ccca50 0x560198cde630 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fe890005c10 tx=0x7fe890003f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ff0457b0f02588e server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:33:42.617 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:42.613+0000 7fe88a000700 10 client.0 ms_handle_connect on v2:172.21.15.87:3300/0 2024-05-08T05:33:42.617 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:42.613+0000 7fe88a000700 1 -- 172.21.15.87:0/1524756483 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8900aa330 con 0x560198ccca50 2024-05-08T05:33:42.617 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:42.613+0000 7fe88a000700 1 -- 172.21.15.87:0/1524756483 <== mon.0 v2:172.21.15.87:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8190+0+0 (secure 0 0 0) 0x7fe8900e0cf0 con 0x560198ccca50 2024-05-08T05:33:42.617 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:42.613+0000 7fe8b18f0b80 1 -- 172.21.15.87:0/1524756483 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe8900aa820 con 0x560198ccca50 2024-05-08T05:33:42.617 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:42.614+0000 7fe88a000700 1 -- 172.21.15.87:0/1524756483 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fe8900cd0b0 con 0x560198ccca50 2024-05-08T05:33:42.617 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:42.614+0000 7fe8b18f0b80 10 client.15546 fetch_fsmap learned FSMap version 29 2024-05-08T05:33:42.617 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:42.614+0000 7fe8b18f0b80 1 -- 172.21.15.87:0/1524756483 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x560198d50600 con 0x560198ccca50 2024-05-08T05:33:42.617 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:42.614+0000 7fe88a000700 1 -- 172.21.15.87:0/1524756483 <== mon.0 v2:172.21.15.87:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe8900aa820 con 0x560198ccca50 2024-05-08T05:33:42.617 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:42.614+0000 7fe88a000700 1 -- 172.21.15.87:0/1524756483 <== mon.0 v2:172.21.15.87:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7fe8900bfc70 con 0x560198ccca50 2024-05-08T05:33:42.618 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:42.614+0000 7fe8b18f0b80 10 client.15546 fetch_fsmap finished waiting for FSMap version 29 2024-05-08T05:33:42.618 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:42.614+0000 7fe8b18f0b80 10 client.15546 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-05-08T05:33:42.618 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:42.614+0000 7fe8b18f0b80 20 client.15546 populate_metadata read hostname 'smithi087' 2024-05-08T05:33:42.618 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:42.614+0000 7fe8b18f0b80 1 --2- 172.21.15.87:0/1524756483 >> [v2:172.21.15.90:6838/160586017,v1:172.21.15.90:6839/160586017] conn(0x560198d50830 0x560198d52c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:33:42.618 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:42.614+0000 7fe8b18f0b80 4 client.15546 mds_command: new command op to 24500 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-05-08T05:33:42.618 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:42.614+0000 7fe8b18f0b80 1 -- 172.21.15.87:0/1524756483 --> [v2:172.21.15.90:6838/160586017,v1:172.21.15.90:6839/160586017] -- command(tid 0: {"prefix": "damage ls"}) -- 0x560198c2c400 con 0x560198d50830 2024-05-08T05:33:42.618 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:42.615+0000 7fe89f400700 1 --2- 172.21.15.87:0/1524756483 >> [v2:172.21.15.90:6838/160586017,v1:172.21.15.90:6839/160586017] conn(0x560198d50830 0x560198d52c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:33:42.619 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:42.615+0000 7fe89f400700 1 --2- 172.21.15.87:0/1524756483 >> [v2:172.21.15.90:6838/160586017,v1:172.21.15.90:6839/160586017] conn(0x560198d50830 0x560198d52c20 crc :-1 s=READY pgs=68 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3471bef25d9802b1 server_cookie=702b8c493561a367 in_seq=0 out_seq=0 2024-05-08T05:33:42.619 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:42.615+0000 7fe88a000700 10 client.15546 ms_handle_connect on v2:172.21.15.90:6838/160586017 2024-05-08T05:33:42.619 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:42.615+0000 7fe88a000700 1 -- 172.21.15.87:0/1524756483 <== mds.0 v2:172.21.15.90:6838/160586017 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x560198c2c400 con 0x560198d50830 2024-05-08T05:33:42.619 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:42.615+0000 7fe88a000700 10 client.15546 handle_command_reply: tid=0 2024-05-08T05:33:42.619 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:42.615+0000 7fe8b18f0b80 1 client.15546 shutdown 2024-05-08T05:33:42.619 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:42.615+0000 7fe8b18f0b80 1 -- 172.21.15.87:0/1524756483 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x560198ccca50 msgr2=0x560198cde630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:33:42.620 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:42.615+0000 7fe8b18f0b80 1 --2- 172.21.15.87:0/1524756483 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x560198ccca50 0x560198cde630 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fe890005c10 tx=0x7fe890003f90 comp rx=0 tx=0).stop 2024-05-08T05:33:42.620 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:42.616+0000 7fe8b18f0b80 1 -- 172.21.15.87:0/1524756483 shutdown_connections 2024-05-08T05:33:42.620 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:42.616+0000 7fe8b18f0b80 1 --2- 172.21.15.87:0/1524756483 >> [v2:172.21.15.90:6838/160586017,v1:172.21.15.90:6839/160586017] conn(0x560198d50830 0x560198d52c20 crc :-1 s=READY pgs=68 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:33:42.620 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:42.616+0000 7fe8b18f0b80 1 --2- 172.21.15.87:0/1524756483 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x560198cd26c0 0x560198ced540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:33:42.620 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:42.616+0000 7fe8b18f0b80 1 --2- 172.21.15.87:0/1524756483 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x560198ccca50 0x560198cde630 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:33:42.620 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:42.616+0000 7fe8b18f0b80 1 --2- 172.21.15.87:0/1524756483 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x560198cd1da0 0x560198ced000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:33:42.620 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:42.616+0000 7fe88a000700 0 client.15546 ms_handle_reset on v2:172.21.15.90:6838/160586017 2024-05-08T05:33:42.620 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:42.616+0000 7fe8b18f0b80 1 -- 172.21.15.87:0/1524756483 >> 172.21.15.87:0/1524756483 conn(0x560198c446d0 msgr2=0x560198cd2aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:33:42.620 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:42.616+0000 7fe8b18f0b80 1 -- 172.21.15.87:0/1524756483 shutdown_connections 2024-05-08T05:33:42.620 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:42.616+0000 7fe8b18f0b80 1 -- 172.21.15.87:0/1524756483 wait complete. 2024-05-08T05:33:42.620 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:42.616+0000 7fe8b18f0b80 20 client.15546 trim_cache size 0 max 16384 2024-05-08T05:33:42.620 INFO:teuthology.orchestra.run.smithi087.stdout:[] 2024-05-08T05:33:42.621 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:42.617+0000 7fe8a5a00700 1 -- 172.21.15.87:0/1388605953 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7fe8840b2880 msgr2=0x7fe8840b4d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:33:42.621 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:42.617+0000 7fe8a5a00700 1 --2- 172.21.15.87:0/1388605953 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7fe8840b2880 0x7fe8840b4d40 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fe898009c10 tx=0x7fe898004ad0 comp rx=0 tx=0).stop 2024-05-08T05:33:42.621 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:42.617+0000 7fe8a5a00700 1 -- 172.21.15.87:0/1388605953 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe8a01033d0 msgr2=0x7fe8a01a1a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:33:42.621 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:42.617+0000 7fe8a5a00700 1 --2- 172.21.15.87:0/1388605953 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe8a01033d0 0x7fe8a01a1a50 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fe890009230 tx=0x7fe89000fa70 comp rx=0 tx=0).stop 2024-05-08T05:33:42.622 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:42.617+0000 7fe8a5a00700 1 -- 172.21.15.87:0/1388605953 shutdown_connections 2024-05-08T05:33:42.622 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:42.617+0000 7fe8a5a00700 1 --2- 172.21.15.87:0/1388605953 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe8a0109460 0x7fe8a019bb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:33:42.622 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:42.617+0000 7fe8a5a00700 1 --2- 172.21.15.87:0/1388605953 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7fe8840b2880 0x7fe8840b4d40 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:33:42.622 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:42.617+0000 7fe8a5a00700 1 --2- 172.21.15.87:0/1388605953 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe8a01033d0 0x7fe8a01a1a50 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:33:42.622 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:42.617+0000 7fe8a5a00700 1 --2- 172.21.15.87:0/1388605953 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe8a0103d90 0x7fe8a01a1f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:33:42.622 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:42.617+0000 7fe8a5a00700 1 -- 172.21.15.87:0/1388605953 >> 172.21.15.87:0/1388605953 conn(0x7fe8a00fef20 msgr2=0x7fe8a010eb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:33:42.622 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:42.617+0000 7fe8a5a00700 1 -- 172.21.15.87:0/1388605953 shutdown_connections 2024-05-08T05:33:42.622 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:42.617+0000 7fe8a5a00700 1 -- 172.21.15.87:0/1388605953 wait complete. 2024-05-08T05:33:42.708 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:33:42 smithi087 ceph-mon[29523]: pgmap v561: 97 pgs: 97 active+clean; 156 MiB data, 994 MiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.0 MiB/s wr, 220 op/s 2024-05-08T05:33:42.788 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:33:42 smithi160 ceph-mon[34827]: pgmap v561: 97 pgs: 97 active+clean; 156 MiB data, 994 MiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.0 MiB/s wr, 220 op/s 2024-05-08T05:33:42.983 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:33:42 smithi090 ceph-mon[34526]: pgmap v561: 97 pgs: 97 active+clean; 156 MiB data, 994 MiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.0 MiB/s wr, 220 op/s 2024-05-08T05:33:43.643 ERROR:tasks.fwd_scrub.fs.[cephfs]:exception: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_ceph-c_bee299f4ac344e4c45e550d7a80abcadd7bc3d5a/qa/tasks/fwd_scrub.py", line 35, in _run self.do_scrub() File "/home/teuthworker/src/git.ceph.com_ceph-c_bee299f4ac344e4c45e550d7a80abcadd7bc3d5a/qa/tasks/fwd_scrub.py", line 49, in do_scrub self.sleep_unless_stopped(self.sleep_between_iterations) File "/home/teuthworker/src/git.ceph.com_ceph-c_bee299f4ac344e4c45e550d7a80abcadd7bc3d5a/qa/tasks/thrasher.py", line 47, in sleep_unless_stopped raise self.Stopped() tasks.thrasher.ThrasherGreenlet.Stopped 2024-05-08T05:33:43.644 INFO:tasks.fwd_scrub:done joining 2024-05-08T05:33:43.644 DEBUG:teuthology.run_tasks:Unwinding manager check-counter 2024-05-08T05:33:43.656 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-08T05:33:43.871 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:43.870+0000 7f8483200640 1 -- 172.21.15.87:0/3151140350 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8484108e30 msgr2=0x7f8484109250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:33:43.871 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:43.870+0000 7f8483200640 1 --2- 172.21.15.87:0/3151140350 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8484108e30 0x7f8484109250 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f8474009900 tx=0x7f847402a410 comp rx=0 tx=0).stop 2024-05-08T05:33:43.871 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:43.870+0000 7f8483200640 1 -- 172.21.15.87:0/3151140350 shutdown_connections 2024-05-08T05:33:43.871 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:43.870+0000 7f8483200640 1 --2- 172.21.15.87:0/3151140350 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f848410a940 0x7f8484111260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:33:43.871 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:43.870+0000 7f8483200640 1 --2- 172.21.15.87:0/3151140350 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f8484109f80 0x7f848410a400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:33:43.871 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:43.870+0000 7f8483200640 1 --2- 172.21.15.87:0/3151140350 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8484108e30 0x7f8484109250 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:33:43.871 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:43.870+0000 7f8483200640 1 -- 172.21.15.87:0/3151140350 >> 172.21.15.87:0/3151140350 conn(0x7f8484077df0 msgr2=0x7f848407a210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:33:43.872 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:43.871+0000 7f8483200640 1 -- 172.21.15.87:0/3151140350 shutdown_connections 2024-05-08T05:33:43.872 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:43.871+0000 7f8483200640 1 -- 172.21.15.87:0/3151140350 wait complete. 2024-05-08T05:33:43.874 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:43.871+0000 7f8483200640 1 Processor -- start 2024-05-08T05:33:43.874 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:43.872+0000 7f8483200640 1 -- start start 2024-05-08T05:33:43.874 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:43.872+0000 7f8483200640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8484108e30 0x7f848419f030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:33:43.874 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:43.872+0000 7f8483200640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f8484109f80 0x7f848419f570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:33:43.874 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:43.872+0000 7f8483200640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f848410a940 0x7f84841a65e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:33:43.875 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:43.872+0000 7f8483200640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f84841149b0 con 0x7f8484108e30 2024-05-08T05:33:43.875 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:43.872+0000 7f8483200640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f8484114830 con 0x7f848410a940 2024-05-08T05:33:43.875 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:43.872+0000 7f8483200640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f8484114b30 con 0x7f8484109f80 2024-05-08T05:33:43.875 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:43.872+0000 7f8482800640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f848410a940 0x7f84841a65e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:33:43.875 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:43.872+0000 7f8481e00640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8484108e30 0x7f848419f030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:33:43.875 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:43.872+0000 7f8482800640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f848410a940 0x7f84841a65e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.87:55246/0 (socket says 172.21.15.87:55246) 2024-05-08T05:33:43.876 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:43.872+0000 7f8481e00640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8484108e30 0x7f848419f030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:50196/0 (socket says 172.21.15.87:50196) 2024-05-08T05:33:43.876 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:43.872+0000 7f8482800640 1 -- 172.21.15.87:0/2430653487 learned_addr learned my addr 172.21.15.87:0/2430653487 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T05:33:43.876 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:43.872+0000 7f847be00640 1 --2- 172.21.15.87:0/2430653487 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f8484109f80 0x7f848419f570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:33:43.876 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:43.873+0000 7f8482800640 1 -- 172.21.15.87:0/2430653487 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f8484109f80 msgr2=0x7f848419f570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:33:43.876 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:43.873+0000 7f8482800640 1 --2- 172.21.15.87:0/2430653487 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f8484109f80 0x7f848419f570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:33:43.876 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:43.873+0000 7f8482800640 1 -- 172.21.15.87:0/2430653487 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8484108e30 msgr2=0x7f848419f030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:33:43.876 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:43.873+0000 7f8482800640 1 --2- 172.21.15.87:0/2430653487 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8484108e30 0x7f848419f030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:33:43.876 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:43.873+0000 7f8482800640 1 -- 172.21.15.87:0/2430653487 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f84841a6c50 con 0x7f848410a940 2024-05-08T05:33:43.877 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:43.873+0000 7f8482800640 1 --2- 172.21.15.87:0/2430653487 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f848410a940 0x7f84841a65e0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f847c00eb10 tx=0x7f847c00c2d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:33:43.877 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:43.873+0000 7f847aa00640 1 -- 172.21.15.87:0/2430653487 <== mon.2 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f847c004b20 con 0x7f848410a940 2024-05-08T05:33:43.877 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:43.873+0000 7f847aa00640 1 -- 172.21.15.87:0/2430653487 <== mon.2 v2:172.21.15.90:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f847c004cc0 con 0x7f848410a940 2024-05-08T05:33:43.877 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:43.873+0000 7f8483200640 1 -- 172.21.15.87:0/2430653487 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f84841a6f40 con 0x7f848410a940 2024-05-08T05:33:43.877 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:43.873+0000 7f847aa00640 1 -- 172.21.15.87:0/2430653487 <== mon.2 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f847c010670 con 0x7f848410a940 2024-05-08T05:33:43.877 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:43.873+0000 7f8483200640 1 -- 172.21.15.87:0/2430653487 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f84841a73b0 con 0x7f848410a940 2024-05-08T05:33:43.877 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:43.874+0000 7f8483200640 1 -- 172.21.15.87:0/2430653487 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8484110140 con 0x7f848410a940 2024-05-08T05:33:43.877 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:43.877+0000 7f847aa00640 1 -- 172.21.15.87:0/2430653487 <== mon.2 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7f847c005020 con 0x7f848410a940 2024-05-08T05:33:43.878 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:43.878+0000 7f847aa00640 1 --2- 172.21.15.87:0/2430653487 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f84680b27f0 0x7f84680b4cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:33:43.878 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:43.878+0000 7f847aa00640 1 -- 172.21.15.87:0/2430653487 <== mon.2 v2:172.21.15.90:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8190+0+0 (secure 0 0 0) 0x7f847c0e27d0 con 0x7f848410a940 2024-05-08T05:33:43.879 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:43.878+0000 7f8481e00640 1 --2- 172.21.15.87:0/2430653487 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f84680b27f0 0x7f84680b4cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:33:43.879 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:43.879+0000 7f8481e00640 1 --2- 172.21.15.87:0/2430653487 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f84680b27f0 0x7f84680b4cb0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f8474031500 tx=0x7f8474005a20 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:33:43.883 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:43.883+0000 7f847aa00640 1 -- 172.21.15.87:0/2430653487 <== mon.2 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f847c0aa4c0 con 0x7f848410a940 2024-05-08T05:33:44.094 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:44.094+0000 7f8483200640 1 -- 172.21.15.87:0/2430653487 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f8484063650 con 0x7f848410a940 2024-05-08T05:33:44.096 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:44.096+0000 7f847aa00640 1 -- 172.21.15.87:0/2430653487 <== mon.2 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v82) ==== 74+0+22588 (secure 0 0 0) 0x7f847c0a9dc0 con 0x7f848410a940 2024-05-08T05:33:44.097 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-05-08T05:33:44.097 INFO:teuthology.orchestra.run.smithi087.stdout:{"epoch":82,"fsid":"eeeb813e-0cf9-11ef-bc97-c7b262605968","created":"2024-05-08T05:16:14.984330+0000","modified":"2024-05-08T05:26:24.106467+0000","last_up_change":"2024-05-08T05:24:22.324501+0000","last_in_change":"2024-05-08T05:24:01.962570+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-08T05:20:08.907941+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-08T05:25:28.054494+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-08T05:25:32.484126+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"f3e25ce0-0762-46fd-83fb-6766a2e9db69","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6802","nonce":2285285644},{"type":"v1","addr":"172.21.15.87:6803","nonce":2285285644}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6804","nonce":2285285644},{"type":"v1","addr":"172.21.15.87:6805","nonce":2285285644}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6808","nonce":2285285644},{"type":"v1","addr":"172.21.15.87:6809","nonce":2285285644}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6806","nonce":2285285644},{"type":"v1","addr":"172.21.15.87:6807","nonce":2285285644}]},"public_addr":"172.21.15.87:6803/2285285644","cluster_addr":"172.21.15.87:6805/2285285644","heartbeat_back_addr":"172.21.15.87:6809/2285285644","heartbeat_front_addr":"172.21.15.87:6807/2285285644","state":["exists","up"]},{"osd":1,"uuid":"b6de5f4c-1d79-41ff-adee-03d8a47ab55e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6800","nonce":1681573998},{"type":"v1","addr":"172.21.15.90:6801","nonce":1681573998}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6802","nonce":1681573998},{"type":"v1","addr":"172.21.15.90:6803","nonce":1681573998}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6806","nonce":1681573998},{"type":"v1","addr":"172.21.15.90:6807","nonce":1681573998}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6804","nonce":1681573998},{"type":"v1","addr":"172.21.15.90:6805","nonce":1681573998}]},"public_addr":"172.21.15.90:6801/1681573998","cluster_addr":"172.21.15.90:6803/1681573998","heartbeat_back_addr":"172.21.15.90:6807/1681573998","heartbeat_front_addr":"172.21.15.90:6805/1681573998","state":["exists","up"]},{"osd":2,"uuid":"ee3a2729-93b2-4985-b84d-165f92cae8e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6800","nonce":2137179096},{"type":"v1","addr":"172.21.15.160:6801","nonce":2137179096}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6802","nonce":2137179096},{"type":"v1","addr":"172.21.15.160:6803","nonce":2137179096}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6806","nonce":2137179096},{"type":"v1","addr":"172.21.15.160:6807","nonce":2137179096}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6804","nonce":2137179096},{"type":"v1","addr":"172.21.15.160:6805","nonce":2137179096}]},"public_addr":"172.21.15.160:6801/2137179096","cluster_addr":"172.21.15.160:6803/2137179096","heartbeat_back_addr":"172.21.15.160:6807/2137179096","heartbeat_front_addr":"172.21.15.160:6805/2137179096","state":["exists","up"]},{"osd":3,"uuid":"fc7bd69f-5a62-4ec6-b95c-c170be46a7d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6810","nonce":2022667023},{"type":"v1","addr":"172.21.15.87:6811","nonce":2022667023}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6812","nonce":2022667023},{"type":"v1","addr":"172.21.15.87:6813","nonce":2022667023}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6816","nonce":2022667023},{"type":"v1","addr":"172.21.15.87:6817","nonce":2022667023}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6814","nonce":2022667023},{"type":"v1","addr":"172.21.15.87:6815","nonce":2022667023}]},"public_addr":"172.21.15.87:6811/2022667023","cluster_addr":"172.21.15.87:6813/2022667023","heartbeat_back_addr":"172.21.15.87:6817/2022667023","heartbeat_front_addr":"172.21.15.87:6815/2022667023","state":["exists","up"]},{"osd":4,"uuid":"a05f7bd1-962a-4f3e-8f70-e7ef4c68bac2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6808","nonce":1371607578},{"type":"v1","addr":"172.21.15.90:6809","nonce":1371607578}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6810","nonce":1371607578},{"type":"v1","addr":"172.21.15.90:6811","nonce":1371607578}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6814","nonce":1371607578},{"type":"v1","addr":"172.21.15.90:6815","nonce":1371607578}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6812","nonce":1371607578},{"type":"v1","addr":"172.21.15.90:6813","nonce":1371607578}]},"public_addr":"172.21.15.90:6809/1371607578","cluster_addr":"172.21.15.90:6811/1371607578","heartbeat_back_addr":"172.21.15.90:6815/1371607578","heartbeat_front_addr":"172.21.15.90:6813/1371607578","state":["exists","up"]},{"osd":5,"uuid":"85e3af08-32ee-4f26-97df-8d54ba928715","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6808","nonce":2190054276},{"type":"v1","addr":"172.21.15.160:6809","nonce":2190054276}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6810","nonce":2190054276},{"type":"v1","addr":"172.21.15.160:6811","nonce":2190054276}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6814","nonce":2190054276},{"type":"v1","addr":"172.21.15.160:6815","nonce":2190054276}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6812","nonce":2190054276},{"type":"v1","addr":"172.21.15.160:6813","nonce":2190054276}]},"public_addr":"172.21.15.160:6809/2190054276","cluster_addr":"172.21.15.160:6811/2190054276","heartbeat_back_addr":"172.21.15.160:6815/2190054276","heartbeat_front_addr":"172.21.15.160:6813/2190054276","state":["exists","up"]},{"osd":6,"uuid":"df4b22a9-6cd8-473e-a17b-a0cb9ad32e98","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":42,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6818","nonce":2863681447},{"type":"v1","addr":"172.21.15.87:6819","nonce":2863681447}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6820","nonce":2863681447},{"type":"v1","addr":"172.21.15.87:6821","nonce":2863681447}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6824","nonce":2863681447},{"type":"v1","addr":"172.21.15.87:6825","nonce":2863681447}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6822","nonce":2863681447},{"type":"v1","addr":"172.21.15.87:6823","nonce":2863681447}]},"public_addr":"172.21.15.87:6819/2863681447","cluster_addr":"172.21.15.87:6821/2863681447","heartbeat_back_addr":"172.21.15.87:6825/2863681447","heartbeat_front_addr":"172.21.15.87:6823/2863681447","state":["exists","up"]},{"osd":7,"uuid":"f6ef3857-0366-4408-932a-a8c8479ba780","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6816","nonce":1964248958},{"type":"v1","addr":"172.21.15.90:6817","nonce":1964248958}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6818","nonce":1964248958},{"type":"v1","addr":"172.21.15.90:6819","nonce":1964248958}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6822","nonce":1964248958},{"type":"v1","addr":"172.21.15.90:6823","nonce":1964248958}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6820","nonce":1964248958},{"type":"v1","addr":"172.21.15.90:6821","nonce":1964248958}]},"public_addr":"172.21.15.90:6817/1964248958","cluster_addr":"172.21.15.90:6819/1964248958","heartbeat_back_addr":"172.21.15.90:6823/1964248958","heartbeat_front_addr":"172.21.15.90:6821/1964248958","state":["exists","up"]},{"osd":8,"uuid":"027dede9-d0be-4fbe-b7b8-02ce88d57f4d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":54,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6816","nonce":927680738},{"type":"v1","addr":"172.21.15.160:6817","nonce":927680738}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6818","nonce":927680738},{"type":"v1","addr":"172.21.15.160:6819","nonce":927680738}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6822","nonce":927680738},{"type":"v1","addr":"172.21.15.160:6823","nonce":927680738}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6820","nonce":927680738},{"type":"v1","addr":"172.21.15.160:6821","nonce":927680738}]},"public_addr":"172.21.15.160:6817/927680738","cluster_addr":"172.21.15.160:6819/927680738","heartbeat_back_addr":"172.21.15.160:6823/927680738","heartbeat_front_addr":"172.21.15.160:6821/927680738","state":["exists","up"]},{"osd":9,"uuid":"bc9e37de-e509-4db6-bd58-b68e2c8e1aff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6826","nonce":3789116749},{"type":"v1","addr":"172.21.15.87:6827","nonce":3789116749}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6828","nonce":3789116749},{"type":"v1","addr":"172.21.15.87:6829","nonce":3789116749}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6832","nonce":3789116749},{"type":"v1","addr":"172.21.15.87:6833","nonce":3789116749}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6830","nonce":3789116749},{"type":"v1","addr":"172.21.15.87:6831","nonce":3789116749}]},"public_addr":"172.21.15.87:6827/3789116749","cluster_addr":"172.21.15.87:6829/3789116749","heartbeat_back_addr":"172.21.15.87:6833/3789116749","heartbeat_front_addr":"172.21.15.87:6831/3789116749","state":["exists","up"]},{"osd":10,"uuid":"43945081-b4c8-4f5d-9301-3540709e69e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":66,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6824","nonce":716529498},{"type":"v1","addr":"172.21.15.90:6825","nonce":716529498}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6826","nonce":716529498},{"type":"v1","addr":"172.21.15.90:6827","nonce":716529498}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6830","nonce":716529498},{"type":"v1","addr":"172.21.15.90:6831","nonce":716529498}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6828","nonce":716529498},{"type":"v1","addr":"172.21.15.90:6829","nonce":716529498}]},"public_addr":"172.21.15.90:6825/716529498","cluster_addr":"172.21.15.90:6827/716529498","heartbeat_back_addr":"172.21.15.90:6831/716529498","heartbeat_front_addr":"172.21.15.90:6829/716529498","state":["exists","up"]},{"osd":11,"uuid":"da23ff5c-3f79-44e3-bca3-d9d5a003c999","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6824","nonce":1842739135},{"type":"v1","addr":"172.21.15.160:6825","nonce":1842739135}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6826","nonce":1842739135},{"type":"v1","addr":"172.21.15.160:6827","nonce":1842739135}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6830","nonce":1842739135},{"type":"v1","addr":"172.21.15.160:6831","nonce":1842739135}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6828","nonce":1842739135},{"type":"v1","addr":"172.21.15.160:6829","nonce":1842739135}]},"public_addr":"172.21.15.160:6825/1842739135","cluster_addr":"172.21.15.160:6827/1842739135","heartbeat_back_addr":"172.21.15.160:6831/1842739135","heartbeat_front_addr":"172.21.15.160:6829/1842739135","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T05:19:15.869398+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T05:19:42.014078+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T05:20:06.430660+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T05:20:38.555519+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T05:21:04.530605+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T05:21:29.545252+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T05:22:03.141982+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T05:22:29.191127+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T05:22:54.502994+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T05:23:27.899000+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T05:23:54.693979+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T05:24:20.307119+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.a","mappings":[{"from":2,"to":11}]},{"pgid":"2.1d","mappings":[{"from":2,"to":4},{"from":8,"to":11}]},{"pgid":"3.0","mappings":[{"from":4,"to":8}]},{"pgid":"3.1","mappings":[{"from":4,"to":9}]},{"pgid":"3.12","mappings":[{"from":3,"to":9}]},{"pgid":"3.28","mappings":[{"from":5,"to":6}]},{"pgid":"3.2c","mappings":[{"from":4,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.87:0/4226160503":"2024-05-09T05:17:22.736165+0000","172.21.15.87:0/2773684806":"2024-05-09T05:17:22.736165+0000","172.21.15.87:0/349590592":"2024-05-09T05:17:22.736165+0000","172.21.15.87:6801/2710124295":"2024-05-09T05:17:22.736165+0000","172.21.15.87:6800/1823425617":"2024-05-09T05:16:48.155337+0000","172.21.15.87:0/2393072013":"2024-05-09T05:16:48.155337+0000","172.21.15.87:0/1291525416":"2024-05-09T05:16:48.155337+0000","172.21.15.87:6801/1823425617":"2024-05-09T05:16:48.155337+0000","172.21.15.87:0/3839463573":"2024-05-09T05:16:48.155337+0000","172.21.15.87:6800/2710124295":"2024-05-09T05:17:22.736165+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-08T05:33:44.099 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:44.098+0000 7f8483200640 1 -- 172.21.15.87:0/2430653487 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f84680b27f0 msgr2=0x7f84680b4cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:33:44.099 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:44.098+0000 7f8483200640 1 --2- 172.21.15.87:0/2430653487 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f84680b27f0 0x7f84680b4cb0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f8474031500 tx=0x7f8474005a20 comp rx=0 tx=0).stop 2024-05-08T05:33:44.100 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:44.098+0000 7f8483200640 1 -- 172.21.15.87:0/2430653487 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f848410a940 msgr2=0x7f84841a65e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:33:44.100 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:44.098+0000 7f8483200640 1 --2- 172.21.15.87:0/2430653487 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f848410a940 0x7f84841a65e0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f847c00eb10 tx=0x7f847c00c2d0 comp rx=0 tx=0).stop 2024-05-08T05:33:44.100 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:44.099+0000 7f8483200640 1 -- 172.21.15.87:0/2430653487 shutdown_connections 2024-05-08T05:33:44.100 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:44.099+0000 7f8483200640 1 --2- 172.21.15.87:0/2430653487 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f84680b27f0 0x7f84680b4cb0 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:33:44.100 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:44.099+0000 7f8483200640 1 --2- 172.21.15.87:0/2430653487 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f848410a940 0x7f84841a65e0 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:33:44.101 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:44.099+0000 7f8483200640 1 --2- 172.21.15.87:0/2430653487 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f8484109f80 0x7f848419f570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:33:44.101 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:44.099+0000 7f8483200640 1 --2- 172.21.15.87:0/2430653487 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8484108e30 0x7f848419f030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:33:44.101 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:44.099+0000 7f8483200640 1 -- 172.21.15.87:0/2430653487 >> 172.21.15.87:0/2430653487 conn(0x7f8484077df0 msgr2=0x7f848410d310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:33:44.101 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:44.099+0000 7f8483200640 1 -- 172.21.15.87:0/2430653487 shutdown_connections 2024-05-08T05:33:44.101 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:44.099+0000 7f8483200640 1 -- 172.21.15.87:0/2430653487 wait complete. 2024-05-08T05:33:44.119 INFO:tasks.check_counter.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-05-08T05:20:08.907941+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-05-08T05:25:28.054494+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '80', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-05-08T05:25:32.484126+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '80', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-05-08T05:33:44.119 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-05-08T05:33:44.315 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:44.314+0000 7fd384a00640 1 -- 172.21.15.87:0/2254108814 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd380102940 msgr2=0x7fd380102d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:33:44.315 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:44.314+0000 7fd384a00640 1 --2- 172.21.15.87:0/2254108814 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd380102940 0x7fd380102d60 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fd370009900 tx=0x7fd37002a3f0 comp rx=0 tx=0).stop 2024-05-08T05:33:44.315 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:44.314+0000 7fd384a00640 1 -- 172.21.15.87:0/2254108814 shutdown_connections 2024-05-08T05:33:44.315 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:44.314+0000 7fd384a00640 1 --2- 172.21.15.87:0/2254108814 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd3801044f0 0x7fd38010ad80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:33:44.315 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:44.314+0000 7fd384a00640 1 --2- 172.21.15.87:0/2254108814 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd380103b30 0x7fd380103fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:33:44.315 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:44.314+0000 7fd384a00640 1 --2- 172.21.15.87:0/2254108814 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd380102940 0x7fd380102d60 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:33:44.315 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:44.314+0000 7fd384a00640 1 -- 172.21.15.87:0/2254108814 >> 172.21.15.87:0/2254108814 conn(0x7fd3800fdeb0 msgr2=0x7fd3801002f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:33:44.315 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:44.314+0000 7fd384a00640 1 -- 172.21.15.87:0/2254108814 shutdown_connections 2024-05-08T05:33:44.315 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:44.314+0000 7fd384a00640 1 -- 172.21.15.87:0/2254108814 wait complete. 2024-05-08T05:33:44.318 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:44.315+0000 7fd384a00640 1 Processor -- start 2024-05-08T05:33:44.318 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:44.315+0000 7fd384a00640 1 -- start start 2024-05-08T05:33:44.318 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:44.316+0000 7fd384a00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd380102940 0x7fd38019ad60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:33:44.318 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:44.316+0000 7fd384a00640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd380103b30 0x7fd38019b2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:33:44.318 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:44.316+0000 7fd384a00640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd3801044f0 0x7fd3801a2310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:33:44.318 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:44.316+0000 7fd384a00640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fd38010e420 con 0x7fd380103b30 2024-05-08T05:33:44.318 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:44.316+0000 7fd384a00640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fd38010e2a0 con 0x7fd380102940 2024-05-08T05:33:44.319 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:44.316+0000 7fd384a00640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7fd38010e5a0 con 0x7fd3801044f0 2024-05-08T05:33:44.319 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:44.316+0000 7fd37e800640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd380102940 0x7fd38019ad60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:33:44.319 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:44.316+0000 7fd37de00640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd380103b30 0x7fd38019b2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:33:44.319 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:44.316+0000 7fd37e800640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd380102940 0x7fd38019ad60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.87:55266/0 (socket says 172.21.15.87:55266) 2024-05-08T05:33:44.319 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:44.316+0000 7fd37e800640 1 -- 172.21.15.87:0/186100324 learned_addr learned my addr 172.21.15.87:0/186100324 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T05:33:44.319 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:44.316+0000 7fd37f200640 1 --2- 172.21.15.87:0/186100324 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd3801044f0 0x7fd3801a2310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:33:44.319 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:44.317+0000 7fd37e800640 1 -- 172.21.15.87:0/186100324 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd3801044f0 msgr2=0x7fd3801a2310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:33:44.319 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:44.317+0000 7fd37e800640 1 --2- 172.21.15.87:0/186100324 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd3801044f0 0x7fd3801a2310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:33:44.319 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:44.317+0000 7fd37e800640 1 -- 172.21.15.87:0/186100324 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd380103b30 msgr2=0x7fd38019b2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:33:44.319 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:44.317+0000 7fd37e800640 1 --2- 172.21.15.87:0/186100324 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd380103b30 0x7fd38019b2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:33:44.319 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:44.317+0000 7fd37e800640 1 -- 172.21.15.87:0/186100324 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd3801a2980 con 0x7fd380102940 2024-05-08T05:33:44.319 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:44.317+0000 7fd37f200640 1 --2- 172.21.15.87:0/186100324 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd3801044f0 0x7fd3801a2310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T05:33:44.319 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:44.317+0000 7fd37de00640 1 --2- 172.21.15.87:0/186100324 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd380103b30 0x7fd38019b2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T05:33:44.320 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:44.317+0000 7fd37e800640 1 --2- 172.21.15.87:0/186100324 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd380102940 0x7fd38019ad60 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fd370031500 tx=0x7fd370003c10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:33:44.320 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:44.317+0000 7fd377400640 1 -- 172.21.15.87:0/186100324 <== mon.2 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd37003f070 con 0x7fd380102940 2024-05-08T05:33:44.320 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:44.317+0000 7fd384a00640 1 -- 172.21.15.87:0/186100324 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd3801a2c10 con 0x7fd380102940 2024-05-08T05:33:44.320 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:44.317+0000 7fd377400640 1 -- 172.21.15.87:0/186100324 <== mon.2 v2:172.21.15.90:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd370031c50 con 0x7fd380102940 2024-05-08T05:33:44.320 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:44.317+0000 7fd377400640 1 -- 172.21.15.87:0/186100324 <== mon.2 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd370035030 con 0x7fd380102940 2024-05-08T05:33:44.320 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:44.317+0000 7fd384a00640 1 -- 172.21.15.87:0/186100324 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd3801a3150 con 0x7fd380102940 2024-05-08T05:33:44.320 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:44.318+0000 7fd384a00640 1 -- 172.21.15.87:0/186100324 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd3801a3320 con 0x7fd380102940 2024-05-08T05:33:44.321 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:44.321+0000 7fd377400640 1 -- 172.21.15.87:0/186100324 <== mon.2 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7fd370042070 con 0x7fd380102940 2024-05-08T05:33:44.323 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:44.322+0000 7fd377400640 1 --2- 172.21.15.87:0/186100324 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7fd3640b2870 0x7fd3640b4d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:33:44.323 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:44.322+0000 7fd377400640 1 -- 172.21.15.87:0/186100324 <== mon.2 v2:172.21.15.90:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8190+0+0 (secure 0 0 0) 0x7fd3701030e0 con 0x7fd380102940 2024-05-08T05:33:44.323 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:44.323+0000 7fd37de00640 1 --2- 172.21.15.87:0/186100324 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7fd3640b2870 0x7fd3640b4d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:33:44.324 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:44.323+0000 7fd37de00640 1 --2- 172.21.15.87:0/186100324 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7fd3640b2870 0x7fd3640b4d30 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fd38019c270 tx=0x7fd368005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:33:44.324 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:44.324+0000 7fd377400640 1 -- 172.21.15.87:0/186100324 <== mon.2 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7fd3700cadd0 con 0x7fd380102940 2024-05-08T05:33:44.535 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:44.535+0000 7fd384a00640 1 -- 172.21.15.87:0/186100324 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fd3801a34f0 con 0x7fd380102940 2024-05-08T05:33:44.536 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:44.536+0000 7fd377400640 1 -- 172.21.15.87:0/186100324 <== mon.2 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v82) ==== 93+0+10 (secure 0 0 0) 0x7fd3700ca6d0 con 0x7fd380102940 2024-05-08T05:33:44.536 INFO:teuthology.orchestra.run.smithi087.stdout:pg_num: 1 2024-05-08T05:33:44.539 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:44.539+0000 7fd384a00640 1 -- 172.21.15.87:0/186100324 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7fd3640b2870 msgr2=0x7fd3640b4d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:33:44.540 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:44.539+0000 7fd384a00640 1 --2- 172.21.15.87:0/186100324 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7fd3640b2870 0x7fd3640b4d30 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fd38019c270 tx=0x7fd368005f90 comp rx=0 tx=0).stop 2024-05-08T05:33:44.540 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:44.539+0000 7fd384a00640 1 -- 172.21.15.87:0/186100324 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd380102940 msgr2=0x7fd38019ad60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:33:44.540 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:44.539+0000 7fd384a00640 1 --2- 172.21.15.87:0/186100324 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd380102940 0x7fd38019ad60 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fd370031500 tx=0x7fd370003c10 comp rx=0 tx=0).stop 2024-05-08T05:33:44.540 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:44.539+0000 7fd384a00640 1 -- 172.21.15.87:0/186100324 shutdown_connections 2024-05-08T05:33:44.540 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:44.539+0000 7fd384a00640 1 --2- 172.21.15.87:0/186100324 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7fd3640b2870 0x7fd3640b4d30 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:33:44.540 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:44.539+0000 7fd384a00640 1 --2- 172.21.15.87:0/186100324 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd3801044f0 0x7fd3801a2310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:33:44.540 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:44.539+0000 7fd384a00640 1 --2- 172.21.15.87:0/186100324 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd380103b30 0x7fd38019b2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:33:44.540 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:44.539+0000 7fd384a00640 1 --2- 172.21.15.87:0/186100324 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd380102940 0x7fd38019ad60 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:33:44.540 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:44.539+0000 7fd384a00640 1 -- 172.21.15.87:0/186100324 >> 172.21.15.87:0/186100324 conn(0x7fd3800fdeb0 msgr2=0x7fd380074be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:33:44.540 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:44.539+0000 7fd384a00640 1 -- 172.21.15.87:0/186100324 shutdown_connections 2024-05-08T05:33:44.540 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:44.539+0000 7fd384a00640 1 -- 172.21.15.87:0/186100324 wait complete. 2024-05-08T05:33:44.559 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-05-08T05:33:44.770 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:44.769+0000 7fb661200640 1 -- 172.21.15.87:0/3779099303 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb65c1028c0 msgr2=0x7fb65c102ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:33:44.770 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:44.769+0000 7fb661200640 1 --2- 172.21.15.87:0/3779099303 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb65c1028c0 0x7fb65c102ce0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fb64c009860 tx=0x7fb64c02a340 comp rx=0 tx=0).stop 2024-05-08T05:33:44.770 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:44.770+0000 7fb661200640 1 -- 172.21.15.87:0/3779099303 shutdown_connections 2024-05-08T05:33:44.770 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:44.770+0000 7fb661200640 1 --2- 172.21.15.87:0/3779099303 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb65c104470 0x7fb65c10ad00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:33:44.771 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:44.770+0000 7fb661200640 1 --2- 172.21.15.87:0/3779099303 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb65c103ab0 0x7fb65c103f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:33:44.771 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:44.770+0000 7fb661200640 1 --2- 172.21.15.87:0/3779099303 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb65c1028c0 0x7fb65c102ce0 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:33:44.771 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:44.770+0000 7fb661200640 1 -- 172.21.15.87:0/3779099303 >> 172.21.15.87:0/3779099303 conn(0x7fb65c0fde50 msgr2=0x7fb65c100270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:33:44.771 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:44.770+0000 7fb661200640 1 -- 172.21.15.87:0/3779099303 shutdown_connections 2024-05-08T05:33:44.771 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:44.770+0000 7fb661200640 1 -- 172.21.15.87:0/3779099303 wait complete. 2024-05-08T05:33:44.772 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:44.771+0000 7fb661200640 1 Processor -- start 2024-05-08T05:33:44.772 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:44.771+0000 7fb661200640 1 -- start start 2024-05-08T05:33:44.772 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:44.771+0000 7fb661200640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb65c1028c0 0x7fb65c198ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:33:44.772 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:44.772+0000 7fb661200640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb65c103ab0 0x7fb65c199000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:33:44.772 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:44.772+0000 7fb661200640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb65c104470 0x7fb65c1a0070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:33:44.772 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:44.772+0000 7fb661200640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fb65c10e3f0 con 0x7fb65c104470 2024-05-08T05:33:44.772 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:44.772+0000 7fb661200640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fb65c10e270 con 0x7fb65c1028c0 2024-05-08T05:33:44.772 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:44.772+0000 7fb661200640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7fb65c10e570 con 0x7fb65c103ab0 2024-05-08T05:33:44.772 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:44.772+0000 7fb652a00640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb65c103ab0 0x7fb65c199000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:33:44.773 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:44.772+0000 7fb652a00640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb65c103ab0 0x7fb65c199000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.87:57322/0 (socket says 172.21.15.87:57322) 2024-05-08T05:33:44.773 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:44.772+0000 7fb652a00640 1 -- 172.21.15.87:0/933071512 learned_addr learned my addr 172.21.15.87:0/933071512 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T05:33:44.773 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:44.772+0000 7fb65be00640 1 --2- 172.21.15.87:0/933071512 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb65c104470 0x7fb65c1a0070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:33:44.773 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:44.772+0000 7fb65b400640 1 --2- 172.21.15.87:0/933071512 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb65c1028c0 0x7fb65c198ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:33:44.774 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:44.772+0000 7fb652a00640 1 -- 172.21.15.87:0/933071512 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb65c1028c0 msgr2=0x7fb65c198ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:33:44.774 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:44.772+0000 7fb652a00640 1 --2- 172.21.15.87:0/933071512 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb65c1028c0 0x7fb65c198ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:33:44.774 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:44.772+0000 7fb652a00640 1 -- 172.21.15.87:0/933071512 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb65c104470 msgr2=0x7fb65c1a0070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:33:44.774 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:44.772+0000 7fb652a00640 1 --2- 172.21.15.87:0/933071512 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb65c104470 0x7fb65c1a0070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:33:44.774 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:44.772+0000 7fb652a00640 1 -- 172.21.15.87:0/933071512 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb65c1a06e0 con 0x7fb65c103ab0 2024-05-08T05:33:44.774 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:44.773+0000 7fb652a00640 1 --2- 172.21.15.87:0/933071512 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb65c103ab0 0x7fb65c199000 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fb64400e9c0 tx=0x7fb64400ee80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:33:44.774 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:44.773+0000 7fb658c00640 1 -- 172.21.15.87:0/933071512 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb64400cde0 con 0x7fb65c103ab0 2024-05-08T05:33:44.774 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:44.773+0000 7fb658c00640 1 -- 172.21.15.87:0/933071512 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb6440035f0 con 0x7fb65c103ab0 2024-05-08T05:33:44.775 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:44.773+0000 7fb658c00640 1 -- 172.21.15.87:0/933071512 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb644010690 con 0x7fb65c103ab0 2024-05-08T05:33:44.775 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:44.773+0000 7fb661200640 1 -- 172.21.15.87:0/933071512 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb65c1a09d0 con 0x7fb65c103ab0 2024-05-08T05:33:44.775 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:44.773+0000 7fb661200640 1 -- 172.21.15.87:0/933071512 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb65c1a0ed0 con 0x7fb65c103ab0 2024-05-08T05:33:44.775 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:44.774+0000 7fb661200640 1 -- 172.21.15.87:0/933071512 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb65c109c60 con 0x7fb65c103ab0 2024-05-08T05:33:44.776 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:44.776+0000 7fb658c00640 1 -- 172.21.15.87:0/933071512 <== mon.1 v2:172.21.15.160:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7fb644004000 con 0x7fb65c103ab0 2024-05-08T05:33:44.778 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:44.778+0000 7fb658c00640 1 --2- 172.21.15.87:0/933071512 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7fb6400b27f0 0x7fb6400b4cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:33:44.778 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:44.778+0000 7fb658c00640 1 -- 172.21.15.87:0/933071512 <== mon.1 v2:172.21.15.160:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8190+0+0 (secure 0 0 0) 0x7fb6440e2520 con 0x7fb65c103ab0 2024-05-08T05:33:44.778 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:44.778+0000 7fb65b400640 1 --2- 172.21.15.87:0/933071512 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7fb6400b27f0 0x7fb6400b4cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:33:44.779 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:44.779+0000 7fb65b400640 1 --2- 172.21.15.87:0/933071512 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7fb6400b27f0 0x7fb6400b4cb0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fb64c009830 tx=0x7fb64c030450 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:33:44.782 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:44.782+0000 7fb658c00640 1 -- 172.21.15.87:0/933071512 <== mon.1 v2:172.21.15.160:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7fb644009510 con 0x7fb65c103ab0 2024-05-08T05:33:44.789 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:33:44 smithi160 ceph-mon[34827]: pgmap v562: 97 pgs: 97 active+clean; 153 MiB data, 986 MiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.1 MiB/s wr, 227 op/s 2024-05-08T05:33:44.789 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:33:44 smithi160 ceph-mon[34827]: from='client.? 172.21.15.87:0/2430653487' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-08T05:33:44.958 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:33:44 smithi087 ceph-mon[29523]: pgmap v562: 97 pgs: 97 active+clean; 153 MiB data, 986 MiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.1 MiB/s wr, 227 op/s 2024-05-08T05:33:44.958 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:33:44 smithi087 ceph-mon[29523]: from='client.? 172.21.15.87:0/2430653487' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-08T05:33:44.983 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:33:44 smithi090 ceph-mon[34526]: pgmap v562: 97 pgs: 97 active+clean; 153 MiB data, 986 MiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.1 MiB/s wr, 227 op/s 2024-05-08T05:33:44.983 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:33:44 smithi090 ceph-mon[34526]: from='client.? 172.21.15.87:0/2430653487' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-08T05:33:44.993 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:44.993+0000 7fb661200640 1 -- 172.21.15.87:0/933071512 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7fb65c0635b0 con 0x7fb65c103ab0 2024-05-08T05:33:44.994 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:44.994+0000 7fb658c00640 1 -- 172.21.15.87:0/933071512 <== mon.1 v2:172.21.15.160:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v82) ==== 104+0+11 (secure 0 0 0) 0x7fb6440aa210 con 0x7fb65c103ab0 2024-05-08T05:33:44.994 INFO:teuthology.orchestra.run.smithi087.stdout:pg_num: 32 2024-05-08T05:33:44.997 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:44.997+0000 7fb661200640 1 -- 172.21.15.87:0/933071512 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7fb6400b27f0 msgr2=0x7fb6400b4cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:33:44.997 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:44.997+0000 7fb661200640 1 --2- 172.21.15.87:0/933071512 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7fb6400b27f0 0x7fb6400b4cb0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fb64c009830 tx=0x7fb64c030450 comp rx=0 tx=0).stop 2024-05-08T05:33:44.997 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:44.997+0000 7fb661200640 1 -- 172.21.15.87:0/933071512 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb65c103ab0 msgr2=0x7fb65c199000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:33:44.997 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:44.997+0000 7fb661200640 1 --2- 172.21.15.87:0/933071512 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb65c103ab0 0x7fb65c199000 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fb64400e9c0 tx=0x7fb64400ee80 comp rx=0 tx=0).stop 2024-05-08T05:33:44.997 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:44.997+0000 7fb661200640 1 -- 172.21.15.87:0/933071512 shutdown_connections 2024-05-08T05:33:44.997 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:44.997+0000 7fb661200640 1 --2- 172.21.15.87:0/933071512 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7fb6400b27f0 0x7fb6400b4cb0 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:33:44.997 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:44.997+0000 7fb661200640 1 --2- 172.21.15.87:0/933071512 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb65c104470 0x7fb65c1a0070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:33:44.998 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:44.997+0000 7fb661200640 1 --2- 172.21.15.87:0/933071512 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb65c103ab0 0x7fb65c199000 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:33:44.998 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:44.997+0000 7fb661200640 1 --2- 172.21.15.87:0/933071512 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb65c1028c0 0x7fb65c198ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:33:44.998 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:44.997+0000 7fb661200640 1 -- 172.21.15.87:0/933071512 >> 172.21.15.87:0/933071512 conn(0x7fb65c0fde50 msgr2=0x7fb65c106e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:33:44.998 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:44.997+0000 7fb661200640 1 -- 172.21.15.87:0/933071512 shutdown_connections 2024-05-08T05:33:44.998 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:44.997+0000 7fb661200640 1 -- 172.21.15.87:0/933071512 wait complete. 2024-05-08T05:33:45.017 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-05-08T05:33:45.225 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:45.224+0000 7fc551a00640 1 -- 172.21.15.87:0/3697723760 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc54c076970 msgr2=0x7fc54c074dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:33:45.225 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:45.224+0000 7fc551a00640 1 --2- 172.21.15.87:0/3697723760 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc54c076970 0x7fc54c074dc0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fc53c009900 tx=0x7fc53c02a490 comp rx=0 tx=0).stop 2024-05-08T05:33:45.225 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:45.224+0000 7fc551a00640 1 -- 172.21.15.87:0/3697723760 shutdown_connections 2024-05-08T05:33:45.225 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:45.224+0000 7fc551a00640 1 --2- 172.21.15.87:0/3697723760 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc54c10a770 0x7fc54c10cc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:33:45.225 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:45.224+0000 7fc551a00640 1 --2- 172.21.15.87:0/3697723760 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc54c075390 0x7fc54c0757f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:33:45.225 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:45.224+0000 7fc551a00640 1 --2- 172.21.15.87:0/3697723760 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc54c076970 0x7fc54c074dc0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:33:45.225 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:45.224+0000 7fc551a00640 1 -- 172.21.15.87:0/3697723760 >> 172.21.15.87:0/3697723760 conn(0x7fc54c0fde50 msgr2=0x7fc54c100270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:33:45.225 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:45.224+0000 7fc551a00640 1 -- 172.21.15.87:0/3697723760 shutdown_connections 2024-05-08T05:33:45.226 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:45.224+0000 7fc551a00640 1 -- 172.21.15.87:0/3697723760 wait complete. 2024-05-08T05:33:45.228 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:45.225+0000 7fc551a00640 1 Processor -- start 2024-05-08T05:33:45.228 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:45.225+0000 7fc551a00640 1 -- start start 2024-05-08T05:33:45.228 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:45.226+0000 7fc551a00640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc54c075390 0x7fc54c19acf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:33:45.228 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:45.226+0000 7fc551a00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc54c076970 0x7fc54c19b230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:33:45.228 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:45.226+0000 7fc551a00640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc54c10a770 0x7fc54c1a2260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:33:45.228 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:45.226+0000 7fc551a00640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fc54c110640 con 0x7fc54c10a770 2024-05-08T05:33:45.228 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:45.226+0000 7fc551a00640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fc54c1104c0 con 0x7fc54c076970 2024-05-08T05:33:45.228 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:45.226+0000 7fc551a00640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7fc54c1107c0 con 0x7fc54c075390 2024-05-08T05:33:45.228 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:45.226+0000 7fc551000640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc54c10a770 0x7fc54c1a2260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:33:45.228 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:45.226+0000 7fc551000640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc54c10a770 0x7fc54c1a2260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:50236/0 (socket says 172.21.15.87:50236) 2024-05-08T05:33:45.228 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:45.226+0000 7fc551000640 1 -- 172.21.15.87:0/3857339661 learned_addr learned my addr 172.21.15.87:0/3857339661 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T05:33:45.228 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:45.226+0000 7fc54be00640 1 --2- 172.21.15.87:0/3857339661 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc54c075390 0x7fc54c19acf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:33:45.228 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:45.226+0000 7fc54b400640 1 --2- 172.21.15.87:0/3857339661 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc54c076970 0x7fc54c19b230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:33:45.229 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:45.226+0000 7fc551000640 1 -- 172.21.15.87:0/3857339661 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc54c075390 msgr2=0x7fc54c19acf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:33:45.229 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:45.226+0000 7fc551000640 1 --2- 172.21.15.87:0/3857339661 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc54c075390 0x7fc54c19acf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:33:45.229 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:45.226+0000 7fc551000640 1 -- 172.21.15.87:0/3857339661 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc54c076970 msgr2=0x7fc54c19b230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:33:45.229 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:45.226+0000 7fc551000640 1 --2- 172.21.15.87:0/3857339661 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc54c076970 0x7fc54c19b230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:33:45.229 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:45.226+0000 7fc551000640 1 -- 172.21.15.87:0/3857339661 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc54c1a2900 con 0x7fc54c10a770 2024-05-08T05:33:45.229 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:45.226+0000 7fc54b400640 1 --2- 172.21.15.87:0/3857339661 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc54c076970 0x7fc54c19b230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T05:33:45.229 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:45.227+0000 7fc551000640 1 --2- 172.21.15.87:0/3857339661 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc54c10a770 0x7fc54c1a2260 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fc54400eb10 tx=0x7fc54400c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:33:45.229 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:45.227+0000 7fc548c00640 1 -- 172.21.15.87:0/3857339661 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc544004b20 con 0x7fc54c10a770 2024-05-08T05:33:45.229 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:45.227+0000 7fc551a00640 1 -- 172.21.15.87:0/3857339661 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc54c1a2bf0 con 0x7fc54c10a770 2024-05-08T05:33:45.229 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:45.227+0000 7fc548c00640 1 -- 172.21.15.87:0/3857339661 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc544004cc0 con 0x7fc54c10a770 2024-05-08T05:33:45.229 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:45.227+0000 7fc548c00640 1 -- 172.21.15.87:0/3857339661 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc544010690 con 0x7fc54c10a770 2024-05-08T05:33:45.229 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:45.227+0000 7fc551a00640 1 -- 172.21.15.87:0/3857339661 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc54c1a3160 con 0x7fc54c10a770 2024-05-08T05:33:45.230 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:45.228+0000 7fc551a00640 1 -- 172.21.15.87:0/3857339661 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc54c109530 con 0x7fc54c10a770 2024-05-08T05:33:45.231 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:45.231+0000 7fc548c00640 1 -- 172.21.15.87:0/3857339661 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7fc544005020 con 0x7fc54c10a770 2024-05-08T05:33:45.233 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:45.233+0000 7fc548c00640 1 --2- 172.21.15.87:0/3857339661 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7fc5300b27f0 0x7fc5300b4cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:33:45.233 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:45.233+0000 7fc548c00640 1 -- 172.21.15.87:0/3857339661 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8190+0+0 (secure 0 0 0) 0x7fc5440e2850 con 0x7fc54c10a770 2024-05-08T05:33:45.233 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:45.233+0000 7fc54be00640 1 --2- 172.21.15.87:0/3857339661 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7fc5300b27f0 0x7fc5300b4cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:33:45.234 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:45.234+0000 7fc54be00640 1 --2- 172.21.15.87:0/3857339661 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7fc5300b27f0 0x7fc5300b4cb0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fc53c031500 tx=0x7fc53c005a20 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:33:45.238 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:45.238+0000 7fc548c00640 1 -- 172.21.15.87:0/3857339661 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7fc5440aa540 con 0x7fc54c10a770 2024-05-08T05:33:45.454 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:45.453+0000 7fc551a00640 1 -- 172.21.15.87:0/3857339661 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7fc54c0635b0 con 0x7fc54c10a770 2024-05-08T05:33:45.455 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:45.454+0000 7fc548c00640 1 -- 172.21.15.87:0/3857339661 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v82) ==== 100+0+11 (secure 0 0 0) 0x7fc5440a9e40 con 0x7fc54c10a770 2024-05-08T05:33:45.455 INFO:teuthology.orchestra.run.smithi087.stdout:pg_num: 64 2024-05-08T05:33:45.457 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:45.457+0000 7fc551a00640 1 -- 172.21.15.87:0/3857339661 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7fc5300b27f0 msgr2=0x7fc5300b4cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:33:45.457 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:45.457+0000 7fc551a00640 1 --2- 172.21.15.87:0/3857339661 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7fc5300b27f0 0x7fc5300b4cb0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fc53c031500 tx=0x7fc53c005a20 comp rx=0 tx=0).stop 2024-05-08T05:33:45.457 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:45.457+0000 7fc551a00640 1 -- 172.21.15.87:0/3857339661 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc54c10a770 msgr2=0x7fc54c1a2260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:33:45.458 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:45.457+0000 7fc551a00640 1 --2- 172.21.15.87:0/3857339661 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc54c10a770 0x7fc54c1a2260 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fc54400eb10 tx=0x7fc54400c2d0 comp rx=0 tx=0).stop 2024-05-08T05:33:45.458 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:45.457+0000 7fc551a00640 1 -- 172.21.15.87:0/3857339661 shutdown_connections 2024-05-08T05:33:45.458 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:45.457+0000 7fc551a00640 1 --2- 172.21.15.87:0/3857339661 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7fc5300b27f0 0x7fc5300b4cb0 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:33:45.459 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:45.457+0000 7fc551a00640 1 --2- 172.21.15.87:0/3857339661 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc54c10a770 0x7fc54c1a2260 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:33:45.459 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:45.457+0000 7fc551a00640 1 --2- 172.21.15.87:0/3857339661 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc54c076970 0x7fc54c19b230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:33:45.459 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:45.457+0000 7fc551a00640 1 --2- 172.21.15.87:0/3857339661 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc54c075390 0x7fc54c19acf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:33:45.459 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:45.457+0000 7fc551a00640 1 -- 172.21.15.87:0/3857339661 >> 172.21.15.87:0/3857339661 conn(0x7fc54c0fde50 msgr2=0x7fc54c106700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:33:45.459 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:45.458+0000 7fc551a00640 1 -- 172.21.15.87:0/3857339661 shutdown_connections 2024-05-08T05:33:45.459 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:45.458+0000 7fc551a00640 1 -- 172.21.15.87:0/3857339661 wait complete. 2024-05-08T05:33:45.478 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json-pretty 2024-05-08T05:33:45.683 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:45.682+0000 7f996b600640 1 -- 172.21.15.87:0/2803967633 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9964109010 msgr2=0x7f9964109430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:33:45.683 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:45.682+0000 7f996b600640 1 --2- 172.21.15.87:0/2803967633 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9964109010 0x7f9964109430 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f9954009900 tx=0x7f995402a3f0 comp rx=0 tx=0).stop 2024-05-08T05:33:45.683 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:45.682+0000 7f996b600640 1 -- 172.21.15.87:0/2803967633 shutdown_connections 2024-05-08T05:33:45.683 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:45.682+0000 7f996b600640 1 --2- 172.21.15.87:0/2803967633 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f996410abc0 0x7f9964111450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:33:45.683 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:45.682+0000 7f996b600640 1 --2- 172.21.15.87:0/2803967633 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f996410a200 0x7f996410a680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:33:45.683 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:45.682+0000 7f996b600640 1 --2- 172.21.15.87:0/2803967633 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9964109010 0x7f9964109430 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:33:45.683 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:45.682+0000 7f996b600640 1 -- 172.21.15.87:0/2803967633 >> 172.21.15.87:0/2803967633 conn(0x7f9964077fd0 msgr2=0x7f996407a3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:33:45.683 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:45.682+0000 7f996b600640 1 -- 172.21.15.87:0/2803967633 shutdown_connections 2024-05-08T05:33:45.683 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:45.682+0000 7f996b600640 1 -- 172.21.15.87:0/2803967633 wait complete. 2024-05-08T05:33:45.686 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:45.683+0000 7f996b600640 1 Processor -- start 2024-05-08T05:33:45.686 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:45.683+0000 7f996b600640 1 -- start start 2024-05-08T05:33:45.686 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:45.683+0000 7f996b600640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9964109010 0x7f996419f240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:33:45.686 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:45.684+0000 7f996b600640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f996410a200 0x7f996419f780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:33:45.686 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:45.684+0000 7f996b600640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f996410abc0 0x7f99641a67f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:33:45.686 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:45.684+0000 7f996b600640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f9964114ba0 con 0x7f9964109010 2024-05-08T05:33:45.686 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:45.684+0000 7f996b600640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f9964114a20 con 0x7f996410abc0 2024-05-08T05:33:45.686 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:45.684+0000 7f996b600640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f9964114d20 con 0x7f996410a200 2024-05-08T05:33:45.686 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:45.684+0000 7f9968c00640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9964109010 0x7f996419f240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:33:45.687 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:45.684+0000 7f9968c00640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9964109010 0x7f996419f240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:50250/0 (socket says 172.21.15.87:50250) 2024-05-08T05:33:45.687 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:45.684+0000 7f9968c00640 1 -- 172.21.15.87:0/3250649131 learned_addr learned my addr 172.21.15.87:0/3250649131 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T05:33:45.687 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:45.684+0000 7f9969600640 1 --2- 172.21.15.87:0/3250649131 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f996410abc0 0x7f99641a67f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:33:45.687 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:45.684+0000 7f995be00640 1 --2- 172.21.15.87:0/3250649131 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f996410a200 0x7f996419f780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:33:45.687 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:45.684+0000 7f9968c00640 1 -- 172.21.15.87:0/3250649131 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f996410a200 msgr2=0x7f996419f780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:33:45.687 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:45.684+0000 7f9968c00640 1 --2- 172.21.15.87:0/3250649131 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f996410a200 0x7f996419f780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:33:45.687 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:45.684+0000 7f9968c00640 1 -- 172.21.15.87:0/3250649131 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f996410abc0 msgr2=0x7f99641a67f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:33:45.687 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:45.684+0000 7f9968c00640 1 --2- 172.21.15.87:0/3250649131 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f996410abc0 0x7f99641a67f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:33:45.687 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:45.684+0000 7f9968c00640 1 -- 172.21.15.87:0/3250649131 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f99641a6e60 con 0x7f9964109010 2024-05-08T05:33:45.687 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:45.684+0000 7f9969600640 1 --2- 172.21.15.87:0/3250649131 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f996410abc0 0x7f99641a67f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T05:33:45.687 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:45.685+0000 7f9968c00640 1 --2- 172.21.15.87:0/3250649131 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9964109010 0x7f996419f240 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f9954031500 tx=0x7f9954003c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:33:45.687 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:45.685+0000 7f9962000640 1 -- 172.21.15.87:0/3250649131 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f995403f070 con 0x7f9964109010 2024-05-08T05:33:45.687 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:45.685+0000 7f9962000640 1 -- 172.21.15.87:0/3250649131 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9954031c50 con 0x7f9964109010 2024-05-08T05:33:45.687 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:45.685+0000 7f996b600640 1 -- 172.21.15.87:0/3250649131 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f99641a70f0 con 0x7f9964109010 2024-05-08T05:33:45.687 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:45.685+0000 7f9962000640 1 -- 172.21.15.87:0/3250649131 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9954035030 con 0x7f9964109010 2024-05-08T05:33:45.688 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:45.685+0000 7f996b600640 1 -- 172.21.15.87:0/3250649131 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f99641a7630 con 0x7f9964109010 2024-05-08T05:33:45.688 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:45.687+0000 7f996b600640 1 -- 172.21.15.87:0/3250649131 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f99641103a0 con 0x7f9964109010 2024-05-08T05:33:45.689 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:45.689+0000 7f9962000640 1 -- 172.21.15.87:0/3250649131 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7f9954042070 con 0x7f9964109010 2024-05-08T05:33:45.690 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:45.690+0000 7f9962000640 1 --2- 172.21.15.87:0/3250649131 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f99480b2870 0x7f99480b4d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:33:45.690 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:45.690+0000 7f9962000640 1 -- 172.21.15.87:0/3250649131 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8190+0+0 (secure 0 0 0) 0x7f9954102f80 con 0x7f9964109010 2024-05-08T05:33:45.691 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:45.691+0000 7f995be00640 1 --2- 172.21.15.87:0/3250649131 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f99480b2870 0x7f99480b4d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:33:45.691 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:45.691+0000 7f995be00640 1 --2- 172.21.15.87:0/3250649131 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f99480b2870 0x7f99480b4d30 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f99641a0750 tx=0x7f994c00b390 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:33:45.693 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:45.693+0000 7f9962000640 1 -- 172.21.15.87:0/3250649131 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f99540ca620 con 0x7f9964109010 2024-05-08T05:33:45.788 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:33:45 smithi160 ceph-mon[34827]: from='client.? 172.21.15.87:0/186100324' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-05-08T05:33:45.788 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:33:45 smithi160 ceph-mon[34827]: from='client.? 172.21.15.87:0/933071512' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-05-08T05:33:45.789 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:33:45 smithi160 ceph-mon[34827]: from='client.? 172.21.15.87:0/3857339661' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-05-08T05:33:45.954 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:45.953+0000 7f996b600640 1 -- 172.21.15.87:0/3250649131 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json-pretty"} v 0) -- 0x7f99640635b0 con 0x7f9964109010 2024-05-08T05:33:45.958 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:33:45 smithi087 ceph-mon[29523]: from='client.? 172.21.15.87:0/186100324' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-05-08T05:33:45.958 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:33:45 smithi087 ceph-mon[29523]: from='client.? 172.21.15.87:0/933071512' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-05-08T05:33:45.958 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:33:45 smithi087 ceph-mon[29523]: from='client.? 172.21.15.87:0/3857339661' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-05-08T05:33:45.983 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:33:45 smithi090 ceph-mon[34526]: from='client.? 172.21.15.87:0/186100324' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-05-08T05:33:45.983 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:33:45 smithi090 ceph-mon[34526]: from='client.? 172.21.15.87:0/933071512' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-05-08T05:33:45.983 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:33:45 smithi090 ceph-mon[34526]: from='client.? 172.21.15.87:0/3857339661' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-05-08T05:33:45.992 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:45.992+0000 7f9962000640 1 -- 172.21.15.87:0/3250649131 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json-pretty"}]=0 v18) ==== 81+0+815639 (secure 0 0 0) 0x7f99540ce920 con 0x7f9964109010 2024-05-08T05:33:46.006 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-05-08T05:33:46.006 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-05-08T05:33:46.006 INFO:teuthology.orchestra.run.smithi087.stdout: "epoch": 18, 2024-05-08T05:33:46.006 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-08T05:33:46.006 INFO:teuthology.orchestra.run.smithi087.stdout: "active_gid": 14152, 2024-05-08T05:33:46.006 INFO:teuthology.orchestra.run.smithi087.stdout: "active_name": "x", 2024-05-08T05:33:46.006 INFO:teuthology.orchestra.run.smithi087.stdout: "active_addrs": { 2024-05-08T05:33:46.006 INFO:teuthology.orchestra.run.smithi087.stdout: "addrvec": [ 2024-05-08T05:33:46.006 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-05-08T05:33:46.006 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "v2", 2024-05-08T05:33:46.006 INFO:teuthology.orchestra.run.smithi087.stdout: "addr": "172.21.15.87:6800", 2024-05-08T05:33:46.006 INFO:teuthology.orchestra.run.smithi087.stdout: "nonce": 1189186457 2024-05-08T05:33:46.007 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.007 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-05-08T05:33:46.007 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "v1", 2024-05-08T05:33:46.007 INFO:teuthology.orchestra.run.smithi087.stdout: "addr": "172.21.15.87:6801", 2024-05-08T05:33:46.007 INFO:teuthology.orchestra.run.smithi087.stdout: "nonce": 1189186457 2024-05-08T05:33:46.007 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-05-08T05:33:46.007 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-05-08T05:33:46.007 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.007 INFO:teuthology.orchestra.run.smithi087.stdout: "active_addr": "172.21.15.87:6801/1189186457", 2024-05-08T05:33:46.007 INFO:teuthology.orchestra.run.smithi087.stdout: "active_change": "2024-05-08T05:17:22.736489+0000", 2024-05-08T05:33:46.007 INFO:teuthology.orchestra.run.smithi087.stdout: "active_mgr_features": 4540701547738038271, 2024-05-08T05:33:46.007 INFO:teuthology.orchestra.run.smithi087.stdout: "available": true, 2024-05-08T05:33:46.007 INFO:teuthology.orchestra.run.smithi087.stdout: "standbys": [ 2024-05-08T05:33:46.007 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-05-08T05:33:46.008 INFO:teuthology.orchestra.run.smithi087.stdout: "gid": 24109, 2024-05-08T05:33:46.008 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "z", 2024-05-08T05:33:46.008 INFO:teuthology.orchestra.run.smithi087.stdout: "mgr_features": 4540701547738038271, 2024-05-08T05:33:46.008 INFO:teuthology.orchestra.run.smithi087.stdout: "available_modules": [ 2024-05-08T05:33:46.008 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-05-08T05:33:46.008 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "alerts", 2024-05-08T05:33:46.008 INFO:teuthology.orchestra.run.smithi087.stdout: "can_run": true, 2024-05-08T05:33:46.008 INFO:teuthology.orchestra.run.smithi087.stdout: "error_string": "", 2024-05-08T05:33:46.008 INFO:teuthology.orchestra.run.smithi087.stdout: "module_options": { 2024-05-08T05:33:46.008 INFO:teuthology.orchestra.run.smithi087.stdout: "interval": { 2024-05-08T05:33:46.008 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "interval", 2024-05-08T05:33:46.008 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "secs", 2024-05-08T05:33:46.008 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.009 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:46.009 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "60", 2024-05-08T05:33:46.009 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.009 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.009 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.009 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "How frequently to reexamine health status", 2024-05-08T05:33:46.009 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.009 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.009 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.009 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.009 INFO:teuthology.orchestra.run.smithi087.stdout: "log_level": { 2024-05-08T05:33:46.009 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_level", 2024-05-08T05:33:46.009 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-08T05:33:46.009 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.010 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:46.010 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-05-08T05:33:46.010 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.010 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.010 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [ 2024-05-08T05:33:46.010 INFO:teuthology.orchestra.run.smithi087.stdout: "", 2024-05-08T05:33:46.010 INFO:teuthology.orchestra.run.smithi087.stdout: "critical", 2024-05-08T05:33:46.010 INFO:teuthology.orchestra.run.smithi087.stdout: "debug", 2024-05-08T05:33:46.010 INFO:teuthology.orchestra.run.smithi087.stdout: "error", 2024-05-08T05:33:46.010 INFO:teuthology.orchestra.run.smithi087.stdout: "info", 2024-05-08T05:33:46.010 INFO:teuthology.orchestra.run.smithi087.stdout: "warning" 2024-05-08T05:33:46.010 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-05-08T05:33:46.010 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:46.010 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.010 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.011 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.011 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.011 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_cluster": { 2024-05-08T05:33:46.011 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_cluster", 2024-05-08T05:33:46.011 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-08T05:33:46.011 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.011 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:46.011 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-05-08T05:33:46.011 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.011 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.011 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.011 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:46.011 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.011 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.012 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.012 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.012 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_cluster_level": { 2024-05-08T05:33:46.012 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_cluster_level", 2024-05-08T05:33:46.012 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-08T05:33:46.012 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.012 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:46.012 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "info", 2024-05-08T05:33:46.012 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.012 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.012 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [ 2024-05-08T05:33:46.012 INFO:teuthology.orchestra.run.smithi087.stdout: "", 2024-05-08T05:33:46.012 INFO:teuthology.orchestra.run.smithi087.stdout: "critical", 2024-05-08T05:33:46.012 INFO:teuthology.orchestra.run.smithi087.stdout: "debug", 2024-05-08T05:33:46.012 INFO:teuthology.orchestra.run.smithi087.stdout: "error", 2024-05-08T05:33:46.013 INFO:teuthology.orchestra.run.smithi087.stdout: "info", 2024-05-08T05:33:46.013 INFO:teuthology.orchestra.run.smithi087.stdout: "warning" 2024-05-08T05:33:46.013 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-05-08T05:33:46.013 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:46.013 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.013 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.013 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.013 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.013 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_file": { 2024-05-08T05:33:46.013 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_file", 2024-05-08T05:33:46.013 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-08T05:33:46.013 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.013 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:46.013 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-05-08T05:33:46.014 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.014 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.014 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.014 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:46.014 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.014 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.014 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.014 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.014 INFO:teuthology.orchestra.run.smithi087.stdout: "smtp_destination": { 2024-05-08T05:33:46.014 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "smtp_destination", 2024-05-08T05:33:46.014 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-08T05:33:46.014 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.014 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:46.014 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-05-08T05:33:46.014 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.015 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.015 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.015 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "Email address to send alerts to", 2024-05-08T05:33:46.015 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.015 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.015 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.015 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.015 INFO:teuthology.orchestra.run.smithi087.stdout: "smtp_from_name": { 2024-05-08T05:33:46.015 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "smtp_from_name", 2024-05-08T05:33:46.015 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-08T05:33:46.015 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.015 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:46.015 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "Ceph", 2024-05-08T05:33:46.015 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.015 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.017 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.017 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "Email From: name", 2024-05-08T05:33:46.017 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.017 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.017 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.017 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.017 INFO:teuthology.orchestra.run.smithi087.stdout: "smtp_host": { 2024-05-08T05:33:46.018 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "smtp_host", 2024-05-08T05:33:46.018 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-08T05:33:46.018 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.018 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:46.018 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-05-08T05:33:46.018 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.018 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.018 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.018 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "SMTP server", 2024-05-08T05:33:46.019 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.019 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.019 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.019 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.019 INFO:teuthology.orchestra.run.smithi087.stdout: "smtp_password": { 2024-05-08T05:33:46.019 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "smtp_password", 2024-05-08T05:33:46.019 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-08T05:33:46.019 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.019 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:46.019 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-05-08T05:33:46.019 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.020 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.020 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.020 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "Password to authenticate with", 2024-05-08T05:33:46.020 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.020 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.020 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.020 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.020 INFO:teuthology.orchestra.run.smithi087.stdout: "smtp_port": { 2024-05-08T05:33:46.020 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "smtp_port", 2024-05-08T05:33:46.020 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "int", 2024-05-08T05:33:46.020 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.020 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:46.020 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "465", 2024-05-08T05:33:46.020 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.020 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.021 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.021 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "SMTP port", 2024-05-08T05:33:46.021 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.021 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.021 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.021 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.021 INFO:teuthology.orchestra.run.smithi087.stdout: "smtp_sender": { 2024-05-08T05:33:46.021 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "smtp_sender", 2024-05-08T05:33:46.021 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-08T05:33:46.021 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.021 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:46.021 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-05-08T05:33:46.022 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.022 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.022 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.022 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "SMTP envelope sender", 2024-05-08T05:33:46.022 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.022 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.022 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.022 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.022 INFO:teuthology.orchestra.run.smithi087.stdout: "smtp_ssl": { 2024-05-08T05:33:46.022 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "smtp_ssl", 2024-05-08T05:33:46.022 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-08T05:33:46.022 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.023 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:46.023 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "True", 2024-05-08T05:33:46.023 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.023 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.023 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.023 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "Use SSL to connect to SMTP server", 2024-05-08T05:33:46.023 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.023 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.023 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.023 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.023 INFO:teuthology.orchestra.run.smithi087.stdout: "smtp_user": { 2024-05-08T05:33:46.023 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "smtp_user", 2024-05-08T05:33:46.023 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-08T05:33:46.023 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.023 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:46.024 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-05-08T05:33:46.024 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.024 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.024 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.024 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "User to authenticate as", 2024-05-08T05:33:46.024 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.024 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.024 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.024 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.024 INFO:teuthology.orchestra.run.smithi087.stdout: "sqlite3_killpoint": { 2024-05-08T05:33:46.024 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "sqlite3_killpoint", 2024-05-08T05:33:46.024 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "int", 2024-05-08T05:33:46.024 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "dev", 2024-05-08T05:33:46.024 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:46.025 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "0", 2024-05-08T05:33:46.025 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.025 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.025 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.025 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:46.025 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.025 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.025 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.025 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-05-08T05:33:46.025 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-05-08T05:33:46.025 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.025 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-05-08T05:33:46.025 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "balancer", 2024-05-08T05:33:46.025 INFO:teuthology.orchestra.run.smithi087.stdout: "can_run": true, 2024-05-08T05:33:46.025 INFO:teuthology.orchestra.run.smithi087.stdout: "error_string": "", 2024-05-08T05:33:46.026 INFO:teuthology.orchestra.run.smithi087.stdout: "module_options": { 2024-05-08T05:33:46.026 INFO:teuthology.orchestra.run.smithi087.stdout: "active": { 2024-05-08T05:33:46.026 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "active", 2024-05-08T05:33:46.026 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-08T05:33:46.026 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.026 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:46.026 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "True", 2024-05-08T05:33:46.026 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.026 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.026 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.026 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "automatically balance PGs across cluster", 2024-05-08T05:33:46.026 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.026 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.026 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.027 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.027 INFO:teuthology.orchestra.run.smithi087.stdout: "begin_time": { 2024-05-08T05:33:46.027 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "begin_time", 2024-05-08T05:33:46.027 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-08T05:33:46.027 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.027 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:46.027 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "0000", 2024-05-08T05:33:46.027 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.027 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.027 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.027 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "beginning time of day to automatically balance", 2024-05-08T05:33:46.027 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-05-08T05:33:46.027 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.027 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.028 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.028 INFO:teuthology.orchestra.run.smithi087.stdout: "begin_weekday": { 2024-05-08T05:33:46.028 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "begin_weekday", 2024-05-08T05:33:46.028 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "uint", 2024-05-08T05:33:46.028 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.028 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:46.028 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "0", 2024-05-08T05:33:46.028 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "0", 2024-05-08T05:33:46.028 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "6", 2024-05-08T05:33:46.028 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.028 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2024-05-08T05:33:46.028 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-05-08T05:33:46.028 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.028 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.029 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.029 INFO:teuthology.orchestra.run.smithi087.stdout: "crush_compat_max_iterations": { 2024-05-08T05:33:46.029 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "crush_compat_max_iterations", 2024-05-08T05:33:46.029 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "uint", 2024-05-08T05:33:46.029 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.029 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:46.029 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "25", 2024-05-08T05:33:46.029 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "1", 2024-05-08T05:33:46.029 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "250", 2024-05-08T05:33:46.029 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.029 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "maximum number of iterations to attempt optimization", 2024-05-08T05:33:46.029 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.029 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.029 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.029 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.030 INFO:teuthology.orchestra.run.smithi087.stdout: "crush_compat_metrics": { 2024-05-08T05:33:46.030 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "crush_compat_metrics", 2024-05-08T05:33:46.030 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-08T05:33:46.030 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.030 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:46.030 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "pgs,objects,bytes", 2024-05-08T05:33:46.030 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.030 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.030 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.030 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "metrics with which to calculate OSD utilization", 2024-05-08T05:33:46.030 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2024-05-08T05:33:46.030 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.030 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.030 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.031 INFO:teuthology.orchestra.run.smithi087.stdout: "crush_compat_step": { 2024-05-08T05:33:46.031 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "crush_compat_step", 2024-05-08T05:33:46.031 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "float", 2024-05-08T05:33:46.031 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.031 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:46.031 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "0.5", 2024-05-08T05:33:46.031 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "0.001", 2024-05-08T05:33:46.031 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "0.999", 2024-05-08T05:33:46.031 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.031 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "aggressiveness of optimization", 2024-05-08T05:33:46.031 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2024-05-08T05:33:46.031 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.031 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.031 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.031 INFO:teuthology.orchestra.run.smithi087.stdout: "end_time": { 2024-05-08T05:33:46.032 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "end_time", 2024-05-08T05:33:46.032 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-08T05:33:46.032 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.032 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:46.032 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "2359", 2024-05-08T05:33:46.032 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.032 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.032 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.032 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "ending time of day to automatically balance", 2024-05-08T05:33:46.032 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-05-08T05:33:46.032 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.032 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.032 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.032 INFO:teuthology.orchestra.run.smithi087.stdout: "end_weekday": { 2024-05-08T05:33:46.033 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "end_weekday", 2024-05-08T05:33:46.033 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "uint", 2024-05-08T05:33:46.033 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.033 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:46.033 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "0", 2024-05-08T05:33:46.033 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "0", 2024-05-08T05:33:46.033 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "6", 2024-05-08T05:33:46.033 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.033 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2024-05-08T05:33:46.033 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-05-08T05:33:46.033 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.033 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.033 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.033 INFO:teuthology.orchestra.run.smithi087.stdout: "log_level": { 2024-05-08T05:33:46.033 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_level", 2024-05-08T05:33:46.034 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-08T05:33:46.034 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.034 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:46.034 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-05-08T05:33:46.034 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.034 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.034 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [ 2024-05-08T05:33:46.034 INFO:teuthology.orchestra.run.smithi087.stdout: "", 2024-05-08T05:33:46.034 INFO:teuthology.orchestra.run.smithi087.stdout: "critical", 2024-05-08T05:33:46.034 INFO:teuthology.orchestra.run.smithi087.stdout: "debug", 2024-05-08T05:33:46.034 INFO:teuthology.orchestra.run.smithi087.stdout: "error", 2024-05-08T05:33:46.035 INFO:teuthology.orchestra.run.smithi087.stdout: "info", 2024-05-08T05:33:46.035 INFO:teuthology.orchestra.run.smithi087.stdout: "warning" 2024-05-08T05:33:46.035 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-05-08T05:33:46.035 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:46.035 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.035 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.035 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.035 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.035 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_cluster": { 2024-05-08T05:33:46.035 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_cluster", 2024-05-08T05:33:46.035 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-08T05:33:46.035 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.035 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:46.035 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-05-08T05:33:46.035 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.036 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.036 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.036 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:46.036 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.036 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.036 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.036 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.036 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_cluster_level": { 2024-05-08T05:33:46.036 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_cluster_level", 2024-05-08T05:33:46.036 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-08T05:33:46.036 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.036 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:46.036 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "info", 2024-05-08T05:33:46.036 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.037 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.037 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [ 2024-05-08T05:33:46.037 INFO:teuthology.orchestra.run.smithi087.stdout: "", 2024-05-08T05:33:46.037 INFO:teuthology.orchestra.run.smithi087.stdout: "critical", 2024-05-08T05:33:46.037 INFO:teuthology.orchestra.run.smithi087.stdout: "debug", 2024-05-08T05:33:46.037 INFO:teuthology.orchestra.run.smithi087.stdout: "error", 2024-05-08T05:33:46.037 INFO:teuthology.orchestra.run.smithi087.stdout: "info", 2024-05-08T05:33:46.037 INFO:teuthology.orchestra.run.smithi087.stdout: "warning" 2024-05-08T05:33:46.037 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-05-08T05:33:46.037 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:46.037 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.037 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.037 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.037 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.037 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_file": { 2024-05-08T05:33:46.038 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_file", 2024-05-08T05:33:46.038 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-08T05:33:46.038 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.038 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:46.038 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-05-08T05:33:46.038 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.038 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.038 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.038 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:46.038 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.038 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.038 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.038 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.038 INFO:teuthology.orchestra.run.smithi087.stdout: "min_score": { 2024-05-08T05:33:46.039 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "min_score", 2024-05-08T05:33:46.039 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "float", 2024-05-08T05:33:46.039 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.039 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:46.039 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "0", 2024-05-08T05:33:46.039 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.039 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.039 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.039 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "minimum score, below which no optimization is attempted", 2024-05-08T05:33:46.039 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.039 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.039 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.039 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.039 INFO:teuthology.orchestra.run.smithi087.stdout: "mode": { 2024-05-08T05:33:46.039 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "mode", 2024-05-08T05:33:46.040 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-08T05:33:46.040 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.040 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:46.040 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "upmap", 2024-05-08T05:33:46.040 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.040 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.040 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [ 2024-05-08T05:33:46.040 INFO:teuthology.orchestra.run.smithi087.stdout: "crush-compat", 2024-05-08T05:33:46.040 INFO:teuthology.orchestra.run.smithi087.stdout: "none", 2024-05-08T05:33:46.040 INFO:teuthology.orchestra.run.smithi087.stdout: "read", 2024-05-08T05:33:46.040 INFO:teuthology.orchestra.run.smithi087.stdout: "upmap", 2024-05-08T05:33:46.040 INFO:teuthology.orchestra.run.smithi087.stdout: "upmap-read" 2024-05-08T05:33:46.040 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-05-08T05:33:46.040 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "Balancer mode", 2024-05-08T05:33:46.041 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.041 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.041 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.041 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.041 INFO:teuthology.orchestra.run.smithi087.stdout: "pool_ids": { 2024-05-08T05:33:46.041 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "pool_ids", 2024-05-08T05:33:46.041 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-08T05:33:46.041 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.041 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:46.041 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-05-08T05:33:46.041 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.041 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.041 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.041 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "pools which the automatic balancing will be limited to", 2024-05-08T05:33:46.041 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.042 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.042 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.042 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.042 INFO:teuthology.orchestra.run.smithi087.stdout: "sleep_interval": { 2024-05-08T05:33:46.042 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "sleep_interval", 2024-05-08T05:33:46.042 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "secs", 2024-05-08T05:33:46.042 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.042 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:46.042 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "60", 2024-05-08T05:33:46.042 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.042 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.042 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.042 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "how frequently to wake up and attempt optimization", 2024-05-08T05:33:46.042 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.042 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.043 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.043 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.043 INFO:teuthology.orchestra.run.smithi087.stdout: "sqlite3_killpoint": { 2024-05-08T05:33:46.043 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "sqlite3_killpoint", 2024-05-08T05:33:46.043 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "int", 2024-05-08T05:33:46.043 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "dev", 2024-05-08T05:33:46.043 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:46.043 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "0", 2024-05-08T05:33:46.043 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.043 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.043 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.043 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:46.043 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.043 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.043 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.043 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.044 INFO:teuthology.orchestra.run.smithi087.stdout: "upmap_max_deviation": { 2024-05-08T05:33:46.044 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "upmap_max_deviation", 2024-05-08T05:33:46.044 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "int", 2024-05-08T05:33:46.044 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.044 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:46.044 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "5", 2024-05-08T05:33:46.044 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "1", 2024-05-08T05:33:46.044 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.044 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.044 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "deviation below which no optimization is attempted", 2024-05-08T05:33:46.045 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2024-05-08T05:33:46.045 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.045 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.045 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.045 INFO:teuthology.orchestra.run.smithi087.stdout: "upmap_max_optimizations": { 2024-05-08T05:33:46.045 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "upmap_max_optimizations", 2024-05-08T05:33:46.045 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "uint", 2024-05-08T05:33:46.045 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.045 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:46.045 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "10", 2024-05-08T05:33:46.045 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.045 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.045 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.045 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "maximum upmap optimizations to make per attempt", 2024-05-08T05:33:46.046 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.046 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.046 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.046 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-05-08T05:33:46.046 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-05-08T05:33:46.046 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.046 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-05-08T05:33:46.046 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "cephadm", 2024-05-08T05:33:46.046 INFO:teuthology.orchestra.run.smithi087.stdout: "can_run": true, 2024-05-08T05:33:46.046 INFO:teuthology.orchestra.run.smithi087.stdout: "error_string": "", 2024-05-08T05:33:46.046 INFO:teuthology.orchestra.run.smithi087.stdout: "module_options": { 2024-05-08T05:33:46.046 INFO:teuthology.orchestra.run.smithi087.stdout: "agent_down_multiplier": { 2024-05-08T05:33:46.046 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "agent_down_multiplier", 2024-05-08T05:33:46.046 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "float", 2024-05-08T05:33:46.046 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.047 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-08T05:33:46.047 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "3.0", 2024-05-08T05:33:46.047 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.047 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.047 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.047 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2024-05-08T05:33:46.047 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.047 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.047 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.047 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.047 INFO:teuthology.orchestra.run.smithi087.stdout: "agent_refresh_rate": { 2024-05-08T05:33:46.047 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "agent_refresh_rate", 2024-05-08T05:33:46.047 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "secs", 2024-05-08T05:33:46.048 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.048 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-08T05:33:46.048 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "20", 2024-05-08T05:33:46.048 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.048 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.048 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.048 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2024-05-08T05:33:46.048 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.048 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.048 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.048 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.048 INFO:teuthology.orchestra.run.smithi087.stdout: "agent_starting_port": { 2024-05-08T05:33:46.048 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "agent_starting_port", 2024-05-08T05:33:46.048 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "int", 2024-05-08T05:33:46.048 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.049 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-08T05:33:46.049 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "4721", 2024-05-08T05:33:46.049 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.049 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.049 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.049 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2024-05-08T05:33:46.049 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.049 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.049 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.049 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.049 INFO:teuthology.orchestra.run.smithi087.stdout: "allow_ptrace": { 2024-05-08T05:33:46.049 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "allow_ptrace", 2024-05-08T05:33:46.049 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-08T05:33:46.049 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.049 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-08T05:33:46.050 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-05-08T05:33:46.050 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.050 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.050 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.050 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2024-05-08T05:33:46.050 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2024-05-08T05:33:46.050 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.050 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.050 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.050 INFO:teuthology.orchestra.run.smithi087.stdout: "autotune_interval": { 2024-05-08T05:33:46.050 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "autotune_interval", 2024-05-08T05:33:46.050 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "secs", 2024-05-08T05:33:46.050 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.050 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-08T05:33:46.050 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "600", 2024-05-08T05:33:46.051 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.051 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.051 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.051 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "how frequently to autotune daemon memory", 2024-05-08T05:33:46.051 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.051 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.051 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.051 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.051 INFO:teuthology.orchestra.run.smithi087.stdout: "autotune_memory_target_ratio": { 2024-05-08T05:33:46.051 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "autotune_memory_target_ratio", 2024-05-08T05:33:46.051 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "float", 2024-05-08T05:33:46.051 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.051 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-08T05:33:46.051 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "0.7", 2024-05-08T05:33:46.052 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.052 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.052 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.052 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2024-05-08T05:33:46.052 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.052 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.052 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.052 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.052 INFO:teuthology.orchestra.run.smithi087.stdout: "cephadm_log_destination": { 2024-05-08T05:33:46.052 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "cephadm_log_destination", 2024-05-08T05:33:46.052 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-08T05:33:46.052 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.052 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-08T05:33:46.052 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-05-08T05:33:46.053 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.053 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.053 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [ 2024-05-08T05:33:46.053 INFO:teuthology.orchestra.run.smithi087.stdout: "file", 2024-05-08T05:33:46.053 INFO:teuthology.orchestra.run.smithi087.stdout: "file,syslog", 2024-05-08T05:33:46.053 INFO:teuthology.orchestra.run.smithi087.stdout: "syslog" 2024-05-08T05:33:46.053 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-05-08T05:33:46.053 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "Destination for cephadm command's persistent logging", 2024-05-08T05:33:46.053 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.053 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.053 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.053 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.053 INFO:teuthology.orchestra.run.smithi087.stdout: "cgroups_split": { 2024-05-08T05:33:46.053 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "cgroups_split", 2024-05-08T05:33:46.053 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-08T05:33:46.054 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.054 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-08T05:33:46.054 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "True", 2024-05-08T05:33:46.054 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.054 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.054 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.054 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2024-05-08T05:33:46.054 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.054 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.054 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.054 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.054 INFO:teuthology.orchestra.run.smithi087.stdout: "config_checks_enabled": { 2024-05-08T05:33:46.054 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "config_checks_enabled", 2024-05-08T05:33:46.054 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-08T05:33:46.054 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.055 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-08T05:33:46.055 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-05-08T05:33:46.055 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.055 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.055 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.055 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2024-05-08T05:33:46.055 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.055 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.055 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.055 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.055 INFO:teuthology.orchestra.run.smithi087.stdout: "config_dashboard": { 2024-05-08T05:33:46.055 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "config_dashboard", 2024-05-08T05:33:46.055 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-08T05:33:46.055 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.055 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-08T05:33:46.056 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "True", 2024-05-08T05:33:46.056 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.056 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.056 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.056 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2024-05-08T05:33:46.056 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.056 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.056 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.056 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.056 INFO:teuthology.orchestra.run.smithi087.stdout: "container_image_alertmanager": { 2024-05-08T05:33:46.056 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "container_image_alertmanager", 2024-05-08T05:33:46.056 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-08T05:33:46.056 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.056 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-08T05:33:46.056 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.25.0", 2024-05-08T05:33:46.057 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.057 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.057 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.057 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "Prometheus container image", 2024-05-08T05:33:46.057 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.057 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.057 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.057 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.057 INFO:teuthology.orchestra.run.smithi087.stdout: "container_image_base": { 2024-05-08T05:33:46.057 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "container_image_base", 2024-05-08T05:33:46.057 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-08T05:33:46.057 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.057 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:46.057 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "quay.io/ceph/ceph", 2024-05-08T05:33:46.057 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.058 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.058 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.058 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "Container image name, without the tag", 2024-05-08T05:33:46.058 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.058 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.058 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.058 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.058 INFO:teuthology.orchestra.run.smithi087.stdout: "container_image_elasticsearch": { 2024-05-08T05:33:46.058 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "container_image_elasticsearch", 2024-05-08T05:33:46.058 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-08T05:33:46.058 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.058 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-08T05:33:46.058 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2024-05-08T05:33:46.058 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.059 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.059 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.059 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "elasticsearch container image", 2024-05-08T05:33:46.059 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.059 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.059 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.059 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.059 INFO:teuthology.orchestra.run.smithi087.stdout: "container_image_grafana": { 2024-05-08T05:33:46.059 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "container_image_grafana", 2024-05-08T05:33:46.059 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-08T05:33:46.059 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.059 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-08T05:33:46.059 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "quay.io/ceph/grafana:9.4.12", 2024-05-08T05:33:46.060 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.060 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.060 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.060 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "Prometheus container image", 2024-05-08T05:33:46.060 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.060 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.060 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.060 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.060 INFO:teuthology.orchestra.run.smithi087.stdout: "container_image_haproxy": { 2024-05-08T05:33:46.060 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "container_image_haproxy", 2024-05-08T05:33:46.060 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-08T05:33:46.060 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.060 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-08T05:33:46.060 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2024-05-08T05:33:46.060 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.061 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.061 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.061 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "HAproxy container image", 2024-05-08T05:33:46.061 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.061 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.061 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.061 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.061 INFO:teuthology.orchestra.run.smithi087.stdout: "container_image_jaeger_agent": { 2024-05-08T05:33:46.061 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "container_image_jaeger_agent", 2024-05-08T05:33:46.061 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-08T05:33:46.061 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.061 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-08T05:33:46.061 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2024-05-08T05:33:46.061 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.062 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.062 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.062 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "Jaeger agent container image", 2024-05-08T05:33:46.062 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.062 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.062 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.062 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.062 INFO:teuthology.orchestra.run.smithi087.stdout: "container_image_jaeger_collector": { 2024-05-08T05:33:46.062 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "container_image_jaeger_collector", 2024-05-08T05:33:46.062 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-08T05:33:46.062 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.062 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-08T05:33:46.062 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2024-05-08T05:33:46.062 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.063 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.063 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.063 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "Jaeger collector container image", 2024-05-08T05:33:46.063 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.063 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.063 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.063 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.063 INFO:teuthology.orchestra.run.smithi087.stdout: "container_image_jaeger_query": { 2024-05-08T05:33:46.063 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "container_image_jaeger_query", 2024-05-08T05:33:46.063 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-08T05:33:46.063 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.063 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-08T05:33:46.063 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2024-05-08T05:33:46.063 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.064 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.064 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.064 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "Jaeger query container image", 2024-05-08T05:33:46.064 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.064 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.064 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.064 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.064 INFO:teuthology.orchestra.run.smithi087.stdout: "container_image_keepalived": { 2024-05-08T05:33:46.064 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "container_image_keepalived", 2024-05-08T05:33:46.064 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-08T05:33:46.064 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.064 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-08T05:33:46.064 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2024-05-08T05:33:46.064 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.064 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.065 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.065 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "Keepalived container image", 2024-05-08T05:33:46.065 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.065 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.065 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.065 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.065 INFO:teuthology.orchestra.run.smithi087.stdout: "container_image_loki": { 2024-05-08T05:33:46.065 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "container_image_loki", 2024-05-08T05:33:46.065 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-08T05:33:46.065 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.065 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-08T05:33:46.065 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "docker.io/grafana/loki:2.4.0", 2024-05-08T05:33:46.065 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.065 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.065 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.066 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "Loki container image", 2024-05-08T05:33:46.066 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.066 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.066 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.066 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.066 INFO:teuthology.orchestra.run.smithi087.stdout: "container_image_node_exporter": { 2024-05-08T05:33:46.066 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "container_image_node_exporter", 2024-05-08T05:33:46.066 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-08T05:33:46.066 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.066 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-08T05:33:46.066 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.5.0", 2024-05-08T05:33:46.066 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.066 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.066 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.066 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "Prometheus container image", 2024-05-08T05:33:46.067 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.067 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.067 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.067 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.067 INFO:teuthology.orchestra.run.smithi087.stdout: "container_image_nvmeof": { 2024-05-08T05:33:46.067 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "container_image_nvmeof", 2024-05-08T05:33:46.067 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-08T05:33:46.067 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.067 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-08T05:33:46.067 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "quay.io/ceph/nvmeof:1.2.1", 2024-05-08T05:33:46.067 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.067 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.067 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.067 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "Nvme-of container image", 2024-05-08T05:33:46.067 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.068 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.068 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.068 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.068 INFO:teuthology.orchestra.run.smithi087.stdout: "container_image_prometheus": { 2024-05-08T05:33:46.068 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "container_image_prometheus", 2024-05-08T05:33:46.068 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-08T05:33:46.068 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.068 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-08T05:33:46.068 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "quay.io/prometheus/prometheus:v2.43.0", 2024-05-08T05:33:46.068 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.068 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.068 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.068 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "Prometheus container image", 2024-05-08T05:33:46.068 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.068 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.069 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.069 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.069 INFO:teuthology.orchestra.run.smithi087.stdout: "container_image_promtail": { 2024-05-08T05:33:46.069 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "container_image_promtail", 2024-05-08T05:33:46.069 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-08T05:33:46.069 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.069 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-08T05:33:46.069 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "docker.io/grafana/promtail:2.4.0", 2024-05-08T05:33:46.069 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.069 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.069 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.069 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "Promtail container image", 2024-05-08T05:33:46.069 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.069 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.069 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.070 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.070 INFO:teuthology.orchestra.run.smithi087.stdout: "container_image_samba": { 2024-05-08T05:33:46.070 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "container_image_samba", 2024-05-08T05:33:46.070 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-08T05:33:46.070 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.070 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-08T05:33:46.070 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "quay.io/samba.org/samba-server:devbuilds-centos-amd64", 2024-05-08T05:33:46.070 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.070 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.070 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.070 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "Samba/SMB container image", 2024-05-08T05:33:46.070 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.071 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.071 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.071 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.071 INFO:teuthology.orchestra.run.smithi087.stdout: "container_image_snmp_gateway": { 2024-05-08T05:33:46.071 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "container_image_snmp_gateway", 2024-05-08T05:33:46.071 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-08T05:33:46.071 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.071 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-08T05:33:46.071 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2024-05-08T05:33:46.071 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.071 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.071 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.071 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "SNMP Gateway container image", 2024-05-08T05:33:46.071 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.071 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.072 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.072 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.072 INFO:teuthology.orchestra.run.smithi087.stdout: "container_init": { 2024-05-08T05:33:46.072 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "container_init", 2024-05-08T05:33:46.072 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-08T05:33:46.072 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.072 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-08T05:33:46.072 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "True", 2024-05-08T05:33:46.072 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.072 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.072 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.072 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "Run podman/docker with `--init`", 2024-05-08T05:33:46.072 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.072 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.073 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.073 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.073 INFO:teuthology.orchestra.run.smithi087.stdout: "daemon_cache_timeout": { 2024-05-08T05:33:46.073 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "daemon_cache_timeout", 2024-05-08T05:33:46.073 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "secs", 2024-05-08T05:33:46.073 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.073 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-08T05:33:46.073 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "600", 2024-05-08T05:33:46.073 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.073 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.073 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.073 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "seconds to cache service (daemon) inventory", 2024-05-08T05:33:46.073 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.073 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.073 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.074 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.074 INFO:teuthology.orchestra.run.smithi087.stdout: "default_cephadm_command_timeout": { 2024-05-08T05:33:46.074 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "default_cephadm_command_timeout", 2024-05-08T05:33:46.074 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "int", 2024-05-08T05:33:46.074 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.074 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-08T05:33:46.074 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "900", 2024-05-08T05:33:46.074 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.074 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.074 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.074 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2024-05-08T05:33:46.074 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.074 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.075 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.075 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.075 INFO:teuthology.orchestra.run.smithi087.stdout: "default_registry": { 2024-05-08T05:33:46.075 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "default_registry", 2024-05-08T05:33:46.075 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-08T05:33:46.075 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.075 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-08T05:33:46.075 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "docker.io", 2024-05-08T05:33:46.075 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.075 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.075 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.075 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2024-05-08T05:33:46.075 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.075 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.076 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.076 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.076 INFO:teuthology.orchestra.run.smithi087.stdout: "device_cache_timeout": { 2024-05-08T05:33:46.076 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "device_cache_timeout", 2024-05-08T05:33:46.076 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "secs", 2024-05-08T05:33:46.076 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.076 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-08T05:33:46.076 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "1800", 2024-05-08T05:33:46.076 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.076 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.076 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.076 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "seconds to cache device inventory", 2024-05-08T05:33:46.076 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.076 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.076 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.077 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.077 INFO:teuthology.orchestra.run.smithi087.stdout: "device_enhanced_scan": { 2024-05-08T05:33:46.077 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "device_enhanced_scan", 2024-05-08T05:33:46.077 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-08T05:33:46.077 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.077 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-08T05:33:46.077 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-05-08T05:33:46.077 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.077 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.077 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.077 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "Use libstoragemgmt during device scans", 2024-05-08T05:33:46.077 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.077 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.077 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.077 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.078 INFO:teuthology.orchestra.run.smithi087.stdout: "facts_cache_timeout": { 2024-05-08T05:33:46.078 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "facts_cache_timeout", 2024-05-08T05:33:46.078 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "secs", 2024-05-08T05:33:46.078 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.078 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-08T05:33:46.078 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "60", 2024-05-08T05:33:46.078 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.078 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.078 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.078 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "seconds to cache host facts data", 2024-05-08T05:33:46.078 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.078 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.078 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.078 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.079 INFO:teuthology.orchestra.run.smithi087.stdout: "grafana_dashboards_path": { 2024-05-08T05:33:46.079 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "grafana_dashboards_path", 2024-05-08T05:33:46.079 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-08T05:33:46.079 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.079 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-08T05:33:46.079 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "/etc/grafana/dashboards/ceph-dashboard/", 2024-05-08T05:33:46.079 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.079 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.079 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.079 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "location of dashboards to include in grafana deployments", 2024-05-08T05:33:46.079 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.079 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.079 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.079 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.080 INFO:teuthology.orchestra.run.smithi087.stdout: "host_check_interval": { 2024-05-08T05:33:46.080 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "host_check_interval", 2024-05-08T05:33:46.080 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "secs", 2024-05-08T05:33:46.080 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.080 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-08T05:33:46.080 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "600", 2024-05-08T05:33:46.080 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.080 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.080 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.080 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "how frequently to perform a host check", 2024-05-08T05:33:46.080 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.080 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.080 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.080 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.080 INFO:teuthology.orchestra.run.smithi087.stdout: "hw_monitoring": { 2024-05-08T05:33:46.081 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "hw_monitoring", 2024-05-08T05:33:46.081 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-08T05:33:46.081 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.081 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-08T05:33:46.081 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-05-08T05:33:46.081 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.081 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.081 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.081 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "Deploy hw monitoring daemon on every host.", 2024-05-08T05:33:46.081 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.081 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.081 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.081 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.081 INFO:teuthology.orchestra.run.smithi087.stdout: "inventory_list_all": { 2024-05-08T05:33:46.081 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "inventory_list_all", 2024-05-08T05:33:46.081 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-08T05:33:46.082 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.082 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-08T05:33:46.082 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-05-08T05:33:46.082 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.082 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.082 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.082 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2024-05-08T05:33:46.082 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.082 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.082 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.082 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.082 INFO:teuthology.orchestra.run.smithi087.stdout: "log_level": { 2024-05-08T05:33:46.083 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_level", 2024-05-08T05:33:46.083 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-08T05:33:46.083 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.083 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:46.083 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-05-08T05:33:46.083 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.083 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.083 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [ 2024-05-08T05:33:46.083 INFO:teuthology.orchestra.run.smithi087.stdout: "", 2024-05-08T05:33:46.083 INFO:teuthology.orchestra.run.smithi087.stdout: "critical", 2024-05-08T05:33:46.083 INFO:teuthology.orchestra.run.smithi087.stdout: "debug", 2024-05-08T05:33:46.083 INFO:teuthology.orchestra.run.smithi087.stdout: "error", 2024-05-08T05:33:46.083 INFO:teuthology.orchestra.run.smithi087.stdout: "info", 2024-05-08T05:33:46.083 INFO:teuthology.orchestra.run.smithi087.stdout: "warning" 2024-05-08T05:33:46.083 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-05-08T05:33:46.084 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:46.084 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.084 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.084 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.084 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.084 INFO:teuthology.orchestra.run.smithi087.stdout: "log_refresh_metadata": { 2024-05-08T05:33:46.084 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_refresh_metadata", 2024-05-08T05:33:46.084 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-08T05:33:46.084 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.084 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-08T05:33:46.084 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-05-08T05:33:46.084 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.084 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.084 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.084 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2024-05-08T05:33:46.085 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.085 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.085 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.085 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.085 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_cluster": { 2024-05-08T05:33:46.085 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_cluster", 2024-05-08T05:33:46.085 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-08T05:33:46.085 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.085 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-08T05:33:46.085 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "True", 2024-05-08T05:33:46.085 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.085 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.085 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.085 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2024-05-08T05:33:46.086 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.086 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.086 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.086 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.086 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_cluster_level": { 2024-05-08T05:33:46.086 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_cluster_level", 2024-05-08T05:33:46.086 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-08T05:33:46.086 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.086 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:46.086 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "info", 2024-05-08T05:33:46.086 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.086 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.086 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [ 2024-05-08T05:33:46.086 INFO:teuthology.orchestra.run.smithi087.stdout: "", 2024-05-08T05:33:46.086 INFO:teuthology.orchestra.run.smithi087.stdout: "critical", 2024-05-08T05:33:46.087 INFO:teuthology.orchestra.run.smithi087.stdout: "debug", 2024-05-08T05:33:46.087 INFO:teuthology.orchestra.run.smithi087.stdout: "error", 2024-05-08T05:33:46.087 INFO:teuthology.orchestra.run.smithi087.stdout: "info", 2024-05-08T05:33:46.087 INFO:teuthology.orchestra.run.smithi087.stdout: "warning" 2024-05-08T05:33:46.087 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-05-08T05:33:46.087 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:46.087 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.087 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.087 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.087 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.087 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_file": { 2024-05-08T05:33:46.087 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_file", 2024-05-08T05:33:46.087 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-08T05:33:46.087 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.087 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:46.088 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-05-08T05:33:46.088 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.088 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.088 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.088 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:46.088 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.088 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.088 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.088 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.088 INFO:teuthology.orchestra.run.smithi087.stdout: "manage_etc_ceph_ceph_conf": { 2024-05-08T05:33:46.088 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "manage_etc_ceph_ceph_conf", 2024-05-08T05:33:46.088 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-08T05:33:46.088 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.088 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-08T05:33:46.088 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-05-08T05:33:46.089 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.089 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.089 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.089 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2024-05-08T05:33:46.089 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.089 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.089 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.089 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.089 INFO:teuthology.orchestra.run.smithi087.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2024-05-08T05:33:46.089 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2024-05-08T05:33:46.089 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-08T05:33:46.089 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.089 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-08T05:33:46.089 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "*", 2024-05-08T05:33:46.089 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.090 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.090 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.090 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2024-05-08T05:33:46.090 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.090 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.090 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.090 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.090 INFO:teuthology.orchestra.run.smithi087.stdout: "max_count_per_host": { 2024-05-08T05:33:46.090 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "max_count_per_host", 2024-05-08T05:33:46.090 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "int", 2024-05-08T05:33:46.090 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.090 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-08T05:33:46.090 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "10", 2024-05-08T05:33:46.090 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.090 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.091 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.091 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "max number of daemons per service per host", 2024-05-08T05:33:46.091 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.091 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.091 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.091 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.091 INFO:teuthology.orchestra.run.smithi087.stdout: "max_osd_draining_count": { 2024-05-08T05:33:46.091 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "max_osd_draining_count", 2024-05-08T05:33:46.091 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "int", 2024-05-08T05:33:46.091 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.091 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-08T05:33:46.091 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "10", 2024-05-08T05:33:46.091 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.091 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.092 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.092 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2024-05-08T05:33:46.092 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.092 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.092 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.092 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.092 INFO:teuthology.orchestra.run.smithi087.stdout: "migration_current": { 2024-05-08T05:33:46.092 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "migration_current", 2024-05-08T05:33:46.092 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "int", 2024-05-08T05:33:46.092 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.092 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-08T05:33:46.092 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-05-08T05:33:46.092 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.092 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.092 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.093 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "internal - do not modify", 2024-05-08T05:33:46.093 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.093 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.093 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.093 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.093 INFO:teuthology.orchestra.run.smithi087.stdout: "mode": { 2024-05-08T05:33:46.093 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "mode", 2024-05-08T05:33:46.093 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-08T05:33:46.093 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.093 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-08T05:33:46.093 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "root", 2024-05-08T05:33:46.093 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.093 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.093 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [ 2024-05-08T05:33:46.093 INFO:teuthology.orchestra.run.smithi087.stdout: "cephadm-package", 2024-05-08T05:33:46.093 INFO:teuthology.orchestra.run.smithi087.stdout: "root" 2024-05-08T05:33:46.094 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-05-08T05:33:46.094 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "mode for remote execution of cephadm", 2024-05-08T05:33:46.094 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.094 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.094 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.094 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.094 INFO:teuthology.orchestra.run.smithi087.stdout: "oob_default_addr": { 2024-05-08T05:33:46.094 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "oob_default_addr", 2024-05-08T05:33:46.094 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-08T05:33:46.094 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.094 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-08T05:33:46.094 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "169.254.1.1", 2024-05-08T05:33:46.095 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.095 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.095 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.095 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "Default address for RedFish API (oob management).", 2024-05-08T05:33:46.095 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.095 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.095 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.095 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.095 INFO:teuthology.orchestra.run.smithi087.stdout: "prometheus_alerts_path": { 2024-05-08T05:33:46.095 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "prometheus_alerts_path", 2024-05-08T05:33:46.095 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-08T05:33:46.095 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.095 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-08T05:33:46.095 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2024-05-08T05:33:46.096 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.096 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.096 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.096 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "location of alerts to include in prometheus deployments", 2024-05-08T05:33:46.096 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.096 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.096 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.096 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.096 INFO:teuthology.orchestra.run.smithi087.stdout: "registry_insecure": { 2024-05-08T05:33:46.096 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "registry_insecure", 2024-05-08T05:33:46.096 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-08T05:33:46.096 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.096 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-08T05:33:46.096 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-05-08T05:33:46.097 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.097 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.097 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.097 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2024-05-08T05:33:46.097 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.097 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.097 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.097 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.097 INFO:teuthology.orchestra.run.smithi087.stdout: "registry_password": { 2024-05-08T05:33:46.097 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "registry_password", 2024-05-08T05:33:46.097 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-08T05:33:46.097 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.097 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-08T05:33:46.097 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-05-08T05:33:46.097 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.098 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.098 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.098 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2024-05-08T05:33:46.098 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.098 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.098 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.098 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.098 INFO:teuthology.orchestra.run.smithi087.stdout: "registry_url": { 2024-05-08T05:33:46.098 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "registry_url", 2024-05-08T05:33:46.098 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-08T05:33:46.098 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.098 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-08T05:33:46.098 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-05-08T05:33:46.098 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.099 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.099 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.099 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2024-05-08T05:33:46.099 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.099 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.099 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.099 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.099 INFO:teuthology.orchestra.run.smithi087.stdout: "registry_username": { 2024-05-08T05:33:46.099 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "registry_username", 2024-05-08T05:33:46.099 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-08T05:33:46.099 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.099 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-08T05:33:46.099 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-05-08T05:33:46.099 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.099 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.100 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.100 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2024-05-08T05:33:46.100 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.100 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.100 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.100 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.100 INFO:teuthology.orchestra.run.smithi087.stdout: "secure_monitoring_stack": { 2024-05-08T05:33:46.100 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "secure_monitoring_stack", 2024-05-08T05:33:46.100 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-08T05:33:46.100 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.100 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-08T05:33:46.100 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-05-08T05:33:46.100 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.100 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.100 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.101 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2024-05-08T05:33:46.101 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.101 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.101 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.101 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.101 INFO:teuthology.orchestra.run.smithi087.stdout: "service_discovery_port": { 2024-05-08T05:33:46.101 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "service_discovery_port", 2024-05-08T05:33:46.101 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "int", 2024-05-08T05:33:46.101 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.101 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-08T05:33:46.101 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "8765", 2024-05-08T05:33:46.101 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.101 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.101 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.102 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "cephadm service discovery port", 2024-05-08T05:33:46.102 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.102 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.102 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.102 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.102 INFO:teuthology.orchestra.run.smithi087.stdout: "sqlite3_killpoint": { 2024-05-08T05:33:46.102 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "sqlite3_killpoint", 2024-05-08T05:33:46.102 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "int", 2024-05-08T05:33:46.102 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "dev", 2024-05-08T05:33:46.102 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:46.102 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "0", 2024-05-08T05:33:46.102 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.102 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.102 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.102 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:46.103 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.103 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.103 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.103 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.103 INFO:teuthology.orchestra.run.smithi087.stdout: "ssh_config_file": { 2024-05-08T05:33:46.103 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "ssh_config_file", 2024-05-08T05:33:46.103 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-08T05:33:46.103 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.103 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-08T05:33:46.103 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-05-08T05:33:46.103 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.103 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.103 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.103 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "customized SSH config file to connect to managed hosts", 2024-05-08T05:33:46.103 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.104 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.104 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.104 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.104 INFO:teuthology.orchestra.run.smithi087.stdout: "use_agent": { 2024-05-08T05:33:46.104 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "use_agent", 2024-05-08T05:33:46.104 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-08T05:33:46.104 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.104 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-08T05:33:46.104 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-05-08T05:33:46.104 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.104 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.104 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.104 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2024-05-08T05:33:46.104 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.104 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.105 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.105 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.105 INFO:teuthology.orchestra.run.smithi087.stdout: "use_repo_digest": { 2024-05-08T05:33:46.105 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "use_repo_digest", 2024-05-08T05:33:46.105 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-08T05:33:46.105 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.105 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-08T05:33:46.105 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "True", 2024-05-08T05:33:46.105 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.105 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.105 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.105 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2024-05-08T05:33:46.105 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.105 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.105 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.106 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.106 INFO:teuthology.orchestra.run.smithi087.stdout: "warn_on_failed_host_check": { 2024-05-08T05:33:46.106 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "warn_on_failed_host_check", 2024-05-08T05:33:46.106 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-08T05:33:46.106 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.106 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-08T05:33:46.106 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "True", 2024-05-08T05:33:46.106 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.106 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.106 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.106 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "raise a health warning if the host check fails", 2024-05-08T05:33:46.106 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.106 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.107 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.107 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.107 INFO:teuthology.orchestra.run.smithi087.stdout: "warn_on_stray_daemons": { 2024-05-08T05:33:46.107 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "warn_on_stray_daemons", 2024-05-08T05:33:46.107 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-08T05:33:46.107 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.107 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-08T05:33:46.107 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "True", 2024-05-08T05:33:46.107 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.107 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.107 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.107 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2024-05-08T05:33:46.107 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.107 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.107 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.108 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.108 INFO:teuthology.orchestra.run.smithi087.stdout: "warn_on_stray_hosts": { 2024-05-08T05:33:46.108 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "warn_on_stray_hosts", 2024-05-08T05:33:46.108 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-08T05:33:46.108 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.108 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-08T05:33:46.108 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "True", 2024-05-08T05:33:46.108 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.108 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.108 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.108 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2024-05-08T05:33:46.108 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.108 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.108 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.108 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-05-08T05:33:46.109 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-05-08T05:33:46.109 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.109 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-05-08T05:33:46.109 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "crash", 2024-05-08T05:33:46.109 INFO:teuthology.orchestra.run.smithi087.stdout: "can_run": true, 2024-05-08T05:33:46.109 INFO:teuthology.orchestra.run.smithi087.stdout: "error_string": "", 2024-05-08T05:33:46.109 INFO:teuthology.orchestra.run.smithi087.stdout: "module_options": { 2024-05-08T05:33:46.109 INFO:teuthology.orchestra.run.smithi087.stdout: "log_level": { 2024-05-08T05:33:46.109 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_level", 2024-05-08T05:33:46.109 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-08T05:33:46.109 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.109 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:46.109 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-05-08T05:33:46.109 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.110 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.110 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [ 2024-05-08T05:33:46.110 INFO:teuthology.orchestra.run.smithi087.stdout: "", 2024-05-08T05:33:46.110 INFO:teuthology.orchestra.run.smithi087.stdout: "critical", 2024-05-08T05:33:46.110 INFO:teuthology.orchestra.run.smithi087.stdout: "debug", 2024-05-08T05:33:46.110 INFO:teuthology.orchestra.run.smithi087.stdout: "error", 2024-05-08T05:33:46.110 INFO:teuthology.orchestra.run.smithi087.stdout: "info", 2024-05-08T05:33:46.110 INFO:teuthology.orchestra.run.smithi087.stdout: "warning" 2024-05-08T05:33:46.110 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-05-08T05:33:46.110 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:46.110 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.110 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.110 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.110 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.110 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_cluster": { 2024-05-08T05:33:46.111 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_cluster", 2024-05-08T05:33:46.111 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-08T05:33:46.111 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.111 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:46.111 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-05-08T05:33:46.111 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.111 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.111 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.111 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:46.111 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.111 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.111 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.111 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.111 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_cluster_level": { 2024-05-08T05:33:46.111 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_cluster_level", 2024-05-08T05:33:46.112 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-08T05:33:46.112 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.112 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:46.112 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "info", 2024-05-08T05:33:46.112 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.112 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.112 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [ 2024-05-08T05:33:46.112 INFO:teuthology.orchestra.run.smithi087.stdout: "", 2024-05-08T05:33:46.112 INFO:teuthology.orchestra.run.smithi087.stdout: "critical", 2024-05-08T05:33:46.112 INFO:teuthology.orchestra.run.smithi087.stdout: "debug", 2024-05-08T05:33:46.112 INFO:teuthology.orchestra.run.smithi087.stdout: "error", 2024-05-08T05:33:46.112 INFO:teuthology.orchestra.run.smithi087.stdout: "info", 2024-05-08T05:33:46.112 INFO:teuthology.orchestra.run.smithi087.stdout: "warning" 2024-05-08T05:33:46.112 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-05-08T05:33:46.112 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:46.113 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.113 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.113 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.113 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.113 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_file": { 2024-05-08T05:33:46.113 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_file", 2024-05-08T05:33:46.113 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-08T05:33:46.113 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.113 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:46.113 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-05-08T05:33:46.113 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.113 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.113 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.113 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:46.113 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.114 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.114 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.114 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.114 INFO:teuthology.orchestra.run.smithi087.stdout: "retain_interval": { 2024-05-08T05:33:46.114 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "retain_interval", 2024-05-08T05:33:46.114 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "secs", 2024-05-08T05:33:46.114 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.114 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:46.114 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "31536000", 2024-05-08T05:33:46.114 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.114 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.114 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.114 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "how long to retain crashes before pruning them", 2024-05-08T05:33:46.114 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.114 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.115 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.115 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.115 INFO:teuthology.orchestra.run.smithi087.stdout: "sqlite3_killpoint": { 2024-05-08T05:33:46.115 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "sqlite3_killpoint", 2024-05-08T05:33:46.115 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "int", 2024-05-08T05:33:46.115 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "dev", 2024-05-08T05:33:46.115 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:46.115 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "0", 2024-05-08T05:33:46.115 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.115 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.115 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.115 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:46.115 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.115 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.115 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.116 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.116 INFO:teuthology.orchestra.run.smithi087.stdout: "warn_recent_interval": { 2024-05-08T05:33:46.116 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "warn_recent_interval", 2024-05-08T05:33:46.116 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "secs", 2024-05-08T05:33:46.116 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.116 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:46.116 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "1209600", 2024-05-08T05:33:46.116 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.116 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.116 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.116 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "time interval in which to warn about recent crashes", 2024-05-08T05:33:46.116 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.116 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.116 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.116 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-05-08T05:33:46.117 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-05-08T05:33:46.117 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.117 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-05-08T05:33:46.117 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "dashboard", 2024-05-08T05:33:46.117 INFO:teuthology.orchestra.run.smithi087.stdout: "can_run": true, 2024-05-08T05:33:46.117 INFO:teuthology.orchestra.run.smithi087.stdout: "error_string": "", 2024-05-08T05:33:46.117 INFO:teuthology.orchestra.run.smithi087.stdout: "module_options": { 2024-05-08T05:33:46.117 INFO:teuthology.orchestra.run.smithi087.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2024-05-08T05:33:46.117 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2024-05-08T05:33:46.117 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "int", 2024-05-08T05:33:46.117 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.117 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-08T05:33:46.117 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "10", 2024-05-08T05:33:46.117 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.117 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.118 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.118 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:46.118 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.118 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.118 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.118 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.118 INFO:teuthology.orchestra.run.smithi087.stdout: "ALERTMANAGER_API_HOST": { 2024-05-08T05:33:46.118 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "ALERTMANAGER_API_HOST", 2024-05-08T05:33:46.118 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-08T05:33:46.118 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.118 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-08T05:33:46.118 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-05-08T05:33:46.118 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.118 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.119 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.119 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:46.119 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.119 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.119 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.119 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.119 INFO:teuthology.orchestra.run.smithi087.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2024-05-08T05:33:46.119 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2024-05-08T05:33:46.119 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-08T05:33:46.119 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.119 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-08T05:33:46.119 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "True", 2024-05-08T05:33:46.119 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.120 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.120 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.120 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:46.120 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.120 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.120 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.120 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.120 INFO:teuthology.orchestra.run.smithi087.stdout: "AUDIT_API_ENABLED": { 2024-05-08T05:33:46.120 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "AUDIT_API_ENABLED", 2024-05-08T05:33:46.120 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-08T05:33:46.120 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.120 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-08T05:33:46.120 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-05-08T05:33:46.120 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.121 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.121 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.121 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:46.121 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.121 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.121 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.121 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.121 INFO:teuthology.orchestra.run.smithi087.stdout: "AUDIT_API_LOG_PAYLOAD": { 2024-05-08T05:33:46.121 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2024-05-08T05:33:46.121 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-08T05:33:46.121 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.121 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-08T05:33:46.121 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "True", 2024-05-08T05:33:46.121 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.121 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.122 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.122 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:46.122 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.122 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.122 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.122 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.122 INFO:teuthology.orchestra.run.smithi087.stdout: "ENABLE_BROWSABLE_API": { 2024-05-08T05:33:46.122 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "ENABLE_BROWSABLE_API", 2024-05-08T05:33:46.122 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-08T05:33:46.122 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.122 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-08T05:33:46.122 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "True", 2024-05-08T05:33:46.122 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.123 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.123 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.123 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:46.123 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.123 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.123 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.123 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.123 INFO:teuthology.orchestra.run.smithi087.stdout: "FEATURE_TOGGLE_CEPHFS": { 2024-05-08T05:33:46.123 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2024-05-08T05:33:46.123 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-08T05:33:46.123 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.123 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-08T05:33:46.123 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "True", 2024-05-08T05:33:46.123 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.123 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.124 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.124 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:46.124 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.124 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.124 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.124 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.124 INFO:teuthology.orchestra.run.smithi087.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2024-05-08T05:33:46.124 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2024-05-08T05:33:46.124 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-08T05:33:46.124 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.124 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-08T05:33:46.124 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "True", 2024-05-08T05:33:46.124 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.124 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.124 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.125 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:46.125 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.125 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.125 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.125 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.125 INFO:teuthology.orchestra.run.smithi087.stdout: "FEATURE_TOGGLE_ISCSI": { 2024-05-08T05:33:46.125 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2024-05-08T05:33:46.125 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-08T05:33:46.125 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.125 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-08T05:33:46.125 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "True", 2024-05-08T05:33:46.125 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.125 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.125 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.125 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:46.125 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.126 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.126 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.126 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.126 INFO:teuthology.orchestra.run.smithi087.stdout: "FEATURE_TOGGLE_MIRRORING": { 2024-05-08T05:33:46.126 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2024-05-08T05:33:46.126 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-08T05:33:46.126 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.126 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-08T05:33:46.126 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "True", 2024-05-08T05:33:46.126 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.126 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.126 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.126 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:46.126 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.126 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.127 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.127 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.127 INFO:teuthology.orchestra.run.smithi087.stdout: "FEATURE_TOGGLE_NFS": { 2024-05-08T05:33:46.127 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "FEATURE_TOGGLE_NFS", 2024-05-08T05:33:46.127 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-08T05:33:46.127 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.127 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-08T05:33:46.127 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "True", 2024-05-08T05:33:46.127 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.127 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.127 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.127 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:46.127 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.127 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.128 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.128 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.128 INFO:teuthology.orchestra.run.smithi087.stdout: "FEATURE_TOGGLE_RBD": { 2024-05-08T05:33:46.128 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "FEATURE_TOGGLE_RBD", 2024-05-08T05:33:46.128 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-08T05:33:46.128 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.128 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-08T05:33:46.128 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "True", 2024-05-08T05:33:46.128 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.128 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.128 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.128 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:46.128 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.128 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.128 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.128 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.129 INFO:teuthology.orchestra.run.smithi087.stdout: "FEATURE_TOGGLE_RGW": { 2024-05-08T05:33:46.129 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "FEATURE_TOGGLE_RGW", 2024-05-08T05:33:46.129 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-08T05:33:46.129 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.129 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-08T05:33:46.129 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "True", 2024-05-08T05:33:46.129 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.129 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.129 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.129 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:46.129 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.129 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.129 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.129 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.129 INFO:teuthology.orchestra.run.smithi087.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2024-05-08T05:33:46.130 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2024-05-08T05:33:46.130 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-08T05:33:46.130 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.130 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-08T05:33:46.130 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-05-08T05:33:46.130 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.130 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.130 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.130 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:46.130 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.130 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.130 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.130 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.130 INFO:teuthology.orchestra.run.smithi087.stdout: "GRAFANA_API_PASSWORD": { 2024-05-08T05:33:46.131 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "GRAFANA_API_PASSWORD", 2024-05-08T05:33:46.131 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-08T05:33:46.131 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.131 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-08T05:33:46.131 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "admin", 2024-05-08T05:33:46.131 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.131 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.131 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.131 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:46.131 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.131 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.131 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.131 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.131 INFO:teuthology.orchestra.run.smithi087.stdout: "GRAFANA_API_SSL_VERIFY": { 2024-05-08T05:33:46.131 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2024-05-08T05:33:46.132 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-08T05:33:46.132 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.132 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-08T05:33:46.132 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "True", 2024-05-08T05:33:46.132 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.132 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.132 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.132 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:46.132 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.132 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.132 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.132 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.133 INFO:teuthology.orchestra.run.smithi087.stdout: "GRAFANA_API_URL": { 2024-05-08T05:33:46.133 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "GRAFANA_API_URL", 2024-05-08T05:33:46.133 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-08T05:33:46.133 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.133 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-08T05:33:46.133 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-05-08T05:33:46.133 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.133 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.133 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.133 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:46.133 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.133 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.133 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.133 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.134 INFO:teuthology.orchestra.run.smithi087.stdout: "GRAFANA_API_USERNAME": { 2024-05-08T05:33:46.134 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "GRAFANA_API_USERNAME", 2024-05-08T05:33:46.134 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-08T05:33:46.134 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.134 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-08T05:33:46.134 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "admin", 2024-05-08T05:33:46.134 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.134 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.134 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.134 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:46.134 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.134 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.134 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.134 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.134 INFO:teuthology.orchestra.run.smithi087.stdout: "GRAFANA_FRONTEND_API_URL": { 2024-05-08T05:33:46.135 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2024-05-08T05:33:46.135 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-08T05:33:46.135 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.135 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-08T05:33:46.135 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-05-08T05:33:46.135 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.135 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.135 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.135 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:46.135 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.135 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.135 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.135 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.136 INFO:teuthology.orchestra.run.smithi087.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2024-05-08T05:33:46.136 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2024-05-08T05:33:46.136 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-08T05:33:46.136 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.136 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-08T05:33:46.136 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-05-08T05:33:46.136 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.136 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.136 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.136 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:46.136 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.136 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.136 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.136 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.137 INFO:teuthology.orchestra.run.smithi087.stdout: "ISCSI_API_SSL_VERIFICATION": { 2024-05-08T05:33:46.137 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2024-05-08T05:33:46.137 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-08T05:33:46.137 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.137 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-08T05:33:46.137 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "True", 2024-05-08T05:33:46.137 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.137 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.137 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.137 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:46.137 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.137 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.137 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.137 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.137 INFO:teuthology.orchestra.run.smithi087.stdout: "ISSUE_TRACKER_API_KEY": { 2024-05-08T05:33:46.138 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "ISSUE_TRACKER_API_KEY", 2024-05-08T05:33:46.138 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-08T05:33:46.138 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.138 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-08T05:33:46.138 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-05-08T05:33:46.138 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.138 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.138 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.138 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:46.138 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.138 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.138 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.138 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.139 INFO:teuthology.orchestra.run.smithi087.stdout: "MANAGED_BY_CLUSTERS": { 2024-05-08T05:33:46.139 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "MANAGED_BY_CLUSTERS", 2024-05-08T05:33:46.139 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-08T05:33:46.139 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.139 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-08T05:33:46.139 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "[]", 2024-05-08T05:33:46.139 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.139 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.139 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.139 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:46.139 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.139 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.139 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.139 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.139 INFO:teuthology.orchestra.run.smithi087.stdout: "MULTICLUSTER_CONFIG": { 2024-05-08T05:33:46.139 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "MULTICLUSTER_CONFIG", 2024-05-08T05:33:46.140 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-08T05:33:46.140 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.140 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-08T05:33:46.140 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "{}", 2024-05-08T05:33:46.140 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.140 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.140 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.140 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:46.140 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.140 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.140 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.140 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.140 INFO:teuthology.orchestra.run.smithi087.stdout: "PROMETHEUS_API_HOST": { 2024-05-08T05:33:46.140 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "PROMETHEUS_API_HOST", 2024-05-08T05:33:46.140 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-08T05:33:46.141 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.141 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-08T05:33:46.141 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-05-08T05:33:46.141 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.141 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.141 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.141 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:46.141 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.141 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.141 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.141 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.141 INFO:teuthology.orchestra.run.smithi087.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2024-05-08T05:33:46.141 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2024-05-08T05:33:46.141 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-08T05:33:46.141 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.142 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-08T05:33:46.142 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "True", 2024-05-08T05:33:46.142 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.142 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.142 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.142 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:46.142 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.142 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.142 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.142 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.142 INFO:teuthology.orchestra.run.smithi087.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2024-05-08T05:33:46.142 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2024-05-08T05:33:46.142 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-08T05:33:46.142 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.143 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-08T05:33:46.143 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-05-08T05:33:46.143 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.143 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.143 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.143 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:46.143 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.143 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.143 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.143 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.143 INFO:teuthology.orchestra.run.smithi087.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2024-05-08T05:33:46.143 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2024-05-08T05:33:46.143 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-08T05:33:46.143 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.143 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-08T05:33:46.144 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-05-08T05:33:46.144 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.144 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.144 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.144 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:46.144 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.144 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.144 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.144 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.144 INFO:teuthology.orchestra.run.smithi087.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2024-05-08T05:33:46.144 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2024-05-08T05:33:46.144 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-08T05:33:46.144 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.144 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-08T05:33:46.144 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "True", 2024-05-08T05:33:46.145 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.145 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.145 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.145 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:46.145 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.145 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.145 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.145 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.145 INFO:teuthology.orchestra.run.smithi087.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2024-05-08T05:33:46.145 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2024-05-08T05:33:46.145 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-08T05:33:46.145 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.145 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-08T05:33:46.145 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "True", 2024-05-08T05:33:46.145 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.146 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.146 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.146 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:46.146 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.146 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.146 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.146 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.146 INFO:teuthology.orchestra.run.smithi087.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2024-05-08T05:33:46.146 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2024-05-08T05:33:46.146 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-08T05:33:46.146 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.146 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-08T05:33:46.146 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-05-08T05:33:46.146 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.147 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.147 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.147 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:46.147 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.147 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.147 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.147 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.147 INFO:teuthology.orchestra.run.smithi087.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2024-05-08T05:33:46.147 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2024-05-08T05:33:46.147 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-08T05:33:46.147 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.147 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-08T05:33:46.147 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-05-08T05:33:46.147 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.147 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.148 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.148 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:46.148 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.148 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.148 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.148 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.148 INFO:teuthology.orchestra.run.smithi087.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2024-05-08T05:33:46.148 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2024-05-08T05:33:46.148 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-08T05:33:46.148 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.148 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-08T05:33:46.148 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-05-08T05:33:46.148 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.148 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.148 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.149 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:46.149 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.149 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.149 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.149 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.149 INFO:teuthology.orchestra.run.smithi087.stdout: "PWD_POLICY_ENABLED": { 2024-05-08T05:33:46.149 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "PWD_POLICY_ENABLED", 2024-05-08T05:33:46.149 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-08T05:33:46.149 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.149 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-08T05:33:46.149 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "True", 2024-05-08T05:33:46.149 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.149 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.149 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.149 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:46.150 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.150 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.150 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.150 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.150 INFO:teuthology.orchestra.run.smithi087.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2024-05-08T05:33:46.150 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2024-05-08T05:33:46.150 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-08T05:33:46.150 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.150 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-08T05:33:46.150 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2024-05-08T05:33:46.150 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.150 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.150 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.150 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:46.151 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.151 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.151 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.151 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.151 INFO:teuthology.orchestra.run.smithi087.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2024-05-08T05:33:46.151 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2024-05-08T05:33:46.151 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "int", 2024-05-08T05:33:46.151 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.151 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-08T05:33:46.151 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "10", 2024-05-08T05:33:46.151 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.151 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.151 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.151 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:46.152 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.152 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.152 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.152 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.152 INFO:teuthology.orchestra.run.smithi087.stdout: "PWD_POLICY_MIN_LENGTH": { 2024-05-08T05:33:46.152 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2024-05-08T05:33:46.152 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "int", 2024-05-08T05:33:46.152 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.152 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-08T05:33:46.152 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "8", 2024-05-08T05:33:46.152 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.152 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.152 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.152 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:46.152 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.153 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.153 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.153 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.153 INFO:teuthology.orchestra.run.smithi087.stdout: "REST_REQUESTS_TIMEOUT": { 2024-05-08T05:33:46.153 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "REST_REQUESTS_TIMEOUT", 2024-05-08T05:33:46.153 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "int", 2024-05-08T05:33:46.153 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.153 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-08T05:33:46.153 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "45", 2024-05-08T05:33:46.153 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.153 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.153 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.153 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:46.153 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.153 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.154 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.154 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.154 INFO:teuthology.orchestra.run.smithi087.stdout: "RGW_API_ACCESS_KEY": { 2024-05-08T05:33:46.154 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "RGW_API_ACCESS_KEY", 2024-05-08T05:33:46.154 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-08T05:33:46.154 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.154 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-08T05:33:46.154 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-05-08T05:33:46.154 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.154 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.154 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.154 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:46.154 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.154 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.155 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.155 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.155 INFO:teuthology.orchestra.run.smithi087.stdout: "RGW_API_ADMIN_RESOURCE": { 2024-05-08T05:33:46.155 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2024-05-08T05:33:46.155 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-08T05:33:46.155 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.155 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-08T05:33:46.155 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "admin", 2024-05-08T05:33:46.155 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.155 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.155 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.155 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:46.155 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.155 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.156 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.156 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.156 INFO:teuthology.orchestra.run.smithi087.stdout: "RGW_API_SECRET_KEY": { 2024-05-08T05:33:46.156 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "RGW_API_SECRET_KEY", 2024-05-08T05:33:46.156 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-08T05:33:46.156 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.156 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-08T05:33:46.156 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-05-08T05:33:46.156 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.156 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.156 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.156 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:46.156 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.156 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.156 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.156 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.157 INFO:teuthology.orchestra.run.smithi087.stdout: "RGW_API_SSL_VERIFY": { 2024-05-08T05:33:46.157 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "RGW_API_SSL_VERIFY", 2024-05-08T05:33:46.157 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-08T05:33:46.157 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.157 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-08T05:33:46.157 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "True", 2024-05-08T05:33:46.157 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.157 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.157 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.157 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:46.157 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.157 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.157 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.157 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.158 INFO:teuthology.orchestra.run.smithi087.stdout: "UNSAFE_TLS_v1_2": { 2024-05-08T05:33:46.158 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "UNSAFE_TLS_v1_2", 2024-05-08T05:33:46.158 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-08T05:33:46.158 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.158 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-08T05:33:46.158 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-05-08T05:33:46.158 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.158 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.158 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.158 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:46.158 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.158 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.158 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.158 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.159 INFO:teuthology.orchestra.run.smithi087.stdout: "USER_PWD_EXPIRATION_SPAN": { 2024-05-08T05:33:46.159 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2024-05-08T05:33:46.159 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "int", 2024-05-08T05:33:46.159 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.159 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-08T05:33:46.159 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "0", 2024-05-08T05:33:46.159 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.159 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.159 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.159 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:46.159 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.159 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.159 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.159 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.159 INFO:teuthology.orchestra.run.smithi087.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2024-05-08T05:33:46.160 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2024-05-08T05:33:46.160 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "int", 2024-05-08T05:33:46.160 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.160 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-08T05:33:46.160 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "10", 2024-05-08T05:33:46.160 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.160 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.160 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.160 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:46.160 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.160 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.160 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.160 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.160 INFO:teuthology.orchestra.run.smithi087.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2024-05-08T05:33:46.160 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2024-05-08T05:33:46.161 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "int", 2024-05-08T05:33:46.161 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.161 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-08T05:33:46.161 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "5", 2024-05-08T05:33:46.161 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.161 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.161 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.161 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:46.161 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.161 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.161 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.161 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.161 INFO:teuthology.orchestra.run.smithi087.stdout: "cross_origin_url": { 2024-05-08T05:33:46.161 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "cross_origin_url", 2024-05-08T05:33:46.161 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-08T05:33:46.162 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.162 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-08T05:33:46.162 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-05-08T05:33:46.162 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.162 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.162 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.162 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:46.162 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.162 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.162 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.162 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.162 INFO:teuthology.orchestra.run.smithi087.stdout: "crt_file": { 2024-05-08T05:33:46.162 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "crt_file", 2024-05-08T05:33:46.163 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-08T05:33:46.163 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.163 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-08T05:33:46.163 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-05-08T05:33:46.163 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.163 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.163 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.163 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:46.163 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.163 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.163 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.163 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.163 INFO:teuthology.orchestra.run.smithi087.stdout: "debug": { 2024-05-08T05:33:46.163 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "debug", 2024-05-08T05:33:46.163 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-08T05:33:46.164 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.164 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-08T05:33:46.164 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-05-08T05:33:46.164 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.164 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.164 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.164 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "Enable/disable debug options", 2024-05-08T05:33:46.164 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.164 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.164 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.164 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.164 INFO:teuthology.orchestra.run.smithi087.stdout: "jwt_token_ttl": { 2024-05-08T05:33:46.164 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "jwt_token_ttl", 2024-05-08T05:33:46.164 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "int", 2024-05-08T05:33:46.164 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.165 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-08T05:33:46.165 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "28800", 2024-05-08T05:33:46.165 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.165 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.165 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.165 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:46.165 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.165 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.165 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.165 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.165 INFO:teuthology.orchestra.run.smithi087.stdout: "key_file": { 2024-05-08T05:33:46.165 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "key_file", 2024-05-08T05:33:46.165 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-08T05:33:46.165 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.165 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-08T05:33:46.166 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-05-08T05:33:46.166 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.166 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.166 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.166 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:46.166 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.166 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.166 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.166 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.166 INFO:teuthology.orchestra.run.smithi087.stdout: "log_level": { 2024-05-08T05:33:46.166 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_level", 2024-05-08T05:33:46.166 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-08T05:33:46.166 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.166 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:46.166 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-05-08T05:33:46.166 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.167 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.167 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [ 2024-05-08T05:33:46.167 INFO:teuthology.orchestra.run.smithi087.stdout: "", 2024-05-08T05:33:46.167 INFO:teuthology.orchestra.run.smithi087.stdout: "critical", 2024-05-08T05:33:46.167 INFO:teuthology.orchestra.run.smithi087.stdout: "debug", 2024-05-08T05:33:46.167 INFO:teuthology.orchestra.run.smithi087.stdout: "error", 2024-05-08T05:33:46.167 INFO:teuthology.orchestra.run.smithi087.stdout: "info", 2024-05-08T05:33:46.167 INFO:teuthology.orchestra.run.smithi087.stdout: "warning" 2024-05-08T05:33:46.167 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-05-08T05:33:46.167 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:46.167 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.167 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.167 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.167 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.168 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_cluster": { 2024-05-08T05:33:46.168 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_cluster", 2024-05-08T05:33:46.168 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-08T05:33:46.168 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.168 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:46.168 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-05-08T05:33:46.168 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.168 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.168 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.168 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:46.168 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.168 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.168 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.168 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.168 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_cluster_level": { 2024-05-08T05:33:46.169 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_cluster_level", 2024-05-08T05:33:46.169 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-08T05:33:46.169 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.169 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:46.169 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "info", 2024-05-08T05:33:46.169 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.169 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.169 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [ 2024-05-08T05:33:46.169 INFO:teuthology.orchestra.run.smithi087.stdout: "", 2024-05-08T05:33:46.169 INFO:teuthology.orchestra.run.smithi087.stdout: "critical", 2024-05-08T05:33:46.169 INFO:teuthology.orchestra.run.smithi087.stdout: "debug", 2024-05-08T05:33:46.169 INFO:teuthology.orchestra.run.smithi087.stdout: "error", 2024-05-08T05:33:46.169 INFO:teuthology.orchestra.run.smithi087.stdout: "info", 2024-05-08T05:33:46.169 INFO:teuthology.orchestra.run.smithi087.stdout: "warning" 2024-05-08T05:33:46.169 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-05-08T05:33:46.170 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:46.170 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.170 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.170 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.170 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.170 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_file": { 2024-05-08T05:33:46.170 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_file", 2024-05-08T05:33:46.170 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-08T05:33:46.170 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.170 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:46.170 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-05-08T05:33:46.170 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.170 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.171 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.171 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:46.171 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.171 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.171 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.171 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.171 INFO:teuthology.orchestra.run.smithi087.stdout: "motd": { 2024-05-08T05:33:46.171 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "motd", 2024-05-08T05:33:46.171 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-08T05:33:46.171 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.171 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-08T05:33:46.171 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-05-08T05:33:46.171 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.171 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.171 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.172 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "The message of the day", 2024-05-08T05:33:46.172 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.172 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.172 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.172 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.172 INFO:teuthology.orchestra.run.smithi087.stdout: "redirect_resolve_ip_addr": { 2024-05-08T05:33:46.172 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "redirect_resolve_ip_addr", 2024-05-08T05:33:46.172 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-08T05:33:46.172 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.172 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-08T05:33:46.172 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-05-08T05:33:46.172 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.172 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.172 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.172 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:46.173 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.173 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.173 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.173 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.173 INFO:teuthology.orchestra.run.smithi087.stdout: "server_addr": { 2024-05-08T05:33:46.173 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "server_addr", 2024-05-08T05:33:46.173 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-08T05:33:46.173 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.173 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-08T05:33:46.173 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "::", 2024-05-08T05:33:46.173 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.173 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.173 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.173 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:46.174 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.174 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.174 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.174 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.174 INFO:teuthology.orchestra.run.smithi087.stdout: "server_port": { 2024-05-08T05:33:46.174 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "server_port", 2024-05-08T05:33:46.174 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "int", 2024-05-08T05:33:46.174 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.174 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-08T05:33:46.174 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "8080", 2024-05-08T05:33:46.174 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.174 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.174 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.174 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:46.174 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.175 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.175 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.177 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.177 INFO:teuthology.orchestra.run.smithi087.stdout: "sqlite3_killpoint": { 2024-05-08T05:33:46.177 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "sqlite3_killpoint", 2024-05-08T05:33:46.178 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "int", 2024-05-08T05:33:46.178 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "dev", 2024-05-08T05:33:46.178 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:46.178 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "0", 2024-05-08T05:33:46.178 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.178 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.178 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.178 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:46.178 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.178 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.178 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.178 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.178 INFO:teuthology.orchestra.run.smithi087.stdout: "ssl": { 2024-05-08T05:33:46.178 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "ssl", 2024-05-08T05:33:46.178 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-08T05:33:46.179 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.179 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-08T05:33:46.179 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "True", 2024-05-08T05:33:46.179 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.179 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.179 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.179 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:46.179 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.179 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.179 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.179 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.179 INFO:teuthology.orchestra.run.smithi087.stdout: "ssl_server_port": { 2024-05-08T05:33:46.179 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "ssl_server_port", 2024-05-08T05:33:46.179 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "int", 2024-05-08T05:33:46.180 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.180 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-08T05:33:46.180 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "8443", 2024-05-08T05:33:46.180 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.180 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.180 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.180 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:46.180 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.180 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.180 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.180 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.180 INFO:teuthology.orchestra.run.smithi087.stdout: "standby_behaviour": { 2024-05-08T05:33:46.180 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "standby_behaviour", 2024-05-08T05:33:46.180 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-08T05:33:46.180 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.180 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-08T05:33:46.181 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "redirect", 2024-05-08T05:33:46.181 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.181 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.181 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [ 2024-05-08T05:33:46.181 INFO:teuthology.orchestra.run.smithi087.stdout: "error", 2024-05-08T05:33:46.181 INFO:teuthology.orchestra.run.smithi087.stdout: "redirect" 2024-05-08T05:33:46.181 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-05-08T05:33:46.181 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:46.181 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.181 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.181 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.181 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.181 INFO:teuthology.orchestra.run.smithi087.stdout: "standby_error_status_code": { 2024-05-08T05:33:46.181 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "standby_error_status_code", 2024-05-08T05:33:46.181 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "int", 2024-05-08T05:33:46.182 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.182 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-08T05:33:46.182 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "500", 2024-05-08T05:33:46.182 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "400", 2024-05-08T05:33:46.182 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "599", 2024-05-08T05:33:46.182 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.182 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:46.182 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.182 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.182 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.182 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.182 INFO:teuthology.orchestra.run.smithi087.stdout: "url_prefix": { 2024-05-08T05:33:46.182 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "url_prefix", 2024-05-08T05:33:46.182 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-08T05:33:46.183 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.183 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-08T05:33:46.183 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-05-08T05:33:46.183 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.183 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.183 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.183 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:46.183 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.183 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.183 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.183 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-05-08T05:33:46.183 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-05-08T05:33:46.183 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.183 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-05-08T05:33:46.183 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "devicehealth", 2024-05-08T05:33:46.184 INFO:teuthology.orchestra.run.smithi087.stdout: "can_run": true, 2024-05-08T05:33:46.184 INFO:teuthology.orchestra.run.smithi087.stdout: "error_string": "", 2024-05-08T05:33:46.184 INFO:teuthology.orchestra.run.smithi087.stdout: "module_options": { 2024-05-08T05:33:46.184 INFO:teuthology.orchestra.run.smithi087.stdout: "enable_monitoring": { 2024-05-08T05:33:46.184 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "enable_monitoring", 2024-05-08T05:33:46.184 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-08T05:33:46.184 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.184 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:46.184 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "True", 2024-05-08T05:33:46.184 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.184 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.184 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.184 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "monitor device health metrics", 2024-05-08T05:33:46.184 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.184 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.185 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.185 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.185 INFO:teuthology.orchestra.run.smithi087.stdout: "log_level": { 2024-05-08T05:33:46.185 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_level", 2024-05-08T05:33:46.185 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-08T05:33:46.185 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.185 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:46.185 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-05-08T05:33:46.185 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.185 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.185 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [ 2024-05-08T05:33:46.185 INFO:teuthology.orchestra.run.smithi087.stdout: "", 2024-05-08T05:33:46.185 INFO:teuthology.orchestra.run.smithi087.stdout: "critical", 2024-05-08T05:33:46.185 INFO:teuthology.orchestra.run.smithi087.stdout: "debug", 2024-05-08T05:33:46.186 INFO:teuthology.orchestra.run.smithi087.stdout: "error", 2024-05-08T05:33:46.186 INFO:teuthology.orchestra.run.smithi087.stdout: "info", 2024-05-08T05:33:46.186 INFO:teuthology.orchestra.run.smithi087.stdout: "warning" 2024-05-08T05:33:46.186 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-05-08T05:33:46.186 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:46.186 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.186 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.186 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.186 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.186 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_cluster": { 2024-05-08T05:33:46.186 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_cluster", 2024-05-08T05:33:46.186 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-08T05:33:46.186 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.186 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:46.187 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-05-08T05:33:46.187 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.187 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.187 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.187 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:46.187 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.187 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.187 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.187 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.187 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_cluster_level": { 2024-05-08T05:33:46.187 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_cluster_level", 2024-05-08T05:33:46.187 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-08T05:33:46.187 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.187 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:46.188 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "info", 2024-05-08T05:33:46.188 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.188 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.188 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [ 2024-05-08T05:33:46.188 INFO:teuthology.orchestra.run.smithi087.stdout: "", 2024-05-08T05:33:46.188 INFO:teuthology.orchestra.run.smithi087.stdout: "critical", 2024-05-08T05:33:46.188 INFO:teuthology.orchestra.run.smithi087.stdout: "debug", 2024-05-08T05:33:46.188 INFO:teuthology.orchestra.run.smithi087.stdout: "error", 2024-05-08T05:33:46.188 INFO:teuthology.orchestra.run.smithi087.stdout: "info", 2024-05-08T05:33:46.188 INFO:teuthology.orchestra.run.smithi087.stdout: "warning" 2024-05-08T05:33:46.188 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-05-08T05:33:46.188 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:46.188 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.188 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.188 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.189 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.189 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_file": { 2024-05-08T05:33:46.189 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_file", 2024-05-08T05:33:46.189 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-08T05:33:46.189 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.189 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:46.189 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-05-08T05:33:46.189 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.189 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.189 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.189 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:46.189 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.189 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.189 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.189 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.190 INFO:teuthology.orchestra.run.smithi087.stdout: "mark_out_threshold": { 2024-05-08T05:33:46.190 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "mark_out_threshold", 2024-05-08T05:33:46.190 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "secs", 2024-05-08T05:33:46.190 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.190 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:46.190 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "2419200", 2024-05-08T05:33:46.190 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.190 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.190 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.190 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "automatically mark OSD if it may fail before this long", 2024-05-08T05:33:46.190 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.190 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.190 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.190 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.191 INFO:teuthology.orchestra.run.smithi087.stdout: "pool_name": { 2024-05-08T05:33:46.191 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "pool_name", 2024-05-08T05:33:46.191 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-08T05:33:46.191 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.191 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:46.191 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "device_health_metrics", 2024-05-08T05:33:46.191 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.191 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.191 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.191 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "name of pool in which to store device health metrics", 2024-05-08T05:33:46.191 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.191 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.191 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.191 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.192 INFO:teuthology.orchestra.run.smithi087.stdout: "retention_period": { 2024-05-08T05:33:46.192 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "retention_period", 2024-05-08T05:33:46.192 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "secs", 2024-05-08T05:33:46.192 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.192 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:46.192 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "15552000", 2024-05-08T05:33:46.192 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.192 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.192 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.192 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "how long to retain device health metrics", 2024-05-08T05:33:46.192 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.192 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.192 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.192 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.193 INFO:teuthology.orchestra.run.smithi087.stdout: "scrape_frequency": { 2024-05-08T05:33:46.193 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "scrape_frequency", 2024-05-08T05:33:46.193 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "secs", 2024-05-08T05:33:46.193 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.193 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:46.193 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "86400", 2024-05-08T05:33:46.193 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.193 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.193 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.193 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "how frequently to scrape device health metrics", 2024-05-08T05:33:46.193 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.193 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.193 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.193 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.193 INFO:teuthology.orchestra.run.smithi087.stdout: "self_heal": { 2024-05-08T05:33:46.194 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "self_heal", 2024-05-08T05:33:46.194 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-08T05:33:46.194 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.194 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:46.194 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "True", 2024-05-08T05:33:46.194 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.194 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.194 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.194 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "preemptively heal cluster around devices that may fail", 2024-05-08T05:33:46.194 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.194 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.194 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.194 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.194 INFO:teuthology.orchestra.run.smithi087.stdout: "sleep_interval": { 2024-05-08T05:33:46.194 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "sleep_interval", 2024-05-08T05:33:46.195 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "secs", 2024-05-08T05:33:46.195 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.195 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:46.195 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "600", 2024-05-08T05:33:46.195 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.195 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.195 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.195 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "how frequently to wake up and check device health", 2024-05-08T05:33:46.195 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.195 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.195 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.195 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.195 INFO:teuthology.orchestra.run.smithi087.stdout: "sqlite3_killpoint": { 2024-05-08T05:33:46.195 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "sqlite3_killpoint", 2024-05-08T05:33:46.195 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "int", 2024-05-08T05:33:46.196 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "dev", 2024-05-08T05:33:46.196 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:46.196 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "0", 2024-05-08T05:33:46.196 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.196 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.196 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.196 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:46.196 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.196 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.196 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.196 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.196 INFO:teuthology.orchestra.run.smithi087.stdout: "warn_threshold": { 2024-05-08T05:33:46.196 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "warn_threshold", 2024-05-08T05:33:46.196 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "secs", 2024-05-08T05:33:46.196 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.197 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:46.197 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "7257600", 2024-05-08T05:33:46.197 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.197 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.197 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.197 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "raise health warning if OSD may fail before this long", 2024-05-08T05:33:46.197 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.197 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.197 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.197 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-05-08T05:33:46.197 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-05-08T05:33:46.197 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.197 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-05-08T05:33:46.197 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "diskprediction_local", 2024-05-08T05:33:46.197 INFO:teuthology.orchestra.run.smithi087.stdout: "can_run": true, 2024-05-08T05:33:46.198 INFO:teuthology.orchestra.run.smithi087.stdout: "error_string": "", 2024-05-08T05:33:46.198 INFO:teuthology.orchestra.run.smithi087.stdout: "module_options": { 2024-05-08T05:33:46.198 INFO:teuthology.orchestra.run.smithi087.stdout: "log_level": { 2024-05-08T05:33:46.198 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_level", 2024-05-08T05:33:46.198 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-08T05:33:46.198 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.198 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:46.198 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-05-08T05:33:46.198 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.198 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.198 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [ 2024-05-08T05:33:46.198 INFO:teuthology.orchestra.run.smithi087.stdout: "", 2024-05-08T05:33:46.198 INFO:teuthology.orchestra.run.smithi087.stdout: "critical", 2024-05-08T05:33:46.198 INFO:teuthology.orchestra.run.smithi087.stdout: "debug", 2024-05-08T05:33:46.199 INFO:teuthology.orchestra.run.smithi087.stdout: "error", 2024-05-08T05:33:46.199 INFO:teuthology.orchestra.run.smithi087.stdout: "info", 2024-05-08T05:33:46.199 INFO:teuthology.orchestra.run.smithi087.stdout: "warning" 2024-05-08T05:33:46.199 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-05-08T05:33:46.199 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:46.199 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.199 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.199 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.199 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.199 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_cluster": { 2024-05-08T05:33:46.199 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_cluster", 2024-05-08T05:33:46.199 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-08T05:33:46.199 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.199 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:46.200 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-05-08T05:33:46.200 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.200 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.200 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.200 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:46.200 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.200 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.200 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.200 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.200 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_cluster_level": { 2024-05-08T05:33:46.200 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_cluster_level", 2024-05-08T05:33:46.200 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-08T05:33:46.200 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.200 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:46.200 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "info", 2024-05-08T05:33:46.200 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.201 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.201 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [ 2024-05-08T05:33:46.201 INFO:teuthology.orchestra.run.smithi087.stdout: "", 2024-05-08T05:33:46.201 INFO:teuthology.orchestra.run.smithi087.stdout: "critical", 2024-05-08T05:33:46.201 INFO:teuthology.orchestra.run.smithi087.stdout: "debug", 2024-05-08T05:33:46.201 INFO:teuthology.orchestra.run.smithi087.stdout: "error", 2024-05-08T05:33:46.201 INFO:teuthology.orchestra.run.smithi087.stdout: "info", 2024-05-08T05:33:46.201 INFO:teuthology.orchestra.run.smithi087.stdout: "warning" 2024-05-08T05:33:46.201 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-05-08T05:33:46.201 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:46.201 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.201 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.201 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.201 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.202 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_file": { 2024-05-08T05:33:46.202 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_file", 2024-05-08T05:33:46.202 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-08T05:33:46.202 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.202 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:46.202 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-05-08T05:33:46.202 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.202 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.202 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.202 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:46.202 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.202 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.202 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.202 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.202 INFO:teuthology.orchestra.run.smithi087.stdout: "predict_interval": { 2024-05-08T05:33:46.203 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "predict_interval", 2024-05-08T05:33:46.203 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-08T05:33:46.203 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.203 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-08T05:33:46.203 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "86400", 2024-05-08T05:33:46.203 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.203 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.203 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.203 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:46.203 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.203 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.203 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.203 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.203 INFO:teuthology.orchestra.run.smithi087.stdout: "predictor_model": { 2024-05-08T05:33:46.203 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "predictor_model", 2024-05-08T05:33:46.204 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-08T05:33:46.204 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.204 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-08T05:33:46.204 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "prophetstor", 2024-05-08T05:33:46.204 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.204 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.204 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.204 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:46.204 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.204 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.204 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.204 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.204 INFO:teuthology.orchestra.run.smithi087.stdout: "sleep_interval": { 2024-05-08T05:33:46.204 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "sleep_interval", 2024-05-08T05:33:46.204 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-08T05:33:46.205 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.205 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-08T05:33:46.205 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "600", 2024-05-08T05:33:46.205 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.205 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.205 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.205 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:46.205 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.205 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.205 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.205 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.205 INFO:teuthology.orchestra.run.smithi087.stdout: "sqlite3_killpoint": { 2024-05-08T05:33:46.205 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "sqlite3_killpoint", 2024-05-08T05:33:46.205 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "int", 2024-05-08T05:33:46.205 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "dev", 2024-05-08T05:33:46.205 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:46.206 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "0", 2024-05-08T05:33:46.206 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.206 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.206 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.206 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:46.206 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.206 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.206 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.206 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-05-08T05:33:46.206 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-05-08T05:33:46.206 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.206 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-05-08T05:33:46.206 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "influx", 2024-05-08T05:33:46.206 INFO:teuthology.orchestra.run.smithi087.stdout: "can_run": false, 2024-05-08T05:33:46.206 INFO:teuthology.orchestra.run.smithi087.stdout: "error_string": "influxdb python module not found", 2024-05-08T05:33:46.207 INFO:teuthology.orchestra.run.smithi087.stdout: "module_options": { 2024-05-08T05:33:46.207 INFO:teuthology.orchestra.run.smithi087.stdout: "batch_size": { 2024-05-08T05:33:46.207 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "batch_size", 2024-05-08T05:33:46.207 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "int", 2024-05-08T05:33:46.207 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.207 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-08T05:33:46.207 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "5000", 2024-05-08T05:33:46.207 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.207 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.207 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.207 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2024-05-08T05:33:46.207 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.207 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.207 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.207 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.208 INFO:teuthology.orchestra.run.smithi087.stdout: "database": { 2024-05-08T05:33:46.208 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "database", 2024-05-08T05:33:46.208 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-08T05:33:46.208 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.208 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-08T05:33:46.208 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "ceph", 2024-05-08T05:33:46.208 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.208 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.208 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.208 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2024-05-08T05:33:46.208 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.208 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.208 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.208 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.208 INFO:teuthology.orchestra.run.smithi087.stdout: "hostname": { 2024-05-08T05:33:46.209 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "hostname", 2024-05-08T05:33:46.209 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-08T05:33:46.209 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.209 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-08T05:33:46.209 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-05-08T05:33:46.209 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.209 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.209 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.209 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "InfluxDB server hostname", 2024-05-08T05:33:46.209 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.209 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.209 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.209 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.209 INFO:teuthology.orchestra.run.smithi087.stdout: "interval": { 2024-05-08T05:33:46.209 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "interval", 2024-05-08T05:33:46.210 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "secs", 2024-05-08T05:33:46.210 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.210 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-08T05:33:46.210 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "30", 2024-05-08T05:33:46.210 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "5", 2024-05-08T05:33:46.210 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.210 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.210 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2024-05-08T05:33:46.210 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.210 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.210 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.210 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.210 INFO:teuthology.orchestra.run.smithi087.stdout: "log_level": { 2024-05-08T05:33:46.210 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_level", 2024-05-08T05:33:46.210 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-08T05:33:46.211 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.211 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:46.211 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-05-08T05:33:46.211 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.211 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.211 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [ 2024-05-08T05:33:46.211 INFO:teuthology.orchestra.run.smithi087.stdout: "", 2024-05-08T05:33:46.211 INFO:teuthology.orchestra.run.smithi087.stdout: "critical", 2024-05-08T05:33:46.211 INFO:teuthology.orchestra.run.smithi087.stdout: "debug", 2024-05-08T05:33:46.211 INFO:teuthology.orchestra.run.smithi087.stdout: "error", 2024-05-08T05:33:46.211 INFO:teuthology.orchestra.run.smithi087.stdout: "info", 2024-05-08T05:33:46.211 INFO:teuthology.orchestra.run.smithi087.stdout: "warning" 2024-05-08T05:33:46.211 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-05-08T05:33:46.212 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:46.212 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.212 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.212 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.212 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.212 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_cluster": { 2024-05-08T05:33:46.212 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_cluster", 2024-05-08T05:33:46.212 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-08T05:33:46.212 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.212 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:46.212 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-05-08T05:33:46.212 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.212 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.212 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.213 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:46.213 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.213 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.213 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.213 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.213 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_cluster_level": { 2024-05-08T05:33:46.213 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_cluster_level", 2024-05-08T05:33:46.213 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-08T05:33:46.213 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.213 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:46.213 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "info", 2024-05-08T05:33:46.213 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.213 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.213 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [ 2024-05-08T05:33:46.213 INFO:teuthology.orchestra.run.smithi087.stdout: "", 2024-05-08T05:33:46.214 INFO:teuthology.orchestra.run.smithi087.stdout: "critical", 2024-05-08T05:33:46.214 INFO:teuthology.orchestra.run.smithi087.stdout: "debug", 2024-05-08T05:33:46.214 INFO:teuthology.orchestra.run.smithi087.stdout: "error", 2024-05-08T05:33:46.214 INFO:teuthology.orchestra.run.smithi087.stdout: "info", 2024-05-08T05:33:46.214 INFO:teuthology.orchestra.run.smithi087.stdout: "warning" 2024-05-08T05:33:46.214 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-05-08T05:33:46.214 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:46.214 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.214 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.214 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.214 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.214 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_file": { 2024-05-08T05:33:46.214 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_file", 2024-05-08T05:33:46.214 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-08T05:33:46.215 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.215 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:46.215 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-05-08T05:33:46.215 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.215 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.215 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.215 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:46.215 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.215 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.215 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.215 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.215 INFO:teuthology.orchestra.run.smithi087.stdout: "password": { 2024-05-08T05:33:46.215 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "password", 2024-05-08T05:33:46.215 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-08T05:33:46.215 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.216 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-08T05:33:46.216 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-05-08T05:33:46.216 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.216 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.216 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.216 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "password of InfluxDB server user", 2024-05-08T05:33:46.216 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.216 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.216 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.216 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.216 INFO:teuthology.orchestra.run.smithi087.stdout: "port": { 2024-05-08T05:33:46.216 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "port", 2024-05-08T05:33:46.216 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "int", 2024-05-08T05:33:46.216 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.217 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-08T05:33:46.217 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "8086", 2024-05-08T05:33:46.217 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.217 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.217 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.217 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "InfluxDB server port", 2024-05-08T05:33:46.217 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.217 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.217 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.217 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.217 INFO:teuthology.orchestra.run.smithi087.stdout: "sqlite3_killpoint": { 2024-05-08T05:33:46.217 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "sqlite3_killpoint", 2024-05-08T05:33:46.217 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "int", 2024-05-08T05:33:46.217 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "dev", 2024-05-08T05:33:46.217 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:46.218 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "0", 2024-05-08T05:33:46.218 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.218 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.218 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.218 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:46.218 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.218 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.218 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.218 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.218 INFO:teuthology.orchestra.run.smithi087.stdout: "ssl": { 2024-05-08T05:33:46.218 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "ssl", 2024-05-08T05:33:46.218 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-08T05:33:46.218 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.218 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-08T05:33:46.218 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "false", 2024-05-08T05:33:46.219 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.219 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.219 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.219 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2024-05-08T05:33:46.219 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.219 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.219 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.219 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.219 INFO:teuthology.orchestra.run.smithi087.stdout: "threads": { 2024-05-08T05:33:46.219 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "threads", 2024-05-08T05:33:46.219 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "int", 2024-05-08T05:33:46.219 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.219 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-08T05:33:46.219 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "5", 2024-05-08T05:33:46.219 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "1", 2024-05-08T05:33:46.220 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "32", 2024-05-08T05:33:46.220 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.220 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2024-05-08T05:33:46.220 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.220 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.220 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.220 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.220 INFO:teuthology.orchestra.run.smithi087.stdout: "username": { 2024-05-08T05:33:46.220 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "username", 2024-05-08T05:33:46.220 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-08T05:33:46.220 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.220 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-08T05:33:46.220 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-05-08T05:33:46.220 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.220 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.221 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.221 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "username of InfluxDB server user", 2024-05-08T05:33:46.221 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.221 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.221 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.221 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.221 INFO:teuthology.orchestra.run.smithi087.stdout: "verify_ssl": { 2024-05-08T05:33:46.221 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "verify_ssl", 2024-05-08T05:33:46.221 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-08T05:33:46.221 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.221 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-08T05:33:46.221 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "true", 2024-05-08T05:33:46.221 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.221 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.222 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.222 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2024-05-08T05:33:46.222 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.222 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.222 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.222 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-05-08T05:33:46.222 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-05-08T05:33:46.222 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.222 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-05-08T05:33:46.222 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "insights", 2024-05-08T05:33:46.222 INFO:teuthology.orchestra.run.smithi087.stdout: "can_run": true, 2024-05-08T05:33:46.222 INFO:teuthology.orchestra.run.smithi087.stdout: "error_string": "", 2024-05-08T05:33:46.222 INFO:teuthology.orchestra.run.smithi087.stdout: "module_options": { 2024-05-08T05:33:46.222 INFO:teuthology.orchestra.run.smithi087.stdout: "log_level": { 2024-05-08T05:33:46.222 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_level", 2024-05-08T05:33:46.223 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-08T05:33:46.223 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.223 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:46.223 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-05-08T05:33:46.223 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.223 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.223 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [ 2024-05-08T05:33:46.223 INFO:teuthology.orchestra.run.smithi087.stdout: "", 2024-05-08T05:33:46.223 INFO:teuthology.orchestra.run.smithi087.stdout: "critical", 2024-05-08T05:33:46.223 INFO:teuthology.orchestra.run.smithi087.stdout: "debug", 2024-05-08T05:33:46.223 INFO:teuthology.orchestra.run.smithi087.stdout: "error", 2024-05-08T05:33:46.223 INFO:teuthology.orchestra.run.smithi087.stdout: "info", 2024-05-08T05:33:46.223 INFO:teuthology.orchestra.run.smithi087.stdout: "warning" 2024-05-08T05:33:46.223 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-05-08T05:33:46.223 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:46.224 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.224 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.224 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.224 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.224 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_cluster": { 2024-05-08T05:33:46.224 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_cluster", 2024-05-08T05:33:46.224 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-08T05:33:46.224 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.224 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:46.224 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-05-08T05:33:46.224 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.224 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.224 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.225 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:46.225 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.225 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.225 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.225 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.225 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_cluster_level": { 2024-05-08T05:33:46.225 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_cluster_level", 2024-05-08T05:33:46.225 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-08T05:33:46.225 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.225 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:46.225 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "info", 2024-05-08T05:33:46.225 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.225 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.225 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [ 2024-05-08T05:33:46.226 INFO:teuthology.orchestra.run.smithi087.stdout: "", 2024-05-08T05:33:46.226 INFO:teuthology.orchestra.run.smithi087.stdout: "critical", 2024-05-08T05:33:46.226 INFO:teuthology.orchestra.run.smithi087.stdout: "debug", 2024-05-08T05:33:46.226 INFO:teuthology.orchestra.run.smithi087.stdout: "error", 2024-05-08T05:33:46.226 INFO:teuthology.orchestra.run.smithi087.stdout: "info", 2024-05-08T05:33:46.226 INFO:teuthology.orchestra.run.smithi087.stdout: "warning" 2024-05-08T05:33:46.226 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-05-08T05:33:46.226 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:46.226 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.226 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.226 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.226 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.226 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_file": { 2024-05-08T05:33:46.226 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_file", 2024-05-08T05:33:46.227 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-08T05:33:46.227 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.227 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:46.227 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-05-08T05:33:46.227 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.227 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.227 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.227 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:46.227 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.227 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.227 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.227 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.227 INFO:teuthology.orchestra.run.smithi087.stdout: "sqlite3_killpoint": { 2024-05-08T05:33:46.227 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "sqlite3_killpoint", 2024-05-08T05:33:46.227 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "int", 2024-05-08T05:33:46.227 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "dev", 2024-05-08T05:33:46.228 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:46.228 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "0", 2024-05-08T05:33:46.228 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.228 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.228 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.228 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:46.228 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.228 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.228 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.228 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-05-08T05:33:46.228 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-05-08T05:33:46.228 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.228 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-05-08T05:33:46.228 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "iostat", 2024-05-08T05:33:46.228 INFO:teuthology.orchestra.run.smithi087.stdout: "can_run": true, 2024-05-08T05:33:46.228 INFO:teuthology.orchestra.run.smithi087.stdout: "error_string": "", 2024-05-08T05:33:46.229 INFO:teuthology.orchestra.run.smithi087.stdout: "module_options": { 2024-05-08T05:33:46.229 INFO:teuthology.orchestra.run.smithi087.stdout: "log_level": { 2024-05-08T05:33:46.229 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_level", 2024-05-08T05:33:46.229 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-08T05:33:46.229 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.229 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:46.229 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-05-08T05:33:46.229 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.229 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.229 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [ 2024-05-08T05:33:46.229 INFO:teuthology.orchestra.run.smithi087.stdout: "", 2024-05-08T05:33:46.229 INFO:teuthology.orchestra.run.smithi087.stdout: "critical", 2024-05-08T05:33:46.229 INFO:teuthology.orchestra.run.smithi087.stdout: "debug", 2024-05-08T05:33:46.229 INFO:teuthology.orchestra.run.smithi087.stdout: "error", 2024-05-08T05:33:46.229 INFO:teuthology.orchestra.run.smithi087.stdout: "info", 2024-05-08T05:33:46.230 INFO:teuthology.orchestra.run.smithi087.stdout: "warning" 2024-05-08T05:33:46.230 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-05-08T05:33:46.230 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:46.230 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.230 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.230 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.230 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.230 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_cluster": { 2024-05-08T05:33:46.230 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_cluster", 2024-05-08T05:33:46.230 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-08T05:33:46.230 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.230 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:46.230 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-05-08T05:33:46.230 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.231 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.231 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.231 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:46.231 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.231 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.231 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.231 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.231 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_cluster_level": { 2024-05-08T05:33:46.231 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_cluster_level", 2024-05-08T05:33:46.231 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-08T05:33:46.231 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.231 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:46.231 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "info", 2024-05-08T05:33:46.231 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.231 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.232 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [ 2024-05-08T05:33:46.232 INFO:teuthology.orchestra.run.smithi087.stdout: "", 2024-05-08T05:33:46.232 INFO:teuthology.orchestra.run.smithi087.stdout: "critical", 2024-05-08T05:33:46.232 INFO:teuthology.orchestra.run.smithi087.stdout: "debug", 2024-05-08T05:33:46.232 INFO:teuthology.orchestra.run.smithi087.stdout: "error", 2024-05-08T05:33:46.232 INFO:teuthology.orchestra.run.smithi087.stdout: "info", 2024-05-08T05:33:46.232 INFO:teuthology.orchestra.run.smithi087.stdout: "warning" 2024-05-08T05:33:46.232 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-05-08T05:33:46.232 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:46.232 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.232 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.232 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.232 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.232 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_file": { 2024-05-08T05:33:46.232 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_file", 2024-05-08T05:33:46.232 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-08T05:33:46.232 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.233 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:46.233 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-05-08T05:33:46.233 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.233 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.233 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.233 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:46.233 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.233 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.233 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.233 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.233 INFO:teuthology.orchestra.run.smithi087.stdout: "sqlite3_killpoint": { 2024-05-08T05:33:46.233 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "sqlite3_killpoint", 2024-05-08T05:33:46.233 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "int", 2024-05-08T05:33:46.233 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "dev", 2024-05-08T05:33:46.234 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:46.234 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "0", 2024-05-08T05:33:46.234 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.234 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.234 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.234 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:46.234 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.234 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.234 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.234 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-05-08T05:33:46.234 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-05-08T05:33:46.234 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.234 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-05-08T05:33:46.234 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "k8sevents", 2024-05-08T05:33:46.234 INFO:teuthology.orchestra.run.smithi087.stdout: "can_run": true, 2024-05-08T05:33:46.235 INFO:teuthology.orchestra.run.smithi087.stdout: "error_string": "", 2024-05-08T05:33:46.235 INFO:teuthology.orchestra.run.smithi087.stdout: "module_options": { 2024-05-08T05:33:46.235 INFO:teuthology.orchestra.run.smithi087.stdout: "ceph_event_retention_days": { 2024-05-08T05:33:46.235 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "ceph_event_retention_days", 2024-05-08T05:33:46.235 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "int", 2024-05-08T05:33:46.235 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.235 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-08T05:33:46.235 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "7", 2024-05-08T05:33:46.235 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.235 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.235 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.235 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "Days to hold ceph event information within local cache", 2024-05-08T05:33:46.235 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.235 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.235 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.236 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.236 INFO:teuthology.orchestra.run.smithi087.stdout: "config_check_secs": { 2024-05-08T05:33:46.236 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "config_check_secs", 2024-05-08T05:33:46.236 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "int", 2024-05-08T05:33:46.236 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.236 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-08T05:33:46.236 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "10", 2024-05-08T05:33:46.236 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "10", 2024-05-08T05:33:46.236 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.236 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.236 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2024-05-08T05:33:46.236 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.236 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.236 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.236 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.237 INFO:teuthology.orchestra.run.smithi087.stdout: "log_level": { 2024-05-08T05:33:46.237 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_level", 2024-05-08T05:33:46.237 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-08T05:33:46.237 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.237 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:46.237 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-05-08T05:33:46.237 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.237 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.237 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [ 2024-05-08T05:33:46.237 INFO:teuthology.orchestra.run.smithi087.stdout: "", 2024-05-08T05:33:46.237 INFO:teuthology.orchestra.run.smithi087.stdout: "critical", 2024-05-08T05:33:46.237 INFO:teuthology.orchestra.run.smithi087.stdout: "debug", 2024-05-08T05:33:46.237 INFO:teuthology.orchestra.run.smithi087.stdout: "error", 2024-05-08T05:33:46.237 INFO:teuthology.orchestra.run.smithi087.stdout: "info", 2024-05-08T05:33:46.237 INFO:teuthology.orchestra.run.smithi087.stdout: "warning" 2024-05-08T05:33:46.238 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-05-08T05:33:46.238 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:46.238 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.238 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.238 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.238 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.238 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_cluster": { 2024-05-08T05:33:46.238 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_cluster", 2024-05-08T05:33:46.238 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-08T05:33:46.238 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.238 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:46.238 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-05-08T05:33:46.238 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.238 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.239 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.239 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:46.239 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.239 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.239 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.239 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.239 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_cluster_level": { 2024-05-08T05:33:46.239 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_cluster_level", 2024-05-08T05:33:46.239 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-08T05:33:46.239 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.239 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:46.239 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "info", 2024-05-08T05:33:46.239 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.239 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.240 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [ 2024-05-08T05:33:46.240 INFO:teuthology.orchestra.run.smithi087.stdout: "", 2024-05-08T05:33:46.240 INFO:teuthology.orchestra.run.smithi087.stdout: "critical", 2024-05-08T05:33:46.240 INFO:teuthology.orchestra.run.smithi087.stdout: "debug", 2024-05-08T05:33:46.240 INFO:teuthology.orchestra.run.smithi087.stdout: "error", 2024-05-08T05:33:46.240 INFO:teuthology.orchestra.run.smithi087.stdout: "info", 2024-05-08T05:33:46.240 INFO:teuthology.orchestra.run.smithi087.stdout: "warning" 2024-05-08T05:33:46.240 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-05-08T05:33:46.240 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:46.240 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.240 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.240 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.240 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.240 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_file": { 2024-05-08T05:33:46.240 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_file", 2024-05-08T05:33:46.241 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-08T05:33:46.241 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.241 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:46.241 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-05-08T05:33:46.241 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.241 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.241 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.241 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:46.241 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.241 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.241 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.241 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.241 INFO:teuthology.orchestra.run.smithi087.stdout: "sqlite3_killpoint": { 2024-05-08T05:33:46.241 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "sqlite3_killpoint", 2024-05-08T05:33:46.241 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "int", 2024-05-08T05:33:46.242 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "dev", 2024-05-08T05:33:46.242 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:46.242 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "0", 2024-05-08T05:33:46.242 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.242 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.242 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.242 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:46.242 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.242 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.242 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.242 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-05-08T05:33:46.242 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-05-08T05:33:46.242 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.242 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-05-08T05:33:46.242 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "localpool", 2024-05-08T05:33:46.243 INFO:teuthology.orchestra.run.smithi087.stdout: "can_run": true, 2024-05-08T05:33:46.243 INFO:teuthology.orchestra.run.smithi087.stdout: "error_string": "", 2024-05-08T05:33:46.243 INFO:teuthology.orchestra.run.smithi087.stdout: "module_options": { 2024-05-08T05:33:46.243 INFO:teuthology.orchestra.run.smithi087.stdout: "failure_domain": { 2024-05-08T05:33:46.243 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "failure_domain", 2024-05-08T05:33:46.243 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-08T05:33:46.243 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.243 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:46.243 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "host", 2024-05-08T05:33:46.243 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.243 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.243 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.243 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "failure domain for any created local pool", 2024-05-08T05:33:46.243 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2024-05-08T05:33:46.243 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.244 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.244 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.244 INFO:teuthology.orchestra.run.smithi087.stdout: "log_level": { 2024-05-08T05:33:46.244 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_level", 2024-05-08T05:33:46.244 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-08T05:33:46.244 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.244 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:46.244 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-05-08T05:33:46.244 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.244 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.244 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [ 2024-05-08T05:33:46.244 INFO:teuthology.orchestra.run.smithi087.stdout: "", 2024-05-08T05:33:46.244 INFO:teuthology.orchestra.run.smithi087.stdout: "critical", 2024-05-08T05:33:46.244 INFO:teuthology.orchestra.run.smithi087.stdout: "debug", 2024-05-08T05:33:46.244 INFO:teuthology.orchestra.run.smithi087.stdout: "error", 2024-05-08T05:33:46.245 INFO:teuthology.orchestra.run.smithi087.stdout: "info", 2024-05-08T05:33:46.245 INFO:teuthology.orchestra.run.smithi087.stdout: "warning" 2024-05-08T05:33:46.245 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-05-08T05:33:46.245 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:46.245 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.245 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.245 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.245 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.245 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_cluster": { 2024-05-08T05:33:46.245 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_cluster", 2024-05-08T05:33:46.245 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-08T05:33:46.245 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.245 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:46.245 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-05-08T05:33:46.245 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.246 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.246 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.246 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:46.246 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.246 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.246 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.246 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.246 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_cluster_level": { 2024-05-08T05:33:46.246 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_cluster_level", 2024-05-08T05:33:46.246 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-08T05:33:46.246 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.246 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:46.246 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "info", 2024-05-08T05:33:46.246 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.247 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.247 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [ 2024-05-08T05:33:46.247 INFO:teuthology.orchestra.run.smithi087.stdout: "", 2024-05-08T05:33:46.247 INFO:teuthology.orchestra.run.smithi087.stdout: "critical", 2024-05-08T05:33:46.247 INFO:teuthology.orchestra.run.smithi087.stdout: "debug", 2024-05-08T05:33:46.247 INFO:teuthology.orchestra.run.smithi087.stdout: "error", 2024-05-08T05:33:46.247 INFO:teuthology.orchestra.run.smithi087.stdout: "info", 2024-05-08T05:33:46.247 INFO:teuthology.orchestra.run.smithi087.stdout: "warning" 2024-05-08T05:33:46.247 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-05-08T05:33:46.247 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:46.247 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.247 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.247 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.247 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.247 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_file": { 2024-05-08T05:33:46.248 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_file", 2024-05-08T05:33:46.248 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-08T05:33:46.248 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.248 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:46.248 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-05-08T05:33:46.248 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.248 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.248 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.248 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:46.248 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.248 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.248 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.248 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.248 INFO:teuthology.orchestra.run.smithi087.stdout: "min_size": { 2024-05-08T05:33:46.248 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "min_size", 2024-05-08T05:33:46.249 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "int", 2024-05-08T05:33:46.249 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.249 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:46.249 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-05-08T05:33:46.249 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.249 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.249 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.249 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "default min_size for any created local pool", 2024-05-08T05:33:46.249 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2024-05-08T05:33:46.249 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.249 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.249 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.249 INFO:teuthology.orchestra.run.smithi087.stdout: "num_rep": { 2024-05-08T05:33:46.249 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "num_rep", 2024-05-08T05:33:46.250 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "int", 2024-05-08T05:33:46.250 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.250 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:46.250 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "3", 2024-05-08T05:33:46.250 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.250 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.250 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.250 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "default replica count for any created local pool", 2024-05-08T05:33:46.250 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.250 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.250 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.250 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.250 INFO:teuthology.orchestra.run.smithi087.stdout: "pg_num": { 2024-05-08T05:33:46.251 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "pg_num", 2024-05-08T05:33:46.251 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "int", 2024-05-08T05:33:46.251 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.251 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:46.251 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "128", 2024-05-08T05:33:46.251 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.251 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.251 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.251 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "default pg_num for any created local pool", 2024-05-08T05:33:46.251 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.251 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.251 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.251 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.251 INFO:teuthology.orchestra.run.smithi087.stdout: "prefix": { 2024-05-08T05:33:46.251 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "prefix", 2024-05-08T05:33:46.252 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-08T05:33:46.252 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.252 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:46.252 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-05-08T05:33:46.252 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.252 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.252 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.252 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "name prefix for any created local pool", 2024-05-08T05:33:46.252 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.252 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.252 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.252 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.252 INFO:teuthology.orchestra.run.smithi087.stdout: "sqlite3_killpoint": { 2024-05-08T05:33:46.252 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "sqlite3_killpoint", 2024-05-08T05:33:46.252 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "int", 2024-05-08T05:33:46.253 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "dev", 2024-05-08T05:33:46.253 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:46.253 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "0", 2024-05-08T05:33:46.253 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.253 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.253 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.253 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:46.253 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.253 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.253 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.253 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.253 INFO:teuthology.orchestra.run.smithi087.stdout: "subtree": { 2024-05-08T05:33:46.253 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "subtree", 2024-05-08T05:33:46.253 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-08T05:33:46.253 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.254 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:46.254 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "rack", 2024-05-08T05:33:46.254 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.254 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.254 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.254 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "CRUSH level for which to create a local pool", 2024-05-08T05:33:46.254 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2024-05-08T05:33:46.254 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.254 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.254 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-05-08T05:33:46.254 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-05-08T05:33:46.254 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.254 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-05-08T05:33:46.254 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "mds_autoscaler", 2024-05-08T05:33:46.254 INFO:teuthology.orchestra.run.smithi087.stdout: "can_run": true, 2024-05-08T05:33:46.255 INFO:teuthology.orchestra.run.smithi087.stdout: "error_string": "", 2024-05-08T05:33:46.255 INFO:teuthology.orchestra.run.smithi087.stdout: "module_options": { 2024-05-08T05:33:46.255 INFO:teuthology.orchestra.run.smithi087.stdout: "log_level": { 2024-05-08T05:33:46.255 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_level", 2024-05-08T05:33:46.255 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-08T05:33:46.255 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.255 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:46.255 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-05-08T05:33:46.255 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.255 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.255 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [ 2024-05-08T05:33:46.255 INFO:teuthology.orchestra.run.smithi087.stdout: "", 2024-05-08T05:33:46.255 INFO:teuthology.orchestra.run.smithi087.stdout: "critical", 2024-05-08T05:33:46.255 INFO:teuthology.orchestra.run.smithi087.stdout: "debug", 2024-05-08T05:33:46.256 INFO:teuthology.orchestra.run.smithi087.stdout: "error", 2024-05-08T05:33:46.256 INFO:teuthology.orchestra.run.smithi087.stdout: "info", 2024-05-08T05:33:46.256 INFO:teuthology.orchestra.run.smithi087.stdout: "warning" 2024-05-08T05:33:46.256 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-05-08T05:33:46.256 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:46.256 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.256 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.256 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.256 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.256 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_cluster": { 2024-05-08T05:33:46.256 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_cluster", 2024-05-08T05:33:46.256 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-08T05:33:46.256 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.256 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:46.256 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-05-08T05:33:46.256 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.257 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.257 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.257 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:46.257 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.257 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.257 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.257 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.257 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_cluster_level": { 2024-05-08T05:33:46.257 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_cluster_level", 2024-05-08T05:33:46.257 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-08T05:33:46.257 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.257 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:46.257 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "info", 2024-05-08T05:33:46.257 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.257 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.258 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [ 2024-05-08T05:33:46.258 INFO:teuthology.orchestra.run.smithi087.stdout: "", 2024-05-08T05:33:46.258 INFO:teuthology.orchestra.run.smithi087.stdout: "critical", 2024-05-08T05:33:46.258 INFO:teuthology.orchestra.run.smithi087.stdout: "debug", 2024-05-08T05:33:46.258 INFO:teuthology.orchestra.run.smithi087.stdout: "error", 2024-05-08T05:33:46.258 INFO:teuthology.orchestra.run.smithi087.stdout: "info", 2024-05-08T05:33:46.258 INFO:teuthology.orchestra.run.smithi087.stdout: "warning" 2024-05-08T05:33:46.258 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-05-08T05:33:46.258 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:46.258 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.258 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.258 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.258 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.258 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_file": { 2024-05-08T05:33:46.258 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_file", 2024-05-08T05:33:46.259 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-08T05:33:46.259 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.259 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:46.259 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-05-08T05:33:46.259 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.259 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.259 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.259 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:46.259 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.259 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.259 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.259 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.259 INFO:teuthology.orchestra.run.smithi087.stdout: "sqlite3_killpoint": { 2024-05-08T05:33:46.259 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "sqlite3_killpoint", 2024-05-08T05:33:46.259 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "int", 2024-05-08T05:33:46.260 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "dev", 2024-05-08T05:33:46.260 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:46.260 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "0", 2024-05-08T05:33:46.260 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.260 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.260 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.260 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:46.260 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.260 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.260 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.260 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-05-08T05:33:46.260 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-05-08T05:33:46.260 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.260 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-05-08T05:33:46.261 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "mirroring", 2024-05-08T05:33:46.261 INFO:teuthology.orchestra.run.smithi087.stdout: "can_run": true, 2024-05-08T05:33:46.261 INFO:teuthology.orchestra.run.smithi087.stdout: "error_string": "", 2024-05-08T05:33:46.261 INFO:teuthology.orchestra.run.smithi087.stdout: "module_options": { 2024-05-08T05:33:46.261 INFO:teuthology.orchestra.run.smithi087.stdout: "log_level": { 2024-05-08T05:33:46.261 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_level", 2024-05-08T05:33:46.261 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-08T05:33:46.261 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.261 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:46.261 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-05-08T05:33:46.261 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.261 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.261 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [ 2024-05-08T05:33:46.261 INFO:teuthology.orchestra.run.smithi087.stdout: "", 2024-05-08T05:33:46.261 INFO:teuthology.orchestra.run.smithi087.stdout: "critical", 2024-05-08T05:33:46.262 INFO:teuthology.orchestra.run.smithi087.stdout: "debug", 2024-05-08T05:33:46.262 INFO:teuthology.orchestra.run.smithi087.stdout: "error", 2024-05-08T05:33:46.262 INFO:teuthology.orchestra.run.smithi087.stdout: "info", 2024-05-08T05:33:46.262 INFO:teuthology.orchestra.run.smithi087.stdout: "warning" 2024-05-08T05:33:46.262 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-05-08T05:33:46.262 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:46.262 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.262 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.262 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.262 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.262 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_cluster": { 2024-05-08T05:33:46.262 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_cluster", 2024-05-08T05:33:46.262 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-08T05:33:46.262 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.263 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:46.263 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-05-08T05:33:46.263 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.263 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.263 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.263 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:46.263 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.263 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.263 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.263 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.263 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_cluster_level": { 2024-05-08T05:33:46.263 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_cluster_level", 2024-05-08T05:33:46.263 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-08T05:33:46.263 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.264 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:46.264 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "info", 2024-05-08T05:33:46.264 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.264 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.264 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [ 2024-05-08T05:33:46.264 INFO:teuthology.orchestra.run.smithi087.stdout: "", 2024-05-08T05:33:46.264 INFO:teuthology.orchestra.run.smithi087.stdout: "critical", 2024-05-08T05:33:46.264 INFO:teuthology.orchestra.run.smithi087.stdout: "debug", 2024-05-08T05:33:46.264 INFO:teuthology.orchestra.run.smithi087.stdout: "error", 2024-05-08T05:33:46.264 INFO:teuthology.orchestra.run.smithi087.stdout: "info", 2024-05-08T05:33:46.264 INFO:teuthology.orchestra.run.smithi087.stdout: "warning" 2024-05-08T05:33:46.264 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-05-08T05:33:46.264 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:46.264 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.265 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.265 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.265 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.265 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_file": { 2024-05-08T05:33:46.265 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_file", 2024-05-08T05:33:46.265 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-08T05:33:46.265 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.265 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:46.265 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-05-08T05:33:46.265 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.265 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.265 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.265 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:46.265 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.265 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.266 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.266 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.266 INFO:teuthology.orchestra.run.smithi087.stdout: "sqlite3_killpoint": { 2024-05-08T05:33:46.266 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "sqlite3_killpoint", 2024-05-08T05:33:46.266 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "int", 2024-05-08T05:33:46.266 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "dev", 2024-05-08T05:33:46.266 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:46.266 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "0", 2024-05-08T05:33:46.266 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.266 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.266 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.266 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:46.266 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.267 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.267 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.267 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-05-08T05:33:46.267 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-05-08T05:33:46.267 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.267 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-05-08T05:33:46.267 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "nfs", 2024-05-08T05:33:46.267 INFO:teuthology.orchestra.run.smithi087.stdout: "can_run": true, 2024-05-08T05:33:46.267 INFO:teuthology.orchestra.run.smithi087.stdout: "error_string": "", 2024-05-08T05:33:46.267 INFO:teuthology.orchestra.run.smithi087.stdout: "module_options": { 2024-05-08T05:33:46.267 INFO:teuthology.orchestra.run.smithi087.stdout: "log_level": { 2024-05-08T05:33:46.267 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_level", 2024-05-08T05:33:46.267 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-08T05:33:46.267 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.268 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:46.268 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-05-08T05:33:46.268 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.268 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.268 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [ 2024-05-08T05:33:46.268 INFO:teuthology.orchestra.run.smithi087.stdout: "", 2024-05-08T05:33:46.268 INFO:teuthology.orchestra.run.smithi087.stdout: "critical", 2024-05-08T05:33:46.268 INFO:teuthology.orchestra.run.smithi087.stdout: "debug", 2024-05-08T05:33:46.268 INFO:teuthology.orchestra.run.smithi087.stdout: "error", 2024-05-08T05:33:46.268 INFO:teuthology.orchestra.run.smithi087.stdout: "info", 2024-05-08T05:33:46.268 INFO:teuthology.orchestra.run.smithi087.stdout: "warning" 2024-05-08T05:33:46.268 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-05-08T05:33:46.268 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:46.268 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.268 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.268 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.269 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.269 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_cluster": { 2024-05-08T05:33:46.269 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_cluster", 2024-05-08T05:33:46.269 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-08T05:33:46.269 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.269 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:46.269 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-05-08T05:33:46.269 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.269 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.269 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.269 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:46.269 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.269 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.269 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.270 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.270 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_cluster_level": { 2024-05-08T05:33:46.270 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_cluster_level", 2024-05-08T05:33:46.270 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-08T05:33:46.270 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.270 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:46.270 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "info", 2024-05-08T05:33:46.270 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.270 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.270 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [ 2024-05-08T05:33:46.270 INFO:teuthology.orchestra.run.smithi087.stdout: "", 2024-05-08T05:33:46.270 INFO:teuthology.orchestra.run.smithi087.stdout: "critical", 2024-05-08T05:33:46.270 INFO:teuthology.orchestra.run.smithi087.stdout: "debug", 2024-05-08T05:33:46.270 INFO:teuthology.orchestra.run.smithi087.stdout: "error", 2024-05-08T05:33:46.270 INFO:teuthology.orchestra.run.smithi087.stdout: "info", 2024-05-08T05:33:46.271 INFO:teuthology.orchestra.run.smithi087.stdout: "warning" 2024-05-08T05:33:46.271 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-05-08T05:33:46.271 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:46.271 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.271 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.271 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.271 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.271 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_file": { 2024-05-08T05:33:46.271 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_file", 2024-05-08T05:33:46.271 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-08T05:33:46.271 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.271 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:46.271 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-05-08T05:33:46.271 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.271 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.272 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.272 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:46.272 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.272 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.272 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.272 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.272 INFO:teuthology.orchestra.run.smithi087.stdout: "sqlite3_killpoint": { 2024-05-08T05:33:46.272 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "sqlite3_killpoint", 2024-05-08T05:33:46.272 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "int", 2024-05-08T05:33:46.272 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "dev", 2024-05-08T05:33:46.272 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:46.272 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "0", 2024-05-08T05:33:46.272 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.272 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.272 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.273 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:46.273 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.273 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.273 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.273 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-05-08T05:33:46.273 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-05-08T05:33:46.273 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.273 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-05-08T05:33:46.273 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "orchestrator", 2024-05-08T05:33:46.273 INFO:teuthology.orchestra.run.smithi087.stdout: "can_run": true, 2024-05-08T05:33:46.273 INFO:teuthology.orchestra.run.smithi087.stdout: "error_string": "", 2024-05-08T05:33:46.273 INFO:teuthology.orchestra.run.smithi087.stdout: "module_options": { 2024-05-08T05:33:46.273 INFO:teuthology.orchestra.run.smithi087.stdout: "fail_fs": { 2024-05-08T05:33:46.273 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "fail_fs", 2024-05-08T05:33:46.273 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-08T05:33:46.273 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.274 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-08T05:33:46.274 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-05-08T05:33:46.274 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.274 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.274 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.274 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2024-05-08T05:33:46.274 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.274 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.274 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.274 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.274 INFO:teuthology.orchestra.run.smithi087.stdout: "log_level": { 2024-05-08T05:33:46.274 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_level", 2024-05-08T05:33:46.274 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-08T05:33:46.274 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.274 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:46.275 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-05-08T05:33:46.275 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.275 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.275 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [ 2024-05-08T05:33:46.275 INFO:teuthology.orchestra.run.smithi087.stdout: "", 2024-05-08T05:33:46.275 INFO:teuthology.orchestra.run.smithi087.stdout: "critical", 2024-05-08T05:33:46.275 INFO:teuthology.orchestra.run.smithi087.stdout: "debug", 2024-05-08T05:33:46.275 INFO:teuthology.orchestra.run.smithi087.stdout: "error", 2024-05-08T05:33:46.275 INFO:teuthology.orchestra.run.smithi087.stdout: "info", 2024-05-08T05:33:46.275 INFO:teuthology.orchestra.run.smithi087.stdout: "warning" 2024-05-08T05:33:46.275 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-05-08T05:33:46.275 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:46.275 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.275 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.275 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.276 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.276 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_cluster": { 2024-05-08T05:33:46.276 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_cluster", 2024-05-08T05:33:46.276 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-08T05:33:46.276 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.276 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:46.276 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-05-08T05:33:46.276 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.276 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.276 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.276 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:46.276 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.276 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.277 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.277 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.277 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_cluster_level": { 2024-05-08T05:33:46.277 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_cluster_level", 2024-05-08T05:33:46.277 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-08T05:33:46.277 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.277 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:46.277 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "info", 2024-05-08T05:33:46.277 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.277 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.277 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [ 2024-05-08T05:33:46.277 INFO:teuthology.orchestra.run.smithi087.stdout: "", 2024-05-08T05:33:46.277 INFO:teuthology.orchestra.run.smithi087.stdout: "critical", 2024-05-08T05:33:46.277 INFO:teuthology.orchestra.run.smithi087.stdout: "debug", 2024-05-08T05:33:46.277 INFO:teuthology.orchestra.run.smithi087.stdout: "error", 2024-05-08T05:33:46.278 INFO:teuthology.orchestra.run.smithi087.stdout: "info", 2024-05-08T05:33:46.278 INFO:teuthology.orchestra.run.smithi087.stdout: "warning" 2024-05-08T05:33:46.278 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-05-08T05:33:46.278 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:46.278 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.278 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.278 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.278 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.278 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_file": { 2024-05-08T05:33:46.278 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_file", 2024-05-08T05:33:46.278 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-08T05:33:46.278 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.278 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:46.278 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-05-08T05:33:46.279 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.279 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.279 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.279 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:46.279 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.279 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.279 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.279 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.279 INFO:teuthology.orchestra.run.smithi087.stdout: "orchestrator": { 2024-05-08T05:33:46.279 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "orchestrator", 2024-05-08T05:33:46.279 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-08T05:33:46.279 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.279 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:46.279 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-05-08T05:33:46.279 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.280 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.280 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [ 2024-05-08T05:33:46.280 INFO:teuthology.orchestra.run.smithi087.stdout: "cephadm", 2024-05-08T05:33:46.280 INFO:teuthology.orchestra.run.smithi087.stdout: "rook", 2024-05-08T05:33:46.280 INFO:teuthology.orchestra.run.smithi087.stdout: "test_orchestrator" 2024-05-08T05:33:46.280 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-05-08T05:33:46.280 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "Orchestrator backend", 2024-05-08T05:33:46.280 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.280 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.280 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.280 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.280 INFO:teuthology.orchestra.run.smithi087.stdout: "sqlite3_killpoint": { 2024-05-08T05:33:46.280 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "sqlite3_killpoint", 2024-05-08T05:33:46.280 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "int", 2024-05-08T05:33:46.280 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "dev", 2024-05-08T05:33:46.281 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:46.281 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "0", 2024-05-08T05:33:46.281 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.281 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.281 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.281 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:46.281 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.281 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.281 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.281 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-05-08T05:33:46.281 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-05-08T05:33:46.281 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.281 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-05-08T05:33:46.281 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "osd_perf_query", 2024-05-08T05:33:46.281 INFO:teuthology.orchestra.run.smithi087.stdout: "can_run": true, 2024-05-08T05:33:46.282 INFO:teuthology.orchestra.run.smithi087.stdout: "error_string": "", 2024-05-08T05:33:46.282 INFO:teuthology.orchestra.run.smithi087.stdout: "module_options": { 2024-05-08T05:33:46.282 INFO:teuthology.orchestra.run.smithi087.stdout: "log_level": { 2024-05-08T05:33:46.282 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_level", 2024-05-08T05:33:46.282 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-08T05:33:46.282 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.282 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:46.282 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-05-08T05:33:46.282 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.282 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.282 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [ 2024-05-08T05:33:46.282 INFO:teuthology.orchestra.run.smithi087.stdout: "", 2024-05-08T05:33:46.282 INFO:teuthology.orchestra.run.smithi087.stdout: "critical", 2024-05-08T05:33:46.282 INFO:teuthology.orchestra.run.smithi087.stdout: "debug", 2024-05-08T05:33:46.283 INFO:teuthology.orchestra.run.smithi087.stdout: "error", 2024-05-08T05:33:46.283 INFO:teuthology.orchestra.run.smithi087.stdout: "info", 2024-05-08T05:33:46.283 INFO:teuthology.orchestra.run.smithi087.stdout: "warning" 2024-05-08T05:33:46.283 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-05-08T05:33:46.283 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:46.283 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.283 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.283 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.283 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.283 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_cluster": { 2024-05-08T05:33:46.283 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_cluster", 2024-05-08T05:33:46.283 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-08T05:33:46.283 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.283 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:46.283 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-05-08T05:33:46.284 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.284 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.284 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.284 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:46.284 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.284 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.284 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.284 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.284 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_cluster_level": { 2024-05-08T05:33:46.284 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_cluster_level", 2024-05-08T05:33:46.284 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-08T05:33:46.284 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.284 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:46.284 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "info", 2024-05-08T05:33:46.284 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.285 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.285 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [ 2024-05-08T05:33:46.285 INFO:teuthology.orchestra.run.smithi087.stdout: "", 2024-05-08T05:33:46.285 INFO:teuthology.orchestra.run.smithi087.stdout: "critical", 2024-05-08T05:33:46.285 INFO:teuthology.orchestra.run.smithi087.stdout: "debug", 2024-05-08T05:33:46.285 INFO:teuthology.orchestra.run.smithi087.stdout: "error", 2024-05-08T05:33:46.285 INFO:teuthology.orchestra.run.smithi087.stdout: "info", 2024-05-08T05:33:46.285 INFO:teuthology.orchestra.run.smithi087.stdout: "warning" 2024-05-08T05:33:46.285 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-05-08T05:33:46.285 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:46.285 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.285 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.285 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.285 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.285 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_file": { 2024-05-08T05:33:46.285 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_file", 2024-05-08T05:33:46.286 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-08T05:33:46.286 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.286 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:46.286 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-05-08T05:33:46.286 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.286 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.286 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.286 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:46.286 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.286 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.286 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.286 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.286 INFO:teuthology.orchestra.run.smithi087.stdout: "sqlite3_killpoint": { 2024-05-08T05:33:46.286 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "sqlite3_killpoint", 2024-05-08T05:33:46.286 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "int", 2024-05-08T05:33:46.287 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "dev", 2024-05-08T05:33:46.287 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:46.287 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "0", 2024-05-08T05:33:46.287 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.287 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.287 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.287 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:46.287 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.287 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.287 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.287 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-05-08T05:33:46.287 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-05-08T05:33:46.287 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.287 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-05-08T05:33:46.287 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "osd_support", 2024-05-08T05:33:46.288 INFO:teuthology.orchestra.run.smithi087.stdout: "can_run": true, 2024-05-08T05:33:46.288 INFO:teuthology.orchestra.run.smithi087.stdout: "error_string": "", 2024-05-08T05:33:46.288 INFO:teuthology.orchestra.run.smithi087.stdout: "module_options": { 2024-05-08T05:33:46.288 INFO:teuthology.orchestra.run.smithi087.stdout: "log_level": { 2024-05-08T05:33:46.288 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_level", 2024-05-08T05:33:46.288 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-08T05:33:46.288 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.288 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:46.288 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-05-08T05:33:46.288 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.288 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.288 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [ 2024-05-08T05:33:46.288 INFO:teuthology.orchestra.run.smithi087.stdout: "", 2024-05-08T05:33:46.288 INFO:teuthology.orchestra.run.smithi087.stdout: "critical", 2024-05-08T05:33:46.288 INFO:teuthology.orchestra.run.smithi087.stdout: "debug", 2024-05-08T05:33:46.288 INFO:teuthology.orchestra.run.smithi087.stdout: "error", 2024-05-08T05:33:46.289 INFO:teuthology.orchestra.run.smithi087.stdout: "info", 2024-05-08T05:33:46.289 INFO:teuthology.orchestra.run.smithi087.stdout: "warning" 2024-05-08T05:33:46.289 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-05-08T05:33:46.289 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:46.289 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.289 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.289 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.289 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.289 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_cluster": { 2024-05-08T05:33:46.289 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_cluster", 2024-05-08T05:33:46.289 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-08T05:33:46.289 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.289 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:46.290 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-05-08T05:33:46.290 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.290 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.290 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.290 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:46.290 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.290 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.290 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.290 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.290 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_cluster_level": { 2024-05-08T05:33:46.290 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_cluster_level", 2024-05-08T05:33:46.290 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-08T05:33:46.290 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.290 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:46.290 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "info", 2024-05-08T05:33:46.291 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.291 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.291 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [ 2024-05-08T05:33:46.291 INFO:teuthology.orchestra.run.smithi087.stdout: "", 2024-05-08T05:33:46.291 INFO:teuthology.orchestra.run.smithi087.stdout: "critical", 2024-05-08T05:33:46.291 INFO:teuthology.orchestra.run.smithi087.stdout: "debug", 2024-05-08T05:33:46.291 INFO:teuthology.orchestra.run.smithi087.stdout: "error", 2024-05-08T05:33:46.291 INFO:teuthology.orchestra.run.smithi087.stdout: "info", 2024-05-08T05:33:46.291 INFO:teuthology.orchestra.run.smithi087.stdout: "warning" 2024-05-08T05:33:46.291 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-05-08T05:33:46.291 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:46.291 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.291 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.291 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.291 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.292 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_file": { 2024-05-08T05:33:46.292 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_file", 2024-05-08T05:33:46.292 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-08T05:33:46.292 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.292 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:46.292 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-05-08T05:33:46.292 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.292 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.292 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.292 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:46.292 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.292 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.292 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.292 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.293 INFO:teuthology.orchestra.run.smithi087.stdout: "sqlite3_killpoint": { 2024-05-08T05:33:46.293 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "sqlite3_killpoint", 2024-05-08T05:33:46.293 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "int", 2024-05-08T05:33:46.293 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "dev", 2024-05-08T05:33:46.293 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:46.293 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "0", 2024-05-08T05:33:46.293 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.293 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.293 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.293 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:46.293 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.293 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.293 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.293 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-05-08T05:33:46.293 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-05-08T05:33:46.294 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.294 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-05-08T05:33:46.294 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "pg_autoscaler", 2024-05-08T05:33:46.294 INFO:teuthology.orchestra.run.smithi087.stdout: "can_run": true, 2024-05-08T05:33:46.294 INFO:teuthology.orchestra.run.smithi087.stdout: "error_string": "", 2024-05-08T05:33:46.294 INFO:teuthology.orchestra.run.smithi087.stdout: "module_options": { 2024-05-08T05:33:46.294 INFO:teuthology.orchestra.run.smithi087.stdout: "log_level": { 2024-05-08T05:33:46.294 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_level", 2024-05-08T05:33:46.294 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-08T05:33:46.294 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.294 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:46.294 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-05-08T05:33:46.294 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.294 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.295 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [ 2024-05-08T05:33:46.295 INFO:teuthology.orchestra.run.smithi087.stdout: "", 2024-05-08T05:33:46.295 INFO:teuthology.orchestra.run.smithi087.stdout: "critical", 2024-05-08T05:33:46.295 INFO:teuthology.orchestra.run.smithi087.stdout: "debug", 2024-05-08T05:33:46.295 INFO:teuthology.orchestra.run.smithi087.stdout: "error", 2024-05-08T05:33:46.295 INFO:teuthology.orchestra.run.smithi087.stdout: "info", 2024-05-08T05:33:46.295 INFO:teuthology.orchestra.run.smithi087.stdout: "warning" 2024-05-08T05:33:46.295 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-05-08T05:33:46.295 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:46.295 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.295 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.295 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.295 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.295 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_cluster": { 2024-05-08T05:33:46.295 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_cluster", 2024-05-08T05:33:46.296 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-08T05:33:46.296 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.296 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:46.296 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-05-08T05:33:46.296 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.296 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.296 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.296 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:46.296 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.296 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.296 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.296 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.296 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_cluster_level": { 2024-05-08T05:33:46.296 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_cluster_level", 2024-05-08T05:33:46.296 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-08T05:33:46.297 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.297 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:46.297 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "info", 2024-05-08T05:33:46.297 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.297 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.297 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [ 2024-05-08T05:33:46.297 INFO:teuthology.orchestra.run.smithi087.stdout: "", 2024-05-08T05:33:46.297 INFO:teuthology.orchestra.run.smithi087.stdout: "critical", 2024-05-08T05:33:46.297 INFO:teuthology.orchestra.run.smithi087.stdout: "debug", 2024-05-08T05:33:46.297 INFO:teuthology.orchestra.run.smithi087.stdout: "error", 2024-05-08T05:33:46.297 INFO:teuthology.orchestra.run.smithi087.stdout: "info", 2024-05-08T05:33:46.297 INFO:teuthology.orchestra.run.smithi087.stdout: "warning" 2024-05-08T05:33:46.297 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-05-08T05:33:46.297 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:46.297 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.297 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.298 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.298 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.298 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_file": { 2024-05-08T05:33:46.298 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_file", 2024-05-08T05:33:46.298 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-08T05:33:46.298 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.298 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:46.298 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-05-08T05:33:46.298 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.298 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.298 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.298 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:46.298 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.298 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.299 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.299 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.299 INFO:teuthology.orchestra.run.smithi087.stdout: "sleep_interval": { 2024-05-08T05:33:46.299 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "sleep_interval", 2024-05-08T05:33:46.299 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "secs", 2024-05-08T05:33:46.299 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.299 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-08T05:33:46.299 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "60", 2024-05-08T05:33:46.299 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.299 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.299 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.299 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:46.299 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.299 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.299 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.299 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.300 INFO:teuthology.orchestra.run.smithi087.stdout: "sqlite3_killpoint": { 2024-05-08T05:33:46.300 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "sqlite3_killpoint", 2024-05-08T05:33:46.300 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "int", 2024-05-08T05:33:46.300 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "dev", 2024-05-08T05:33:46.300 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:46.300 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "0", 2024-05-08T05:33:46.300 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.300 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.300 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.300 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:46.300 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.300 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.300 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.300 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.300 INFO:teuthology.orchestra.run.smithi087.stdout: "threshold": { 2024-05-08T05:33:46.301 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "threshold", 2024-05-08T05:33:46.301 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "float", 2024-05-08T05:33:46.301 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.301 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-08T05:33:46.301 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "3.0", 2024-05-08T05:33:46.301 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "1.0", 2024-05-08T05:33:46.301 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.301 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.301 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "scaling threshold", 2024-05-08T05:33:46.301 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2024-05-08T05:33:46.301 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.301 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.301 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-05-08T05:33:46.301 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-05-08T05:33:46.302 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.302 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-05-08T05:33:46.302 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "progress", 2024-05-08T05:33:46.302 INFO:teuthology.orchestra.run.smithi087.stdout: "can_run": true, 2024-05-08T05:33:46.302 INFO:teuthology.orchestra.run.smithi087.stdout: "error_string": "", 2024-05-08T05:33:46.302 INFO:teuthology.orchestra.run.smithi087.stdout: "module_options": { 2024-05-08T05:33:46.302 INFO:teuthology.orchestra.run.smithi087.stdout: "allow_pg_recovery_event": { 2024-05-08T05:33:46.302 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "allow_pg_recovery_event", 2024-05-08T05:33:46.302 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-08T05:33:46.302 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.302 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:46.302 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-05-08T05:33:46.302 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.302 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.303 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.303 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "allow the module to show pg recovery progress", 2024-05-08T05:33:46.303 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.303 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.303 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.303 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.303 INFO:teuthology.orchestra.run.smithi087.stdout: "enabled": { 2024-05-08T05:33:46.303 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "enabled", 2024-05-08T05:33:46.303 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-08T05:33:46.303 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.303 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-08T05:33:46.303 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "True", 2024-05-08T05:33:46.303 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.303 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.304 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.304 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:46.304 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.304 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.304 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.304 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.304 INFO:teuthology.orchestra.run.smithi087.stdout: "log_level": { 2024-05-08T05:33:46.304 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_level", 2024-05-08T05:33:46.304 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-08T05:33:46.304 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.304 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:46.304 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-05-08T05:33:46.304 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.304 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.304 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [ 2024-05-08T05:33:46.304 INFO:teuthology.orchestra.run.smithi087.stdout: "", 2024-05-08T05:33:46.305 INFO:teuthology.orchestra.run.smithi087.stdout: "critical", 2024-05-08T05:33:46.305 INFO:teuthology.orchestra.run.smithi087.stdout: "debug", 2024-05-08T05:33:46.305 INFO:teuthology.orchestra.run.smithi087.stdout: "error", 2024-05-08T05:33:46.305 INFO:teuthology.orchestra.run.smithi087.stdout: "info", 2024-05-08T05:33:46.305 INFO:teuthology.orchestra.run.smithi087.stdout: "warning" 2024-05-08T05:33:46.305 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-05-08T05:33:46.305 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:46.305 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.305 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.305 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.305 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.305 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_cluster": { 2024-05-08T05:33:46.305 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_cluster", 2024-05-08T05:33:46.305 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-08T05:33:46.305 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.306 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:46.306 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-05-08T05:33:46.306 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.306 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.306 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.306 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:46.306 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.306 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.306 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.306 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.306 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_cluster_level": { 2024-05-08T05:33:46.306 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_cluster_level", 2024-05-08T05:33:46.306 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-08T05:33:46.306 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.307 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:46.307 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "info", 2024-05-08T05:33:46.307 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.307 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.307 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [ 2024-05-08T05:33:46.307 INFO:teuthology.orchestra.run.smithi087.stdout: "", 2024-05-08T05:33:46.307 INFO:teuthology.orchestra.run.smithi087.stdout: "critical", 2024-05-08T05:33:46.307 INFO:teuthology.orchestra.run.smithi087.stdout: "debug", 2024-05-08T05:33:46.307 INFO:teuthology.orchestra.run.smithi087.stdout: "error", 2024-05-08T05:33:46.307 INFO:teuthology.orchestra.run.smithi087.stdout: "info", 2024-05-08T05:33:46.307 INFO:teuthology.orchestra.run.smithi087.stdout: "warning" 2024-05-08T05:33:46.307 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-05-08T05:33:46.307 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:46.307 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.307 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.307 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.308 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.308 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_file": { 2024-05-08T05:33:46.308 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_file", 2024-05-08T05:33:46.308 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-08T05:33:46.308 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.308 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:46.308 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-05-08T05:33:46.308 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.308 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.308 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.308 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:46.308 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.308 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.308 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.308 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.309 INFO:teuthology.orchestra.run.smithi087.stdout: "max_completed_events": { 2024-05-08T05:33:46.309 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "max_completed_events", 2024-05-08T05:33:46.309 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "int", 2024-05-08T05:33:46.309 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.309 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:46.309 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "50", 2024-05-08T05:33:46.309 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.309 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.309 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.309 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "number of past completed events to remember", 2024-05-08T05:33:46.309 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.309 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.309 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.309 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.309 INFO:teuthology.orchestra.run.smithi087.stdout: "sleep_interval": { 2024-05-08T05:33:46.310 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "sleep_interval", 2024-05-08T05:33:46.310 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "secs", 2024-05-08T05:33:46.310 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.310 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:46.310 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "5", 2024-05-08T05:33:46.310 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.310 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.310 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.310 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "how long the module is going to sleep", 2024-05-08T05:33:46.310 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.310 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.310 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.310 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.310 INFO:teuthology.orchestra.run.smithi087.stdout: "sqlite3_killpoint": { 2024-05-08T05:33:46.310 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "sqlite3_killpoint", 2024-05-08T05:33:46.311 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "int", 2024-05-08T05:33:46.311 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "dev", 2024-05-08T05:33:46.311 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:46.311 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "0", 2024-05-08T05:33:46.311 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.311 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.311 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.311 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:46.311 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.311 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.311 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.311 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-05-08T05:33:46.311 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-05-08T05:33:46.311 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.312 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-05-08T05:33:46.312 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "prometheus", 2024-05-08T05:33:46.312 INFO:teuthology.orchestra.run.smithi087.stdout: "can_run": true, 2024-05-08T05:33:46.312 INFO:teuthology.orchestra.run.smithi087.stdout: "error_string": "", 2024-05-08T05:33:46.312 INFO:teuthology.orchestra.run.smithi087.stdout: "module_options": { 2024-05-08T05:33:46.312 INFO:teuthology.orchestra.run.smithi087.stdout: "cache": { 2024-05-08T05:33:46.312 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "cache", 2024-05-08T05:33:46.312 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-08T05:33:46.312 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.312 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-08T05:33:46.312 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "True", 2024-05-08T05:33:46.312 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.312 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.312 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.312 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:46.313 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.313 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.313 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.313 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.313 INFO:teuthology.orchestra.run.smithi087.stdout: "exclude_perf_counters": { 2024-05-08T05:33:46.313 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "exclude_perf_counters", 2024-05-08T05:33:46.313 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-08T05:33:46.313 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.313 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:46.313 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "True", 2024-05-08T05:33:46.313 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.313 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.313 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.313 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "Do not include perf-counters in the metrics output", 2024-05-08T05:33:46.313 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2024-05-08T05:33:46.314 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.314 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.314 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.314 INFO:teuthology.orchestra.run.smithi087.stdout: "log_level": { 2024-05-08T05:33:46.314 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_level", 2024-05-08T05:33:46.314 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-08T05:33:46.314 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.314 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:46.314 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-05-08T05:33:46.314 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.314 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.314 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [ 2024-05-08T05:33:46.314 INFO:teuthology.orchestra.run.smithi087.stdout: "", 2024-05-08T05:33:46.315 INFO:teuthology.orchestra.run.smithi087.stdout: "critical", 2024-05-08T05:33:46.315 INFO:teuthology.orchestra.run.smithi087.stdout: "debug", 2024-05-08T05:33:46.315 INFO:teuthology.orchestra.run.smithi087.stdout: "error", 2024-05-08T05:33:46.315 INFO:teuthology.orchestra.run.smithi087.stdout: "info", 2024-05-08T05:33:46.315 INFO:teuthology.orchestra.run.smithi087.stdout: "warning" 2024-05-08T05:33:46.315 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-05-08T05:33:46.315 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:46.315 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.315 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.315 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.316 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.316 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_cluster": { 2024-05-08T05:33:46.316 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_cluster", 2024-05-08T05:33:46.316 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-08T05:33:46.316 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.316 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:46.316 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-05-08T05:33:46.316 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.316 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.316 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.316 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:46.316 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.316 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.316 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.316 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.317 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_cluster_level": { 2024-05-08T05:33:46.317 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_cluster_level", 2024-05-08T05:33:46.317 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-08T05:33:46.317 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.317 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:46.317 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "info", 2024-05-08T05:33:46.317 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.317 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.317 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [ 2024-05-08T05:33:46.317 INFO:teuthology.orchestra.run.smithi087.stdout: "", 2024-05-08T05:33:46.317 INFO:teuthology.orchestra.run.smithi087.stdout: "critical", 2024-05-08T05:33:46.317 INFO:teuthology.orchestra.run.smithi087.stdout: "debug", 2024-05-08T05:33:46.317 INFO:teuthology.orchestra.run.smithi087.stdout: "error", 2024-05-08T05:33:46.317 INFO:teuthology.orchestra.run.smithi087.stdout: "info", 2024-05-08T05:33:46.317 INFO:teuthology.orchestra.run.smithi087.stdout: "warning" 2024-05-08T05:33:46.318 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-05-08T05:33:46.318 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:46.318 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.318 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.318 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.318 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.318 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_file": { 2024-05-08T05:33:46.318 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_file", 2024-05-08T05:33:46.318 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-08T05:33:46.318 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.318 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:46.318 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-05-08T05:33:46.318 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.318 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.319 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.319 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:46.319 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.319 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.319 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.319 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.319 INFO:teuthology.orchestra.run.smithi087.stdout: "rbd_stats_pools": { 2024-05-08T05:33:46.319 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "rbd_stats_pools", 2024-05-08T05:33:46.319 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-08T05:33:46.319 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.319 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-08T05:33:46.319 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-05-08T05:33:46.319 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.319 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.320 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.320 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:46.320 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.320 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.320 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.320 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.320 INFO:teuthology.orchestra.run.smithi087.stdout: "rbd_stats_pools_refresh_interval": { 2024-05-08T05:33:46.320 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "rbd_stats_pools_refresh_interval", 2024-05-08T05:33:46.320 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "int", 2024-05-08T05:33:46.320 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.320 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-08T05:33:46.320 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "300", 2024-05-08T05:33:46.320 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.320 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.320 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.321 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:46.321 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.321 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.321 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.321 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.321 INFO:teuthology.orchestra.run.smithi087.stdout: "scrape_interval": { 2024-05-08T05:33:46.321 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "scrape_interval", 2024-05-08T05:33:46.321 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "float", 2024-05-08T05:33:46.321 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.321 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-08T05:33:46.321 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "15.0", 2024-05-08T05:33:46.321 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.321 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.321 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.322 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:46.322 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.322 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.322 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.322 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.322 INFO:teuthology.orchestra.run.smithi087.stdout: "server_addr": { 2024-05-08T05:33:46.322 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "server_addr", 2024-05-08T05:33:46.322 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-08T05:33:46.322 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.322 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-08T05:33:46.322 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "::", 2024-05-08T05:33:46.322 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.322 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.322 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.323 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2024-05-08T05:33:46.323 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.323 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.323 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.323 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.323 INFO:teuthology.orchestra.run.smithi087.stdout: "server_port": { 2024-05-08T05:33:46.323 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "server_port", 2024-05-08T05:33:46.323 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "int", 2024-05-08T05:33:46.323 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.323 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:46.323 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "9283", 2024-05-08T05:33:46.323 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.323 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.323 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.323 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "the port on which the module listens for HTTP requests", 2024-05-08T05:33:46.324 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.324 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.324 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.324 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.324 INFO:teuthology.orchestra.run.smithi087.stdout: "sqlite3_killpoint": { 2024-05-08T05:33:46.324 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "sqlite3_killpoint", 2024-05-08T05:33:46.324 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "int", 2024-05-08T05:33:46.324 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "dev", 2024-05-08T05:33:46.324 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:46.324 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "0", 2024-05-08T05:33:46.324 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.324 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.324 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.324 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:46.324 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.325 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.325 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.325 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.325 INFO:teuthology.orchestra.run.smithi087.stdout: "stale_cache_strategy": { 2024-05-08T05:33:46.325 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "stale_cache_strategy", 2024-05-08T05:33:46.325 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-08T05:33:46.325 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.325 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-08T05:33:46.325 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "log", 2024-05-08T05:33:46.325 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.325 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.325 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.325 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:46.325 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.325 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.326 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.326 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.326 INFO:teuthology.orchestra.run.smithi087.stdout: "standby_behaviour": { 2024-05-08T05:33:46.326 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "standby_behaviour", 2024-05-08T05:33:46.326 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-08T05:33:46.326 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.326 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:46.326 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "default", 2024-05-08T05:33:46.326 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.326 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.326 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [ 2024-05-08T05:33:46.326 INFO:teuthology.orchestra.run.smithi087.stdout: "default", 2024-05-08T05:33:46.326 INFO:teuthology.orchestra.run.smithi087.stdout: "error" 2024-05-08T05:33:46.326 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-05-08T05:33:46.326 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:46.327 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.327 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.327 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.327 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.327 INFO:teuthology.orchestra.run.smithi087.stdout: "standby_error_status_code": { 2024-05-08T05:33:46.327 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "standby_error_status_code", 2024-05-08T05:33:46.327 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "int", 2024-05-08T05:33:46.327 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.327 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:46.327 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "500", 2024-05-08T05:33:46.327 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "400", 2024-05-08T05:33:46.327 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "599", 2024-05-08T05:33:46.327 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.327 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:46.327 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.328 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.328 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.328 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-05-08T05:33:46.328 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-05-08T05:33:46.328 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.328 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-05-08T05:33:46.328 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "rbd_support", 2024-05-08T05:33:46.328 INFO:teuthology.orchestra.run.smithi087.stdout: "can_run": true, 2024-05-08T05:33:46.328 INFO:teuthology.orchestra.run.smithi087.stdout: "error_string": "", 2024-05-08T05:33:46.328 INFO:teuthology.orchestra.run.smithi087.stdout: "module_options": { 2024-05-08T05:33:46.328 INFO:teuthology.orchestra.run.smithi087.stdout: "log_level": { 2024-05-08T05:33:46.328 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_level", 2024-05-08T05:33:46.328 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-08T05:33:46.328 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.329 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:46.329 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-05-08T05:33:46.329 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.329 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.329 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [ 2024-05-08T05:33:46.329 INFO:teuthology.orchestra.run.smithi087.stdout: "", 2024-05-08T05:33:46.329 INFO:teuthology.orchestra.run.smithi087.stdout: "critical", 2024-05-08T05:33:46.329 INFO:teuthology.orchestra.run.smithi087.stdout: "debug", 2024-05-08T05:33:46.329 INFO:teuthology.orchestra.run.smithi087.stdout: "error", 2024-05-08T05:33:46.329 INFO:teuthology.orchestra.run.smithi087.stdout: "info", 2024-05-08T05:33:46.329 INFO:teuthology.orchestra.run.smithi087.stdout: "warning" 2024-05-08T05:33:46.329 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-05-08T05:33:46.329 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:46.329 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.330 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.330 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.330 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.330 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_cluster": { 2024-05-08T05:33:46.330 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_cluster", 2024-05-08T05:33:46.330 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-08T05:33:46.330 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.330 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:46.330 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-05-08T05:33:46.330 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.330 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.330 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.330 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:46.330 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.330 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.331 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.331 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.331 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_cluster_level": { 2024-05-08T05:33:46.331 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_cluster_level", 2024-05-08T05:33:46.331 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-08T05:33:46.331 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.331 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:46.331 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "info", 2024-05-08T05:33:46.331 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.331 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.331 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [ 2024-05-08T05:33:46.331 INFO:teuthology.orchestra.run.smithi087.stdout: "", 2024-05-08T05:33:46.331 INFO:teuthology.orchestra.run.smithi087.stdout: "critical", 2024-05-08T05:33:46.331 INFO:teuthology.orchestra.run.smithi087.stdout: "debug", 2024-05-08T05:33:46.332 INFO:teuthology.orchestra.run.smithi087.stdout: "error", 2024-05-08T05:33:46.332 INFO:teuthology.orchestra.run.smithi087.stdout: "info", 2024-05-08T05:33:46.332 INFO:teuthology.orchestra.run.smithi087.stdout: "warning" 2024-05-08T05:33:46.332 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-05-08T05:33:46.332 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:46.332 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.332 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.332 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.332 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.332 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_file": { 2024-05-08T05:33:46.332 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_file", 2024-05-08T05:33:46.332 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-08T05:33:46.332 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.332 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:46.332 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-05-08T05:33:46.332 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.333 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.333 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.333 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:46.333 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.333 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.333 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.333 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.333 INFO:teuthology.orchestra.run.smithi087.stdout: "max_concurrent_snap_create": { 2024-05-08T05:33:46.333 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "max_concurrent_snap_create", 2024-05-08T05:33:46.333 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "int", 2024-05-08T05:33:46.333 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.333 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-08T05:33:46.333 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "10", 2024-05-08T05:33:46.333 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.333 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.334 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.334 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:46.334 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.334 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.334 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.334 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.334 INFO:teuthology.orchestra.run.smithi087.stdout: "mirror_snapshot_schedule": { 2024-05-08T05:33:46.334 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "mirror_snapshot_schedule", 2024-05-08T05:33:46.334 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-08T05:33:46.334 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.334 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-08T05:33:46.334 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-05-08T05:33:46.334 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.334 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.335 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.335 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:46.335 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.335 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.335 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.335 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.335 INFO:teuthology.orchestra.run.smithi087.stdout: "sqlite3_killpoint": { 2024-05-08T05:33:46.335 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "sqlite3_killpoint", 2024-05-08T05:33:46.335 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "int", 2024-05-08T05:33:46.335 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "dev", 2024-05-08T05:33:46.335 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:46.335 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "0", 2024-05-08T05:33:46.335 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.335 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.335 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.336 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:46.336 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.336 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.336 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.336 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.336 INFO:teuthology.orchestra.run.smithi087.stdout: "trash_purge_schedule": { 2024-05-08T05:33:46.336 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "trash_purge_schedule", 2024-05-08T05:33:46.336 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-08T05:33:46.336 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.336 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-08T05:33:46.336 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-05-08T05:33:46.336 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.336 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.336 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.336 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:46.336 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.337 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.337 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.337 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-05-08T05:33:46.337 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-05-08T05:33:46.337 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.337 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-05-08T05:33:46.337 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "restful", 2024-05-08T05:33:46.337 INFO:teuthology.orchestra.run.smithi087.stdout: "can_run": true, 2024-05-08T05:33:46.337 INFO:teuthology.orchestra.run.smithi087.stdout: "error_string": "", 2024-05-08T05:33:46.337 INFO:teuthology.orchestra.run.smithi087.stdout: "module_options": { 2024-05-08T05:33:46.337 INFO:teuthology.orchestra.run.smithi087.stdout: "enable_auth": { 2024-05-08T05:33:46.337 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "enable_auth", 2024-05-08T05:33:46.337 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-08T05:33:46.337 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.337 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-08T05:33:46.338 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "True", 2024-05-08T05:33:46.338 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.338 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.338 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.338 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:46.338 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.338 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.338 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.338 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.338 INFO:teuthology.orchestra.run.smithi087.stdout: "key_file": { 2024-05-08T05:33:46.338 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "key_file", 2024-05-08T05:33:46.338 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-08T05:33:46.338 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.338 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-08T05:33:46.339 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-05-08T05:33:46.339 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.339 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.339 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.339 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:46.339 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.339 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.339 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.339 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.339 INFO:teuthology.orchestra.run.smithi087.stdout: "log_level": { 2024-05-08T05:33:46.339 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_level", 2024-05-08T05:33:46.339 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-08T05:33:46.339 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.339 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:46.340 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-05-08T05:33:46.340 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.340 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.340 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [ 2024-05-08T05:33:46.340 INFO:teuthology.orchestra.run.smithi087.stdout: "", 2024-05-08T05:33:46.340 INFO:teuthology.orchestra.run.smithi087.stdout: "critical", 2024-05-08T05:33:46.340 INFO:teuthology.orchestra.run.smithi087.stdout: "debug", 2024-05-08T05:33:46.340 INFO:teuthology.orchestra.run.smithi087.stdout: "error", 2024-05-08T05:33:46.340 INFO:teuthology.orchestra.run.smithi087.stdout: "info", 2024-05-08T05:33:46.340 INFO:teuthology.orchestra.run.smithi087.stdout: "warning" 2024-05-08T05:33:46.340 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-05-08T05:33:46.340 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:46.340 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.340 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.340 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.341 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.341 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_cluster": { 2024-05-08T05:33:46.341 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_cluster", 2024-05-08T05:33:46.341 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-08T05:33:46.341 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.341 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:46.341 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-05-08T05:33:46.341 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.341 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.341 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.341 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:46.341 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.341 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.342 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.342 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.342 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_cluster_level": { 2024-05-08T05:33:46.342 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_cluster_level", 2024-05-08T05:33:46.342 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-08T05:33:46.342 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.342 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:46.342 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "info", 2024-05-08T05:33:46.342 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.342 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.342 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [ 2024-05-08T05:33:46.342 INFO:teuthology.orchestra.run.smithi087.stdout: "", 2024-05-08T05:33:46.342 INFO:teuthology.orchestra.run.smithi087.stdout: "critical", 2024-05-08T05:33:46.342 INFO:teuthology.orchestra.run.smithi087.stdout: "debug", 2024-05-08T05:33:46.343 INFO:teuthology.orchestra.run.smithi087.stdout: "error", 2024-05-08T05:33:46.343 INFO:teuthology.orchestra.run.smithi087.stdout: "info", 2024-05-08T05:33:46.343 INFO:teuthology.orchestra.run.smithi087.stdout: "warning" 2024-05-08T05:33:46.343 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-05-08T05:33:46.343 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:46.343 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.343 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.343 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.343 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.343 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_file": { 2024-05-08T05:33:46.343 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_file", 2024-05-08T05:33:46.343 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-08T05:33:46.343 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.343 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:46.344 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-05-08T05:33:46.344 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.344 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.344 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.344 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:46.344 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.344 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.344 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.344 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.344 INFO:teuthology.orchestra.run.smithi087.stdout: "server_addr": { 2024-05-08T05:33:46.344 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "server_addr", 2024-05-08T05:33:46.344 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-08T05:33:46.344 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.344 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-08T05:33:46.344 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-05-08T05:33:46.345 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.345 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.345 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.345 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:46.345 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.345 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.345 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.345 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.345 INFO:teuthology.orchestra.run.smithi087.stdout: "server_port": { 2024-05-08T05:33:46.345 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "server_port", 2024-05-08T05:33:46.345 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-08T05:33:46.345 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.345 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-08T05:33:46.345 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-05-08T05:33:46.346 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.346 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.346 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.346 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:46.346 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.346 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.346 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.346 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.346 INFO:teuthology.orchestra.run.smithi087.stdout: "sqlite3_killpoint": { 2024-05-08T05:33:46.346 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "sqlite3_killpoint", 2024-05-08T05:33:46.346 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "int", 2024-05-08T05:33:46.346 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "dev", 2024-05-08T05:33:46.346 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:46.346 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "0", 2024-05-08T05:33:46.347 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.347 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.347 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.347 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:46.347 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.347 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.347 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.347 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-05-08T05:33:46.347 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-05-08T05:33:46.347 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.347 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-05-08T05:33:46.347 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "rgw", 2024-05-08T05:33:46.347 INFO:teuthology.orchestra.run.smithi087.stdout: "can_run": true, 2024-05-08T05:33:46.347 INFO:teuthology.orchestra.run.smithi087.stdout: "error_string": "", 2024-05-08T05:33:46.348 INFO:teuthology.orchestra.run.smithi087.stdout: "module_options": { 2024-05-08T05:33:46.348 INFO:teuthology.orchestra.run.smithi087.stdout: "log_level": { 2024-05-08T05:33:46.348 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_level", 2024-05-08T05:33:46.348 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-08T05:33:46.348 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.348 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:46.348 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-05-08T05:33:46.348 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.348 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.348 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [ 2024-05-08T05:33:46.348 INFO:teuthology.orchestra.run.smithi087.stdout: "", 2024-05-08T05:33:46.348 INFO:teuthology.orchestra.run.smithi087.stdout: "critical", 2024-05-08T05:33:46.348 INFO:teuthology.orchestra.run.smithi087.stdout: "debug", 2024-05-08T05:33:46.348 INFO:teuthology.orchestra.run.smithi087.stdout: "error", 2024-05-08T05:33:46.348 INFO:teuthology.orchestra.run.smithi087.stdout: "info", 2024-05-08T05:33:46.349 INFO:teuthology.orchestra.run.smithi087.stdout: "warning" 2024-05-08T05:33:46.349 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-05-08T05:33:46.349 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:46.349 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.349 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.349 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.349 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.349 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_cluster": { 2024-05-08T05:33:46.349 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_cluster", 2024-05-08T05:33:46.349 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-08T05:33:46.349 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.349 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:46.349 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-05-08T05:33:46.349 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.349 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.350 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.350 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:46.350 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.350 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.350 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.350 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.350 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_cluster_level": { 2024-05-08T05:33:46.350 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_cluster_level", 2024-05-08T05:33:46.350 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-08T05:33:46.350 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.350 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:46.350 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "info", 2024-05-08T05:33:46.350 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.350 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.350 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [ 2024-05-08T05:33:46.351 INFO:teuthology.orchestra.run.smithi087.stdout: "", 2024-05-08T05:33:46.351 INFO:teuthology.orchestra.run.smithi087.stdout: "critical", 2024-05-08T05:33:46.351 INFO:teuthology.orchestra.run.smithi087.stdout: "debug", 2024-05-08T05:33:46.351 INFO:teuthology.orchestra.run.smithi087.stdout: "error", 2024-05-08T05:33:46.351 INFO:teuthology.orchestra.run.smithi087.stdout: "info", 2024-05-08T05:33:46.351 INFO:teuthology.orchestra.run.smithi087.stdout: "warning" 2024-05-08T05:33:46.351 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-05-08T05:33:46.351 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:46.351 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.351 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.351 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.351 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.351 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_file": { 2024-05-08T05:33:46.351 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_file", 2024-05-08T05:33:46.351 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-08T05:33:46.352 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.352 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:46.352 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-05-08T05:33:46.352 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.352 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.352 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.352 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:46.352 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.352 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.352 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.352 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.352 INFO:teuthology.orchestra.run.smithi087.stdout: "sqlite3_killpoint": { 2024-05-08T05:33:46.352 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "sqlite3_killpoint", 2024-05-08T05:33:46.352 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "int", 2024-05-08T05:33:46.353 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "dev", 2024-05-08T05:33:46.353 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:46.353 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "0", 2024-05-08T05:33:46.353 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.353 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.353 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.353 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:46.353 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.353 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.353 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.353 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-05-08T05:33:46.353 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-05-08T05:33:46.353 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.353 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-05-08T05:33:46.353 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "rook", 2024-05-08T05:33:46.354 INFO:teuthology.orchestra.run.smithi087.stdout: "can_run": true, 2024-05-08T05:33:46.354 INFO:teuthology.orchestra.run.smithi087.stdout: "error_string": "", 2024-05-08T05:33:46.354 INFO:teuthology.orchestra.run.smithi087.stdout: "module_options": { 2024-05-08T05:33:46.354 INFO:teuthology.orchestra.run.smithi087.stdout: "log_level": { 2024-05-08T05:33:46.354 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_level", 2024-05-08T05:33:46.354 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-08T05:33:46.354 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.354 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:46.354 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-05-08T05:33:46.354 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.354 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.354 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [ 2024-05-08T05:33:46.354 INFO:teuthology.orchestra.run.smithi087.stdout: "", 2024-05-08T05:33:46.354 INFO:teuthology.orchestra.run.smithi087.stdout: "critical", 2024-05-08T05:33:46.354 INFO:teuthology.orchestra.run.smithi087.stdout: "debug", 2024-05-08T05:33:46.355 INFO:teuthology.orchestra.run.smithi087.stdout: "error", 2024-05-08T05:33:46.355 INFO:teuthology.orchestra.run.smithi087.stdout: "info", 2024-05-08T05:33:46.355 INFO:teuthology.orchestra.run.smithi087.stdout: "warning" 2024-05-08T05:33:46.355 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-05-08T05:33:46.355 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:46.355 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.355 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.355 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.355 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.355 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_cluster": { 2024-05-08T05:33:46.355 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_cluster", 2024-05-08T05:33:46.355 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-08T05:33:46.355 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.356 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:46.356 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-05-08T05:33:46.356 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.356 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.356 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.356 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:46.356 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.356 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.356 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.356 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.356 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_cluster_level": { 2024-05-08T05:33:46.356 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_cluster_level", 2024-05-08T05:33:46.356 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-08T05:33:46.356 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.357 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:46.357 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "info", 2024-05-08T05:33:46.357 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.357 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.357 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [ 2024-05-08T05:33:46.357 INFO:teuthology.orchestra.run.smithi087.stdout: "", 2024-05-08T05:33:46.357 INFO:teuthology.orchestra.run.smithi087.stdout: "critical", 2024-05-08T05:33:46.357 INFO:teuthology.orchestra.run.smithi087.stdout: "debug", 2024-05-08T05:33:46.357 INFO:teuthology.orchestra.run.smithi087.stdout: "error", 2024-05-08T05:33:46.357 INFO:teuthology.orchestra.run.smithi087.stdout: "info", 2024-05-08T05:33:46.357 INFO:teuthology.orchestra.run.smithi087.stdout: "warning" 2024-05-08T05:33:46.357 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-05-08T05:33:46.357 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:46.357 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.358 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.358 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.358 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.358 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_file": { 2024-05-08T05:33:46.358 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_file", 2024-05-08T05:33:46.358 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-08T05:33:46.358 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.358 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:46.358 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-05-08T05:33:46.358 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.358 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.358 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.358 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:46.358 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.359 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.359 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.359 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.359 INFO:teuthology.orchestra.run.smithi087.stdout: "sqlite3_killpoint": { 2024-05-08T05:33:46.359 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "sqlite3_killpoint", 2024-05-08T05:33:46.359 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "int", 2024-05-08T05:33:46.359 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "dev", 2024-05-08T05:33:46.359 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:46.359 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "0", 2024-05-08T05:33:46.359 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.359 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.359 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.359 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:46.359 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.359 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.360 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.360 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.360 INFO:teuthology.orchestra.run.smithi087.stdout: "storage_class": { 2024-05-08T05:33:46.360 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "storage_class", 2024-05-08T05:33:46.360 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-08T05:33:46.360 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.360 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-08T05:33:46.360 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "local", 2024-05-08T05:33:46.360 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.360 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.360 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.360 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "storage class name for LSO-discovered PVs", 2024-05-08T05:33:46.360 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.360 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.360 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.361 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-05-08T05:33:46.361 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-05-08T05:33:46.361 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.361 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-05-08T05:33:46.361 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "selftest", 2024-05-08T05:33:46.361 INFO:teuthology.orchestra.run.smithi087.stdout: "can_run": true, 2024-05-08T05:33:46.361 INFO:teuthology.orchestra.run.smithi087.stdout: "error_string": "", 2024-05-08T05:33:46.361 INFO:teuthology.orchestra.run.smithi087.stdout: "module_options": { 2024-05-08T05:33:46.361 INFO:teuthology.orchestra.run.smithi087.stdout: "log_level": { 2024-05-08T05:33:46.361 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_level", 2024-05-08T05:33:46.361 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-08T05:33:46.361 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.361 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:46.361 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-05-08T05:33:46.362 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.362 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.362 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [ 2024-05-08T05:33:46.362 INFO:teuthology.orchestra.run.smithi087.stdout: "", 2024-05-08T05:33:46.362 INFO:teuthology.orchestra.run.smithi087.stdout: "critical", 2024-05-08T05:33:46.362 INFO:teuthology.orchestra.run.smithi087.stdout: "debug", 2024-05-08T05:33:46.362 INFO:teuthology.orchestra.run.smithi087.stdout: "error", 2024-05-08T05:33:46.362 INFO:teuthology.orchestra.run.smithi087.stdout: "info", 2024-05-08T05:33:46.362 INFO:teuthology.orchestra.run.smithi087.stdout: "warning" 2024-05-08T05:33:46.362 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-05-08T05:33:46.362 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:46.362 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.362 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.362 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.362 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.363 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_cluster": { 2024-05-08T05:33:46.363 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_cluster", 2024-05-08T05:33:46.363 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-08T05:33:46.363 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.363 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:46.363 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-05-08T05:33:46.363 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.363 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.363 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.363 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:46.363 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.363 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.363 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.363 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.363 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_cluster_level": { 2024-05-08T05:33:46.364 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_cluster_level", 2024-05-08T05:33:46.364 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-08T05:33:46.364 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.364 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:46.364 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "info", 2024-05-08T05:33:46.364 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.364 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.364 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [ 2024-05-08T05:33:46.364 INFO:teuthology.orchestra.run.smithi087.stdout: "", 2024-05-08T05:33:46.364 INFO:teuthology.orchestra.run.smithi087.stdout: "critical", 2024-05-08T05:33:46.364 INFO:teuthology.orchestra.run.smithi087.stdout: "debug", 2024-05-08T05:33:46.364 INFO:teuthology.orchestra.run.smithi087.stdout: "error", 2024-05-08T05:33:46.364 INFO:teuthology.orchestra.run.smithi087.stdout: "info", 2024-05-08T05:33:46.364 INFO:teuthology.orchestra.run.smithi087.stdout: "warning" 2024-05-08T05:33:46.364 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-05-08T05:33:46.365 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:46.365 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.365 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.365 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.365 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.365 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_file": { 2024-05-08T05:33:46.365 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_file", 2024-05-08T05:33:46.365 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-08T05:33:46.365 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.365 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:46.365 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-05-08T05:33:46.365 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.365 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.365 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.365 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:46.365 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.366 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.366 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.366 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.366 INFO:teuthology.orchestra.run.smithi087.stdout: "roption1": { 2024-05-08T05:33:46.366 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "roption1", 2024-05-08T05:33:46.366 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-08T05:33:46.366 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.366 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-08T05:33:46.366 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-05-08T05:33:46.366 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.366 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.366 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.366 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:46.366 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.366 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.367 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.367 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.367 INFO:teuthology.orchestra.run.smithi087.stdout: "roption2": { 2024-05-08T05:33:46.367 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "roption2", 2024-05-08T05:33:46.367 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-08T05:33:46.367 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.367 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-08T05:33:46.367 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "xyz", 2024-05-08T05:33:46.367 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.367 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.367 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.367 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:46.367 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.367 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.367 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.368 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.368 INFO:teuthology.orchestra.run.smithi087.stdout: "rwoption1": { 2024-05-08T05:33:46.368 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "rwoption1", 2024-05-08T05:33:46.368 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-08T05:33:46.368 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.368 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-08T05:33:46.368 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-05-08T05:33:46.368 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.368 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.368 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.368 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:46.368 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.368 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.369 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.369 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.369 INFO:teuthology.orchestra.run.smithi087.stdout: "rwoption2": { 2024-05-08T05:33:46.369 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "rwoption2", 2024-05-08T05:33:46.369 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "int", 2024-05-08T05:33:46.369 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.369 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-08T05:33:46.369 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-05-08T05:33:46.369 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.369 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.369 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.369 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:46.369 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.369 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.369 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.370 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.370 INFO:teuthology.orchestra.run.smithi087.stdout: "rwoption3": { 2024-05-08T05:33:46.370 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "rwoption3", 2024-05-08T05:33:46.370 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "float", 2024-05-08T05:33:46.370 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.370 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-08T05:33:46.370 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-05-08T05:33:46.370 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.370 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.370 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.370 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:46.370 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.370 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.370 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.370 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.371 INFO:teuthology.orchestra.run.smithi087.stdout: "rwoption4": { 2024-05-08T05:33:46.371 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "rwoption4", 2024-05-08T05:33:46.371 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-08T05:33:46.371 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.371 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-08T05:33:46.371 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-05-08T05:33:46.371 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.371 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.371 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.371 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:46.371 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.371 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.371 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.371 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.372 INFO:teuthology.orchestra.run.smithi087.stdout: "rwoption5": { 2024-05-08T05:33:46.372 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "rwoption5", 2024-05-08T05:33:46.372 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-08T05:33:46.372 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.372 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-08T05:33:46.372 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-05-08T05:33:46.372 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.372 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.372 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.372 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:46.372 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.372 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.372 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.372 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.372 INFO:teuthology.orchestra.run.smithi087.stdout: "rwoption6": { 2024-05-08T05:33:46.372 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "rwoption6", 2024-05-08T05:33:46.373 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-08T05:33:46.373 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.373 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-08T05:33:46.373 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "True", 2024-05-08T05:33:46.373 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.373 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.373 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.373 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:46.373 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.373 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.373 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.373 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.373 INFO:teuthology.orchestra.run.smithi087.stdout: "rwoption7": { 2024-05-08T05:33:46.373 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "rwoption7", 2024-05-08T05:33:46.374 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "int", 2024-05-08T05:33:46.374 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.374 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-08T05:33:46.374 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-05-08T05:33:46.374 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "1", 2024-05-08T05:33:46.374 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "42", 2024-05-08T05:33:46.374 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.374 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:46.374 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.374 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.374 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.374 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.374 INFO:teuthology.orchestra.run.smithi087.stdout: "sqlite3_killpoint": { 2024-05-08T05:33:46.374 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "sqlite3_killpoint", 2024-05-08T05:33:46.374 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "int", 2024-05-08T05:33:46.375 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "dev", 2024-05-08T05:33:46.375 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:46.375 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "0", 2024-05-08T05:33:46.375 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.375 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.375 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.375 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:46.375 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.375 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.375 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.375 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.375 INFO:teuthology.orchestra.run.smithi087.stdout: "testkey": { 2024-05-08T05:33:46.375 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "testkey", 2024-05-08T05:33:46.375 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-08T05:33:46.375 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.376 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-08T05:33:46.376 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-05-08T05:33:46.376 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.376 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.376 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.376 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:46.376 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.376 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.376 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.376 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.376 INFO:teuthology.orchestra.run.smithi087.stdout: "testlkey": { 2024-05-08T05:33:46.376 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "testlkey", 2024-05-08T05:33:46.376 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-08T05:33:46.376 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.376 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-08T05:33:46.377 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-05-08T05:33:46.377 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.377 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.377 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.377 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:46.377 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.377 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.377 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.377 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.377 INFO:teuthology.orchestra.run.smithi087.stdout: "testnewline": { 2024-05-08T05:33:46.377 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "testnewline", 2024-05-08T05:33:46.377 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-08T05:33:46.377 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.377 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-08T05:33:46.377 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-05-08T05:33:46.378 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.378 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.378 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.378 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:46.378 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.378 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.378 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.378 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-05-08T05:33:46.378 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-05-08T05:33:46.378 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.378 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-05-08T05:33:46.378 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "smb", 2024-05-08T05:33:46.378 INFO:teuthology.orchestra.run.smithi087.stdout: "can_run": true, 2024-05-08T05:33:46.378 INFO:teuthology.orchestra.run.smithi087.stdout: "error_string": "", 2024-05-08T05:33:46.378 INFO:teuthology.orchestra.run.smithi087.stdout: "module_options": { 2024-05-08T05:33:46.379 INFO:teuthology.orchestra.run.smithi087.stdout: "log_level": { 2024-05-08T05:33:46.379 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_level", 2024-05-08T05:33:46.379 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-08T05:33:46.379 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.379 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:46.379 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-05-08T05:33:46.379 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.379 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.379 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [ 2024-05-08T05:33:46.379 INFO:teuthology.orchestra.run.smithi087.stdout: "", 2024-05-08T05:33:46.379 INFO:teuthology.orchestra.run.smithi087.stdout: "critical", 2024-05-08T05:33:46.379 INFO:teuthology.orchestra.run.smithi087.stdout: "debug", 2024-05-08T05:33:46.379 INFO:teuthology.orchestra.run.smithi087.stdout: "error", 2024-05-08T05:33:46.379 INFO:teuthology.orchestra.run.smithi087.stdout: "info", 2024-05-08T05:33:46.380 INFO:teuthology.orchestra.run.smithi087.stdout: "warning" 2024-05-08T05:33:46.380 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-05-08T05:33:46.380 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:46.380 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.380 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.380 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.380 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.380 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_cluster": { 2024-05-08T05:33:46.380 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_cluster", 2024-05-08T05:33:46.380 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-08T05:33:46.380 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.380 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:46.380 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-05-08T05:33:46.380 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.380 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.380 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.381 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:46.381 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.381 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.381 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.381 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.381 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_cluster_level": { 2024-05-08T05:33:46.381 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_cluster_level", 2024-05-08T05:33:46.381 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-08T05:33:46.381 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.381 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:46.381 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "info", 2024-05-08T05:33:46.381 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.381 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.382 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [ 2024-05-08T05:33:46.382 INFO:teuthology.orchestra.run.smithi087.stdout: "", 2024-05-08T05:33:46.382 INFO:teuthology.orchestra.run.smithi087.stdout: "critical", 2024-05-08T05:33:46.382 INFO:teuthology.orchestra.run.smithi087.stdout: "debug", 2024-05-08T05:33:46.382 INFO:teuthology.orchestra.run.smithi087.stdout: "error", 2024-05-08T05:33:46.382 INFO:teuthology.orchestra.run.smithi087.stdout: "info", 2024-05-08T05:33:46.382 INFO:teuthology.orchestra.run.smithi087.stdout: "warning" 2024-05-08T05:33:46.382 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-05-08T05:33:46.382 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:46.382 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.382 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.382 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.382 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.382 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_file": { 2024-05-08T05:33:46.383 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_file", 2024-05-08T05:33:46.383 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-08T05:33:46.383 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.383 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:46.383 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-05-08T05:33:46.383 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.383 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.383 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.383 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:46.383 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.383 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.383 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.383 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.383 INFO:teuthology.orchestra.run.smithi087.stdout: "sqlite3_killpoint": { 2024-05-08T05:33:46.383 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "sqlite3_killpoint", 2024-05-08T05:33:46.384 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "int", 2024-05-08T05:33:46.384 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "dev", 2024-05-08T05:33:46.384 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:46.384 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "0", 2024-05-08T05:33:46.384 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.384 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.384 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.384 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:46.384 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.384 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.384 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.384 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.384 INFO:teuthology.orchestra.run.smithi087.stdout: "update_orchestration": { 2024-05-08T05:33:46.384 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "update_orchestration", 2024-05-08T05:33:46.384 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-08T05:33:46.385 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.385 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-08T05:33:46.385 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "True", 2024-05-08T05:33:46.385 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.385 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.385 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.385 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "automatically update orchestration when smb resources are changed", 2024-05-08T05:33:46.385 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.385 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.385 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.385 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-05-08T05:33:46.385 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-05-08T05:33:46.385 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.385 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-05-08T05:33:46.385 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "snap_schedule", 2024-05-08T05:33:46.386 INFO:teuthology.orchestra.run.smithi087.stdout: "can_run": true, 2024-05-08T05:33:46.386 INFO:teuthology.orchestra.run.smithi087.stdout: "error_string": "", 2024-05-08T05:33:46.386 INFO:teuthology.orchestra.run.smithi087.stdout: "module_options": { 2024-05-08T05:33:46.386 INFO:teuthology.orchestra.run.smithi087.stdout: "allow_m_granularity": { 2024-05-08T05:33:46.386 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "allow_m_granularity", 2024-05-08T05:33:46.386 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-08T05:33:46.386 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.386 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:46.386 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-05-08T05:33:46.386 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.386 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.386 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.386 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "allow minute scheduled snapshots", 2024-05-08T05:33:46.386 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.387 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.387 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.387 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.387 INFO:teuthology.orchestra.run.smithi087.stdout: "dump_on_update": { 2024-05-08T05:33:46.387 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "dump_on_update", 2024-05-08T05:33:46.387 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-08T05:33:46.387 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.387 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:46.387 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-05-08T05:33:46.388 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.388 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.388 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.388 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "dump database to debug log on update", 2024-05-08T05:33:46.388 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.388 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.388 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.388 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.388 INFO:teuthology.orchestra.run.smithi087.stdout: "log_level": { 2024-05-08T05:33:46.388 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_level", 2024-05-08T05:33:46.388 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-08T05:33:46.388 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.388 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:46.389 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-05-08T05:33:46.389 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.389 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.389 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [ 2024-05-08T05:33:46.389 INFO:teuthology.orchestra.run.smithi087.stdout: "", 2024-05-08T05:33:46.389 INFO:teuthology.orchestra.run.smithi087.stdout: "critical", 2024-05-08T05:33:46.389 INFO:teuthology.orchestra.run.smithi087.stdout: "debug", 2024-05-08T05:33:46.389 INFO:teuthology.orchestra.run.smithi087.stdout: "error", 2024-05-08T05:33:46.389 INFO:teuthology.orchestra.run.smithi087.stdout: "info", 2024-05-08T05:33:46.389 INFO:teuthology.orchestra.run.smithi087.stdout: "warning" 2024-05-08T05:33:46.389 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-05-08T05:33:46.389 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:46.389 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.389 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.390 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.390 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.390 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_cluster": { 2024-05-08T05:33:46.390 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_cluster", 2024-05-08T05:33:46.390 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-08T05:33:46.390 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.390 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:46.390 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-05-08T05:33:46.390 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.390 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.390 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.391 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:46.391 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.391 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.391 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.391 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.391 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_cluster_level": { 2024-05-08T05:33:46.391 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_cluster_level", 2024-05-08T05:33:46.391 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-08T05:33:46.391 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.391 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:46.391 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "info", 2024-05-08T05:33:46.391 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.392 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.392 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [ 2024-05-08T05:33:46.392 INFO:teuthology.orchestra.run.smithi087.stdout: "", 2024-05-08T05:33:46.392 INFO:teuthology.orchestra.run.smithi087.stdout: "critical", 2024-05-08T05:33:46.392 INFO:teuthology.orchestra.run.smithi087.stdout: "debug", 2024-05-08T05:33:46.392 INFO:teuthology.orchestra.run.smithi087.stdout: "error", 2024-05-08T05:33:46.392 INFO:teuthology.orchestra.run.smithi087.stdout: "info", 2024-05-08T05:33:46.392 INFO:teuthology.orchestra.run.smithi087.stdout: "warning" 2024-05-08T05:33:46.392 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-05-08T05:33:46.392 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:46.392 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.392 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.393 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.393 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.393 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_file": { 2024-05-08T05:33:46.393 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_file", 2024-05-08T05:33:46.393 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-08T05:33:46.393 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.393 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:46.393 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-05-08T05:33:46.393 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.393 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.393 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.393 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:46.394 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.394 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.394 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.394 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.394 INFO:teuthology.orchestra.run.smithi087.stdout: "sqlite3_killpoint": { 2024-05-08T05:33:46.394 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "sqlite3_killpoint", 2024-05-08T05:33:46.394 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "int", 2024-05-08T05:33:46.394 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "dev", 2024-05-08T05:33:46.394 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:46.394 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "0", 2024-05-08T05:33:46.394 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.394 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.394 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.395 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:46.395 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.395 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.395 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.395 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-05-08T05:33:46.395 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-05-08T05:33:46.395 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.395 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-05-08T05:33:46.395 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "stats", 2024-05-08T05:33:46.395 INFO:teuthology.orchestra.run.smithi087.stdout: "can_run": true, 2024-05-08T05:33:46.395 INFO:teuthology.orchestra.run.smithi087.stdout: "error_string": "", 2024-05-08T05:33:46.395 INFO:teuthology.orchestra.run.smithi087.stdout: "module_options": { 2024-05-08T05:33:46.395 INFO:teuthology.orchestra.run.smithi087.stdout: "log_level": { 2024-05-08T05:33:46.396 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_level", 2024-05-08T05:33:46.396 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-08T05:33:46.396 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.396 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:46.396 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-05-08T05:33:46.396 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.396 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.396 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [ 2024-05-08T05:33:46.396 INFO:teuthology.orchestra.run.smithi087.stdout: "", 2024-05-08T05:33:46.396 INFO:teuthology.orchestra.run.smithi087.stdout: "critical", 2024-05-08T05:33:46.396 INFO:teuthology.orchestra.run.smithi087.stdout: "debug", 2024-05-08T05:33:46.396 INFO:teuthology.orchestra.run.smithi087.stdout: "error", 2024-05-08T05:33:46.397 INFO:teuthology.orchestra.run.smithi087.stdout: "info", 2024-05-08T05:33:46.397 INFO:teuthology.orchestra.run.smithi087.stdout: "warning" 2024-05-08T05:33:46.397 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-05-08T05:33:46.397 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:46.397 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.397 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.397 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.397 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.397 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_cluster": { 2024-05-08T05:33:46.397 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_cluster", 2024-05-08T05:33:46.397 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-08T05:33:46.397 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.397 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:46.398 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-05-08T05:33:46.398 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.398 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.398 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.398 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:46.398 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.398 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.398 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.398 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.398 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_cluster_level": { 2024-05-08T05:33:46.398 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_cluster_level", 2024-05-08T05:33:46.399 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-08T05:33:46.399 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.399 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:46.399 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "info", 2024-05-08T05:33:46.399 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.399 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.399 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [ 2024-05-08T05:33:46.399 INFO:teuthology.orchestra.run.smithi087.stdout: "", 2024-05-08T05:33:46.399 INFO:teuthology.orchestra.run.smithi087.stdout: "critical", 2024-05-08T05:33:46.399 INFO:teuthology.orchestra.run.smithi087.stdout: "debug", 2024-05-08T05:33:46.399 INFO:teuthology.orchestra.run.smithi087.stdout: "error", 2024-05-08T05:33:46.399 INFO:teuthology.orchestra.run.smithi087.stdout: "info", 2024-05-08T05:33:46.399 INFO:teuthology.orchestra.run.smithi087.stdout: "warning" 2024-05-08T05:33:46.400 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-05-08T05:33:46.400 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:46.400 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.400 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.400 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.400 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.400 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_file": { 2024-05-08T05:33:46.400 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_file", 2024-05-08T05:33:46.400 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-08T05:33:46.400 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.400 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:46.400 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-05-08T05:33:46.400 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.400 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.401 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.401 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:46.401 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.401 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.401 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.401 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.401 INFO:teuthology.orchestra.run.smithi087.stdout: "sqlite3_killpoint": { 2024-05-08T05:33:46.401 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "sqlite3_killpoint", 2024-05-08T05:33:46.401 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "int", 2024-05-08T05:33:46.401 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "dev", 2024-05-08T05:33:46.401 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:46.401 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "0", 2024-05-08T05:33:46.401 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.401 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.402 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.402 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:46.402 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.402 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.402 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.402 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-05-08T05:33:46.402 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-05-08T05:33:46.402 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.402 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-05-08T05:33:46.402 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "status", 2024-05-08T05:33:46.402 INFO:teuthology.orchestra.run.smithi087.stdout: "can_run": true, 2024-05-08T05:33:46.402 INFO:teuthology.orchestra.run.smithi087.stdout: "error_string": "", 2024-05-08T05:33:46.403 INFO:teuthology.orchestra.run.smithi087.stdout: "module_options": { 2024-05-08T05:33:46.403 INFO:teuthology.orchestra.run.smithi087.stdout: "log_level": { 2024-05-08T05:33:46.403 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_level", 2024-05-08T05:33:46.403 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-08T05:33:46.403 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.403 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:46.403 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-05-08T05:33:46.403 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.403 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.403 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [ 2024-05-08T05:33:46.403 INFO:teuthology.orchestra.run.smithi087.stdout: "", 2024-05-08T05:33:46.403 INFO:teuthology.orchestra.run.smithi087.stdout: "critical", 2024-05-08T05:33:46.404 INFO:teuthology.orchestra.run.smithi087.stdout: "debug", 2024-05-08T05:33:46.404 INFO:teuthology.orchestra.run.smithi087.stdout: "error", 2024-05-08T05:33:46.404 INFO:teuthology.orchestra.run.smithi087.stdout: "info", 2024-05-08T05:33:46.404 INFO:teuthology.orchestra.run.smithi087.stdout: "warning" 2024-05-08T05:33:46.404 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-05-08T05:33:46.404 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:46.404 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.404 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.404 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.404 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.404 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_cluster": { 2024-05-08T05:33:46.404 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_cluster", 2024-05-08T05:33:46.404 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-08T05:33:46.405 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.405 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:46.405 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-05-08T05:33:46.405 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.405 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.405 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.405 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:46.405 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.405 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.405 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.405 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.406 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_cluster_level": { 2024-05-08T05:33:46.406 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_cluster_level", 2024-05-08T05:33:46.406 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-08T05:33:46.406 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.406 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:46.406 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "info", 2024-05-08T05:33:46.406 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.406 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.406 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [ 2024-05-08T05:33:46.406 INFO:teuthology.orchestra.run.smithi087.stdout: "", 2024-05-08T05:33:46.406 INFO:teuthology.orchestra.run.smithi087.stdout: "critical", 2024-05-08T05:33:46.406 INFO:teuthology.orchestra.run.smithi087.stdout: "debug", 2024-05-08T05:33:46.407 INFO:teuthology.orchestra.run.smithi087.stdout: "error", 2024-05-08T05:33:46.407 INFO:teuthology.orchestra.run.smithi087.stdout: "info", 2024-05-08T05:33:46.407 INFO:teuthology.orchestra.run.smithi087.stdout: "warning" 2024-05-08T05:33:46.407 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-05-08T05:33:46.407 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:46.407 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.407 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.407 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.407 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.407 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_file": { 2024-05-08T05:33:46.407 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_file", 2024-05-08T05:33:46.407 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-08T05:33:46.407 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.408 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:46.408 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-05-08T05:33:46.408 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.408 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.408 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.408 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:46.408 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.408 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.408 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.408 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.408 INFO:teuthology.orchestra.run.smithi087.stdout: "sqlite3_killpoint": { 2024-05-08T05:33:46.408 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "sqlite3_killpoint", 2024-05-08T05:33:46.408 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "int", 2024-05-08T05:33:46.409 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "dev", 2024-05-08T05:33:46.409 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:46.409 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "0", 2024-05-08T05:33:46.409 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.409 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.409 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.409 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:46.409 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.409 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.409 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.409 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-05-08T05:33:46.409 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-05-08T05:33:46.409 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.410 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-05-08T05:33:46.410 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "telegraf", 2024-05-08T05:33:46.410 INFO:teuthology.orchestra.run.smithi087.stdout: "can_run": true, 2024-05-08T05:33:46.410 INFO:teuthology.orchestra.run.smithi087.stdout: "error_string": "", 2024-05-08T05:33:46.410 INFO:teuthology.orchestra.run.smithi087.stdout: "module_options": { 2024-05-08T05:33:46.410 INFO:teuthology.orchestra.run.smithi087.stdout: "address": { 2024-05-08T05:33:46.410 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "address", 2024-05-08T05:33:46.410 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-08T05:33:46.410 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.410 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-08T05:33:46.410 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2024-05-08T05:33:46.410 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.411 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.411 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.411 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:46.411 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.411 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.411 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.411 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.411 INFO:teuthology.orchestra.run.smithi087.stdout: "interval": { 2024-05-08T05:33:46.411 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "interval", 2024-05-08T05:33:46.411 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "secs", 2024-05-08T05:33:46.411 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.411 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-08T05:33:46.411 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "15", 2024-05-08T05:33:46.412 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.412 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.412 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.412 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:46.412 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.412 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.412 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.412 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.412 INFO:teuthology.orchestra.run.smithi087.stdout: "log_level": { 2024-05-08T05:33:46.412 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_level", 2024-05-08T05:33:46.412 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-08T05:33:46.412 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.412 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:46.413 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-05-08T05:33:46.413 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.413 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.413 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [ 2024-05-08T05:33:46.413 INFO:teuthology.orchestra.run.smithi087.stdout: "", 2024-05-08T05:33:46.413 INFO:teuthology.orchestra.run.smithi087.stdout: "critical", 2024-05-08T05:33:46.413 INFO:teuthology.orchestra.run.smithi087.stdout: "debug", 2024-05-08T05:33:46.413 INFO:teuthology.orchestra.run.smithi087.stdout: "error", 2024-05-08T05:33:46.413 INFO:teuthology.orchestra.run.smithi087.stdout: "info", 2024-05-08T05:33:46.413 INFO:teuthology.orchestra.run.smithi087.stdout: "warning" 2024-05-08T05:33:46.413 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-05-08T05:33:46.413 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:46.413 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.414 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.414 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.414 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.414 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_cluster": { 2024-05-08T05:33:46.414 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_cluster", 2024-05-08T05:33:46.414 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-08T05:33:46.414 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.414 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:46.414 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-05-08T05:33:46.414 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.414 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.414 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.415 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:46.415 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.415 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.415 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.415 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.415 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_cluster_level": { 2024-05-08T05:33:46.415 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_cluster_level", 2024-05-08T05:33:46.415 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-08T05:33:46.415 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.415 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:46.415 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "info", 2024-05-08T05:33:46.415 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.416 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.416 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [ 2024-05-08T05:33:46.416 INFO:teuthology.orchestra.run.smithi087.stdout: "", 2024-05-08T05:33:46.416 INFO:teuthology.orchestra.run.smithi087.stdout: "critical", 2024-05-08T05:33:46.416 INFO:teuthology.orchestra.run.smithi087.stdout: "debug", 2024-05-08T05:33:46.416 INFO:teuthology.orchestra.run.smithi087.stdout: "error", 2024-05-08T05:33:46.416 INFO:teuthology.orchestra.run.smithi087.stdout: "info", 2024-05-08T05:33:46.416 INFO:teuthology.orchestra.run.smithi087.stdout: "warning" 2024-05-08T05:33:46.416 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-05-08T05:33:46.416 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:46.416 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.417 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.417 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.417 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.417 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_file": { 2024-05-08T05:33:46.417 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_file", 2024-05-08T05:33:46.417 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-08T05:33:46.417 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.417 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:46.417 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-05-08T05:33:46.417 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.417 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.417 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.418 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:46.418 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.418 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.418 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.418 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.418 INFO:teuthology.orchestra.run.smithi087.stdout: "sqlite3_killpoint": { 2024-05-08T05:33:46.418 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "sqlite3_killpoint", 2024-05-08T05:33:46.418 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "int", 2024-05-08T05:33:46.418 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "dev", 2024-05-08T05:33:46.418 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:46.418 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "0", 2024-05-08T05:33:46.418 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.418 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.419 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.419 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:46.419 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.419 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.419 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.419 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-05-08T05:33:46.419 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-05-08T05:33:46.419 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.419 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-05-08T05:33:46.419 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "telemetry", 2024-05-08T05:33:46.419 INFO:teuthology.orchestra.run.smithi087.stdout: "can_run": true, 2024-05-08T05:33:46.419 INFO:teuthology.orchestra.run.smithi087.stdout: "error_string": "", 2024-05-08T05:33:46.419 INFO:teuthology.orchestra.run.smithi087.stdout: "module_options": { 2024-05-08T05:33:46.419 INFO:teuthology.orchestra.run.smithi087.stdout: "channel_basic": { 2024-05-08T05:33:46.420 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "channel_basic", 2024-05-08T05:33:46.420 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-08T05:33:46.420 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.420 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-08T05:33:46.420 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "True", 2024-05-08T05:33:46.420 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.420 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.420 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.420 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "Share basic cluster information (size, version)", 2024-05-08T05:33:46.420 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.420 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.420 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.420 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.421 INFO:teuthology.orchestra.run.smithi087.stdout: "channel_crash": { 2024-05-08T05:33:46.421 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "channel_crash", 2024-05-08T05:33:46.421 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-08T05:33:46.421 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.421 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-08T05:33:46.421 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "True", 2024-05-08T05:33:46.421 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.421 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.421 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.421 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2024-05-08T05:33:46.421 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.421 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.421 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.422 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.422 INFO:teuthology.orchestra.run.smithi087.stdout: "channel_device": { 2024-05-08T05:33:46.422 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "channel_device", 2024-05-08T05:33:46.422 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-08T05:33:46.422 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.422 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-08T05:33:46.422 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "True", 2024-05-08T05:33:46.422 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.422 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.422 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.422 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2024-05-08T05:33:46.422 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.423 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.423 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.423 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.423 INFO:teuthology.orchestra.run.smithi087.stdout: "channel_ident": { 2024-05-08T05:33:46.423 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "channel_ident", 2024-05-08T05:33:46.423 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-08T05:33:46.423 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.423 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-08T05:33:46.423 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-05-08T05:33:46.423 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.423 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.423 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.423 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2024-05-08T05:33:46.424 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.424 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.424 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.424 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.424 INFO:teuthology.orchestra.run.smithi087.stdout: "channel_perf": { 2024-05-08T05:33:46.424 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "channel_perf", 2024-05-08T05:33:46.424 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-08T05:33:46.424 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.424 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-08T05:33:46.424 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-05-08T05:33:46.424 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.424 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.424 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.425 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "Share various performance metrics of a cluster", 2024-05-08T05:33:46.425 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.425 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.425 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.425 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.425 INFO:teuthology.orchestra.run.smithi087.stdout: "contact": { 2024-05-08T05:33:46.425 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "contact", 2024-05-08T05:33:46.425 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-08T05:33:46.425 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.425 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-08T05:33:46.425 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-05-08T05:33:46.425 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.425 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.426 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.426 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:46.426 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.426 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.426 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.426 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.426 INFO:teuthology.orchestra.run.smithi087.stdout: "description": { 2024-05-08T05:33:46.426 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "description", 2024-05-08T05:33:46.426 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-08T05:33:46.426 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.426 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-08T05:33:46.426 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-05-08T05:33:46.426 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.427 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.427 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.427 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:46.427 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.427 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.427 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.427 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.427 INFO:teuthology.orchestra.run.smithi087.stdout: "device_url": { 2024-05-08T05:33:46.427 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "device_url", 2024-05-08T05:33:46.427 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-08T05:33:46.427 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.427 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-08T05:33:46.427 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "https://telemetry.ceph.com/device", 2024-05-08T05:33:46.428 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.428 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.428 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.428 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:46.428 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.428 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.428 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.428 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.428 INFO:teuthology.orchestra.run.smithi087.stdout: "enabled": { 2024-05-08T05:33:46.428 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "enabled", 2024-05-08T05:33:46.428 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-08T05:33:46.428 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.428 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-08T05:33:46.428 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-05-08T05:33:46.429 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.429 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.429 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.429 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:46.429 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.429 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.429 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.429 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.429 INFO:teuthology.orchestra.run.smithi087.stdout: "interval": { 2024-05-08T05:33:46.429 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "interval", 2024-05-08T05:33:46.429 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "int", 2024-05-08T05:33:46.429 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.429 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-08T05:33:46.429 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "24", 2024-05-08T05:33:46.430 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "8", 2024-05-08T05:33:46.430 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.430 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.430 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:46.430 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.430 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.430 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.430 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.430 INFO:teuthology.orchestra.run.smithi087.stdout: "last_opt_revision": { 2024-05-08T05:33:46.430 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "last_opt_revision", 2024-05-08T05:33:46.430 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "int", 2024-05-08T05:33:46.430 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.431 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-08T05:33:46.431 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "1", 2024-05-08T05:33:46.431 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.431 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.431 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.431 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:46.431 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.431 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.431 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.431 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.431 INFO:teuthology.orchestra.run.smithi087.stdout: "leaderboard": { 2024-05-08T05:33:46.431 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "leaderboard", 2024-05-08T05:33:46.432 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-08T05:33:46.432 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.432 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-08T05:33:46.432 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-05-08T05:33:46.432 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.432 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.432 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.432 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:46.432 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.432 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.432 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.432 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.433 INFO:teuthology.orchestra.run.smithi087.stdout: "leaderboard_description": { 2024-05-08T05:33:46.433 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "leaderboard_description", 2024-05-08T05:33:46.433 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-08T05:33:46.433 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.433 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-08T05:33:46.433 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-05-08T05:33:46.433 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.433 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.433 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.433 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:46.433 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.433 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.434 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.434 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.434 INFO:teuthology.orchestra.run.smithi087.stdout: "log_level": { 2024-05-08T05:33:46.434 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_level", 2024-05-08T05:33:46.434 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-08T05:33:46.434 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.434 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:46.434 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-05-08T05:33:46.434 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.434 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.434 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [ 2024-05-08T05:33:46.434 INFO:teuthology.orchestra.run.smithi087.stdout: "", 2024-05-08T05:33:46.435 INFO:teuthology.orchestra.run.smithi087.stdout: "critical", 2024-05-08T05:33:46.435 INFO:teuthology.orchestra.run.smithi087.stdout: "debug", 2024-05-08T05:33:46.435 INFO:teuthology.orchestra.run.smithi087.stdout: "error", 2024-05-08T05:33:46.435 INFO:teuthology.orchestra.run.smithi087.stdout: "info", 2024-05-08T05:33:46.435 INFO:teuthology.orchestra.run.smithi087.stdout: "warning" 2024-05-08T05:33:46.435 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-05-08T05:33:46.435 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:46.435 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.435 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.435 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.435 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.435 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_cluster": { 2024-05-08T05:33:46.436 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_cluster", 2024-05-08T05:33:46.436 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-08T05:33:46.436 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.436 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:46.436 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-05-08T05:33:46.436 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.436 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.436 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.436 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:46.436 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.436 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.436 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.436 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.437 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_cluster_level": { 2024-05-08T05:33:46.437 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_cluster_level", 2024-05-08T05:33:46.437 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-08T05:33:46.437 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.437 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:46.437 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "info", 2024-05-08T05:33:46.437 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.437 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.437 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [ 2024-05-08T05:33:46.437 INFO:teuthology.orchestra.run.smithi087.stdout: "", 2024-05-08T05:33:46.437 INFO:teuthology.orchestra.run.smithi087.stdout: "critical", 2024-05-08T05:33:46.437 INFO:teuthology.orchestra.run.smithi087.stdout: "debug", 2024-05-08T05:33:46.437 INFO:teuthology.orchestra.run.smithi087.stdout: "error", 2024-05-08T05:33:46.438 INFO:teuthology.orchestra.run.smithi087.stdout: "info", 2024-05-08T05:33:46.438 INFO:teuthology.orchestra.run.smithi087.stdout: "warning" 2024-05-08T05:33:46.438 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-05-08T05:33:46.438 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:46.438 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.438 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.438 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.438 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.438 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_file": { 2024-05-08T05:33:46.438 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_file", 2024-05-08T05:33:46.438 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-08T05:33:46.438 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.439 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:46.439 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-05-08T05:33:46.439 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.439 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.439 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.439 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:46.439 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.439 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.439 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.439 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.439 INFO:teuthology.orchestra.run.smithi087.stdout: "organization": { 2024-05-08T05:33:46.439 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "organization", 2024-05-08T05:33:46.440 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-08T05:33:46.440 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.440 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-08T05:33:46.440 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-05-08T05:33:46.440 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.440 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.440 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.440 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:46.440 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.440 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.440 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.440 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.440 INFO:teuthology.orchestra.run.smithi087.stdout: "proxy": { 2024-05-08T05:33:46.441 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "proxy", 2024-05-08T05:33:46.441 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-08T05:33:46.441 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.441 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-08T05:33:46.441 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-05-08T05:33:46.441 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.441 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.441 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.441 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:46.441 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.441 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.441 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.442 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.442 INFO:teuthology.orchestra.run.smithi087.stdout: "sqlite3_killpoint": { 2024-05-08T05:33:46.442 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "sqlite3_killpoint", 2024-05-08T05:33:46.442 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "int", 2024-05-08T05:33:46.442 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "dev", 2024-05-08T05:33:46.442 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:46.442 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "0", 2024-05-08T05:33:46.442 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.442 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.442 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.442 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:46.443 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.443 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.443 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.443 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.443 INFO:teuthology.orchestra.run.smithi087.stdout: "url": { 2024-05-08T05:33:46.443 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "url", 2024-05-08T05:33:46.443 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-08T05:33:46.443 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.443 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-08T05:33:46.443 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "https://telemetry.ceph.com/report", 2024-05-08T05:33:46.443 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.443 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.443 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.444 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:46.444 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.444 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.444 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.444 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-05-08T05:33:46.444 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-05-08T05:33:46.444 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.444 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-05-08T05:33:46.444 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "test_orchestrator", 2024-05-08T05:33:46.444 INFO:teuthology.orchestra.run.smithi087.stdout: "can_run": true, 2024-05-08T05:33:46.444 INFO:teuthology.orchestra.run.smithi087.stdout: "error_string": "", 2024-05-08T05:33:46.445 INFO:teuthology.orchestra.run.smithi087.stdout: "module_options": { 2024-05-08T05:33:46.445 INFO:teuthology.orchestra.run.smithi087.stdout: "log_level": { 2024-05-08T05:33:46.445 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_level", 2024-05-08T05:33:46.445 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-08T05:33:46.445 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.445 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:46.445 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-05-08T05:33:46.445 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.445 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.445 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [ 2024-05-08T05:33:46.445 INFO:teuthology.orchestra.run.smithi087.stdout: "", 2024-05-08T05:33:46.445 INFO:teuthology.orchestra.run.smithi087.stdout: "critical", 2024-05-08T05:33:46.446 INFO:teuthology.orchestra.run.smithi087.stdout: "debug", 2024-05-08T05:33:46.446 INFO:teuthology.orchestra.run.smithi087.stdout: "error", 2024-05-08T05:33:46.446 INFO:teuthology.orchestra.run.smithi087.stdout: "info", 2024-05-08T05:33:46.446 INFO:teuthology.orchestra.run.smithi087.stdout: "warning" 2024-05-08T05:33:46.446 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-05-08T05:33:46.446 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:46.446 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.446 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.446 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.446 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.446 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_cluster": { 2024-05-08T05:33:46.447 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_cluster", 2024-05-08T05:33:46.447 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-08T05:33:46.447 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.447 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:46.447 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-05-08T05:33:46.447 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.447 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.447 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.447 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:46.447 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.447 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.447 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.447 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.448 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_cluster_level": { 2024-05-08T05:33:46.448 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_cluster_level", 2024-05-08T05:33:46.448 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-08T05:33:46.448 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.448 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:46.448 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "info", 2024-05-08T05:33:46.448 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.448 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.448 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [ 2024-05-08T05:33:46.448 INFO:teuthology.orchestra.run.smithi087.stdout: "", 2024-05-08T05:33:46.448 INFO:teuthology.orchestra.run.smithi087.stdout: "critical", 2024-05-08T05:33:46.448 INFO:teuthology.orchestra.run.smithi087.stdout: "debug", 2024-05-08T05:33:46.448 INFO:teuthology.orchestra.run.smithi087.stdout: "error", 2024-05-08T05:33:46.449 INFO:teuthology.orchestra.run.smithi087.stdout: "info", 2024-05-08T05:33:46.449 INFO:teuthology.orchestra.run.smithi087.stdout: "warning" 2024-05-08T05:33:46.449 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-05-08T05:33:46.449 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:46.449 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.449 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.449 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.449 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.449 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_file": { 2024-05-08T05:33:46.449 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_file", 2024-05-08T05:33:46.449 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-08T05:33:46.449 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.449 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:46.450 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-05-08T05:33:46.450 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.450 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.450 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.450 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:46.450 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.450 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.450 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.450 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.450 INFO:teuthology.orchestra.run.smithi087.stdout: "sqlite3_killpoint": { 2024-05-08T05:33:46.450 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "sqlite3_killpoint", 2024-05-08T05:33:46.451 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "int", 2024-05-08T05:33:46.451 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "dev", 2024-05-08T05:33:46.451 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:46.451 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "0", 2024-05-08T05:33:46.451 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.451 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.451 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.451 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:46.451 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.451 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.451 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.451 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-05-08T05:33:46.452 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-05-08T05:33:46.452 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.452 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-05-08T05:33:46.452 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "volumes", 2024-05-08T05:33:46.452 INFO:teuthology.orchestra.run.smithi087.stdout: "can_run": true, 2024-05-08T05:33:46.452 INFO:teuthology.orchestra.run.smithi087.stdout: "error_string": "", 2024-05-08T05:33:46.452 INFO:teuthology.orchestra.run.smithi087.stdout: "module_options": { 2024-05-08T05:33:46.452 INFO:teuthology.orchestra.run.smithi087.stdout: "log_level": { 2024-05-08T05:33:46.452 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_level", 2024-05-08T05:33:46.452 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-08T05:33:46.453 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.453 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:46.453 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-05-08T05:33:46.453 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.453 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.453 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [ 2024-05-08T05:33:46.453 INFO:teuthology.orchestra.run.smithi087.stdout: "", 2024-05-08T05:33:46.453 INFO:teuthology.orchestra.run.smithi087.stdout: "critical", 2024-05-08T05:33:46.453 INFO:teuthology.orchestra.run.smithi087.stdout: "debug", 2024-05-08T05:33:46.453 INFO:teuthology.orchestra.run.smithi087.stdout: "error", 2024-05-08T05:33:46.453 INFO:teuthology.orchestra.run.smithi087.stdout: "info", 2024-05-08T05:33:46.453 INFO:teuthology.orchestra.run.smithi087.stdout: "warning" 2024-05-08T05:33:46.454 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-05-08T05:33:46.454 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:46.454 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.454 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.454 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.454 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.454 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_cluster": { 2024-05-08T05:33:46.454 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_cluster", 2024-05-08T05:33:46.454 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-08T05:33:46.454 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.454 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:46.454 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-05-08T05:33:46.455 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.455 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.455 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.455 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:46.455 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.455 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.455 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.455 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.455 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_cluster_level": { 2024-05-08T05:33:46.455 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_cluster_level", 2024-05-08T05:33:46.455 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-08T05:33:46.455 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.455 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:46.456 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "info", 2024-05-08T05:33:46.456 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.456 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.456 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [ 2024-05-08T05:33:46.456 INFO:teuthology.orchestra.run.smithi087.stdout: "", 2024-05-08T05:33:46.456 INFO:teuthology.orchestra.run.smithi087.stdout: "critical", 2024-05-08T05:33:46.456 INFO:teuthology.orchestra.run.smithi087.stdout: "debug", 2024-05-08T05:33:46.456 INFO:teuthology.orchestra.run.smithi087.stdout: "error", 2024-05-08T05:33:46.456 INFO:teuthology.orchestra.run.smithi087.stdout: "info", 2024-05-08T05:33:46.456 INFO:teuthology.orchestra.run.smithi087.stdout: "warning" 2024-05-08T05:33:46.456 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-05-08T05:33:46.457 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:46.457 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.457 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.457 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.457 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.457 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_file": { 2024-05-08T05:33:46.457 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_file", 2024-05-08T05:33:46.457 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-08T05:33:46.457 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.457 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:46.457 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-05-08T05:33:46.457 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.457 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.458 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.458 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:46.458 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.458 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.458 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.458 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.458 INFO:teuthology.orchestra.run.smithi087.stdout: "max_concurrent_clones": { 2024-05-08T05:33:46.458 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "max_concurrent_clones", 2024-05-08T05:33:46.458 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "int", 2024-05-08T05:33:46.458 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.458 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-08T05:33:46.459 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "4", 2024-05-08T05:33:46.459 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.459 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.459 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.459 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "Number of asynchronous cloner threads", 2024-05-08T05:33:46.459 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.459 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.459 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.459 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.459 INFO:teuthology.orchestra.run.smithi087.stdout: "periodic_async_work": { 2024-05-08T05:33:46.459 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "periodic_async_work", 2024-05-08T05:33:46.459 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-08T05:33:46.460 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.460 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-08T05:33:46.460 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-05-08T05:33:46.460 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.460 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.460 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.460 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "Periodically check for async work", 2024-05-08T05:33:46.460 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.460 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.460 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.460 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.460 INFO:teuthology.orchestra.run.smithi087.stdout: "snapshot_clone_delay": { 2024-05-08T05:33:46.461 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "snapshot_clone_delay", 2024-05-08T05:33:46.461 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "int", 2024-05-08T05:33:46.461 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.461 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-08T05:33:46.461 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "0", 2024-05-08T05:33:46.461 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.461 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.461 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.461 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2024-05-08T05:33:46.461 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.461 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.461 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.461 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.462 INFO:teuthology.orchestra.run.smithi087.stdout: "snapshot_clone_no_wait": { 2024-05-08T05:33:46.462 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "snapshot_clone_no_wait", 2024-05-08T05:33:46.462 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-08T05:33:46.462 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.462 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-08T05:33:46.462 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "True", 2024-05-08T05:33:46.462 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.462 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.462 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.462 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "Reject subvolume clone request when cloner threads are busy", 2024-05-08T05:33:46.462 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.463 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.463 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.463 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.463 INFO:teuthology.orchestra.run.smithi087.stdout: "sqlite3_killpoint": { 2024-05-08T05:33:46.463 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "sqlite3_killpoint", 2024-05-08T05:33:46.463 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "int", 2024-05-08T05:33:46.463 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "dev", 2024-05-08T05:33:46.463 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:46.463 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "0", 2024-05-08T05:33:46.463 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.463 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.463 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.464 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:46.464 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.464 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.464 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.464 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-05-08T05:33:46.464 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-05-08T05:33:46.464 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.464 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-05-08T05:33:46.464 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "zabbix", 2024-05-08T05:33:46.464 INFO:teuthology.orchestra.run.smithi087.stdout: "can_run": true, 2024-05-08T05:33:46.464 INFO:teuthology.orchestra.run.smithi087.stdout: "error_string": "", 2024-05-08T05:33:46.464 INFO:teuthology.orchestra.run.smithi087.stdout: "module_options": { 2024-05-08T05:33:46.464 INFO:teuthology.orchestra.run.smithi087.stdout: "discovery_interval": { 2024-05-08T05:33:46.465 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "discovery_interval", 2024-05-08T05:33:46.465 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "uint", 2024-05-08T05:33:46.465 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.465 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-08T05:33:46.465 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "100", 2024-05-08T05:33:46.465 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.465 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.465 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.465 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:46.465 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.465 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.465 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.465 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.466 INFO:teuthology.orchestra.run.smithi087.stdout: "identifier": { 2024-05-08T05:33:46.466 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "identifier", 2024-05-08T05:33:46.466 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-08T05:33:46.466 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.466 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-08T05:33:46.466 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-05-08T05:33:46.466 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.466 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.466 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.466 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:46.466 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.466 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.467 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.467 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.467 INFO:teuthology.orchestra.run.smithi087.stdout: "interval": { 2024-05-08T05:33:46.467 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "interval", 2024-05-08T05:33:46.467 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "secs", 2024-05-08T05:33:46.467 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.467 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-08T05:33:46.467 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "60", 2024-05-08T05:33:46.467 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.467 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.467 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.467 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:46.467 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.468 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.468 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.468 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.468 INFO:teuthology.orchestra.run.smithi087.stdout: "log_level": { 2024-05-08T05:33:46.468 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_level", 2024-05-08T05:33:46.468 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-08T05:33:46.468 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.468 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:46.468 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-05-08T05:33:46.468 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.468 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.468 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [ 2024-05-08T05:33:46.468 INFO:teuthology.orchestra.run.smithi087.stdout: "", 2024-05-08T05:33:46.469 INFO:teuthology.orchestra.run.smithi087.stdout: "critical", 2024-05-08T05:33:46.469 INFO:teuthology.orchestra.run.smithi087.stdout: "debug", 2024-05-08T05:33:46.469 INFO:teuthology.orchestra.run.smithi087.stdout: "error", 2024-05-08T05:33:46.469 INFO:teuthology.orchestra.run.smithi087.stdout: "info", 2024-05-08T05:33:46.469 INFO:teuthology.orchestra.run.smithi087.stdout: "warning" 2024-05-08T05:33:46.469 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-05-08T05:33:46.469 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:46.469 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.469 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.469 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.469 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.469 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_cluster": { 2024-05-08T05:33:46.469 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_cluster", 2024-05-08T05:33:46.470 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-08T05:33:46.470 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.470 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:46.470 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-05-08T05:33:46.470 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.470 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.470 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.470 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:46.470 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.470 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.470 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.470 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.471 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_cluster_level": { 2024-05-08T05:33:46.471 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_cluster_level", 2024-05-08T05:33:46.471 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-08T05:33:46.471 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.471 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:46.471 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "info", 2024-05-08T05:33:46.471 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.471 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.471 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [ 2024-05-08T05:33:46.471 INFO:teuthology.orchestra.run.smithi087.stdout: "", 2024-05-08T05:33:46.471 INFO:teuthology.orchestra.run.smithi087.stdout: "critical", 2024-05-08T05:33:46.471 INFO:teuthology.orchestra.run.smithi087.stdout: "debug", 2024-05-08T05:33:46.472 INFO:teuthology.orchestra.run.smithi087.stdout: "error", 2024-05-08T05:33:46.472 INFO:teuthology.orchestra.run.smithi087.stdout: "info", 2024-05-08T05:33:46.472 INFO:teuthology.orchestra.run.smithi087.stdout: "warning" 2024-05-08T05:33:46.472 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-05-08T05:33:46.472 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:46.472 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.472 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.472 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.472 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.472 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_file": { 2024-05-08T05:33:46.472 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_file", 2024-05-08T05:33:46.472 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-08T05:33:46.472 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.472 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:46.473 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-05-08T05:33:46.473 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.473 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.473 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.473 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:46.473 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.473 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.473 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.473 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.473 INFO:teuthology.orchestra.run.smithi087.stdout: "sqlite3_killpoint": { 2024-05-08T05:33:46.473 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "sqlite3_killpoint", 2024-05-08T05:33:46.473 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "int", 2024-05-08T05:33:46.473 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "dev", 2024-05-08T05:33:46.474 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:46.474 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "0", 2024-05-08T05:33:46.474 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.474 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.474 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.474 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:46.474 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.474 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.474 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.474 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.474 INFO:teuthology.orchestra.run.smithi087.stdout: "zabbix_host": { 2024-05-08T05:33:46.475 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "zabbix_host", 2024-05-08T05:33:46.475 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-08T05:33:46.475 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.475 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-08T05:33:46.475 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-05-08T05:33:46.475 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.475 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.475 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.475 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:46.475 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.475 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.475 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.476 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.476 INFO:teuthology.orchestra.run.smithi087.stdout: "zabbix_port": { 2024-05-08T05:33:46.476 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "zabbix_port", 2024-05-08T05:33:46.476 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "int", 2024-05-08T05:33:46.476 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.476 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-08T05:33:46.476 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "10051", 2024-05-08T05:33:46.476 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.476 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.476 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.476 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:46.476 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.477 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.477 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.477 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.477 INFO:teuthology.orchestra.run.smithi087.stdout: "zabbix_sender": { 2024-05-08T05:33:46.477 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "zabbix_sender", 2024-05-08T05:33:46.477 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-08T05:33:46.477 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.477 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-08T05:33:46.477 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "/usr/bin/zabbix_sender", 2024-05-08T05:33:46.477 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.477 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.477 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.477 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:46.478 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.478 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.478 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.478 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-05-08T05:33:46.478 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-05-08T05:33:46.478 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-05-08T05:33:46.478 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-05-08T05:33:46.478 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.478 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-05-08T05:33:46.478 INFO:teuthology.orchestra.run.smithi087.stdout: "gid": 24110, 2024-05-08T05:33:46.478 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "y", 2024-05-08T05:33:46.478 INFO:teuthology.orchestra.run.smithi087.stdout: "mgr_features": 4540701547738038271, 2024-05-08T05:33:46.479 INFO:teuthology.orchestra.run.smithi087.stdout: "available_modules": [ 2024-05-08T05:33:46.479 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-05-08T05:33:46.479 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "alerts", 2024-05-08T05:33:46.479 INFO:teuthology.orchestra.run.smithi087.stdout: "can_run": true, 2024-05-08T05:33:46.479 INFO:teuthology.orchestra.run.smithi087.stdout: "error_string": "", 2024-05-08T05:33:46.479 INFO:teuthology.orchestra.run.smithi087.stdout: "module_options": { 2024-05-08T05:33:46.479 INFO:teuthology.orchestra.run.smithi087.stdout: "interval": { 2024-05-08T05:33:46.479 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "interval", 2024-05-08T05:33:46.479 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "secs", 2024-05-08T05:33:46.479 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.479 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:46.479 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "60", 2024-05-08T05:33:46.480 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.480 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.480 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.480 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "How frequently to reexamine health status", 2024-05-08T05:33:46.480 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.480 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.480 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.480 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.480 INFO:teuthology.orchestra.run.smithi087.stdout: "log_level": { 2024-05-08T05:33:46.480 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_level", 2024-05-08T05:33:46.480 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-08T05:33:46.480 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.481 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:46.481 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-05-08T05:33:46.481 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.481 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.481 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [ 2024-05-08T05:33:46.481 INFO:teuthology.orchestra.run.smithi087.stdout: "", 2024-05-08T05:33:46.481 INFO:teuthology.orchestra.run.smithi087.stdout: "critical", 2024-05-08T05:33:46.481 INFO:teuthology.orchestra.run.smithi087.stdout: "debug", 2024-05-08T05:33:46.481 INFO:teuthology.orchestra.run.smithi087.stdout: "error", 2024-05-08T05:33:46.481 INFO:teuthology.orchestra.run.smithi087.stdout: "info", 2024-05-08T05:33:46.481 INFO:teuthology.orchestra.run.smithi087.stdout: "warning" 2024-05-08T05:33:46.481 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-05-08T05:33:46.482 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:46.482 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.482 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.482 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.482 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.482 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_cluster": { 2024-05-08T05:33:46.482 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_cluster", 2024-05-08T05:33:46.482 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-08T05:33:46.482 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.482 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:46.482 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-05-08T05:33:46.483 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.483 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.483 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.483 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:46.483 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.483 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.483 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.483 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.483 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_cluster_level": { 2024-05-08T05:33:46.483 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_cluster_level", 2024-05-08T05:33:46.483 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-08T05:33:46.483 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.484 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:46.484 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "info", 2024-05-08T05:33:46.484 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.484 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.484 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [ 2024-05-08T05:33:46.484 INFO:teuthology.orchestra.run.smithi087.stdout: "", 2024-05-08T05:33:46.484 INFO:teuthology.orchestra.run.smithi087.stdout: "critical", 2024-05-08T05:33:46.484 INFO:teuthology.orchestra.run.smithi087.stdout: "debug", 2024-05-08T05:33:46.484 INFO:teuthology.orchestra.run.smithi087.stdout: "error", 2024-05-08T05:33:46.484 INFO:teuthology.orchestra.run.smithi087.stdout: "info", 2024-05-08T05:33:46.484 INFO:teuthology.orchestra.run.smithi087.stdout: "warning" 2024-05-08T05:33:46.484 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-05-08T05:33:46.485 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:46.485 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.485 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.485 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.485 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.485 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_file": { 2024-05-08T05:33:46.485 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_file", 2024-05-08T05:33:46.485 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-08T05:33:46.485 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.485 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:46.485 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-05-08T05:33:46.485 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.485 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.486 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.486 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:46.486 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.486 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.486 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.486 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.486 INFO:teuthology.orchestra.run.smithi087.stdout: "smtp_destination": { 2024-05-08T05:33:46.486 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "smtp_destination", 2024-05-08T05:33:46.486 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-08T05:33:46.486 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.486 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:46.486 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-05-08T05:33:46.487 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.487 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.487 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.487 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "Email address to send alerts to", 2024-05-08T05:33:46.487 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.487 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.487 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.487 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.487 INFO:teuthology.orchestra.run.smithi087.stdout: "smtp_from_name": { 2024-05-08T05:33:46.487 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "smtp_from_name", 2024-05-08T05:33:46.487 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-08T05:33:46.487 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.488 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:46.488 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "Ceph", 2024-05-08T05:33:46.488 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.488 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.488 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.488 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "Email From: name", 2024-05-08T05:33:46.488 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.488 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.488 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.488 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.488 INFO:teuthology.orchestra.run.smithi087.stdout: "smtp_host": { 2024-05-08T05:33:46.488 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "smtp_host", 2024-05-08T05:33:46.489 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-08T05:33:46.489 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.489 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:46.489 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-05-08T05:33:46.489 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.489 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.489 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.489 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "SMTP server", 2024-05-08T05:33:46.489 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.489 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.489 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.489 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.490 INFO:teuthology.orchestra.run.smithi087.stdout: "smtp_password": { 2024-05-08T05:33:46.490 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "smtp_password", 2024-05-08T05:33:46.490 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-08T05:33:46.490 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.490 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:46.490 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-05-08T05:33:46.490 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.490 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.490 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.490 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "Password to authenticate with", 2024-05-08T05:33:46.490 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.490 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.491 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.491 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.491 INFO:teuthology.orchestra.run.smithi087.stdout: "smtp_port": { 2024-05-08T05:33:46.491 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "smtp_port", 2024-05-08T05:33:46.491 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "int", 2024-05-08T05:33:46.491 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.491 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:46.491 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "465", 2024-05-08T05:33:46.491 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.491 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.491 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.492 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "SMTP port", 2024-05-08T05:33:46.492 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.492 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.492 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.492 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.492 INFO:teuthology.orchestra.run.smithi087.stdout: "smtp_sender": { 2024-05-08T05:33:46.492 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "smtp_sender", 2024-05-08T05:33:46.492 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-08T05:33:46.492 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.492 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:46.492 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-05-08T05:33:46.492 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.493 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.493 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.493 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "SMTP envelope sender", 2024-05-08T05:33:46.493 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.493 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.493 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.493 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.493 INFO:teuthology.orchestra.run.smithi087.stdout: "smtp_ssl": { 2024-05-08T05:33:46.493 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "smtp_ssl", 2024-05-08T05:33:46.493 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-08T05:33:46.493 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.493 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:46.493 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "True", 2024-05-08T05:33:46.494 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.494 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.494 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.494 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "Use SSL to connect to SMTP server", 2024-05-08T05:33:46.494 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.494 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.494 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.494 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.494 INFO:teuthology.orchestra.run.smithi087.stdout: "smtp_user": { 2024-05-08T05:33:46.494 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "smtp_user", 2024-05-08T05:33:46.494 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-08T05:33:46.495 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.495 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:46.495 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-05-08T05:33:46.495 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.495 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.495 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.495 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "User to authenticate as", 2024-05-08T05:33:46.495 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.495 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.495 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.495 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.495 INFO:teuthology.orchestra.run.smithi087.stdout: "sqlite3_killpoint": { 2024-05-08T05:33:46.495 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "sqlite3_killpoint", 2024-05-08T05:33:46.496 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "int", 2024-05-08T05:33:46.496 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "dev", 2024-05-08T05:33:46.496 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:46.496 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "0", 2024-05-08T05:33:46.496 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.496 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.496 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.496 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:46.496 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.496 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.496 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.496 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-05-08T05:33:46.496 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-05-08T05:33:46.497 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.497 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-05-08T05:33:46.497 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "balancer", 2024-05-08T05:33:46.497 INFO:teuthology.orchestra.run.smithi087.stdout: "can_run": true, 2024-05-08T05:33:46.497 INFO:teuthology.orchestra.run.smithi087.stdout: "error_string": "", 2024-05-08T05:33:46.497 INFO:teuthology.orchestra.run.smithi087.stdout: "module_options": { 2024-05-08T05:33:46.497 INFO:teuthology.orchestra.run.smithi087.stdout: "active": { 2024-05-08T05:33:46.497 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "active", 2024-05-08T05:33:46.497 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-08T05:33:46.497 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.497 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:46.497 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "True", 2024-05-08T05:33:46.497 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.497 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.498 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.498 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "automatically balance PGs across cluster", 2024-05-08T05:33:46.498 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.498 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.498 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.498 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.498 INFO:teuthology.orchestra.run.smithi087.stdout: "begin_time": { 2024-05-08T05:33:46.498 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "begin_time", 2024-05-08T05:33:46.498 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-08T05:33:46.498 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.498 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:46.498 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "0000", 2024-05-08T05:33:46.499 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.499 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.499 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.499 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "beginning time of day to automatically balance", 2024-05-08T05:33:46.499 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-05-08T05:33:46.499 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.499 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.499 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.499 INFO:teuthology.orchestra.run.smithi087.stdout: "begin_weekday": { 2024-05-08T05:33:46.499 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "begin_weekday", 2024-05-08T05:33:46.499 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "uint", 2024-05-08T05:33:46.499 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.499 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:46.499 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "0", 2024-05-08T05:33:46.500 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "0", 2024-05-08T05:33:46.500 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "6", 2024-05-08T05:33:46.500 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.500 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2024-05-08T05:33:46.500 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-05-08T05:33:46.500 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.500 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.500 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.500 INFO:teuthology.orchestra.run.smithi087.stdout: "crush_compat_max_iterations": { 2024-05-08T05:33:46.500 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "crush_compat_max_iterations", 2024-05-08T05:33:46.500 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "uint", 2024-05-08T05:33:46.500 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.500 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:46.500 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "25", 2024-05-08T05:33:46.501 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "1", 2024-05-08T05:33:46.501 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "250", 2024-05-08T05:33:46.501 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.501 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "maximum number of iterations to attempt optimization", 2024-05-08T05:33:46.501 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.501 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.501 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.501 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.501 INFO:teuthology.orchestra.run.smithi087.stdout: "crush_compat_metrics": { 2024-05-08T05:33:46.501 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "crush_compat_metrics", 2024-05-08T05:33:46.501 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-08T05:33:46.501 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.502 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:46.502 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "pgs,objects,bytes", 2024-05-08T05:33:46.502 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.502 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.502 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.502 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "metrics with which to calculate OSD utilization", 2024-05-08T05:33:46.502 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2024-05-08T05:33:46.502 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.502 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.502 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.502 INFO:teuthology.orchestra.run.smithi087.stdout: "crush_compat_step": { 2024-05-08T05:33:46.502 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "crush_compat_step", 2024-05-08T05:33:46.503 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "float", 2024-05-08T05:33:46.503 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.503 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:46.503 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "0.5", 2024-05-08T05:33:46.503 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "0.001", 2024-05-08T05:33:46.503 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "0.999", 2024-05-08T05:33:46.503 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.503 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "aggressiveness of optimization", 2024-05-08T05:33:46.503 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2024-05-08T05:33:46.503 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.503 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.503 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.504 INFO:teuthology.orchestra.run.smithi087.stdout: "end_time": { 2024-05-08T05:33:46.504 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "end_time", 2024-05-08T05:33:46.504 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-08T05:33:46.504 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.504 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:46.504 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "2359", 2024-05-08T05:33:46.504 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.504 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.504 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.504 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "ending time of day to automatically balance", 2024-05-08T05:33:46.504 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-05-08T05:33:46.505 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.505 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.505 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.505 INFO:teuthology.orchestra.run.smithi087.stdout: "end_weekday": { 2024-05-08T05:33:46.505 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "end_weekday", 2024-05-08T05:33:46.505 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "uint", 2024-05-08T05:33:46.505 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.505 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:46.505 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "0", 2024-05-08T05:33:46.505 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "0", 2024-05-08T05:33:46.505 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "6", 2024-05-08T05:33:46.505 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.505 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2024-05-08T05:33:46.506 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-05-08T05:33:46.506 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.506 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.506 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.506 INFO:teuthology.orchestra.run.smithi087.stdout: "log_level": { 2024-05-08T05:33:46.506 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_level", 2024-05-08T05:33:46.506 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-08T05:33:46.506 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.506 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:46.506 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-05-08T05:33:46.506 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.506 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.507 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [ 2024-05-08T05:33:46.507 INFO:teuthology.orchestra.run.smithi087.stdout: "", 2024-05-08T05:33:46.507 INFO:teuthology.orchestra.run.smithi087.stdout: "critical", 2024-05-08T05:33:46.507 INFO:teuthology.orchestra.run.smithi087.stdout: "debug", 2024-05-08T05:33:46.507 INFO:teuthology.orchestra.run.smithi087.stdout: "error", 2024-05-08T05:33:46.507 INFO:teuthology.orchestra.run.smithi087.stdout: "info", 2024-05-08T05:33:46.507 INFO:teuthology.orchestra.run.smithi087.stdout: "warning" 2024-05-08T05:33:46.507 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-05-08T05:33:46.507 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:46.507 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.507 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.507 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.508 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.508 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_cluster": { 2024-05-08T05:33:46.508 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_cluster", 2024-05-08T05:33:46.508 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-08T05:33:46.508 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.508 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:46.508 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-05-08T05:33:46.508 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.508 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.508 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.508 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:46.508 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.509 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.509 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.509 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.509 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_cluster_level": { 2024-05-08T05:33:46.509 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_cluster_level", 2024-05-08T05:33:46.509 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-08T05:33:46.509 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.509 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:46.509 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "info", 2024-05-08T05:33:46.509 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.509 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.509 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [ 2024-05-08T05:33:46.510 INFO:teuthology.orchestra.run.smithi087.stdout: "", 2024-05-08T05:33:46.510 INFO:teuthology.orchestra.run.smithi087.stdout: "critical", 2024-05-08T05:33:46.510 INFO:teuthology.orchestra.run.smithi087.stdout: "debug", 2024-05-08T05:33:46.510 INFO:teuthology.orchestra.run.smithi087.stdout: "error", 2024-05-08T05:33:46.510 INFO:teuthology.orchestra.run.smithi087.stdout: "info", 2024-05-08T05:33:46.510 INFO:teuthology.orchestra.run.smithi087.stdout: "warning" 2024-05-08T05:33:46.510 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-05-08T05:33:46.510 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:46.510 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.510 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.510 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.511 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.511 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_file": { 2024-05-08T05:33:46.511 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_file", 2024-05-08T05:33:46.511 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-08T05:33:46.511 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.511 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:46.511 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-05-08T05:33:46.511 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.511 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.511 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.511 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:46.511 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.512 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.512 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.512 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.512 INFO:teuthology.orchestra.run.smithi087.stdout: "min_score": { 2024-05-08T05:33:46.512 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "min_score", 2024-05-08T05:33:46.512 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "float", 2024-05-08T05:33:46.512 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.512 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:46.512 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "0", 2024-05-08T05:33:46.512 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.512 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.512 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.512 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "minimum score, below which no optimization is attempted", 2024-05-08T05:33:46.513 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.513 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.513 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.513 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.513 INFO:teuthology.orchestra.run.smithi087.stdout: "mode": { 2024-05-08T05:33:46.513 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "mode", 2024-05-08T05:33:46.513 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-08T05:33:46.513 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.513 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:46.513 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "upmap", 2024-05-08T05:33:46.513 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.513 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.514 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [ 2024-05-08T05:33:46.514 INFO:teuthology.orchestra.run.smithi087.stdout: "crush-compat", 2024-05-08T05:33:46.514 INFO:teuthology.orchestra.run.smithi087.stdout: "none", 2024-05-08T05:33:46.514 INFO:teuthology.orchestra.run.smithi087.stdout: "read", 2024-05-08T05:33:46.514 INFO:teuthology.orchestra.run.smithi087.stdout: "upmap", 2024-05-08T05:33:46.514 INFO:teuthology.orchestra.run.smithi087.stdout: "upmap-read" 2024-05-08T05:33:46.514 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-05-08T05:33:46.514 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "Balancer mode", 2024-05-08T05:33:46.514 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.514 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.514 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.514 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.514 INFO:teuthology.orchestra.run.smithi087.stdout: "pool_ids": { 2024-05-08T05:33:46.514 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "pool_ids", 2024-05-08T05:33:46.515 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-08T05:33:46.515 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.515 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:46.515 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-05-08T05:33:46.515 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.515 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.515 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.515 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "pools which the automatic balancing will be limited to", 2024-05-08T05:33:46.515 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.515 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.515 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.515 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.516 INFO:teuthology.orchestra.run.smithi087.stdout: "sleep_interval": { 2024-05-08T05:33:46.516 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "sleep_interval", 2024-05-08T05:33:46.516 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "secs", 2024-05-08T05:33:46.516 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.516 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:46.516 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "60", 2024-05-08T05:33:46.516 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.516 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.516 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.516 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "how frequently to wake up and attempt optimization", 2024-05-08T05:33:46.516 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.516 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.516 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.517 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.517 INFO:teuthology.orchestra.run.smithi087.stdout: "sqlite3_killpoint": { 2024-05-08T05:33:46.517 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "sqlite3_killpoint", 2024-05-08T05:33:46.517 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "int", 2024-05-08T05:33:46.517 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "dev", 2024-05-08T05:33:46.517 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:46.517 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "0", 2024-05-08T05:33:46.517 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.517 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.517 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.517 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:46.517 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.517 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.518 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.518 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.518 INFO:teuthology.orchestra.run.smithi087.stdout: "upmap_max_deviation": { 2024-05-08T05:33:46.518 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "upmap_max_deviation", 2024-05-08T05:33:46.518 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "int", 2024-05-08T05:33:46.518 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.518 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:46.518 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "5", 2024-05-08T05:33:46.518 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "1", 2024-05-08T05:33:46.518 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.518 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.518 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "deviation below which no optimization is attempted", 2024-05-08T05:33:46.519 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2024-05-08T05:33:46.519 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.519 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.519 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.519 INFO:teuthology.orchestra.run.smithi087.stdout: "upmap_max_optimizations": { 2024-05-08T05:33:46.519 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "upmap_max_optimizations", 2024-05-08T05:33:46.519 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "uint", 2024-05-08T05:33:46.519 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.519 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:46.519 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "10", 2024-05-08T05:33:46.519 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.519 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.520 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.520 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "maximum upmap optimizations to make per attempt", 2024-05-08T05:33:46.520 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.520 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.520 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.520 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-05-08T05:33:46.520 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-05-08T05:33:46.520 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.520 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-05-08T05:33:46.520 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "cephadm", 2024-05-08T05:33:46.520 INFO:teuthology.orchestra.run.smithi087.stdout: "can_run": true, 2024-05-08T05:33:46.520 INFO:teuthology.orchestra.run.smithi087.stdout: "error_string": "", 2024-05-08T05:33:46.521 INFO:teuthology.orchestra.run.smithi087.stdout: "module_options": { 2024-05-08T05:33:46.521 INFO:teuthology.orchestra.run.smithi087.stdout: "agent_down_multiplier": { 2024-05-08T05:33:46.521 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "agent_down_multiplier", 2024-05-08T05:33:46.521 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "float", 2024-05-08T05:33:46.521 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.521 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-08T05:33:46.521 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "3.0", 2024-05-08T05:33:46.521 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.521 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.521 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.521 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2024-05-08T05:33:46.521 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.522 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.522 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.522 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.522 INFO:teuthology.orchestra.run.smithi087.stdout: "agent_refresh_rate": { 2024-05-08T05:33:46.522 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "agent_refresh_rate", 2024-05-08T05:33:46.522 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "secs", 2024-05-08T05:33:46.522 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.522 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-08T05:33:46.522 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "20", 2024-05-08T05:33:46.522 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.522 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.523 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.523 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2024-05-08T05:33:46.523 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.523 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.523 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.523 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.523 INFO:teuthology.orchestra.run.smithi087.stdout: "agent_starting_port": { 2024-05-08T05:33:46.523 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "agent_starting_port", 2024-05-08T05:33:46.523 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "int", 2024-05-08T05:33:46.523 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.523 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-08T05:33:46.523 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "4721", 2024-05-08T05:33:46.523 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.524 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.524 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.524 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2024-05-08T05:33:46.524 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.524 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.524 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.524 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.524 INFO:teuthology.orchestra.run.smithi087.stdout: "allow_ptrace": { 2024-05-08T05:33:46.524 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "allow_ptrace", 2024-05-08T05:33:46.524 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-08T05:33:46.524 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.524 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-08T05:33:46.525 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-05-08T05:33:46.525 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.525 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.525 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.525 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2024-05-08T05:33:46.525 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2024-05-08T05:33:46.525 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.525 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.525 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.525 INFO:teuthology.orchestra.run.smithi087.stdout: "autotune_interval": { 2024-05-08T05:33:46.526 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "autotune_interval", 2024-05-08T05:33:46.526 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "secs", 2024-05-08T05:33:46.526 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.526 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-08T05:33:46.526 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "600", 2024-05-08T05:33:46.526 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.526 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.526 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.526 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "how frequently to autotune daemon memory", 2024-05-08T05:33:46.526 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.526 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.526 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.527 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.527 INFO:teuthology.orchestra.run.smithi087.stdout: "autotune_memory_target_ratio": { 2024-05-08T05:33:46.527 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "autotune_memory_target_ratio", 2024-05-08T05:33:46.527 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "float", 2024-05-08T05:33:46.527 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.527 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-08T05:33:46.527 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "0.7", 2024-05-08T05:33:46.527 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.527 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.527 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.527 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2024-05-08T05:33:46.527 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.527 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.528 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.528 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.528 INFO:teuthology.orchestra.run.smithi087.stdout: "cephadm_log_destination": { 2024-05-08T05:33:46.528 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "cephadm_log_destination", 2024-05-08T05:33:46.528 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-08T05:33:46.528 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.528 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-08T05:33:46.528 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-05-08T05:33:46.528 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.528 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.528 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [ 2024-05-08T05:33:46.528 INFO:teuthology.orchestra.run.smithi087.stdout: "file", 2024-05-08T05:33:46.528 INFO:teuthology.orchestra.run.smithi087.stdout: "file,syslog", 2024-05-08T05:33:46.528 INFO:teuthology.orchestra.run.smithi087.stdout: "syslog" 2024-05-08T05:33:46.529 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-05-08T05:33:46.529 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "Destination for cephadm command's persistent logging", 2024-05-08T05:33:46.529 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.529 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.529 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.529 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.529 INFO:teuthology.orchestra.run.smithi087.stdout: "cgroups_split": { 2024-05-08T05:33:46.529 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "cgroups_split", 2024-05-08T05:33:46.529 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-08T05:33:46.529 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.529 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-08T05:33:46.529 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "True", 2024-05-08T05:33:46.529 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.529 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.530 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.530 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2024-05-08T05:33:46.530 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.530 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.530 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.530 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.530 INFO:teuthology.orchestra.run.smithi087.stdout: "config_checks_enabled": { 2024-05-08T05:33:46.530 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "config_checks_enabled", 2024-05-08T05:33:46.530 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-08T05:33:46.530 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.530 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-08T05:33:46.531 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-05-08T05:33:46.531 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.531 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.531 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.531 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2024-05-08T05:33:46.531 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.531 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.531 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.531 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.531 INFO:teuthology.orchestra.run.smithi087.stdout: "config_dashboard": { 2024-05-08T05:33:46.531 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "config_dashboard", 2024-05-08T05:33:46.531 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-08T05:33:46.531 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.532 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-08T05:33:46.532 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "True", 2024-05-08T05:33:46.532 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.532 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.532 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.532 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2024-05-08T05:33:46.532 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.532 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.532 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.532 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.532 INFO:teuthology.orchestra.run.smithi087.stdout: "container_image_alertmanager": { 2024-05-08T05:33:46.532 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "container_image_alertmanager", 2024-05-08T05:33:46.533 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-08T05:33:46.533 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.533 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-08T05:33:46.533 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.25.0", 2024-05-08T05:33:46.533 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.533 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.533 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.533 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "Prometheus container image", 2024-05-08T05:33:46.533 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.533 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.533 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.534 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.534 INFO:teuthology.orchestra.run.smithi087.stdout: "container_image_base": { 2024-05-08T05:33:46.534 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "container_image_base", 2024-05-08T05:33:46.534 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-08T05:33:46.534 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.534 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:46.534 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "quay.io/ceph/ceph", 2024-05-08T05:33:46.534 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.534 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.534 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.534 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "Container image name, without the tag", 2024-05-08T05:33:46.534 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.535 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.535 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.535 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.535 INFO:teuthology.orchestra.run.smithi087.stdout: "container_image_elasticsearch": { 2024-05-08T05:33:46.535 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "container_image_elasticsearch", 2024-05-08T05:33:46.535 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-08T05:33:46.535 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.535 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-08T05:33:46.535 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2024-05-08T05:33:46.535 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.535 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.536 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.536 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "elasticsearch container image", 2024-05-08T05:33:46.536 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.536 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.536 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.536 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.536 INFO:teuthology.orchestra.run.smithi087.stdout: "container_image_grafana": { 2024-05-08T05:33:46.536 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "container_image_grafana", 2024-05-08T05:33:46.536 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-08T05:33:46.536 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.536 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-08T05:33:46.536 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "quay.io/ceph/grafana:9.4.12", 2024-05-08T05:33:46.537 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.537 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.537 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.537 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "Prometheus container image", 2024-05-08T05:33:46.537 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.537 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.537 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.537 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.537 INFO:teuthology.orchestra.run.smithi087.stdout: "container_image_haproxy": { 2024-05-08T05:33:46.537 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "container_image_haproxy", 2024-05-08T05:33:46.537 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-08T05:33:46.537 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.538 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-08T05:33:46.538 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2024-05-08T05:33:46.538 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.538 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.538 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.538 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "HAproxy container image", 2024-05-08T05:33:46.538 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.538 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.538 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.538 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.538 INFO:teuthology.orchestra.run.smithi087.stdout: "container_image_jaeger_agent": { 2024-05-08T05:33:46.539 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "container_image_jaeger_agent", 2024-05-08T05:33:46.539 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-08T05:33:46.539 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.539 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-08T05:33:46.539 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2024-05-08T05:33:46.539 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.539 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.539 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.539 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "Jaeger agent container image", 2024-05-08T05:33:46.539 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.539 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.539 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.540 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.540 INFO:teuthology.orchestra.run.smithi087.stdout: "container_image_jaeger_collector": { 2024-05-08T05:33:46.540 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "container_image_jaeger_collector", 2024-05-08T05:33:46.540 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-08T05:33:46.540 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.540 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-08T05:33:46.540 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2024-05-08T05:33:46.540 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.540 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.540 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.540 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "Jaeger collector container image", 2024-05-08T05:33:46.540 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.541 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.541 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.541 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.541 INFO:teuthology.orchestra.run.smithi087.stdout: "container_image_jaeger_query": { 2024-05-08T05:33:46.541 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "container_image_jaeger_query", 2024-05-08T05:33:46.541 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-08T05:33:46.541 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.541 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-08T05:33:46.541 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2024-05-08T05:33:46.541 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.541 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.542 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.542 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "Jaeger query container image", 2024-05-08T05:33:46.542 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.542 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.542 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.542 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.542 INFO:teuthology.orchestra.run.smithi087.stdout: "container_image_keepalived": { 2024-05-08T05:33:46.542 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "container_image_keepalived", 2024-05-08T05:33:46.542 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-08T05:33:46.542 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.543 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-08T05:33:46.543 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2024-05-08T05:33:46.543 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.543 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.543 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.543 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "Keepalived container image", 2024-05-08T05:33:46.543 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.543 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.543 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.543 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.543 INFO:teuthology.orchestra.run.smithi087.stdout: "container_image_loki": { 2024-05-08T05:33:46.543 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "container_image_loki", 2024-05-08T05:33:46.544 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-08T05:33:46.544 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.544 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-08T05:33:46.544 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "docker.io/grafana/loki:2.4.0", 2024-05-08T05:33:46.544 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.544 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.544 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.544 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "Loki container image", 2024-05-08T05:33:46.544 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.544 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.544 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.544 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.544 INFO:teuthology.orchestra.run.smithi087.stdout: "container_image_node_exporter": { 2024-05-08T05:33:46.544 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "container_image_node_exporter", 2024-05-08T05:33:46.545 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-08T05:33:46.545 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.545 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-08T05:33:46.545 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.5.0", 2024-05-08T05:33:46.545 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.545 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.545 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.545 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "Prometheus container image", 2024-05-08T05:33:46.545 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.545 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.545 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.545 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.546 INFO:teuthology.orchestra.run.smithi087.stdout: "container_image_nvmeof": { 2024-05-08T05:33:46.546 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "container_image_nvmeof", 2024-05-08T05:33:46.546 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-08T05:33:46.546 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.546 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-08T05:33:46.546 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "quay.io/ceph/nvmeof:1.2.1", 2024-05-08T05:33:46.546 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.546 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.546 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.546 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "Nvme-of container image", 2024-05-08T05:33:46.546 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.546 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.546 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.547 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.547 INFO:teuthology.orchestra.run.smithi087.stdout: "container_image_prometheus": { 2024-05-08T05:33:46.547 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "container_image_prometheus", 2024-05-08T05:33:46.547 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-08T05:33:46.547 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.547 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-08T05:33:46.547 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "quay.io/prometheus/prometheus:v2.43.0", 2024-05-08T05:33:46.547 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.547 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.547 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.547 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "Prometheus container image", 2024-05-08T05:33:46.548 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.548 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.548 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.548 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.548 INFO:teuthology.orchestra.run.smithi087.stdout: "container_image_promtail": { 2024-05-08T05:33:46.548 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "container_image_promtail", 2024-05-08T05:33:46.548 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-08T05:33:46.548 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.548 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-08T05:33:46.548 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "docker.io/grafana/promtail:2.4.0", 2024-05-08T05:33:46.548 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.548 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.549 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.549 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "Promtail container image", 2024-05-08T05:33:46.549 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.549 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.549 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.549 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.549 INFO:teuthology.orchestra.run.smithi087.stdout: "container_image_samba": { 2024-05-08T05:33:46.549 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "container_image_samba", 2024-05-08T05:33:46.549 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-08T05:33:46.549 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.549 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-08T05:33:46.549 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "quay.io/samba.org/samba-server:devbuilds-centos-amd64", 2024-05-08T05:33:46.550 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.550 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.550 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.550 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "Samba/SMB container image", 2024-05-08T05:33:46.550 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.550 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.550 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.550 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.550 INFO:teuthology.orchestra.run.smithi087.stdout: "container_image_snmp_gateway": { 2024-05-08T05:33:46.550 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "container_image_snmp_gateway", 2024-05-08T05:33:46.550 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-08T05:33:46.551 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.551 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-08T05:33:46.551 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2024-05-08T05:33:46.551 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.551 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.551 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.551 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "SNMP Gateway container image", 2024-05-08T05:33:46.551 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.551 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.551 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.551 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.551 INFO:teuthology.orchestra.run.smithi087.stdout: "container_init": { 2024-05-08T05:33:46.552 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "container_init", 2024-05-08T05:33:46.552 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-08T05:33:46.552 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.552 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-08T05:33:46.552 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "True", 2024-05-08T05:33:46.552 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.552 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.552 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.552 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "Run podman/docker with `--init`", 2024-05-08T05:33:46.552 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.552 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.552 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.553 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.553 INFO:teuthology.orchestra.run.smithi087.stdout: "daemon_cache_timeout": { 2024-05-08T05:33:46.553 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "daemon_cache_timeout", 2024-05-08T05:33:46.553 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "secs", 2024-05-08T05:33:46.553 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.553 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-08T05:33:46.553 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "600", 2024-05-08T05:33:46.553 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.553 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.553 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.553 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "seconds to cache service (daemon) inventory", 2024-05-08T05:33:46.553 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.554 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.554 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.554 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.554 INFO:teuthology.orchestra.run.smithi087.stdout: "default_cephadm_command_timeout": { 2024-05-08T05:33:46.554 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "default_cephadm_command_timeout", 2024-05-08T05:33:46.554 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "int", 2024-05-08T05:33:46.554 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.554 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-08T05:33:46.554 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "900", 2024-05-08T05:33:46.554 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.554 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.555 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.555 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2024-05-08T05:33:46.555 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.555 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.555 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.555 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.555 INFO:teuthology.orchestra.run.smithi087.stdout: "default_registry": { 2024-05-08T05:33:46.555 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "default_registry", 2024-05-08T05:33:46.555 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-08T05:33:46.555 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.555 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-08T05:33:46.555 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "docker.io", 2024-05-08T05:33:46.555 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.556 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.556 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.556 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2024-05-08T05:33:46.556 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.556 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.556 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.556 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.556 INFO:teuthology.orchestra.run.smithi087.stdout: "device_cache_timeout": { 2024-05-08T05:33:46.556 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "device_cache_timeout", 2024-05-08T05:33:46.556 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "secs", 2024-05-08T05:33:46.556 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.556 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-08T05:33:46.556 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "1800", 2024-05-08T05:33:46.557 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.557 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.557 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.557 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "seconds to cache device inventory", 2024-05-08T05:33:46.557 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.557 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.557 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.557 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.557 INFO:teuthology.orchestra.run.smithi087.stdout: "device_enhanced_scan": { 2024-05-08T05:33:46.557 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "device_enhanced_scan", 2024-05-08T05:33:46.557 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-08T05:33:46.557 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.558 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-08T05:33:46.558 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-05-08T05:33:46.558 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.558 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.558 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.558 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "Use libstoragemgmt during device scans", 2024-05-08T05:33:46.558 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.558 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.558 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.558 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.558 INFO:teuthology.orchestra.run.smithi087.stdout: "facts_cache_timeout": { 2024-05-08T05:33:46.558 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "facts_cache_timeout", 2024-05-08T05:33:46.559 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "secs", 2024-05-08T05:33:46.559 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.559 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-08T05:33:46.559 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "60", 2024-05-08T05:33:46.559 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.559 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.559 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.559 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "seconds to cache host facts data", 2024-05-08T05:33:46.559 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.559 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.559 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.559 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.559 INFO:teuthology.orchestra.run.smithi087.stdout: "grafana_dashboards_path": { 2024-05-08T05:33:46.560 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "grafana_dashboards_path", 2024-05-08T05:33:46.560 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-08T05:33:46.560 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.560 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-08T05:33:46.560 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "/etc/grafana/dashboards/ceph-dashboard/", 2024-05-08T05:33:46.560 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.560 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.560 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.560 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "location of dashboards to include in grafana deployments", 2024-05-08T05:33:46.560 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.560 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.560 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.560 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.561 INFO:teuthology.orchestra.run.smithi087.stdout: "host_check_interval": { 2024-05-08T05:33:46.561 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "host_check_interval", 2024-05-08T05:33:46.561 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "secs", 2024-05-08T05:33:46.561 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.561 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-08T05:33:46.561 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "600", 2024-05-08T05:33:46.561 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.561 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.561 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.561 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "how frequently to perform a host check", 2024-05-08T05:33:46.561 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.562 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.562 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.562 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.562 INFO:teuthology.orchestra.run.smithi087.stdout: "hw_monitoring": { 2024-05-08T05:33:46.562 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "hw_monitoring", 2024-05-08T05:33:46.562 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-08T05:33:46.562 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.562 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-08T05:33:46.562 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-05-08T05:33:46.562 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.562 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.562 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.563 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "Deploy hw monitoring daemon on every host.", 2024-05-08T05:33:46.563 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.563 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.563 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.563 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.563 INFO:teuthology.orchestra.run.smithi087.stdout: "inventory_list_all": { 2024-05-08T05:33:46.563 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "inventory_list_all", 2024-05-08T05:33:46.563 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-08T05:33:46.563 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.563 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-08T05:33:46.563 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-05-08T05:33:46.563 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.563 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.563 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.564 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2024-05-08T05:33:46.564 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.564 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.564 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.564 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.564 INFO:teuthology.orchestra.run.smithi087.stdout: "log_level": { 2024-05-08T05:33:46.564 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_level", 2024-05-08T05:33:46.564 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-08T05:33:46.564 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.564 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:46.564 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-05-08T05:33:46.564 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.565 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.565 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [ 2024-05-08T05:33:46.565 INFO:teuthology.orchestra.run.smithi087.stdout: "", 2024-05-08T05:33:46.565 INFO:teuthology.orchestra.run.smithi087.stdout: "critical", 2024-05-08T05:33:46.565 INFO:teuthology.orchestra.run.smithi087.stdout: "debug", 2024-05-08T05:33:46.565 INFO:teuthology.orchestra.run.smithi087.stdout: "error", 2024-05-08T05:33:46.565 INFO:teuthology.orchestra.run.smithi087.stdout: "info", 2024-05-08T05:33:46.565 INFO:teuthology.orchestra.run.smithi087.stdout: "warning" 2024-05-08T05:33:46.565 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-05-08T05:33:46.565 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:46.565 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.565 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.565 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.566 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.566 INFO:teuthology.orchestra.run.smithi087.stdout: "log_refresh_metadata": { 2024-05-08T05:33:46.566 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_refresh_metadata", 2024-05-08T05:33:46.566 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-08T05:33:46.566 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.566 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-08T05:33:46.566 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-05-08T05:33:46.566 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.566 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.566 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.566 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2024-05-08T05:33:46.567 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.567 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.567 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.567 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.567 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_cluster": { 2024-05-08T05:33:46.567 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_cluster", 2024-05-08T05:33:46.567 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-08T05:33:46.567 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.567 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-08T05:33:46.567 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "True", 2024-05-08T05:33:46.567 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.567 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.567 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.568 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2024-05-08T05:33:46.568 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.568 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.568 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.568 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.568 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_cluster_level": { 2024-05-08T05:33:46.568 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_cluster_level", 2024-05-08T05:33:46.568 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-08T05:33:46.568 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.568 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:46.568 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "info", 2024-05-08T05:33:46.568 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.569 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.569 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [ 2024-05-08T05:33:46.569 INFO:teuthology.orchestra.run.smithi087.stdout: "", 2024-05-08T05:33:46.569 INFO:teuthology.orchestra.run.smithi087.stdout: "critical", 2024-05-08T05:33:46.569 INFO:teuthology.orchestra.run.smithi087.stdout: "debug", 2024-05-08T05:33:46.569 INFO:teuthology.orchestra.run.smithi087.stdout: "error", 2024-05-08T05:33:46.569 INFO:teuthology.orchestra.run.smithi087.stdout: "info", 2024-05-08T05:33:46.569 INFO:teuthology.orchestra.run.smithi087.stdout: "warning" 2024-05-08T05:33:46.569 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-05-08T05:33:46.569 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:46.569 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.569 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.569 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.570 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.570 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_file": { 2024-05-08T05:33:46.570 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_file", 2024-05-08T05:33:46.570 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-08T05:33:46.570 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.570 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:46.570 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-05-08T05:33:46.570 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.570 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.570 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.570 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:46.571 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.571 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.571 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.571 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.571 INFO:teuthology.orchestra.run.smithi087.stdout: "manage_etc_ceph_ceph_conf": { 2024-05-08T05:33:46.571 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "manage_etc_ceph_ceph_conf", 2024-05-08T05:33:46.571 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-08T05:33:46.571 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.571 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-08T05:33:46.571 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-05-08T05:33:46.571 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.571 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.571 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.571 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2024-05-08T05:33:46.572 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.572 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.572 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.572 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.572 INFO:teuthology.orchestra.run.smithi087.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2024-05-08T05:33:46.572 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2024-05-08T05:33:46.572 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-08T05:33:46.572 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.572 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-08T05:33:46.572 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "*", 2024-05-08T05:33:46.572 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.572 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.572 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.572 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2024-05-08T05:33:46.573 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.573 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.573 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.573 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.573 INFO:teuthology.orchestra.run.smithi087.stdout: "max_count_per_host": { 2024-05-08T05:33:46.573 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "max_count_per_host", 2024-05-08T05:33:46.573 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "int", 2024-05-08T05:33:46.573 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.573 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-08T05:33:46.573 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "10", 2024-05-08T05:33:46.573 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.573 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.573 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.573 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "max number of daemons per service per host", 2024-05-08T05:33:46.574 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.574 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.574 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.574 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.574 INFO:teuthology.orchestra.run.smithi087.stdout: "max_osd_draining_count": { 2024-05-08T05:33:46.574 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "max_osd_draining_count", 2024-05-08T05:33:46.574 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "int", 2024-05-08T05:33:46.574 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.574 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-08T05:33:46.574 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "10", 2024-05-08T05:33:46.574 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.574 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.575 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.575 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2024-05-08T05:33:46.575 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.575 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.575 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.575 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.575 INFO:teuthology.orchestra.run.smithi087.stdout: "migration_current": { 2024-05-08T05:33:46.575 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "migration_current", 2024-05-08T05:33:46.575 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "int", 2024-05-08T05:33:46.575 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.575 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-08T05:33:46.575 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-05-08T05:33:46.576 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.576 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.576 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.576 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "internal - do not modify", 2024-05-08T05:33:46.576 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.576 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.576 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.576 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.576 INFO:teuthology.orchestra.run.smithi087.stdout: "mode": { 2024-05-08T05:33:46.576 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "mode", 2024-05-08T05:33:46.576 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-08T05:33:46.576 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.577 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-08T05:33:46.577 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "root", 2024-05-08T05:33:46.577 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.577 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.577 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [ 2024-05-08T05:33:46.577 INFO:teuthology.orchestra.run.smithi087.stdout: "cephadm-package", 2024-05-08T05:33:46.577 INFO:teuthology.orchestra.run.smithi087.stdout: "root" 2024-05-08T05:33:46.577 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-05-08T05:33:46.577 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "mode for remote execution of cephadm", 2024-05-08T05:33:46.577 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.577 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.577 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.577 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.577 INFO:teuthology.orchestra.run.smithi087.stdout: "oob_default_addr": { 2024-05-08T05:33:46.578 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "oob_default_addr", 2024-05-08T05:33:46.578 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-08T05:33:46.578 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.578 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-08T05:33:46.578 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "169.254.1.1", 2024-05-08T05:33:46.578 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.578 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.578 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.578 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "Default address for RedFish API (oob management).", 2024-05-08T05:33:46.578 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.578 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.578 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.579 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.579 INFO:teuthology.orchestra.run.smithi087.stdout: "prometheus_alerts_path": { 2024-05-08T05:33:46.579 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "prometheus_alerts_path", 2024-05-08T05:33:46.579 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-08T05:33:46.579 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.579 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-08T05:33:46.579 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2024-05-08T05:33:46.579 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.579 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.579 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.579 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "location of alerts to include in prometheus deployments", 2024-05-08T05:33:46.579 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.579 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.580 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.580 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.580 INFO:teuthology.orchestra.run.smithi087.stdout: "registry_insecure": { 2024-05-08T05:33:46.580 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "registry_insecure", 2024-05-08T05:33:46.580 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-08T05:33:46.580 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.580 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-08T05:33:46.580 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-05-08T05:33:46.580 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.580 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.580 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.580 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2024-05-08T05:33:46.580 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.581 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.581 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.581 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.581 INFO:teuthology.orchestra.run.smithi087.stdout: "registry_password": { 2024-05-08T05:33:46.581 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "registry_password", 2024-05-08T05:33:46.581 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-08T05:33:46.581 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.581 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-08T05:33:46.581 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-05-08T05:33:46.581 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.581 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.581 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.581 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2024-05-08T05:33:46.582 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.582 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.582 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.582 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.582 INFO:teuthology.orchestra.run.smithi087.stdout: "registry_url": { 2024-05-08T05:33:46.582 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "registry_url", 2024-05-08T05:33:46.582 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-08T05:33:46.582 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.582 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-08T05:33:46.582 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-05-08T05:33:46.582 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.582 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.583 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.583 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2024-05-08T05:33:46.583 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.583 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.583 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.583 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.583 INFO:teuthology.orchestra.run.smithi087.stdout: "registry_username": { 2024-05-08T05:33:46.583 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "registry_username", 2024-05-08T05:33:46.583 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-08T05:33:46.583 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.583 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-08T05:33:46.583 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-05-08T05:33:46.583 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.583 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.584 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.584 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2024-05-08T05:33:46.584 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.584 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.584 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.584 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.584 INFO:teuthology.orchestra.run.smithi087.stdout: "secure_monitoring_stack": { 2024-05-08T05:33:46.584 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "secure_monitoring_stack", 2024-05-08T05:33:46.584 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-08T05:33:46.584 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.584 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-08T05:33:46.584 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-05-08T05:33:46.584 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.584 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.585 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.585 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2024-05-08T05:33:46.585 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.585 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.585 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.585 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.585 INFO:teuthology.orchestra.run.smithi087.stdout: "service_discovery_port": { 2024-05-08T05:33:46.585 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "service_discovery_port", 2024-05-08T05:33:46.585 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "int", 2024-05-08T05:33:46.585 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.585 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-08T05:33:46.585 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "8765", 2024-05-08T05:33:46.585 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.586 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.586 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.586 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "cephadm service discovery port", 2024-05-08T05:33:46.586 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.586 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.586 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.586 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.586 INFO:teuthology.orchestra.run.smithi087.stdout: "sqlite3_killpoint": { 2024-05-08T05:33:46.586 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "sqlite3_killpoint", 2024-05-08T05:33:46.586 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "int", 2024-05-08T05:33:46.586 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "dev", 2024-05-08T05:33:46.586 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:46.586 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "0", 2024-05-08T05:33:46.586 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.587 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.587 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.587 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:46.587 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.587 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.587 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.587 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.587 INFO:teuthology.orchestra.run.smithi087.stdout: "ssh_config_file": { 2024-05-08T05:33:46.587 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "ssh_config_file", 2024-05-08T05:33:46.587 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-08T05:33:46.587 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.587 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-08T05:33:46.587 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-05-08T05:33:46.588 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.588 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.588 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.588 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "customized SSH config file to connect to managed hosts", 2024-05-08T05:33:46.588 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.588 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.588 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.588 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.588 INFO:teuthology.orchestra.run.smithi087.stdout: "use_agent": { 2024-05-08T05:33:46.588 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "use_agent", 2024-05-08T05:33:46.588 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-08T05:33:46.588 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.588 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-08T05:33:46.589 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-05-08T05:33:46.589 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.589 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.589 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.589 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2024-05-08T05:33:46.589 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.589 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.589 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.589 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.589 INFO:teuthology.orchestra.run.smithi087.stdout: "use_repo_digest": { 2024-05-08T05:33:46.589 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "use_repo_digest", 2024-05-08T05:33:46.589 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-08T05:33:46.589 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.590 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-08T05:33:46.590 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "True", 2024-05-08T05:33:46.590 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.590 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.590 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.590 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2024-05-08T05:33:46.590 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.590 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.590 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.590 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.590 INFO:teuthology.orchestra.run.smithi087.stdout: "warn_on_failed_host_check": { 2024-05-08T05:33:46.590 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "warn_on_failed_host_check", 2024-05-08T05:33:46.590 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-08T05:33:46.590 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.591 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-08T05:33:46.591 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "True", 2024-05-08T05:33:46.591 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.591 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.591 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.591 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "raise a health warning if the host check fails", 2024-05-08T05:33:46.591 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.591 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.591 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.591 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.591 INFO:teuthology.orchestra.run.smithi087.stdout: "warn_on_stray_daemons": { 2024-05-08T05:33:46.591 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "warn_on_stray_daemons", 2024-05-08T05:33:46.591 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-08T05:33:46.592 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.592 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-08T05:33:46.592 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "True", 2024-05-08T05:33:46.592 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.592 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.592 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.592 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2024-05-08T05:33:46.592 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.592 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.592 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.592 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.592 INFO:teuthology.orchestra.run.smithi087.stdout: "warn_on_stray_hosts": { 2024-05-08T05:33:46.592 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "warn_on_stray_hosts", 2024-05-08T05:33:46.592 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-08T05:33:46.593 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.593 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-08T05:33:46.593 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "True", 2024-05-08T05:33:46.593 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.593 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.593 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.593 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2024-05-08T05:33:46.593 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.593 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.593 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.593 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-05-08T05:33:46.593 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-05-08T05:33:46.593 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.594 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-05-08T05:33:46.594 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "crash", 2024-05-08T05:33:46.594 INFO:teuthology.orchestra.run.smithi087.stdout: "can_run": true, 2024-05-08T05:33:46.594 INFO:teuthology.orchestra.run.smithi087.stdout: "error_string": "", 2024-05-08T05:33:46.594 INFO:teuthology.orchestra.run.smithi087.stdout: "module_options": { 2024-05-08T05:33:46.594 INFO:teuthology.orchestra.run.smithi087.stdout: "log_level": { 2024-05-08T05:33:46.594 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_level", 2024-05-08T05:33:46.594 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-08T05:33:46.594 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.594 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:46.594 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-05-08T05:33:46.594 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.594 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.595 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [ 2024-05-08T05:33:46.595 INFO:teuthology.orchestra.run.smithi087.stdout: "", 2024-05-08T05:33:46.595 INFO:teuthology.orchestra.run.smithi087.stdout: "critical", 2024-05-08T05:33:46.595 INFO:teuthology.orchestra.run.smithi087.stdout: "debug", 2024-05-08T05:33:46.595 INFO:teuthology.orchestra.run.smithi087.stdout: "error", 2024-05-08T05:33:46.595 INFO:teuthology.orchestra.run.smithi087.stdout: "info", 2024-05-08T05:33:46.595 INFO:teuthology.orchestra.run.smithi087.stdout: "warning" 2024-05-08T05:33:46.595 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-05-08T05:33:46.595 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:46.595 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.595 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.595 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.595 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.596 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_cluster": { 2024-05-08T05:33:46.596 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_cluster", 2024-05-08T05:33:46.596 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-08T05:33:46.596 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.596 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:46.596 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-05-08T05:33:46.596 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.596 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.596 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.596 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:46.596 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.596 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.596 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.596 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.596 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_cluster_level": { 2024-05-08T05:33:46.597 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_cluster_level", 2024-05-08T05:33:46.597 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-08T05:33:46.597 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.597 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:46.597 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "info", 2024-05-08T05:33:46.597 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.597 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.597 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [ 2024-05-08T05:33:46.597 INFO:teuthology.orchestra.run.smithi087.stdout: "", 2024-05-08T05:33:46.597 INFO:teuthology.orchestra.run.smithi087.stdout: "critical", 2024-05-08T05:33:46.597 INFO:teuthology.orchestra.run.smithi087.stdout: "debug", 2024-05-08T05:33:46.597 INFO:teuthology.orchestra.run.smithi087.stdout: "error", 2024-05-08T05:33:46.597 INFO:teuthology.orchestra.run.smithi087.stdout: "info", 2024-05-08T05:33:46.597 INFO:teuthology.orchestra.run.smithi087.stdout: "warning" 2024-05-08T05:33:46.598 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-05-08T05:33:46.598 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:46.598 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.598 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.598 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.598 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.598 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_file": { 2024-05-08T05:33:46.598 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_file", 2024-05-08T05:33:46.598 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-08T05:33:46.598 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.598 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:46.598 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-05-08T05:33:46.598 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.599 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.599 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.599 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:46.599 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.599 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.599 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.599 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.599 INFO:teuthology.orchestra.run.smithi087.stdout: "retain_interval": { 2024-05-08T05:33:46.599 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "retain_interval", 2024-05-08T05:33:46.599 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "secs", 2024-05-08T05:33:46.599 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.599 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:46.599 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "31536000", 2024-05-08T05:33:46.599 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.600 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.600 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.600 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "how long to retain crashes before pruning them", 2024-05-08T05:33:46.600 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.600 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.600 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.600 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.600 INFO:teuthology.orchestra.run.smithi087.stdout: "sqlite3_killpoint": { 2024-05-08T05:33:46.600 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "sqlite3_killpoint", 2024-05-08T05:33:46.600 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "int", 2024-05-08T05:33:46.600 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "dev", 2024-05-08T05:33:46.600 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:46.600 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "0", 2024-05-08T05:33:46.601 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.601 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.601 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.601 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:46.601 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.601 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.601 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.601 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.601 INFO:teuthology.orchestra.run.smithi087.stdout: "warn_recent_interval": { 2024-05-08T05:33:46.601 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "warn_recent_interval", 2024-05-08T05:33:46.601 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "secs", 2024-05-08T05:33:46.601 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.601 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:46.601 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "1209600", 2024-05-08T05:33:46.601 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.602 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.602 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.602 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "time interval in which to warn about recent crashes", 2024-05-08T05:33:46.602 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.602 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.602 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.602 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-05-08T05:33:46.602 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-05-08T05:33:46.602 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.602 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-05-08T05:33:46.602 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "dashboard", 2024-05-08T05:33:46.602 INFO:teuthology.orchestra.run.smithi087.stdout: "can_run": true, 2024-05-08T05:33:46.602 INFO:teuthology.orchestra.run.smithi087.stdout: "error_string": "", 2024-05-08T05:33:46.603 INFO:teuthology.orchestra.run.smithi087.stdout: "module_options": { 2024-05-08T05:33:46.603 INFO:teuthology.orchestra.run.smithi087.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2024-05-08T05:33:46.603 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2024-05-08T05:33:46.603 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "int", 2024-05-08T05:33:46.603 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.603 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-08T05:33:46.603 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "10", 2024-05-08T05:33:46.603 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.603 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.603 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.603 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:46.603 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.603 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.604 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.604 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.604 INFO:teuthology.orchestra.run.smithi087.stdout: "ALERTMANAGER_API_HOST": { 2024-05-08T05:33:46.604 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "ALERTMANAGER_API_HOST", 2024-05-08T05:33:46.604 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-08T05:33:46.604 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.604 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-08T05:33:46.604 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-05-08T05:33:46.604 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.604 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.604 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.604 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:46.604 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.604 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.605 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.605 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.605 INFO:teuthology.orchestra.run.smithi087.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2024-05-08T05:33:46.605 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2024-05-08T05:33:46.605 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-08T05:33:46.605 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.605 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-08T05:33:46.605 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "True", 2024-05-08T05:33:46.605 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.605 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.605 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.605 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:46.605 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.606 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.606 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.606 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.606 INFO:teuthology.orchestra.run.smithi087.stdout: "AUDIT_API_ENABLED": { 2024-05-08T05:33:46.606 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "AUDIT_API_ENABLED", 2024-05-08T05:33:46.606 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-08T05:33:46.606 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.606 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-08T05:33:46.606 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-05-08T05:33:46.606 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.606 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.606 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.607 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:46.607 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.607 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.607 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.607 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.607 INFO:teuthology.orchestra.run.smithi087.stdout: "AUDIT_API_LOG_PAYLOAD": { 2024-05-08T05:33:46.607 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2024-05-08T05:33:46.607 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-08T05:33:46.607 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.607 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-08T05:33:46.607 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "True", 2024-05-08T05:33:46.607 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.607 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.607 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.608 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:46.608 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.608 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.608 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.608 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.608 INFO:teuthology.orchestra.run.smithi087.stdout: "ENABLE_BROWSABLE_API": { 2024-05-08T05:33:46.608 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "ENABLE_BROWSABLE_API", 2024-05-08T05:33:46.608 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-08T05:33:46.608 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.608 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-08T05:33:46.608 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "True", 2024-05-08T05:33:46.608 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.608 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.609 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.609 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:46.609 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.609 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.609 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.609 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.609 INFO:teuthology.orchestra.run.smithi087.stdout: "FEATURE_TOGGLE_CEPHFS": { 2024-05-08T05:33:46.609 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2024-05-08T05:33:46.609 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-08T05:33:46.609 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.609 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-08T05:33:46.609 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "True", 2024-05-08T05:33:46.610 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.610 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.610 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.610 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:46.610 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.610 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.610 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.610 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.610 INFO:teuthology.orchestra.run.smithi087.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2024-05-08T05:33:46.610 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2024-05-08T05:33:46.610 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-08T05:33:46.610 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.611 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-08T05:33:46.611 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "True", 2024-05-08T05:33:46.611 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.611 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.611 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.611 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:46.611 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.611 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.611 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.611 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.611 INFO:teuthology.orchestra.run.smithi087.stdout: "FEATURE_TOGGLE_ISCSI": { 2024-05-08T05:33:46.611 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2024-05-08T05:33:46.612 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-08T05:33:46.612 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.612 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-08T05:33:46.612 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "True", 2024-05-08T05:33:46.612 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.612 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.612 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.612 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:46.612 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.612 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.612 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.612 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.613 INFO:teuthology.orchestra.run.smithi087.stdout: "FEATURE_TOGGLE_MIRRORING": { 2024-05-08T05:33:46.613 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2024-05-08T05:33:46.613 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-08T05:33:46.613 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.613 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-08T05:33:46.613 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "True", 2024-05-08T05:33:46.613 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.613 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.613 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.613 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:46.613 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.613 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.613 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.613 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.614 INFO:teuthology.orchestra.run.smithi087.stdout: "FEATURE_TOGGLE_NFS": { 2024-05-08T05:33:46.614 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "FEATURE_TOGGLE_NFS", 2024-05-08T05:33:46.614 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-08T05:33:46.614 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.614 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-08T05:33:46.614 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "True", 2024-05-08T05:33:46.614 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.614 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.614 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.614 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:46.614 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.614 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.615 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.615 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.615 INFO:teuthology.orchestra.run.smithi087.stdout: "FEATURE_TOGGLE_RBD": { 2024-05-08T05:33:46.615 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "FEATURE_TOGGLE_RBD", 2024-05-08T05:33:46.615 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-08T05:33:46.615 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.615 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-08T05:33:46.615 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "True", 2024-05-08T05:33:46.615 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.615 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.615 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.615 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:46.615 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.616 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.616 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.616 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.616 INFO:teuthology.orchestra.run.smithi087.stdout: "FEATURE_TOGGLE_RGW": { 2024-05-08T05:33:46.616 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "FEATURE_TOGGLE_RGW", 2024-05-08T05:33:46.616 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-08T05:33:46.616 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.616 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-08T05:33:46.616 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "True", 2024-05-08T05:33:46.616 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.616 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.616 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.617 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:46.617 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.617 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.617 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.617 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.617 INFO:teuthology.orchestra.run.smithi087.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2024-05-08T05:33:46.617 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2024-05-08T05:33:46.617 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-08T05:33:46.617 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.617 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-08T05:33:46.617 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-05-08T05:33:46.617 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.617 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.618 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.618 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:46.618 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.618 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.618 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.618 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.618 INFO:teuthology.orchestra.run.smithi087.stdout: "GRAFANA_API_PASSWORD": { 2024-05-08T05:33:46.618 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "GRAFANA_API_PASSWORD", 2024-05-08T05:33:46.618 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-08T05:33:46.618 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.618 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-08T05:33:46.618 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "admin", 2024-05-08T05:33:46.618 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.619 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.619 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.619 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:46.619 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.619 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.619 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.619 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.619 INFO:teuthology.orchestra.run.smithi087.stdout: "GRAFANA_API_SSL_VERIFY": { 2024-05-08T05:33:46.619 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2024-05-08T05:33:46.619 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-08T05:33:46.619 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.619 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-08T05:33:46.620 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "True", 2024-05-08T05:33:46.620 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.620 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.620 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.620 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:46.620 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.620 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.620 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.620 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.620 INFO:teuthology.orchestra.run.smithi087.stdout: "GRAFANA_API_URL": { 2024-05-08T05:33:46.620 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "GRAFANA_API_URL", 2024-05-08T05:33:46.620 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-08T05:33:46.620 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.621 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-08T05:33:46.621 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-05-08T05:33:46.621 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.621 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.621 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.621 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:46.621 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.621 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.621 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.621 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.621 INFO:teuthology.orchestra.run.smithi087.stdout: "GRAFANA_API_USERNAME": { 2024-05-08T05:33:46.621 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "GRAFANA_API_USERNAME", 2024-05-08T05:33:46.621 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-08T05:33:46.621 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.622 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-08T05:33:46.622 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "admin", 2024-05-08T05:33:46.622 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.622 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.622 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.622 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:46.622 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.622 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.622 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.622 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.622 INFO:teuthology.orchestra.run.smithi087.stdout: "GRAFANA_FRONTEND_API_URL": { 2024-05-08T05:33:46.622 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2024-05-08T05:33:46.623 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-08T05:33:46.623 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.623 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-08T05:33:46.623 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-05-08T05:33:46.623 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.623 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.623 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.623 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:46.623 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.623 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.623 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.623 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.623 INFO:teuthology.orchestra.run.smithi087.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2024-05-08T05:33:46.623 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2024-05-08T05:33:46.624 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-08T05:33:46.624 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.624 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-08T05:33:46.624 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-05-08T05:33:46.624 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.624 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.624 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.624 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:46.624 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.624 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.624 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.624 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.624 INFO:teuthology.orchestra.run.smithi087.stdout: "ISCSI_API_SSL_VERIFICATION": { 2024-05-08T05:33:46.624 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2024-05-08T05:33:46.625 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-08T05:33:46.625 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.625 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-08T05:33:46.625 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "True", 2024-05-08T05:33:46.625 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.625 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.625 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.625 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:46.625 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.625 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.625 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.625 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.626 INFO:teuthology.orchestra.run.smithi087.stdout: "ISSUE_TRACKER_API_KEY": { 2024-05-08T05:33:46.626 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "ISSUE_TRACKER_API_KEY", 2024-05-08T05:33:46.626 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-08T05:33:46.626 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.626 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-08T05:33:46.626 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-05-08T05:33:46.626 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.629 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.630 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.630 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:46.630 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.630 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.630 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.630 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.630 INFO:teuthology.orchestra.run.smithi087.stdout: "MANAGED_BY_CLUSTERS": { 2024-05-08T05:33:46.630 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "MANAGED_BY_CLUSTERS", 2024-05-08T05:33:46.630 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-08T05:33:46.630 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.630 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-08T05:33:46.630 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "[]", 2024-05-08T05:33:46.630 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.630 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.631 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.631 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:46.631 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.631 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.631 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.631 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.631 INFO:teuthology.orchestra.run.smithi087.stdout: "MULTICLUSTER_CONFIG": { 2024-05-08T05:33:46.631 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "MULTICLUSTER_CONFIG", 2024-05-08T05:33:46.631 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-08T05:33:46.631 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.631 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-08T05:33:46.631 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "{}", 2024-05-08T05:33:46.631 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.631 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.631 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.632 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:46.632 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.632 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.632 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.632 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.632 INFO:teuthology.orchestra.run.smithi087.stdout: "PROMETHEUS_API_HOST": { 2024-05-08T05:33:46.632 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "PROMETHEUS_API_HOST", 2024-05-08T05:33:46.632 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-08T05:33:46.632 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.632 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-08T05:33:46.632 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-05-08T05:33:46.632 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.632 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.632 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.632 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:46.632 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.633 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.633 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.633 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.633 INFO:teuthology.orchestra.run.smithi087.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2024-05-08T05:33:46.633 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2024-05-08T05:33:46.633 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-08T05:33:46.633 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.633 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-08T05:33:46.633 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "True", 2024-05-08T05:33:46.633 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.633 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.633 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.633 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:46.634 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.634 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.634 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.634 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.634 INFO:teuthology.orchestra.run.smithi087.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2024-05-08T05:33:46.634 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2024-05-08T05:33:46.634 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-08T05:33:46.634 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.634 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-08T05:33:46.634 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-05-08T05:33:46.634 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.634 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.634 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.634 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:46.635 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.635 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.635 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.635 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.635 INFO:teuthology.orchestra.run.smithi087.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2024-05-08T05:33:46.635 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2024-05-08T05:33:46.635 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-08T05:33:46.635 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.635 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-08T05:33:46.635 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-05-08T05:33:46.635 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.635 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.635 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.635 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:46.635 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.636 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.636 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.636 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.636 INFO:teuthology.orchestra.run.smithi087.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2024-05-08T05:33:46.636 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2024-05-08T05:33:46.636 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-08T05:33:46.636 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.636 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-08T05:33:46.636 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "True", 2024-05-08T05:33:46.636 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.636 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.636 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.636 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:46.636 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.636 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.637 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.637 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.637 INFO:teuthology.orchestra.run.smithi087.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2024-05-08T05:33:46.637 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2024-05-08T05:33:46.637 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-08T05:33:46.637 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.637 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-08T05:33:46.637 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "True", 2024-05-08T05:33:46.637 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.637 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.637 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.637 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:46.637 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.637 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.637 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.638 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.638 INFO:teuthology.orchestra.run.smithi087.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2024-05-08T05:33:46.638 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2024-05-08T05:33:46.638 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-08T05:33:46.638 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.638 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-08T05:33:46.638 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-05-08T05:33:46.638 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.638 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.638 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.638 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:46.638 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.638 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.638 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.639 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.639 INFO:teuthology.orchestra.run.smithi087.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2024-05-08T05:33:46.639 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2024-05-08T05:33:46.639 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-08T05:33:46.639 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.639 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-08T05:33:46.639 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-05-08T05:33:46.639 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.639 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.639 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.639 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:46.639 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.639 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.639 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.640 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.640 INFO:teuthology.orchestra.run.smithi087.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2024-05-08T05:33:46.640 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2024-05-08T05:33:46.640 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-08T05:33:46.640 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.640 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-08T05:33:46.640 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-05-08T05:33:46.640 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.640 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.640 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.640 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:46.640 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.640 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.640 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.640 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.641 INFO:teuthology.orchestra.run.smithi087.stdout: "PWD_POLICY_ENABLED": { 2024-05-08T05:33:46.641 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "PWD_POLICY_ENABLED", 2024-05-08T05:33:46.641 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-08T05:33:46.641 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.641 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-08T05:33:46.641 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "True", 2024-05-08T05:33:46.641 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.641 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.641 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.641 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:46.641 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.641 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.641 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.641 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.642 INFO:teuthology.orchestra.run.smithi087.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2024-05-08T05:33:46.642 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2024-05-08T05:33:46.642 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-08T05:33:46.642 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.642 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-08T05:33:46.642 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2024-05-08T05:33:46.642 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.642 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.642 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.642 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:46.642 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.642 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.642 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.642 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.642 INFO:teuthology.orchestra.run.smithi087.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2024-05-08T05:33:46.643 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2024-05-08T05:33:46.643 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "int", 2024-05-08T05:33:46.643 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.643 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-08T05:33:46.643 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "10", 2024-05-08T05:33:46.643 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.643 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.643 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.643 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:46.643 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.643 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.643 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.643 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.643 INFO:teuthology.orchestra.run.smithi087.stdout: "PWD_POLICY_MIN_LENGTH": { 2024-05-08T05:33:46.643 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2024-05-08T05:33:46.644 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "int", 2024-05-08T05:33:46.644 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.644 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-08T05:33:46.644 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "8", 2024-05-08T05:33:46.644 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.644 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.644 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.644 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:46.644 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.644 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.644 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.644 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.644 INFO:teuthology.orchestra.run.smithi087.stdout: "REST_REQUESTS_TIMEOUT": { 2024-05-08T05:33:46.644 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "REST_REQUESTS_TIMEOUT", 2024-05-08T05:33:46.644 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "int", 2024-05-08T05:33:46.645 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.645 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-08T05:33:46.645 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "45", 2024-05-08T05:33:46.645 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.645 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.645 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.645 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:46.645 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.645 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.645 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.645 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.645 INFO:teuthology.orchestra.run.smithi087.stdout: "RGW_API_ACCESS_KEY": { 2024-05-08T05:33:46.645 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "RGW_API_ACCESS_KEY", 2024-05-08T05:33:46.645 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-08T05:33:46.645 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.646 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-08T05:33:46.646 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-05-08T05:33:46.646 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.646 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.646 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.646 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:46.646 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.646 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.646 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.646 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.646 INFO:teuthology.orchestra.run.smithi087.stdout: "RGW_API_ADMIN_RESOURCE": { 2024-05-08T05:33:46.646 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2024-05-08T05:33:46.646 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-08T05:33:46.647 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.647 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-08T05:33:46.647 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "admin", 2024-05-08T05:33:46.647 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.647 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.647 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.647 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:46.647 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.647 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.647 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.647 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.647 INFO:teuthology.orchestra.run.smithi087.stdout: "RGW_API_SECRET_KEY": { 2024-05-08T05:33:46.647 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "RGW_API_SECRET_KEY", 2024-05-08T05:33:46.647 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-08T05:33:46.648 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.648 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-08T05:33:46.648 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-05-08T05:33:46.648 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.648 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.648 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.648 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:46.648 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.648 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.648 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.648 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.648 INFO:teuthology.orchestra.run.smithi087.stdout: "RGW_API_SSL_VERIFY": { 2024-05-08T05:33:46.648 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "RGW_API_SSL_VERIFY", 2024-05-08T05:33:46.648 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-08T05:33:46.648 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.649 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-08T05:33:46.649 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "True", 2024-05-08T05:33:46.649 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.649 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.649 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.649 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:46.649 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.649 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.649 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.649 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.649 INFO:teuthology.orchestra.run.smithi087.stdout: "UNSAFE_TLS_v1_2": { 2024-05-08T05:33:46.649 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "UNSAFE_TLS_v1_2", 2024-05-08T05:33:46.649 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-08T05:33:46.649 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.649 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-08T05:33:46.650 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-05-08T05:33:46.650 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.650 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.650 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.650 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:46.650 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.650 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.650 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.650 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.650 INFO:teuthology.orchestra.run.smithi087.stdout: "USER_PWD_EXPIRATION_SPAN": { 2024-05-08T05:33:46.650 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2024-05-08T05:33:46.650 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "int", 2024-05-08T05:33:46.650 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.650 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-08T05:33:46.650 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "0", 2024-05-08T05:33:46.651 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.651 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.651 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.651 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:46.651 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.651 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.651 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.651 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.651 INFO:teuthology.orchestra.run.smithi087.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2024-05-08T05:33:46.651 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2024-05-08T05:33:46.651 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "int", 2024-05-08T05:33:46.651 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.651 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-08T05:33:46.651 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "10", 2024-05-08T05:33:46.652 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.652 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.652 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.652 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:46.652 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.652 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.652 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.652 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.652 INFO:teuthology.orchestra.run.smithi087.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2024-05-08T05:33:46.652 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2024-05-08T05:33:46.652 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "int", 2024-05-08T05:33:46.652 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.652 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-08T05:33:46.652 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "5", 2024-05-08T05:33:46.652 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.652 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.653 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.653 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:46.653 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.653 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.653 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.653 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.653 INFO:teuthology.orchestra.run.smithi087.stdout: "cross_origin_url": { 2024-05-08T05:33:46.653 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "cross_origin_url", 2024-05-08T05:33:46.653 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-08T05:33:46.653 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.653 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-08T05:33:46.653 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-05-08T05:33:46.653 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.653 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.653 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.654 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:46.654 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.654 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.654 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.654 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.654 INFO:teuthology.orchestra.run.smithi087.stdout: "crt_file": { 2024-05-08T05:33:46.654 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "crt_file", 2024-05-08T05:33:46.654 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-08T05:33:46.654 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.654 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-08T05:33:46.654 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-05-08T05:33:46.654 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.654 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.654 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.655 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:46.655 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.655 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.655 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.655 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.655 INFO:teuthology.orchestra.run.smithi087.stdout: "debug": { 2024-05-08T05:33:46.655 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "debug", 2024-05-08T05:33:46.655 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-08T05:33:46.655 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.655 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-08T05:33:46.655 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-05-08T05:33:46.655 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.655 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.655 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.655 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "Enable/disable debug options", 2024-05-08T05:33:46.655 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.656 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.656 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.656 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.656 INFO:teuthology.orchestra.run.smithi087.stdout: "jwt_token_ttl": { 2024-05-08T05:33:46.656 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "jwt_token_ttl", 2024-05-08T05:33:46.656 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "int", 2024-05-08T05:33:46.656 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.656 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-08T05:33:46.656 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "28800", 2024-05-08T05:33:46.656 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.656 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.656 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.656 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:46.656 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.656 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.656 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.657 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.657 INFO:teuthology.orchestra.run.smithi087.stdout: "key_file": { 2024-05-08T05:33:46.657 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "key_file", 2024-05-08T05:33:46.657 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-08T05:33:46.657 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.657 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-08T05:33:46.657 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-05-08T05:33:46.657 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.657 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.657 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.657 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:46.657 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.657 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.657 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.657 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.658 INFO:teuthology.orchestra.run.smithi087.stdout: "log_level": { 2024-05-08T05:33:46.658 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_level", 2024-05-08T05:33:46.658 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-08T05:33:46.658 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.658 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:46.658 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-05-08T05:33:46.658 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.658 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.658 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [ 2024-05-08T05:33:46.658 INFO:teuthology.orchestra.run.smithi087.stdout: "", 2024-05-08T05:33:46.658 INFO:teuthology.orchestra.run.smithi087.stdout: "critical", 2024-05-08T05:33:46.658 INFO:teuthology.orchestra.run.smithi087.stdout: "debug", 2024-05-08T05:33:46.658 INFO:teuthology.orchestra.run.smithi087.stdout: "error", 2024-05-08T05:33:46.658 INFO:teuthology.orchestra.run.smithi087.stdout: "info", 2024-05-08T05:33:46.659 INFO:teuthology.orchestra.run.smithi087.stdout: "warning" 2024-05-08T05:33:46.659 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-05-08T05:33:46.659 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:46.659 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.659 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.659 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.659 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.659 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_cluster": { 2024-05-08T05:33:46.659 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_cluster", 2024-05-08T05:33:46.659 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-08T05:33:46.659 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.659 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:46.659 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-05-08T05:33:46.659 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.660 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.660 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.660 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:46.660 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.660 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.660 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.660 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.660 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_cluster_level": { 2024-05-08T05:33:46.660 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_cluster_level", 2024-05-08T05:33:46.660 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-08T05:33:46.660 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.660 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:46.660 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "info", 2024-05-08T05:33:46.660 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.661 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.661 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [ 2024-05-08T05:33:46.661 INFO:teuthology.orchestra.run.smithi087.stdout: "", 2024-05-08T05:33:46.661 INFO:teuthology.orchestra.run.smithi087.stdout: "critical", 2024-05-08T05:33:46.661 INFO:teuthology.orchestra.run.smithi087.stdout: "debug", 2024-05-08T05:33:46.661 INFO:teuthology.orchestra.run.smithi087.stdout: "error", 2024-05-08T05:33:46.661 INFO:teuthology.orchestra.run.smithi087.stdout: "info", 2024-05-08T05:33:46.661 INFO:teuthology.orchestra.run.smithi087.stdout: "warning" 2024-05-08T05:33:46.661 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-05-08T05:33:46.661 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:46.661 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.661 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.661 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.661 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.661 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_file": { 2024-05-08T05:33:46.662 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_file", 2024-05-08T05:33:46.662 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-08T05:33:46.662 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.662 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:46.662 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-05-08T05:33:46.662 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.662 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.662 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.662 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:46.662 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.662 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.662 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.662 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.662 INFO:teuthology.orchestra.run.smithi087.stdout: "motd": { 2024-05-08T05:33:46.662 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "motd", 2024-05-08T05:33:46.663 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-08T05:33:46.663 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.663 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-08T05:33:46.663 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-05-08T05:33:46.663 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.663 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.663 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.663 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "The message of the day", 2024-05-08T05:33:46.663 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.663 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.663 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.663 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.663 INFO:teuthology.orchestra.run.smithi087.stdout: "redirect_resolve_ip_addr": { 2024-05-08T05:33:46.663 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "redirect_resolve_ip_addr", 2024-05-08T05:33:46.663 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-08T05:33:46.664 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.664 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-08T05:33:46.664 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-05-08T05:33:46.664 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.664 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.664 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.664 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:46.664 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.664 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.664 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.664 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.664 INFO:teuthology.orchestra.run.smithi087.stdout: "server_addr": { 2024-05-08T05:33:46.664 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "server_addr", 2024-05-08T05:33:46.664 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-08T05:33:46.664 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.665 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-08T05:33:46.665 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "::", 2024-05-08T05:33:46.665 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.665 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.665 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.665 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:46.665 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.665 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.665 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.665 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.665 INFO:teuthology.orchestra.run.smithi087.stdout: "server_port": { 2024-05-08T05:33:46.665 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "server_port", 2024-05-08T05:33:46.665 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "int", 2024-05-08T05:33:46.665 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.665 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-08T05:33:46.666 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "8080", 2024-05-08T05:33:46.666 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.666 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.666 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.666 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:46.666 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.666 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.666 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.666 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.666 INFO:teuthology.orchestra.run.smithi087.stdout: "sqlite3_killpoint": { 2024-05-08T05:33:46.666 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "sqlite3_killpoint", 2024-05-08T05:33:46.666 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "int", 2024-05-08T05:33:46.666 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "dev", 2024-05-08T05:33:46.666 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:46.666 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "0", 2024-05-08T05:33:46.667 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.667 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.667 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.667 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:46.667 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.667 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.667 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.667 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.667 INFO:teuthology.orchestra.run.smithi087.stdout: "ssl": { 2024-05-08T05:33:46.667 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "ssl", 2024-05-08T05:33:46.667 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-08T05:33:46.667 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.667 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-08T05:33:46.667 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "True", 2024-05-08T05:33:46.667 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.668 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.668 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.668 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:46.668 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.668 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.668 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.668 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.668 INFO:teuthology.orchestra.run.smithi087.stdout: "ssl_server_port": { 2024-05-08T05:33:46.668 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "ssl_server_port", 2024-05-08T05:33:46.668 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "int", 2024-05-08T05:33:46.668 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.668 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-08T05:33:46.668 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "8443", 2024-05-08T05:33:46.668 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.668 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.669 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.669 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:46.669 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.669 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.669 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.669 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.669 INFO:teuthology.orchestra.run.smithi087.stdout: "standby_behaviour": { 2024-05-08T05:33:46.669 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "standby_behaviour", 2024-05-08T05:33:46.669 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-08T05:33:46.669 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.669 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-08T05:33:46.669 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "redirect", 2024-05-08T05:33:46.669 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.669 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.669 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [ 2024-05-08T05:33:46.670 INFO:teuthology.orchestra.run.smithi087.stdout: "error", 2024-05-08T05:33:46.670 INFO:teuthology.orchestra.run.smithi087.stdout: "redirect" 2024-05-08T05:33:46.670 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-05-08T05:33:46.670 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:46.670 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.670 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.670 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.670 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.670 INFO:teuthology.orchestra.run.smithi087.stdout: "standby_error_status_code": { 2024-05-08T05:33:46.670 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "standby_error_status_code", 2024-05-08T05:33:46.670 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "int", 2024-05-08T05:33:46.670 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.670 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-08T05:33:46.670 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "500", 2024-05-08T05:33:46.671 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "400", 2024-05-08T05:33:46.671 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "599", 2024-05-08T05:33:46.671 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.671 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:46.671 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.671 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.671 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.671 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.671 INFO:teuthology.orchestra.run.smithi087.stdout: "url_prefix": { 2024-05-08T05:33:46.671 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "url_prefix", 2024-05-08T05:33:46.671 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-08T05:33:46.671 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.671 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-08T05:33:46.671 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-05-08T05:33:46.671 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.672 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.672 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.672 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:46.672 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.672 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.672 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.672 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-05-08T05:33:46.672 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-05-08T05:33:46.672 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.672 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-05-08T05:33:46.672 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "devicehealth", 2024-05-08T05:33:46.672 INFO:teuthology.orchestra.run.smithi087.stdout: "can_run": true, 2024-05-08T05:33:46.672 INFO:teuthology.orchestra.run.smithi087.stdout: "error_string": "", 2024-05-08T05:33:46.672 INFO:teuthology.orchestra.run.smithi087.stdout: "module_options": { 2024-05-08T05:33:46.672 INFO:teuthology.orchestra.run.smithi087.stdout: "enable_monitoring": { 2024-05-08T05:33:46.673 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "enable_monitoring", 2024-05-08T05:33:46.673 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-08T05:33:46.673 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.673 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:46.673 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "True", 2024-05-08T05:33:46.673 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.673 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.673 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.673 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "monitor device health metrics", 2024-05-08T05:33:46.673 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.673 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.673 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.673 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.673 INFO:teuthology.orchestra.run.smithi087.stdout: "log_level": { 2024-05-08T05:33:46.674 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_level", 2024-05-08T05:33:46.674 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-08T05:33:46.674 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.674 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:46.674 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-05-08T05:33:46.674 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.674 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.674 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [ 2024-05-08T05:33:46.674 INFO:teuthology.orchestra.run.smithi087.stdout: "", 2024-05-08T05:33:46.674 INFO:teuthology.orchestra.run.smithi087.stdout: "critical", 2024-05-08T05:33:46.674 INFO:teuthology.orchestra.run.smithi087.stdout: "debug", 2024-05-08T05:33:46.674 INFO:teuthology.orchestra.run.smithi087.stdout: "error", 2024-05-08T05:33:46.674 INFO:teuthology.orchestra.run.smithi087.stdout: "info", 2024-05-08T05:33:46.674 INFO:teuthology.orchestra.run.smithi087.stdout: "warning" 2024-05-08T05:33:46.674 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-05-08T05:33:46.675 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:46.675 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.675 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.675 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.675 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.675 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_cluster": { 2024-05-08T05:33:46.675 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_cluster", 2024-05-08T05:33:46.675 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-08T05:33:46.675 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.675 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:46.675 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-05-08T05:33:46.675 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.675 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.675 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.675 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:46.676 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.676 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.676 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.676 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.676 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_cluster_level": { 2024-05-08T05:33:46.676 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_cluster_level", 2024-05-08T05:33:46.676 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-08T05:33:46.676 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.676 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:46.676 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "info", 2024-05-08T05:33:46.676 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.676 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.676 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [ 2024-05-08T05:33:46.676 INFO:teuthology.orchestra.run.smithi087.stdout: "", 2024-05-08T05:33:46.676 INFO:teuthology.orchestra.run.smithi087.stdout: "critical", 2024-05-08T05:33:46.677 INFO:teuthology.orchestra.run.smithi087.stdout: "debug", 2024-05-08T05:33:46.677 INFO:teuthology.orchestra.run.smithi087.stdout: "error", 2024-05-08T05:33:46.677 INFO:teuthology.orchestra.run.smithi087.stdout: "info", 2024-05-08T05:33:46.677 INFO:teuthology.orchestra.run.smithi087.stdout: "warning" 2024-05-08T05:33:46.677 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-05-08T05:33:46.677 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:46.677 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.677 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.677 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.677 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.677 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_file": { 2024-05-08T05:33:46.677 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_file", 2024-05-08T05:33:46.677 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-08T05:33:46.677 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.677 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:46.678 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-05-08T05:33:46.678 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.678 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.678 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.678 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:46.678 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.678 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.678 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.678 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.678 INFO:teuthology.orchestra.run.smithi087.stdout: "mark_out_threshold": { 2024-05-08T05:33:46.678 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "mark_out_threshold", 2024-05-08T05:33:46.678 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "secs", 2024-05-08T05:33:46.678 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.678 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:46.678 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "2419200", 2024-05-08T05:33:46.679 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.679 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.679 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.679 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "automatically mark OSD if it may fail before this long", 2024-05-08T05:33:46.679 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.679 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.679 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.679 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.679 INFO:teuthology.orchestra.run.smithi087.stdout: "pool_name": { 2024-05-08T05:33:46.679 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "pool_name", 2024-05-08T05:33:46.679 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-08T05:33:46.679 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.679 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:46.679 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "device_health_metrics", 2024-05-08T05:33:46.679 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.680 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.680 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.680 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "name of pool in which to store device health metrics", 2024-05-08T05:33:46.680 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.680 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.680 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.680 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.680 INFO:teuthology.orchestra.run.smithi087.stdout: "retention_period": { 2024-05-08T05:33:46.680 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "retention_period", 2024-05-08T05:33:46.680 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "secs", 2024-05-08T05:33:46.680 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.680 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:46.680 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "15552000", 2024-05-08T05:33:46.680 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.680 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.681 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.681 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "how long to retain device health metrics", 2024-05-08T05:33:46.681 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.681 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.681 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.681 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.681 INFO:teuthology.orchestra.run.smithi087.stdout: "scrape_frequency": { 2024-05-08T05:33:46.681 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "scrape_frequency", 2024-05-08T05:33:46.681 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "secs", 2024-05-08T05:33:46.681 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.681 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:46.681 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "86400", 2024-05-08T05:33:46.681 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.681 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.681 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.682 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "how frequently to scrape device health metrics", 2024-05-08T05:33:46.682 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.682 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.682 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.682 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.682 INFO:teuthology.orchestra.run.smithi087.stdout: "self_heal": { 2024-05-08T05:33:46.682 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "self_heal", 2024-05-08T05:33:46.682 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-08T05:33:46.682 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.682 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:46.682 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "True", 2024-05-08T05:33:46.682 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.682 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.682 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.682 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "preemptively heal cluster around devices that may fail", 2024-05-08T05:33:46.683 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.683 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.683 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.683 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.683 INFO:teuthology.orchestra.run.smithi087.stdout: "sleep_interval": { 2024-05-08T05:33:46.683 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "sleep_interval", 2024-05-08T05:33:46.683 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "secs", 2024-05-08T05:33:46.683 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.683 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:46.683 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "600", 2024-05-08T05:33:46.683 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.683 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.683 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.683 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "how frequently to wake up and check device health", 2024-05-08T05:33:46.683 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.684 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.684 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.684 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.684 INFO:teuthology.orchestra.run.smithi087.stdout: "sqlite3_killpoint": { 2024-05-08T05:33:46.684 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "sqlite3_killpoint", 2024-05-08T05:33:46.684 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "int", 2024-05-08T05:33:46.684 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "dev", 2024-05-08T05:33:46.684 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:46.684 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "0", 2024-05-08T05:33:46.684 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.684 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.685 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.685 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:46.685 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.685 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.685 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.685 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.685 INFO:teuthology.orchestra.run.smithi087.stdout: "warn_threshold": { 2024-05-08T05:33:46.685 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "warn_threshold", 2024-05-08T05:33:46.685 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "secs", 2024-05-08T05:33:46.685 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.685 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:46.685 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "7257600", 2024-05-08T05:33:46.685 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.685 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.685 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.686 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "raise health warning if OSD may fail before this long", 2024-05-08T05:33:46.686 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.686 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.686 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.686 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-05-08T05:33:46.686 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-05-08T05:33:46.686 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.686 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-05-08T05:33:46.686 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "diskprediction_local", 2024-05-08T05:33:46.686 INFO:teuthology.orchestra.run.smithi087.stdout: "can_run": true, 2024-05-08T05:33:46.686 INFO:teuthology.orchestra.run.smithi087.stdout: "error_string": "", 2024-05-08T05:33:46.686 INFO:teuthology.orchestra.run.smithi087.stdout: "module_options": { 2024-05-08T05:33:46.686 INFO:teuthology.orchestra.run.smithi087.stdout: "log_level": { 2024-05-08T05:33:46.686 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_level", 2024-05-08T05:33:46.687 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-08T05:33:46.687 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.687 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:46.687 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-05-08T05:33:46.687 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.687 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.687 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [ 2024-05-08T05:33:46.687 INFO:teuthology.orchestra.run.smithi087.stdout: "", 2024-05-08T05:33:46.687 INFO:teuthology.orchestra.run.smithi087.stdout: "critical", 2024-05-08T05:33:46.687 INFO:teuthology.orchestra.run.smithi087.stdout: "debug", 2024-05-08T05:33:46.687 INFO:teuthology.orchestra.run.smithi087.stdout: "error", 2024-05-08T05:33:46.687 INFO:teuthology.orchestra.run.smithi087.stdout: "info", 2024-05-08T05:33:46.687 INFO:teuthology.orchestra.run.smithi087.stdout: "warning" 2024-05-08T05:33:46.687 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-05-08T05:33:46.687 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:46.688 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.688 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.688 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.688 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.688 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_cluster": { 2024-05-08T05:33:46.688 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_cluster", 2024-05-08T05:33:46.688 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-08T05:33:46.688 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.688 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:46.688 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-05-08T05:33:46.688 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.688 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.688 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.688 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:46.688 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.689 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.689 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.689 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.689 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_cluster_level": { 2024-05-08T05:33:46.689 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_cluster_level", 2024-05-08T05:33:46.689 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-08T05:33:46.689 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.689 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:46.689 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "info", 2024-05-08T05:33:46.689 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.690 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.690 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [ 2024-05-08T05:33:46.690 INFO:teuthology.orchestra.run.smithi087.stdout: "", 2024-05-08T05:33:46.690 INFO:teuthology.orchestra.run.smithi087.stdout: "critical", 2024-05-08T05:33:46.690 INFO:teuthology.orchestra.run.smithi087.stdout: "debug", 2024-05-08T05:33:46.690 INFO:teuthology.orchestra.run.smithi087.stdout: "error", 2024-05-08T05:33:46.690 INFO:teuthology.orchestra.run.smithi087.stdout: "info", 2024-05-08T05:33:46.690 INFO:teuthology.orchestra.run.smithi087.stdout: "warning" 2024-05-08T05:33:46.690 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-05-08T05:33:46.690 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:46.690 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.691 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.691 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.691 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.691 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_file": { 2024-05-08T05:33:46.691 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_file", 2024-05-08T05:33:46.691 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-08T05:33:46.691 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.691 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:46.691 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-05-08T05:33:46.691 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.691 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.691 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.691 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:46.692 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.692 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.692 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.692 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.692 INFO:teuthology.orchestra.run.smithi087.stdout: "predict_interval": { 2024-05-08T05:33:46.692 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "predict_interval", 2024-05-08T05:33:46.692 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-08T05:33:46.692 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.692 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-08T05:33:46.692 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "86400", 2024-05-08T05:33:46.692 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.692 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.692 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.693 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:46.693 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.693 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.693 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.693 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.693 INFO:teuthology.orchestra.run.smithi087.stdout: "predictor_model": { 2024-05-08T05:33:46.693 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "predictor_model", 2024-05-08T05:33:46.693 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-08T05:33:46.693 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.693 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-08T05:33:46.693 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "prophetstor", 2024-05-08T05:33:46.693 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.693 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.694 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.694 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:46.694 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.694 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.694 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.694 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.694 INFO:teuthology.orchestra.run.smithi087.stdout: "sleep_interval": { 2024-05-08T05:33:46.694 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "sleep_interval", 2024-05-08T05:33:46.694 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-08T05:33:46.694 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.694 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-08T05:33:46.694 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "600", 2024-05-08T05:33:46.695 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.695 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.695 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.695 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:46.695 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.695 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.695 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.695 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.695 INFO:teuthology.orchestra.run.smithi087.stdout: "sqlite3_killpoint": { 2024-05-08T05:33:46.695 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "sqlite3_killpoint", 2024-05-08T05:33:46.695 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "int", 2024-05-08T05:33:46.695 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "dev", 2024-05-08T05:33:46.695 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:46.696 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "0", 2024-05-08T05:33:46.696 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.696 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.696 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.696 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:46.696 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.696 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.696 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.696 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-05-08T05:33:46.696 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-05-08T05:33:46.696 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.696 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-05-08T05:33:46.696 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "influx", 2024-05-08T05:33:46.696 INFO:teuthology.orchestra.run.smithi087.stdout: "can_run": false, 2024-05-08T05:33:46.697 INFO:teuthology.orchestra.run.smithi087.stdout: "error_string": "influxdb python module not found", 2024-05-08T05:33:46.697 INFO:teuthology.orchestra.run.smithi087.stdout: "module_options": { 2024-05-08T05:33:46.697 INFO:teuthology.orchestra.run.smithi087.stdout: "batch_size": { 2024-05-08T05:33:46.697 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "batch_size", 2024-05-08T05:33:46.697 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "int", 2024-05-08T05:33:46.697 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.697 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-08T05:33:46.697 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "5000", 2024-05-08T05:33:46.697 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.697 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.697 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.697 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2024-05-08T05:33:46.697 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.697 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.698 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.698 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.698 INFO:teuthology.orchestra.run.smithi087.stdout: "database": { 2024-05-08T05:33:46.698 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "database", 2024-05-08T05:33:46.698 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-08T05:33:46.698 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.698 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-08T05:33:46.698 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "ceph", 2024-05-08T05:33:46.698 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.698 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.698 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.699 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2024-05-08T05:33:46.699 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.699 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.699 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.699 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.699 INFO:teuthology.orchestra.run.smithi087.stdout: "hostname": { 2024-05-08T05:33:46.699 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "hostname", 2024-05-08T05:33:46.699 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-08T05:33:46.699 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.699 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-08T05:33:46.699 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-05-08T05:33:46.700 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.700 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.700 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.700 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "InfluxDB server hostname", 2024-05-08T05:33:46.700 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.700 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.700 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.700 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.700 INFO:teuthology.orchestra.run.smithi087.stdout: "interval": { 2024-05-08T05:33:46.700 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "interval", 2024-05-08T05:33:46.700 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "secs", 2024-05-08T05:33:46.700 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.700 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-08T05:33:46.701 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "30", 2024-05-08T05:33:46.701 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "5", 2024-05-08T05:33:46.701 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.701 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.701 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2024-05-08T05:33:46.701 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.701 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.701 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.701 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.701 INFO:teuthology.orchestra.run.smithi087.stdout: "log_level": { 2024-05-08T05:33:46.701 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_level", 2024-05-08T05:33:46.702 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-08T05:33:46.702 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.702 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:46.702 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-05-08T05:33:46.702 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.702 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.702 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [ 2024-05-08T05:33:46.702 INFO:teuthology.orchestra.run.smithi087.stdout: "", 2024-05-08T05:33:46.702 INFO:teuthology.orchestra.run.smithi087.stdout: "critical", 2024-05-08T05:33:46.702 INFO:teuthology.orchestra.run.smithi087.stdout: "debug", 2024-05-08T05:33:46.702 INFO:teuthology.orchestra.run.smithi087.stdout: "error", 2024-05-08T05:33:46.702 INFO:teuthology.orchestra.run.smithi087.stdout: "info", 2024-05-08T05:33:46.703 INFO:teuthology.orchestra.run.smithi087.stdout: "warning" 2024-05-08T05:33:46.703 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-05-08T05:33:46.703 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:46.703 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.703 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.703 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.703 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.703 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_cluster": { 2024-05-08T05:33:46.703 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_cluster", 2024-05-08T05:33:46.703 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-08T05:33:46.703 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.703 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:46.704 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-05-08T05:33:46.704 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.704 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.704 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.704 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:46.704 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.704 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.704 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.704 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.704 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_cluster_level": { 2024-05-08T05:33:46.704 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_cluster_level", 2024-05-08T05:33:46.704 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-08T05:33:46.704 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.705 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:46.705 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "info", 2024-05-08T05:33:46.705 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.705 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.705 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [ 2024-05-08T05:33:46.705 INFO:teuthology.orchestra.run.smithi087.stdout: "", 2024-05-08T05:33:46.705 INFO:teuthology.orchestra.run.smithi087.stdout: "critical", 2024-05-08T05:33:46.705 INFO:teuthology.orchestra.run.smithi087.stdout: "debug", 2024-05-08T05:33:46.705 INFO:teuthology.orchestra.run.smithi087.stdout: "error", 2024-05-08T05:33:46.705 INFO:teuthology.orchestra.run.smithi087.stdout: "info", 2024-05-08T05:33:46.705 INFO:teuthology.orchestra.run.smithi087.stdout: "warning" 2024-05-08T05:33:46.705 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-05-08T05:33:46.706 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:46.706 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.706 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.706 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.706 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.706 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_file": { 2024-05-08T05:33:46.706 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_file", 2024-05-08T05:33:46.706 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-08T05:33:46.706 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.706 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:46.706 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-05-08T05:33:46.707 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.707 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.707 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.707 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:46.707 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.707 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.707 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.707 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.707 INFO:teuthology.orchestra.run.smithi087.stdout: "password": { 2024-05-08T05:33:46.707 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "password", 2024-05-08T05:33:46.707 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-08T05:33:46.708 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.708 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-08T05:33:46.708 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-05-08T05:33:46.708 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.708 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.708 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.708 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "password of InfluxDB server user", 2024-05-08T05:33:46.708 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.708 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.708 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.708 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.708 INFO:teuthology.orchestra.run.smithi087.stdout: "port": { 2024-05-08T05:33:46.709 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "port", 2024-05-08T05:33:46.709 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "int", 2024-05-08T05:33:46.709 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.709 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-08T05:33:46.709 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "8086", 2024-05-08T05:33:46.709 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.709 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.709 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.709 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "InfluxDB server port", 2024-05-08T05:33:46.709 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.709 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.709 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.710 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.710 INFO:teuthology.orchestra.run.smithi087.stdout: "sqlite3_killpoint": { 2024-05-08T05:33:46.710 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "sqlite3_killpoint", 2024-05-08T05:33:46.710 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "int", 2024-05-08T05:33:46.710 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "dev", 2024-05-08T05:33:46.710 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:46.710 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "0", 2024-05-08T05:33:46.710 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.710 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.710 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.710 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:46.711 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.711 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.711 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.711 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.711 INFO:teuthology.orchestra.run.smithi087.stdout: "ssl": { 2024-05-08T05:33:46.711 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "ssl", 2024-05-08T05:33:46.711 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-08T05:33:46.711 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.711 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-08T05:33:46.711 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "false", 2024-05-08T05:33:46.711 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.711 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.711 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.712 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2024-05-08T05:33:46.712 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.712 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.712 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.712 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.712 INFO:teuthology.orchestra.run.smithi087.stdout: "threads": { 2024-05-08T05:33:46.712 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "threads", 2024-05-08T05:33:46.712 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "int", 2024-05-08T05:33:46.712 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.712 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-08T05:33:46.712 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "5", 2024-05-08T05:33:46.712 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "1", 2024-05-08T05:33:46.713 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "32", 2024-05-08T05:33:46.713 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.713 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2024-05-08T05:33:46.713 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.713 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.713 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.713 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.713 INFO:teuthology.orchestra.run.smithi087.stdout: "username": { 2024-05-08T05:33:46.713 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "username", 2024-05-08T05:33:46.713 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-08T05:33:46.713 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.713 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-08T05:33:46.713 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-05-08T05:33:46.714 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.714 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.714 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.714 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "username of InfluxDB server user", 2024-05-08T05:33:46.714 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.714 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.714 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.714 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.714 INFO:teuthology.orchestra.run.smithi087.stdout: "verify_ssl": { 2024-05-08T05:33:46.714 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "verify_ssl", 2024-05-08T05:33:46.714 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-08T05:33:46.715 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.715 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-08T05:33:46.715 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "true", 2024-05-08T05:33:46.715 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.715 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.715 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.715 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2024-05-08T05:33:46.715 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.715 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.715 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.715 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-05-08T05:33:46.715 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-05-08T05:33:46.715 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.716 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-05-08T05:33:46.716 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "insights", 2024-05-08T05:33:46.716 INFO:teuthology.orchestra.run.smithi087.stdout: "can_run": true, 2024-05-08T05:33:46.716 INFO:teuthology.orchestra.run.smithi087.stdout: "error_string": "", 2024-05-08T05:33:46.716 INFO:teuthology.orchestra.run.smithi087.stdout: "module_options": { 2024-05-08T05:33:46.716 INFO:teuthology.orchestra.run.smithi087.stdout: "log_level": { 2024-05-08T05:33:46.716 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_level", 2024-05-08T05:33:46.716 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-08T05:33:46.716 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.716 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:46.716 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-05-08T05:33:46.716 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.716 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.717 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [ 2024-05-08T05:33:46.717 INFO:teuthology.orchestra.run.smithi087.stdout: "", 2024-05-08T05:33:46.717 INFO:teuthology.orchestra.run.smithi087.stdout: "critical", 2024-05-08T05:33:46.717 INFO:teuthology.orchestra.run.smithi087.stdout: "debug", 2024-05-08T05:33:46.717 INFO:teuthology.orchestra.run.smithi087.stdout: "error", 2024-05-08T05:33:46.717 INFO:teuthology.orchestra.run.smithi087.stdout: "info", 2024-05-08T05:33:46.717 INFO:teuthology.orchestra.run.smithi087.stdout: "warning" 2024-05-08T05:33:46.717 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-05-08T05:33:46.717 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:46.717 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.717 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.717 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.718 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.718 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_cluster": { 2024-05-08T05:33:46.718 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_cluster", 2024-05-08T05:33:46.718 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-08T05:33:46.718 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.718 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:46.718 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-05-08T05:33:46.718 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.718 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.718 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.718 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:46.718 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.719 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.719 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.719 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.719 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_cluster_level": { 2024-05-08T05:33:46.719 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_cluster_level", 2024-05-08T05:33:46.719 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-08T05:33:46.719 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.719 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:46.719 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "info", 2024-05-08T05:33:46.719 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.719 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.719 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [ 2024-05-08T05:33:46.720 INFO:teuthology.orchestra.run.smithi087.stdout: "", 2024-05-08T05:33:46.720 INFO:teuthology.orchestra.run.smithi087.stdout: "critical", 2024-05-08T05:33:46.720 INFO:teuthology.orchestra.run.smithi087.stdout: "debug", 2024-05-08T05:33:46.720 INFO:teuthology.orchestra.run.smithi087.stdout: "error", 2024-05-08T05:33:46.720 INFO:teuthology.orchestra.run.smithi087.stdout: "info", 2024-05-08T05:33:46.720 INFO:teuthology.orchestra.run.smithi087.stdout: "warning" 2024-05-08T05:33:46.720 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-05-08T05:33:46.720 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:46.720 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.720 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.720 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.720 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.720 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_file": { 2024-05-08T05:33:46.721 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_file", 2024-05-08T05:33:46.721 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-08T05:33:46.721 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.721 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:46.721 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-05-08T05:33:46.721 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.721 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.721 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.721 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:46.721 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.721 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.721 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.721 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.722 INFO:teuthology.orchestra.run.smithi087.stdout: "sqlite3_killpoint": { 2024-05-08T05:33:46.722 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "sqlite3_killpoint", 2024-05-08T05:33:46.722 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "int", 2024-05-08T05:33:46.722 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "dev", 2024-05-08T05:33:46.722 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:46.722 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "0", 2024-05-08T05:33:46.722 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.722 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.722 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.722 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:46.722 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.722 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.723 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.723 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-05-08T05:33:46.723 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-05-08T05:33:46.723 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.723 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-05-08T05:33:46.723 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "iostat", 2024-05-08T05:33:46.723 INFO:teuthology.orchestra.run.smithi087.stdout: "can_run": true, 2024-05-08T05:33:46.723 INFO:teuthology.orchestra.run.smithi087.stdout: "error_string": "", 2024-05-08T05:33:46.723 INFO:teuthology.orchestra.run.smithi087.stdout: "module_options": { 2024-05-08T05:33:46.723 INFO:teuthology.orchestra.run.smithi087.stdout: "log_level": { 2024-05-08T05:33:46.723 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_level", 2024-05-08T05:33:46.723 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-08T05:33:46.724 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.724 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:46.724 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-05-08T05:33:46.724 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.724 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.724 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [ 2024-05-08T05:33:46.724 INFO:teuthology.orchestra.run.smithi087.stdout: "", 2024-05-08T05:33:46.724 INFO:teuthology.orchestra.run.smithi087.stdout: "critical", 2024-05-08T05:33:46.724 INFO:teuthology.orchestra.run.smithi087.stdout: "debug", 2024-05-08T05:33:46.724 INFO:teuthology.orchestra.run.smithi087.stdout: "error", 2024-05-08T05:33:46.724 INFO:teuthology.orchestra.run.smithi087.stdout: "info", 2024-05-08T05:33:46.724 INFO:teuthology.orchestra.run.smithi087.stdout: "warning" 2024-05-08T05:33:46.724 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-05-08T05:33:46.725 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:46.725 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.725 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.725 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.725 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.725 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_cluster": { 2024-05-08T05:33:46.725 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_cluster", 2024-05-08T05:33:46.725 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-08T05:33:46.725 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.725 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:46.725 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-05-08T05:33:46.725 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.725 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.726 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.726 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:46.726 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.726 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.726 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.726 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.726 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_cluster_level": { 2024-05-08T05:33:46.726 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_cluster_level", 2024-05-08T05:33:46.726 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-08T05:33:46.726 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.726 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:46.726 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "info", 2024-05-08T05:33:46.727 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.727 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.727 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [ 2024-05-08T05:33:46.727 INFO:teuthology.orchestra.run.smithi087.stdout: "", 2024-05-08T05:33:46.727 INFO:teuthology.orchestra.run.smithi087.stdout: "critical", 2024-05-08T05:33:46.727 INFO:teuthology.orchestra.run.smithi087.stdout: "debug", 2024-05-08T05:33:46.727 INFO:teuthology.orchestra.run.smithi087.stdout: "error", 2024-05-08T05:33:46.727 INFO:teuthology.orchestra.run.smithi087.stdout: "info", 2024-05-08T05:33:46.727 INFO:teuthology.orchestra.run.smithi087.stdout: "warning" 2024-05-08T05:33:46.727 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-05-08T05:33:46.727 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:46.727 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.727 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.728 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.728 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.728 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_file": { 2024-05-08T05:33:46.728 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_file", 2024-05-08T05:33:46.728 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-08T05:33:46.728 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.728 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:46.728 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-05-08T05:33:46.728 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.728 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.728 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.728 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:46.729 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.729 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.729 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.729 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.729 INFO:teuthology.orchestra.run.smithi087.stdout: "sqlite3_killpoint": { 2024-05-08T05:33:46.729 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "sqlite3_killpoint", 2024-05-08T05:33:46.729 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "int", 2024-05-08T05:33:46.729 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "dev", 2024-05-08T05:33:46.729 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:46.729 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "0", 2024-05-08T05:33:46.729 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.729 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.729 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.730 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:46.730 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.730 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.730 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.730 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-05-08T05:33:46.730 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-05-08T05:33:46.730 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.730 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-05-08T05:33:46.730 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "k8sevents", 2024-05-08T05:33:46.730 INFO:teuthology.orchestra.run.smithi087.stdout: "can_run": true, 2024-05-08T05:33:46.731 INFO:teuthology.orchestra.run.smithi087.stdout: "error_string": "", 2024-05-08T05:33:46.731 INFO:teuthology.orchestra.run.smithi087.stdout: "module_options": { 2024-05-08T05:33:46.731 INFO:teuthology.orchestra.run.smithi087.stdout: "ceph_event_retention_days": { 2024-05-08T05:33:46.731 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "ceph_event_retention_days", 2024-05-08T05:33:46.731 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "int", 2024-05-08T05:33:46.731 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.731 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-08T05:33:46.731 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "7", 2024-05-08T05:33:46.731 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.731 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.731 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.731 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "Days to hold ceph event information within local cache", 2024-05-08T05:33:46.731 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.732 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.732 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.732 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.732 INFO:teuthology.orchestra.run.smithi087.stdout: "config_check_secs": { 2024-05-08T05:33:46.732 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "config_check_secs", 2024-05-08T05:33:46.732 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "int", 2024-05-08T05:33:46.732 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.732 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-08T05:33:46.732 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "10", 2024-05-08T05:33:46.732 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "10", 2024-05-08T05:33:46.732 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.732 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.733 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2024-05-08T05:33:46.733 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.733 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.733 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.733 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.733 INFO:teuthology.orchestra.run.smithi087.stdout: "log_level": { 2024-05-08T05:33:46.733 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_level", 2024-05-08T05:33:46.733 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-08T05:33:46.733 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.733 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:46.733 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-05-08T05:33:46.733 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.733 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.734 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [ 2024-05-08T05:33:46.734 INFO:teuthology.orchestra.run.smithi087.stdout: "", 2024-05-08T05:33:46.734 INFO:teuthology.orchestra.run.smithi087.stdout: "critical", 2024-05-08T05:33:46.734 INFO:teuthology.orchestra.run.smithi087.stdout: "debug", 2024-05-08T05:33:46.734 INFO:teuthology.orchestra.run.smithi087.stdout: "error", 2024-05-08T05:33:46.734 INFO:teuthology.orchestra.run.smithi087.stdout: "info", 2024-05-08T05:33:46.734 INFO:teuthology.orchestra.run.smithi087.stdout: "warning" 2024-05-08T05:33:46.734 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-05-08T05:33:46.734 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:46.734 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.734 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.734 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.735 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.735 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_cluster": { 2024-05-08T05:33:46.735 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_cluster", 2024-05-08T05:33:46.735 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-08T05:33:46.735 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.735 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:46.735 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-05-08T05:33:46.735 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.735 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.735 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.735 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:46.735 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.736 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.736 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.736 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.736 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_cluster_level": { 2024-05-08T05:33:46.736 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_cluster_level", 2024-05-08T05:33:46.736 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-08T05:33:46.736 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.736 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:46.736 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "info", 2024-05-08T05:33:46.736 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.736 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.736 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [ 2024-05-08T05:33:46.737 INFO:teuthology.orchestra.run.smithi087.stdout: "", 2024-05-08T05:33:46.737 INFO:teuthology.orchestra.run.smithi087.stdout: "critical", 2024-05-08T05:33:46.737 INFO:teuthology.orchestra.run.smithi087.stdout: "debug", 2024-05-08T05:33:46.737 INFO:teuthology.orchestra.run.smithi087.stdout: "error", 2024-05-08T05:33:46.737 INFO:teuthology.orchestra.run.smithi087.stdout: "info", 2024-05-08T05:33:46.737 INFO:teuthology.orchestra.run.smithi087.stdout: "warning" 2024-05-08T05:33:46.737 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-05-08T05:33:46.737 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:46.737 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.737 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.737 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.737 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.737 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_file": { 2024-05-08T05:33:46.737 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_file", 2024-05-08T05:33:46.738 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-08T05:33:46.738 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.738 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:46.738 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-05-08T05:33:46.738 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.738 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.738 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.738 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:46.738 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.738 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.738 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.739 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.739 INFO:teuthology.orchestra.run.smithi087.stdout: "sqlite3_killpoint": { 2024-05-08T05:33:46.739 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "sqlite3_killpoint", 2024-05-08T05:33:46.739 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "int", 2024-05-08T05:33:46.739 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "dev", 2024-05-08T05:33:46.739 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:46.739 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "0", 2024-05-08T05:33:46.739 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.739 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.739 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.739 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:46.739 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.739 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.740 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.740 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-05-08T05:33:46.740 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-05-08T05:33:46.740 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.740 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-05-08T05:33:46.740 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "localpool", 2024-05-08T05:33:46.740 INFO:teuthology.orchestra.run.smithi087.stdout: "can_run": true, 2024-05-08T05:33:46.740 INFO:teuthology.orchestra.run.smithi087.stdout: "error_string": "", 2024-05-08T05:33:46.740 INFO:teuthology.orchestra.run.smithi087.stdout: "module_options": { 2024-05-08T05:33:46.740 INFO:teuthology.orchestra.run.smithi087.stdout: "failure_domain": { 2024-05-08T05:33:46.740 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "failure_domain", 2024-05-08T05:33:46.740 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-08T05:33:46.740 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.741 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:46.741 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "host", 2024-05-08T05:33:46.741 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.741 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.741 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.741 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "failure domain for any created local pool", 2024-05-08T05:33:46.741 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2024-05-08T05:33:46.741 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.741 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.741 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.741 INFO:teuthology.orchestra.run.smithi087.stdout: "log_level": { 2024-05-08T05:33:46.741 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_level", 2024-05-08T05:33:46.742 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-08T05:33:46.742 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.742 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:46.742 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-05-08T05:33:46.742 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.742 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.742 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [ 2024-05-08T05:33:46.742 INFO:teuthology.orchestra.run.smithi087.stdout: "", 2024-05-08T05:33:46.742 INFO:teuthology.orchestra.run.smithi087.stdout: "critical", 2024-05-08T05:33:46.742 INFO:teuthology.orchestra.run.smithi087.stdout: "debug", 2024-05-08T05:33:46.742 INFO:teuthology.orchestra.run.smithi087.stdout: "error", 2024-05-08T05:33:46.742 INFO:teuthology.orchestra.run.smithi087.stdout: "info", 2024-05-08T05:33:46.742 INFO:teuthology.orchestra.run.smithi087.stdout: "warning" 2024-05-08T05:33:46.743 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-05-08T05:33:46.743 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:46.743 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.743 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.743 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.743 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.743 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_cluster": { 2024-05-08T05:33:46.743 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_cluster", 2024-05-08T05:33:46.743 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-08T05:33:46.743 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.743 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:46.743 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-05-08T05:33:46.744 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.744 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.744 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.744 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:46.744 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.744 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.744 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.744 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.744 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_cluster_level": { 2024-05-08T05:33:46.744 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_cluster_level", 2024-05-08T05:33:46.744 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-08T05:33:46.744 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.744 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:46.745 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "info", 2024-05-08T05:33:46.745 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.745 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.745 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [ 2024-05-08T05:33:46.745 INFO:teuthology.orchestra.run.smithi087.stdout: "", 2024-05-08T05:33:46.745 INFO:teuthology.orchestra.run.smithi087.stdout: "critical", 2024-05-08T05:33:46.745 INFO:teuthology.orchestra.run.smithi087.stdout: "debug", 2024-05-08T05:33:46.745 INFO:teuthology.orchestra.run.smithi087.stdout: "error", 2024-05-08T05:33:46.745 INFO:teuthology.orchestra.run.smithi087.stdout: "info", 2024-05-08T05:33:46.745 INFO:teuthology.orchestra.run.smithi087.stdout: "warning" 2024-05-08T05:33:46.745 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-05-08T05:33:46.745 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:46.746 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.746 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.746 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.746 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.746 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_file": { 2024-05-08T05:33:46.746 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_file", 2024-05-08T05:33:46.746 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-08T05:33:46.746 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.746 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:46.746 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-05-08T05:33:46.746 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.747 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.747 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.747 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:46.747 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.747 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.747 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.747 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.747 INFO:teuthology.orchestra.run.smithi087.stdout: "min_size": { 2024-05-08T05:33:46.747 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "min_size", 2024-05-08T05:33:46.747 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "int", 2024-05-08T05:33:46.747 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.747 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:46.747 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-05-08T05:33:46.748 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.748 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.748 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.748 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "default min_size for any created local pool", 2024-05-08T05:33:46.748 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2024-05-08T05:33:46.748 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.748 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.748 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.748 INFO:teuthology.orchestra.run.smithi087.stdout: "num_rep": { 2024-05-08T05:33:46.748 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "num_rep", 2024-05-08T05:33:46.748 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "int", 2024-05-08T05:33:46.749 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.749 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:46.749 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "3", 2024-05-08T05:33:46.749 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.749 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.749 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.749 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "default replica count for any created local pool", 2024-05-08T05:33:46.749 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.749 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.749 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.749 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.749 INFO:teuthology.orchestra.run.smithi087.stdout: "pg_num": { 2024-05-08T05:33:46.750 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "pg_num", 2024-05-08T05:33:46.750 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "int", 2024-05-08T05:33:46.750 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.750 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:46.750 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "128", 2024-05-08T05:33:46.750 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.750 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.750 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.750 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "default pg_num for any created local pool", 2024-05-08T05:33:46.750 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.750 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.751 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.751 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.751 INFO:teuthology.orchestra.run.smithi087.stdout: "prefix": { 2024-05-08T05:33:46.751 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "prefix", 2024-05-08T05:33:46.751 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-08T05:33:46.751 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.751 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:46.751 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-05-08T05:33:46.751 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.751 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.751 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.751 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "name prefix for any created local pool", 2024-05-08T05:33:46.751 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.752 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.752 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.752 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.752 INFO:teuthology.orchestra.run.smithi087.stdout: "sqlite3_killpoint": { 2024-05-08T05:33:46.752 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "sqlite3_killpoint", 2024-05-08T05:33:46.752 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "int", 2024-05-08T05:33:46.752 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "dev", 2024-05-08T05:33:46.752 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:46.752 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "0", 2024-05-08T05:33:46.752 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.752 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.752 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.752 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:46.753 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.753 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.753 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.753 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.753 INFO:teuthology.orchestra.run.smithi087.stdout: "subtree": { 2024-05-08T05:33:46.753 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "subtree", 2024-05-08T05:33:46.753 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-08T05:33:46.753 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.753 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:46.753 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "rack", 2024-05-08T05:33:46.753 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.753 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.754 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.754 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "CRUSH level for which to create a local pool", 2024-05-08T05:33:46.754 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2024-05-08T05:33:46.754 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.754 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.754 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-05-08T05:33:46.754 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-05-08T05:33:46.754 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.754 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-05-08T05:33:46.754 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "mds_autoscaler", 2024-05-08T05:33:46.754 INFO:teuthology.orchestra.run.smithi087.stdout: "can_run": true, 2024-05-08T05:33:46.754 INFO:teuthology.orchestra.run.smithi087.stdout: "error_string": "", 2024-05-08T05:33:46.754 INFO:teuthology.orchestra.run.smithi087.stdout: "module_options": { 2024-05-08T05:33:46.755 INFO:teuthology.orchestra.run.smithi087.stdout: "log_level": { 2024-05-08T05:33:46.755 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_level", 2024-05-08T05:33:46.755 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-08T05:33:46.755 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.755 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:46.755 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-05-08T05:33:46.755 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.755 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.755 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [ 2024-05-08T05:33:46.755 INFO:teuthology.orchestra.run.smithi087.stdout: "", 2024-05-08T05:33:46.755 INFO:teuthology.orchestra.run.smithi087.stdout: "critical", 2024-05-08T05:33:46.755 INFO:teuthology.orchestra.run.smithi087.stdout: "debug", 2024-05-08T05:33:46.755 INFO:teuthology.orchestra.run.smithi087.stdout: "error", 2024-05-08T05:33:46.756 INFO:teuthology.orchestra.run.smithi087.stdout: "info", 2024-05-08T05:33:46.756 INFO:teuthology.orchestra.run.smithi087.stdout: "warning" 2024-05-08T05:33:46.756 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-05-08T05:33:46.756 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:46.756 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.756 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.756 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.756 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.756 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_cluster": { 2024-05-08T05:33:46.756 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_cluster", 2024-05-08T05:33:46.756 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-08T05:33:46.756 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.757 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:46.757 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-05-08T05:33:46.757 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.757 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.757 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.757 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:46.757 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.757 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.757 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.757 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.757 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_cluster_level": { 2024-05-08T05:33:46.757 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_cluster_level", 2024-05-08T05:33:46.757 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-08T05:33:46.757 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.758 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:46.758 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "info", 2024-05-08T05:33:46.758 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.758 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.758 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [ 2024-05-08T05:33:46.758 INFO:teuthology.orchestra.run.smithi087.stdout: "", 2024-05-08T05:33:46.758 INFO:teuthology.orchestra.run.smithi087.stdout: "critical", 2024-05-08T05:33:46.758 INFO:teuthology.orchestra.run.smithi087.stdout: "debug", 2024-05-08T05:33:46.758 INFO:teuthology.orchestra.run.smithi087.stdout: "error", 2024-05-08T05:33:46.758 INFO:teuthology.orchestra.run.smithi087.stdout: "info", 2024-05-08T05:33:46.758 INFO:teuthology.orchestra.run.smithi087.stdout: "warning" 2024-05-08T05:33:46.758 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-05-08T05:33:46.759 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:46.759 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.759 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.759 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.759 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.759 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_file": { 2024-05-08T05:33:46.759 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_file", 2024-05-08T05:33:46.759 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-08T05:33:46.759 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.759 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:46.759 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-05-08T05:33:46.759 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.759 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.760 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.760 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:46.760 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.760 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.760 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.760 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.760 INFO:teuthology.orchestra.run.smithi087.stdout: "sqlite3_killpoint": { 2024-05-08T05:33:46.760 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "sqlite3_killpoint", 2024-05-08T05:33:46.760 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "int", 2024-05-08T05:33:46.760 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "dev", 2024-05-08T05:33:46.760 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:46.760 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "0", 2024-05-08T05:33:46.761 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.761 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.761 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.761 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:46.761 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.761 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.761 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.761 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-05-08T05:33:46.761 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-05-08T05:33:46.761 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.761 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-05-08T05:33:46.761 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "mirroring", 2024-05-08T05:33:46.761 INFO:teuthology.orchestra.run.smithi087.stdout: "can_run": true, 2024-05-08T05:33:46.762 INFO:teuthology.orchestra.run.smithi087.stdout: "error_string": "", 2024-05-08T05:33:46.762 INFO:teuthology.orchestra.run.smithi087.stdout: "module_options": { 2024-05-08T05:33:46.762 INFO:teuthology.orchestra.run.smithi087.stdout: "log_level": { 2024-05-08T05:33:46.762 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_level", 2024-05-08T05:33:46.762 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-08T05:33:46.762 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.762 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:46.762 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-05-08T05:33:46.762 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.762 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.762 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [ 2024-05-08T05:33:46.762 INFO:teuthology.orchestra.run.smithi087.stdout: "", 2024-05-08T05:33:46.762 INFO:teuthology.orchestra.run.smithi087.stdout: "critical", 2024-05-08T05:33:46.763 INFO:teuthology.orchestra.run.smithi087.stdout: "debug", 2024-05-08T05:33:46.763 INFO:teuthology.orchestra.run.smithi087.stdout: "error", 2024-05-08T05:33:46.763 INFO:teuthology.orchestra.run.smithi087.stdout: "info", 2024-05-08T05:33:46.763 INFO:teuthology.orchestra.run.smithi087.stdout: "warning" 2024-05-08T05:33:46.763 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-05-08T05:33:46.763 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:46.763 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.763 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.763 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.763 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.763 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_cluster": { 2024-05-08T05:33:46.763 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_cluster", 2024-05-08T05:33:46.763 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-08T05:33:46.763 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.764 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:46.764 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-05-08T05:33:46.764 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.764 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.764 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.764 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:46.764 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.764 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.764 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.764 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.764 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_cluster_level": { 2024-05-08T05:33:46.764 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_cluster_level", 2024-05-08T05:33:46.764 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-08T05:33:46.765 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.765 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:46.765 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "info", 2024-05-08T05:33:46.765 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.765 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.765 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [ 2024-05-08T05:33:46.765 INFO:teuthology.orchestra.run.smithi087.stdout: "", 2024-05-08T05:33:46.765 INFO:teuthology.orchestra.run.smithi087.stdout: "critical", 2024-05-08T05:33:46.765 INFO:teuthology.orchestra.run.smithi087.stdout: "debug", 2024-05-08T05:33:46.765 INFO:teuthology.orchestra.run.smithi087.stdout: "error", 2024-05-08T05:33:46.765 INFO:teuthology.orchestra.run.smithi087.stdout: "info", 2024-05-08T05:33:46.765 INFO:teuthology.orchestra.run.smithi087.stdout: "warning" 2024-05-08T05:33:46.766 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-05-08T05:33:46.766 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:46.766 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.766 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.766 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.766 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.766 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_file": { 2024-05-08T05:33:46.766 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_file", 2024-05-08T05:33:46.766 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-08T05:33:46.766 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.766 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:46.766 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-05-08T05:33:46.767 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.767 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.767 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.767 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:46.767 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.767 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.767 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.767 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.767 INFO:teuthology.orchestra.run.smithi087.stdout: "sqlite3_killpoint": { 2024-05-08T05:33:46.767 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "sqlite3_killpoint", 2024-05-08T05:33:46.767 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "int", 2024-05-08T05:33:46.767 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "dev", 2024-05-08T05:33:46.767 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:46.767 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "0", 2024-05-08T05:33:46.768 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.768 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.768 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.768 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:46.768 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.768 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.768 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.768 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-05-08T05:33:46.768 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-05-08T05:33:46.768 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.768 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-05-08T05:33:46.769 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "nfs", 2024-05-08T05:33:46.769 INFO:teuthology.orchestra.run.smithi087.stdout: "can_run": true, 2024-05-08T05:33:46.769 INFO:teuthology.orchestra.run.smithi087.stdout: "error_string": "", 2024-05-08T05:33:46.769 INFO:teuthology.orchestra.run.smithi087.stdout: "module_options": { 2024-05-08T05:33:46.769 INFO:teuthology.orchestra.run.smithi087.stdout: "log_level": { 2024-05-08T05:33:46.769 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_level", 2024-05-08T05:33:46.769 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-08T05:33:46.769 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.769 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:46.769 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-05-08T05:33:46.769 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.769 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.769 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [ 2024-05-08T05:33:46.769 INFO:teuthology.orchestra.run.smithi087.stdout: "", 2024-05-08T05:33:46.770 INFO:teuthology.orchestra.run.smithi087.stdout: "critical", 2024-05-08T05:33:46.770 INFO:teuthology.orchestra.run.smithi087.stdout: "debug", 2024-05-08T05:33:46.770 INFO:teuthology.orchestra.run.smithi087.stdout: "error", 2024-05-08T05:33:46.770 INFO:teuthology.orchestra.run.smithi087.stdout: "info", 2024-05-08T05:33:46.770 INFO:teuthology.orchestra.run.smithi087.stdout: "warning" 2024-05-08T05:33:46.770 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-05-08T05:33:46.770 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:46.770 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.770 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.770 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.770 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.770 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_cluster": { 2024-05-08T05:33:46.770 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_cluster", 2024-05-08T05:33:46.771 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-08T05:33:46.771 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.771 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:46.771 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-05-08T05:33:46.771 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.771 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.771 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.771 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:46.771 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.771 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.771 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.771 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.771 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_cluster_level": { 2024-05-08T05:33:46.771 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_cluster_level", 2024-05-08T05:33:46.772 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-08T05:33:46.772 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.772 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:46.772 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "info", 2024-05-08T05:33:46.772 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.772 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.772 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [ 2024-05-08T05:33:46.772 INFO:teuthology.orchestra.run.smithi087.stdout: "", 2024-05-08T05:33:46.772 INFO:teuthology.orchestra.run.smithi087.stdout: "critical", 2024-05-08T05:33:46.772 INFO:teuthology.orchestra.run.smithi087.stdout: "debug", 2024-05-08T05:33:46.772 INFO:teuthology.orchestra.run.smithi087.stdout: "error", 2024-05-08T05:33:46.772 INFO:teuthology.orchestra.run.smithi087.stdout: "info", 2024-05-08T05:33:46.773 INFO:teuthology.orchestra.run.smithi087.stdout: "warning" 2024-05-08T05:33:46.773 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-05-08T05:33:46.773 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:46.773 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.773 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.773 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.773 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.773 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_file": { 2024-05-08T05:33:46.773 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_file", 2024-05-08T05:33:46.773 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-08T05:33:46.773 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.773 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:46.773 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-05-08T05:33:46.774 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.774 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.774 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.774 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:46.774 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.774 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.774 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.774 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.774 INFO:teuthology.orchestra.run.smithi087.stdout: "sqlite3_killpoint": { 2024-05-08T05:33:46.774 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "sqlite3_killpoint", 2024-05-08T05:33:46.774 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "int", 2024-05-08T05:33:46.774 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "dev", 2024-05-08T05:33:46.775 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:46.775 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "0", 2024-05-08T05:33:46.775 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.775 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.775 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.775 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:46.775 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.775 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.775 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.775 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-05-08T05:33:46.775 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-05-08T05:33:46.775 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.775 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-05-08T05:33:46.776 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "orchestrator", 2024-05-08T05:33:46.776 INFO:teuthology.orchestra.run.smithi087.stdout: "can_run": true, 2024-05-08T05:33:46.776 INFO:teuthology.orchestra.run.smithi087.stdout: "error_string": "", 2024-05-08T05:33:46.776 INFO:teuthology.orchestra.run.smithi087.stdout: "module_options": { 2024-05-08T05:33:46.776 INFO:teuthology.orchestra.run.smithi087.stdout: "fail_fs": { 2024-05-08T05:33:46.776 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "fail_fs", 2024-05-08T05:33:46.776 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-08T05:33:46.776 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.776 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-08T05:33:46.776 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-05-08T05:33:46.776 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.777 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.777 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.777 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2024-05-08T05:33:46.777 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.777 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.777 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.777 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.777 INFO:teuthology.orchestra.run.smithi087.stdout: "log_level": { 2024-05-08T05:33:46.777 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_level", 2024-05-08T05:33:46.777 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-08T05:33:46.777 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.777 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:46.778 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-05-08T05:33:46.778 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.778 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.778 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [ 2024-05-08T05:33:46.778 INFO:teuthology.orchestra.run.smithi087.stdout: "", 2024-05-08T05:33:46.778 INFO:teuthology.orchestra.run.smithi087.stdout: "critical", 2024-05-08T05:33:46.778 INFO:teuthology.orchestra.run.smithi087.stdout: "debug", 2024-05-08T05:33:46.778 INFO:teuthology.orchestra.run.smithi087.stdout: "error", 2024-05-08T05:33:46.778 INFO:teuthology.orchestra.run.smithi087.stdout: "info", 2024-05-08T05:33:46.778 INFO:teuthology.orchestra.run.smithi087.stdout: "warning" 2024-05-08T05:33:46.778 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-05-08T05:33:46.779 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:46.779 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.779 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.779 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.779 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.779 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_cluster": { 2024-05-08T05:33:46.779 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_cluster", 2024-05-08T05:33:46.779 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-08T05:33:46.779 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.779 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:46.779 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-05-08T05:33:46.779 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.779 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.780 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.780 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:46.780 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.780 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.780 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.780 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.780 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_cluster_level": { 2024-05-08T05:33:46.780 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_cluster_level", 2024-05-08T05:33:46.780 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-08T05:33:46.780 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.780 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:46.780 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "info", 2024-05-08T05:33:46.781 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.781 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.781 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [ 2024-05-08T05:33:46.781 INFO:teuthology.orchestra.run.smithi087.stdout: "", 2024-05-08T05:33:46.781 INFO:teuthology.orchestra.run.smithi087.stdout: "critical", 2024-05-08T05:33:46.781 INFO:teuthology.orchestra.run.smithi087.stdout: "debug", 2024-05-08T05:33:46.781 INFO:teuthology.orchestra.run.smithi087.stdout: "error", 2024-05-08T05:33:46.781 INFO:teuthology.orchestra.run.smithi087.stdout: "info", 2024-05-08T05:33:46.781 INFO:teuthology.orchestra.run.smithi087.stdout: "warning" 2024-05-08T05:33:46.781 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-05-08T05:33:46.781 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:46.781 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.781 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.782 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.782 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.782 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_file": { 2024-05-08T05:33:46.782 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_file", 2024-05-08T05:33:46.782 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-08T05:33:46.782 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.782 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:46.782 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-05-08T05:33:46.782 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.782 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.782 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.782 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:46.783 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.783 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.783 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.783 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.783 INFO:teuthology.orchestra.run.smithi087.stdout: "orchestrator": { 2024-05-08T05:33:46.783 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "orchestrator", 2024-05-08T05:33:46.783 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-08T05:33:46.783 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.783 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:46.783 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-05-08T05:33:46.783 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.783 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.783 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [ 2024-05-08T05:33:46.784 INFO:teuthology.orchestra.run.smithi087.stdout: "cephadm", 2024-05-08T05:33:46.784 INFO:teuthology.orchestra.run.smithi087.stdout: "rook", 2024-05-08T05:33:46.784 INFO:teuthology.orchestra.run.smithi087.stdout: "test_orchestrator" 2024-05-08T05:33:46.784 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-05-08T05:33:46.784 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "Orchestrator backend", 2024-05-08T05:33:46.784 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.784 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.784 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.784 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.784 INFO:teuthology.orchestra.run.smithi087.stdout: "sqlite3_killpoint": { 2024-05-08T05:33:46.784 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "sqlite3_killpoint", 2024-05-08T05:33:46.784 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "int", 2024-05-08T05:33:46.785 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "dev", 2024-05-08T05:33:46.785 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:46.785 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "0", 2024-05-08T05:33:46.785 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.785 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.785 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.785 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:46.785 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.785 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.785 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.785 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-05-08T05:33:46.785 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-05-08T05:33:46.785 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.786 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-05-08T05:33:46.786 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "osd_perf_query", 2024-05-08T05:33:46.786 INFO:teuthology.orchestra.run.smithi087.stdout: "can_run": true, 2024-05-08T05:33:46.786 INFO:teuthology.orchestra.run.smithi087.stdout: "error_string": "", 2024-05-08T05:33:46.786 INFO:teuthology.orchestra.run.smithi087.stdout: "module_options": { 2024-05-08T05:33:46.786 INFO:teuthology.orchestra.run.smithi087.stdout: "log_level": { 2024-05-08T05:33:46.786 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_level", 2024-05-08T05:33:46.786 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-08T05:33:46.786 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.786 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:46.786 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-05-08T05:33:46.787 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.787 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.787 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [ 2024-05-08T05:33:46.787 INFO:teuthology.orchestra.run.smithi087.stdout: "", 2024-05-08T05:33:46.787 INFO:teuthology.orchestra.run.smithi087.stdout: "critical", 2024-05-08T05:33:46.787 INFO:teuthology.orchestra.run.smithi087.stdout: "debug", 2024-05-08T05:33:46.787 INFO:teuthology.orchestra.run.smithi087.stdout: "error", 2024-05-08T05:33:46.787 INFO:teuthology.orchestra.run.smithi087.stdout: "info", 2024-05-08T05:33:46.787 INFO:teuthology.orchestra.run.smithi087.stdout: "warning" 2024-05-08T05:33:46.787 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-05-08T05:33:46.787 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:46.787 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.788 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.788 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.788 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.788 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_cluster": { 2024-05-08T05:33:46.788 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_cluster", 2024-05-08T05:33:46.788 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-08T05:33:46.788 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.788 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:46.788 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-05-08T05:33:46.788 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.788 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.788 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.789 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:46.789 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.789 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.789 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.789 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.789 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_cluster_level": { 2024-05-08T05:33:46.789 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_cluster_level", 2024-05-08T05:33:46.789 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-08T05:33:46.789 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.789 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:46.789 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "info", 2024-05-08T05:33:46.789 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.790 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.790 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [ 2024-05-08T05:33:46.790 INFO:teuthology.orchestra.run.smithi087.stdout: "", 2024-05-08T05:33:46.790 INFO:teuthology.orchestra.run.smithi087.stdout: "critical", 2024-05-08T05:33:46.790 INFO:teuthology.orchestra.run.smithi087.stdout: "debug", 2024-05-08T05:33:46.790 INFO:teuthology.orchestra.run.smithi087.stdout: "error", 2024-05-08T05:33:46.790 INFO:teuthology.orchestra.run.smithi087.stdout: "info", 2024-05-08T05:33:46.790 INFO:teuthology.orchestra.run.smithi087.stdout: "warning" 2024-05-08T05:33:46.790 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-05-08T05:33:46.790 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:46.790 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.791 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.791 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.791 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.791 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_file": { 2024-05-08T05:33:46.791 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_file", 2024-05-08T05:33:46.791 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-08T05:33:46.791 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.791 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:46.791 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-05-08T05:33:46.791 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.791 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.791 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.792 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:46.792 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.792 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.792 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.792 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.792 INFO:teuthology.orchestra.run.smithi087.stdout: "sqlite3_killpoint": { 2024-05-08T05:33:46.792 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "sqlite3_killpoint", 2024-05-08T05:33:46.792 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "int", 2024-05-08T05:33:46.792 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "dev", 2024-05-08T05:33:46.792 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:46.792 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "0", 2024-05-08T05:33:46.792 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.792 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.792 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.793 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:46.793 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.793 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.793 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.793 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-05-08T05:33:46.793 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-05-08T05:33:46.793 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.793 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-05-08T05:33:46.793 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "osd_support", 2024-05-08T05:33:46.793 INFO:teuthology.orchestra.run.smithi087.stdout: "can_run": true, 2024-05-08T05:33:46.793 INFO:teuthology.orchestra.run.smithi087.stdout: "error_string": "", 2024-05-08T05:33:46.793 INFO:teuthology.orchestra.run.smithi087.stdout: "module_options": { 2024-05-08T05:33:46.793 INFO:teuthology.orchestra.run.smithi087.stdout: "log_level": { 2024-05-08T05:33:46.794 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_level", 2024-05-08T05:33:46.794 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-08T05:33:46.794 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.794 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:46.794 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-05-08T05:33:46.794 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.794 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.794 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [ 2024-05-08T05:33:46.794 INFO:teuthology.orchestra.run.smithi087.stdout: "", 2024-05-08T05:33:46.794 INFO:teuthology.orchestra.run.smithi087.stdout: "critical", 2024-05-08T05:33:46.794 INFO:teuthology.orchestra.run.smithi087.stdout: "debug", 2024-05-08T05:33:46.794 INFO:teuthology.orchestra.run.smithi087.stdout: "error", 2024-05-08T05:33:46.795 INFO:teuthology.orchestra.run.smithi087.stdout: "info", 2024-05-08T05:33:46.795 INFO:teuthology.orchestra.run.smithi087.stdout: "warning" 2024-05-08T05:33:46.795 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-05-08T05:33:46.795 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:46.795 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.795 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.795 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.795 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.795 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_cluster": { 2024-05-08T05:33:46.795 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_cluster", 2024-05-08T05:33:46.795 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-08T05:33:46.795 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.795 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:46.795 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-05-08T05:33:46.796 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.796 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.796 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.796 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:46.796 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.796 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.796 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.796 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.796 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_cluster_level": { 2024-05-08T05:33:46.796 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_cluster_level", 2024-05-08T05:33:46.796 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-08T05:33:46.796 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.796 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:46.797 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "info", 2024-05-08T05:33:46.797 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.797 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.797 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [ 2024-05-08T05:33:46.797 INFO:teuthology.orchestra.run.smithi087.stdout: "", 2024-05-08T05:33:46.797 INFO:teuthology.orchestra.run.smithi087.stdout: "critical", 2024-05-08T05:33:46.797 INFO:teuthology.orchestra.run.smithi087.stdout: "debug", 2024-05-08T05:33:46.797 INFO:teuthology.orchestra.run.smithi087.stdout: "error", 2024-05-08T05:33:46.797 INFO:teuthology.orchestra.run.smithi087.stdout: "info", 2024-05-08T05:33:46.797 INFO:teuthology.orchestra.run.smithi087.stdout: "warning" 2024-05-08T05:33:46.797 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-05-08T05:33:46.797 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:46.797 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.798 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.798 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.798 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.798 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_file": { 2024-05-08T05:33:46.798 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_file", 2024-05-08T05:33:46.798 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-08T05:33:46.798 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.798 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:46.798 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-05-08T05:33:46.798 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.798 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.798 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.798 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:46.799 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.799 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.799 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.799 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.799 INFO:teuthology.orchestra.run.smithi087.stdout: "sqlite3_killpoint": { 2024-05-08T05:33:46.799 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "sqlite3_killpoint", 2024-05-08T05:33:46.799 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "int", 2024-05-08T05:33:46.799 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "dev", 2024-05-08T05:33:46.799 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:46.799 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "0", 2024-05-08T05:33:46.799 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.799 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.799 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.799 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:46.800 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.800 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.800 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.800 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-05-08T05:33:46.800 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-05-08T05:33:46.800 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.800 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-05-08T05:33:46.800 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "pg_autoscaler", 2024-05-08T05:33:46.800 INFO:teuthology.orchestra.run.smithi087.stdout: "can_run": true, 2024-05-08T05:33:46.800 INFO:teuthology.orchestra.run.smithi087.stdout: "error_string": "", 2024-05-08T05:33:46.800 INFO:teuthology.orchestra.run.smithi087.stdout: "module_options": { 2024-05-08T05:33:46.800 INFO:teuthology.orchestra.run.smithi087.stdout: "log_level": { 2024-05-08T05:33:46.801 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_level", 2024-05-08T05:33:46.801 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-08T05:33:46.801 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.801 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:46.801 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-05-08T05:33:46.801 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.801 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.801 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [ 2024-05-08T05:33:46.801 INFO:teuthology.orchestra.run.smithi087.stdout: "", 2024-05-08T05:33:46.801 INFO:teuthology.orchestra.run.smithi087.stdout: "critical", 2024-05-08T05:33:46.801 INFO:teuthology.orchestra.run.smithi087.stdout: "debug", 2024-05-08T05:33:46.801 INFO:teuthology.orchestra.run.smithi087.stdout: "error", 2024-05-08T05:33:46.801 INFO:teuthology.orchestra.run.smithi087.stdout: "info", 2024-05-08T05:33:46.801 INFO:teuthology.orchestra.run.smithi087.stdout: "warning" 2024-05-08T05:33:46.802 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-05-08T05:33:46.802 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:46.802 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.802 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.802 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.802 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.802 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_cluster": { 2024-05-08T05:33:46.802 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_cluster", 2024-05-08T05:33:46.802 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-08T05:33:46.802 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.802 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:46.802 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-05-08T05:33:46.803 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.803 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.803 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.803 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:46.803 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.803 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.803 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.803 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.803 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_cluster_level": { 2024-05-08T05:33:46.803 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_cluster_level", 2024-05-08T05:33:46.803 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-08T05:33:46.803 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.803 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:46.803 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "info", 2024-05-08T05:33:46.804 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.804 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.804 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [ 2024-05-08T05:33:46.804 INFO:teuthology.orchestra.run.smithi087.stdout: "", 2024-05-08T05:33:46.804 INFO:teuthology.orchestra.run.smithi087.stdout: "critical", 2024-05-08T05:33:46.804 INFO:teuthology.orchestra.run.smithi087.stdout: "debug", 2024-05-08T05:33:46.804 INFO:teuthology.orchestra.run.smithi087.stdout: "error", 2024-05-08T05:33:46.804 INFO:teuthology.orchestra.run.smithi087.stdout: "info", 2024-05-08T05:33:46.804 INFO:teuthology.orchestra.run.smithi087.stdout: "warning" 2024-05-08T05:33:46.804 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-05-08T05:33:46.804 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:46.804 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.804 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.805 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.805 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.805 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_file": { 2024-05-08T05:33:46.805 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_file", 2024-05-08T05:33:46.805 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-08T05:33:46.805 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.805 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:46.805 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-05-08T05:33:46.805 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.805 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.805 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.805 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:46.806 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.806 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.806 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.806 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.806 INFO:teuthology.orchestra.run.smithi087.stdout: "sleep_interval": { 2024-05-08T05:33:46.806 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "sleep_interval", 2024-05-08T05:33:46.806 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "secs", 2024-05-08T05:33:46.806 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.806 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-08T05:33:46.806 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "60", 2024-05-08T05:33:46.806 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.807 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.807 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.807 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:46.807 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.807 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.807 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.807 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.807 INFO:teuthology.orchestra.run.smithi087.stdout: "sqlite3_killpoint": { 2024-05-08T05:33:46.807 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "sqlite3_killpoint", 2024-05-08T05:33:46.807 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "int", 2024-05-08T05:33:46.807 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "dev", 2024-05-08T05:33:46.807 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:46.808 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "0", 2024-05-08T05:33:46.808 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.808 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.808 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.808 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:46.808 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.808 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.808 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.808 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.808 INFO:teuthology.orchestra.run.smithi087.stdout: "threshold": { 2024-05-08T05:33:46.808 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "threshold", 2024-05-08T05:33:46.808 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "float", 2024-05-08T05:33:46.809 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.809 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-08T05:33:46.809 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "3.0", 2024-05-08T05:33:46.809 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "1.0", 2024-05-08T05:33:46.809 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.809 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.809 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "scaling threshold", 2024-05-08T05:33:46.809 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2024-05-08T05:33:46.809 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.809 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.809 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-05-08T05:33:46.809 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-05-08T05:33:46.810 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.810 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-05-08T05:33:46.810 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "progress", 2024-05-08T05:33:46.810 INFO:teuthology.orchestra.run.smithi087.stdout: "can_run": true, 2024-05-08T05:33:46.810 INFO:teuthology.orchestra.run.smithi087.stdout: "error_string": "", 2024-05-08T05:33:46.810 INFO:teuthology.orchestra.run.smithi087.stdout: "module_options": { 2024-05-08T05:33:46.810 INFO:teuthology.orchestra.run.smithi087.stdout: "allow_pg_recovery_event": { 2024-05-08T05:33:46.810 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "allow_pg_recovery_event", 2024-05-08T05:33:46.810 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-08T05:33:46.810 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.810 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:46.810 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-05-08T05:33:46.811 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.811 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.811 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.811 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "allow the module to show pg recovery progress", 2024-05-08T05:33:46.811 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.811 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.811 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.811 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.811 INFO:teuthology.orchestra.run.smithi087.stdout: "enabled": { 2024-05-08T05:33:46.811 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "enabled", 2024-05-08T05:33:46.811 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-08T05:33:46.811 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.812 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-08T05:33:46.812 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "True", 2024-05-08T05:33:46.812 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.812 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.812 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.812 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:46.812 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.812 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.812 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.812 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.812 INFO:teuthology.orchestra.run.smithi087.stdout: "log_level": { 2024-05-08T05:33:46.813 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_level", 2024-05-08T05:33:46.813 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-08T05:33:46.813 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.813 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:46.813 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-05-08T05:33:46.813 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.813 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.813 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [ 2024-05-08T05:33:46.813 INFO:teuthology.orchestra.run.smithi087.stdout: "", 2024-05-08T05:33:46.813 INFO:teuthology.orchestra.run.smithi087.stdout: "critical", 2024-05-08T05:33:46.813 INFO:teuthology.orchestra.run.smithi087.stdout: "debug", 2024-05-08T05:33:46.813 INFO:teuthology.orchestra.run.smithi087.stdout: "error", 2024-05-08T05:33:46.814 INFO:teuthology.orchestra.run.smithi087.stdout: "info", 2024-05-08T05:33:46.814 INFO:teuthology.orchestra.run.smithi087.stdout: "warning" 2024-05-08T05:33:46.814 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-05-08T05:33:46.814 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:46.814 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.814 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.814 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.814 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.814 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_cluster": { 2024-05-08T05:33:46.814 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_cluster", 2024-05-08T05:33:46.814 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-08T05:33:46.815 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.815 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:46.815 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-05-08T05:33:46.815 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.815 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.815 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.815 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:46.815 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.815 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.815 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.815 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.815 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_cluster_level": { 2024-05-08T05:33:46.815 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_cluster_level", 2024-05-08T05:33:46.816 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-08T05:33:46.816 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.816 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:46.816 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "info", 2024-05-08T05:33:46.816 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.816 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.816 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [ 2024-05-08T05:33:46.816 INFO:teuthology.orchestra.run.smithi087.stdout: "", 2024-05-08T05:33:46.816 INFO:teuthology.orchestra.run.smithi087.stdout: "critical", 2024-05-08T05:33:46.816 INFO:teuthology.orchestra.run.smithi087.stdout: "debug", 2024-05-08T05:33:46.816 INFO:teuthology.orchestra.run.smithi087.stdout: "error", 2024-05-08T05:33:46.816 INFO:teuthology.orchestra.run.smithi087.stdout: "info", 2024-05-08T05:33:46.817 INFO:teuthology.orchestra.run.smithi087.stdout: "warning" 2024-05-08T05:33:46.817 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-05-08T05:33:46.817 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:46.817 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.817 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.817 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.817 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.817 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_file": { 2024-05-08T05:33:46.817 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_file", 2024-05-08T05:33:46.817 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-08T05:33:46.817 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.817 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:46.818 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-05-08T05:33:46.818 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.818 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.818 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.818 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:46.818 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.818 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.818 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.818 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.818 INFO:teuthology.orchestra.run.smithi087.stdout: "max_completed_events": { 2024-05-08T05:33:46.818 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "max_completed_events", 2024-05-08T05:33:46.818 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "int", 2024-05-08T05:33:46.819 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.819 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:46.819 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "50", 2024-05-08T05:33:46.819 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.819 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.819 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.819 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "number of past completed events to remember", 2024-05-08T05:33:46.819 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.819 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.819 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.819 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.819 INFO:teuthology.orchestra.run.smithi087.stdout: "sleep_interval": { 2024-05-08T05:33:46.820 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "sleep_interval", 2024-05-08T05:33:46.820 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "secs", 2024-05-08T05:33:46.820 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.820 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:46.820 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "5", 2024-05-08T05:33:46.820 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.820 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.820 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.820 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "how long the module is going to sleep", 2024-05-08T05:33:46.820 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.820 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.821 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.821 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.821 INFO:teuthology.orchestra.run.smithi087.stdout: "sqlite3_killpoint": { 2024-05-08T05:33:46.821 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "sqlite3_killpoint", 2024-05-08T05:33:46.821 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "int", 2024-05-08T05:33:46.821 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "dev", 2024-05-08T05:33:46.821 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:46.821 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "0", 2024-05-08T05:33:46.821 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.821 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.821 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.821 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:46.821 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.822 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.822 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.822 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-05-08T05:33:46.822 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-05-08T05:33:46.822 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.822 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-05-08T05:33:46.822 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "prometheus", 2024-05-08T05:33:46.822 INFO:teuthology.orchestra.run.smithi087.stdout: "can_run": true, 2024-05-08T05:33:46.822 INFO:teuthology.orchestra.run.smithi087.stdout: "error_string": "", 2024-05-08T05:33:46.822 INFO:teuthology.orchestra.run.smithi087.stdout: "module_options": { 2024-05-08T05:33:46.822 INFO:teuthology.orchestra.run.smithi087.stdout: "cache": { 2024-05-08T05:33:46.822 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "cache", 2024-05-08T05:33:46.823 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-08T05:33:46.823 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.823 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-08T05:33:46.823 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "True", 2024-05-08T05:33:46.823 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.823 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.823 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.823 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:46.823 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.823 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.823 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.824 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.824 INFO:teuthology.orchestra.run.smithi087.stdout: "exclude_perf_counters": { 2024-05-08T05:33:46.824 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "exclude_perf_counters", 2024-05-08T05:33:46.824 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-08T05:33:46.824 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.824 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:46.824 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "True", 2024-05-08T05:33:46.824 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.824 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.824 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.824 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "Do not include perf-counters in the metrics output", 2024-05-08T05:33:46.824 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2024-05-08T05:33:46.825 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.825 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.825 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.825 INFO:teuthology.orchestra.run.smithi087.stdout: "log_level": { 2024-05-08T05:33:46.825 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_level", 2024-05-08T05:33:46.825 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-08T05:33:46.825 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.825 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:46.825 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-05-08T05:33:46.825 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.825 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.825 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [ 2024-05-08T05:33:46.825 INFO:teuthology.orchestra.run.smithi087.stdout: "", 2024-05-08T05:33:46.826 INFO:teuthology.orchestra.run.smithi087.stdout: "critical", 2024-05-08T05:33:46.826 INFO:teuthology.orchestra.run.smithi087.stdout: "debug", 2024-05-08T05:33:46.826 INFO:teuthology.orchestra.run.smithi087.stdout: "error", 2024-05-08T05:33:46.826 INFO:teuthology.orchestra.run.smithi087.stdout: "info", 2024-05-08T05:33:46.826 INFO:teuthology.orchestra.run.smithi087.stdout: "warning" 2024-05-08T05:33:46.826 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-05-08T05:33:46.826 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:46.826 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.826 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.826 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.826 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.827 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_cluster": { 2024-05-08T05:33:46.827 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_cluster", 2024-05-08T05:33:46.827 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-08T05:33:46.827 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.827 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:46.827 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-05-08T05:33:46.827 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.827 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.827 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.827 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:46.827 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.828 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.828 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.828 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.828 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_cluster_level": { 2024-05-08T05:33:46.828 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_cluster_level", 2024-05-08T05:33:46.828 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-08T05:33:46.828 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.828 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:46.828 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "info", 2024-05-08T05:33:46.828 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.828 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.828 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [ 2024-05-08T05:33:46.828 INFO:teuthology.orchestra.run.smithi087.stdout: "", 2024-05-08T05:33:46.829 INFO:teuthology.orchestra.run.smithi087.stdout: "critical", 2024-05-08T05:33:46.829 INFO:teuthology.orchestra.run.smithi087.stdout: "debug", 2024-05-08T05:33:46.829 INFO:teuthology.orchestra.run.smithi087.stdout: "error", 2024-05-08T05:33:46.829 INFO:teuthology.orchestra.run.smithi087.stdout: "info", 2024-05-08T05:33:46.829 INFO:teuthology.orchestra.run.smithi087.stdout: "warning" 2024-05-08T05:33:46.829 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-05-08T05:33:46.829 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:46.829 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.829 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.829 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.829 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.829 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_file": { 2024-05-08T05:33:46.830 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_file", 2024-05-08T05:33:46.830 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-08T05:33:46.830 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.830 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:46.830 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-05-08T05:33:46.830 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.830 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.830 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.830 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:46.830 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.830 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.831 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.831 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.831 INFO:teuthology.orchestra.run.smithi087.stdout: "rbd_stats_pools": { 2024-05-08T05:33:46.831 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "rbd_stats_pools", 2024-05-08T05:33:46.831 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-08T05:33:46.831 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.831 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-08T05:33:46.831 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-05-08T05:33:46.831 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.831 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.831 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.831 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:46.832 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.832 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.832 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.832 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.832 INFO:teuthology.orchestra.run.smithi087.stdout: "rbd_stats_pools_refresh_interval": { 2024-05-08T05:33:46.832 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "rbd_stats_pools_refresh_interval", 2024-05-08T05:33:46.832 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "int", 2024-05-08T05:33:46.832 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.832 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-08T05:33:46.832 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "300", 2024-05-08T05:33:46.832 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.832 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.832 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.832 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:46.833 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.833 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.833 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.833 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.833 INFO:teuthology.orchestra.run.smithi087.stdout: "scrape_interval": { 2024-05-08T05:33:46.833 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "scrape_interval", 2024-05-08T05:33:46.833 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "float", 2024-05-08T05:33:46.833 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.833 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-08T05:33:46.833 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "15.0", 2024-05-08T05:33:46.833 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.833 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.833 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.834 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:46.834 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.834 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.834 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.834 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.834 INFO:teuthology.orchestra.run.smithi087.stdout: "server_addr": { 2024-05-08T05:33:46.834 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "server_addr", 2024-05-08T05:33:46.834 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-08T05:33:46.834 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.834 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-08T05:33:46.834 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "::", 2024-05-08T05:33:46.834 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.835 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.835 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.835 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2024-05-08T05:33:46.835 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.835 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.835 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.835 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.835 INFO:teuthology.orchestra.run.smithi087.stdout: "server_port": { 2024-05-08T05:33:46.835 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "server_port", 2024-05-08T05:33:46.835 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "int", 2024-05-08T05:33:46.835 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.835 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:46.836 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "9283", 2024-05-08T05:33:46.836 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.836 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.836 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.836 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "the port on which the module listens for HTTP requests", 2024-05-08T05:33:46.836 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.836 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.836 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.836 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.836 INFO:teuthology.orchestra.run.smithi087.stdout: "sqlite3_killpoint": { 2024-05-08T05:33:46.836 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "sqlite3_killpoint", 2024-05-08T05:33:46.836 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "int", 2024-05-08T05:33:46.837 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "dev", 2024-05-08T05:33:46.837 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:46.837 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "0", 2024-05-08T05:33:46.837 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.837 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.837 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.837 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:46.837 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.837 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.837 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.837 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.837 INFO:teuthology.orchestra.run.smithi087.stdout: "stale_cache_strategy": { 2024-05-08T05:33:46.837 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "stale_cache_strategy", 2024-05-08T05:33:46.838 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-08T05:33:46.838 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.838 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-08T05:33:46.838 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "log", 2024-05-08T05:33:46.838 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.838 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.838 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.838 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:46.838 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.838 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.838 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.838 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.838 INFO:teuthology.orchestra.run.smithi087.stdout: "standby_behaviour": { 2024-05-08T05:33:46.839 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "standby_behaviour", 2024-05-08T05:33:46.839 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-08T05:33:46.839 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.839 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:46.839 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "default", 2024-05-08T05:33:46.839 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.839 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.839 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [ 2024-05-08T05:33:46.839 INFO:teuthology.orchestra.run.smithi087.stdout: "default", 2024-05-08T05:33:46.839 INFO:teuthology.orchestra.run.smithi087.stdout: "error" 2024-05-08T05:33:46.839 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-05-08T05:33:46.839 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:46.839 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.840 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.840 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.840 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.840 INFO:teuthology.orchestra.run.smithi087.stdout: "standby_error_status_code": { 2024-05-08T05:33:46.840 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "standby_error_status_code", 2024-05-08T05:33:46.840 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "int", 2024-05-08T05:33:46.840 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.840 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:46.840 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "500", 2024-05-08T05:33:46.840 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "400", 2024-05-08T05:33:46.840 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "599", 2024-05-08T05:33:46.840 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.841 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:46.841 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.841 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.841 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.841 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-05-08T05:33:46.841 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-05-08T05:33:46.841 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.841 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-05-08T05:33:46.841 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "rbd_support", 2024-05-08T05:33:46.841 INFO:teuthology.orchestra.run.smithi087.stdout: "can_run": true, 2024-05-08T05:33:46.841 INFO:teuthology.orchestra.run.smithi087.stdout: "error_string": "", 2024-05-08T05:33:46.841 INFO:teuthology.orchestra.run.smithi087.stdout: "module_options": { 2024-05-08T05:33:46.841 INFO:teuthology.orchestra.run.smithi087.stdout: "log_level": { 2024-05-08T05:33:46.842 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_level", 2024-05-08T05:33:46.842 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-08T05:33:46.842 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.842 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:46.842 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-05-08T05:33:46.842 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.842 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.842 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [ 2024-05-08T05:33:46.842 INFO:teuthology.orchestra.run.smithi087.stdout: "", 2024-05-08T05:33:46.842 INFO:teuthology.orchestra.run.smithi087.stdout: "critical", 2024-05-08T05:33:46.842 INFO:teuthology.orchestra.run.smithi087.stdout: "debug", 2024-05-08T05:33:46.842 INFO:teuthology.orchestra.run.smithi087.stdout: "error", 2024-05-08T05:33:46.843 INFO:teuthology.orchestra.run.smithi087.stdout: "info", 2024-05-08T05:33:46.843 INFO:teuthology.orchestra.run.smithi087.stdout: "warning" 2024-05-08T05:33:46.843 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-05-08T05:33:46.843 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:46.843 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.843 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.843 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.843 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.843 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_cluster": { 2024-05-08T05:33:46.843 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_cluster", 2024-05-08T05:33:46.843 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-08T05:33:46.843 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.843 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:46.844 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-05-08T05:33:46.844 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.844 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.844 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.844 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:46.844 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.844 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.844 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.844 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.844 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_cluster_level": { 2024-05-08T05:33:46.844 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_cluster_level", 2024-05-08T05:33:46.844 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-08T05:33:46.844 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.845 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:46.845 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "info", 2024-05-08T05:33:46.845 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.845 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.845 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [ 2024-05-08T05:33:46.845 INFO:teuthology.orchestra.run.smithi087.stdout: "", 2024-05-08T05:33:46.845 INFO:teuthology.orchestra.run.smithi087.stdout: "critical", 2024-05-08T05:33:46.845 INFO:teuthology.orchestra.run.smithi087.stdout: "debug", 2024-05-08T05:33:46.845 INFO:teuthology.orchestra.run.smithi087.stdout: "error", 2024-05-08T05:33:46.845 INFO:teuthology.orchestra.run.smithi087.stdout: "info", 2024-05-08T05:33:46.845 INFO:teuthology.orchestra.run.smithi087.stdout: "warning" 2024-05-08T05:33:46.845 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-05-08T05:33:46.845 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:46.846 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.846 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.846 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.846 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.846 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_file": { 2024-05-08T05:33:46.846 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_file", 2024-05-08T05:33:46.846 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-08T05:33:46.846 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.846 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:46.846 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-05-08T05:33:46.846 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.846 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.847 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.847 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:46.847 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.847 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.847 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.847 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.847 INFO:teuthology.orchestra.run.smithi087.stdout: "max_concurrent_snap_create": { 2024-05-08T05:33:46.847 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "max_concurrent_snap_create", 2024-05-08T05:33:46.847 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "int", 2024-05-08T05:33:46.847 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.847 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-08T05:33:46.847 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "10", 2024-05-08T05:33:46.847 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.848 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.848 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.848 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:46.848 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.848 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.848 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.848 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.848 INFO:teuthology.orchestra.run.smithi087.stdout: "mirror_snapshot_schedule": { 2024-05-08T05:33:46.848 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "mirror_snapshot_schedule", 2024-05-08T05:33:46.848 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-08T05:33:46.848 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.848 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-08T05:33:46.849 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-05-08T05:33:46.849 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.849 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.849 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.849 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:46.849 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.849 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.849 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.849 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.849 INFO:teuthology.orchestra.run.smithi087.stdout: "sqlite3_killpoint": { 2024-05-08T05:33:46.849 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "sqlite3_killpoint", 2024-05-08T05:33:46.849 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "int", 2024-05-08T05:33:46.849 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "dev", 2024-05-08T05:33:46.850 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:46.850 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "0", 2024-05-08T05:33:46.850 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.850 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.850 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.850 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:46.850 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.850 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.850 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.850 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.850 INFO:teuthology.orchestra.run.smithi087.stdout: "trash_purge_schedule": { 2024-05-08T05:33:46.850 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "trash_purge_schedule", 2024-05-08T05:33:46.850 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-08T05:33:46.851 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.851 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-08T05:33:46.851 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-05-08T05:33:46.851 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.851 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.851 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.851 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:46.851 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.851 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.851 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.851 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-05-08T05:33:46.851 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-05-08T05:33:46.851 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.852 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-05-08T05:33:46.852 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "restful", 2024-05-08T05:33:46.852 INFO:teuthology.orchestra.run.smithi087.stdout: "can_run": true, 2024-05-08T05:33:46.852 INFO:teuthology.orchestra.run.smithi087.stdout: "error_string": "", 2024-05-08T05:33:46.852 INFO:teuthology.orchestra.run.smithi087.stdout: "module_options": { 2024-05-08T05:33:46.852 INFO:teuthology.orchestra.run.smithi087.stdout: "enable_auth": { 2024-05-08T05:33:46.852 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "enable_auth", 2024-05-08T05:33:46.852 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-08T05:33:46.852 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.852 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-08T05:33:46.852 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "True", 2024-05-08T05:33:46.852 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.853 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.853 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.853 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:46.853 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.853 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.853 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.853 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.853 INFO:teuthology.orchestra.run.smithi087.stdout: "key_file": { 2024-05-08T05:33:46.853 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "key_file", 2024-05-08T05:33:46.853 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-08T05:33:46.853 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.853 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-08T05:33:46.853 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-05-08T05:33:46.854 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.854 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.854 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.854 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:46.854 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.854 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.854 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.854 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.854 INFO:teuthology.orchestra.run.smithi087.stdout: "log_level": { 2024-05-08T05:33:46.854 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_level", 2024-05-08T05:33:46.854 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-08T05:33:46.854 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.855 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:46.855 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-05-08T05:33:46.855 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.855 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.855 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [ 2024-05-08T05:33:46.855 INFO:teuthology.orchestra.run.smithi087.stdout: "", 2024-05-08T05:33:46.855 INFO:teuthology.orchestra.run.smithi087.stdout: "critical", 2024-05-08T05:33:46.855 INFO:teuthology.orchestra.run.smithi087.stdout: "debug", 2024-05-08T05:33:46.855 INFO:teuthology.orchestra.run.smithi087.stdout: "error", 2024-05-08T05:33:46.855 INFO:teuthology.orchestra.run.smithi087.stdout: "info", 2024-05-08T05:33:46.855 INFO:teuthology.orchestra.run.smithi087.stdout: "warning" 2024-05-08T05:33:46.855 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-05-08T05:33:46.855 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:46.856 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.856 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.856 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.856 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.856 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_cluster": { 2024-05-08T05:33:46.856 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_cluster", 2024-05-08T05:33:46.856 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-08T05:33:46.856 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.856 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:46.856 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-05-08T05:33:46.856 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.856 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.857 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.857 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:46.857 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.857 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.857 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.857 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.857 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_cluster_level": { 2024-05-08T05:33:46.857 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_cluster_level", 2024-05-08T05:33:46.857 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-08T05:33:46.857 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.857 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:46.857 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "info", 2024-05-08T05:33:46.858 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.858 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.858 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [ 2024-05-08T05:33:46.858 INFO:teuthology.orchestra.run.smithi087.stdout: "", 2024-05-08T05:33:46.858 INFO:teuthology.orchestra.run.smithi087.stdout: "critical", 2024-05-08T05:33:46.858 INFO:teuthology.orchestra.run.smithi087.stdout: "debug", 2024-05-08T05:33:46.858 INFO:teuthology.orchestra.run.smithi087.stdout: "error", 2024-05-08T05:33:46.858 INFO:teuthology.orchestra.run.smithi087.stdout: "info", 2024-05-08T05:33:46.858 INFO:teuthology.orchestra.run.smithi087.stdout: "warning" 2024-05-08T05:33:46.858 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-05-08T05:33:46.858 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:46.858 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.859 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.859 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.859 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.859 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_file": { 2024-05-08T05:33:46.859 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_file", 2024-05-08T05:33:46.859 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-08T05:33:46.859 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.859 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:46.859 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-05-08T05:33:46.859 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.859 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.859 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.859 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:46.860 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.860 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.860 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.860 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.860 INFO:teuthology.orchestra.run.smithi087.stdout: "server_addr": { 2024-05-08T05:33:46.860 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "server_addr", 2024-05-08T05:33:46.860 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-08T05:33:46.860 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.860 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-08T05:33:46.860 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-05-08T05:33:46.860 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.860 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.860 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.860 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:46.861 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.861 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.861 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.861 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.861 INFO:teuthology.orchestra.run.smithi087.stdout: "server_port": { 2024-05-08T05:33:46.861 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "server_port", 2024-05-08T05:33:46.861 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-08T05:33:46.861 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.861 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-08T05:33:46.861 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-05-08T05:33:46.861 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.861 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.861 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.861 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:46.862 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.862 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.862 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.862 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.862 INFO:teuthology.orchestra.run.smithi087.stdout: "sqlite3_killpoint": { 2024-05-08T05:33:46.862 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "sqlite3_killpoint", 2024-05-08T05:33:46.862 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "int", 2024-05-08T05:33:46.862 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "dev", 2024-05-08T05:33:46.862 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:46.862 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "0", 2024-05-08T05:33:46.862 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.862 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.862 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.863 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:46.863 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.863 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.863 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.863 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-05-08T05:33:46.863 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-05-08T05:33:46.863 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.863 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-05-08T05:33:46.863 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "rgw", 2024-05-08T05:33:46.863 INFO:teuthology.orchestra.run.smithi087.stdout: "can_run": true, 2024-05-08T05:33:46.863 INFO:teuthology.orchestra.run.smithi087.stdout: "error_string": "", 2024-05-08T05:33:46.863 INFO:teuthology.orchestra.run.smithi087.stdout: "module_options": { 2024-05-08T05:33:46.863 INFO:teuthology.orchestra.run.smithi087.stdout: "log_level": { 2024-05-08T05:33:46.864 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_level", 2024-05-08T05:33:46.864 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-08T05:33:46.864 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.864 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:46.864 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-05-08T05:33:46.864 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.864 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.864 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [ 2024-05-08T05:33:46.864 INFO:teuthology.orchestra.run.smithi087.stdout: "", 2024-05-08T05:33:46.864 INFO:teuthology.orchestra.run.smithi087.stdout: "critical", 2024-05-08T05:33:46.864 INFO:teuthology.orchestra.run.smithi087.stdout: "debug", 2024-05-08T05:33:46.864 INFO:teuthology.orchestra.run.smithi087.stdout: "error", 2024-05-08T05:33:46.864 INFO:teuthology.orchestra.run.smithi087.stdout: "info", 2024-05-08T05:33:46.865 INFO:teuthology.orchestra.run.smithi087.stdout: "warning" 2024-05-08T05:33:46.865 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-05-08T05:33:46.865 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:46.865 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.865 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.865 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.865 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.865 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_cluster": { 2024-05-08T05:33:46.865 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_cluster", 2024-05-08T05:33:46.865 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-08T05:33:46.865 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.865 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:46.866 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-05-08T05:33:46.866 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.866 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.866 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.866 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:46.866 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.866 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.866 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.866 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.866 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_cluster_level": { 2024-05-08T05:33:46.866 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_cluster_level", 2024-05-08T05:33:46.866 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-08T05:33:46.867 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.867 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:46.867 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "info", 2024-05-08T05:33:46.867 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.867 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.867 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [ 2024-05-08T05:33:46.867 INFO:teuthology.orchestra.run.smithi087.stdout: "", 2024-05-08T05:33:46.867 INFO:teuthology.orchestra.run.smithi087.stdout: "critical", 2024-05-08T05:33:46.867 INFO:teuthology.orchestra.run.smithi087.stdout: "debug", 2024-05-08T05:33:46.867 INFO:teuthology.orchestra.run.smithi087.stdout: "error", 2024-05-08T05:33:46.867 INFO:teuthology.orchestra.run.smithi087.stdout: "info", 2024-05-08T05:33:46.867 INFO:teuthology.orchestra.run.smithi087.stdout: "warning" 2024-05-08T05:33:46.867 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-05-08T05:33:46.867 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:46.868 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.868 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.868 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.868 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.868 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_file": { 2024-05-08T05:33:46.868 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_file", 2024-05-08T05:33:46.868 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-08T05:33:46.868 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.868 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:46.868 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-05-08T05:33:46.868 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.868 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.868 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.869 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:46.869 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.869 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.869 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.869 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.869 INFO:teuthology.orchestra.run.smithi087.stdout: "sqlite3_killpoint": { 2024-05-08T05:33:46.869 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "sqlite3_killpoint", 2024-05-08T05:33:46.869 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "int", 2024-05-08T05:33:46.869 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "dev", 2024-05-08T05:33:46.869 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:46.869 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "0", 2024-05-08T05:33:46.869 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.869 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.870 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.870 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:46.870 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.870 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.870 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.870 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-05-08T05:33:46.870 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-05-08T05:33:46.870 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.870 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-05-08T05:33:46.870 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "rook", 2024-05-08T05:33:46.870 INFO:teuthology.orchestra.run.smithi087.stdout: "can_run": true, 2024-05-08T05:33:46.870 INFO:teuthology.orchestra.run.smithi087.stdout: "error_string": "", 2024-05-08T05:33:46.871 INFO:teuthology.orchestra.run.smithi087.stdout: "module_options": { 2024-05-08T05:33:46.871 INFO:teuthology.orchestra.run.smithi087.stdout: "log_level": { 2024-05-08T05:33:46.871 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_level", 2024-05-08T05:33:46.871 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-08T05:33:46.871 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.871 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:46.871 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-05-08T05:33:46.871 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.871 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.871 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [ 2024-05-08T05:33:46.871 INFO:teuthology.orchestra.run.smithi087.stdout: "", 2024-05-08T05:33:46.871 INFO:teuthology.orchestra.run.smithi087.stdout: "critical", 2024-05-08T05:33:46.871 INFO:teuthology.orchestra.run.smithi087.stdout: "debug", 2024-05-08T05:33:46.871 INFO:teuthology.orchestra.run.smithi087.stdout: "error", 2024-05-08T05:33:46.872 INFO:teuthology.orchestra.run.smithi087.stdout: "info", 2024-05-08T05:33:46.872 INFO:teuthology.orchestra.run.smithi087.stdout: "warning" 2024-05-08T05:33:46.872 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-05-08T05:33:46.872 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:46.872 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.872 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.872 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.872 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.872 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_cluster": { 2024-05-08T05:33:46.872 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_cluster", 2024-05-08T05:33:46.872 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-08T05:33:46.872 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.872 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:46.872 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-05-08T05:33:46.873 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.873 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.873 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.873 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:46.873 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.873 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.873 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.873 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.873 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_cluster_level": { 2024-05-08T05:33:46.873 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_cluster_level", 2024-05-08T05:33:46.873 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-08T05:33:46.873 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.874 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:46.874 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "info", 2024-05-08T05:33:46.874 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.874 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.874 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [ 2024-05-08T05:33:46.874 INFO:teuthology.orchestra.run.smithi087.stdout: "", 2024-05-08T05:33:46.874 INFO:teuthology.orchestra.run.smithi087.stdout: "critical", 2024-05-08T05:33:46.874 INFO:teuthology.orchestra.run.smithi087.stdout: "debug", 2024-05-08T05:33:46.874 INFO:teuthology.orchestra.run.smithi087.stdout: "error", 2024-05-08T05:33:46.874 INFO:teuthology.orchestra.run.smithi087.stdout: "info", 2024-05-08T05:33:46.874 INFO:teuthology.orchestra.run.smithi087.stdout: "warning" 2024-05-08T05:33:46.874 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-05-08T05:33:46.874 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:46.875 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.875 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.875 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.875 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.875 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_file": { 2024-05-08T05:33:46.875 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_file", 2024-05-08T05:33:46.875 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-08T05:33:46.875 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.875 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:46.875 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-05-08T05:33:46.875 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.875 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.875 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.876 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:46.876 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.876 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.876 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.876 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.876 INFO:teuthology.orchestra.run.smithi087.stdout: "sqlite3_killpoint": { 2024-05-08T05:33:46.876 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "sqlite3_killpoint", 2024-05-08T05:33:46.876 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "int", 2024-05-08T05:33:46.876 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "dev", 2024-05-08T05:33:46.876 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:46.876 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "0", 2024-05-08T05:33:46.877 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.877 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.877 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.877 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:46.877 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.877 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.877 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.877 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.877 INFO:teuthology.orchestra.run.smithi087.stdout: "storage_class": { 2024-05-08T05:33:46.877 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "storage_class", 2024-05-08T05:33:46.877 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-08T05:33:46.877 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.878 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-08T05:33:46.878 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "local", 2024-05-08T05:33:46.878 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.878 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.878 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.878 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "storage class name for LSO-discovered PVs", 2024-05-08T05:33:46.878 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.878 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.878 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.878 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-05-08T05:33:46.878 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-05-08T05:33:46.878 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.879 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-05-08T05:33:46.879 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "selftest", 2024-05-08T05:33:46.879 INFO:teuthology.orchestra.run.smithi087.stdout: "can_run": true, 2024-05-08T05:33:46.879 INFO:teuthology.orchestra.run.smithi087.stdout: "error_string": "", 2024-05-08T05:33:46.879 INFO:teuthology.orchestra.run.smithi087.stdout: "module_options": { 2024-05-08T05:33:46.879 INFO:teuthology.orchestra.run.smithi087.stdout: "log_level": { 2024-05-08T05:33:46.879 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_level", 2024-05-08T05:33:46.879 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-08T05:33:46.879 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.879 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:46.879 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-05-08T05:33:46.879 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.879 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.880 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [ 2024-05-08T05:33:46.880 INFO:teuthology.orchestra.run.smithi087.stdout: "", 2024-05-08T05:33:46.880 INFO:teuthology.orchestra.run.smithi087.stdout: "critical", 2024-05-08T05:33:46.880 INFO:teuthology.orchestra.run.smithi087.stdout: "debug", 2024-05-08T05:33:46.880 INFO:teuthology.orchestra.run.smithi087.stdout: "error", 2024-05-08T05:33:46.880 INFO:teuthology.orchestra.run.smithi087.stdout: "info", 2024-05-08T05:33:46.880 INFO:teuthology.orchestra.run.smithi087.stdout: "warning" 2024-05-08T05:33:46.880 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-05-08T05:33:46.880 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:46.880 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.880 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.880 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.880 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.881 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_cluster": { 2024-05-08T05:33:46.881 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_cluster", 2024-05-08T05:33:46.881 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-08T05:33:46.881 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.881 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:46.881 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-05-08T05:33:46.881 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.881 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.881 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.881 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:46.881 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.881 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.881 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.882 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.882 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_cluster_level": { 2024-05-08T05:33:46.882 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_cluster_level", 2024-05-08T05:33:46.882 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-08T05:33:46.882 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.882 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:46.882 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "info", 2024-05-08T05:33:46.882 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.882 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.882 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [ 2024-05-08T05:33:46.882 INFO:teuthology.orchestra.run.smithi087.stdout: "", 2024-05-08T05:33:46.882 INFO:teuthology.orchestra.run.smithi087.stdout: "critical", 2024-05-08T05:33:46.883 INFO:teuthology.orchestra.run.smithi087.stdout: "debug", 2024-05-08T05:33:46.883 INFO:teuthology.orchestra.run.smithi087.stdout: "error", 2024-05-08T05:33:46.883 INFO:teuthology.orchestra.run.smithi087.stdout: "info", 2024-05-08T05:33:46.883 INFO:teuthology.orchestra.run.smithi087.stdout: "warning" 2024-05-08T05:33:46.883 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-05-08T05:33:46.883 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:46.883 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.883 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.883 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.883 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.883 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_file": { 2024-05-08T05:33:46.883 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_file", 2024-05-08T05:33:46.883 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-08T05:33:46.884 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.884 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:46.884 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-05-08T05:33:46.884 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.884 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.884 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.884 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:46.884 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.884 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.884 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.884 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.884 INFO:teuthology.orchestra.run.smithi087.stdout: "roption1": { 2024-05-08T05:33:46.884 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "roption1", 2024-05-08T05:33:46.885 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-08T05:33:46.885 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.885 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-08T05:33:46.885 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-05-08T05:33:46.885 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.885 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.885 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.885 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:46.885 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.885 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.885 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.885 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.885 INFO:teuthology.orchestra.run.smithi087.stdout: "roption2": { 2024-05-08T05:33:46.886 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "roption2", 2024-05-08T05:33:46.886 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-08T05:33:46.886 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.886 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-08T05:33:46.886 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "xyz", 2024-05-08T05:33:46.886 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.886 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.886 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.886 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:46.886 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.886 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.886 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.887 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.887 INFO:teuthology.orchestra.run.smithi087.stdout: "rwoption1": { 2024-05-08T05:33:46.887 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "rwoption1", 2024-05-08T05:33:46.887 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-08T05:33:46.887 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.887 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-08T05:33:46.887 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-05-08T05:33:46.887 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.887 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.887 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.887 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:46.887 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.887 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.888 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.888 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.888 INFO:teuthology.orchestra.run.smithi087.stdout: "rwoption2": { 2024-05-08T05:33:46.888 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "rwoption2", 2024-05-08T05:33:46.888 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "int", 2024-05-08T05:33:46.888 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.888 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-08T05:33:46.888 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-05-08T05:33:46.888 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.888 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.888 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.888 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:46.889 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.889 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.889 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.889 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.889 INFO:teuthology.orchestra.run.smithi087.stdout: "rwoption3": { 2024-05-08T05:33:46.889 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "rwoption3", 2024-05-08T05:33:46.889 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "float", 2024-05-08T05:33:46.889 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.889 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-08T05:33:46.889 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-05-08T05:33:46.889 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.890 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.890 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.890 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:46.890 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.890 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.890 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.890 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.890 INFO:teuthology.orchestra.run.smithi087.stdout: "rwoption4": { 2024-05-08T05:33:46.890 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "rwoption4", 2024-05-08T05:33:46.890 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-08T05:33:46.890 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.890 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-08T05:33:46.890 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-05-08T05:33:46.891 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.891 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.891 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.891 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:46.891 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.891 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.891 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.891 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.891 INFO:teuthology.orchestra.run.smithi087.stdout: "rwoption5": { 2024-05-08T05:33:46.891 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "rwoption5", 2024-05-08T05:33:46.891 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-08T05:33:46.891 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.891 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-08T05:33:46.892 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-05-08T05:33:46.892 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.892 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.892 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.892 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:46.892 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.892 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.892 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.892 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.892 INFO:teuthology.orchestra.run.smithi087.stdout: "rwoption6": { 2024-05-08T05:33:46.892 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "rwoption6", 2024-05-08T05:33:46.892 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-08T05:33:46.893 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.893 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-08T05:33:46.893 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "True", 2024-05-08T05:33:46.893 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.893 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.893 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.893 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:46.893 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.893 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.893 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.893 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.893 INFO:teuthology.orchestra.run.smithi087.stdout: "rwoption7": { 2024-05-08T05:33:46.893 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "rwoption7", 2024-05-08T05:33:46.894 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "int", 2024-05-08T05:33:46.894 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.894 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-08T05:33:46.894 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-05-08T05:33:46.894 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "1", 2024-05-08T05:33:46.894 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "42", 2024-05-08T05:33:46.894 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.894 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:46.894 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.894 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.894 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.894 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.895 INFO:teuthology.orchestra.run.smithi087.stdout: "sqlite3_killpoint": { 2024-05-08T05:33:46.895 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "sqlite3_killpoint", 2024-05-08T05:33:46.895 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "int", 2024-05-08T05:33:46.895 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "dev", 2024-05-08T05:33:46.895 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:46.895 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "0", 2024-05-08T05:33:46.895 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.895 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.895 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.895 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:46.895 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.895 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.896 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.896 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.896 INFO:teuthology.orchestra.run.smithi087.stdout: "testkey": { 2024-05-08T05:33:46.896 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "testkey", 2024-05-08T05:33:46.896 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-08T05:33:46.896 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.896 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-08T05:33:46.896 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-05-08T05:33:46.896 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.896 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.896 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.896 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:46.896 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.897 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.897 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.897 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.897 INFO:teuthology.orchestra.run.smithi087.stdout: "testlkey": { 2024-05-08T05:33:46.897 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "testlkey", 2024-05-08T05:33:46.897 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-08T05:33:46.897 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.897 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-08T05:33:46.897 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-05-08T05:33:46.897 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.897 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.897 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.897 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:46.898 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.898 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.898 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.898 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.898 INFO:teuthology.orchestra.run.smithi087.stdout: "testnewline": { 2024-05-08T05:33:46.898 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "testnewline", 2024-05-08T05:33:46.898 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-08T05:33:46.898 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.898 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-08T05:33:46.898 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-05-08T05:33:46.898 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.898 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.898 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.899 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:46.899 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.899 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.899 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.899 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-05-08T05:33:46.899 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-05-08T05:33:46.899 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.899 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-05-08T05:33:46.899 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "smb", 2024-05-08T05:33:46.899 INFO:teuthology.orchestra.run.smithi087.stdout: "can_run": true, 2024-05-08T05:33:46.899 INFO:teuthology.orchestra.run.smithi087.stdout: "error_string": "", 2024-05-08T05:33:46.899 INFO:teuthology.orchestra.run.smithi087.stdout: "module_options": { 2024-05-08T05:33:46.899 INFO:teuthology.orchestra.run.smithi087.stdout: "log_level": { 2024-05-08T05:33:46.900 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_level", 2024-05-08T05:33:46.900 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-08T05:33:46.900 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.900 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:46.900 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-05-08T05:33:46.900 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.900 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.900 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [ 2024-05-08T05:33:46.900 INFO:teuthology.orchestra.run.smithi087.stdout: "", 2024-05-08T05:33:46.900 INFO:teuthology.orchestra.run.smithi087.stdout: "critical", 2024-05-08T05:33:46.900 INFO:teuthology.orchestra.run.smithi087.stdout: "debug", 2024-05-08T05:33:46.900 INFO:teuthology.orchestra.run.smithi087.stdout: "error", 2024-05-08T05:33:46.900 INFO:teuthology.orchestra.run.smithi087.stdout: "info", 2024-05-08T05:33:46.901 INFO:teuthology.orchestra.run.smithi087.stdout: "warning" 2024-05-08T05:33:46.901 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-05-08T05:33:46.901 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:46.901 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.901 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.901 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.901 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.901 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_cluster": { 2024-05-08T05:33:46.901 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_cluster", 2024-05-08T05:33:46.901 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-08T05:33:46.901 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.901 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:46.901 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-05-08T05:33:46.902 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.902 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.902 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.902 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:46.902 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.902 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.902 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.902 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.902 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_cluster_level": { 2024-05-08T05:33:46.902 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_cluster_level", 2024-05-08T05:33:46.902 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-08T05:33:46.902 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.903 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:46.903 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "info", 2024-05-08T05:33:46.903 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.903 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.903 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [ 2024-05-08T05:33:46.903 INFO:teuthology.orchestra.run.smithi087.stdout: "", 2024-05-08T05:33:46.903 INFO:teuthology.orchestra.run.smithi087.stdout: "critical", 2024-05-08T05:33:46.903 INFO:teuthology.orchestra.run.smithi087.stdout: "debug", 2024-05-08T05:33:46.903 INFO:teuthology.orchestra.run.smithi087.stdout: "error", 2024-05-08T05:33:46.903 INFO:teuthology.orchestra.run.smithi087.stdout: "info", 2024-05-08T05:33:46.903 INFO:teuthology.orchestra.run.smithi087.stdout: "warning" 2024-05-08T05:33:46.903 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-05-08T05:33:46.903 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:46.904 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.904 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.904 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.904 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.904 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_file": { 2024-05-08T05:33:46.904 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_file", 2024-05-08T05:33:46.904 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-08T05:33:46.904 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.904 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:46.904 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-05-08T05:33:46.904 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.904 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.904 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.905 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:46.905 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.905 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.905 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.905 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.905 INFO:teuthology.orchestra.run.smithi087.stdout: "sqlite3_killpoint": { 2024-05-08T05:33:46.905 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "sqlite3_killpoint", 2024-05-08T05:33:46.905 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "int", 2024-05-08T05:33:46.905 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "dev", 2024-05-08T05:33:46.905 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:46.905 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "0", 2024-05-08T05:33:46.905 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.905 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.906 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.906 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:46.906 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.906 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.906 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.906 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.906 INFO:teuthology.orchestra.run.smithi087.stdout: "update_orchestration": { 2024-05-08T05:33:46.906 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "update_orchestration", 2024-05-08T05:33:46.906 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-08T05:33:46.906 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.906 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-08T05:33:46.907 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "True", 2024-05-08T05:33:46.907 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.907 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.907 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.907 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "automatically update orchestration when smb resources are changed", 2024-05-08T05:33:46.907 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.907 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.907 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.907 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-05-08T05:33:46.907 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-05-08T05:33:46.907 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.907 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-05-08T05:33:46.907 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "snap_schedule", 2024-05-08T05:33:46.907 INFO:teuthology.orchestra.run.smithi087.stdout: "can_run": true, 2024-05-08T05:33:46.908 INFO:teuthology.orchestra.run.smithi087.stdout: "error_string": "", 2024-05-08T05:33:46.908 INFO:teuthology.orchestra.run.smithi087.stdout: "module_options": { 2024-05-08T05:33:46.908 INFO:teuthology.orchestra.run.smithi087.stdout: "allow_m_granularity": { 2024-05-08T05:33:46.908 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "allow_m_granularity", 2024-05-08T05:33:46.908 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-08T05:33:46.908 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.908 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:46.908 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-05-08T05:33:46.908 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.908 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.908 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.908 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "allow minute scheduled snapshots", 2024-05-08T05:33:46.908 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.909 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.909 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.909 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.909 INFO:teuthology.orchestra.run.smithi087.stdout: "dump_on_update": { 2024-05-08T05:33:46.909 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "dump_on_update", 2024-05-08T05:33:46.909 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-08T05:33:46.909 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.909 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:46.909 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-05-08T05:33:46.909 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.909 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.909 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.909 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "dump database to debug log on update", 2024-05-08T05:33:46.910 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.910 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.910 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.910 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.910 INFO:teuthology.orchestra.run.smithi087.stdout: "log_level": { 2024-05-08T05:33:46.910 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_level", 2024-05-08T05:33:46.910 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-08T05:33:46.910 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.910 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:46.910 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-05-08T05:33:46.910 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.910 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.911 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [ 2024-05-08T05:33:46.911 INFO:teuthology.orchestra.run.smithi087.stdout: "", 2024-05-08T05:33:46.911 INFO:teuthology.orchestra.run.smithi087.stdout: "critical", 2024-05-08T05:33:46.911 INFO:teuthology.orchestra.run.smithi087.stdout: "debug", 2024-05-08T05:33:46.911 INFO:teuthology.orchestra.run.smithi087.stdout: "error", 2024-05-08T05:33:46.911 INFO:teuthology.orchestra.run.smithi087.stdout: "info", 2024-05-08T05:33:46.911 INFO:teuthology.orchestra.run.smithi087.stdout: "warning" 2024-05-08T05:33:46.911 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-05-08T05:33:46.911 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:46.911 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.911 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.911 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.912 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.912 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_cluster": { 2024-05-08T05:33:46.912 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_cluster", 2024-05-08T05:33:46.912 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-08T05:33:46.912 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.912 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:46.912 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-05-08T05:33:46.912 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.912 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.912 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.912 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:46.912 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.912 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.912 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.912 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.913 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_cluster_level": { 2024-05-08T05:33:46.913 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_cluster_level", 2024-05-08T05:33:46.913 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-08T05:33:46.913 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.913 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:46.913 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "info", 2024-05-08T05:33:46.913 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.913 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.913 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [ 2024-05-08T05:33:46.913 INFO:teuthology.orchestra.run.smithi087.stdout: "", 2024-05-08T05:33:46.913 INFO:teuthology.orchestra.run.smithi087.stdout: "critical", 2024-05-08T05:33:46.913 INFO:teuthology.orchestra.run.smithi087.stdout: "debug", 2024-05-08T05:33:46.913 INFO:teuthology.orchestra.run.smithi087.stdout: "error", 2024-05-08T05:33:46.914 INFO:teuthology.orchestra.run.smithi087.stdout: "info", 2024-05-08T05:33:46.914 INFO:teuthology.orchestra.run.smithi087.stdout: "warning" 2024-05-08T05:33:46.914 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-05-08T05:33:46.914 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:46.914 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.914 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.914 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.914 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.914 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_file": { 2024-05-08T05:33:46.914 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_file", 2024-05-08T05:33:46.914 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-08T05:33:46.914 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.914 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:46.915 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-05-08T05:33:46.915 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.915 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.915 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.915 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:46.915 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.915 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.915 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.915 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.915 INFO:teuthology.orchestra.run.smithi087.stdout: "sqlite3_killpoint": { 2024-05-08T05:33:46.915 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "sqlite3_killpoint", 2024-05-08T05:33:46.915 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "int", 2024-05-08T05:33:46.915 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "dev", 2024-05-08T05:33:46.916 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:46.916 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "0", 2024-05-08T05:33:46.916 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.916 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.916 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.916 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:46.916 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.916 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.916 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.916 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-05-08T05:33:46.916 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-05-08T05:33:46.916 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.916 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-05-08T05:33:46.917 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "stats", 2024-05-08T05:33:46.917 INFO:teuthology.orchestra.run.smithi087.stdout: "can_run": true, 2024-05-08T05:33:46.917 INFO:teuthology.orchestra.run.smithi087.stdout: "error_string": "", 2024-05-08T05:33:46.917 INFO:teuthology.orchestra.run.smithi087.stdout: "module_options": { 2024-05-08T05:33:46.917 INFO:teuthology.orchestra.run.smithi087.stdout: "log_level": { 2024-05-08T05:33:46.917 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_level", 2024-05-08T05:33:46.917 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-08T05:33:46.917 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.917 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:46.917 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-05-08T05:33:46.917 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.917 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.917 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [ 2024-05-08T05:33:46.918 INFO:teuthology.orchestra.run.smithi087.stdout: "", 2024-05-08T05:33:46.918 INFO:teuthology.orchestra.run.smithi087.stdout: "critical", 2024-05-08T05:33:46.918 INFO:teuthology.orchestra.run.smithi087.stdout: "debug", 2024-05-08T05:33:46.918 INFO:teuthology.orchestra.run.smithi087.stdout: "error", 2024-05-08T05:33:46.918 INFO:teuthology.orchestra.run.smithi087.stdout: "info", 2024-05-08T05:33:46.918 INFO:teuthology.orchestra.run.smithi087.stdout: "warning" 2024-05-08T05:33:46.918 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-05-08T05:33:46.918 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:46.918 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.918 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.918 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.918 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.919 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_cluster": { 2024-05-08T05:33:46.919 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_cluster", 2024-05-08T05:33:46.919 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-08T05:33:46.919 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.919 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:46.919 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-05-08T05:33:46.919 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.919 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.919 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.919 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:46.919 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.919 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.919 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.920 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.920 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_cluster_level": { 2024-05-08T05:33:46.920 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_cluster_level", 2024-05-08T05:33:46.920 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-08T05:33:46.920 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.920 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:46.920 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "info", 2024-05-08T05:33:46.920 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.920 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.920 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [ 2024-05-08T05:33:46.920 INFO:teuthology.orchestra.run.smithi087.stdout: "", 2024-05-08T05:33:46.920 INFO:teuthology.orchestra.run.smithi087.stdout: "critical", 2024-05-08T05:33:46.920 INFO:teuthology.orchestra.run.smithi087.stdout: "debug", 2024-05-08T05:33:46.921 INFO:teuthology.orchestra.run.smithi087.stdout: "error", 2024-05-08T05:33:46.921 INFO:teuthology.orchestra.run.smithi087.stdout: "info", 2024-05-08T05:33:46.921 INFO:teuthology.orchestra.run.smithi087.stdout: "warning" 2024-05-08T05:33:46.921 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-05-08T05:33:46.921 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:46.921 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.921 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.921 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.921 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.921 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_file": { 2024-05-08T05:33:46.921 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_file", 2024-05-08T05:33:46.921 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-08T05:33:46.921 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.922 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:46.922 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-05-08T05:33:46.922 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.922 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.922 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.922 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:46.922 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.922 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.922 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.922 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.922 INFO:teuthology.orchestra.run.smithi087.stdout: "sqlite3_killpoint": { 2024-05-08T05:33:46.922 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "sqlite3_killpoint", 2024-05-08T05:33:46.923 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "int", 2024-05-08T05:33:46.923 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "dev", 2024-05-08T05:33:46.923 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:46.923 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "0", 2024-05-08T05:33:46.923 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.923 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.923 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.924 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:46.924 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.924 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.924 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.924 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-05-08T05:33:46.924 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-05-08T05:33:46.924 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.925 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-05-08T05:33:46.925 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "status", 2024-05-08T05:33:46.925 INFO:teuthology.orchestra.run.smithi087.stdout: "can_run": true, 2024-05-08T05:33:46.925 INFO:teuthology.orchestra.run.smithi087.stdout: "error_string": "", 2024-05-08T05:33:46.925 INFO:teuthology.orchestra.run.smithi087.stdout: "module_options": { 2024-05-08T05:33:46.925 INFO:teuthology.orchestra.run.smithi087.stdout: "log_level": { 2024-05-08T05:33:46.925 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_level", 2024-05-08T05:33:46.925 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-08T05:33:46.925 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.925 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:46.925 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-05-08T05:33:46.925 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.926 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.926 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [ 2024-05-08T05:33:46.926 INFO:teuthology.orchestra.run.smithi087.stdout: "", 2024-05-08T05:33:46.926 INFO:teuthology.orchestra.run.smithi087.stdout: "critical", 2024-05-08T05:33:46.926 INFO:teuthology.orchestra.run.smithi087.stdout: "debug", 2024-05-08T05:33:46.926 INFO:teuthology.orchestra.run.smithi087.stdout: "error", 2024-05-08T05:33:46.926 INFO:teuthology.orchestra.run.smithi087.stdout: "info", 2024-05-08T05:33:46.926 INFO:teuthology.orchestra.run.smithi087.stdout: "warning" 2024-05-08T05:33:46.926 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-05-08T05:33:46.926 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:46.926 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.926 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.927 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.927 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.927 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_cluster": { 2024-05-08T05:33:46.927 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_cluster", 2024-05-08T05:33:46.927 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-08T05:33:46.927 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.927 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:46.927 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-05-08T05:33:46.927 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.927 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.927 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.927 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:46.927 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.928 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.928 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.928 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.928 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_cluster_level": { 2024-05-08T05:33:46.928 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_cluster_level", 2024-05-08T05:33:46.928 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-08T05:33:46.928 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.928 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:46.928 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "info", 2024-05-08T05:33:46.928 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.928 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.928 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [ 2024-05-08T05:33:46.928 INFO:teuthology.orchestra.run.smithi087.stdout: "", 2024-05-08T05:33:46.928 INFO:teuthology.orchestra.run.smithi087.stdout: "critical", 2024-05-08T05:33:46.929 INFO:teuthology.orchestra.run.smithi087.stdout: "debug", 2024-05-08T05:33:46.929 INFO:teuthology.orchestra.run.smithi087.stdout: "error", 2024-05-08T05:33:46.929 INFO:teuthology.orchestra.run.smithi087.stdout: "info", 2024-05-08T05:33:46.929 INFO:teuthology.orchestra.run.smithi087.stdout: "warning" 2024-05-08T05:33:46.929 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-05-08T05:33:46.929 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:46.929 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.929 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.929 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.929 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.929 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_file": { 2024-05-08T05:33:46.929 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_file", 2024-05-08T05:33:46.929 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-08T05:33:46.930 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.930 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:46.930 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-05-08T05:33:46.930 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.930 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.930 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.930 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:46.930 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.930 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.930 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.930 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.930 INFO:teuthology.orchestra.run.smithi087.stdout: "sqlite3_killpoint": { 2024-05-08T05:33:46.931 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "sqlite3_killpoint", 2024-05-08T05:33:46.931 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "int", 2024-05-08T05:33:46.931 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "dev", 2024-05-08T05:33:46.931 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:46.931 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "0", 2024-05-08T05:33:46.931 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.931 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.931 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.931 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:46.931 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.931 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.931 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.932 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-05-08T05:33:46.932 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-05-08T05:33:46.932 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.932 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-05-08T05:33:46.932 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "telegraf", 2024-05-08T05:33:46.932 INFO:teuthology.orchestra.run.smithi087.stdout: "can_run": true, 2024-05-08T05:33:46.932 INFO:teuthology.orchestra.run.smithi087.stdout: "error_string": "", 2024-05-08T05:33:46.932 INFO:teuthology.orchestra.run.smithi087.stdout: "module_options": { 2024-05-08T05:33:46.932 INFO:teuthology.orchestra.run.smithi087.stdout: "address": { 2024-05-08T05:33:46.932 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "address", 2024-05-08T05:33:46.932 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-08T05:33:46.932 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.932 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-08T05:33:46.932 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2024-05-08T05:33:46.933 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.933 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.933 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.933 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:46.933 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.933 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.933 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.933 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.933 INFO:teuthology.orchestra.run.smithi087.stdout: "interval": { 2024-05-08T05:33:46.933 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "interval", 2024-05-08T05:33:46.933 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "secs", 2024-05-08T05:33:46.933 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.933 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-08T05:33:46.933 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "15", 2024-05-08T05:33:46.934 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.934 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.934 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.934 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:46.934 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.934 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.934 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.934 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.934 INFO:teuthology.orchestra.run.smithi087.stdout: "log_level": { 2024-05-08T05:33:46.934 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_level", 2024-05-08T05:33:46.934 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-08T05:33:46.934 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.934 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:46.935 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-05-08T05:33:46.935 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.935 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.935 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [ 2024-05-08T05:33:46.935 INFO:teuthology.orchestra.run.smithi087.stdout: "", 2024-05-08T05:33:46.935 INFO:teuthology.orchestra.run.smithi087.stdout: "critical", 2024-05-08T05:33:46.935 INFO:teuthology.orchestra.run.smithi087.stdout: "debug", 2024-05-08T05:33:46.935 INFO:teuthology.orchestra.run.smithi087.stdout: "error", 2024-05-08T05:33:46.935 INFO:teuthology.orchestra.run.smithi087.stdout: "info", 2024-05-08T05:33:46.935 INFO:teuthology.orchestra.run.smithi087.stdout: "warning" 2024-05-08T05:33:46.935 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-05-08T05:33:46.936 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:46.936 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.936 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.936 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.936 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.936 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_cluster": { 2024-05-08T05:33:46.936 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_cluster", 2024-05-08T05:33:46.936 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-08T05:33:46.936 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.936 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:46.936 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-05-08T05:33:46.936 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.936 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.937 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.937 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:46.937 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.937 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.937 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.937 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.937 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_cluster_level": { 2024-05-08T05:33:46.937 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_cluster_level", 2024-05-08T05:33:46.937 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-08T05:33:46.937 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.937 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:46.937 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "info", 2024-05-08T05:33:46.938 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.938 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.938 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [ 2024-05-08T05:33:46.938 INFO:teuthology.orchestra.run.smithi087.stdout: "", 2024-05-08T05:33:46.938 INFO:teuthology.orchestra.run.smithi087.stdout: "critical", 2024-05-08T05:33:46.938 INFO:teuthology.orchestra.run.smithi087.stdout: "debug", 2024-05-08T05:33:46.938 INFO:teuthology.orchestra.run.smithi087.stdout: "error", 2024-05-08T05:33:46.938 INFO:teuthology.orchestra.run.smithi087.stdout: "info", 2024-05-08T05:33:46.938 INFO:teuthology.orchestra.run.smithi087.stdout: "warning" 2024-05-08T05:33:46.938 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-05-08T05:33:46.938 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:46.938 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.939 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.939 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.939 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.939 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_file": { 2024-05-08T05:33:46.939 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_file", 2024-05-08T05:33:46.939 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-08T05:33:46.939 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.939 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:46.939 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-05-08T05:33:46.939 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.939 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.939 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.940 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:46.940 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.940 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.940 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.940 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.940 INFO:teuthology.orchestra.run.smithi087.stdout: "sqlite3_killpoint": { 2024-05-08T05:33:46.940 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "sqlite3_killpoint", 2024-05-08T05:33:46.940 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "int", 2024-05-08T05:33:46.940 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "dev", 2024-05-08T05:33:46.940 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:46.940 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "0", 2024-05-08T05:33:46.940 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.940 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.941 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.941 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:46.941 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.941 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.941 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.941 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-05-08T05:33:46.941 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-05-08T05:33:46.941 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.941 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-05-08T05:33:46.941 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "telemetry", 2024-05-08T05:33:46.941 INFO:teuthology.orchestra.run.smithi087.stdout: "can_run": true, 2024-05-08T05:33:46.941 INFO:teuthology.orchestra.run.smithi087.stdout: "error_string": "", 2024-05-08T05:33:46.942 INFO:teuthology.orchestra.run.smithi087.stdout: "module_options": { 2024-05-08T05:33:46.942 INFO:teuthology.orchestra.run.smithi087.stdout: "channel_basic": { 2024-05-08T05:33:46.942 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "channel_basic", 2024-05-08T05:33:46.942 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-08T05:33:46.942 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.942 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-08T05:33:46.942 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "True", 2024-05-08T05:33:46.942 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.942 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.942 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.942 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "Share basic cluster information (size, version)", 2024-05-08T05:33:46.942 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.943 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.943 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.943 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.943 INFO:teuthology.orchestra.run.smithi087.stdout: "channel_crash": { 2024-05-08T05:33:46.943 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "channel_crash", 2024-05-08T05:33:46.943 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-08T05:33:46.943 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.943 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-08T05:33:46.943 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "True", 2024-05-08T05:33:46.943 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.943 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.943 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.944 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2024-05-08T05:33:46.944 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.944 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.944 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.944 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.944 INFO:teuthology.orchestra.run.smithi087.stdout: "channel_device": { 2024-05-08T05:33:46.944 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "channel_device", 2024-05-08T05:33:46.944 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-08T05:33:46.944 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.944 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-08T05:33:46.944 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "True", 2024-05-08T05:33:46.944 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.944 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.945 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.945 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2024-05-08T05:33:46.945 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.945 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.945 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.945 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.945 INFO:teuthology.orchestra.run.smithi087.stdout: "channel_ident": { 2024-05-08T05:33:46.945 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "channel_ident", 2024-05-08T05:33:46.945 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-08T05:33:46.945 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.945 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-08T05:33:46.945 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-05-08T05:33:46.946 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.946 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.946 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.946 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2024-05-08T05:33:46.946 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.946 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.946 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.946 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.946 INFO:teuthology.orchestra.run.smithi087.stdout: "channel_perf": { 2024-05-08T05:33:46.946 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "channel_perf", 2024-05-08T05:33:46.946 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-08T05:33:46.946 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.947 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-08T05:33:46.947 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-05-08T05:33:46.947 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.947 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.947 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.947 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "Share various performance metrics of a cluster", 2024-05-08T05:33:46.947 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.947 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.947 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.947 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.947 INFO:teuthology.orchestra.run.smithi087.stdout: "contact": { 2024-05-08T05:33:46.947 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "contact", 2024-05-08T05:33:46.948 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-08T05:33:46.948 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.948 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-08T05:33:46.948 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-05-08T05:33:46.948 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.948 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.948 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.948 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:46.948 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.948 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.948 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.948 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.948 INFO:teuthology.orchestra.run.smithi087.stdout: "description": { 2024-05-08T05:33:46.949 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "description", 2024-05-08T05:33:46.949 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-08T05:33:46.949 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.949 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-08T05:33:46.949 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-05-08T05:33:46.949 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.949 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.949 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.949 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:46.949 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.949 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.949 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.949 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.949 INFO:teuthology.orchestra.run.smithi087.stdout: "device_url": { 2024-05-08T05:33:46.950 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "device_url", 2024-05-08T05:33:46.950 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-08T05:33:46.950 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.950 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-08T05:33:46.950 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "https://telemetry.ceph.com/device", 2024-05-08T05:33:46.950 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.950 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.950 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.950 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:46.950 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.950 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.950 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.951 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.951 INFO:teuthology.orchestra.run.smithi087.stdout: "enabled": { 2024-05-08T05:33:46.951 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "enabled", 2024-05-08T05:33:46.951 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-08T05:33:46.951 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.951 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-08T05:33:46.951 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-05-08T05:33:46.951 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.951 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.951 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.951 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:46.951 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.951 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.952 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.952 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.952 INFO:teuthology.orchestra.run.smithi087.stdout: "interval": { 2024-05-08T05:33:46.952 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "interval", 2024-05-08T05:33:46.952 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "int", 2024-05-08T05:33:46.952 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.952 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-08T05:33:46.952 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "24", 2024-05-08T05:33:46.952 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "8", 2024-05-08T05:33:46.952 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.952 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.952 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:46.952 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.952 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.953 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.953 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.953 INFO:teuthology.orchestra.run.smithi087.stdout: "last_opt_revision": { 2024-05-08T05:33:46.953 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "last_opt_revision", 2024-05-08T05:33:46.953 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "int", 2024-05-08T05:33:46.953 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.953 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-08T05:33:46.953 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "1", 2024-05-08T05:33:46.953 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.953 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.953 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.953 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:46.953 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.954 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.954 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.954 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.954 INFO:teuthology.orchestra.run.smithi087.stdout: "leaderboard": { 2024-05-08T05:33:46.954 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "leaderboard", 2024-05-08T05:33:46.954 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-08T05:33:46.954 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.954 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-08T05:33:46.954 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-05-08T05:33:46.954 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.954 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.954 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.954 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:46.955 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.955 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.955 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.955 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.955 INFO:teuthology.orchestra.run.smithi087.stdout: "leaderboard_description": { 2024-05-08T05:33:46.955 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "leaderboard_description", 2024-05-08T05:33:46.955 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-08T05:33:46.955 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.955 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-08T05:33:46.955 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-05-08T05:33:46.955 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.955 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.955 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.956 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:46.956 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.956 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.956 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.956 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.956 INFO:teuthology.orchestra.run.smithi087.stdout: "log_level": { 2024-05-08T05:33:46.956 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_level", 2024-05-08T05:33:46.956 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-08T05:33:46.956 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.956 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:46.956 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-05-08T05:33:46.956 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.956 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.957 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [ 2024-05-08T05:33:46.957 INFO:teuthology.orchestra.run.smithi087.stdout: "", 2024-05-08T05:33:46.957 INFO:teuthology.orchestra.run.smithi087.stdout: "critical", 2024-05-08T05:33:46.957 INFO:teuthology.orchestra.run.smithi087.stdout: "debug", 2024-05-08T05:33:46.957 INFO:teuthology.orchestra.run.smithi087.stdout: "error", 2024-05-08T05:33:46.957 INFO:teuthology.orchestra.run.smithi087.stdout: "info", 2024-05-08T05:33:46.957 INFO:teuthology.orchestra.run.smithi087.stdout: "warning" 2024-05-08T05:33:46.957 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-05-08T05:33:46.957 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:46.957 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.957 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.957 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.958 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.958 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_cluster": { 2024-05-08T05:33:46.958 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_cluster", 2024-05-08T05:33:46.958 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-08T05:33:46.958 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.958 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:46.958 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-05-08T05:33:46.958 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.958 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.958 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.958 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:46.958 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.958 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.959 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.959 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.959 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_cluster_level": { 2024-05-08T05:33:46.959 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_cluster_level", 2024-05-08T05:33:46.959 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-08T05:33:46.959 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.959 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:46.959 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "info", 2024-05-08T05:33:46.959 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.959 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.959 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [ 2024-05-08T05:33:46.959 INFO:teuthology.orchestra.run.smithi087.stdout: "", 2024-05-08T05:33:46.959 INFO:teuthology.orchestra.run.smithi087.stdout: "critical", 2024-05-08T05:33:46.960 INFO:teuthology.orchestra.run.smithi087.stdout: "debug", 2024-05-08T05:33:46.960 INFO:teuthology.orchestra.run.smithi087.stdout: "error", 2024-05-08T05:33:46.960 INFO:teuthology.orchestra.run.smithi087.stdout: "info", 2024-05-08T05:33:46.960 INFO:teuthology.orchestra.run.smithi087.stdout: "warning" 2024-05-08T05:33:46.960 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-05-08T05:33:46.960 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:46.960 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.960 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.960 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.960 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.960 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_file": { 2024-05-08T05:33:46.960 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_file", 2024-05-08T05:33:46.961 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-08T05:33:46.961 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.961 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:46.961 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-05-08T05:33:46.961 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.961 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.961 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.961 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:46.961 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.961 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.961 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.961 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.961 INFO:teuthology.orchestra.run.smithi087.stdout: "organization": { 2024-05-08T05:33:46.962 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "organization", 2024-05-08T05:33:46.962 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-08T05:33:46.962 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.962 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-08T05:33:46.962 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-05-08T05:33:46.962 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.962 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.962 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.962 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:46.962 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.962 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.962 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.963 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.963 INFO:teuthology.orchestra.run.smithi087.stdout: "proxy": { 2024-05-08T05:33:46.963 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "proxy", 2024-05-08T05:33:46.963 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-08T05:33:46.963 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.963 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-08T05:33:46.963 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-05-08T05:33:46.963 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.963 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.963 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.963 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:46.963 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.963 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.964 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.964 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.964 INFO:teuthology.orchestra.run.smithi087.stdout: "sqlite3_killpoint": { 2024-05-08T05:33:46.964 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "sqlite3_killpoint", 2024-05-08T05:33:46.964 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "int", 2024-05-08T05:33:46.964 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "dev", 2024-05-08T05:33:46.964 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:46.964 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "0", 2024-05-08T05:33:46.964 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.964 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.964 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.964 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:46.965 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.965 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.965 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.965 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.965 INFO:teuthology.orchestra.run.smithi087.stdout: "url": { 2024-05-08T05:33:46.965 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "url", 2024-05-08T05:33:46.965 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-08T05:33:46.965 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.965 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-08T05:33:46.965 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "https://telemetry.ceph.com/report", 2024-05-08T05:33:46.965 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.965 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.966 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.966 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:46.966 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.966 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.966 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.966 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-05-08T05:33:46.966 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-05-08T05:33:46.966 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.966 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-05-08T05:33:46.966 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "test_orchestrator", 2024-05-08T05:33:46.966 INFO:teuthology.orchestra.run.smithi087.stdout: "can_run": true, 2024-05-08T05:33:46.966 INFO:teuthology.orchestra.run.smithi087.stdout: "error_string": "", 2024-05-08T05:33:46.967 INFO:teuthology.orchestra.run.smithi087.stdout: "module_options": { 2024-05-08T05:33:46.967 INFO:teuthology.orchestra.run.smithi087.stdout: "log_level": { 2024-05-08T05:33:46.967 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_level", 2024-05-08T05:33:46.967 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-08T05:33:46.967 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.967 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:46.967 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-05-08T05:33:46.967 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.967 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.967 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [ 2024-05-08T05:33:46.967 INFO:teuthology.orchestra.run.smithi087.stdout: "", 2024-05-08T05:33:46.967 INFO:teuthology.orchestra.run.smithi087.stdout: "critical", 2024-05-08T05:33:46.968 INFO:teuthology.orchestra.run.smithi087.stdout: "debug", 2024-05-08T05:33:46.968 INFO:teuthology.orchestra.run.smithi087.stdout: "error", 2024-05-08T05:33:46.968 INFO:teuthology.orchestra.run.smithi087.stdout: "info", 2024-05-08T05:33:46.968 INFO:teuthology.orchestra.run.smithi087.stdout: "warning" 2024-05-08T05:33:46.968 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-05-08T05:33:46.968 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:46.968 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.968 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.968 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.968 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.968 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_cluster": { 2024-05-08T05:33:46.968 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_cluster", 2024-05-08T05:33:46.968 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-08T05:33:46.969 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.969 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:46.969 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-05-08T05:33:46.969 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.969 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.969 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.969 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:46.969 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.969 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.969 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.969 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.969 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_cluster_level": { 2024-05-08T05:33:46.970 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_cluster_level", 2024-05-08T05:33:46.970 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-08T05:33:46.970 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.970 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:46.970 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "info", 2024-05-08T05:33:46.970 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.970 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.970 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [ 2024-05-08T05:33:46.970 INFO:teuthology.orchestra.run.smithi087.stdout: "", 2024-05-08T05:33:46.970 INFO:teuthology.orchestra.run.smithi087.stdout: "critical", 2024-05-08T05:33:46.970 INFO:teuthology.orchestra.run.smithi087.stdout: "debug", 2024-05-08T05:33:46.970 INFO:teuthology.orchestra.run.smithi087.stdout: "error", 2024-05-08T05:33:46.971 INFO:teuthology.orchestra.run.smithi087.stdout: "info", 2024-05-08T05:33:46.971 INFO:teuthology.orchestra.run.smithi087.stdout: "warning" 2024-05-08T05:33:46.971 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-05-08T05:33:46.971 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:46.971 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.971 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.971 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.971 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.971 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_file": { 2024-05-08T05:33:46.971 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_file", 2024-05-08T05:33:46.971 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-08T05:33:46.971 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.971 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:46.972 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-05-08T05:33:46.972 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.972 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.972 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.972 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:46.972 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.972 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.972 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.972 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.972 INFO:teuthology.orchestra.run.smithi087.stdout: "sqlite3_killpoint": { 2024-05-08T05:33:46.972 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "sqlite3_killpoint", 2024-05-08T05:33:46.972 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "int", 2024-05-08T05:33:46.973 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "dev", 2024-05-08T05:33:46.973 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:46.973 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "0", 2024-05-08T05:33:46.973 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.973 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.973 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.973 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:46.973 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.973 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.973 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.973 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-05-08T05:33:46.973 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-05-08T05:33:46.973 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.974 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-05-08T05:33:46.974 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "volumes", 2024-05-08T05:33:46.974 INFO:teuthology.orchestra.run.smithi087.stdout: "can_run": true, 2024-05-08T05:33:46.974 INFO:teuthology.orchestra.run.smithi087.stdout: "error_string": "", 2024-05-08T05:33:46.974 INFO:teuthology.orchestra.run.smithi087.stdout: "module_options": { 2024-05-08T05:33:46.974 INFO:teuthology.orchestra.run.smithi087.stdout: "log_level": { 2024-05-08T05:33:46.974 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_level", 2024-05-08T05:33:46.974 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-08T05:33:46.974 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.974 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:46.974 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-05-08T05:33:46.974 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.975 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.975 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [ 2024-05-08T05:33:46.975 INFO:teuthology.orchestra.run.smithi087.stdout: "", 2024-05-08T05:33:46.975 INFO:teuthology.orchestra.run.smithi087.stdout: "critical", 2024-05-08T05:33:46.975 INFO:teuthology.orchestra.run.smithi087.stdout: "debug", 2024-05-08T05:33:46.975 INFO:teuthology.orchestra.run.smithi087.stdout: "error", 2024-05-08T05:33:46.975 INFO:teuthology.orchestra.run.smithi087.stdout: "info", 2024-05-08T05:33:46.975 INFO:teuthology.orchestra.run.smithi087.stdout: "warning" 2024-05-08T05:33:46.975 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-05-08T05:33:46.975 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:46.975 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.975 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.976 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.976 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.976 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_cluster": { 2024-05-08T05:33:46.976 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_cluster", 2024-05-08T05:33:46.976 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-08T05:33:46.976 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.976 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:46.976 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-05-08T05:33:46.976 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.976 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.976 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.976 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:46.976 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.977 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.977 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.977 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.977 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_cluster_level": { 2024-05-08T05:33:46.977 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_cluster_level", 2024-05-08T05:33:46.977 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-08T05:33:46.977 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.977 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:46.977 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "info", 2024-05-08T05:33:46.977 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.977 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.977 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [ 2024-05-08T05:33:46.977 INFO:teuthology.orchestra.run.smithi087.stdout: "", 2024-05-08T05:33:46.978 INFO:teuthology.orchestra.run.smithi087.stdout: "critical", 2024-05-08T05:33:46.978 INFO:teuthology.orchestra.run.smithi087.stdout: "debug", 2024-05-08T05:33:46.978 INFO:teuthology.orchestra.run.smithi087.stdout: "error", 2024-05-08T05:33:46.978 INFO:teuthology.orchestra.run.smithi087.stdout: "info", 2024-05-08T05:33:46.978 INFO:teuthology.orchestra.run.smithi087.stdout: "warning" 2024-05-08T05:33:46.978 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-05-08T05:33:46.978 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:46.978 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.978 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.978 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.978 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.978 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_file": { 2024-05-08T05:33:46.979 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_file", 2024-05-08T05:33:46.979 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-08T05:33:46.979 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.979 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:46.979 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-05-08T05:33:46.979 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.979 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.979 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.979 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:46.979 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.979 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.979 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.979 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.979 INFO:teuthology.orchestra.run.smithi087.stdout: "max_concurrent_clones": { 2024-05-08T05:33:46.980 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "max_concurrent_clones", 2024-05-08T05:33:46.980 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "int", 2024-05-08T05:33:46.980 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.980 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-08T05:33:46.980 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "4", 2024-05-08T05:33:46.980 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.980 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.980 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.980 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "Number of asynchronous cloner threads", 2024-05-08T05:33:46.980 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.980 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.980 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.980 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.981 INFO:teuthology.orchestra.run.smithi087.stdout: "periodic_async_work": { 2024-05-08T05:33:46.981 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "periodic_async_work", 2024-05-08T05:33:46.981 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-08T05:33:46.981 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.981 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-08T05:33:46.981 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-05-08T05:33:46.981 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.981 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.981 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.981 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "Periodically check for async work", 2024-05-08T05:33:46.981 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.981 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.982 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.982 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.982 INFO:teuthology.orchestra.run.smithi087.stdout: "snapshot_clone_delay": { 2024-05-08T05:33:46.982 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "snapshot_clone_delay", 2024-05-08T05:33:46.982 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "int", 2024-05-08T05:33:46.982 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.982 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-08T05:33:46.982 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "0", 2024-05-08T05:33:46.982 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.982 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.982 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.982 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2024-05-08T05:33:46.983 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.983 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.983 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.983 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.983 INFO:teuthology.orchestra.run.smithi087.stdout: "snapshot_clone_no_wait": { 2024-05-08T05:33:46.983 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "snapshot_clone_no_wait", 2024-05-08T05:33:46.983 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-08T05:33:46.983 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.983 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-08T05:33:46.983 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "True", 2024-05-08T05:33:46.983 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.983 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.984 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.984 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "Reject subvolume clone request when cloner threads are busy", 2024-05-08T05:33:46.984 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.984 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.984 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.984 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.984 INFO:teuthology.orchestra.run.smithi087.stdout: "sqlite3_killpoint": { 2024-05-08T05:33:46.984 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "sqlite3_killpoint", 2024-05-08T05:33:46.984 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "int", 2024-05-08T05:33:46.984 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "dev", 2024-05-08T05:33:46.984 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:46.984 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "0", 2024-05-08T05:33:46.984 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.985 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.985 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.985 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:46.985 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.985 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.985 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.985 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-05-08T05:33:46.985 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-05-08T05:33:46.985 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.985 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-05-08T05:33:46.985 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "zabbix", 2024-05-08T05:33:46.985 INFO:teuthology.orchestra.run.smithi087.stdout: "can_run": true, 2024-05-08T05:33:46.985 INFO:teuthology.orchestra.run.smithi087.stdout: "error_string": "", 2024-05-08T05:33:46.986 INFO:teuthology.orchestra.run.smithi087.stdout: "module_options": { 2024-05-08T05:33:46.986 INFO:teuthology.orchestra.run.smithi087.stdout: "discovery_interval": { 2024-05-08T05:33:46.986 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "discovery_interval", 2024-05-08T05:33:46.986 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "uint", 2024-05-08T05:33:46.986 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.986 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-08T05:33:46.986 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "100", 2024-05-08T05:33:46.986 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.986 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.986 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.986 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:46.987 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.987 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.987 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.987 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.987 INFO:teuthology.orchestra.run.smithi087.stdout: "identifier": { 2024-05-08T05:33:46.987 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "identifier", 2024-05-08T05:33:46.987 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-08T05:33:46.987 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.987 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-08T05:33:46.987 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-05-08T05:33:46.987 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.987 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.987 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.988 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:46.988 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.988 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.988 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.988 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.988 INFO:teuthology.orchestra.run.smithi087.stdout: "interval": { 2024-05-08T05:33:46.988 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "interval", 2024-05-08T05:33:46.988 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "secs", 2024-05-08T05:33:46.988 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.988 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-08T05:33:46.988 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "60", 2024-05-08T05:33:46.989 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.989 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.989 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.989 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:46.989 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.989 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.989 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.989 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.989 INFO:teuthology.orchestra.run.smithi087.stdout: "log_level": { 2024-05-08T05:33:46.989 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_level", 2024-05-08T05:33:46.989 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-08T05:33:46.989 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.989 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:46.990 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-05-08T05:33:46.990 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.990 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.990 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [ 2024-05-08T05:33:46.990 INFO:teuthology.orchestra.run.smithi087.stdout: "", 2024-05-08T05:33:46.990 INFO:teuthology.orchestra.run.smithi087.stdout: "critical", 2024-05-08T05:33:46.990 INFO:teuthology.orchestra.run.smithi087.stdout: "debug", 2024-05-08T05:33:46.990 INFO:teuthology.orchestra.run.smithi087.stdout: "error", 2024-05-08T05:33:46.990 INFO:teuthology.orchestra.run.smithi087.stdout: "info", 2024-05-08T05:33:46.990 INFO:teuthology.orchestra.run.smithi087.stdout: "warning" 2024-05-08T05:33:46.990 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-05-08T05:33:46.991 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:46.991 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.991 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.991 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.991 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.991 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_cluster": { 2024-05-08T05:33:46.991 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_cluster", 2024-05-08T05:33:46.991 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-08T05:33:46.991 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.991 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:46.991 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-05-08T05:33:46.991 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.992 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.992 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.992 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:46.992 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.992 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.992 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.992 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.992 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_cluster_level": { 2024-05-08T05:33:46.992 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_cluster_level", 2024-05-08T05:33:46.992 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-08T05:33:46.992 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.992 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:46.993 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "info", 2024-05-08T05:33:46.993 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.993 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.993 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [ 2024-05-08T05:33:46.993 INFO:teuthology.orchestra.run.smithi087.stdout: "", 2024-05-08T05:33:46.993 INFO:teuthology.orchestra.run.smithi087.stdout: "critical", 2024-05-08T05:33:46.993 INFO:teuthology.orchestra.run.smithi087.stdout: "debug", 2024-05-08T05:33:46.993 INFO:teuthology.orchestra.run.smithi087.stdout: "error", 2024-05-08T05:33:46.993 INFO:teuthology.orchestra.run.smithi087.stdout: "info", 2024-05-08T05:33:46.993 INFO:teuthology.orchestra.run.smithi087.stdout: "warning" 2024-05-08T05:33:46.993 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-05-08T05:33:46.993 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:46.994 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.994 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.994 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.994 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.994 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_file": { 2024-05-08T05:33:46.994 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_file", 2024-05-08T05:33:46.994 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-08T05:33:46.994 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.994 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:46.994 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-05-08T05:33:46.994 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.994 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.994 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.995 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:46.995 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.995 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.995 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.995 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.995 INFO:teuthology.orchestra.run.smithi087.stdout: "sqlite3_killpoint": { 2024-05-08T05:33:46.995 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "sqlite3_killpoint", 2024-05-08T05:33:46.995 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "int", 2024-05-08T05:33:46.995 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "dev", 2024-05-08T05:33:46.995 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:46.995 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "0", 2024-05-08T05:33:46.995 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.996 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.996 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.996 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:46.996 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.996 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.996 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.996 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.996 INFO:teuthology.orchestra.run.smithi087.stdout: "zabbix_host": { 2024-05-08T05:33:46.996 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "zabbix_host", 2024-05-08T05:33:46.996 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-08T05:33:46.996 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.997 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-08T05:33:46.997 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-05-08T05:33:46.997 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.997 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.997 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.997 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:46.997 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.997 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.997 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.997 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.997 INFO:teuthology.orchestra.run.smithi087.stdout: "zabbix_port": { 2024-05-08T05:33:46.997 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "zabbix_port", 2024-05-08T05:33:46.997 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "int", 2024-05-08T05:33:46.998 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.998 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-08T05:33:46.998 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "10051", 2024-05-08T05:33:46.998 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.998 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.998 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.998 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:46.998 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.998 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.998 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:46.998 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:46.999 INFO:teuthology.orchestra.run.smithi087.stdout: "zabbix_sender": { 2024-05-08T05:33:46.999 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "zabbix_sender", 2024-05-08T05:33:46.999 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-08T05:33:46.999 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:46.999 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-08T05:33:46.999 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "/usr/bin/zabbix_sender", 2024-05-08T05:33:46.999 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:46.999 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:46.999 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:46.999 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:46.999 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:46.999 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:46.999 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:47.000 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-05-08T05:33:47.000 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-05-08T05:33:47.000 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-05-08T05:33:47.000 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-05-08T05:33:47.000 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-05-08T05:33:47.000 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-05-08T05:33:47.000 INFO:teuthology.orchestra.run.smithi087.stdout: "modules": [ 2024-05-08T05:33:47.000 INFO:teuthology.orchestra.run.smithi087.stdout: "cephadm", 2024-05-08T05:33:47.000 INFO:teuthology.orchestra.run.smithi087.stdout: "dashboard", 2024-05-08T05:33:47.000 INFO:teuthology.orchestra.run.smithi087.stdout: "iostat", 2024-05-08T05:33:47.000 INFO:teuthology.orchestra.run.smithi087.stdout: "nfs", 2024-05-08T05:33:47.000 INFO:teuthology.orchestra.run.smithi087.stdout: "restful" 2024-05-08T05:33:47.000 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-05-08T05:33:47.000 INFO:teuthology.orchestra.run.smithi087.stdout: "available_modules": [ 2024-05-08T05:33:47.001 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-05-08T05:33:47.001 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "alerts", 2024-05-08T05:33:47.001 INFO:teuthology.orchestra.run.smithi087.stdout: "can_run": true, 2024-05-08T05:33:47.001 INFO:teuthology.orchestra.run.smithi087.stdout: "error_string": "", 2024-05-08T05:33:47.001 INFO:teuthology.orchestra.run.smithi087.stdout: "module_options": { 2024-05-08T05:33:47.001 INFO:teuthology.orchestra.run.smithi087.stdout: "interval": { 2024-05-08T05:33:47.001 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "interval", 2024-05-08T05:33:47.001 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "secs", 2024-05-08T05:33:47.001 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:47.001 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:47.001 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "60", 2024-05-08T05:33:47.001 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:47.002 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:47.002 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:47.002 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "How frequently to reexamine health status", 2024-05-08T05:33:47.002 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:47.002 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:47.002 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:47.002 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:47.002 INFO:teuthology.orchestra.run.smithi087.stdout: "log_level": { 2024-05-08T05:33:47.002 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_level", 2024-05-08T05:33:47.002 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-08T05:33:47.002 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:47.002 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:47.003 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-05-08T05:33:47.003 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:47.003 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:47.003 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [ 2024-05-08T05:33:47.003 INFO:teuthology.orchestra.run.smithi087.stdout: "", 2024-05-08T05:33:47.003 INFO:teuthology.orchestra.run.smithi087.stdout: "critical", 2024-05-08T05:33:47.003 INFO:teuthology.orchestra.run.smithi087.stdout: "debug", 2024-05-08T05:33:47.003 INFO:teuthology.orchestra.run.smithi087.stdout: "error", 2024-05-08T05:33:47.003 INFO:teuthology.orchestra.run.smithi087.stdout: "info", 2024-05-08T05:33:47.003 INFO:teuthology.orchestra.run.smithi087.stdout: "warning" 2024-05-08T05:33:47.003 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-05-08T05:33:47.003 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:47.003 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:47.003 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:47.003 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:47.004 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:47.004 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_cluster": { 2024-05-08T05:33:47.004 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_cluster", 2024-05-08T05:33:47.004 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-08T05:33:47.004 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:47.004 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:47.004 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-05-08T05:33:47.004 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:47.004 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:47.004 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:47.004 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:47.004 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:47.004 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:47.005 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:47.005 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:47.005 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_cluster_level": { 2024-05-08T05:33:47.005 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_cluster_level", 2024-05-08T05:33:47.005 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-08T05:33:47.005 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:47.005 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:47.005 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "info", 2024-05-08T05:33:47.005 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:47.005 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:47.005 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [ 2024-05-08T05:33:47.005 INFO:teuthology.orchestra.run.smithi087.stdout: "", 2024-05-08T05:33:47.005 INFO:teuthology.orchestra.run.smithi087.stdout: "critical", 2024-05-08T05:33:47.006 INFO:teuthology.orchestra.run.smithi087.stdout: "debug", 2024-05-08T05:33:47.006 INFO:teuthology.orchestra.run.smithi087.stdout: "error", 2024-05-08T05:33:47.006 INFO:teuthology.orchestra.run.smithi087.stdout: "info", 2024-05-08T05:33:47.006 INFO:teuthology.orchestra.run.smithi087.stdout: "warning" 2024-05-08T05:33:47.006 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-05-08T05:33:47.006 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:47.006 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:47.006 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:47.006 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:47.006 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:47.006 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_file": { 2024-05-08T05:33:47.007 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_file", 2024-05-08T05:33:47.007 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-08T05:33:47.007 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:47.007 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:47.007 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-05-08T05:33:47.007 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:47.007 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:47.007 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:47.007 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:47.007 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:47.007 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:47.007 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:47.007 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:47.008 INFO:teuthology.orchestra.run.smithi087.stdout: "smtp_destination": { 2024-05-08T05:33:47.008 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "smtp_destination", 2024-05-08T05:33:47.008 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-08T05:33:47.008 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:47.008 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:47.008 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-05-08T05:33:47.008 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:47.008 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:47.008 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:47.008 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "Email address to send alerts to", 2024-05-08T05:33:47.008 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:47.008 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:47.008 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:47.009 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:47.009 INFO:teuthology.orchestra.run.smithi087.stdout: "smtp_from_name": { 2024-05-08T05:33:47.009 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "smtp_from_name", 2024-05-08T05:33:47.009 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-08T05:33:47.009 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:47.009 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:47.009 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "Ceph", 2024-05-08T05:33:47.009 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:47.009 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:47.009 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:47.009 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "Email From: name", 2024-05-08T05:33:47.009 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:47.009 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:47.010 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:47.010 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:47.010 INFO:teuthology.orchestra.run.smithi087.stdout: "smtp_host": { 2024-05-08T05:33:47.010 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "smtp_host", 2024-05-08T05:33:47.010 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-08T05:33:47.010 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:47.010 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:47.010 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-05-08T05:33:47.010 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:47.010 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:47.010 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:47.010 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "SMTP server", 2024-05-08T05:33:47.011 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:47.011 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:47.011 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:47.011 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:47.011 INFO:teuthology.orchestra.run.smithi087.stdout: "smtp_password": { 2024-05-08T05:33:47.011 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "smtp_password", 2024-05-08T05:33:47.011 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-08T05:33:47.011 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:47.011 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:47.011 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-05-08T05:33:47.011 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:47.011 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:47.011 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:47.011 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "Password to authenticate with", 2024-05-08T05:33:47.012 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:47.012 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:47.012 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:47.012 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:47.012 INFO:teuthology.orchestra.run.smithi087.stdout: "smtp_port": { 2024-05-08T05:33:47.012 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "smtp_port", 2024-05-08T05:33:47.012 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "int", 2024-05-08T05:33:47.012 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:47.012 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:47.012 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "465", 2024-05-08T05:33:47.012 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:47.012 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:47.012 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:47.013 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "SMTP port", 2024-05-08T05:33:47.013 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:47.013 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:47.013 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:47.013 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:47.013 INFO:teuthology.orchestra.run.smithi087.stdout: "smtp_sender": { 2024-05-08T05:33:47.013 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "smtp_sender", 2024-05-08T05:33:47.013 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-08T05:33:47.013 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:47.013 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:47.013 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-05-08T05:33:47.013 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:47.013 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:47.014 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:47.014 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "SMTP envelope sender", 2024-05-08T05:33:47.014 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:47.014 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:47.014 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:47.014 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:47.014 INFO:teuthology.orchestra.run.smithi087.stdout: "smtp_ssl": { 2024-05-08T05:33:47.014 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "smtp_ssl", 2024-05-08T05:33:47.014 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-08T05:33:47.014 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:47.014 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:47.015 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "True", 2024-05-08T05:33:47.015 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:47.015 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:47.015 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:47.015 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "Use SSL to connect to SMTP server", 2024-05-08T05:33:47.015 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:47.015 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:47.015 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:47.015 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:47.015 INFO:teuthology.orchestra.run.smithi087.stdout: "smtp_user": { 2024-05-08T05:33:47.015 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "smtp_user", 2024-05-08T05:33:47.015 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-08T05:33:47.016 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:47.016 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:47.016 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-05-08T05:33:47.016 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:47.016 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:47.016 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:47.016 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "User to authenticate as", 2024-05-08T05:33:47.016 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:47.016 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:47.016 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:47.016 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:47.016 INFO:teuthology.orchestra.run.smithi087.stdout: "sqlite3_killpoint": { 2024-05-08T05:33:47.017 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "sqlite3_killpoint", 2024-05-08T05:33:47.017 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "int", 2024-05-08T05:33:47.017 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "dev", 2024-05-08T05:33:47.017 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:47.017 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "0", 2024-05-08T05:33:47.017 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:47.017 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:47.017 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:47.017 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:47.017 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:47.017 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:47.017 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:47.018 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-05-08T05:33:47.018 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-05-08T05:33:47.018 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:47.018 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-05-08T05:33:47.018 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "balancer", 2024-05-08T05:33:47.018 INFO:teuthology.orchestra.run.smithi087.stdout: "can_run": true, 2024-05-08T05:33:47.018 INFO:teuthology.orchestra.run.smithi087.stdout: "error_string": "", 2024-05-08T05:33:47.018 INFO:teuthology.orchestra.run.smithi087.stdout: "module_options": { 2024-05-08T05:33:47.018 INFO:teuthology.orchestra.run.smithi087.stdout: "active": { 2024-05-08T05:33:47.018 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "active", 2024-05-08T05:33:47.018 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-08T05:33:47.018 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:47.019 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:47.019 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "True", 2024-05-08T05:33:47.019 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:47.019 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:47.019 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:47.019 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "automatically balance PGs across cluster", 2024-05-08T05:33:47.019 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:47.019 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:47.019 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:47.019 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:47.019 INFO:teuthology.orchestra.run.smithi087.stdout: "begin_time": { 2024-05-08T05:33:47.019 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "begin_time", 2024-05-08T05:33:47.020 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-08T05:33:47.020 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:47.020 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:47.020 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "0000", 2024-05-08T05:33:47.020 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:47.020 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:47.020 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:47.020 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "beginning time of day to automatically balance", 2024-05-08T05:33:47.020 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-05-08T05:33:47.020 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:47.020 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:47.020 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:47.020 INFO:teuthology.orchestra.run.smithi087.stdout: "begin_weekday": { 2024-05-08T05:33:47.021 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "begin_weekday", 2024-05-08T05:33:47.021 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "uint", 2024-05-08T05:33:47.021 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:47.021 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:47.021 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "0", 2024-05-08T05:33:47.021 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "0", 2024-05-08T05:33:47.021 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "6", 2024-05-08T05:33:47.021 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:47.021 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2024-05-08T05:33:47.021 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-05-08T05:33:47.021 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:47.021 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:47.021 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:47.022 INFO:teuthology.orchestra.run.smithi087.stdout: "crush_compat_max_iterations": { 2024-05-08T05:33:47.022 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "crush_compat_max_iterations", 2024-05-08T05:33:47.022 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "uint", 2024-05-08T05:33:47.022 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:47.022 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:47.022 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "25", 2024-05-08T05:33:47.022 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "1", 2024-05-08T05:33:47.022 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "250", 2024-05-08T05:33:47.022 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:47.022 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "maximum number of iterations to attempt optimization", 2024-05-08T05:33:47.022 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:47.022 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:47.023 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:47.023 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:47.023 INFO:teuthology.orchestra.run.smithi087.stdout: "crush_compat_metrics": { 2024-05-08T05:33:47.023 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "crush_compat_metrics", 2024-05-08T05:33:47.023 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-08T05:33:47.023 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:47.023 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:47.023 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "pgs,objects,bytes", 2024-05-08T05:33:47.023 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:47.023 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:47.023 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:47.023 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "metrics with which to calculate OSD utilization", 2024-05-08T05:33:47.023 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2024-05-08T05:33:47.024 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:47.024 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:47.024 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:47.024 INFO:teuthology.orchestra.run.smithi087.stdout: "crush_compat_step": { 2024-05-08T05:33:47.024 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "crush_compat_step", 2024-05-08T05:33:47.024 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "float", 2024-05-08T05:33:47.024 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:47.024 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:47.024 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "0.5", 2024-05-08T05:33:47.024 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "0.001", 2024-05-08T05:33:47.024 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "0.999", 2024-05-08T05:33:47.024 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:47.024 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "aggressiveness of optimization", 2024-05-08T05:33:47.025 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2024-05-08T05:33:47.025 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:47.025 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:47.025 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:47.025 INFO:teuthology.orchestra.run.smithi087.stdout: "end_time": { 2024-05-08T05:33:47.025 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "end_time", 2024-05-08T05:33:47.025 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-08T05:33:47.025 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:47.025 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:47.025 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "2359", 2024-05-08T05:33:47.025 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:47.025 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:47.025 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:47.026 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "ending time of day to automatically balance", 2024-05-08T05:33:47.026 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-05-08T05:33:47.026 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:47.026 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:47.026 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:47.026 INFO:teuthology.orchestra.run.smithi087.stdout: "end_weekday": { 2024-05-08T05:33:47.026 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "end_weekday", 2024-05-08T05:33:47.026 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "uint", 2024-05-08T05:33:47.026 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:47.026 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:47.026 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "0", 2024-05-08T05:33:47.026 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "0", 2024-05-08T05:33:47.027 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "6", 2024-05-08T05:33:47.027 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:47.027 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2024-05-08T05:33:47.027 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-05-08T05:33:47.027 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:47.027 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:47.027 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:47.027 INFO:teuthology.orchestra.run.smithi087.stdout: "log_level": { 2024-05-08T05:33:47.027 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_level", 2024-05-08T05:33:47.027 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-08T05:33:47.027 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:47.027 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:47.028 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-05-08T05:33:47.028 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:47.028 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:47.028 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [ 2024-05-08T05:33:47.028 INFO:teuthology.orchestra.run.smithi087.stdout: "", 2024-05-08T05:33:47.028 INFO:teuthology.orchestra.run.smithi087.stdout: "critical", 2024-05-08T05:33:47.028 INFO:teuthology.orchestra.run.smithi087.stdout: "debug", 2024-05-08T05:33:47.028 INFO:teuthology.orchestra.run.smithi087.stdout: "error", 2024-05-08T05:33:47.028 INFO:teuthology.orchestra.run.smithi087.stdout: "info", 2024-05-08T05:33:47.028 INFO:teuthology.orchestra.run.smithi087.stdout: "warning" 2024-05-08T05:33:47.028 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-05-08T05:33:47.028 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:47.029 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:47.029 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:47.029 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:47.029 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:47.029 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_cluster": { 2024-05-08T05:33:47.029 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_cluster", 2024-05-08T05:33:47.029 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-08T05:33:47.029 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:47.029 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:47.029 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-05-08T05:33:47.029 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:47.029 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:47.030 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:47.030 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:47.030 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:47.030 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:47.030 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:47.030 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:47.030 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_cluster_level": { 2024-05-08T05:33:47.030 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_cluster_level", 2024-05-08T05:33:47.030 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-08T05:33:47.030 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:47.030 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:47.030 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "info", 2024-05-08T05:33:47.030 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:47.031 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:47.031 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [ 2024-05-08T05:33:47.031 INFO:teuthology.orchestra.run.smithi087.stdout: "", 2024-05-08T05:33:47.031 INFO:teuthology.orchestra.run.smithi087.stdout: "critical", 2024-05-08T05:33:47.031 INFO:teuthology.orchestra.run.smithi087.stdout: "debug", 2024-05-08T05:33:47.031 INFO:teuthology.orchestra.run.smithi087.stdout: "error", 2024-05-08T05:33:47.031 INFO:teuthology.orchestra.run.smithi087.stdout: "info", 2024-05-08T05:33:47.031 INFO:teuthology.orchestra.run.smithi087.stdout: "warning" 2024-05-08T05:33:47.031 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-05-08T05:33:47.031 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:47.031 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:47.031 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:47.031 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:47.032 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:47.032 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_file": { 2024-05-08T05:33:47.032 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_file", 2024-05-08T05:33:47.032 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-08T05:33:47.032 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:47.032 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:47.032 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-05-08T05:33:47.032 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:47.032 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:47.032 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:47.032 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:47.032 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:47.033 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:47.033 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:47.033 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:47.033 INFO:teuthology.orchestra.run.smithi087.stdout: "min_score": { 2024-05-08T05:33:47.033 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "min_score", 2024-05-08T05:33:47.033 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "float", 2024-05-08T05:33:47.033 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:47.033 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:47.033 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "0", 2024-05-08T05:33:47.033 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:47.033 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:47.033 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:47.033 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "minimum score, below which no optimization is attempted", 2024-05-08T05:33:47.034 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:47.034 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:47.034 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:47.034 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:47.034 INFO:teuthology.orchestra.run.smithi087.stdout: "mode": { 2024-05-08T05:33:47.034 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "mode", 2024-05-08T05:33:47.034 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-08T05:33:47.034 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:47.034 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:47.034 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "upmap", 2024-05-08T05:33:47.034 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:47.034 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:47.034 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [ 2024-05-08T05:33:47.035 INFO:teuthology.orchestra.run.smithi087.stdout: "crush-compat", 2024-05-08T05:33:47.035 INFO:teuthology.orchestra.run.smithi087.stdout: "none", 2024-05-08T05:33:47.035 INFO:teuthology.orchestra.run.smithi087.stdout: "read", 2024-05-08T05:33:47.035 INFO:teuthology.orchestra.run.smithi087.stdout: "upmap", 2024-05-08T05:33:47.035 INFO:teuthology.orchestra.run.smithi087.stdout: "upmap-read" 2024-05-08T05:33:47.035 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-05-08T05:33:47.035 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "Balancer mode", 2024-05-08T05:33:47.035 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:47.035 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:47.035 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:47.035 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:47.035 INFO:teuthology.orchestra.run.smithi087.stdout: "pool_ids": { 2024-05-08T05:33:47.036 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "pool_ids", 2024-05-08T05:33:47.036 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-08T05:33:47.036 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:47.036 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:47.036 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-05-08T05:33:47.036 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:47.036 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:47.036 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:47.036 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "pools which the automatic balancing will be limited to", 2024-05-08T05:33:47.036 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:47.036 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:47.036 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:47.036 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:47.037 INFO:teuthology.orchestra.run.smithi087.stdout: "sleep_interval": { 2024-05-08T05:33:47.037 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "sleep_interval", 2024-05-08T05:33:47.037 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "secs", 2024-05-08T05:33:47.037 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:47.037 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:47.037 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "60", 2024-05-08T05:33:47.037 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:47.037 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:47.037 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:47.037 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "how frequently to wake up and attempt optimization", 2024-05-08T05:33:47.037 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:47.037 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:47.037 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:47.038 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:47.038 INFO:teuthology.orchestra.run.smithi087.stdout: "sqlite3_killpoint": { 2024-05-08T05:33:47.038 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "sqlite3_killpoint", 2024-05-08T05:33:47.038 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "int", 2024-05-08T05:33:47.038 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "dev", 2024-05-08T05:33:47.038 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:47.038 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "0", 2024-05-08T05:33:47.038 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:47.038 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:47.038 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:47.038 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:47.038 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:47.039 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:47.039 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:47.039 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:47.039 INFO:teuthology.orchestra.run.smithi087.stdout: "upmap_max_deviation": { 2024-05-08T05:33:47.039 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "upmap_max_deviation", 2024-05-08T05:33:47.039 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "int", 2024-05-08T05:33:47.039 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:47.039 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:47.039 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "5", 2024-05-08T05:33:47.039 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "1", 2024-05-08T05:33:47.039 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:47.039 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:47.039 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "deviation below which no optimization is attempted", 2024-05-08T05:33:47.040 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2024-05-08T05:33:47.040 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:47.040 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:47.040 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:47.040 INFO:teuthology.orchestra.run.smithi087.stdout: "upmap_max_optimizations": { 2024-05-08T05:33:47.040 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "upmap_max_optimizations", 2024-05-08T05:33:47.040 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "uint", 2024-05-08T05:33:47.040 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:47.040 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:47.040 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "10", 2024-05-08T05:33:47.040 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:47.040 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:47.041 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:47.041 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "maximum upmap optimizations to make per attempt", 2024-05-08T05:33:47.041 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:47.041 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:47.041 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:47.041 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-05-08T05:33:47.041 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-05-08T05:33:47.041 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:47.041 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-05-08T05:33:47.041 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "cephadm", 2024-05-08T05:33:47.041 INFO:teuthology.orchestra.run.smithi087.stdout: "can_run": true, 2024-05-08T05:33:47.041 INFO:teuthology.orchestra.run.smithi087.stdout: "error_string": "", 2024-05-08T05:33:47.041 INFO:teuthology.orchestra.run.smithi087.stdout: "module_options": { 2024-05-08T05:33:47.042 INFO:teuthology.orchestra.run.smithi087.stdout: "agent_down_multiplier": { 2024-05-08T05:33:47.042 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "agent_down_multiplier", 2024-05-08T05:33:47.042 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "float", 2024-05-08T05:33:47.042 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:47.042 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-08T05:33:47.042 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "3.0", 2024-05-08T05:33:47.042 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:47.042 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:47.042 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:47.042 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2024-05-08T05:33:47.042 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:47.042 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:47.043 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:47.043 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:47.043 INFO:teuthology.orchestra.run.smithi087.stdout: "agent_refresh_rate": { 2024-05-08T05:33:47.043 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "agent_refresh_rate", 2024-05-08T05:33:47.043 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "secs", 2024-05-08T05:33:47.043 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:47.043 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-08T05:33:47.043 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "20", 2024-05-08T05:33:47.043 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:47.043 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:47.043 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:47.043 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2024-05-08T05:33:47.043 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:47.044 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:47.044 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:47.044 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:47.044 INFO:teuthology.orchestra.run.smithi087.stdout: "agent_starting_port": { 2024-05-08T05:33:47.044 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "agent_starting_port", 2024-05-08T05:33:47.044 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "int", 2024-05-08T05:33:47.044 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:47.044 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-08T05:33:47.044 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "4721", 2024-05-08T05:33:47.044 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:47.044 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:47.044 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:47.045 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2024-05-08T05:33:47.045 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:47.045 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:47.045 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:47.045 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:47.045 INFO:teuthology.orchestra.run.smithi087.stdout: "allow_ptrace": { 2024-05-08T05:33:47.045 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "allow_ptrace", 2024-05-08T05:33:47.045 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-08T05:33:47.045 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:47.045 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-08T05:33:47.045 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-05-08T05:33:47.045 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:47.046 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:47.046 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:47.046 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2024-05-08T05:33:47.046 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2024-05-08T05:33:47.046 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:47.046 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:47.046 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:47.046 INFO:teuthology.orchestra.run.smithi087.stdout: "autotune_interval": { 2024-05-08T05:33:47.046 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "autotune_interval", 2024-05-08T05:33:47.046 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "secs", 2024-05-08T05:33:47.046 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:47.046 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-08T05:33:47.047 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "600", 2024-05-08T05:33:47.047 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:47.047 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:47.047 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:47.047 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "how frequently to autotune daemon memory", 2024-05-08T05:33:47.047 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:47.047 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:47.047 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:47.047 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:47.047 INFO:teuthology.orchestra.run.smithi087.stdout: "autotune_memory_target_ratio": { 2024-05-08T05:33:47.047 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "autotune_memory_target_ratio", 2024-05-08T05:33:47.047 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "float", 2024-05-08T05:33:47.048 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:47.048 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-08T05:33:47.048 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "0.7", 2024-05-08T05:33:47.048 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:47.048 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:47.048 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:47.048 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2024-05-08T05:33:47.048 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:47.048 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:47.048 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:47.048 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:47.048 INFO:teuthology.orchestra.run.smithi087.stdout: "cephadm_log_destination": { 2024-05-08T05:33:47.048 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "cephadm_log_destination", 2024-05-08T05:33:47.049 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-08T05:33:47.049 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:47.049 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-08T05:33:47.049 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-05-08T05:33:47.049 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:47.049 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:47.049 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [ 2024-05-08T05:33:47.049 INFO:teuthology.orchestra.run.smithi087.stdout: "file", 2024-05-08T05:33:47.049 INFO:teuthology.orchestra.run.smithi087.stdout: "file,syslog", 2024-05-08T05:33:47.049 INFO:teuthology.orchestra.run.smithi087.stdout: "syslog" 2024-05-08T05:33:47.049 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-05-08T05:33:47.049 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "Destination for cephadm command's persistent logging", 2024-05-08T05:33:47.049 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:47.050 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:47.050 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:47.050 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:47.050 INFO:teuthology.orchestra.run.smithi087.stdout: "cgroups_split": { 2024-05-08T05:33:47.050 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "cgroups_split", 2024-05-08T05:33:47.050 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-08T05:33:47.050 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:47.050 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-08T05:33:47.050 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "True", 2024-05-08T05:33:47.050 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:47.050 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:47.051 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:47.051 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2024-05-08T05:33:47.051 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:47.051 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:47.051 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:47.051 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:47.051 INFO:teuthology.orchestra.run.smithi087.stdout: "config_checks_enabled": { 2024-05-08T05:33:47.051 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "config_checks_enabled", 2024-05-08T05:33:47.051 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-08T05:33:47.051 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:47.051 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-08T05:33:47.051 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-05-08T05:33:47.052 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:47.052 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:47.052 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:47.052 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2024-05-08T05:33:47.052 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:47.052 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:47.052 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:47.052 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:47.052 INFO:teuthology.orchestra.run.smithi087.stdout: "config_dashboard": { 2024-05-08T05:33:47.052 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "config_dashboard", 2024-05-08T05:33:47.052 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-08T05:33:47.052 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:47.052 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-08T05:33:47.053 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "True", 2024-05-08T05:33:47.053 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:47.053 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:47.053 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:47.053 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2024-05-08T05:33:47.053 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:47.053 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:47.053 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:47.053 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:47.053 INFO:teuthology.orchestra.run.smithi087.stdout: "container_image_alertmanager": { 2024-05-08T05:33:47.053 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "container_image_alertmanager", 2024-05-08T05:33:47.053 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-08T05:33:47.054 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:47.054 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-08T05:33:47.054 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.25.0", 2024-05-08T05:33:47.054 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:47.054 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:47.054 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:47.054 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "Prometheus container image", 2024-05-08T05:33:47.054 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:47.054 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:47.054 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:47.054 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:47.055 INFO:teuthology.orchestra.run.smithi087.stdout: "container_image_base": { 2024-05-08T05:33:47.055 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "container_image_base", 2024-05-08T05:33:47.055 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-08T05:33:47.055 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:47.055 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:47.055 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "quay.io/ceph/ceph", 2024-05-08T05:33:47.055 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:47.055 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:47.055 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:47.055 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "Container image name, without the tag", 2024-05-08T05:33:47.055 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:47.055 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:47.056 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:47.056 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:47.056 INFO:teuthology.orchestra.run.smithi087.stdout: "container_image_elasticsearch": { 2024-05-08T05:33:47.056 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "container_image_elasticsearch", 2024-05-08T05:33:47.056 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-08T05:33:47.056 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:47.056 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-08T05:33:47.056 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2024-05-08T05:33:47.056 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:47.056 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:47.056 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:47.056 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "elasticsearch container image", 2024-05-08T05:33:47.057 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:47.057 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:47.057 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:47.057 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:47.057 INFO:teuthology.orchestra.run.smithi087.stdout: "container_image_grafana": { 2024-05-08T05:33:47.057 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "container_image_grafana", 2024-05-08T05:33:47.057 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-08T05:33:47.057 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:47.057 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-08T05:33:47.057 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "quay.io/ceph/grafana:9.4.12", 2024-05-08T05:33:47.057 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:47.057 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:47.057 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:47.058 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "Prometheus container image", 2024-05-08T05:33:47.058 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:47.058 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:47.058 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:47.058 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:47.058 INFO:teuthology.orchestra.run.smithi087.stdout: "container_image_haproxy": { 2024-05-08T05:33:47.058 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "container_image_haproxy", 2024-05-08T05:33:47.058 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-08T05:33:47.058 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:47.058 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-08T05:33:47.058 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2024-05-08T05:33:47.058 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:47.059 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:47.059 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:47.059 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "HAproxy container image", 2024-05-08T05:33:47.059 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:47.059 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:47.059 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:47.059 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:47.059 INFO:teuthology.orchestra.run.smithi087.stdout: "container_image_jaeger_agent": { 2024-05-08T05:33:47.059 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "container_image_jaeger_agent", 2024-05-08T05:33:47.059 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-08T05:33:47.059 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:47.059 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-08T05:33:47.060 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2024-05-08T05:33:47.060 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:47.060 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:47.060 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:47.060 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "Jaeger agent container image", 2024-05-08T05:33:47.060 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:47.060 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:47.060 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:47.060 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:47.060 INFO:teuthology.orchestra.run.smithi087.stdout: "container_image_jaeger_collector": { 2024-05-08T05:33:47.060 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "container_image_jaeger_collector", 2024-05-08T05:33:47.060 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-08T05:33:47.060 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:47.060 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-08T05:33:47.061 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2024-05-08T05:33:47.061 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:47.061 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:47.061 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:47.061 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "Jaeger collector container image", 2024-05-08T05:33:47.061 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:47.061 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:47.061 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:47.061 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:47.061 INFO:teuthology.orchestra.run.smithi087.stdout: "container_image_jaeger_query": { 2024-05-08T05:33:47.061 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "container_image_jaeger_query", 2024-05-08T05:33:47.062 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-08T05:33:47.062 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:47.062 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-08T05:33:47.062 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2024-05-08T05:33:47.062 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:47.062 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:47.062 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:47.062 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "Jaeger query container image", 2024-05-08T05:33:47.062 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:47.062 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:47.062 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:47.062 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:47.063 INFO:teuthology.orchestra.run.smithi087.stdout: "container_image_keepalived": { 2024-05-08T05:33:47.063 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "container_image_keepalived", 2024-05-08T05:33:47.063 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-08T05:33:47.063 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:47.063 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-08T05:33:47.063 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2024-05-08T05:33:47.063 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:47.063 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:47.063 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:47.063 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "Keepalived container image", 2024-05-08T05:33:47.063 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:47.063 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:47.064 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:47.064 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:47.064 INFO:teuthology.orchestra.run.smithi087.stdout: "container_image_loki": { 2024-05-08T05:33:47.064 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "container_image_loki", 2024-05-08T05:33:47.064 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-08T05:33:47.064 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:47.064 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-08T05:33:47.064 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "docker.io/grafana/loki:2.4.0", 2024-05-08T05:33:47.064 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:47.064 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:47.064 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:47.064 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "Loki container image", 2024-05-08T05:33:47.064 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:47.065 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:47.065 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:47.065 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:47.065 INFO:teuthology.orchestra.run.smithi087.stdout: "container_image_node_exporter": { 2024-05-08T05:33:47.065 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "container_image_node_exporter", 2024-05-08T05:33:47.065 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-08T05:33:47.065 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:47.065 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-08T05:33:47.065 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.5.0", 2024-05-08T05:33:47.065 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:47.065 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:47.065 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:47.065 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "Prometheus container image", 2024-05-08T05:33:47.066 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:47.066 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:47.066 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:47.066 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:47.066 INFO:teuthology.orchestra.run.smithi087.stdout: "container_image_nvmeof": { 2024-05-08T05:33:47.066 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "container_image_nvmeof", 2024-05-08T05:33:47.066 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-08T05:33:47.066 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:47.066 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-08T05:33:47.066 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "quay.io/ceph/nvmeof:1.2.1", 2024-05-08T05:33:47.066 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:47.066 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:47.067 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:47.067 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "Nvme-of container image", 2024-05-08T05:33:47.067 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:47.067 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:47.067 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:47.067 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:47.067 INFO:teuthology.orchestra.run.smithi087.stdout: "container_image_prometheus": { 2024-05-08T05:33:47.067 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "container_image_prometheus", 2024-05-08T05:33:47.067 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-08T05:33:47.067 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:47.067 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-08T05:33:47.067 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "quay.io/prometheus/prometheus:v2.43.0", 2024-05-08T05:33:47.067 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:47.068 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:47.068 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:47.068 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "Prometheus container image", 2024-05-08T05:33:47.068 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:47.068 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:47.068 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:47.068 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:47.068 INFO:teuthology.orchestra.run.smithi087.stdout: "container_image_promtail": { 2024-05-08T05:33:47.068 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "container_image_promtail", 2024-05-08T05:33:47.068 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-08T05:33:47.068 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:47.068 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-08T05:33:47.069 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "docker.io/grafana/promtail:2.4.0", 2024-05-08T05:33:47.069 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:47.069 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:47.069 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:47.069 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "Promtail container image", 2024-05-08T05:33:47.069 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:47.069 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:47.069 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:47.069 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:47.069 INFO:teuthology.orchestra.run.smithi087.stdout: "container_image_samba": { 2024-05-08T05:33:47.069 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "container_image_samba", 2024-05-08T05:33:47.069 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-08T05:33:47.069 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:47.070 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-08T05:33:47.070 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "quay.io/samba.org/samba-server:devbuilds-centos-amd64", 2024-05-08T05:33:47.070 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:47.070 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:47.070 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:47.070 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "Samba/SMB container image", 2024-05-08T05:33:47.070 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:47.070 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:47.070 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:47.070 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:47.070 INFO:teuthology.orchestra.run.smithi087.stdout: "container_image_snmp_gateway": { 2024-05-08T05:33:47.070 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "container_image_snmp_gateway", 2024-05-08T05:33:47.071 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-08T05:33:47.071 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:47.071 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-08T05:33:47.071 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2024-05-08T05:33:47.071 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:47.071 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:47.071 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:47.071 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "SNMP Gateway container image", 2024-05-08T05:33:47.071 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:47.071 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:47.071 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:47.071 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:47.071 INFO:teuthology.orchestra.run.smithi087.stdout: "container_init": { 2024-05-08T05:33:47.072 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "container_init", 2024-05-08T05:33:47.072 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-08T05:33:47.072 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:47.072 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-08T05:33:47.072 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "True", 2024-05-08T05:33:47.072 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:47.072 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:47.072 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:47.072 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "Run podman/docker with `--init`", 2024-05-08T05:33:47.072 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:47.072 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:47.072 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:47.072 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:47.072 INFO:teuthology.orchestra.run.smithi087.stdout: "daemon_cache_timeout": { 2024-05-08T05:33:47.073 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "daemon_cache_timeout", 2024-05-08T05:33:47.073 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "secs", 2024-05-08T05:33:47.073 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:47.073 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-08T05:33:47.073 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "600", 2024-05-08T05:33:47.073 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:47.073 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:47.073 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:47.073 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "seconds to cache service (daemon) inventory", 2024-05-08T05:33:47.073 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:47.073 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:47.073 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:47.073 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:47.073 INFO:teuthology.orchestra.run.smithi087.stdout: "default_cephadm_command_timeout": { 2024-05-08T05:33:47.074 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "default_cephadm_command_timeout", 2024-05-08T05:33:47.074 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "int", 2024-05-08T05:33:47.074 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:47.074 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-08T05:33:47.074 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "900", 2024-05-08T05:33:47.074 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:47.074 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:47.074 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:47.074 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2024-05-08T05:33:47.074 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:47.074 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:47.074 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:47.075 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:47.075 INFO:teuthology.orchestra.run.smithi087.stdout: "default_registry": { 2024-05-08T05:33:47.075 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "default_registry", 2024-05-08T05:33:47.075 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-08T05:33:47.075 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:47.075 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-08T05:33:47.075 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "docker.io", 2024-05-08T05:33:47.075 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:47.075 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:47.075 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:47.075 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2024-05-08T05:33:47.075 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:47.075 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:47.076 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:47.076 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:47.076 INFO:teuthology.orchestra.run.smithi087.stdout: "device_cache_timeout": { 2024-05-08T05:33:47.076 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "device_cache_timeout", 2024-05-08T05:33:47.076 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "secs", 2024-05-08T05:33:47.076 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:47.076 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-08T05:33:47.076 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "1800", 2024-05-08T05:33:47.076 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:47.076 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:47.076 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:47.076 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "seconds to cache device inventory", 2024-05-08T05:33:47.076 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:47.077 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:47.077 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:47.077 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:47.077 INFO:teuthology.orchestra.run.smithi087.stdout: "device_enhanced_scan": { 2024-05-08T05:33:47.077 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "device_enhanced_scan", 2024-05-08T05:33:47.077 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-08T05:33:47.077 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:47.077 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-08T05:33:47.077 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-05-08T05:33:47.077 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:47.077 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:47.078 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:47.078 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "Use libstoragemgmt during device scans", 2024-05-08T05:33:47.078 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:47.078 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:47.078 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:47.078 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:47.078 INFO:teuthology.orchestra.run.smithi087.stdout: "facts_cache_timeout": { 2024-05-08T05:33:47.078 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "facts_cache_timeout", 2024-05-08T05:33:47.078 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "secs", 2024-05-08T05:33:47.078 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:47.078 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-08T05:33:47.078 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "60", 2024-05-08T05:33:47.079 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:47.079 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:47.079 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:47.079 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "seconds to cache host facts data", 2024-05-08T05:33:47.079 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:47.079 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:47.079 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:47.079 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:47.079 INFO:teuthology.orchestra.run.smithi087.stdout: "grafana_dashboards_path": { 2024-05-08T05:33:47.079 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "grafana_dashboards_path", 2024-05-08T05:33:47.079 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-08T05:33:47.080 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:47.080 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-08T05:33:47.080 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "/etc/grafana/dashboards/ceph-dashboard/", 2024-05-08T05:33:47.080 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:47.080 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:47.080 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:47.080 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "location of dashboards to include in grafana deployments", 2024-05-08T05:33:47.080 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:47.080 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:47.080 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:47.080 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:47.081 INFO:teuthology.orchestra.run.smithi087.stdout: "host_check_interval": { 2024-05-08T05:33:47.081 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "host_check_interval", 2024-05-08T05:33:47.081 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "secs", 2024-05-08T05:33:47.081 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:47.081 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-08T05:33:47.081 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "600", 2024-05-08T05:33:47.081 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:47.081 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:47.081 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:47.081 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "how frequently to perform a host check", 2024-05-08T05:33:47.081 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:47.082 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:47.082 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:47.082 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:47.082 INFO:teuthology.orchestra.run.smithi087.stdout: "hw_monitoring": { 2024-05-08T05:33:47.082 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "hw_monitoring", 2024-05-08T05:33:47.082 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-08T05:33:47.082 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:47.082 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-08T05:33:47.082 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-05-08T05:33:47.082 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:47.082 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:47.082 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:47.083 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "Deploy hw monitoring daemon on every host.", 2024-05-08T05:33:47.083 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:47.083 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:47.083 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:47.083 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:47.083 INFO:teuthology.orchestra.run.smithi087.stdout: "inventory_list_all": { 2024-05-08T05:33:47.083 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "inventory_list_all", 2024-05-08T05:33:47.083 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-08T05:33:47.083 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:47.083 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-08T05:33:47.083 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-05-08T05:33:47.084 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:47.084 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:47.084 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:47.084 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2024-05-08T05:33:47.084 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:47.084 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:47.084 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:47.084 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:47.084 INFO:teuthology.orchestra.run.smithi087.stdout: "log_level": { 2024-05-08T05:33:47.084 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_level", 2024-05-08T05:33:47.084 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-08T05:33:47.084 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:47.084 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:47.085 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-05-08T05:33:47.085 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:47.085 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:47.085 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [ 2024-05-08T05:33:47.085 INFO:teuthology.orchestra.run.smithi087.stdout: "", 2024-05-08T05:33:47.085 INFO:teuthology.orchestra.run.smithi087.stdout: "critical", 2024-05-08T05:33:47.085 INFO:teuthology.orchestra.run.smithi087.stdout: "debug", 2024-05-08T05:33:47.085 INFO:teuthology.orchestra.run.smithi087.stdout: "error", 2024-05-08T05:33:47.085 INFO:teuthology.orchestra.run.smithi087.stdout: "info", 2024-05-08T05:33:47.085 INFO:teuthology.orchestra.run.smithi087.stdout: "warning" 2024-05-08T05:33:47.085 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-05-08T05:33:47.085 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:47.086 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:47.086 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:47.086 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:47.086 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:47.086 INFO:teuthology.orchestra.run.smithi087.stdout: "log_refresh_metadata": { 2024-05-08T05:33:47.086 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_refresh_metadata", 2024-05-08T05:33:47.086 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-08T05:33:47.086 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:47.086 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-08T05:33:47.086 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-05-08T05:33:47.086 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:47.087 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:47.087 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:47.087 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2024-05-08T05:33:47.087 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:47.087 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:47.087 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:47.087 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:47.087 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_cluster": { 2024-05-08T05:33:47.087 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_cluster", 2024-05-08T05:33:47.087 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-08T05:33:47.087 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:47.087 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-08T05:33:47.087 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "True", 2024-05-08T05:33:47.088 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:47.088 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:47.088 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:47.088 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2024-05-08T05:33:47.088 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:47.088 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:47.088 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:47.088 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:47.088 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_cluster_level": { 2024-05-08T05:33:47.088 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_cluster_level", 2024-05-08T05:33:47.088 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-08T05:33:47.088 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:47.089 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:47.089 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "info", 2024-05-08T05:33:47.089 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:47.089 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:47.089 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [ 2024-05-08T05:33:47.089 INFO:teuthology.orchestra.run.smithi087.stdout: "", 2024-05-08T05:33:47.089 INFO:teuthology.orchestra.run.smithi087.stdout: "critical", 2024-05-08T05:33:47.089 INFO:teuthology.orchestra.run.smithi087.stdout: "debug", 2024-05-08T05:33:47.089 INFO:teuthology.orchestra.run.smithi087.stdout: "error", 2024-05-08T05:33:47.089 INFO:teuthology.orchestra.run.smithi087.stdout: "info", 2024-05-08T05:33:47.089 INFO:teuthology.orchestra.run.smithi087.stdout: "warning" 2024-05-08T05:33:47.089 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-05-08T05:33:47.089 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:47.090 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:47.090 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:47.090 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:47.090 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:47.090 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_file": { 2024-05-08T05:33:47.090 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_file", 2024-05-08T05:33:47.090 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-08T05:33:47.090 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:47.090 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:47.090 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-05-08T05:33:47.090 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:47.090 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:47.091 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:47.091 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:47.091 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:47.091 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:47.091 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:47.091 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:47.091 INFO:teuthology.orchestra.run.smithi087.stdout: "manage_etc_ceph_ceph_conf": { 2024-05-08T05:33:47.091 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "manage_etc_ceph_ceph_conf", 2024-05-08T05:33:47.091 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-08T05:33:47.091 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:47.091 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-08T05:33:47.091 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-05-08T05:33:47.092 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:47.092 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:47.092 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:47.092 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2024-05-08T05:33:47.092 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:47.092 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:47.092 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:47.092 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:47.092 INFO:teuthology.orchestra.run.smithi087.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2024-05-08T05:33:47.092 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2024-05-08T05:33:47.092 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-08T05:33:47.092 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:47.093 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-08T05:33:47.093 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "*", 2024-05-08T05:33:47.093 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:47.093 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:47.093 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:47.093 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2024-05-08T05:33:47.093 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:47.093 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:47.093 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:47.093 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:47.093 INFO:teuthology.orchestra.run.smithi087.stdout: "max_count_per_host": { 2024-05-08T05:33:47.093 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "max_count_per_host", 2024-05-08T05:33:47.094 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "int", 2024-05-08T05:33:47.094 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:47.094 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-08T05:33:47.094 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "10", 2024-05-08T05:33:47.094 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:47.094 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:47.094 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:47.094 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "max number of daemons per service per host", 2024-05-08T05:33:47.094 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:47.094 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:47.094 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:47.094 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:47.095 INFO:teuthology.orchestra.run.smithi087.stdout: "max_osd_draining_count": { 2024-05-08T05:33:47.095 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "max_osd_draining_count", 2024-05-08T05:33:47.095 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "int", 2024-05-08T05:33:47.095 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:47.095 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-08T05:33:47.095 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "10", 2024-05-08T05:33:47.095 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:47.095 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:47.095 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:47.096 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2024-05-08T05:33:47.096 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:47.096 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:47.096 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:47.096 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:47.096 INFO:teuthology.orchestra.run.smithi087.stdout: "migration_current": { 2024-05-08T05:33:47.096 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "migration_current", 2024-05-08T05:33:47.096 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "int", 2024-05-08T05:33:47.096 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:47.096 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-08T05:33:47.096 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-05-08T05:33:47.096 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:47.097 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:47.097 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:47.097 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "internal - do not modify", 2024-05-08T05:33:47.097 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:47.097 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:47.097 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:47.097 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:47.097 INFO:teuthology.orchestra.run.smithi087.stdout: "mode": { 2024-05-08T05:33:47.097 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "mode", 2024-05-08T05:33:47.097 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-08T05:33:47.097 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:47.097 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-08T05:33:47.097 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "root", 2024-05-08T05:33:47.098 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:47.098 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:47.098 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [ 2024-05-08T05:33:47.098 INFO:teuthology.orchestra.run.smithi087.stdout: "cephadm-package", 2024-05-08T05:33:47.098 INFO:teuthology.orchestra.run.smithi087.stdout: "root" 2024-05-08T05:33:47.098 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-05-08T05:33:47.098 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "mode for remote execution of cephadm", 2024-05-08T05:33:47.098 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:47.098 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:47.098 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:47.098 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:47.099 INFO:teuthology.orchestra.run.smithi087.stdout: "oob_default_addr": { 2024-05-08T05:33:47.099 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "oob_default_addr", 2024-05-08T05:33:47.099 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-08T05:33:47.099 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:47.099 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-08T05:33:47.099 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "169.254.1.1", 2024-05-08T05:33:47.099 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:47.099 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:47.099 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:47.099 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "Default address for RedFish API (oob management).", 2024-05-08T05:33:47.099 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:47.099 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:47.100 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:47.100 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:47.100 INFO:teuthology.orchestra.run.smithi087.stdout: "prometheus_alerts_path": { 2024-05-08T05:33:47.100 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "prometheus_alerts_path", 2024-05-08T05:33:47.100 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-08T05:33:47.100 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:47.100 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-08T05:33:47.100 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2024-05-08T05:33:47.100 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:47.100 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:47.100 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:47.101 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "location of alerts to include in prometheus deployments", 2024-05-08T05:33:47.101 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:47.101 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:47.101 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:47.101 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:47.101 INFO:teuthology.orchestra.run.smithi087.stdout: "registry_insecure": { 2024-05-08T05:33:47.101 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "registry_insecure", 2024-05-08T05:33:47.101 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-08T05:33:47.101 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:47.101 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-08T05:33:47.101 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-05-08T05:33:47.101 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:47.102 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:47.102 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:47.102 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2024-05-08T05:33:47.102 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:47.102 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:47.102 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:47.102 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:47.102 INFO:teuthology.orchestra.run.smithi087.stdout: "registry_password": { 2024-05-08T05:33:47.102 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "registry_password", 2024-05-08T05:33:47.102 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-08T05:33:47.102 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:47.103 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-08T05:33:47.103 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-05-08T05:33:47.103 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:47.103 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:47.103 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:47.103 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2024-05-08T05:33:47.103 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:47.103 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:47.103 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:47.103 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:47.103 INFO:teuthology.orchestra.run.smithi087.stdout: "registry_url": { 2024-05-08T05:33:47.103 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "registry_url", 2024-05-08T05:33:47.103 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-08T05:33:47.104 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:47.104 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-08T05:33:47.104 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-05-08T05:33:47.104 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:47.104 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:47.104 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:47.104 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2024-05-08T05:33:47.104 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:47.104 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:47.104 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:47.104 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:47.104 INFO:teuthology.orchestra.run.smithi087.stdout: "registry_username": { 2024-05-08T05:33:47.105 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "registry_username", 2024-05-08T05:33:47.105 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-08T05:33:47.105 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:47.105 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-08T05:33:47.105 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-05-08T05:33:47.105 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:47.105 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:47.105 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:47.105 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2024-05-08T05:33:47.105 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:47.105 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:47.106 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:47.106 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:47.106 INFO:teuthology.orchestra.run.smithi087.stdout: "secure_monitoring_stack": { 2024-05-08T05:33:47.106 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "secure_monitoring_stack", 2024-05-08T05:33:47.106 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-08T05:33:47.106 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:47.106 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-08T05:33:47.106 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-05-08T05:33:47.106 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:47.106 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:47.106 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:47.106 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2024-05-08T05:33:47.107 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:47.107 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:47.107 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:47.107 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:47.107 INFO:teuthology.orchestra.run.smithi087.stdout: "service_discovery_port": { 2024-05-08T05:33:47.107 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "service_discovery_port", 2024-05-08T05:33:47.107 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "int", 2024-05-08T05:33:47.107 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:47.107 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-08T05:33:47.107 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "8765", 2024-05-08T05:33:47.107 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:47.107 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:47.107 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:47.108 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "cephadm service discovery port", 2024-05-08T05:33:47.108 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:47.108 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:47.108 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:47.108 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:47.108 INFO:teuthology.orchestra.run.smithi087.stdout: "sqlite3_killpoint": { 2024-05-08T05:33:47.108 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "sqlite3_killpoint", 2024-05-08T05:33:47.108 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "int", 2024-05-08T05:33:47.108 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "dev", 2024-05-08T05:33:47.108 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:47.108 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "0", 2024-05-08T05:33:47.108 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:47.108 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:47.109 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:47.109 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:47.109 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:47.109 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:47.109 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:47.109 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:47.109 INFO:teuthology.orchestra.run.smithi087.stdout: "ssh_config_file": { 2024-05-08T05:33:47.109 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "ssh_config_file", 2024-05-08T05:33:47.109 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-08T05:33:47.109 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:47.109 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-08T05:33:47.109 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-05-08T05:33:47.109 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:47.110 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:47.110 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:47.110 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "customized SSH config file to connect to managed hosts", 2024-05-08T05:33:47.110 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:47.110 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:47.110 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:47.110 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:47.110 INFO:teuthology.orchestra.run.smithi087.stdout: "use_agent": { 2024-05-08T05:33:47.110 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "use_agent", 2024-05-08T05:33:47.110 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-08T05:33:47.110 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:47.110 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-08T05:33:47.111 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-05-08T05:33:47.111 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:47.111 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:47.111 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:47.111 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2024-05-08T05:33:47.111 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:47.111 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:47.111 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:47.111 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:47.111 INFO:teuthology.orchestra.run.smithi087.stdout: "use_repo_digest": { 2024-05-08T05:33:47.111 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "use_repo_digest", 2024-05-08T05:33:47.111 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-08T05:33:47.111 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:47.112 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-08T05:33:47.112 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "True", 2024-05-08T05:33:47.112 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:47.112 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:47.112 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:47.112 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2024-05-08T05:33:47.112 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:47.112 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:47.112 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:47.112 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:47.112 INFO:teuthology.orchestra.run.smithi087.stdout: "warn_on_failed_host_check": { 2024-05-08T05:33:47.112 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "warn_on_failed_host_check", 2024-05-08T05:33:47.113 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-08T05:33:47.113 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:47.113 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-08T05:33:47.113 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "True", 2024-05-08T05:33:47.113 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:47.113 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:47.113 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:47.113 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "raise a health warning if the host check fails", 2024-05-08T05:33:47.113 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:47.113 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:47.113 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:47.113 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:47.113 INFO:teuthology.orchestra.run.smithi087.stdout: "warn_on_stray_daemons": { 2024-05-08T05:33:47.114 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "warn_on_stray_daemons", 2024-05-08T05:33:47.114 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-08T05:33:47.114 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:47.114 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-08T05:33:47.114 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "True", 2024-05-08T05:33:47.114 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:47.114 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:47.114 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:47.114 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2024-05-08T05:33:47.114 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:47.114 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:47.115 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:47.115 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:47.115 INFO:teuthology.orchestra.run.smithi087.stdout: "warn_on_stray_hosts": { 2024-05-08T05:33:47.115 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "warn_on_stray_hosts", 2024-05-08T05:33:47.115 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-08T05:33:47.115 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:47.115 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-08T05:33:47.115 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "True", 2024-05-08T05:33:47.115 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:47.115 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:47.115 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:47.115 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2024-05-08T05:33:47.115 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:47.116 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:47.116 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:47.116 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-05-08T05:33:47.116 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-05-08T05:33:47.116 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:47.116 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-05-08T05:33:47.116 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "crash", 2024-05-08T05:33:47.116 INFO:teuthology.orchestra.run.smithi087.stdout: "can_run": true, 2024-05-08T05:33:47.116 INFO:teuthology.orchestra.run.smithi087.stdout: "error_string": "", 2024-05-08T05:33:47.116 INFO:teuthology.orchestra.run.smithi087.stdout: "module_options": { 2024-05-08T05:33:47.116 INFO:teuthology.orchestra.run.smithi087.stdout: "log_level": { 2024-05-08T05:33:47.116 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_level", 2024-05-08T05:33:47.117 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-08T05:33:47.117 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:47.117 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:47.117 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-05-08T05:33:47.117 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:47.117 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:47.117 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [ 2024-05-08T05:33:47.117 INFO:teuthology.orchestra.run.smithi087.stdout: "", 2024-05-08T05:33:47.117 INFO:teuthology.orchestra.run.smithi087.stdout: "critical", 2024-05-08T05:33:47.117 INFO:teuthology.orchestra.run.smithi087.stdout: "debug", 2024-05-08T05:33:47.117 INFO:teuthology.orchestra.run.smithi087.stdout: "error", 2024-05-08T05:33:47.117 INFO:teuthology.orchestra.run.smithi087.stdout: "info", 2024-05-08T05:33:47.118 INFO:teuthology.orchestra.run.smithi087.stdout: "warning" 2024-05-08T05:33:47.118 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-05-08T05:33:47.118 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:47.118 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:47.118 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:47.118 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:47.118 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:47.118 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_cluster": { 2024-05-08T05:33:47.118 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_cluster", 2024-05-08T05:33:47.118 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-08T05:33:47.118 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:47.118 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:47.119 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-05-08T05:33:47.119 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:47.119 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:47.119 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:47.119 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:47.119 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:47.119 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:47.119 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:47.119 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:47.119 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_cluster_level": { 2024-05-08T05:33:47.119 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_cluster_level", 2024-05-08T05:33:47.119 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-08T05:33:47.119 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:47.120 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:47.120 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "info", 2024-05-08T05:33:47.120 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:47.120 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:47.120 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [ 2024-05-08T05:33:47.120 INFO:teuthology.orchestra.run.smithi087.stdout: "", 2024-05-08T05:33:47.120 INFO:teuthology.orchestra.run.smithi087.stdout: "critical", 2024-05-08T05:33:47.120 INFO:teuthology.orchestra.run.smithi087.stdout: "debug", 2024-05-08T05:33:47.120 INFO:teuthology.orchestra.run.smithi087.stdout: "error", 2024-05-08T05:33:47.120 INFO:teuthology.orchestra.run.smithi087.stdout: "info", 2024-05-08T05:33:47.120 INFO:teuthology.orchestra.run.smithi087.stdout: "warning" 2024-05-08T05:33:47.120 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-05-08T05:33:47.120 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:47.121 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:47.121 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:47.121 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:47.121 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:47.121 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_file": { 2024-05-08T05:33:47.121 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_file", 2024-05-08T05:33:47.121 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-08T05:33:47.121 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:47.121 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:47.121 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-05-08T05:33:47.121 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:47.121 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:47.121 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:47.121 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:47.121 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:47.122 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:47.122 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:47.122 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:47.122 INFO:teuthology.orchestra.run.smithi087.stdout: "retain_interval": { 2024-05-08T05:33:47.122 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "retain_interval", 2024-05-08T05:33:47.122 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "secs", 2024-05-08T05:33:47.122 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:47.122 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:47.122 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "31536000", 2024-05-08T05:33:47.122 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:47.122 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:47.122 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:47.123 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "how long to retain crashes before pruning them", 2024-05-08T05:33:47.123 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:47.123 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:47.123 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:47.123 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:47.123 INFO:teuthology.orchestra.run.smithi087.stdout: "sqlite3_killpoint": { 2024-05-08T05:33:47.123 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "sqlite3_killpoint", 2024-05-08T05:33:47.123 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "int", 2024-05-08T05:33:47.123 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "dev", 2024-05-08T05:33:47.123 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:47.123 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "0", 2024-05-08T05:33:47.124 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:47.124 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:47.124 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:47.124 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:47.124 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:47.124 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:47.124 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:47.124 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:47.124 INFO:teuthology.orchestra.run.smithi087.stdout: "warn_recent_interval": { 2024-05-08T05:33:47.124 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "warn_recent_interval", 2024-05-08T05:33:47.124 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "secs", 2024-05-08T05:33:47.124 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:47.124 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:47.125 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "1209600", 2024-05-08T05:33:47.125 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:47.125 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:47.125 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:47.125 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "time interval in which to warn about recent crashes", 2024-05-08T05:33:47.125 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:47.125 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:47.125 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:47.125 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-05-08T05:33:47.125 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-05-08T05:33:47.125 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:47.125 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-05-08T05:33:47.126 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "dashboard", 2024-05-08T05:33:47.126 INFO:teuthology.orchestra.run.smithi087.stdout: "can_run": true, 2024-05-08T05:33:47.126 INFO:teuthology.orchestra.run.smithi087.stdout: "error_string": "", 2024-05-08T05:33:47.126 INFO:teuthology.orchestra.run.smithi087.stdout: "module_options": { 2024-05-08T05:33:47.126 INFO:teuthology.orchestra.run.smithi087.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2024-05-08T05:33:47.126 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2024-05-08T05:33:47.126 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "int", 2024-05-08T05:33:47.126 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:47.126 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-08T05:33:47.126 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "10", 2024-05-08T05:33:47.126 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:47.126 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:47.127 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:47.127 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:47.127 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:47.127 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:47.127 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:47.127 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:47.127 INFO:teuthology.orchestra.run.smithi087.stdout: "ALERTMANAGER_API_HOST": { 2024-05-08T05:33:47.127 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "ALERTMANAGER_API_HOST", 2024-05-08T05:33:47.127 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-08T05:33:47.127 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:47.127 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-08T05:33:47.127 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-05-08T05:33:47.128 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:47.128 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:47.128 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:47.128 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:47.128 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:47.128 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:47.128 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:47.128 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:47.128 INFO:teuthology.orchestra.run.smithi087.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2024-05-08T05:33:47.128 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2024-05-08T05:33:47.128 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-08T05:33:47.128 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:47.128 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-08T05:33:47.128 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "True", 2024-05-08T05:33:47.129 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:47.129 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:47.129 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:47.129 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:47.129 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:47.129 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:47.129 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:47.129 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:47.129 INFO:teuthology.orchestra.run.smithi087.stdout: "AUDIT_API_ENABLED": { 2024-05-08T05:33:47.129 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "AUDIT_API_ENABLED", 2024-05-08T05:33:47.129 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-08T05:33:47.130 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:47.130 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-08T05:33:47.130 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-05-08T05:33:47.130 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:47.130 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:47.130 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:47.130 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:47.130 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:47.130 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:47.130 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:47.130 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:47.130 INFO:teuthology.orchestra.run.smithi087.stdout: "AUDIT_API_LOG_PAYLOAD": { 2024-05-08T05:33:47.131 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2024-05-08T05:33:47.131 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-08T05:33:47.131 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:47.131 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-08T05:33:47.131 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "True", 2024-05-08T05:33:47.131 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:47.131 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:47.131 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:47.131 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:47.131 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:47.131 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:47.131 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:47.132 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:47.132 INFO:teuthology.orchestra.run.smithi087.stdout: "ENABLE_BROWSABLE_API": { 2024-05-08T05:33:47.132 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "ENABLE_BROWSABLE_API", 2024-05-08T05:33:47.132 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-08T05:33:47.132 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:47.132 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-08T05:33:47.132 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "True", 2024-05-08T05:33:47.132 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:47.132 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:47.132 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:47.132 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:47.133 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:47.133 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:47.133 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:47.133 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:47.133 INFO:teuthology.orchestra.run.smithi087.stdout: "FEATURE_TOGGLE_CEPHFS": { 2024-05-08T05:33:47.133 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2024-05-08T05:33:47.133 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-08T05:33:47.133 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:47.133 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-08T05:33:47.133 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "True", 2024-05-08T05:33:47.133 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:47.133 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:47.133 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:47.134 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:47.134 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:47.134 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:47.134 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:47.134 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:47.134 INFO:teuthology.orchestra.run.smithi087.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2024-05-08T05:33:47.134 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2024-05-08T05:33:47.134 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-08T05:33:47.134 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:47.134 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-08T05:33:47.134 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "True", 2024-05-08T05:33:47.134 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:47.135 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:47.135 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:47.135 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:47.135 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:47.135 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:47.135 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:47.135 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:47.135 INFO:teuthology.orchestra.run.smithi087.stdout: "FEATURE_TOGGLE_ISCSI": { 2024-05-08T05:33:47.135 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2024-05-08T05:33:47.135 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-08T05:33:47.135 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:47.135 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-08T05:33:47.136 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "True", 2024-05-08T05:33:47.136 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:47.136 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:47.136 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:47.136 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:47.136 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:47.136 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:47.136 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:47.136 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:47.136 INFO:teuthology.orchestra.run.smithi087.stdout: "FEATURE_TOGGLE_MIRRORING": { 2024-05-08T05:33:47.136 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2024-05-08T05:33:47.136 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-08T05:33:47.136 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:47.136 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-08T05:33:47.137 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "True", 2024-05-08T05:33:47.137 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:47.137 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:47.137 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:47.137 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:47.137 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:47.137 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:47.137 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:47.137 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:47.137 INFO:teuthology.orchestra.run.smithi087.stdout: "FEATURE_TOGGLE_NFS": { 2024-05-08T05:33:47.137 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "FEATURE_TOGGLE_NFS", 2024-05-08T05:33:47.138 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-08T05:33:47.138 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:47.138 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-08T05:33:47.138 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "True", 2024-05-08T05:33:47.138 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:47.138 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:47.138 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:47.138 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:47.138 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:47.138 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:47.138 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:47.139 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:47.139 INFO:teuthology.orchestra.run.smithi087.stdout: "FEATURE_TOGGLE_RBD": { 2024-05-08T05:33:47.139 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "FEATURE_TOGGLE_RBD", 2024-05-08T05:33:47.139 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-08T05:33:47.139 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:47.139 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-08T05:33:47.139 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "True", 2024-05-08T05:33:47.139 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:47.139 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:47.139 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:47.139 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:47.140 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:47.140 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:47.140 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:47.140 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:47.140 INFO:teuthology.orchestra.run.smithi087.stdout: "FEATURE_TOGGLE_RGW": { 2024-05-08T05:33:47.140 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "FEATURE_TOGGLE_RGW", 2024-05-08T05:33:47.140 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-08T05:33:47.140 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:47.140 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-08T05:33:47.140 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "True", 2024-05-08T05:33:47.140 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:47.140 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:47.141 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:47.141 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:47.141 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:47.141 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:47.141 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:47.141 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:47.141 INFO:teuthology.orchestra.run.smithi087.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2024-05-08T05:33:47.141 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2024-05-08T05:33:47.141 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-08T05:33:47.141 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:47.141 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-08T05:33:47.141 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-05-08T05:33:47.142 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:47.142 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:47.142 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:47.142 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:47.142 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:47.142 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:47.142 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:47.142 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:47.142 INFO:teuthology.orchestra.run.smithi087.stdout: "GRAFANA_API_PASSWORD": { 2024-05-08T05:33:47.142 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "GRAFANA_API_PASSWORD", 2024-05-08T05:33:47.142 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-08T05:33:47.142 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:47.143 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-08T05:33:47.143 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "admin", 2024-05-08T05:33:47.143 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:47.143 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:47.143 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:47.143 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:47.143 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:47.143 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:47.143 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:47.143 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:47.143 INFO:teuthology.orchestra.run.smithi087.stdout: "GRAFANA_API_SSL_VERIFY": { 2024-05-08T05:33:47.143 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2024-05-08T05:33:47.144 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-08T05:33:47.144 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:47.144 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-08T05:33:47.144 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "True", 2024-05-08T05:33:47.144 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:47.144 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:47.144 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:47.144 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:47.144 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:47.144 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:47.144 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:47.144 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:47.145 INFO:teuthology.orchestra.run.smithi087.stdout: "GRAFANA_API_URL": { 2024-05-08T05:33:47.145 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "GRAFANA_API_URL", 2024-05-08T05:33:47.145 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-08T05:33:47.145 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:47.145 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-08T05:33:47.145 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-05-08T05:33:47.145 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:47.145 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:47.145 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:47.145 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:47.145 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:47.145 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:47.146 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:47.146 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:47.146 INFO:teuthology.orchestra.run.smithi087.stdout: "GRAFANA_API_USERNAME": { 2024-05-08T05:33:47.146 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "GRAFANA_API_USERNAME", 2024-05-08T05:33:47.146 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-08T05:33:47.146 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:47.146 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-08T05:33:47.146 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "admin", 2024-05-08T05:33:47.146 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:47.146 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:47.146 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:47.147 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:47.147 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:47.147 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:47.147 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:47.147 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:47.147 INFO:teuthology.orchestra.run.smithi087.stdout: "GRAFANA_FRONTEND_API_URL": { 2024-05-08T05:33:47.147 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2024-05-08T05:33:47.147 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-08T05:33:47.147 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:47.147 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-08T05:33:47.148 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-05-08T05:33:47.148 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:47.148 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:47.148 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:47.148 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:47.148 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:47.149 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:47.149 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:47.149 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:47.149 INFO:teuthology.orchestra.run.smithi087.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2024-05-08T05:33:47.149 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2024-05-08T05:33:47.149 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-08T05:33:47.149 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:47.150 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-08T05:33:47.150 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-05-08T05:33:47.150 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:47.150 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:47.150 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:47.150 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:47.151 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:47.151 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:47.151 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:47.151 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:47.151 INFO:teuthology.orchestra.run.smithi087.stdout: "ISCSI_API_SSL_VERIFICATION": { 2024-05-08T05:33:47.151 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2024-05-08T05:33:47.152 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-08T05:33:47.152 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:47.152 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-08T05:33:47.152 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "True", 2024-05-08T05:33:47.152 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:47.152 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:47.152 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:47.152 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:47.153 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:47.153 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:47.153 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:47.153 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:47.153 INFO:teuthology.orchestra.run.smithi087.stdout: "ISSUE_TRACKER_API_KEY": { 2024-05-08T05:33:47.153 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "ISSUE_TRACKER_API_KEY", 2024-05-08T05:33:47.153 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-08T05:33:47.153 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:47.153 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-08T05:33:47.153 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-05-08T05:33:47.153 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:47.154 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:47.154 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:47.154 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:47.154 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:47.154 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:47.154 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:47.154 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:47.154 INFO:teuthology.orchestra.run.smithi087.stdout: "MANAGED_BY_CLUSTERS": { 2024-05-08T05:33:47.154 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "MANAGED_BY_CLUSTERS", 2024-05-08T05:33:47.154 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-08T05:33:47.154 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:47.154 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-08T05:33:47.155 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "[]", 2024-05-08T05:33:47.155 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:47.155 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:47.155 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:47.155 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:47.155 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:47.155 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:47.155 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:47.155 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:47.155 INFO:teuthology.orchestra.run.smithi087.stdout: "MULTICLUSTER_CONFIG": { 2024-05-08T05:33:47.155 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "MULTICLUSTER_CONFIG", 2024-05-08T05:33:47.155 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-08T05:33:47.156 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:47.156 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-08T05:33:47.156 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "{}", 2024-05-08T05:33:47.156 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:47.156 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:47.156 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:47.156 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:47.156 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:47.156 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:47.156 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:47.156 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:47.156 INFO:teuthology.orchestra.run.smithi087.stdout: "PROMETHEUS_API_HOST": { 2024-05-08T05:33:47.156 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "PROMETHEUS_API_HOST", 2024-05-08T05:33:47.157 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-08T05:33:47.157 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:47.157 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-08T05:33:47.157 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-05-08T05:33:47.157 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:47.157 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:47.157 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:47.157 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:47.157 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:47.157 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:47.157 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:47.157 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:47.158 INFO:teuthology.orchestra.run.smithi087.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2024-05-08T05:33:47.158 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2024-05-08T05:33:47.158 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-08T05:33:47.158 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:47.158 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-08T05:33:47.158 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "True", 2024-05-08T05:33:47.158 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:47.158 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:47.158 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:47.158 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:47.158 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:47.158 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:47.159 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:47.159 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:47.159 INFO:teuthology.orchestra.run.smithi087.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2024-05-08T05:33:47.159 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2024-05-08T05:33:47.159 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-08T05:33:47.159 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:47.159 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-08T05:33:47.159 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-05-08T05:33:47.159 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:47.159 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:47.159 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:47.160 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:47.160 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:47.160 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:47.160 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:47.160 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:47.160 INFO:teuthology.orchestra.run.smithi087.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2024-05-08T05:33:47.160 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2024-05-08T05:33:47.160 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-08T05:33:47.160 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:47.160 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-08T05:33:47.160 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-05-08T05:33:47.160 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:47.161 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:47.161 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:47.161 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:47.161 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:47.161 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:47.161 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:47.161 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:47.161 INFO:teuthology.orchestra.run.smithi087.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2024-05-08T05:33:47.161 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2024-05-08T05:33:47.161 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-08T05:33:47.161 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:47.161 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-08T05:33:47.162 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "True", 2024-05-08T05:33:47.162 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:47.162 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:47.162 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:47.162 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:47.162 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:47.162 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:47.162 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:47.162 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:47.162 INFO:teuthology.orchestra.run.smithi087.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2024-05-08T05:33:47.162 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2024-05-08T05:33:47.162 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-08T05:33:47.163 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:47.163 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-08T05:33:47.163 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "True", 2024-05-08T05:33:47.163 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:47.163 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:47.163 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:47.163 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:47.163 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:47.163 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:47.163 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:47.163 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:47.164 INFO:teuthology.orchestra.run.smithi087.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2024-05-08T05:33:47.164 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2024-05-08T05:33:47.164 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-08T05:33:47.164 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:47.164 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-08T05:33:47.164 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-05-08T05:33:47.164 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:47.164 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:47.164 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:47.164 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:47.164 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:47.164 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:47.164 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:47.165 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:47.165 INFO:teuthology.orchestra.run.smithi087.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2024-05-08T05:33:47.165 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2024-05-08T05:33:47.165 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-08T05:33:47.165 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:47.165 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-08T05:33:47.165 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-05-08T05:33:47.165 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:47.165 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:47.165 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:47.165 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:47.165 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:47.166 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:47.166 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:47.166 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:47.166 INFO:teuthology.orchestra.run.smithi087.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2024-05-08T05:33:47.166 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2024-05-08T05:33:47.166 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-08T05:33:47.166 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:47.166 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-08T05:33:47.166 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-05-08T05:33:47.166 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:47.166 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:47.166 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:47.167 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:47.167 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:47.167 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:47.167 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:47.167 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:47.167 INFO:teuthology.orchestra.run.smithi087.stdout: "PWD_POLICY_ENABLED": { 2024-05-08T05:33:47.167 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "PWD_POLICY_ENABLED", 2024-05-08T05:33:47.167 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-08T05:33:47.167 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:47.167 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-08T05:33:47.167 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "True", 2024-05-08T05:33:47.168 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:47.168 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:47.168 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:47.168 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:47.168 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:47.168 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:47.168 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:47.168 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:47.168 INFO:teuthology.orchestra.run.smithi087.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2024-05-08T05:33:47.168 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2024-05-08T05:33:47.168 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-08T05:33:47.169 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:47.169 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-08T05:33:47.169 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2024-05-08T05:33:47.169 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:47.169 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:47.169 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:47.169 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:47.169 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:47.169 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:47.169 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:47.169 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:47.169 INFO:teuthology.orchestra.run.smithi087.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2024-05-08T05:33:47.169 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2024-05-08T05:33:47.170 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "int", 2024-05-08T05:33:47.170 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:47.170 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-08T05:33:47.170 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "10", 2024-05-08T05:33:47.170 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:47.170 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:47.170 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:47.170 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:47.170 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:47.170 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:47.170 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:47.171 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:47.171 INFO:teuthology.orchestra.run.smithi087.stdout: "PWD_POLICY_MIN_LENGTH": { 2024-05-08T05:33:47.171 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2024-05-08T05:33:47.171 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "int", 2024-05-08T05:33:47.171 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:47.171 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-08T05:33:47.171 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "8", 2024-05-08T05:33:47.171 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:47.171 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:47.171 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:47.171 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:47.171 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:47.172 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:47.172 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:47.172 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:47.172 INFO:teuthology.orchestra.run.smithi087.stdout: "REST_REQUESTS_TIMEOUT": { 2024-05-08T05:33:47.172 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "REST_REQUESTS_TIMEOUT", 2024-05-08T05:33:47.172 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "int", 2024-05-08T05:33:47.172 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:47.172 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-08T05:33:47.172 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "45", 2024-05-08T05:33:47.172 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:47.172 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:47.172 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:47.172 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:47.173 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:47.173 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:47.173 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:47.173 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:47.173 INFO:teuthology.orchestra.run.smithi087.stdout: "RGW_API_ACCESS_KEY": { 2024-05-08T05:33:47.173 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "RGW_API_ACCESS_KEY", 2024-05-08T05:33:47.173 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-08T05:33:47.173 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:47.173 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-08T05:33:47.173 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-05-08T05:33:47.173 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:47.173 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:47.174 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:47.174 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:47.174 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:47.174 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:47.174 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:47.174 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:47.174 INFO:teuthology.orchestra.run.smithi087.stdout: "RGW_API_ADMIN_RESOURCE": { 2024-05-08T05:33:47.174 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2024-05-08T05:33:47.174 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-08T05:33:47.174 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:47.174 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-08T05:33:47.174 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "admin", 2024-05-08T05:33:47.175 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:47.175 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:47.175 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:47.175 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:47.175 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:47.175 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:47.175 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:47.175 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:47.175 INFO:teuthology.orchestra.run.smithi087.stdout: "RGW_API_SECRET_KEY": { 2024-05-08T05:33:47.175 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "RGW_API_SECRET_KEY", 2024-05-08T05:33:47.175 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-08T05:33:47.175 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:47.176 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-08T05:33:47.176 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-05-08T05:33:47.176 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:47.176 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:47.176 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:47.176 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:47.176 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:47.176 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:47.176 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:47.176 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:47.176 INFO:teuthology.orchestra.run.smithi087.stdout: "RGW_API_SSL_VERIFY": { 2024-05-08T05:33:47.176 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "RGW_API_SSL_VERIFY", 2024-05-08T05:33:47.176 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-08T05:33:47.177 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:47.177 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-08T05:33:47.177 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "True", 2024-05-08T05:33:47.177 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:47.177 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:47.177 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:47.177 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:47.177 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:47.177 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:47.177 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:47.177 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:47.177 INFO:teuthology.orchestra.run.smithi087.stdout: "UNSAFE_TLS_v1_2": { 2024-05-08T05:33:47.177 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "UNSAFE_TLS_v1_2", 2024-05-08T05:33:47.178 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-08T05:33:47.178 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:47.178 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-08T05:33:47.178 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-05-08T05:33:47.178 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:47.178 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:47.178 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:47.178 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:47.178 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:47.178 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:47.178 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:47.178 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:47.178 INFO:teuthology.orchestra.run.smithi087.stdout: "USER_PWD_EXPIRATION_SPAN": { 2024-05-08T05:33:47.179 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2024-05-08T05:33:47.179 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "int", 2024-05-08T05:33:47.179 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:47.179 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-08T05:33:47.179 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "0", 2024-05-08T05:33:47.179 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:47.179 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:47.179 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:47.179 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:47.179 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:47.179 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:47.180 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:47.180 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:47.180 INFO:teuthology.orchestra.run.smithi087.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2024-05-08T05:33:47.180 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2024-05-08T05:33:47.180 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "int", 2024-05-08T05:33:47.180 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:47.180 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-08T05:33:47.180 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "10", 2024-05-08T05:33:47.180 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:47.180 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:47.180 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:47.180 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:47.180 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:47.180 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:47.181 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:47.181 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:47.181 INFO:teuthology.orchestra.run.smithi087.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2024-05-08T05:33:47.181 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2024-05-08T05:33:47.181 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "int", 2024-05-08T05:33:47.181 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:47.181 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-08T05:33:47.181 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "5", 2024-05-08T05:33:47.181 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:47.181 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:47.181 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:47.181 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:47.181 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:47.181 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:47.182 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:47.182 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:47.182 INFO:teuthology.orchestra.run.smithi087.stdout: "cross_origin_url": { 2024-05-08T05:33:47.182 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "cross_origin_url", 2024-05-08T05:33:47.182 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-08T05:33:47.182 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:47.182 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-08T05:33:47.182 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-05-08T05:33:47.182 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:47.182 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:47.182 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:47.182 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:47.183 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:47.183 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:47.183 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:47.183 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:47.183 INFO:teuthology.orchestra.run.smithi087.stdout: "crt_file": { 2024-05-08T05:33:47.183 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "crt_file", 2024-05-08T05:33:47.183 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-08T05:33:47.183 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:47.183 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-08T05:33:47.183 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-05-08T05:33:47.183 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:47.183 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:47.184 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:47.184 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:47.184 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:47.184 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:47.184 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:47.184 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:47.184 INFO:teuthology.orchestra.run.smithi087.stdout: "debug": { 2024-05-08T05:33:47.184 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "debug", 2024-05-08T05:33:47.184 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-08T05:33:47.184 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:47.184 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-08T05:33:47.184 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-05-08T05:33:47.184 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:47.184 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:47.185 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:47.185 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "Enable/disable debug options", 2024-05-08T05:33:47.185 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:47.185 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:47.185 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:47.185 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:47.185 INFO:teuthology.orchestra.run.smithi087.stdout: "jwt_token_ttl": { 2024-05-08T05:33:47.185 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "jwt_token_ttl", 2024-05-08T05:33:47.185 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "int", 2024-05-08T05:33:47.185 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:47.185 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-08T05:33:47.185 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "28800", 2024-05-08T05:33:47.186 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:47.186 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:47.186 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:47.186 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:47.186 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:47.186 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:47.186 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:47.186 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:47.186 INFO:teuthology.orchestra.run.smithi087.stdout: "key_file": { 2024-05-08T05:33:47.186 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "key_file", 2024-05-08T05:33:47.186 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-08T05:33:47.186 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:47.187 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-08T05:33:47.187 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-05-08T05:33:47.187 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:47.187 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:47.187 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:47.187 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:47.187 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:47.187 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:47.187 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:47.187 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:47.187 INFO:teuthology.orchestra.run.smithi087.stdout: "log_level": { 2024-05-08T05:33:47.187 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_level", 2024-05-08T05:33:47.188 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-08T05:33:47.188 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:47.188 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:47.188 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-05-08T05:33:47.188 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:47.188 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:47.188 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [ 2024-05-08T05:33:47.188 INFO:teuthology.orchestra.run.smithi087.stdout: "", 2024-05-08T05:33:47.188 INFO:teuthology.orchestra.run.smithi087.stdout: "critical", 2024-05-08T05:33:47.188 INFO:teuthology.orchestra.run.smithi087.stdout: "debug", 2024-05-08T05:33:47.188 INFO:teuthology.orchestra.run.smithi087.stdout: "error", 2024-05-08T05:33:47.188 INFO:teuthology.orchestra.run.smithi087.stdout: "info", 2024-05-08T05:33:47.189 INFO:teuthology.orchestra.run.smithi087.stdout: "warning" 2024-05-08T05:33:47.189 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-05-08T05:33:47.189 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:47.189 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:47.189 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:47.189 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:47.189 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:47.189 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_cluster": { 2024-05-08T05:33:47.189 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_cluster", 2024-05-08T05:33:47.189 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-08T05:33:47.189 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:47.189 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:47.190 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-05-08T05:33:47.190 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:47.190 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:47.190 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:47.190 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:47.190 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:47.190 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:47.190 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:47.190 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:47.190 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_cluster_level": { 2024-05-08T05:33:47.190 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_cluster_level", 2024-05-08T05:33:47.190 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-08T05:33:47.191 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:47.191 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:47.191 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "info", 2024-05-08T05:33:47.191 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:47.191 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:47.191 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [ 2024-05-08T05:33:47.191 INFO:teuthology.orchestra.run.smithi087.stdout: "", 2024-05-08T05:33:47.191 INFO:teuthology.orchestra.run.smithi087.stdout: "critical", 2024-05-08T05:33:47.191 INFO:teuthology.orchestra.run.smithi087.stdout: "debug", 2024-05-08T05:33:47.191 INFO:teuthology.orchestra.run.smithi087.stdout: "error", 2024-05-08T05:33:47.191 INFO:teuthology.orchestra.run.smithi087.stdout: "info", 2024-05-08T05:33:47.191 INFO:teuthology.orchestra.run.smithi087.stdout: "warning" 2024-05-08T05:33:47.191 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-05-08T05:33:47.192 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:47.192 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:47.192 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:47.192 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:47.192 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:47.192 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_file": { 2024-05-08T05:33:47.192 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_file", 2024-05-08T05:33:47.192 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-08T05:33:47.192 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:47.192 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:47.192 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-05-08T05:33:47.192 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:47.192 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:47.192 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:47.193 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:47.193 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:47.193 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:47.193 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:47.193 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:47.193 INFO:teuthology.orchestra.run.smithi087.stdout: "motd": { 2024-05-08T05:33:47.193 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "motd", 2024-05-08T05:33:47.193 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-08T05:33:47.193 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:47.193 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-08T05:33:47.193 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-05-08T05:33:47.193 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:47.193 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:47.193 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:47.193 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "The message of the day", 2024-05-08T05:33:47.194 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:47.194 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:47.194 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:47.194 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:47.194 INFO:teuthology.orchestra.run.smithi087.stdout: "redirect_resolve_ip_addr": { 2024-05-08T05:33:47.194 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "redirect_resolve_ip_addr", 2024-05-08T05:33:47.194 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-08T05:33:47.194 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:47.194 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-08T05:33:47.194 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-05-08T05:33:47.194 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:47.194 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:47.195 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:47.195 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:47.195 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:47.195 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:47.195 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:47.195 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:47.195 INFO:teuthology.orchestra.run.smithi087.stdout: "server_addr": { 2024-05-08T05:33:47.195 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "server_addr", 2024-05-08T05:33:47.195 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-08T05:33:47.195 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:47.195 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-08T05:33:47.195 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "::", 2024-05-08T05:33:47.195 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:47.195 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:47.196 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:47.196 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:47.196 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:47.196 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:47.196 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:47.196 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:47.196 INFO:teuthology.orchestra.run.smithi087.stdout: "server_port": { 2024-05-08T05:33:47.196 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "server_port", 2024-05-08T05:33:47.196 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "int", 2024-05-08T05:33:47.196 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:47.196 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-08T05:33:47.196 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "8080", 2024-05-08T05:33:47.196 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:47.197 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:47.197 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:47.197 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:47.197 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:47.197 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:47.197 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:47.197 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:47.197 INFO:teuthology.orchestra.run.smithi087.stdout: "sqlite3_killpoint": { 2024-05-08T05:33:47.197 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "sqlite3_killpoint", 2024-05-08T05:33:47.197 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "int", 2024-05-08T05:33:47.197 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "dev", 2024-05-08T05:33:47.197 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:47.198 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "0", 2024-05-08T05:33:47.198 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:47.198 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:47.198 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:47.198 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:47.198 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:47.198 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:47.198 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:47.198 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:47.198 INFO:teuthology.orchestra.run.smithi087.stdout: "ssl": { 2024-05-08T05:33:47.198 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "ssl", 2024-05-08T05:33:47.198 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-08T05:33:47.198 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:47.199 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-08T05:33:47.199 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "True", 2024-05-08T05:33:47.199 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:47.199 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:47.199 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:47.199 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:47.199 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:47.199 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:47.199 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:47.199 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:47.199 INFO:teuthology.orchestra.run.smithi087.stdout: "ssl_server_port": { 2024-05-08T05:33:47.199 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "ssl_server_port", 2024-05-08T05:33:47.200 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "int", 2024-05-08T05:33:47.200 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:47.200 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-08T05:33:47.200 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "8443", 2024-05-08T05:33:47.200 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:47.200 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:47.200 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:47.200 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:47.200 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:47.200 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:47.200 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:47.200 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:47.200 INFO:teuthology.orchestra.run.smithi087.stdout: "standby_behaviour": { 2024-05-08T05:33:47.201 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "standby_behaviour", 2024-05-08T05:33:47.201 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-08T05:33:47.201 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:47.201 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-08T05:33:47.201 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "redirect", 2024-05-08T05:33:47.201 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:47.201 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:47.201 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [ 2024-05-08T05:33:47.201 INFO:teuthology.orchestra.run.smithi087.stdout: "error", 2024-05-08T05:33:47.201 INFO:teuthology.orchestra.run.smithi087.stdout: "redirect" 2024-05-08T05:33:47.201 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-05-08T05:33:47.201 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:47.201 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:47.201 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:47.202 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:47.202 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:47.202 INFO:teuthology.orchestra.run.smithi087.stdout: "standby_error_status_code": { 2024-05-08T05:33:47.202 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "standby_error_status_code", 2024-05-08T05:33:47.202 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "int", 2024-05-08T05:33:47.202 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:47.202 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-08T05:33:47.202 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "500", 2024-05-08T05:33:47.202 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "400", 2024-05-08T05:33:47.202 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "599", 2024-05-08T05:33:47.202 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:47.202 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:47.203 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:47.203 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:47.203 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:47.203 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:47.203 INFO:teuthology.orchestra.run.smithi087.stdout: "url_prefix": { 2024-05-08T05:33:47.203 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "url_prefix", 2024-05-08T05:33:47.203 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-08T05:33:47.203 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:47.203 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-08T05:33:47.203 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-05-08T05:33:47.203 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:47.203 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:47.203 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:47.204 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:47.204 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:47.204 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:47.204 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:47.204 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-05-08T05:33:47.204 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-05-08T05:33:47.204 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:47.204 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-05-08T05:33:47.204 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "devicehealth", 2024-05-08T05:33:47.204 INFO:teuthology.orchestra.run.smithi087.stdout: "can_run": true, 2024-05-08T05:33:47.204 INFO:teuthology.orchestra.run.smithi087.stdout: "error_string": "", 2024-05-08T05:33:47.204 INFO:teuthology.orchestra.run.smithi087.stdout: "module_options": { 2024-05-08T05:33:47.204 INFO:teuthology.orchestra.run.smithi087.stdout: "enable_monitoring": { 2024-05-08T05:33:47.205 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "enable_monitoring", 2024-05-08T05:33:47.205 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-08T05:33:47.205 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:47.205 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:47.205 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "True", 2024-05-08T05:33:47.205 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:47.205 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:47.205 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:47.205 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "monitor device health metrics", 2024-05-08T05:33:47.205 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:47.205 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:47.205 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:47.205 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:47.205 INFO:teuthology.orchestra.run.smithi087.stdout: "log_level": { 2024-05-08T05:33:47.206 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_level", 2024-05-08T05:33:47.206 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-08T05:33:47.206 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:47.206 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:47.206 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-05-08T05:33:47.206 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:47.206 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:47.206 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [ 2024-05-08T05:33:47.206 INFO:teuthology.orchestra.run.smithi087.stdout: "", 2024-05-08T05:33:47.206 INFO:teuthology.orchestra.run.smithi087.stdout: "critical", 2024-05-08T05:33:47.206 INFO:teuthology.orchestra.run.smithi087.stdout: "debug", 2024-05-08T05:33:47.207 INFO:teuthology.orchestra.run.smithi087.stdout: "error", 2024-05-08T05:33:47.207 INFO:teuthology.orchestra.run.smithi087.stdout: "info", 2024-05-08T05:33:47.207 INFO:teuthology.orchestra.run.smithi087.stdout: "warning" 2024-05-08T05:33:47.207 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-05-08T05:33:47.207 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:47.207 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:47.207 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:47.207 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:47.207 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:47.207 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_cluster": { 2024-05-08T05:33:47.207 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_cluster", 2024-05-08T05:33:47.207 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-08T05:33:47.207 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:47.208 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:47.208 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-05-08T05:33:47.208 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:47.208 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:47.208 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:47.208 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:47.208 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:47.208 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:47.208 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:47.208 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:47.208 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_cluster_level": { 2024-05-08T05:33:47.208 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_cluster_level", 2024-05-08T05:33:47.208 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-08T05:33:47.209 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:47.209 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:47.209 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "info", 2024-05-08T05:33:47.209 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:47.209 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:47.209 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [ 2024-05-08T05:33:47.209 INFO:teuthology.orchestra.run.smithi087.stdout: "", 2024-05-08T05:33:47.209 INFO:teuthology.orchestra.run.smithi087.stdout: "critical", 2024-05-08T05:33:47.209 INFO:teuthology.orchestra.run.smithi087.stdout: "debug", 2024-05-08T05:33:47.209 INFO:teuthology.orchestra.run.smithi087.stdout: "error", 2024-05-08T05:33:47.209 INFO:teuthology.orchestra.run.smithi087.stdout: "info", 2024-05-08T05:33:47.209 INFO:teuthology.orchestra.run.smithi087.stdout: "warning" 2024-05-08T05:33:47.209 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-05-08T05:33:47.210 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:47.210 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:47.210 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:47.210 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:47.210 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:47.210 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_file": { 2024-05-08T05:33:47.210 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_file", 2024-05-08T05:33:47.210 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-08T05:33:47.210 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:47.210 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:47.210 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-05-08T05:33:47.210 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:47.211 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:47.211 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:47.211 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:47.211 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:47.211 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:47.211 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:47.211 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:47.211 INFO:teuthology.orchestra.run.smithi087.stdout: "mark_out_threshold": { 2024-05-08T05:33:47.211 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "mark_out_threshold", 2024-05-08T05:33:47.211 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "secs", 2024-05-08T05:33:47.211 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:47.211 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:47.212 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "2419200", 2024-05-08T05:33:47.212 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:47.212 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:47.212 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:47.212 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "automatically mark OSD if it may fail before this long", 2024-05-08T05:33:47.212 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:47.212 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:47.212 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:47.212 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:47.212 INFO:teuthology.orchestra.run.smithi087.stdout: "pool_name": { 2024-05-08T05:33:47.212 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "pool_name", 2024-05-08T05:33:47.212 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-08T05:33:47.213 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:47.213 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:47.213 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "device_health_metrics", 2024-05-08T05:33:47.213 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:47.213 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:47.213 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:47.213 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "name of pool in which to store device health metrics", 2024-05-08T05:33:47.213 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:47.213 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:47.213 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:47.213 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:47.213 INFO:teuthology.orchestra.run.smithi087.stdout: "retention_period": { 2024-05-08T05:33:47.214 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "retention_period", 2024-05-08T05:33:47.214 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "secs", 2024-05-08T05:33:47.214 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:47.214 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:47.214 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "15552000", 2024-05-08T05:33:47.214 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:47.214 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:47.214 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:47.214 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "how long to retain device health metrics", 2024-05-08T05:33:47.214 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:47.214 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:47.214 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:47.215 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:47.215 INFO:teuthology.orchestra.run.smithi087.stdout: "scrape_frequency": { 2024-05-08T05:33:47.215 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "scrape_frequency", 2024-05-08T05:33:47.215 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "secs", 2024-05-08T05:33:47.215 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:47.215 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:47.215 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "86400", 2024-05-08T05:33:47.215 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:47.215 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:47.215 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:47.215 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "how frequently to scrape device health metrics", 2024-05-08T05:33:47.215 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:47.216 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:47.216 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:47.216 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:47.216 INFO:teuthology.orchestra.run.smithi087.stdout: "self_heal": { 2024-05-08T05:33:47.216 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "self_heal", 2024-05-08T05:33:47.216 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-08T05:33:47.216 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:47.216 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:47.216 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "True", 2024-05-08T05:33:47.216 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:47.216 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:47.216 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:47.217 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "preemptively heal cluster around devices that may fail", 2024-05-08T05:33:47.217 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:47.217 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:47.217 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:47.217 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:47.217 INFO:teuthology.orchestra.run.smithi087.stdout: "sleep_interval": { 2024-05-08T05:33:47.217 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "sleep_interval", 2024-05-08T05:33:47.217 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "secs", 2024-05-08T05:33:47.217 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:47.217 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:47.217 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "600", 2024-05-08T05:33:47.217 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:47.218 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:47.218 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:47.218 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "how frequently to wake up and check device health", 2024-05-08T05:33:47.218 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:47.218 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:47.218 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:47.218 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:47.218 INFO:teuthology.orchestra.run.smithi087.stdout: "sqlite3_killpoint": { 2024-05-08T05:33:47.218 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "sqlite3_killpoint", 2024-05-08T05:33:47.218 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "int", 2024-05-08T05:33:47.218 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "dev", 2024-05-08T05:33:47.218 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:47.218 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "0", 2024-05-08T05:33:47.219 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:47.219 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:47.219 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:47.219 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:47.219 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:47.219 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:47.219 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:47.219 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:47.219 INFO:teuthology.orchestra.run.smithi087.stdout: "warn_threshold": { 2024-05-08T05:33:47.219 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "warn_threshold", 2024-05-08T05:33:47.219 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "secs", 2024-05-08T05:33:47.219 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:47.219 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:47.220 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "7257600", 2024-05-08T05:33:47.220 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:47.220 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:47.220 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:47.220 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "raise health warning if OSD may fail before this long", 2024-05-08T05:33:47.220 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:47.220 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:47.220 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:47.220 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-05-08T05:33:47.220 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-05-08T05:33:47.220 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:47.220 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-05-08T05:33:47.220 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "diskprediction_local", 2024-05-08T05:33:47.221 INFO:teuthology.orchestra.run.smithi087.stdout: "can_run": true, 2024-05-08T05:33:47.221 INFO:teuthology.orchestra.run.smithi087.stdout: "error_string": "", 2024-05-08T05:33:47.221 INFO:teuthology.orchestra.run.smithi087.stdout: "module_options": { 2024-05-08T05:33:47.221 INFO:teuthology.orchestra.run.smithi087.stdout: "log_level": { 2024-05-08T05:33:47.221 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_level", 2024-05-08T05:33:47.221 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-08T05:33:47.221 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:47.221 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:47.221 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-05-08T05:33:47.221 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:47.221 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:47.221 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [ 2024-05-08T05:33:47.221 INFO:teuthology.orchestra.run.smithi087.stdout: "", 2024-05-08T05:33:47.221 INFO:teuthology.orchestra.run.smithi087.stdout: "critical", 2024-05-08T05:33:47.222 INFO:teuthology.orchestra.run.smithi087.stdout: "debug", 2024-05-08T05:33:47.222 INFO:teuthology.orchestra.run.smithi087.stdout: "error", 2024-05-08T05:33:47.222 INFO:teuthology.orchestra.run.smithi087.stdout: "info", 2024-05-08T05:33:47.222 INFO:teuthology.orchestra.run.smithi087.stdout: "warning" 2024-05-08T05:33:47.222 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-05-08T05:33:47.222 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:47.222 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:47.222 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:47.222 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:47.222 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:47.222 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_cluster": { 2024-05-08T05:33:47.222 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_cluster", 2024-05-08T05:33:47.223 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-08T05:33:47.223 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:47.223 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:47.223 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-05-08T05:33:47.223 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:47.223 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:47.223 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:47.223 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:47.223 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:47.223 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:47.223 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:47.223 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:47.223 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_cluster_level": { 2024-05-08T05:33:47.224 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_cluster_level", 2024-05-08T05:33:47.224 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-08T05:33:47.224 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:47.224 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:47.224 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "info", 2024-05-08T05:33:47.224 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:47.224 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:47.224 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [ 2024-05-08T05:33:47.224 INFO:teuthology.orchestra.run.smithi087.stdout: "", 2024-05-08T05:33:47.224 INFO:teuthology.orchestra.run.smithi087.stdout: "critical", 2024-05-08T05:33:47.224 INFO:teuthology.orchestra.run.smithi087.stdout: "debug", 2024-05-08T05:33:47.224 INFO:teuthology.orchestra.run.smithi087.stdout: "error", 2024-05-08T05:33:47.224 INFO:teuthology.orchestra.run.smithi087.stdout: "info", 2024-05-08T05:33:47.225 INFO:teuthology.orchestra.run.smithi087.stdout: "warning" 2024-05-08T05:33:47.225 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-05-08T05:33:47.225 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:47.225 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:47.225 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:47.225 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:47.225 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:47.225 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_file": { 2024-05-08T05:33:47.225 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_file", 2024-05-08T05:33:47.225 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-08T05:33:47.225 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:47.225 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:47.226 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-05-08T05:33:47.226 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:47.226 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:47.226 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:47.226 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:47.226 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:47.226 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:47.226 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:47.226 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:47.226 INFO:teuthology.orchestra.run.smithi087.stdout: "predict_interval": { 2024-05-08T05:33:47.226 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "predict_interval", 2024-05-08T05:33:47.226 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-08T05:33:47.227 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:47.227 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-08T05:33:47.227 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "86400", 2024-05-08T05:33:47.227 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:47.227 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:47.227 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:47.227 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:47.227 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:47.227 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:47.227 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:47.227 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:47.227 INFO:teuthology.orchestra.run.smithi087.stdout: "predictor_model": { 2024-05-08T05:33:47.228 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "predictor_model", 2024-05-08T05:33:47.228 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-08T05:33:47.228 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:47.228 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-08T05:33:47.228 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "prophetstor", 2024-05-08T05:33:47.228 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:47.228 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:47.228 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:47.228 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:47.228 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:47.228 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:47.228 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:47.228 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:47.229 INFO:teuthology.orchestra.run.smithi087.stdout: "sleep_interval": { 2024-05-08T05:33:47.229 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "sleep_interval", 2024-05-08T05:33:47.229 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-08T05:33:47.229 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:47.229 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-08T05:33:47.229 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "600", 2024-05-08T05:33:47.229 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:47.229 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:47.229 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:47.229 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:47.229 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:47.229 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:47.230 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:47.230 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:47.230 INFO:teuthology.orchestra.run.smithi087.stdout: "sqlite3_killpoint": { 2024-05-08T05:33:47.230 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "sqlite3_killpoint", 2024-05-08T05:33:47.230 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "int", 2024-05-08T05:33:47.230 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "dev", 2024-05-08T05:33:47.230 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:47.230 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "0", 2024-05-08T05:33:47.230 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:47.230 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:47.230 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:47.230 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:47.231 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:47.231 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:47.231 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:47.231 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-05-08T05:33:47.231 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-05-08T05:33:47.231 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:47.231 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-05-08T05:33:47.231 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "influx", 2024-05-08T05:33:47.231 INFO:teuthology.orchestra.run.smithi087.stdout: "can_run": false, 2024-05-08T05:33:47.231 INFO:teuthology.orchestra.run.smithi087.stdout: "error_string": "influxdb python module not found", 2024-05-08T05:33:47.231 INFO:teuthology.orchestra.run.smithi087.stdout: "module_options": { 2024-05-08T05:33:47.231 INFO:teuthology.orchestra.run.smithi087.stdout: "batch_size": { 2024-05-08T05:33:47.232 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "batch_size", 2024-05-08T05:33:47.232 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "int", 2024-05-08T05:33:47.232 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:47.232 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-08T05:33:47.232 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "5000", 2024-05-08T05:33:47.232 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:47.232 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:47.232 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:47.232 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2024-05-08T05:33:47.232 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:47.232 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:47.232 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:47.232 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:47.233 INFO:teuthology.orchestra.run.smithi087.stdout: "database": { 2024-05-08T05:33:47.233 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "database", 2024-05-08T05:33:47.233 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-08T05:33:47.233 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:47.233 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-08T05:33:47.233 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "ceph", 2024-05-08T05:33:47.233 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:47.233 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:47.233 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:47.233 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2024-05-08T05:33:47.233 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:47.233 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:47.234 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:47.234 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:47.234 INFO:teuthology.orchestra.run.smithi087.stdout: "hostname": { 2024-05-08T05:33:47.234 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "hostname", 2024-05-08T05:33:47.234 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-08T05:33:47.234 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:47.234 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-08T05:33:47.234 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-05-08T05:33:47.234 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:47.234 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:47.234 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:47.234 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "InfluxDB server hostname", 2024-05-08T05:33:47.235 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:47.235 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:47.235 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:47.235 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:47.235 INFO:teuthology.orchestra.run.smithi087.stdout: "interval": { 2024-05-08T05:33:47.235 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "interval", 2024-05-08T05:33:47.235 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "secs", 2024-05-08T05:33:47.235 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:47.235 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-08T05:33:47.235 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "30", 2024-05-08T05:33:47.235 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "5", 2024-05-08T05:33:47.235 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:47.236 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:47.236 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2024-05-08T05:33:47.236 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:47.236 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:47.236 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:47.236 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:47.236 INFO:teuthology.orchestra.run.smithi087.stdout: "log_level": { 2024-05-08T05:33:47.236 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_level", 2024-05-08T05:33:47.236 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-08T05:33:47.236 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:47.236 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:47.236 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-05-08T05:33:47.237 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:47.237 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:47.237 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [ 2024-05-08T05:33:47.237 INFO:teuthology.orchestra.run.smithi087.stdout: "", 2024-05-08T05:33:47.237 INFO:teuthology.orchestra.run.smithi087.stdout: "critical", 2024-05-08T05:33:47.237 INFO:teuthology.orchestra.run.smithi087.stdout: "debug", 2024-05-08T05:33:47.237 INFO:teuthology.orchestra.run.smithi087.stdout: "error", 2024-05-08T05:33:47.237 INFO:teuthology.orchestra.run.smithi087.stdout: "info", 2024-05-08T05:33:47.237 INFO:teuthology.orchestra.run.smithi087.stdout: "warning" 2024-05-08T05:33:47.237 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-05-08T05:33:47.237 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:47.237 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:47.237 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:47.238 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:47.238 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:47.238 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_cluster": { 2024-05-08T05:33:47.238 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_cluster", 2024-05-08T05:33:47.238 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-08T05:33:47.238 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:47.238 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:47.238 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-05-08T05:33:47.238 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:47.238 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:47.238 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:47.238 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:47.239 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:47.239 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:47.239 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:47.239 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:47.239 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_cluster_level": { 2024-05-08T05:33:47.239 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_cluster_level", 2024-05-08T05:33:47.239 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-08T05:33:47.239 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:47.239 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:47.239 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "info", 2024-05-08T05:33:47.239 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:47.239 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:47.239 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [ 2024-05-08T05:33:47.240 INFO:teuthology.orchestra.run.smithi087.stdout: "", 2024-05-08T05:33:47.240 INFO:teuthology.orchestra.run.smithi087.stdout: "critical", 2024-05-08T05:33:47.240 INFO:teuthology.orchestra.run.smithi087.stdout: "debug", 2024-05-08T05:33:47.240 INFO:teuthology.orchestra.run.smithi087.stdout: "error", 2024-05-08T05:33:47.240 INFO:teuthology.orchestra.run.smithi087.stdout: "info", 2024-05-08T05:33:47.240 INFO:teuthology.orchestra.run.smithi087.stdout: "warning" 2024-05-08T05:33:47.240 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-05-08T05:33:47.240 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:47.240 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:47.240 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:47.240 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:47.241 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:47.241 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_file": { 2024-05-08T05:33:47.241 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_file", 2024-05-08T05:33:47.241 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-08T05:33:47.241 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:47.241 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:47.241 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-05-08T05:33:47.241 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:47.241 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:47.241 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:47.241 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:47.241 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:47.241 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:47.242 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:47.242 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:47.242 INFO:teuthology.orchestra.run.smithi087.stdout: "password": { 2024-05-08T05:33:47.242 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "password", 2024-05-08T05:33:47.242 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-08T05:33:47.242 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:47.242 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-08T05:33:47.242 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-05-08T05:33:47.242 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:47.242 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:47.242 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:47.242 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "password of InfluxDB server user", 2024-05-08T05:33:47.242 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:47.243 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:47.243 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:47.243 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:47.243 INFO:teuthology.orchestra.run.smithi087.stdout: "port": { 2024-05-08T05:33:47.243 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "port", 2024-05-08T05:33:47.243 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "int", 2024-05-08T05:33:47.243 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:47.243 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-08T05:33:47.243 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "8086", 2024-05-08T05:33:47.243 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:47.243 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:47.244 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:47.244 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "InfluxDB server port", 2024-05-08T05:33:47.244 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:47.244 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:47.244 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:47.244 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:47.244 INFO:teuthology.orchestra.run.smithi087.stdout: "sqlite3_killpoint": { 2024-05-08T05:33:47.244 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "sqlite3_killpoint", 2024-05-08T05:33:47.244 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "int", 2024-05-08T05:33:47.244 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "dev", 2024-05-08T05:33:47.244 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:47.245 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "0", 2024-05-08T05:33:47.245 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:47.245 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:47.245 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:47.245 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:47.245 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:47.245 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:47.245 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:47.245 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:47.245 INFO:teuthology.orchestra.run.smithi087.stdout: "ssl": { 2024-05-08T05:33:47.245 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "ssl", 2024-05-08T05:33:47.245 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-08T05:33:47.245 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:47.246 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-08T05:33:47.246 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "false", 2024-05-08T05:33:47.246 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:47.246 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:47.246 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:47.246 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2024-05-08T05:33:47.246 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:47.246 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:47.246 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:47.246 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:47.246 INFO:teuthology.orchestra.run.smithi087.stdout: "threads": { 2024-05-08T05:33:47.246 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "threads", 2024-05-08T05:33:47.247 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "int", 2024-05-08T05:33:47.247 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:47.247 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-08T05:33:47.247 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "5", 2024-05-08T05:33:47.247 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "1", 2024-05-08T05:33:47.247 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "32", 2024-05-08T05:33:47.247 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:47.247 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2024-05-08T05:33:47.247 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:47.247 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:47.247 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:47.248 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:47.248 INFO:teuthology.orchestra.run.smithi087.stdout: "username": { 2024-05-08T05:33:47.248 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "username", 2024-05-08T05:33:47.248 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-08T05:33:47.248 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:47.248 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-08T05:33:47.248 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-05-08T05:33:47.248 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:47.248 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:47.248 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:47.248 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "username of InfluxDB server user", 2024-05-08T05:33:47.248 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:47.249 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:47.249 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:47.249 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:47.249 INFO:teuthology.orchestra.run.smithi087.stdout: "verify_ssl": { 2024-05-08T05:33:47.249 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "verify_ssl", 2024-05-08T05:33:47.249 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-08T05:33:47.249 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:47.249 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-08T05:33:47.249 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "true", 2024-05-08T05:33:47.249 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:47.249 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:47.249 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:47.250 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2024-05-08T05:33:47.250 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:47.250 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:47.250 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:47.250 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-05-08T05:33:47.250 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-05-08T05:33:47.250 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:47.250 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-05-08T05:33:47.250 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "insights", 2024-05-08T05:33:47.250 INFO:teuthology.orchestra.run.smithi087.stdout: "can_run": true, 2024-05-08T05:33:47.250 INFO:teuthology.orchestra.run.smithi087.stdout: "error_string": "", 2024-05-08T05:33:47.251 INFO:teuthology.orchestra.run.smithi087.stdout: "module_options": { 2024-05-08T05:33:47.251 INFO:teuthology.orchestra.run.smithi087.stdout: "log_level": { 2024-05-08T05:33:47.251 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_level", 2024-05-08T05:33:47.251 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-08T05:33:47.251 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:47.251 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:47.251 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-05-08T05:33:47.251 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:47.251 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:47.251 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [ 2024-05-08T05:33:47.251 INFO:teuthology.orchestra.run.smithi087.stdout: "", 2024-05-08T05:33:47.251 INFO:teuthology.orchestra.run.smithi087.stdout: "critical", 2024-05-08T05:33:47.252 INFO:teuthology.orchestra.run.smithi087.stdout: "debug", 2024-05-08T05:33:47.252 INFO:teuthology.orchestra.run.smithi087.stdout: "error", 2024-05-08T05:33:47.252 INFO:teuthology.orchestra.run.smithi087.stdout: "info", 2024-05-08T05:33:47.252 INFO:teuthology.orchestra.run.smithi087.stdout: "warning" 2024-05-08T05:33:47.252 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-05-08T05:33:47.252 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:47.252 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:47.252 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:47.252 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:47.252 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:47.252 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_cluster": { 2024-05-08T05:33:47.252 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_cluster", 2024-05-08T05:33:47.253 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-08T05:33:47.253 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:47.253 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:47.253 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-05-08T05:33:47.253 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:47.253 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:47.253 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:47.253 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:47.253 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:47.253 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:47.253 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:47.253 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:47.253 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_cluster_level": { 2024-05-08T05:33:47.254 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_cluster_level", 2024-05-08T05:33:47.254 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-08T05:33:47.254 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:47.254 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:47.254 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "info", 2024-05-08T05:33:47.254 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:47.254 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:47.254 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [ 2024-05-08T05:33:47.254 INFO:teuthology.orchestra.run.smithi087.stdout: "", 2024-05-08T05:33:47.254 INFO:teuthology.orchestra.run.smithi087.stdout: "critical", 2024-05-08T05:33:47.254 INFO:teuthology.orchestra.run.smithi087.stdout: "debug", 2024-05-08T05:33:47.255 INFO:teuthology.orchestra.run.smithi087.stdout: "error", 2024-05-08T05:33:47.255 INFO:teuthology.orchestra.run.smithi087.stdout: "info", 2024-05-08T05:33:47.255 INFO:teuthology.orchestra.run.smithi087.stdout: "warning" 2024-05-08T05:33:47.255 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-05-08T05:33:47.255 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:47.255 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:47.255 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:47.255 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:47.255 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:47.255 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_file": { 2024-05-08T05:33:47.255 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_file", 2024-05-08T05:33:47.255 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-08T05:33:47.256 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:47.256 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:47.256 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-05-08T05:33:47.256 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:47.256 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:47.256 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:47.256 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:47.256 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:47.256 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:47.256 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:47.256 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:47.257 INFO:teuthology.orchestra.run.smithi087.stdout: "sqlite3_killpoint": { 2024-05-08T05:33:47.257 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "sqlite3_killpoint", 2024-05-08T05:33:47.257 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "int", 2024-05-08T05:33:47.257 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "dev", 2024-05-08T05:33:47.257 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:47.257 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "0", 2024-05-08T05:33:47.257 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:47.257 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:47.257 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:47.257 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:47.257 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:47.257 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:47.258 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:47.258 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-05-08T05:33:47.258 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-05-08T05:33:47.258 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:47.258 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-05-08T05:33:47.258 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "iostat", 2024-05-08T05:33:47.258 INFO:teuthology.orchestra.run.smithi087.stdout: "can_run": true, 2024-05-08T05:33:47.258 INFO:teuthology.orchestra.run.smithi087.stdout: "error_string": "", 2024-05-08T05:33:47.258 INFO:teuthology.orchestra.run.smithi087.stdout: "module_options": { 2024-05-08T05:33:47.258 INFO:teuthology.orchestra.run.smithi087.stdout: "log_level": { 2024-05-08T05:33:47.258 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_level", 2024-05-08T05:33:47.259 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-08T05:33:47.259 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:47.259 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:47.259 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-05-08T05:33:47.259 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:47.259 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:47.259 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [ 2024-05-08T05:33:47.259 INFO:teuthology.orchestra.run.smithi087.stdout: "", 2024-05-08T05:33:47.259 INFO:teuthology.orchestra.run.smithi087.stdout: "critical", 2024-05-08T05:33:47.259 INFO:teuthology.orchestra.run.smithi087.stdout: "debug", 2024-05-08T05:33:47.259 INFO:teuthology.orchestra.run.smithi087.stdout: "error", 2024-05-08T05:33:47.259 INFO:teuthology.orchestra.run.smithi087.stdout: "info", 2024-05-08T05:33:47.259 INFO:teuthology.orchestra.run.smithi087.stdout: "warning" 2024-05-08T05:33:47.260 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-05-08T05:33:47.260 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:47.260 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:47.260 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:47.260 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:47.260 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:47.260 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_cluster": { 2024-05-08T05:33:47.260 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_cluster", 2024-05-08T05:33:47.260 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-08T05:33:47.260 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:47.260 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:47.260 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-05-08T05:33:47.260 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:47.260 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:47.261 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:47.261 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:47.261 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:47.261 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:47.261 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:47.261 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:47.261 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_cluster_level": { 2024-05-08T05:33:47.261 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_cluster_level", 2024-05-08T05:33:47.261 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-08T05:33:47.261 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:47.261 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:47.261 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "info", 2024-05-08T05:33:47.261 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:47.261 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:47.262 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [ 2024-05-08T05:33:47.262 INFO:teuthology.orchestra.run.smithi087.stdout: "", 2024-05-08T05:33:47.262 INFO:teuthology.orchestra.run.smithi087.stdout: "critical", 2024-05-08T05:33:47.262 INFO:teuthology.orchestra.run.smithi087.stdout: "debug", 2024-05-08T05:33:47.262 INFO:teuthology.orchestra.run.smithi087.stdout: "error", 2024-05-08T05:33:47.262 INFO:teuthology.orchestra.run.smithi087.stdout: "info", 2024-05-08T05:33:47.262 INFO:teuthology.orchestra.run.smithi087.stdout: "warning" 2024-05-08T05:33:47.262 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-05-08T05:33:47.262 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:47.262 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:47.262 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:47.262 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:47.262 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:47.263 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_file": { 2024-05-08T05:33:47.263 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_file", 2024-05-08T05:33:47.263 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-08T05:33:47.263 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:47.263 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:47.263 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-05-08T05:33:47.263 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:47.263 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:47.263 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:47.263 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:47.263 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:47.263 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:47.263 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:47.264 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:47.264 INFO:teuthology.orchestra.run.smithi087.stdout: "sqlite3_killpoint": { 2024-05-08T05:33:47.264 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "sqlite3_killpoint", 2024-05-08T05:33:47.264 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "int", 2024-05-08T05:33:47.264 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "dev", 2024-05-08T05:33:47.264 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:47.264 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "0", 2024-05-08T05:33:47.264 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:47.264 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:47.264 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:47.264 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:47.264 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:47.264 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:47.264 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:47.265 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-05-08T05:33:47.265 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-05-08T05:33:47.265 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:47.265 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-05-08T05:33:47.265 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "k8sevents", 2024-05-08T05:33:47.265 INFO:teuthology.orchestra.run.smithi087.stdout: "can_run": true, 2024-05-08T05:33:47.265 INFO:teuthology.orchestra.run.smithi087.stdout: "error_string": "", 2024-05-08T05:33:47.265 INFO:teuthology.orchestra.run.smithi087.stdout: "module_options": { 2024-05-08T05:33:47.265 INFO:teuthology.orchestra.run.smithi087.stdout: "ceph_event_retention_days": { 2024-05-08T05:33:47.265 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "ceph_event_retention_days", 2024-05-08T05:33:47.265 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "int", 2024-05-08T05:33:47.265 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:47.265 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-08T05:33:47.266 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "7", 2024-05-08T05:33:47.266 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:47.266 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:47.266 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:47.266 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "Days to hold ceph event information within local cache", 2024-05-08T05:33:47.266 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:47.266 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:47.266 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:47.266 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:47.266 INFO:teuthology.orchestra.run.smithi087.stdout: "config_check_secs": { 2024-05-08T05:33:47.266 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "config_check_secs", 2024-05-08T05:33:47.266 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "int", 2024-05-08T05:33:47.267 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:47.267 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-08T05:33:47.267 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "10", 2024-05-08T05:33:47.267 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "10", 2024-05-08T05:33:47.267 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:47.267 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:47.267 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2024-05-08T05:33:47.267 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:47.267 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:47.267 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:47.267 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:47.267 INFO:teuthology.orchestra.run.smithi087.stdout: "log_level": { 2024-05-08T05:33:47.267 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_level", 2024-05-08T05:33:47.268 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-08T05:33:47.268 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:47.268 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:47.268 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-05-08T05:33:47.268 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:47.268 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:47.268 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [ 2024-05-08T05:33:47.268 INFO:teuthology.orchestra.run.smithi087.stdout: "", 2024-05-08T05:33:47.268 INFO:teuthology.orchestra.run.smithi087.stdout: "critical", 2024-05-08T05:33:47.268 INFO:teuthology.orchestra.run.smithi087.stdout: "debug", 2024-05-08T05:33:47.268 INFO:teuthology.orchestra.run.smithi087.stdout: "error", 2024-05-08T05:33:47.268 INFO:teuthology.orchestra.run.smithi087.stdout: "info", 2024-05-08T05:33:47.268 INFO:teuthology.orchestra.run.smithi087.stdout: "warning" 2024-05-08T05:33:47.268 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-05-08T05:33:47.269 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:47.269 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:47.269 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:47.269 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:47.269 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:47.269 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_cluster": { 2024-05-08T05:33:47.269 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_cluster", 2024-05-08T05:33:47.269 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-08T05:33:47.269 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:47.269 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:47.269 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-05-08T05:33:47.269 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:47.269 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:47.270 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:47.270 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:47.270 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:47.270 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:47.270 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:47.270 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:47.270 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_cluster_level": { 2024-05-08T05:33:47.270 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_cluster_level", 2024-05-08T05:33:47.270 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-08T05:33:47.270 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:47.270 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:47.270 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "info", 2024-05-08T05:33:47.271 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:47.271 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:47.271 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [ 2024-05-08T05:33:47.271 INFO:teuthology.orchestra.run.smithi087.stdout: "", 2024-05-08T05:33:47.271 INFO:teuthology.orchestra.run.smithi087.stdout: "critical", 2024-05-08T05:33:47.271 INFO:teuthology.orchestra.run.smithi087.stdout: "debug", 2024-05-08T05:33:47.271 INFO:teuthology.orchestra.run.smithi087.stdout: "error", 2024-05-08T05:33:47.271 INFO:teuthology.orchestra.run.smithi087.stdout: "info", 2024-05-08T05:33:47.271 INFO:teuthology.orchestra.run.smithi087.stdout: "warning" 2024-05-08T05:33:47.271 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-05-08T05:33:47.271 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:47.271 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:47.271 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:47.272 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:47.272 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:47.272 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_file": { 2024-05-08T05:33:47.272 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_file", 2024-05-08T05:33:47.272 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-08T05:33:47.272 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:47.272 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:47.272 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-05-08T05:33:47.272 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:47.272 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:47.272 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:47.272 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:47.273 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:47.273 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:47.273 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:47.273 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:47.273 INFO:teuthology.orchestra.run.smithi087.stdout: "sqlite3_killpoint": { 2024-05-08T05:33:47.273 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "sqlite3_killpoint", 2024-05-08T05:33:47.273 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "int", 2024-05-08T05:33:47.273 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "dev", 2024-05-08T05:33:47.273 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:47.273 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "0", 2024-05-08T05:33:47.273 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:47.273 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:47.273 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:47.274 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:47.274 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:47.274 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:47.274 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:47.274 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-05-08T05:33:47.274 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-05-08T05:33:47.274 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:47.274 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-05-08T05:33:47.274 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "localpool", 2024-05-08T05:33:47.274 INFO:teuthology.orchestra.run.smithi087.stdout: "can_run": true, 2024-05-08T05:33:47.274 INFO:teuthology.orchestra.run.smithi087.stdout: "error_string": "", 2024-05-08T05:33:47.274 INFO:teuthology.orchestra.run.smithi087.stdout: "module_options": { 2024-05-08T05:33:47.275 INFO:teuthology.orchestra.run.smithi087.stdout: "failure_domain": { 2024-05-08T05:33:47.275 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "failure_domain", 2024-05-08T05:33:47.275 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-08T05:33:47.275 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:47.275 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:47.275 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "host", 2024-05-08T05:33:47.275 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:47.275 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:47.275 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:47.275 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "failure domain for any created local pool", 2024-05-08T05:33:47.275 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2024-05-08T05:33:47.276 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:47.276 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:47.276 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:47.276 INFO:teuthology.orchestra.run.smithi087.stdout: "log_level": { 2024-05-08T05:33:47.276 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_level", 2024-05-08T05:33:47.276 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-08T05:33:47.276 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:47.276 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:47.276 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-05-08T05:33:47.276 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:47.276 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:47.276 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [ 2024-05-08T05:33:47.276 INFO:teuthology.orchestra.run.smithi087.stdout: "", 2024-05-08T05:33:47.277 INFO:teuthology.orchestra.run.smithi087.stdout: "critical", 2024-05-08T05:33:47.277 INFO:teuthology.orchestra.run.smithi087.stdout: "debug", 2024-05-08T05:33:47.277 INFO:teuthology.orchestra.run.smithi087.stdout: "error", 2024-05-08T05:33:47.277 INFO:teuthology.orchestra.run.smithi087.stdout: "info", 2024-05-08T05:33:47.277 INFO:teuthology.orchestra.run.smithi087.stdout: "warning" 2024-05-08T05:33:47.277 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-05-08T05:33:47.277 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:47.277 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:47.277 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:47.277 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:47.277 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:47.277 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_cluster": { 2024-05-08T05:33:47.277 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_cluster", 2024-05-08T05:33:47.278 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-08T05:33:47.278 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:47.278 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:47.278 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-05-08T05:33:47.278 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:47.278 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:47.278 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:47.278 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:47.278 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:47.278 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:47.278 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:47.278 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:47.279 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_cluster_level": { 2024-05-08T05:33:47.279 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_cluster_level", 2024-05-08T05:33:47.279 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-08T05:33:47.279 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:47.279 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:47.279 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "info", 2024-05-08T05:33:47.279 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:47.279 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:47.279 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [ 2024-05-08T05:33:47.279 INFO:teuthology.orchestra.run.smithi087.stdout: "", 2024-05-08T05:33:47.279 INFO:teuthology.orchestra.run.smithi087.stdout: "critical", 2024-05-08T05:33:47.279 INFO:teuthology.orchestra.run.smithi087.stdout: "debug", 2024-05-08T05:33:47.279 INFO:teuthology.orchestra.run.smithi087.stdout: "error", 2024-05-08T05:33:47.280 INFO:teuthology.orchestra.run.smithi087.stdout: "info", 2024-05-08T05:33:47.280 INFO:teuthology.orchestra.run.smithi087.stdout: "warning" 2024-05-08T05:33:47.280 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-05-08T05:33:47.280 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:47.280 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:47.280 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:47.280 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:47.280 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:47.280 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_file": { 2024-05-08T05:33:47.280 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_file", 2024-05-08T05:33:47.280 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-08T05:33:47.280 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:47.280 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:47.281 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-05-08T05:33:47.281 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:47.281 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:47.281 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:47.281 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:47.281 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:47.281 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:47.281 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:47.281 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:47.281 INFO:teuthology.orchestra.run.smithi087.stdout: "min_size": { 2024-05-08T05:33:47.281 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "min_size", 2024-05-08T05:33:47.281 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "int", 2024-05-08T05:33:47.281 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:47.282 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:47.282 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-05-08T05:33:47.282 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:47.282 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:47.282 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:47.282 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "default min_size for any created local pool", 2024-05-08T05:33:47.282 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2024-05-08T05:33:47.282 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:47.282 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:47.282 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:47.282 INFO:teuthology.orchestra.run.smithi087.stdout: "num_rep": { 2024-05-08T05:33:47.282 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "num_rep", 2024-05-08T05:33:47.283 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "int", 2024-05-08T05:33:47.283 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:47.283 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:47.283 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "3", 2024-05-08T05:33:47.283 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:47.283 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:47.283 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:47.283 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "default replica count for any created local pool", 2024-05-08T05:33:47.283 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:47.283 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:47.283 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:47.283 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:47.284 INFO:teuthology.orchestra.run.smithi087.stdout: "pg_num": { 2024-05-08T05:33:47.284 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "pg_num", 2024-05-08T05:33:47.284 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "int", 2024-05-08T05:33:47.284 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:47.284 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:47.284 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "128", 2024-05-08T05:33:47.284 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:47.284 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:47.284 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:47.284 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "default pg_num for any created local pool", 2024-05-08T05:33:47.284 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:47.284 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:47.285 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:47.285 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:47.285 INFO:teuthology.orchestra.run.smithi087.stdout: "prefix": { 2024-05-08T05:33:47.285 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "prefix", 2024-05-08T05:33:47.285 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-08T05:33:47.285 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:47.285 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:47.285 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-05-08T05:33:47.285 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:47.285 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:47.285 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:47.285 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "name prefix for any created local pool", 2024-05-08T05:33:47.285 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:47.286 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:47.286 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:47.286 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:47.286 INFO:teuthology.orchestra.run.smithi087.stdout: "sqlite3_killpoint": { 2024-05-08T05:33:47.286 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "sqlite3_killpoint", 2024-05-08T05:33:47.286 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "int", 2024-05-08T05:33:47.286 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "dev", 2024-05-08T05:33:47.286 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:47.286 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "0", 2024-05-08T05:33:47.286 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:47.287 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:47.287 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:47.287 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:47.287 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:47.287 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:47.287 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:47.287 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:47.287 INFO:teuthology.orchestra.run.smithi087.stdout: "subtree": { 2024-05-08T05:33:47.287 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "subtree", 2024-05-08T05:33:47.287 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-08T05:33:47.287 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:47.287 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:47.287 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "rack", 2024-05-08T05:33:47.288 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:47.288 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:47.288 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:47.288 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "CRUSH level for which to create a local pool", 2024-05-08T05:33:47.288 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2024-05-08T05:33:47.288 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:47.288 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:47.288 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-05-08T05:33:47.288 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-05-08T05:33:47.288 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:47.288 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-05-08T05:33:47.288 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "mds_autoscaler", 2024-05-08T05:33:47.289 INFO:teuthology.orchestra.run.smithi087.stdout: "can_run": true, 2024-05-08T05:33:47.289 INFO:teuthology.orchestra.run.smithi087.stdout: "error_string": "", 2024-05-08T05:33:47.289 INFO:teuthology.orchestra.run.smithi087.stdout: "module_options": { 2024-05-08T05:33:47.289 INFO:teuthology.orchestra.run.smithi087.stdout: "log_level": { 2024-05-08T05:33:47.289 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_level", 2024-05-08T05:33:47.289 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-08T05:33:47.289 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:47.289 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:47.289 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-05-08T05:33:47.289 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:47.289 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:47.289 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [ 2024-05-08T05:33:47.289 INFO:teuthology.orchestra.run.smithi087.stdout: "", 2024-05-08T05:33:47.290 INFO:teuthology.orchestra.run.smithi087.stdout: "critical", 2024-05-08T05:33:47.290 INFO:teuthology.orchestra.run.smithi087.stdout: "debug", 2024-05-08T05:33:47.290 INFO:teuthology.orchestra.run.smithi087.stdout: "error", 2024-05-08T05:33:47.290 INFO:teuthology.orchestra.run.smithi087.stdout: "info", 2024-05-08T05:33:47.290 INFO:teuthology.orchestra.run.smithi087.stdout: "warning" 2024-05-08T05:33:47.290 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-05-08T05:33:47.290 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:47.290 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:47.290 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:47.290 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:47.290 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:47.290 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_cluster": { 2024-05-08T05:33:47.291 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_cluster", 2024-05-08T05:33:47.291 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-08T05:33:47.291 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:47.291 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:47.291 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-05-08T05:33:47.291 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:47.291 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:47.291 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:47.291 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:47.291 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:47.291 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:47.291 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:47.292 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:47.292 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_cluster_level": { 2024-05-08T05:33:47.292 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_cluster_level", 2024-05-08T05:33:47.292 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-08T05:33:47.292 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:47.292 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:47.292 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "info", 2024-05-08T05:33:47.292 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:47.292 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:47.292 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [ 2024-05-08T05:33:47.292 INFO:teuthology.orchestra.run.smithi087.stdout: "", 2024-05-08T05:33:47.292 INFO:teuthology.orchestra.run.smithi087.stdout: "critical", 2024-05-08T05:33:47.292 INFO:teuthology.orchestra.run.smithi087.stdout: "debug", 2024-05-08T05:33:47.292 INFO:teuthology.orchestra.run.smithi087.stdout: "error", 2024-05-08T05:33:47.293 INFO:teuthology.orchestra.run.smithi087.stdout: "info", 2024-05-08T05:33:47.293 INFO:teuthology.orchestra.run.smithi087.stdout: "warning" 2024-05-08T05:33:47.293 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-05-08T05:33:47.293 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:47.293 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:47.293 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:47.293 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:47.293 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:47.293 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_file": { 2024-05-08T05:33:47.293 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_file", 2024-05-08T05:33:47.293 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-08T05:33:47.293 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:47.293 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:47.293 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-05-08T05:33:47.294 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:47.294 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:47.294 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:47.294 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:47.294 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:47.294 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:47.294 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:47.294 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:47.294 INFO:teuthology.orchestra.run.smithi087.stdout: "sqlite3_killpoint": { 2024-05-08T05:33:47.294 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "sqlite3_killpoint", 2024-05-08T05:33:47.294 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "int", 2024-05-08T05:33:47.294 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "dev", 2024-05-08T05:33:47.294 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:47.295 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "0", 2024-05-08T05:33:47.295 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:47.295 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:47.295 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:47.295 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:47.295 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:47.295 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:47.295 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:47.295 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-05-08T05:33:47.295 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-05-08T05:33:47.295 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:47.295 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-05-08T05:33:47.295 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "mirroring", 2024-05-08T05:33:47.295 INFO:teuthology.orchestra.run.smithi087.stdout: "can_run": true, 2024-05-08T05:33:47.296 INFO:teuthology.orchestra.run.smithi087.stdout: "error_string": "", 2024-05-08T05:33:47.296 INFO:teuthology.orchestra.run.smithi087.stdout: "module_options": { 2024-05-08T05:33:47.296 INFO:teuthology.orchestra.run.smithi087.stdout: "log_level": { 2024-05-08T05:33:47.296 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_level", 2024-05-08T05:33:47.296 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-08T05:33:47.296 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:47.296 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:47.296 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-05-08T05:33:47.296 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:47.296 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:47.296 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [ 2024-05-08T05:33:47.296 INFO:teuthology.orchestra.run.smithi087.stdout: "", 2024-05-08T05:33:47.296 INFO:teuthology.orchestra.run.smithi087.stdout: "critical", 2024-05-08T05:33:47.296 INFO:teuthology.orchestra.run.smithi087.stdout: "debug", 2024-05-08T05:33:47.297 INFO:teuthology.orchestra.run.smithi087.stdout: "error", 2024-05-08T05:33:47.297 INFO:teuthology.orchestra.run.smithi087.stdout: "info", 2024-05-08T05:33:47.297 INFO:teuthology.orchestra.run.smithi087.stdout: "warning" 2024-05-08T05:33:47.297 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-05-08T05:33:47.297 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:47.297 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:47.297 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:47.297 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:47.297 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:47.297 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_cluster": { 2024-05-08T05:33:47.297 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_cluster", 2024-05-08T05:33:47.297 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-08T05:33:47.297 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:47.298 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:47.298 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-05-08T05:33:47.298 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:47.298 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:47.298 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:47.298 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:47.298 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:47.298 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:47.298 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:47.298 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:47.298 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_cluster_level": { 2024-05-08T05:33:47.298 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_cluster_level", 2024-05-08T05:33:47.298 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-08T05:33:47.299 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:47.299 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:47.299 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "info", 2024-05-08T05:33:47.299 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:47.299 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:47.299 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [ 2024-05-08T05:33:47.299 INFO:teuthology.orchestra.run.smithi087.stdout: "", 2024-05-08T05:33:47.299 INFO:teuthology.orchestra.run.smithi087.stdout: "critical", 2024-05-08T05:33:47.299 INFO:teuthology.orchestra.run.smithi087.stdout: "debug", 2024-05-08T05:33:47.299 INFO:teuthology.orchestra.run.smithi087.stdout: "error", 2024-05-08T05:33:47.299 INFO:teuthology.orchestra.run.smithi087.stdout: "info", 2024-05-08T05:33:47.299 INFO:teuthology.orchestra.run.smithi087.stdout: "warning" 2024-05-08T05:33:47.300 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-05-08T05:33:47.300 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:47.300 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:47.300 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:47.300 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:47.300 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:47.300 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_file": { 2024-05-08T05:33:47.300 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_file", 2024-05-08T05:33:47.300 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-08T05:33:47.300 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:47.300 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:47.300 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-05-08T05:33:47.301 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:47.301 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:47.301 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:47.301 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:47.301 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:47.301 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:47.301 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:47.301 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:47.301 INFO:teuthology.orchestra.run.smithi087.stdout: "sqlite3_killpoint": { 2024-05-08T05:33:47.301 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "sqlite3_killpoint", 2024-05-08T05:33:47.301 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "int", 2024-05-08T05:33:47.301 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "dev", 2024-05-08T05:33:47.301 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:47.301 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "0", 2024-05-08T05:33:47.302 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:47.302 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:47.302 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:47.302 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:47.302 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:47.302 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:47.302 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:47.302 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-05-08T05:33:47.302 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-05-08T05:33:47.302 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:47.302 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-05-08T05:33:47.303 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "nfs", 2024-05-08T05:33:47.303 INFO:teuthology.orchestra.run.smithi087.stdout: "can_run": true, 2024-05-08T05:33:47.303 INFO:teuthology.orchestra.run.smithi087.stdout: "error_string": "", 2024-05-08T05:33:47.303 INFO:teuthology.orchestra.run.smithi087.stdout: "module_options": { 2024-05-08T05:33:47.303 INFO:teuthology.orchestra.run.smithi087.stdout: "log_level": { 2024-05-08T05:33:47.303 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_level", 2024-05-08T05:33:47.303 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-08T05:33:47.303 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:47.303 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:47.303 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-05-08T05:33:47.303 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:47.303 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:47.303 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [ 2024-05-08T05:33:47.304 INFO:teuthology.orchestra.run.smithi087.stdout: "", 2024-05-08T05:33:47.304 INFO:teuthology.orchestra.run.smithi087.stdout: "critical", 2024-05-08T05:33:47.304 INFO:teuthology.orchestra.run.smithi087.stdout: "debug", 2024-05-08T05:33:47.304 INFO:teuthology.orchestra.run.smithi087.stdout: "error", 2024-05-08T05:33:47.304 INFO:teuthology.orchestra.run.smithi087.stdout: "info", 2024-05-08T05:33:47.304 INFO:teuthology.orchestra.run.smithi087.stdout: "warning" 2024-05-08T05:33:47.304 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-05-08T05:33:47.304 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:47.304 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:47.304 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:47.304 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:47.304 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:47.305 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_cluster": { 2024-05-08T05:33:47.305 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_cluster", 2024-05-08T05:33:47.305 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-08T05:33:47.305 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:47.305 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:47.305 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-05-08T05:33:47.305 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:47.305 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:47.305 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:47.305 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:47.305 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:47.305 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:47.306 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:47.306 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:47.306 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_cluster_level": { 2024-05-08T05:33:47.306 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_cluster_level", 2024-05-08T05:33:47.306 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-08T05:33:47.306 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:47.306 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:47.306 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "info", 2024-05-08T05:33:47.306 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:47.306 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:47.306 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [ 2024-05-08T05:33:47.306 INFO:teuthology.orchestra.run.smithi087.stdout: "", 2024-05-08T05:33:47.307 INFO:teuthology.orchestra.run.smithi087.stdout: "critical", 2024-05-08T05:33:47.307 INFO:teuthology.orchestra.run.smithi087.stdout: "debug", 2024-05-08T05:33:47.307 INFO:teuthology.orchestra.run.smithi087.stdout: "error", 2024-05-08T05:33:47.307 INFO:teuthology.orchestra.run.smithi087.stdout: "info", 2024-05-08T05:33:47.307 INFO:teuthology.orchestra.run.smithi087.stdout: "warning" 2024-05-08T05:33:47.307 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-05-08T05:33:47.307 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:47.307 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:47.307 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:47.307 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:47.307 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:47.307 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_file": { 2024-05-08T05:33:47.308 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_file", 2024-05-08T05:33:47.308 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-08T05:33:47.308 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:47.308 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:47.308 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-05-08T05:33:47.308 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:47.308 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:47.308 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:47.308 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:47.308 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:47.308 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:47.308 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:47.308 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:47.309 INFO:teuthology.orchestra.run.smithi087.stdout: "sqlite3_killpoint": { 2024-05-08T05:33:47.309 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "sqlite3_killpoint", 2024-05-08T05:33:47.309 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "int", 2024-05-08T05:33:47.309 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "dev", 2024-05-08T05:33:47.309 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:47.309 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "0", 2024-05-08T05:33:47.309 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:47.309 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:47.309 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:47.309 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:47.309 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:47.309 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:47.309 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:47.309 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-05-08T05:33:47.310 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-05-08T05:33:47.310 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:47.310 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-05-08T05:33:47.310 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "orchestrator", 2024-05-08T05:33:47.310 INFO:teuthology.orchestra.run.smithi087.stdout: "can_run": true, 2024-05-08T05:33:47.310 INFO:teuthology.orchestra.run.smithi087.stdout: "error_string": "", 2024-05-08T05:33:47.310 INFO:teuthology.orchestra.run.smithi087.stdout: "module_options": { 2024-05-08T05:33:47.310 INFO:teuthology.orchestra.run.smithi087.stdout: "fail_fs": { 2024-05-08T05:33:47.310 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "fail_fs", 2024-05-08T05:33:47.310 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-08T05:33:47.310 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:47.310 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-08T05:33:47.310 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-05-08T05:33:47.310 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:47.311 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:47.311 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:47.311 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2024-05-08T05:33:47.311 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:47.311 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:47.311 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:47.311 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:47.311 INFO:teuthology.orchestra.run.smithi087.stdout: "log_level": { 2024-05-08T05:33:47.311 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_level", 2024-05-08T05:33:47.311 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-08T05:33:47.311 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:47.311 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:47.311 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-05-08T05:33:47.311 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:47.312 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:47.312 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [ 2024-05-08T05:33:47.312 INFO:teuthology.orchestra.run.smithi087.stdout: "", 2024-05-08T05:33:47.312 INFO:teuthology.orchestra.run.smithi087.stdout: "critical", 2024-05-08T05:33:47.312 INFO:teuthology.orchestra.run.smithi087.stdout: "debug", 2024-05-08T05:33:47.312 INFO:teuthology.orchestra.run.smithi087.stdout: "error", 2024-05-08T05:33:47.312 INFO:teuthology.orchestra.run.smithi087.stdout: "info", 2024-05-08T05:33:47.312 INFO:teuthology.orchestra.run.smithi087.stdout: "warning" 2024-05-08T05:33:47.312 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-05-08T05:33:47.312 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:47.312 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:47.312 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:47.312 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:47.312 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:47.313 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_cluster": { 2024-05-08T05:33:47.313 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_cluster", 2024-05-08T05:33:47.313 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-08T05:33:47.313 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:47.313 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:47.313 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-05-08T05:33:47.313 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:47.313 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:47.313 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:47.313 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:47.313 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:47.313 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:47.313 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:47.314 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:47.314 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_cluster_level": { 2024-05-08T05:33:47.314 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_cluster_level", 2024-05-08T05:33:47.314 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-08T05:33:47.314 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:47.314 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:47.314 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "info", 2024-05-08T05:33:47.314 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:47.314 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:47.314 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [ 2024-05-08T05:33:47.314 INFO:teuthology.orchestra.run.smithi087.stdout: "", 2024-05-08T05:33:47.314 INFO:teuthology.orchestra.run.smithi087.stdout: "critical", 2024-05-08T05:33:47.315 INFO:teuthology.orchestra.run.smithi087.stdout: "debug", 2024-05-08T05:33:47.315 INFO:teuthology.orchestra.run.smithi087.stdout: "error", 2024-05-08T05:33:47.315 INFO:teuthology.orchestra.run.smithi087.stdout: "info", 2024-05-08T05:33:47.315 INFO:teuthology.orchestra.run.smithi087.stdout: "warning" 2024-05-08T05:33:47.315 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-05-08T05:33:47.315 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:47.315 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:47.315 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:47.315 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:47.315 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:47.315 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_file": { 2024-05-08T05:33:47.315 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_file", 2024-05-08T05:33:47.315 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-08T05:33:47.315 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:47.316 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:47.316 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-05-08T05:33:47.316 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:47.316 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:47.316 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:47.316 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:47.316 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:47.316 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:47.316 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:47.316 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:47.316 INFO:teuthology.orchestra.run.smithi087.stdout: "orchestrator": { 2024-05-08T05:33:47.316 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "orchestrator", 2024-05-08T05:33:47.316 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-08T05:33:47.317 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:47.317 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:47.317 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-05-08T05:33:47.317 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:47.317 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:47.317 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [ 2024-05-08T05:33:47.317 INFO:teuthology.orchestra.run.smithi087.stdout: "cephadm", 2024-05-08T05:33:47.317 INFO:teuthology.orchestra.run.smithi087.stdout: "rook", 2024-05-08T05:33:47.317 INFO:teuthology.orchestra.run.smithi087.stdout: "test_orchestrator" 2024-05-08T05:33:47.317 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-05-08T05:33:47.317 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "Orchestrator backend", 2024-05-08T05:33:47.317 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:47.317 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:47.318 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:47.318 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:47.318 INFO:teuthology.orchestra.run.smithi087.stdout: "sqlite3_killpoint": { 2024-05-08T05:33:47.318 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "sqlite3_killpoint", 2024-05-08T05:33:47.318 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "int", 2024-05-08T05:33:47.318 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "dev", 2024-05-08T05:33:47.318 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:47.318 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "0", 2024-05-08T05:33:47.318 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:47.318 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:47.318 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:47.318 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:47.319 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:47.319 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:47.319 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:47.319 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-05-08T05:33:47.319 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-05-08T05:33:47.319 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:47.319 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-05-08T05:33:47.319 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "osd_perf_query", 2024-05-08T05:33:47.319 INFO:teuthology.orchestra.run.smithi087.stdout: "can_run": true, 2024-05-08T05:33:47.319 INFO:teuthology.orchestra.run.smithi087.stdout: "error_string": "", 2024-05-08T05:33:47.319 INFO:teuthology.orchestra.run.smithi087.stdout: "module_options": { 2024-05-08T05:33:47.319 INFO:teuthology.orchestra.run.smithi087.stdout: "log_level": { 2024-05-08T05:33:47.320 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_level", 2024-05-08T05:33:47.320 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-08T05:33:47.320 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:47.320 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:47.320 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-05-08T05:33:47.320 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:47.320 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:47.320 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [ 2024-05-08T05:33:47.320 INFO:teuthology.orchestra.run.smithi087.stdout: "", 2024-05-08T05:33:47.320 INFO:teuthology.orchestra.run.smithi087.stdout: "critical", 2024-05-08T05:33:47.320 INFO:teuthology.orchestra.run.smithi087.stdout: "debug", 2024-05-08T05:33:47.320 INFO:teuthology.orchestra.run.smithi087.stdout: "error", 2024-05-08T05:33:47.321 INFO:teuthology.orchestra.run.smithi087.stdout: "info", 2024-05-08T05:33:47.321 INFO:teuthology.orchestra.run.smithi087.stdout: "warning" 2024-05-08T05:33:47.321 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-05-08T05:33:47.321 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:47.321 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:47.321 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:47.321 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:47.321 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:47.321 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_cluster": { 2024-05-08T05:33:47.321 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_cluster", 2024-05-08T05:33:47.321 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-08T05:33:47.321 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:47.322 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:47.322 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-05-08T05:33:47.322 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:47.322 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:47.322 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:47.322 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:47.322 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:47.322 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:47.322 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:47.322 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:47.322 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_cluster_level": { 2024-05-08T05:33:47.323 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_cluster_level", 2024-05-08T05:33:47.323 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-08T05:33:47.323 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:47.323 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:47.323 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "info", 2024-05-08T05:33:47.323 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:47.323 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:47.323 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [ 2024-05-08T05:33:47.323 INFO:teuthology.orchestra.run.smithi087.stdout: "", 2024-05-08T05:33:47.323 INFO:teuthology.orchestra.run.smithi087.stdout: "critical", 2024-05-08T05:33:47.323 INFO:teuthology.orchestra.run.smithi087.stdout: "debug", 2024-05-08T05:33:47.323 INFO:teuthology.orchestra.run.smithi087.stdout: "error", 2024-05-08T05:33:47.323 INFO:teuthology.orchestra.run.smithi087.stdout: "info", 2024-05-08T05:33:47.323 INFO:teuthology.orchestra.run.smithi087.stdout: "warning" 2024-05-08T05:33:47.324 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-05-08T05:33:47.324 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:47.324 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:47.324 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:47.324 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:47.324 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:47.324 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_file": { 2024-05-08T05:33:47.324 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_file", 2024-05-08T05:33:47.324 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-08T05:33:47.324 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:47.324 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:47.324 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-05-08T05:33:47.324 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:47.324 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:47.325 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:47.325 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:47.325 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:47.325 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:47.325 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:47.325 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:47.325 INFO:teuthology.orchestra.run.smithi087.stdout: "sqlite3_killpoint": { 2024-05-08T05:33:47.325 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "sqlite3_killpoint", 2024-05-08T05:33:47.325 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "int", 2024-05-08T05:33:47.325 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "dev", 2024-05-08T05:33:47.325 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:47.325 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "0", 2024-05-08T05:33:47.325 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:47.326 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:47.326 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:47.326 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:47.326 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:47.326 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:47.326 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:47.326 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-05-08T05:33:47.326 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-05-08T05:33:47.326 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:47.326 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-05-08T05:33:47.326 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "osd_support", 2024-05-08T05:33:47.326 INFO:teuthology.orchestra.run.smithi087.stdout: "can_run": true, 2024-05-08T05:33:47.327 INFO:teuthology.orchestra.run.smithi087.stdout: "error_string": "", 2024-05-08T05:33:47.327 INFO:teuthology.orchestra.run.smithi087.stdout: "module_options": { 2024-05-08T05:33:47.327 INFO:teuthology.orchestra.run.smithi087.stdout: "log_level": { 2024-05-08T05:33:47.327 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_level", 2024-05-08T05:33:47.327 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-08T05:33:47.327 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:47.327 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:47.327 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-05-08T05:33:47.327 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:47.327 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:47.327 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [ 2024-05-08T05:33:47.327 INFO:teuthology.orchestra.run.smithi087.stdout: "", 2024-05-08T05:33:47.327 INFO:teuthology.orchestra.run.smithi087.stdout: "critical", 2024-05-08T05:33:47.328 INFO:teuthology.orchestra.run.smithi087.stdout: "debug", 2024-05-08T05:33:47.328 INFO:teuthology.orchestra.run.smithi087.stdout: "error", 2024-05-08T05:33:47.328 INFO:teuthology.orchestra.run.smithi087.stdout: "info", 2024-05-08T05:33:47.328 INFO:teuthology.orchestra.run.smithi087.stdout: "warning" 2024-05-08T05:33:47.328 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-05-08T05:33:47.328 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:47.328 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:47.328 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:47.328 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:47.328 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:47.328 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_cluster": { 2024-05-08T05:33:47.328 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_cluster", 2024-05-08T05:33:47.329 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-08T05:33:47.329 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:47.329 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:47.329 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-05-08T05:33:47.329 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:47.329 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:47.329 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:47.329 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:47.329 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:47.329 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:47.329 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:47.329 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:47.329 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_cluster_level": { 2024-05-08T05:33:47.329 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_cluster_level", 2024-05-08T05:33:47.330 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-08T05:33:47.330 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:47.330 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:47.330 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "info", 2024-05-08T05:33:47.330 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:47.330 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:47.330 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [ 2024-05-08T05:33:47.330 INFO:teuthology.orchestra.run.smithi087.stdout: "", 2024-05-08T05:33:47.330 INFO:teuthology.orchestra.run.smithi087.stdout: "critical", 2024-05-08T05:33:47.330 INFO:teuthology.orchestra.run.smithi087.stdout: "debug", 2024-05-08T05:33:47.330 INFO:teuthology.orchestra.run.smithi087.stdout: "error", 2024-05-08T05:33:47.330 INFO:teuthology.orchestra.run.smithi087.stdout: "info", 2024-05-08T05:33:47.331 INFO:teuthology.orchestra.run.smithi087.stdout: "warning" 2024-05-08T05:33:47.331 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-05-08T05:33:47.331 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:47.331 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:47.331 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:47.331 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:47.331 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:47.331 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_file": { 2024-05-08T05:33:47.331 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_file", 2024-05-08T05:33:47.331 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-08T05:33:47.331 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:47.331 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:47.332 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-05-08T05:33:47.332 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:47.332 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:47.332 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:47.332 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:47.332 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:47.332 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:47.332 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:47.332 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:47.332 INFO:teuthology.orchestra.run.smithi087.stdout: "sqlite3_killpoint": { 2024-05-08T05:33:47.332 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "sqlite3_killpoint", 2024-05-08T05:33:47.332 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "int", 2024-05-08T05:33:47.333 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "dev", 2024-05-08T05:33:47.333 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:47.333 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "0", 2024-05-08T05:33:47.333 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:47.333 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:47.333 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:47.333 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:47.333 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:47.333 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:47.333 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:47.333 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-05-08T05:33:47.333 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-05-08T05:33:47.334 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:47.334 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-05-08T05:33:47.334 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "pg_autoscaler", 2024-05-08T05:33:47.334 INFO:teuthology.orchestra.run.smithi087.stdout: "can_run": true, 2024-05-08T05:33:47.334 INFO:teuthology.orchestra.run.smithi087.stdout: "error_string": "", 2024-05-08T05:33:47.334 INFO:teuthology.orchestra.run.smithi087.stdout: "module_options": { 2024-05-08T05:33:47.334 INFO:teuthology.orchestra.run.smithi087.stdout: "log_level": { 2024-05-08T05:33:47.334 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_level", 2024-05-08T05:33:47.334 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-08T05:33:47.334 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:47.334 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:47.334 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-05-08T05:33:47.335 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:47.335 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:47.335 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [ 2024-05-08T05:33:47.335 INFO:teuthology.orchestra.run.smithi087.stdout: "", 2024-05-08T05:33:47.335 INFO:teuthology.orchestra.run.smithi087.stdout: "critical", 2024-05-08T05:33:47.335 INFO:teuthology.orchestra.run.smithi087.stdout: "debug", 2024-05-08T05:33:47.335 INFO:teuthology.orchestra.run.smithi087.stdout: "error", 2024-05-08T05:33:47.335 INFO:teuthology.orchestra.run.smithi087.stdout: "info", 2024-05-08T05:33:47.335 INFO:teuthology.orchestra.run.smithi087.stdout: "warning" 2024-05-08T05:33:47.335 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-05-08T05:33:47.335 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:47.335 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:47.335 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:47.336 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:47.336 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:47.336 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_cluster": { 2024-05-08T05:33:47.336 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_cluster", 2024-05-08T05:33:47.336 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-08T05:33:47.336 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:47.336 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:47.336 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-05-08T05:33:47.336 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:47.336 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:47.336 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:47.336 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:47.337 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:47.337 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:47.337 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:47.337 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:47.337 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_cluster_level": { 2024-05-08T05:33:47.337 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_cluster_level", 2024-05-08T05:33:47.337 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-08T05:33:47.337 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:47.337 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:47.337 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "info", 2024-05-08T05:33:47.337 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:47.337 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:47.337 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [ 2024-05-08T05:33:47.338 INFO:teuthology.orchestra.run.smithi087.stdout: "", 2024-05-08T05:33:47.338 INFO:teuthology.orchestra.run.smithi087.stdout: "critical", 2024-05-08T05:33:47.338 INFO:teuthology.orchestra.run.smithi087.stdout: "debug", 2024-05-08T05:33:47.338 INFO:teuthology.orchestra.run.smithi087.stdout: "error", 2024-05-08T05:33:47.338 INFO:teuthology.orchestra.run.smithi087.stdout: "info", 2024-05-08T05:33:47.338 INFO:teuthology.orchestra.run.smithi087.stdout: "warning" 2024-05-08T05:33:47.338 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-05-08T05:33:47.338 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:47.338 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:47.338 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:47.338 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:47.338 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:47.338 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_file": { 2024-05-08T05:33:47.339 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_file", 2024-05-08T05:33:47.339 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-08T05:33:47.339 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:47.339 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:47.339 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-05-08T05:33:47.339 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:47.339 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:47.339 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:47.339 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:47.339 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:47.339 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:47.340 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:47.340 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:47.340 INFO:teuthology.orchestra.run.smithi087.stdout: "sleep_interval": { 2024-05-08T05:33:47.340 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "sleep_interval", 2024-05-08T05:33:47.340 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "secs", 2024-05-08T05:33:47.340 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:47.340 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-08T05:33:47.340 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "60", 2024-05-08T05:33:47.340 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:47.340 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:47.340 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:47.340 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:47.341 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:47.341 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:47.341 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:47.341 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:47.341 INFO:teuthology.orchestra.run.smithi087.stdout: "sqlite3_killpoint": { 2024-05-08T05:33:47.341 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "sqlite3_killpoint", 2024-05-08T05:33:47.341 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "int", 2024-05-08T05:33:47.341 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "dev", 2024-05-08T05:33:47.341 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:47.341 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "0", 2024-05-08T05:33:47.341 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:47.341 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:47.341 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:47.342 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:47.342 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:47.342 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:47.342 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:47.342 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:47.342 INFO:teuthology.orchestra.run.smithi087.stdout: "threshold": { 2024-05-08T05:33:47.342 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "threshold", 2024-05-08T05:33:47.342 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "float", 2024-05-08T05:33:47.342 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:47.342 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-08T05:33:47.342 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "3.0", 2024-05-08T05:33:47.342 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "1.0", 2024-05-08T05:33:47.343 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:47.343 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:47.343 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "scaling threshold", 2024-05-08T05:33:47.343 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2024-05-08T05:33:47.343 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:47.343 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:47.343 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-05-08T05:33:47.343 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-05-08T05:33:47.343 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:47.343 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-05-08T05:33:47.343 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "progress", 2024-05-08T05:33:47.343 INFO:teuthology.orchestra.run.smithi087.stdout: "can_run": true, 2024-05-08T05:33:47.344 INFO:teuthology.orchestra.run.smithi087.stdout: "error_string": "", 2024-05-08T05:33:47.344 INFO:teuthology.orchestra.run.smithi087.stdout: "module_options": { 2024-05-08T05:33:47.344 INFO:teuthology.orchestra.run.smithi087.stdout: "allow_pg_recovery_event": { 2024-05-08T05:33:47.344 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "allow_pg_recovery_event", 2024-05-08T05:33:47.344 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-08T05:33:47.344 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:47.344 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:47.344 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-05-08T05:33:47.344 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:47.344 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:47.344 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:47.344 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "allow the module to show pg recovery progress", 2024-05-08T05:33:47.345 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:47.345 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:47.345 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:47.345 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:47.345 INFO:teuthology.orchestra.run.smithi087.stdout: "enabled": { 2024-05-08T05:33:47.345 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "enabled", 2024-05-08T05:33:47.345 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-08T05:33:47.345 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:47.345 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-08T05:33:47.345 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "True", 2024-05-08T05:33:47.345 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:47.345 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:47.346 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:47.346 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:47.346 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:47.346 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:47.346 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:47.346 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:47.346 INFO:teuthology.orchestra.run.smithi087.stdout: "log_level": { 2024-05-08T05:33:47.346 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_level", 2024-05-08T05:33:47.346 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-08T05:33:47.346 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:47.346 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:47.346 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-05-08T05:33:47.346 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:47.347 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:47.347 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [ 2024-05-08T05:33:47.347 INFO:teuthology.orchestra.run.smithi087.stdout: "", 2024-05-08T05:33:47.347 INFO:teuthology.orchestra.run.smithi087.stdout: "critical", 2024-05-08T05:33:47.347 INFO:teuthology.orchestra.run.smithi087.stdout: "debug", 2024-05-08T05:33:47.347 INFO:teuthology.orchestra.run.smithi087.stdout: "error", 2024-05-08T05:33:47.347 INFO:teuthology.orchestra.run.smithi087.stdout: "info", 2024-05-08T05:33:47.347 INFO:teuthology.orchestra.run.smithi087.stdout: "warning" 2024-05-08T05:33:47.347 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-05-08T05:33:47.347 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:47.347 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:47.347 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:47.348 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:47.348 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:47.348 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_cluster": { 2024-05-08T05:33:47.348 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_cluster", 2024-05-08T05:33:47.348 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-08T05:33:47.348 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:47.348 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:47.348 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-05-08T05:33:47.348 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:47.348 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:47.348 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:47.348 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:47.348 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:47.349 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:47.349 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:47.349 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:47.349 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_cluster_level": { 2024-05-08T05:33:47.349 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_cluster_level", 2024-05-08T05:33:47.349 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-08T05:33:47.349 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:47.349 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:47.349 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "info", 2024-05-08T05:33:47.349 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:47.349 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:47.350 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [ 2024-05-08T05:33:47.350 INFO:teuthology.orchestra.run.smithi087.stdout: "", 2024-05-08T05:33:47.350 INFO:teuthology.orchestra.run.smithi087.stdout: "critical", 2024-05-08T05:33:47.350 INFO:teuthology.orchestra.run.smithi087.stdout: "debug", 2024-05-08T05:33:47.350 INFO:teuthology.orchestra.run.smithi087.stdout: "error", 2024-05-08T05:33:47.350 INFO:teuthology.orchestra.run.smithi087.stdout: "info", 2024-05-08T05:33:47.350 INFO:teuthology.orchestra.run.smithi087.stdout: "warning" 2024-05-08T05:33:47.350 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-05-08T05:33:47.350 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:47.350 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:47.350 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:47.350 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:47.350 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:47.351 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_file": { 2024-05-08T05:33:47.351 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_file", 2024-05-08T05:33:47.351 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-08T05:33:47.351 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:47.351 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:47.351 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-05-08T05:33:47.351 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:47.351 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:47.351 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:47.351 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:47.351 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:47.351 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:47.351 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:47.351 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:47.352 INFO:teuthology.orchestra.run.smithi087.stdout: "max_completed_events": { 2024-05-08T05:33:47.352 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "max_completed_events", 2024-05-08T05:33:47.352 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "int", 2024-05-08T05:33:47.352 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:47.352 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:47.352 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "50", 2024-05-08T05:33:47.352 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:47.352 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:47.352 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:47.352 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "number of past completed events to remember", 2024-05-08T05:33:47.352 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:47.352 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:47.353 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:47.353 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:47.353 INFO:teuthology.orchestra.run.smithi087.stdout: "sleep_interval": { 2024-05-08T05:33:47.353 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "sleep_interval", 2024-05-08T05:33:47.353 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "secs", 2024-05-08T05:33:47.353 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:47.353 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:47.353 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "5", 2024-05-08T05:33:47.353 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:47.353 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:47.353 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:47.353 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "how long the module is going to sleep", 2024-05-08T05:33:47.354 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:47.354 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:47.354 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:47.354 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:47.354 INFO:teuthology.orchestra.run.smithi087.stdout: "sqlite3_killpoint": { 2024-05-08T05:33:47.354 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "sqlite3_killpoint", 2024-05-08T05:33:47.354 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "int", 2024-05-08T05:33:47.354 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "dev", 2024-05-08T05:33:47.354 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:47.354 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "0", 2024-05-08T05:33:47.354 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:47.354 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:47.355 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:47.355 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:47.355 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:47.355 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:47.355 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:47.355 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-05-08T05:33:47.355 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-05-08T05:33:47.355 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:47.355 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-05-08T05:33:47.355 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "prometheus", 2024-05-08T05:33:47.355 INFO:teuthology.orchestra.run.smithi087.stdout: "can_run": true, 2024-05-08T05:33:47.355 INFO:teuthology.orchestra.run.smithi087.stdout: "error_string": "", 2024-05-08T05:33:47.356 INFO:teuthology.orchestra.run.smithi087.stdout: "module_options": { 2024-05-08T05:33:47.356 INFO:teuthology.orchestra.run.smithi087.stdout: "cache": { 2024-05-08T05:33:47.356 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "cache", 2024-05-08T05:33:47.356 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-08T05:33:47.356 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:47.356 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-08T05:33:47.356 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "True", 2024-05-08T05:33:47.356 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:47.356 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:47.356 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:47.356 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:47.356 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:47.357 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:47.357 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:47.357 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:47.357 INFO:teuthology.orchestra.run.smithi087.stdout: "exclude_perf_counters": { 2024-05-08T05:33:47.357 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "exclude_perf_counters", 2024-05-08T05:33:47.357 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-08T05:33:47.357 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:47.357 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:47.357 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "True", 2024-05-08T05:33:47.357 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:47.357 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:47.357 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:47.358 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "Do not include perf-counters in the metrics output", 2024-05-08T05:33:47.358 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2024-05-08T05:33:47.358 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:47.358 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:47.358 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:47.358 INFO:teuthology.orchestra.run.smithi087.stdout: "log_level": { 2024-05-08T05:33:47.358 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_level", 2024-05-08T05:33:47.358 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-08T05:33:47.358 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:47.358 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:47.358 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-05-08T05:33:47.359 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:47.359 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:47.359 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [ 2024-05-08T05:33:47.359 INFO:teuthology.orchestra.run.smithi087.stdout: "", 2024-05-08T05:33:47.359 INFO:teuthology.orchestra.run.smithi087.stdout: "critical", 2024-05-08T05:33:47.359 INFO:teuthology.orchestra.run.smithi087.stdout: "debug", 2024-05-08T05:33:47.359 INFO:teuthology.orchestra.run.smithi087.stdout: "error", 2024-05-08T05:33:47.359 INFO:teuthology.orchestra.run.smithi087.stdout: "info", 2024-05-08T05:33:47.359 INFO:teuthology.orchestra.run.smithi087.stdout: "warning" 2024-05-08T05:33:47.359 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-05-08T05:33:47.359 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:47.359 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:47.360 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:47.360 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:47.360 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:47.360 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_cluster": { 2024-05-08T05:33:47.360 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_cluster", 2024-05-08T05:33:47.360 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-08T05:33:47.360 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:47.360 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:47.360 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-05-08T05:33:47.360 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:47.360 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:47.360 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:47.361 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:47.361 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:47.361 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:47.361 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:47.361 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:47.361 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_cluster_level": { 2024-05-08T05:33:47.361 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_cluster_level", 2024-05-08T05:33:47.361 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-08T05:33:47.361 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:47.361 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:47.361 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "info", 2024-05-08T05:33:47.361 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:47.362 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:47.362 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [ 2024-05-08T05:33:47.362 INFO:teuthology.orchestra.run.smithi087.stdout: "", 2024-05-08T05:33:47.362 INFO:teuthology.orchestra.run.smithi087.stdout: "critical", 2024-05-08T05:33:47.362 INFO:teuthology.orchestra.run.smithi087.stdout: "debug", 2024-05-08T05:33:47.362 INFO:teuthology.orchestra.run.smithi087.stdout: "error", 2024-05-08T05:33:47.362 INFO:teuthology.orchestra.run.smithi087.stdout: "info", 2024-05-08T05:33:47.362 INFO:teuthology.orchestra.run.smithi087.stdout: "warning" 2024-05-08T05:33:47.362 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-05-08T05:33:47.362 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:47.362 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:47.362 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:47.363 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:47.363 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:47.363 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_file": { 2024-05-08T05:33:47.363 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_file", 2024-05-08T05:33:47.363 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-08T05:33:47.363 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:47.363 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:47.363 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-05-08T05:33:47.363 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:47.363 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:47.363 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:47.363 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:47.363 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:47.364 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:47.364 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:47.364 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:47.364 INFO:teuthology.orchestra.run.smithi087.stdout: "rbd_stats_pools": { 2024-05-08T05:33:47.364 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "rbd_stats_pools", 2024-05-08T05:33:47.364 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-08T05:33:47.364 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:47.364 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-08T05:33:47.364 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-05-08T05:33:47.364 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:47.364 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:47.364 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:47.365 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:47.365 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:47.365 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:47.365 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:47.365 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:47.365 INFO:teuthology.orchestra.run.smithi087.stdout: "rbd_stats_pools_refresh_interval": { 2024-05-08T05:33:47.365 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "rbd_stats_pools_refresh_interval", 2024-05-08T05:33:47.365 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "int", 2024-05-08T05:33:47.365 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:47.365 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-08T05:33:47.365 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "300", 2024-05-08T05:33:47.365 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:47.366 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:47.366 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:47.366 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:47.366 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:47.366 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:47.366 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:47.366 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:47.366 INFO:teuthology.orchestra.run.smithi087.stdout: "scrape_interval": { 2024-05-08T05:33:47.366 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "scrape_interval", 2024-05-08T05:33:47.366 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "float", 2024-05-08T05:33:47.366 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:47.367 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-08T05:33:47.367 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "15.0", 2024-05-08T05:33:47.367 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:47.367 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:47.367 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:47.367 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:47.367 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:47.367 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:47.367 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:47.367 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:47.367 INFO:teuthology.orchestra.run.smithi087.stdout: "server_addr": { 2024-05-08T05:33:47.367 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "server_addr", 2024-05-08T05:33:47.368 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-08T05:33:47.368 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:47.368 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-08T05:33:47.368 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "::", 2024-05-08T05:33:47.368 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:47.368 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:47.368 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:47.368 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2024-05-08T05:33:47.368 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:47.368 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:47.368 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:47.368 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:47.368 INFO:teuthology.orchestra.run.smithi087.stdout: "server_port": { 2024-05-08T05:33:47.369 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "server_port", 2024-05-08T05:33:47.369 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "int", 2024-05-08T05:33:47.369 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:47.369 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:47.369 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "9283", 2024-05-08T05:33:47.369 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:47.369 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:47.369 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:47.369 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "the port on which the module listens for HTTP requests", 2024-05-08T05:33:47.369 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:47.369 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:47.369 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:47.369 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:47.370 INFO:teuthology.orchestra.run.smithi087.stdout: "sqlite3_killpoint": { 2024-05-08T05:33:47.370 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "sqlite3_killpoint", 2024-05-08T05:33:47.370 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "int", 2024-05-08T05:33:47.370 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "dev", 2024-05-08T05:33:47.370 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:47.370 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "0", 2024-05-08T05:33:47.370 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:47.370 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:47.370 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:47.370 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:47.370 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:47.370 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:47.371 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:47.371 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:47.371 INFO:teuthology.orchestra.run.smithi087.stdout: "stale_cache_strategy": { 2024-05-08T05:33:47.371 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "stale_cache_strategy", 2024-05-08T05:33:47.371 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-08T05:33:47.371 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:47.371 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-08T05:33:47.371 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "log", 2024-05-08T05:33:47.371 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:47.371 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:47.371 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:47.371 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:47.371 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:47.372 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:47.372 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:47.372 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:47.372 INFO:teuthology.orchestra.run.smithi087.stdout: "standby_behaviour": { 2024-05-08T05:33:47.372 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "standby_behaviour", 2024-05-08T05:33:47.372 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-08T05:33:47.372 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:47.372 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:47.372 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "default", 2024-05-08T05:33:47.372 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:47.372 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:47.372 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [ 2024-05-08T05:33:47.372 INFO:teuthology.orchestra.run.smithi087.stdout: "default", 2024-05-08T05:33:47.373 INFO:teuthology.orchestra.run.smithi087.stdout: "error" 2024-05-08T05:33:47.373 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-05-08T05:33:47.373 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:47.373 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:47.373 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:47.373 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:47.373 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:47.373 INFO:teuthology.orchestra.run.smithi087.stdout: "standby_error_status_code": { 2024-05-08T05:33:47.373 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "standby_error_status_code", 2024-05-08T05:33:47.373 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "int", 2024-05-08T05:33:47.373 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:47.373 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:47.374 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "500", 2024-05-08T05:33:47.374 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "400", 2024-05-08T05:33:47.374 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "599", 2024-05-08T05:33:47.374 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:47.374 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:47.374 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:47.374 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:47.374 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:47.374 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-05-08T05:33:47.374 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-05-08T05:33:47.374 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:47.374 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-05-08T05:33:47.375 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "rbd_support", 2024-05-08T05:33:47.375 INFO:teuthology.orchestra.run.smithi087.stdout: "can_run": true, 2024-05-08T05:33:47.375 INFO:teuthology.orchestra.run.smithi087.stdout: "error_string": "", 2024-05-08T05:33:47.375 INFO:teuthology.orchestra.run.smithi087.stdout: "module_options": { 2024-05-08T05:33:47.375 INFO:teuthology.orchestra.run.smithi087.stdout: "log_level": { 2024-05-08T05:33:47.375 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_level", 2024-05-08T05:33:47.375 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-08T05:33:47.375 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:47.375 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:47.375 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-05-08T05:33:47.375 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:47.375 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:47.375 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [ 2024-05-08T05:33:47.376 INFO:teuthology.orchestra.run.smithi087.stdout: "", 2024-05-08T05:33:47.376 INFO:teuthology.orchestra.run.smithi087.stdout: "critical", 2024-05-08T05:33:47.376 INFO:teuthology.orchestra.run.smithi087.stdout: "debug", 2024-05-08T05:33:47.376 INFO:teuthology.orchestra.run.smithi087.stdout: "error", 2024-05-08T05:33:47.376 INFO:teuthology.orchestra.run.smithi087.stdout: "info", 2024-05-08T05:33:47.376 INFO:teuthology.orchestra.run.smithi087.stdout: "warning" 2024-05-08T05:33:47.376 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-05-08T05:33:47.376 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:47.376 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:47.376 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:47.376 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:47.376 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:47.377 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_cluster": { 2024-05-08T05:33:47.377 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_cluster", 2024-05-08T05:33:47.377 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-08T05:33:47.377 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:47.377 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:47.377 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-05-08T05:33:47.377 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:47.377 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:47.377 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:47.377 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:47.377 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:47.377 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:47.378 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:47.378 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:47.378 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_cluster_level": { 2024-05-08T05:33:47.378 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_cluster_level", 2024-05-08T05:33:47.378 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-08T05:33:47.378 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:47.378 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:47.378 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "info", 2024-05-08T05:33:47.378 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:47.378 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:47.378 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [ 2024-05-08T05:33:47.378 INFO:teuthology.orchestra.run.smithi087.stdout: "", 2024-05-08T05:33:47.379 INFO:teuthology.orchestra.run.smithi087.stdout: "critical", 2024-05-08T05:33:47.379 INFO:teuthology.orchestra.run.smithi087.stdout: "debug", 2024-05-08T05:33:47.379 INFO:teuthology.orchestra.run.smithi087.stdout: "error", 2024-05-08T05:33:47.379 INFO:teuthology.orchestra.run.smithi087.stdout: "info", 2024-05-08T05:33:47.379 INFO:teuthology.orchestra.run.smithi087.stdout: "warning" 2024-05-08T05:33:47.379 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-05-08T05:33:47.379 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:47.379 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:47.379 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:47.379 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:47.379 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:47.379 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_file": { 2024-05-08T05:33:47.380 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_file", 2024-05-08T05:33:47.380 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-08T05:33:47.380 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:47.380 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:47.380 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-05-08T05:33:47.380 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:47.380 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:47.380 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:47.380 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:47.380 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:47.380 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:47.380 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:47.381 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:47.381 INFO:teuthology.orchestra.run.smithi087.stdout: "max_concurrent_snap_create": { 2024-05-08T05:33:47.381 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "max_concurrent_snap_create", 2024-05-08T05:33:47.381 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "int", 2024-05-08T05:33:47.381 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:47.381 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-08T05:33:47.381 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "10", 2024-05-08T05:33:47.381 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:47.381 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:47.381 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:47.381 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:47.381 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:47.381 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:47.382 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:47.382 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:47.382 INFO:teuthology.orchestra.run.smithi087.stdout: "mirror_snapshot_schedule": { 2024-05-08T05:33:47.382 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "mirror_snapshot_schedule", 2024-05-08T05:33:47.382 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-08T05:33:47.382 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:47.382 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-08T05:33:47.382 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-05-08T05:33:47.382 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:47.382 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:47.382 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:47.382 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:47.382 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:47.383 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:47.383 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:47.383 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:47.383 INFO:teuthology.orchestra.run.smithi087.stdout: "sqlite3_killpoint": { 2024-05-08T05:33:47.383 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "sqlite3_killpoint", 2024-05-08T05:33:47.383 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "int", 2024-05-08T05:33:47.383 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "dev", 2024-05-08T05:33:47.383 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:47.383 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "0", 2024-05-08T05:33:47.383 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:47.383 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:47.384 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:47.384 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:47.384 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:47.384 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:47.384 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:47.384 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:47.384 INFO:teuthology.orchestra.run.smithi087.stdout: "trash_purge_schedule": { 2024-05-08T05:33:47.384 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "trash_purge_schedule", 2024-05-08T05:33:47.384 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-08T05:33:47.384 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:47.384 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-08T05:33:47.384 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-05-08T05:33:47.384 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:47.385 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:47.385 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:47.385 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:47.385 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:47.385 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:47.385 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:47.385 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-05-08T05:33:47.385 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-05-08T05:33:47.385 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:47.385 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-05-08T05:33:47.385 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "restful", 2024-05-08T05:33:47.385 INFO:teuthology.orchestra.run.smithi087.stdout: "can_run": true, 2024-05-08T05:33:47.385 INFO:teuthology.orchestra.run.smithi087.stdout: "error_string": "", 2024-05-08T05:33:47.386 INFO:teuthology.orchestra.run.smithi087.stdout: "module_options": { 2024-05-08T05:33:47.386 INFO:teuthology.orchestra.run.smithi087.stdout: "enable_auth": { 2024-05-08T05:33:47.386 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "enable_auth", 2024-05-08T05:33:47.386 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-08T05:33:47.386 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:47.386 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-08T05:33:47.386 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "True", 2024-05-08T05:33:47.386 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:47.386 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:47.386 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:47.386 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:47.386 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:47.387 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:47.387 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:47.387 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:47.387 INFO:teuthology.orchestra.run.smithi087.stdout: "key_file": { 2024-05-08T05:33:47.387 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "key_file", 2024-05-08T05:33:47.387 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-08T05:33:47.387 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:47.387 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-08T05:33:47.387 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-05-08T05:33:47.387 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:47.387 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:47.387 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:47.388 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:47.388 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:47.388 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:47.388 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:47.388 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:47.388 INFO:teuthology.orchestra.run.smithi087.stdout: "log_level": { 2024-05-08T05:33:47.388 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_level", 2024-05-08T05:33:47.388 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-08T05:33:47.388 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:47.388 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:47.388 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-05-08T05:33:47.388 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:47.388 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:47.389 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [ 2024-05-08T05:33:47.389 INFO:teuthology.orchestra.run.smithi087.stdout: "", 2024-05-08T05:33:47.389 INFO:teuthology.orchestra.run.smithi087.stdout: "critical", 2024-05-08T05:33:47.389 INFO:teuthology.orchestra.run.smithi087.stdout: "debug", 2024-05-08T05:33:47.389 INFO:teuthology.orchestra.run.smithi087.stdout: "error", 2024-05-08T05:33:47.389 INFO:teuthology.orchestra.run.smithi087.stdout: "info", 2024-05-08T05:33:47.389 INFO:teuthology.orchestra.run.smithi087.stdout: "warning" 2024-05-08T05:33:47.389 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-05-08T05:33:47.389 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:47.389 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:47.389 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:47.389 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:47.389 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:47.390 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_cluster": { 2024-05-08T05:33:47.390 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_cluster", 2024-05-08T05:33:47.390 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-08T05:33:47.390 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:47.390 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:47.390 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-05-08T05:33:47.390 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:47.390 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:47.390 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:47.390 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:47.390 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:47.391 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:47.391 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:47.391 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:47.391 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_cluster_level": { 2024-05-08T05:33:47.391 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_cluster_level", 2024-05-08T05:33:47.391 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-08T05:33:47.391 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:47.391 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:47.391 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "info", 2024-05-08T05:33:47.391 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:47.391 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:47.391 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [ 2024-05-08T05:33:47.392 INFO:teuthology.orchestra.run.smithi087.stdout: "", 2024-05-08T05:33:47.392 INFO:teuthology.orchestra.run.smithi087.stdout: "critical", 2024-05-08T05:33:47.392 INFO:teuthology.orchestra.run.smithi087.stdout: "debug", 2024-05-08T05:33:47.392 INFO:teuthology.orchestra.run.smithi087.stdout: "error", 2024-05-08T05:33:47.392 INFO:teuthology.orchestra.run.smithi087.stdout: "info", 2024-05-08T05:33:47.392 INFO:teuthology.orchestra.run.smithi087.stdout: "warning" 2024-05-08T05:33:47.392 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-05-08T05:33:47.392 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:47.392 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:47.392 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:47.392 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:47.392 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:47.393 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_file": { 2024-05-08T05:33:47.393 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_file", 2024-05-08T05:33:47.393 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-08T05:33:47.393 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:47.393 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:47.393 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-05-08T05:33:47.393 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:47.393 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:47.393 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:47.393 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:47.393 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:47.393 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:47.394 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:47.394 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:47.394 INFO:teuthology.orchestra.run.smithi087.stdout: "server_addr": { 2024-05-08T05:33:47.394 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "server_addr", 2024-05-08T05:33:47.394 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-08T05:33:47.394 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:47.394 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-08T05:33:47.394 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-05-08T05:33:47.394 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:47.394 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:47.394 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:47.394 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:47.394 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:47.395 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:47.395 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:47.395 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:47.395 INFO:teuthology.orchestra.run.smithi087.stdout: "server_port": { 2024-05-08T05:33:47.395 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "server_port", 2024-05-08T05:33:47.395 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-08T05:33:47.395 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:47.395 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-08T05:33:47.395 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-05-08T05:33:47.395 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:47.395 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:47.396 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:47.397 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:33:46 smithi090 ceph-mon[34526]: pgmap v563: 97 pgs: 97 active+clean; 153 MiB data, 986 MiB used, 1.0 TiB / 1.0 TiB avail; 609 KiB/s rd, 571 KiB/s wr, 164 op/s 2024-05-08T05:33:47.397 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:33:46 smithi090 ceph-mon[34526]: from='client.? 172.21.15.87:0/3250649131' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json-pretty"}]: dispatch 2024-05-08T05:33:47.397 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:33:46 smithi160 ceph-mon[34827]: pgmap v563: 97 pgs: 97 active+clean; 153 MiB data, 986 MiB used, 1.0 TiB / 1.0 TiB avail; 609 KiB/s rd, 571 KiB/s wr, 164 op/s 2024-05-08T05:33:47.397 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:33:46 smithi160 ceph-mon[34827]: from='client.? 172.21.15.87:0/3250649131' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json-pretty"}]: dispatch 2024-05-08T05:33:47.398 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:47.398 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:47.398 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:47.398 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:47.398 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:47.398 INFO:teuthology.orchestra.run.smithi087.stdout: "sqlite3_killpoint": { 2024-05-08T05:33:47.398 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "sqlite3_killpoint", 2024-05-08T05:33:47.399 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "int", 2024-05-08T05:33:47.399 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "dev", 2024-05-08T05:33:47.399 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:47.399 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "0", 2024-05-08T05:33:47.399 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:47.399 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:47.399 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:47.399 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:47.399 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:47.399 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:47.399 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:47.399 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-05-08T05:33:47.399 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-05-08T05:33:47.400 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:47.400 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-05-08T05:33:47.400 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "rgw", 2024-05-08T05:33:47.400 INFO:teuthology.orchestra.run.smithi087.stdout: "can_run": true, 2024-05-08T05:33:47.400 INFO:teuthology.orchestra.run.smithi087.stdout: "error_string": "", 2024-05-08T05:33:47.400 INFO:teuthology.orchestra.run.smithi087.stdout: "module_options": { 2024-05-08T05:33:47.400 INFO:teuthology.orchestra.run.smithi087.stdout: "log_level": { 2024-05-08T05:33:47.400 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_level", 2024-05-08T05:33:47.400 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-08T05:33:47.400 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:47.400 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:47.400 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-05-08T05:33:47.400 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:47.401 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:47.401 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [ 2024-05-08T05:33:47.401 INFO:teuthology.orchestra.run.smithi087.stdout: "", 2024-05-08T05:33:47.401 INFO:teuthology.orchestra.run.smithi087.stdout: "critical", 2024-05-08T05:33:47.401 INFO:teuthology.orchestra.run.smithi087.stdout: "debug", 2024-05-08T05:33:47.401 INFO:teuthology.orchestra.run.smithi087.stdout: "error", 2024-05-08T05:33:47.401 INFO:teuthology.orchestra.run.smithi087.stdout: "info", 2024-05-08T05:33:47.401 INFO:teuthology.orchestra.run.smithi087.stdout: "warning" 2024-05-08T05:33:47.401 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-05-08T05:33:47.401 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:47.401 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:47.401 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:47.401 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:47.401 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:47.402 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_cluster": { 2024-05-08T05:33:47.402 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_cluster", 2024-05-08T05:33:47.402 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-08T05:33:47.402 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:47.402 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:47.402 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-05-08T05:33:47.402 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:47.402 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:47.402 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:47.402 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:47.402 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:47.402 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:47.402 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:47.403 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:47.403 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_cluster_level": { 2024-05-08T05:33:47.403 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_cluster_level", 2024-05-08T05:33:47.403 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-08T05:33:47.403 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:47.403 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:47.403 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "info", 2024-05-08T05:33:47.403 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:47.403 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:47.403 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [ 2024-05-08T05:33:47.403 INFO:teuthology.orchestra.run.smithi087.stdout: "", 2024-05-08T05:33:47.403 INFO:teuthology.orchestra.run.smithi087.stdout: "critical", 2024-05-08T05:33:47.404 INFO:teuthology.orchestra.run.smithi087.stdout: "debug", 2024-05-08T05:33:47.404 INFO:teuthology.orchestra.run.smithi087.stdout: "error", 2024-05-08T05:33:47.404 INFO:teuthology.orchestra.run.smithi087.stdout: "info", 2024-05-08T05:33:47.404 INFO:teuthology.orchestra.run.smithi087.stdout: "warning" 2024-05-08T05:33:47.404 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-05-08T05:33:47.404 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:47.404 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:47.404 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:47.404 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:47.404 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:47.404 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_file": { 2024-05-08T05:33:47.404 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_file", 2024-05-08T05:33:47.404 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-08T05:33:47.405 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:47.405 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:47.405 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-05-08T05:33:47.405 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:47.405 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:47.405 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:47.405 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:47.405 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:47.405 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:47.405 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:47.405 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:47.405 INFO:teuthology.orchestra.run.smithi087.stdout: "sqlite3_killpoint": { 2024-05-08T05:33:47.405 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "sqlite3_killpoint", 2024-05-08T05:33:47.406 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "int", 2024-05-08T05:33:47.406 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "dev", 2024-05-08T05:33:47.406 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:47.406 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "0", 2024-05-08T05:33:47.406 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:47.406 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:47.406 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:47.406 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:47.406 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:47.406 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:47.406 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:47.407 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-05-08T05:33:47.407 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-05-08T05:33:47.407 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:47.407 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-05-08T05:33:47.407 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "rook", 2024-05-08T05:33:47.407 INFO:teuthology.orchestra.run.smithi087.stdout: "can_run": true, 2024-05-08T05:33:47.407 INFO:teuthology.orchestra.run.smithi087.stdout: "error_string": "", 2024-05-08T05:33:47.407 INFO:teuthology.orchestra.run.smithi087.stdout: "module_options": { 2024-05-08T05:33:47.407 INFO:teuthology.orchestra.run.smithi087.stdout: "log_level": { 2024-05-08T05:33:47.407 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_level", 2024-05-08T05:33:47.407 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-08T05:33:47.407 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:47.407 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:47.407 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-05-08T05:33:47.408 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:47.408 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:47.408 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [ 2024-05-08T05:33:47.408 INFO:teuthology.orchestra.run.smithi087.stdout: "", 2024-05-08T05:33:47.408 INFO:teuthology.orchestra.run.smithi087.stdout: "critical", 2024-05-08T05:33:47.408 INFO:teuthology.orchestra.run.smithi087.stdout: "debug", 2024-05-08T05:33:47.408 INFO:teuthology.orchestra.run.smithi087.stdout: "error", 2024-05-08T05:33:47.408 INFO:teuthology.orchestra.run.smithi087.stdout: "info", 2024-05-08T05:33:47.408 INFO:teuthology.orchestra.run.smithi087.stdout: "warning" 2024-05-08T05:33:47.408 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-05-08T05:33:47.408 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:47.408 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:47.409 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:47.409 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:47.409 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:47.409 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_cluster": { 2024-05-08T05:33:47.409 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_cluster", 2024-05-08T05:33:47.409 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-08T05:33:47.409 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:47.409 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:47.409 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-05-08T05:33:47.409 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:47.409 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:47.409 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:47.409 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:47.409 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:47.410 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:47.410 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:47.410 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:47.410 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_cluster_level": { 2024-05-08T05:33:47.410 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_cluster_level", 2024-05-08T05:33:47.410 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-08T05:33:47.410 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:47.410 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:47.410 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "info", 2024-05-08T05:33:47.410 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:47.410 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:47.410 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [ 2024-05-08T05:33:47.411 INFO:teuthology.orchestra.run.smithi087.stdout: "", 2024-05-08T05:33:47.411 INFO:teuthology.orchestra.run.smithi087.stdout: "critical", 2024-05-08T05:33:47.411 INFO:teuthology.orchestra.run.smithi087.stdout: "debug", 2024-05-08T05:33:47.411 INFO:teuthology.orchestra.run.smithi087.stdout: "error", 2024-05-08T05:33:47.411 INFO:teuthology.orchestra.run.smithi087.stdout: "info", 2024-05-08T05:33:47.411 INFO:teuthology.orchestra.run.smithi087.stdout: "warning" 2024-05-08T05:33:47.411 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-05-08T05:33:47.411 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:47.411 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:47.411 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:47.411 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:47.412 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:47.412 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_file": { 2024-05-08T05:33:47.412 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_file", 2024-05-08T05:33:47.412 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-08T05:33:47.412 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:47.412 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:47.412 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-05-08T05:33:47.412 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:47.412 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:47.412 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:47.412 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:47.412 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:47.412 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:47.412 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:47.412 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:47.413 INFO:teuthology.orchestra.run.smithi087.stdout: "sqlite3_killpoint": { 2024-05-08T05:33:47.413 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "sqlite3_killpoint", 2024-05-08T05:33:47.413 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "int", 2024-05-08T05:33:47.413 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "dev", 2024-05-08T05:33:47.413 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:47.413 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "0", 2024-05-08T05:33:47.413 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:47.413 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:47.413 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:47.413 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:47.413 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:47.413 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:47.413 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:47.413 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:47.414 INFO:teuthology.orchestra.run.smithi087.stdout: "storage_class": { 2024-05-08T05:33:47.414 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "storage_class", 2024-05-08T05:33:47.414 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-08T05:33:47.414 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:47.414 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-08T05:33:47.414 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "local", 2024-05-08T05:33:47.414 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:47.414 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:47.414 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:47.414 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "storage class name for LSO-discovered PVs", 2024-05-08T05:33:47.414 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:47.414 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:47.415 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:47.415 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-05-08T05:33:47.415 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-05-08T05:33:47.415 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:47.415 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-05-08T05:33:47.415 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "selftest", 2024-05-08T05:33:47.415 INFO:teuthology.orchestra.run.smithi087.stdout: "can_run": true, 2024-05-08T05:33:47.415 INFO:teuthology.orchestra.run.smithi087.stdout: "error_string": "", 2024-05-08T05:33:47.415 INFO:teuthology.orchestra.run.smithi087.stdout: "module_options": { 2024-05-08T05:33:47.415 INFO:teuthology.orchestra.run.smithi087.stdout: "log_level": { 2024-05-08T05:33:47.415 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_level", 2024-05-08T05:33:47.415 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-08T05:33:47.415 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:47.416 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:47.416 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-05-08T05:33:47.416 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:47.416 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:47.416 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [ 2024-05-08T05:33:47.416 INFO:teuthology.orchestra.run.smithi087.stdout: "", 2024-05-08T05:33:47.416 INFO:teuthology.orchestra.run.smithi087.stdout: "critical", 2024-05-08T05:33:47.416 INFO:teuthology.orchestra.run.smithi087.stdout: "debug", 2024-05-08T05:33:47.416 INFO:teuthology.orchestra.run.smithi087.stdout: "error", 2024-05-08T05:33:47.416 INFO:teuthology.orchestra.run.smithi087.stdout: "info", 2024-05-08T05:33:47.416 INFO:teuthology.orchestra.run.smithi087.stdout: "warning" 2024-05-08T05:33:47.416 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-05-08T05:33:47.416 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:47.416 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:47.417 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:47.417 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:47.417 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:47.417 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_cluster": { 2024-05-08T05:33:47.417 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_cluster", 2024-05-08T05:33:47.417 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-08T05:33:47.417 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:47.417 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:47.417 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-05-08T05:33:47.417 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:47.417 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:47.418 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:47.418 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:47.418 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:47.418 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:47.418 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:47.418 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:47.418 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_cluster_level": { 2024-05-08T05:33:47.418 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_cluster_level", 2024-05-08T05:33:47.418 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-08T05:33:47.418 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:47.418 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:47.419 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "info", 2024-05-08T05:33:47.419 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:47.419 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:47.419 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [ 2024-05-08T05:33:47.419 INFO:teuthology.orchestra.run.smithi087.stdout: "", 2024-05-08T05:33:47.419 INFO:teuthology.orchestra.run.smithi087.stdout: "critical", 2024-05-08T05:33:47.419 INFO:teuthology.orchestra.run.smithi087.stdout: "debug", 2024-05-08T05:33:47.419 INFO:teuthology.orchestra.run.smithi087.stdout: "error", 2024-05-08T05:33:47.419 INFO:teuthology.orchestra.run.smithi087.stdout: "info", 2024-05-08T05:33:47.419 INFO:teuthology.orchestra.run.smithi087.stdout: "warning" 2024-05-08T05:33:47.419 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-05-08T05:33:47.419 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:47.419 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:47.420 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:47.420 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:47.420 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:47.420 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_file": { 2024-05-08T05:33:47.420 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_file", 2024-05-08T05:33:47.420 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-08T05:33:47.420 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:47.420 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:47.420 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-05-08T05:33:47.420 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:47.420 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:47.420 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:47.421 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:47.421 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:47.421 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:47.421 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:47.421 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:47.421 INFO:teuthology.orchestra.run.smithi087.stdout: "roption1": { 2024-05-08T05:33:47.421 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "roption1", 2024-05-08T05:33:47.421 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-08T05:33:47.421 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:47.421 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-08T05:33:47.421 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-05-08T05:33:47.421 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:47.422 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:47.422 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:47.422 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:47.422 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:47.422 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:47.422 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:47.422 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:47.422 INFO:teuthology.orchestra.run.smithi087.stdout: "roption2": { 2024-05-08T05:33:47.422 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "roption2", 2024-05-08T05:33:47.422 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-08T05:33:47.422 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:47.422 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-08T05:33:47.423 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "xyz", 2024-05-08T05:33:47.423 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:47.423 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:47.423 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:47.423 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:47.423 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:47.423 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:47.423 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:47.423 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:47.423 INFO:teuthology.orchestra.run.smithi087.stdout: "rwoption1": { 2024-05-08T05:33:47.423 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "rwoption1", 2024-05-08T05:33:47.423 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-08T05:33:47.423 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:47.424 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-08T05:33:47.424 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-05-08T05:33:47.424 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:47.424 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:47.424 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:47.424 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:47.424 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:47.424 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:47.424 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:47.424 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:47.424 INFO:teuthology.orchestra.run.smithi087.stdout: "rwoption2": { 2024-05-08T05:33:47.424 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "rwoption2", 2024-05-08T05:33:47.424 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "int", 2024-05-08T05:33:47.424 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:47.425 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-08T05:33:47.425 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-05-08T05:33:47.425 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:47.425 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:47.425 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:47.425 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:47.425 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:47.425 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:47.425 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:47.425 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:47.425 INFO:teuthology.orchestra.run.smithi087.stdout: "rwoption3": { 2024-05-08T05:33:47.425 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "rwoption3", 2024-05-08T05:33:47.426 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "float", 2024-05-08T05:33:47.426 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:47.426 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-08T05:33:47.426 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-05-08T05:33:47.426 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:47.426 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:47.426 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:47.426 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:47.426 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:47.426 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:47.426 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:47.426 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:47.427 INFO:teuthology.orchestra.run.smithi087.stdout: "rwoption4": { 2024-05-08T05:33:47.427 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "rwoption4", 2024-05-08T05:33:47.427 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-08T05:33:47.427 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:47.427 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-08T05:33:47.427 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-05-08T05:33:47.427 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:47.427 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:47.427 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:47.427 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:47.427 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:47.427 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:47.428 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:47.428 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:47.428 INFO:teuthology.orchestra.run.smithi087.stdout: "rwoption5": { 2024-05-08T05:33:47.428 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "rwoption5", 2024-05-08T05:33:47.428 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-08T05:33:47.428 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:47.428 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-08T05:33:47.428 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-05-08T05:33:47.428 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:47.428 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:47.428 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:47.428 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:47.428 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:47.429 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:47.429 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:47.429 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:47.429 INFO:teuthology.orchestra.run.smithi087.stdout: "rwoption6": { 2024-05-08T05:33:47.429 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "rwoption6", 2024-05-08T05:33:47.429 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-08T05:33:47.429 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:47.429 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-08T05:33:47.429 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "True", 2024-05-08T05:33:47.429 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:47.429 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:47.429 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:47.430 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:47.430 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:47.430 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:47.430 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:47.430 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:47.430 INFO:teuthology.orchestra.run.smithi087.stdout: "rwoption7": { 2024-05-08T05:33:47.430 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "rwoption7", 2024-05-08T05:33:47.430 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "int", 2024-05-08T05:33:47.430 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:47.430 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-08T05:33:47.430 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-05-08T05:33:47.430 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "1", 2024-05-08T05:33:47.430 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "42", 2024-05-08T05:33:47.431 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:47.431 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:47.431 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:47.431 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:47.431 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:47.431 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:47.431 INFO:teuthology.orchestra.run.smithi087.stdout: "sqlite3_killpoint": { 2024-05-08T05:33:47.431 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "sqlite3_killpoint", 2024-05-08T05:33:47.431 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "int", 2024-05-08T05:33:47.431 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "dev", 2024-05-08T05:33:47.431 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:47.431 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "0", 2024-05-08T05:33:47.431 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:47.432 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:47.432 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:47.432 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:47.432 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:47.432 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:47.432 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:47.432 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:47.432 INFO:teuthology.orchestra.run.smithi087.stdout: "testkey": { 2024-05-08T05:33:47.432 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "testkey", 2024-05-08T05:33:47.432 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-08T05:33:47.432 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:47.432 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-08T05:33:47.432 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-05-08T05:33:47.433 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:47.433 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:47.433 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:47.433 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:47.433 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:47.433 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:47.433 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:47.433 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:47.433 INFO:teuthology.orchestra.run.smithi087.stdout: "testlkey": { 2024-05-08T05:33:47.433 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "testlkey", 2024-05-08T05:33:47.433 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-08T05:33:47.433 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:47.433 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-08T05:33:47.433 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-05-08T05:33:47.434 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:47.434 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:47.434 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:47.434 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:47.434 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:47.434 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:47.434 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:47.434 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:47.434 INFO:teuthology.orchestra.run.smithi087.stdout: "testnewline": { 2024-05-08T05:33:47.434 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "testnewline", 2024-05-08T05:33:47.434 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-08T05:33:47.435 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:47.435 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-08T05:33:47.435 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-05-08T05:33:47.435 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:47.435 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:47.435 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:47.435 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:47.435 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:47.435 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:47.435 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:47.435 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-05-08T05:33:47.435 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-05-08T05:33:47.435 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:47.436 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-05-08T05:33:47.436 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "smb", 2024-05-08T05:33:47.436 INFO:teuthology.orchestra.run.smithi087.stdout: "can_run": true, 2024-05-08T05:33:47.436 INFO:teuthology.orchestra.run.smithi087.stdout: "error_string": "", 2024-05-08T05:33:47.436 INFO:teuthology.orchestra.run.smithi087.stdout: "module_options": { 2024-05-08T05:33:47.436 INFO:teuthology.orchestra.run.smithi087.stdout: "log_level": { 2024-05-08T05:33:47.436 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_level", 2024-05-08T05:33:47.436 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-08T05:33:47.436 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:47.436 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:47.436 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-05-08T05:33:47.436 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:47.437 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:47.437 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [ 2024-05-08T05:33:47.437 INFO:teuthology.orchestra.run.smithi087.stdout: "", 2024-05-08T05:33:47.437 INFO:teuthology.orchestra.run.smithi087.stdout: "critical", 2024-05-08T05:33:47.437 INFO:teuthology.orchestra.run.smithi087.stdout: "debug", 2024-05-08T05:33:47.437 INFO:teuthology.orchestra.run.smithi087.stdout: "error", 2024-05-08T05:33:47.437 INFO:teuthology.orchestra.run.smithi087.stdout: "info", 2024-05-08T05:33:47.437 INFO:teuthology.orchestra.run.smithi087.stdout: "warning" 2024-05-08T05:33:47.437 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-05-08T05:33:47.437 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:47.437 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:47.437 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:47.437 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:47.438 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:47.438 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_cluster": { 2024-05-08T05:33:47.438 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_cluster", 2024-05-08T05:33:47.438 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-08T05:33:47.438 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:47.438 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:47.438 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-05-08T05:33:47.438 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:47.438 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:47.438 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:47.438 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:47.438 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:47.439 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:47.439 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:47.439 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:47.439 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_cluster_level": { 2024-05-08T05:33:47.439 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_cluster_level", 2024-05-08T05:33:47.439 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-08T05:33:47.439 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:47.439 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:47.439 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "info", 2024-05-08T05:33:47.439 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:47.439 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:47.439 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [ 2024-05-08T05:33:47.440 INFO:teuthology.orchestra.run.smithi087.stdout: "", 2024-05-08T05:33:47.440 INFO:teuthology.orchestra.run.smithi087.stdout: "critical", 2024-05-08T05:33:47.440 INFO:teuthology.orchestra.run.smithi087.stdout: "debug", 2024-05-08T05:33:47.440 INFO:teuthology.orchestra.run.smithi087.stdout: "error", 2024-05-08T05:33:47.440 INFO:teuthology.orchestra.run.smithi087.stdout: "info", 2024-05-08T05:33:47.440 INFO:teuthology.orchestra.run.smithi087.stdout: "warning" 2024-05-08T05:33:47.440 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-05-08T05:33:47.440 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:47.440 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:47.440 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:47.440 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:47.440 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:47.441 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_file": { 2024-05-08T05:33:47.441 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_file", 2024-05-08T05:33:47.441 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-08T05:33:47.441 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:47.441 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:47.441 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-05-08T05:33:47.441 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:47.441 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:47.441 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:47.441 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:47.441 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:47.441 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:47.442 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:47.442 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:47.442 INFO:teuthology.orchestra.run.smithi087.stdout: "sqlite3_killpoint": { 2024-05-08T05:33:47.442 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "sqlite3_killpoint", 2024-05-08T05:33:47.442 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "int", 2024-05-08T05:33:47.442 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "dev", 2024-05-08T05:33:47.442 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:47.442 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "0", 2024-05-08T05:33:47.442 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:47.442 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:47.442 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:47.442 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:47.443 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:47.443 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:47.443 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:47.443 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:47.443 INFO:teuthology.orchestra.run.smithi087.stdout: "update_orchestration": { 2024-05-08T05:33:47.443 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "update_orchestration", 2024-05-08T05:33:47.443 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-08T05:33:47.443 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:47.443 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-08T05:33:47.443 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "True", 2024-05-08T05:33:47.443 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:47.443 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:47.443 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:47.444 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "automatically update orchestration when smb resources are changed", 2024-05-08T05:33:47.444 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:47.444 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:47.444 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:47.444 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-05-08T05:33:47.444 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-05-08T05:33:47.444 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:47.444 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-05-08T05:33:47.444 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "snap_schedule", 2024-05-08T05:33:47.444 INFO:teuthology.orchestra.run.smithi087.stdout: "can_run": true, 2024-05-08T05:33:47.445 INFO:teuthology.orchestra.run.smithi087.stdout: "error_string": "", 2024-05-08T05:33:47.445 INFO:teuthology.orchestra.run.smithi087.stdout: "module_options": { 2024-05-08T05:33:47.445 INFO:teuthology.orchestra.run.smithi087.stdout: "allow_m_granularity": { 2024-05-08T05:33:47.446 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "allow_m_granularity", 2024-05-08T05:33:47.446 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-08T05:33:47.446 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:47.446 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:47.446 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-05-08T05:33:47.446 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:47.446 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:47.446 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:47.446 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "allow minute scheduled snapshots", 2024-05-08T05:33:47.446 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:47.446 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:47.446 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:47.447 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:47.447 INFO:teuthology.orchestra.run.smithi087.stdout: "dump_on_update": { 2024-05-08T05:33:47.447 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "dump_on_update", 2024-05-08T05:33:47.447 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-08T05:33:47.447 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:47.447 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:47.447 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-05-08T05:33:47.447 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:47.447 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:47.447 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:47.447 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "dump database to debug log on update", 2024-05-08T05:33:47.447 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:47.447 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:47.448 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:47.448 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:47.448 INFO:teuthology.orchestra.run.smithi087.stdout: "log_level": { 2024-05-08T05:33:47.448 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_level", 2024-05-08T05:33:47.448 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-08T05:33:47.448 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:47.448 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:47.448 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-05-08T05:33:47.448 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:47.448 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:47.448 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [ 2024-05-08T05:33:47.448 INFO:teuthology.orchestra.run.smithi087.stdout: "", 2024-05-08T05:33:47.448 INFO:teuthology.orchestra.run.smithi087.stdout: "critical", 2024-05-08T05:33:47.449 INFO:teuthology.orchestra.run.smithi087.stdout: "debug", 2024-05-08T05:33:47.449 INFO:teuthology.orchestra.run.smithi087.stdout: "error", 2024-05-08T05:33:47.449 INFO:teuthology.orchestra.run.smithi087.stdout: "info", 2024-05-08T05:33:47.449 INFO:teuthology.orchestra.run.smithi087.stdout: "warning" 2024-05-08T05:33:47.449 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-05-08T05:33:47.449 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:47.449 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:47.449 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:47.449 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:47.449 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:47.449 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_cluster": { 2024-05-08T05:33:47.449 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_cluster", 2024-05-08T05:33:47.450 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-08T05:33:47.450 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:47.450 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:47.450 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-05-08T05:33:47.450 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:47.450 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:47.450 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:47.450 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:47.450 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:47.450 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:47.450 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:47.450 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:47.450 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_cluster_level": { 2024-05-08T05:33:47.451 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_cluster_level", 2024-05-08T05:33:47.451 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-08T05:33:47.451 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:47.451 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:47.451 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "info", 2024-05-08T05:33:47.451 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:47.451 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:47.452 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [ 2024-05-08T05:33:47.452 INFO:teuthology.orchestra.run.smithi087.stdout: "", 2024-05-08T05:33:47.452 INFO:teuthology.orchestra.run.smithi087.stdout: "critical", 2024-05-08T05:33:47.452 INFO:teuthology.orchestra.run.smithi087.stdout: "debug", 2024-05-08T05:33:47.452 INFO:teuthology.orchestra.run.smithi087.stdout: "error", 2024-05-08T05:33:47.452 INFO:teuthology.orchestra.run.smithi087.stdout: "info", 2024-05-08T05:33:47.452 INFO:teuthology.orchestra.run.smithi087.stdout: "warning" 2024-05-08T05:33:47.452 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-05-08T05:33:47.452 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:47.452 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:47.453 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:47.453 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:47.453 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:47.453 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_file": { 2024-05-08T05:33:47.453 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_file", 2024-05-08T05:33:47.453 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-08T05:33:47.453 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:47.453 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:47.453 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-05-08T05:33:47.453 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:47.453 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:47.453 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:47.454 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:47.454 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:47.454 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:47.454 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:47.454 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:47.454 INFO:teuthology.orchestra.run.smithi087.stdout: "sqlite3_killpoint": { 2024-05-08T05:33:47.454 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "sqlite3_killpoint", 2024-05-08T05:33:47.454 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "int", 2024-05-08T05:33:47.454 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "dev", 2024-05-08T05:33:47.454 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:47.454 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "0", 2024-05-08T05:33:47.454 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:47.454 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:47.455 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:47.455 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:47.455 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:47.455 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:47.455 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:47.455 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-05-08T05:33:47.455 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-05-08T05:33:47.455 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:47.455 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-05-08T05:33:47.455 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "stats", 2024-05-08T05:33:47.455 INFO:teuthology.orchestra.run.smithi087.stdout: "can_run": true, 2024-05-08T05:33:47.455 INFO:teuthology.orchestra.run.smithi087.stdout: "error_string": "", 2024-05-08T05:33:47.456 INFO:teuthology.orchestra.run.smithi087.stdout: "module_options": { 2024-05-08T05:33:47.456 INFO:teuthology.orchestra.run.smithi087.stdout: "log_level": { 2024-05-08T05:33:47.456 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_level", 2024-05-08T05:33:47.456 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-08T05:33:47.456 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:47.456 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:47.456 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-05-08T05:33:47.456 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:47.456 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:47.456 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [ 2024-05-08T05:33:47.456 INFO:teuthology.orchestra.run.smithi087.stdout: "", 2024-05-08T05:33:47.456 INFO:teuthology.orchestra.run.smithi087.stdout: "critical", 2024-05-08T05:33:47.457 INFO:teuthology.orchestra.run.smithi087.stdout: "debug", 2024-05-08T05:33:47.457 INFO:teuthology.orchestra.run.smithi087.stdout: "error", 2024-05-08T05:33:47.457 INFO:teuthology.orchestra.run.smithi087.stdout: "info", 2024-05-08T05:33:47.457 INFO:teuthology.orchestra.run.smithi087.stdout: "warning" 2024-05-08T05:33:47.457 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-05-08T05:33:47.457 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:47.457 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:47.457 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:47.457 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:47.457 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:47.457 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_cluster": { 2024-05-08T05:33:47.458 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_cluster", 2024-05-08T05:33:47.458 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-08T05:33:47.458 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:47.458 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:47.458 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-05-08T05:33:47.458 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:47.458 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:47.458 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:47.458 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:47.458 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:47.458 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:47.459 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:47.459 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:47.459 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_cluster_level": { 2024-05-08T05:33:47.459 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_cluster_level", 2024-05-08T05:33:47.459 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-08T05:33:47.459 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:47.459 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:47.459 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "info", 2024-05-08T05:33:47.459 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:47.459 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:47.459 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [ 2024-05-08T05:33:47.459 INFO:teuthology.orchestra.run.smithi087.stdout: "", 2024-05-08T05:33:47.460 INFO:teuthology.orchestra.run.smithi087.stdout: "critical", 2024-05-08T05:33:47.460 INFO:teuthology.orchestra.run.smithi087.stdout: "debug", 2024-05-08T05:33:47.460 INFO:teuthology.orchestra.run.smithi087.stdout: "error", 2024-05-08T05:33:47.460 INFO:teuthology.orchestra.run.smithi087.stdout: "info", 2024-05-08T05:33:47.460 INFO:teuthology.orchestra.run.smithi087.stdout: "warning" 2024-05-08T05:33:47.460 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-05-08T05:33:47.460 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:47.460 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:47.460 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:47.460 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:47.460 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:47.460 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_file": { 2024-05-08T05:33:47.460 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_file", 2024-05-08T05:33:47.461 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-08T05:33:47.461 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:47.461 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:47.461 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-05-08T05:33:47.461 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:47.461 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:47.461 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:47.461 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:47.461 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:47.461 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:47.461 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:47.461 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:47.462 INFO:teuthology.orchestra.run.smithi087.stdout: "sqlite3_killpoint": { 2024-05-08T05:33:47.462 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "sqlite3_killpoint", 2024-05-08T05:33:47.462 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "int", 2024-05-08T05:33:47.462 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "dev", 2024-05-08T05:33:47.462 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:47.462 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "0", 2024-05-08T05:33:47.462 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:47.462 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:47.462 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:47.462 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:47.462 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:47.463 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:47.463 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:47.463 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-05-08T05:33:47.463 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-05-08T05:33:47.463 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:47.463 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-05-08T05:33:47.463 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "status", 2024-05-08T05:33:47.463 INFO:teuthology.orchestra.run.smithi087.stdout: "can_run": true, 2024-05-08T05:33:47.463 INFO:teuthology.orchestra.run.smithi087.stdout: "error_string": "", 2024-05-08T05:33:47.463 INFO:teuthology.orchestra.run.smithi087.stdout: "module_options": { 2024-05-08T05:33:47.463 INFO:teuthology.orchestra.run.smithi087.stdout: "log_level": { 2024-05-08T05:33:47.463 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_level", 2024-05-08T05:33:47.463 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-08T05:33:47.464 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:47.464 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:47.464 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-05-08T05:33:47.464 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:47.464 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:47.464 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [ 2024-05-08T05:33:47.464 INFO:teuthology.orchestra.run.smithi087.stdout: "", 2024-05-08T05:33:47.464 INFO:teuthology.orchestra.run.smithi087.stdout: "critical", 2024-05-08T05:33:47.464 INFO:teuthology.orchestra.run.smithi087.stdout: "debug", 2024-05-08T05:33:47.464 INFO:teuthology.orchestra.run.smithi087.stdout: "error", 2024-05-08T05:33:47.464 INFO:teuthology.orchestra.run.smithi087.stdout: "info", 2024-05-08T05:33:47.464 INFO:teuthology.orchestra.run.smithi087.stdout: "warning" 2024-05-08T05:33:47.465 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-05-08T05:33:47.465 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:47.465 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:47.465 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:47.465 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:47.465 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:47.465 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_cluster": { 2024-05-08T05:33:47.465 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_cluster", 2024-05-08T05:33:47.465 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-08T05:33:47.465 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:47.465 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:47.466 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-05-08T05:33:47.466 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:47.466 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:47.466 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:47.466 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:47.466 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:47.466 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:47.466 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:47.466 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:47.466 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_cluster_level": { 2024-05-08T05:33:47.466 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_cluster_level", 2024-05-08T05:33:47.466 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-08T05:33:47.467 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:47.467 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:47.467 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "info", 2024-05-08T05:33:47.467 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:47.467 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:47.467 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [ 2024-05-08T05:33:47.467 INFO:teuthology.orchestra.run.smithi087.stdout: "", 2024-05-08T05:33:47.467 INFO:teuthology.orchestra.run.smithi087.stdout: "critical", 2024-05-08T05:33:47.467 INFO:teuthology.orchestra.run.smithi087.stdout: "debug", 2024-05-08T05:33:47.467 INFO:teuthology.orchestra.run.smithi087.stdout: "error", 2024-05-08T05:33:47.467 INFO:teuthology.orchestra.run.smithi087.stdout: "info", 2024-05-08T05:33:47.467 INFO:teuthology.orchestra.run.smithi087.stdout: "warning" 2024-05-08T05:33:47.468 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-05-08T05:33:47.468 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:47.468 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:47.468 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:47.468 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:47.468 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:47.468 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_file": { 2024-05-08T05:33:47.468 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_file", 2024-05-08T05:33:47.468 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-08T05:33:47.468 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:47.468 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:47.468 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-05-08T05:33:47.469 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:47.469 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:47.469 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:47.469 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:47.469 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:47.469 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:47.469 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:47.469 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:47.469 INFO:teuthology.orchestra.run.smithi087.stdout: "sqlite3_killpoint": { 2024-05-08T05:33:47.469 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "sqlite3_killpoint", 2024-05-08T05:33:47.469 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "int", 2024-05-08T05:33:47.469 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "dev", 2024-05-08T05:33:47.470 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:47.470 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "0", 2024-05-08T05:33:47.470 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:47.470 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:47.470 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:47.470 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:47.470 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:47.470 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:47.470 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:47.470 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-05-08T05:33:47.470 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-05-08T05:33:47.470 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:47.471 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-05-08T05:33:47.471 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "telegraf", 2024-05-08T05:33:47.471 INFO:teuthology.orchestra.run.smithi087.stdout: "can_run": true, 2024-05-08T05:33:47.471 INFO:teuthology.orchestra.run.smithi087.stdout: "error_string": "", 2024-05-08T05:33:47.471 INFO:teuthology.orchestra.run.smithi087.stdout: "module_options": { 2024-05-08T05:33:47.471 INFO:teuthology.orchestra.run.smithi087.stdout: "address": { 2024-05-08T05:33:47.471 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "address", 2024-05-08T05:33:47.471 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-08T05:33:47.471 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:47.471 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-08T05:33:47.471 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2024-05-08T05:33:47.471 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:47.471 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:47.472 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:47.472 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:47.472 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:47.472 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:47.472 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:47.472 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:47.472 INFO:teuthology.orchestra.run.smithi087.stdout: "interval": { 2024-05-08T05:33:47.472 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "interval", 2024-05-08T05:33:47.472 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "secs", 2024-05-08T05:33:47.472 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:47.472 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-08T05:33:47.472 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "15", 2024-05-08T05:33:47.473 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:47.473 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:47.473 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:47.473 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:47.473 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:47.473 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:47.473 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:47.473 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:47.473 INFO:teuthology.orchestra.run.smithi087.stdout: "log_level": { 2024-05-08T05:33:47.473 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_level", 2024-05-08T05:33:47.473 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-08T05:33:47.473 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:47.473 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:47.474 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-05-08T05:33:47.474 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:47.474 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:47.474 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [ 2024-05-08T05:33:47.474 INFO:teuthology.orchestra.run.smithi087.stdout: "", 2024-05-08T05:33:47.474 INFO:teuthology.orchestra.run.smithi087.stdout: "critical", 2024-05-08T05:33:47.474 INFO:teuthology.orchestra.run.smithi087.stdout: "debug", 2024-05-08T05:33:47.474 INFO:teuthology.orchestra.run.smithi087.stdout: "error", 2024-05-08T05:33:47.474 INFO:teuthology.orchestra.run.smithi087.stdout: "info", 2024-05-08T05:33:47.474 INFO:teuthology.orchestra.run.smithi087.stdout: "warning" 2024-05-08T05:33:47.474 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-05-08T05:33:47.474 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:47.475 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:47.475 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:47.475 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:47.475 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:47.475 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_cluster": { 2024-05-08T05:33:47.475 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_cluster", 2024-05-08T05:33:47.475 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-08T05:33:47.475 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:47.475 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:47.475 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-05-08T05:33:47.475 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:47.475 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:47.475 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:47.476 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:47.476 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:47.476 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:47.476 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:47.476 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:47.476 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_cluster_level": { 2024-05-08T05:33:47.476 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_cluster_level", 2024-05-08T05:33:47.476 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-08T05:33:47.476 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:47.476 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:47.476 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "info", 2024-05-08T05:33:47.476 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:47.477 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:47.477 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [ 2024-05-08T05:33:47.477 INFO:teuthology.orchestra.run.smithi087.stdout: "", 2024-05-08T05:33:47.477 INFO:teuthology.orchestra.run.smithi087.stdout: "critical", 2024-05-08T05:33:47.477 INFO:teuthology.orchestra.run.smithi087.stdout: "debug", 2024-05-08T05:33:47.477 INFO:teuthology.orchestra.run.smithi087.stdout: "error", 2024-05-08T05:33:47.477 INFO:teuthology.orchestra.run.smithi087.stdout: "info", 2024-05-08T05:33:47.477 INFO:teuthology.orchestra.run.smithi087.stdout: "warning" 2024-05-08T05:33:47.477 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-05-08T05:33:47.477 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:47.477 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:47.477 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:47.478 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:47.478 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:47.478 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_file": { 2024-05-08T05:33:47.478 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_file", 2024-05-08T05:33:47.478 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-08T05:33:47.478 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:47.478 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:47.478 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-05-08T05:33:47.478 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:47.478 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:47.478 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:47.479 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:47.479 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:47.479 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:47.479 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:47.479 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:47.479 INFO:teuthology.orchestra.run.smithi087.stdout: "sqlite3_killpoint": { 2024-05-08T05:33:47.479 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "sqlite3_killpoint", 2024-05-08T05:33:47.479 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "int", 2024-05-08T05:33:47.479 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "dev", 2024-05-08T05:33:47.479 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:47.479 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "0", 2024-05-08T05:33:47.479 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:47.480 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:47.480 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:47.480 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:47.480 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:47.480 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:47.480 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:47.480 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-05-08T05:33:47.480 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-05-08T05:33:47.480 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:47.480 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-05-08T05:33:47.480 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "telemetry", 2024-05-08T05:33:47.481 INFO:teuthology.orchestra.run.smithi087.stdout: "can_run": true, 2024-05-08T05:33:47.481 INFO:teuthology.orchestra.run.smithi087.stdout: "error_string": "", 2024-05-08T05:33:47.481 INFO:teuthology.orchestra.run.smithi087.stdout: "module_options": { 2024-05-08T05:33:47.481 INFO:teuthology.orchestra.run.smithi087.stdout: "channel_basic": { 2024-05-08T05:33:47.481 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "channel_basic", 2024-05-08T05:33:47.481 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-08T05:33:47.481 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:47.481 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-08T05:33:47.481 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "True", 2024-05-08T05:33:47.481 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:47.481 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:47.482 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:47.482 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "Share basic cluster information (size, version)", 2024-05-08T05:33:47.482 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:47.482 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:47.482 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:47.482 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:47.482 INFO:teuthology.orchestra.run.smithi087.stdout: "channel_crash": { 2024-05-08T05:33:47.482 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "channel_crash", 2024-05-08T05:33:47.482 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-08T05:33:47.482 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:47.482 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-08T05:33:47.482 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "True", 2024-05-08T05:33:47.483 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:47.483 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:47.483 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:47.483 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2024-05-08T05:33:47.483 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:47.483 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:47.483 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:47.483 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:47.483 INFO:teuthology.orchestra.run.smithi087.stdout: "channel_device": { 2024-05-08T05:33:47.483 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "channel_device", 2024-05-08T05:33:47.483 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-08T05:33:47.483 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:47.483 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-08T05:33:47.484 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "True", 2024-05-08T05:33:47.484 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:47.484 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:47.484 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:47.484 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2024-05-08T05:33:47.484 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:47.484 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:47.484 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:47.484 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:47.484 INFO:teuthology.orchestra.run.smithi087.stdout: "channel_ident": { 2024-05-08T05:33:47.484 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "channel_ident", 2024-05-08T05:33:47.485 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-08T05:33:47.485 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:47.485 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-08T05:33:47.485 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-05-08T05:33:47.485 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:47.485 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:47.485 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:47.485 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2024-05-08T05:33:47.485 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:47.485 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:47.485 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:47.485 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:47.485 INFO:teuthology.orchestra.run.smithi087.stdout: "channel_perf": { 2024-05-08T05:33:47.486 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "channel_perf", 2024-05-08T05:33:47.486 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-08T05:33:47.486 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:47.486 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-08T05:33:47.486 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-05-08T05:33:47.486 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:47.486 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:47.486 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:47.486 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "Share various performance metrics of a cluster", 2024-05-08T05:33:47.486 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:47.486 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:47.486 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:47.487 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:47.487 INFO:teuthology.orchestra.run.smithi087.stdout: "contact": { 2024-05-08T05:33:47.487 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "contact", 2024-05-08T05:33:47.487 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-08T05:33:47.487 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:47.487 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-08T05:33:47.487 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-05-08T05:33:47.487 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:47.487 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:47.487 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:47.487 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:47.487 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:47.487 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:47.488 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:47.488 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:47.488 INFO:teuthology.orchestra.run.smithi087.stdout: "description": { 2024-05-08T05:33:47.488 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "description", 2024-05-08T05:33:47.488 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-08T05:33:47.488 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:47.488 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-08T05:33:47.488 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-05-08T05:33:47.488 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:47.488 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:47.488 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:47.488 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:47.488 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:47.489 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:47.489 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:47.489 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:47.489 INFO:teuthology.orchestra.run.smithi087.stdout: "device_url": { 2024-05-08T05:33:47.489 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "device_url", 2024-05-08T05:33:47.489 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-08T05:33:47.489 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:47.489 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-08T05:33:47.489 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "https://telemetry.ceph.com/device", 2024-05-08T05:33:47.489 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:47.489 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:47.489 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:47.489 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:47.490 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:47.490 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:47.490 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:47.490 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:47.490 INFO:teuthology.orchestra.run.smithi087.stdout: "enabled": { 2024-05-08T05:33:47.490 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "enabled", 2024-05-08T05:33:47.490 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-08T05:33:47.490 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:47.490 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-08T05:33:47.490 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-05-08T05:33:47.490 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:47.490 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:47.491 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:47.491 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:47.491 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:47.491 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:47.491 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:47.491 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:47.491 INFO:teuthology.orchestra.run.smithi087.stdout: "interval": { 2024-05-08T05:33:47.491 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "interval", 2024-05-08T05:33:47.491 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "int", 2024-05-08T05:33:47.491 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:47.491 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-08T05:33:47.491 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "24", 2024-05-08T05:33:47.492 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "8", 2024-05-08T05:33:47.492 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:47.492 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:47.492 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:47.492 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:47.492 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:47.492 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:47.492 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:47.492 INFO:teuthology.orchestra.run.smithi087.stdout: "last_opt_revision": { 2024-05-08T05:33:47.492 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "last_opt_revision", 2024-05-08T05:33:47.492 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "int", 2024-05-08T05:33:47.492 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:47.492 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-08T05:33:47.493 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "1", 2024-05-08T05:33:47.493 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:47.493 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:47.493 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:47.493 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:47.493 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:47.493 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:47.493 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:47.493 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:47.493 INFO:teuthology.orchestra.run.smithi087.stdout: "leaderboard": { 2024-05-08T05:33:47.493 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "leaderboard", 2024-05-08T05:33:47.493 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-08T05:33:47.493 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:47.494 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-08T05:33:47.494 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-05-08T05:33:47.494 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:47.494 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:47.494 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:47.494 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:47.494 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:47.494 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:47.494 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:47.494 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:47.494 INFO:teuthology.orchestra.run.smithi087.stdout: "leaderboard_description": { 2024-05-08T05:33:47.494 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "leaderboard_description", 2024-05-08T05:33:47.494 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-08T05:33:47.495 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:47.495 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-08T05:33:47.495 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-05-08T05:33:47.495 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:47.495 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:47.495 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:47.495 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:47.495 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:47.495 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:47.495 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:47.495 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:47.495 INFO:teuthology.orchestra.run.smithi087.stdout: "log_level": { 2024-05-08T05:33:47.495 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_level", 2024-05-08T05:33:47.496 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-08T05:33:47.496 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:47.496 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:47.496 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-05-08T05:33:47.496 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:47.496 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:47.496 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [ 2024-05-08T05:33:47.496 INFO:teuthology.orchestra.run.smithi087.stdout: "", 2024-05-08T05:33:47.496 INFO:teuthology.orchestra.run.smithi087.stdout: "critical", 2024-05-08T05:33:47.496 INFO:teuthology.orchestra.run.smithi087.stdout: "debug", 2024-05-08T05:33:47.496 INFO:teuthology.orchestra.run.smithi087.stdout: "error", 2024-05-08T05:33:47.496 INFO:teuthology.orchestra.run.smithi087.stdout: "info", 2024-05-08T05:33:47.497 INFO:teuthology.orchestra.run.smithi087.stdout: "warning" 2024-05-08T05:33:47.497 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-05-08T05:33:47.497 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:47.497 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:47.497 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:47.497 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:47.497 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:47.497 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_cluster": { 2024-05-08T05:33:47.497 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_cluster", 2024-05-08T05:33:47.497 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-08T05:33:47.497 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:47.497 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:47.497 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-05-08T05:33:47.498 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:47.498 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:47.498 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:47.498 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:47.498 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:47.498 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:47.498 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:47.498 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:47.498 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_cluster_level": { 2024-05-08T05:33:47.498 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_cluster_level", 2024-05-08T05:33:47.498 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-08T05:33:47.498 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:47.499 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:47.499 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "info", 2024-05-08T05:33:47.499 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:47.499 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:47.499 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [ 2024-05-08T05:33:47.499 INFO:teuthology.orchestra.run.smithi087.stdout: "", 2024-05-08T05:33:47.499 INFO:teuthology.orchestra.run.smithi087.stdout: "critical", 2024-05-08T05:33:47.499 INFO:teuthology.orchestra.run.smithi087.stdout: "debug", 2024-05-08T05:33:47.499 INFO:teuthology.orchestra.run.smithi087.stdout: "error", 2024-05-08T05:33:47.499 INFO:teuthology.orchestra.run.smithi087.stdout: "info", 2024-05-08T05:33:47.499 INFO:teuthology.orchestra.run.smithi087.stdout: "warning" 2024-05-08T05:33:47.499 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-05-08T05:33:47.500 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:47.500 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:47.500 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:47.500 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:47.500 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:47.500 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_file": { 2024-05-08T05:33:47.500 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_file", 2024-05-08T05:33:47.500 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-08T05:33:47.500 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:47.500 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:47.500 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-05-08T05:33:47.500 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:47.500 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:47.501 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:47.501 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:47.501 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:47.501 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:47.501 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:47.501 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:47.501 INFO:teuthology.orchestra.run.smithi087.stdout: "organization": { 2024-05-08T05:33:47.501 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "organization", 2024-05-08T05:33:47.501 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-08T05:33:47.501 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:47.501 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-08T05:33:47.501 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-05-08T05:33:47.501 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:47.501 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:47.502 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:47.502 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:47.502 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:47.502 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:47.502 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:47.502 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:47.502 INFO:teuthology.orchestra.run.smithi087.stdout: "proxy": { 2024-05-08T05:33:47.502 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "proxy", 2024-05-08T05:33:47.502 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-08T05:33:47.502 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:47.502 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-08T05:33:47.502 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-05-08T05:33:47.502 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:47.503 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:47.503 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:47.503 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:47.503 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:47.503 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:47.503 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:47.503 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:47.503 INFO:teuthology.orchestra.run.smithi087.stdout: "sqlite3_killpoint": { 2024-05-08T05:33:47.503 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "sqlite3_killpoint", 2024-05-08T05:33:47.503 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "int", 2024-05-08T05:33:47.503 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "dev", 2024-05-08T05:33:47.504 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:47.504 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "0", 2024-05-08T05:33:47.504 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:47.504 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:47.504 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:47.504 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:47.504 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:47.504 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:47.504 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:47.504 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:47.504 INFO:teuthology.orchestra.run.smithi087.stdout: "url": { 2024-05-08T05:33:47.504 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "url", 2024-05-08T05:33:47.504 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-08T05:33:47.504 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:47.505 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-08T05:33:47.505 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "https://telemetry.ceph.com/report", 2024-05-08T05:33:47.505 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:47.505 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:47.505 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:47.505 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:47.505 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:47.505 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:47.505 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:47.505 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-05-08T05:33:47.505 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-05-08T05:33:47.505 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:47.506 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-05-08T05:33:47.506 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "test_orchestrator", 2024-05-08T05:33:47.506 INFO:teuthology.orchestra.run.smithi087.stdout: "can_run": true, 2024-05-08T05:33:47.506 INFO:teuthology.orchestra.run.smithi087.stdout: "error_string": "", 2024-05-08T05:33:47.506 INFO:teuthology.orchestra.run.smithi087.stdout: "module_options": { 2024-05-08T05:33:47.506 INFO:teuthology.orchestra.run.smithi087.stdout: "log_level": { 2024-05-08T05:33:47.506 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_level", 2024-05-08T05:33:47.506 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-08T05:33:47.506 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:47.506 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:47.506 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-05-08T05:33:47.506 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:47.506 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:47.507 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [ 2024-05-08T05:33:47.507 INFO:teuthology.orchestra.run.smithi087.stdout: "", 2024-05-08T05:33:47.507 INFO:teuthology.orchestra.run.smithi087.stdout: "critical", 2024-05-08T05:33:47.507 INFO:teuthology.orchestra.run.smithi087.stdout: "debug", 2024-05-08T05:33:47.507 INFO:teuthology.orchestra.run.smithi087.stdout: "error", 2024-05-08T05:33:47.507 INFO:teuthology.orchestra.run.smithi087.stdout: "info", 2024-05-08T05:33:47.507 INFO:teuthology.orchestra.run.smithi087.stdout: "warning" 2024-05-08T05:33:47.507 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-05-08T05:33:47.507 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:47.507 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:47.507 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:47.507 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:47.507 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:47.508 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_cluster": { 2024-05-08T05:33:47.508 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_cluster", 2024-05-08T05:33:47.508 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-08T05:33:47.508 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:47.508 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:47.508 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-05-08T05:33:47.508 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:47.508 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:47.508 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:47.508 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:47.508 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:47.508 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:47.508 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:47.509 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:47.509 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_cluster_level": { 2024-05-08T05:33:47.509 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_cluster_level", 2024-05-08T05:33:47.509 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-08T05:33:47.509 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:47.509 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:47.509 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "info", 2024-05-08T05:33:47.509 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:47.509 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:47.509 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [ 2024-05-08T05:33:47.509 INFO:teuthology.orchestra.run.smithi087.stdout: "", 2024-05-08T05:33:47.509 INFO:teuthology.orchestra.run.smithi087.stdout: "critical", 2024-05-08T05:33:47.510 INFO:teuthology.orchestra.run.smithi087.stdout: "debug", 2024-05-08T05:33:47.510 INFO:teuthology.orchestra.run.smithi087.stdout: "error", 2024-05-08T05:33:47.510 INFO:teuthology.orchestra.run.smithi087.stdout: "info", 2024-05-08T05:33:47.510 INFO:teuthology.orchestra.run.smithi087.stdout: "warning" 2024-05-08T05:33:47.510 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-05-08T05:33:47.510 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:47.510 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:47.510 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:47.510 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:47.510 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:47.510 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_file": { 2024-05-08T05:33:47.510 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_file", 2024-05-08T05:33:47.511 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-08T05:33:47.511 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:47.511 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:47.511 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-05-08T05:33:47.511 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:47.511 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:47.511 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:47.511 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:47.511 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:47.511 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:47.511 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:47.511 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:47.511 INFO:teuthology.orchestra.run.smithi087.stdout: "sqlite3_killpoint": { 2024-05-08T05:33:47.512 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "sqlite3_killpoint", 2024-05-08T05:33:47.512 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "int", 2024-05-08T05:33:47.512 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "dev", 2024-05-08T05:33:47.512 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:47.512 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "0", 2024-05-08T05:33:47.512 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:47.512 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:47.512 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:47.512 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:47.512 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:47.512 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:47.512 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:47.513 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-05-08T05:33:47.513 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-05-08T05:33:47.513 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:47.513 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-05-08T05:33:47.513 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "volumes", 2024-05-08T05:33:47.513 INFO:teuthology.orchestra.run.smithi087.stdout: "can_run": true, 2024-05-08T05:33:47.513 INFO:teuthology.orchestra.run.smithi087.stdout: "error_string": "", 2024-05-08T05:33:47.513 INFO:teuthology.orchestra.run.smithi087.stdout: "module_options": { 2024-05-08T05:33:47.513 INFO:teuthology.orchestra.run.smithi087.stdout: "log_level": { 2024-05-08T05:33:47.513 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_level", 2024-05-08T05:33:47.513 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-08T05:33:47.514 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:47.514 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:47.514 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-05-08T05:33:47.514 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:47.514 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:47.514 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [ 2024-05-08T05:33:47.514 INFO:teuthology.orchestra.run.smithi087.stdout: "", 2024-05-08T05:33:47.514 INFO:teuthology.orchestra.run.smithi087.stdout: "critical", 2024-05-08T05:33:47.514 INFO:teuthology.orchestra.run.smithi087.stdout: "debug", 2024-05-08T05:33:47.514 INFO:teuthology.orchestra.run.smithi087.stdout: "error", 2024-05-08T05:33:47.514 INFO:teuthology.orchestra.run.smithi087.stdout: "info", 2024-05-08T05:33:47.515 INFO:teuthology.orchestra.run.smithi087.stdout: "warning" 2024-05-08T05:33:47.515 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-05-08T05:33:47.515 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:47.515 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:47.515 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:47.515 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:47.515 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:47.515 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_cluster": { 2024-05-08T05:33:47.515 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_cluster", 2024-05-08T05:33:47.515 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-08T05:33:47.515 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:47.515 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:47.516 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-05-08T05:33:47.516 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:47.516 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:47.516 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:47.516 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:47.516 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:47.516 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:47.516 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:47.516 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:47.516 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_cluster_level": { 2024-05-08T05:33:47.516 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_cluster_level", 2024-05-08T05:33:47.516 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-08T05:33:47.517 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:47.517 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:47.517 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "info", 2024-05-08T05:33:47.517 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:47.517 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:47.517 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [ 2024-05-08T05:33:47.517 INFO:teuthology.orchestra.run.smithi087.stdout: "", 2024-05-08T05:33:47.517 INFO:teuthology.orchestra.run.smithi087.stdout: "critical", 2024-05-08T05:33:47.517 INFO:teuthology.orchestra.run.smithi087.stdout: "debug", 2024-05-08T05:33:47.517 INFO:teuthology.orchestra.run.smithi087.stdout: "error", 2024-05-08T05:33:47.517 INFO:teuthology.orchestra.run.smithi087.stdout: "info", 2024-05-08T05:33:47.517 INFO:teuthology.orchestra.run.smithi087.stdout: "warning" 2024-05-08T05:33:47.518 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-05-08T05:33:47.518 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:47.518 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:47.518 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:47.518 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:47.518 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:47.518 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_file": { 2024-05-08T05:33:47.518 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_file", 2024-05-08T05:33:47.518 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-08T05:33:47.518 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:47.518 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:47.519 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-05-08T05:33:47.519 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:47.519 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:47.519 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:47.519 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:47.519 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:47.519 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:47.519 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:47.519 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:47.519 INFO:teuthology.orchestra.run.smithi087.stdout: "max_concurrent_clones": { 2024-05-08T05:33:47.519 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "max_concurrent_clones", 2024-05-08T05:33:47.519 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "int", 2024-05-08T05:33:47.519 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:47.519 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-08T05:33:47.520 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "4", 2024-05-08T05:33:47.520 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:47.520 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:47.520 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:47.520 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "Number of asynchronous cloner threads", 2024-05-08T05:33:47.520 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:47.520 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:47.520 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:47.520 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:47.520 INFO:teuthology.orchestra.run.smithi087.stdout: "periodic_async_work": { 2024-05-08T05:33:47.520 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "periodic_async_work", 2024-05-08T05:33:47.520 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-08T05:33:47.520 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:47.521 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-08T05:33:47.521 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-05-08T05:33:47.521 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:47.521 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:47.521 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:47.521 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "Periodically check for async work", 2024-05-08T05:33:47.521 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:47.521 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:47.521 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:47.521 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:47.521 INFO:teuthology.orchestra.run.smithi087.stdout: "snapshot_clone_delay": { 2024-05-08T05:33:47.521 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "snapshot_clone_delay", 2024-05-08T05:33:47.521 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "int", 2024-05-08T05:33:47.522 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:47.522 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-08T05:33:47.522 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "0", 2024-05-08T05:33:47.522 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:47.522 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:47.522 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:47.522 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2024-05-08T05:33:47.522 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:47.522 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:47.522 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:47.522 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:47.522 INFO:teuthology.orchestra.run.smithi087.stdout: "snapshot_clone_no_wait": { 2024-05-08T05:33:47.523 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "snapshot_clone_no_wait", 2024-05-08T05:33:47.523 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-08T05:33:47.523 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:47.523 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-08T05:33:47.523 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "True", 2024-05-08T05:33:47.523 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:47.523 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:47.523 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:47.523 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "Reject subvolume clone request when cloner threads are busy", 2024-05-08T05:33:47.523 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:47.523 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:47.523 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:47.523 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:47.524 INFO:teuthology.orchestra.run.smithi087.stdout: "sqlite3_killpoint": { 2024-05-08T05:33:47.524 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "sqlite3_killpoint", 2024-05-08T05:33:47.524 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "int", 2024-05-08T05:33:47.524 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "dev", 2024-05-08T05:33:47.524 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:47.524 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "0", 2024-05-08T05:33:47.524 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:47.524 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:47.524 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:47.524 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:47.524 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:47.524 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:47.525 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:47.525 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-05-08T05:33:47.525 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-05-08T05:33:47.525 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:47.525 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-05-08T05:33:47.525 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "zabbix", 2024-05-08T05:33:47.525 INFO:teuthology.orchestra.run.smithi087.stdout: "can_run": true, 2024-05-08T05:33:47.525 INFO:teuthology.orchestra.run.smithi087.stdout: "error_string": "", 2024-05-08T05:33:47.525 INFO:teuthology.orchestra.run.smithi087.stdout: "module_options": { 2024-05-08T05:33:47.525 INFO:teuthology.orchestra.run.smithi087.stdout: "discovery_interval": { 2024-05-08T05:33:47.525 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "discovery_interval", 2024-05-08T05:33:47.525 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "uint", 2024-05-08T05:33:47.526 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:47.526 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-08T05:33:47.526 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "100", 2024-05-08T05:33:47.526 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:47.526 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:47.526 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:47.526 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:47.526 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:47.526 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:47.526 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:47.526 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:47.526 INFO:teuthology.orchestra.run.smithi087.stdout: "identifier": { 2024-05-08T05:33:47.527 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "identifier", 2024-05-08T05:33:47.527 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-08T05:33:47.527 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:47.527 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-08T05:33:47.527 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-05-08T05:33:47.527 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:47.527 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:47.527 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:47.527 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:47.527 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:47.527 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:47.527 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:47.527 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:47.528 INFO:teuthology.orchestra.run.smithi087.stdout: "interval": { 2024-05-08T05:33:47.528 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "interval", 2024-05-08T05:33:47.528 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "secs", 2024-05-08T05:33:47.528 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:47.528 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-08T05:33:47.528 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "60", 2024-05-08T05:33:47.528 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:47.528 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:47.528 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:47.528 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:47.528 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:47.528 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:47.528 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:47.529 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:47.529 INFO:teuthology.orchestra.run.smithi087.stdout: "log_level": { 2024-05-08T05:33:47.529 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_level", 2024-05-08T05:33:47.529 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-08T05:33:47.529 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:47.529 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:47.529 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-05-08T05:33:47.529 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:47.529 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:47.529 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [ 2024-05-08T05:33:47.529 INFO:teuthology.orchestra.run.smithi087.stdout: "", 2024-05-08T05:33:47.529 INFO:teuthology.orchestra.run.smithi087.stdout: "critical", 2024-05-08T05:33:47.530 INFO:teuthology.orchestra.run.smithi087.stdout: "debug", 2024-05-08T05:33:47.530 INFO:teuthology.orchestra.run.smithi087.stdout: "error", 2024-05-08T05:33:47.530 INFO:teuthology.orchestra.run.smithi087.stdout: "info", 2024-05-08T05:33:47.530 INFO:teuthology.orchestra.run.smithi087.stdout: "warning" 2024-05-08T05:33:47.530 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-05-08T05:33:47.530 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:47.530 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:47.530 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:47.530 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:47.530 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:47.530 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_cluster": { 2024-05-08T05:33:47.530 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_cluster", 2024-05-08T05:33:47.531 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-08T05:33:47.531 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:47.531 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:47.531 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-05-08T05:33:47.531 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:47.531 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:47.531 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:47.531 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:47.531 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:47.531 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:47.531 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:47.531 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:47.531 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_cluster_level": { 2024-05-08T05:33:47.532 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_cluster_level", 2024-05-08T05:33:47.532 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-08T05:33:47.532 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:47.532 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:47.532 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "info", 2024-05-08T05:33:47.532 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:47.532 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:47.532 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [ 2024-05-08T05:33:47.532 INFO:teuthology.orchestra.run.smithi087.stdout: "", 2024-05-08T05:33:47.532 INFO:teuthology.orchestra.run.smithi087.stdout: "critical", 2024-05-08T05:33:47.532 INFO:teuthology.orchestra.run.smithi087.stdout: "debug", 2024-05-08T05:33:47.532 INFO:teuthology.orchestra.run.smithi087.stdout: "error", 2024-05-08T05:33:47.533 INFO:teuthology.orchestra.run.smithi087.stdout: "info", 2024-05-08T05:33:47.533 INFO:teuthology.orchestra.run.smithi087.stdout: "warning" 2024-05-08T05:33:47.533 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-05-08T05:33:47.533 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:47.533 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:47.533 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:47.533 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:47.533 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:47.533 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_file": { 2024-05-08T05:33:47.533 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_file", 2024-05-08T05:33:47.533 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-08T05:33:47.533 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:47.533 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:47.534 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-05-08T05:33:47.534 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:47.534 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:47.534 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:47.534 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:47.534 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:47.534 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:47.534 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:47.534 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:47.534 INFO:teuthology.orchestra.run.smithi087.stdout: "sqlite3_killpoint": { 2024-05-08T05:33:47.534 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "sqlite3_killpoint", 2024-05-08T05:33:47.534 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "int", 2024-05-08T05:33:47.535 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "dev", 2024-05-08T05:33:47.535 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-08T05:33:47.535 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "0", 2024-05-08T05:33:47.535 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:47.535 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:47.535 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:47.535 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:47.535 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:47.535 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:47.535 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:47.535 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:47.535 INFO:teuthology.orchestra.run.smithi087.stdout: "zabbix_host": { 2024-05-08T05:33:47.536 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "zabbix_host", 2024-05-08T05:33:47.536 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-08T05:33:47.536 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:47.536 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-08T05:33:47.536 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-05-08T05:33:47.536 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:47.536 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:47.536 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:47.536 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:47.536 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:47.536 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:47.536 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:47.536 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:47.537 INFO:teuthology.orchestra.run.smithi087.stdout: "zabbix_port": { 2024-05-08T05:33:47.537 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "zabbix_port", 2024-05-08T05:33:47.537 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "int", 2024-05-08T05:33:47.537 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:47.537 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-08T05:33:47.537 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "10051", 2024-05-08T05:33:47.537 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:47.537 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:47.537 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:47.537 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:47.537 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:47.537 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:47.538 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:47.538 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:47.538 INFO:teuthology.orchestra.run.smithi087.stdout: "zabbix_sender": { 2024-05-08T05:33:47.538 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "zabbix_sender", 2024-05-08T05:33:47.538 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-08T05:33:47.538 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-08T05:33:47.538 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-08T05:33:47.538 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "/usr/bin/zabbix_sender", 2024-05-08T05:33:47.538 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-08T05:33:47.538 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-08T05:33:47.538 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-08T05:33:47.538 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-08T05:33:47.539 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-08T05:33:47.539 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-08T05:33:47.539 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-08T05:33:47.539 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-05-08T05:33:47.539 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-05-08T05:33:47.539 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-05-08T05:33:47.539 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-05-08T05:33:47.539 INFO:teuthology.orchestra.run.smithi087.stdout: "services": { 2024-05-08T05:33:47.539 INFO:teuthology.orchestra.run.smithi087.stdout: "dashboard": "https://172.21.15.87:8443/" 2024-05-08T05:33:47.539 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:47.539 INFO:teuthology.orchestra.run.smithi087.stdout: "always_on_modules": { 2024-05-08T05:33:47.539 INFO:teuthology.orchestra.run.smithi087.stdout: "octopus": [ 2024-05-08T05:33:47.539 INFO:teuthology.orchestra.run.smithi087.stdout: "balancer", 2024-05-08T05:33:47.539 INFO:teuthology.orchestra.run.smithi087.stdout: "crash", 2024-05-08T05:33:47.540 INFO:teuthology.orchestra.run.smithi087.stdout: "devicehealth", 2024-05-08T05:33:47.540 INFO:teuthology.orchestra.run.smithi087.stdout: "orchestrator", 2024-05-08T05:33:47.540 INFO:teuthology.orchestra.run.smithi087.stdout: "pg_autoscaler", 2024-05-08T05:33:47.540 INFO:teuthology.orchestra.run.smithi087.stdout: "progress", 2024-05-08T05:33:47.540 INFO:teuthology.orchestra.run.smithi087.stdout: "rbd_support", 2024-05-08T05:33:47.540 INFO:teuthology.orchestra.run.smithi087.stdout: "status", 2024-05-08T05:33:47.540 INFO:teuthology.orchestra.run.smithi087.stdout: "telemetry", 2024-05-08T05:33:47.540 INFO:teuthology.orchestra.run.smithi087.stdout: "volumes" 2024-05-08T05:33:47.540 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-05-08T05:33:47.540 INFO:teuthology.orchestra.run.smithi087.stdout: "pacific": [ 2024-05-08T05:33:47.541 INFO:teuthology.orchestra.run.smithi087.stdout: "balancer", 2024-05-08T05:33:47.541 INFO:teuthology.orchestra.run.smithi087.stdout: "crash", 2024-05-08T05:33:47.541 INFO:teuthology.orchestra.run.smithi087.stdout: "devicehealth", 2024-05-08T05:33:47.541 INFO:teuthology.orchestra.run.smithi087.stdout: "orchestrator", 2024-05-08T05:33:47.541 INFO:teuthology.orchestra.run.smithi087.stdout: "pg_autoscaler", 2024-05-08T05:33:47.541 INFO:teuthology.orchestra.run.smithi087.stdout: "progress", 2024-05-08T05:33:47.541 INFO:teuthology.orchestra.run.smithi087.stdout: "rbd_support", 2024-05-08T05:33:47.541 INFO:teuthology.orchestra.run.smithi087.stdout: "status", 2024-05-08T05:33:47.541 INFO:teuthology.orchestra.run.smithi087.stdout: "telemetry", 2024-05-08T05:33:47.541 INFO:teuthology.orchestra.run.smithi087.stdout: "volumes" 2024-05-08T05:33:47.541 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-05-08T05:33:47.541 INFO:teuthology.orchestra.run.smithi087.stdout: "quincy": [ 2024-05-08T05:33:47.542 INFO:teuthology.orchestra.run.smithi087.stdout: "balancer", 2024-05-08T05:33:47.542 INFO:teuthology.orchestra.run.smithi087.stdout: "crash", 2024-05-08T05:33:47.542 INFO:teuthology.orchestra.run.smithi087.stdout: "devicehealth", 2024-05-08T05:33:47.542 INFO:teuthology.orchestra.run.smithi087.stdout: "orchestrator", 2024-05-08T05:33:47.542 INFO:teuthology.orchestra.run.smithi087.stdout: "pg_autoscaler", 2024-05-08T05:33:47.542 INFO:teuthology.orchestra.run.smithi087.stdout: "progress", 2024-05-08T05:33:47.542 INFO:teuthology.orchestra.run.smithi087.stdout: "rbd_support", 2024-05-08T05:33:47.542 INFO:teuthology.orchestra.run.smithi087.stdout: "status", 2024-05-08T05:33:47.542 INFO:teuthology.orchestra.run.smithi087.stdout: "telemetry", 2024-05-08T05:33:47.542 INFO:teuthology.orchestra.run.smithi087.stdout: "volumes" 2024-05-08T05:33:47.542 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-05-08T05:33:47.543 INFO:teuthology.orchestra.run.smithi087.stdout: "reef": [ 2024-05-08T05:33:47.543 INFO:teuthology.orchestra.run.smithi087.stdout: "balancer", 2024-05-08T05:33:47.543 INFO:teuthology.orchestra.run.smithi087.stdout: "crash", 2024-05-08T05:33:47.543 INFO:teuthology.orchestra.run.smithi087.stdout: "devicehealth", 2024-05-08T05:33:47.543 INFO:teuthology.orchestra.run.smithi087.stdout: "orchestrator", 2024-05-08T05:33:47.543 INFO:teuthology.orchestra.run.smithi087.stdout: "pg_autoscaler", 2024-05-08T05:33:47.543 INFO:teuthology.orchestra.run.smithi087.stdout: "progress", 2024-05-08T05:33:47.543 INFO:teuthology.orchestra.run.smithi087.stdout: "rbd_support", 2024-05-08T05:33:47.543 INFO:teuthology.orchestra.run.smithi087.stdout: "status", 2024-05-08T05:33:47.543 INFO:teuthology.orchestra.run.smithi087.stdout: "telemetry", 2024-05-08T05:33:47.543 INFO:teuthology.orchestra.run.smithi087.stdout: "volumes" 2024-05-08T05:33:47.543 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-05-08T05:33:47.544 INFO:teuthology.orchestra.run.smithi087.stdout: "squid": [ 2024-05-08T05:33:47.544 INFO:teuthology.orchestra.run.smithi087.stdout: "balancer", 2024-05-08T05:33:47.544 INFO:teuthology.orchestra.run.smithi087.stdout: "crash", 2024-05-08T05:33:47.544 INFO:teuthology.orchestra.run.smithi087.stdout: "devicehealth", 2024-05-08T05:33:47.544 INFO:teuthology.orchestra.run.smithi087.stdout: "orchestrator", 2024-05-08T05:33:47.544 INFO:teuthology.orchestra.run.smithi087.stdout: "pg_autoscaler", 2024-05-08T05:33:47.544 INFO:teuthology.orchestra.run.smithi087.stdout: "progress", 2024-05-08T05:33:47.544 INFO:teuthology.orchestra.run.smithi087.stdout: "rbd_support", 2024-05-08T05:33:47.544 INFO:teuthology.orchestra.run.smithi087.stdout: "status", 2024-05-08T05:33:47.544 INFO:teuthology.orchestra.run.smithi087.stdout: "telemetry", 2024-05-08T05:33:47.544 INFO:teuthology.orchestra.run.smithi087.stdout: "volumes" 2024-05-08T05:33:47.544 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-05-08T05:33:47.544 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:47.545 INFO:teuthology.orchestra.run.smithi087.stdout: "last_failure_osd_epoch": 3, 2024-05-08T05:33:47.545 INFO:teuthology.orchestra.run.smithi087.stdout: "active_clients": [ 2024-05-08T05:33:47.545 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-05-08T05:33:47.545 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "devicehealth", 2024-05-08T05:33:47.545 INFO:teuthology.orchestra.run.smithi087.stdout: "addrvec": [ 2024-05-08T05:33:47.545 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-05-08T05:33:47.545 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "v2", 2024-05-08T05:33:47.545 INFO:teuthology.orchestra.run.smithi087.stdout: "addr": "172.21.15.87:0", 2024-05-08T05:33:47.545 INFO:teuthology.orchestra.run.smithi087.stdout: "nonce": 21652332 2024-05-08T05:33:47.545 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-05-08T05:33:47.545 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-05-08T05:33:47.545 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:47.546 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-05-08T05:33:47.546 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "libcephsqlite", 2024-05-08T05:33:47.546 INFO:teuthology.orchestra.run.smithi087.stdout: "addrvec": [ 2024-05-08T05:33:47.546 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-05-08T05:33:47.546 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "v2", 2024-05-08T05:33:47.546 INFO:teuthology.orchestra.run.smithi087.stdout: "addr": "172.21.15.87:0", 2024-05-08T05:33:47.546 INFO:teuthology.orchestra.run.smithi087.stdout: "nonce": 1921367406 2024-05-08T05:33:47.546 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-05-08T05:33:47.546 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-05-08T05:33:47.546 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:47.546 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-05-08T05:33:47.547 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "rbd_support", 2024-05-08T05:33:47.547 INFO:teuthology.orchestra.run.smithi087.stdout: "addrvec": [ 2024-05-08T05:33:47.547 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-05-08T05:33:47.547 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "v2", 2024-05-08T05:33:47.547 INFO:teuthology.orchestra.run.smithi087.stdout: "addr": "172.21.15.87:0", 2024-05-08T05:33:47.547 INFO:teuthology.orchestra.run.smithi087.stdout: "nonce": 895834073 2024-05-08T05:33:47.547 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-05-08T05:33:47.547 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-05-08T05:33:47.547 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:47.547 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-05-08T05:33:47.547 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "volumes", 2024-05-08T05:33:47.547 INFO:teuthology.orchestra.run.smithi087.stdout: "addrvec": [ 2024-05-08T05:33:47.548 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-05-08T05:33:47.548 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "v2", 2024-05-08T05:33:47.548 INFO:teuthology.orchestra.run.smithi087.stdout: "addr": "172.21.15.87:0", 2024-05-08T05:33:47.548 INFO:teuthology.orchestra.run.smithi087.stdout: "nonce": 547500259 2024-05-08T05:33:47.548 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-05-08T05:33:47.548 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-05-08T05:33:47.548 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-05-08T05:33:47.548 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-05-08T05:33:47.548 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-05-08T05:33:47.550 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:46.009+0000 7f996b600640 1 -- 172.21.15.87:0/3250649131 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f99480b2870 msgr2=0x7f99480b4d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:33:47.550 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:46.009+0000 7f996b600640 1 --2- 172.21.15.87:0/3250649131 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f99480b2870 0x7f99480b4d30 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f99641a0750 tx=0x7f994c00b390 comp rx=0 tx=0).stop 2024-05-08T05:33:47.550 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:46.009+0000 7f996b600640 1 -- 172.21.15.87:0/3250649131 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9964109010 msgr2=0x7f996419f240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:33:47.550 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:46.009+0000 7f996b600640 1 --2- 172.21.15.87:0/3250649131 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9964109010 0x7f996419f240 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f9954031500 tx=0x7f9954003c10 comp rx=0 tx=0).stop 2024-05-08T05:33:47.550 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:46.009+0000 7f996b600640 1 -- 172.21.15.87:0/3250649131 shutdown_connections 2024-05-08T05:33:47.550 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:46.009+0000 7f996b600640 1 --2- 172.21.15.87:0/3250649131 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f99480b2870 0x7f99480b4d30 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:33:47.550 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:46.009+0000 7f996b600640 1 --2- 172.21.15.87:0/3250649131 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f996410abc0 0x7f99641a67f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:33:47.550 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:46.009+0000 7f996b600640 1 --2- 172.21.15.87:0/3250649131 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f996410a200 0x7f996419f780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:33:47.550 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:46.009+0000 7f996b600640 1 --2- 172.21.15.87:0/3250649131 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9964109010 0x7f996419f240 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:33:47.550 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:46.009+0000 7f996b600640 1 -- 172.21.15.87:0/3250649131 >> 172.21.15.87:0/3250649131 conn(0x7f9964077fd0 msgr2=0x7f996410d570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:33:47.551 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:46.009+0000 7f996b600640 1 -- 172.21.15.87:0/3250649131 shutdown_connections 2024-05-08T05:33:47.551 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:33:46.010+0000 7f996b600640 1 -- 172.21.15.87:0/3250649131 wait complete. 2024-05-08T05:33:47.595 DEBUG:tasks.check_counter:Getting stats from a 2024-05-08T05:33:47.595 DEBUG:teuthology.orchestra.run.smithi087:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid eeeb813e-0cf9-11ef-bc97-c7b262605968 -- ceph daemon mds.a perf dump 2024-05-08T05:33:47.596 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:33:46 smithi087 ceph-mon[29523]: pgmap v563: 97 pgs: 97 active+clean; 153 MiB data, 986 MiB used, 1.0 TiB / 1.0 TiB avail; 609 KiB/s rd, 571 KiB/s wr, 164 op/s 2024-05-08T05:33:47.596 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:33:46 smithi087 ceph-mon[29523]: from='client.? 172.21.15.87:0/3250649131' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json-pretty"}]: dispatch 2024-05-08T05:33:48.039 INFO:teuthology.orchestra.run.smithi087.stderr:Inferring config /var/lib/ceph/eeeb813e-0cf9-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T05:33:48.708 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:33:48 smithi087 ceph-mon[29523]: pgmap v564: 97 pgs: 97 active+clean; 153 MiB data, 986 MiB used, 1.0 TiB / 1.0 TiB avail; 519 KiB/s rd, 495 KiB/s wr, 120 op/s 2024-05-08T05:33:48.788 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:33:48 smithi160 ceph-mon[34827]: pgmap v564: 97 pgs: 97 active+clean; 153 MiB data, 986 MiB used, 1.0 TiB / 1.0 TiB avail; 519 KiB/s rd, 495 KiB/s wr, 120 op/s 2024-05-08T05:33:48.983 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:33:48 smithi090 ceph-mon[34526]: pgmap v564: 97 pgs: 97 active+clean; 153 MiB data, 986 MiB used, 1.0 TiB / 1.0 TiB avail; 519 KiB/s rd, 495 KiB/s wr, 120 op/s 2024-05-08T05:33:50.306 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-05-08T05:33:50.307 INFO:teuthology.orchestra.run.smithi087.stdout: "AsyncMessenger::Worker-0": { 2024-05-08T05:33:50.307 INFO:teuthology.orchestra.run.smithi087.stdout: "msgr_recv_messages": 4, 2024-05-08T05:33:50.307 INFO:teuthology.orchestra.run.smithi087.stdout: "msgr_send_messages": 4, 2024-05-08T05:33:50.307 INFO:teuthology.orchestra.run.smithi087.stdout: "msgr_recv_bytes": 2992, 2024-05-08T05:33:50.307 INFO:teuthology.orchestra.run.smithi087.stdout: "msgr_send_bytes": 448, 2024-05-08T05:33:50.307 INFO:teuthology.orchestra.run.smithi087.stdout: "msgr_created_connections": 4, 2024-05-08T05:33:50.307 INFO:teuthology.orchestra.run.smithi087.stdout: "msgr_active_connections": 0, 2024-05-08T05:33:50.307 INFO:teuthology.orchestra.run.smithi087.stdout: "msgr_running_total_time": 0.004778135, 2024-05-08T05:33:50.307 INFO:teuthology.orchestra.run.smithi087.stdout: "msgr_running_send_time": 0.000068564, 2024-05-08T05:33:50.307 INFO:teuthology.orchestra.run.smithi087.stdout: "msgr_running_recv_time": 0.001295413, 2024-05-08T05:33:50.307 INFO:teuthology.orchestra.run.smithi087.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-05-08T05:33:50.308 INFO:teuthology.orchestra.run.smithi087.stdout: "msgr_send_messages_queue_lat": { 2024-05-08T05:33:50.308 INFO:teuthology.orchestra.run.smithi087.stdout: "avgcount": 3, 2024-05-08T05:33:50.308 INFO:teuthology.orchestra.run.smithi087.stdout: "sum": 0.001412543, 2024-05-08T05:33:50.308 INFO:teuthology.orchestra.run.smithi087.stdout: "avgtime": 0.000470847 2024-05-08T05:33:50.308 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:50.308 INFO:teuthology.orchestra.run.smithi087.stdout: "msgr_handle_ack_lat": { 2024-05-08T05:33:50.308 INFO:teuthology.orchestra.run.smithi087.stdout: "avgcount": 0, 2024-05-08T05:33:50.308 INFO:teuthology.orchestra.run.smithi087.stdout: "sum": 0.000000000, 2024-05-08T05:33:50.308 INFO:teuthology.orchestra.run.smithi087.stdout: "avgtime": 0.000000000 2024-05-08T05:33:50.308 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:50.308 INFO:teuthology.orchestra.run.smithi087.stdout: "msgr_recv_encrypted_bytes": 2992, 2024-05-08T05:33:50.308 INFO:teuthology.orchestra.run.smithi087.stdout: "msgr_send_encrypted_bytes": 448 2024-05-08T05:33:50.309 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:50.309 INFO:teuthology.orchestra.run.smithi087.stdout: "AsyncMessenger::Worker-1": { 2024-05-08T05:33:50.309 INFO:teuthology.orchestra.run.smithi087.stdout: "msgr_recv_messages": 1, 2024-05-08T05:33:50.309 INFO:teuthology.orchestra.run.smithi087.stdout: "msgr_send_messages": 106, 2024-05-08T05:33:50.309 INFO:teuthology.orchestra.run.smithi087.stdout: "msgr_recv_bytes": 160, 2024-05-08T05:33:50.309 INFO:teuthology.orchestra.run.smithi087.stdout: "msgr_send_bytes": 97200, 2024-05-08T05:33:50.309 INFO:teuthology.orchestra.run.smithi087.stdout: "msgr_created_connections": 3, 2024-05-08T05:33:50.309 INFO:teuthology.orchestra.run.smithi087.stdout: "msgr_active_connections": 2, 2024-05-08T05:33:50.309 INFO:teuthology.orchestra.run.smithi087.stdout: "msgr_running_total_time": 0.020262363, 2024-05-08T05:33:50.309 INFO:teuthology.orchestra.run.smithi087.stdout: "msgr_running_send_time": 0.015486905, 2024-05-08T05:33:50.309 INFO:teuthology.orchestra.run.smithi087.stdout: "msgr_running_recv_time": 0.002420271, 2024-05-08T05:33:50.309 INFO:teuthology.orchestra.run.smithi087.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-05-08T05:33:50.310 INFO:teuthology.orchestra.run.smithi087.stdout: "msgr_send_messages_queue_lat": { 2024-05-08T05:33:50.310 INFO:teuthology.orchestra.run.smithi087.stdout: "avgcount": 104, 2024-05-08T05:33:50.310 INFO:teuthology.orchestra.run.smithi087.stdout: "sum": 0.012281888, 2024-05-08T05:33:50.310 INFO:teuthology.orchestra.run.smithi087.stdout: "avgtime": 0.000118095 2024-05-08T05:33:50.310 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:50.310 INFO:teuthology.orchestra.run.smithi087.stdout: "msgr_handle_ack_lat": { 2024-05-08T05:33:50.310 INFO:teuthology.orchestra.run.smithi087.stdout: "avgcount": 0, 2024-05-08T05:33:50.310 INFO:teuthology.orchestra.run.smithi087.stdout: "sum": 0.000000000, 2024-05-08T05:33:50.310 INFO:teuthology.orchestra.run.smithi087.stdout: "avgtime": 0.000000000 2024-05-08T05:33:50.310 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:50.310 INFO:teuthology.orchestra.run.smithi087.stdout: "msgr_recv_encrypted_bytes": 160, 2024-05-08T05:33:50.310 INFO:teuthology.orchestra.run.smithi087.stdout: "msgr_send_encrypted_bytes": 97200 2024-05-08T05:33:50.311 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:50.311 INFO:teuthology.orchestra.run.smithi087.stdout: "AsyncMessenger::Worker-2": { 2024-05-08T05:33:50.311 INFO:teuthology.orchestra.run.smithi087.stdout: "msgr_recv_messages": 143, 2024-05-08T05:33:50.311 INFO:teuthology.orchestra.run.smithi087.stdout: "msgr_send_messages": 140, 2024-05-08T05:33:50.311 INFO:teuthology.orchestra.run.smithi087.stdout: "msgr_recv_bytes": 491664, 2024-05-08T05:33:50.311 INFO:teuthology.orchestra.run.smithi087.stdout: "msgr_send_bytes": 85472, 2024-05-08T05:33:50.311 INFO:teuthology.orchestra.run.smithi087.stdout: "msgr_created_connections": 2, 2024-05-08T05:33:50.311 INFO:teuthology.orchestra.run.smithi087.stdout: "msgr_active_connections": 1, 2024-05-08T05:33:50.311 INFO:teuthology.orchestra.run.smithi087.stdout: "msgr_running_total_time": 0.051871662, 2024-05-08T05:33:50.311 INFO:teuthology.orchestra.run.smithi087.stdout: "msgr_running_send_time": 0.021108102, 2024-05-08T05:33:50.311 INFO:teuthology.orchestra.run.smithi087.stdout: "msgr_running_recv_time": 0.029635421, 2024-05-08T05:33:50.312 INFO:teuthology.orchestra.run.smithi087.stdout: "msgr_running_fast_dispatch_time": 0.006118032, 2024-05-08T05:33:50.312 INFO:teuthology.orchestra.run.smithi087.stdout: "msgr_send_messages_queue_lat": { 2024-05-08T05:33:50.312 INFO:teuthology.orchestra.run.smithi087.stdout: "avgcount": 139, 2024-05-08T05:33:50.312 INFO:teuthology.orchestra.run.smithi087.stdout: "sum": 0.013774007, 2024-05-08T05:33:50.312 INFO:teuthology.orchestra.run.smithi087.stdout: "avgtime": 0.000099093 2024-05-08T05:33:50.312 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:50.312 INFO:teuthology.orchestra.run.smithi087.stdout: "msgr_handle_ack_lat": { 2024-05-08T05:33:50.312 INFO:teuthology.orchestra.run.smithi087.stdout: "avgcount": 0, 2024-05-08T05:33:50.312 INFO:teuthology.orchestra.run.smithi087.stdout: "sum": 0.000000000, 2024-05-08T05:33:50.312 INFO:teuthology.orchestra.run.smithi087.stdout: "avgtime": 0.000000000 2024-05-08T05:33:50.312 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:50.312 INFO:teuthology.orchestra.run.smithi087.stdout: "msgr_recv_encrypted_bytes": 491664, 2024-05-08T05:33:50.312 INFO:teuthology.orchestra.run.smithi087.stdout: "msgr_send_encrypted_bytes": 85472 2024-05-08T05:33:50.313 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:50.313 INFO:teuthology.orchestra.run.smithi087.stdout: "cct": { 2024-05-08T05:33:50.313 INFO:teuthology.orchestra.run.smithi087.stdout: "total_workers": 0, 2024-05-08T05:33:50.313 INFO:teuthology.orchestra.run.smithi087.stdout: "unhealthy_workers": 0 2024-05-08T05:33:50.313 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:50.313 INFO:teuthology.orchestra.run.smithi087.stdout: "mempool": { 2024-05-08T05:33:50.313 INFO:teuthology.orchestra.run.smithi087.stdout: "bloom_filter_bytes": 0, 2024-05-08T05:33:50.313 INFO:teuthology.orchestra.run.smithi087.stdout: "bloom_filter_items": 0, 2024-05-08T05:33:50.313 INFO:teuthology.orchestra.run.smithi087.stdout: "bluestore_alloc_bytes": 0, 2024-05-08T05:33:50.313 INFO:teuthology.orchestra.run.smithi087.stdout: "bluestore_alloc_items": 0, 2024-05-08T05:33:50.313 INFO:teuthology.orchestra.run.smithi087.stdout: "bluestore_cache_data_bytes": 0, 2024-05-08T05:33:50.313 INFO:teuthology.orchestra.run.smithi087.stdout: "bluestore_cache_data_items": 0, 2024-05-08T05:33:50.314 INFO:teuthology.orchestra.run.smithi087.stdout: "bluestore_cache_onode_bytes": 0, 2024-05-08T05:33:50.314 INFO:teuthology.orchestra.run.smithi087.stdout: "bluestore_cache_onode_items": 0, 2024-05-08T05:33:50.314 INFO:teuthology.orchestra.run.smithi087.stdout: "bluestore_cache_meta_bytes": 0, 2024-05-08T05:33:50.314 INFO:teuthology.orchestra.run.smithi087.stdout: "bluestore_cache_meta_items": 0, 2024-05-08T05:33:50.314 INFO:teuthology.orchestra.run.smithi087.stdout: "bluestore_cache_other_bytes": 0, 2024-05-08T05:33:50.314 INFO:teuthology.orchestra.run.smithi087.stdout: "bluestore_cache_other_items": 0, 2024-05-08T05:33:50.314 INFO:teuthology.orchestra.run.smithi087.stdout: "bluestore_cache_buffer_bytes": 0, 2024-05-08T05:33:50.314 INFO:teuthology.orchestra.run.smithi087.stdout: "bluestore_cache_buffer_items": 0, 2024-05-08T05:33:50.314 INFO:teuthology.orchestra.run.smithi087.stdout: "bluestore_extent_bytes": 0, 2024-05-08T05:33:50.314 INFO:teuthology.orchestra.run.smithi087.stdout: "bluestore_extent_items": 0, 2024-05-08T05:33:50.314 INFO:teuthology.orchestra.run.smithi087.stdout: "bluestore_blob_bytes": 0, 2024-05-08T05:33:50.315 INFO:teuthology.orchestra.run.smithi087.stdout: "bluestore_blob_items": 0, 2024-05-08T05:33:50.315 INFO:teuthology.orchestra.run.smithi087.stdout: "bluestore_shared_blob_bytes": 0, 2024-05-08T05:33:50.315 INFO:teuthology.orchestra.run.smithi087.stdout: "bluestore_shared_blob_items": 0, 2024-05-08T05:33:50.315 INFO:teuthology.orchestra.run.smithi087.stdout: "bluestore_inline_bl_bytes": 0, 2024-05-08T05:33:50.315 INFO:teuthology.orchestra.run.smithi087.stdout: "bluestore_inline_bl_items": 0, 2024-05-08T05:33:50.315 INFO:teuthology.orchestra.run.smithi087.stdout: "bluestore_fsck_bytes": 0, 2024-05-08T05:33:50.315 INFO:teuthology.orchestra.run.smithi087.stdout: "bluestore_fsck_items": 0, 2024-05-08T05:33:50.315 INFO:teuthology.orchestra.run.smithi087.stdout: "bluestore_txc_bytes": 0, 2024-05-08T05:33:50.315 INFO:teuthology.orchestra.run.smithi087.stdout: "bluestore_txc_items": 0, 2024-05-08T05:33:50.315 INFO:teuthology.orchestra.run.smithi087.stdout: "bluestore_writing_deferred_bytes": 0, 2024-05-08T05:33:50.315 INFO:teuthology.orchestra.run.smithi087.stdout: "bluestore_writing_deferred_items": 0, 2024-05-08T05:33:50.315 INFO:teuthology.orchestra.run.smithi087.stdout: "bluestore_writing_bytes": 0, 2024-05-08T05:33:50.316 INFO:teuthology.orchestra.run.smithi087.stdout: "bluestore_writing_items": 0, 2024-05-08T05:33:50.316 INFO:teuthology.orchestra.run.smithi087.stdout: "bluefs_bytes": 0, 2024-05-08T05:33:50.316 INFO:teuthology.orchestra.run.smithi087.stdout: "bluefs_items": 0, 2024-05-08T05:33:50.316 INFO:teuthology.orchestra.run.smithi087.stdout: "bluefs_file_reader_bytes": 0, 2024-05-08T05:33:50.316 INFO:teuthology.orchestra.run.smithi087.stdout: "bluefs_file_reader_items": 0, 2024-05-08T05:33:50.316 INFO:teuthology.orchestra.run.smithi087.stdout: "bluefs_file_writer_bytes": 0, 2024-05-08T05:33:50.316 INFO:teuthology.orchestra.run.smithi087.stdout: "bluefs_file_writer_items": 0, 2024-05-08T05:33:50.316 INFO:teuthology.orchestra.run.smithi087.stdout: "buffer_anon_bytes": 151029, 2024-05-08T05:33:50.316 INFO:teuthology.orchestra.run.smithi087.stdout: "buffer_anon_items": 31, 2024-05-08T05:33:50.316 INFO:teuthology.orchestra.run.smithi087.stdout: "buffer_meta_bytes": 0, 2024-05-08T05:33:50.316 INFO:teuthology.orchestra.run.smithi087.stdout: "buffer_meta_items": 0, 2024-05-08T05:33:50.316 INFO:teuthology.orchestra.run.smithi087.stdout: "osd_bytes": 0, 2024-05-08T05:33:50.317 INFO:teuthology.orchestra.run.smithi087.stdout: "osd_items": 0, 2024-05-08T05:33:50.317 INFO:teuthology.orchestra.run.smithi087.stdout: "osd_mapbl_bytes": 0, 2024-05-08T05:33:50.317 INFO:teuthology.orchestra.run.smithi087.stdout: "osd_mapbl_items": 0, 2024-05-08T05:33:50.317 INFO:teuthology.orchestra.run.smithi087.stdout: "osd_pglog_bytes": 0, 2024-05-08T05:33:50.317 INFO:teuthology.orchestra.run.smithi087.stdout: "osd_pglog_items": 0, 2024-05-08T05:33:50.317 INFO:teuthology.orchestra.run.smithi087.stdout: "osdmap_bytes": 0, 2024-05-08T05:33:50.317 INFO:teuthology.orchestra.run.smithi087.stdout: "osdmap_items": 0, 2024-05-08T05:33:50.317 INFO:teuthology.orchestra.run.smithi087.stdout: "osdmap_mapping_bytes": 0, 2024-05-08T05:33:50.317 INFO:teuthology.orchestra.run.smithi087.stdout: "osdmap_mapping_items": 0, 2024-05-08T05:33:50.317 INFO:teuthology.orchestra.run.smithi087.stdout: "pgmap_bytes": 0, 2024-05-08T05:33:50.318 INFO:teuthology.orchestra.run.smithi087.stdout: "pgmap_items": 0, 2024-05-08T05:33:50.318 INFO:teuthology.orchestra.run.smithi087.stdout: "mds_co_bytes": 928, 2024-05-08T05:33:50.318 INFO:teuthology.orchestra.run.smithi087.stdout: "mds_co_items": 2, 2024-05-08T05:33:50.318 INFO:teuthology.orchestra.run.smithi087.stdout: "unittest_1_bytes": 0, 2024-05-08T05:33:50.318 INFO:teuthology.orchestra.run.smithi087.stdout: "unittest_1_items": 0, 2024-05-08T05:33:50.318 INFO:teuthology.orchestra.run.smithi087.stdout: "unittest_2_bytes": 0, 2024-05-08T05:33:50.318 INFO:teuthology.orchestra.run.smithi087.stdout: "unittest_2_items": 0 2024-05-08T05:33:50.318 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:50.318 INFO:teuthology.orchestra.run.smithi087.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-05-08T05:33:50.318 INFO:teuthology.orchestra.run.smithi087.stdout: "val": 0, 2024-05-08T05:33:50.318 INFO:teuthology.orchestra.run.smithi087.stdout: "max": 104857600, 2024-05-08T05:33:50.318 INFO:teuthology.orchestra.run.smithi087.stdout: "get_started": 0, 2024-05-08T05:33:50.319 INFO:teuthology.orchestra.run.smithi087.stdout: "get": 144, 2024-05-08T05:33:50.319 INFO:teuthology.orchestra.run.smithi087.stdout: "get_sum": 471467, 2024-05-08T05:33:50.319 INFO:teuthology.orchestra.run.smithi087.stdout: "get_or_fail_fail": 0, 2024-05-08T05:33:50.319 INFO:teuthology.orchestra.run.smithi087.stdout: "get_or_fail_success": 144, 2024-05-08T05:33:50.319 INFO:teuthology.orchestra.run.smithi087.stdout: "take": 0, 2024-05-08T05:33:50.319 INFO:teuthology.orchestra.run.smithi087.stdout: "take_sum": 0, 2024-05-08T05:33:50.319 INFO:teuthology.orchestra.run.smithi087.stdout: "put": 144, 2024-05-08T05:33:50.319 INFO:teuthology.orchestra.run.smithi087.stdout: "put_sum": 471467, 2024-05-08T05:33:50.319 INFO:teuthology.orchestra.run.smithi087.stdout: "wait": { 2024-05-08T05:33:50.319 INFO:teuthology.orchestra.run.smithi087.stdout: "avgcount": 0, 2024-05-08T05:33:50.319 INFO:teuthology.orchestra.run.smithi087.stdout: "sum": 0.000000000, 2024-05-08T05:33:50.320 INFO:teuthology.orchestra.run.smithi087.stdout: "avgtime": 0.000000000 2024-05-08T05:33:50.320 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-05-08T05:33:50.320 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-05-08T05:33:50.320 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-05-08T05:33:50.788 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:33:50 smithi160 ceph-mon[34827]: pgmap v565: 97 pgs: 97 active+clean; 153 MiB data, 1004 MiB used, 1.0 TiB / 1.0 TiB avail; 522 KiB/s rd, 493 KiB/s wr, 105 op/s 2024-05-08T05:33:50.958 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:33:50 smithi087 ceph-mon[29523]: pgmap v565: 97 pgs: 97 active+clean; 153 MiB data, 1004 MiB used, 1.0 TiB / 1.0 TiB avail; 522 KiB/s rd, 493 KiB/s wr, 105 op/s 2024-05-08T05:33:50.983 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:33:50 smithi090 ceph-mon[34526]: pgmap v565: 97 pgs: 97 active+clean; 153 MiB data, 1004 MiB used, 1.0 TiB / 1.0 TiB avail; 522 KiB/s rd, 493 KiB/s wr, 105 op/s 2024-05-08T05:33:51.148 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.a 2024-05-08T05:33:51.149 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.a 2024-05-08T05:33:51.149 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update' not found on daemon mds.a 2024-05-08T05:33:51.149 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update_receipt' not found on daemon mds.a 2024-05-08T05:33:51.149 DEBUG:tasks.check_counter:Getting stats from d 2024-05-08T05:33:51.149 DEBUG:teuthology.orchestra.run.smithi087:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid eeeb813e-0cf9-11ef-bc97-c7b262605968 -- ceph daemon mds.d perf dump 2024-05-08T05:33:51.591 INFO:teuthology.orchestra.run.smithi087.stderr:Inferring config /var/lib/ceph/eeeb813e-0cf9-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T05:33:52.789 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:33:52 smithi160 ceph-mon[34827]: pgmap v566: 97 pgs: 97 active+clean; 153 MiB data, 1004 MiB used, 1.0 TiB / 1.0 TiB avail; 188 KiB/s rd, 187 KiB/s wr, 50 op/s 2024-05-08T05:33:52.958 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:33:52 smithi087 ceph-mon[29523]: pgmap v566: 97 pgs: 97 active+clean; 153 MiB data, 1004 MiB used, 1.0 TiB / 1.0 TiB avail; 188 KiB/s rd, 187 KiB/s wr, 50 op/s 2024-05-08T05:33:52.983 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:33:52 smithi090 ceph-mon[34526]: pgmap v566: 97 pgs: 97 active+clean; 153 MiB data, 1004 MiB used, 1.0 TiB / 1.0 TiB avail; 188 KiB/s rd, 187 KiB/s wr, 50 op/s 2024-05-08T05:33:53.876 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-05-08T05:33:53.876 INFO:teuthology.orchestra.run.smithi087.stdout: "AsyncMessenger::Worker-0": { 2024-05-08T05:33:53.876 INFO:teuthology.orchestra.run.smithi087.stdout: "msgr_recv_messages": 0, 2024-05-08T05:33:53.876 INFO:teuthology.orchestra.run.smithi087.stdout: "msgr_send_messages": 2, 2024-05-08T05:33:53.876 INFO:teuthology.orchestra.run.smithi087.stdout: "msgr_recv_bytes": 0, 2024-05-08T05:33:53.876 INFO:teuthology.orchestra.run.smithi087.stdout: "msgr_send_bytes": 0, 2024-05-08T05:33:53.876 INFO:teuthology.orchestra.run.smithi087.stdout: "msgr_created_connections": 4, 2024-05-08T05:33:53.876 INFO:teuthology.orchestra.run.smithi087.stdout: "msgr_active_connections": 0, 2024-05-08T05:33:53.876 INFO:teuthology.orchestra.run.smithi087.stdout: "msgr_running_total_time": 0.004390324, 2024-05-08T05:33:53.877 INFO:teuthology.orchestra.run.smithi087.stdout: "msgr_running_send_time": 0.000000000, 2024-05-08T05:33:53.877 INFO:teuthology.orchestra.run.smithi087.stdout: "msgr_running_recv_time": 0.001305765, 2024-05-08T05:33:53.877 INFO:teuthology.orchestra.run.smithi087.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-05-08T05:33:53.877 INFO:teuthology.orchestra.run.smithi087.stdout: "msgr_send_messages_queue_lat": { 2024-05-08T05:33:53.877 INFO:teuthology.orchestra.run.smithi087.stdout: "avgcount": 0, 2024-05-08T05:33:53.877 INFO:teuthology.orchestra.run.smithi087.stdout: "sum": 0.000000000, 2024-05-08T05:33:53.877 INFO:teuthology.orchestra.run.smithi087.stdout: "avgtime": 0.000000000 2024-05-08T05:33:53.877 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:53.877 INFO:teuthology.orchestra.run.smithi087.stdout: "msgr_handle_ack_lat": { 2024-05-08T05:33:53.877 INFO:teuthology.orchestra.run.smithi087.stdout: "avgcount": 0, 2024-05-08T05:33:53.877 INFO:teuthology.orchestra.run.smithi087.stdout: "sum": 0.000000000, 2024-05-08T05:33:53.877 INFO:teuthology.orchestra.run.smithi087.stdout: "avgtime": 0.000000000 2024-05-08T05:33:53.877 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:53.877 INFO:teuthology.orchestra.run.smithi087.stdout: "msgr_recv_encrypted_bytes": 0, 2024-05-08T05:33:53.878 INFO:teuthology.orchestra.run.smithi087.stdout: "msgr_send_encrypted_bytes": 0 2024-05-08T05:33:53.878 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:53.878 INFO:teuthology.orchestra.run.smithi087.stdout: "AsyncMessenger::Worker-1": { 2024-05-08T05:33:53.878 INFO:teuthology.orchestra.run.smithi087.stdout: "msgr_recv_messages": 155, 2024-05-08T05:33:53.878 INFO:teuthology.orchestra.run.smithi087.stdout: "msgr_send_messages": 150, 2024-05-08T05:33:53.878 INFO:teuthology.orchestra.run.smithi087.stdout: "msgr_recv_bytes": 497456, 2024-05-08T05:33:53.878 INFO:teuthology.orchestra.run.smithi087.stdout: "msgr_send_bytes": 90736, 2024-05-08T05:33:53.878 INFO:teuthology.orchestra.run.smithi087.stdout: "msgr_created_connections": 2, 2024-05-08T05:33:53.878 INFO:teuthology.orchestra.run.smithi087.stdout: "msgr_active_connections": 1, 2024-05-08T05:33:53.878 INFO:teuthology.orchestra.run.smithi087.stdout: "msgr_running_total_time": 0.054441932, 2024-05-08T05:33:53.878 INFO:teuthology.orchestra.run.smithi087.stdout: "msgr_running_send_time": 0.021669336, 2024-05-08T05:33:53.878 INFO:teuthology.orchestra.run.smithi087.stdout: "msgr_running_recv_time": 0.032310964, 2024-05-08T05:33:53.878 INFO:teuthology.orchestra.run.smithi087.stdout: "msgr_running_fast_dispatch_time": 0.006244581, 2024-05-08T05:33:53.879 INFO:teuthology.orchestra.run.smithi087.stdout: "msgr_send_messages_queue_lat": { 2024-05-08T05:33:53.879 INFO:teuthology.orchestra.run.smithi087.stdout: "avgcount": 150, 2024-05-08T05:33:53.879 INFO:teuthology.orchestra.run.smithi087.stdout: "sum": 0.016852194, 2024-05-08T05:33:53.879 INFO:teuthology.orchestra.run.smithi087.stdout: "avgtime": 0.000112347 2024-05-08T05:33:53.879 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:53.879 INFO:teuthology.orchestra.run.smithi087.stdout: "msgr_handle_ack_lat": { 2024-05-08T05:33:53.879 INFO:teuthology.orchestra.run.smithi087.stdout: "avgcount": 0, 2024-05-08T05:33:53.879 INFO:teuthology.orchestra.run.smithi087.stdout: "sum": 0.000000000, 2024-05-08T05:33:53.879 INFO:teuthology.orchestra.run.smithi087.stdout: "avgtime": 0.000000000 2024-05-08T05:33:53.879 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:53.879 INFO:teuthology.orchestra.run.smithi087.stdout: "msgr_recv_encrypted_bytes": 497456, 2024-05-08T05:33:53.879 INFO:teuthology.orchestra.run.smithi087.stdout: "msgr_send_encrypted_bytes": 90736 2024-05-08T05:33:53.879 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:53.879 INFO:teuthology.orchestra.run.smithi087.stdout: "AsyncMessenger::Worker-2": { 2024-05-08T05:33:53.880 INFO:teuthology.orchestra.run.smithi087.stdout: "msgr_recv_messages": 1, 2024-05-08T05:33:53.880 INFO:teuthology.orchestra.run.smithi087.stdout: "msgr_send_messages": 112, 2024-05-08T05:33:53.880 INFO:teuthology.orchestra.run.smithi087.stdout: "msgr_recv_bytes": 160, 2024-05-08T05:33:53.880 INFO:teuthology.orchestra.run.smithi087.stdout: "msgr_send_bytes": 98256, 2024-05-08T05:33:53.880 INFO:teuthology.orchestra.run.smithi087.stdout: "msgr_created_connections": 3, 2024-05-08T05:33:53.880 INFO:teuthology.orchestra.run.smithi087.stdout: "msgr_active_connections": 2, 2024-05-08T05:33:53.880 INFO:teuthology.orchestra.run.smithi087.stdout: "msgr_running_total_time": 0.020241412, 2024-05-08T05:33:53.880 INFO:teuthology.orchestra.run.smithi087.stdout: "msgr_running_send_time": 0.015428651, 2024-05-08T05:33:53.880 INFO:teuthology.orchestra.run.smithi087.stdout: "msgr_running_recv_time": 0.002413049, 2024-05-08T05:33:53.880 INFO:teuthology.orchestra.run.smithi087.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-05-08T05:33:53.880 INFO:teuthology.orchestra.run.smithi087.stdout: "msgr_send_messages_queue_lat": { 2024-05-08T05:33:53.880 INFO:teuthology.orchestra.run.smithi087.stdout: "avgcount": 110, 2024-05-08T05:33:53.880 INFO:teuthology.orchestra.run.smithi087.stdout: "sum": 0.009973144, 2024-05-08T05:33:53.880 INFO:teuthology.orchestra.run.smithi087.stdout: "avgtime": 0.000090664 2024-05-08T05:33:53.881 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:53.881 INFO:teuthology.orchestra.run.smithi087.stdout: "msgr_handle_ack_lat": { 2024-05-08T05:33:53.881 INFO:teuthology.orchestra.run.smithi087.stdout: "avgcount": 0, 2024-05-08T05:33:53.881 INFO:teuthology.orchestra.run.smithi087.stdout: "sum": 0.000000000, 2024-05-08T05:33:53.881 INFO:teuthology.orchestra.run.smithi087.stdout: "avgtime": 0.000000000 2024-05-08T05:33:53.881 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:53.881 INFO:teuthology.orchestra.run.smithi087.stdout: "msgr_recv_encrypted_bytes": 160, 2024-05-08T05:33:53.881 INFO:teuthology.orchestra.run.smithi087.stdout: "msgr_send_encrypted_bytes": 98256 2024-05-08T05:33:53.881 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:53.881 INFO:teuthology.orchestra.run.smithi087.stdout: "cct": { 2024-05-08T05:33:53.881 INFO:teuthology.orchestra.run.smithi087.stdout: "total_workers": 0, 2024-05-08T05:33:53.881 INFO:teuthology.orchestra.run.smithi087.stdout: "unhealthy_workers": 0 2024-05-08T05:33:53.881 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:53.881 INFO:teuthology.orchestra.run.smithi087.stdout: "mempool": { 2024-05-08T05:33:53.881 INFO:teuthology.orchestra.run.smithi087.stdout: "bloom_filter_bytes": 0, 2024-05-08T05:33:53.882 INFO:teuthology.orchestra.run.smithi087.stdout: "bloom_filter_items": 0, 2024-05-08T05:33:53.882 INFO:teuthology.orchestra.run.smithi087.stdout: "bluestore_alloc_bytes": 0, 2024-05-08T05:33:53.882 INFO:teuthology.orchestra.run.smithi087.stdout: "bluestore_alloc_items": 0, 2024-05-08T05:33:53.882 INFO:teuthology.orchestra.run.smithi087.stdout: "bluestore_cache_data_bytes": 0, 2024-05-08T05:33:53.882 INFO:teuthology.orchestra.run.smithi087.stdout: "bluestore_cache_data_items": 0, 2024-05-08T05:33:53.882 INFO:teuthology.orchestra.run.smithi087.stdout: "bluestore_cache_onode_bytes": 0, 2024-05-08T05:33:53.882 INFO:teuthology.orchestra.run.smithi087.stdout: "bluestore_cache_onode_items": 0, 2024-05-08T05:33:53.882 INFO:teuthology.orchestra.run.smithi087.stdout: "bluestore_cache_meta_bytes": 0, 2024-05-08T05:33:53.882 INFO:teuthology.orchestra.run.smithi087.stdout: "bluestore_cache_meta_items": 0, 2024-05-08T05:33:53.882 INFO:teuthology.orchestra.run.smithi087.stdout: "bluestore_cache_other_bytes": 0, 2024-05-08T05:33:53.883 INFO:teuthology.orchestra.run.smithi087.stdout: "bluestore_cache_other_items": 0, 2024-05-08T05:33:53.883 INFO:teuthology.orchestra.run.smithi087.stdout: "bluestore_cache_buffer_bytes": 0, 2024-05-08T05:33:53.883 INFO:teuthology.orchestra.run.smithi087.stdout: "bluestore_cache_buffer_items": 0, 2024-05-08T05:33:53.883 INFO:teuthology.orchestra.run.smithi087.stdout: "bluestore_extent_bytes": 0, 2024-05-08T05:33:53.883 INFO:teuthology.orchestra.run.smithi087.stdout: "bluestore_extent_items": 0, 2024-05-08T05:33:53.883 INFO:teuthology.orchestra.run.smithi087.stdout: "bluestore_blob_bytes": 0, 2024-05-08T05:33:53.883 INFO:teuthology.orchestra.run.smithi087.stdout: "bluestore_blob_items": 0, 2024-05-08T05:33:53.883 INFO:teuthology.orchestra.run.smithi087.stdout: "bluestore_shared_blob_bytes": 0, 2024-05-08T05:33:53.883 INFO:teuthology.orchestra.run.smithi087.stdout: "bluestore_shared_blob_items": 0, 2024-05-08T05:33:53.883 INFO:teuthology.orchestra.run.smithi087.stdout: "bluestore_inline_bl_bytes": 0, 2024-05-08T05:33:53.883 INFO:teuthology.orchestra.run.smithi087.stdout: "bluestore_inline_bl_items": 0, 2024-05-08T05:33:53.883 INFO:teuthology.orchestra.run.smithi087.stdout: "bluestore_fsck_bytes": 0, 2024-05-08T05:33:53.883 INFO:teuthology.orchestra.run.smithi087.stdout: "bluestore_fsck_items": 0, 2024-05-08T05:33:53.883 INFO:teuthology.orchestra.run.smithi087.stdout: "bluestore_txc_bytes": 0, 2024-05-08T05:33:53.884 INFO:teuthology.orchestra.run.smithi087.stdout: "bluestore_txc_items": 0, 2024-05-08T05:33:53.884 INFO:teuthology.orchestra.run.smithi087.stdout: "bluestore_writing_deferred_bytes": 0, 2024-05-08T05:33:53.884 INFO:teuthology.orchestra.run.smithi087.stdout: "bluestore_writing_deferred_items": 0, 2024-05-08T05:33:53.884 INFO:teuthology.orchestra.run.smithi087.stdout: "bluestore_writing_bytes": 0, 2024-05-08T05:33:53.884 INFO:teuthology.orchestra.run.smithi087.stdout: "bluestore_writing_items": 0, 2024-05-08T05:33:53.884 INFO:teuthology.orchestra.run.smithi087.stdout: "bluefs_bytes": 0, 2024-05-08T05:33:53.884 INFO:teuthology.orchestra.run.smithi087.stdout: "bluefs_items": 0, 2024-05-08T05:33:53.884 INFO:teuthology.orchestra.run.smithi087.stdout: "bluefs_file_reader_bytes": 0, 2024-05-08T05:33:53.884 INFO:teuthology.orchestra.run.smithi087.stdout: "bluefs_file_reader_items": 0, 2024-05-08T05:33:53.884 INFO:teuthology.orchestra.run.smithi087.stdout: "bluefs_file_writer_bytes": 0, 2024-05-08T05:33:53.884 INFO:teuthology.orchestra.run.smithi087.stdout: "bluefs_file_writer_items": 0, 2024-05-08T05:33:53.884 INFO:teuthology.orchestra.run.smithi087.stdout: "buffer_anon_bytes": 150015, 2024-05-08T05:33:53.884 INFO:teuthology.orchestra.run.smithi087.stdout: "buffer_anon_items": 31, 2024-05-08T05:33:53.884 INFO:teuthology.orchestra.run.smithi087.stdout: "buffer_meta_bytes": 0, 2024-05-08T05:33:53.884 INFO:teuthology.orchestra.run.smithi087.stdout: "buffer_meta_items": 0, 2024-05-08T05:33:53.885 INFO:teuthology.orchestra.run.smithi087.stdout: "osd_bytes": 0, 2024-05-08T05:33:53.885 INFO:teuthology.orchestra.run.smithi087.stdout: "osd_items": 0, 2024-05-08T05:33:53.885 INFO:teuthology.orchestra.run.smithi087.stdout: "osd_mapbl_bytes": 0, 2024-05-08T05:33:53.885 INFO:teuthology.orchestra.run.smithi087.stdout: "osd_mapbl_items": 0, 2024-05-08T05:33:53.885 INFO:teuthology.orchestra.run.smithi087.stdout: "osd_pglog_bytes": 0, 2024-05-08T05:33:53.885 INFO:teuthology.orchestra.run.smithi087.stdout: "osd_pglog_items": 0, 2024-05-08T05:33:53.885 INFO:teuthology.orchestra.run.smithi087.stdout: "osdmap_bytes": 0, 2024-05-08T05:33:53.885 INFO:teuthology.orchestra.run.smithi087.stdout: "osdmap_items": 0, 2024-05-08T05:33:53.885 INFO:teuthology.orchestra.run.smithi087.stdout: "osdmap_mapping_bytes": 0, 2024-05-08T05:33:53.885 INFO:teuthology.orchestra.run.smithi087.stdout: "osdmap_mapping_items": 0, 2024-05-08T05:33:53.885 INFO:teuthology.orchestra.run.smithi087.stdout: "pgmap_bytes": 0, 2024-05-08T05:33:53.885 INFO:teuthology.orchestra.run.smithi087.stdout: "pgmap_items": 0, 2024-05-08T05:33:53.885 INFO:teuthology.orchestra.run.smithi087.stdout: "mds_co_bytes": 928, 2024-05-08T05:33:53.885 INFO:teuthology.orchestra.run.smithi087.stdout: "mds_co_items": 2, 2024-05-08T05:33:53.886 INFO:teuthology.orchestra.run.smithi087.stdout: "unittest_1_bytes": 0, 2024-05-08T05:33:53.886 INFO:teuthology.orchestra.run.smithi087.stdout: "unittest_1_items": 0, 2024-05-08T05:33:53.886 INFO:teuthology.orchestra.run.smithi087.stdout: "unittest_2_bytes": 0, 2024-05-08T05:33:53.886 INFO:teuthology.orchestra.run.smithi087.stdout: "unittest_2_items": 0 2024-05-08T05:33:53.886 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:53.886 INFO:teuthology.orchestra.run.smithi087.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-05-08T05:33:53.886 INFO:teuthology.orchestra.run.smithi087.stdout: "val": 0, 2024-05-08T05:33:53.886 INFO:teuthology.orchestra.run.smithi087.stdout: "max": 104857600, 2024-05-08T05:33:53.886 INFO:teuthology.orchestra.run.smithi087.stdout: "get_started": 0, 2024-05-08T05:33:53.886 INFO:teuthology.orchestra.run.smithi087.stdout: "get": 152, 2024-05-08T05:33:53.886 INFO:teuthology.orchestra.run.smithi087.stdout: "get_sum": 473144, 2024-05-08T05:33:53.886 INFO:teuthology.orchestra.run.smithi087.stdout: "get_or_fail_fail": 0, 2024-05-08T05:33:53.886 INFO:teuthology.orchestra.run.smithi087.stdout: "get_or_fail_success": 152, 2024-05-08T05:33:53.887 INFO:teuthology.orchestra.run.smithi087.stdout: "take": 0, 2024-05-08T05:33:53.887 INFO:teuthology.orchestra.run.smithi087.stdout: "take_sum": 0, 2024-05-08T05:33:53.887 INFO:teuthology.orchestra.run.smithi087.stdout: "put": 152, 2024-05-08T05:33:53.887 INFO:teuthology.orchestra.run.smithi087.stdout: "put_sum": 473144, 2024-05-08T05:33:53.887 INFO:teuthology.orchestra.run.smithi087.stdout: "wait": { 2024-05-08T05:33:53.887 INFO:teuthology.orchestra.run.smithi087.stdout: "avgcount": 0, 2024-05-08T05:33:53.887 INFO:teuthology.orchestra.run.smithi087.stdout: "sum": 0.000000000, 2024-05-08T05:33:53.887 INFO:teuthology.orchestra.run.smithi087.stdout: "avgtime": 0.000000000 2024-05-08T05:33:53.887 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-05-08T05:33:53.887 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-05-08T05:33:53.887 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-05-08T05:33:54.694 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:33:54 smithi087 ceph-mon[29523]: pgmap v567: 97 pgs: 97 active+clean; 153 MiB data, 1004 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 28 op/s 2024-05-08T05:33:54.788 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:33:54 smithi160 ceph-mon[34827]: pgmap v567: 97 pgs: 97 active+clean; 153 MiB data, 1004 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 28 op/s 2024-05-08T05:33:54.801 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.d 2024-05-08T05:33:54.801 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.d 2024-05-08T05:33:54.801 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update' not found on daemon mds.d 2024-05-08T05:33:54.801 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update_receipt' not found on daemon mds.d 2024-05-08T05:33:54.801 DEBUG:tasks.check_counter:Getting stats from g 2024-05-08T05:33:54.802 DEBUG:teuthology.orchestra.run.smithi087:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid eeeb813e-0cf9-11ef-bc97-c7b262605968 -- ceph daemon mds.g perf dump 2024-05-08T05:33:54.983 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:33:54 smithi090 ceph-mon[34526]: pgmap v567: 97 pgs: 97 active+clean; 153 MiB data, 1004 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 28 op/s 2024-05-08T05:33:55.224 INFO:teuthology.orchestra.run.smithi087.stderr:Inferring config /var/lib/ceph/eeeb813e-0cf9-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T05:33:55.708 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:33:55 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T05:33:55.983 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:33:55 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T05:33:56.038 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:33:55 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T05:33:56.883 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:33:56 smithi087 ceph-mon[29523]: pgmap v568: 97 pgs: 97 active+clean; 153 MiB data, 1004 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 6.7 KiB/s wr, 9 op/s 2024-05-08T05:33:56.883 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:33:56 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-05-08T05:33:56.884 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:33:56 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-05-08T05:33:56.884 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:33:56 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-05-08T05:33:56.884 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:33:56 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-05-08T05:33:56.884 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:33:56 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T05:33:56.884 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:33:56 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T05:33:56.884 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:33:56 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:33:56.983 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:33:56 smithi090 ceph-mon[34526]: pgmap v568: 97 pgs: 97 active+clean; 153 MiB data, 1004 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 6.7 KiB/s wr, 9 op/s 2024-05-08T05:33:56.983 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:33:56 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-05-08T05:33:56.983 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:33:56 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-05-08T05:33:56.984 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:33:56 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-05-08T05:33:56.984 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:33:56 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-05-08T05:33:56.984 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:33:56 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T05:33:56.984 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:33:56 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T05:33:56.984 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:33:56 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:33:57.038 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:33:56 smithi160 ceph-mon[34827]: pgmap v568: 97 pgs: 97 active+clean; 153 MiB data, 1004 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 6.7 KiB/s wr, 9 op/s 2024-05-08T05:33:57.039 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:33:56 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-05-08T05:33:57.039 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:33:56 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-05-08T05:33:57.039 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:33:56 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-05-08T05:33:57.039 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:33:56 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-05-08T05:33:57.039 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:33:56 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T05:33:57.039 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:33:56 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T05:33:57.039 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:33:56 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' 2024-05-08T05:33:57.406 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-05-08T05:33:57.406 INFO:teuthology.orchestra.run.smithi087.stdout: "AsyncMessenger::Worker-0": { 2024-05-08T05:33:57.407 INFO:teuthology.orchestra.run.smithi087.stdout: "msgr_recv_messages": 18703, 2024-05-08T05:33:57.407 INFO:teuthology.orchestra.run.smithi087.stdout: "msgr_send_messages": 29773, 2024-05-08T05:33:57.407 INFO:teuthology.orchestra.run.smithi087.stdout: "msgr_recv_bytes": 13928815, 2024-05-08T05:33:57.407 INFO:teuthology.orchestra.run.smithi087.stdout: "msgr_send_bytes": 31328416, 2024-05-08T05:33:57.407 INFO:teuthology.orchestra.run.smithi087.stdout: "msgr_created_connections": 12, 2024-05-08T05:33:57.407 INFO:teuthology.orchestra.run.smithi087.stdout: "msgr_active_connections": 5, 2024-05-08T05:33:57.407 INFO:teuthology.orchestra.run.smithi087.stdout: "msgr_running_total_time": 3.320811227, 2024-05-08T05:33:57.407 INFO:teuthology.orchestra.run.smithi087.stdout: "msgr_running_send_time": 1.552282750, 2024-05-08T05:33:57.407 INFO:teuthology.orchestra.run.smithi087.stdout: "msgr_running_recv_time": 1.885756064, 2024-05-08T05:33:57.407 INFO:teuthology.orchestra.run.smithi087.stdout: "msgr_running_fast_dispatch_time": 0.204673542, 2024-05-08T05:33:57.407 INFO:teuthology.orchestra.run.smithi087.stdout: "msgr_send_messages_queue_lat": { 2024-05-08T05:33:57.407 INFO:teuthology.orchestra.run.smithi087.stdout: "avgcount": 29772, 2024-05-08T05:33:57.407 INFO:teuthology.orchestra.run.smithi087.stdout: "sum": 2.614597052, 2024-05-08T05:33:57.407 INFO:teuthology.orchestra.run.smithi087.stdout: "avgtime": 0.000087820 2024-05-08T05:33:57.408 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:57.408 INFO:teuthology.orchestra.run.smithi087.stdout: "msgr_handle_ack_lat": { 2024-05-08T05:33:57.408 INFO:teuthology.orchestra.run.smithi087.stdout: "avgcount": 35826, 2024-05-08T05:33:57.408 INFO:teuthology.orchestra.run.smithi087.stdout: "sum": 0.023859102, 2024-05-08T05:33:57.408 INFO:teuthology.orchestra.run.smithi087.stdout: "avgtime": 0.000000665 2024-05-08T05:33:57.408 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:57.408 INFO:teuthology.orchestra.run.smithi087.stdout: "msgr_recv_encrypted_bytes": 549824, 2024-05-08T05:33:57.408 INFO:teuthology.orchestra.run.smithi087.stdout: "msgr_send_encrypted_bytes": 95712 2024-05-08T05:33:57.408 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:57.408 INFO:teuthology.orchestra.run.smithi087.stdout: "AsyncMessenger::Worker-1": { 2024-05-08T05:33:57.408 INFO:teuthology.orchestra.run.smithi087.stdout: "msgr_recv_messages": 27701, 2024-05-08T05:33:57.408 INFO:teuthology.orchestra.run.smithi087.stdout: "msgr_send_messages": 27975, 2024-05-08T05:33:57.408 INFO:teuthology.orchestra.run.smithi087.stdout: "msgr_recv_bytes": 8800429, 2024-05-08T05:33:57.408 INFO:teuthology.orchestra.run.smithi087.stdout: "msgr_send_bytes": 18586538, 2024-05-08T05:33:57.409 INFO:teuthology.orchestra.run.smithi087.stdout: "msgr_created_connections": 22, 2024-05-08T05:33:57.409 INFO:teuthology.orchestra.run.smithi087.stdout: "msgr_active_connections": 5, 2024-05-08T05:33:57.409 INFO:teuthology.orchestra.run.smithi087.stdout: "msgr_running_total_time": 4.014438456, 2024-05-08T05:33:57.409 INFO:teuthology.orchestra.run.smithi087.stdout: "msgr_running_send_time": 1.817706499, 2024-05-08T05:33:57.409 INFO:teuthology.orchestra.run.smithi087.stdout: "msgr_running_recv_time": 2.632019601, 2024-05-08T05:33:57.409 INFO:teuthology.orchestra.run.smithi087.stdout: "msgr_running_fast_dispatch_time": 0.173009639, 2024-05-08T05:33:57.409 INFO:teuthology.orchestra.run.smithi087.stdout: "msgr_send_messages_queue_lat": { 2024-05-08T05:33:57.409 INFO:teuthology.orchestra.run.smithi087.stdout: "avgcount": 27973, 2024-05-08T05:33:57.409 INFO:teuthology.orchestra.run.smithi087.stdout: "sum": 1.804692797, 2024-05-08T05:33:57.409 INFO:teuthology.orchestra.run.smithi087.stdout: "avgtime": 0.000064515 2024-05-08T05:33:57.409 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:57.409 INFO:teuthology.orchestra.run.smithi087.stdout: "msgr_handle_ack_lat": { 2024-05-08T05:33:57.409 INFO:teuthology.orchestra.run.smithi087.stdout: "avgcount": 44348, 2024-05-08T05:33:57.409 INFO:teuthology.orchestra.run.smithi087.stdout: "sum": 0.015489385, 2024-05-08T05:33:57.409 INFO:teuthology.orchestra.run.smithi087.stdout: "avgtime": 0.000000349 2024-05-08T05:33:57.410 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:57.410 INFO:teuthology.orchestra.run.smithi087.stdout: "msgr_recv_encrypted_bytes": 1744, 2024-05-08T05:33:57.410 INFO:teuthology.orchestra.run.smithi087.stdout: "msgr_send_encrypted_bytes": 265328 2024-05-08T05:33:57.410 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:57.410 INFO:teuthology.orchestra.run.smithi087.stdout: "AsyncMessenger::Worker-2": { 2024-05-08T05:33:57.410 INFO:teuthology.orchestra.run.smithi087.stdout: "msgr_recv_messages": 21383, 2024-05-08T05:33:57.410 INFO:teuthology.orchestra.run.smithi087.stdout: "msgr_send_messages": 46440, 2024-05-08T05:33:57.410 INFO:teuthology.orchestra.run.smithi087.stdout: "msgr_recv_bytes": 7387778, 2024-05-08T05:33:57.410 INFO:teuthology.orchestra.run.smithi087.stdout: "msgr_send_bytes": 40850898, 2024-05-08T05:33:57.410 INFO:teuthology.orchestra.run.smithi087.stdout: "msgr_created_connections": 9, 2024-05-08T05:33:57.410 INFO:teuthology.orchestra.run.smithi087.stdout: "msgr_active_connections": 5, 2024-05-08T05:33:57.410 INFO:teuthology.orchestra.run.smithi087.stdout: "msgr_running_total_time": 5.960229511, 2024-05-08T05:33:57.410 INFO:teuthology.orchestra.run.smithi087.stdout: "msgr_running_send_time": 3.778822940, 2024-05-08T05:33:57.411 INFO:teuthology.orchestra.run.smithi087.stdout: "msgr_running_recv_time": 2.737382146, 2024-05-08T05:33:57.411 INFO:teuthology.orchestra.run.smithi087.stdout: "msgr_running_fast_dispatch_time": 0.242689124, 2024-05-08T05:33:57.411 INFO:teuthology.orchestra.run.smithi087.stdout: "msgr_send_messages_queue_lat": { 2024-05-08T05:33:57.411 INFO:teuthology.orchestra.run.smithi087.stdout: "avgcount": 46439, 2024-05-08T05:33:57.411 INFO:teuthology.orchestra.run.smithi087.stdout: "sum": 51.478461222, 2024-05-08T05:33:57.411 INFO:teuthology.orchestra.run.smithi087.stdout: "avgtime": 0.001108517 2024-05-08T05:33:57.411 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:57.411 INFO:teuthology.orchestra.run.smithi087.stdout: "msgr_handle_ack_lat": { 2024-05-08T05:33:57.411 INFO:teuthology.orchestra.run.smithi087.stdout: "avgcount": 37833, 2024-05-08T05:33:57.411 INFO:teuthology.orchestra.run.smithi087.stdout: "sum": 0.018362537, 2024-05-08T05:33:57.411 INFO:teuthology.orchestra.run.smithi087.stdout: "avgtime": 0.000000485 2024-05-08T05:33:57.411 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:57.411 INFO:teuthology.orchestra.run.smithi087.stdout: "msgr_recv_encrypted_bytes": 2992, 2024-05-08T05:33:57.411 INFO:teuthology.orchestra.run.smithi087.stdout: "msgr_send_encrypted_bytes": 448 2024-05-08T05:33:57.411 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:57.411 INFO:teuthology.orchestra.run.smithi087.stdout: "cct": { 2024-05-08T05:33:57.412 INFO:teuthology.orchestra.run.smithi087.stdout: "total_workers": 1, 2024-05-08T05:33:57.412 INFO:teuthology.orchestra.run.smithi087.stdout: "unhealthy_workers": 0 2024-05-08T05:33:57.412 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:57.412 INFO:teuthology.orchestra.run.smithi087.stdout: "finisher-MDSRank": { 2024-05-08T05:33:57.412 INFO:teuthology.orchestra.run.smithi087.stdout: "queue_len": 0, 2024-05-08T05:33:57.412 INFO:teuthology.orchestra.run.smithi087.stdout: "complete_latency": { 2024-05-08T05:33:57.412 INFO:teuthology.orchestra.run.smithi087.stdout: "avgcount": 5362, 2024-05-08T05:33:57.412 INFO:teuthology.orchestra.run.smithi087.stdout: "sum": 18.483771453, 2024-05-08T05:33:57.412 INFO:teuthology.orchestra.run.smithi087.stdout: "avgtime": 0.003447178 2024-05-08T05:33:57.412 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-05-08T05:33:57.412 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:57.412 INFO:teuthology.orchestra.run.smithi087.stdout: "finisher-PurgeQueue": { 2024-05-08T05:33:57.412 INFO:teuthology.orchestra.run.smithi087.stdout: "queue_len": 0, 2024-05-08T05:33:57.412 INFO:teuthology.orchestra.run.smithi087.stdout: "complete_latency": { 2024-05-08T05:33:57.412 INFO:teuthology.orchestra.run.smithi087.stdout: "avgcount": 10810, 2024-05-08T05:33:57.413 INFO:teuthology.orchestra.run.smithi087.stdout: "sum": 4.840744574, 2024-05-08T05:33:57.413 INFO:teuthology.orchestra.run.smithi087.stdout: "avgtime": 0.000447802 2024-05-08T05:33:57.413 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-05-08T05:33:57.413 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:57.413 INFO:teuthology.orchestra.run.smithi087.stdout: "mds": { 2024-05-08T05:33:57.413 INFO:teuthology.orchestra.run.smithi087.stdout: "request": 11248, 2024-05-08T05:33:57.413 INFO:teuthology.orchestra.run.smithi087.stdout: "reply": 11211, 2024-05-08T05:33:57.413 INFO:teuthology.orchestra.run.smithi087.stdout: "reply_latency": { 2024-05-08T05:33:57.413 INFO:teuthology.orchestra.run.smithi087.stdout: "avgcount": 11211, 2024-05-08T05:33:57.413 INFO:teuthology.orchestra.run.smithi087.stdout: "sum": 37.946264822, 2024-05-08T05:33:57.413 INFO:teuthology.orchestra.run.smithi087.stdout: "avgtime": 0.003384735 2024-05-08T05:33:57.413 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:57.413 INFO:teuthology.orchestra.run.smithi087.stdout: "slow_reply": 0, 2024-05-08T05:33:57.413 INFO:teuthology.orchestra.run.smithi087.stdout: "forward": 37, 2024-05-08T05:33:57.414 INFO:teuthology.orchestra.run.smithi087.stdout: "dir_fetch_complete": 0, 2024-05-08T05:33:57.414 INFO:teuthology.orchestra.run.smithi087.stdout: "dir_fetch_keys": 0, 2024-05-08T05:33:57.414 INFO:teuthology.orchestra.run.smithi087.stdout: "dir_commit": 22, 2024-05-08T05:33:57.414 INFO:teuthology.orchestra.run.smithi087.stdout: "dir_split": 1, 2024-05-08T05:33:57.414 INFO:teuthology.orchestra.run.smithi087.stdout: "dir_merge": 2, 2024-05-08T05:33:57.414 INFO:teuthology.orchestra.run.smithi087.stdout: "inodes": 552, 2024-05-08T05:33:57.414 INFO:teuthology.orchestra.run.smithi087.stdout: "inodes_top": 259, 2024-05-08T05:33:57.414 INFO:teuthology.orchestra.run.smithi087.stdout: "inodes_bottom": 121, 2024-05-08T05:33:57.414 INFO:teuthology.orchestra.run.smithi087.stdout: "inodes_pin_tail": 172, 2024-05-08T05:33:57.414 INFO:teuthology.orchestra.run.smithi087.stdout: "inodes_pinned": 179, 2024-05-08T05:33:57.414 INFO:teuthology.orchestra.run.smithi087.stdout: "inodes_expired": 2724, 2024-05-08T05:33:57.414 INFO:teuthology.orchestra.run.smithi087.stdout: "inodes_with_caps": 1, 2024-05-08T05:33:57.414 INFO:teuthology.orchestra.run.smithi087.stdout: "caps": 1, 2024-05-08T05:33:57.414 INFO:teuthology.orchestra.run.smithi087.stdout: "subtrees": 4, 2024-05-08T05:33:57.415 INFO:teuthology.orchestra.run.smithi087.stdout: "traverse": 17058, 2024-05-08T05:33:57.415 INFO:teuthology.orchestra.run.smithi087.stdout: "traverse_hit": 15042, 2024-05-08T05:33:57.415 INFO:teuthology.orchestra.run.smithi087.stdout: "traverse_forward": 32, 2024-05-08T05:33:57.415 INFO:teuthology.orchestra.run.smithi087.stdout: "traverse_discover": 978, 2024-05-08T05:33:57.415 INFO:teuthology.orchestra.run.smithi087.stdout: "traverse_dir_fetch": 0, 2024-05-08T05:33:57.415 INFO:teuthology.orchestra.run.smithi087.stdout: "traverse_remote_ino": 0, 2024-05-08T05:33:57.415 INFO:teuthology.orchestra.run.smithi087.stdout: "traverse_lock": 5, 2024-05-08T05:33:57.415 INFO:teuthology.orchestra.run.smithi087.stdout: "load_cent": 1000, 2024-05-08T05:33:57.415 INFO:teuthology.orchestra.run.smithi087.stdout: "q": 1, 2024-05-08T05:33:57.415 INFO:teuthology.orchestra.run.smithi087.stdout: "exported": 9, 2024-05-08T05:33:57.415 INFO:teuthology.orchestra.run.smithi087.stdout: "exported_inodes": 797, 2024-05-08T05:33:57.415 INFO:teuthology.orchestra.run.smithi087.stdout: "imported": 14, 2024-05-08T05:33:57.415 INFO:teuthology.orchestra.run.smithi087.stdout: "imported_inodes": 8400, 2024-05-08T05:33:57.415 INFO:teuthology.orchestra.run.smithi087.stdout: "openino_dir_fetch": 0, 2024-05-08T05:33:57.415 INFO:teuthology.orchestra.run.smithi087.stdout: "openino_backtrace_fetch": 7801, 2024-05-08T05:33:57.416 INFO:teuthology.orchestra.run.smithi087.stdout: "openino_peer_discover": 1, 2024-05-08T05:33:57.416 INFO:teuthology.orchestra.run.smithi087.stdout: "root_rfiles": 6735, 2024-05-08T05:33:57.416 INFO:teuthology.orchestra.run.smithi087.stdout: "root_rbytes": 45007454, 2024-05-08T05:33:57.416 INFO:teuthology.orchestra.run.smithi087.stdout: "root_rsnaps": 0, 2024-05-08T05:33:57.416 INFO:teuthology.orchestra.run.smithi087.stdout: "scrub_backtrace_fetch": 7801, 2024-05-08T05:33:57.416 INFO:teuthology.orchestra.run.smithi087.stdout: "scrub_set_tag": 0, 2024-05-08T05:33:57.416 INFO:teuthology.orchestra.run.smithi087.stdout: "scrub_backtrace_repaired": 0, 2024-05-08T05:33:57.416 INFO:teuthology.orchestra.run.smithi087.stdout: "scrub_inotable_repaired": 0, 2024-05-08T05:33:57.416 INFO:teuthology.orchestra.run.smithi087.stdout: "scrub_dir_inodes": 850, 2024-05-08T05:33:57.416 INFO:teuthology.orchestra.run.smithi087.stdout: "scrub_dir_base_inodes": 0, 2024-05-08T05:33:57.416 INFO:teuthology.orchestra.run.smithi087.stdout: "scrub_dirfrag_rstats": 850, 2024-05-08T05:33:57.416 INFO:teuthology.orchestra.run.smithi087.stdout: "scrub_file_inodes": 6951, 2024-05-08T05:33:57.416 INFO:teuthology.orchestra.run.smithi087.stdout: "handle_inode_file_caps": 11, 2024-05-08T05:33:57.416 INFO:teuthology.orchestra.run.smithi087.stdout: "ceph_cap_op_revoke": 1912, 2024-05-08T05:33:57.416 INFO:teuthology.orchestra.run.smithi087.stdout: "ceph_cap_op_grant": 9176, 2024-05-08T05:33:57.417 INFO:teuthology.orchestra.run.smithi087.stdout: "ceph_cap_op_trunc": 5, 2024-05-08T05:33:57.417 INFO:teuthology.orchestra.run.smithi087.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-05-08T05:33:57.417 INFO:teuthology.orchestra.run.smithi087.stdout: "ceph_cap_op_flush_ack": 0, 2024-05-08T05:33:57.417 INFO:teuthology.orchestra.run.smithi087.stdout: "handle_client_caps": 3303, 2024-05-08T05:33:57.417 INFO:teuthology.orchestra.run.smithi087.stdout: "handle_client_caps_dirty": 1002, 2024-05-08T05:33:57.417 INFO:teuthology.orchestra.run.smithi087.stdout: "handle_client_cap_release": 60, 2024-05-08T05:33:57.417 INFO:teuthology.orchestra.run.smithi087.stdout: "process_request_cap_release": 8952 2024-05-08T05:33:57.417 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:57.417 INFO:teuthology.orchestra.run.smithi087.stdout: "mds_cache": { 2024-05-08T05:33:57.417 INFO:teuthology.orchestra.run.smithi087.stdout: "dir_update": 1618, 2024-05-08T05:33:57.417 INFO:teuthology.orchestra.run.smithi087.stdout: "dir_update_receipt": 2781, 2024-05-08T05:33:57.417 INFO:teuthology.orchestra.run.smithi087.stdout: "dir_try_discover": 1865, 2024-05-08T05:33:57.417 INFO:teuthology.orchestra.run.smithi087.stdout: "dir_send_discover": 1849, 2024-05-08T05:33:57.417 INFO:teuthology.orchestra.run.smithi087.stdout: "dir_handle_discover": 3211, 2024-05-08T05:33:57.417 INFO:teuthology.orchestra.run.smithi087.stdout: "num_strays": 162, 2024-05-08T05:33:57.418 INFO:teuthology.orchestra.run.smithi087.stdout: "num_strays_delayed": 0, 2024-05-08T05:33:57.418 INFO:teuthology.orchestra.run.smithi087.stdout: "num_strays_enqueuing": 0, 2024-05-08T05:33:57.418 INFO:teuthology.orchestra.run.smithi087.stdout: "strays_created": 7403, 2024-05-08T05:33:57.418 INFO:teuthology.orchestra.run.smithi087.stdout: "strays_enqueued": 7221, 2024-05-08T05:33:57.418 INFO:teuthology.orchestra.run.smithi087.stdout: "strays_reintegrated": 21, 2024-05-08T05:33:57.418 INFO:teuthology.orchestra.run.smithi087.stdout: "strays_migrated": 1, 2024-05-08T05:33:57.418 INFO:teuthology.orchestra.run.smithi087.stdout: "num_recovering_processing": 0, 2024-05-08T05:33:57.418 INFO:teuthology.orchestra.run.smithi087.stdout: "num_recovering_enqueued": 0, 2024-05-08T05:33:57.418 INFO:teuthology.orchestra.run.smithi087.stdout: "num_recovering_prioritized": 0, 2024-05-08T05:33:57.418 INFO:teuthology.orchestra.run.smithi087.stdout: "recovery_started": 0, 2024-05-08T05:33:57.418 INFO:teuthology.orchestra.run.smithi087.stdout: "recovery_completed": 0, 2024-05-08T05:33:57.418 INFO:teuthology.orchestra.run.smithi087.stdout: "ireq_quiesce_path": 0, 2024-05-08T05:33:57.418 INFO:teuthology.orchestra.run.smithi087.stdout: "ireq_quiesce_inode": 0, 2024-05-08T05:33:57.418 INFO:teuthology.orchestra.run.smithi087.stdout: "ireq_enqueue_scrub": 0, 2024-05-08T05:33:57.418 INFO:teuthology.orchestra.run.smithi087.stdout: "ireq_exportdir": 9, 2024-05-08T05:33:57.419 INFO:teuthology.orchestra.run.smithi087.stdout: "ireq_flush": 0, 2024-05-08T05:33:57.419 INFO:teuthology.orchestra.run.smithi087.stdout: "ireq_fragmentdir": 3, 2024-05-08T05:33:57.419 INFO:teuthology.orchestra.run.smithi087.stdout: "ireq_fragstats": 0, 2024-05-08T05:33:57.419 INFO:teuthology.orchestra.run.smithi087.stdout: "ireq_inodestats": 0 2024-05-08T05:33:57.419 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:57.419 INFO:teuthology.orchestra.run.smithi087.stdout: "mds_log": { 2024-05-08T05:33:57.419 INFO:teuthology.orchestra.run.smithi087.stdout: "evlrg": 3, 2024-05-08T05:33:57.419 INFO:teuthology.orchestra.run.smithi087.stdout: "evadd": 21715, 2024-05-08T05:33:57.419 INFO:teuthology.orchestra.run.smithi087.stdout: "evex": 0, 2024-05-08T05:33:57.419 INFO:teuthology.orchestra.run.smithi087.stdout: "evtrm": 0, 2024-05-08T05:33:57.419 INFO:teuthology.orchestra.run.smithi087.stdout: "ev": 21715, 2024-05-08T05:33:57.419 INFO:teuthology.orchestra.run.smithi087.stdout: "evexg": 0, 2024-05-08T05:33:57.419 INFO:teuthology.orchestra.run.smithi087.stdout: "evexd": 0, 2024-05-08T05:33:57.419 INFO:teuthology.orchestra.run.smithi087.stdout: "segadd": 30, 2024-05-08T05:33:57.419 INFO:teuthology.orchestra.run.smithi087.stdout: "segex": 0, 2024-05-08T05:33:57.420 INFO:teuthology.orchestra.run.smithi087.stdout: "segtrm": 0, 2024-05-08T05:33:57.420 INFO:teuthology.orchestra.run.smithi087.stdout: "seg": 30, 2024-05-08T05:33:57.420 INFO:teuthology.orchestra.run.smithi087.stdout: "segmjr": 3, 2024-05-08T05:33:57.420 INFO:teuthology.orchestra.run.smithi087.stdout: "segexg": 0, 2024-05-08T05:33:57.420 INFO:teuthology.orchestra.run.smithi087.stdout: "segexd": 0, 2024-05-08T05:33:57.420 INFO:teuthology.orchestra.run.smithi087.stdout: "expos": 4194304, 2024-05-08T05:33:57.420 INFO:teuthology.orchestra.run.smithi087.stdout: "wrpos": 50313705, 2024-05-08T05:33:57.420 INFO:teuthology.orchestra.run.smithi087.stdout: "rdpos": 0, 2024-05-08T05:33:57.420 INFO:teuthology.orchestra.run.smithi087.stdout: "jlat": { 2024-05-08T05:33:57.420 INFO:teuthology.orchestra.run.smithi087.stdout: "avgcount": 1169, 2024-05-08T05:33:57.420 INFO:teuthology.orchestra.run.smithi087.stdout: "sum": 6.504304541, 2024-05-08T05:33:57.420 INFO:teuthology.orchestra.run.smithi087.stdout: "avgtime": 0.005563990 2024-05-08T05:33:57.420 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:57.420 INFO:teuthology.orchestra.run.smithi087.stdout: "replayed": 0 2024-05-08T05:33:57.421 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:57.421 INFO:teuthology.orchestra.run.smithi087.stdout: "mds_mem": { 2024-05-08T05:33:57.421 INFO:teuthology.orchestra.run.smithi087.stdout: "ino": 193, 2024-05-08T05:33:57.421 INFO:teuthology.orchestra.run.smithi087.stdout: "ino+": 9090, 2024-05-08T05:33:57.421 INFO:teuthology.orchestra.run.smithi087.stdout: "ino-": 8897, 2024-05-08T05:33:57.421 INFO:teuthology.orchestra.run.smithi087.stdout: "dir": 202, 2024-05-08T05:33:57.421 INFO:teuthology.orchestra.run.smithi087.stdout: "dir+": 1978, 2024-05-08T05:33:57.421 INFO:teuthology.orchestra.run.smithi087.stdout: "dir-": 1776, 2024-05-08T05:33:57.421 INFO:teuthology.orchestra.run.smithi087.stdout: "dn": 552, 2024-05-08T05:33:57.421 INFO:teuthology.orchestra.run.smithi087.stdout: "dn+": 17801, 2024-05-08T05:33:57.421 INFO:teuthology.orchestra.run.smithi087.stdout: "dn-": 17249, 2024-05-08T05:33:57.421 INFO:teuthology.orchestra.run.smithi087.stdout: "cap": 1, 2024-05-08T05:33:57.421 INFO:teuthology.orchestra.run.smithi087.stdout: "cap+": 8257, 2024-05-08T05:33:57.421 INFO:teuthology.orchestra.run.smithi087.stdout: "cap-": 8256, 2024-05-08T05:33:57.421 INFO:teuthology.orchestra.run.smithi087.stdout: "rss": 117124, 2024-05-08T05:33:57.422 INFO:teuthology.orchestra.run.smithi087.stdout: "heap": 223608 2024-05-08T05:33:57.422 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:57.422 INFO:teuthology.orchestra.run.smithi087.stdout: "mds_server": { 2024-05-08T05:33:57.422 INFO:teuthology.orchestra.run.smithi087.stdout: "dispatch_client_request": 16867, 2024-05-08T05:33:57.422 INFO:teuthology.orchestra.run.smithi087.stdout: "dispatch_server_request": 211, 2024-05-08T05:33:57.422 INFO:teuthology.orchestra.run.smithi087.stdout: "handle_client_request": 11248, 2024-05-08T05:33:57.422 INFO:teuthology.orchestra.run.smithi087.stdout: "handle_client_session": 28, 2024-05-08T05:33:57.422 INFO:teuthology.orchestra.run.smithi087.stdout: "handle_peer_request": 388, 2024-05-08T05:33:57.422 INFO:teuthology.orchestra.run.smithi087.stdout: "req_create_latency": { 2024-05-08T05:33:57.422 INFO:teuthology.orchestra.run.smithi087.stdout: "avgcount": 19, 2024-05-08T05:33:57.422 INFO:teuthology.orchestra.run.smithi087.stdout: "sum": 0.073697037, 2024-05-08T05:33:57.422 INFO:teuthology.orchestra.run.smithi087.stdout: "avgtime": 0.003878791 2024-05-08T05:33:57.422 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:57.422 INFO:teuthology.orchestra.run.smithi087.stdout: "req_getattr_latency": { 2024-05-08T05:33:57.422 INFO:teuthology.orchestra.run.smithi087.stdout: "avgcount": 7, 2024-05-08T05:33:57.423 INFO:teuthology.orchestra.run.smithi087.stdout: "sum": 0.064183165, 2024-05-08T05:33:57.423 INFO:teuthology.orchestra.run.smithi087.stdout: "avgtime": 0.009169023 2024-05-08T05:33:57.423 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:57.423 INFO:teuthology.orchestra.run.smithi087.stdout: "req_getfilelock_latency": { 2024-05-08T05:33:57.423 INFO:teuthology.orchestra.run.smithi087.stdout: "avgcount": 0, 2024-05-08T05:33:57.423 INFO:teuthology.orchestra.run.smithi087.stdout: "sum": 0.000000000, 2024-05-08T05:33:57.423 INFO:teuthology.orchestra.run.smithi087.stdout: "avgtime": 0.000000000 2024-05-08T05:33:57.423 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:57.423 INFO:teuthology.orchestra.run.smithi087.stdout: "req_link_latency": { 2024-05-08T05:33:57.423 INFO:teuthology.orchestra.run.smithi087.stdout: "avgcount": 5, 2024-05-08T05:33:57.423 INFO:teuthology.orchestra.run.smithi087.stdout: "sum": 0.018670836, 2024-05-08T05:33:57.423 INFO:teuthology.orchestra.run.smithi087.stdout: "avgtime": 0.003734167 2024-05-08T05:33:57.423 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:57.423 INFO:teuthology.orchestra.run.smithi087.stdout: "req_lookup_latency": { 2024-05-08T05:33:57.423 INFO:teuthology.orchestra.run.smithi087.stdout: "avgcount": 2736, 2024-05-08T05:33:57.423 INFO:teuthology.orchestra.run.smithi087.stdout: "sum": 1.853473058, 2024-05-08T05:33:57.424 INFO:teuthology.orchestra.run.smithi087.stdout: "avgtime": 0.000677438 2024-05-08T05:33:57.424 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:57.424 INFO:teuthology.orchestra.run.smithi087.stdout: "req_lookuphash_latency": { 2024-05-08T05:33:57.424 INFO:teuthology.orchestra.run.smithi087.stdout: "avgcount": 0, 2024-05-08T05:33:57.424 INFO:teuthology.orchestra.run.smithi087.stdout: "sum": 0.000000000, 2024-05-08T05:33:57.424 INFO:teuthology.orchestra.run.smithi087.stdout: "avgtime": 0.000000000 2024-05-08T05:33:57.424 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:57.424 INFO:teuthology.orchestra.run.smithi087.stdout: "req_lookupino_latency": { 2024-05-08T05:33:57.424 INFO:teuthology.orchestra.run.smithi087.stdout: "avgcount": 1, 2024-05-08T05:33:57.424 INFO:teuthology.orchestra.run.smithi087.stdout: "sum": 0.000375229, 2024-05-08T05:33:57.424 INFO:teuthology.orchestra.run.smithi087.stdout: "avgtime": 0.000375229 2024-05-08T05:33:57.424 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:57.424 INFO:teuthology.orchestra.run.smithi087.stdout: "req_lookupname_latency": { 2024-05-08T05:33:57.424 INFO:teuthology.orchestra.run.smithi087.stdout: "avgcount": 0, 2024-05-08T05:33:57.424 INFO:teuthology.orchestra.run.smithi087.stdout: "sum": 0.000000000, 2024-05-08T05:33:57.425 INFO:teuthology.orchestra.run.smithi087.stdout: "avgtime": 0.000000000 2024-05-08T05:33:57.425 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:57.425 INFO:teuthology.orchestra.run.smithi087.stdout: "req_lookupparent_latency": { 2024-05-08T05:33:57.425 INFO:teuthology.orchestra.run.smithi087.stdout: "avgcount": 0, 2024-05-08T05:33:57.425 INFO:teuthology.orchestra.run.smithi087.stdout: "sum": 0.000000000, 2024-05-08T05:33:57.425 INFO:teuthology.orchestra.run.smithi087.stdout: "avgtime": 0.000000000 2024-05-08T05:33:57.425 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:57.425 INFO:teuthology.orchestra.run.smithi087.stdout: "req_lookupsnap_latency": { 2024-05-08T05:33:57.425 INFO:teuthology.orchestra.run.smithi087.stdout: "avgcount": 0, 2024-05-08T05:33:57.425 INFO:teuthology.orchestra.run.smithi087.stdout: "sum": 0.000000000, 2024-05-08T05:33:57.425 INFO:teuthology.orchestra.run.smithi087.stdout: "avgtime": 0.000000000 2024-05-08T05:33:57.426 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:57.426 INFO:teuthology.orchestra.run.smithi087.stdout: "req_lssnap_latency": { 2024-05-08T05:33:57.426 INFO:teuthology.orchestra.run.smithi087.stdout: "avgcount": 0, 2024-05-08T05:33:57.426 INFO:teuthology.orchestra.run.smithi087.stdout: "sum": 0.000000000, 2024-05-08T05:33:57.426 INFO:teuthology.orchestra.run.smithi087.stdout: "avgtime": 0.000000000 2024-05-08T05:33:57.426 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:57.426 INFO:teuthology.orchestra.run.smithi087.stdout: "req_mkdir_latency": { 2024-05-08T05:33:57.426 INFO:teuthology.orchestra.run.smithi087.stdout: "avgcount": 14, 2024-05-08T05:33:57.427 INFO:teuthology.orchestra.run.smithi087.stdout: "sum": 0.047729315, 2024-05-08T05:33:57.427 INFO:teuthology.orchestra.run.smithi087.stdout: "avgtime": 0.003409236 2024-05-08T05:33:57.427 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:57.427 INFO:teuthology.orchestra.run.smithi087.stdout: "req_mknod_latency": { 2024-05-08T05:33:57.427 INFO:teuthology.orchestra.run.smithi087.stdout: "avgcount": 13, 2024-05-08T05:33:57.427 INFO:teuthology.orchestra.run.smithi087.stdout: "sum": 0.038146318, 2024-05-08T05:33:57.427 INFO:teuthology.orchestra.run.smithi087.stdout: "avgtime": 0.002934332 2024-05-08T05:33:57.427 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:57.427 INFO:teuthology.orchestra.run.smithi087.stdout: "req_mksnap_latency": { 2024-05-08T05:33:57.427 INFO:teuthology.orchestra.run.smithi087.stdout: "avgcount": 0, 2024-05-08T05:33:57.427 INFO:teuthology.orchestra.run.smithi087.stdout: "sum": 0.000000000, 2024-05-08T05:33:57.427 INFO:teuthology.orchestra.run.smithi087.stdout: "avgtime": 0.000000000 2024-05-08T05:33:57.427 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:57.427 INFO:teuthology.orchestra.run.smithi087.stdout: "req_open_latency": { 2024-05-08T05:33:57.428 INFO:teuthology.orchestra.run.smithi087.stdout: "avgcount": 17, 2024-05-08T05:33:57.428 INFO:teuthology.orchestra.run.smithi087.stdout: "sum": 0.010605952, 2024-05-08T05:33:57.428 INFO:teuthology.orchestra.run.smithi087.stdout: "avgtime": 0.000623879 2024-05-08T05:33:57.428 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:57.428 INFO:teuthology.orchestra.run.smithi087.stdout: "req_readdir_latency": { 2024-05-08T05:33:57.428 INFO:teuthology.orchestra.run.smithi087.stdout: "avgcount": 877, 2024-05-08T05:33:57.428 INFO:teuthology.orchestra.run.smithi087.stdout: "sum": 1.016321247, 2024-05-08T05:33:57.428 INFO:teuthology.orchestra.run.smithi087.stdout: "avgtime": 0.001158861 2024-05-08T05:33:57.428 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:57.428 INFO:teuthology.orchestra.run.smithi087.stdout: "req_rename_latency": { 2024-05-08T05:33:57.428 INFO:teuthology.orchestra.run.smithi087.stdout: "avgcount": 41, 2024-05-08T05:33:57.428 INFO:teuthology.orchestra.run.smithi087.stdout: "sum": 0.501708327, 2024-05-08T05:33:57.428 INFO:teuthology.orchestra.run.smithi087.stdout: "avgtime": 0.012236788 2024-05-08T05:33:57.429 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:57.429 INFO:teuthology.orchestra.run.smithi087.stdout: "req_renamesnap_latency": { 2024-05-08T05:33:57.429 INFO:teuthology.orchestra.run.smithi087.stdout: "avgcount": 0, 2024-05-08T05:33:57.429 INFO:teuthology.orchestra.run.smithi087.stdout: "sum": 0.000000000, 2024-05-08T05:33:57.429 INFO:teuthology.orchestra.run.smithi087.stdout: "avgtime": 0.000000000 2024-05-08T05:33:57.429 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:57.429 INFO:teuthology.orchestra.run.smithi087.stdout: "req_snapdiff_latency": { 2024-05-08T05:33:57.429 INFO:teuthology.orchestra.run.smithi087.stdout: "avgcount": 0, 2024-05-08T05:33:57.429 INFO:teuthology.orchestra.run.smithi087.stdout: "sum": 0.000000000, 2024-05-08T05:33:57.429 INFO:teuthology.orchestra.run.smithi087.stdout: "avgtime": 0.000000000 2024-05-08T05:33:57.429 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:57.429 INFO:teuthology.orchestra.run.smithi087.stdout: "req_rmdir_latency": { 2024-05-08T05:33:57.429 INFO:teuthology.orchestra.run.smithi087.stdout: "avgcount": 883, 2024-05-08T05:33:57.429 INFO:teuthology.orchestra.run.smithi087.stdout: "sum": 19.447841211, 2024-05-08T05:33:57.429 INFO:teuthology.orchestra.run.smithi087.stdout: "avgtime": 0.022024735 2024-05-08T05:33:57.430 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:57.430 INFO:teuthology.orchestra.run.smithi087.stdout: "req_rmsnap_latency": { 2024-05-08T05:33:57.430 INFO:teuthology.orchestra.run.smithi087.stdout: "avgcount": 0, 2024-05-08T05:33:57.430 INFO:teuthology.orchestra.run.smithi087.stdout: "sum": 0.000000000, 2024-05-08T05:33:57.430 INFO:teuthology.orchestra.run.smithi087.stdout: "avgtime": 0.000000000 2024-05-08T05:33:57.430 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:57.430 INFO:teuthology.orchestra.run.smithi087.stdout: "req_rmxattr_latency": { 2024-05-08T05:33:57.430 INFO:teuthology.orchestra.run.smithi087.stdout: "avgcount": 0, 2024-05-08T05:33:57.430 INFO:teuthology.orchestra.run.smithi087.stdout: "sum": 0.000000000, 2024-05-08T05:33:57.430 INFO:teuthology.orchestra.run.smithi087.stdout: "avgtime": 0.000000000 2024-05-08T05:33:57.430 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:57.430 INFO:teuthology.orchestra.run.smithi087.stdout: "req_setattr_latency": { 2024-05-08T05:33:57.430 INFO:teuthology.orchestra.run.smithi087.stdout: "avgcount": 5, 2024-05-08T05:33:57.431 INFO:teuthology.orchestra.run.smithi087.stdout: "sum": 0.012544893, 2024-05-08T05:33:57.431 INFO:teuthology.orchestra.run.smithi087.stdout: "avgtime": 0.002508978 2024-05-08T05:33:57.431 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:57.431 INFO:teuthology.orchestra.run.smithi087.stdout: "req_setdirlayout_latency": { 2024-05-08T05:33:57.431 INFO:teuthology.orchestra.run.smithi087.stdout: "avgcount": 0, 2024-05-08T05:33:57.431 INFO:teuthology.orchestra.run.smithi087.stdout: "sum": 0.000000000, 2024-05-08T05:33:57.431 INFO:teuthology.orchestra.run.smithi087.stdout: "avgtime": 0.000000000 2024-05-08T05:33:57.431 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:57.431 INFO:teuthology.orchestra.run.smithi087.stdout: "req_setfilelock_latency": { 2024-05-08T05:33:57.431 INFO:teuthology.orchestra.run.smithi087.stdout: "avgcount": 0, 2024-05-08T05:33:57.431 INFO:teuthology.orchestra.run.smithi087.stdout: "sum": 0.000000000, 2024-05-08T05:33:57.431 INFO:teuthology.orchestra.run.smithi087.stdout: "avgtime": 0.000000000 2024-05-08T05:33:57.431 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:57.431 INFO:teuthology.orchestra.run.smithi087.stdout: "req_setlayout_latency": { 2024-05-08T05:33:57.431 INFO:teuthology.orchestra.run.smithi087.stdout: "avgcount": 0, 2024-05-08T05:33:57.431 INFO:teuthology.orchestra.run.smithi087.stdout: "sum": 0.000000000, 2024-05-08T05:33:57.432 INFO:teuthology.orchestra.run.smithi087.stdout: "avgtime": 0.000000000 2024-05-08T05:33:57.432 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:57.432 INFO:teuthology.orchestra.run.smithi087.stdout: "req_setxattr_latency": { 2024-05-08T05:33:57.432 INFO:teuthology.orchestra.run.smithi087.stdout: "avgcount": 0, 2024-05-08T05:33:57.432 INFO:teuthology.orchestra.run.smithi087.stdout: "sum": 0.000000000, 2024-05-08T05:33:57.432 INFO:teuthology.orchestra.run.smithi087.stdout: "avgtime": 0.000000000 2024-05-08T05:33:57.432 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:57.432 INFO:teuthology.orchestra.run.smithi087.stdout: "req_symlink_latency": { 2024-05-08T05:33:57.432 INFO:teuthology.orchestra.run.smithi087.stdout: "avgcount": 18, 2024-05-08T05:33:57.432 INFO:teuthology.orchestra.run.smithi087.stdout: "sum": 0.043780042, 2024-05-08T05:33:57.432 INFO:teuthology.orchestra.run.smithi087.stdout: "avgtime": 0.002432224 2024-05-08T05:33:57.432 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:57.432 INFO:teuthology.orchestra.run.smithi087.stdout: "req_unlink_latency": { 2024-05-08T05:33:57.432 INFO:teuthology.orchestra.run.smithi087.stdout: "avgcount": 6575, 2024-05-08T05:33:57.433 INFO:teuthology.orchestra.run.smithi087.stdout: "sum": 14.817188192, 2024-05-08T05:33:57.433 INFO:teuthology.orchestra.run.smithi087.stdout: "avgtime": 0.002253564 2024-05-08T05:33:57.433 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:57.433 INFO:teuthology.orchestra.run.smithi087.stdout: "cap_revoke_eviction": 0, 2024-05-08T05:33:57.433 INFO:teuthology.orchestra.run.smithi087.stdout: "cap_acquisition_throttle": 0, 2024-05-08T05:33:57.433 INFO:teuthology.orchestra.run.smithi087.stdout: "req_getvxattr_latency": { 2024-05-08T05:33:57.433 INFO:teuthology.orchestra.run.smithi087.stdout: "avgcount": 0, 2024-05-08T05:33:57.433 INFO:teuthology.orchestra.run.smithi087.stdout: "sum": 0.000000000, 2024-05-08T05:33:57.433 INFO:teuthology.orchestra.run.smithi087.stdout: "avgtime": 0.000000000 2024-05-08T05:33:57.433 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-05-08T05:33:57.433 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:57.433 INFO:teuthology.orchestra.run.smithi087.stdout: "mds_sessions": { 2024-05-08T05:33:57.433 INFO:teuthology.orchestra.run.smithi087.stdout: "session_count": 1, 2024-05-08T05:33:57.433 INFO:teuthology.orchestra.run.smithi087.stdout: "session_add": 2, 2024-05-08T05:33:57.434 INFO:teuthology.orchestra.run.smithi087.stdout: "session_remove": 1, 2024-05-08T05:33:57.434 INFO:teuthology.orchestra.run.smithi087.stdout: "sessions_open": 1, 2024-05-08T05:33:57.434 INFO:teuthology.orchestra.run.smithi087.stdout: "sessions_stale": 0, 2024-05-08T05:33:57.434 INFO:teuthology.orchestra.run.smithi087.stdout: "total_load": 6818, 2024-05-08T05:33:57.434 INFO:teuthology.orchestra.run.smithi087.stdout: "average_load": 6818, 2024-05-08T05:33:57.434 INFO:teuthology.orchestra.run.smithi087.stdout: "avg_session_uptime": 263, 2024-05-08T05:33:57.434 INFO:teuthology.orchestra.run.smithi087.stdout: "mdthresh_evicted": 0 2024-05-08T05:33:57.434 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:57.434 INFO:teuthology.orchestra.run.smithi087.stdout: "mempool": { 2024-05-08T05:33:57.434 INFO:teuthology.orchestra.run.smithi087.stdout: "bloom_filter_bytes": 0, 2024-05-08T05:33:57.434 INFO:teuthology.orchestra.run.smithi087.stdout: "bloom_filter_items": 0, 2024-05-08T05:33:57.434 INFO:teuthology.orchestra.run.smithi087.stdout: "bluestore_alloc_bytes": 0, 2024-05-08T05:33:57.434 INFO:teuthology.orchestra.run.smithi087.stdout: "bluestore_alloc_items": 0, 2024-05-08T05:33:57.434 INFO:teuthology.orchestra.run.smithi087.stdout: "bluestore_cache_data_bytes": 0, 2024-05-08T05:33:57.435 INFO:teuthology.orchestra.run.smithi087.stdout: "bluestore_cache_data_items": 0, 2024-05-08T05:33:57.435 INFO:teuthology.orchestra.run.smithi087.stdout: "bluestore_cache_onode_bytes": 0, 2024-05-08T05:33:57.435 INFO:teuthology.orchestra.run.smithi087.stdout: "bluestore_cache_onode_items": 0, 2024-05-08T05:33:57.435 INFO:teuthology.orchestra.run.smithi087.stdout: "bluestore_cache_meta_bytes": 0, 2024-05-08T05:33:57.435 INFO:teuthology.orchestra.run.smithi087.stdout: "bluestore_cache_meta_items": 0, 2024-05-08T05:33:57.435 INFO:teuthology.orchestra.run.smithi087.stdout: "bluestore_cache_other_bytes": 0, 2024-05-08T05:33:57.435 INFO:teuthology.orchestra.run.smithi087.stdout: "bluestore_cache_other_items": 0, 2024-05-08T05:33:57.435 INFO:teuthology.orchestra.run.smithi087.stdout: "bluestore_cache_buffer_bytes": 0, 2024-05-08T05:33:57.435 INFO:teuthology.orchestra.run.smithi087.stdout: "bluestore_cache_buffer_items": 0, 2024-05-08T05:33:57.435 INFO:teuthology.orchestra.run.smithi087.stdout: "bluestore_extent_bytes": 0, 2024-05-08T05:33:57.435 INFO:teuthology.orchestra.run.smithi087.stdout: "bluestore_extent_items": 0, 2024-05-08T05:33:57.435 INFO:teuthology.orchestra.run.smithi087.stdout: "bluestore_blob_bytes": 0, 2024-05-08T05:33:57.435 INFO:teuthology.orchestra.run.smithi087.stdout: "bluestore_blob_items": 0, 2024-05-08T05:33:57.435 INFO:teuthology.orchestra.run.smithi087.stdout: "bluestore_shared_blob_bytes": 0, 2024-05-08T05:33:57.435 INFO:teuthology.orchestra.run.smithi087.stdout: "bluestore_shared_blob_items": 0, 2024-05-08T05:33:57.436 INFO:teuthology.orchestra.run.smithi087.stdout: "bluestore_inline_bl_bytes": 0, 2024-05-08T05:33:57.436 INFO:teuthology.orchestra.run.smithi087.stdout: "bluestore_inline_bl_items": 0, 2024-05-08T05:33:57.436 INFO:teuthology.orchestra.run.smithi087.stdout: "bluestore_fsck_bytes": 0, 2024-05-08T05:33:57.436 INFO:teuthology.orchestra.run.smithi087.stdout: "bluestore_fsck_items": 0, 2024-05-08T05:33:57.436 INFO:teuthology.orchestra.run.smithi087.stdout: "bluestore_txc_bytes": 0, 2024-05-08T05:33:57.436 INFO:teuthology.orchestra.run.smithi087.stdout: "bluestore_txc_items": 0, 2024-05-08T05:33:57.436 INFO:teuthology.orchestra.run.smithi087.stdout: "bluestore_writing_deferred_bytes": 0, 2024-05-08T05:33:57.436 INFO:teuthology.orchestra.run.smithi087.stdout: "bluestore_writing_deferred_items": 0, 2024-05-08T05:33:57.436 INFO:teuthology.orchestra.run.smithi087.stdout: "bluestore_writing_bytes": 0, 2024-05-08T05:33:57.436 INFO:teuthology.orchestra.run.smithi087.stdout: "bluestore_writing_items": 0, 2024-05-08T05:33:57.436 INFO:teuthology.orchestra.run.smithi087.stdout: "bluefs_bytes": 0, 2024-05-08T05:33:57.436 INFO:teuthology.orchestra.run.smithi087.stdout: "bluefs_items": 0, 2024-05-08T05:33:57.436 INFO:teuthology.orchestra.run.smithi087.stdout: "bluefs_file_reader_bytes": 0, 2024-05-08T05:33:57.436 INFO:teuthology.orchestra.run.smithi087.stdout: "bluefs_file_reader_items": 0, 2024-05-08T05:33:57.436 INFO:teuthology.orchestra.run.smithi087.stdout: "bluefs_file_writer_bytes": 0, 2024-05-08T05:33:57.437 INFO:teuthology.orchestra.run.smithi087.stdout: "bluefs_file_writer_items": 0, 2024-05-08T05:33:57.437 INFO:teuthology.orchestra.run.smithi087.stdout: "buffer_anon_bytes": 305508, 2024-05-08T05:33:57.437 INFO:teuthology.orchestra.run.smithi087.stdout: "buffer_anon_items": 282, 2024-05-08T05:33:57.437 INFO:teuthology.orchestra.run.smithi087.stdout: "buffer_meta_bytes": 0, 2024-05-08T05:33:57.437 INFO:teuthology.orchestra.run.smithi087.stdout: "buffer_meta_items": 0, 2024-05-08T05:33:57.437 INFO:teuthology.orchestra.run.smithi087.stdout: "osd_bytes": 0, 2024-05-08T05:33:57.437 INFO:teuthology.orchestra.run.smithi087.stdout: "osd_items": 0, 2024-05-08T05:33:57.437 INFO:teuthology.orchestra.run.smithi087.stdout: "osd_mapbl_bytes": 0, 2024-05-08T05:33:57.437 INFO:teuthology.orchestra.run.smithi087.stdout: "osd_mapbl_items": 0, 2024-05-08T05:33:57.437 INFO:teuthology.orchestra.run.smithi087.stdout: "osd_pglog_bytes": 0, 2024-05-08T05:33:57.437 INFO:teuthology.orchestra.run.smithi087.stdout: "osd_pglog_items": 0, 2024-05-08T05:33:57.437 INFO:teuthology.orchestra.run.smithi087.stdout: "osdmap_bytes": 7440, 2024-05-08T05:33:57.437 INFO:teuthology.orchestra.run.smithi087.stdout: "osdmap_items": 157, 2024-05-08T05:33:57.437 INFO:teuthology.orchestra.run.smithi087.stdout: "osdmap_mapping_bytes": 0, 2024-05-08T05:33:57.438 INFO:teuthology.orchestra.run.smithi087.stdout: "osdmap_mapping_items": 0, 2024-05-08T05:33:57.438 INFO:teuthology.orchestra.run.smithi087.stdout: "pgmap_bytes": 0, 2024-05-08T05:33:57.438 INFO:teuthology.orchestra.run.smithi087.stdout: "pgmap_items": 0, 2024-05-08T05:33:57.438 INFO:teuthology.orchestra.run.smithi087.stdout: "mds_co_bytes": 1180459, 2024-05-08T05:33:57.438 INFO:teuthology.orchestra.run.smithi087.stdout: "mds_co_items": 34703, 2024-05-08T05:33:57.438 INFO:teuthology.orchestra.run.smithi087.stdout: "unittest_1_bytes": 0, 2024-05-08T05:33:57.438 INFO:teuthology.orchestra.run.smithi087.stdout: "unittest_1_items": 0, 2024-05-08T05:33:57.438 INFO:teuthology.orchestra.run.smithi087.stdout: "unittest_2_bytes": 0, 2024-05-08T05:33:57.438 INFO:teuthology.orchestra.run.smithi087.stdout: "unittest_2_items": 0 2024-05-08T05:33:57.438 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:57.438 INFO:teuthology.orchestra.run.smithi087.stdout: "objecter": { 2024-05-08T05:33:57.438 INFO:teuthology.orchestra.run.smithi087.stdout: "op_active": 0, 2024-05-08T05:33:57.438 INFO:teuthology.orchestra.run.smithi087.stdout: "op_laggy": 0, 2024-05-08T05:33:57.438 INFO:teuthology.orchestra.run.smithi087.stdout: "op_send": 17296, 2024-05-08T05:33:57.439 INFO:teuthology.orchestra.run.smithi087.stdout: "op_send_bytes": 47421138, 2024-05-08T05:33:57.439 INFO:teuthology.orchestra.run.smithi087.stdout: "op_resend": 30, 2024-05-08T05:33:57.439 INFO:teuthology.orchestra.run.smithi087.stdout: "op_reply": 17296, 2024-05-08T05:33:57.439 INFO:teuthology.orchestra.run.smithi087.stdout: "op_latency": { 2024-05-08T05:33:57.439 INFO:teuthology.orchestra.run.smithi087.stdout: "avgcount": 17296, 2024-05-08T05:33:57.439 INFO:teuthology.orchestra.run.smithi087.stdout: "sum": 38.017160789, 2024-05-08T05:33:57.439 INFO:teuthology.orchestra.run.smithi087.stdout: "avgtime": 0.002198031 2024-05-08T05:33:57.439 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:57.439 INFO:teuthology.orchestra.run.smithi087.stdout: "op_inflight": 0, 2024-05-08T05:33:57.439 INFO:teuthology.orchestra.run.smithi087.stdout: "oplen_avg": { 2024-05-08T05:33:57.439 INFO:teuthology.orchestra.run.smithi087.stdout: "avgcount": 17296, 2024-05-08T05:33:57.439 INFO:teuthology.orchestra.run.smithi087.stdout: "sum": 17450 2024-05-08T05:33:57.439 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:57.439 INFO:teuthology.orchestra.run.smithi087.stdout: "op": 17296, 2024-05-08T05:33:57.439 INFO:teuthology.orchestra.run.smithi087.stdout: "op_r": 8069, 2024-05-08T05:33:57.440 INFO:teuthology.orchestra.run.smithi087.stdout: "op_w": 9227, 2024-05-08T05:33:57.440 INFO:teuthology.orchestra.run.smithi087.stdout: "op_rmw": 0, 2024-05-08T05:33:57.440 INFO:teuthology.orchestra.run.smithi087.stdout: "op_pg": 0, 2024-05-08T05:33:57.440 INFO:teuthology.orchestra.run.smithi087.stdout: "osdop_stat": 0, 2024-05-08T05:33:57.440 INFO:teuthology.orchestra.run.smithi087.stdout: "osdop_create": 10, 2024-05-08T05:33:57.440 INFO:teuthology.orchestra.run.smithi087.stdout: "osdop_read": 268, 2024-05-08T05:33:57.440 INFO:teuthology.orchestra.run.smithi087.stdout: "osdop_write": 1437, 2024-05-08T05:33:57.440 INFO:teuthology.orchestra.run.smithi087.stdout: "osdop_writefull": 137, 2024-05-08T05:33:57.440 INFO:teuthology.orchestra.run.smithi087.stdout: "osdop_writesame": 0, 2024-05-08T05:33:57.440 INFO:teuthology.orchestra.run.smithi087.stdout: "osdop_append": 0, 2024-05-08T05:33:57.440 INFO:teuthology.orchestra.run.smithi087.stdout: "osdop_zero": 0, 2024-05-08T05:33:57.440 INFO:teuthology.orchestra.run.smithi087.stdout: "osdop_truncate": 1, 2024-05-08T05:33:57.440 INFO:teuthology.orchestra.run.smithi087.stdout: "osdop_delete": 7540, 2024-05-08T05:33:57.440 INFO:teuthology.orchestra.run.smithi087.stdout: "osdop_mapext": 0, 2024-05-08T05:33:57.440 INFO:teuthology.orchestra.run.smithi087.stdout: "osdop_sparse_read": 0, 2024-05-08T05:33:57.441 INFO:teuthology.orchestra.run.smithi087.stdout: "osdop_clonerange": 0, 2024-05-08T05:33:57.441 INFO:teuthology.orchestra.run.smithi087.stdout: "osdop_getxattr": 7801, 2024-05-08T05:33:57.441 INFO:teuthology.orchestra.run.smithi087.stdout: "osdop_setxattr": 20, 2024-05-08T05:33:57.441 INFO:teuthology.orchestra.run.smithi087.stdout: "osdop_cmpxattr": 0, 2024-05-08T05:33:57.441 INFO:teuthology.orchestra.run.smithi087.stdout: "osdop_rmxattr": 0, 2024-05-08T05:33:57.441 INFO:teuthology.orchestra.run.smithi087.stdout: "osdop_resetxattrs": 0, 2024-05-08T05:33:57.441 INFO:teuthology.orchestra.run.smithi087.stdout: "osdop_call": 0, 2024-05-08T05:33:57.441 INFO:teuthology.orchestra.run.smithi087.stdout: "osdop_watch": 0, 2024-05-08T05:33:57.441 INFO:teuthology.orchestra.run.smithi087.stdout: "osdop_notify": 0, 2024-05-08T05:33:57.441 INFO:teuthology.orchestra.run.smithi087.stdout: "osdop_src_cmpxattr": 0, 2024-05-08T05:33:57.441 INFO:teuthology.orchestra.run.smithi087.stdout: "osdop_pgls": 0, 2024-05-08T05:33:57.441 INFO:teuthology.orchestra.run.smithi087.stdout: "osdop_pgls_filter": 0, 2024-05-08T05:33:57.441 INFO:teuthology.orchestra.run.smithi087.stdout: "osdop_other": 6, 2024-05-08T05:33:57.441 INFO:teuthology.orchestra.run.smithi087.stdout: "linger_active": 0, 2024-05-08T05:33:57.441 INFO:teuthology.orchestra.run.smithi087.stdout: "linger_send": 0, 2024-05-08T05:33:57.442 INFO:teuthology.orchestra.run.smithi087.stdout: "linger_resend": 0, 2024-05-08T05:33:57.442 INFO:teuthology.orchestra.run.smithi087.stdout: "linger_ping": 0, 2024-05-08T05:33:57.442 INFO:teuthology.orchestra.run.smithi087.stdout: "poolop_active": 0, 2024-05-08T05:33:57.442 INFO:teuthology.orchestra.run.smithi087.stdout: "poolop_send": 0, 2024-05-08T05:33:57.442 INFO:teuthology.orchestra.run.smithi087.stdout: "poolop_resend": 0, 2024-05-08T05:33:57.442 INFO:teuthology.orchestra.run.smithi087.stdout: "poolstat_active": 0, 2024-05-08T05:33:57.442 INFO:teuthology.orchestra.run.smithi087.stdout: "poolstat_send": 0, 2024-05-08T05:33:57.442 INFO:teuthology.orchestra.run.smithi087.stdout: "poolstat_resend": 0, 2024-05-08T05:33:57.442 INFO:teuthology.orchestra.run.smithi087.stdout: "statfs_active": 0, 2024-05-08T05:33:57.442 INFO:teuthology.orchestra.run.smithi087.stdout: "statfs_send": 0, 2024-05-08T05:33:57.442 INFO:teuthology.orchestra.run.smithi087.stdout: "statfs_resend": 0, 2024-05-08T05:33:57.442 INFO:teuthology.orchestra.run.smithi087.stdout: "command_active": 0, 2024-05-08T05:33:57.442 INFO:teuthology.orchestra.run.smithi087.stdout: "command_send": 0, 2024-05-08T05:33:57.442 INFO:teuthology.orchestra.run.smithi087.stdout: "command_resend": 0, 2024-05-08T05:33:57.443 INFO:teuthology.orchestra.run.smithi087.stdout: "map_epoch": 82, 2024-05-08T05:33:57.443 INFO:teuthology.orchestra.run.smithi087.stdout: "map_full": 0, 2024-05-08T05:33:57.443 INFO:teuthology.orchestra.run.smithi087.stdout: "map_inc": 2, 2024-05-08T05:33:57.443 INFO:teuthology.orchestra.run.smithi087.stdout: "osd_sessions": 12, 2024-05-08T05:33:57.443 INFO:teuthology.orchestra.run.smithi087.stdout: "osd_session_open": 12, 2024-05-08T05:33:57.443 INFO:teuthology.orchestra.run.smithi087.stdout: "osd_session_close": 0, 2024-05-08T05:33:57.443 INFO:teuthology.orchestra.run.smithi087.stdout: "osd_laggy": 0, 2024-05-08T05:33:57.443 INFO:teuthology.orchestra.run.smithi087.stdout: "omap_wr": 168, 2024-05-08T05:33:57.443 INFO:teuthology.orchestra.run.smithi087.stdout: "omap_rd": 0, 2024-05-08T05:33:57.443 INFO:teuthology.orchestra.run.smithi087.stdout: "omap_del": 62 2024-05-08T05:33:57.443 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:57.443 INFO:teuthology.orchestra.run.smithi087.stdout: "oft": { 2024-05-08T05:33:57.443 INFO:teuthology.orchestra.run.smithi087.stdout: "omap_total_objs": 1, 2024-05-08T05:33:57.443 INFO:teuthology.orchestra.run.smithi087.stdout: "omap_total_kv_pairs": 0, 2024-05-08T05:33:57.443 INFO:teuthology.orchestra.run.smithi087.stdout: "omap_total_updates": 0, 2024-05-08T05:33:57.444 INFO:teuthology.orchestra.run.smithi087.stdout: "omap_total_removes": 0 2024-05-08T05:33:57.444 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:57.444 INFO:teuthology.orchestra.run.smithi087.stdout: "osd-slow-ops": { 2024-05-08T05:33:57.444 INFO:teuthology.orchestra.run.smithi087.stdout: "slow_ops_count": 0 2024-05-08T05:33:57.444 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:57.444 INFO:teuthology.orchestra.run.smithi087.stdout: "purge_queue": { 2024-05-08T05:33:57.444 INFO:teuthology.orchestra.run.smithi087.stdout: "pq_executing_ops": 0, 2024-05-08T05:33:57.444 INFO:teuthology.orchestra.run.smithi087.stdout: "pq_executing_ops_high_water": 18, 2024-05-08T05:33:57.444 INFO:teuthology.orchestra.run.smithi087.stdout: "pq_executing": 0, 2024-05-08T05:33:57.444 INFO:teuthology.orchestra.run.smithi087.stdout: "pq_executing_high_water": 10, 2024-05-08T05:33:57.444 INFO:teuthology.orchestra.run.smithi087.stdout: "pq_executed_ops": 7512, 2024-05-08T05:33:57.444 INFO:teuthology.orchestra.run.smithi087.stdout: "pq_executed": 7221, 2024-05-08T05:33:57.444 INFO:teuthology.orchestra.run.smithi087.stdout: "pq_item_in_journal": 0 2024-05-08T05:33:57.444 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:57.444 INFO:teuthology.orchestra.run.smithi087.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-05-08T05:33:57.444 INFO:teuthology.orchestra.run.smithi087.stdout: "val": 0, 2024-05-08T05:33:57.445 INFO:teuthology.orchestra.run.smithi087.stdout: "max": 104857600, 2024-05-08T05:33:57.445 INFO:teuthology.orchestra.run.smithi087.stdout: "get_started": 0, 2024-05-08T05:33:57.445 INFO:teuthology.orchestra.run.smithi087.stdout: "get": 67783, 2024-05-08T05:33:57.445 INFO:teuthology.orchestra.run.smithi087.stdout: "get_sum": 24003387, 2024-05-08T05:33:57.445 INFO:teuthology.orchestra.run.smithi087.stdout: "get_or_fail_fail": 0, 2024-05-08T05:33:57.445 INFO:teuthology.orchestra.run.smithi087.stdout: "get_or_fail_success": 67783, 2024-05-08T05:33:57.445 INFO:teuthology.orchestra.run.smithi087.stdout: "take": 0, 2024-05-08T05:33:57.445 INFO:teuthology.orchestra.run.smithi087.stdout: "take_sum": 0, 2024-05-08T05:33:57.445 INFO:teuthology.orchestra.run.smithi087.stdout: "put": 67783, 2024-05-08T05:33:57.445 INFO:teuthology.orchestra.run.smithi087.stdout: "put_sum": 24003387, 2024-05-08T05:33:57.445 INFO:teuthology.orchestra.run.smithi087.stdout: "wait": { 2024-05-08T05:33:57.445 INFO:teuthology.orchestra.run.smithi087.stdout: "avgcount": 0, 2024-05-08T05:33:57.445 INFO:teuthology.orchestra.run.smithi087.stdout: "sum": 0.000000000, 2024-05-08T05:33:57.445 INFO:teuthology.orchestra.run.smithi087.stdout: "avgtime": 0.000000000 2024-05-08T05:33:57.446 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-05-08T05:33:57.446 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:57.446 INFO:teuthology.orchestra.run.smithi087.stdout: "throttle-objecter_bytes": { 2024-05-08T05:33:57.446 INFO:teuthology.orchestra.run.smithi087.stdout: "val": 0, 2024-05-08T05:33:57.446 INFO:teuthology.orchestra.run.smithi087.stdout: "max": 104857600, 2024-05-08T05:33:57.446 INFO:teuthology.orchestra.run.smithi087.stdout: "get_started": 0, 2024-05-08T05:33:57.446 INFO:teuthology.orchestra.run.smithi087.stdout: "get": 0, 2024-05-08T05:33:57.446 INFO:teuthology.orchestra.run.smithi087.stdout: "get_sum": 0, 2024-05-08T05:33:57.446 INFO:teuthology.orchestra.run.smithi087.stdout: "get_or_fail_fail": 0, 2024-05-08T05:33:57.446 INFO:teuthology.orchestra.run.smithi087.stdout: "get_or_fail_success": 0, 2024-05-08T05:33:57.446 INFO:teuthology.orchestra.run.smithi087.stdout: "take": 17296, 2024-05-08T05:33:57.446 INFO:teuthology.orchestra.run.smithi087.stdout: "take_sum": 48150483, 2024-05-08T05:33:57.446 INFO:teuthology.orchestra.run.smithi087.stdout: "put": 17296, 2024-05-08T05:33:57.446 INFO:teuthology.orchestra.run.smithi087.stdout: "put_sum": 48150483, 2024-05-08T05:33:57.446 INFO:teuthology.orchestra.run.smithi087.stdout: "wait": { 2024-05-08T05:33:57.447 INFO:teuthology.orchestra.run.smithi087.stdout: "avgcount": 0, 2024-05-08T05:33:57.447 INFO:teuthology.orchestra.run.smithi087.stdout: "sum": 0.000000000, 2024-05-08T05:33:57.447 INFO:teuthology.orchestra.run.smithi087.stdout: "avgtime": 0.000000000 2024-05-08T05:33:57.447 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-05-08T05:33:57.447 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:57.447 INFO:teuthology.orchestra.run.smithi087.stdout: "throttle-objecter_ops": { 2024-05-08T05:33:57.447 INFO:teuthology.orchestra.run.smithi087.stdout: "val": 0, 2024-05-08T05:33:57.447 INFO:teuthology.orchestra.run.smithi087.stdout: "max": 1024, 2024-05-08T05:33:57.447 INFO:teuthology.orchestra.run.smithi087.stdout: "get_started": 0, 2024-05-08T05:33:57.447 INFO:teuthology.orchestra.run.smithi087.stdout: "get": 0, 2024-05-08T05:33:57.447 INFO:teuthology.orchestra.run.smithi087.stdout: "get_sum": 0, 2024-05-08T05:33:57.447 INFO:teuthology.orchestra.run.smithi087.stdout: "get_or_fail_fail": 0, 2024-05-08T05:33:57.447 INFO:teuthology.orchestra.run.smithi087.stdout: "get_or_fail_success": 0, 2024-05-08T05:33:57.447 INFO:teuthology.orchestra.run.smithi087.stdout: "take": 17296, 2024-05-08T05:33:57.447 INFO:teuthology.orchestra.run.smithi087.stdout: "take_sum": 17296, 2024-05-08T05:33:57.448 INFO:teuthology.orchestra.run.smithi087.stdout: "put": 17296, 2024-05-08T05:33:57.448 INFO:teuthology.orchestra.run.smithi087.stdout: "put_sum": 17296, 2024-05-08T05:33:57.448 INFO:teuthology.orchestra.run.smithi087.stdout: "wait": { 2024-05-08T05:33:57.448 INFO:teuthology.orchestra.run.smithi087.stdout: "avgcount": 0, 2024-05-08T05:33:57.448 INFO:teuthology.orchestra.run.smithi087.stdout: "sum": 0.000000000, 2024-05-08T05:33:57.448 INFO:teuthology.orchestra.run.smithi087.stdout: "avgtime": 0.000000000 2024-05-08T05:33:57.448 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-05-08T05:33:57.448 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:57.448 INFO:teuthology.orchestra.run.smithi087.stdout: "throttle-write_buf_throttle": { 2024-05-08T05:33:57.448 INFO:teuthology.orchestra.run.smithi087.stdout: "val": 0, 2024-05-08T05:33:57.448 INFO:teuthology.orchestra.run.smithi087.stdout: "max": 3758096384, 2024-05-08T05:33:57.448 INFO:teuthology.orchestra.run.smithi087.stdout: "get_started": 0, 2024-05-08T05:33:57.448 INFO:teuthology.orchestra.run.smithi087.stdout: "get": 7221, 2024-05-08T05:33:57.448 INFO:teuthology.orchestra.run.smithi087.stdout: "get_sum": 729345, 2024-05-08T05:33:57.448 INFO:teuthology.orchestra.run.smithi087.stdout: "get_or_fail_fail": 0, 2024-05-08T05:33:57.448 INFO:teuthology.orchestra.run.smithi087.stdout: "get_or_fail_success": 7221, 2024-05-08T05:33:57.449 INFO:teuthology.orchestra.run.smithi087.stdout: "take": 0, 2024-05-08T05:33:57.449 INFO:teuthology.orchestra.run.smithi087.stdout: "take_sum": 0, 2024-05-08T05:33:57.449 INFO:teuthology.orchestra.run.smithi087.stdout: "put": 268, 2024-05-08T05:33:57.449 INFO:teuthology.orchestra.run.smithi087.stdout: "put_sum": 729345, 2024-05-08T05:33:57.449 INFO:teuthology.orchestra.run.smithi087.stdout: "wait": { 2024-05-08T05:33:57.449 INFO:teuthology.orchestra.run.smithi087.stdout: "avgcount": 0, 2024-05-08T05:33:57.449 INFO:teuthology.orchestra.run.smithi087.stdout: "sum": 0.000000000, 2024-05-08T05:33:57.449 INFO:teuthology.orchestra.run.smithi087.stdout: "avgtime": 0.000000000 2024-05-08T05:33:57.449 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-05-08T05:33:57.449 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:33:57.449 INFO:teuthology.orchestra.run.smithi087.stdout: "throttle-write_buf_throttle-0x55cd6d6ba500": { 2024-05-08T05:33:57.449 INFO:teuthology.orchestra.run.smithi087.stdout: "val": 0, 2024-05-08T05:33:57.449 INFO:teuthology.orchestra.run.smithi087.stdout: "max": 3758096384, 2024-05-08T05:33:57.449 INFO:teuthology.orchestra.run.smithi087.stdout: "get_started": 0, 2024-05-08T05:33:57.449 INFO:teuthology.orchestra.run.smithi087.stdout: "get": 21715, 2024-05-08T05:33:57.449 INFO:teuthology.orchestra.run.smithi087.stdout: "get_sum": 46119401, 2024-05-08T05:33:57.450 INFO:teuthology.orchestra.run.smithi087.stdout: "get_or_fail_fail": 0, 2024-05-08T05:33:57.450 INFO:teuthology.orchestra.run.smithi087.stdout: "get_or_fail_success": 21715, 2024-05-08T05:33:57.450 INFO:teuthology.orchestra.run.smithi087.stdout: "take": 0, 2024-05-08T05:33:57.450 INFO:teuthology.orchestra.run.smithi087.stdout: "take_sum": 0, 2024-05-08T05:33:57.450 INFO:teuthology.orchestra.run.smithi087.stdout: "put": 1169, 2024-05-08T05:33:57.450 INFO:teuthology.orchestra.run.smithi087.stdout: "put_sum": 46119401, 2024-05-08T05:33:57.450 INFO:teuthology.orchestra.run.smithi087.stdout: "wait": { 2024-05-08T05:33:57.450 INFO:teuthology.orchestra.run.smithi087.stdout: "avgcount": 0, 2024-05-08T05:33:57.450 INFO:teuthology.orchestra.run.smithi087.stdout: "sum": 0.000000000, 2024-05-08T05:33:57.450 INFO:teuthology.orchestra.run.smithi087.stdout: "avgtime": 0.000000000 2024-05-08T05:33:57.450 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-05-08T05:33:57.450 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-05-08T05:33:57.450 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-05-08T05:33:57.920 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:33:57 smithi087 ceph-mon[29523]: Adjusting osd_memory_target on smithi087 to 176.4M 2024-05-08T05:33:57.920 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:33:57 smithi087 ceph-mon[29523]: Unable to set osd_memory_target on smithi087 to 185040486: error parsing value: Value '185040486' is below minimum 939524096 2024-05-08T05:33:57.983 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:33:57 smithi090 ceph-mon[34526]: Adjusting osd_memory_target on smithi087 to 176.4M 2024-05-08T05:33:57.983 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:33:57 smithi090 ceph-mon[34526]: Unable to set osd_memory_target on smithi087 to 185040486: error parsing value: Value '185040486' is below minimum 939524096 2024-05-08T05:33:58.038 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:33:57 smithi160 ceph-mon[34827]: Adjusting osd_memory_target on smithi087 to 176.4M 2024-05-08T05:33:58.038 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:33:57 smithi160 ceph-mon[34827]: Unable to set osd_memory_target on smithi087 to 185040486: error parsing value: Value '185040486' is below minimum 939524096 2024-05-08T05:33:58.401 INFO:tasks.check_counter:Daemon mds.g mds.exported=9 2024-05-08T05:33:58.401 INFO:tasks.check_counter:Daemon mds.g mds.imported=14 2024-05-08T05:33:58.401 INFO:tasks.check_counter:Daemon mds.g mds_cache.dir_update=1618 2024-05-08T05:33:58.401 INFO:tasks.check_counter:Daemon mds.g mds_cache.dir_update_receipt=2781 2024-05-08T05:33:58.401 DEBUG:tasks.check_counter:Getting stats from j 2024-05-08T05:33:58.401 DEBUG:teuthology.orchestra.run.smithi087:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid eeeb813e-0cf9-11ef-bc97-c7b262605968 -- ceph daemon mds.j perf dump 2024-05-08T05:33:58.708 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:33:58 smithi087 ceph-mon[29523]: pgmap v569: 97 pgs: 97 active+clean; 153 MiB data, 1004 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 511 B/s wr, 6 op/s 2024-05-08T05:33:58.867 INFO:teuthology.orchestra.run.smithi087.stderr:Inferring config /var/lib/ceph/eeeb813e-0cf9-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T05:33:58.983 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:33:58 smithi090 ceph-mon[34526]: pgmap v569: 97 pgs: 97 active+clean; 153 MiB data, 1004 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 511 B/s wr, 6 op/s 2024-05-08T05:33:59.038 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:33:58 smithi160 ceph-mon[34827]: pgmap v569: 97 pgs: 97 active+clean; 153 MiB data, 1004 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 511 B/s wr, 6 op/s 2024-05-08T05:34:00.869 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:34:00 smithi087 ceph-mon[29523]: pgmap v570: 97 pgs: 97 active+clean; 153 MiB data, 1004 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 426 B/s wr, 8 op/s 2024-05-08T05:34:00.983 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:34:00 smithi090 ceph-mon[34526]: pgmap v570: 97 pgs: 97 active+clean; 153 MiB data, 1004 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 426 B/s wr, 8 op/s 2024-05-08T05:34:01.038 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:34:00 smithi160 ceph-mon[34827]: pgmap v570: 97 pgs: 97 active+clean; 153 MiB data, 1004 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 426 B/s wr, 8 op/s 2024-05-08T05:34:01.079 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-05-08T05:34:01.079 INFO:teuthology.orchestra.run.smithi087.stdout: "AsyncMessenger::Worker-0": { 2024-05-08T05:34:01.079 INFO:teuthology.orchestra.run.smithi087.stdout: "msgr_recv_messages": 0, 2024-05-08T05:34:01.079 INFO:teuthology.orchestra.run.smithi087.stdout: "msgr_send_messages": 2, 2024-05-08T05:34:01.079 INFO:teuthology.orchestra.run.smithi087.stdout: "msgr_recv_bytes": 0, 2024-05-08T05:34:01.079 INFO:teuthology.orchestra.run.smithi087.stdout: "msgr_send_bytes": 0, 2024-05-08T05:34:01.080 INFO:teuthology.orchestra.run.smithi087.stdout: "msgr_created_connections": 4, 2024-05-08T05:34:01.080 INFO:teuthology.orchestra.run.smithi087.stdout: "msgr_active_connections": 0, 2024-05-08T05:34:01.080 INFO:teuthology.orchestra.run.smithi087.stdout: "msgr_running_total_time": 0.003900672, 2024-05-08T05:34:01.080 INFO:teuthology.orchestra.run.smithi087.stdout: "msgr_running_send_time": 0.000000000, 2024-05-08T05:34:01.080 INFO:teuthology.orchestra.run.smithi087.stdout: "msgr_running_recv_time": 0.000936137, 2024-05-08T05:34:01.080 INFO:teuthology.orchestra.run.smithi087.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-05-08T05:34:01.080 INFO:teuthology.orchestra.run.smithi087.stdout: "msgr_send_messages_queue_lat": { 2024-05-08T05:34:01.080 INFO:teuthology.orchestra.run.smithi087.stdout: "avgcount": 0, 2024-05-08T05:34:01.080 INFO:teuthology.orchestra.run.smithi087.stdout: "sum": 0.000000000, 2024-05-08T05:34:01.080 INFO:teuthology.orchestra.run.smithi087.stdout: "avgtime": 0.000000000 2024-05-08T05:34:01.080 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:34:01.080 INFO:teuthology.orchestra.run.smithi087.stdout: "msgr_handle_ack_lat": { 2024-05-08T05:34:01.080 INFO:teuthology.orchestra.run.smithi087.stdout: "avgcount": 0, 2024-05-08T05:34:01.080 INFO:teuthology.orchestra.run.smithi087.stdout: "sum": 0.000000000, 2024-05-08T05:34:01.081 INFO:teuthology.orchestra.run.smithi087.stdout: "avgtime": 0.000000000 2024-05-08T05:34:01.081 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:34:01.081 INFO:teuthology.orchestra.run.smithi087.stdout: "msgr_recv_encrypted_bytes": 0, 2024-05-08T05:34:01.081 INFO:teuthology.orchestra.run.smithi087.stdout: "msgr_send_encrypted_bytes": 0 2024-05-08T05:34:01.081 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:34:01.081 INFO:teuthology.orchestra.run.smithi087.stdout: "AsyncMessenger::Worker-1": { 2024-05-08T05:34:01.081 INFO:teuthology.orchestra.run.smithi087.stdout: "msgr_recv_messages": 5, 2024-05-08T05:34:01.081 INFO:teuthology.orchestra.run.smithi087.stdout: "msgr_send_messages": 116, 2024-05-08T05:34:01.081 INFO:teuthology.orchestra.run.smithi087.stdout: "msgr_recv_bytes": 3152, 2024-05-08T05:34:01.081 INFO:teuthology.orchestra.run.smithi087.stdout: "msgr_send_bytes": 99056, 2024-05-08T05:34:01.081 INFO:teuthology.orchestra.run.smithi087.stdout: "msgr_created_connections": 3, 2024-05-08T05:34:01.081 INFO:teuthology.orchestra.run.smithi087.stdout: "msgr_active_connections": 2, 2024-05-08T05:34:01.081 INFO:teuthology.orchestra.run.smithi087.stdout: "msgr_running_total_time": 0.021369704, 2024-05-08T05:34:01.081 INFO:teuthology.orchestra.run.smithi087.stdout: "msgr_running_send_time": 0.015615488, 2024-05-08T05:34:01.082 INFO:teuthology.orchestra.run.smithi087.stdout: "msgr_running_recv_time": 0.003210786, 2024-05-08T05:34:01.082 INFO:teuthology.orchestra.run.smithi087.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-05-08T05:34:01.082 INFO:teuthology.orchestra.run.smithi087.stdout: "msgr_send_messages_queue_lat": { 2024-05-08T05:34:01.082 INFO:teuthology.orchestra.run.smithi087.stdout: "avgcount": 115, 2024-05-08T05:34:01.082 INFO:teuthology.orchestra.run.smithi087.stdout: "sum": 0.012885430, 2024-05-08T05:34:01.082 INFO:teuthology.orchestra.run.smithi087.stdout: "avgtime": 0.000112047 2024-05-08T05:34:01.082 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:34:01.082 INFO:teuthology.orchestra.run.smithi087.stdout: "msgr_handle_ack_lat": { 2024-05-08T05:34:01.082 INFO:teuthology.orchestra.run.smithi087.stdout: "avgcount": 0, 2024-05-08T05:34:01.082 INFO:teuthology.orchestra.run.smithi087.stdout: "sum": 0.000000000, 2024-05-08T05:34:01.082 INFO:teuthology.orchestra.run.smithi087.stdout: "avgtime": 0.000000000 2024-05-08T05:34:01.082 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:34:01.082 INFO:teuthology.orchestra.run.smithi087.stdout: "msgr_recv_encrypted_bytes": 3152, 2024-05-08T05:34:01.083 INFO:teuthology.orchestra.run.smithi087.stdout: "msgr_send_encrypted_bytes": 99056 2024-05-08T05:34:01.083 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:34:01.083 INFO:teuthology.orchestra.run.smithi087.stdout: "AsyncMessenger::Worker-2": { 2024-05-08T05:34:01.083 INFO:teuthology.orchestra.run.smithi087.stdout: "msgr_recv_messages": 154, 2024-05-08T05:34:01.083 INFO:teuthology.orchestra.run.smithi087.stdout: "msgr_send_messages": 151, 2024-05-08T05:34:01.083 INFO:teuthology.orchestra.run.smithi087.stdout: "msgr_recv_bytes": 495280, 2024-05-08T05:34:01.083 INFO:teuthology.orchestra.run.smithi087.stdout: "msgr_send_bytes": 92208, 2024-05-08T05:34:01.083 INFO:teuthology.orchestra.run.smithi087.stdout: "msgr_created_connections": 2, 2024-05-08T05:34:01.083 INFO:teuthology.orchestra.run.smithi087.stdout: "msgr_active_connections": 1, 2024-05-08T05:34:01.083 INFO:teuthology.orchestra.run.smithi087.stdout: "msgr_running_total_time": 0.056750772, 2024-05-08T05:34:01.083 INFO:teuthology.orchestra.run.smithi087.stdout: "msgr_running_send_time": 0.022747027, 2024-05-08T05:34:01.083 INFO:teuthology.orchestra.run.smithi087.stdout: "msgr_running_recv_time": 0.033593452, 2024-05-08T05:34:01.083 INFO:teuthology.orchestra.run.smithi087.stdout: "msgr_running_fast_dispatch_time": 0.006246511, 2024-05-08T05:34:01.083 INFO:teuthology.orchestra.run.smithi087.stdout: "msgr_send_messages_queue_lat": { 2024-05-08T05:34:01.084 INFO:teuthology.orchestra.run.smithi087.stdout: "avgcount": 150, 2024-05-08T05:34:01.084 INFO:teuthology.orchestra.run.smithi087.stdout: "sum": 0.014630039, 2024-05-08T05:34:01.084 INFO:teuthology.orchestra.run.smithi087.stdout: "avgtime": 0.000097533 2024-05-08T05:34:01.084 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:34:01.084 INFO:teuthology.orchestra.run.smithi087.stdout: "msgr_handle_ack_lat": { 2024-05-08T05:34:01.084 INFO:teuthology.orchestra.run.smithi087.stdout: "avgcount": 0, 2024-05-08T05:34:01.084 INFO:teuthology.orchestra.run.smithi087.stdout: "sum": 0.000000000, 2024-05-08T05:34:01.084 INFO:teuthology.orchestra.run.smithi087.stdout: "avgtime": 0.000000000 2024-05-08T05:34:01.084 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:34:01.084 INFO:teuthology.orchestra.run.smithi087.stdout: "msgr_recv_encrypted_bytes": 495280, 2024-05-08T05:34:01.084 INFO:teuthology.orchestra.run.smithi087.stdout: "msgr_send_encrypted_bytes": 92208 2024-05-08T05:34:01.084 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:34:01.084 INFO:teuthology.orchestra.run.smithi087.stdout: "cct": { 2024-05-08T05:34:01.084 INFO:teuthology.orchestra.run.smithi087.stdout: "total_workers": 0, 2024-05-08T05:34:01.084 INFO:teuthology.orchestra.run.smithi087.stdout: "unhealthy_workers": 0 2024-05-08T05:34:01.085 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:34:01.085 INFO:teuthology.orchestra.run.smithi087.stdout: "mempool": { 2024-05-08T05:34:01.085 INFO:teuthology.orchestra.run.smithi087.stdout: "bloom_filter_bytes": 0, 2024-05-08T05:34:01.085 INFO:teuthology.orchestra.run.smithi087.stdout: "bloom_filter_items": 0, 2024-05-08T05:34:01.085 INFO:teuthology.orchestra.run.smithi087.stdout: "bluestore_alloc_bytes": 0, 2024-05-08T05:34:01.085 INFO:teuthology.orchestra.run.smithi087.stdout: "bluestore_alloc_items": 0, 2024-05-08T05:34:01.085 INFO:teuthology.orchestra.run.smithi087.stdout: "bluestore_cache_data_bytes": 0, 2024-05-08T05:34:01.085 INFO:teuthology.orchestra.run.smithi087.stdout: "bluestore_cache_data_items": 0, 2024-05-08T05:34:01.085 INFO:teuthology.orchestra.run.smithi087.stdout: "bluestore_cache_onode_bytes": 0, 2024-05-08T05:34:01.085 INFO:teuthology.orchestra.run.smithi087.stdout: "bluestore_cache_onode_items": 0, 2024-05-08T05:34:01.085 INFO:teuthology.orchestra.run.smithi087.stdout: "bluestore_cache_meta_bytes": 0, 2024-05-08T05:34:01.085 INFO:teuthology.orchestra.run.smithi087.stdout: "bluestore_cache_meta_items": 0, 2024-05-08T05:34:01.085 INFO:teuthology.orchestra.run.smithi087.stdout: "bluestore_cache_other_bytes": 0, 2024-05-08T05:34:01.086 INFO:teuthology.orchestra.run.smithi087.stdout: "bluestore_cache_other_items": 0, 2024-05-08T05:34:01.086 INFO:teuthology.orchestra.run.smithi087.stdout: "bluestore_cache_buffer_bytes": 0, 2024-05-08T05:34:01.086 INFO:teuthology.orchestra.run.smithi087.stdout: "bluestore_cache_buffer_items": 0, 2024-05-08T05:34:01.086 INFO:teuthology.orchestra.run.smithi087.stdout: "bluestore_extent_bytes": 0, 2024-05-08T05:34:01.086 INFO:teuthology.orchestra.run.smithi087.stdout: "bluestore_extent_items": 0, 2024-05-08T05:34:01.086 INFO:teuthology.orchestra.run.smithi087.stdout: "bluestore_blob_bytes": 0, 2024-05-08T05:34:01.086 INFO:teuthology.orchestra.run.smithi087.stdout: "bluestore_blob_items": 0, 2024-05-08T05:34:01.086 INFO:teuthology.orchestra.run.smithi087.stdout: "bluestore_shared_blob_bytes": 0, 2024-05-08T05:34:01.086 INFO:teuthology.orchestra.run.smithi087.stdout: "bluestore_shared_blob_items": 0, 2024-05-08T05:34:01.086 INFO:teuthology.orchestra.run.smithi087.stdout: "bluestore_inline_bl_bytes": 0, 2024-05-08T05:34:01.086 INFO:teuthology.orchestra.run.smithi087.stdout: "bluestore_inline_bl_items": 0, 2024-05-08T05:34:01.087 INFO:teuthology.orchestra.run.smithi087.stdout: "bluestore_fsck_bytes": 0, 2024-05-08T05:34:01.087 INFO:teuthology.orchestra.run.smithi087.stdout: "bluestore_fsck_items": 0, 2024-05-08T05:34:01.087 INFO:teuthology.orchestra.run.smithi087.stdout: "bluestore_txc_bytes": 0, 2024-05-08T05:34:01.087 INFO:teuthology.orchestra.run.smithi087.stdout: "bluestore_txc_items": 0, 2024-05-08T05:34:01.087 INFO:teuthology.orchestra.run.smithi087.stdout: "bluestore_writing_deferred_bytes": 0, 2024-05-08T05:34:01.087 INFO:teuthology.orchestra.run.smithi087.stdout: "bluestore_writing_deferred_items": 0, 2024-05-08T05:34:01.087 INFO:teuthology.orchestra.run.smithi087.stdout: "bluestore_writing_bytes": 0, 2024-05-08T05:34:01.087 INFO:teuthology.orchestra.run.smithi087.stdout: "bluestore_writing_items": 0, 2024-05-08T05:34:01.087 INFO:teuthology.orchestra.run.smithi087.stdout: "bluefs_bytes": 0, 2024-05-08T05:34:01.087 INFO:teuthology.orchestra.run.smithi087.stdout: "bluefs_items": 0, 2024-05-08T05:34:01.087 INFO:teuthology.orchestra.run.smithi087.stdout: "bluefs_file_reader_bytes": 0, 2024-05-08T05:34:01.087 INFO:teuthology.orchestra.run.smithi087.stdout: "bluefs_file_reader_items": 0, 2024-05-08T05:34:01.087 INFO:teuthology.orchestra.run.smithi087.stdout: "bluefs_file_writer_bytes": 0, 2024-05-08T05:34:01.087 INFO:teuthology.orchestra.run.smithi087.stdout: "bluefs_file_writer_items": 0, 2024-05-08T05:34:01.088 INFO:teuthology.orchestra.run.smithi087.stdout: "buffer_anon_bytes": 151029, 2024-05-08T05:34:01.088 INFO:teuthology.orchestra.run.smithi087.stdout: "buffer_anon_items": 31, 2024-05-08T05:34:01.088 INFO:teuthology.orchestra.run.smithi087.stdout: "buffer_meta_bytes": 0, 2024-05-08T05:34:01.088 INFO:teuthology.orchestra.run.smithi087.stdout: "buffer_meta_items": 0, 2024-05-08T05:34:01.088 INFO:teuthology.orchestra.run.smithi087.stdout: "osd_bytes": 0, 2024-05-08T05:34:01.088 INFO:teuthology.orchestra.run.smithi087.stdout: "osd_items": 0, 2024-05-08T05:34:01.088 INFO:teuthology.orchestra.run.smithi087.stdout: "osd_mapbl_bytes": 0, 2024-05-08T05:34:01.088 INFO:teuthology.orchestra.run.smithi087.stdout: "osd_mapbl_items": 0, 2024-05-08T05:34:01.088 INFO:teuthology.orchestra.run.smithi087.stdout: "osd_pglog_bytes": 0, 2024-05-08T05:34:01.088 INFO:teuthology.orchestra.run.smithi087.stdout: "osd_pglog_items": 0, 2024-05-08T05:34:01.088 INFO:teuthology.orchestra.run.smithi087.stdout: "osdmap_bytes": 0, 2024-05-08T05:34:01.088 INFO:teuthology.orchestra.run.smithi087.stdout: "osdmap_items": 0, 2024-05-08T05:34:01.088 INFO:teuthology.orchestra.run.smithi087.stdout: "osdmap_mapping_bytes": 0, 2024-05-08T05:34:01.088 INFO:teuthology.orchestra.run.smithi087.stdout: "osdmap_mapping_items": 0, 2024-05-08T05:34:01.089 INFO:teuthology.orchestra.run.smithi087.stdout: "pgmap_bytes": 0, 2024-05-08T05:34:01.089 INFO:teuthology.orchestra.run.smithi087.stdout: "pgmap_items": 0, 2024-05-08T05:34:01.089 INFO:teuthology.orchestra.run.smithi087.stdout: "mds_co_bytes": 928, 2024-05-08T05:34:01.089 INFO:teuthology.orchestra.run.smithi087.stdout: "mds_co_items": 2, 2024-05-08T05:34:01.089 INFO:teuthology.orchestra.run.smithi087.stdout: "unittest_1_bytes": 0, 2024-05-08T05:34:01.089 INFO:teuthology.orchestra.run.smithi087.stdout: "unittest_1_items": 0, 2024-05-08T05:34:01.089 INFO:teuthology.orchestra.run.smithi087.stdout: "unittest_2_bytes": 0, 2024-05-08T05:34:01.089 INFO:teuthology.orchestra.run.smithi087.stdout: "unittest_2_items": 0 2024-05-08T05:34:01.089 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-08T05:34:01.089 INFO:teuthology.orchestra.run.smithi087.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-05-08T05:34:01.089 INFO:teuthology.orchestra.run.smithi087.stdout: "val": 0, 2024-05-08T05:34:01.090 INFO:teuthology.orchestra.run.smithi087.stdout: "max": 104857600, 2024-05-08T05:34:01.090 INFO:teuthology.orchestra.run.smithi087.stdout: "get_started": 0, 2024-05-08T05:34:01.090 INFO:teuthology.orchestra.run.smithi087.stdout: "get": 155, 2024-05-08T05:34:01.090 INFO:teuthology.orchestra.run.smithi087.stdout: "get_sum": 473534, 2024-05-08T05:34:01.090 INFO:teuthology.orchestra.run.smithi087.stdout: "get_or_fail_fail": 0, 2024-05-08T05:34:01.090 INFO:teuthology.orchestra.run.smithi087.stdout: "get_or_fail_success": 155, 2024-05-08T05:34:01.090 INFO:teuthology.orchestra.run.smithi087.stdout: "take": 0, 2024-05-08T05:34:01.090 INFO:teuthology.orchestra.run.smithi087.stdout: "take_sum": 0, 2024-05-08T05:34:01.090 INFO:teuthology.orchestra.run.smithi087.stdout: "put": 155, 2024-05-08T05:34:01.090 INFO:teuthology.orchestra.run.smithi087.stdout: "put_sum": 473534, 2024-05-08T05:34:01.090 INFO:teuthology.orchestra.run.smithi087.stdout: "wait": { 2024-05-08T05:34:01.090 INFO:teuthology.orchestra.run.smithi087.stdout: "avgcount": 0, 2024-05-08T05:34:01.090 INFO:teuthology.orchestra.run.smithi087.stdout: "sum": 0.000000000, 2024-05-08T05:34:01.090 INFO:teuthology.orchestra.run.smithi087.stdout: "avgtime": 0.000000000 2024-05-08T05:34:01.091 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-05-08T05:34:01.091 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-05-08T05:34:01.091 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-05-08T05:34:01.932 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.j 2024-05-08T05:34:01.932 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.j 2024-05-08T05:34:01.933 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update' not found on daemon mds.j 2024-05-08T05:34:01.933 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update_receipt' not found on daemon mds.j 2024-05-08T05:34:01.933 DEBUG:tasks.check_counter:Getting stats from b 2024-05-08T05:34:01.933 DEBUG:teuthology.orchestra.run.smithi090:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid eeeb813e-0cf9-11ef-bc97-c7b262605968 -- ceph daemon mds.b perf dump 2024-05-08T05:34:02.183 INFO:teuthology.orchestra.run.smithi090.stderr:Inferring config /var/lib/ceph/eeeb813e-0cf9-11ef-bc97-c7b262605968/mon.b/config 2024-05-08T05:34:02.958 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:34:02 smithi087 ceph-mon[29523]: pgmap v571: 97 pgs: 97 active+clean; 153 MiB data, 1004 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 170 B/s wr, 6 op/s 2024-05-08T05:34:02.983 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:34:02 smithi090 ceph-mon[34526]: pgmap v571: 97 pgs: 97 active+clean; 153 MiB data, 1004 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 170 B/s wr, 6 op/s 2024-05-08T05:34:03.038 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:34:02 smithi160 ceph-mon[34827]: pgmap v571: 97 pgs: 97 active+clean; 153 MiB data, 1004 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 170 B/s wr, 6 op/s 2024-05-08T05:34:03.950 INFO:teuthology.orchestra.run.smithi090.stdout:{ 2024-05-08T05:34:03.951 INFO:teuthology.orchestra.run.smithi090.stdout: "AsyncMessenger::Worker-0": { 2024-05-08T05:34:03.951 INFO:teuthology.orchestra.run.smithi090.stdout: "msgr_recv_messages": 28086, 2024-05-08T05:34:03.951 INFO:teuthology.orchestra.run.smithi090.stdout: "msgr_send_messages": 17002, 2024-05-08T05:34:03.951 INFO:teuthology.orchestra.run.smithi090.stdout: "msgr_recv_bytes": 10087305, 2024-05-08T05:34:03.951 INFO:teuthology.orchestra.run.smithi090.stdout: "msgr_send_bytes": 50449989, 2024-05-08T05:34:03.951 INFO:teuthology.orchestra.run.smithi090.stdout: "msgr_created_connections": 51, 2024-05-08T05:34:03.951 INFO:teuthology.orchestra.run.smithi090.stdout: "msgr_active_connections": 4, 2024-05-08T05:34:03.951 INFO:teuthology.orchestra.run.smithi090.stdout: "msgr_running_total_time": 1.294247319, 2024-05-08T05:34:03.951 INFO:teuthology.orchestra.run.smithi090.stdout: "msgr_running_send_time": 0.530919358, 2024-05-08T05:34:03.951 INFO:teuthology.orchestra.run.smithi090.stdout: "msgr_running_recv_time": 0.873098525, 2024-05-08T05:34:03.951 INFO:teuthology.orchestra.run.smithi090.stdout: "msgr_running_fast_dispatch_time": 0.112281221, 2024-05-08T05:34:03.952 INFO:teuthology.orchestra.run.smithi090.stdout: "msgr_send_messages_queue_lat": { 2024-05-08T05:34:03.952 INFO:teuthology.orchestra.run.smithi090.stdout: "avgcount": 17003, 2024-05-08T05:34:03.952 INFO:teuthology.orchestra.run.smithi090.stdout: "sum": 0.402962690, 2024-05-08T05:34:03.952 INFO:teuthology.orchestra.run.smithi090.stdout: "avgtime": 0.000023699 2024-05-08T05:34:03.952 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-05-08T05:34:03.952 INFO:teuthology.orchestra.run.smithi090.stdout: "msgr_handle_ack_lat": { 2024-05-08T05:34:03.952 INFO:teuthology.orchestra.run.smithi090.stdout: "avgcount": 36420, 2024-05-08T05:34:03.952 INFO:teuthology.orchestra.run.smithi090.stdout: "sum": 0.004244541, 2024-05-08T05:34:03.952 INFO:teuthology.orchestra.run.smithi090.stdout: "avgtime": 0.000000116 2024-05-08T05:34:03.952 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-05-08T05:34:03.952 INFO:teuthology.orchestra.run.smithi090.stdout: "msgr_recv_encrypted_bytes": 0, 2024-05-08T05:34:03.952 INFO:teuthology.orchestra.run.smithi090.stdout: "msgr_send_encrypted_bytes": 0 2024-05-08T05:34:03.952 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-05-08T05:34:03.952 INFO:teuthology.orchestra.run.smithi090.stdout: "AsyncMessenger::Worker-1": { 2024-05-08T05:34:03.953 INFO:teuthology.orchestra.run.smithi090.stdout: "msgr_recv_messages": 33128, 2024-05-08T05:34:03.953 INFO:teuthology.orchestra.run.smithi090.stdout: "msgr_send_messages": 75527, 2024-05-08T05:34:03.953 INFO:teuthology.orchestra.run.smithi090.stdout: "msgr_recv_bytes": 12680200, 2024-05-08T05:34:03.953 INFO:teuthology.orchestra.run.smithi090.stdout: "msgr_send_bytes": 42260538, 2024-05-08T05:34:03.953 INFO:teuthology.orchestra.run.smithi090.stdout: "msgr_created_connections": 14, 2024-05-08T05:34:03.953 INFO:teuthology.orchestra.run.smithi090.stdout: "msgr_active_connections": 5, 2024-05-08T05:34:03.953 INFO:teuthology.orchestra.run.smithi090.stdout: "msgr_running_total_time": 2.047615768, 2024-05-08T05:34:03.953 INFO:teuthology.orchestra.run.smithi090.stdout: "msgr_running_send_time": 0.956491360, 2024-05-08T05:34:03.953 INFO:teuthology.orchestra.run.smithi090.stdout: "msgr_running_recv_time": 3.736436417, 2024-05-08T05:34:03.953 INFO:teuthology.orchestra.run.smithi090.stdout: "msgr_running_fast_dispatch_time": 0.075810200, 2024-05-08T05:34:03.953 INFO:teuthology.orchestra.run.smithi090.stdout: "msgr_send_messages_queue_lat": { 2024-05-08T05:34:03.953 INFO:teuthology.orchestra.run.smithi090.stdout: "avgcount": 75526, 2024-05-08T05:34:03.953 INFO:teuthology.orchestra.run.smithi090.stdout: "sum": 1.676522177, 2024-05-08T05:34:03.954 INFO:teuthology.orchestra.run.smithi090.stdout: "avgtime": 0.000022197 2024-05-08T05:34:03.954 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-05-08T05:34:03.954 INFO:teuthology.orchestra.run.smithi090.stdout: "msgr_handle_ack_lat": { 2024-05-08T05:34:03.954 INFO:teuthology.orchestra.run.smithi090.stdout: "avgcount": 79208, 2024-05-08T05:34:03.954 INFO:teuthology.orchestra.run.smithi090.stdout: "sum": 0.012462619, 2024-05-08T05:34:03.954 INFO:teuthology.orchestra.run.smithi090.stdout: "avgtime": 0.000000157 2024-05-08T05:34:03.954 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-05-08T05:34:03.954 INFO:teuthology.orchestra.run.smithi090.stdout: "msgr_recv_encrypted_bytes": 56208, 2024-05-08T05:34:03.954 INFO:teuthology.orchestra.run.smithi090.stdout: "msgr_send_encrypted_bytes": 304064 2024-05-08T05:34:03.954 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-05-08T05:34:03.954 INFO:teuthology.orchestra.run.smithi090.stdout: "AsyncMessenger::Worker-2": { 2024-05-08T05:34:03.954 INFO:teuthology.orchestra.run.smithi090.stdout: "msgr_recv_messages": 21346, 2024-05-08T05:34:03.954 INFO:teuthology.orchestra.run.smithi090.stdout: "msgr_send_messages": 14879, 2024-05-08T05:34:03.954 INFO:teuthology.orchestra.run.smithi090.stdout: "msgr_recv_bytes": 8741392, 2024-05-08T05:34:03.955 INFO:teuthology.orchestra.run.smithi090.stdout: "msgr_send_bytes": 23458589, 2024-05-08T05:34:03.955 INFO:teuthology.orchestra.run.smithi090.stdout: "msgr_created_connections": 8, 2024-05-08T05:34:03.955 INFO:teuthology.orchestra.run.smithi090.stdout: "msgr_active_connections": 7, 2024-05-08T05:34:03.955 INFO:teuthology.orchestra.run.smithi090.stdout: "msgr_running_total_time": 1.024011513, 2024-05-08T05:34:03.955 INFO:teuthology.orchestra.run.smithi090.stdout: "msgr_running_send_time": 0.398833389, 2024-05-08T05:34:03.955 INFO:teuthology.orchestra.run.smithi090.stdout: "msgr_running_recv_time": 0.675188130, 2024-05-08T05:34:03.955 INFO:teuthology.orchestra.run.smithi090.stdout: "msgr_running_fast_dispatch_time": 0.121959247, 2024-05-08T05:34:03.955 INFO:teuthology.orchestra.run.smithi090.stdout: "msgr_send_messages_queue_lat": { 2024-05-08T05:34:03.955 INFO:teuthology.orchestra.run.smithi090.stdout: "avgcount": 14875, 2024-05-08T05:34:03.955 INFO:teuthology.orchestra.run.smithi090.stdout: "sum": 0.522663557, 2024-05-08T05:34:03.955 INFO:teuthology.orchestra.run.smithi090.stdout: "avgtime": 0.000035137 2024-05-08T05:34:03.955 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-05-08T05:34:03.955 INFO:teuthology.orchestra.run.smithi090.stdout: "msgr_handle_ack_lat": { 2024-05-08T05:34:03.955 INFO:teuthology.orchestra.run.smithi090.stdout: "avgcount": 30631, 2024-05-08T05:34:03.956 INFO:teuthology.orchestra.run.smithi090.stdout: "sum": 0.003565239, 2024-05-08T05:34:03.956 INFO:teuthology.orchestra.run.smithi090.stdout: "avgtime": 0.000000116 2024-05-08T05:34:03.956 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-05-08T05:34:03.956 INFO:teuthology.orchestra.run.smithi090.stdout: "msgr_recv_encrypted_bytes": 555264, 2024-05-08T05:34:03.956 INFO:teuthology.orchestra.run.smithi090.stdout: "msgr_send_encrypted_bytes": 100464 2024-05-08T05:34:03.956 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-05-08T05:34:03.956 INFO:teuthology.orchestra.run.smithi090.stdout: "cct": { 2024-05-08T05:34:03.956 INFO:teuthology.orchestra.run.smithi090.stdout: "total_workers": 1, 2024-05-08T05:34:03.956 INFO:teuthology.orchestra.run.smithi090.stdout: "unhealthy_workers": 0 2024-05-08T05:34:03.956 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-05-08T05:34:03.956 INFO:teuthology.orchestra.run.smithi090.stdout: "finisher-MDSRank": { 2024-05-08T05:34:03.956 INFO:teuthology.orchestra.run.smithi090.stdout: "queue_len": 0, 2024-05-08T05:34:03.956 INFO:teuthology.orchestra.run.smithi090.stdout: "complete_latency": { 2024-05-08T05:34:03.956 INFO:teuthology.orchestra.run.smithi090.stdout: "avgcount": 5822, 2024-05-08T05:34:03.956 INFO:teuthology.orchestra.run.smithi090.stdout: "sum": 20.423508267, 2024-05-08T05:34:03.957 INFO:teuthology.orchestra.run.smithi090.stdout: "avgtime": 0.003507988 2024-05-08T05:34:03.957 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-05-08T05:34:03.957 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-05-08T05:34:03.957 INFO:teuthology.orchestra.run.smithi090.stdout: "finisher-PurgeQueue": { 2024-05-08T05:34:03.957 INFO:teuthology.orchestra.run.smithi090.stdout: "queue_len": 0, 2024-05-08T05:34:03.957 INFO:teuthology.orchestra.run.smithi090.stdout: "complete_latency": { 2024-05-08T05:34:03.957 INFO:teuthology.orchestra.run.smithi090.stdout: "avgcount": 2419, 2024-05-08T05:34:03.957 INFO:teuthology.orchestra.run.smithi090.stdout: "sum": 0.280072805, 2024-05-08T05:34:03.957 INFO:teuthology.orchestra.run.smithi090.stdout: "avgtime": 0.000115780 2024-05-08T05:34:03.957 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-05-08T05:34:03.957 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-05-08T05:34:03.957 INFO:teuthology.orchestra.run.smithi090.stdout: "mds": { 2024-05-08T05:34:03.957 INFO:teuthology.orchestra.run.smithi090.stdout: "request": 17701, 2024-05-08T05:34:03.957 INFO:teuthology.orchestra.run.smithi090.stdout: "reply": 17557, 2024-05-08T05:34:03.957 INFO:teuthology.orchestra.run.smithi090.stdout: "reply_latency": { 2024-05-08T05:34:03.957 INFO:teuthology.orchestra.run.smithi090.stdout: "avgcount": 17557, 2024-05-08T05:34:03.957 INFO:teuthology.orchestra.run.smithi090.stdout: "sum": 50.966151929, 2024-05-08T05:34:03.958 INFO:teuthology.orchestra.run.smithi090.stdout: "avgtime": 0.002902896 2024-05-08T05:34:03.958 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-05-08T05:34:03.958 INFO:teuthology.orchestra.run.smithi090.stdout: "slow_reply": 0, 2024-05-08T05:34:03.958 INFO:teuthology.orchestra.run.smithi090.stdout: "forward": 144, 2024-05-08T05:34:03.958 INFO:teuthology.orchestra.run.smithi090.stdout: "dir_fetch_complete": 0, 2024-05-08T05:34:03.958 INFO:teuthology.orchestra.run.smithi090.stdout: "dir_fetch_keys": 0, 2024-05-08T05:34:03.958 INFO:teuthology.orchestra.run.smithi090.stdout: "dir_commit": 75, 2024-05-08T05:34:03.958 INFO:teuthology.orchestra.run.smithi090.stdout: "dir_split": 7, 2024-05-08T05:34:03.958 INFO:teuthology.orchestra.run.smithi090.stdout: "dir_merge": 0, 2024-05-08T05:34:03.958 INFO:teuthology.orchestra.run.smithi090.stdout: "inodes": 164, 2024-05-08T05:34:03.958 INFO:teuthology.orchestra.run.smithi090.stdout: "inodes_top": 53, 2024-05-08T05:34:03.958 INFO:teuthology.orchestra.run.smithi090.stdout: "inodes_bottom": 38, 2024-05-08T05:34:03.958 INFO:teuthology.orchestra.run.smithi090.stdout: "inodes_pin_tail": 73, 2024-05-08T05:34:03.958 INFO:teuthology.orchestra.run.smithi090.stdout: "inodes_pinned": 87, 2024-05-08T05:34:03.959 INFO:teuthology.orchestra.run.smithi090.stdout: "inodes_expired": 17372, 2024-05-08T05:34:03.959 INFO:teuthology.orchestra.run.smithi090.stdout: "inodes_with_caps": 1, 2024-05-08T05:34:03.959 INFO:teuthology.orchestra.run.smithi090.stdout: "caps": 1, 2024-05-08T05:34:03.959 INFO:teuthology.orchestra.run.smithi090.stdout: "subtrees": 4, 2024-05-08T05:34:03.959 INFO:teuthology.orchestra.run.smithi090.stdout: "traverse": 22894, 2024-05-08T05:34:03.959 INFO:teuthology.orchestra.run.smithi090.stdout: "traverse_hit": 20594, 2024-05-08T05:34:03.959 INFO:teuthology.orchestra.run.smithi090.stdout: "traverse_forward": 10, 2024-05-08T05:34:03.959 INFO:teuthology.orchestra.run.smithi090.stdout: "traverse_discover": 1670, 2024-05-08T05:34:03.959 INFO:teuthology.orchestra.run.smithi090.stdout: "traverse_dir_fetch": 0, 2024-05-08T05:34:03.959 INFO:teuthology.orchestra.run.smithi090.stdout: "traverse_remote_ino": 2, 2024-05-08T05:34:03.959 INFO:teuthology.orchestra.run.smithi090.stdout: "traverse_lock": 15, 2024-05-08T05:34:03.959 INFO:teuthology.orchestra.run.smithi090.stdout: "load_cent": 12, 2024-05-08T05:34:03.959 INFO:teuthology.orchestra.run.smithi090.stdout: "q": 0, 2024-05-08T05:34:03.959 INFO:teuthology.orchestra.run.smithi090.stdout: "exported": 32, 2024-05-08T05:34:03.960 INFO:teuthology.orchestra.run.smithi090.stdout: "exported_inodes": 14015, 2024-05-08T05:34:03.960 INFO:teuthology.orchestra.run.smithi090.stdout: "imported": 12, 2024-05-08T05:34:03.960 INFO:teuthology.orchestra.run.smithi090.stdout: "imported_inodes": 340, 2024-05-08T05:34:03.960 INFO:teuthology.orchestra.run.smithi090.stdout: "openino_dir_fetch": 0, 2024-05-08T05:34:03.960 INFO:teuthology.orchestra.run.smithi090.stdout: "openino_backtrace_fetch": 3932, 2024-05-08T05:34:03.960 INFO:teuthology.orchestra.run.smithi090.stdout: "openino_peer_discover": 4, 2024-05-08T05:34:03.960 INFO:teuthology.orchestra.run.smithi090.stdout: "root_rfiles": 4, 2024-05-08T05:34:03.960 INFO:teuthology.orchestra.run.smithi090.stdout: "root_rbytes": 234, 2024-05-08T05:34:03.960 INFO:teuthology.orchestra.run.smithi090.stdout: "root_rsnaps": 0, 2024-05-08T05:34:03.960 INFO:teuthology.orchestra.run.smithi090.stdout: "scrub_backtrace_fetch": 3932, 2024-05-08T05:34:03.960 INFO:teuthology.orchestra.run.smithi090.stdout: "scrub_set_tag": 0, 2024-05-08T05:34:03.960 INFO:teuthology.orchestra.run.smithi090.stdout: "scrub_backtrace_repaired": 0, 2024-05-08T05:34:03.960 INFO:teuthology.orchestra.run.smithi090.stdout: "scrub_inotable_repaired": 0, 2024-05-08T05:34:03.960 INFO:teuthology.orchestra.run.smithi090.stdout: "scrub_dir_inodes": 411, 2024-05-08T05:34:03.960 INFO:teuthology.orchestra.run.smithi090.stdout: "scrub_dir_base_inodes": 6, 2024-05-08T05:34:03.960 INFO:teuthology.orchestra.run.smithi090.stdout: "scrub_dirfrag_rstats": 405, 2024-05-08T05:34:03.961 INFO:teuthology.orchestra.run.smithi090.stdout: "scrub_file_inodes": 3521, 2024-05-08T05:34:03.961 INFO:teuthology.orchestra.run.smithi090.stdout: "handle_inode_file_caps": 18, 2024-05-08T05:34:03.961 INFO:teuthology.orchestra.run.smithi090.stdout: "ceph_cap_op_revoke": 663, 2024-05-08T05:34:03.961 INFO:teuthology.orchestra.run.smithi090.stdout: "ceph_cap_op_grant": 14116, 2024-05-08T05:34:03.961 INFO:teuthology.orchestra.run.smithi090.stdout: "ceph_cap_op_trunc": 209, 2024-05-08T05:34:03.961 INFO:teuthology.orchestra.run.smithi090.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-05-08T05:34:03.961 INFO:teuthology.orchestra.run.smithi090.stdout: "ceph_cap_op_flush_ack": 0, 2024-05-08T05:34:03.961 INFO:teuthology.orchestra.run.smithi090.stdout: "handle_client_caps": 12136, 2024-05-08T05:34:03.961 INFO:teuthology.orchestra.run.smithi090.stdout: "handle_client_caps_dirty": 10123, 2024-05-08T05:34:03.961 INFO:teuthology.orchestra.run.smithi090.stdout: "handle_client_cap_release": 25, 2024-05-08T05:34:03.961 INFO:teuthology.orchestra.run.smithi090.stdout: "process_request_cap_release": 4399 2024-05-08T05:34:03.961 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-05-08T05:34:03.961 INFO:teuthology.orchestra.run.smithi090.stdout: "mds_cache": { 2024-05-08T05:34:03.961 INFO:teuthology.orchestra.run.smithi090.stdout: "dir_update": 435, 2024-05-08T05:34:03.962 INFO:teuthology.orchestra.run.smithi090.stdout: "dir_update_receipt": 4678, 2024-05-08T05:34:03.962 INFO:teuthology.orchestra.run.smithi090.stdout: "dir_try_discover": 3119, 2024-05-08T05:34:03.962 INFO:teuthology.orchestra.run.smithi090.stdout: "dir_send_discover": 3137, 2024-05-08T05:34:03.962 INFO:teuthology.orchestra.run.smithi090.stdout: "dir_handle_discover": 946, 2024-05-08T05:34:03.962 INFO:teuthology.orchestra.run.smithi090.stdout: "num_strays": 40, 2024-05-08T05:34:03.962 INFO:teuthology.orchestra.run.smithi090.stdout: "num_strays_delayed": 0, 2024-05-08T05:34:03.962 INFO:teuthology.orchestra.run.smithi090.stdout: "num_strays_enqueuing": 0, 2024-05-08T05:34:03.962 INFO:teuthology.orchestra.run.smithi090.stdout: "strays_created": 1163, 2024-05-08T05:34:03.962 INFO:teuthology.orchestra.run.smithi090.stdout: "strays_enqueued": 1078, 2024-05-08T05:34:03.962 INFO:teuthology.orchestra.run.smithi090.stdout: "strays_reintegrated": 48, 2024-05-08T05:34:03.962 INFO:teuthology.orchestra.run.smithi090.stdout: "strays_migrated": 0, 2024-05-08T05:34:03.962 INFO:teuthology.orchestra.run.smithi090.stdout: "num_recovering_processing": 0, 2024-05-08T05:34:03.962 INFO:teuthology.orchestra.run.smithi090.stdout: "num_recovering_enqueued": 0, 2024-05-08T05:34:03.962 INFO:teuthology.orchestra.run.smithi090.stdout: "num_recovering_prioritized": 0, 2024-05-08T05:34:03.963 INFO:teuthology.orchestra.run.smithi090.stdout: "recovery_started": 0, 2024-05-08T05:34:03.963 INFO:teuthology.orchestra.run.smithi090.stdout: "recovery_completed": 0, 2024-05-08T05:34:03.963 INFO:teuthology.orchestra.run.smithi090.stdout: "ireq_quiesce_path": 0, 2024-05-08T05:34:03.963 INFO:teuthology.orchestra.run.smithi090.stdout: "ireq_quiesce_inode": 0, 2024-05-08T05:34:03.963 INFO:teuthology.orchestra.run.smithi090.stdout: "ireq_enqueue_scrub": 6, 2024-05-08T05:34:03.963 INFO:teuthology.orchestra.run.smithi090.stdout: "ireq_exportdir": 32, 2024-05-08T05:34:03.963 INFO:teuthology.orchestra.run.smithi090.stdout: "ireq_flush": 0, 2024-05-08T05:34:03.963 INFO:teuthology.orchestra.run.smithi090.stdout: "ireq_fragmentdir": 7, 2024-05-08T05:34:03.963 INFO:teuthology.orchestra.run.smithi090.stdout: "ireq_fragstats": 0, 2024-05-08T05:34:03.963 INFO:teuthology.orchestra.run.smithi090.stdout: "ireq_inodestats": 0 2024-05-08T05:34:03.963 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-05-08T05:34:03.963 INFO:teuthology.orchestra.run.smithi090.stdout: "mds_log": { 2024-05-08T05:34:03.963 INFO:teuthology.orchestra.run.smithi090.stdout: "evlrg": 0, 2024-05-08T05:34:03.963 INFO:teuthology.orchestra.run.smithi090.stdout: "evadd": 30387, 2024-05-08T05:34:03.963 INFO:teuthology.orchestra.run.smithi090.stdout: "evex": 0, 2024-05-08T05:34:03.964 INFO:teuthology.orchestra.run.smithi090.stdout: "evtrm": 0, 2024-05-08T05:34:03.964 INFO:teuthology.orchestra.run.smithi090.stdout: "ev": 30387, 2024-05-08T05:34:03.964 INFO:teuthology.orchestra.run.smithi090.stdout: "evexg": 0, 2024-05-08T05:34:03.964 INFO:teuthology.orchestra.run.smithi090.stdout: "evexd": 0, 2024-05-08T05:34:03.964 INFO:teuthology.orchestra.run.smithi090.stdout: "segadd": 36, 2024-05-08T05:34:03.964 INFO:teuthology.orchestra.run.smithi090.stdout: "segex": 0, 2024-05-08T05:34:03.964 INFO:teuthology.orchestra.run.smithi090.stdout: "segtrm": 0, 2024-05-08T05:34:03.964 INFO:teuthology.orchestra.run.smithi090.stdout: "seg": 36, 2024-05-08T05:34:03.964 INFO:teuthology.orchestra.run.smithi090.stdout: "segmjr": 4, 2024-05-08T05:34:03.964 INFO:teuthology.orchestra.run.smithi090.stdout: "segexg": 0, 2024-05-08T05:34:03.964 INFO:teuthology.orchestra.run.smithi090.stdout: "segexd": 0, 2024-05-08T05:34:03.964 INFO:teuthology.orchestra.run.smithi090.stdout: "expos": 4194304, 2024-05-08T05:34:03.964 INFO:teuthology.orchestra.run.smithi090.stdout: "wrpos": 72095967, 2024-05-08T05:34:03.964 INFO:teuthology.orchestra.run.smithi090.stdout: "rdpos": 0, 2024-05-08T05:34:03.964 INFO:teuthology.orchestra.run.smithi090.stdout: "jlat": { 2024-05-08T05:34:03.965 INFO:teuthology.orchestra.run.smithi090.stdout: "avgcount": 2428, 2024-05-08T05:34:03.965 INFO:teuthology.orchestra.run.smithi090.stdout: "sum": 66.914193183, 2024-05-08T05:34:03.965 INFO:teuthology.orchestra.run.smithi090.stdout: "avgtime": 0.027559387 2024-05-08T05:34:03.965 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-05-08T05:34:03.965 INFO:teuthology.orchestra.run.smithi090.stdout: "replayed": 0 2024-05-08T05:34:03.965 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-05-08T05:34:03.965 INFO:teuthology.orchestra.run.smithi090.stdout: "mds_mem": { 2024-05-08T05:34:03.965 INFO:teuthology.orchestra.run.smithi090.stdout: "ino": 82, 2024-05-08T05:34:03.965 INFO:teuthology.orchestra.run.smithi090.stdout: "ino+": 16181, 2024-05-08T05:34:03.965 INFO:teuthology.orchestra.run.smithi090.stdout: "ino-": 16099, 2024-05-08T05:34:03.965 INFO:teuthology.orchestra.run.smithi090.stdout: "dir": 77, 2024-05-08T05:34:03.965 INFO:teuthology.orchestra.run.smithi090.stdout: "dir+": 3607, 2024-05-08T05:34:03.965 INFO:teuthology.orchestra.run.smithi090.stdout: "dir-": 3530, 2024-05-08T05:34:03.965 INFO:teuthology.orchestra.run.smithi090.stdout: "dn": 164, 2024-05-08T05:34:03.966 INFO:teuthology.orchestra.run.smithi090.stdout: "dn+": 19736, 2024-05-08T05:34:03.966 INFO:teuthology.orchestra.run.smithi090.stdout: "dn-": 19572, 2024-05-08T05:34:03.966 INFO:teuthology.orchestra.run.smithi090.stdout: "cap": 1, 2024-05-08T05:34:03.966 INFO:teuthology.orchestra.run.smithi090.stdout: "cap+": 14494, 2024-05-08T05:34:03.966 INFO:teuthology.orchestra.run.smithi090.stdout: "cap-": 14493, 2024-05-08T05:34:03.966 INFO:teuthology.orchestra.run.smithi090.stdout: "rss": 134936, 2024-05-08T05:34:03.966 INFO:teuthology.orchestra.run.smithi090.stdout: "heap": 231800 2024-05-08T05:34:03.966 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-05-08T05:34:03.966 INFO:teuthology.orchestra.run.smithi090.stdout: "mds_server": { 2024-05-08T05:34:03.966 INFO:teuthology.orchestra.run.smithi090.stdout: "dispatch_client_request": 19468, 2024-05-08T05:34:03.966 INFO:teuthology.orchestra.run.smithi090.stdout: "dispatch_server_request": 78, 2024-05-08T05:34:03.966 INFO:teuthology.orchestra.run.smithi090.stdout: "handle_client_request": 17701, 2024-05-08T05:34:03.967 INFO:teuthology.orchestra.run.smithi090.stdout: "handle_client_session": 277, 2024-05-08T05:34:03.967 INFO:teuthology.orchestra.run.smithi090.stdout: "handle_peer_request": 400, 2024-05-08T05:34:03.967 INFO:teuthology.orchestra.run.smithi090.stdout: "req_create_latency": { 2024-05-08T05:34:03.967 INFO:teuthology.orchestra.run.smithi090.stdout: "avgcount": 11484, 2024-05-08T05:34:03.967 INFO:teuthology.orchestra.run.smithi090.stdout: "sum": 17.677452507, 2024-05-08T05:34:03.967 INFO:teuthology.orchestra.run.smithi090.stdout: "avgtime": 0.001539311 2024-05-08T05:34:03.967 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-05-08T05:34:03.967 INFO:teuthology.orchestra.run.smithi090.stdout: "req_getattr_latency": { 2024-05-08T05:34:03.967 INFO:teuthology.orchestra.run.smithi090.stdout: "avgcount": 68, 2024-05-08T05:34:03.967 INFO:teuthology.orchestra.run.smithi090.stdout: "sum": 0.110744354, 2024-05-08T05:34:03.967 INFO:teuthology.orchestra.run.smithi090.stdout: "avgtime": 0.001628593 2024-05-08T05:34:03.967 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-05-08T05:34:03.967 INFO:teuthology.orchestra.run.smithi090.stdout: "req_getfilelock_latency": { 2024-05-08T05:34:03.967 INFO:teuthology.orchestra.run.smithi090.stdout: "avgcount": 0, 2024-05-08T05:34:03.968 INFO:teuthology.orchestra.run.smithi090.stdout: "sum": 0.000000000, 2024-05-08T05:34:03.968 INFO:teuthology.orchestra.run.smithi090.stdout: "avgtime": 0.000000000 2024-05-08T05:34:03.968 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-05-08T05:34:03.968 INFO:teuthology.orchestra.run.smithi090.stdout: "req_link_latency": { 2024-05-08T05:34:03.968 INFO:teuthology.orchestra.run.smithi090.stdout: "avgcount": 244, 2024-05-08T05:34:03.968 INFO:teuthology.orchestra.run.smithi090.stdout: "sum": 1.727418211, 2024-05-08T05:34:03.968 INFO:teuthology.orchestra.run.smithi090.stdout: "avgtime": 0.007079582 2024-05-08T05:34:03.968 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-05-08T05:34:03.968 INFO:teuthology.orchestra.run.smithi090.stdout: "req_lookup_latency": { 2024-05-08T05:34:03.968 INFO:teuthology.orchestra.run.smithi090.stdout: "avgcount": 508, 2024-05-08T05:34:03.968 INFO:teuthology.orchestra.run.smithi090.stdout: "sum": 0.939667882, 2024-05-08T05:34:03.968 INFO:teuthology.orchestra.run.smithi090.stdout: "avgtime": 0.001849739 2024-05-08T05:34:03.968 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-05-08T05:34:03.968 INFO:teuthology.orchestra.run.smithi090.stdout: "req_lookuphash_latency": { 2024-05-08T05:34:03.969 INFO:teuthology.orchestra.run.smithi090.stdout: "avgcount": 0, 2024-05-08T05:34:03.969 INFO:teuthology.orchestra.run.smithi090.stdout: "sum": 0.000000000, 2024-05-08T05:34:03.969 INFO:teuthology.orchestra.run.smithi090.stdout: "avgtime": 0.000000000 2024-05-08T05:34:03.969 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-05-08T05:34:03.969 INFO:teuthology.orchestra.run.smithi090.stdout: "req_lookupino_latency": { 2024-05-08T05:34:03.969 INFO:teuthology.orchestra.run.smithi090.stdout: "avgcount": 0, 2024-05-08T05:34:03.969 INFO:teuthology.orchestra.run.smithi090.stdout: "sum": 0.000000000, 2024-05-08T05:34:03.969 INFO:teuthology.orchestra.run.smithi090.stdout: "avgtime": 0.000000000 2024-05-08T05:34:03.969 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-05-08T05:34:03.969 INFO:teuthology.orchestra.run.smithi090.stdout: "req_lookupname_latency": { 2024-05-08T05:34:03.969 INFO:teuthology.orchestra.run.smithi090.stdout: "avgcount": 0, 2024-05-08T05:34:03.969 INFO:teuthology.orchestra.run.smithi090.stdout: "sum": 0.000000000, 2024-05-08T05:34:03.969 INFO:teuthology.orchestra.run.smithi090.stdout: "avgtime": 0.000000000 2024-05-08T05:34:03.969 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-05-08T05:34:03.970 INFO:teuthology.orchestra.run.smithi090.stdout: "req_lookupparent_latency": { 2024-05-08T05:34:03.970 INFO:teuthology.orchestra.run.smithi090.stdout: "avgcount": 0, 2024-05-08T05:34:03.970 INFO:teuthology.orchestra.run.smithi090.stdout: "sum": 0.000000000, 2024-05-08T05:34:03.970 INFO:teuthology.orchestra.run.smithi090.stdout: "avgtime": 0.000000000 2024-05-08T05:34:03.970 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-05-08T05:34:03.970 INFO:teuthology.orchestra.run.smithi090.stdout: "req_lookupsnap_latency": { 2024-05-08T05:34:03.970 INFO:teuthology.orchestra.run.smithi090.stdout: "avgcount": 0, 2024-05-08T05:34:03.970 INFO:teuthology.orchestra.run.smithi090.stdout: "sum": 0.000000000, 2024-05-08T05:34:03.970 INFO:teuthology.orchestra.run.smithi090.stdout: "avgtime": 0.000000000 2024-05-08T05:34:03.971 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-05-08T05:34:03.971 INFO:teuthology.orchestra.run.smithi090.stdout: "req_lssnap_latency": { 2024-05-08T05:34:03.971 INFO:teuthology.orchestra.run.smithi090.stdout: "avgcount": 0, 2024-05-08T05:34:03.971 INFO:teuthology.orchestra.run.smithi090.stdout: "sum": 0.000000000, 2024-05-08T05:34:03.971 INFO:teuthology.orchestra.run.smithi090.stdout: "avgtime": 0.000000000 2024-05-08T05:34:03.971 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-05-08T05:34:03.971 INFO:teuthology.orchestra.run.smithi090.stdout: "req_mkdir_latency": { 2024-05-08T05:34:03.971 INFO:teuthology.orchestra.run.smithi090.stdout: "avgcount": 1791, 2024-05-08T05:34:03.971 INFO:teuthology.orchestra.run.smithi090.stdout: "sum": 8.478192982, 2024-05-08T05:34:03.971 INFO:teuthology.orchestra.run.smithi090.stdout: "avgtime": 0.004733776 2024-05-08T05:34:03.972 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-05-08T05:34:03.972 INFO:teuthology.orchestra.run.smithi090.stdout: "req_mknod_latency": { 2024-05-08T05:34:03.972 INFO:teuthology.orchestra.run.smithi090.stdout: "avgcount": 502, 2024-05-08T05:34:03.972 INFO:teuthology.orchestra.run.smithi090.stdout: "sum": 2.130018928, 2024-05-08T05:34:03.972 INFO:teuthology.orchestra.run.smithi090.stdout: "avgtime": 0.004243065 2024-05-08T05:34:03.972 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-05-08T05:34:03.972 INFO:teuthology.orchestra.run.smithi090.stdout: "req_mksnap_latency": { 2024-05-08T05:34:03.972 INFO:teuthology.orchestra.run.smithi090.stdout: "avgcount": 0, 2024-05-08T05:34:03.972 INFO:teuthology.orchestra.run.smithi090.stdout: "sum": 0.000000000, 2024-05-08T05:34:03.972 INFO:teuthology.orchestra.run.smithi090.stdout: "avgtime": 0.000000000 2024-05-08T05:34:03.972 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-05-08T05:34:03.972 INFO:teuthology.orchestra.run.smithi090.stdout: "req_open_latency": { 2024-05-08T05:34:03.972 INFO:teuthology.orchestra.run.smithi090.stdout: "avgcount": 30, 2024-05-08T05:34:03.972 INFO:teuthology.orchestra.run.smithi090.stdout: "sum": 0.017172012, 2024-05-08T05:34:03.973 INFO:teuthology.orchestra.run.smithi090.stdout: "avgtime": 0.000572400 2024-05-08T05:34:03.973 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-05-08T05:34:03.973 INFO:teuthology.orchestra.run.smithi090.stdout: "req_readdir_latency": { 2024-05-08T05:34:03.973 INFO:teuthology.orchestra.run.smithi090.stdout: "avgcount": 351, 2024-05-08T05:34:03.973 INFO:teuthology.orchestra.run.smithi090.stdout: "sum": 2.159455604, 2024-05-08T05:34:03.973 INFO:teuthology.orchestra.run.smithi090.stdout: "avgtime": 0.006152295 2024-05-08T05:34:03.973 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-05-08T05:34:03.973 INFO:teuthology.orchestra.run.smithi090.stdout: "req_rename_latency": { 2024-05-08T05:34:03.973 INFO:teuthology.orchestra.run.smithi090.stdout: "avgcount": 504, 2024-05-08T05:34:03.973 INFO:teuthology.orchestra.run.smithi090.stdout: "sum": 5.250442379, 2024-05-08T05:34:03.973 INFO:teuthology.orchestra.run.smithi090.stdout: "avgtime": 0.010417544 2024-05-08T05:34:03.973 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-05-08T05:34:03.973 INFO:teuthology.orchestra.run.smithi090.stdout: "req_renamesnap_latency": { 2024-05-08T05:34:03.973 INFO:teuthology.orchestra.run.smithi090.stdout: "avgcount": 0, 2024-05-08T05:34:03.974 INFO:teuthology.orchestra.run.smithi090.stdout: "sum": 0.000000000, 2024-05-08T05:34:03.974 INFO:teuthology.orchestra.run.smithi090.stdout: "avgtime": 0.000000000 2024-05-08T05:34:03.974 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-05-08T05:34:03.974 INFO:teuthology.orchestra.run.smithi090.stdout: "req_snapdiff_latency": { 2024-05-08T05:34:03.974 INFO:teuthology.orchestra.run.smithi090.stdout: "avgcount": 0, 2024-05-08T05:34:03.974 INFO:teuthology.orchestra.run.smithi090.stdout: "sum": 0.000000000, 2024-05-08T05:34:03.974 INFO:teuthology.orchestra.run.smithi090.stdout: "avgtime": 0.000000000 2024-05-08T05:34:03.974 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-05-08T05:34:03.974 INFO:teuthology.orchestra.run.smithi090.stdout: "req_rmdir_latency": { 2024-05-08T05:34:03.974 INFO:teuthology.orchestra.run.smithi090.stdout: "avgcount": 390, 2024-05-08T05:34:03.974 INFO:teuthology.orchestra.run.smithi090.stdout: "sum": 3.887535314, 2024-05-08T05:34:03.974 INFO:teuthology.orchestra.run.smithi090.stdout: "avgtime": 0.009968039 2024-05-08T05:34:03.974 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-05-08T05:34:03.974 INFO:teuthology.orchestra.run.smithi090.stdout: "req_rmsnap_latency": { 2024-05-08T05:34:03.975 INFO:teuthology.orchestra.run.smithi090.stdout: "avgcount": 0, 2024-05-08T05:34:03.975 INFO:teuthology.orchestra.run.smithi090.stdout: "sum": 0.000000000, 2024-05-08T05:34:03.975 INFO:teuthology.orchestra.run.smithi090.stdout: "avgtime": 0.000000000 2024-05-08T05:34:03.975 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-05-08T05:34:03.975 INFO:teuthology.orchestra.run.smithi090.stdout: "req_rmxattr_latency": { 2024-05-08T05:34:03.975 INFO:teuthology.orchestra.run.smithi090.stdout: "avgcount": 0, 2024-05-08T05:34:03.975 INFO:teuthology.orchestra.run.smithi090.stdout: "sum": 0.000000000, 2024-05-08T05:34:03.975 INFO:teuthology.orchestra.run.smithi090.stdout: "avgtime": 0.000000000 2024-05-08T05:34:03.975 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-05-08T05:34:03.975 INFO:teuthology.orchestra.run.smithi090.stdout: "req_setattr_latency": { 2024-05-08T05:34:03.975 INFO:teuthology.orchestra.run.smithi090.stdout: "avgcount": 212, 2024-05-08T05:34:03.975 INFO:teuthology.orchestra.run.smithi090.stdout: "sum": 1.341595246, 2024-05-08T05:34:03.975 INFO:teuthology.orchestra.run.smithi090.stdout: "avgtime": 0.006328279 2024-05-08T05:34:03.975 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-05-08T05:34:03.976 INFO:teuthology.orchestra.run.smithi090.stdout: "req_setdirlayout_latency": { 2024-05-08T05:34:03.976 INFO:teuthology.orchestra.run.smithi090.stdout: "avgcount": 0, 2024-05-08T05:34:03.976 INFO:teuthology.orchestra.run.smithi090.stdout: "sum": 0.000000000, 2024-05-08T05:34:03.976 INFO:teuthology.orchestra.run.smithi090.stdout: "avgtime": 0.000000000 2024-05-08T05:34:03.976 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-05-08T05:34:03.976 INFO:teuthology.orchestra.run.smithi090.stdout: "req_setfilelock_latency": { 2024-05-08T05:34:03.976 INFO:teuthology.orchestra.run.smithi090.stdout: "avgcount": 0, 2024-05-08T05:34:03.976 INFO:teuthology.orchestra.run.smithi090.stdout: "sum": 0.000000000, 2024-05-08T05:34:03.976 INFO:teuthology.orchestra.run.smithi090.stdout: "avgtime": 0.000000000 2024-05-08T05:34:03.976 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-05-08T05:34:03.976 INFO:teuthology.orchestra.run.smithi090.stdout: "req_setlayout_latency": { 2024-05-08T05:34:03.976 INFO:teuthology.orchestra.run.smithi090.stdout: "avgcount": 0, 2024-05-08T05:34:03.976 INFO:teuthology.orchestra.run.smithi090.stdout: "sum": 0.000000000, 2024-05-08T05:34:03.976 INFO:teuthology.orchestra.run.smithi090.stdout: "avgtime": 0.000000000 2024-05-08T05:34:03.976 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-05-08T05:34:03.976 INFO:teuthology.orchestra.run.smithi090.stdout: "req_setxattr_latency": { 2024-05-08T05:34:03.977 INFO:teuthology.orchestra.run.smithi090.stdout: "avgcount": 7, 2024-05-08T05:34:03.977 INFO:teuthology.orchestra.run.smithi090.stdout: "sum": 0.022275033, 2024-05-08T05:34:03.977 INFO:teuthology.orchestra.run.smithi090.stdout: "avgtime": 0.003182147 2024-05-08T05:34:03.977 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-05-08T05:34:03.977 INFO:teuthology.orchestra.run.smithi090.stdout: "req_symlink_latency": { 2024-05-08T05:34:03.977 INFO:teuthology.orchestra.run.smithi090.stdout: "avgcount": 439, 2024-05-08T05:34:03.977 INFO:teuthology.orchestra.run.smithi090.stdout: "sum": 1.995003361, 2024-05-08T05:34:03.977 INFO:teuthology.orchestra.run.smithi090.stdout: "avgtime": 0.004544426 2024-05-08T05:34:03.977 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-05-08T05:34:03.977 INFO:teuthology.orchestra.run.smithi090.stdout: "req_unlink_latency": { 2024-05-08T05:34:03.977 INFO:teuthology.orchestra.run.smithi090.stdout: "avgcount": 1027, 2024-05-08T05:34:03.977 INFO:teuthology.orchestra.run.smithi090.stdout: "sum": 5.229178116, 2024-05-08T05:34:03.977 INFO:teuthology.orchestra.run.smithi090.stdout: "avgtime": 0.005091702 2024-05-08T05:34:03.977 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-05-08T05:34:03.977 INFO:teuthology.orchestra.run.smithi090.stdout: "cap_revoke_eviction": 0, 2024-05-08T05:34:03.978 INFO:teuthology.orchestra.run.smithi090.stdout: "cap_acquisition_throttle": 0, 2024-05-08T05:34:03.978 INFO:teuthology.orchestra.run.smithi090.stdout: "req_getvxattr_latency": { 2024-05-08T05:34:03.978 INFO:teuthology.orchestra.run.smithi090.stdout: "avgcount": 0, 2024-05-08T05:34:03.978 INFO:teuthology.orchestra.run.smithi090.stdout: "sum": 0.000000000, 2024-05-08T05:34:03.978 INFO:teuthology.orchestra.run.smithi090.stdout: "avgtime": 0.000000000 2024-05-08T05:34:03.978 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-05-08T05:34:03.978 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-05-08T05:34:03.978 INFO:teuthology.orchestra.run.smithi090.stdout: "mds_sessions": { 2024-05-08T05:34:03.978 INFO:teuthology.orchestra.run.smithi090.stdout: "session_count": 1, 2024-05-08T05:34:03.978 INFO:teuthology.orchestra.run.smithi090.stdout: "session_add": 2, 2024-05-08T05:34:03.978 INFO:teuthology.orchestra.run.smithi090.stdout: "session_remove": 1, 2024-05-08T05:34:03.978 INFO:teuthology.orchestra.run.smithi090.stdout: "sessions_open": 1, 2024-05-08T05:34:03.978 INFO:teuthology.orchestra.run.smithi090.stdout: "sessions_stale": 0, 2024-05-08T05:34:03.978 INFO:teuthology.orchestra.run.smithi090.stdout: "total_load": 5261, 2024-05-08T05:34:03.978 INFO:teuthology.orchestra.run.smithi090.stdout: "average_load": 5261, 2024-05-08T05:34:03.979 INFO:teuthology.orchestra.run.smithi090.stdout: "avg_session_uptime": 287, 2024-05-08T05:34:03.979 INFO:teuthology.orchestra.run.smithi090.stdout: "mdthresh_evicted": 0 2024-05-08T05:34:03.979 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-05-08T05:34:03.979 INFO:teuthology.orchestra.run.smithi090.stdout: "mempool": { 2024-05-08T05:34:03.979 INFO:teuthology.orchestra.run.smithi090.stdout: "bloom_filter_bytes": 0, 2024-05-08T05:34:03.979 INFO:teuthology.orchestra.run.smithi090.stdout: "bloom_filter_items": 0, 2024-05-08T05:34:03.979 INFO:teuthology.orchestra.run.smithi090.stdout: "bluestore_alloc_bytes": 0, 2024-05-08T05:34:03.979 INFO:teuthology.orchestra.run.smithi090.stdout: "bluestore_alloc_items": 0, 2024-05-08T05:34:03.979 INFO:teuthology.orchestra.run.smithi090.stdout: "bluestore_cache_data_bytes": 0, 2024-05-08T05:34:03.979 INFO:teuthology.orchestra.run.smithi090.stdout: "bluestore_cache_data_items": 0, 2024-05-08T05:34:03.979 INFO:teuthology.orchestra.run.smithi090.stdout: "bluestore_cache_onode_bytes": 0, 2024-05-08T05:34:03.979 INFO:teuthology.orchestra.run.smithi090.stdout: "bluestore_cache_onode_items": 0, 2024-05-08T05:34:03.979 INFO:teuthology.orchestra.run.smithi090.stdout: "bluestore_cache_meta_bytes": 0, 2024-05-08T05:34:03.979 INFO:teuthology.orchestra.run.smithi090.stdout: "bluestore_cache_meta_items": 0, 2024-05-08T05:34:03.980 INFO:teuthology.orchestra.run.smithi090.stdout: "bluestore_cache_other_bytes": 0, 2024-05-08T05:34:03.980 INFO:teuthology.orchestra.run.smithi090.stdout: "bluestore_cache_other_items": 0, 2024-05-08T05:34:03.980 INFO:teuthology.orchestra.run.smithi090.stdout: "bluestore_cache_buffer_bytes": 0, 2024-05-08T05:34:03.980 INFO:teuthology.orchestra.run.smithi090.stdout: "bluestore_cache_buffer_items": 0, 2024-05-08T05:34:03.980 INFO:teuthology.orchestra.run.smithi090.stdout: "bluestore_extent_bytes": 0, 2024-05-08T05:34:03.980 INFO:teuthology.orchestra.run.smithi090.stdout: "bluestore_extent_items": 0, 2024-05-08T05:34:03.980 INFO:teuthology.orchestra.run.smithi090.stdout: "bluestore_blob_bytes": 0, 2024-05-08T05:34:03.980 INFO:teuthology.orchestra.run.smithi090.stdout: "bluestore_blob_items": 0, 2024-05-08T05:34:03.980 INFO:teuthology.orchestra.run.smithi090.stdout: "bluestore_shared_blob_bytes": 0, 2024-05-08T05:34:03.980 INFO:teuthology.orchestra.run.smithi090.stdout: "bluestore_shared_blob_items": 0, 2024-05-08T05:34:03.980 INFO:teuthology.orchestra.run.smithi090.stdout: "bluestore_inline_bl_bytes": 0, 2024-05-08T05:34:03.980 INFO:teuthology.orchestra.run.smithi090.stdout: "bluestore_inline_bl_items": 0, 2024-05-08T05:34:03.980 INFO:teuthology.orchestra.run.smithi090.stdout: "bluestore_fsck_bytes": 0, 2024-05-08T05:34:03.980 INFO:teuthology.orchestra.run.smithi090.stdout: "bluestore_fsck_items": 0, 2024-05-08T05:34:03.980 INFO:teuthology.orchestra.run.smithi090.stdout: "bluestore_txc_bytes": 0, 2024-05-08T05:34:03.981 INFO:teuthology.orchestra.run.smithi090.stdout: "bluestore_txc_items": 0, 2024-05-08T05:34:03.981 INFO:teuthology.orchestra.run.smithi090.stdout: "bluestore_writing_deferred_bytes": 0, 2024-05-08T05:34:03.981 INFO:teuthology.orchestra.run.smithi090.stdout: "bluestore_writing_deferred_items": 0, 2024-05-08T05:34:03.981 INFO:teuthology.orchestra.run.smithi090.stdout: "bluestore_writing_bytes": 0, 2024-05-08T05:34:03.981 INFO:teuthology.orchestra.run.smithi090.stdout: "bluestore_writing_items": 0, 2024-05-08T05:34:03.981 INFO:teuthology.orchestra.run.smithi090.stdout: "bluefs_bytes": 0, 2024-05-08T05:34:03.981 INFO:teuthology.orchestra.run.smithi090.stdout: "bluefs_items": 0, 2024-05-08T05:34:03.981 INFO:teuthology.orchestra.run.smithi090.stdout: "bluefs_file_reader_bytes": 0, 2024-05-08T05:34:03.981 INFO:teuthology.orchestra.run.smithi090.stdout: "bluefs_file_reader_items": 0, 2024-05-08T05:34:03.981 INFO:teuthology.orchestra.run.smithi090.stdout: "bluefs_file_writer_bytes": 0, 2024-05-08T05:34:03.981 INFO:teuthology.orchestra.run.smithi090.stdout: "bluefs_file_writer_items": 0, 2024-05-08T05:34:03.981 INFO:teuthology.orchestra.run.smithi090.stdout: "buffer_anon_bytes": 308063, 2024-05-08T05:34:03.981 INFO:teuthology.orchestra.run.smithi090.stdout: "buffer_anon_items": 164, 2024-05-08T05:34:03.981 INFO:teuthology.orchestra.run.smithi090.stdout: "buffer_meta_bytes": 704, 2024-05-08T05:34:03.981 INFO:teuthology.orchestra.run.smithi090.stdout: "buffer_meta_items": 8, 2024-05-08T05:34:03.982 INFO:teuthology.orchestra.run.smithi090.stdout: "osd_bytes": 0, 2024-05-08T05:34:03.982 INFO:teuthology.orchestra.run.smithi090.stdout: "osd_items": 0, 2024-05-08T05:34:03.982 INFO:teuthology.orchestra.run.smithi090.stdout: "osd_mapbl_bytes": 0, 2024-05-08T05:34:03.982 INFO:teuthology.orchestra.run.smithi090.stdout: "osd_mapbl_items": 0, 2024-05-08T05:34:03.982 INFO:teuthology.orchestra.run.smithi090.stdout: "osd_pglog_bytes": 0, 2024-05-08T05:34:03.982 INFO:teuthology.orchestra.run.smithi090.stdout: "osd_pglog_items": 0, 2024-05-08T05:34:03.982 INFO:teuthology.orchestra.run.smithi090.stdout: "osdmap_bytes": 7440, 2024-05-08T05:34:03.982 INFO:teuthology.orchestra.run.smithi090.stdout: "osdmap_items": 157, 2024-05-08T05:34:03.982 INFO:teuthology.orchestra.run.smithi090.stdout: "osdmap_mapping_bytes": 0, 2024-05-08T05:34:03.982 INFO:teuthology.orchestra.run.smithi090.stdout: "osdmap_mapping_items": 0, 2024-05-08T05:34:03.982 INFO:teuthology.orchestra.run.smithi090.stdout: "pgmap_bytes": 0, 2024-05-08T05:34:03.982 INFO:teuthology.orchestra.run.smithi090.stdout: "pgmap_items": 0, 2024-05-08T05:34:03.982 INFO:teuthology.orchestra.run.smithi090.stdout: "mds_co_bytes": 422565, 2024-05-08T05:34:03.982 INFO:teuthology.orchestra.run.smithi090.stdout: "mds_co_items": 8163, 2024-05-08T05:34:03.982 INFO:teuthology.orchestra.run.smithi090.stdout: "unittest_1_bytes": 0, 2024-05-08T05:34:03.983 INFO:teuthology.orchestra.run.smithi090.stdout: "unittest_1_items": 0, 2024-05-08T05:34:03.983 INFO:teuthology.orchestra.run.smithi090.stdout: "unittest_2_bytes": 0, 2024-05-08T05:34:03.983 INFO:teuthology.orchestra.run.smithi090.stdout: "unittest_2_items": 0 2024-05-08T05:34:03.983 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-05-08T05:34:03.983 INFO:teuthology.orchestra.run.smithi090.stdout: "objecter": { 2024-05-08T05:34:03.983 INFO:teuthology.orchestra.run.smithi090.stdout: "op_active": 0, 2024-05-08T05:34:03.983 INFO:teuthology.orchestra.run.smithi090.stdout: "op_laggy": 0, 2024-05-08T05:34:03.983 INFO:teuthology.orchestra.run.smithi090.stdout: "op_send": 8913, 2024-05-08T05:34:03.983 INFO:teuthology.orchestra.run.smithi090.stdout: "op_send_bytes": 70546938, 2024-05-08T05:34:03.983 INFO:teuthology.orchestra.run.smithi090.stdout: "op_resend": 32, 2024-05-08T05:34:03.983 INFO:teuthology.orchestra.run.smithi090.stdout: "op_reply": 8913, 2024-05-08T05:34:03.983 INFO:teuthology.orchestra.run.smithi090.stdout: "op_latency": { 2024-05-08T05:34:03.983 INFO:teuthology.orchestra.run.smithi090.stdout: "avgcount": 8913, 2024-05-08T05:34:03.983 INFO:teuthology.orchestra.run.smithi090.stdout: "sum": 50.221258682, 2024-05-08T05:34:03.984 INFO:teuthology.orchestra.run.smithi090.stdout: "avgtime": 0.005634607 2024-05-08T05:34:03.984 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-05-08T05:34:03.984 INFO:teuthology.orchestra.run.smithi090.stdout: "op_inflight": 0, 2024-05-08T05:34:03.984 INFO:teuthology.orchestra.run.smithi090.stdout: "oplen_avg": { 2024-05-08T05:34:03.984 INFO:teuthology.orchestra.run.smithi090.stdout: "avgcount": 8913, 2024-05-08T05:34:03.984 INFO:teuthology.orchestra.run.smithi090.stdout: "sum": 9137 2024-05-08T05:34:03.984 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-05-08T05:34:03.984 INFO:teuthology.orchestra.run.smithi090.stdout: "op": 8913, 2024-05-08T05:34:03.984 INFO:teuthology.orchestra.run.smithi090.stdout: "op_r": 4012, 2024-05-08T05:34:03.984 INFO:teuthology.orchestra.run.smithi090.stdout: "op_w": 4901, 2024-05-08T05:34:03.984 INFO:teuthology.orchestra.run.smithi090.stdout: "op_rmw": 0, 2024-05-08T05:34:03.984 INFO:teuthology.orchestra.run.smithi090.stdout: "op_pg": 0, 2024-05-08T05:34:03.984 INFO:teuthology.orchestra.run.smithi090.stdout: "osdop_stat": 0, 2024-05-08T05:34:03.984 INFO:teuthology.orchestra.run.smithi090.stdout: "osdop_create": 11, 2024-05-08T05:34:03.984 INFO:teuthology.orchestra.run.smithi090.stdout: "osdop_read": 74, 2024-05-08T05:34:03.985 INFO:teuthology.orchestra.run.smithi090.stdout: "osdop_write": 2496, 2024-05-08T05:34:03.985 INFO:teuthology.orchestra.run.smithi090.stdout: "osdop_writefull": 64, 2024-05-08T05:34:03.985 INFO:teuthology.orchestra.run.smithi090.stdout: "osdop_writesame": 0, 2024-05-08T05:34:03.985 INFO:teuthology.orchestra.run.smithi090.stdout: "osdop_append": 0, 2024-05-08T05:34:03.985 INFO:teuthology.orchestra.run.smithi090.stdout: "osdop_zero": 0, 2024-05-08T05:34:03.985 INFO:teuthology.orchestra.run.smithi090.stdout: "osdop_truncate": 7, 2024-05-08T05:34:03.985 INFO:teuthology.orchestra.run.smithi090.stdout: "osdop_delete": 1899, 2024-05-08T05:34:03.985 INFO:teuthology.orchestra.run.smithi090.stdout: "osdop_mapext": 0, 2024-05-08T05:34:03.985 INFO:teuthology.orchestra.run.smithi090.stdout: "osdop_sparse_read": 0, 2024-05-08T05:34:03.985 INFO:teuthology.orchestra.run.smithi090.stdout: "osdop_clonerange": 0, 2024-05-08T05:34:03.985 INFO:teuthology.orchestra.run.smithi090.stdout: "osdop_getxattr": 3938, 2024-05-08T05:34:03.985 INFO:teuthology.orchestra.run.smithi090.stdout: "osdop_setxattr": 22, 2024-05-08T05:34:03.985 INFO:teuthology.orchestra.run.smithi090.stdout: "osdop_cmpxattr": 0, 2024-05-08T05:34:03.985 INFO:teuthology.orchestra.run.smithi090.stdout: "osdop_rmxattr": 0, 2024-05-08T05:34:03.986 INFO:teuthology.orchestra.run.smithi090.stdout: "osdop_resetxattrs": 0, 2024-05-08T05:34:03.986 INFO:teuthology.orchestra.run.smithi090.stdout: "osdop_call": 0, 2024-05-08T05:34:03.986 INFO:teuthology.orchestra.run.smithi090.stdout: "osdop_watch": 0, 2024-05-08T05:34:03.986 INFO:teuthology.orchestra.run.smithi090.stdout: "osdop_notify": 0, 2024-05-08T05:34:03.986 INFO:teuthology.orchestra.run.smithi090.stdout: "osdop_src_cmpxattr": 0, 2024-05-08T05:34:03.986 INFO:teuthology.orchestra.run.smithi090.stdout: "osdop_pgls": 0, 2024-05-08T05:34:03.986 INFO:teuthology.orchestra.run.smithi090.stdout: "osdop_pgls_filter": 0, 2024-05-08T05:34:03.986 INFO:teuthology.orchestra.run.smithi090.stdout: "osdop_other": 254, 2024-05-08T05:34:03.986 INFO:teuthology.orchestra.run.smithi090.stdout: "linger_active": 0, 2024-05-08T05:34:03.986 INFO:teuthology.orchestra.run.smithi090.stdout: "linger_send": 0, 2024-05-08T05:34:03.986 INFO:teuthology.orchestra.run.smithi090.stdout: "linger_resend": 0, 2024-05-08T05:34:03.986 INFO:teuthology.orchestra.run.smithi090.stdout: "linger_ping": 0, 2024-05-08T05:34:03.986 INFO:teuthology.orchestra.run.smithi090.stdout: "poolop_active": 0, 2024-05-08T05:34:03.986 INFO:teuthology.orchestra.run.smithi090.stdout: "poolop_send": 0, 2024-05-08T05:34:03.986 INFO:teuthology.orchestra.run.smithi090.stdout: "poolop_resend": 0, 2024-05-08T05:34:03.987 INFO:teuthology.orchestra.run.smithi090.stdout: "poolstat_active": 0, 2024-05-08T05:34:03.987 INFO:teuthology.orchestra.run.smithi090.stdout: "poolstat_send": 0, 2024-05-08T05:34:03.987 INFO:teuthology.orchestra.run.smithi090.stdout: "poolstat_resend": 0, 2024-05-08T05:34:03.987 INFO:teuthology.orchestra.run.smithi090.stdout: "statfs_active": 0, 2024-05-08T05:34:03.987 INFO:teuthology.orchestra.run.smithi090.stdout: "statfs_send": 0, 2024-05-08T05:34:03.987 INFO:teuthology.orchestra.run.smithi090.stdout: "statfs_resend": 0, 2024-05-08T05:34:03.987 INFO:teuthology.orchestra.run.smithi090.stdout: "command_active": 0, 2024-05-08T05:34:03.987 INFO:teuthology.orchestra.run.smithi090.stdout: "command_send": 0, 2024-05-08T05:34:03.987 INFO:teuthology.orchestra.run.smithi090.stdout: "command_resend": 0, 2024-05-08T05:34:03.987 INFO:teuthology.orchestra.run.smithi090.stdout: "map_epoch": 82, 2024-05-08T05:34:03.987 INFO:teuthology.orchestra.run.smithi090.stdout: "map_full": 0, 2024-05-08T05:34:03.987 INFO:teuthology.orchestra.run.smithi090.stdout: "map_inc": 2, 2024-05-08T05:34:03.987 INFO:teuthology.orchestra.run.smithi090.stdout: "osd_sessions": 12, 2024-05-08T05:34:03.987 INFO:teuthology.orchestra.run.smithi090.stdout: "osd_session_open": 12, 2024-05-08T05:34:03.987 INFO:teuthology.orchestra.run.smithi090.stdout: "osd_session_close": 0, 2024-05-08T05:34:03.988 INFO:teuthology.orchestra.run.smithi090.stdout: "osd_laggy": 0, 2024-05-08T05:34:03.988 INFO:teuthology.orchestra.run.smithi090.stdout: "omap_wr": 311, 2024-05-08T05:34:03.988 INFO:teuthology.orchestra.run.smithi090.stdout: "omap_rd": 0, 2024-05-08T05:34:03.988 INFO:teuthology.orchestra.run.smithi090.stdout: "omap_del": 61 2024-05-08T05:34:03.988 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-05-08T05:34:03.988 INFO:teuthology.orchestra.run.smithi090.stdout: "oft": { 2024-05-08T05:34:03.988 INFO:teuthology.orchestra.run.smithi090.stdout: "omap_total_objs": 1, 2024-05-08T05:34:03.988 INFO:teuthology.orchestra.run.smithi090.stdout: "omap_total_kv_pairs": 0, 2024-05-08T05:34:03.988 INFO:teuthology.orchestra.run.smithi090.stdout: "omap_total_updates": 0, 2024-05-08T05:34:03.988 INFO:teuthology.orchestra.run.smithi090.stdout: "omap_total_removes": 0 2024-05-08T05:34:03.988 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-05-08T05:34:03.988 INFO:teuthology.orchestra.run.smithi090.stdout: "osd-slow-ops": { 2024-05-08T05:34:03.988 INFO:teuthology.orchestra.run.smithi090.stdout: "slow_ops_count": 0 2024-05-08T05:34:03.988 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-05-08T05:34:03.989 INFO:teuthology.orchestra.run.smithi090.stdout: "purge_queue": { 2024-05-08T05:34:03.989 INFO:teuthology.orchestra.run.smithi090.stdout: "pq_executing_ops": 0, 2024-05-08T05:34:03.989 INFO:teuthology.orchestra.run.smithi090.stdout: "pq_executing_ops_high_water": 14, 2024-05-08T05:34:03.989 INFO:teuthology.orchestra.run.smithi090.stdout: "pq_executing": 0, 2024-05-08T05:34:03.989 INFO:teuthology.orchestra.run.smithi090.stdout: "pq_executing_high_water": 10, 2024-05-08T05:34:03.989 INFO:teuthology.orchestra.run.smithi090.stdout: "pq_executed_ops": 1371, 2024-05-08T05:34:03.989 INFO:teuthology.orchestra.run.smithi090.stdout: "pq_executed": 1078, 2024-05-08T05:34:03.989 INFO:teuthology.orchestra.run.smithi090.stdout: "pq_item_in_journal": 0 2024-05-08T05:34:03.989 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-05-08T05:34:03.989 INFO:teuthology.orchestra.run.smithi090.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-05-08T05:34:03.989 INFO:teuthology.orchestra.run.smithi090.stdout: "val": 0, 2024-05-08T05:34:03.989 INFO:teuthology.orchestra.run.smithi090.stdout: "max": 104857600, 2024-05-08T05:34:03.989 INFO:teuthology.orchestra.run.smithi090.stdout: "get_started": 0, 2024-05-08T05:34:03.989 INFO:teuthology.orchestra.run.smithi090.stdout: "get": 82556, 2024-05-08T05:34:03.989 INFO:teuthology.orchestra.run.smithi090.stdout: "get_sum": 24059519, 2024-05-08T05:34:03.990 INFO:teuthology.orchestra.run.smithi090.stdout: "get_or_fail_fail": 0, 2024-05-08T05:34:03.990 INFO:teuthology.orchestra.run.smithi090.stdout: "get_or_fail_success": 82556, 2024-05-08T05:34:03.990 INFO:teuthology.orchestra.run.smithi090.stdout: "take": 0, 2024-05-08T05:34:03.990 INFO:teuthology.orchestra.run.smithi090.stdout: "take_sum": 0, 2024-05-08T05:34:03.990 INFO:teuthology.orchestra.run.smithi090.stdout: "put": 82556, 2024-05-08T05:34:03.990 INFO:teuthology.orchestra.run.smithi090.stdout: "put_sum": 24059519, 2024-05-08T05:34:03.990 INFO:teuthology.orchestra.run.smithi090.stdout: "wait": { 2024-05-08T05:34:03.990 INFO:teuthology.orchestra.run.smithi090.stdout: "avgcount": 0, 2024-05-08T05:34:03.990 INFO:teuthology.orchestra.run.smithi090.stdout: "sum": 0.000000000, 2024-05-08T05:34:03.990 INFO:teuthology.orchestra.run.smithi090.stdout: "avgtime": 0.000000000 2024-05-08T05:34:03.990 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-05-08T05:34:03.990 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-05-08T05:34:03.990 INFO:teuthology.orchestra.run.smithi090.stdout: "throttle-objecter_bytes": { 2024-05-08T05:34:03.990 INFO:teuthology.orchestra.run.smithi090.stdout: "val": 0, 2024-05-08T05:34:03.990 INFO:teuthology.orchestra.run.smithi090.stdout: "max": 104857600, 2024-05-08T05:34:03.991 INFO:teuthology.orchestra.run.smithi090.stdout: "get_started": 0, 2024-05-08T05:34:03.991 INFO:teuthology.orchestra.run.smithi090.stdout: "get": 0, 2024-05-08T05:34:03.991 INFO:teuthology.orchestra.run.smithi090.stdout: "get_sum": 0, 2024-05-08T05:34:03.991 INFO:teuthology.orchestra.run.smithi090.stdout: "get_or_fail_fail": 0, 2024-05-08T05:34:03.991 INFO:teuthology.orchestra.run.smithi090.stdout: "get_or_fail_success": 0, 2024-05-08T05:34:03.991 INFO:teuthology.orchestra.run.smithi090.stdout: "take": 8913, 2024-05-08T05:34:03.991 INFO:teuthology.orchestra.run.smithi090.stdout: "take_sum": 70655816, 2024-05-08T05:34:03.991 INFO:teuthology.orchestra.run.smithi090.stdout: "put": 8913, 2024-05-08T05:34:03.992 INFO:teuthology.orchestra.run.smithi090.stdout: "put_sum": 70655816, 2024-05-08T05:34:03.992 INFO:teuthology.orchestra.run.smithi090.stdout: "wait": { 2024-05-08T05:34:03.992 INFO:teuthology.orchestra.run.smithi090.stdout: "avgcount": 0, 2024-05-08T05:34:03.992 INFO:teuthology.orchestra.run.smithi090.stdout: "sum": 0.000000000, 2024-05-08T05:34:03.992 INFO:teuthology.orchestra.run.smithi090.stdout: "avgtime": 0.000000000 2024-05-08T05:34:03.992 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-05-08T05:34:03.992 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-05-08T05:34:03.992 INFO:teuthology.orchestra.run.smithi090.stdout: "throttle-objecter_ops": { 2024-05-08T05:34:03.992 INFO:teuthology.orchestra.run.smithi090.stdout: "val": 0, 2024-05-08T05:34:03.992 INFO:teuthology.orchestra.run.smithi090.stdout: "max": 1024, 2024-05-08T05:34:03.992 INFO:teuthology.orchestra.run.smithi090.stdout: "get_started": 0, 2024-05-08T05:34:03.992 INFO:teuthology.orchestra.run.smithi090.stdout: "get": 0, 2024-05-08T05:34:03.993 INFO:teuthology.orchestra.run.smithi090.stdout: "get_sum": 0, 2024-05-08T05:34:03.993 INFO:teuthology.orchestra.run.smithi090.stdout: "get_or_fail_fail": 0, 2024-05-08T05:34:03.993 INFO:teuthology.orchestra.run.smithi090.stdout: "get_or_fail_success": 0, 2024-05-08T05:34:03.993 INFO:teuthology.orchestra.run.smithi090.stdout: "take": 8913, 2024-05-08T05:34:03.993 INFO:teuthology.orchestra.run.smithi090.stdout: "take_sum": 8913, 2024-05-08T05:34:03.993 INFO:teuthology.orchestra.run.smithi090.stdout: "put": 8913, 2024-05-08T05:34:03.993 INFO:teuthology.orchestra.run.smithi090.stdout: "put_sum": 8913, 2024-05-08T05:34:03.993 INFO:teuthology.orchestra.run.smithi090.stdout: "wait": { 2024-05-08T05:34:03.993 INFO:teuthology.orchestra.run.smithi090.stdout: "avgcount": 0, 2024-05-08T05:34:03.993 INFO:teuthology.orchestra.run.smithi090.stdout: "sum": 0.000000000, 2024-05-08T05:34:03.993 INFO:teuthology.orchestra.run.smithi090.stdout: "avgtime": 0.000000000 2024-05-08T05:34:03.993 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-05-08T05:34:03.993 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-05-08T05:34:03.993 INFO:teuthology.orchestra.run.smithi090.stdout: "throttle-write_buf_throttle": { 2024-05-08T05:34:03.993 INFO:teuthology.orchestra.run.smithi090.stdout: "val": 0, 2024-05-08T05:34:03.994 INFO:teuthology.orchestra.run.smithi090.stdout: "max": 3758096384, 2024-05-08T05:34:03.994 INFO:teuthology.orchestra.run.smithi090.stdout: "get_started": 0, 2024-05-08T05:34:03.994 INFO:teuthology.orchestra.run.smithi090.stdout: "get": 1078, 2024-05-08T05:34:03.994 INFO:teuthology.orchestra.run.smithi090.stdout: "get_sum": 108878, 2024-05-08T05:34:03.994 INFO:teuthology.orchestra.run.smithi090.stdout: "get_or_fail_fail": 0, 2024-05-08T05:34:03.994 INFO:teuthology.orchestra.run.smithi090.stdout: "get_or_fail_success": 1078, 2024-05-08T05:34:03.994 INFO:teuthology.orchestra.run.smithi090.stdout: "take": 0, 2024-05-08T05:34:03.994 INFO:teuthology.orchestra.run.smithi090.stdout: "take_sum": 0, 2024-05-08T05:34:03.994 INFO:teuthology.orchestra.run.smithi090.stdout: "put": 68, 2024-05-08T05:34:03.994 INFO:teuthology.orchestra.run.smithi090.stdout: "put_sum": 108878, 2024-05-08T05:34:03.994 INFO:teuthology.orchestra.run.smithi090.stdout: "wait": { 2024-05-08T05:34:03.994 INFO:teuthology.orchestra.run.smithi090.stdout: "avgcount": 0, 2024-05-08T05:34:03.994 INFO:teuthology.orchestra.run.smithi090.stdout: "sum": 0.000000000, 2024-05-08T05:34:03.994 INFO:teuthology.orchestra.run.smithi090.stdout: "avgtime": 0.000000000 2024-05-08T05:34:03.995 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-05-08T05:34:03.995 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-05-08T05:34:03.995 INFO:teuthology.orchestra.run.smithi090.stdout: "throttle-write_buf_throttle-0x55bb80e18500": { 2024-05-08T05:34:03.995 INFO:teuthology.orchestra.run.smithi090.stdout: "val": 0, 2024-05-08T05:34:03.995 INFO:teuthology.orchestra.run.smithi090.stdout: "max": 3758096384, 2024-05-08T05:34:03.995 INFO:teuthology.orchestra.run.smithi090.stdout: "get_started": 0, 2024-05-08T05:34:03.995 INFO:teuthology.orchestra.run.smithi090.stdout: "get": 30387, 2024-05-08T05:34:03.995 INFO:teuthology.orchestra.run.smithi090.stdout: "get_sum": 67901663, 2024-05-08T05:34:03.995 INFO:teuthology.orchestra.run.smithi090.stdout: "get_or_fail_fail": 0, 2024-05-08T05:34:03.995 INFO:teuthology.orchestra.run.smithi090.stdout: "get_or_fail_success": 30387, 2024-05-08T05:34:03.997 INFO:teuthology.orchestra.run.smithi090.stdout: "take": 0, 2024-05-08T05:34:03.997 INFO:teuthology.orchestra.run.smithi090.stdout: "take_sum": 0, 2024-05-08T05:34:03.997 INFO:teuthology.orchestra.run.smithi090.stdout: "put": 2428, 2024-05-08T05:34:03.997 INFO:teuthology.orchestra.run.smithi090.stdout: "put_sum": 67901663, 2024-05-08T05:34:03.997 INFO:teuthology.orchestra.run.smithi090.stdout: "wait": { 2024-05-08T05:34:03.997 INFO:teuthology.orchestra.run.smithi090.stdout: "avgcount": 0, 2024-05-08T05:34:03.997 INFO:teuthology.orchestra.run.smithi090.stdout: "sum": 0.000000000, 2024-05-08T05:34:03.997 INFO:teuthology.orchestra.run.smithi090.stdout: "avgtime": 0.000000000 2024-05-08T05:34:03.997 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-05-08T05:34:03.997 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-05-08T05:34:03.998 INFO:teuthology.orchestra.run.smithi090.stdout:} 2024-05-08T05:34:04.958 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:34:04 smithi087 ceph-mon[29523]: pgmap v572: 97 pgs: 97 active+clean; 153 MiB data, 1004 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 7 op/s 2024-05-08T05:34:04.966 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:34:04 smithi090 ceph-mon[34526]: pgmap v572: 97 pgs: 97 active+clean; 153 MiB data, 1004 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 7 op/s 2024-05-08T05:34:04.999 INFO:tasks.check_counter:Daemon mds.b mds.exported=32 2024-05-08T05:34:05.000 INFO:tasks.check_counter:Daemon mds.b mds.imported=12 2024-05-08T05:34:05.000 INFO:tasks.check_counter:Daemon mds.b mds_cache.dir_update=435 2024-05-08T05:34:05.000 INFO:tasks.check_counter:Daemon mds.b mds_cache.dir_update_receipt=4678 2024-05-08T05:34:05.000 DEBUG:tasks.check_counter:Getting stats from e 2024-05-08T05:34:05.000 DEBUG:teuthology.orchestra.run.smithi090:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid eeeb813e-0cf9-11ef-bc97-c7b262605968 -- ceph daemon mds.e perf dump 2024-05-08T05:34:05.038 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:34:04 smithi160 ceph-mon[34827]: pgmap v572: 97 pgs: 97 active+clean; 153 MiB data, 1004 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 7 op/s 2024-05-08T05:34:05.244 INFO:teuthology.orchestra.run.smithi090.stderr:Inferring config /var/lib/ceph/eeeb813e-0cf9-11ef-bc97-c7b262605968/mon.b/config 2024-05-08T05:34:06.708 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:34:06 smithi087 ceph-mon[29523]: pgmap v573: 97 pgs: 97 active+clean; 153 MiB data, 1004 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 7 op/s 2024-05-08T05:34:06.840 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:34:06 smithi160 ceph-mon[34827]: pgmap v573: 97 pgs: 97 active+clean; 153 MiB data, 1004 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 7 op/s 2024-05-08T05:34:06.888 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:34:06 smithi090 ceph-mon[34526]: pgmap v573: 97 pgs: 97 active+clean; 153 MiB data, 1004 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 7 op/s 2024-05-08T05:34:06.923 INFO:teuthology.orchestra.run.smithi090.stdout:{ 2024-05-08T05:34:06.923 INFO:teuthology.orchestra.run.smithi090.stdout: "AsyncMessenger::Worker-0": { 2024-05-08T05:34:06.923 INFO:teuthology.orchestra.run.smithi090.stdout: "msgr_recv_messages": 0, 2024-05-08T05:34:06.923 INFO:teuthology.orchestra.run.smithi090.stdout: "msgr_send_messages": 2, 2024-05-08T05:34:06.923 INFO:teuthology.orchestra.run.smithi090.stdout: "msgr_recv_bytes": 0, 2024-05-08T05:34:06.923 INFO:teuthology.orchestra.run.smithi090.stdout: "msgr_send_bytes": 0, 2024-05-08T05:34:06.923 INFO:teuthology.orchestra.run.smithi090.stdout: "msgr_created_connections": 4, 2024-05-08T05:34:06.924 INFO:teuthology.orchestra.run.smithi090.stdout: "msgr_active_connections": 0, 2024-05-08T05:34:06.924 INFO:teuthology.orchestra.run.smithi090.stdout: "msgr_running_total_time": 0.000997823, 2024-05-08T05:34:06.924 INFO:teuthology.orchestra.run.smithi090.stdout: "msgr_running_send_time": 0.000000000, 2024-05-08T05:34:06.924 INFO:teuthology.orchestra.run.smithi090.stdout: "msgr_running_recv_time": 0.000167331, 2024-05-08T05:34:06.924 INFO:teuthology.orchestra.run.smithi090.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-05-08T05:34:06.924 INFO:teuthology.orchestra.run.smithi090.stdout: "msgr_send_messages_queue_lat": { 2024-05-08T05:34:06.924 INFO:teuthology.orchestra.run.smithi090.stdout: "avgcount": 0, 2024-05-08T05:34:06.924 INFO:teuthology.orchestra.run.smithi090.stdout: "sum": 0.000000000, 2024-05-08T05:34:06.924 INFO:teuthology.orchestra.run.smithi090.stdout: "avgtime": 0.000000000 2024-05-08T05:34:06.924 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-05-08T05:34:06.924 INFO:teuthology.orchestra.run.smithi090.stdout: "msgr_handle_ack_lat": { 2024-05-08T05:34:06.924 INFO:teuthology.orchestra.run.smithi090.stdout: "avgcount": 0, 2024-05-08T05:34:06.924 INFO:teuthology.orchestra.run.smithi090.stdout: "sum": 0.000000000, 2024-05-08T05:34:06.924 INFO:teuthology.orchestra.run.smithi090.stdout: "avgtime": 0.000000000 2024-05-08T05:34:06.924 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-05-08T05:34:06.925 INFO:teuthology.orchestra.run.smithi090.stdout: "msgr_recv_encrypted_bytes": 0, 2024-05-08T05:34:06.925 INFO:teuthology.orchestra.run.smithi090.stdout: "msgr_send_encrypted_bytes": 0 2024-05-08T05:34:06.925 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-05-08T05:34:06.925 INFO:teuthology.orchestra.run.smithi090.stdout: "AsyncMessenger::Worker-1": { 2024-05-08T05:34:06.925 INFO:teuthology.orchestra.run.smithi090.stdout: "msgr_recv_messages": 6, 2024-05-08T05:34:06.925 INFO:teuthology.orchestra.run.smithi090.stdout: "msgr_send_messages": 118, 2024-05-08T05:34:06.925 INFO:teuthology.orchestra.run.smithi090.stdout: "msgr_recv_bytes": 3312, 2024-05-08T05:34:06.925 INFO:teuthology.orchestra.run.smithi090.stdout: "msgr_send_bytes": 178304, 2024-05-08T05:34:06.925 INFO:teuthology.orchestra.run.smithi090.stdout: "msgr_created_connections": 4, 2024-05-08T05:34:06.925 INFO:teuthology.orchestra.run.smithi090.stdout: "msgr_active_connections": 2, 2024-05-08T05:34:06.925 INFO:teuthology.orchestra.run.smithi090.stdout: "msgr_running_total_time": 0.007960024, 2024-05-08T05:34:06.925 INFO:teuthology.orchestra.run.smithi090.stdout: "msgr_running_send_time": 0.005366817, 2024-05-08T05:34:06.925 INFO:teuthology.orchestra.run.smithi090.stdout: "msgr_running_recv_time": 0.001226192, 2024-05-08T05:34:06.926 INFO:teuthology.orchestra.run.smithi090.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-05-08T05:34:06.926 INFO:teuthology.orchestra.run.smithi090.stdout: "msgr_send_messages_queue_lat": { 2024-05-08T05:34:06.926 INFO:teuthology.orchestra.run.smithi090.stdout: "avgcount": 117, 2024-05-08T05:34:06.926 INFO:teuthology.orchestra.run.smithi090.stdout: "sum": 0.009467602, 2024-05-08T05:34:06.926 INFO:teuthology.orchestra.run.smithi090.stdout: "avgtime": 0.000080919 2024-05-08T05:34:06.926 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-05-08T05:34:06.926 INFO:teuthology.orchestra.run.smithi090.stdout: "msgr_handle_ack_lat": { 2024-05-08T05:34:06.926 INFO:teuthology.orchestra.run.smithi090.stdout: "avgcount": 0, 2024-05-08T05:34:06.926 INFO:teuthology.orchestra.run.smithi090.stdout: "sum": 0.000000000, 2024-05-08T05:34:06.926 INFO:teuthology.orchestra.run.smithi090.stdout: "avgtime": 0.000000000 2024-05-08T05:34:06.926 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-05-08T05:34:06.926 INFO:teuthology.orchestra.run.smithi090.stdout: "msgr_recv_encrypted_bytes": 3312, 2024-05-08T05:34:06.926 INFO:teuthology.orchestra.run.smithi090.stdout: "msgr_send_encrypted_bytes": 178304 2024-05-08T05:34:06.926 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-05-08T05:34:06.926 INFO:teuthology.orchestra.run.smithi090.stdout: "AsyncMessenger::Worker-2": { 2024-05-08T05:34:06.927 INFO:teuthology.orchestra.run.smithi090.stdout: "msgr_recv_messages": 154, 2024-05-08T05:34:06.927 INFO:teuthology.orchestra.run.smithi090.stdout: "msgr_send_messages": 151, 2024-05-08T05:34:06.927 INFO:teuthology.orchestra.run.smithi090.stdout: "msgr_recv_bytes": 495280, 2024-05-08T05:34:06.927 INFO:teuthology.orchestra.run.smithi090.stdout: "msgr_send_bytes": 92208, 2024-05-08T05:34:06.927 INFO:teuthology.orchestra.run.smithi090.stdout: "msgr_created_connections": 2, 2024-05-08T05:34:06.927 INFO:teuthology.orchestra.run.smithi090.stdout: "msgr_active_connections": 1, 2024-05-08T05:34:06.927 INFO:teuthology.orchestra.run.smithi090.stdout: "msgr_running_total_time": 0.024754218, 2024-05-08T05:34:06.927 INFO:teuthology.orchestra.run.smithi090.stdout: "msgr_running_send_time": 0.009412640, 2024-05-08T05:34:06.927 INFO:teuthology.orchestra.run.smithi090.stdout: "msgr_running_recv_time": 0.013052115, 2024-05-08T05:34:06.927 INFO:teuthology.orchestra.run.smithi090.stdout: "msgr_running_fast_dispatch_time": 0.003430618, 2024-05-08T05:34:06.927 INFO:teuthology.orchestra.run.smithi090.stdout: "msgr_send_messages_queue_lat": { 2024-05-08T05:34:06.927 INFO:teuthology.orchestra.run.smithi090.stdout: "avgcount": 150, 2024-05-08T05:34:06.927 INFO:teuthology.orchestra.run.smithi090.stdout: "sum": 0.006805580, 2024-05-08T05:34:06.927 INFO:teuthology.orchestra.run.smithi090.stdout: "avgtime": 0.000045370 2024-05-08T05:34:06.927 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-05-08T05:34:06.928 INFO:teuthology.orchestra.run.smithi090.stdout: "msgr_handle_ack_lat": { 2024-05-08T05:34:06.928 INFO:teuthology.orchestra.run.smithi090.stdout: "avgcount": 0, 2024-05-08T05:34:06.928 INFO:teuthology.orchestra.run.smithi090.stdout: "sum": 0.000000000, 2024-05-08T05:34:06.928 INFO:teuthology.orchestra.run.smithi090.stdout: "avgtime": 0.000000000 2024-05-08T05:34:06.928 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-05-08T05:34:06.928 INFO:teuthology.orchestra.run.smithi090.stdout: "msgr_recv_encrypted_bytes": 495280, 2024-05-08T05:34:06.928 INFO:teuthology.orchestra.run.smithi090.stdout: "msgr_send_encrypted_bytes": 92208 2024-05-08T05:34:06.928 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-05-08T05:34:06.928 INFO:teuthology.orchestra.run.smithi090.stdout: "cct": { 2024-05-08T05:34:06.928 INFO:teuthology.orchestra.run.smithi090.stdout: "total_workers": 0, 2024-05-08T05:34:06.928 INFO:teuthology.orchestra.run.smithi090.stdout: "unhealthy_workers": 0 2024-05-08T05:34:06.928 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-05-08T05:34:06.928 INFO:teuthology.orchestra.run.smithi090.stdout: "mempool": { 2024-05-08T05:34:06.928 INFO:teuthology.orchestra.run.smithi090.stdout: "bloom_filter_bytes": 0, 2024-05-08T05:34:06.928 INFO:teuthology.orchestra.run.smithi090.stdout: "bloom_filter_items": 0, 2024-05-08T05:34:06.929 INFO:teuthology.orchestra.run.smithi090.stdout: "bluestore_alloc_bytes": 0, 2024-05-08T05:34:06.929 INFO:teuthology.orchestra.run.smithi090.stdout: "bluestore_alloc_items": 0, 2024-05-08T05:34:06.929 INFO:teuthology.orchestra.run.smithi090.stdout: "bluestore_cache_data_bytes": 0, 2024-05-08T05:34:06.929 INFO:teuthology.orchestra.run.smithi090.stdout: "bluestore_cache_data_items": 0, 2024-05-08T05:34:06.929 INFO:teuthology.orchestra.run.smithi090.stdout: "bluestore_cache_onode_bytes": 0, 2024-05-08T05:34:06.929 INFO:teuthology.orchestra.run.smithi090.stdout: "bluestore_cache_onode_items": 0, 2024-05-08T05:34:06.929 INFO:teuthology.orchestra.run.smithi090.stdout: "bluestore_cache_meta_bytes": 0, 2024-05-08T05:34:06.929 INFO:teuthology.orchestra.run.smithi090.stdout: "bluestore_cache_meta_items": 0, 2024-05-08T05:34:06.929 INFO:teuthology.orchestra.run.smithi090.stdout: "bluestore_cache_other_bytes": 0, 2024-05-08T05:34:06.929 INFO:teuthology.orchestra.run.smithi090.stdout: "bluestore_cache_other_items": 0, 2024-05-08T05:34:06.929 INFO:teuthology.orchestra.run.smithi090.stdout: "bluestore_cache_buffer_bytes": 0, 2024-05-08T05:34:06.929 INFO:teuthology.orchestra.run.smithi090.stdout: "bluestore_cache_buffer_items": 0, 2024-05-08T05:34:06.929 INFO:teuthology.orchestra.run.smithi090.stdout: "bluestore_extent_bytes": 0, 2024-05-08T05:34:06.929 INFO:teuthology.orchestra.run.smithi090.stdout: "bluestore_extent_items": 0, 2024-05-08T05:34:06.929 INFO:teuthology.orchestra.run.smithi090.stdout: "bluestore_blob_bytes": 0, 2024-05-08T05:34:06.929 INFO:teuthology.orchestra.run.smithi090.stdout: "bluestore_blob_items": 0, 2024-05-08T05:34:06.930 INFO:teuthology.orchestra.run.smithi090.stdout: "bluestore_shared_blob_bytes": 0, 2024-05-08T05:34:06.930 INFO:teuthology.orchestra.run.smithi090.stdout: "bluestore_shared_blob_items": 0, 2024-05-08T05:34:06.930 INFO:teuthology.orchestra.run.smithi090.stdout: "bluestore_inline_bl_bytes": 0, 2024-05-08T05:34:06.930 INFO:teuthology.orchestra.run.smithi090.stdout: "bluestore_inline_bl_items": 0, 2024-05-08T05:34:06.930 INFO:teuthology.orchestra.run.smithi090.stdout: "bluestore_fsck_bytes": 0, 2024-05-08T05:34:06.930 INFO:teuthology.orchestra.run.smithi090.stdout: "bluestore_fsck_items": 0, 2024-05-08T05:34:06.930 INFO:teuthology.orchestra.run.smithi090.stdout: "bluestore_txc_bytes": 0, 2024-05-08T05:34:06.930 INFO:teuthology.orchestra.run.smithi090.stdout: "bluestore_txc_items": 0, 2024-05-08T05:34:06.930 INFO:teuthology.orchestra.run.smithi090.stdout: "bluestore_writing_deferred_bytes": 0, 2024-05-08T05:34:06.930 INFO:teuthology.orchestra.run.smithi090.stdout: "bluestore_writing_deferred_items": 0, 2024-05-08T05:34:06.930 INFO:teuthology.orchestra.run.smithi090.stdout: "bluestore_writing_bytes": 0, 2024-05-08T05:34:06.930 INFO:teuthology.orchestra.run.smithi090.stdout: "bluestore_writing_items": 0, 2024-05-08T05:34:06.930 INFO:teuthology.orchestra.run.smithi090.stdout: "bluefs_bytes": 0, 2024-05-08T05:34:06.930 INFO:teuthology.orchestra.run.smithi090.stdout: "bluefs_items": 0, 2024-05-08T05:34:06.931 INFO:teuthology.orchestra.run.smithi090.stdout: "bluefs_file_reader_bytes": 0, 2024-05-08T05:34:06.931 INFO:teuthology.orchestra.run.smithi090.stdout: "bluefs_file_reader_items": 0, 2024-05-08T05:34:06.931 INFO:teuthology.orchestra.run.smithi090.stdout: "bluefs_file_writer_bytes": 0, 2024-05-08T05:34:06.931 INFO:teuthology.orchestra.run.smithi090.stdout: "bluefs_file_writer_items": 0, 2024-05-08T05:34:06.931 INFO:teuthology.orchestra.run.smithi090.stdout: "buffer_anon_bytes": 148967, 2024-05-08T05:34:06.931 INFO:teuthology.orchestra.run.smithi090.stdout: "buffer_anon_items": 29, 2024-05-08T05:34:06.931 INFO:teuthology.orchestra.run.smithi090.stdout: "buffer_meta_bytes": 0, 2024-05-08T05:34:06.931 INFO:teuthology.orchestra.run.smithi090.stdout: "buffer_meta_items": 0, 2024-05-08T05:34:06.931 INFO:teuthology.orchestra.run.smithi090.stdout: "osd_bytes": 0, 2024-05-08T05:34:06.931 INFO:teuthology.orchestra.run.smithi090.stdout: "osd_items": 0, 2024-05-08T05:34:06.931 INFO:teuthology.orchestra.run.smithi090.stdout: "osd_mapbl_bytes": 0, 2024-05-08T05:34:06.931 INFO:teuthology.orchestra.run.smithi090.stdout: "osd_mapbl_items": 0, 2024-05-08T05:34:06.931 INFO:teuthology.orchestra.run.smithi090.stdout: "osd_pglog_bytes": 0, 2024-05-08T05:34:06.931 INFO:teuthology.orchestra.run.smithi090.stdout: "osd_pglog_items": 0, 2024-05-08T05:34:06.931 INFO:teuthology.orchestra.run.smithi090.stdout: "osdmap_bytes": 0, 2024-05-08T05:34:06.931 INFO:teuthology.orchestra.run.smithi090.stdout: "osdmap_items": 0, 2024-05-08T05:34:06.932 INFO:teuthology.orchestra.run.smithi090.stdout: "osdmap_mapping_bytes": 0, 2024-05-08T05:34:06.932 INFO:teuthology.orchestra.run.smithi090.stdout: "osdmap_mapping_items": 0, 2024-05-08T05:34:06.932 INFO:teuthology.orchestra.run.smithi090.stdout: "pgmap_bytes": 0, 2024-05-08T05:34:06.932 INFO:teuthology.orchestra.run.smithi090.stdout: "pgmap_items": 0, 2024-05-08T05:34:06.932 INFO:teuthology.orchestra.run.smithi090.stdout: "mds_co_bytes": 928, 2024-05-08T05:34:06.932 INFO:teuthology.orchestra.run.smithi090.stdout: "mds_co_items": 2, 2024-05-08T05:34:06.932 INFO:teuthology.orchestra.run.smithi090.stdout: "unittest_1_bytes": 0, 2024-05-08T05:34:06.932 INFO:teuthology.orchestra.run.smithi090.stdout: "unittest_1_items": 0, 2024-05-08T05:34:06.932 INFO:teuthology.orchestra.run.smithi090.stdout: "unittest_2_bytes": 0, 2024-05-08T05:34:06.932 INFO:teuthology.orchestra.run.smithi090.stdout: "unittest_2_items": 0 2024-05-08T05:34:06.932 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-05-08T05:34:06.932 INFO:teuthology.orchestra.run.smithi090.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-05-08T05:34:06.932 INFO:teuthology.orchestra.run.smithi090.stdout: "val": 0, 2024-05-08T05:34:06.932 INFO:teuthology.orchestra.run.smithi090.stdout: "max": 104857600, 2024-05-08T05:34:06.932 INFO:teuthology.orchestra.run.smithi090.stdout: "get_started": 0, 2024-05-08T05:34:06.933 INFO:teuthology.orchestra.run.smithi090.stdout: "get": 156, 2024-05-08T05:34:06.933 INFO:teuthology.orchestra.run.smithi090.stdout: "get_sum": 473561, 2024-05-08T05:34:06.933 INFO:teuthology.orchestra.run.smithi090.stdout: "get_or_fail_fail": 0, 2024-05-08T05:34:06.933 INFO:teuthology.orchestra.run.smithi090.stdout: "get_or_fail_success": 156, 2024-05-08T05:34:06.933 INFO:teuthology.orchestra.run.smithi090.stdout: "take": 0, 2024-05-08T05:34:06.933 INFO:teuthology.orchestra.run.smithi090.stdout: "take_sum": 0, 2024-05-08T05:34:06.933 INFO:teuthology.orchestra.run.smithi090.stdout: "put": 156, 2024-05-08T05:34:06.933 INFO:teuthology.orchestra.run.smithi090.stdout: "put_sum": 473561, 2024-05-08T05:34:06.933 INFO:teuthology.orchestra.run.smithi090.stdout: "wait": { 2024-05-08T05:34:06.933 INFO:teuthology.orchestra.run.smithi090.stdout: "avgcount": 0, 2024-05-08T05:34:06.933 INFO:teuthology.orchestra.run.smithi090.stdout: "sum": 0.000000000, 2024-05-08T05:34:06.933 INFO:teuthology.orchestra.run.smithi090.stdout: "avgtime": 0.000000000 2024-05-08T05:34:06.933 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-05-08T05:34:06.933 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-05-08T05:34:06.933 INFO:teuthology.orchestra.run.smithi090.stdout:} 2024-05-08T05:34:07.866 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.e 2024-05-08T05:34:07.866 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.e 2024-05-08T05:34:07.866 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update' not found on daemon mds.e 2024-05-08T05:34:07.866 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update_receipt' not found on daemon mds.e 2024-05-08T05:34:07.866 DEBUG:tasks.check_counter:Getting stats from h 2024-05-08T05:34:07.866 DEBUG:teuthology.orchestra.run.smithi090:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid eeeb813e-0cf9-11ef-bc97-c7b262605968 -- ceph daemon mds.h perf dump 2024-05-08T05:34:08.107 INFO:teuthology.orchestra.run.smithi090.stderr:Inferring config /var/lib/ceph/eeeb813e-0cf9-11ef-bc97-c7b262605968/mon.b/config 2024-05-08T05:34:08.958 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:34:08 smithi087 ceph-mon[29523]: pgmap v574: 97 pgs: 97 active+clean; 153 MiB data, 1004 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-05-08T05:34:08.983 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:34:08 smithi090 ceph-mon[34526]: pgmap v574: 97 pgs: 97 active+clean; 153 MiB data, 1004 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-05-08T05:34:09.038 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:34:08 smithi160 ceph-mon[34827]: pgmap v574: 97 pgs: 97 active+clean; 153 MiB data, 1004 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-05-08T05:34:09.826 INFO:teuthology.orchestra.run.smithi090.stdout:{ 2024-05-08T05:34:09.826 INFO:teuthology.orchestra.run.smithi090.stdout: "AsyncMessenger::Worker-0": { 2024-05-08T05:34:09.826 INFO:teuthology.orchestra.run.smithi090.stdout: "msgr_recv_messages": 1317, 2024-05-08T05:34:09.826 INFO:teuthology.orchestra.run.smithi090.stdout: "msgr_send_messages": 1317, 2024-05-08T05:34:09.826 INFO:teuthology.orchestra.run.smithi090.stdout: "msgr_recv_bytes": 25544243, 2024-05-08T05:34:09.826 INFO:teuthology.orchestra.run.smithi090.stdout: "msgr_send_bytes": 417989, 2024-05-08T05:34:09.827 INFO:teuthology.orchestra.run.smithi090.stdout: "msgr_created_connections": 7, 2024-05-08T05:34:09.827 INFO:teuthology.orchestra.run.smithi090.stdout: "msgr_active_connections": 3, 2024-05-08T05:34:09.827 INFO:teuthology.orchestra.run.smithi090.stdout: "msgr_running_total_time": 0.112100055, 2024-05-08T05:34:09.827 INFO:teuthology.orchestra.run.smithi090.stdout: "msgr_running_send_time": 0.031580361, 2024-05-08T05:34:09.827 INFO:teuthology.orchestra.run.smithi090.stdout: "msgr_running_recv_time": 0.038391053, 2024-05-08T05:34:09.827 INFO:teuthology.orchestra.run.smithi090.stdout: "msgr_running_fast_dispatch_time": 0.033540404, 2024-05-08T05:34:09.827 INFO:teuthology.orchestra.run.smithi090.stdout: "msgr_send_messages_queue_lat": { 2024-05-08T05:34:09.827 INFO:teuthology.orchestra.run.smithi090.stdout: "avgcount": 1316, 2024-05-08T05:34:09.827 INFO:teuthology.orchestra.run.smithi090.stdout: "sum": 0.041776096, 2024-05-08T05:34:09.827 INFO:teuthology.orchestra.run.smithi090.stdout: "avgtime": 0.000031744 2024-05-08T05:34:09.827 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-05-08T05:34:09.827 INFO:teuthology.orchestra.run.smithi090.stdout: "msgr_handle_ack_lat": { 2024-05-08T05:34:09.828 INFO:teuthology.orchestra.run.smithi090.stdout: "avgcount": 0, 2024-05-08T05:34:09.828 INFO:teuthology.orchestra.run.smithi090.stdout: "sum": 0.000000000, 2024-05-08T05:34:09.828 INFO:teuthology.orchestra.run.smithi090.stdout: "avgtime": 0.000000000 2024-05-08T05:34:09.828 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-05-08T05:34:09.828 INFO:teuthology.orchestra.run.smithi090.stdout: "msgr_recv_encrypted_bytes": 2992, 2024-05-08T05:34:09.828 INFO:teuthology.orchestra.run.smithi090.stdout: "msgr_send_encrypted_bytes": 448 2024-05-08T05:34:09.828 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-05-08T05:34:09.828 INFO:teuthology.orchestra.run.smithi090.stdout: "AsyncMessenger::Worker-1": { 2024-05-08T05:34:09.828 INFO:teuthology.orchestra.run.smithi090.stdout: "msgr_recv_messages": 135, 2024-05-08T05:34:09.828 INFO:teuthology.orchestra.run.smithi090.stdout: "msgr_send_messages": 247, 2024-05-08T05:34:09.828 INFO:teuthology.orchestra.run.smithi090.stdout: "msgr_recv_bytes": 16794106, 2024-05-08T05:34:09.828 INFO:teuthology.orchestra.run.smithi090.stdout: "msgr_send_bytes": 310370, 2024-05-08T05:34:09.828 INFO:teuthology.orchestra.run.smithi090.stdout: "msgr_created_connections": 6, 2024-05-08T05:34:09.829 INFO:teuthology.orchestra.run.smithi090.stdout: "msgr_active_connections": 5, 2024-05-08T05:34:09.829 INFO:teuthology.orchestra.run.smithi090.stdout: "msgr_running_total_time": 0.020482145, 2024-05-08T05:34:09.829 INFO:teuthology.orchestra.run.smithi090.stdout: "msgr_running_send_time": 0.006944009, 2024-05-08T05:34:09.829 INFO:teuthology.orchestra.run.smithi090.stdout: "msgr_running_recv_time": 0.009097589, 2024-05-08T05:34:09.829 INFO:teuthology.orchestra.run.smithi090.stdout: "msgr_running_fast_dispatch_time": 0.002633050, 2024-05-08T05:34:09.829 INFO:teuthology.orchestra.run.smithi090.stdout: "msgr_send_messages_queue_lat": { 2024-05-08T05:34:09.829 INFO:teuthology.orchestra.run.smithi090.stdout: "avgcount": 245, 2024-05-08T05:34:09.829 INFO:teuthology.orchestra.run.smithi090.stdout: "sum": 0.013124230, 2024-05-08T05:34:09.829 INFO:teuthology.orchestra.run.smithi090.stdout: "avgtime": 0.000053568 2024-05-08T05:34:09.829 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-05-08T05:34:09.829 INFO:teuthology.orchestra.run.smithi090.stdout: "msgr_handle_ack_lat": { 2024-05-08T05:34:09.829 INFO:teuthology.orchestra.run.smithi090.stdout: "avgcount": 0, 2024-05-08T05:34:09.829 INFO:teuthology.orchestra.run.smithi090.stdout: "sum": 0.000000000, 2024-05-08T05:34:09.829 INFO:teuthology.orchestra.run.smithi090.stdout: "avgtime": 0.000000000 2024-05-08T05:34:09.829 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-05-08T05:34:09.830 INFO:teuthology.orchestra.run.smithi090.stdout: "msgr_recv_encrypted_bytes": 160, 2024-05-08T05:34:09.830 INFO:teuthology.orchestra.run.smithi090.stdout: "msgr_send_encrypted_bytes": 267696 2024-05-08T05:34:09.830 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-05-08T05:34:09.830 INFO:teuthology.orchestra.run.smithi090.stdout: "AsyncMessenger::Worker-2": { 2024-05-08T05:34:09.830 INFO:teuthology.orchestra.run.smithi090.stdout: "msgr_recv_messages": 224, 2024-05-08T05:34:09.830 INFO:teuthology.orchestra.run.smithi090.stdout: "msgr_send_messages": 215, 2024-05-08T05:34:09.830 INFO:teuthology.orchestra.run.smithi090.stdout: "msgr_recv_bytes": 4743960, 2024-05-08T05:34:09.830 INFO:teuthology.orchestra.run.smithi090.stdout: "msgr_send_bytes": 110874, 2024-05-08T05:34:09.830 INFO:teuthology.orchestra.run.smithi090.stdout: "msgr_created_connections": 4, 2024-05-08T05:34:09.830 INFO:teuthology.orchestra.run.smithi090.stdout: "msgr_active_connections": 3, 2024-05-08T05:34:09.830 INFO:teuthology.orchestra.run.smithi090.stdout: "msgr_running_total_time": 0.030346200, 2024-05-08T05:34:09.830 INFO:teuthology.orchestra.run.smithi090.stdout: "msgr_running_send_time": 0.009979234, 2024-05-08T05:34:09.830 INFO:teuthology.orchestra.run.smithi090.stdout: "msgr_running_recv_time": 0.015970734, 2024-05-08T05:34:09.830 INFO:teuthology.orchestra.run.smithi090.stdout: "msgr_running_fast_dispatch_time": 0.005271154, 2024-05-08T05:34:09.831 INFO:teuthology.orchestra.run.smithi090.stdout: "msgr_send_messages_queue_lat": { 2024-05-08T05:34:09.831 INFO:teuthology.orchestra.run.smithi090.stdout: "avgcount": 214, 2024-05-08T05:34:09.831 INFO:teuthology.orchestra.run.smithi090.stdout: "sum": 0.010393593, 2024-05-08T05:34:09.831 INFO:teuthology.orchestra.run.smithi090.stdout: "avgtime": 0.000048568 2024-05-08T05:34:09.831 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-05-08T05:34:09.831 INFO:teuthology.orchestra.run.smithi090.stdout: "msgr_handle_ack_lat": { 2024-05-08T05:34:09.831 INFO:teuthology.orchestra.run.smithi090.stdout: "avgcount": 0, 2024-05-08T05:34:09.831 INFO:teuthology.orchestra.run.smithi090.stdout: "sum": 0.000000000, 2024-05-08T05:34:09.831 INFO:teuthology.orchestra.run.smithi090.stdout: "avgtime": 0.000000000 2024-05-08T05:34:09.831 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-05-08T05:34:09.831 INFO:teuthology.orchestra.run.smithi090.stdout: "msgr_recv_encrypted_bytes": 534912, 2024-05-08T05:34:09.831 INFO:teuthology.orchestra.run.smithi090.stdout: "msgr_send_encrypted_bytes": 92112 2024-05-08T05:34:09.831 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-05-08T05:34:09.831 INFO:teuthology.orchestra.run.smithi090.stdout: "cct": { 2024-05-08T05:34:09.831 INFO:teuthology.orchestra.run.smithi090.stdout: "total_workers": 1, 2024-05-08T05:34:09.832 INFO:teuthology.orchestra.run.smithi090.stdout: "unhealthy_workers": 0 2024-05-08T05:34:09.832 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-05-08T05:34:09.832 INFO:teuthology.orchestra.run.smithi090.stdout: "finisher-MDSRank": { 2024-05-08T05:34:09.832 INFO:teuthology.orchestra.run.smithi090.stdout: "queue_len": 0, 2024-05-08T05:34:09.832 INFO:teuthology.orchestra.run.smithi090.stdout: "complete_latency": { 2024-05-08T05:34:09.832 INFO:teuthology.orchestra.run.smithi090.stdout: "avgcount": 2553, 2024-05-08T05:34:09.832 INFO:teuthology.orchestra.run.smithi090.stdout: "sum": 0.059187751, 2024-05-08T05:34:09.832 INFO:teuthology.orchestra.run.smithi090.stdout: "avgtime": 0.000023183 2024-05-08T05:34:09.832 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-05-08T05:34:09.832 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-05-08T05:34:09.832 INFO:teuthology.orchestra.run.smithi090.stdout: "finisher-PurgeQueue": { 2024-05-08T05:34:09.832 INFO:teuthology.orchestra.run.smithi090.stdout: "queue_len": 0, 2024-05-08T05:34:09.832 INFO:teuthology.orchestra.run.smithi090.stdout: "complete_latency": { 2024-05-08T05:34:09.832 INFO:teuthology.orchestra.run.smithi090.stdout: "avgcount": 0, 2024-05-08T05:34:09.832 INFO:teuthology.orchestra.run.smithi090.stdout: "sum": 0.000000000, 2024-05-08T05:34:09.833 INFO:teuthology.orchestra.run.smithi090.stdout: "avgtime": 0.000000000 2024-05-08T05:34:09.833 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-05-08T05:34:09.833 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-05-08T05:34:09.833 INFO:teuthology.orchestra.run.smithi090.stdout: "mds": { 2024-05-08T05:34:09.833 INFO:teuthology.orchestra.run.smithi090.stdout: "request": 0, 2024-05-08T05:34:09.833 INFO:teuthology.orchestra.run.smithi090.stdout: "reply": 0, 2024-05-08T05:34:09.833 INFO:teuthology.orchestra.run.smithi090.stdout: "reply_latency": { 2024-05-08T05:34:09.833 INFO:teuthology.orchestra.run.smithi090.stdout: "avgcount": 0, 2024-05-08T05:34:09.833 INFO:teuthology.orchestra.run.smithi090.stdout: "sum": 0.000000000, 2024-05-08T05:34:09.833 INFO:teuthology.orchestra.run.smithi090.stdout: "avgtime": 0.000000000 2024-05-08T05:34:09.833 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-05-08T05:34:09.833 INFO:teuthology.orchestra.run.smithi090.stdout: "slow_reply": 0, 2024-05-08T05:34:09.833 INFO:teuthology.orchestra.run.smithi090.stdout: "forward": 0, 2024-05-08T05:34:09.833 INFO:teuthology.orchestra.run.smithi090.stdout: "dir_fetch_complete": 0, 2024-05-08T05:34:09.833 INFO:teuthology.orchestra.run.smithi090.stdout: "dir_fetch_keys": 0, 2024-05-08T05:34:09.833 INFO:teuthology.orchestra.run.smithi090.stdout: "dir_commit": 0, 2024-05-08T05:34:09.834 INFO:teuthology.orchestra.run.smithi090.stdout: "dir_split": 0, 2024-05-08T05:34:09.834 INFO:teuthology.orchestra.run.smithi090.stdout: "dir_merge": 0, 2024-05-08T05:34:09.834 INFO:teuthology.orchestra.run.smithi090.stdout: "inodes": 9828, 2024-05-08T05:34:09.834 INFO:teuthology.orchestra.run.smithi090.stdout: "inodes_top": 0, 2024-05-08T05:34:09.834 INFO:teuthology.orchestra.run.smithi090.stdout: "inodes_bottom": 9828, 2024-05-08T05:34:09.834 INFO:teuthology.orchestra.run.smithi090.stdout: "inodes_pin_tail": 0, 2024-05-08T05:34:09.834 INFO:teuthology.orchestra.run.smithi090.stdout: "inodes_pinned": 9828, 2024-05-08T05:34:09.834 INFO:teuthology.orchestra.run.smithi090.stdout: "inodes_expired": 0, 2024-05-08T05:34:09.834 INFO:teuthology.orchestra.run.smithi090.stdout: "inodes_with_caps": 0, 2024-05-08T05:34:09.834 INFO:teuthology.orchestra.run.smithi090.stdout: "caps": 0, 2024-05-08T05:34:09.834 INFO:teuthology.orchestra.run.smithi090.stdout: "subtrees": 1, 2024-05-08T05:34:09.834 INFO:teuthology.orchestra.run.smithi090.stdout: "traverse": 0, 2024-05-08T05:34:09.835 INFO:teuthology.orchestra.run.smithi090.stdout: "traverse_hit": 0, 2024-05-08T05:34:09.835 INFO:teuthology.orchestra.run.smithi090.stdout: "traverse_forward": 0, 2024-05-08T05:34:09.835 INFO:teuthology.orchestra.run.smithi090.stdout: "traverse_discover": 0, 2024-05-08T05:34:09.835 INFO:teuthology.orchestra.run.smithi090.stdout: "traverse_dir_fetch": 0, 2024-05-08T05:34:09.835 INFO:teuthology.orchestra.run.smithi090.stdout: "traverse_remote_ino": 0, 2024-05-08T05:34:09.835 INFO:teuthology.orchestra.run.smithi090.stdout: "traverse_lock": 0, 2024-05-08T05:34:09.835 INFO:teuthology.orchestra.run.smithi090.stdout: "load_cent": 0, 2024-05-08T05:34:09.835 INFO:teuthology.orchestra.run.smithi090.stdout: "q": 0, 2024-05-08T05:34:09.835 INFO:teuthology.orchestra.run.smithi090.stdout: "exported": 0, 2024-05-08T05:34:09.835 INFO:teuthology.orchestra.run.smithi090.stdout: "exported_inodes": 0, 2024-05-08T05:34:09.835 INFO:teuthology.orchestra.run.smithi090.stdout: "imported": 0, 2024-05-08T05:34:09.835 INFO:teuthology.orchestra.run.smithi090.stdout: "imported_inodes": 0, 2024-05-08T05:34:09.835 INFO:teuthology.orchestra.run.smithi090.stdout: "openino_dir_fetch": 0, 2024-05-08T05:34:09.836 INFO:teuthology.orchestra.run.smithi090.stdout: "openino_backtrace_fetch": 0, 2024-05-08T05:34:09.836 INFO:teuthology.orchestra.run.smithi090.stdout: "openino_peer_discover": 0, 2024-05-08T05:34:09.836 INFO:teuthology.orchestra.run.smithi090.stdout: "root_rfiles": 0, 2024-05-08T05:34:09.836 INFO:teuthology.orchestra.run.smithi090.stdout: "root_rbytes": 0, 2024-05-08T05:34:09.836 INFO:teuthology.orchestra.run.smithi090.stdout: "root_rsnaps": 0, 2024-05-08T05:34:09.836 INFO:teuthology.orchestra.run.smithi090.stdout: "scrub_backtrace_fetch": 0, 2024-05-08T05:34:09.836 INFO:teuthology.orchestra.run.smithi090.stdout: "scrub_set_tag": 0, 2024-05-08T05:34:09.836 INFO:teuthology.orchestra.run.smithi090.stdout: "scrub_backtrace_repaired": 0, 2024-05-08T05:34:09.836 INFO:teuthology.orchestra.run.smithi090.stdout: "scrub_inotable_repaired": 0, 2024-05-08T05:34:09.836 INFO:teuthology.orchestra.run.smithi090.stdout: "scrub_dir_inodes": 0, 2024-05-08T05:34:09.837 INFO:teuthology.orchestra.run.smithi090.stdout: "scrub_dir_base_inodes": 0, 2024-05-08T05:34:09.837 INFO:teuthology.orchestra.run.smithi090.stdout: "scrub_dirfrag_rstats": 0, 2024-05-08T05:34:09.837 INFO:teuthology.orchestra.run.smithi090.stdout: "scrub_file_inodes": 0, 2024-05-08T05:34:09.837 INFO:teuthology.orchestra.run.smithi090.stdout: "handle_inode_file_caps": 0, 2024-05-08T05:34:09.837 INFO:teuthology.orchestra.run.smithi090.stdout: "ceph_cap_op_revoke": 0, 2024-05-08T05:34:09.837 INFO:teuthology.orchestra.run.smithi090.stdout: "ceph_cap_op_grant": 0, 2024-05-08T05:34:09.837 INFO:teuthology.orchestra.run.smithi090.stdout: "ceph_cap_op_trunc": 0, 2024-05-08T05:34:09.837 INFO:teuthology.orchestra.run.smithi090.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-05-08T05:34:09.837 INFO:teuthology.orchestra.run.smithi090.stdout: "ceph_cap_op_flush_ack": 0, 2024-05-08T05:34:09.837 INFO:teuthology.orchestra.run.smithi090.stdout: "handle_client_caps": 0, 2024-05-08T05:34:09.837 INFO:teuthology.orchestra.run.smithi090.stdout: "handle_client_caps_dirty": 0, 2024-05-08T05:34:09.837 INFO:teuthology.orchestra.run.smithi090.stdout: "handle_client_cap_release": 0, 2024-05-08T05:34:09.837 INFO:teuthology.orchestra.run.smithi090.stdout: "process_request_cap_release": 0 2024-05-08T05:34:09.837 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-05-08T05:34:09.837 INFO:teuthology.orchestra.run.smithi090.stdout: "mds_cache": { 2024-05-08T05:34:09.837 INFO:teuthology.orchestra.run.smithi090.stdout: "dir_update": 0, 2024-05-08T05:34:09.838 INFO:teuthology.orchestra.run.smithi090.stdout: "dir_update_receipt": 0, 2024-05-08T05:34:09.838 INFO:teuthology.orchestra.run.smithi090.stdout: "dir_try_discover": 0, 2024-05-08T05:34:09.838 INFO:teuthology.orchestra.run.smithi090.stdout: "dir_send_discover": 0, 2024-05-08T05:34:09.838 INFO:teuthology.orchestra.run.smithi090.stdout: "dir_handle_discover": 0, 2024-05-08T05:34:09.838 INFO:teuthology.orchestra.run.smithi090.stdout: "num_strays": 0, 2024-05-08T05:34:09.838 INFO:teuthology.orchestra.run.smithi090.stdout: "num_strays_delayed": 0, 2024-05-08T05:34:09.838 INFO:teuthology.orchestra.run.smithi090.stdout: "num_strays_enqueuing": 0, 2024-05-08T05:34:09.838 INFO:teuthology.orchestra.run.smithi090.stdout: "strays_created": 0, 2024-05-08T05:34:09.838 INFO:teuthology.orchestra.run.smithi090.stdout: "strays_enqueued": 0, 2024-05-08T05:34:09.838 INFO:teuthology.orchestra.run.smithi090.stdout: "strays_reintegrated": 0, 2024-05-08T05:34:09.838 INFO:teuthology.orchestra.run.smithi090.stdout: "strays_migrated": 0, 2024-05-08T05:34:09.839 INFO:teuthology.orchestra.run.smithi090.stdout: "num_recovering_processing": 0, 2024-05-08T05:34:09.839 INFO:teuthology.orchestra.run.smithi090.stdout: "num_recovering_enqueued": 0, 2024-05-08T05:34:09.839 INFO:teuthology.orchestra.run.smithi090.stdout: "num_recovering_prioritized": 0, 2024-05-08T05:34:09.839 INFO:teuthology.orchestra.run.smithi090.stdout: "recovery_started": 0, 2024-05-08T05:34:09.839 INFO:teuthology.orchestra.run.smithi090.stdout: "recovery_completed": 0, 2024-05-08T05:34:09.839 INFO:teuthology.orchestra.run.smithi090.stdout: "ireq_quiesce_path": 0, 2024-05-08T05:34:09.839 INFO:teuthology.orchestra.run.smithi090.stdout: "ireq_quiesce_inode": 0, 2024-05-08T05:34:09.839 INFO:teuthology.orchestra.run.smithi090.stdout: "ireq_enqueue_scrub": 0, 2024-05-08T05:34:09.839 INFO:teuthology.orchestra.run.smithi090.stdout: "ireq_exportdir": 0, 2024-05-08T05:34:09.839 INFO:teuthology.orchestra.run.smithi090.stdout: "ireq_flush": 0, 2024-05-08T05:34:09.839 INFO:teuthology.orchestra.run.smithi090.stdout: "ireq_fragmentdir": 0, 2024-05-08T05:34:09.839 INFO:teuthology.orchestra.run.smithi090.stdout: "ireq_fragstats": 0, 2024-05-08T05:34:09.839 INFO:teuthology.orchestra.run.smithi090.stdout: "ireq_inodestats": 0 2024-05-08T05:34:09.839 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-05-08T05:34:09.840 INFO:teuthology.orchestra.run.smithi090.stdout: "mds_log": { 2024-05-08T05:34:09.840 INFO:teuthology.orchestra.run.smithi090.stdout: "evlrg": 0, 2024-05-08T05:34:09.840 INFO:teuthology.orchestra.run.smithi090.stdout: "evadd": 0, 2024-05-08T05:34:09.840 INFO:teuthology.orchestra.run.smithi090.stdout: "evex": 0, 2024-05-08T05:34:09.840 INFO:teuthology.orchestra.run.smithi090.stdout: "evtrm": 0, 2024-05-08T05:34:09.840 INFO:teuthology.orchestra.run.smithi090.stdout: "ev": 21715, 2024-05-08T05:34:09.840 INFO:teuthology.orchestra.run.smithi090.stdout: "evexg": 0, 2024-05-08T05:34:09.840 INFO:teuthology.orchestra.run.smithi090.stdout: "evexd": 0, 2024-05-08T05:34:09.840 INFO:teuthology.orchestra.run.smithi090.stdout: "segadd": 0, 2024-05-08T05:34:09.840 INFO:teuthology.orchestra.run.smithi090.stdout: "segex": 0, 2024-05-08T05:34:09.840 INFO:teuthology.orchestra.run.smithi090.stdout: "segtrm": 0, 2024-05-08T05:34:09.840 INFO:teuthology.orchestra.run.smithi090.stdout: "seg": 30, 2024-05-08T05:34:09.840 INFO:teuthology.orchestra.run.smithi090.stdout: "segmjr": 3, 2024-05-08T05:34:09.840 INFO:teuthology.orchestra.run.smithi090.stdout: "segexg": 0, 2024-05-08T05:34:09.841 INFO:teuthology.orchestra.run.smithi090.stdout: "segexd": 0, 2024-05-08T05:34:09.841 INFO:teuthology.orchestra.run.smithi090.stdout: "expos": 4194304, 2024-05-08T05:34:09.841 INFO:teuthology.orchestra.run.smithi090.stdout: "wrpos": 50313705, 2024-05-08T05:34:09.841 INFO:teuthology.orchestra.run.smithi090.stdout: "rdpos": 50312567, 2024-05-08T05:34:09.841 INFO:teuthology.orchestra.run.smithi090.stdout: "jlat": { 2024-05-08T05:34:09.841 INFO:teuthology.orchestra.run.smithi090.stdout: "avgcount": 0, 2024-05-08T05:34:09.841 INFO:teuthology.orchestra.run.smithi090.stdout: "sum": 0.000000000, 2024-05-08T05:34:09.841 INFO:teuthology.orchestra.run.smithi090.stdout: "avgtime": 0.000000000 2024-05-08T05:34:09.841 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-05-08T05:34:09.841 INFO:teuthology.orchestra.run.smithi090.stdout: "replayed": 21715 2024-05-08T05:34:09.841 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-05-08T05:34:09.841 INFO:teuthology.orchestra.run.smithi090.stdout: "mds_mem": { 2024-05-08T05:34:09.841 INFO:teuthology.orchestra.run.smithi090.stdout: "ino": 175, 2024-05-08T05:34:09.841 INFO:teuthology.orchestra.run.smithi090.stdout: "ino+": 8164, 2024-05-08T05:34:09.842 INFO:teuthology.orchestra.run.smithi090.stdout: "ino-": 7989, 2024-05-08T05:34:09.842 INFO:teuthology.orchestra.run.smithi090.stdout: "dir": 183, 2024-05-08T05:34:09.842 INFO:teuthology.orchestra.run.smithi090.stdout: "dir+": 1029, 2024-05-08T05:34:09.842 INFO:teuthology.orchestra.run.smithi090.stdout: "dir-": 846, 2024-05-08T05:34:09.842 INFO:teuthology.orchestra.run.smithi090.stdout: "dn": 9828, 2024-05-08T05:34:09.842 INFO:teuthology.orchestra.run.smithi090.stdout: "dn+": 15911, 2024-05-08T05:34:09.842 INFO:teuthology.orchestra.run.smithi090.stdout: "dn-": 6083, 2024-05-08T05:34:09.842 INFO:teuthology.orchestra.run.smithi090.stdout: "cap": 0, 2024-05-08T05:34:09.842 INFO:teuthology.orchestra.run.smithi090.stdout: "cap+": 0, 2024-05-08T05:34:09.842 INFO:teuthology.orchestra.run.smithi090.stdout: "cap-": 0, 2024-05-08T05:34:09.842 INFO:teuthology.orchestra.run.smithi090.stdout: "rss": 72024, 2024-05-08T05:34:09.842 INFO:teuthology.orchestra.run.smithi090.stdout: "heap": 215416 2024-05-08T05:34:09.842 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-05-08T05:34:09.843 INFO:teuthology.orchestra.run.smithi090.stdout: "mds_server": { 2024-05-08T05:34:09.843 INFO:teuthology.orchestra.run.smithi090.stdout: "dispatch_client_request": 0, 2024-05-08T05:34:09.843 INFO:teuthology.orchestra.run.smithi090.stdout: "dispatch_server_request": 0, 2024-05-08T05:34:09.843 INFO:teuthology.orchestra.run.smithi090.stdout: "handle_client_request": 0, 2024-05-08T05:34:09.843 INFO:teuthology.orchestra.run.smithi090.stdout: "handle_client_session": 0, 2024-05-08T05:34:09.843 INFO:teuthology.orchestra.run.smithi090.stdout: "handle_peer_request": 0, 2024-05-08T05:34:09.843 INFO:teuthology.orchestra.run.smithi090.stdout: "req_create_latency": { 2024-05-08T05:34:09.844 INFO:teuthology.orchestra.run.smithi090.stdout: "avgcount": 0, 2024-05-08T05:34:09.844 INFO:teuthology.orchestra.run.smithi090.stdout: "sum": 0.000000000, 2024-05-08T05:34:09.844 INFO:teuthology.orchestra.run.smithi090.stdout: "avgtime": 0.000000000 2024-05-08T05:34:09.844 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-05-08T05:34:09.844 INFO:teuthology.orchestra.run.smithi090.stdout: "req_getattr_latency": { 2024-05-08T05:34:09.844 INFO:teuthology.orchestra.run.smithi090.stdout: "avgcount": 0, 2024-05-08T05:34:09.844 INFO:teuthology.orchestra.run.smithi090.stdout: "sum": 0.000000000, 2024-05-08T05:34:09.844 INFO:teuthology.orchestra.run.smithi090.stdout: "avgtime": 0.000000000 2024-05-08T05:34:09.845 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-05-08T05:34:09.845 INFO:teuthology.orchestra.run.smithi090.stdout: "req_getfilelock_latency": { 2024-05-08T05:34:09.845 INFO:teuthology.orchestra.run.smithi090.stdout: "avgcount": 0, 2024-05-08T05:34:09.845 INFO:teuthology.orchestra.run.smithi090.stdout: "sum": 0.000000000, 2024-05-08T05:34:09.845 INFO:teuthology.orchestra.run.smithi090.stdout: "avgtime": 0.000000000 2024-05-08T05:34:09.845 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-05-08T05:34:09.845 INFO:teuthology.orchestra.run.smithi090.stdout: "req_link_latency": { 2024-05-08T05:34:09.845 INFO:teuthology.orchestra.run.smithi090.stdout: "avgcount": 0, 2024-05-08T05:34:09.845 INFO:teuthology.orchestra.run.smithi090.stdout: "sum": 0.000000000, 2024-05-08T05:34:09.845 INFO:teuthology.orchestra.run.smithi090.stdout: "avgtime": 0.000000000 2024-05-08T05:34:09.845 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-05-08T05:34:09.845 INFO:teuthology.orchestra.run.smithi090.stdout: "req_lookup_latency": { 2024-05-08T05:34:09.845 INFO:teuthology.orchestra.run.smithi090.stdout: "avgcount": 0, 2024-05-08T05:34:09.846 INFO:teuthology.orchestra.run.smithi090.stdout: "sum": 0.000000000, 2024-05-08T05:34:09.846 INFO:teuthology.orchestra.run.smithi090.stdout: "avgtime": 0.000000000 2024-05-08T05:34:09.846 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-05-08T05:34:09.846 INFO:teuthology.orchestra.run.smithi090.stdout: "req_lookuphash_latency": { 2024-05-08T05:34:09.846 INFO:teuthology.orchestra.run.smithi090.stdout: "avgcount": 0, 2024-05-08T05:34:09.846 INFO:teuthology.orchestra.run.smithi090.stdout: "sum": 0.000000000, 2024-05-08T05:34:09.846 INFO:teuthology.orchestra.run.smithi090.stdout: "avgtime": 0.000000000 2024-05-08T05:34:09.846 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-05-08T05:34:09.846 INFO:teuthology.orchestra.run.smithi090.stdout: "req_lookupino_latency": { 2024-05-08T05:34:09.846 INFO:teuthology.orchestra.run.smithi090.stdout: "avgcount": 0, 2024-05-08T05:34:09.847 INFO:teuthology.orchestra.run.smithi090.stdout: "sum": 0.000000000, 2024-05-08T05:34:09.847 INFO:teuthology.orchestra.run.smithi090.stdout: "avgtime": 0.000000000 2024-05-08T05:34:09.847 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-05-08T05:34:09.847 INFO:teuthology.orchestra.run.smithi090.stdout: "req_lookupname_latency": { 2024-05-08T05:34:09.847 INFO:teuthology.orchestra.run.smithi090.stdout: "avgcount": 0, 2024-05-08T05:34:09.847 INFO:teuthology.orchestra.run.smithi090.stdout: "sum": 0.000000000, 2024-05-08T05:34:09.847 INFO:teuthology.orchestra.run.smithi090.stdout: "avgtime": 0.000000000 2024-05-08T05:34:09.847 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-05-08T05:34:09.847 INFO:teuthology.orchestra.run.smithi090.stdout: "req_lookupparent_latency": { 2024-05-08T05:34:09.848 INFO:teuthology.orchestra.run.smithi090.stdout: "avgcount": 0, 2024-05-08T05:34:09.848 INFO:teuthology.orchestra.run.smithi090.stdout: "sum": 0.000000000, 2024-05-08T05:34:09.848 INFO:teuthology.orchestra.run.smithi090.stdout: "avgtime": 0.000000000 2024-05-08T05:34:09.848 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-05-08T05:34:09.848 INFO:teuthology.orchestra.run.smithi090.stdout: "req_lookupsnap_latency": { 2024-05-08T05:34:09.848 INFO:teuthology.orchestra.run.smithi090.stdout: "avgcount": 0, 2024-05-08T05:34:09.848 INFO:teuthology.orchestra.run.smithi090.stdout: "sum": 0.000000000, 2024-05-08T05:34:09.848 INFO:teuthology.orchestra.run.smithi090.stdout: "avgtime": 0.000000000 2024-05-08T05:34:09.848 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-05-08T05:34:09.848 INFO:teuthology.orchestra.run.smithi090.stdout: "req_lssnap_latency": { 2024-05-08T05:34:09.848 INFO:teuthology.orchestra.run.smithi090.stdout: "avgcount": 0, 2024-05-08T05:34:09.848 INFO:teuthology.orchestra.run.smithi090.stdout: "sum": 0.000000000, 2024-05-08T05:34:09.848 INFO:teuthology.orchestra.run.smithi090.stdout: "avgtime": 0.000000000 2024-05-08T05:34:09.848 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-05-08T05:34:09.849 INFO:teuthology.orchestra.run.smithi090.stdout: "req_mkdir_latency": { 2024-05-08T05:34:09.849 INFO:teuthology.orchestra.run.smithi090.stdout: "avgcount": 0, 2024-05-08T05:34:09.849 INFO:teuthology.orchestra.run.smithi090.stdout: "sum": 0.000000000, 2024-05-08T05:34:09.850 INFO:teuthology.orchestra.run.smithi090.stdout: "avgtime": 0.000000000 2024-05-08T05:34:09.850 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-05-08T05:34:09.850 INFO:teuthology.orchestra.run.smithi090.stdout: "req_mknod_latency": { 2024-05-08T05:34:09.850 INFO:teuthology.orchestra.run.smithi090.stdout: "avgcount": 0, 2024-05-08T05:34:09.850 INFO:teuthology.orchestra.run.smithi090.stdout: "sum": 0.000000000, 2024-05-08T05:34:09.850 INFO:teuthology.orchestra.run.smithi090.stdout: "avgtime": 0.000000000 2024-05-08T05:34:09.850 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-05-08T05:34:09.850 INFO:teuthology.orchestra.run.smithi090.stdout: "req_mksnap_latency": { 2024-05-08T05:34:09.850 INFO:teuthology.orchestra.run.smithi090.stdout: "avgcount": 0, 2024-05-08T05:34:09.850 INFO:teuthology.orchestra.run.smithi090.stdout: "sum": 0.000000000, 2024-05-08T05:34:09.850 INFO:teuthology.orchestra.run.smithi090.stdout: "avgtime": 0.000000000 2024-05-08T05:34:09.850 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-05-08T05:34:09.850 INFO:teuthology.orchestra.run.smithi090.stdout: "req_open_latency": { 2024-05-08T05:34:09.851 INFO:teuthology.orchestra.run.smithi090.stdout: "avgcount": 0, 2024-05-08T05:34:09.851 INFO:teuthology.orchestra.run.smithi090.stdout: "sum": 0.000000000, 2024-05-08T05:34:09.851 INFO:teuthology.orchestra.run.smithi090.stdout: "avgtime": 0.000000000 2024-05-08T05:34:09.851 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-05-08T05:34:09.851 INFO:teuthology.orchestra.run.smithi090.stdout: "req_readdir_latency": { 2024-05-08T05:34:09.851 INFO:teuthology.orchestra.run.smithi090.stdout: "avgcount": 0, 2024-05-08T05:34:09.851 INFO:teuthology.orchestra.run.smithi090.stdout: "sum": 0.000000000, 2024-05-08T05:34:09.851 INFO:teuthology.orchestra.run.smithi090.stdout: "avgtime": 0.000000000 2024-05-08T05:34:09.851 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-05-08T05:34:09.851 INFO:teuthology.orchestra.run.smithi090.stdout: "req_rename_latency": { 2024-05-08T05:34:09.851 INFO:teuthology.orchestra.run.smithi090.stdout: "avgcount": 0, 2024-05-08T05:34:09.851 INFO:teuthology.orchestra.run.smithi090.stdout: "sum": 0.000000000, 2024-05-08T05:34:09.851 INFO:teuthology.orchestra.run.smithi090.stdout: "avgtime": 0.000000000 2024-05-08T05:34:09.851 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-05-08T05:34:09.851 INFO:teuthology.orchestra.run.smithi090.stdout: "req_renamesnap_latency": { 2024-05-08T05:34:09.852 INFO:teuthology.orchestra.run.smithi090.stdout: "avgcount": 0, 2024-05-08T05:34:09.852 INFO:teuthology.orchestra.run.smithi090.stdout: "sum": 0.000000000, 2024-05-08T05:34:09.852 INFO:teuthology.orchestra.run.smithi090.stdout: "avgtime": 0.000000000 2024-05-08T05:34:09.852 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-05-08T05:34:09.852 INFO:teuthology.orchestra.run.smithi090.stdout: "req_snapdiff_latency": { 2024-05-08T05:34:09.852 INFO:teuthology.orchestra.run.smithi090.stdout: "avgcount": 0, 2024-05-08T05:34:09.852 INFO:teuthology.orchestra.run.smithi090.stdout: "sum": 0.000000000, 2024-05-08T05:34:09.852 INFO:teuthology.orchestra.run.smithi090.stdout: "avgtime": 0.000000000 2024-05-08T05:34:09.852 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-05-08T05:34:09.852 INFO:teuthology.orchestra.run.smithi090.stdout: "req_rmdir_latency": { 2024-05-08T05:34:09.852 INFO:teuthology.orchestra.run.smithi090.stdout: "avgcount": 0, 2024-05-08T05:34:09.852 INFO:teuthology.orchestra.run.smithi090.stdout: "sum": 0.000000000, 2024-05-08T05:34:09.852 INFO:teuthology.orchestra.run.smithi090.stdout: "avgtime": 0.000000000 2024-05-08T05:34:09.852 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-05-08T05:34:09.853 INFO:teuthology.orchestra.run.smithi090.stdout: "req_rmsnap_latency": { 2024-05-08T05:34:09.853 INFO:teuthology.orchestra.run.smithi090.stdout: "avgcount": 0, 2024-05-08T05:34:09.853 INFO:teuthology.orchestra.run.smithi090.stdout: "sum": 0.000000000, 2024-05-08T05:34:09.853 INFO:teuthology.orchestra.run.smithi090.stdout: "avgtime": 0.000000000 2024-05-08T05:34:09.853 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-05-08T05:34:09.853 INFO:teuthology.orchestra.run.smithi090.stdout: "req_rmxattr_latency": { 2024-05-08T05:34:09.853 INFO:teuthology.orchestra.run.smithi090.stdout: "avgcount": 0, 2024-05-08T05:34:09.853 INFO:teuthology.orchestra.run.smithi090.stdout: "sum": 0.000000000, 2024-05-08T05:34:09.853 INFO:teuthology.orchestra.run.smithi090.stdout: "avgtime": 0.000000000 2024-05-08T05:34:09.853 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-05-08T05:34:09.853 INFO:teuthology.orchestra.run.smithi090.stdout: "req_setattr_latency": { 2024-05-08T05:34:09.854 INFO:teuthology.orchestra.run.smithi090.stdout: "avgcount": 0, 2024-05-08T05:34:09.854 INFO:teuthology.orchestra.run.smithi090.stdout: "sum": 0.000000000, 2024-05-08T05:34:09.854 INFO:teuthology.orchestra.run.smithi090.stdout: "avgtime": 0.000000000 2024-05-08T05:34:09.854 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-05-08T05:34:09.854 INFO:teuthology.orchestra.run.smithi090.stdout: "req_setdirlayout_latency": { 2024-05-08T05:34:09.854 INFO:teuthology.orchestra.run.smithi090.stdout: "avgcount": 0, 2024-05-08T05:34:09.854 INFO:teuthology.orchestra.run.smithi090.stdout: "sum": 0.000000000, 2024-05-08T05:34:09.854 INFO:teuthology.orchestra.run.smithi090.stdout: "avgtime": 0.000000000 2024-05-08T05:34:09.854 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-05-08T05:34:09.854 INFO:teuthology.orchestra.run.smithi090.stdout: "req_setfilelock_latency": { 2024-05-08T05:34:09.854 INFO:teuthology.orchestra.run.smithi090.stdout: "avgcount": 0, 2024-05-08T05:34:09.854 INFO:teuthology.orchestra.run.smithi090.stdout: "sum": 0.000000000, 2024-05-08T05:34:09.854 INFO:teuthology.orchestra.run.smithi090.stdout: "avgtime": 0.000000000 2024-05-08T05:34:09.855 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-05-08T05:34:09.855 INFO:teuthology.orchestra.run.smithi090.stdout: "req_setlayout_latency": { 2024-05-08T05:34:09.855 INFO:teuthology.orchestra.run.smithi090.stdout: "avgcount": 0, 2024-05-08T05:34:09.855 INFO:teuthology.orchestra.run.smithi090.stdout: "sum": 0.000000000, 2024-05-08T05:34:09.855 INFO:teuthology.orchestra.run.smithi090.stdout: "avgtime": 0.000000000 2024-05-08T05:34:09.855 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-05-08T05:34:09.855 INFO:teuthology.orchestra.run.smithi090.stdout: "req_setxattr_latency": { 2024-05-08T05:34:09.855 INFO:teuthology.orchestra.run.smithi090.stdout: "avgcount": 0, 2024-05-08T05:34:09.855 INFO:teuthology.orchestra.run.smithi090.stdout: "sum": 0.000000000, 2024-05-08T05:34:09.855 INFO:teuthology.orchestra.run.smithi090.stdout: "avgtime": 0.000000000 2024-05-08T05:34:09.855 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-05-08T05:34:09.855 INFO:teuthology.orchestra.run.smithi090.stdout: "req_symlink_latency": { 2024-05-08T05:34:09.855 INFO:teuthology.orchestra.run.smithi090.stdout: "avgcount": 0, 2024-05-08T05:34:09.856 INFO:teuthology.orchestra.run.smithi090.stdout: "sum": 0.000000000, 2024-05-08T05:34:09.856 INFO:teuthology.orchestra.run.smithi090.stdout: "avgtime": 0.000000000 2024-05-08T05:34:09.856 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-05-08T05:34:09.856 INFO:teuthology.orchestra.run.smithi090.stdout: "req_unlink_latency": { 2024-05-08T05:34:09.856 INFO:teuthology.orchestra.run.smithi090.stdout: "avgcount": 0, 2024-05-08T05:34:09.856 INFO:teuthology.orchestra.run.smithi090.stdout: "sum": 0.000000000, 2024-05-08T05:34:09.856 INFO:teuthology.orchestra.run.smithi090.stdout: "avgtime": 0.000000000 2024-05-08T05:34:09.856 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-05-08T05:34:09.856 INFO:teuthology.orchestra.run.smithi090.stdout: "cap_revoke_eviction": 0, 2024-05-08T05:34:09.856 INFO:teuthology.orchestra.run.smithi090.stdout: "cap_acquisition_throttle": 0, 2024-05-08T05:34:09.856 INFO:teuthology.orchestra.run.smithi090.stdout: "req_getvxattr_latency": { 2024-05-08T05:34:09.856 INFO:teuthology.orchestra.run.smithi090.stdout: "avgcount": 0, 2024-05-08T05:34:09.856 INFO:teuthology.orchestra.run.smithi090.stdout: "sum": 0.000000000, 2024-05-08T05:34:09.856 INFO:teuthology.orchestra.run.smithi090.stdout: "avgtime": 0.000000000 2024-05-08T05:34:09.856 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-05-08T05:34:09.856 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-05-08T05:34:09.857 INFO:teuthology.orchestra.run.smithi090.stdout: "mds_sessions": { 2024-05-08T05:34:09.857 INFO:teuthology.orchestra.run.smithi090.stdout: "session_count": 1, 2024-05-08T05:34:09.857 INFO:teuthology.orchestra.run.smithi090.stdout: "session_add": 2, 2024-05-08T05:34:09.857 INFO:teuthology.orchestra.run.smithi090.stdout: "session_remove": 1, 2024-05-08T05:34:09.857 INFO:teuthology.orchestra.run.smithi090.stdout: "sessions_open": 1, 2024-05-08T05:34:09.857 INFO:teuthology.orchestra.run.smithi090.stdout: "sessions_stale": 0, 2024-05-08T05:34:09.857 INFO:teuthology.orchestra.run.smithi090.stdout: "total_load": 0, 2024-05-08T05:34:09.857 INFO:teuthology.orchestra.run.smithi090.stdout: "average_load": 0, 2024-05-08T05:34:09.857 INFO:teuthology.orchestra.run.smithi090.stdout: "avg_session_uptime": 1957, 2024-05-08T05:34:09.858 INFO:teuthology.orchestra.run.smithi090.stdout: "mdthresh_evicted": 0 2024-05-08T05:34:09.858 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-05-08T05:34:09.858 INFO:teuthology.orchestra.run.smithi090.stdout: "mempool": { 2024-05-08T05:34:09.858 INFO:teuthology.orchestra.run.smithi090.stdout: "bloom_filter_bytes": 0, 2024-05-08T05:34:09.858 INFO:teuthology.orchestra.run.smithi090.stdout: "bloom_filter_items": 0, 2024-05-08T05:34:09.858 INFO:teuthology.orchestra.run.smithi090.stdout: "bluestore_alloc_bytes": 0, 2024-05-08T05:34:09.858 INFO:teuthology.orchestra.run.smithi090.stdout: "bluestore_alloc_items": 0, 2024-05-08T05:34:09.858 INFO:teuthology.orchestra.run.smithi090.stdout: "bluestore_cache_data_bytes": 0, 2024-05-08T05:34:09.858 INFO:teuthology.orchestra.run.smithi090.stdout: "bluestore_cache_data_items": 0, 2024-05-08T05:34:09.858 INFO:teuthology.orchestra.run.smithi090.stdout: "bluestore_cache_onode_bytes": 0, 2024-05-08T05:34:09.858 INFO:teuthology.orchestra.run.smithi090.stdout: "bluestore_cache_onode_items": 0, 2024-05-08T05:34:09.858 INFO:teuthology.orchestra.run.smithi090.stdout: "bluestore_cache_meta_bytes": 0, 2024-05-08T05:34:09.858 INFO:teuthology.orchestra.run.smithi090.stdout: "bluestore_cache_meta_items": 0, 2024-05-08T05:34:09.859 INFO:teuthology.orchestra.run.smithi090.stdout: "bluestore_cache_other_bytes": 0, 2024-05-08T05:34:09.859 INFO:teuthology.orchestra.run.smithi090.stdout: "bluestore_cache_other_items": 0, 2024-05-08T05:34:09.859 INFO:teuthology.orchestra.run.smithi090.stdout: "bluestore_cache_buffer_bytes": 0, 2024-05-08T05:34:09.859 INFO:teuthology.orchestra.run.smithi090.stdout: "bluestore_cache_buffer_items": 0, 2024-05-08T05:34:09.859 INFO:teuthology.orchestra.run.smithi090.stdout: "bluestore_extent_bytes": 0, 2024-05-08T05:34:09.859 INFO:teuthology.orchestra.run.smithi090.stdout: "bluestore_extent_items": 0, 2024-05-08T05:34:09.859 INFO:teuthology.orchestra.run.smithi090.stdout: "bluestore_blob_bytes": 0, 2024-05-08T05:34:09.859 INFO:teuthology.orchestra.run.smithi090.stdout: "bluestore_blob_items": 0, 2024-05-08T05:34:09.859 INFO:teuthology.orchestra.run.smithi090.stdout: "bluestore_shared_blob_bytes": 0, 2024-05-08T05:34:09.859 INFO:teuthology.orchestra.run.smithi090.stdout: "bluestore_shared_blob_items": 0, 2024-05-08T05:34:09.859 INFO:teuthology.orchestra.run.smithi090.stdout: "bluestore_inline_bl_bytes": 0, 2024-05-08T05:34:09.859 INFO:teuthology.orchestra.run.smithi090.stdout: "bluestore_inline_bl_items": 0, 2024-05-08T05:34:09.859 INFO:teuthology.orchestra.run.smithi090.stdout: "bluestore_fsck_bytes": 0, 2024-05-08T05:34:09.859 INFO:teuthology.orchestra.run.smithi090.stdout: "bluestore_fsck_items": 0, 2024-05-08T05:34:09.860 INFO:teuthology.orchestra.run.smithi090.stdout: "bluestore_txc_bytes": 0, 2024-05-08T05:34:09.860 INFO:teuthology.orchestra.run.smithi090.stdout: "bluestore_txc_items": 0, 2024-05-08T05:34:09.860 INFO:teuthology.orchestra.run.smithi090.stdout: "bluestore_writing_deferred_bytes": 0, 2024-05-08T05:34:09.860 INFO:teuthology.orchestra.run.smithi090.stdout: "bluestore_writing_deferred_items": 0, 2024-05-08T05:34:09.860 INFO:teuthology.orchestra.run.smithi090.stdout: "bluestore_writing_bytes": 0, 2024-05-08T05:34:09.860 INFO:teuthology.orchestra.run.smithi090.stdout: "bluestore_writing_items": 0, 2024-05-08T05:34:09.860 INFO:teuthology.orchestra.run.smithi090.stdout: "bluefs_bytes": 0, 2024-05-08T05:34:09.860 INFO:teuthology.orchestra.run.smithi090.stdout: "bluefs_items": 0, 2024-05-08T05:34:09.860 INFO:teuthology.orchestra.run.smithi090.stdout: "bluefs_file_reader_bytes": 0, 2024-05-08T05:34:09.860 INFO:teuthology.orchestra.run.smithi090.stdout: "bluefs_file_reader_items": 0, 2024-05-08T05:34:09.860 INFO:teuthology.orchestra.run.smithi090.stdout: "bluefs_file_writer_bytes": 0, 2024-05-08T05:34:09.860 INFO:teuthology.orchestra.run.smithi090.stdout: "bluefs_file_writer_items": 0, 2024-05-08T05:34:09.860 INFO:teuthology.orchestra.run.smithi090.stdout: "buffer_anon_bytes": 220357, 2024-05-08T05:34:09.860 INFO:teuthology.orchestra.run.smithi090.stdout: "buffer_anon_items": 226, 2024-05-08T05:34:09.860 INFO:teuthology.orchestra.run.smithi090.stdout: "buffer_meta_bytes": 0, 2024-05-08T05:34:09.861 INFO:teuthology.orchestra.run.smithi090.stdout: "buffer_meta_items": 0, 2024-05-08T05:34:09.861 INFO:teuthology.orchestra.run.smithi090.stdout: "osd_bytes": 0, 2024-05-08T05:34:09.861 INFO:teuthology.orchestra.run.smithi090.stdout: "osd_items": 0, 2024-05-08T05:34:09.861 INFO:teuthology.orchestra.run.smithi090.stdout: "osd_mapbl_bytes": 0, 2024-05-08T05:34:09.861 INFO:teuthology.orchestra.run.smithi090.stdout: "osd_mapbl_items": 0, 2024-05-08T05:34:09.861 INFO:teuthology.orchestra.run.smithi090.stdout: "osd_pglog_bytes": 0, 2024-05-08T05:34:09.861 INFO:teuthology.orchestra.run.smithi090.stdout: "osd_pglog_items": 0, 2024-05-08T05:34:09.861 INFO:teuthology.orchestra.run.smithi090.stdout: "osdmap_bytes": 7440, 2024-05-08T05:34:09.861 INFO:teuthology.orchestra.run.smithi090.stdout: "osdmap_items": 157, 2024-05-08T05:34:09.861 INFO:teuthology.orchestra.run.smithi090.stdout: "osdmap_mapping_bytes": 0, 2024-05-08T05:34:09.861 INFO:teuthology.orchestra.run.smithi090.stdout: "osdmap_mapping_items": 0, 2024-05-08T05:34:09.861 INFO:teuthology.orchestra.run.smithi090.stdout: "pgmap_bytes": 0, 2024-05-08T05:34:09.861 INFO:teuthology.orchestra.run.smithi090.stdout: "pgmap_items": 0, 2024-05-08T05:34:09.862 INFO:teuthology.orchestra.run.smithi090.stdout: "mds_co_bytes": 7607143, 2024-05-08T05:34:09.862 INFO:teuthology.orchestra.run.smithi090.stdout: "mds_co_items": 74226, 2024-05-08T05:34:09.862 INFO:teuthology.orchestra.run.smithi090.stdout: "unittest_1_bytes": 0, 2024-05-08T05:34:09.862 INFO:teuthology.orchestra.run.smithi090.stdout: "unittest_1_items": 0, 2024-05-08T05:34:09.862 INFO:teuthology.orchestra.run.smithi090.stdout: "unittest_2_bytes": 0, 2024-05-08T05:34:09.862 INFO:teuthology.orchestra.run.smithi090.stdout: "unittest_2_items": 0 2024-05-08T05:34:09.862 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-05-08T05:34:09.862 INFO:teuthology.orchestra.run.smithi090.stdout: "objecter": { 2024-05-08T05:34:09.862 INFO:teuthology.orchestra.run.smithi090.stdout: "op_active": 0, 2024-05-08T05:34:09.862 INFO:teuthology.orchestra.run.smithi090.stdout: "op_laggy": 0, 2024-05-08T05:34:09.862 INFO:teuthology.orchestra.run.smithi090.stdout: "op_send": 1506, 2024-05-08T05:34:09.863 INFO:teuthology.orchestra.run.smithi090.stdout: "op_send_bytes": 21, 2024-05-08T05:34:09.863 INFO:teuthology.orchestra.run.smithi090.stdout: "op_resend": 3, 2024-05-08T05:34:09.863 INFO:teuthology.orchestra.run.smithi090.stdout: "op_reply": 1506, 2024-05-08T05:34:09.863 INFO:teuthology.orchestra.run.smithi090.stdout: "op_latency": { 2024-05-08T05:34:09.863 INFO:teuthology.orchestra.run.smithi090.stdout: "avgcount": 1506, 2024-05-08T05:34:09.863 INFO:teuthology.orchestra.run.smithi090.stdout: "sum": 0.967985664, 2024-05-08T05:34:09.863 INFO:teuthology.orchestra.run.smithi090.stdout: "avgtime": 0.000642752 2024-05-08T05:34:09.863 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-05-08T05:34:09.863 INFO:teuthology.orchestra.run.smithi090.stdout: "op_inflight": 0, 2024-05-08T05:34:09.863 INFO:teuthology.orchestra.run.smithi090.stdout: "oplen_avg": { 2024-05-08T05:34:09.863 INFO:teuthology.orchestra.run.smithi090.stdout: "avgcount": 1506, 2024-05-08T05:34:09.863 INFO:teuthology.orchestra.run.smithi090.stdout: "sum": 1507 2024-05-08T05:34:09.863 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-05-08T05:34:09.864 INFO:teuthology.orchestra.run.smithi090.stdout: "op": 1506, 2024-05-08T05:34:09.864 INFO:teuthology.orchestra.run.smithi090.stdout: "op_r": 1506, 2024-05-08T05:34:09.864 INFO:teuthology.orchestra.run.smithi090.stdout: "op_w": 0, 2024-05-08T05:34:09.864 INFO:teuthology.orchestra.run.smithi090.stdout: "op_rmw": 0, 2024-05-08T05:34:09.864 INFO:teuthology.orchestra.run.smithi090.stdout: "op_pg": 0, 2024-05-08T05:34:09.864 INFO:teuthology.orchestra.run.smithi090.stdout: "osdop_stat": 920, 2024-05-08T05:34:09.864 INFO:teuthology.orchestra.run.smithi090.stdout: "osdop_create": 0, 2024-05-08T05:34:09.864 INFO:teuthology.orchestra.run.smithi090.stdout: "osdop_read": 584, 2024-05-08T05:34:09.864 INFO:teuthology.orchestra.run.smithi090.stdout: "osdop_write": 0, 2024-05-08T05:34:09.864 INFO:teuthology.orchestra.run.smithi090.stdout: "osdop_writefull": 0, 2024-05-08T05:34:09.864 INFO:teuthology.orchestra.run.smithi090.stdout: "osdop_writesame": 0, 2024-05-08T05:34:09.864 INFO:teuthology.orchestra.run.smithi090.stdout: "osdop_append": 0, 2024-05-08T05:34:09.864 INFO:teuthology.orchestra.run.smithi090.stdout: "osdop_zero": 0, 2024-05-08T05:34:09.864 INFO:teuthology.orchestra.run.smithi090.stdout: "osdop_truncate": 0, 2024-05-08T05:34:09.865 INFO:teuthology.orchestra.run.smithi090.stdout: "osdop_delete": 0, 2024-05-08T05:34:09.865 INFO:teuthology.orchestra.run.smithi090.stdout: "osdop_mapext": 0, 2024-05-08T05:34:09.865 INFO:teuthology.orchestra.run.smithi090.stdout: "osdop_sparse_read": 0, 2024-05-08T05:34:09.865 INFO:teuthology.orchestra.run.smithi090.stdout: "osdop_clonerange": 0, 2024-05-08T05:34:09.865 INFO:teuthology.orchestra.run.smithi090.stdout: "osdop_getxattr": 1, 2024-05-08T05:34:09.865 INFO:teuthology.orchestra.run.smithi090.stdout: "osdop_setxattr": 0, 2024-05-08T05:34:09.865 INFO:teuthology.orchestra.run.smithi090.stdout: "osdop_cmpxattr": 0, 2024-05-08T05:34:09.865 INFO:teuthology.orchestra.run.smithi090.stdout: "osdop_rmxattr": 0, 2024-05-08T05:34:09.865 INFO:teuthology.orchestra.run.smithi090.stdout: "osdop_resetxattrs": 0, 2024-05-08T05:34:09.866 INFO:teuthology.orchestra.run.smithi090.stdout: "osdop_call": 0, 2024-05-08T05:34:09.866 INFO:teuthology.orchestra.run.smithi090.stdout: "osdop_watch": 0, 2024-05-08T05:34:09.866 INFO:teuthology.orchestra.run.smithi090.stdout: "osdop_notify": 0, 2024-05-08T05:34:09.866 INFO:teuthology.orchestra.run.smithi090.stdout: "osdop_src_cmpxattr": 0, 2024-05-08T05:34:09.866 INFO:teuthology.orchestra.run.smithi090.stdout: "osdop_pgls": 0, 2024-05-08T05:34:09.866 INFO:teuthology.orchestra.run.smithi090.stdout: "osdop_pgls_filter": 0, 2024-05-08T05:34:09.867 INFO:teuthology.orchestra.run.smithi090.stdout: "osdop_other": 0, 2024-05-08T05:34:09.867 INFO:teuthology.orchestra.run.smithi090.stdout: "linger_active": 0, 2024-05-08T05:34:09.867 INFO:teuthology.orchestra.run.smithi090.stdout: "linger_send": 0, 2024-05-08T05:34:09.867 INFO:teuthology.orchestra.run.smithi090.stdout: "linger_resend": 0, 2024-05-08T05:34:09.867 INFO:teuthology.orchestra.run.smithi090.stdout: "linger_ping": 0, 2024-05-08T05:34:09.867 INFO:teuthology.orchestra.run.smithi090.stdout: "poolop_active": 0, 2024-05-08T05:34:09.867 INFO:teuthology.orchestra.run.smithi090.stdout: "poolop_send": 0, 2024-05-08T05:34:09.868 INFO:teuthology.orchestra.run.smithi090.stdout: "poolop_resend": 0, 2024-05-08T05:34:09.868 INFO:teuthology.orchestra.run.smithi090.stdout: "poolstat_active": 0, 2024-05-08T05:34:09.868 INFO:teuthology.orchestra.run.smithi090.stdout: "poolstat_send": 0, 2024-05-08T05:34:09.868 INFO:teuthology.orchestra.run.smithi090.stdout: "poolstat_resend": 0, 2024-05-08T05:34:09.868 INFO:teuthology.orchestra.run.smithi090.stdout: "statfs_active": 0, 2024-05-08T05:34:09.868 INFO:teuthology.orchestra.run.smithi090.stdout: "statfs_send": 0, 2024-05-08T05:34:09.869 INFO:teuthology.orchestra.run.smithi090.stdout: "statfs_resend": 0, 2024-05-08T05:34:09.869 INFO:teuthology.orchestra.run.smithi090.stdout: "command_active": 0, 2024-05-08T05:34:09.869 INFO:teuthology.orchestra.run.smithi090.stdout: "command_send": 0, 2024-05-08T05:34:09.869 INFO:teuthology.orchestra.run.smithi090.stdout: "command_resend": 0, 2024-05-08T05:34:09.869 INFO:teuthology.orchestra.run.smithi090.stdout: "map_epoch": 82, 2024-05-08T05:34:09.869 INFO:teuthology.orchestra.run.smithi090.stdout: "map_full": 0, 2024-05-08T05:34:09.870 INFO:teuthology.orchestra.run.smithi090.stdout: "map_inc": 2, 2024-05-08T05:34:09.870 INFO:teuthology.orchestra.run.smithi090.stdout: "osd_sessions": 8, 2024-05-08T05:34:09.870 INFO:teuthology.orchestra.run.smithi090.stdout: "osd_session_open": 8, 2024-05-08T05:34:09.870 INFO:teuthology.orchestra.run.smithi090.stdout: "osd_session_close": 0, 2024-05-08T05:34:09.870 INFO:teuthology.orchestra.run.smithi090.stdout: "osd_laggy": 0, 2024-05-08T05:34:09.870 INFO:teuthology.orchestra.run.smithi090.stdout: "omap_wr": 0, 2024-05-08T05:34:09.871 INFO:teuthology.orchestra.run.smithi090.stdout: "omap_rd": 2, 2024-05-08T05:34:09.871 INFO:teuthology.orchestra.run.smithi090.stdout: "omap_del": 0 2024-05-08T05:34:09.871 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-05-08T05:34:09.871 INFO:teuthology.orchestra.run.smithi090.stdout: "oft": { 2024-05-08T05:34:09.871 INFO:teuthology.orchestra.run.smithi090.stdout: "omap_total_objs": 0, 2024-05-08T05:34:09.871 INFO:teuthology.orchestra.run.smithi090.stdout: "omap_total_kv_pairs": 0, 2024-05-08T05:34:09.871 INFO:teuthology.orchestra.run.smithi090.stdout: "omap_total_updates": 0, 2024-05-08T05:34:09.872 INFO:teuthology.orchestra.run.smithi090.stdout: "omap_total_removes": 0 2024-05-08T05:34:09.872 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-05-08T05:34:09.872 INFO:teuthology.orchestra.run.smithi090.stdout: "osd-slow-ops": { 2024-05-08T05:34:09.872 INFO:teuthology.orchestra.run.smithi090.stdout: "slow_ops_count": 0 2024-05-08T05:34:09.872 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-05-08T05:34:09.873 INFO:teuthology.orchestra.run.smithi090.stdout: "purge_queue": { 2024-05-08T05:34:09.873 INFO:teuthology.orchestra.run.smithi090.stdout: "pq_executing_ops": 0, 2024-05-08T05:34:09.873 INFO:teuthology.orchestra.run.smithi090.stdout: "pq_executing_ops_high_water": 0, 2024-05-08T05:34:09.873 INFO:teuthology.orchestra.run.smithi090.stdout: "pq_executing": 0, 2024-05-08T05:34:09.873 INFO:teuthology.orchestra.run.smithi090.stdout: "pq_executing_high_water": 0, 2024-05-08T05:34:09.873 INFO:teuthology.orchestra.run.smithi090.stdout: "pq_executed_ops": 0, 2024-05-08T05:34:09.874 INFO:teuthology.orchestra.run.smithi090.stdout: "pq_executed": 0, 2024-05-08T05:34:09.874 INFO:teuthology.orchestra.run.smithi090.stdout: "pq_item_in_journal": 0 2024-05-08T05:34:09.874 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-05-08T05:34:09.874 INFO:teuthology.orchestra.run.smithi090.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-05-08T05:34:09.874 INFO:teuthology.orchestra.run.smithi090.stdout: "val": 0, 2024-05-08T05:34:09.874 INFO:teuthology.orchestra.run.smithi090.stdout: "max": 104857600, 2024-05-08T05:34:09.874 INFO:teuthology.orchestra.run.smithi090.stdout: "get_started": 0, 2024-05-08T05:34:09.874 INFO:teuthology.orchestra.run.smithi090.stdout: "get": 1672, 2024-05-08T05:34:09.875 INFO:teuthology.orchestra.run.smithi090.stdout: "get_sum": 46920368, 2024-05-08T05:34:09.875 INFO:teuthology.orchestra.run.smithi090.stdout: "get_or_fail_fail": 0, 2024-05-08T05:34:09.875 INFO:teuthology.orchestra.run.smithi090.stdout: "get_or_fail_success": 1672, 2024-05-08T05:34:09.875 INFO:teuthology.orchestra.run.smithi090.stdout: "take": 0, 2024-05-08T05:34:09.875 INFO:teuthology.orchestra.run.smithi090.stdout: "take_sum": 0, 2024-05-08T05:34:09.875 INFO:teuthology.orchestra.run.smithi090.stdout: "put": 1672, 2024-05-08T05:34:09.875 INFO:teuthology.orchestra.run.smithi090.stdout: "put_sum": 46920368, 2024-05-08T05:34:09.875 INFO:teuthology.orchestra.run.smithi090.stdout: "wait": { 2024-05-08T05:34:09.876 INFO:teuthology.orchestra.run.smithi090.stdout: "avgcount": 0, 2024-05-08T05:34:09.876 INFO:teuthology.orchestra.run.smithi090.stdout: "sum": 0.000000000, 2024-05-08T05:34:09.876 INFO:teuthology.orchestra.run.smithi090.stdout: "avgtime": 0.000000000 2024-05-08T05:34:09.876 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-05-08T05:34:09.876 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-05-08T05:34:09.876 INFO:teuthology.orchestra.run.smithi090.stdout: "throttle-objecter_bytes": { 2024-05-08T05:34:09.876 INFO:teuthology.orchestra.run.smithi090.stdout: "val": 0, 2024-05-08T05:34:09.877 INFO:teuthology.orchestra.run.smithi090.stdout: "max": 104857600, 2024-05-08T05:34:09.877 INFO:teuthology.orchestra.run.smithi090.stdout: "get_started": 0, 2024-05-08T05:34:09.877 INFO:teuthology.orchestra.run.smithi090.stdout: "get": 0, 2024-05-08T05:34:09.877 INFO:teuthology.orchestra.run.smithi090.stdout: "get_sum": 0, 2024-05-08T05:34:09.877 INFO:teuthology.orchestra.run.smithi090.stdout: "get_or_fail_fail": 0, 2024-05-08T05:34:09.877 INFO:teuthology.orchestra.run.smithi090.stdout: "get_or_fail_success": 0, 2024-05-08T05:34:09.878 INFO:teuthology.orchestra.run.smithi090.stdout: "take": 1506, 2024-05-08T05:34:09.878 INFO:teuthology.orchestra.run.smithi090.stdout: "take_sum": 46119579, 2024-05-08T05:34:09.878 INFO:teuthology.orchestra.run.smithi090.stdout: "put": 1506, 2024-05-08T05:34:09.878 INFO:teuthology.orchestra.run.smithi090.stdout: "put_sum": 46119579, 2024-05-08T05:34:09.878 INFO:teuthology.orchestra.run.smithi090.stdout: "wait": { 2024-05-08T05:34:09.878 INFO:teuthology.orchestra.run.smithi090.stdout: "avgcount": 0, 2024-05-08T05:34:09.879 INFO:teuthology.orchestra.run.smithi090.stdout: "sum": 0.000000000, 2024-05-08T05:34:09.879 INFO:teuthology.orchestra.run.smithi090.stdout: "avgtime": 0.000000000 2024-05-08T05:34:09.879 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-05-08T05:34:09.879 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-05-08T05:34:09.879 INFO:teuthology.orchestra.run.smithi090.stdout: "throttle-objecter_ops": { 2024-05-08T05:34:09.879 INFO:teuthology.orchestra.run.smithi090.stdout: "val": 0, 2024-05-08T05:34:09.880 INFO:teuthology.orchestra.run.smithi090.stdout: "max": 1024, 2024-05-08T05:34:09.880 INFO:teuthology.orchestra.run.smithi090.stdout: "get_started": 0, 2024-05-08T05:34:09.880 INFO:teuthology.orchestra.run.smithi090.stdout: "get": 0, 2024-05-08T05:34:09.880 INFO:teuthology.orchestra.run.smithi090.stdout: "get_sum": 0, 2024-05-08T05:34:09.880 INFO:teuthology.orchestra.run.smithi090.stdout: "get_or_fail_fail": 0, 2024-05-08T05:34:09.880 INFO:teuthology.orchestra.run.smithi090.stdout: "get_or_fail_success": 0, 2024-05-08T05:34:09.881 INFO:teuthology.orchestra.run.smithi090.stdout: "take": 1506, 2024-05-08T05:34:09.881 INFO:teuthology.orchestra.run.smithi090.stdout: "take_sum": 1506, 2024-05-08T05:34:09.881 INFO:teuthology.orchestra.run.smithi090.stdout: "put": 1506, 2024-05-08T05:34:09.881 INFO:teuthology.orchestra.run.smithi090.stdout: "put_sum": 1506, 2024-05-08T05:34:09.881 INFO:teuthology.orchestra.run.smithi090.stdout: "wait": { 2024-05-08T05:34:09.881 INFO:teuthology.orchestra.run.smithi090.stdout: "avgcount": 0, 2024-05-08T05:34:09.882 INFO:teuthology.orchestra.run.smithi090.stdout: "sum": 0.000000000, 2024-05-08T05:34:09.882 INFO:teuthology.orchestra.run.smithi090.stdout: "avgtime": 0.000000000 2024-05-08T05:34:09.882 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-05-08T05:34:09.882 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-05-08T05:34:09.882 INFO:teuthology.orchestra.run.smithi090.stdout: "throttle-write_buf_throttle": { 2024-05-08T05:34:09.883 INFO:teuthology.orchestra.run.smithi090.stdout: "val": 0, 2024-05-08T05:34:09.883 INFO:teuthology.orchestra.run.smithi090.stdout: "max": 3758096384, 2024-05-08T05:34:09.883 INFO:teuthology.orchestra.run.smithi090.stdout: "get_started": 0, 2024-05-08T05:34:09.883 INFO:teuthology.orchestra.run.smithi090.stdout: "get": 0, 2024-05-08T05:34:09.883 INFO:teuthology.orchestra.run.smithi090.stdout: "get_sum": 0, 2024-05-08T05:34:09.883 INFO:teuthology.orchestra.run.smithi090.stdout: "get_or_fail_fail": 0, 2024-05-08T05:34:09.883 INFO:teuthology.orchestra.run.smithi090.stdout: "get_or_fail_success": 0, 2024-05-08T05:34:09.884 INFO:teuthology.orchestra.run.smithi090.stdout: "take": 0, 2024-05-08T05:34:09.884 INFO:teuthology.orchestra.run.smithi090.stdout: "take_sum": 0, 2024-05-08T05:34:09.884 INFO:teuthology.orchestra.run.smithi090.stdout: "put": 0, 2024-05-08T05:34:09.884 INFO:teuthology.orchestra.run.smithi090.stdout: "put_sum": 0, 2024-05-08T05:34:09.884 INFO:teuthology.orchestra.run.smithi090.stdout: "wait": { 2024-05-08T05:34:09.884 INFO:teuthology.orchestra.run.smithi090.stdout: "avgcount": 0, 2024-05-08T05:34:09.885 INFO:teuthology.orchestra.run.smithi090.stdout: "sum": 0.000000000, 2024-05-08T05:34:09.885 INFO:teuthology.orchestra.run.smithi090.stdout: "avgtime": 0.000000000 2024-05-08T05:34:09.885 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-05-08T05:34:09.885 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-05-08T05:34:09.885 INFO:teuthology.orchestra.run.smithi090.stdout: "throttle-write_buf_throttle-0x562ee963e6e0": { 2024-05-08T05:34:09.885 INFO:teuthology.orchestra.run.smithi090.stdout: "val": 0, 2024-05-08T05:34:09.885 INFO:teuthology.orchestra.run.smithi090.stdout: "max": 3758096384, 2024-05-08T05:34:09.886 INFO:teuthology.orchestra.run.smithi090.stdout: "get_started": 0, 2024-05-08T05:34:09.886 INFO:teuthology.orchestra.run.smithi090.stdout: "get": 0, 2024-05-08T05:34:09.886 INFO:teuthology.orchestra.run.smithi090.stdout: "get_sum": 0, 2024-05-08T05:34:09.886 INFO:teuthology.orchestra.run.smithi090.stdout: "get_or_fail_fail": 0, 2024-05-08T05:34:09.886 INFO:teuthology.orchestra.run.smithi090.stdout: "get_or_fail_success": 0, 2024-05-08T05:34:09.886 INFO:teuthology.orchestra.run.smithi090.stdout: "take": 0, 2024-05-08T05:34:09.887 INFO:teuthology.orchestra.run.smithi090.stdout: "take_sum": 0, 2024-05-08T05:34:09.887 INFO:teuthology.orchestra.run.smithi090.stdout: "put": 0, 2024-05-08T05:34:09.887 INFO:teuthology.orchestra.run.smithi090.stdout: "put_sum": 0, 2024-05-08T05:34:09.887 INFO:teuthology.orchestra.run.smithi090.stdout: "wait": { 2024-05-08T05:34:09.887 INFO:teuthology.orchestra.run.smithi090.stdout: "avgcount": 0, 2024-05-08T05:34:09.887 INFO:teuthology.orchestra.run.smithi090.stdout: "sum": 0.000000000, 2024-05-08T05:34:09.887 INFO:teuthology.orchestra.run.smithi090.stdout: "avgtime": 0.000000000 2024-05-08T05:34:09.888 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-05-08T05:34:09.888 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-05-08T05:34:09.888 INFO:teuthology.orchestra.run.smithi090.stdout:} 2024-05-08T05:34:10.518 INFO:tasks.check_counter:Daemon mds.h mds.exported=0 2024-05-08T05:34:10.519 INFO:tasks.check_counter:Daemon mds.h mds.imported=0 2024-05-08T05:34:10.519 INFO:tasks.check_counter:Daemon mds.h mds_cache.dir_update=0 2024-05-08T05:34:10.519 INFO:tasks.check_counter:Daemon mds.h mds_cache.dir_update_receipt=0 2024-05-08T05:34:10.519 DEBUG:tasks.check_counter:Getting stats from k 2024-05-08T05:34:10.520 DEBUG:teuthology.orchestra.run.smithi090:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid eeeb813e-0cf9-11ef-bc97-c7b262605968 -- ceph daemon mds.k perf dump 2024-05-08T05:34:10.759 INFO:teuthology.orchestra.run.smithi090.stderr:Inferring config /var/lib/ceph/eeeb813e-0cf9-11ef-bc97-c7b262605968/mon.b/config 2024-05-08T05:34:10.880 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:34:10 smithi090 ceph-mon[34526]: pgmap v575: 97 pgs: 97 active+clean; 153 MiB data, 1004 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 8 op/s 2024-05-08T05:34:10.958 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:34:10 smithi087 ceph-mon[29523]: pgmap v575: 97 pgs: 97 active+clean; 153 MiB data, 1004 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 8 op/s 2024-05-08T05:34:11.038 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:34:10 smithi160 ceph-mon[34827]: pgmap v575: 97 pgs: 97 active+clean; 153 MiB data, 1004 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 8 op/s 2024-05-08T05:34:12.522 INFO:teuthology.orchestra.run.smithi090.stdout:{ 2024-05-08T05:34:12.522 INFO:teuthology.orchestra.run.smithi090.stdout: "AsyncMessenger::Worker-0": { 2024-05-08T05:34:12.522 INFO:teuthology.orchestra.run.smithi090.stdout: "msgr_recv_messages": 0, 2024-05-08T05:34:12.522 INFO:teuthology.orchestra.run.smithi090.stdout: "msgr_send_messages": 2, 2024-05-08T05:34:12.522 INFO:teuthology.orchestra.run.smithi090.stdout: "msgr_recv_bytes": 0, 2024-05-08T05:34:12.522 INFO:teuthology.orchestra.run.smithi090.stdout: "msgr_send_bytes": 0, 2024-05-08T05:34:12.523 INFO:teuthology.orchestra.run.smithi090.stdout: "msgr_created_connections": 4, 2024-05-08T05:34:12.523 INFO:teuthology.orchestra.run.smithi090.stdout: "msgr_active_connections": 0, 2024-05-08T05:34:12.523 INFO:teuthology.orchestra.run.smithi090.stdout: "msgr_running_total_time": 0.000873827, 2024-05-08T05:34:12.523 INFO:teuthology.orchestra.run.smithi090.stdout: "msgr_running_send_time": 0.000000000, 2024-05-08T05:34:12.523 INFO:teuthology.orchestra.run.smithi090.stdout: "msgr_running_recv_time": 0.000111204, 2024-05-08T05:34:12.523 INFO:teuthology.orchestra.run.smithi090.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-05-08T05:34:12.523 INFO:teuthology.orchestra.run.smithi090.stdout: "msgr_send_messages_queue_lat": { 2024-05-08T05:34:12.523 INFO:teuthology.orchestra.run.smithi090.stdout: "avgcount": 0, 2024-05-08T05:34:12.523 INFO:teuthology.orchestra.run.smithi090.stdout: "sum": 0.000000000, 2024-05-08T05:34:12.523 INFO:teuthology.orchestra.run.smithi090.stdout: "avgtime": 0.000000000 2024-05-08T05:34:12.523 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-05-08T05:34:12.523 INFO:teuthology.orchestra.run.smithi090.stdout: "msgr_handle_ack_lat": { 2024-05-08T05:34:12.523 INFO:teuthology.orchestra.run.smithi090.stdout: "avgcount": 0, 2024-05-08T05:34:12.523 INFO:teuthology.orchestra.run.smithi090.stdout: "sum": 0.000000000, 2024-05-08T05:34:12.523 INFO:teuthology.orchestra.run.smithi090.stdout: "avgtime": 0.000000000 2024-05-08T05:34:12.523 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-05-08T05:34:12.524 INFO:teuthology.orchestra.run.smithi090.stdout: "msgr_recv_encrypted_bytes": 0, 2024-05-08T05:34:12.524 INFO:teuthology.orchestra.run.smithi090.stdout: "msgr_send_encrypted_bytes": 0 2024-05-08T05:34:12.524 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-05-08T05:34:12.524 INFO:teuthology.orchestra.run.smithi090.stdout: "AsyncMessenger::Worker-1": { 2024-05-08T05:34:12.524 INFO:teuthology.orchestra.run.smithi090.stdout: "msgr_recv_messages": 1, 2024-05-08T05:34:12.524 INFO:teuthology.orchestra.run.smithi090.stdout: "msgr_send_messages": 118, 2024-05-08T05:34:12.524 INFO:teuthology.orchestra.run.smithi090.stdout: "msgr_recv_bytes": 160, 2024-05-08T05:34:12.524 INFO:teuthology.orchestra.run.smithi090.stdout: "msgr_send_bytes": 99312, 2024-05-08T05:34:12.524 INFO:teuthology.orchestra.run.smithi090.stdout: "msgr_created_connections": 3, 2024-05-08T05:34:12.524 INFO:teuthology.orchestra.run.smithi090.stdout: "msgr_active_connections": 2, 2024-05-08T05:34:12.524 INFO:teuthology.orchestra.run.smithi090.stdout: "msgr_running_total_time": 0.007317244, 2024-05-08T05:34:12.524 INFO:teuthology.orchestra.run.smithi090.stdout: "msgr_running_send_time": 0.005466830, 2024-05-08T05:34:12.524 INFO:teuthology.orchestra.run.smithi090.stdout: "msgr_running_recv_time": 0.000490114, 2024-05-08T05:34:12.524 INFO:teuthology.orchestra.run.smithi090.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-05-08T05:34:12.524 INFO:teuthology.orchestra.run.smithi090.stdout: "msgr_send_messages_queue_lat": { 2024-05-08T05:34:12.524 INFO:teuthology.orchestra.run.smithi090.stdout: "avgcount": 116, 2024-05-08T05:34:12.525 INFO:teuthology.orchestra.run.smithi090.stdout: "sum": 0.007857427, 2024-05-08T05:34:12.525 INFO:teuthology.orchestra.run.smithi090.stdout: "avgtime": 0.000067736 2024-05-08T05:34:12.525 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-05-08T05:34:12.525 INFO:teuthology.orchestra.run.smithi090.stdout: "msgr_handle_ack_lat": { 2024-05-08T05:34:12.525 INFO:teuthology.orchestra.run.smithi090.stdout: "avgcount": 0, 2024-05-08T05:34:12.525 INFO:teuthology.orchestra.run.smithi090.stdout: "sum": 0.000000000, 2024-05-08T05:34:12.525 INFO:teuthology.orchestra.run.smithi090.stdout: "avgtime": 0.000000000 2024-05-08T05:34:12.525 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-05-08T05:34:12.525 INFO:teuthology.orchestra.run.smithi090.stdout: "msgr_recv_encrypted_bytes": 160, 2024-05-08T05:34:12.525 INFO:teuthology.orchestra.run.smithi090.stdout: "msgr_send_encrypted_bytes": 99312 2024-05-08T05:34:12.525 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-05-08T05:34:12.525 INFO:teuthology.orchestra.run.smithi090.stdout: "AsyncMessenger::Worker-2": { 2024-05-08T05:34:12.525 INFO:teuthology.orchestra.run.smithi090.stdout: "msgr_recv_messages": 163, 2024-05-08T05:34:12.525 INFO:teuthology.orchestra.run.smithi090.stdout: "msgr_send_messages": 158, 2024-05-08T05:34:12.525 INFO:teuthology.orchestra.run.smithi090.stdout: "msgr_recv_bytes": 499632, 2024-05-08T05:34:12.526 INFO:teuthology.orchestra.run.smithi090.stdout: "msgr_send_bytes": 95856, 2024-05-08T05:34:12.526 INFO:teuthology.orchestra.run.smithi090.stdout: "msgr_created_connections": 2, 2024-05-08T05:34:12.526 INFO:teuthology.orchestra.run.smithi090.stdout: "msgr_active_connections": 1, 2024-05-08T05:34:12.526 INFO:teuthology.orchestra.run.smithi090.stdout: "msgr_running_total_time": 0.026561342, 2024-05-08T05:34:12.526 INFO:teuthology.orchestra.run.smithi090.stdout: "msgr_running_send_time": 0.009453041, 2024-05-08T05:34:12.526 INFO:teuthology.orchestra.run.smithi090.stdout: "msgr_running_recv_time": 0.014047271, 2024-05-08T05:34:12.526 INFO:teuthology.orchestra.run.smithi090.stdout: "msgr_running_fast_dispatch_time": 0.004011016, 2024-05-08T05:34:12.526 INFO:teuthology.orchestra.run.smithi090.stdout: "msgr_send_messages_queue_lat": { 2024-05-08T05:34:12.526 INFO:teuthology.orchestra.run.smithi090.stdout: "avgcount": 158, 2024-05-08T05:34:12.526 INFO:teuthology.orchestra.run.smithi090.stdout: "sum": 0.008100901, 2024-05-08T05:34:12.526 INFO:teuthology.orchestra.run.smithi090.stdout: "avgtime": 0.000051271 2024-05-08T05:34:12.526 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-05-08T05:34:12.526 INFO:teuthology.orchestra.run.smithi090.stdout: "msgr_handle_ack_lat": { 2024-05-08T05:34:12.526 INFO:teuthology.orchestra.run.smithi090.stdout: "avgcount": 0, 2024-05-08T05:34:12.526 INFO:teuthology.orchestra.run.smithi090.stdout: "sum": 0.000000000, 2024-05-08T05:34:12.527 INFO:teuthology.orchestra.run.smithi090.stdout: "avgtime": 0.000000000 2024-05-08T05:34:12.527 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-05-08T05:34:12.527 INFO:teuthology.orchestra.run.smithi090.stdout: "msgr_recv_encrypted_bytes": 499632, 2024-05-08T05:34:12.527 INFO:teuthology.orchestra.run.smithi090.stdout: "msgr_send_encrypted_bytes": 95856 2024-05-08T05:34:12.527 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-05-08T05:34:12.527 INFO:teuthology.orchestra.run.smithi090.stdout: "cct": { 2024-05-08T05:34:12.527 INFO:teuthology.orchestra.run.smithi090.stdout: "total_workers": 0, 2024-05-08T05:34:12.527 INFO:teuthology.orchestra.run.smithi090.stdout: "unhealthy_workers": 0 2024-05-08T05:34:12.527 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-05-08T05:34:12.527 INFO:teuthology.orchestra.run.smithi090.stdout: "mempool": { 2024-05-08T05:34:12.527 INFO:teuthology.orchestra.run.smithi090.stdout: "bloom_filter_bytes": 0, 2024-05-08T05:34:12.527 INFO:teuthology.orchestra.run.smithi090.stdout: "bloom_filter_items": 0, 2024-05-08T05:34:12.527 INFO:teuthology.orchestra.run.smithi090.stdout: "bluestore_alloc_bytes": 0, 2024-05-08T05:34:12.527 INFO:teuthology.orchestra.run.smithi090.stdout: "bluestore_alloc_items": 0, 2024-05-08T05:34:12.527 INFO:teuthology.orchestra.run.smithi090.stdout: "bluestore_cache_data_bytes": 0, 2024-05-08T05:34:12.528 INFO:teuthology.orchestra.run.smithi090.stdout: "bluestore_cache_data_items": 0, 2024-05-08T05:34:12.528 INFO:teuthology.orchestra.run.smithi090.stdout: "bluestore_cache_onode_bytes": 0, 2024-05-08T05:34:12.528 INFO:teuthology.orchestra.run.smithi090.stdout: "bluestore_cache_onode_items": 0, 2024-05-08T05:34:12.528 INFO:teuthology.orchestra.run.smithi090.stdout: "bluestore_cache_meta_bytes": 0, 2024-05-08T05:34:12.528 INFO:teuthology.orchestra.run.smithi090.stdout: "bluestore_cache_meta_items": 0, 2024-05-08T05:34:12.528 INFO:teuthology.orchestra.run.smithi090.stdout: "bluestore_cache_other_bytes": 0, 2024-05-08T05:34:12.528 INFO:teuthology.orchestra.run.smithi090.stdout: "bluestore_cache_other_items": 0, 2024-05-08T05:34:12.528 INFO:teuthology.orchestra.run.smithi090.stdout: "bluestore_cache_buffer_bytes": 0, 2024-05-08T05:34:12.528 INFO:teuthology.orchestra.run.smithi090.stdout: "bluestore_cache_buffer_items": 0, 2024-05-08T05:34:12.528 INFO:teuthology.orchestra.run.smithi090.stdout: "bluestore_extent_bytes": 0, 2024-05-08T05:34:12.528 INFO:teuthology.orchestra.run.smithi090.stdout: "bluestore_extent_items": 0, 2024-05-08T05:34:12.528 INFO:teuthology.orchestra.run.smithi090.stdout: "bluestore_blob_bytes": 0, 2024-05-08T05:34:12.528 INFO:teuthology.orchestra.run.smithi090.stdout: "bluestore_blob_items": 0, 2024-05-08T05:34:12.528 INFO:teuthology.orchestra.run.smithi090.stdout: "bluestore_shared_blob_bytes": 0, 2024-05-08T05:34:12.528 INFO:teuthology.orchestra.run.smithi090.stdout: "bluestore_shared_blob_items": 0, 2024-05-08T05:34:12.529 INFO:teuthology.orchestra.run.smithi090.stdout: "bluestore_inline_bl_bytes": 0, 2024-05-08T05:34:12.529 INFO:teuthology.orchestra.run.smithi090.stdout: "bluestore_inline_bl_items": 0, 2024-05-08T05:34:12.529 INFO:teuthology.orchestra.run.smithi090.stdout: "bluestore_fsck_bytes": 0, 2024-05-08T05:34:12.529 INFO:teuthology.orchestra.run.smithi090.stdout: "bluestore_fsck_items": 0, 2024-05-08T05:34:12.529 INFO:teuthology.orchestra.run.smithi090.stdout: "bluestore_txc_bytes": 0, 2024-05-08T05:34:12.529 INFO:teuthology.orchestra.run.smithi090.stdout: "bluestore_txc_items": 0, 2024-05-08T05:34:12.529 INFO:teuthology.orchestra.run.smithi090.stdout: "bluestore_writing_deferred_bytes": 0, 2024-05-08T05:34:12.529 INFO:teuthology.orchestra.run.smithi090.stdout: "bluestore_writing_deferred_items": 0, 2024-05-08T05:34:12.529 INFO:teuthology.orchestra.run.smithi090.stdout: "bluestore_writing_bytes": 0, 2024-05-08T05:34:12.529 INFO:teuthology.orchestra.run.smithi090.stdout: "bluestore_writing_items": 0, 2024-05-08T05:34:12.529 INFO:teuthology.orchestra.run.smithi090.stdout: "bluefs_bytes": 0, 2024-05-08T05:34:12.529 INFO:teuthology.orchestra.run.smithi090.stdout: "bluefs_items": 0, 2024-05-08T05:34:12.529 INFO:teuthology.orchestra.run.smithi090.stdout: "bluefs_file_reader_bytes": 0, 2024-05-08T05:34:12.529 INFO:teuthology.orchestra.run.smithi090.stdout: "bluefs_file_reader_items": 0, 2024-05-08T05:34:12.530 INFO:teuthology.orchestra.run.smithi090.stdout: "bluefs_file_writer_bytes": 0, 2024-05-08T05:34:12.530 INFO:teuthology.orchestra.run.smithi090.stdout: "bluefs_file_writer_items": 0, 2024-05-08T05:34:12.530 INFO:teuthology.orchestra.run.smithi090.stdout: "buffer_anon_bytes": 148945, 2024-05-08T05:34:12.530 INFO:teuthology.orchestra.run.smithi090.stdout: "buffer_anon_items": 29, 2024-05-08T05:34:12.530 INFO:teuthology.orchestra.run.smithi090.stdout: "buffer_meta_bytes": 0, 2024-05-08T05:34:12.530 INFO:teuthology.orchestra.run.smithi090.stdout: "buffer_meta_items": 0, 2024-05-08T05:34:12.530 INFO:teuthology.orchestra.run.smithi090.stdout: "osd_bytes": 0, 2024-05-08T05:34:12.530 INFO:teuthology.orchestra.run.smithi090.stdout: "osd_items": 0, 2024-05-08T05:34:12.530 INFO:teuthology.orchestra.run.smithi090.stdout: "osd_mapbl_bytes": 0, 2024-05-08T05:34:12.530 INFO:teuthology.orchestra.run.smithi090.stdout: "osd_mapbl_items": 0, 2024-05-08T05:34:12.530 INFO:teuthology.orchestra.run.smithi090.stdout: "osd_pglog_bytes": 0, 2024-05-08T05:34:12.530 INFO:teuthology.orchestra.run.smithi090.stdout: "osd_pglog_items": 0, 2024-05-08T05:34:12.530 INFO:teuthology.orchestra.run.smithi090.stdout: "osdmap_bytes": 0, 2024-05-08T05:34:12.530 INFO:teuthology.orchestra.run.smithi090.stdout: "osdmap_items": 0, 2024-05-08T05:34:12.530 INFO:teuthology.orchestra.run.smithi090.stdout: "osdmap_mapping_bytes": 0, 2024-05-08T05:34:12.531 INFO:teuthology.orchestra.run.smithi090.stdout: "osdmap_mapping_items": 0, 2024-05-08T05:34:12.531 INFO:teuthology.orchestra.run.smithi090.stdout: "pgmap_bytes": 0, 2024-05-08T05:34:12.531 INFO:teuthology.orchestra.run.smithi090.stdout: "pgmap_items": 0, 2024-05-08T05:34:12.531 INFO:teuthology.orchestra.run.smithi090.stdout: "mds_co_bytes": 928, 2024-05-08T05:34:12.531 INFO:teuthology.orchestra.run.smithi090.stdout: "mds_co_items": 2, 2024-05-08T05:34:12.531 INFO:teuthology.orchestra.run.smithi090.stdout: "unittest_1_bytes": 0, 2024-05-08T05:34:12.531 INFO:teuthology.orchestra.run.smithi090.stdout: "unittest_1_items": 0, 2024-05-08T05:34:12.531 INFO:teuthology.orchestra.run.smithi090.stdout: "unittest_2_bytes": 0, 2024-05-08T05:34:12.531 INFO:teuthology.orchestra.run.smithi090.stdout: "unittest_2_items": 0 2024-05-08T05:34:12.531 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-05-08T05:34:12.531 INFO:teuthology.orchestra.run.smithi090.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-05-08T05:34:12.531 INFO:teuthology.orchestra.run.smithi090.stdout: "val": 0, 2024-05-08T05:34:12.531 INFO:teuthology.orchestra.run.smithi090.stdout: "max": 104857600, 2024-05-08T05:34:12.531 INFO:teuthology.orchestra.run.smithi090.stdout: "get_started": 0, 2024-05-08T05:34:12.531 INFO:teuthology.orchestra.run.smithi090.stdout: "get": 160, 2024-05-08T05:34:12.532 INFO:teuthology.orchestra.run.smithi090.stdout: "get_sum": 474184, 2024-05-08T05:34:12.532 INFO:teuthology.orchestra.run.smithi090.stdout: "get_or_fail_fail": 0, 2024-05-08T05:34:12.532 INFO:teuthology.orchestra.run.smithi090.stdout: "get_or_fail_success": 160, 2024-05-08T05:34:12.532 INFO:teuthology.orchestra.run.smithi090.stdout: "take": 0, 2024-05-08T05:34:12.532 INFO:teuthology.orchestra.run.smithi090.stdout: "take_sum": 0, 2024-05-08T05:34:12.532 INFO:teuthology.orchestra.run.smithi090.stdout: "put": 160, 2024-05-08T05:34:12.532 INFO:teuthology.orchestra.run.smithi090.stdout: "put_sum": 474184, 2024-05-08T05:34:12.532 INFO:teuthology.orchestra.run.smithi090.stdout: "wait": { 2024-05-08T05:34:12.532 INFO:teuthology.orchestra.run.smithi090.stdout: "avgcount": 0, 2024-05-08T05:34:12.532 INFO:teuthology.orchestra.run.smithi090.stdout: "sum": 0.000000000, 2024-05-08T05:34:12.532 INFO:teuthology.orchestra.run.smithi090.stdout: "avgtime": 0.000000000 2024-05-08T05:34:12.532 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-05-08T05:34:12.532 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-05-08T05:34:12.532 INFO:teuthology.orchestra.run.smithi090.stdout:} 2024-05-08T05:34:12.733 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:34:12 smithi090 ceph-mon[34526]: pgmap v576: 97 pgs: 97 active+clean; 153 MiB data, 1004 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 6 op/s 2024-05-08T05:34:12.958 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:34:12 smithi087 ceph-mon[29523]: pgmap v576: 97 pgs: 97 active+clean; 153 MiB data, 1004 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 6 op/s 2024-05-08T05:34:13.038 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:34:12 smithi160 ceph-mon[34827]: pgmap v576: 97 pgs: 97 active+clean; 153 MiB data, 1004 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 6 op/s 2024-05-08T05:34:13.194 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.k 2024-05-08T05:34:13.194 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.k 2024-05-08T05:34:13.194 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update' not found on daemon mds.k 2024-05-08T05:34:13.194 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update_receipt' not found on daemon mds.k 2024-05-08T05:34:13.194 DEBUG:tasks.check_counter:Getting stats from c 2024-05-08T05:34:13.194 DEBUG:teuthology.orchestra.run.smithi160:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid eeeb813e-0cf9-11ef-bc97-c7b262605968 -- ceph daemon mds.c perf dump 2024-05-08T05:34:13.446 INFO:teuthology.orchestra.run.smithi160.stderr:Inferring config /var/lib/ceph/eeeb813e-0cf9-11ef-bc97-c7b262605968/mon.c/config 2024-05-08T05:34:14.834 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:34:14 smithi160 ceph-mon[34827]: pgmap v577: 97 pgs: 97 active+clean; 153 MiB data, 1004 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 7 op/s 2024-05-08T05:34:14.958 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:34:14 smithi087 ceph-mon[29523]: pgmap v577: 97 pgs: 97 active+clean; 153 MiB data, 1004 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 7 op/s 2024-05-08T05:34:14.983 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:34:14 smithi090 ceph-mon[34526]: pgmap v577: 97 pgs: 97 active+clean; 153 MiB data, 1004 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 7 op/s 2024-05-08T05:34:15.364 INFO:teuthology.orchestra.run.smithi160.stdout:{ 2024-05-08T05:34:15.364 INFO:teuthology.orchestra.run.smithi160.stdout: "AsyncMessenger::Worker-0": { 2024-05-08T05:34:15.364 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_recv_messages": 937, 2024-05-08T05:34:15.364 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_send_messages": 939, 2024-05-08T05:34:15.364 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_recv_bytes": 25449247, 2024-05-08T05:34:15.364 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_send_bytes": 297976, 2024-05-08T05:34:15.364 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_created_connections": 7, 2024-05-08T05:34:15.365 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_active_connections": 3, 2024-05-08T05:34:15.365 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_running_total_time": 0.103877536, 2024-05-08T05:34:15.365 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_running_send_time": 0.028430907, 2024-05-08T05:34:15.365 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_running_recv_time": 0.035925958, 2024-05-08T05:34:15.365 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_running_fast_dispatch_time": 0.030613224, 2024-05-08T05:34:15.365 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_send_messages_queue_lat": { 2024-05-08T05:34:15.365 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 937, 2024-05-08T05:34:15.365 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.038084078, 2024-05-08T05:34:15.365 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000040644 2024-05-08T05:34:15.365 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-05-08T05:34:15.365 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_handle_ack_lat": { 2024-05-08T05:34:15.365 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 0, 2024-05-08T05:34:15.365 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000000000, 2024-05-08T05:34:15.366 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000000 2024-05-08T05:34:15.366 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-05-08T05:34:15.366 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_recv_encrypted_bytes": 0, 2024-05-08T05:34:15.366 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_send_encrypted_bytes": 0 2024-05-08T05:34:15.366 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-05-08T05:34:15.366 INFO:teuthology.orchestra.run.smithi160.stdout: "AsyncMessenger::Worker-1": { 2024-05-08T05:34:15.366 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_recv_messages": 177, 2024-05-08T05:34:15.366 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_send_messages": 291, 2024-05-08T05:34:15.366 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_recv_bytes": 21814366, 2024-05-08T05:34:15.366 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_send_bytes": 404594, 2024-05-08T05:34:15.366 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_created_connections": 7, 2024-05-08T05:34:15.366 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_active_connections": 5, 2024-05-08T05:34:15.366 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_running_total_time": 0.031563123, 2024-05-08T05:34:15.367 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_running_send_time": 0.008227972, 2024-05-08T05:34:15.367 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_running_recv_time": 0.016821037, 2024-05-08T05:34:15.367 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_running_fast_dispatch_time": 0.004175408, 2024-05-08T05:34:15.367 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_send_messages_queue_lat": { 2024-05-08T05:34:15.367 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 289, 2024-05-08T05:34:15.367 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.018321869, 2024-05-08T05:34:15.367 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000063397 2024-05-08T05:34:15.367 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-05-08T05:34:15.367 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_handle_ack_lat": { 2024-05-08T05:34:15.367 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 0, 2024-05-08T05:34:15.367 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000000000, 2024-05-08T05:34:15.367 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000000 2024-05-08T05:34:15.367 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-05-08T05:34:15.367 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_recv_encrypted_bytes": 160, 2024-05-08T05:34:15.368 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_send_encrypted_bytes": 348560 2024-05-08T05:34:15.368 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-05-08T05:34:15.368 INFO:teuthology.orchestra.run.smithi160.stdout: "AsyncMessenger::Worker-2": { 2024-05-08T05:34:15.368 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_recv_messages": 733, 2024-05-08T05:34:15.368 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_send_messages": 722, 2024-05-08T05:34:15.368 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_recv_bytes": 21652959, 2024-05-08T05:34:15.368 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_send_bytes": 272399, 2024-05-08T05:34:15.368 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_created_connections": 5, 2024-05-08T05:34:15.368 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_active_connections": 4, 2024-05-08T05:34:15.368 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_running_total_time": 0.084494729, 2024-05-08T05:34:15.368 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_running_send_time": 0.026560580, 2024-05-08T05:34:15.368 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_running_recv_time": 0.035338826, 2024-05-08T05:34:15.368 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_running_fast_dispatch_time": 0.019827105, 2024-05-08T05:34:15.369 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_send_messages_queue_lat": { 2024-05-08T05:34:15.369 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 722, 2024-05-08T05:34:15.369 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.031062181, 2024-05-08T05:34:15.369 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000043022 2024-05-08T05:34:15.369 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-05-08T05:34:15.369 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_handle_ack_lat": { 2024-05-08T05:34:15.369 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 0, 2024-05-08T05:34:15.369 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000000000, 2024-05-08T05:34:15.369 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000000 2024-05-08T05:34:15.369 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-05-08T05:34:15.369 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_recv_encrypted_bytes": 538608, 2024-05-08T05:34:15.369 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_send_encrypted_bytes": 94000 2024-05-08T05:34:15.369 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-05-08T05:34:15.369 INFO:teuthology.orchestra.run.smithi160.stdout: "cct": { 2024-05-08T05:34:15.370 INFO:teuthology.orchestra.run.smithi160.stdout: "total_workers": 1, 2024-05-08T05:34:15.370 INFO:teuthology.orchestra.run.smithi160.stdout: "unhealthy_workers": 0 2024-05-08T05:34:15.370 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-05-08T05:34:15.370 INFO:teuthology.orchestra.run.smithi160.stdout: "finisher-MDSRank": { 2024-05-08T05:34:15.370 INFO:teuthology.orchestra.run.smithi160.stdout: "queue_len": 0, 2024-05-08T05:34:15.370 INFO:teuthology.orchestra.run.smithi160.stdout: "complete_latency": { 2024-05-08T05:34:15.370 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 2706, 2024-05-08T05:34:15.370 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.077160234, 2024-05-08T05:34:15.370 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000028514 2024-05-08T05:34:15.371 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-05-08T05:34:15.371 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-05-08T05:34:15.371 INFO:teuthology.orchestra.run.smithi160.stdout: "finisher-PurgeQueue": { 2024-05-08T05:34:15.371 INFO:teuthology.orchestra.run.smithi160.stdout: "queue_len": 0, 2024-05-08T05:34:15.371 INFO:teuthology.orchestra.run.smithi160.stdout: "complete_latency": { 2024-05-08T05:34:15.371 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 0, 2024-05-08T05:34:15.371 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000000000, 2024-05-08T05:34:15.371 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000000 2024-05-08T05:34:15.371 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-05-08T05:34:15.371 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-05-08T05:34:15.371 INFO:teuthology.orchestra.run.smithi160.stdout: "mds": { 2024-05-08T05:34:15.371 INFO:teuthology.orchestra.run.smithi160.stdout: "request": 0, 2024-05-08T05:34:15.371 INFO:teuthology.orchestra.run.smithi160.stdout: "reply": 0, 2024-05-08T05:34:15.371 INFO:teuthology.orchestra.run.smithi160.stdout: "reply_latency": { 2024-05-08T05:34:15.372 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 0, 2024-05-08T05:34:15.372 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000000000, 2024-05-08T05:34:15.372 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000000 2024-05-08T05:34:15.372 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-05-08T05:34:15.372 INFO:teuthology.orchestra.run.smithi160.stdout: "slow_reply": 0, 2024-05-08T05:34:15.372 INFO:teuthology.orchestra.run.smithi160.stdout: "forward": 0, 2024-05-08T05:34:15.372 INFO:teuthology.orchestra.run.smithi160.stdout: "dir_fetch_complete": 0, 2024-05-08T05:34:15.372 INFO:teuthology.orchestra.run.smithi160.stdout: "dir_fetch_keys": 0, 2024-05-08T05:34:15.372 INFO:teuthology.orchestra.run.smithi160.stdout: "dir_commit": 0, 2024-05-08T05:34:15.372 INFO:teuthology.orchestra.run.smithi160.stdout: "dir_split": 0, 2024-05-08T05:34:15.372 INFO:teuthology.orchestra.run.smithi160.stdout: "dir_merge": 0, 2024-05-08T05:34:15.372 INFO:teuthology.orchestra.run.smithi160.stdout: "inodes": 1614, 2024-05-08T05:34:15.372 INFO:teuthology.orchestra.run.smithi160.stdout: "inodes_top": 0, 2024-05-08T05:34:15.372 INFO:teuthology.orchestra.run.smithi160.stdout: "inodes_bottom": 1614, 2024-05-08T05:34:15.372 INFO:teuthology.orchestra.run.smithi160.stdout: "inodes_pin_tail": 0, 2024-05-08T05:34:15.373 INFO:teuthology.orchestra.run.smithi160.stdout: "inodes_pinned": 1614, 2024-05-08T05:34:15.373 INFO:teuthology.orchestra.run.smithi160.stdout: "inodes_expired": 0, 2024-05-08T05:34:15.373 INFO:teuthology.orchestra.run.smithi160.stdout: "inodes_with_caps": 0, 2024-05-08T05:34:15.373 INFO:teuthology.orchestra.run.smithi160.stdout: "caps": 0, 2024-05-08T05:34:15.373 INFO:teuthology.orchestra.run.smithi160.stdout: "subtrees": 2, 2024-05-08T05:34:15.373 INFO:teuthology.orchestra.run.smithi160.stdout: "traverse": 0, 2024-05-08T05:34:15.373 INFO:teuthology.orchestra.run.smithi160.stdout: "traverse_hit": 0, 2024-05-08T05:34:15.373 INFO:teuthology.orchestra.run.smithi160.stdout: "traverse_forward": 0, 2024-05-08T05:34:15.373 INFO:teuthology.orchestra.run.smithi160.stdout: "traverse_discover": 0, 2024-05-08T05:34:15.373 INFO:teuthology.orchestra.run.smithi160.stdout: "traverse_dir_fetch": 0, 2024-05-08T05:34:15.373 INFO:teuthology.orchestra.run.smithi160.stdout: "traverse_remote_ino": 0, 2024-05-08T05:34:15.373 INFO:teuthology.orchestra.run.smithi160.stdout: "traverse_lock": 0, 2024-05-08T05:34:15.373 INFO:teuthology.orchestra.run.smithi160.stdout: "load_cent": 0, 2024-05-08T05:34:15.373 INFO:teuthology.orchestra.run.smithi160.stdout: "q": 0, 2024-05-08T05:34:15.374 INFO:teuthology.orchestra.run.smithi160.stdout: "exported": 0, 2024-05-08T05:34:15.374 INFO:teuthology.orchestra.run.smithi160.stdout: "exported_inodes": 0, 2024-05-08T05:34:15.374 INFO:teuthology.orchestra.run.smithi160.stdout: "imported": 0, 2024-05-08T05:34:15.374 INFO:teuthology.orchestra.run.smithi160.stdout: "imported_inodes": 0, 2024-05-08T05:34:15.374 INFO:teuthology.orchestra.run.smithi160.stdout: "openino_dir_fetch": 0, 2024-05-08T05:34:15.374 INFO:teuthology.orchestra.run.smithi160.stdout: "openino_backtrace_fetch": 0, 2024-05-08T05:34:15.374 INFO:teuthology.orchestra.run.smithi160.stdout: "openino_peer_discover": 0, 2024-05-08T05:34:15.374 INFO:teuthology.orchestra.run.smithi160.stdout: "root_rfiles": 4, 2024-05-08T05:34:15.374 INFO:teuthology.orchestra.run.smithi160.stdout: "root_rbytes": 234, 2024-05-08T05:34:15.374 INFO:teuthology.orchestra.run.smithi160.stdout: "root_rsnaps": 0, 2024-05-08T05:34:15.374 INFO:teuthology.orchestra.run.smithi160.stdout: "scrub_backtrace_fetch": 0, 2024-05-08T05:34:15.375 INFO:teuthology.orchestra.run.smithi160.stdout: "scrub_set_tag": 0, 2024-05-08T05:34:15.375 INFO:teuthology.orchestra.run.smithi160.stdout: "scrub_backtrace_repaired": 0, 2024-05-08T05:34:15.375 INFO:teuthology.orchestra.run.smithi160.stdout: "scrub_inotable_repaired": 0, 2024-05-08T05:34:15.375 INFO:teuthology.orchestra.run.smithi160.stdout: "scrub_dir_inodes": 0, 2024-05-08T05:34:15.375 INFO:teuthology.orchestra.run.smithi160.stdout: "scrub_dir_base_inodes": 0, 2024-05-08T05:34:15.375 INFO:teuthology.orchestra.run.smithi160.stdout: "scrub_dirfrag_rstats": 0, 2024-05-08T05:34:15.375 INFO:teuthology.orchestra.run.smithi160.stdout: "scrub_file_inodes": 0, 2024-05-08T05:34:15.375 INFO:teuthology.orchestra.run.smithi160.stdout: "handle_inode_file_caps": 0, 2024-05-08T05:34:15.375 INFO:teuthology.orchestra.run.smithi160.stdout: "ceph_cap_op_revoke": 0, 2024-05-08T05:34:15.375 INFO:teuthology.orchestra.run.smithi160.stdout: "ceph_cap_op_grant": 0, 2024-05-08T05:34:15.376 INFO:teuthology.orchestra.run.smithi160.stdout: "ceph_cap_op_trunc": 0, 2024-05-08T05:34:15.376 INFO:teuthology.orchestra.run.smithi160.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-05-08T05:34:15.376 INFO:teuthology.orchestra.run.smithi160.stdout: "ceph_cap_op_flush_ack": 0, 2024-05-08T05:34:15.376 INFO:teuthology.orchestra.run.smithi160.stdout: "handle_client_caps": 0, 2024-05-08T05:34:15.376 INFO:teuthology.orchestra.run.smithi160.stdout: "handle_client_caps_dirty": 0, 2024-05-08T05:34:15.376 INFO:teuthology.orchestra.run.smithi160.stdout: "handle_client_cap_release": 0, 2024-05-08T05:34:15.376 INFO:teuthology.orchestra.run.smithi160.stdout: "process_request_cap_release": 0 2024-05-08T05:34:15.376 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-05-08T05:34:15.376 INFO:teuthology.orchestra.run.smithi160.stdout: "mds_cache": { 2024-05-08T05:34:15.376 INFO:teuthology.orchestra.run.smithi160.stdout: "dir_update": 0, 2024-05-08T05:34:15.376 INFO:teuthology.orchestra.run.smithi160.stdout: "dir_update_receipt": 0, 2024-05-08T05:34:15.376 INFO:teuthology.orchestra.run.smithi160.stdout: "dir_try_discover": 0, 2024-05-08T05:34:15.376 INFO:teuthology.orchestra.run.smithi160.stdout: "dir_send_discover": 0, 2024-05-08T05:34:15.376 INFO:teuthology.orchestra.run.smithi160.stdout: "dir_handle_discover": 0, 2024-05-08T05:34:15.376 INFO:teuthology.orchestra.run.smithi160.stdout: "num_strays": 0, 2024-05-08T05:34:15.377 INFO:teuthology.orchestra.run.smithi160.stdout: "num_strays_delayed": 0, 2024-05-08T05:34:15.377 INFO:teuthology.orchestra.run.smithi160.stdout: "num_strays_enqueuing": 0, 2024-05-08T05:34:15.377 INFO:teuthology.orchestra.run.smithi160.stdout: "strays_created": 0, 2024-05-08T05:34:15.377 INFO:teuthology.orchestra.run.smithi160.stdout: "strays_enqueued": 0, 2024-05-08T05:34:15.377 INFO:teuthology.orchestra.run.smithi160.stdout: "strays_reintegrated": 0, 2024-05-08T05:34:15.377 INFO:teuthology.orchestra.run.smithi160.stdout: "strays_migrated": 0, 2024-05-08T05:34:15.377 INFO:teuthology.orchestra.run.smithi160.stdout: "num_recovering_processing": 0, 2024-05-08T05:34:15.377 INFO:teuthology.orchestra.run.smithi160.stdout: "num_recovering_enqueued": 0, 2024-05-08T05:34:15.377 INFO:teuthology.orchestra.run.smithi160.stdout: "num_recovering_prioritized": 0, 2024-05-08T05:34:15.377 INFO:teuthology.orchestra.run.smithi160.stdout: "recovery_started": 0, 2024-05-08T05:34:15.377 INFO:teuthology.orchestra.run.smithi160.stdout: "recovery_completed": 0, 2024-05-08T05:34:15.377 INFO:teuthology.orchestra.run.smithi160.stdout: "ireq_quiesce_path": 0, 2024-05-08T05:34:15.377 INFO:teuthology.orchestra.run.smithi160.stdout: "ireq_quiesce_inode": 0, 2024-05-08T05:34:15.377 INFO:teuthology.orchestra.run.smithi160.stdout: "ireq_enqueue_scrub": 0, 2024-05-08T05:34:15.377 INFO:teuthology.orchestra.run.smithi160.stdout: "ireq_exportdir": 0, 2024-05-08T05:34:15.377 INFO:teuthology.orchestra.run.smithi160.stdout: "ireq_flush": 0, 2024-05-08T05:34:15.378 INFO:teuthology.orchestra.run.smithi160.stdout: "ireq_fragmentdir": 0, 2024-05-08T05:34:15.378 INFO:teuthology.orchestra.run.smithi160.stdout: "ireq_fragstats": 0, 2024-05-08T05:34:15.378 INFO:teuthology.orchestra.run.smithi160.stdout: "ireq_inodestats": 0 2024-05-08T05:34:15.378 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-05-08T05:34:15.378 INFO:teuthology.orchestra.run.smithi160.stdout: "mds_log": { 2024-05-08T05:34:15.378 INFO:teuthology.orchestra.run.smithi160.stdout: "evlrg": 0, 2024-05-08T05:34:15.378 INFO:teuthology.orchestra.run.smithi160.stdout: "evadd": 0, 2024-05-08T05:34:15.378 INFO:teuthology.orchestra.run.smithi160.stdout: "evex": 0, 2024-05-08T05:34:15.378 INFO:teuthology.orchestra.run.smithi160.stdout: "evtrm": 0, 2024-05-08T05:34:15.378 INFO:teuthology.orchestra.run.smithi160.stdout: "ev": 30387, 2024-05-08T05:34:15.378 INFO:teuthology.orchestra.run.smithi160.stdout: "evexg": 0, 2024-05-08T05:34:15.378 INFO:teuthology.orchestra.run.smithi160.stdout: "evexd": 0, 2024-05-08T05:34:15.378 INFO:teuthology.orchestra.run.smithi160.stdout: "segadd": 0, 2024-05-08T05:34:15.378 INFO:teuthology.orchestra.run.smithi160.stdout: "segex": 0, 2024-05-08T05:34:15.378 INFO:teuthology.orchestra.run.smithi160.stdout: "segtrm": 0, 2024-05-08T05:34:15.379 INFO:teuthology.orchestra.run.smithi160.stdout: "seg": 36, 2024-05-08T05:34:15.379 INFO:teuthology.orchestra.run.smithi160.stdout: "segmjr": 4, 2024-05-08T05:34:15.379 INFO:teuthology.orchestra.run.smithi160.stdout: "segexg": 0, 2024-05-08T05:34:15.379 INFO:teuthology.orchestra.run.smithi160.stdout: "segexd": 0, 2024-05-08T05:34:15.379 INFO:teuthology.orchestra.run.smithi160.stdout: "expos": 4194304, 2024-05-08T05:34:15.379 INFO:teuthology.orchestra.run.smithi160.stdout: "wrpos": 72095967, 2024-05-08T05:34:15.379 INFO:teuthology.orchestra.run.smithi160.stdout: "rdpos": 72095368, 2024-05-08T05:34:15.379 INFO:teuthology.orchestra.run.smithi160.stdout: "jlat": { 2024-05-08T05:34:15.379 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 0, 2024-05-08T05:34:15.379 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000000000, 2024-05-08T05:34:15.379 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000000 2024-05-08T05:34:15.379 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-05-08T05:34:15.379 INFO:teuthology.orchestra.run.smithi160.stdout: "replayed": 30387 2024-05-08T05:34:15.379 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-05-08T05:34:15.379 INFO:teuthology.orchestra.run.smithi160.stdout: "mds_mem": { 2024-05-08T05:34:15.379 INFO:teuthology.orchestra.run.smithi160.stdout: "ino": 63, 2024-05-08T05:34:15.380 INFO:teuthology.orchestra.run.smithi160.stdout: "ino+": 14503, 2024-05-08T05:34:15.380 INFO:teuthology.orchestra.run.smithi160.stdout: "ino-": 14440, 2024-05-08T05:34:15.380 INFO:teuthology.orchestra.run.smithi160.stdout: "dir": 58, 2024-05-08T05:34:15.380 INFO:teuthology.orchestra.run.smithi160.stdout: "dir+": 1904, 2024-05-08T05:34:15.380 INFO:teuthology.orchestra.run.smithi160.stdout: "dir-": 1846, 2024-05-08T05:34:15.380 INFO:teuthology.orchestra.run.smithi160.stdout: "dn": 1614, 2024-05-08T05:34:15.380 INFO:teuthology.orchestra.run.smithi160.stdout: "dn+": 16414, 2024-05-08T05:34:15.380 INFO:teuthology.orchestra.run.smithi160.stdout: "dn-": 14800, 2024-05-08T05:34:15.380 INFO:teuthology.orchestra.run.smithi160.stdout: "cap": 0, 2024-05-08T05:34:15.380 INFO:teuthology.orchestra.run.smithi160.stdout: "cap+": 0, 2024-05-08T05:34:15.380 INFO:teuthology.orchestra.run.smithi160.stdout: "cap-": 0, 2024-05-08T05:34:15.380 INFO:teuthology.orchestra.run.smithi160.stdout: "rss": 74408, 2024-05-08T05:34:15.380 INFO:teuthology.orchestra.run.smithi160.stdout: "heap": 215416 2024-05-08T05:34:15.380 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-05-08T05:34:15.380 INFO:teuthology.orchestra.run.smithi160.stdout: "mds_server": { 2024-05-08T05:34:15.381 INFO:teuthology.orchestra.run.smithi160.stdout: "dispatch_client_request": 0, 2024-05-08T05:34:15.381 INFO:teuthology.orchestra.run.smithi160.stdout: "dispatch_server_request": 0, 2024-05-08T05:34:15.381 INFO:teuthology.orchestra.run.smithi160.stdout: "handle_client_request": 0, 2024-05-08T05:34:15.381 INFO:teuthology.orchestra.run.smithi160.stdout: "handle_client_session": 0, 2024-05-08T05:34:15.381 INFO:teuthology.orchestra.run.smithi160.stdout: "handle_peer_request": 0, 2024-05-08T05:34:15.381 INFO:teuthology.orchestra.run.smithi160.stdout: "req_create_latency": { 2024-05-08T05:34:15.381 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 0, 2024-05-08T05:34:15.381 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000000000, 2024-05-08T05:34:15.381 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000000 2024-05-08T05:34:15.381 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-05-08T05:34:15.381 INFO:teuthology.orchestra.run.smithi160.stdout: "req_getattr_latency": { 2024-05-08T05:34:15.381 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 0, 2024-05-08T05:34:15.381 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000000000, 2024-05-08T05:34:15.381 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000000 2024-05-08T05:34:15.382 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-05-08T05:34:15.382 INFO:teuthology.orchestra.run.smithi160.stdout: "req_getfilelock_latency": { 2024-05-08T05:34:15.382 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 0, 2024-05-08T05:34:15.382 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000000000, 2024-05-08T05:34:15.382 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000000 2024-05-08T05:34:15.382 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-05-08T05:34:15.382 INFO:teuthology.orchestra.run.smithi160.stdout: "req_link_latency": { 2024-05-08T05:34:15.382 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 0, 2024-05-08T05:34:15.382 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000000000, 2024-05-08T05:34:15.382 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000000 2024-05-08T05:34:15.382 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-05-08T05:34:15.382 INFO:teuthology.orchestra.run.smithi160.stdout: "req_lookup_latency": { 2024-05-08T05:34:15.382 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 0, 2024-05-08T05:34:15.382 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000000000, 2024-05-08T05:34:15.383 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000000 2024-05-08T05:34:15.383 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-05-08T05:34:15.383 INFO:teuthology.orchestra.run.smithi160.stdout: "req_lookuphash_latency": { 2024-05-08T05:34:15.383 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 0, 2024-05-08T05:34:15.383 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000000000, 2024-05-08T05:34:15.383 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000000 2024-05-08T05:34:15.383 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-05-08T05:34:15.383 INFO:teuthology.orchestra.run.smithi160.stdout: "req_lookupino_latency": { 2024-05-08T05:34:15.383 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 0, 2024-05-08T05:34:15.383 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000000000, 2024-05-08T05:34:15.383 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000000 2024-05-08T05:34:15.383 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-05-08T05:34:15.383 INFO:teuthology.orchestra.run.smithi160.stdout: "req_lookupname_latency": { 2024-05-08T05:34:15.383 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 0, 2024-05-08T05:34:15.383 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000000000, 2024-05-08T05:34:15.384 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000000 2024-05-08T05:34:15.384 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-05-08T05:34:15.384 INFO:teuthology.orchestra.run.smithi160.stdout: "req_lookupparent_latency": { 2024-05-08T05:34:15.384 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 0, 2024-05-08T05:34:15.384 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000000000, 2024-05-08T05:34:15.384 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000000 2024-05-08T05:34:15.384 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-05-08T05:34:15.384 INFO:teuthology.orchestra.run.smithi160.stdout: "req_lookupsnap_latency": { 2024-05-08T05:34:15.384 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 0, 2024-05-08T05:34:15.384 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000000000, 2024-05-08T05:34:15.384 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000000 2024-05-08T05:34:15.384 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-05-08T05:34:15.384 INFO:teuthology.orchestra.run.smithi160.stdout: "req_lssnap_latency": { 2024-05-08T05:34:15.384 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 0, 2024-05-08T05:34:15.384 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000000000, 2024-05-08T05:34:15.385 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000000 2024-05-08T05:34:15.385 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-05-08T05:34:15.385 INFO:teuthology.orchestra.run.smithi160.stdout: "req_mkdir_latency": { 2024-05-08T05:34:15.385 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 0, 2024-05-08T05:34:15.385 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000000000, 2024-05-08T05:34:15.386 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000000 2024-05-08T05:34:15.386 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-05-08T05:34:15.386 INFO:teuthology.orchestra.run.smithi160.stdout: "req_mknod_latency": { 2024-05-08T05:34:15.386 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 0, 2024-05-08T05:34:15.386 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000000000, 2024-05-08T05:34:15.386 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000000 2024-05-08T05:34:15.386 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-05-08T05:34:15.386 INFO:teuthology.orchestra.run.smithi160.stdout: "req_mksnap_latency": { 2024-05-08T05:34:15.386 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 0, 2024-05-08T05:34:15.386 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000000000, 2024-05-08T05:34:15.386 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000000 2024-05-08T05:34:15.386 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-05-08T05:34:15.386 INFO:teuthology.orchestra.run.smithi160.stdout: "req_open_latency": { 2024-05-08T05:34:15.387 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 0, 2024-05-08T05:34:15.387 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000000000, 2024-05-08T05:34:15.387 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000000 2024-05-08T05:34:15.387 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-05-08T05:34:15.387 INFO:teuthology.orchestra.run.smithi160.stdout: "req_readdir_latency": { 2024-05-08T05:34:15.387 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 0, 2024-05-08T05:34:15.387 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000000000, 2024-05-08T05:34:15.387 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000000 2024-05-08T05:34:15.387 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-05-08T05:34:15.387 INFO:teuthology.orchestra.run.smithi160.stdout: "req_rename_latency": { 2024-05-08T05:34:15.387 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 0, 2024-05-08T05:34:15.387 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000000000, 2024-05-08T05:34:15.387 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000000 2024-05-08T05:34:15.387 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-05-08T05:34:15.388 INFO:teuthology.orchestra.run.smithi160.stdout: "req_renamesnap_latency": { 2024-05-08T05:34:15.388 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 0, 2024-05-08T05:34:15.388 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000000000, 2024-05-08T05:34:15.388 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000000 2024-05-08T05:34:15.388 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-05-08T05:34:15.388 INFO:teuthology.orchestra.run.smithi160.stdout: "req_snapdiff_latency": { 2024-05-08T05:34:15.388 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 0, 2024-05-08T05:34:15.388 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000000000, 2024-05-08T05:34:15.388 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000000 2024-05-08T05:34:15.388 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-05-08T05:34:15.388 INFO:teuthology.orchestra.run.smithi160.stdout: "req_rmdir_latency": { 2024-05-08T05:34:15.388 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 0, 2024-05-08T05:34:15.388 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000000000, 2024-05-08T05:34:15.388 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000000 2024-05-08T05:34:15.388 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-05-08T05:34:15.389 INFO:teuthology.orchestra.run.smithi160.stdout: "req_rmsnap_latency": { 2024-05-08T05:34:15.389 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 0, 2024-05-08T05:34:15.389 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000000000, 2024-05-08T05:34:15.389 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000000 2024-05-08T05:34:15.389 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-05-08T05:34:15.389 INFO:teuthology.orchestra.run.smithi160.stdout: "req_rmxattr_latency": { 2024-05-08T05:34:15.389 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 0, 2024-05-08T05:34:15.389 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000000000, 2024-05-08T05:34:15.389 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000000 2024-05-08T05:34:15.389 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-05-08T05:34:15.389 INFO:teuthology.orchestra.run.smithi160.stdout: "req_setattr_latency": { 2024-05-08T05:34:15.389 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 0, 2024-05-08T05:34:15.389 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000000000, 2024-05-08T05:34:15.389 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000000 2024-05-08T05:34:15.390 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-05-08T05:34:15.390 INFO:teuthology.orchestra.run.smithi160.stdout: "req_setdirlayout_latency": { 2024-05-08T05:34:15.390 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 0, 2024-05-08T05:34:15.390 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000000000, 2024-05-08T05:34:15.390 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000000 2024-05-08T05:34:15.390 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-05-08T05:34:15.390 INFO:teuthology.orchestra.run.smithi160.stdout: "req_setfilelock_latency": { 2024-05-08T05:34:15.390 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 0, 2024-05-08T05:34:15.390 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000000000, 2024-05-08T05:34:15.390 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000000 2024-05-08T05:34:15.390 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-05-08T05:34:15.390 INFO:teuthology.orchestra.run.smithi160.stdout: "req_setlayout_latency": { 2024-05-08T05:34:15.390 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 0, 2024-05-08T05:34:15.390 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000000000, 2024-05-08T05:34:15.391 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000000 2024-05-08T05:34:15.391 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-05-08T05:34:15.391 INFO:teuthology.orchestra.run.smithi160.stdout: "req_setxattr_latency": { 2024-05-08T05:34:15.391 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 0, 2024-05-08T05:34:15.391 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000000000, 2024-05-08T05:34:15.391 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000000 2024-05-08T05:34:15.391 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-05-08T05:34:15.391 INFO:teuthology.orchestra.run.smithi160.stdout: "req_symlink_latency": { 2024-05-08T05:34:15.391 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 0, 2024-05-08T05:34:15.391 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000000000, 2024-05-08T05:34:15.391 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000000 2024-05-08T05:34:15.391 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-05-08T05:34:15.391 INFO:teuthology.orchestra.run.smithi160.stdout: "req_unlink_latency": { 2024-05-08T05:34:15.392 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 0, 2024-05-08T05:34:15.392 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000000000, 2024-05-08T05:34:15.392 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000000 2024-05-08T05:34:15.392 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-05-08T05:34:15.392 INFO:teuthology.orchestra.run.smithi160.stdout: "cap_revoke_eviction": 0, 2024-05-08T05:34:15.392 INFO:teuthology.orchestra.run.smithi160.stdout: "cap_acquisition_throttle": 0, 2024-05-08T05:34:15.392 INFO:teuthology.orchestra.run.smithi160.stdout: "req_getvxattr_latency": { 2024-05-08T05:34:15.392 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 0, 2024-05-08T05:34:15.392 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000000000, 2024-05-08T05:34:15.392 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000000 2024-05-08T05:34:15.392 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-05-08T05:34:15.392 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-05-08T05:34:15.392 INFO:teuthology.orchestra.run.smithi160.stdout: "mds_sessions": { 2024-05-08T05:34:15.392 INFO:teuthology.orchestra.run.smithi160.stdout: "session_count": 1, 2024-05-08T05:34:15.393 INFO:teuthology.orchestra.run.smithi160.stdout: "session_add": 2, 2024-05-08T05:34:15.393 INFO:teuthology.orchestra.run.smithi160.stdout: "session_remove": 1, 2024-05-08T05:34:15.393 INFO:teuthology.orchestra.run.smithi160.stdout: "sessions_open": 1, 2024-05-08T05:34:15.393 INFO:teuthology.orchestra.run.smithi160.stdout: "sessions_stale": 0, 2024-05-08T05:34:15.393 INFO:teuthology.orchestra.run.smithi160.stdout: "total_load": 0, 2024-05-08T05:34:15.393 INFO:teuthology.orchestra.run.smithi160.stdout: "average_load": 0, 2024-05-08T05:34:15.393 INFO:teuthology.orchestra.run.smithi160.stdout: "avg_session_uptime": 1997, 2024-05-08T05:34:15.393 INFO:teuthology.orchestra.run.smithi160.stdout: "mdthresh_evicted": 0 2024-05-08T05:34:15.393 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-05-08T05:34:15.393 INFO:teuthology.orchestra.run.smithi160.stdout: "mempool": { 2024-05-08T05:34:15.393 INFO:teuthology.orchestra.run.smithi160.stdout: "bloom_filter_bytes": 0, 2024-05-08T05:34:15.393 INFO:teuthology.orchestra.run.smithi160.stdout: "bloom_filter_items": 0, 2024-05-08T05:34:15.393 INFO:teuthology.orchestra.run.smithi160.stdout: "bluestore_alloc_bytes": 0, 2024-05-08T05:34:15.393 INFO:teuthology.orchestra.run.smithi160.stdout: "bluestore_alloc_items": 0, 2024-05-08T05:34:15.394 INFO:teuthology.orchestra.run.smithi160.stdout: "bluestore_cache_data_bytes": 0, 2024-05-08T05:34:15.394 INFO:teuthology.orchestra.run.smithi160.stdout: "bluestore_cache_data_items": 0, 2024-05-08T05:34:15.394 INFO:teuthology.orchestra.run.smithi160.stdout: "bluestore_cache_onode_bytes": 0, 2024-05-08T05:34:15.394 INFO:teuthology.orchestra.run.smithi160.stdout: "bluestore_cache_onode_items": 0, 2024-05-08T05:34:15.394 INFO:teuthology.orchestra.run.smithi160.stdout: "bluestore_cache_meta_bytes": 0, 2024-05-08T05:34:15.394 INFO:teuthology.orchestra.run.smithi160.stdout: "bluestore_cache_meta_items": 0, 2024-05-08T05:34:15.394 INFO:teuthology.orchestra.run.smithi160.stdout: "bluestore_cache_other_bytes": 0, 2024-05-08T05:34:15.394 INFO:teuthology.orchestra.run.smithi160.stdout: "bluestore_cache_other_items": 0, 2024-05-08T05:34:15.394 INFO:teuthology.orchestra.run.smithi160.stdout: "bluestore_cache_buffer_bytes": 0, 2024-05-08T05:34:15.394 INFO:teuthology.orchestra.run.smithi160.stdout: "bluestore_cache_buffer_items": 0, 2024-05-08T05:34:15.394 INFO:teuthology.orchestra.run.smithi160.stdout: "bluestore_extent_bytes": 0, 2024-05-08T05:34:15.394 INFO:teuthology.orchestra.run.smithi160.stdout: "bluestore_extent_items": 0, 2024-05-08T05:34:15.394 INFO:teuthology.orchestra.run.smithi160.stdout: "bluestore_blob_bytes": 0, 2024-05-08T05:34:15.394 INFO:teuthology.orchestra.run.smithi160.stdout: "bluestore_blob_items": 0, 2024-05-08T05:34:15.395 INFO:teuthology.orchestra.run.smithi160.stdout: "bluestore_shared_blob_bytes": 0, 2024-05-08T05:34:15.395 INFO:teuthology.orchestra.run.smithi160.stdout: "bluestore_shared_blob_items": 0, 2024-05-08T05:34:15.395 INFO:teuthology.orchestra.run.smithi160.stdout: "bluestore_inline_bl_bytes": 0, 2024-05-08T05:34:15.395 INFO:teuthology.orchestra.run.smithi160.stdout: "bluestore_inline_bl_items": 0, 2024-05-08T05:34:15.395 INFO:teuthology.orchestra.run.smithi160.stdout: "bluestore_fsck_bytes": 0, 2024-05-08T05:34:15.395 INFO:teuthology.orchestra.run.smithi160.stdout: "bluestore_fsck_items": 0, 2024-05-08T05:34:15.395 INFO:teuthology.orchestra.run.smithi160.stdout: "bluestore_txc_bytes": 0, 2024-05-08T05:34:15.395 INFO:teuthology.orchestra.run.smithi160.stdout: "bluestore_txc_items": 0, 2024-05-08T05:34:15.395 INFO:teuthology.orchestra.run.smithi160.stdout: "bluestore_writing_deferred_bytes": 0, 2024-05-08T05:34:15.395 INFO:teuthology.orchestra.run.smithi160.stdout: "bluestore_writing_deferred_items": 0, 2024-05-08T05:34:15.395 INFO:teuthology.orchestra.run.smithi160.stdout: "bluestore_writing_bytes": 0, 2024-05-08T05:34:15.395 INFO:teuthology.orchestra.run.smithi160.stdout: "bluestore_writing_items": 0, 2024-05-08T05:34:15.395 INFO:teuthology.orchestra.run.smithi160.stdout: "bluefs_bytes": 0, 2024-05-08T05:34:15.396 INFO:teuthology.orchestra.run.smithi160.stdout: "bluefs_items": 0, 2024-05-08T05:34:15.396 INFO:teuthology.orchestra.run.smithi160.stdout: "bluefs_file_reader_bytes": 0, 2024-05-08T05:34:15.396 INFO:teuthology.orchestra.run.smithi160.stdout: "bluefs_file_reader_items": 0, 2024-05-08T05:34:15.396 INFO:teuthology.orchestra.run.smithi160.stdout: "bluefs_file_writer_bytes": 0, 2024-05-08T05:34:15.396 INFO:teuthology.orchestra.run.smithi160.stdout: "bluefs_file_writer_items": 0, 2024-05-08T05:34:15.396 INFO:teuthology.orchestra.run.smithi160.stdout: "buffer_anon_bytes": 223945, 2024-05-08T05:34:15.396 INFO:teuthology.orchestra.run.smithi160.stdout: "buffer_anon_items": 108, 2024-05-08T05:34:15.396 INFO:teuthology.orchestra.run.smithi160.stdout: "buffer_meta_bytes": 0, 2024-05-08T05:34:15.396 INFO:teuthology.orchestra.run.smithi160.stdout: "buffer_meta_items": 0, 2024-05-08T05:34:15.396 INFO:teuthology.orchestra.run.smithi160.stdout: "osd_bytes": 0, 2024-05-08T05:34:15.396 INFO:teuthology.orchestra.run.smithi160.stdout: "osd_items": 0, 2024-05-08T05:34:15.396 INFO:teuthology.orchestra.run.smithi160.stdout: "osd_mapbl_bytes": 0, 2024-05-08T05:34:15.396 INFO:teuthology.orchestra.run.smithi160.stdout: "osd_mapbl_items": 0, 2024-05-08T05:34:15.396 INFO:teuthology.orchestra.run.smithi160.stdout: "osd_pglog_bytes": 0, 2024-05-08T05:34:15.397 INFO:teuthology.orchestra.run.smithi160.stdout: "osd_pglog_items": 0, 2024-05-08T05:34:15.397 INFO:teuthology.orchestra.run.smithi160.stdout: "osdmap_bytes": 7440, 2024-05-08T05:34:15.397 INFO:teuthology.orchestra.run.smithi160.stdout: "osdmap_items": 157, 2024-05-08T05:34:15.397 INFO:teuthology.orchestra.run.smithi160.stdout: "osdmap_mapping_bytes": 0, 2024-05-08T05:34:15.397 INFO:teuthology.orchestra.run.smithi160.stdout: "osdmap_mapping_items": 0, 2024-05-08T05:34:15.397 INFO:teuthology.orchestra.run.smithi160.stdout: "pgmap_bytes": 0, 2024-05-08T05:34:15.397 INFO:teuthology.orchestra.run.smithi160.stdout: "pgmap_items": 0, 2024-05-08T05:34:15.397 INFO:teuthology.orchestra.run.smithi160.stdout: "mds_co_bytes": 1363301, 2024-05-08T05:34:15.397 INFO:teuthology.orchestra.run.smithi160.stdout: "mds_co_items": 12370, 2024-05-08T05:34:15.397 INFO:teuthology.orchestra.run.smithi160.stdout: "unittest_1_bytes": 0, 2024-05-08T05:34:15.397 INFO:teuthology.orchestra.run.smithi160.stdout: "unittest_1_items": 0, 2024-05-08T05:34:15.397 INFO:teuthology.orchestra.run.smithi160.stdout: "unittest_2_bytes": 0, 2024-05-08T05:34:15.397 INFO:teuthology.orchestra.run.smithi160.stdout: "unittest_2_items": 0 2024-05-08T05:34:15.397 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-05-08T05:34:15.397 INFO:teuthology.orchestra.run.smithi160.stdout: "objecter": { 2024-05-08T05:34:15.398 INFO:teuthology.orchestra.run.smithi160.stdout: "op_active": 0, 2024-05-08T05:34:15.398 INFO:teuthology.orchestra.run.smithi160.stdout: "op_laggy": 0, 2024-05-08T05:34:15.398 INFO:teuthology.orchestra.run.smithi160.stdout: "op_send": 1674, 2024-05-08T05:34:15.398 INFO:teuthology.orchestra.run.smithi160.stdout: "op_send_bytes": 26, 2024-05-08T05:34:15.398 INFO:teuthology.orchestra.run.smithi160.stdout: "op_resend": 4, 2024-05-08T05:34:15.398 INFO:teuthology.orchestra.run.smithi160.stdout: "op_reply": 1674, 2024-05-08T05:34:15.398 INFO:teuthology.orchestra.run.smithi160.stdout: "op_latency": { 2024-05-08T05:34:15.398 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 1674, 2024-05-08T05:34:15.398 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 1.255981725, 2024-05-08T05:34:15.398 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000750287 2024-05-08T05:34:15.398 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-05-08T05:34:15.398 INFO:teuthology.orchestra.run.smithi160.stdout: "op_inflight": 0, 2024-05-08T05:34:15.398 INFO:teuthology.orchestra.run.smithi160.stdout: "oplen_avg": { 2024-05-08T05:34:15.398 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 1674, 2024-05-08T05:34:15.398 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 1675 2024-05-08T05:34:15.399 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-05-08T05:34:15.399 INFO:teuthology.orchestra.run.smithi160.stdout: "op": 1674, 2024-05-08T05:34:15.399 INFO:teuthology.orchestra.run.smithi160.stdout: "op_r": 1674, 2024-05-08T05:34:15.399 INFO:teuthology.orchestra.run.smithi160.stdout: "op_w": 0, 2024-05-08T05:34:15.399 INFO:teuthology.orchestra.run.smithi160.stdout: "op_rmw": 0, 2024-05-08T05:34:15.399 INFO:teuthology.orchestra.run.smithi160.stdout: "op_pg": 0, 2024-05-08T05:34:15.399 INFO:teuthology.orchestra.run.smithi160.stdout: "osdop_stat": 1057, 2024-05-08T05:34:15.399 INFO:teuthology.orchestra.run.smithi160.stdout: "osdop_create": 0, 2024-05-08T05:34:15.399 INFO:teuthology.orchestra.run.smithi160.stdout: "osdop_read": 614, 2024-05-08T05:34:15.399 INFO:teuthology.orchestra.run.smithi160.stdout: "osdop_write": 0, 2024-05-08T05:34:15.399 INFO:teuthology.orchestra.run.smithi160.stdout: "osdop_writefull": 0, 2024-05-08T05:34:15.399 INFO:teuthology.orchestra.run.smithi160.stdout: "osdop_writesame": 0, 2024-05-08T05:34:15.399 INFO:teuthology.orchestra.run.smithi160.stdout: "osdop_append": 0, 2024-05-08T05:34:15.399 INFO:teuthology.orchestra.run.smithi160.stdout: "osdop_zero": 0, 2024-05-08T05:34:15.399 INFO:teuthology.orchestra.run.smithi160.stdout: "osdop_truncate": 0, 2024-05-08T05:34:15.400 INFO:teuthology.orchestra.run.smithi160.stdout: "osdop_delete": 0, 2024-05-08T05:34:15.400 INFO:teuthology.orchestra.run.smithi160.stdout: "osdop_mapext": 0, 2024-05-08T05:34:15.400 INFO:teuthology.orchestra.run.smithi160.stdout: "osdop_sparse_read": 0, 2024-05-08T05:34:15.400 INFO:teuthology.orchestra.run.smithi160.stdout: "osdop_clonerange": 0, 2024-05-08T05:34:15.400 INFO:teuthology.orchestra.run.smithi160.stdout: "osdop_getxattr": 2, 2024-05-08T05:34:15.400 INFO:teuthology.orchestra.run.smithi160.stdout: "osdop_setxattr": 0, 2024-05-08T05:34:15.400 INFO:teuthology.orchestra.run.smithi160.stdout: "osdop_cmpxattr": 0, 2024-05-08T05:34:15.400 INFO:teuthology.orchestra.run.smithi160.stdout: "osdop_rmxattr": 0, 2024-05-08T05:34:15.400 INFO:teuthology.orchestra.run.smithi160.stdout: "osdop_resetxattrs": 0, 2024-05-08T05:34:15.400 INFO:teuthology.orchestra.run.smithi160.stdout: "osdop_call": 0, 2024-05-08T05:34:15.400 INFO:teuthology.orchestra.run.smithi160.stdout: "osdop_watch": 0, 2024-05-08T05:34:15.400 INFO:teuthology.orchestra.run.smithi160.stdout: "osdop_notify": 0, 2024-05-08T05:34:15.400 INFO:teuthology.orchestra.run.smithi160.stdout: "osdop_src_cmpxattr": 0, 2024-05-08T05:34:15.400 INFO:teuthology.orchestra.run.smithi160.stdout: "osdop_pgls": 0, 2024-05-08T05:34:15.400 INFO:teuthology.orchestra.run.smithi160.stdout: "osdop_pgls_filter": 0, 2024-05-08T05:34:15.401 INFO:teuthology.orchestra.run.smithi160.stdout: "osdop_other": 0, 2024-05-08T05:34:15.401 INFO:teuthology.orchestra.run.smithi160.stdout: "linger_active": 0, 2024-05-08T05:34:15.401 INFO:teuthology.orchestra.run.smithi160.stdout: "linger_send": 0, 2024-05-08T05:34:15.401 INFO:teuthology.orchestra.run.smithi160.stdout: "linger_resend": 0, 2024-05-08T05:34:15.401 INFO:teuthology.orchestra.run.smithi160.stdout: "linger_ping": 0, 2024-05-08T05:34:15.401 INFO:teuthology.orchestra.run.smithi160.stdout: "poolop_active": 0, 2024-05-08T05:34:15.401 INFO:teuthology.orchestra.run.smithi160.stdout: "poolop_send": 0, 2024-05-08T05:34:15.401 INFO:teuthology.orchestra.run.smithi160.stdout: "poolop_resend": 0, 2024-05-08T05:34:15.401 INFO:teuthology.orchestra.run.smithi160.stdout: "poolstat_active": 0, 2024-05-08T05:34:15.401 INFO:teuthology.orchestra.run.smithi160.stdout: "poolstat_send": 0, 2024-05-08T05:34:15.401 INFO:teuthology.orchestra.run.smithi160.stdout: "poolstat_resend": 0, 2024-05-08T05:34:15.401 INFO:teuthology.orchestra.run.smithi160.stdout: "statfs_active": 0, 2024-05-08T05:34:15.401 INFO:teuthology.orchestra.run.smithi160.stdout: "statfs_send": 0, 2024-05-08T05:34:15.401 INFO:teuthology.orchestra.run.smithi160.stdout: "statfs_resend": 0, 2024-05-08T05:34:15.402 INFO:teuthology.orchestra.run.smithi160.stdout: "command_active": 0, 2024-05-08T05:34:15.402 INFO:teuthology.orchestra.run.smithi160.stdout: "command_send": 0, 2024-05-08T05:34:15.402 INFO:teuthology.orchestra.run.smithi160.stdout: "command_resend": 0, 2024-05-08T05:34:15.402 INFO:teuthology.orchestra.run.smithi160.stdout: "map_epoch": 82, 2024-05-08T05:34:15.402 INFO:teuthology.orchestra.run.smithi160.stdout: "map_full": 0, 2024-05-08T05:34:15.402 INFO:teuthology.orchestra.run.smithi160.stdout: "map_inc": 2, 2024-05-08T05:34:15.402 INFO:teuthology.orchestra.run.smithi160.stdout: "osd_sessions": 9, 2024-05-08T05:34:15.402 INFO:teuthology.orchestra.run.smithi160.stdout: "osd_session_open": 9, 2024-05-08T05:34:15.402 INFO:teuthology.orchestra.run.smithi160.stdout: "osd_session_close": 0, 2024-05-08T05:34:15.402 INFO:teuthology.orchestra.run.smithi160.stdout: "osd_laggy": 0, 2024-05-08T05:34:15.402 INFO:teuthology.orchestra.run.smithi160.stdout: "omap_wr": 0, 2024-05-08T05:34:15.402 INFO:teuthology.orchestra.run.smithi160.stdout: "omap_rd": 2, 2024-05-08T05:34:15.402 INFO:teuthology.orchestra.run.smithi160.stdout: "omap_del": 0 2024-05-08T05:34:15.402 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-05-08T05:34:15.403 INFO:teuthology.orchestra.run.smithi160.stdout: "oft": { 2024-05-08T05:34:15.403 INFO:teuthology.orchestra.run.smithi160.stdout: "omap_total_objs": 0, 2024-05-08T05:34:15.403 INFO:teuthology.orchestra.run.smithi160.stdout: "omap_total_kv_pairs": 0, 2024-05-08T05:34:15.403 INFO:teuthology.orchestra.run.smithi160.stdout: "omap_total_updates": 0, 2024-05-08T05:34:15.403 INFO:teuthology.orchestra.run.smithi160.stdout: "omap_total_removes": 0 2024-05-08T05:34:15.403 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-05-08T05:34:15.403 INFO:teuthology.orchestra.run.smithi160.stdout: "osd-slow-ops": { 2024-05-08T05:34:15.403 INFO:teuthology.orchestra.run.smithi160.stdout: "slow_ops_count": 0 2024-05-08T05:34:15.403 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-05-08T05:34:15.403 INFO:teuthology.orchestra.run.smithi160.stdout: "purge_queue": { 2024-05-08T05:34:15.403 INFO:teuthology.orchestra.run.smithi160.stdout: "pq_executing_ops": 0, 2024-05-08T05:34:15.403 INFO:teuthology.orchestra.run.smithi160.stdout: "pq_executing_ops_high_water": 0, 2024-05-08T05:34:15.403 INFO:teuthology.orchestra.run.smithi160.stdout: "pq_executing": 0, 2024-05-08T05:34:15.403 INFO:teuthology.orchestra.run.smithi160.stdout: "pq_executing_high_water": 0, 2024-05-08T05:34:15.403 INFO:teuthology.orchestra.run.smithi160.stdout: "pq_executed_ops": 0, 2024-05-08T05:34:15.403 INFO:teuthology.orchestra.run.smithi160.stdout: "pq_executed": 0, 2024-05-08T05:34:15.404 INFO:teuthology.orchestra.run.smithi160.stdout: "pq_item_in_journal": 0 2024-05-08T05:34:15.404 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-05-08T05:34:15.404 INFO:teuthology.orchestra.run.smithi160.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-05-08T05:34:15.404 INFO:teuthology.orchestra.run.smithi160.stdout: "val": 0, 2024-05-08T05:34:15.404 INFO:teuthology.orchestra.run.smithi160.stdout: "max": 104857600, 2024-05-08T05:34:15.404 INFO:teuthology.orchestra.run.smithi160.stdout: "get_started": 0, 2024-05-08T05:34:15.404 INFO:teuthology.orchestra.run.smithi160.stdout: "get": 1843, 2024-05-08T05:34:15.404 INFO:teuthology.orchestra.run.smithi160.stdout: "get_sum": 68739091, 2024-05-08T05:34:15.404 INFO:teuthology.orchestra.run.smithi160.stdout: "get_or_fail_fail": 0, 2024-05-08T05:34:15.404 INFO:teuthology.orchestra.run.smithi160.stdout: "get_or_fail_success": 1843, 2024-05-08T05:34:15.404 INFO:teuthology.orchestra.run.smithi160.stdout: "take": 0, 2024-05-08T05:34:15.404 INFO:teuthology.orchestra.run.smithi160.stdout: "take_sum": 0, 2024-05-08T05:34:15.404 INFO:teuthology.orchestra.run.smithi160.stdout: "put": 1843, 2024-05-08T05:34:15.404 INFO:teuthology.orchestra.run.smithi160.stdout: "put_sum": 68739091, 2024-05-08T05:34:15.404 INFO:teuthology.orchestra.run.smithi160.stdout: "wait": { 2024-05-08T05:34:15.404 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 0, 2024-05-08T05:34:15.404 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000000000, 2024-05-08T05:34:15.405 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000000 2024-05-08T05:34:15.405 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-05-08T05:34:15.405 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-05-08T05:34:15.405 INFO:teuthology.orchestra.run.smithi160.stdout: "throttle-objecter_bytes": { 2024-05-08T05:34:15.405 INFO:teuthology.orchestra.run.smithi160.stdout: "val": 0, 2024-05-08T05:34:15.405 INFO:teuthology.orchestra.run.smithi160.stdout: "max": 104857600, 2024-05-08T05:34:15.405 INFO:teuthology.orchestra.run.smithi160.stdout: "get_started": 0, 2024-05-08T05:34:15.405 INFO:teuthology.orchestra.run.smithi160.stdout: "get": 0, 2024-05-08T05:34:15.405 INFO:teuthology.orchestra.run.smithi160.stdout: "get_sum": 0, 2024-05-08T05:34:15.405 INFO:teuthology.orchestra.run.smithi160.stdout: "get_or_fail_fail": 0, 2024-05-08T05:34:15.405 INFO:teuthology.orchestra.run.smithi160.stdout: "get_or_fail_success": 0, 2024-05-08T05:34:15.405 INFO:teuthology.orchestra.run.smithi160.stdout: "take": 1674, 2024-05-08T05:34:15.405 INFO:teuthology.orchestra.run.smithi160.stdout: "take_sum": 67910022, 2024-05-08T05:34:15.405 INFO:teuthology.orchestra.run.smithi160.stdout: "put": 1674, 2024-05-08T05:34:15.405 INFO:teuthology.orchestra.run.smithi160.stdout: "put_sum": 67910022, 2024-05-08T05:34:15.405 INFO:teuthology.orchestra.run.smithi160.stdout: "wait": { 2024-05-08T05:34:15.406 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 0, 2024-05-08T05:34:15.406 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000000000, 2024-05-08T05:34:15.406 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000000 2024-05-08T05:34:15.406 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-05-08T05:34:15.406 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-05-08T05:34:15.406 INFO:teuthology.orchestra.run.smithi160.stdout: "throttle-objecter_ops": { 2024-05-08T05:34:15.406 INFO:teuthology.orchestra.run.smithi160.stdout: "val": 0, 2024-05-08T05:34:15.406 INFO:teuthology.orchestra.run.smithi160.stdout: "max": 1024, 2024-05-08T05:34:15.406 INFO:teuthology.orchestra.run.smithi160.stdout: "get_started": 0, 2024-05-08T05:34:15.406 INFO:teuthology.orchestra.run.smithi160.stdout: "get": 0, 2024-05-08T05:34:15.406 INFO:teuthology.orchestra.run.smithi160.stdout: "get_sum": 0, 2024-05-08T05:34:15.406 INFO:teuthology.orchestra.run.smithi160.stdout: "get_or_fail_fail": 0, 2024-05-08T05:34:15.406 INFO:teuthology.orchestra.run.smithi160.stdout: "get_or_fail_success": 0, 2024-05-08T05:34:15.407 INFO:teuthology.orchestra.run.smithi160.stdout: "take": 1674, 2024-05-08T05:34:15.407 INFO:teuthology.orchestra.run.smithi160.stdout: "take_sum": 1674, 2024-05-08T05:34:15.407 INFO:teuthology.orchestra.run.smithi160.stdout: "put": 1674, 2024-05-08T05:34:15.407 INFO:teuthology.orchestra.run.smithi160.stdout: "put_sum": 1674, 2024-05-08T05:34:15.407 INFO:teuthology.orchestra.run.smithi160.stdout: "wait": { 2024-05-08T05:34:15.407 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 0, 2024-05-08T05:34:15.407 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000000000, 2024-05-08T05:34:15.407 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000000 2024-05-08T05:34:15.407 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-05-08T05:34:15.407 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-05-08T05:34:15.407 INFO:teuthology.orchestra.run.smithi160.stdout: "throttle-write_buf_throttle": { 2024-05-08T05:34:15.407 INFO:teuthology.orchestra.run.smithi160.stdout: "val": 0, 2024-05-08T05:34:15.407 INFO:teuthology.orchestra.run.smithi160.stdout: "max": 3758096384, 2024-05-08T05:34:15.407 INFO:teuthology.orchestra.run.smithi160.stdout: "get_started": 0, 2024-05-08T05:34:15.407 INFO:teuthology.orchestra.run.smithi160.stdout: "get": 0, 2024-05-08T05:34:15.407 INFO:teuthology.orchestra.run.smithi160.stdout: "get_sum": 0, 2024-05-08T05:34:15.408 INFO:teuthology.orchestra.run.smithi160.stdout: "get_or_fail_fail": 0, 2024-05-08T05:34:15.408 INFO:teuthology.orchestra.run.smithi160.stdout: "get_or_fail_success": 0, 2024-05-08T05:34:15.408 INFO:teuthology.orchestra.run.smithi160.stdout: "take": 0, 2024-05-08T05:34:15.408 INFO:teuthology.orchestra.run.smithi160.stdout: "take_sum": 0, 2024-05-08T05:34:15.408 INFO:teuthology.orchestra.run.smithi160.stdout: "put": 0, 2024-05-08T05:34:15.408 INFO:teuthology.orchestra.run.smithi160.stdout: "put_sum": 0, 2024-05-08T05:34:15.408 INFO:teuthology.orchestra.run.smithi160.stdout: "wait": { 2024-05-08T05:34:15.408 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 0, 2024-05-08T05:34:15.408 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000000000, 2024-05-08T05:34:15.408 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000000 2024-05-08T05:34:15.408 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-05-08T05:34:15.408 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-05-08T05:34:15.408 INFO:teuthology.orchestra.run.smithi160.stdout: "throttle-write_buf_throttle-0x55c754f2a6e0": { 2024-05-08T05:34:15.408 INFO:teuthology.orchestra.run.smithi160.stdout: "val": 0, 2024-05-08T05:34:15.408 INFO:teuthology.orchestra.run.smithi160.stdout: "max": 3758096384, 2024-05-08T05:34:15.408 INFO:teuthology.orchestra.run.smithi160.stdout: "get_started": 0, 2024-05-08T05:34:15.409 INFO:teuthology.orchestra.run.smithi160.stdout: "get": 0, 2024-05-08T05:34:15.409 INFO:teuthology.orchestra.run.smithi160.stdout: "get_sum": 0, 2024-05-08T05:34:15.409 INFO:teuthology.orchestra.run.smithi160.stdout: "get_or_fail_fail": 0, 2024-05-08T05:34:15.409 INFO:teuthology.orchestra.run.smithi160.stdout: "get_or_fail_success": 0, 2024-05-08T05:34:15.409 INFO:teuthology.orchestra.run.smithi160.stdout: "take": 0, 2024-05-08T05:34:15.409 INFO:teuthology.orchestra.run.smithi160.stdout: "take_sum": 0, 2024-05-08T05:34:15.409 INFO:teuthology.orchestra.run.smithi160.stdout: "put": 0, 2024-05-08T05:34:15.409 INFO:teuthology.orchestra.run.smithi160.stdout: "put_sum": 0, 2024-05-08T05:34:15.409 INFO:teuthology.orchestra.run.smithi160.stdout: "wait": { 2024-05-08T05:34:15.409 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 0, 2024-05-08T05:34:15.409 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000000000, 2024-05-08T05:34:15.409 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000000 2024-05-08T05:34:15.409 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-05-08T05:34:15.409 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-05-08T05:34:15.410 INFO:teuthology.orchestra.run.smithi160.stdout:} 2024-05-08T05:34:16.060 INFO:tasks.check_counter:Daemon mds.c mds.exported=0 2024-05-08T05:34:16.061 INFO:tasks.check_counter:Daemon mds.c mds.imported=0 2024-05-08T05:34:16.061 INFO:tasks.check_counter:Daemon mds.c mds_cache.dir_update=0 2024-05-08T05:34:16.061 INFO:tasks.check_counter:Daemon mds.c mds_cache.dir_update_receipt=0 2024-05-08T05:34:16.061 DEBUG:tasks.check_counter:Getting stats from f 2024-05-08T05:34:16.061 DEBUG:teuthology.orchestra.run.smithi160:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid eeeb813e-0cf9-11ef-bc97-c7b262605968 -- ceph daemon mds.f perf dump 2024-05-08T05:34:16.317 INFO:teuthology.orchestra.run.smithi160.stderr:Inferring config /var/lib/ceph/eeeb813e-0cf9-11ef-bc97-c7b262605968/mon.c/config 2024-05-08T05:34:16.728 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:34:16 smithi160 ceph-mon[34827]: pgmap v578: 97 pgs: 97 active+clean; 153 MiB data, 1004 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2024-05-08T05:34:16.888 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:34:16 smithi090 ceph-mon[34526]: pgmap v578: 97 pgs: 97 active+clean; 153 MiB data, 1004 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2024-05-08T05:34:16.958 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:34:16 smithi087 ceph-mon[29523]: pgmap v578: 97 pgs: 97 active+clean; 153 MiB data, 1004 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2024-05-08T05:34:18.155 INFO:teuthology.orchestra.run.smithi160.stdout:{ 2024-05-08T05:34:18.155 INFO:teuthology.orchestra.run.smithi160.stdout: "AsyncMessenger::Worker-0": { 2024-05-08T05:34:18.156 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_recv_messages": 215, 2024-05-08T05:34:18.156 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_send_messages": 204, 2024-05-08T05:34:18.156 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_recv_bytes": 4744568, 2024-05-08T05:34:18.156 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_send_bytes": 108482, 2024-05-08T05:34:18.156 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_created_connections": 6, 2024-05-08T05:34:18.156 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_active_connections": 2, 2024-05-08T05:34:18.156 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_running_total_time": 0.033312789, 2024-05-08T05:34:18.156 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_running_send_time": 0.010686062, 2024-05-08T05:34:18.156 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_running_recv_time": 0.017909878, 2024-05-08T05:34:18.156 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_running_fast_dispatch_time": 0.004701519, 2024-05-08T05:34:18.156 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_send_messages_queue_lat": { 2024-05-08T05:34:18.156 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 204, 2024-05-08T05:34:18.156 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.011922593, 2024-05-08T05:34:18.157 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000058444 2024-05-08T05:34:18.157 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-05-08T05:34:18.157 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_handle_ack_lat": { 2024-05-08T05:34:18.157 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 0, 2024-05-08T05:34:18.157 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000000000, 2024-05-08T05:34:18.157 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000000 2024-05-08T05:34:18.157 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-05-08T05:34:18.157 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_recv_encrypted_bytes": 538992, 2024-05-08T05:34:18.157 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_send_encrypted_bytes": 95120 2024-05-08T05:34:18.157 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-05-08T05:34:18.157 INFO:teuthology.orchestra.run.smithi160.stdout: "AsyncMessenger::Worker-1": { 2024-05-08T05:34:18.157 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_recv_messages": 384, 2024-05-08T05:34:18.157 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_send_messages": 499, 2024-05-08T05:34:18.157 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_recv_bytes": 16872576, 2024-05-08T05:34:18.158 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_send_bytes": 393255, 2024-05-08T05:34:18.158 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_created_connections": 6, 2024-05-08T05:34:18.158 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_active_connections": 5, 2024-05-08T05:34:18.158 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_running_total_time": 0.053185140, 2024-05-08T05:34:18.158 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_running_send_time": 0.015304449, 2024-05-08T05:34:18.158 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_running_recv_time": 0.018787189, 2024-05-08T05:34:18.158 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_running_fast_dispatch_time": 0.014769889, 2024-05-08T05:34:18.158 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_send_messages_queue_lat": { 2024-05-08T05:34:18.158 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 497, 2024-05-08T05:34:18.158 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.020964004, 2024-05-08T05:34:18.158 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000042181 2024-05-08T05:34:18.158 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-05-08T05:34:18.158 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_handle_ack_lat": { 2024-05-08T05:34:18.158 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 0, 2024-05-08T05:34:18.158 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000000000, 2024-05-08T05:34:18.159 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000000 2024-05-08T05:34:18.159 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-05-08T05:34:18.159 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_recv_encrypted_bytes": 160, 2024-05-08T05:34:18.159 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_send_encrypted_bytes": 271456 2024-05-08T05:34:18.159 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-05-08T05:34:18.159 INFO:teuthology.orchestra.run.smithi160.stdout: "AsyncMessenger::Worker-2": { 2024-05-08T05:34:18.159 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_recv_messages": 1076, 2024-05-08T05:34:18.159 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_send_messages": 1078, 2024-05-08T05:34:18.159 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_recv_bytes": 23636693, 2024-05-08T05:34:18.159 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_send_bytes": 342226, 2024-05-08T05:34:18.159 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_created_connections": 6, 2024-05-08T05:34:18.159 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_active_connections": 5, 2024-05-08T05:34:18.159 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_running_total_time": 0.119977026, 2024-05-08T05:34:18.159 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_running_send_time": 0.031752733, 2024-05-08T05:34:18.160 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_running_recv_time": 0.043159681, 2024-05-08T05:34:18.160 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_running_fast_dispatch_time": 0.035571516, 2024-05-08T05:34:18.160 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_send_messages_queue_lat": { 2024-05-08T05:34:18.160 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 1076, 2024-05-08T05:34:18.160 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.043753348, 2024-05-08T05:34:18.160 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000040662 2024-05-08T05:34:18.160 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-05-08T05:34:18.160 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_handle_ack_lat": { 2024-05-08T05:34:18.160 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 0, 2024-05-08T05:34:18.160 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000000000, 2024-05-08T05:34:18.160 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000000 2024-05-08T05:34:18.160 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-05-08T05:34:18.160 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_recv_encrypted_bytes": 0, 2024-05-08T05:34:18.160 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_send_encrypted_bytes": 0 2024-05-08T05:34:18.160 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-05-08T05:34:18.161 INFO:teuthology.orchestra.run.smithi160.stdout: "cct": { 2024-05-08T05:34:18.161 INFO:teuthology.orchestra.run.smithi160.stdout: "total_workers": 1, 2024-05-08T05:34:18.161 INFO:teuthology.orchestra.run.smithi160.stdout: "unhealthy_workers": 0 2024-05-08T05:34:18.161 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-05-08T05:34:18.161 INFO:teuthology.orchestra.run.smithi160.stdout: "finisher-MDSRank": { 2024-05-08T05:34:18.161 INFO:teuthology.orchestra.run.smithi160.stdout: "queue_len": 0, 2024-05-08T05:34:18.161 INFO:teuthology.orchestra.run.smithi160.stdout: "complete_latency": { 2024-05-08T05:34:18.161 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 2527, 2024-05-08T05:34:18.161 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.071555849, 2024-05-08T05:34:18.161 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000028316 2024-05-08T05:34:18.161 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-05-08T05:34:18.161 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-05-08T05:34:18.161 INFO:teuthology.orchestra.run.smithi160.stdout: "finisher-PurgeQueue": { 2024-05-08T05:34:18.161 INFO:teuthology.orchestra.run.smithi160.stdout: "queue_len": 0, 2024-05-08T05:34:18.162 INFO:teuthology.orchestra.run.smithi160.stdout: "complete_latency": { 2024-05-08T05:34:18.162 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 0, 2024-05-08T05:34:18.162 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000000000, 2024-05-08T05:34:18.162 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000000 2024-05-08T05:34:18.162 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-05-08T05:34:18.162 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-05-08T05:34:18.162 INFO:teuthology.orchestra.run.smithi160.stdout: "mds": { 2024-05-08T05:34:18.162 INFO:teuthology.orchestra.run.smithi160.stdout: "request": 0, 2024-05-08T05:34:18.162 INFO:teuthology.orchestra.run.smithi160.stdout: "reply": 0, 2024-05-08T05:34:18.162 INFO:teuthology.orchestra.run.smithi160.stdout: "reply_latency": { 2024-05-08T05:34:18.162 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 0, 2024-05-08T05:34:18.162 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000000000, 2024-05-08T05:34:18.162 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000000 2024-05-08T05:34:18.163 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-05-08T05:34:18.163 INFO:teuthology.orchestra.run.smithi160.stdout: "slow_reply": 0, 2024-05-08T05:34:18.163 INFO:teuthology.orchestra.run.smithi160.stdout: "forward": 0, 2024-05-08T05:34:18.163 INFO:teuthology.orchestra.run.smithi160.stdout: "dir_fetch_complete": 0, 2024-05-08T05:34:18.163 INFO:teuthology.orchestra.run.smithi160.stdout: "dir_fetch_keys": 0, 2024-05-08T05:34:18.163 INFO:teuthology.orchestra.run.smithi160.stdout: "dir_commit": 0, 2024-05-08T05:34:18.163 INFO:teuthology.orchestra.run.smithi160.stdout: "dir_split": 0, 2024-05-08T05:34:18.163 INFO:teuthology.orchestra.run.smithi160.stdout: "dir_merge": 0, 2024-05-08T05:34:18.163 INFO:teuthology.orchestra.run.smithi160.stdout: "inodes": 7917, 2024-05-08T05:34:18.163 INFO:teuthology.orchestra.run.smithi160.stdout: "inodes_top": 0, 2024-05-08T05:34:18.163 INFO:teuthology.orchestra.run.smithi160.stdout: "inodes_bottom": 7917, 2024-05-08T05:34:18.163 INFO:teuthology.orchestra.run.smithi160.stdout: "inodes_pin_tail": 0, 2024-05-08T05:34:18.163 INFO:teuthology.orchestra.run.smithi160.stdout: "inodes_pinned": 7917, 2024-05-08T05:34:18.163 INFO:teuthology.orchestra.run.smithi160.stdout: "inodes_expired": 0, 2024-05-08T05:34:18.164 INFO:teuthology.orchestra.run.smithi160.stdout: "inodes_with_caps": 0, 2024-05-08T05:34:18.164 INFO:teuthology.orchestra.run.smithi160.stdout: "caps": 0, 2024-05-08T05:34:18.164 INFO:teuthology.orchestra.run.smithi160.stdout: "subtrees": 1, 2024-05-08T05:34:18.164 INFO:teuthology.orchestra.run.smithi160.stdout: "traverse": 0, 2024-05-08T05:34:18.164 INFO:teuthology.orchestra.run.smithi160.stdout: "traverse_hit": 0, 2024-05-08T05:34:18.164 INFO:teuthology.orchestra.run.smithi160.stdout: "traverse_forward": 0, 2024-05-08T05:34:18.164 INFO:teuthology.orchestra.run.smithi160.stdout: "traverse_discover": 0, 2024-05-08T05:34:18.164 INFO:teuthology.orchestra.run.smithi160.stdout: "traverse_dir_fetch": 0, 2024-05-08T05:34:18.164 INFO:teuthology.orchestra.run.smithi160.stdout: "traverse_remote_ino": 0, 2024-05-08T05:34:18.164 INFO:teuthology.orchestra.run.smithi160.stdout: "traverse_lock": 0, 2024-05-08T05:34:18.164 INFO:teuthology.orchestra.run.smithi160.stdout: "load_cent": 0, 2024-05-08T05:34:18.164 INFO:teuthology.orchestra.run.smithi160.stdout: "q": 0, 2024-05-08T05:34:18.164 INFO:teuthology.orchestra.run.smithi160.stdout: "exported": 0, 2024-05-08T05:34:18.164 INFO:teuthology.orchestra.run.smithi160.stdout: "exported_inodes": 0, 2024-05-08T05:34:18.164 INFO:teuthology.orchestra.run.smithi160.stdout: "imported": 0, 2024-05-08T05:34:18.165 INFO:teuthology.orchestra.run.smithi160.stdout: "imported_inodes": 0, 2024-05-08T05:34:18.165 INFO:teuthology.orchestra.run.smithi160.stdout: "openino_dir_fetch": 0, 2024-05-08T05:34:18.165 INFO:teuthology.orchestra.run.smithi160.stdout: "openino_backtrace_fetch": 0, 2024-05-08T05:34:18.165 INFO:teuthology.orchestra.run.smithi160.stdout: "openino_peer_discover": 0, 2024-05-08T05:34:18.165 INFO:teuthology.orchestra.run.smithi160.stdout: "root_rfiles": 0, 2024-05-08T05:34:18.165 INFO:teuthology.orchestra.run.smithi160.stdout: "root_rbytes": 0, 2024-05-08T05:34:18.165 INFO:teuthology.orchestra.run.smithi160.stdout: "root_rsnaps": 0, 2024-05-08T05:34:18.165 INFO:teuthology.orchestra.run.smithi160.stdout: "scrub_backtrace_fetch": 0, 2024-05-08T05:34:18.165 INFO:teuthology.orchestra.run.smithi160.stdout: "scrub_set_tag": 0, 2024-05-08T05:34:18.165 INFO:teuthology.orchestra.run.smithi160.stdout: "scrub_backtrace_repaired": 0, 2024-05-08T05:34:18.165 INFO:teuthology.orchestra.run.smithi160.stdout: "scrub_inotable_repaired": 0, 2024-05-08T05:34:18.165 INFO:teuthology.orchestra.run.smithi160.stdout: "scrub_dir_inodes": 0, 2024-05-08T05:34:18.165 INFO:teuthology.orchestra.run.smithi160.stdout: "scrub_dir_base_inodes": 0, 2024-05-08T05:34:18.165 INFO:teuthology.orchestra.run.smithi160.stdout: "scrub_dirfrag_rstats": 0, 2024-05-08T05:34:18.166 INFO:teuthology.orchestra.run.smithi160.stdout: "scrub_file_inodes": 0, 2024-05-08T05:34:18.166 INFO:teuthology.orchestra.run.smithi160.stdout: "handle_inode_file_caps": 0, 2024-05-08T05:34:18.166 INFO:teuthology.orchestra.run.smithi160.stdout: "ceph_cap_op_revoke": 0, 2024-05-08T05:34:18.166 INFO:teuthology.orchestra.run.smithi160.stdout: "ceph_cap_op_grant": 0, 2024-05-08T05:34:18.166 INFO:teuthology.orchestra.run.smithi160.stdout: "ceph_cap_op_trunc": 0, 2024-05-08T05:34:18.166 INFO:teuthology.orchestra.run.smithi160.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-05-08T05:34:18.166 INFO:teuthology.orchestra.run.smithi160.stdout: "ceph_cap_op_flush_ack": 0, 2024-05-08T05:34:18.166 INFO:teuthology.orchestra.run.smithi160.stdout: "handle_client_caps": 0, 2024-05-08T05:34:18.166 INFO:teuthology.orchestra.run.smithi160.stdout: "handle_client_caps_dirty": 0, 2024-05-08T05:34:18.166 INFO:teuthology.orchestra.run.smithi160.stdout: "handle_client_cap_release": 0, 2024-05-08T05:34:18.166 INFO:teuthology.orchestra.run.smithi160.stdout: "process_request_cap_release": 0 2024-05-08T05:34:18.166 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-05-08T05:34:18.166 INFO:teuthology.orchestra.run.smithi160.stdout: "mds_cache": { 2024-05-08T05:34:18.167 INFO:teuthology.orchestra.run.smithi160.stdout: "dir_update": 0, 2024-05-08T05:34:18.167 INFO:teuthology.orchestra.run.smithi160.stdout: "dir_update_receipt": 0, 2024-05-08T05:34:18.167 INFO:teuthology.orchestra.run.smithi160.stdout: "dir_try_discover": 0, 2024-05-08T05:34:18.167 INFO:teuthology.orchestra.run.smithi160.stdout: "dir_send_discover": 0, 2024-05-08T05:34:18.167 INFO:teuthology.orchestra.run.smithi160.stdout: "dir_handle_discover": 0, 2024-05-08T05:34:18.167 INFO:teuthology.orchestra.run.smithi160.stdout: "num_strays": 0, 2024-05-08T05:34:18.167 INFO:teuthology.orchestra.run.smithi160.stdout: "num_strays_delayed": 0, 2024-05-08T05:34:18.167 INFO:teuthology.orchestra.run.smithi160.stdout: "num_strays_enqueuing": 0, 2024-05-08T05:34:18.167 INFO:teuthology.orchestra.run.smithi160.stdout: "strays_created": 0, 2024-05-08T05:34:18.167 INFO:teuthology.orchestra.run.smithi160.stdout: "strays_enqueued": 0, 2024-05-08T05:34:18.167 INFO:teuthology.orchestra.run.smithi160.stdout: "strays_reintegrated": 0, 2024-05-08T05:34:18.167 INFO:teuthology.orchestra.run.smithi160.stdout: "strays_migrated": 0, 2024-05-08T05:34:18.167 INFO:teuthology.orchestra.run.smithi160.stdout: "num_recovering_processing": 0, 2024-05-08T05:34:18.167 INFO:teuthology.orchestra.run.smithi160.stdout: "num_recovering_enqueued": 0, 2024-05-08T05:34:18.167 INFO:teuthology.orchestra.run.smithi160.stdout: "num_recovering_prioritized": 0, 2024-05-08T05:34:18.168 INFO:teuthology.orchestra.run.smithi160.stdout: "recovery_started": 0, 2024-05-08T05:34:18.168 INFO:teuthology.orchestra.run.smithi160.stdout: "recovery_completed": 0, 2024-05-08T05:34:18.168 INFO:teuthology.orchestra.run.smithi160.stdout: "ireq_quiesce_path": 0, 2024-05-08T05:34:18.168 INFO:teuthology.orchestra.run.smithi160.stdout: "ireq_quiesce_inode": 0, 2024-05-08T05:34:18.168 INFO:teuthology.orchestra.run.smithi160.stdout: "ireq_enqueue_scrub": 0, 2024-05-08T05:34:18.168 INFO:teuthology.orchestra.run.smithi160.stdout: "ireq_exportdir": 0, 2024-05-08T05:34:18.168 INFO:teuthology.orchestra.run.smithi160.stdout: "ireq_flush": 0, 2024-05-08T05:34:18.168 INFO:teuthology.orchestra.run.smithi160.stdout: "ireq_fragmentdir": 0, 2024-05-08T05:34:18.168 INFO:teuthology.orchestra.run.smithi160.stdout: "ireq_fragstats": 0, 2024-05-08T05:34:18.168 INFO:teuthology.orchestra.run.smithi160.stdout: "ireq_inodestats": 0 2024-05-08T05:34:18.168 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-05-08T05:34:18.168 INFO:teuthology.orchestra.run.smithi160.stdout: "mds_log": { 2024-05-08T05:34:18.168 INFO:teuthology.orchestra.run.smithi160.stdout: "evlrg": 0, 2024-05-08T05:34:18.168 INFO:teuthology.orchestra.run.smithi160.stdout: "evadd": 0, 2024-05-08T05:34:18.169 INFO:teuthology.orchestra.run.smithi160.stdout: "evex": 0, 2024-05-08T05:34:18.169 INFO:teuthology.orchestra.run.smithi160.stdout: "evtrm": 0, 2024-05-08T05:34:18.169 INFO:teuthology.orchestra.run.smithi160.stdout: "ev": 21029, 2024-05-08T05:34:18.169 INFO:teuthology.orchestra.run.smithi160.stdout: "evexg": 0, 2024-05-08T05:34:18.169 INFO:teuthology.orchestra.run.smithi160.stdout: "evexd": 0, 2024-05-08T05:34:18.169 INFO:teuthology.orchestra.run.smithi160.stdout: "segadd": 0, 2024-05-08T05:34:18.169 INFO:teuthology.orchestra.run.smithi160.stdout: "segex": 0, 2024-05-08T05:34:18.169 INFO:teuthology.orchestra.run.smithi160.stdout: "segtrm": 0, 2024-05-08T05:34:18.169 INFO:teuthology.orchestra.run.smithi160.stdout: "seg": 29, 2024-05-08T05:34:18.169 INFO:teuthology.orchestra.run.smithi160.stdout: "segmjr": 3, 2024-05-08T05:34:18.169 INFO:teuthology.orchestra.run.smithi160.stdout: "segexg": 0, 2024-05-08T05:34:18.169 INFO:teuthology.orchestra.run.smithi160.stdout: "segexd": 0, 2024-05-08T05:34:18.169 INFO:teuthology.orchestra.run.smithi160.stdout: "expos": 4194304, 2024-05-08T05:34:18.170 INFO:teuthology.orchestra.run.smithi160.stdout: "wrpos": 48481280, 2024-05-08T05:34:18.170 INFO:teuthology.orchestra.run.smithi160.stdout: "rdpos": 48480681, 2024-05-08T05:34:18.170 INFO:teuthology.orchestra.run.smithi160.stdout: "jlat": { 2024-05-08T05:34:18.170 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 0, 2024-05-08T05:34:18.170 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000000000, 2024-05-08T05:34:18.170 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000000 2024-05-08T05:34:18.170 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-05-08T05:34:18.170 INFO:teuthology.orchestra.run.smithi160.stdout: "replayed": 21029 2024-05-08T05:34:18.170 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-05-08T05:34:18.170 INFO:teuthology.orchestra.run.smithi160.stdout: "mds_mem": { 2024-05-08T05:34:18.170 INFO:teuthology.orchestra.run.smithi160.stdout: "ino": 139, 2024-05-08T05:34:18.170 INFO:teuthology.orchestra.run.smithi160.stdout: "ino+": 6379, 2024-05-08T05:34:18.170 INFO:teuthology.orchestra.run.smithi160.stdout: "ino-": 6240, 2024-05-08T05:34:18.171 INFO:teuthology.orchestra.run.smithi160.stdout: "dir": 141, 2024-05-08T05:34:18.171 INFO:teuthology.orchestra.run.smithi160.stdout: "dir+": 886, 2024-05-08T05:34:18.171 INFO:teuthology.orchestra.run.smithi160.stdout: "dir-": 745, 2024-05-08T05:34:18.171 INFO:teuthology.orchestra.run.smithi160.stdout: "dn": 7917, 2024-05-08T05:34:18.171 INFO:teuthology.orchestra.run.smithi160.stdout: "dn+": 12850, 2024-05-08T05:34:18.171 INFO:teuthology.orchestra.run.smithi160.stdout: "dn-": 4933, 2024-05-08T05:34:18.171 INFO:teuthology.orchestra.run.smithi160.stdout: "cap": 0, 2024-05-08T05:34:18.171 INFO:teuthology.orchestra.run.smithi160.stdout: "cap+": 0, 2024-05-08T05:34:18.171 INFO:teuthology.orchestra.run.smithi160.stdout: "cap-": 0, 2024-05-08T05:34:18.171 INFO:teuthology.orchestra.run.smithi160.stdout: "rss": 68548, 2024-05-08T05:34:18.171 INFO:teuthology.orchestra.run.smithi160.stdout: "heap": 215416 2024-05-08T05:34:18.171 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-05-08T05:34:18.171 INFO:teuthology.orchestra.run.smithi160.stdout: "mds_server": { 2024-05-08T05:34:18.171 INFO:teuthology.orchestra.run.smithi160.stdout: "dispatch_client_request": 0, 2024-05-08T05:34:18.172 INFO:teuthology.orchestra.run.smithi160.stdout: "dispatch_server_request": 0, 2024-05-08T05:34:18.172 INFO:teuthology.orchestra.run.smithi160.stdout: "handle_client_request": 0, 2024-05-08T05:34:18.172 INFO:teuthology.orchestra.run.smithi160.stdout: "handle_client_session": 0, 2024-05-08T05:34:18.172 INFO:teuthology.orchestra.run.smithi160.stdout: "handle_peer_request": 0, 2024-05-08T05:34:18.172 INFO:teuthology.orchestra.run.smithi160.stdout: "req_create_latency": { 2024-05-08T05:34:18.172 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 0, 2024-05-08T05:34:18.172 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000000000, 2024-05-08T05:34:18.172 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000000 2024-05-08T05:34:18.172 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-05-08T05:34:18.172 INFO:teuthology.orchestra.run.smithi160.stdout: "req_getattr_latency": { 2024-05-08T05:34:18.172 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 0, 2024-05-08T05:34:18.172 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000000000, 2024-05-08T05:34:18.172 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000000 2024-05-08T05:34:18.173 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-05-08T05:34:18.173 INFO:teuthology.orchestra.run.smithi160.stdout: "req_getfilelock_latency": { 2024-05-08T05:34:18.173 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 0, 2024-05-08T05:34:18.173 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000000000, 2024-05-08T05:34:18.173 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000000 2024-05-08T05:34:18.173 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-05-08T05:34:18.173 INFO:teuthology.orchestra.run.smithi160.stdout: "req_link_latency": { 2024-05-08T05:34:18.173 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 0, 2024-05-08T05:34:18.173 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000000000, 2024-05-08T05:34:18.173 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000000 2024-05-08T05:34:18.173 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-05-08T05:34:18.173 INFO:teuthology.orchestra.run.smithi160.stdout: "req_lookup_latency": { 2024-05-08T05:34:18.173 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 0, 2024-05-08T05:34:18.173 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000000000, 2024-05-08T05:34:18.174 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000000 2024-05-08T05:34:18.174 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-05-08T05:34:18.174 INFO:teuthology.orchestra.run.smithi160.stdout: "req_lookuphash_latency": { 2024-05-08T05:34:18.174 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 0, 2024-05-08T05:34:18.174 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000000000, 2024-05-08T05:34:18.174 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000000 2024-05-08T05:34:18.174 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-05-08T05:34:18.174 INFO:teuthology.orchestra.run.smithi160.stdout: "req_lookupino_latency": { 2024-05-08T05:34:18.174 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 0, 2024-05-08T05:34:18.174 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000000000, 2024-05-08T05:34:18.174 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000000 2024-05-08T05:34:18.174 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-05-08T05:34:18.174 INFO:teuthology.orchestra.run.smithi160.stdout: "req_lookupname_latency": { 2024-05-08T05:34:18.174 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 0, 2024-05-08T05:34:18.175 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000000000, 2024-05-08T05:34:18.175 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000000 2024-05-08T05:34:18.175 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-05-08T05:34:18.175 INFO:teuthology.orchestra.run.smithi160.stdout: "req_lookupparent_latency": { 2024-05-08T05:34:18.175 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 0, 2024-05-08T05:34:18.175 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000000000, 2024-05-08T05:34:18.175 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000000 2024-05-08T05:34:18.175 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-05-08T05:34:18.175 INFO:teuthology.orchestra.run.smithi160.stdout: "req_lookupsnap_latency": { 2024-05-08T05:34:18.176 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 0, 2024-05-08T05:34:18.176 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000000000, 2024-05-08T05:34:18.176 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000000 2024-05-08T05:34:18.176 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-05-08T05:34:18.176 INFO:teuthology.orchestra.run.smithi160.stdout: "req_lssnap_latency": { 2024-05-08T05:34:18.176 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 0, 2024-05-08T05:34:18.176 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000000000, 2024-05-08T05:34:18.176 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000000 2024-05-08T05:34:18.176 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-05-08T05:34:18.176 INFO:teuthology.orchestra.run.smithi160.stdout: "req_mkdir_latency": { 2024-05-08T05:34:18.177 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 0, 2024-05-08T05:34:18.177 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000000000, 2024-05-08T05:34:18.177 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000000 2024-05-08T05:34:18.177 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-05-08T05:34:18.177 INFO:teuthology.orchestra.run.smithi160.stdout: "req_mknod_latency": { 2024-05-08T05:34:18.177 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 0, 2024-05-08T05:34:18.178 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000000000, 2024-05-08T05:34:18.178 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000000 2024-05-08T05:34:18.178 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-05-08T05:34:18.178 INFO:teuthology.orchestra.run.smithi160.stdout: "req_mksnap_latency": { 2024-05-08T05:34:18.178 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 0, 2024-05-08T05:34:18.178 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000000000, 2024-05-08T05:34:18.178 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000000 2024-05-08T05:34:18.178 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-05-08T05:34:18.178 INFO:teuthology.orchestra.run.smithi160.stdout: "req_open_latency": { 2024-05-08T05:34:18.178 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 0, 2024-05-08T05:34:18.178 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000000000, 2024-05-08T05:34:18.178 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000000 2024-05-08T05:34:18.178 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-05-08T05:34:18.178 INFO:teuthology.orchestra.run.smithi160.stdout: "req_readdir_latency": { 2024-05-08T05:34:18.179 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 0, 2024-05-08T05:34:18.179 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000000000, 2024-05-08T05:34:18.179 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000000 2024-05-08T05:34:18.179 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-05-08T05:34:18.179 INFO:teuthology.orchestra.run.smithi160.stdout: "req_rename_latency": { 2024-05-08T05:34:18.179 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 0, 2024-05-08T05:34:18.179 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000000000, 2024-05-08T05:34:18.179 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000000 2024-05-08T05:34:18.179 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-05-08T05:34:18.179 INFO:teuthology.orchestra.run.smithi160.stdout: "req_renamesnap_latency": { 2024-05-08T05:34:18.179 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 0, 2024-05-08T05:34:18.179 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000000000, 2024-05-08T05:34:18.179 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000000 2024-05-08T05:34:18.179 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-05-08T05:34:18.180 INFO:teuthology.orchestra.run.smithi160.stdout: "req_snapdiff_latency": { 2024-05-08T05:34:18.180 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 0, 2024-05-08T05:34:18.180 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000000000, 2024-05-08T05:34:18.180 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000000 2024-05-08T05:34:18.180 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-05-08T05:34:18.180 INFO:teuthology.orchestra.run.smithi160.stdout: "req_rmdir_latency": { 2024-05-08T05:34:18.180 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 0, 2024-05-08T05:34:18.180 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000000000, 2024-05-08T05:34:18.180 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000000 2024-05-08T05:34:18.180 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-05-08T05:34:18.180 INFO:teuthology.orchestra.run.smithi160.stdout: "req_rmsnap_latency": { 2024-05-08T05:34:18.181 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 0, 2024-05-08T05:34:18.181 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000000000, 2024-05-08T05:34:18.181 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000000 2024-05-08T05:34:18.181 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-05-08T05:34:18.181 INFO:teuthology.orchestra.run.smithi160.stdout: "req_rmxattr_latency": { 2024-05-08T05:34:18.181 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 0, 2024-05-08T05:34:18.181 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000000000, 2024-05-08T05:34:18.181 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000000 2024-05-08T05:34:18.181 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-05-08T05:34:18.181 INFO:teuthology.orchestra.run.smithi160.stdout: "req_setattr_latency": { 2024-05-08T05:34:18.181 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 0, 2024-05-08T05:34:18.181 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000000000, 2024-05-08T05:34:18.181 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000000 2024-05-08T05:34:18.181 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-05-08T05:34:18.182 INFO:teuthology.orchestra.run.smithi160.stdout: "req_setdirlayout_latency": { 2024-05-08T05:34:18.182 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 0, 2024-05-08T05:34:18.182 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000000000, 2024-05-08T05:34:18.182 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000000 2024-05-08T05:34:18.182 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-05-08T05:34:18.182 INFO:teuthology.orchestra.run.smithi160.stdout: "req_setfilelock_latency": { 2024-05-08T05:34:18.182 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 0, 2024-05-08T05:34:18.182 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000000000, 2024-05-08T05:34:18.182 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000000 2024-05-08T05:34:18.182 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-05-08T05:34:18.182 INFO:teuthology.orchestra.run.smithi160.stdout: "req_setlayout_latency": { 2024-05-08T05:34:18.182 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 0, 2024-05-08T05:34:18.183 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000000000, 2024-05-08T05:34:18.183 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000000 2024-05-08T05:34:18.183 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-05-08T05:34:18.183 INFO:teuthology.orchestra.run.smithi160.stdout: "req_setxattr_latency": { 2024-05-08T05:34:18.183 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 0, 2024-05-08T05:34:18.183 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000000000, 2024-05-08T05:34:18.183 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000000 2024-05-08T05:34:18.183 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-05-08T05:34:18.183 INFO:teuthology.orchestra.run.smithi160.stdout: "req_symlink_latency": { 2024-05-08T05:34:18.183 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 0, 2024-05-08T05:34:18.183 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000000000, 2024-05-08T05:34:18.183 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000000 2024-05-08T05:34:18.183 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-05-08T05:34:18.183 INFO:teuthology.orchestra.run.smithi160.stdout: "req_unlink_latency": { 2024-05-08T05:34:18.183 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 0, 2024-05-08T05:34:18.184 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000000000, 2024-05-08T05:34:18.184 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000000 2024-05-08T05:34:18.184 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-05-08T05:34:18.184 INFO:teuthology.orchestra.run.smithi160.stdout: "cap_revoke_eviction": 0, 2024-05-08T05:34:18.184 INFO:teuthology.orchestra.run.smithi160.stdout: "cap_acquisition_throttle": 0, 2024-05-08T05:34:18.184 INFO:teuthology.orchestra.run.smithi160.stdout: "req_getvxattr_latency": { 2024-05-08T05:34:18.184 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 0, 2024-05-08T05:34:18.184 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000000000, 2024-05-08T05:34:18.184 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000000 2024-05-08T05:34:18.184 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-05-08T05:34:18.184 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-05-08T05:34:18.184 INFO:teuthology.orchestra.run.smithi160.stdout: "mds_sessions": { 2024-05-08T05:34:18.184 INFO:teuthology.orchestra.run.smithi160.stdout: "session_count": 1, 2024-05-08T05:34:18.184 INFO:teuthology.orchestra.run.smithi160.stdout: "session_add": 2, 2024-05-08T05:34:18.184 INFO:teuthology.orchestra.run.smithi160.stdout: "session_remove": 1, 2024-05-08T05:34:18.185 INFO:teuthology.orchestra.run.smithi160.stdout: "sessions_open": 1, 2024-05-08T05:34:18.185 INFO:teuthology.orchestra.run.smithi160.stdout: "sessions_stale": 0, 2024-05-08T05:34:18.185 INFO:teuthology.orchestra.run.smithi160.stdout: "total_load": 0, 2024-05-08T05:34:18.185 INFO:teuthology.orchestra.run.smithi160.stdout: "average_load": 0, 2024-05-08T05:34:18.185 INFO:teuthology.orchestra.run.smithi160.stdout: "avg_session_uptime": 1999, 2024-05-08T05:34:18.185 INFO:teuthology.orchestra.run.smithi160.stdout: "mdthresh_evicted": 0 2024-05-08T05:34:18.185 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-05-08T05:34:18.185 INFO:teuthology.orchestra.run.smithi160.stdout: "mempool": { 2024-05-08T05:34:18.185 INFO:teuthology.orchestra.run.smithi160.stdout: "bloom_filter_bytes": 0, 2024-05-08T05:34:18.185 INFO:teuthology.orchestra.run.smithi160.stdout: "bloom_filter_items": 0, 2024-05-08T05:34:18.185 INFO:teuthology.orchestra.run.smithi160.stdout: "bluestore_alloc_bytes": 0, 2024-05-08T05:34:18.185 INFO:teuthology.orchestra.run.smithi160.stdout: "bluestore_alloc_items": 0, 2024-05-08T05:34:18.185 INFO:teuthology.orchestra.run.smithi160.stdout: "bluestore_cache_data_bytes": 0, 2024-05-08T05:34:18.186 INFO:teuthology.orchestra.run.smithi160.stdout: "bluestore_cache_data_items": 0, 2024-05-08T05:34:18.186 INFO:teuthology.orchestra.run.smithi160.stdout: "bluestore_cache_onode_bytes": 0, 2024-05-08T05:34:18.186 INFO:teuthology.orchestra.run.smithi160.stdout: "bluestore_cache_onode_items": 0, 2024-05-08T05:34:18.186 INFO:teuthology.orchestra.run.smithi160.stdout: "bluestore_cache_meta_bytes": 0, 2024-05-08T05:34:18.186 INFO:teuthology.orchestra.run.smithi160.stdout: "bluestore_cache_meta_items": 0, 2024-05-08T05:34:18.186 INFO:teuthology.orchestra.run.smithi160.stdout: "bluestore_cache_other_bytes": 0, 2024-05-08T05:34:18.186 INFO:teuthology.orchestra.run.smithi160.stdout: "bluestore_cache_other_items": 0, 2024-05-08T05:34:18.186 INFO:teuthology.orchestra.run.smithi160.stdout: "bluestore_cache_buffer_bytes": 0, 2024-05-08T05:34:18.186 INFO:teuthology.orchestra.run.smithi160.stdout: "bluestore_cache_buffer_items": 0, 2024-05-08T05:34:18.186 INFO:teuthology.orchestra.run.smithi160.stdout: "bluestore_extent_bytes": 0, 2024-05-08T05:34:18.186 INFO:teuthology.orchestra.run.smithi160.stdout: "bluestore_extent_items": 0, 2024-05-08T05:34:18.186 INFO:teuthology.orchestra.run.smithi160.stdout: "bluestore_blob_bytes": 0, 2024-05-08T05:34:18.186 INFO:teuthology.orchestra.run.smithi160.stdout: "bluestore_blob_items": 0, 2024-05-08T05:34:18.186 INFO:teuthology.orchestra.run.smithi160.stdout: "bluestore_shared_blob_bytes": 0, 2024-05-08T05:34:18.186 INFO:teuthology.orchestra.run.smithi160.stdout: "bluestore_shared_blob_items": 0, 2024-05-08T05:34:18.187 INFO:teuthology.orchestra.run.smithi160.stdout: "bluestore_inline_bl_bytes": 0, 2024-05-08T05:34:18.187 INFO:teuthology.orchestra.run.smithi160.stdout: "bluestore_inline_bl_items": 0, 2024-05-08T05:34:18.187 INFO:teuthology.orchestra.run.smithi160.stdout: "bluestore_fsck_bytes": 0, 2024-05-08T05:34:18.187 INFO:teuthology.orchestra.run.smithi160.stdout: "bluestore_fsck_items": 0, 2024-05-08T05:34:18.187 INFO:teuthology.orchestra.run.smithi160.stdout: "bluestore_txc_bytes": 0, 2024-05-08T05:34:18.187 INFO:teuthology.orchestra.run.smithi160.stdout: "bluestore_txc_items": 0, 2024-05-08T05:34:18.187 INFO:teuthology.orchestra.run.smithi160.stdout: "bluestore_writing_deferred_bytes": 0, 2024-05-08T05:34:18.187 INFO:teuthology.orchestra.run.smithi160.stdout: "bluestore_writing_deferred_items": 0, 2024-05-08T05:34:18.187 INFO:teuthology.orchestra.run.smithi160.stdout: "bluestore_writing_bytes": 0, 2024-05-08T05:34:18.187 INFO:teuthology.orchestra.run.smithi160.stdout: "bluestore_writing_items": 0, 2024-05-08T05:34:18.187 INFO:teuthology.orchestra.run.smithi160.stdout: "bluefs_bytes": 0, 2024-05-08T05:34:18.187 INFO:teuthology.orchestra.run.smithi160.stdout: "bluefs_items": 0, 2024-05-08T05:34:18.187 INFO:teuthology.orchestra.run.smithi160.stdout: "bluefs_file_reader_bytes": 0, 2024-05-08T05:34:18.187 INFO:teuthology.orchestra.run.smithi160.stdout: "bluefs_file_reader_items": 0, 2024-05-08T05:34:18.187 INFO:teuthology.orchestra.run.smithi160.stdout: "bluefs_file_writer_bytes": 0, 2024-05-08T05:34:18.188 INFO:teuthology.orchestra.run.smithi160.stdout: "bluefs_file_writer_items": 0, 2024-05-08T05:34:18.188 INFO:teuthology.orchestra.run.smithi160.stdout: "buffer_anon_bytes": 227127, 2024-05-08T05:34:18.188 INFO:teuthology.orchestra.run.smithi160.stdout: "buffer_anon_items": 194, 2024-05-08T05:34:18.188 INFO:teuthology.orchestra.run.smithi160.stdout: "buffer_meta_bytes": 0, 2024-05-08T05:34:18.188 INFO:teuthology.orchestra.run.smithi160.stdout: "buffer_meta_items": 0, 2024-05-08T05:34:18.188 INFO:teuthology.orchestra.run.smithi160.stdout: "osd_bytes": 0, 2024-05-08T05:34:18.188 INFO:teuthology.orchestra.run.smithi160.stdout: "osd_items": 0, 2024-05-08T05:34:18.188 INFO:teuthology.orchestra.run.smithi160.stdout: "osd_mapbl_bytes": 0, 2024-05-08T05:34:18.188 INFO:teuthology.orchestra.run.smithi160.stdout: "osd_mapbl_items": 0, 2024-05-08T05:34:18.188 INFO:teuthology.orchestra.run.smithi160.stdout: "osd_pglog_bytes": 0, 2024-05-08T05:34:18.188 INFO:teuthology.orchestra.run.smithi160.stdout: "osd_pglog_items": 0, 2024-05-08T05:34:18.188 INFO:teuthology.orchestra.run.smithi160.stdout: "osdmap_bytes": 7440, 2024-05-08T05:34:18.188 INFO:teuthology.orchestra.run.smithi160.stdout: "osdmap_items": 157, 2024-05-08T05:34:18.188 INFO:teuthology.orchestra.run.smithi160.stdout: "osdmap_mapping_bytes": 0, 2024-05-08T05:34:18.188 INFO:teuthology.orchestra.run.smithi160.stdout: "osdmap_mapping_items": 0, 2024-05-08T05:34:18.189 INFO:teuthology.orchestra.run.smithi160.stdout: "pgmap_bytes": 0, 2024-05-08T05:34:18.189 INFO:teuthology.orchestra.run.smithi160.stdout: "pgmap_items": 0, 2024-05-08T05:34:18.189 INFO:teuthology.orchestra.run.smithi160.stdout: "mds_co_bytes": 6109482, 2024-05-08T05:34:18.189 INFO:teuthology.orchestra.run.smithi160.stdout: "mds_co_items": 55487, 2024-05-08T05:34:18.189 INFO:teuthology.orchestra.run.smithi160.stdout: "unittest_1_bytes": 0, 2024-05-08T05:34:18.189 INFO:teuthology.orchestra.run.smithi160.stdout: "unittest_1_items": 0, 2024-05-08T05:34:18.189 INFO:teuthology.orchestra.run.smithi160.stdout: "unittest_2_bytes": 0, 2024-05-08T05:34:18.189 INFO:teuthology.orchestra.run.smithi160.stdout: "unittest_2_items": 0 2024-05-08T05:34:18.189 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-05-08T05:34:18.189 INFO:teuthology.orchestra.run.smithi160.stdout: "objecter": { 2024-05-08T05:34:18.189 INFO:teuthology.orchestra.run.smithi160.stdout: "op_active": 0, 2024-05-08T05:34:18.189 INFO:teuthology.orchestra.run.smithi160.stdout: "op_laggy": 0, 2024-05-08T05:34:18.189 INFO:teuthology.orchestra.run.smithi160.stdout: "op_send": 1501, 2024-05-08T05:34:18.189 INFO:teuthology.orchestra.run.smithi160.stdout: "op_send_bytes": 21, 2024-05-08T05:34:18.189 INFO:teuthology.orchestra.run.smithi160.stdout: "op_resend": 3, 2024-05-08T05:34:18.189 INFO:teuthology.orchestra.run.smithi160.stdout: "op_reply": 1501, 2024-05-08T05:34:18.190 INFO:teuthology.orchestra.run.smithi160.stdout: "op_latency": { 2024-05-08T05:34:18.190 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 1501, 2024-05-08T05:34:18.190 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 1.472978577, 2024-05-08T05:34:18.190 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000981331 2024-05-08T05:34:18.190 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-05-08T05:34:18.190 INFO:teuthology.orchestra.run.smithi160.stdout: "op_inflight": 0, 2024-05-08T05:34:18.190 INFO:teuthology.orchestra.run.smithi160.stdout: "oplen_avg": { 2024-05-08T05:34:18.190 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 1501, 2024-05-08T05:34:18.190 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 1502 2024-05-08T05:34:18.190 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-05-08T05:34:18.190 INFO:teuthology.orchestra.run.smithi160.stdout: "op": 1501, 2024-05-08T05:34:18.190 INFO:teuthology.orchestra.run.smithi160.stdout: "op_r": 1501, 2024-05-08T05:34:18.190 INFO:teuthology.orchestra.run.smithi160.stdout: "op_w": 0, 2024-05-08T05:34:18.190 INFO:teuthology.orchestra.run.smithi160.stdout: "op_rmw": 0, 2024-05-08T05:34:18.191 INFO:teuthology.orchestra.run.smithi160.stdout: "op_pg": 0, 2024-05-08T05:34:18.191 INFO:teuthology.orchestra.run.smithi160.stdout: "osdop_stat": 920, 2024-05-08T05:34:18.191 INFO:teuthology.orchestra.run.smithi160.stdout: "osdop_create": 0, 2024-05-08T05:34:18.191 INFO:teuthology.orchestra.run.smithi160.stdout: "osdop_read": 579, 2024-05-08T05:34:18.191 INFO:teuthology.orchestra.run.smithi160.stdout: "osdop_write": 0, 2024-05-08T05:34:18.191 INFO:teuthology.orchestra.run.smithi160.stdout: "osdop_writefull": 0, 2024-05-08T05:34:18.191 INFO:teuthology.orchestra.run.smithi160.stdout: "osdop_writesame": 0, 2024-05-08T05:34:18.191 INFO:teuthology.orchestra.run.smithi160.stdout: "osdop_append": 0, 2024-05-08T05:34:18.191 INFO:teuthology.orchestra.run.smithi160.stdout: "osdop_zero": 0, 2024-05-08T05:34:18.191 INFO:teuthology.orchestra.run.smithi160.stdout: "osdop_truncate": 0, 2024-05-08T05:34:18.191 INFO:teuthology.orchestra.run.smithi160.stdout: "osdop_delete": 0, 2024-05-08T05:34:18.191 INFO:teuthology.orchestra.run.smithi160.stdout: "osdop_mapext": 0, 2024-05-08T05:34:18.191 INFO:teuthology.orchestra.run.smithi160.stdout: "osdop_sparse_read": 0, 2024-05-08T05:34:18.191 INFO:teuthology.orchestra.run.smithi160.stdout: "osdop_clonerange": 0, 2024-05-08T05:34:18.191 INFO:teuthology.orchestra.run.smithi160.stdout: "osdop_getxattr": 1, 2024-05-08T05:34:18.191 INFO:teuthology.orchestra.run.smithi160.stdout: "osdop_setxattr": 0, 2024-05-08T05:34:18.192 INFO:teuthology.orchestra.run.smithi160.stdout: "osdop_cmpxattr": 0, 2024-05-08T05:34:18.192 INFO:teuthology.orchestra.run.smithi160.stdout: "osdop_rmxattr": 0, 2024-05-08T05:34:18.192 INFO:teuthology.orchestra.run.smithi160.stdout: "osdop_resetxattrs": 0, 2024-05-08T05:34:18.192 INFO:teuthology.orchestra.run.smithi160.stdout: "osdop_call": 0, 2024-05-08T05:34:18.192 INFO:teuthology.orchestra.run.smithi160.stdout: "osdop_watch": 0, 2024-05-08T05:34:18.192 INFO:teuthology.orchestra.run.smithi160.stdout: "osdop_notify": 0, 2024-05-08T05:34:18.192 INFO:teuthology.orchestra.run.smithi160.stdout: "osdop_src_cmpxattr": 0, 2024-05-08T05:34:18.192 INFO:teuthology.orchestra.run.smithi160.stdout: "osdop_pgls": 0, 2024-05-08T05:34:18.192 INFO:teuthology.orchestra.run.smithi160.stdout: "osdop_pgls_filter": 0, 2024-05-08T05:34:18.192 INFO:teuthology.orchestra.run.smithi160.stdout: "osdop_other": 0, 2024-05-08T05:34:18.192 INFO:teuthology.orchestra.run.smithi160.stdout: "linger_active": 0, 2024-05-08T05:34:18.192 INFO:teuthology.orchestra.run.smithi160.stdout: "linger_send": 0, 2024-05-08T05:34:18.192 INFO:teuthology.orchestra.run.smithi160.stdout: "linger_resend": 0, 2024-05-08T05:34:18.192 INFO:teuthology.orchestra.run.smithi160.stdout: "linger_ping": 0, 2024-05-08T05:34:18.193 INFO:teuthology.orchestra.run.smithi160.stdout: "poolop_active": 0, 2024-05-08T05:34:18.193 INFO:teuthology.orchestra.run.smithi160.stdout: "poolop_send": 0, 2024-05-08T05:34:18.193 INFO:teuthology.orchestra.run.smithi160.stdout: "poolop_resend": 0, 2024-05-08T05:34:18.193 INFO:teuthology.orchestra.run.smithi160.stdout: "poolstat_active": 0, 2024-05-08T05:34:18.193 INFO:teuthology.orchestra.run.smithi160.stdout: "poolstat_send": 0, 2024-05-08T05:34:18.193 INFO:teuthology.orchestra.run.smithi160.stdout: "poolstat_resend": 0, 2024-05-08T05:34:18.193 INFO:teuthology.orchestra.run.smithi160.stdout: "statfs_active": 0, 2024-05-08T05:34:18.193 INFO:teuthology.orchestra.run.smithi160.stdout: "statfs_send": 0, 2024-05-08T05:34:18.193 INFO:teuthology.orchestra.run.smithi160.stdout: "statfs_resend": 0, 2024-05-08T05:34:18.193 INFO:teuthology.orchestra.run.smithi160.stdout: "command_active": 0, 2024-05-08T05:34:18.193 INFO:teuthology.orchestra.run.smithi160.stdout: "command_send": 0, 2024-05-08T05:34:18.193 INFO:teuthology.orchestra.run.smithi160.stdout: "command_resend": 0, 2024-05-08T05:34:18.193 INFO:teuthology.orchestra.run.smithi160.stdout: "map_epoch": 82, 2024-05-08T05:34:18.193 INFO:teuthology.orchestra.run.smithi160.stdout: "map_full": 0, 2024-05-08T05:34:18.193 INFO:teuthology.orchestra.run.smithi160.stdout: "map_inc": 2, 2024-05-08T05:34:18.193 INFO:teuthology.orchestra.run.smithi160.stdout: "osd_sessions": 9, 2024-05-08T05:34:18.194 INFO:teuthology.orchestra.run.smithi160.stdout: "osd_session_open": 9, 2024-05-08T05:34:18.194 INFO:teuthology.orchestra.run.smithi160.stdout: "osd_session_close": 0, 2024-05-08T05:34:18.194 INFO:teuthology.orchestra.run.smithi160.stdout: "osd_laggy": 0, 2024-05-08T05:34:18.194 INFO:teuthology.orchestra.run.smithi160.stdout: "omap_wr": 0, 2024-05-08T05:34:18.194 INFO:teuthology.orchestra.run.smithi160.stdout: "omap_rd": 2, 2024-05-08T05:34:18.194 INFO:teuthology.orchestra.run.smithi160.stdout: "omap_del": 0 2024-05-08T05:34:18.194 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-05-08T05:34:18.194 INFO:teuthology.orchestra.run.smithi160.stdout: "oft": { 2024-05-08T05:34:18.194 INFO:teuthology.orchestra.run.smithi160.stdout: "omap_total_objs": 0, 2024-05-08T05:34:18.194 INFO:teuthology.orchestra.run.smithi160.stdout: "omap_total_kv_pairs": 0, 2024-05-08T05:34:18.194 INFO:teuthology.orchestra.run.smithi160.stdout: "omap_total_updates": 0, 2024-05-08T05:34:18.194 INFO:teuthology.orchestra.run.smithi160.stdout: "omap_total_removes": 0 2024-05-08T05:34:18.194 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-05-08T05:34:18.194 INFO:teuthology.orchestra.run.smithi160.stdout: "osd-slow-ops": { 2024-05-08T05:34:18.194 INFO:teuthology.orchestra.run.smithi160.stdout: "slow_ops_count": 0 2024-05-08T05:34:18.195 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-05-08T05:34:18.195 INFO:teuthology.orchestra.run.smithi160.stdout: "purge_queue": { 2024-05-08T05:34:18.195 INFO:teuthology.orchestra.run.smithi160.stdout: "pq_executing_ops": 0, 2024-05-08T05:34:18.195 INFO:teuthology.orchestra.run.smithi160.stdout: "pq_executing_ops_high_water": 0, 2024-05-08T05:34:18.195 INFO:teuthology.orchestra.run.smithi160.stdout: "pq_executing": 0, 2024-05-08T05:34:18.195 INFO:teuthology.orchestra.run.smithi160.stdout: "pq_executing_high_water": 0, 2024-05-08T05:34:18.195 INFO:teuthology.orchestra.run.smithi160.stdout: "pq_executed_ops": 0, 2024-05-08T05:34:18.195 INFO:teuthology.orchestra.run.smithi160.stdout: "pq_executed": 0, 2024-05-08T05:34:18.195 INFO:teuthology.orchestra.run.smithi160.stdout: "pq_item_in_journal": 0 2024-05-08T05:34:18.195 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-05-08T05:34:18.195 INFO:teuthology.orchestra.run.smithi160.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-05-08T05:34:18.195 INFO:teuthology.orchestra.run.smithi160.stdout: "val": 0, 2024-05-08T05:34:18.195 INFO:teuthology.orchestra.run.smithi160.stdout: "max": 104857600, 2024-05-08T05:34:18.196 INFO:teuthology.orchestra.run.smithi160.stdout: "get_started": 0, 2024-05-08T05:34:18.196 INFO:teuthology.orchestra.run.smithi160.stdout: "get": 1671, 2024-05-08T05:34:18.196 INFO:teuthology.orchestra.run.smithi160.stdout: "get_sum": 45091778, 2024-05-08T05:34:18.196 INFO:teuthology.orchestra.run.smithi160.stdout: "get_or_fail_fail": 0, 2024-05-08T05:34:18.196 INFO:teuthology.orchestra.run.smithi160.stdout: "get_or_fail_success": 1671, 2024-05-08T05:34:18.196 INFO:teuthology.orchestra.run.smithi160.stdout: "take": 0, 2024-05-08T05:34:18.196 INFO:teuthology.orchestra.run.smithi160.stdout: "take_sum": 0, 2024-05-08T05:34:18.196 INFO:teuthology.orchestra.run.smithi160.stdout: "put": 1671, 2024-05-08T05:34:18.196 INFO:teuthology.orchestra.run.smithi160.stdout: "put_sum": 45091778, 2024-05-08T05:34:18.196 INFO:teuthology.orchestra.run.smithi160.stdout: "wait": { 2024-05-08T05:34:18.196 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 0, 2024-05-08T05:34:18.196 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000000000, 2024-05-08T05:34:18.196 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000000 2024-05-08T05:34:18.196 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-05-08T05:34:18.196 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-05-08T05:34:18.197 INFO:teuthology.orchestra.run.smithi160.stdout: "throttle-objecter_bytes": { 2024-05-08T05:34:18.197 INFO:teuthology.orchestra.run.smithi160.stdout: "val": 0, 2024-05-08T05:34:18.197 INFO:teuthology.orchestra.run.smithi160.stdout: "max": 104857600, 2024-05-08T05:34:18.197 INFO:teuthology.orchestra.run.smithi160.stdout: "get_started": 0, 2024-05-08T05:34:18.197 INFO:teuthology.orchestra.run.smithi160.stdout: "get": 0, 2024-05-08T05:34:18.197 INFO:teuthology.orchestra.run.smithi160.stdout: "get_sum": 0, 2024-05-08T05:34:18.197 INFO:teuthology.orchestra.run.smithi160.stdout: "get_or_fail_fail": 0, 2024-05-08T05:34:18.197 INFO:teuthology.orchestra.run.smithi160.stdout: "get_or_fail_success": 0, 2024-05-08T05:34:18.197 INFO:teuthology.orchestra.run.smithi160.stdout: "take": 1501, 2024-05-08T05:34:18.197 INFO:teuthology.orchestra.run.smithi160.stdout: "take_sum": 44290161, 2024-05-08T05:34:18.197 INFO:teuthology.orchestra.run.smithi160.stdout: "put": 1501, 2024-05-08T05:34:18.197 INFO:teuthology.orchestra.run.smithi160.stdout: "put_sum": 44290161, 2024-05-08T05:34:18.197 INFO:teuthology.orchestra.run.smithi160.stdout: "wait": { 2024-05-08T05:34:18.197 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 0, 2024-05-08T05:34:18.198 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000000000, 2024-05-08T05:34:18.198 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000000 2024-05-08T05:34:18.198 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-05-08T05:34:18.198 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-05-08T05:34:18.198 INFO:teuthology.orchestra.run.smithi160.stdout: "throttle-objecter_ops": { 2024-05-08T05:34:18.198 INFO:teuthology.orchestra.run.smithi160.stdout: "val": 0, 2024-05-08T05:34:18.198 INFO:teuthology.orchestra.run.smithi160.stdout: "max": 1024, 2024-05-08T05:34:18.198 INFO:teuthology.orchestra.run.smithi160.stdout: "get_started": 0, 2024-05-08T05:34:18.198 INFO:teuthology.orchestra.run.smithi160.stdout: "get": 0, 2024-05-08T05:34:18.198 INFO:teuthology.orchestra.run.smithi160.stdout: "get_sum": 0, 2024-05-08T05:34:18.198 INFO:teuthology.orchestra.run.smithi160.stdout: "get_or_fail_fail": 0, 2024-05-08T05:34:18.198 INFO:teuthology.orchestra.run.smithi160.stdout: "get_or_fail_success": 0, 2024-05-08T05:34:18.198 INFO:teuthology.orchestra.run.smithi160.stdout: "take": 1501, 2024-05-08T05:34:18.198 INFO:teuthology.orchestra.run.smithi160.stdout: "take_sum": 1501, 2024-05-08T05:34:18.199 INFO:teuthology.orchestra.run.smithi160.stdout: "put": 1501, 2024-05-08T05:34:18.199 INFO:teuthology.orchestra.run.smithi160.stdout: "put_sum": 1501, 2024-05-08T05:34:18.199 INFO:teuthology.orchestra.run.smithi160.stdout: "wait": { 2024-05-08T05:34:18.199 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 0, 2024-05-08T05:34:18.199 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000000000, 2024-05-08T05:34:18.199 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000000 2024-05-08T05:34:18.199 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-05-08T05:34:18.199 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-05-08T05:34:18.199 INFO:teuthology.orchestra.run.smithi160.stdout: "throttle-write_buf_throttle": { 2024-05-08T05:34:18.199 INFO:teuthology.orchestra.run.smithi160.stdout: "val": 0, 2024-05-08T05:34:18.199 INFO:teuthology.orchestra.run.smithi160.stdout: "max": 3758096384, 2024-05-08T05:34:18.199 INFO:teuthology.orchestra.run.smithi160.stdout: "get_started": 0, 2024-05-08T05:34:18.199 INFO:teuthology.orchestra.run.smithi160.stdout: "get": 0, 2024-05-08T05:34:18.199 INFO:teuthology.orchestra.run.smithi160.stdout: "get_sum": 0, 2024-05-08T05:34:18.200 INFO:teuthology.orchestra.run.smithi160.stdout: "get_or_fail_fail": 0, 2024-05-08T05:34:18.200 INFO:teuthology.orchestra.run.smithi160.stdout: "get_or_fail_success": 0, 2024-05-08T05:34:18.200 INFO:teuthology.orchestra.run.smithi160.stdout: "take": 0, 2024-05-08T05:34:18.200 INFO:teuthology.orchestra.run.smithi160.stdout: "take_sum": 0, 2024-05-08T05:34:18.200 INFO:teuthology.orchestra.run.smithi160.stdout: "put": 0, 2024-05-08T05:34:18.200 INFO:teuthology.orchestra.run.smithi160.stdout: "put_sum": 0, 2024-05-08T05:34:18.200 INFO:teuthology.orchestra.run.smithi160.stdout: "wait": { 2024-05-08T05:34:18.200 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 0, 2024-05-08T05:34:18.200 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000000000, 2024-05-08T05:34:18.200 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000000 2024-05-08T05:34:18.200 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-05-08T05:34:18.200 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-05-08T05:34:18.200 INFO:teuthology.orchestra.run.smithi160.stdout: "throttle-write_buf_throttle-0x55ff9ee906e0": { 2024-05-08T05:34:18.201 INFO:teuthology.orchestra.run.smithi160.stdout: "val": 0, 2024-05-08T05:34:18.201 INFO:teuthology.orchestra.run.smithi160.stdout: "max": 3758096384, 2024-05-08T05:34:18.201 INFO:teuthology.orchestra.run.smithi160.stdout: "get_started": 0, 2024-05-08T05:34:18.201 INFO:teuthology.orchestra.run.smithi160.stdout: "get": 0, 2024-05-08T05:34:18.201 INFO:teuthology.orchestra.run.smithi160.stdout: "get_sum": 0, 2024-05-08T05:34:18.201 INFO:teuthology.orchestra.run.smithi160.stdout: "get_or_fail_fail": 0, 2024-05-08T05:34:18.201 INFO:teuthology.orchestra.run.smithi160.stdout: "get_or_fail_success": 0, 2024-05-08T05:34:18.201 INFO:teuthology.orchestra.run.smithi160.stdout: "take": 0, 2024-05-08T05:34:18.201 INFO:teuthology.orchestra.run.smithi160.stdout: "take_sum": 0, 2024-05-08T05:34:18.201 INFO:teuthology.orchestra.run.smithi160.stdout: "put": 0, 2024-05-08T05:34:18.201 INFO:teuthology.orchestra.run.smithi160.stdout: "put_sum": 0, 2024-05-08T05:34:18.201 INFO:teuthology.orchestra.run.smithi160.stdout: "wait": { 2024-05-08T05:34:18.201 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 0, 2024-05-08T05:34:18.202 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000000000, 2024-05-08T05:34:18.202 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000000 2024-05-08T05:34:18.202 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-05-08T05:34:18.202 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-05-08T05:34:18.202 INFO:teuthology.orchestra.run.smithi160.stdout:} 2024-05-08T05:34:18.789 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:34:18 smithi160 ceph-mon[34827]: pgmap v579: 97 pgs: 97 active+clean; 153 MiB data, 1004 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-05-08T05:34:18.958 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:34:18 smithi087 ceph-mon[29523]: pgmap v579: 97 pgs: 97 active+clean; 153 MiB data, 1004 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-05-08T05:34:18.983 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:34:18 smithi090 ceph-mon[34526]: pgmap v579: 97 pgs: 97 active+clean; 153 MiB data, 1004 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-05-08T05:34:19.031 INFO:tasks.check_counter:Daemon mds.f mds.exported=0 2024-05-08T05:34:19.031 INFO:tasks.check_counter:Daemon mds.f mds.imported=0 2024-05-08T05:34:19.032 INFO:tasks.check_counter:Daemon mds.f mds_cache.dir_update=0 2024-05-08T05:34:19.032 INFO:tasks.check_counter:Daemon mds.f mds_cache.dir_update_receipt=0 2024-05-08T05:34:19.032 DEBUG:tasks.check_counter:Getting stats from i 2024-05-08T05:34:19.032 DEBUG:teuthology.orchestra.run.smithi160:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid eeeb813e-0cf9-11ef-bc97-c7b262605968 -- ceph daemon mds.i perf dump 2024-05-08T05:34:19.273 INFO:teuthology.orchestra.run.smithi160.stderr:Inferring config /var/lib/ceph/eeeb813e-0cf9-11ef-bc97-c7b262605968/mon.c/config 2024-05-08T05:34:20.788 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:34:20 smithi160 ceph-mon[34827]: pgmap v580: 97 pgs: 97 active+clean; 153 MiB data, 1004 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 8 op/s 2024-05-08T05:34:20.959 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:34:20 smithi087 ceph-mon[29523]: pgmap v580: 97 pgs: 97 active+clean; 153 MiB data, 1004 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 8 op/s 2024-05-08T05:34:20.983 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:34:20 smithi090 ceph-mon[34526]: pgmap v580: 97 pgs: 97 active+clean; 153 MiB data, 1004 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 8 op/s 2024-05-08T05:34:21.246 INFO:teuthology.orchestra.run.smithi160.stdout:{ 2024-05-08T05:34:21.246 INFO:teuthology.orchestra.run.smithi160.stdout: "AsyncMessenger::Worker-0": { 2024-05-08T05:34:21.246 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_recv_messages": 16661, 2024-05-08T05:34:21.247 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_send_messages": 36697, 2024-05-08T05:34:21.247 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_recv_bytes": 6074260, 2024-05-08T05:34:21.247 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_send_bytes": 34165407, 2024-05-08T05:34:21.247 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_created_connections": 17, 2024-05-08T05:34:21.247 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_active_connections": 5, 2024-05-08T05:34:21.247 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_running_total_time": 1.100984706, 2024-05-08T05:34:21.247 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_running_send_time": 0.537597413, 2024-05-08T05:34:21.247 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_running_recv_time": 0.689939104, 2024-05-08T05:34:21.247 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_running_fast_dispatch_time": 0.068907359, 2024-05-08T05:34:21.247 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_send_messages_queue_lat": { 2024-05-08T05:34:21.247 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 36697, 2024-05-08T05:34:21.247 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 9.316362464, 2024-05-08T05:34:21.248 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000253872 2024-05-08T05:34:21.248 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-05-08T05:34:21.248 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_handle_ack_lat": { 2024-05-08T05:34:21.248 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 32628, 2024-05-08T05:34:21.248 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.005912476, 2024-05-08T05:34:21.248 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000181 2024-05-08T05:34:21.248 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-05-08T05:34:21.248 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_recv_encrypted_bytes": 552736, 2024-05-08T05:34:21.248 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_send_encrypted_bytes": 101872 2024-05-08T05:34:21.248 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-05-08T05:34:21.248 INFO:teuthology.orchestra.run.smithi160.stdout: "AsyncMessenger::Worker-1": { 2024-05-08T05:34:21.249 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_recv_messages": 5886, 2024-05-08T05:34:21.249 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_send_messages": 6006, 2024-05-08T05:34:21.249 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_recv_bytes": 1492806, 2024-05-08T05:34:21.249 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_send_bytes": 16428773, 2024-05-08T05:34:21.249 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_created_connections": 18, 2024-05-08T05:34:21.249 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_active_connections": 8, 2024-05-08T05:34:21.249 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_running_total_time": 0.445134949, 2024-05-08T05:34:21.249 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_running_send_time": 0.193285065, 2024-05-08T05:34:21.249 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_running_recv_time": 0.091957328, 2024-05-08T05:34:21.249 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_running_fast_dispatch_time": 0.130886075, 2024-05-08T05:34:21.249 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_send_messages_queue_lat": { 2024-05-08T05:34:21.250 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 5998, 2024-05-08T05:34:21.250 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.195835494, 2024-05-08T05:34:21.250 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000032650 2024-05-08T05:34:21.250 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-05-08T05:34:21.250 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_handle_ack_lat": { 2024-05-08T05:34:21.250 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 8, 2024-05-08T05:34:21.250 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000000921, 2024-05-08T05:34:21.250 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000115 2024-05-08T05:34:21.250 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-05-08T05:34:21.250 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_recv_encrypted_bytes": 160, 2024-05-08T05:34:21.250 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_send_encrypted_bytes": 273024 2024-05-08T05:34:21.250 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-05-08T05:34:21.251 INFO:teuthology.orchestra.run.smithi160.stdout: "AsyncMessenger::Worker-2": { 2024-05-08T05:34:21.251 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_recv_messages": 40987, 2024-05-08T05:34:21.251 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_send_messages": 47277, 2024-05-08T05:34:21.251 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_recv_bytes": 19866255, 2024-05-08T05:34:21.251 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_send_bytes": 27220777, 2024-05-08T05:34:21.251 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_created_connections": 8, 2024-05-08T05:34:21.251 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_active_connections": 4, 2024-05-08T05:34:21.251 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_running_total_time": 2.034049411, 2024-05-08T05:34:21.251 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_running_send_time": 0.792888056, 2024-05-08T05:34:21.251 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_running_recv_time": 1.386792836, 2024-05-08T05:34:21.251 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_running_fast_dispatch_time": 0.136865447, 2024-05-08T05:34:21.251 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_send_messages_queue_lat": { 2024-05-08T05:34:21.252 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 47281, 2024-05-08T05:34:21.252 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.818380726, 2024-05-08T05:34:21.252 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000017308 2024-05-08T05:34:21.252 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-05-08T05:34:21.252 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_handle_ack_lat": { 2024-05-08T05:34:21.252 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 72419, 2024-05-08T05:34:21.252 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.010139037, 2024-05-08T05:34:21.252 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000140 2024-05-08T05:34:21.252 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-05-08T05:34:21.252 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_recv_encrypted_bytes": 0, 2024-05-08T05:34:21.252 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_send_encrypted_bytes": 0 2024-05-08T05:34:21.252 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-05-08T05:34:21.253 INFO:teuthology.orchestra.run.smithi160.stdout: "cct": { 2024-05-08T05:34:21.253 INFO:teuthology.orchestra.run.smithi160.stdout: "total_workers": 1, 2024-05-08T05:34:21.253 INFO:teuthology.orchestra.run.smithi160.stdout: "unhealthy_workers": 0 2024-05-08T05:34:21.253 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-05-08T05:34:21.253 INFO:teuthology.orchestra.run.smithi160.stdout: "finisher-MDSRank": { 2024-05-08T05:34:21.253 INFO:teuthology.orchestra.run.smithi160.stdout: "queue_len": 0, 2024-05-08T05:34:21.253 INFO:teuthology.orchestra.run.smithi160.stdout: "complete_latency": { 2024-05-08T05:34:21.253 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 6478, 2024-05-08T05:34:21.253 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 8.375077707, 2024-05-08T05:34:21.253 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.001292849 2024-05-08T05:34:21.253 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-05-08T05:34:21.253 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-05-08T05:34:21.254 INFO:teuthology.orchestra.run.smithi160.stdout: "finisher-PurgeQueue": { 2024-05-08T05:34:21.254 INFO:teuthology.orchestra.run.smithi160.stdout: "queue_len": 0, 2024-05-08T05:34:21.254 INFO:teuthology.orchestra.run.smithi160.stdout: "complete_latency": { 2024-05-08T05:34:21.254 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 10619, 2024-05-08T05:34:21.254 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 1.364486271, 2024-05-08T05:34:21.254 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000128494 2024-05-08T05:34:21.254 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-05-08T05:34:21.254 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-05-08T05:34:21.254 INFO:teuthology.orchestra.run.smithi160.stdout: "mds": { 2024-05-08T05:34:21.254 INFO:teuthology.orchestra.run.smithi160.stdout: "request": 8595, 2024-05-08T05:34:21.254 INFO:teuthology.orchestra.run.smithi160.stdout: "reply": 8566, 2024-05-08T05:34:21.254 INFO:teuthology.orchestra.run.smithi160.stdout: "reply_latency": { 2024-05-08T05:34:21.255 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 8566, 2024-05-08T05:34:21.255 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 22.070777380, 2024-05-08T05:34:21.255 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.002576555 2024-05-08T05:34:21.255 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-05-08T05:34:21.255 INFO:teuthology.orchestra.run.smithi160.stdout: "slow_reply": 0, 2024-05-08T05:34:21.255 INFO:teuthology.orchestra.run.smithi160.stdout: "forward": 29, 2024-05-08T05:34:21.255 INFO:teuthology.orchestra.run.smithi160.stdout: "dir_fetch_complete": 0, 2024-05-08T05:34:21.255 INFO:teuthology.orchestra.run.smithi160.stdout: "dir_fetch_keys": 0, 2024-05-08T05:34:21.255 INFO:teuthology.orchestra.run.smithi160.stdout: "dir_commit": 12, 2024-05-08T05:34:21.255 INFO:teuthology.orchestra.run.smithi160.stdout: "dir_split": 0, 2024-05-08T05:34:21.255 INFO:teuthology.orchestra.run.smithi160.stdout: "dir_merge": 1, 2024-05-08T05:34:21.256 INFO:teuthology.orchestra.run.smithi160.stdout: "inodes": 423, 2024-05-08T05:34:21.256 INFO:teuthology.orchestra.run.smithi160.stdout: "inodes_top": 195, 2024-05-08T05:34:21.256 INFO:teuthology.orchestra.run.smithi160.stdout: "inodes_bottom": 90, 2024-05-08T05:34:21.256 INFO:teuthology.orchestra.run.smithi160.stdout: "inodes_pin_tail": 138, 2024-05-08T05:34:21.256 INFO:teuthology.orchestra.run.smithi160.stdout: "inodes_pinned": 142, 2024-05-08T05:34:21.256 INFO:teuthology.orchestra.run.smithi160.stdout: "inodes_expired": 2384, 2024-05-08T05:34:21.256 INFO:teuthology.orchestra.run.smithi160.stdout: "inodes_with_caps": 1, 2024-05-08T05:34:21.256 INFO:teuthology.orchestra.run.smithi160.stdout: "caps": 1, 2024-05-08T05:34:21.256 INFO:teuthology.orchestra.run.smithi160.stdout: "subtrees": 4, 2024-05-08T05:34:21.256 INFO:teuthology.orchestra.run.smithi160.stdout: "traverse": 13129, 2024-05-08T05:34:21.256 INFO:teuthology.orchestra.run.smithi160.stdout: "traverse_hit": 11031, 2024-05-08T05:34:21.256 INFO:teuthology.orchestra.run.smithi160.stdout: "traverse_forward": 26, 2024-05-08T05:34:21.257 INFO:teuthology.orchestra.run.smithi160.stdout: "traverse_discover": 1094, 2024-05-08T05:34:21.257 INFO:teuthology.orchestra.run.smithi160.stdout: "traverse_dir_fetch": 0, 2024-05-08T05:34:21.257 INFO:teuthology.orchestra.run.smithi160.stdout: "traverse_remote_ino": 0, 2024-05-08T05:34:21.257 INFO:teuthology.orchestra.run.smithi160.stdout: "traverse_lock": 11, 2024-05-08T05:34:21.257 INFO:teuthology.orchestra.run.smithi160.stdout: "load_cent": 0, 2024-05-08T05:34:21.257 INFO:teuthology.orchestra.run.smithi160.stdout: "q": 0, 2024-05-08T05:34:21.257 INFO:teuthology.orchestra.run.smithi160.stdout: "exported": 8, 2024-05-08T05:34:21.257 INFO:teuthology.orchestra.run.smithi160.stdout: "exported_inodes": 306, 2024-05-08T05:34:21.257 INFO:teuthology.orchestra.run.smithi160.stdout: "imported": 23, 2024-05-08T05:34:21.257 INFO:teuthology.orchestra.run.smithi160.stdout: "imported_inodes": 6378, 2024-05-08T05:34:21.257 INFO:teuthology.orchestra.run.smithi160.stdout: "openino_dir_fetch": 0, 2024-05-08T05:34:21.257 INFO:teuthology.orchestra.run.smithi160.stdout: "openino_backtrace_fetch": 6187, 2024-05-08T05:34:21.257 INFO:teuthology.orchestra.run.smithi160.stdout: "openino_peer_discover": 0, 2024-05-08T05:34:21.258 INFO:teuthology.orchestra.run.smithi160.stdout: "root_rfiles": 6735, 2024-05-08T05:34:21.258 INFO:teuthology.orchestra.run.smithi160.stdout: "root_rbytes": 45007454, 2024-05-08T05:34:21.258 INFO:teuthology.orchestra.run.smithi160.stdout: "root_rsnaps": 0, 2024-05-08T05:34:21.258 INFO:teuthology.orchestra.run.smithi160.stdout: "scrub_backtrace_fetch": 6187, 2024-05-08T05:34:21.258 INFO:teuthology.orchestra.run.smithi160.stdout: "scrub_set_tag": 0, 2024-05-08T05:34:21.258 INFO:teuthology.orchestra.run.smithi160.stdout: "scrub_backtrace_repaired": 0, 2024-05-08T05:34:21.258 INFO:teuthology.orchestra.run.smithi160.stdout: "scrub_inotable_repaired": 0, 2024-05-08T05:34:21.258 INFO:teuthology.orchestra.run.smithi160.stdout: "scrub_dir_inodes": 561, 2024-05-08T05:34:21.258 INFO:teuthology.orchestra.run.smithi160.stdout: "scrub_dir_base_inodes": 0, 2024-05-08T05:34:21.258 INFO:teuthology.orchestra.run.smithi160.stdout: "scrub_dirfrag_rstats": 561, 2024-05-08T05:34:21.258 INFO:teuthology.orchestra.run.smithi160.stdout: "scrub_file_inodes": 5626, 2024-05-08T05:34:21.258 INFO:teuthology.orchestra.run.smithi160.stdout: "handle_inode_file_caps": 20, 2024-05-08T05:34:21.259 INFO:teuthology.orchestra.run.smithi160.stdout: "ceph_cap_op_revoke": 1740, 2024-05-08T05:34:21.259 INFO:teuthology.orchestra.run.smithi160.stdout: "ceph_cap_op_grant": 7937, 2024-05-08T05:34:21.259 INFO:teuthology.orchestra.run.smithi160.stdout: "ceph_cap_op_trunc": 13, 2024-05-08T05:34:21.259 INFO:teuthology.orchestra.run.smithi160.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-05-08T05:34:21.259 INFO:teuthology.orchestra.run.smithi160.stdout: "ceph_cap_op_flush_ack": 0, 2024-05-08T05:34:21.259 INFO:teuthology.orchestra.run.smithi160.stdout: "handle_client_caps": 5405, 2024-05-08T05:34:21.259 INFO:teuthology.orchestra.run.smithi160.stdout: "handle_client_caps_dirty": 3007, 2024-05-08T05:34:21.259 INFO:teuthology.orchestra.run.smithi160.stdout: "handle_client_cap_release": 54, 2024-05-08T05:34:21.259 INFO:teuthology.orchestra.run.smithi160.stdout: "process_request_cap_release": 7387 2024-05-08T05:34:21.259 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-05-08T05:34:21.259 INFO:teuthology.orchestra.run.smithi160.stdout: "mds_cache": { 2024-05-08T05:34:21.259 INFO:teuthology.orchestra.run.smithi160.stdout: "dir_update": 1437, 2024-05-08T05:34:21.259 INFO:teuthology.orchestra.run.smithi160.stdout: "dir_update_receipt": 3080, 2024-05-08T05:34:21.260 INFO:teuthology.orchestra.run.smithi160.stdout: "dir_try_discover": 2068, 2024-05-08T05:34:21.260 INFO:teuthology.orchestra.run.smithi160.stdout: "dir_send_discover": 2032, 2024-05-08T05:34:21.260 INFO:teuthology.orchestra.run.smithi160.stdout: "dir_handle_discover": 2870, 2024-05-08T05:34:21.260 INFO:teuthology.orchestra.run.smithi160.stdout: "num_strays": 126, 2024-05-08T05:34:21.260 INFO:teuthology.orchestra.run.smithi160.stdout: "num_strays_delayed": 0, 2024-05-08T05:34:21.260 INFO:teuthology.orchestra.run.smithi160.stdout: "num_strays_enqueuing": 0, 2024-05-08T05:34:21.260 INFO:teuthology.orchestra.run.smithi160.stdout: "strays_created": 6116, 2024-05-08T05:34:21.260 INFO:teuthology.orchestra.run.smithi160.stdout: "strays_enqueued": 5947, 2024-05-08T05:34:21.260 INFO:teuthology.orchestra.run.smithi160.stdout: "strays_reintegrated": 44, 2024-05-08T05:34:21.260 INFO:teuthology.orchestra.run.smithi160.stdout: "strays_migrated": 0, 2024-05-08T05:34:21.260 INFO:teuthology.orchestra.run.smithi160.stdout: "num_recovering_processing": 0, 2024-05-08T05:34:21.260 INFO:teuthology.orchestra.run.smithi160.stdout: "num_recovering_enqueued": 0, 2024-05-08T05:34:21.261 INFO:teuthology.orchestra.run.smithi160.stdout: "num_recovering_prioritized": 0, 2024-05-08T05:34:21.261 INFO:teuthology.orchestra.run.smithi160.stdout: "recovery_started": 0, 2024-05-08T05:34:21.261 INFO:teuthology.orchestra.run.smithi160.stdout: "recovery_completed": 0, 2024-05-08T05:34:21.261 INFO:teuthology.orchestra.run.smithi160.stdout: "ireq_quiesce_path": 0, 2024-05-08T05:34:21.261 INFO:teuthology.orchestra.run.smithi160.stdout: "ireq_quiesce_inode": 0, 2024-05-08T05:34:21.261 INFO:teuthology.orchestra.run.smithi160.stdout: "ireq_enqueue_scrub": 0, 2024-05-08T05:34:21.261 INFO:teuthology.orchestra.run.smithi160.stdout: "ireq_exportdir": 8, 2024-05-08T05:34:21.261 INFO:teuthology.orchestra.run.smithi160.stdout: "ireq_flush": 0, 2024-05-08T05:34:21.261 INFO:teuthology.orchestra.run.smithi160.stdout: "ireq_fragmentdir": 1, 2024-05-08T05:34:21.261 INFO:teuthology.orchestra.run.smithi160.stdout: "ireq_fragstats": 0, 2024-05-08T05:34:21.261 INFO:teuthology.orchestra.run.smithi160.stdout: "ireq_inodestats": 0 2024-05-08T05:34:21.261 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-05-08T05:34:21.262 INFO:teuthology.orchestra.run.smithi160.stdout: "mds_log": { 2024-05-08T05:34:21.262 INFO:teuthology.orchestra.run.smithi160.stdout: "evlrg": 2, 2024-05-08T05:34:21.262 INFO:teuthology.orchestra.run.smithi160.stdout: "evadd": 21029, 2024-05-08T05:34:21.262 INFO:teuthology.orchestra.run.smithi160.stdout: "evex": 0, 2024-05-08T05:34:21.262 INFO:teuthology.orchestra.run.smithi160.stdout: "evtrm": 0, 2024-05-08T05:34:21.262 INFO:teuthology.orchestra.run.smithi160.stdout: "ev": 21029, 2024-05-08T05:34:21.262 INFO:teuthology.orchestra.run.smithi160.stdout: "evexg": 0, 2024-05-08T05:34:21.262 INFO:teuthology.orchestra.run.smithi160.stdout: "evexd": 0, 2024-05-08T05:34:21.262 INFO:teuthology.orchestra.run.smithi160.stdout: "segadd": 29, 2024-05-08T05:34:21.262 INFO:teuthology.orchestra.run.smithi160.stdout: "segex": 0, 2024-05-08T05:34:21.262 INFO:teuthology.orchestra.run.smithi160.stdout: "segtrm": 0, 2024-05-08T05:34:21.262 INFO:teuthology.orchestra.run.smithi160.stdout: "seg": 29, 2024-05-08T05:34:21.263 INFO:teuthology.orchestra.run.smithi160.stdout: "segmjr": 3, 2024-05-08T05:34:21.263 INFO:teuthology.orchestra.run.smithi160.stdout: "segexg": 0, 2024-05-08T05:34:21.263 INFO:teuthology.orchestra.run.smithi160.stdout: "segexd": 0, 2024-05-08T05:34:21.263 INFO:teuthology.orchestra.run.smithi160.stdout: "expos": 4194304, 2024-05-08T05:34:21.263 INFO:teuthology.orchestra.run.smithi160.stdout: "wrpos": 48481280, 2024-05-08T05:34:21.263 INFO:teuthology.orchestra.run.smithi160.stdout: "rdpos": 0, 2024-05-08T05:34:21.263 INFO:teuthology.orchestra.run.smithi160.stdout: "jlat": { 2024-05-08T05:34:21.263 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 1198, 2024-05-08T05:34:21.263 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 6.447042106, 2024-05-08T05:34:21.263 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.005381504 2024-05-08T05:34:21.263 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-05-08T05:34:21.263 INFO:teuthology.orchestra.run.smithi160.stdout: "replayed": 0 2024-05-08T05:34:21.263 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-05-08T05:34:21.264 INFO:teuthology.orchestra.run.smithi160.stdout: "mds_mem": { 2024-05-08T05:34:21.264 INFO:teuthology.orchestra.run.smithi160.stdout: "ino": 156, 2024-05-08T05:34:21.264 INFO:teuthology.orchestra.run.smithi160.stdout: "ino+": 7379, 2024-05-08T05:34:21.264 INFO:teuthology.orchestra.run.smithi160.stdout: "ino-": 7223, 2024-05-08T05:34:21.264 INFO:teuthology.orchestra.run.smithi160.stdout: "dir": 159, 2024-05-08T05:34:21.264 INFO:teuthology.orchestra.run.smithi160.stdout: "dir+": 1925, 2024-05-08T05:34:21.264 INFO:teuthology.orchestra.run.smithi160.stdout: "dir-": 1766, 2024-05-08T05:34:21.264 INFO:teuthology.orchestra.run.smithi160.stdout: "dn": 423, 2024-05-08T05:34:21.264 INFO:teuthology.orchestra.run.smithi160.stdout: "dn+": 14878, 2024-05-08T05:34:21.264 INFO:teuthology.orchestra.run.smithi160.stdout: "dn-": 14455, 2024-05-08T05:34:21.264 INFO:teuthology.orchestra.run.smithi160.stdout: "cap": 1, 2024-05-08T05:34:21.264 INFO:teuthology.orchestra.run.smithi160.stdout: "cap+": 6412, 2024-05-08T05:34:21.265 INFO:teuthology.orchestra.run.smithi160.stdout: "cap-": 6411, 2024-05-08T05:34:21.265 INFO:teuthology.orchestra.run.smithi160.stdout: "rss": 119112, 2024-05-08T05:34:21.265 INFO:teuthology.orchestra.run.smithi160.stdout: "heap": 223608 2024-05-08T05:34:21.265 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-05-08T05:34:21.265 INFO:teuthology.orchestra.run.smithi160.stdout: "mds_server": { 2024-05-08T05:34:21.265 INFO:teuthology.orchestra.run.smithi160.stdout: "dispatch_client_request": 13649, 2024-05-08T05:34:21.265 INFO:teuthology.orchestra.run.smithi160.stdout: "dispatch_server_request": 125, 2024-05-08T05:34:21.265 INFO:teuthology.orchestra.run.smithi160.stdout: "handle_client_request": 8595, 2024-05-08T05:34:21.265 INFO:teuthology.orchestra.run.smithi160.stdout: "handle_client_session": 35, 2024-05-08T05:34:21.265 INFO:teuthology.orchestra.run.smithi160.stdout: "handle_peer_request": 285, 2024-05-08T05:34:21.265 INFO:teuthology.orchestra.run.smithi160.stdout: "req_create_latency": { 2024-05-08T05:34:21.265 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 172, 2024-05-08T05:34:21.266 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.183757200, 2024-05-08T05:34:21.266 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.001068355 2024-05-08T05:34:21.266 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-05-08T05:34:21.266 INFO:teuthology.orchestra.run.smithi160.stdout: "req_getattr_latency": { 2024-05-08T05:34:21.266 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 1, 2024-05-08T05:34:21.266 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000551175, 2024-05-08T05:34:21.266 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000551175 2024-05-08T05:34:21.266 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-05-08T05:34:21.266 INFO:teuthology.orchestra.run.smithi160.stdout: "req_getfilelock_latency": { 2024-05-08T05:34:21.266 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 0, 2024-05-08T05:34:21.266 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000000000, 2024-05-08T05:34:21.266 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000000 2024-05-08T05:34:21.267 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-05-08T05:34:21.267 INFO:teuthology.orchestra.run.smithi160.stdout: "req_link_latency": { 2024-05-08T05:34:21.267 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 18, 2024-05-08T05:34:21.267 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.042673706, 2024-05-08T05:34:21.267 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.002370761 2024-05-08T05:34:21.267 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-05-08T05:34:21.267 INFO:teuthology.orchestra.run.smithi160.stdout: "req_lookup_latency": { 2024-05-08T05:34:21.267 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 1177, 2024-05-08T05:34:21.267 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.491617458, 2024-05-08T05:34:21.267 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000417686 2024-05-08T05:34:21.267 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-05-08T05:34:21.267 INFO:teuthology.orchestra.run.smithi160.stdout: "req_lookuphash_latency": { 2024-05-08T05:34:21.267 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 0, 2024-05-08T05:34:21.268 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000000000, 2024-05-08T05:34:21.268 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000000 2024-05-08T05:34:21.268 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-05-08T05:34:21.268 INFO:teuthology.orchestra.run.smithi160.stdout: "req_lookupino_latency": { 2024-05-08T05:34:21.268 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 1, 2024-05-08T05:34:21.268 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000133848, 2024-05-08T05:34:21.268 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000133848 2024-05-08T05:34:21.268 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-05-08T05:34:21.268 INFO:teuthology.orchestra.run.smithi160.stdout: "req_lookupname_latency": { 2024-05-08T05:34:21.268 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 0, 2024-05-08T05:34:21.268 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000000000, 2024-05-08T05:34:21.268 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000000 2024-05-08T05:34:21.269 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-05-08T05:34:21.269 INFO:teuthology.orchestra.run.smithi160.stdout: "req_lookupparent_latency": { 2024-05-08T05:34:21.269 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 0, 2024-05-08T05:34:21.269 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000000000, 2024-05-08T05:34:21.269 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000000 2024-05-08T05:34:21.269 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-05-08T05:34:21.269 INFO:teuthology.orchestra.run.smithi160.stdout: "req_lookupsnap_latency": { 2024-05-08T05:34:21.269 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 0, 2024-05-08T05:34:21.269 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000000000, 2024-05-08T05:34:21.269 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000000 2024-05-08T05:34:21.269 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-05-08T05:34:21.270 INFO:teuthology.orchestra.run.smithi160.stdout: "req_lssnap_latency": { 2024-05-08T05:34:21.270 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 0, 2024-05-08T05:34:21.270 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000000000, 2024-05-08T05:34:21.271 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000000 2024-05-08T05:34:21.271 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-05-08T05:34:21.271 INFO:teuthology.orchestra.run.smithi160.stdout: "req_mkdir_latency": { 2024-05-08T05:34:21.271 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 62, 2024-05-08T05:34:21.271 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.091264861, 2024-05-08T05:34:21.271 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.001472013 2024-05-08T05:34:21.271 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-05-08T05:34:21.271 INFO:teuthology.orchestra.run.smithi160.stdout: "req_mknod_latency": { 2024-05-08T05:34:21.271 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 36, 2024-05-08T05:34:21.271 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.056014793, 2024-05-08T05:34:21.271 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.001555966 2024-05-08T05:34:21.271 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-05-08T05:34:21.271 INFO:teuthology.orchestra.run.smithi160.stdout: "req_mksnap_latency": { 2024-05-08T05:34:21.272 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 0, 2024-05-08T05:34:21.272 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000000000, 2024-05-08T05:34:21.272 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000000 2024-05-08T05:34:21.272 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-05-08T05:34:21.272 INFO:teuthology.orchestra.run.smithi160.stdout: "req_open_latency": { 2024-05-08T05:34:21.272 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 0, 2024-05-08T05:34:21.272 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000000000, 2024-05-08T05:34:21.272 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000000 2024-05-08T05:34:21.272 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-05-08T05:34:21.272 INFO:teuthology.orchestra.run.smithi160.stdout: "req_readdir_latency": { 2024-05-08T05:34:21.272 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 797, 2024-05-08T05:34:21.272 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.574090696, 2024-05-08T05:34:21.272 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000720314 2024-05-08T05:34:21.273 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-05-08T05:34:21.273 INFO:teuthology.orchestra.run.smithi160.stdout: "req_rename_latency": { 2024-05-08T05:34:21.273 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 77, 2024-05-08T05:34:21.273 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.660926113, 2024-05-08T05:34:21.273 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.008583456 2024-05-08T05:34:21.273 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-05-08T05:34:21.273 INFO:teuthology.orchestra.run.smithi160.stdout: "req_renamesnap_latency": { 2024-05-08T05:34:21.273 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 0, 2024-05-08T05:34:21.273 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000000000, 2024-05-08T05:34:21.273 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000000 2024-05-08T05:34:21.273 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-05-08T05:34:21.274 INFO:teuthology.orchestra.run.smithi160.stdout: "req_snapdiff_latency": { 2024-05-08T05:34:21.274 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 0, 2024-05-08T05:34:21.274 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000000000, 2024-05-08T05:34:21.274 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000000 2024-05-08T05:34:21.274 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-05-08T05:34:21.274 INFO:teuthology.orchestra.run.smithi160.stdout: "req_rmdir_latency": { 2024-05-08T05:34:21.274 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 799, 2024-05-08T05:34:21.274 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 11.796753377, 2024-05-08T05:34:21.274 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.014764397 2024-05-08T05:34:21.274 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-05-08T05:34:21.274 INFO:teuthology.orchestra.run.smithi160.stdout: "req_rmsnap_latency": { 2024-05-08T05:34:21.275 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 0, 2024-05-08T05:34:21.275 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000000000, 2024-05-08T05:34:21.275 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000000 2024-05-08T05:34:21.275 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-05-08T05:34:21.275 INFO:teuthology.orchestra.run.smithi160.stdout: "req_rmxattr_latency": { 2024-05-08T05:34:21.275 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 0, 2024-05-08T05:34:21.275 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000000000, 2024-05-08T05:34:21.275 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000000 2024-05-08T05:34:21.275 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-05-08T05:34:21.275 INFO:teuthology.orchestra.run.smithi160.stdout: "req_setattr_latency": { 2024-05-08T05:34:21.275 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 14, 2024-05-08T05:34:21.276 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.036871809, 2024-05-08T05:34:21.276 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.002633700 2024-05-08T05:34:21.276 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-05-08T05:34:21.276 INFO:teuthology.orchestra.run.smithi160.stdout: "req_setdirlayout_latency": { 2024-05-08T05:34:21.276 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 0, 2024-05-08T05:34:21.276 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000000000, 2024-05-08T05:34:21.276 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000000 2024-05-08T05:34:21.276 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-05-08T05:34:21.276 INFO:teuthology.orchestra.run.smithi160.stdout: "req_setfilelock_latency": { 2024-05-08T05:34:21.276 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 0, 2024-05-08T05:34:21.276 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000000000, 2024-05-08T05:34:21.277 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000000 2024-05-08T05:34:21.277 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-05-08T05:34:21.277 INFO:teuthology.orchestra.run.smithi160.stdout: "req_setlayout_latency": { 2024-05-08T05:34:21.277 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 0, 2024-05-08T05:34:21.277 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000000000, 2024-05-08T05:34:21.277 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000000 2024-05-08T05:34:21.277 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-05-08T05:34:21.277 INFO:teuthology.orchestra.run.smithi160.stdout: "req_setxattr_latency": { 2024-05-08T05:34:21.277 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 0, 2024-05-08T05:34:21.277 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000000000, 2024-05-08T05:34:21.277 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000000 2024-05-08T05:34:21.277 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-05-08T05:34:21.277 INFO:teuthology.orchestra.run.smithi160.stdout: "req_symlink_latency": { 2024-05-08T05:34:21.278 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 34, 2024-05-08T05:34:21.278 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.038192914, 2024-05-08T05:34:21.278 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.001123321 2024-05-08T05:34:21.278 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-05-08T05:34:21.278 INFO:teuthology.orchestra.run.smithi160.stdout: "req_unlink_latency": { 2024-05-08T05:34:21.278 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 5378, 2024-05-08T05:34:21.278 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 8.097929430, 2024-05-08T05:34:21.278 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.001505751 2024-05-08T05:34:21.278 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-05-08T05:34:21.278 INFO:teuthology.orchestra.run.smithi160.stdout: "cap_revoke_eviction": 0, 2024-05-08T05:34:21.278 INFO:teuthology.orchestra.run.smithi160.stdout: "cap_acquisition_throttle": 0, 2024-05-08T05:34:21.279 INFO:teuthology.orchestra.run.smithi160.stdout: "req_getvxattr_latency": { 2024-05-08T05:34:21.279 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 0, 2024-05-08T05:34:21.279 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000000000, 2024-05-08T05:34:21.279 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000000 2024-05-08T05:34:21.279 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-05-08T05:34:21.279 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-05-08T05:34:21.279 INFO:teuthology.orchestra.run.smithi160.stdout: "mds_sessions": { 2024-05-08T05:34:21.279 INFO:teuthology.orchestra.run.smithi160.stdout: "session_count": 1, 2024-05-08T05:34:21.279 INFO:teuthology.orchestra.run.smithi160.stdout: "session_add": 2, 2024-05-08T05:34:21.279 INFO:teuthology.orchestra.run.smithi160.stdout: "session_remove": 1, 2024-05-08T05:34:21.279 INFO:teuthology.orchestra.run.smithi160.stdout: "sessions_open": 1, 2024-05-08T05:34:21.279 INFO:teuthology.orchestra.run.smithi160.stdout: "sessions_stale": 0, 2024-05-08T05:34:21.280 INFO:teuthology.orchestra.run.smithi160.stdout: "total_load": 6162, 2024-05-08T05:34:21.280 INFO:teuthology.orchestra.run.smithi160.stdout: "average_load": 6162, 2024-05-08T05:34:21.280 INFO:teuthology.orchestra.run.smithi160.stdout: "avg_session_uptime": 305, 2024-05-08T05:34:21.280 INFO:teuthology.orchestra.run.smithi160.stdout: "mdthresh_evicted": 0 2024-05-08T05:34:21.280 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-05-08T05:34:21.280 INFO:teuthology.orchestra.run.smithi160.stdout: "mempool": { 2024-05-08T05:34:21.280 INFO:teuthology.orchestra.run.smithi160.stdout: "bloom_filter_bytes": 0, 2024-05-08T05:34:21.280 INFO:teuthology.orchestra.run.smithi160.stdout: "bloom_filter_items": 0, 2024-05-08T05:34:21.280 INFO:teuthology.orchestra.run.smithi160.stdout: "bluestore_alloc_bytes": 0, 2024-05-08T05:34:21.280 INFO:teuthology.orchestra.run.smithi160.stdout: "bluestore_alloc_items": 0, 2024-05-08T05:34:21.280 INFO:teuthology.orchestra.run.smithi160.stdout: "bluestore_cache_data_bytes": 0, 2024-05-08T05:34:21.281 INFO:teuthology.orchestra.run.smithi160.stdout: "bluestore_cache_data_items": 0, 2024-05-08T05:34:21.281 INFO:teuthology.orchestra.run.smithi160.stdout: "bluestore_cache_onode_bytes": 0, 2024-05-08T05:34:21.281 INFO:teuthology.orchestra.run.smithi160.stdout: "bluestore_cache_onode_items": 0, 2024-05-08T05:34:21.281 INFO:teuthology.orchestra.run.smithi160.stdout: "bluestore_cache_meta_bytes": 0, 2024-05-08T05:34:21.281 INFO:teuthology.orchestra.run.smithi160.stdout: "bluestore_cache_meta_items": 0, 2024-05-08T05:34:21.281 INFO:teuthology.orchestra.run.smithi160.stdout: "bluestore_cache_other_bytes": 0, 2024-05-08T05:34:21.281 INFO:teuthology.orchestra.run.smithi160.stdout: "bluestore_cache_other_items": 0, 2024-05-08T05:34:21.281 INFO:teuthology.orchestra.run.smithi160.stdout: "bluestore_cache_buffer_bytes": 0, 2024-05-08T05:34:21.281 INFO:teuthology.orchestra.run.smithi160.stdout: "bluestore_cache_buffer_items": 0, 2024-05-08T05:34:21.281 INFO:teuthology.orchestra.run.smithi160.stdout: "bluestore_extent_bytes": 0, 2024-05-08T05:34:21.281 INFO:teuthology.orchestra.run.smithi160.stdout: "bluestore_extent_items": 0, 2024-05-08T05:34:21.281 INFO:teuthology.orchestra.run.smithi160.stdout: "bluestore_blob_bytes": 0, 2024-05-08T05:34:21.282 INFO:teuthology.orchestra.run.smithi160.stdout: "bluestore_blob_items": 0, 2024-05-08T05:34:21.282 INFO:teuthology.orchestra.run.smithi160.stdout: "bluestore_shared_blob_bytes": 0, 2024-05-08T05:34:21.282 INFO:teuthology.orchestra.run.smithi160.stdout: "bluestore_shared_blob_items": 0, 2024-05-08T05:34:21.282 INFO:teuthology.orchestra.run.smithi160.stdout: "bluestore_inline_bl_bytes": 0, 2024-05-08T05:34:21.282 INFO:teuthology.orchestra.run.smithi160.stdout: "bluestore_inline_bl_items": 0, 2024-05-08T05:34:21.282 INFO:teuthology.orchestra.run.smithi160.stdout: "bluestore_fsck_bytes": 0, 2024-05-08T05:34:21.282 INFO:teuthology.orchestra.run.smithi160.stdout: "bluestore_fsck_items": 0, 2024-05-08T05:34:21.282 INFO:teuthology.orchestra.run.smithi160.stdout: "bluestore_txc_bytes": 0, 2024-05-08T05:34:21.282 INFO:teuthology.orchestra.run.smithi160.stdout: "bluestore_txc_items": 0, 2024-05-08T05:34:21.282 INFO:teuthology.orchestra.run.smithi160.stdout: "bluestore_writing_deferred_bytes": 0, 2024-05-08T05:34:21.282 INFO:teuthology.orchestra.run.smithi160.stdout: "bluestore_writing_deferred_items": 0, 2024-05-08T05:34:21.282 INFO:teuthology.orchestra.run.smithi160.stdout: "bluestore_writing_bytes": 0, 2024-05-08T05:34:21.283 INFO:teuthology.orchestra.run.smithi160.stdout: "bluestore_writing_items": 0, 2024-05-08T05:34:21.283 INFO:teuthology.orchestra.run.smithi160.stdout: "bluefs_bytes": 0, 2024-05-08T05:34:21.283 INFO:teuthology.orchestra.run.smithi160.stdout: "bluefs_items": 0, 2024-05-08T05:34:21.283 INFO:teuthology.orchestra.run.smithi160.stdout: "bluefs_file_reader_bytes": 0, 2024-05-08T05:34:21.283 INFO:teuthology.orchestra.run.smithi160.stdout: "bluefs_file_reader_items": 0, 2024-05-08T05:34:21.283 INFO:teuthology.orchestra.run.smithi160.stdout: "bluefs_file_writer_bytes": 0, 2024-05-08T05:34:21.283 INFO:teuthology.orchestra.run.smithi160.stdout: "bluefs_file_writer_items": 0, 2024-05-08T05:34:21.283 INFO:teuthology.orchestra.run.smithi160.stdout: "buffer_anon_bytes": 297283, 2024-05-08T05:34:21.283 INFO:teuthology.orchestra.run.smithi160.stdout: "buffer_anon_items": 248, 2024-05-08T05:34:21.283 INFO:teuthology.orchestra.run.smithi160.stdout: "buffer_meta_bytes": 880, 2024-05-08T05:34:21.283 INFO:teuthology.orchestra.run.smithi160.stdout: "buffer_meta_items": 10, 2024-05-08T05:34:21.283 INFO:teuthology.orchestra.run.smithi160.stdout: "osd_bytes": 0, 2024-05-08T05:34:21.284 INFO:teuthology.orchestra.run.smithi160.stdout: "osd_items": 0, 2024-05-08T05:34:21.284 INFO:teuthology.orchestra.run.smithi160.stdout: "osd_mapbl_bytes": 0, 2024-05-08T05:34:21.284 INFO:teuthology.orchestra.run.smithi160.stdout: "osd_mapbl_items": 0, 2024-05-08T05:34:21.284 INFO:teuthology.orchestra.run.smithi160.stdout: "osd_pglog_bytes": 0, 2024-05-08T05:34:21.284 INFO:teuthology.orchestra.run.smithi160.stdout: "osd_pglog_items": 0, 2024-05-08T05:34:21.284 INFO:teuthology.orchestra.run.smithi160.stdout: "osdmap_bytes": 7440, 2024-05-08T05:34:21.284 INFO:teuthology.orchestra.run.smithi160.stdout: "osdmap_items": 157, 2024-05-08T05:34:21.284 INFO:teuthology.orchestra.run.smithi160.stdout: "osdmap_mapping_bytes": 0, 2024-05-08T05:34:21.284 INFO:teuthology.orchestra.run.smithi160.stdout: "osdmap_mapping_items": 0, 2024-05-08T05:34:21.284 INFO:teuthology.orchestra.run.smithi160.stdout: "pgmap_bytes": 0, 2024-05-08T05:34:21.284 INFO:teuthology.orchestra.run.smithi160.stdout: "pgmap_items": 0, 2024-05-08T05:34:21.284 INFO:teuthology.orchestra.run.smithi160.stdout: "mds_co_bytes": 927701, 2024-05-08T05:34:21.285 INFO:teuthology.orchestra.run.smithi160.stdout: "mds_co_items": 24905, 2024-05-08T05:34:21.285 INFO:teuthology.orchestra.run.smithi160.stdout: "unittest_1_bytes": 0, 2024-05-08T05:34:21.285 INFO:teuthology.orchestra.run.smithi160.stdout: "unittest_1_items": 0, 2024-05-08T05:34:21.285 INFO:teuthology.orchestra.run.smithi160.stdout: "unittest_2_bytes": 0, 2024-05-08T05:34:21.285 INFO:teuthology.orchestra.run.smithi160.stdout: "unittest_2_items": 0 2024-05-08T05:34:21.285 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-05-08T05:34:21.285 INFO:teuthology.orchestra.run.smithi160.stdout: "objecter": { 2024-05-08T05:34:21.285 INFO:teuthology.orchestra.run.smithi160.stdout: "op_active": 0, 2024-05-08T05:34:21.285 INFO:teuthology.orchestra.run.smithi160.stdout: "op_laggy": 0, 2024-05-08T05:34:21.285 INFO:teuthology.orchestra.run.smithi160.stdout: "op_send": 14287, 2024-05-08T05:34:21.285 INFO:teuthology.orchestra.run.smithi160.stdout: "op_send_bytes": 45355209, 2024-05-08T05:34:21.285 INFO:teuthology.orchestra.run.smithi160.stdout: "op_resend": 30, 2024-05-08T05:34:21.286 INFO:teuthology.orchestra.run.smithi160.stdout: "op_reply": 14287, 2024-05-08T05:34:21.286 INFO:teuthology.orchestra.run.smithi160.stdout: "op_latency": { 2024-05-08T05:34:21.286 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 14287, 2024-05-08T05:34:21.286 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 33.260517311, 2024-05-08T05:34:21.286 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.002328026 2024-05-08T05:34:21.286 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-05-08T05:34:21.286 INFO:teuthology.orchestra.run.smithi160.stdout: "op_inflight": 0, 2024-05-08T05:34:21.286 INFO:teuthology.orchestra.run.smithi160.stdout: "oplen_avg": { 2024-05-08T05:34:21.286 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 14287, 2024-05-08T05:34:21.286 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 14396 2024-05-08T05:34:21.286 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-05-08T05:34:21.286 INFO:teuthology.orchestra.run.smithi160.stdout: "op": 14287, 2024-05-08T05:34:21.287 INFO:teuthology.orchestra.run.smithi160.stdout: "op_r": 6379, 2024-05-08T05:34:21.287 INFO:teuthology.orchestra.run.smithi160.stdout: "op_w": 7908, 2024-05-08T05:34:21.287 INFO:teuthology.orchestra.run.smithi160.stdout: "op_rmw": 0, 2024-05-08T05:34:21.287 INFO:teuthology.orchestra.run.smithi160.stdout: "op_pg": 0, 2024-05-08T05:34:21.287 INFO:teuthology.orchestra.run.smithi160.stdout: "osdop_stat": 0, 2024-05-08T05:34:21.287 INFO:teuthology.orchestra.run.smithi160.stdout: "osdop_create": 10, 2024-05-08T05:34:21.287 INFO:teuthology.orchestra.run.smithi160.stdout: "osdop_read": 192, 2024-05-08T05:34:21.287 INFO:teuthology.orchestra.run.smithi160.stdout: "osdop_write": 1390, 2024-05-08T05:34:21.287 INFO:teuthology.orchestra.run.smithi160.stdout: "osdop_writefull": 95, 2024-05-08T05:34:21.287 INFO:teuthology.orchestra.run.smithi160.stdout: "osdop_writesame": 0, 2024-05-08T05:34:21.287 INFO:teuthology.orchestra.run.smithi160.stdout: "osdop_append": 0, 2024-05-08T05:34:21.287 INFO:teuthology.orchestra.run.smithi160.stdout: "osdop_zero": 0, 2024-05-08T05:34:21.287 INFO:teuthology.orchestra.run.smithi160.stdout: "osdop_truncate": 0, 2024-05-08T05:34:21.288 INFO:teuthology.orchestra.run.smithi160.stdout: "osdop_delete": 6329, 2024-05-08T05:34:21.288 INFO:teuthology.orchestra.run.smithi160.stdout: "osdop_mapext": 0, 2024-05-08T05:34:21.288 INFO:teuthology.orchestra.run.smithi160.stdout: "osdop_sparse_read": 0, 2024-05-08T05:34:21.288 INFO:teuthology.orchestra.run.smithi160.stdout: "osdop_clonerange": 0, 2024-05-08T05:34:21.288 INFO:teuthology.orchestra.run.smithi160.stdout: "osdop_getxattr": 6187, 2024-05-08T05:34:21.288 INFO:teuthology.orchestra.run.smithi160.stdout: "osdop_setxattr": 20, 2024-05-08T05:34:21.288 INFO:teuthology.orchestra.run.smithi160.stdout: "osdop_cmpxattr": 0, 2024-05-08T05:34:21.288 INFO:teuthology.orchestra.run.smithi160.stdout: "osdop_rmxattr": 0, 2024-05-08T05:34:21.288 INFO:teuthology.orchestra.run.smithi160.stdout: "osdop_resetxattrs": 0, 2024-05-08T05:34:21.288 INFO:teuthology.orchestra.run.smithi160.stdout: "osdop_call": 0, 2024-05-08T05:34:21.288 INFO:teuthology.orchestra.run.smithi160.stdout: "osdop_watch": 0, 2024-05-08T05:34:21.288 INFO:teuthology.orchestra.run.smithi160.stdout: "osdop_notify": 0, 2024-05-08T05:34:21.289 INFO:teuthology.orchestra.run.smithi160.stdout: "osdop_src_cmpxattr": 0, 2024-05-08T05:34:21.289 INFO:teuthology.orchestra.run.smithi160.stdout: "osdop_pgls": 0, 2024-05-08T05:34:21.289 INFO:teuthology.orchestra.run.smithi160.stdout: "osdop_pgls_filter": 0, 2024-05-08T05:34:21.289 INFO:teuthology.orchestra.run.smithi160.stdout: "osdop_other": 15, 2024-05-08T05:34:21.289 INFO:teuthology.orchestra.run.smithi160.stdout: "linger_active": 0, 2024-05-08T05:34:21.289 INFO:teuthology.orchestra.run.smithi160.stdout: "linger_send": 0, 2024-05-08T05:34:21.289 INFO:teuthology.orchestra.run.smithi160.stdout: "linger_resend": 0, 2024-05-08T05:34:21.289 INFO:teuthology.orchestra.run.smithi160.stdout: "linger_ping": 0, 2024-05-08T05:34:21.289 INFO:teuthology.orchestra.run.smithi160.stdout: "poolop_active": 0, 2024-05-08T05:34:21.289 INFO:teuthology.orchestra.run.smithi160.stdout: "poolop_send": 0, 2024-05-08T05:34:21.289 INFO:teuthology.orchestra.run.smithi160.stdout: "poolop_resend": 0, 2024-05-08T05:34:21.289 INFO:teuthology.orchestra.run.smithi160.stdout: "poolstat_active": 0, 2024-05-08T05:34:21.289 INFO:teuthology.orchestra.run.smithi160.stdout: "poolstat_send": 0, 2024-05-08T05:34:21.290 INFO:teuthology.orchestra.run.smithi160.stdout: "poolstat_resend": 0, 2024-05-08T05:34:21.290 INFO:teuthology.orchestra.run.smithi160.stdout: "statfs_active": 0, 2024-05-08T05:34:21.290 INFO:teuthology.orchestra.run.smithi160.stdout: "statfs_send": 0, 2024-05-08T05:34:21.290 INFO:teuthology.orchestra.run.smithi160.stdout: "statfs_resend": 0, 2024-05-08T05:34:21.290 INFO:teuthology.orchestra.run.smithi160.stdout: "command_active": 0, 2024-05-08T05:34:21.290 INFO:teuthology.orchestra.run.smithi160.stdout: "command_send": 0, 2024-05-08T05:34:21.290 INFO:teuthology.orchestra.run.smithi160.stdout: "command_resend": 0, 2024-05-08T05:34:21.290 INFO:teuthology.orchestra.run.smithi160.stdout: "map_epoch": 82, 2024-05-08T05:34:21.290 INFO:teuthology.orchestra.run.smithi160.stdout: "map_full": 0, 2024-05-08T05:34:21.290 INFO:teuthology.orchestra.run.smithi160.stdout: "map_inc": 2, 2024-05-08T05:34:21.290 INFO:teuthology.orchestra.run.smithi160.stdout: "osd_sessions": 12, 2024-05-08T05:34:21.291 INFO:teuthology.orchestra.run.smithi160.stdout: "osd_session_open": 12, 2024-05-08T05:34:21.291 INFO:teuthology.orchestra.run.smithi160.stdout: "osd_session_close": 0, 2024-05-08T05:34:21.291 INFO:teuthology.orchestra.run.smithi160.stdout: "osd_laggy": 0, 2024-05-08T05:34:21.291 INFO:teuthology.orchestra.run.smithi160.stdout: "omap_wr": 112, 2024-05-08T05:34:21.291 INFO:teuthology.orchestra.run.smithi160.stdout: "omap_rd": 0, 2024-05-08T05:34:21.291 INFO:teuthology.orchestra.run.smithi160.stdout: "omap_del": 46 2024-05-08T05:34:21.291 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-05-08T05:34:21.291 INFO:teuthology.orchestra.run.smithi160.stdout: "oft": { 2024-05-08T05:34:21.291 INFO:teuthology.orchestra.run.smithi160.stdout: "omap_total_objs": 1, 2024-05-08T05:34:21.291 INFO:teuthology.orchestra.run.smithi160.stdout: "omap_total_kv_pairs": 0, 2024-05-08T05:34:21.291 INFO:teuthology.orchestra.run.smithi160.stdout: "omap_total_updates": 0, 2024-05-08T05:34:21.291 INFO:teuthology.orchestra.run.smithi160.stdout: "omap_total_removes": 0 2024-05-08T05:34:21.292 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-05-08T05:34:21.292 INFO:teuthology.orchestra.run.smithi160.stdout: "osd-slow-ops": { 2024-05-08T05:34:21.292 INFO:teuthology.orchestra.run.smithi160.stdout: "slow_ops_count": 0 2024-05-08T05:34:21.292 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-05-08T05:34:21.292 INFO:teuthology.orchestra.run.smithi160.stdout: "purge_queue": { 2024-05-08T05:34:21.292 INFO:teuthology.orchestra.run.smithi160.stdout: "pq_executing_ops": 0, 2024-05-08T05:34:21.292 INFO:teuthology.orchestra.run.smithi160.stdout: "pq_executing_ops_high_water": 18, 2024-05-08T05:34:21.292 INFO:teuthology.orchestra.run.smithi160.stdout: "pq_executing": 0, 2024-05-08T05:34:21.292 INFO:teuthology.orchestra.run.smithi160.stdout: "pq_executing_high_water": 10, 2024-05-08T05:34:21.292 INFO:teuthology.orchestra.run.smithi160.stdout: "pq_executed_ops": 6303, 2024-05-08T05:34:21.292 INFO:teuthology.orchestra.run.smithi160.stdout: "pq_executed": 5947, 2024-05-08T05:34:21.293 INFO:teuthology.orchestra.run.smithi160.stdout: "pq_item_in_journal": 0 2024-05-08T05:34:21.293 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-05-08T05:34:21.293 INFO:teuthology.orchestra.run.smithi160.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-05-08T05:34:21.293 INFO:teuthology.orchestra.run.smithi160.stdout: "val": 0, 2024-05-08T05:34:21.293 INFO:teuthology.orchestra.run.smithi160.stdout: "max": 104857600, 2024-05-08T05:34:21.293 INFO:teuthology.orchestra.run.smithi160.stdout: "get_started": 0, 2024-05-08T05:34:21.293 INFO:teuthology.orchestra.run.smithi160.stdout: "get": 63530, 2024-05-08T05:34:21.293 INFO:teuthology.orchestra.run.smithi160.stdout: "get_sum": 21702190, 2024-05-08T05:34:21.293 INFO:teuthology.orchestra.run.smithi160.stdout: "get_or_fail_fail": 0, 2024-05-08T05:34:21.293 INFO:teuthology.orchestra.run.smithi160.stdout: "get_or_fail_success": 63530, 2024-05-08T05:34:21.293 INFO:teuthology.orchestra.run.smithi160.stdout: "take": 0, 2024-05-08T05:34:21.293 INFO:teuthology.orchestra.run.smithi160.stdout: "take_sum": 0, 2024-05-08T05:34:21.294 INFO:teuthology.orchestra.run.smithi160.stdout: "put": 63530, 2024-05-08T05:34:21.294 INFO:teuthology.orchestra.run.smithi160.stdout: "put_sum": 21702190, 2024-05-08T05:34:21.294 INFO:teuthology.orchestra.run.smithi160.stdout: "wait": { 2024-05-08T05:34:21.294 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 0, 2024-05-08T05:34:21.294 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000000000, 2024-05-08T05:34:21.294 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000000 2024-05-08T05:34:21.294 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-05-08T05:34:21.294 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-05-08T05:34:21.294 INFO:teuthology.orchestra.run.smithi160.stdout: "throttle-objecter_bytes": { 2024-05-08T05:34:21.294 INFO:teuthology.orchestra.run.smithi160.stdout: "val": 0, 2024-05-08T05:34:21.294 INFO:teuthology.orchestra.run.smithi160.stdout: "max": 104857600, 2024-05-08T05:34:21.295 INFO:teuthology.orchestra.run.smithi160.stdout: "get_started": 0, 2024-05-08T05:34:21.295 INFO:teuthology.orchestra.run.smithi160.stdout: "get": 0, 2024-05-08T05:34:21.295 INFO:teuthology.orchestra.run.smithi160.stdout: "get_sum": 0, 2024-05-08T05:34:21.295 INFO:teuthology.orchestra.run.smithi160.stdout: "get_or_fail_fail": 0, 2024-05-08T05:34:21.295 INFO:teuthology.orchestra.run.smithi160.stdout: "get_or_fail_success": 0, 2024-05-08T05:34:21.295 INFO:teuthology.orchestra.run.smithi160.stdout: "take": 14287, 2024-05-08T05:34:21.295 INFO:teuthology.orchestra.run.smithi160.stdout: "take_sum": 45955872, 2024-05-08T05:34:21.295 INFO:teuthology.orchestra.run.smithi160.stdout: "put": 14287, 2024-05-08T05:34:21.295 INFO:teuthology.orchestra.run.smithi160.stdout: "put_sum": 45955872, 2024-05-08T05:34:21.295 INFO:teuthology.orchestra.run.smithi160.stdout: "wait": { 2024-05-08T05:34:21.295 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 0, 2024-05-08T05:34:21.295 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000000000, 2024-05-08T05:34:21.296 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000000 2024-05-08T05:34:21.296 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-05-08T05:34:21.296 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-05-08T05:34:21.296 INFO:teuthology.orchestra.run.smithi160.stdout: "throttle-objecter_ops": { 2024-05-08T05:34:21.296 INFO:teuthology.orchestra.run.smithi160.stdout: "val": 0, 2024-05-08T05:34:21.296 INFO:teuthology.orchestra.run.smithi160.stdout: "max": 1024, 2024-05-08T05:34:21.296 INFO:teuthology.orchestra.run.smithi160.stdout: "get_started": 0, 2024-05-08T05:34:21.296 INFO:teuthology.orchestra.run.smithi160.stdout: "get": 0, 2024-05-08T05:34:21.296 INFO:teuthology.orchestra.run.smithi160.stdout: "get_sum": 0, 2024-05-08T05:34:21.296 INFO:teuthology.orchestra.run.smithi160.stdout: "get_or_fail_fail": 0, 2024-05-08T05:34:21.296 INFO:teuthology.orchestra.run.smithi160.stdout: "get_or_fail_success": 0, 2024-05-08T05:34:21.296 INFO:teuthology.orchestra.run.smithi160.stdout: "take": 14287, 2024-05-08T05:34:21.297 INFO:teuthology.orchestra.run.smithi160.stdout: "take_sum": 14287, 2024-05-08T05:34:21.297 INFO:teuthology.orchestra.run.smithi160.stdout: "put": 14287, 2024-05-08T05:34:21.297 INFO:teuthology.orchestra.run.smithi160.stdout: "put_sum": 14287, 2024-05-08T05:34:21.297 INFO:teuthology.orchestra.run.smithi160.stdout: "wait": { 2024-05-08T05:34:21.297 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 0, 2024-05-08T05:34:21.297 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000000000, 2024-05-08T05:34:21.297 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000000 2024-05-08T05:34:21.297 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-05-08T05:34:21.297 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-05-08T05:34:21.297 INFO:teuthology.orchestra.run.smithi160.stdout: "throttle-write_buf_throttle": { 2024-05-08T05:34:21.297 INFO:teuthology.orchestra.run.smithi160.stdout: "val": 0, 2024-05-08T05:34:21.297 INFO:teuthology.orchestra.run.smithi160.stdout: "max": 3758096384, 2024-05-08T05:34:21.298 INFO:teuthology.orchestra.run.smithi160.stdout: "get_started": 0, 2024-05-08T05:34:21.298 INFO:teuthology.orchestra.run.smithi160.stdout: "get": 5947, 2024-05-08T05:34:21.298 INFO:teuthology.orchestra.run.smithi160.stdout: "get_sum": 600663, 2024-05-08T05:34:21.298 INFO:teuthology.orchestra.run.smithi160.stdout: "get_or_fail_fail": 0, 2024-05-08T05:34:21.298 INFO:teuthology.orchestra.run.smithi160.stdout: "get_or_fail_success": 5947, 2024-05-08T05:34:21.298 INFO:teuthology.orchestra.run.smithi160.stdout: "take": 0, 2024-05-08T05:34:21.298 INFO:teuthology.orchestra.run.smithi160.stdout: "take_sum": 0, 2024-05-08T05:34:21.298 INFO:teuthology.orchestra.run.smithi160.stdout: "put": 192, 2024-05-08T05:34:21.298 INFO:teuthology.orchestra.run.smithi160.stdout: "put_sum": 600663, 2024-05-08T05:34:21.298 INFO:teuthology.orchestra.run.smithi160.stdout: "wait": { 2024-05-08T05:34:21.298 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 0, 2024-05-08T05:34:21.298 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000000000, 2024-05-08T05:34:21.299 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000000 2024-05-08T05:34:21.299 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-05-08T05:34:21.299 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-05-08T05:34:21.299 INFO:teuthology.orchestra.run.smithi160.stdout: "throttle-write_buf_throttle-0x560845434500": { 2024-05-08T05:34:21.299 INFO:teuthology.orchestra.run.smithi160.stdout: "val": 0, 2024-05-08T05:34:21.299 INFO:teuthology.orchestra.run.smithi160.stdout: "max": 3758096384, 2024-05-08T05:34:21.299 INFO:teuthology.orchestra.run.smithi160.stdout: "get_started": 0, 2024-05-08T05:34:21.299 INFO:teuthology.orchestra.run.smithi160.stdout: "get": 21029, 2024-05-08T05:34:21.299 INFO:teuthology.orchestra.run.smithi160.stdout: "get_sum": 44286976, 2024-05-08T05:34:21.299 INFO:teuthology.orchestra.run.smithi160.stdout: "get_or_fail_fail": 0, 2024-05-08T05:34:21.299 INFO:teuthology.orchestra.run.smithi160.stdout: "get_or_fail_success": 21029, 2024-05-08T05:34:21.299 INFO:teuthology.orchestra.run.smithi160.stdout: "take": 0, 2024-05-08T05:34:21.300 INFO:teuthology.orchestra.run.smithi160.stdout: "take_sum": 0, 2024-05-08T05:34:21.300 INFO:teuthology.orchestra.run.smithi160.stdout: "put": 1198, 2024-05-08T05:34:21.300 INFO:teuthology.orchestra.run.smithi160.stdout: "put_sum": 44286976, 2024-05-08T05:34:21.300 INFO:teuthology.orchestra.run.smithi160.stdout: "wait": { 2024-05-08T05:34:21.300 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 0, 2024-05-08T05:34:21.300 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000000000, 2024-05-08T05:34:21.300 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000000 2024-05-08T05:34:21.300 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-05-08T05:34:21.300 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-05-08T05:34:21.300 INFO:teuthology.orchestra.run.smithi160.stdout:} 2024-05-08T05:34:22.139 INFO:tasks.check_counter:Daemon mds.i mds.exported=8 2024-05-08T05:34:22.139 INFO:tasks.check_counter:Daemon mds.i mds.imported=23 2024-05-08T05:34:22.139 INFO:tasks.check_counter:Daemon mds.i mds_cache.dir_update=1437 2024-05-08T05:34:22.139 INFO:tasks.check_counter:Daemon mds.i mds_cache.dir_update_receipt=3080 2024-05-08T05:34:22.139 DEBUG:tasks.check_counter:Getting stats from l 2024-05-08T05:34:22.139 DEBUG:teuthology.orchestra.run.smithi160:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid eeeb813e-0cf9-11ef-bc97-c7b262605968 -- ceph daemon mds.l perf dump 2024-05-08T05:34:22.374 INFO:teuthology.orchestra.run.smithi160.stderr:Inferring config /var/lib/ceph/eeeb813e-0cf9-11ef-bc97-c7b262605968/mon.c/config 2024-05-08T05:34:22.773 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:34:22 smithi160 ceph-mon[34827]: pgmap v581: 97 pgs: 97 active+clean; 153 MiB data, 1004 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 6 op/s 2024-05-08T05:34:22.958 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:34:22 smithi087 ceph-mon[29523]: pgmap v581: 97 pgs: 97 active+clean; 153 MiB data, 1004 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 6 op/s 2024-05-08T05:34:22.983 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:34:22 smithi090 ceph-mon[34526]: pgmap v581: 97 pgs: 97 active+clean; 153 MiB data, 1004 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 6 op/s 2024-05-08T05:34:24.014 INFO:teuthology.orchestra.run.smithi160.stdout:{ 2024-05-08T05:34:24.014 INFO:teuthology.orchestra.run.smithi160.stdout: "AsyncMessenger::Worker-0": { 2024-05-08T05:34:24.014 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_recv_messages": 162, 2024-05-08T05:34:24.014 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_send_messages": 159, 2024-05-08T05:34:24.014 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_recv_bytes": 497456, 2024-05-08T05:34:24.015 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_send_bytes": 97328, 2024-05-08T05:34:24.015 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_created_connections": 4, 2024-05-08T05:34:24.015 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_active_connections": 0, 2024-05-08T05:34:24.015 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_running_total_time": 0.027979196, 2024-05-08T05:34:24.015 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_running_send_time": 0.010455259, 2024-05-08T05:34:24.015 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_running_recv_time": 0.013482681, 2024-05-08T05:34:24.015 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_running_fast_dispatch_time": 0.003979324, 2024-05-08T05:34:24.015 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_send_messages_queue_lat": { 2024-05-08T05:34:24.015 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 158, 2024-05-08T05:34:24.015 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.007986674, 2024-05-08T05:34:24.015 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000050548 2024-05-08T05:34:24.015 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-05-08T05:34:24.015 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_handle_ack_lat": { 2024-05-08T05:34:24.015 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 0, 2024-05-08T05:34:24.015 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000000000, 2024-05-08T05:34:24.016 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000000 2024-05-08T05:34:24.016 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-05-08T05:34:24.016 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_recv_encrypted_bytes": 497456, 2024-05-08T05:34:24.016 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_send_encrypted_bytes": 97328 2024-05-08T05:34:24.016 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-05-08T05:34:24.016 INFO:teuthology.orchestra.run.smithi160.stdout: "AsyncMessenger::Worker-1": { 2024-05-08T05:34:24.016 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_recv_messages": 5, 2024-05-08T05:34:24.016 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_send_messages": 123, 2024-05-08T05:34:24.016 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_recv_bytes": 3152, 2024-05-08T05:34:24.016 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_send_bytes": 100288, 2024-05-08T05:34:24.016 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_created_connections": 3, 2024-05-08T05:34:24.016 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_active_connections": 2, 2024-05-08T05:34:24.016 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_running_total_time": 0.007380632, 2024-05-08T05:34:24.016 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_running_send_time": 0.005302186, 2024-05-08T05:34:24.017 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_running_recv_time": 0.000731565, 2024-05-08T05:34:24.017 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-05-08T05:34:24.017 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_send_messages_queue_lat": { 2024-05-08T05:34:24.017 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 122, 2024-05-08T05:34:24.017 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.008838253, 2024-05-08T05:34:24.017 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000072444 2024-05-08T05:34:24.017 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-05-08T05:34:24.017 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_handle_ack_lat": { 2024-05-08T05:34:24.017 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 0, 2024-05-08T05:34:24.017 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000000000, 2024-05-08T05:34:24.017 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000000 2024-05-08T05:34:24.017 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-05-08T05:34:24.017 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_recv_encrypted_bytes": 3152, 2024-05-08T05:34:24.017 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_send_encrypted_bytes": 100288 2024-05-08T05:34:24.017 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-05-08T05:34:24.018 INFO:teuthology.orchestra.run.smithi160.stdout: "AsyncMessenger::Worker-2": { 2024-05-08T05:34:24.018 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_recv_messages": 0, 2024-05-08T05:34:24.018 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_send_messages": 2, 2024-05-08T05:34:24.018 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_recv_bytes": 0, 2024-05-08T05:34:24.018 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_send_bytes": 0, 2024-05-08T05:34:24.018 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_created_connections": 2, 2024-05-08T05:34:24.018 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_active_connections": 1, 2024-05-08T05:34:24.018 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_running_total_time": 0.000187865, 2024-05-08T05:34:24.018 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_running_send_time": 0.000000000, 2024-05-08T05:34:24.018 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_running_recv_time": 0.000126135, 2024-05-08T05:34:24.018 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-05-08T05:34:24.018 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_send_messages_queue_lat": { 2024-05-08T05:34:24.018 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 0, 2024-05-08T05:34:24.018 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000000000, 2024-05-08T05:34:24.018 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000000 2024-05-08T05:34:24.019 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-05-08T05:34:24.019 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_handle_ack_lat": { 2024-05-08T05:34:24.019 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 0, 2024-05-08T05:34:24.019 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000000000, 2024-05-08T05:34:24.019 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000000 2024-05-08T05:34:24.019 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-05-08T05:34:24.019 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_recv_encrypted_bytes": 0, 2024-05-08T05:34:24.019 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_send_encrypted_bytes": 0 2024-05-08T05:34:24.019 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-05-08T05:34:24.019 INFO:teuthology.orchestra.run.smithi160.stdout: "cct": { 2024-05-08T05:34:24.019 INFO:teuthology.orchestra.run.smithi160.stdout: "total_workers": 0, 2024-05-08T05:34:24.019 INFO:teuthology.orchestra.run.smithi160.stdout: "unhealthy_workers": 0 2024-05-08T05:34:24.019 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-05-08T05:34:24.019 INFO:teuthology.orchestra.run.smithi160.stdout: "mempool": { 2024-05-08T05:34:24.019 INFO:teuthology.orchestra.run.smithi160.stdout: "bloom_filter_bytes": 0, 2024-05-08T05:34:24.019 INFO:teuthology.orchestra.run.smithi160.stdout: "bloom_filter_items": 0, 2024-05-08T05:34:24.020 INFO:teuthology.orchestra.run.smithi160.stdout: "bluestore_alloc_bytes": 0, 2024-05-08T05:34:24.020 INFO:teuthology.orchestra.run.smithi160.stdout: "bluestore_alloc_items": 0, 2024-05-08T05:34:24.020 INFO:teuthology.orchestra.run.smithi160.stdout: "bluestore_cache_data_bytes": 0, 2024-05-08T05:34:24.020 INFO:teuthology.orchestra.run.smithi160.stdout: "bluestore_cache_data_items": 0, 2024-05-08T05:34:24.020 INFO:teuthology.orchestra.run.smithi160.stdout: "bluestore_cache_onode_bytes": 0, 2024-05-08T05:34:24.020 INFO:teuthology.orchestra.run.smithi160.stdout: "bluestore_cache_onode_items": 0, 2024-05-08T05:34:24.020 INFO:teuthology.orchestra.run.smithi160.stdout: "bluestore_cache_meta_bytes": 0, 2024-05-08T05:34:24.020 INFO:teuthology.orchestra.run.smithi160.stdout: "bluestore_cache_meta_items": 0, 2024-05-08T05:34:24.020 INFO:teuthology.orchestra.run.smithi160.stdout: "bluestore_cache_other_bytes": 0, 2024-05-08T05:34:24.020 INFO:teuthology.orchestra.run.smithi160.stdout: "bluestore_cache_other_items": 0, 2024-05-08T05:34:24.020 INFO:teuthology.orchestra.run.smithi160.stdout: "bluestore_cache_buffer_bytes": 0, 2024-05-08T05:34:24.020 INFO:teuthology.orchestra.run.smithi160.stdout: "bluestore_cache_buffer_items": 0, 2024-05-08T05:34:24.020 INFO:teuthology.orchestra.run.smithi160.stdout: "bluestore_extent_bytes": 0, 2024-05-08T05:34:24.020 INFO:teuthology.orchestra.run.smithi160.stdout: "bluestore_extent_items": 0, 2024-05-08T05:34:24.020 INFO:teuthology.orchestra.run.smithi160.stdout: "bluestore_blob_bytes": 0, 2024-05-08T05:34:24.020 INFO:teuthology.orchestra.run.smithi160.stdout: "bluestore_blob_items": 0, 2024-05-08T05:34:24.021 INFO:teuthology.orchestra.run.smithi160.stdout: "bluestore_shared_blob_bytes": 0, 2024-05-08T05:34:24.021 INFO:teuthology.orchestra.run.smithi160.stdout: "bluestore_shared_blob_items": 0, 2024-05-08T05:34:24.021 INFO:teuthology.orchestra.run.smithi160.stdout: "bluestore_inline_bl_bytes": 0, 2024-05-08T05:34:24.021 INFO:teuthology.orchestra.run.smithi160.stdout: "bluestore_inline_bl_items": 0, 2024-05-08T05:34:24.021 INFO:teuthology.orchestra.run.smithi160.stdout: "bluestore_fsck_bytes": 0, 2024-05-08T05:34:24.021 INFO:teuthology.orchestra.run.smithi160.stdout: "bluestore_fsck_items": 0, 2024-05-08T05:34:24.021 INFO:teuthology.orchestra.run.smithi160.stdout: "bluestore_txc_bytes": 0, 2024-05-08T05:34:24.021 INFO:teuthology.orchestra.run.smithi160.stdout: "bluestore_txc_items": 0, 2024-05-08T05:34:24.021 INFO:teuthology.orchestra.run.smithi160.stdout: "bluestore_writing_deferred_bytes": 0, 2024-05-08T05:34:24.021 INFO:teuthology.orchestra.run.smithi160.stdout: "bluestore_writing_deferred_items": 0, 2024-05-08T05:34:24.021 INFO:teuthology.orchestra.run.smithi160.stdout: "bluestore_writing_bytes": 0, 2024-05-08T05:34:24.021 INFO:teuthology.orchestra.run.smithi160.stdout: "bluestore_writing_items": 0, 2024-05-08T05:34:24.021 INFO:teuthology.orchestra.run.smithi160.stdout: "bluefs_bytes": 0, 2024-05-08T05:34:24.021 INFO:teuthology.orchestra.run.smithi160.stdout: "bluefs_items": 0, 2024-05-08T05:34:24.021 INFO:teuthology.orchestra.run.smithi160.stdout: "bluefs_file_reader_bytes": 0, 2024-05-08T05:34:24.022 INFO:teuthology.orchestra.run.smithi160.stdout: "bluefs_file_reader_items": 0, 2024-05-08T05:34:24.022 INFO:teuthology.orchestra.run.smithi160.stdout: "bluefs_file_writer_bytes": 0, 2024-05-08T05:34:24.022 INFO:teuthology.orchestra.run.smithi160.stdout: "bluefs_file_writer_items": 0, 2024-05-08T05:34:24.022 INFO:teuthology.orchestra.run.smithi160.stdout: "buffer_anon_bytes": 148945, 2024-05-08T05:34:24.022 INFO:teuthology.orchestra.run.smithi160.stdout: "buffer_anon_items": 29, 2024-05-08T05:34:24.022 INFO:teuthology.orchestra.run.smithi160.stdout: "buffer_meta_bytes": 0, 2024-05-08T05:34:24.022 INFO:teuthology.orchestra.run.smithi160.stdout: "buffer_meta_items": 0, 2024-05-08T05:34:24.022 INFO:teuthology.orchestra.run.smithi160.stdout: "osd_bytes": 0, 2024-05-08T05:34:24.022 INFO:teuthology.orchestra.run.smithi160.stdout: "osd_items": 0, 2024-05-08T05:34:24.022 INFO:teuthology.orchestra.run.smithi160.stdout: "osd_mapbl_bytes": 0, 2024-05-08T05:34:24.022 INFO:teuthology.orchestra.run.smithi160.stdout: "osd_mapbl_items": 0, 2024-05-08T05:34:24.022 INFO:teuthology.orchestra.run.smithi160.stdout: "osd_pglog_bytes": 0, 2024-05-08T05:34:24.022 INFO:teuthology.orchestra.run.smithi160.stdout: "osd_pglog_items": 0, 2024-05-08T05:34:24.022 INFO:teuthology.orchestra.run.smithi160.stdout: "osdmap_bytes": 0, 2024-05-08T05:34:24.022 INFO:teuthology.orchestra.run.smithi160.stdout: "osdmap_items": 0, 2024-05-08T05:34:24.022 INFO:teuthology.orchestra.run.smithi160.stdout: "osdmap_mapping_bytes": 0, 2024-05-08T05:34:24.023 INFO:teuthology.orchestra.run.smithi160.stdout: "osdmap_mapping_items": 0, 2024-05-08T05:34:24.023 INFO:teuthology.orchestra.run.smithi160.stdout: "pgmap_bytes": 0, 2024-05-08T05:34:24.023 INFO:teuthology.orchestra.run.smithi160.stdout: "pgmap_items": 0, 2024-05-08T05:34:24.023 INFO:teuthology.orchestra.run.smithi160.stdout: "mds_co_bytes": 928, 2024-05-08T05:34:24.023 INFO:teuthology.orchestra.run.smithi160.stdout: "mds_co_items": 2, 2024-05-08T05:34:24.023 INFO:teuthology.orchestra.run.smithi160.stdout: "unittest_1_bytes": 0, 2024-05-08T05:34:24.023 INFO:teuthology.orchestra.run.smithi160.stdout: "unittest_1_items": 0, 2024-05-08T05:34:24.023 INFO:teuthology.orchestra.run.smithi160.stdout: "unittest_2_bytes": 0, 2024-05-08T05:34:24.023 INFO:teuthology.orchestra.run.smithi160.stdout: "unittest_2_items": 0 2024-05-08T05:34:24.023 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-05-08T05:34:24.023 INFO:teuthology.orchestra.run.smithi160.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-05-08T05:34:24.023 INFO:teuthology.orchestra.run.smithi160.stdout: "val": 0, 2024-05-08T05:34:24.023 INFO:teuthology.orchestra.run.smithi160.stdout: "max": 104857600, 2024-05-08T05:34:24.023 INFO:teuthology.orchestra.run.smithi160.stdout: "get_started": 0, 2024-05-08T05:34:24.023 INFO:teuthology.orchestra.run.smithi160.stdout: "get": 163, 2024-05-08T05:34:24.024 INFO:teuthology.orchestra.run.smithi160.stdout: "get_sum": 474574, 2024-05-08T05:34:24.024 INFO:teuthology.orchestra.run.smithi160.stdout: "get_or_fail_fail": 0, 2024-05-08T05:34:24.024 INFO:teuthology.orchestra.run.smithi160.stdout: "get_or_fail_success": 163, 2024-05-08T05:34:24.024 INFO:teuthology.orchestra.run.smithi160.stdout: "take": 0, 2024-05-08T05:34:24.024 INFO:teuthology.orchestra.run.smithi160.stdout: "take_sum": 0, 2024-05-08T05:34:24.024 INFO:teuthology.orchestra.run.smithi160.stdout: "put": 163, 2024-05-08T05:34:24.024 INFO:teuthology.orchestra.run.smithi160.stdout: "put_sum": 474574, 2024-05-08T05:34:24.024 INFO:teuthology.orchestra.run.smithi160.stdout: "wait": { 2024-05-08T05:34:24.024 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 0, 2024-05-08T05:34:24.024 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000000000, 2024-05-08T05:34:24.024 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000000 2024-05-08T05:34:24.024 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-05-08T05:34:24.024 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-05-08T05:34:24.024 INFO:teuthology.orchestra.run.smithi160.stdout:} 2024-05-08T05:34:24.727 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.l 2024-05-08T05:34:24.727 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.l 2024-05-08T05:34:24.727 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update' not found on daemon mds.l 2024-05-08T05:34:24.727 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update_receipt' not found on daemon mds.l 2024-05-08T05:34:24.728 DEBUG:teuthology.run_tasks:Unwinding manager kclient 2024-05-08T05:34:24.739 INFO:tasks.kclient:Unmounting kernel clients... 2024-05-08T05:34:24.740 DEBUG:teuthology.orchestra.run.smithi087:> set -ex 2024-05-08T05:34:24.740 DEBUG:teuthology.orchestra.run.smithi087:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-08T05:34:24.788 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:34:24 smithi160 ceph-mon[34827]: pgmap v582: 97 pgs: 97 active+clean; 153 MiB data, 1004 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 7 op/s 2024-05-08T05:34:24.798 DEBUG:teuthology.orchestra.run.smithi087:> set -ex 2024-05-08T05:34:24.798 DEBUG:teuthology.orchestra.run.smithi087:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-08T05:34:24.845 DEBUG:teuthology.orchestra.run.smithi087:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid eeeb813e-0cf9-11ef-bc97-c7b262605968 -- ceph osd blocklist ls 2024-05-08T05:34:24.958 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:34:24 smithi087 ceph-mon[29523]: pgmap v582: 97 pgs: 97 active+clean; 153 MiB data, 1004 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 7 op/s 2024-05-08T05:34:24.983 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:34:24 smithi090 ceph-mon[34526]: pgmap v582: 97 pgs: 97 active+clean; 153 MiB data, 1004 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 7 op/s 2024-05-08T05:34:25.337 INFO:teuthology.orchestra.run.smithi087.stderr:Inferring config /var/lib/ceph/eeeb813e-0cf9-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T05:34:26.958 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:34:26 smithi087 ceph-mon[29523]: pgmap v583: 97 pgs: 97 active+clean; 153 MiB data, 1004 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2024-05-08T05:34:26.983 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:34:26 smithi090 ceph-mon[34526]: pgmap v583: 97 pgs: 97 active+clean; 153 MiB data, 1004 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2024-05-08T05:34:27.038 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:34:26 smithi160 ceph-mon[34827]: pgmap v583: 97 pgs: 97 active+clean; 153 MiB data, 1004 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2024-05-08T05:34:27.575 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:34:27.574+0000 7f4439c00700 1 -- 172.21.15.87:0/4167488785 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4434114670 msgr2=0x7f4434116a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:34:27.575 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:34:27.574+0000 7f4439c00700 1 --2- 172.21.15.87:0/4167488785 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4434114670 0x7f4434116a60 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f442c009990 tx=0x7f442c009ca0 comp rx=0 tx=0).stop 2024-05-08T05:34:27.575 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:34:27.574+0000 7f4439c00700 1 -- 172.21.15.87:0/4167488785 shutdown_connections 2024-05-08T05:34:27.576 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:34:27.574+0000 7f4439c00700 1 --2- 172.21.15.87:0/4167488785 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4434114670 0x7f4434116a60 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:34:27.576 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:34:27.574+0000 7f4439c00700 1 --2- 172.21.15.87:0/4167488785 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f44340756d0 0x7f4434075ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:34:27.576 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:34:27.574+0000 7f4439c00700 1 --2- 172.21.15.87:0/4167488785 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4434075ff0 0x7f4434114130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:34:27.576 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:34:27.574+0000 7f4439c00700 1 -- 172.21.15.87:0/4167488785 >> 172.21.15.87:0/4167488785 conn(0x7f443407a600 msgr2=0x7f443407aa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:34:27.576 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:34:27.575+0000 7f4439c00700 1 -- 172.21.15.87:0/4167488785 shutdown_connections 2024-05-08T05:34:27.576 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:34:27.575+0000 7f4439c00700 1 -- 172.21.15.87:0/4167488785 wait complete. 2024-05-08T05:34:27.577 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:34:27.576+0000 7f4439c00700 1 Processor -- start 2024-05-08T05:34:27.577 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:34:27.576+0000 7f4439c00700 1 -- start start 2024-05-08T05:34:27.577 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:34:27.576+0000 7f4439c00700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f44340756d0 0x7f44341a0170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:34:27.577 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:34:27.576+0000 7f4439c00700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4434075ff0 0x7f44341a06b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:34:27.577 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:34:27.576+0000 7f4439c00700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4434114670 0x7f44341a4a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:34:27.577 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:34:27.576+0000 7f4439c00700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f4434119c80 con 0x7f4434114670 2024-05-08T05:34:27.577 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:34:27.576+0000 7f4439c00700 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f4434119b00 con 0x7f4434075ff0 2024-05-08T05:34:27.577 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:34:27.576+0000 7f4439c00700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f4434119e00 con 0x7f44340756d0 2024-05-08T05:34:27.578 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:34:27.577+0000 7f442a000700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4434075ff0 0x7f44341a06b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:34:27.578 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:34:27.577+0000 7f4433400700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4434114670 0x7f44341a4a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:34:27.578 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:34:27.577+0000 7f442a000700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4434075ff0 0x7f44341a06b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.87:46114/0 (socket says 172.21.15.87:46114) 2024-05-08T05:34:27.578 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:34:27.577+0000 7f442a000700 1 -- 172.21.15.87:0/2242890782 learned_addr learned my addr 172.21.15.87:0/2242890782 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T05:34:27.578 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:34:27.577+0000 7f4432a00700 1 --2- 172.21.15.87:0/2242890782 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f44340756d0 0x7f44341a0170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:34:27.579 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:34:27.577+0000 7f442a000700 1 -- 172.21.15.87:0/2242890782 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f44340756d0 msgr2=0x7f44341a0170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:34:27.579 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:34:27.577+0000 7f442a000700 1 --2- 172.21.15.87:0/2242890782 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f44340756d0 0x7f44341a0170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:34:27.579 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:34:27.577+0000 7f442a000700 1 -- 172.21.15.87:0/2242890782 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4434114670 msgr2=0x7f44341a4a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:34:27.579 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:34:27.577+0000 7f442a000700 1 --2- 172.21.15.87:0/2242890782 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4434114670 0x7f44341a4a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:34:27.579 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:34:27.577+0000 7f442a000700 1 -- 172.21.15.87:0/2242890782 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f44341a5180 con 0x7f4434075ff0 2024-05-08T05:34:27.579 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:34:27.577+0000 7f442a000700 1 --2- 172.21.15.87:0/2242890782 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4434075ff0 0x7f44341a06b0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f441c00eb30 tx=0x7f441c00ee40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:34:27.580 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:34:27.578+0000 7f442be00700 1 -- 172.21.15.87:0/2242890782 <== mon.2 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f441c00cbd0 con 0x7f4434075ff0 2024-05-08T05:34:27.580 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:34:27.578+0000 7f442be00700 1 -- 172.21.15.87:0/2242890782 <== mon.2 v2:172.21.15.90:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f441c0044d0 con 0x7f4434075ff0 2024-05-08T05:34:27.580 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:34:27.578+0000 7f442be00700 1 -- 172.21.15.87:0/2242890782 <== mon.2 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f441c003e30 con 0x7f4434075ff0 2024-05-08T05:34:27.580 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:34:27.578+0000 7f4439c00700 1 -- 172.21.15.87:0/2242890782 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f44341a5470 con 0x7f4434075ff0 2024-05-08T05:34:27.580 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:34:27.578+0000 7f4439c00700 1 -- 172.21.15.87:0/2242890782 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f44341accf0 con 0x7f4434075ff0 2024-05-08T05:34:27.580 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:34:27.579+0000 7f4439c00700 1 -- 172.21.15.87:0/2242890782 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f443406a190 con 0x7f4434075ff0 2024-05-08T05:34:27.581 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:34:27.582+0000 7f442be00700 1 -- 172.21.15.87:0/2242890782 <== mon.2 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7f441c004000 con 0x7f4434075ff0 2024-05-08T05:34:27.583 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:34:27.583+0000 7f442be00700 1 --2- 172.21.15.87:0/2242890782 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f44180b2900 0x7f44180b4dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:34:27.583 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:34:27.583+0000 7f442be00700 1 -- 172.21.15.87:0/2242890782 <== mon.2 v2:172.21.15.90:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8190+0+0 (secure 0 0 0) 0x7f441c0e26a0 con 0x7f4434075ff0 2024-05-08T05:34:27.584 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:34:27.583+0000 7f4432a00700 1 --2- 172.21.15.87:0/2242890782 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f44180b2900 0x7f44180b4dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:34:27.584 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:34:27.584+0000 7f4432a00700 1 --2- 172.21.15.87:0/2242890782 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f44180b2900 0x7f44180b4dc0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f442400f540 tx=0x7f442400b040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:34:27.585 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:34:27.585+0000 7f442be00700 1 -- 172.21.15.87:0/2242890782 <== mon.2 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f441c054df0 con 0x7f4434075ff0 2024-05-08T05:34:27.834 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:34:27.834+0000 7f4439c00700 1 -- 172.21.15.87:0/2242890782 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f44341acef0 con 0x7f4434075ff0 2024-05-08T05:34:27.835 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:34:27.835+0000 7f442be00700 1 -- 172.21.15.87:0/2242890782 <== mon.2 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 10 entries v82) ==== 81+0+591 (secure 0 0 0) 0x7f441c0042f0 con 0x7f4434075ff0 2024-05-08T05:34:27.835 INFO:teuthology.orchestra.run.smithi087.stdout:172.21.15.87:0/4226160503 2024-05-09T05:17:22.736165+0000 2024-05-08T05:34:27.835 INFO:teuthology.orchestra.run.smithi087.stdout:172.21.15.87:0/2773684806 2024-05-09T05:17:22.736165+0000 2024-05-08T05:34:27.835 INFO:teuthology.orchestra.run.smithi087.stdout:172.21.15.87:0/349590592 2024-05-09T05:17:22.736165+0000 2024-05-08T05:34:27.835 INFO:teuthology.orchestra.run.smithi087.stdout:172.21.15.87:6801/2710124295 2024-05-09T05:17:22.736165+0000 2024-05-08T05:34:27.835 INFO:teuthology.orchestra.run.smithi087.stdout:172.21.15.87:6800/1823425617 2024-05-09T05:16:48.155337+0000 2024-05-08T05:34:27.835 INFO:teuthology.orchestra.run.smithi087.stdout:172.21.15.87:0/2393072013 2024-05-09T05:16:48.155337+0000 2024-05-08T05:34:27.836 INFO:teuthology.orchestra.run.smithi087.stdout:172.21.15.87:0/1291525416 2024-05-09T05:16:48.155337+0000 2024-05-08T05:34:27.836 INFO:teuthology.orchestra.run.smithi087.stdout:172.21.15.87:6801/1823425617 2024-05-09T05:16:48.155337+0000 2024-05-08T05:34:27.836 INFO:teuthology.orchestra.run.smithi087.stdout:172.21.15.87:0/3839463573 2024-05-09T05:16:48.155337+0000 2024-05-08T05:34:27.836 INFO:teuthology.orchestra.run.smithi087.stdout:172.21.15.87:6800/2710124295 2024-05-09T05:17:22.736165+0000 2024-05-08T05:34:27.838 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:34:27.838+0000 7f4439c00700 1 -- 172.21.15.87:0/2242890782 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f44180b2900 msgr2=0x7f44180b4dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:34:27.838 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:34:27.838+0000 7f4439c00700 1 --2- 172.21.15.87:0/2242890782 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f44180b2900 0x7f44180b4dc0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f442400f540 tx=0x7f442400b040 comp rx=0 tx=0).stop 2024-05-08T05:34:27.839 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:34:27.838+0000 7f4439c00700 1 -- 172.21.15.87:0/2242890782 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4434075ff0 msgr2=0x7f44341a06b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:34:27.839 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:34:27.838+0000 7f4439c00700 1 --2- 172.21.15.87:0/2242890782 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4434075ff0 0x7f44341a06b0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f441c00eb30 tx=0x7f441c00ee40 comp rx=0 tx=0).stop 2024-05-08T05:34:27.839 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:34:27.838+0000 7f4439c00700 1 -- 172.21.15.87:0/2242890782 shutdown_connections 2024-05-08T05:34:27.839 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:34:27.838+0000 7f4439c00700 1 --2- 172.21.15.87:0/2242890782 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4434114670 0x7f44341a4a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:34:27.839 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:34:27.838+0000 7f4439c00700 1 --2- 172.21.15.87:0/2242890782 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f44180b2900 0x7f44180b4dc0 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:34:27.839 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:34:27.838+0000 7f4439c00700 1 --2- 172.21.15.87:0/2242890782 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f44340756d0 0x7f44341a0170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:34:27.839 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:34:27.838+0000 7f4439c00700 1 --2- 172.21.15.87:0/2242890782 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4434075ff0 0x7f44341a06b0 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:34:27.839 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:34:27.838+0000 7f4439c00700 1 -- 172.21.15.87:0/2242890782 >> 172.21.15.87:0/2242890782 conn(0x7f443407a600 msgr2=0x7f4434110110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:34:27.839 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:34:27.838+0000 7f4439c00700 1 -- 172.21.15.87:0/2242890782 shutdown_connections 2024-05-08T05:34:27.839 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:34:27.838+0000 7f4439c00700 1 -- 172.21.15.87:0/2242890782 wait complete. 2024-05-08T05:34:27.840 INFO:teuthology.orchestra.run.smithi087.stderr:listed 10 entries 2024-05-08T05:34:28.674 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-05-08T05:34:28.674 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T05:34:28.674 DEBUG:teuthology.orchestra.run.smithi087:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-05-08T05:34:28.875 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:34:28 smithi087 ceph-mon[29523]: pgmap v584: 97 pgs: 97 active+clean; 153 MiB data, 1004 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-05-08T05:34:28.876 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:34:28 smithi087 ceph-mon[29523]: from='client.? 172.21.15.87:0/2242890782' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-05-08T05:34:28.877 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi087.front.sepia.ceph.com 2024-05-08T05:34:28.878 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T05:34:28.878 DEBUG:teuthology.orchestra.run.smithi087:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-05-08T05:34:28.971 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T05:34:28.972 DEBUG:teuthology.orchestra.run.smithi087:> ip netns list 2024-05-08T05:34:28.983 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:34:28 smithi090 ceph-mon[34526]: pgmap v584: 97 pgs: 97 active+clean; 153 MiB data, 1004 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-05-08T05:34:28.983 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:34:28 smithi090 ceph-mon[34526]: from='client.? 172.21.15.87:0/2242890782' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-05-08T05:34:29.009 INFO:teuthology.orchestra.run.smithi087.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-05-08T05:34:29.010 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T05:34:29.010 DEBUG:teuthology.orchestra.run.smithi087:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2024-05-08T05:34:29.038 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:34:28 smithi160 ceph-mon[34827]: pgmap v584: 97 pgs: 97 active+clean; 153 MiB data, 1004 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-05-08T05:34:29.039 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:34:28 smithi160 ceph-mon[34827]: from='client.? 172.21.15.87:0/2242890782' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-05-08T05:34:29.116 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T05:34:29.116 DEBUG:teuthology.orchestra.run.smithi087:> sudo ip link delete ceph-brx 2024-05-08T05:34:29.220 DEBUG:teuthology.run_tasks:Unwinding manager cephadm 2024-05-08T05:34:29.232 INFO:tasks.cephadm:Teardown begin 2024-05-08T05:34:29.233 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-05-08T05:34:29.233 DEBUG:teuthology.orchestra.run.smithi087:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid eeeb813e-0cf9-11ef-bc97-c7b262605968 -- ceph fs dump --format=json 2024-05-08T05:34:29.663 INFO:teuthology.orchestra.run.smithi087.stderr:Inferring config /var/lib/ceph/eeeb813e-0cf9-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T05:34:30.958 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:34:30 smithi087 ceph-mon[29523]: pgmap v585: 97 pgs: 97 active+clean; 153 MiB data, 1004 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 8 op/s 2024-05-08T05:34:30.983 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:34:30 smithi090 ceph-mon[34526]: pgmap v585: 97 pgs: 97 active+clean; 153 MiB data, 1004 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 8 op/s 2024-05-08T05:34:31.038 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:34:30 smithi160 ceph-mon[34827]: pgmap v585: 97 pgs: 97 active+clean; 153 MiB data, 1004 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 8 op/s 2024-05-08T05:34:31.805 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:34:31.804+0000 7fba52800700 1 -- 172.21.15.87:0/2404239150 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fba4c108850 msgr2=0x7fba4c1103d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:34:31.805 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:34:31.804+0000 7fba52800700 1 --2- 172.21.15.87:0/2404239150 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fba4c108850 0x7fba4c1103d0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fba4400b0d0 tx=0x7fba4400b3e0 comp rx=0 tx=0).stop 2024-05-08T05:34:31.806 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:34:31.804+0000 7fba52800700 1 -- 172.21.15.87:0/2404239150 shutdown_connections 2024-05-08T05:34:31.806 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:34:31.804+0000 7fba52800700 1 --2- 172.21.15.87:0/2404239150 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fba4c108850 0x7fba4c1103d0 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:34:31.806 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:34:31.804+0000 7fba52800700 1 --2- 172.21.15.87:0/2404239150 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fba4c103750 0x7fba4c103b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:34:31.806 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:34:31.804+0000 7fba52800700 1 --2- 172.21.15.87:0/2404239150 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fba4c104100 0x7fba4c108120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:34:31.806 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:34:31.804+0000 7fba52800700 1 -- 172.21.15.87:0/2404239150 >> 172.21.15.87:0/2404239150 conn(0x7fba4c07a600 msgr2=0x7fba4c07aa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:34:31.806 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:34:31.804+0000 7fba52800700 1 -- 172.21.15.87:0/2404239150 shutdown_connections 2024-05-08T05:34:31.806 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:34:31.805+0000 7fba52800700 1 -- 172.21.15.87:0/2404239150 wait complete. 2024-05-08T05:34:31.808 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:34:31.806+0000 7fba52800700 1 Processor -- start 2024-05-08T05:34:31.808 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:34:31.806+0000 7fba52800700 1 -- start start 2024-05-08T05:34:31.808 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:34:31.806+0000 7fba52800700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fba4c103750 0x7fba4c1a1a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:34:31.808 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:34:31.806+0000 7fba52800700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fba4c104100 0x7fba4c1a1f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:34:31.808 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:34:31.806+0000 7fba52800700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fba4c108850 0x7fba4c19bb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:34:31.808 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:34:31.806+0000 7fba52800700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fba4c113690 con 0x7fba4c103750 2024-05-08T05:34:31.808 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:34:31.806+0000 7fba52800700 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fba4c113510 con 0x7fba4c104100 2024-05-08T05:34:31.808 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:34:31.806+0000 7fba52800700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7fba4c113810 con 0x7fba4c108850 2024-05-08T05:34:31.808 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:34:31.807+0000 7fba4aa00700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fba4c104100 0x7fba4c1a1f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:34:31.808 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:34:31.807+0000 7fba4b400700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fba4c103750 0x7fba4c1a1a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:34:31.808 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:34:31.807+0000 7fba4aa00700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fba4c104100 0x7fba4c1a1f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.87:46130/0 (socket says 172.21.15.87:46130) 2024-05-08T05:34:31.809 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:34:31.807+0000 7fba4aa00700 1 -- 172.21.15.87:0/2701543627 learned_addr learned my addr 172.21.15.87:0/2701543627 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T05:34:31.809 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:34:31.807+0000 7fba4be00700 1 --2- 172.21.15.87:0/2701543627 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fba4c108850 0x7fba4c19bb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:34:31.809 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:34:31.807+0000 7fba4aa00700 1 -- 172.21.15.87:0/2701543627 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fba4c108850 msgr2=0x7fba4c19bb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:34:31.809 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:34:31.807+0000 7fba4aa00700 1 --2- 172.21.15.87:0/2701543627 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fba4c108850 0x7fba4c19bb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:34:31.809 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:34:31.807+0000 7fba4aa00700 1 -- 172.21.15.87:0/2701543627 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fba4c103750 msgr2=0x7fba4c1a1a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:34:31.809 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:34:31.807+0000 7fba4aa00700 1 --2- 172.21.15.87:0/2701543627 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fba4c103750 0x7fba4c1a1a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:34:31.809 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:34:31.807+0000 7fba4aa00700 1 -- 172.21.15.87:0/2701543627 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fba4c19c400 con 0x7fba4c104100 2024-05-08T05:34:31.809 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:34:31.807+0000 7fba4b400700 1 --2- 172.21.15.87:0/2701543627 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fba4c103750 0x7fba4c1a1a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T05:34:31.809 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:34:31.808+0000 7fba4aa00700 1 --2- 172.21.15.87:0/2701543627 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fba4c104100 0x7fba4c1a1f90 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fba3800e9c0 tx=0x7fba3800ecd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:34:31.810 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:34:31.808+0000 7fba43e00700 1 -- 172.21.15.87:0/2701543627 <== mon.2 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba3800cbd0 con 0x7fba4c104100 2024-05-08T05:34:31.810 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:34:31.808+0000 7fba43e00700 1 -- 172.21.15.87:0/2701543627 <== mon.2 v2:172.21.15.90:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fba3800ee60 con 0x7fba4c104100 2024-05-08T05:34:31.810 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:34:31.808+0000 7fba43e00700 1 -- 172.21.15.87:0/2701543627 <== mon.2 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba380055c0 con 0x7fba4c104100 2024-05-08T05:34:31.811 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:34:31.808+0000 7fba52800700 1 -- 172.21.15.87:0/2701543627 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fba4c19c6f0 con 0x7fba4c104100 2024-05-08T05:34:31.811 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:34:31.808+0000 7fba52800700 1 -- 172.21.15.87:0/2701543627 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fba4c1a89d0 con 0x7fba4c104100 2024-05-08T05:34:31.811 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:34:31.809+0000 7fba52800700 1 -- 172.21.15.87:0/2701543627 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fba4c104be0 con 0x7fba4c104100 2024-05-08T05:34:31.812 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:34:31.812+0000 7fba43e00700 1 -- 172.21.15.87:0/2701543627 <== mon.2 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7fba38004750 con 0x7fba4c104100 2024-05-08T05:34:31.813 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:34:31.813+0000 7fba43e00700 1 --2- 172.21.15.87:0/2701543627 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7fba300b2900 0x7fba300b4dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:34:31.814 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:34:31.814+0000 7fba43e00700 1 -- 172.21.15.87:0/2701543627 <== mon.2 v2:172.21.15.90:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8190+0+0 (secure 0 0 0) 0x7fba380e2440 con 0x7fba4c104100 2024-05-08T05:34:31.814 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:34:31.814+0000 7fba4b400700 1 --2- 172.21.15.87:0/2701543627 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7fba300b2900 0x7fba300b4dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:34:31.814 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:34:31.814+0000 7fba4b400700 1 --2- 172.21.15.87:0/2701543627 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7fba300b2900 0x7fba300b4dc0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fba3c011490 tx=0x7fba3c009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:34:31.818 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:34:31.818+0000 7fba43e00700 1 -- 172.21.15.87:0/2701543627 <== mon.2 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7fba380aa130 con 0x7fba4c104100 2024-05-08T05:34:32.100 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:34:32.099+0000 7fba52800700 1 -- 172.21.15.87:0/2701543627 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fba4c1a8ba0 con 0x7fba4c104100 2024-05-08T05:34:32.101 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:34:32.100+0000 7fba43e00700 1 -- 172.21.15.87:0/2701543627 <== mon.2 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 29 v29) ==== 94+0+11867 (secure 0 0 0) 0x7fba380a9a30 con 0x7fba4c104100 2024-05-08T05:34:32.101 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-05-08T05:34:32.102 INFO:teuthology.orchestra.run.smithi087.stdout:{"epoch":29,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14358,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6835/1183985321","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6834","nonce":1183985321},{"type":"v1","addr":"172.21.15.87:6835","nonce":1183985321}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14370,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6837/1485824316","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6836","nonce":1485824316},{"type":"v1","addr":"172.21.15.87:6837","nonce":1485824316}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14409,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6841/724277538","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6840","nonce":724277538},{"type":"v1","addr":"172.21.15.87:6841","nonce":724277538}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24412,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6833/3339455985","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6832","nonce":3339455985},{"type":"v1","addr":"172.21.15.160:6833","nonce":3339455985}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24413,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6833/3292166873","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6832","nonce":3292166873},{"type":"v1","addr":"172.21.15.90:6833","nonce":3292166873}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24443,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6835/824555459","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6834","nonce":824555459},{"type":"v1","addr":"172.21.15.90:6835","nonce":824555459}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6}],"filesystems":[{"mdsmap":{"epoch":29,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-05-08T05:25:36.816840+0000","modified":"2024-05-08T05:32:35.804539+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24500,"mds_1":24482,"mds_2":24481},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24463":{"gid":24463,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.160:6835/409648357","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6834","nonce":409648357},{"type":"v1","addr":"172.21.15.160:6835","nonce":409648357}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24467":{"gid":24467,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.90:6837/4221919418","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6836","nonce":4221919418},{"type":"v1","addr":"172.21.15.90:6837","nonce":4221919418}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24469":{"gid":24469,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.160:6837/4200018040","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6836","nonce":4200018040},{"type":"v1","addr":"172.21.15.160:6837","nonce":4200018040}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24481":{"gid":24481,"name":"i","rank":2,"incarnation":20,"state":"up:active","state_seq":13,"addr":"172.21.15.160:6839/234657686","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6838","nonce":234657686},{"type":"v1","addr":"172.21.15.160:6839","nonce":234657686}]},"join_fscid":-1,"export_targets":[0,1],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24482":{"gid":24482,"name":"g","rank":1,"incarnation":18,"state":"up:active","state_seq":12,"addr":"172.21.15.87:6839/2127215876","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6838","nonce":2127215876},{"type":"v1","addr":"172.21.15.87:6839","nonce":2127215876}]},"join_fscid":-1,"export_targets":[0,2],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24500":{"gid":24500,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.90:6839/160586017","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6838","nonce":160586017},{"type":"v1","addr":"172.21.15.90:6839","nonce":160586017}]},"join_fscid":-1,"export_targets":[1,2],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24500,"qdb_cluster":[24500,24481,24482]},"id":1}]} 2024-05-08T05:34:32.104 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:34:32.104+0000 7fba52800700 1 -- 172.21.15.87:0/2701543627 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7fba300b2900 msgr2=0x7fba300b4dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:34:32.105 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:34:32.104+0000 7fba52800700 1 --2- 172.21.15.87:0/2701543627 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7fba300b2900 0x7fba300b4dc0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fba3c011490 tx=0x7fba3c009260 comp rx=0 tx=0).stop 2024-05-08T05:34:32.105 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:34:32.104+0000 7fba52800700 1 -- 172.21.15.87:0/2701543627 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fba4c104100 msgr2=0x7fba4c1a1f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:34:32.105 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:34:32.104+0000 7fba52800700 1 --2- 172.21.15.87:0/2701543627 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fba4c104100 0x7fba4c1a1f90 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fba3800e9c0 tx=0x7fba3800ecd0 comp rx=0 tx=0).stop 2024-05-08T05:34:32.105 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:34:32.104+0000 7fba52800700 1 -- 172.21.15.87:0/2701543627 shutdown_connections 2024-05-08T05:34:32.105 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:34:32.104+0000 7fba52800700 1 --2- 172.21.15.87:0/2701543627 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7fba300b2900 0x7fba300b4dc0 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:34:32.105 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:34:32.104+0000 7fba52800700 1 --2- 172.21.15.87:0/2701543627 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fba4c108850 0x7fba4c19bb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:34:32.105 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:34:32.104+0000 7fba52800700 1 --2- 172.21.15.87:0/2701543627 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fba4c103750 0x7fba4c1a1a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:34:32.105 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:34:32.104+0000 7fba52800700 1 --2- 172.21.15.87:0/2701543627 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fba4c104100 0x7fba4c1a1f90 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:34:32.105 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:34:32.104+0000 7fba52800700 1 -- 172.21.15.87:0/2701543627 >> 172.21.15.87:0/2701543627 conn(0x7fba4c07a600 msgr2=0x7fba4c101810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:34:32.105 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:34:32.104+0000 7fba52800700 1 -- 172.21.15.87:0/2701543627 shutdown_connections 2024-05-08T05:34:32.105 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:34:32.104+0000 7fba52800700 1 -- 172.21.15.87:0/2701543627 wait complete. 2024-05-08T05:34:32.106 INFO:teuthology.orchestra.run.smithi087.stderr:dumped fsmap epoch 29 2024-05-08T05:34:32.882 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:34:32 smithi087 ceph-mon[29523]: pgmap v586: 97 pgs: 97 active+clean; 153 MiB data, 1004 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 170 B/s wr, 6 op/s 2024-05-08T05:34:32.882 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:34:32 smithi087 ceph-mon[29523]: from='client.? 172.21.15.87:0/2701543627' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T05:34:32.969 DEBUG:teuthology.orchestra.run.smithi087:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid eeeb813e-0cf9-11ef-bc97-c7b262605968 -- ceph fs dump --format=json 2024-05-08T05:34:32.983 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:34:32 smithi090 ceph-mon[34526]: pgmap v586: 97 pgs: 97 active+clean; 153 MiB data, 1004 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 170 B/s wr, 6 op/s 2024-05-08T05:34:32.983 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:34:32 smithi090 ceph-mon[34526]: from='client.? 172.21.15.87:0/2701543627' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T05:34:33.038 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:34:32 smithi160 ceph-mon[34827]: pgmap v586: 97 pgs: 97 active+clean; 153 MiB data, 1004 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 170 B/s wr, 6 op/s 2024-05-08T05:34:33.039 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:34:32 smithi160 ceph-mon[34827]: from='client.? 172.21.15.87:0/2701543627' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T05:34:33.412 INFO:teuthology.orchestra.run.smithi087.stderr:Inferring config /var/lib/ceph/eeeb813e-0cf9-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T05:34:34.958 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:34:34 smithi087 ceph-mon[29523]: pgmap v587: 97 pgs: 97 active+clean; 153 MiB data, 1012 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 426 B/s wr, 7 op/s 2024-05-08T05:34:34.983 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:34:34 smithi090 ceph-mon[34526]: pgmap v587: 97 pgs: 97 active+clean; 153 MiB data, 1012 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 426 B/s wr, 7 op/s 2024-05-08T05:34:35.039 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:34:34 smithi160 ceph-mon[34827]: pgmap v587: 97 pgs: 97 active+clean; 153 MiB data, 1012 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 426 B/s wr, 7 op/s 2024-05-08T05:34:35.595 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:34:35.594+0000 7f76d9c00700 1 -- 172.21.15.87:0/3653277840 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f76d4106080 msgr2=0x7f76d4112590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:34:35.595 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:34:35.594+0000 7f76d9c00700 1 --2- 172.21.15.87:0/3653277840 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f76d4106080 0x7f76d4112590 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f76cc00b0a0 tx=0x7f76cc00b3b0 comp rx=0 tx=0).stop 2024-05-08T05:34:35.595 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:34:35.594+0000 7f76d9c00700 1 -- 172.21.15.87:0/3653277840 shutdown_connections 2024-05-08T05:34:35.595 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:34:35.594+0000 7f76d9c00700 1 --2- 172.21.15.87:0/3653277840 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f76d4106080 0x7f76d4112590 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:34:35.595 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:34:35.594+0000 7f76d9c00700 1 --2- 172.21.15.87:0/3653277840 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f76d410b6c0 0x7f76d410baa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:34:35.596 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:34:35.594+0000 7f76d9c00700 1 --2- 172.21.15.87:0/3653277840 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f76d41056c0 0x7f76d4105b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:34:35.596 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:34:35.594+0000 7f76d9c00700 1 -- 172.21.15.87:0/3653277840 >> 172.21.15.87:0/3653277840 conn(0x7f76d41011b0 msgr2=0x7f76d41035d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:34:35.596 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:34:35.594+0000 7f76d9c00700 1 -- 172.21.15.87:0/3653277840 shutdown_connections 2024-05-08T05:34:35.596 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:34:35.594+0000 7f76d9c00700 1 -- 172.21.15.87:0/3653277840 wait complete. 2024-05-08T05:34:35.596 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:34:35.596+0000 7f76d9c00700 1 Processor -- start 2024-05-08T05:34:35.596 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:34:35.596+0000 7f76d9c00700 1 -- start start 2024-05-08T05:34:35.598 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:34:35.597+0000 7f76d9c00700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f76d41056c0 0x7f76d419bda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:34:35.598 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:34:35.597+0000 7f76d9c00700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f76d4106080 0x7f76d419c2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:34:35.598 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:34:35.597+0000 7f76d9c00700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f76d410b6c0 0x7f76d41a0620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:34:35.598 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:34:35.597+0000 7f76d9c00700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f76d4115910 con 0x7f76d4106080 2024-05-08T05:34:35.598 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:34:35.597+0000 7f76d9c00700 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f76d4115790 con 0x7f76d41056c0 2024-05-08T05:34:35.598 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:34:35.597+0000 7f76d9c00700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f76d4115a90 con 0x7f76d410b6c0 2024-05-08T05:34:35.598 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:34:35.597+0000 7f76d2000700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f76d4106080 0x7f76d419c2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:34:35.598 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:34:35.597+0000 7f76d2a00700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f76d41056c0 0x7f76d419bda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:34:35.598 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:34:35.597+0000 7f76d2a00700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f76d41056c0 0x7f76d419bda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.87:46152/0 (socket says 172.21.15.87:46152) 2024-05-08T05:34:35.598 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:34:35.597+0000 7f76d2000700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f76d4106080 0x7f76d419c2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:34330/0 (socket says 172.21.15.87:34330) 2024-05-08T05:34:35.598 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:34:35.597+0000 7f76d2a00700 1 -- 172.21.15.87:0/1699993072 learned_addr learned my addr 172.21.15.87:0/1699993072 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T05:34:35.598 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:34:35.597+0000 7f76d3400700 1 --2- 172.21.15.87:0/1699993072 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f76d410b6c0 0x7f76d41a0620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:34:35.599 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:34:35.598+0000 7f76d2a00700 1 -- 172.21.15.87:0/1699993072 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f76d410b6c0 msgr2=0x7f76d41a0620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:34:35.599 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:34:35.598+0000 7f76d2a00700 1 --2- 172.21.15.87:0/1699993072 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f76d410b6c0 0x7f76d41a0620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:34:35.599 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:34:35.598+0000 7f76d2a00700 1 -- 172.21.15.87:0/1699993072 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f76d4106080 msgr2=0x7f76d419c2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:34:35.599 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:34:35.598+0000 7f76d2a00700 1 --2- 172.21.15.87:0/1699993072 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f76d4106080 0x7f76d419c2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:34:35.599 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:34:35.598+0000 7f76d2a00700 1 -- 172.21.15.87:0/1699993072 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f76d41a0d60 con 0x7f76d41056c0 2024-05-08T05:34:35.600 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:34:35.598+0000 7f76d2a00700 1 --2- 172.21.15.87:0/1699993072 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f76d41056c0 0x7f76d419bda0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f76c400e9a0 tx=0x7f76c400ecb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:34:35.600 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:34:35.598+0000 7f76cb400700 1 -- 172.21.15.87:0/1699993072 <== mon.2 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76c400ca10 con 0x7f76d41056c0 2024-05-08T05:34:35.600 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:34:35.598+0000 7f76cb400700 1 -- 172.21.15.87:0/1699993072 <== mon.2 v2:172.21.15.90:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f76c400cbb0 con 0x7f76d41056c0 2024-05-08T05:34:35.600 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:34:35.598+0000 7f76d9c00700 1 -- 172.21.15.87:0/1699993072 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f76d41a1050 con 0x7f76d41056c0 2024-05-08T05:34:35.600 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:34:35.598+0000 7f76cb400700 1 -- 172.21.15.87:0/1699993072 <== mon.2 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76c4018680 con 0x7f76d41056c0 2024-05-08T05:34:35.600 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:34:35.598+0000 7f76d9c00700 1 -- 172.21.15.87:0/1699993072 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f76d41a88d0 con 0x7f76d41056c0 2024-05-08T05:34:35.600 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:34:35.599+0000 7f76d9c00700 1 -- 172.21.15.87:0/1699993072 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f76d406a190 con 0x7f76d41056c0 2024-05-08T05:34:35.602 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:34:35.602+0000 7f76cb400700 1 -- 172.21.15.87:0/1699993072 <== mon.2 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7f76c4010430 con 0x7f76d41056c0 2024-05-08T05:34:35.603 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:34:35.603+0000 7f76cb400700 1 --2- 172.21.15.87:0/1699993072 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f76b80b2880 0x7f76b80b4d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:34:35.604 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:34:35.603+0000 7f76cb400700 1 -- 172.21.15.87:0/1699993072 <== mon.2 v2:172.21.15.90:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8190+0+0 (secure 0 0 0) 0x7f76c40e2650 con 0x7f76d41056c0 2024-05-08T05:34:35.604 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:34:35.604+0000 7f76d2000700 1 --2- 172.21.15.87:0/1699993072 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f76b80b2880 0x7f76b80b4d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:34:35.604 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:34:35.604+0000 7f76d2000700 1 --2- 172.21.15.87:0/1699993072 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f76b80b2880 0x7f76b80b4d40 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f76d41037a0 tx=0x7f76c0009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:34:35.605 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:34:35.605+0000 7f76cb400700 1 -- 172.21.15.87:0/1699993072 <== mon.2 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f76c40aa340 con 0x7f76d41056c0 2024-05-08T05:34:35.887 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:34:35.886+0000 7f76d9c00700 1 -- 172.21.15.87:0/1699993072 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f76d402e510 con 0x7f76d41056c0 2024-05-08T05:34:35.888 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:34:35.888+0000 7f76cb400700 1 -- 172.21.15.87:0/1699993072 <== mon.2 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 29 v29) ==== 94+0+11867 (secure 0 0 0) 0x7f76c40b23c0 con 0x7f76d41056c0 2024-05-08T05:34:35.888 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-05-08T05:34:35.888 INFO:teuthology.orchestra.run.smithi087.stdout:{"epoch":29,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14358,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6835/1183985321","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6834","nonce":1183985321},{"type":"v1","addr":"172.21.15.87:6835","nonce":1183985321}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14370,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6837/1485824316","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6836","nonce":1485824316},{"type":"v1","addr":"172.21.15.87:6837","nonce":1485824316}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14409,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6841/724277538","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6840","nonce":724277538},{"type":"v1","addr":"172.21.15.87:6841","nonce":724277538}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24412,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6833/3339455985","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6832","nonce":3339455985},{"type":"v1","addr":"172.21.15.160:6833","nonce":3339455985}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24413,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6833/3292166873","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6832","nonce":3292166873},{"type":"v1","addr":"172.21.15.90:6833","nonce":3292166873}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24443,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6835/824555459","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6834","nonce":824555459},{"type":"v1","addr":"172.21.15.90:6835","nonce":824555459}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6}],"filesystems":[{"mdsmap":{"epoch":29,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-05-08T05:25:36.816840+0000","modified":"2024-05-08T05:32:35.804539+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24500,"mds_1":24482,"mds_2":24481},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24463":{"gid":24463,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.160:6835/409648357","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6834","nonce":409648357},{"type":"v1","addr":"172.21.15.160:6835","nonce":409648357}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24467":{"gid":24467,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.90:6837/4221919418","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6836","nonce":4221919418},{"type":"v1","addr":"172.21.15.90:6837","nonce":4221919418}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24469":{"gid":24469,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.160:6837/4200018040","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6836","nonce":4200018040},{"type":"v1","addr":"172.21.15.160:6837","nonce":4200018040}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24481":{"gid":24481,"name":"i","rank":2,"incarnation":20,"state":"up:active","state_seq":13,"addr":"172.21.15.160:6839/234657686","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6838","nonce":234657686},{"type":"v1","addr":"172.21.15.160:6839","nonce":234657686}]},"join_fscid":-1,"export_targets":[0,1],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24482":{"gid":24482,"name":"g","rank":1,"incarnation":18,"state":"up:active","state_seq":12,"addr":"172.21.15.87:6839/2127215876","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6838","nonce":2127215876},{"type":"v1","addr":"172.21.15.87:6839","nonce":2127215876}]},"join_fscid":-1,"export_targets":[0,2],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24500":{"gid":24500,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.90:6839/160586017","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6838","nonce":160586017},{"type":"v1","addr":"172.21.15.90:6839","nonce":160586017}]},"join_fscid":-1,"export_targets":[1,2],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24500,"qdb_cluster":[24500,24481,24482]},"id":1}]} 2024-05-08T05:34:35.892 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:34:35.891+0000 7f76d9c00700 1 -- 172.21.15.87:0/1699993072 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f76b80b2880 msgr2=0x7f76b80b4d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:34:35.892 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:34:35.891+0000 7f76d9c00700 1 --2- 172.21.15.87:0/1699993072 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f76b80b2880 0x7f76b80b4d40 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f76d41037a0 tx=0x7f76c0009260 comp rx=0 tx=0).stop 2024-05-08T05:34:35.892 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:34:35.891+0000 7f76d9c00700 1 -- 172.21.15.87:0/1699993072 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f76d41056c0 msgr2=0x7f76d419bda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:34:35.892 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:34:35.891+0000 7f76d9c00700 1 --2- 172.21.15.87:0/1699993072 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f76d41056c0 0x7f76d419bda0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f76c400e9a0 tx=0x7f76c400ecb0 comp rx=0 tx=0).stop 2024-05-08T05:34:35.892 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:34:35.891+0000 7f76d9c00700 1 -- 172.21.15.87:0/1699993072 shutdown_connections 2024-05-08T05:34:35.892 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:34:35.891+0000 7f76d9c00700 1 --2- 172.21.15.87:0/1699993072 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f76b80b2880 0x7f76b80b4d40 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:34:35.892 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:34:35.891+0000 7f76d9c00700 1 --2- 172.21.15.87:0/1699993072 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f76d410b6c0 0x7f76d41a0620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:34:35.892 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:34:35.891+0000 7f76d9c00700 1 --2- 172.21.15.87:0/1699993072 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f76d41056c0 0x7f76d419bda0 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:34:35.892 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:34:35.891+0000 7f76d9c00700 1 --2- 172.21.15.87:0/1699993072 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f76d4106080 0x7f76d419c2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:34:35.892 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:34:35.891+0000 7f76d9c00700 1 -- 172.21.15.87:0/1699993072 >> 172.21.15.87:0/1699993072 conn(0x7f76d41011b0 msgr2=0x7f76d4101820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:34:35.892 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:34:35.892+0000 7f76d9c00700 1 -- 172.21.15.87:0/1699993072 shutdown_connections 2024-05-08T05:34:35.892 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:34:35.892+0000 7f76d9c00700 1 -- 172.21.15.87:0/1699993072 wait complete. 2024-05-08T05:34:35.893 INFO:teuthology.orchestra.run.smithi087.stderr:dumped fsmap epoch 29 2024-05-08T05:34:36.764 DEBUG:teuthology.orchestra.run.smithi087:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid eeeb813e-0cf9-11ef-bc97-c7b262605968 -- ceph osd dump --format=json 2024-05-08T05:34:36.958 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:34:36 smithi087 ceph-mon[29523]: pgmap v588: 97 pgs: 97 active+clean; 153 MiB data, 1012 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 767 B/s wr, 8 op/s 2024-05-08T05:34:36.959 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:34:36 smithi087 ceph-mon[29523]: from='client.? 172.21.15.87:0/1699993072' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T05:34:36.986 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:34:36 smithi090 ceph-mon[34526]: pgmap v588: 97 pgs: 97 active+clean; 153 MiB data, 1012 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 767 B/s wr, 8 op/s 2024-05-08T05:34:36.986 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:34:36 smithi090 ceph-mon[34526]: from='client.? 172.21.15.87:0/1699993072' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T05:34:37.038 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:34:36 smithi160 ceph-mon[34827]: pgmap v588: 97 pgs: 97 active+clean; 153 MiB data, 1012 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 767 B/s wr, 8 op/s 2024-05-08T05:34:37.038 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:34:36 smithi160 ceph-mon[34827]: from='client.? 172.21.15.87:0/1699993072' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T05:34:37.224 INFO:teuthology.orchestra.run.smithi087.stderr:Inferring config /var/lib/ceph/eeeb813e-0cf9-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T05:34:38.437 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:34:38 smithi087 ceph-mon[29523]: pgmap v589: 97 pgs: 97 active+clean; 153 MiB data, 1012 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 767 B/s wr, 6 op/s 2024-05-08T05:34:38.483 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:34:38 smithi090 ceph-mon[34526]: pgmap v589: 97 pgs: 97 active+clean; 153 MiB data, 1012 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 767 B/s wr, 6 op/s 2024-05-08T05:34:38.539 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:34:38 smithi160 ceph-mon[34827]: pgmap v589: 97 pgs: 97 active+clean; 153 MiB data, 1012 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 767 B/s wr, 6 op/s 2024-05-08T05:34:39.729 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:34:39.727+0000 7f0ea8200700 1 -- 172.21.15.87:0/866055518 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0ea0106080 msgr2=0x7f0ea0112590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:34:39.729 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:34:39.727+0000 7f0ea8200700 1 --2- 172.21.15.87:0/866055518 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0ea0106080 0x7f0ea0112590 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f0e9800b0a0 tx=0x7f0e9800b3b0 comp rx=0 tx=0).stop 2024-05-08T05:34:39.729 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:34:39.727+0000 7f0ea8200700 1 -- 172.21.15.87:0/866055518 shutdown_connections 2024-05-08T05:34:39.729 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:34:39.727+0000 7f0ea8200700 1 --2- 172.21.15.87:0/866055518 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0ea0106080 0x7f0ea0112590 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:34:39.729 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:34:39.727+0000 7f0ea8200700 1 --2- 172.21.15.87:0/866055518 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0ea010b6c0 0x7f0ea010baa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:34:39.729 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:34:39.727+0000 7f0ea8200700 1 --2- 172.21.15.87:0/866055518 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0ea01056c0 0x7f0ea0105b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:34:39.729 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:34:39.727+0000 7f0ea8200700 1 -- 172.21.15.87:0/866055518 >> 172.21.15.87:0/866055518 conn(0x7f0ea01011b0 msgr2=0x7f0ea01035d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:34:39.729 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:34:39.728+0000 7f0ea8200700 1 -- 172.21.15.87:0/866055518 shutdown_connections 2024-05-08T05:34:39.729 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:34:39.728+0000 7f0ea8200700 1 -- 172.21.15.87:0/866055518 wait complete. 2024-05-08T05:34:39.729 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:34:39.729+0000 7f0ea8200700 1 Processor -- start 2024-05-08T05:34:39.731 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:34:39.729+0000 7f0ea8200700 1 -- start start 2024-05-08T05:34:39.731 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:34:39.729+0000 7f0ea8200700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0ea01056c0 0x7f0ea019bd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:34:39.731 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:34:39.729+0000 7f0ea8200700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0ea0106080 0x7f0ea019c250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:34:39.731 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:34:39.729+0000 7f0ea8200700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0ea010b6c0 0x7f0ea01a05e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:34:39.731 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:34:39.729+0000 7f0ea8200700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f0ea01158c0 con 0x7f0ea0106080 2024-05-08T05:34:39.732 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:34:39.729+0000 7f0ea8200700 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f0ea0115740 con 0x7f0ea01056c0 2024-05-08T05:34:39.732 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:34:39.729+0000 7f0ea8200700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f0ea0115a40 con 0x7f0ea010b6c0 2024-05-08T05:34:39.732 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:34:39.730+0000 7f0ea4e00700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0ea0106080 0x7f0ea019c250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:34:39.732 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:34:39.730+0000 7f0ea5800700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0ea01056c0 0x7f0ea019bd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:34:39.732 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:34:39.730+0000 7f0ea4e00700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0ea0106080 0x7f0ea019c250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:39548/0 (socket says 172.21.15.87:39548) 2024-05-08T05:34:39.732 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:34:39.730+0000 7f0ea4e00700 1 -- 172.21.15.87:0/297860050 learned_addr learned my addr 172.21.15.87:0/297860050 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T05:34:39.732 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:34:39.730+0000 7f0ea6200700 1 --2- 172.21.15.87:0/297860050 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0ea010b6c0 0x7f0ea01a05e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:34:39.732 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:34:39.730+0000 7f0ea6200700 1 -- 172.21.15.87:0/297860050 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0ea01056c0 msgr2=0x7f0ea019bd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:34:39.732 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:34:39.730+0000 7f0ea6200700 1 --2- 172.21.15.87:0/297860050 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0ea01056c0 0x7f0ea019bd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:34:39.732 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:34:39.730+0000 7f0ea6200700 1 -- 172.21.15.87:0/297860050 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0ea0106080 msgr2=0x7f0ea019c250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:34:39.732 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:34:39.730+0000 7f0ea6200700 1 --2- 172.21.15.87:0/297860050 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0ea0106080 0x7f0ea019c250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:34:39.732 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:34:39.730+0000 7f0ea6200700 1 -- 172.21.15.87:0/297860050 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0ea01a0d20 con 0x7f0ea010b6c0 2024-05-08T05:34:39.732 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:34:39.730+0000 7f0ea6200700 1 --2- 172.21.15.87:0/297860050 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0ea010b6c0 0x7f0ea01a05e0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f0e9800b070 tx=0x7f0e98004d00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:34:39.732 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:34:39.731+0000 7f0e9e000700 1 -- 172.21.15.87:0/297860050 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e98021070 con 0x7f0ea010b6c0 2024-05-08T05:34:39.733 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:34:39.731+0000 7f0e9e000700 1 -- 172.21.15.87:0/297860050 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0e98007e30 con 0x7f0ea010b6c0 2024-05-08T05:34:39.733 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:34:39.731+0000 7f0e9e000700 1 -- 172.21.15.87:0/297860050 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e980045d0 con 0x7f0ea010b6c0 2024-05-08T05:34:39.733 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:34:39.731+0000 7f0ea8200700 1 -- 172.21.15.87:0/297860050 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0ea01a0fb0 con 0x7f0ea010b6c0 2024-05-08T05:34:39.733 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:34:39.731+0000 7f0ea8200700 1 -- 172.21.15.87:0/297860050 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0ea01a8890 con 0x7f0ea010b6c0 2024-05-08T05:34:39.733 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:34:39.732+0000 7f0ea8200700 1 -- 172.21.15.87:0/297860050 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0ea0106e00 con 0x7f0ea010b6c0 2024-05-08T05:34:39.735 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:34:39.735+0000 7f0e9e000700 1 -- 172.21.15.87:0/297860050 <== mon.1 v2:172.21.15.160:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7f0e98003c00 con 0x7f0ea010b6c0 2024-05-08T05:34:39.736 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:34:39.736+0000 7f0e9e000700 1 --2- 172.21.15.87:0/297860050 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f0e880b2900 0x7f0e880b4dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:34:39.736 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:34:39.736+0000 7f0e9e000700 1 -- 172.21.15.87:0/297860050 <== mon.1 v2:172.21.15.160:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8190+0+0 (secure 0 0 0) 0x7f0e980e2f00 con 0x7f0ea010b6c0 2024-05-08T05:34:39.736 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:34:39.736+0000 7f0ea5800700 1 --2- 172.21.15.87:0/297860050 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f0e880b2900 0x7f0e880b4dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:34:39.737 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:34:39.737+0000 7f0ea5800700 1 --2- 172.21.15.87:0/297860050 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f0e880b2900 0x7f0e880b4dc0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f0e94009be0 tx=0x7f0e94009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:34:39.738 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:34:39.738+0000 7f0e9e000700 1 -- 172.21.15.87:0/297860050 <== mon.1 v2:172.21.15.160:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f0e980aac80 con 0x7f0ea010b6c0 2024-05-08T05:34:39.977 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:34:39.977+0000 7f0ea8200700 1 -- 172.21.15.87:0/297860050 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f0ea002e510 con 0x7f0ea010b6c0 2024-05-08T05:34:39.979 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:34:39.979+0000 7f0e9e000700 1 -- 172.21.15.87:0/297860050 <== mon.1 v2:172.21.15.160:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v82) ==== 74+0+22588 (secure 0 0 0) 0x7f0e980aa580 con 0x7f0ea010b6c0 2024-05-08T05:34:39.980 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-05-08T05:34:39.980 INFO:teuthology.orchestra.run.smithi087.stdout:{"epoch":82,"fsid":"eeeb813e-0cf9-11ef-bc97-c7b262605968","created":"2024-05-08T05:16:14.984330+0000","modified":"2024-05-08T05:26:24.106467+0000","last_up_change":"2024-05-08T05:24:22.324501+0000","last_in_change":"2024-05-08T05:24:01.962570+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-08T05:20:08.907941+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-08T05:25:28.054494+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-08T05:25:32.484126+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"f3e25ce0-0762-46fd-83fb-6766a2e9db69","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6802","nonce":2285285644},{"type":"v1","addr":"172.21.15.87:6803","nonce":2285285644}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6804","nonce":2285285644},{"type":"v1","addr":"172.21.15.87:6805","nonce":2285285644}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6808","nonce":2285285644},{"type":"v1","addr":"172.21.15.87:6809","nonce":2285285644}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6806","nonce":2285285644},{"type":"v1","addr":"172.21.15.87:6807","nonce":2285285644}]},"public_addr":"172.21.15.87:6803/2285285644","cluster_addr":"172.21.15.87:6805/2285285644","heartbeat_back_addr":"172.21.15.87:6809/2285285644","heartbeat_front_addr":"172.21.15.87:6807/2285285644","state":["exists","up"]},{"osd":1,"uuid":"b6de5f4c-1d79-41ff-adee-03d8a47ab55e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6800","nonce":1681573998},{"type":"v1","addr":"172.21.15.90:6801","nonce":1681573998}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6802","nonce":1681573998},{"type":"v1","addr":"172.21.15.90:6803","nonce":1681573998}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6806","nonce":1681573998},{"type":"v1","addr":"172.21.15.90:6807","nonce":1681573998}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6804","nonce":1681573998},{"type":"v1","addr":"172.21.15.90:6805","nonce":1681573998}]},"public_addr":"172.21.15.90:6801/1681573998","cluster_addr":"172.21.15.90:6803/1681573998","heartbeat_back_addr":"172.21.15.90:6807/1681573998","heartbeat_front_addr":"172.21.15.90:6805/1681573998","state":["exists","up"]},{"osd":2,"uuid":"ee3a2729-93b2-4985-b84d-165f92cae8e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6800","nonce":2137179096},{"type":"v1","addr":"172.21.15.160:6801","nonce":2137179096}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6802","nonce":2137179096},{"type":"v1","addr":"172.21.15.160:6803","nonce":2137179096}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6806","nonce":2137179096},{"type":"v1","addr":"172.21.15.160:6807","nonce":2137179096}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6804","nonce":2137179096},{"type":"v1","addr":"172.21.15.160:6805","nonce":2137179096}]},"public_addr":"172.21.15.160:6801/2137179096","cluster_addr":"172.21.15.160:6803/2137179096","heartbeat_back_addr":"172.21.15.160:6807/2137179096","heartbeat_front_addr":"172.21.15.160:6805/2137179096","state":["exists","up"]},{"osd":3,"uuid":"fc7bd69f-5a62-4ec6-b95c-c170be46a7d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6810","nonce":2022667023},{"type":"v1","addr":"172.21.15.87:6811","nonce":2022667023}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6812","nonce":2022667023},{"type":"v1","addr":"172.21.15.87:6813","nonce":2022667023}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6816","nonce":2022667023},{"type":"v1","addr":"172.21.15.87:6817","nonce":2022667023}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6814","nonce":2022667023},{"type":"v1","addr":"172.21.15.87:6815","nonce":2022667023}]},"public_addr":"172.21.15.87:6811/2022667023","cluster_addr":"172.21.15.87:6813/2022667023","heartbeat_back_addr":"172.21.15.87:6817/2022667023","heartbeat_front_addr":"172.21.15.87:6815/2022667023","state":["exists","up"]},{"osd":4,"uuid":"a05f7bd1-962a-4f3e-8f70-e7ef4c68bac2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6808","nonce":1371607578},{"type":"v1","addr":"172.21.15.90:6809","nonce":1371607578}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6810","nonce":1371607578},{"type":"v1","addr":"172.21.15.90:6811","nonce":1371607578}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6814","nonce":1371607578},{"type":"v1","addr":"172.21.15.90:6815","nonce":1371607578}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6812","nonce":1371607578},{"type":"v1","addr":"172.21.15.90:6813","nonce":1371607578}]},"public_addr":"172.21.15.90:6809/1371607578","cluster_addr":"172.21.15.90:6811/1371607578","heartbeat_back_addr":"172.21.15.90:6815/1371607578","heartbeat_front_addr":"172.21.15.90:6813/1371607578","state":["exists","up"]},{"osd":5,"uuid":"85e3af08-32ee-4f26-97df-8d54ba928715","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6808","nonce":2190054276},{"type":"v1","addr":"172.21.15.160:6809","nonce":2190054276}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6810","nonce":2190054276},{"type":"v1","addr":"172.21.15.160:6811","nonce":2190054276}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6814","nonce":2190054276},{"type":"v1","addr":"172.21.15.160:6815","nonce":2190054276}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6812","nonce":2190054276},{"type":"v1","addr":"172.21.15.160:6813","nonce":2190054276}]},"public_addr":"172.21.15.160:6809/2190054276","cluster_addr":"172.21.15.160:6811/2190054276","heartbeat_back_addr":"172.21.15.160:6815/2190054276","heartbeat_front_addr":"172.21.15.160:6813/2190054276","state":["exists","up"]},{"osd":6,"uuid":"df4b22a9-6cd8-473e-a17b-a0cb9ad32e98","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":42,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6818","nonce":2863681447},{"type":"v1","addr":"172.21.15.87:6819","nonce":2863681447}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6820","nonce":2863681447},{"type":"v1","addr":"172.21.15.87:6821","nonce":2863681447}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6824","nonce":2863681447},{"type":"v1","addr":"172.21.15.87:6825","nonce":2863681447}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6822","nonce":2863681447},{"type":"v1","addr":"172.21.15.87:6823","nonce":2863681447}]},"public_addr":"172.21.15.87:6819/2863681447","cluster_addr":"172.21.15.87:6821/2863681447","heartbeat_back_addr":"172.21.15.87:6825/2863681447","heartbeat_front_addr":"172.21.15.87:6823/2863681447","state":["exists","up"]},{"osd":7,"uuid":"f6ef3857-0366-4408-932a-a8c8479ba780","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6816","nonce":1964248958},{"type":"v1","addr":"172.21.15.90:6817","nonce":1964248958}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6818","nonce":1964248958},{"type":"v1","addr":"172.21.15.90:6819","nonce":1964248958}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6822","nonce":1964248958},{"type":"v1","addr":"172.21.15.90:6823","nonce":1964248958}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6820","nonce":1964248958},{"type":"v1","addr":"172.21.15.90:6821","nonce":1964248958}]},"public_addr":"172.21.15.90:6817/1964248958","cluster_addr":"172.21.15.90:6819/1964248958","heartbeat_back_addr":"172.21.15.90:6823/1964248958","heartbeat_front_addr":"172.21.15.90:6821/1964248958","state":["exists","up"]},{"osd":8,"uuid":"027dede9-d0be-4fbe-b7b8-02ce88d57f4d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":54,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6816","nonce":927680738},{"type":"v1","addr":"172.21.15.160:6817","nonce":927680738}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6818","nonce":927680738},{"type":"v1","addr":"172.21.15.160:6819","nonce":927680738}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6822","nonce":927680738},{"type":"v1","addr":"172.21.15.160:6823","nonce":927680738}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6820","nonce":927680738},{"type":"v1","addr":"172.21.15.160:6821","nonce":927680738}]},"public_addr":"172.21.15.160:6817/927680738","cluster_addr":"172.21.15.160:6819/927680738","heartbeat_back_addr":"172.21.15.160:6823/927680738","heartbeat_front_addr":"172.21.15.160:6821/927680738","state":["exists","up"]},{"osd":9,"uuid":"bc9e37de-e509-4db6-bd58-b68e2c8e1aff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6826","nonce":3789116749},{"type":"v1","addr":"172.21.15.87:6827","nonce":3789116749}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6828","nonce":3789116749},{"type":"v1","addr":"172.21.15.87:6829","nonce":3789116749}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6832","nonce":3789116749},{"type":"v1","addr":"172.21.15.87:6833","nonce":3789116749}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6830","nonce":3789116749},{"type":"v1","addr":"172.21.15.87:6831","nonce":3789116749}]},"public_addr":"172.21.15.87:6827/3789116749","cluster_addr":"172.21.15.87:6829/3789116749","heartbeat_back_addr":"172.21.15.87:6833/3789116749","heartbeat_front_addr":"172.21.15.87:6831/3789116749","state":["exists","up"]},{"osd":10,"uuid":"43945081-b4c8-4f5d-9301-3540709e69e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":66,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6824","nonce":716529498},{"type":"v1","addr":"172.21.15.90:6825","nonce":716529498}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6826","nonce":716529498},{"type":"v1","addr":"172.21.15.90:6827","nonce":716529498}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6830","nonce":716529498},{"type":"v1","addr":"172.21.15.90:6831","nonce":716529498}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6828","nonce":716529498},{"type":"v1","addr":"172.21.15.90:6829","nonce":716529498}]},"public_addr":"172.21.15.90:6825/716529498","cluster_addr":"172.21.15.90:6827/716529498","heartbeat_back_addr":"172.21.15.90:6831/716529498","heartbeat_front_addr":"172.21.15.90:6829/716529498","state":["exists","up"]},{"osd":11,"uuid":"da23ff5c-3f79-44e3-bca3-d9d5a003c999","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6824","nonce":1842739135},{"type":"v1","addr":"172.21.15.160:6825","nonce":1842739135}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6826","nonce":1842739135},{"type":"v1","addr":"172.21.15.160:6827","nonce":1842739135}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6830","nonce":1842739135},{"type":"v1","addr":"172.21.15.160:6831","nonce":1842739135}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6828","nonce":1842739135},{"type":"v1","addr":"172.21.15.160:6829","nonce":1842739135}]},"public_addr":"172.21.15.160:6825/1842739135","cluster_addr":"172.21.15.160:6827/1842739135","heartbeat_back_addr":"172.21.15.160:6831/1842739135","heartbeat_front_addr":"172.21.15.160:6829/1842739135","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T05:19:15.869398+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T05:19:42.014078+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T05:20:06.430660+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T05:20:38.555519+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T05:21:04.530605+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T05:21:29.545252+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T05:22:03.141982+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T05:22:29.191127+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T05:22:54.502994+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T05:23:27.899000+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T05:23:54.693979+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T05:24:20.307119+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.a","mappings":[{"from":2,"to":11}]},{"pgid":"2.1d","mappings":[{"from":2,"to":4},{"from":8,"to":11}]},{"pgid":"3.0","mappings":[{"from":4,"to":8}]},{"pgid":"3.1","mappings":[{"from":4,"to":9}]},{"pgid":"3.12","mappings":[{"from":3,"to":9}]},{"pgid":"3.28","mappings":[{"from":5,"to":6}]},{"pgid":"3.2c","mappings":[{"from":4,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.87:0/4226160503":"2024-05-09T05:17:22.736165+0000","172.21.15.87:0/2773684806":"2024-05-09T05:17:22.736165+0000","172.21.15.87:0/349590592":"2024-05-09T05:17:22.736165+0000","172.21.15.87:6801/2710124295":"2024-05-09T05:17:22.736165+0000","172.21.15.87:6800/1823425617":"2024-05-09T05:16:48.155337+0000","172.21.15.87:0/2393072013":"2024-05-09T05:16:48.155337+0000","172.21.15.87:0/1291525416":"2024-05-09T05:16:48.155337+0000","172.21.15.87:6801/1823425617":"2024-05-09T05:16:48.155337+0000","172.21.15.87:0/3839463573":"2024-05-09T05:16:48.155337+0000","172.21.15.87:6800/2710124295":"2024-05-09T05:17:22.736165+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-08T05:34:39.983 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:34:39.982+0000 7f0ea8200700 1 -- 172.21.15.87:0/297860050 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f0e880b2900 msgr2=0x7f0e880b4dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:34:39.983 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:34:39.982+0000 7f0ea8200700 1 --2- 172.21.15.87:0/297860050 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f0e880b2900 0x7f0e880b4dc0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f0e94009be0 tx=0x7f0e94009260 comp rx=0 tx=0).stop 2024-05-08T05:34:39.983 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:34:39.982+0000 7f0ea8200700 1 -- 172.21.15.87:0/297860050 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0ea010b6c0 msgr2=0x7f0ea01a05e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:34:39.983 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:34:39.982+0000 7f0ea8200700 1 --2- 172.21.15.87:0/297860050 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0ea010b6c0 0x7f0ea01a05e0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f0e9800b070 tx=0x7f0e98004d00 comp rx=0 tx=0).stop 2024-05-08T05:34:39.983 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:34:39.982+0000 7f0ea8200700 1 -- 172.21.15.87:0/297860050 shutdown_connections 2024-05-08T05:34:39.983 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:34:39.982+0000 7f0ea8200700 1 --2- 172.21.15.87:0/297860050 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f0e880b2900 0x7f0e880b4dc0 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:34:39.983 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:34:39.982+0000 7f0ea8200700 1 --2- 172.21.15.87:0/297860050 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0ea010b6c0 0x7f0ea01a05e0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:34:39.983 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:34:39.982+0000 7f0ea8200700 1 --2- 172.21.15.87:0/297860050 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0ea01056c0 0x7f0ea019bd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:34:39.983 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:34:39.982+0000 7f0ea8200700 1 --2- 172.21.15.87:0/297860050 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0ea0106080 0x7f0ea019c250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:34:39.983 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:34:39.982+0000 7f0ea8200700 1 -- 172.21.15.87:0/297860050 >> 172.21.15.87:0/297860050 conn(0x7f0ea01011b0 msgr2=0x7f0ea0101820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:34:39.984 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:34:39.982+0000 7f0ea8200700 1 -- 172.21.15.87:0/297860050 shutdown_connections 2024-05-08T05:34:39.984 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:34:39.983+0000 7f0ea8200700 1 -- 172.21.15.87:0/297860050 wait complete. 2024-05-08T05:34:40.295 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:34:40 smithi087 ceph-mon[29523]: pgmap v590: 97 pgs: 97 active+clean; 153 MiB data, 1012 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 767 B/s wr, 9 op/s 2024-05-08T05:34:40.295 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:34:40 smithi087 ceph-mon[29523]: from='client.? 172.21.15.87:0/297860050' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-08T05:34:40.483 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:34:40 smithi090 ceph-mon[34526]: pgmap v590: 97 pgs: 97 active+clean; 153 MiB data, 1012 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 767 B/s wr, 9 op/s 2024-05-08T05:34:40.483 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:34:40 smithi090 ceph-mon[34526]: from='client.? 172.21.15.87:0/297860050' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-08T05:34:40.538 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:34:40 smithi160 ceph-mon[34827]: pgmap v590: 97 pgs: 97 active+clean; 153 MiB data, 1012 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 767 B/s wr, 9 op/s 2024-05-08T05:34:40.539 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:34:40 smithi160 ceph-mon[34827]: from='client.? 172.21.15.87:0/297860050' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-08T05:34:40.700 DEBUG:teuthology.orchestra.run.smithi087:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid eeeb813e-0cf9-11ef-bc97-c7b262605968 -- ceph fs fail cephfs 2024-05-08T05:34:41.147 INFO:teuthology.orchestra.run.smithi087.stderr:Inferring config /var/lib/ceph/eeeb813e-0cf9-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T05:34:42.421 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:34:42 smithi087 ceph-mon[29523]: pgmap v591: 97 pgs: 97 active+clean; 153 MiB data, 1012 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 767 B/s wr, 6 op/s 2024-05-08T05:34:42.483 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:34:42 smithi090 ceph-mon[34526]: pgmap v591: 97 pgs: 97 active+clean; 153 MiB data, 1012 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 767 B/s wr, 6 op/s 2024-05-08T05:34:42.538 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:34:42 smithi160 ceph-mon[34827]: pgmap v591: 97 pgs: 97 active+clean; 153 MiB data, 1012 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 767 B/s wr, 6 op/s 2024-05-08T05:34:43.216 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:34:43.215+0000 7fc126600700 1 -- 172.21.15.87:0/2362275902 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc1201056c0 msgr2=0x7fc120105b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:34:43.216 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:34:43.215+0000 7fc126600700 1 --2- 172.21.15.87:0/2362275902 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc1201056c0 0x7fc120105b40 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fc10c009990 tx=0x7fc10c009ca0 comp rx=0 tx=0).stop 2024-05-08T05:34:43.216 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:34:43.215+0000 7fc126600700 1 -- 172.21.15.87:0/2362275902 shutdown_connections 2024-05-08T05:34:43.216 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:34:43.215+0000 7fc126600700 1 --2- 172.21.15.87:0/2362275902 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc120106080 0x7fc120112590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:34:43.216 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:34:43.215+0000 7fc126600700 1 --2- 172.21.15.87:0/2362275902 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc12010b6c0 0x7fc12010baa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:34:43.217 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:34:43.215+0000 7fc126600700 1 --2- 172.21.15.87:0/2362275902 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc1201056c0 0x7fc120105b40 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:34:43.217 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:34:43.215+0000 7fc126600700 1 -- 172.21.15.87:0/2362275902 >> 172.21.15.87:0/2362275902 conn(0x7fc1201011b0 msgr2=0x7fc1201035d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:34:43.217 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:34:43.215+0000 7fc126600700 1 -- 172.21.15.87:0/2362275902 shutdown_connections 2024-05-08T05:34:43.217 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:34:43.215+0000 7fc126600700 1 -- 172.21.15.87:0/2362275902 wait complete. 2024-05-08T05:34:43.220 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:34:43.216+0000 7fc126600700 1 Processor -- start 2024-05-08T05:34:43.221 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:34:43.216+0000 7fc126600700 1 -- start start 2024-05-08T05:34:43.221 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:34:43.216+0000 7fc126600700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc1201056c0 0x7fc12019bd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:34:43.221 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:34:43.216+0000 7fc126600700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc120106080 0x7fc12019c2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:34:43.221 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:34:43.216+0000 7fc126600700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc12010b6c0 0x7fc1201a05f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:34:43.221 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:34:43.216+0000 7fc126600700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fc1201158a0 con 0x7fc120106080 2024-05-08T05:34:43.222 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:34:43.216+0000 7fc126600700 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fc120115720 con 0x7fc1201056c0 2024-05-08T05:34:43.222 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:34:43.216+0000 7fc126600700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7fc120115a20 con 0x7fc12010b6c0 2024-05-08T05:34:43.222 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:34:43.217+0000 7fc11ea00700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc120106080 0x7fc12019c2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:34:43.222 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:34:43.217+0000 7fc11f400700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc1201056c0 0x7fc12019bd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:34:43.222 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:34:43.217+0000 7fc11ea00700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc120106080 0x7fc12019c2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:39570/0 (socket says 172.21.15.87:39570) 2024-05-08T05:34:43.222 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:34:43.217+0000 7fc11ea00700 1 -- 172.21.15.87:0/3315058516 learned_addr learned my addr 172.21.15.87:0/3315058516 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T05:34:43.223 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:34:43.217+0000 7fc11f400700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc1201056c0 0x7fc12019bd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.87:38174/0 (socket says 172.21.15.87:38174) 2024-05-08T05:34:43.223 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:34:43.217+0000 7fc11fe00700 1 --2- 172.21.15.87:0/3315058516 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc12010b6c0 0x7fc1201a05f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:34:43.223 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:34:43.217+0000 7fc11f400700 1 -- 172.21.15.87:0/3315058516 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc12010b6c0 msgr2=0x7fc1201a05f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:34:43.223 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:34:43.217+0000 7fc11f400700 1 --2- 172.21.15.87:0/3315058516 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc12010b6c0 0x7fc1201a05f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:34:43.223 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:34:43.217+0000 7fc11f400700 1 -- 172.21.15.87:0/3315058516 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc120106080 msgr2=0x7fc12019c2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:34:43.223 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:34:43.217+0000 7fc11f400700 1 --2- 172.21.15.87:0/3315058516 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc120106080 0x7fc12019c2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:34:43.224 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:34:43.217+0000 7fc11f400700 1 -- 172.21.15.87:0/3315058516 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc1201a0d30 con 0x7fc1201056c0 2024-05-08T05:34:43.224 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:34:43.217+0000 7fc11ea00700 1 --2- 172.21.15.87:0/3315058516 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc120106080 0x7fc12019c2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T05:34:43.224 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:34:43.218+0000 7fc11f400700 1 --2- 172.21.15.87:0/3315058516 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc1201056c0 0x7fc12019bd70 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fc11000e9f0 tx=0x7fc11000ed00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:34:43.224 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:34:43.218+0000 7fc117e00700 1 -- 172.21.15.87:0/3315058516 <== mon.2 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc11000c9c0 con 0x7fc1201056c0 2024-05-08T05:34:43.224 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:34:43.218+0000 7fc126600700 1 -- 172.21.15.87:0/3315058516 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc1201a1020 con 0x7fc1201056c0 2024-05-08T05:34:43.224 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:34:43.218+0000 7fc117e00700 1 -- 172.21.15.87:0/3315058516 <== mon.2 v2:172.21.15.90:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc11000cb60 con 0x7fc1201056c0 2024-05-08T05:34:43.225 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:34:43.218+0000 7fc117e00700 1 -- 172.21.15.87:0/3315058516 <== mon.2 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc110018680 con 0x7fc1201056c0 2024-05-08T05:34:43.225 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:34:43.218+0000 7fc126600700 1 -- 172.21.15.87:0/3315058516 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc1201a88a0 con 0x7fc1201056c0 2024-05-08T05:34:43.225 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:34:43.219+0000 7fc126600700 1 -- 172.21.15.87:0/3315058516 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc12006a190 con 0x7fc1201056c0 2024-05-08T05:34:43.227 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:34:43.221+0000 7fc117e00700 1 -- 172.21.15.87:0/3315058516 <== mon.2 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7fc110010430 con 0x7fc1201056c0 2024-05-08T05:34:43.227 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:34:43.223+0000 7fc117e00700 1 --2- 172.21.15.87:0/3315058516 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7fc1040b2900 0x7fc1040b4dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:34:43.227 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:34:43.223+0000 7fc117e00700 1 -- 172.21.15.87:0/3315058516 <== mon.2 v2:172.21.15.90:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8190+0+0 (secure 0 0 0) 0x7fc1100e2280 con 0x7fc1201056c0 2024-05-08T05:34:43.227 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:34:43.223+0000 7fc11ea00700 1 --2- 172.21.15.87:0/3315058516 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7fc1040b2900 0x7fc1040b4dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:34:43.227 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:34:43.224+0000 7fc11ea00700 1 --2- 172.21.15.87:0/3315058516 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7fc1040b2900 0x7fc1040b4dc0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fc10c009750 tx=0x7fc10c01a040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:34:43.227 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:34:43.227+0000 7fc117e00700 1 -- 172.21.15.87:0/3315058516 <== mon.2 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7fc1100a9f70 con 0x7fc1201056c0 2024-05-08T05:34:43.509 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:34:43.508+0000 7fc126600700 1 -- 172.21.15.87:0/3315058516 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7fc12002e510 con 0x7fc1201056c0 2024-05-08T05:34:43.518 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:34:43.518+0000 7fc117e00700 1 -- 172.21.15.87:0/3315058516 <== mon.2 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v30) ==== 161+0+0 (secure 0 0 0) 0x7fc1100a9870 con 0x7fc1201056c0 2024-05-08T05:34:43.521 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:34:43.521+0000 7fc126600700 1 -- 172.21.15.87:0/3315058516 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7fc1040b2900 msgr2=0x7fc1040b4dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:34:43.522 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:34:43.521+0000 7fc126600700 1 --2- 172.21.15.87:0/3315058516 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7fc1040b2900 0x7fc1040b4dc0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fc10c009750 tx=0x7fc10c01a040 comp rx=0 tx=0).stop 2024-05-08T05:34:43.522 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:34:43.521+0000 7fc126600700 1 -- 172.21.15.87:0/3315058516 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc1201056c0 msgr2=0x7fc12019bd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:34:43.522 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:34:43.521+0000 7fc126600700 1 --2- 172.21.15.87:0/3315058516 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc1201056c0 0x7fc12019bd70 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fc11000e9f0 tx=0x7fc11000ed00 comp rx=0 tx=0).stop 2024-05-08T05:34:43.523 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:34:43.522+0000 7fc126600700 1 -- 172.21.15.87:0/3315058516 shutdown_connections 2024-05-08T05:34:43.523 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:34:43.522+0000 7fc126600700 1 --2- 172.21.15.87:0/3315058516 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7fc1040b2900 0x7fc1040b4dc0 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:34:43.523 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:34:43.522+0000 7fc126600700 1 --2- 172.21.15.87:0/3315058516 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc12010b6c0 0x7fc1201a05f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:34:43.523 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:34:43.522+0000 7fc126600700 1 --2- 172.21.15.87:0/3315058516 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc1201056c0 0x7fc12019bd70 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:34:43.523 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:34:43.522+0000 7fc126600700 1 --2- 172.21.15.87:0/3315058516 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc120106080 0x7fc12019c2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:34:43.523 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:34:43.522+0000 7fc126600700 1 -- 172.21.15.87:0/3315058516 >> 172.21.15.87:0/3315058516 conn(0x7fc1201011b0 msgr2=0x7fc120101860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:34:43.523 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:34:43.522+0000 7fc126600700 1 -- 172.21.15.87:0/3315058516 shutdown_connections 2024-05-08T05:34:43.523 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:34:43.522+0000 7fc126600700 1 -- 172.21.15.87:0/3315058516 wait complete. 2024-05-08T05:34:43.524 INFO:teuthology.orchestra.run.smithi087.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-05-08T05:34:43.893 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:34:43 smithi087 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-mon-a[29519]: 2024-05-08T05:34:43.510+0000 7f12dba00700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-05-08T05:34:43.894 INFO:journalctl@ceph.mds.g.smithi087.stdout:May 08 05:34:43 smithi087 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-mds-g[71534]: ignoring --setuser ceph since I am not root 2024-05-08T05:34:43.894 INFO:journalctl@ceph.mds.g.smithi087.stdout:May 08 05:34:43 smithi087 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-mds-g[71534]: ignoring --setgroup ceph since I am not root 2024-05-08T05:34:43.894 INFO:journalctl@ceph.mds.g.smithi087.stdout:May 08 05:34:43 smithi087 ceph-mds[71539]: -- 172.21.15.87:0/2444499583 <== mon.1 v2:172.21.15.160:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5636913e3a40 con 0x5636913b6c00 2024-05-08T05:34:43.894 INFO:journalctl@ceph.mds.g.smithi087.stdout:May 08 05:34:43 smithi087 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-mds-g[71534]: starting mds.g at 2024-05-08T05:34:43.983 INFO:journalctl@ceph.mds.b.smithi090.stdout:May 08 05:34:43 smithi090 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-mds-b[64959]: ignoring --setuser ceph since I am not root 2024-05-08T05:34:43.984 INFO:journalctl@ceph.mds.b.smithi090.stdout:May 08 05:34:43 smithi090 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-mds-b[64959]: ignoring --setgroup ceph since I am not root 2024-05-08T05:34:43.984 INFO:journalctl@ceph.mds.b.smithi090.stdout:May 08 05:34:43 smithi090 ceph-mds[64963]: -- 172.21.15.90:0/4107275376 <== mon.2 v2:172.21.15.90:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5654ff179a40 con 0x5654ff14d000 2024-05-08T05:34:43.984 INFO:journalctl@ceph.mds.b.smithi090.stdout:May 08 05:34:43 smithi090 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-mds-b[64959]: starting mds.b at 2024-05-08T05:34:43.984 INFO:journalctl@ceph.mds.h.smithi090.stdout:May 08 05:34:43 smithi090 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-mds-h[64651]: ignoring --setuser ceph since I am not root 2024-05-08T05:34:43.984 INFO:journalctl@ceph.mds.h.smithi090.stdout:May 08 05:34:43 smithi090 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-mds-h[64651]: ignoring --setgroup ceph since I am not root 2024-05-08T05:34:43.984 INFO:journalctl@ceph.mds.h.smithi090.stdout:May 08 05:34:43 smithi090 ceph-mds[64655]: -- 172.21.15.90:0/2220976302 <== mon.2 v2:172.21.15.90:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55e7f6d21a40 con 0x55e7f6cf4c00 2024-05-08T05:34:43.984 INFO:journalctl@ceph.mds.h.smithi090.stdout:May 08 05:34:43 smithi090 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-mds-h[64651]: starting mds.h at 2024-05-08T05:34:44.038 INFO:journalctl@ceph.mds.c.smithi160.stdout:May 08 05:34:43 smithi160 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-mds-c[65466]: ignoring --setuser ceph since I am not root 2024-05-08T05:34:44.038 INFO:journalctl@ceph.mds.c.smithi160.stdout:May 08 05:34:43 smithi160 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-mds-c[65466]: ignoring --setgroup ceph since I am not root 2024-05-08T05:34:44.039 INFO:journalctl@ceph.mds.c.smithi160.stdout:May 08 05:34:43 smithi160 ceph-mds[65470]: -- 172.21.15.160:0/727974413 <== mon.1 v2:172.21.15.160:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5556913dfa40 con 0x5556913b2800 2024-05-08T05:34:44.039 INFO:journalctl@ceph.mds.c.smithi160.stdout:May 08 05:34:43 smithi160 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-mds-c[65466]: starting mds.c at 2024-05-08T05:34:44.039 INFO:journalctl@ceph.mds.f.smithi160.stdout:May 08 05:34:43 smithi160 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-mds-f[65156]: ignoring --setuser ceph since I am not root 2024-05-08T05:34:44.039 INFO:journalctl@ceph.mds.f.smithi160.stdout:May 08 05:34:43 smithi160 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-mds-f[65156]: ignoring --setgroup ceph since I am not root 2024-05-08T05:34:44.039 INFO:journalctl@ceph.mds.f.smithi160.stdout:May 08 05:34:43 smithi160 ceph-mds[65160]: -- 172.21.15.160:0/4122486698 <== mon.1 v2:172.21.15.160:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x555b31e23a40 con 0x555b31df7000 2024-05-08T05:34:44.039 INFO:journalctl@ceph.mds.f.smithi160.stdout:May 08 05:34:43 smithi160 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-mds-f[65156]: starting mds.f at 2024-05-08T05:34:44.039 INFO:journalctl@ceph.mds.i.smithi160.stdout:May 08 05:34:43 smithi160 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-mds-i[65778]: ignoring --setuser ceph since I am not root 2024-05-08T05:34:44.039 INFO:journalctl@ceph.mds.i.smithi160.stdout:May 08 05:34:43 smithi160 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-mds-i[65778]: ignoring --setgroup ceph since I am not root 2024-05-08T05:34:44.040 INFO:journalctl@ceph.mds.i.smithi160.stdout:May 08 05:34:43 smithi160 ceph-mds[65782]: -- 172.21.15.160:0/3905414668 <== mon.1 v2:172.21.15.160:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5582b74fba40 con 0x5582b74cf000 2024-05-08T05:34:44.040 INFO:journalctl@ceph.mds.i.smithi160.stdout:May 08 05:34:43 smithi160 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-mds-i[65778]: starting mds.i at 2024-05-08T05:34:44.289 DEBUG:teuthology.orchestra.run.smithi087:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid eeeb813e-0cf9-11ef-bc97-c7b262605968 -- ceph fs rm cephfs --yes-i-really-mean-it 2024-05-08T05:34:44.458 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:34:44 smithi087 ceph-mon[29523]: pgmap v592: 97 pgs: 97 active+clean; 153 MiB data, 1012 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 597 B/s wr, 7 op/s 2024-05-08T05:34:44.459 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:34:44 smithi087 ceph-mon[29523]: from='client.? 172.21.15.87:0/3315058516' entity='client.admin' cmd=[{"prefix": "fs fail", "fs_name": "cephfs"}]: dispatch 2024-05-08T05:34:44.459 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:34:44 smithi087 ceph-mon[29523]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs fail", "fs_name": "cephfs"}]: dispatch 2024-05-08T05:34:44.459 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:34:44 smithi087 ceph-mon[29523]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-05-08T05:34:44.459 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:34:44 smithi087 ceph-mon[29523]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-05-08T05:34:44.459 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:34:44 smithi087 ceph-mon[29523]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2024-05-08T05:34:44.459 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:34:44 smithi087 ceph-mon[29523]: osdmap e83: 12 total, 12 up, 12 in 2024-05-08T05:34:44.459 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:34:44 smithi087 ceph-mon[29523]: fsmap cephfs:0/3 6 up:standby, 3 failed 2024-05-08T05:34:44.483 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:34:44 smithi090 ceph-mon[34526]: pgmap v592: 97 pgs: 97 active+clean; 153 MiB data, 1012 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 597 B/s wr, 7 op/s 2024-05-08T05:34:44.483 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:34:44 smithi090 ceph-mon[34526]: from='client.? 172.21.15.87:0/3315058516' entity='client.admin' cmd=[{"prefix": "fs fail", "fs_name": "cephfs"}]: dispatch 2024-05-08T05:34:44.483 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:34:44 smithi090 ceph-mon[34526]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs fail", "fs_name": "cephfs"}]: dispatch 2024-05-08T05:34:44.483 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:34:44 smithi090 ceph-mon[34526]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-05-08T05:34:44.483 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:34:44 smithi090 ceph-mon[34526]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-05-08T05:34:44.484 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:34:44 smithi090 ceph-mon[34526]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2024-05-08T05:34:44.484 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:34:44 smithi090 ceph-mon[34526]: osdmap e83: 12 total, 12 up, 12 in 2024-05-08T05:34:44.484 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:34:44 smithi090 ceph-mon[34526]: fsmap cephfs:0/3 6 up:standby, 3 failed 2024-05-08T05:34:44.538 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:34:44 smithi160 ceph-mon[34827]: pgmap v592: 97 pgs: 97 active+clean; 153 MiB data, 1012 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 597 B/s wr, 7 op/s 2024-05-08T05:34:44.539 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:34:44 smithi160 ceph-mon[34827]: from='client.? 172.21.15.87:0/3315058516' entity='client.admin' cmd=[{"prefix": "fs fail", "fs_name": "cephfs"}]: dispatch 2024-05-08T05:34:44.539 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:34:44 smithi160 ceph-mon[34827]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs fail", "fs_name": "cephfs"}]: dispatch 2024-05-08T05:34:44.539 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:34:44 smithi160 ceph-mon[34827]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-05-08T05:34:44.539 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:34:44 smithi160 ceph-mon[34827]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-05-08T05:34:44.539 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:34:44 smithi160 ceph-mon[34827]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2024-05-08T05:34:44.539 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:34:44 smithi160 ceph-mon[34827]: osdmap e83: 12 total, 12 up, 12 in 2024-05-08T05:34:44.539 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:34:44 smithi160 ceph-mon[34827]: fsmap cephfs:0/3 6 up:standby, 3 failed 2024-05-08T05:34:44.736 INFO:teuthology.orchestra.run.smithi087.stderr:Inferring config /var/lib/ceph/eeeb813e-0cf9-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T05:34:45.789 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:34:45 smithi160 ceph-mon[34827]: mds.? [v2:172.21.15.160:6834/2525049922,v1:172.21.15.160:6835/2525049922] up:boot 2024-05-08T05:34:45.789 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:34:45 smithi160 ceph-mon[34827]: mds.? [v2:172.21.15.90:6836/3707869938,v1:172.21.15.90:6837/3707869938] up:boot 2024-05-08T05:34:45.789 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:34:45 smithi160 ceph-mon[34827]: mds.? [v2:172.21.15.90:6838/1153132136,v1:172.21.15.90:6839/1153132136] up:boot 2024-05-08T05:34:45.789 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:34:45 smithi160 ceph-mon[34827]: mds.? [v2:172.21.15.160:6836/2901192981,v1:172.21.15.160:6837/2901192981] up:boot 2024-05-08T05:34:45.789 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:34:45 smithi160 ceph-mon[34827]: mds.? [v2:172.21.15.160:6838/1911160320,v1:172.21.15.160:6839/1911160320] up:boot 2024-05-08T05:34:45.789 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:34:45 smithi160 ceph-mon[34827]: mds.? [v2:172.21.15.87:6838/1089050643,v1:172.21.15.87:6839/1089050643] up:boot 2024-05-08T05:34:45.789 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:34:45 smithi160 ceph-mon[34827]: fsmap cephfs:0/3 12 up:standby, 3 failed 2024-05-08T05:34:45.789 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:34:45 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-05-08T05:34:45.789 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:34:45 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-05-08T05:34:45.789 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:34:45 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-05-08T05:34:45.789 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:34:45 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-05-08T05:34:45.790 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:34:45 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-05-08T05:34:45.790 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:34:45 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-05-08T05:34:45.909 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:34:45 smithi087 ceph-mon[29523]: mds.? [v2:172.21.15.160:6834/2525049922,v1:172.21.15.160:6835/2525049922] up:boot 2024-05-08T05:34:45.909 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:34:45 smithi087 ceph-mon[29523]: mds.? [v2:172.21.15.90:6836/3707869938,v1:172.21.15.90:6837/3707869938] up:boot 2024-05-08T05:34:45.909 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:34:45 smithi087 ceph-mon[29523]: mds.? [v2:172.21.15.90:6838/1153132136,v1:172.21.15.90:6839/1153132136] up:boot 2024-05-08T05:34:45.909 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:34:45 smithi087 ceph-mon[29523]: mds.? [v2:172.21.15.160:6836/2901192981,v1:172.21.15.160:6837/2901192981] up:boot 2024-05-08T05:34:45.909 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:34:45 smithi087 ceph-mon[29523]: mds.? [v2:172.21.15.160:6838/1911160320,v1:172.21.15.160:6839/1911160320] up:boot 2024-05-08T05:34:45.909 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:34:45 smithi087 ceph-mon[29523]: mds.? [v2:172.21.15.87:6838/1089050643,v1:172.21.15.87:6839/1089050643] up:boot 2024-05-08T05:34:45.909 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:34:45 smithi087 ceph-mon[29523]: fsmap cephfs:0/3 12 up:standby, 3 failed 2024-05-08T05:34:45.909 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:34:45 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-05-08T05:34:45.909 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:34:45 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-05-08T05:34:45.909 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:34:45 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-05-08T05:34:45.910 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:34:45 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-05-08T05:34:45.910 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:34:45 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-05-08T05:34:45.910 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:34:45 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-05-08T05:34:45.983 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:34:45 smithi090 ceph-mon[34526]: mds.? [v2:172.21.15.160:6834/2525049922,v1:172.21.15.160:6835/2525049922] up:boot 2024-05-08T05:34:45.984 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:34:45 smithi090 ceph-mon[34526]: mds.? [v2:172.21.15.90:6836/3707869938,v1:172.21.15.90:6837/3707869938] up:boot 2024-05-08T05:34:45.984 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:34:45 smithi090 ceph-mon[34526]: mds.? [v2:172.21.15.90:6838/1153132136,v1:172.21.15.90:6839/1153132136] up:boot 2024-05-08T05:34:45.984 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:34:45 smithi090 ceph-mon[34526]: mds.? [v2:172.21.15.160:6836/2901192981,v1:172.21.15.160:6837/2901192981] up:boot 2024-05-08T05:34:45.984 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:34:45 smithi090 ceph-mon[34526]: mds.? [v2:172.21.15.160:6838/1911160320,v1:172.21.15.160:6839/1911160320] up:boot 2024-05-08T05:34:45.984 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:34:45 smithi090 ceph-mon[34526]: mds.? [v2:172.21.15.87:6838/1089050643,v1:172.21.15.87:6839/1089050643] up:boot 2024-05-08T05:34:45.984 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:34:45 smithi090 ceph-mon[34526]: fsmap cephfs:0/3 12 up:standby, 3 failed 2024-05-08T05:34:45.984 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:34:45 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-05-08T05:34:45.984 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:34:45 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-05-08T05:34:45.984 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:34:45 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-05-08T05:34:45.984 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:34:45 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-05-08T05:34:45.984 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:34:45 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-05-08T05:34:45.984 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:34:45 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-05-08T05:34:46.781 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:34:46.779+0000 7f18f8a00700 1 -- 172.21.15.87:0/2565355354 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f18f4104100 msgr2=0x7f18f4108120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:34:46.781 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:34:46.779+0000 7f18f8a00700 1 --2- 172.21.15.87:0/2565355354 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f18f4104100 0x7f18f4108120 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f18e0009920 tx=0x7f18e0009c30 comp rx=0 tx=0).stop 2024-05-08T05:34:46.781 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:34:46.780+0000 7f18f8a00700 1 -- 172.21.15.87:0/2565355354 shutdown_connections 2024-05-08T05:34:46.781 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:34:46.780+0000 7f18f8a00700 1 --2- 172.21.15.87:0/2565355354 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f18f4108850 0x7f18f41103d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:34:46.781 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:34:46.780+0000 7f18f8a00700 1 --2- 172.21.15.87:0/2565355354 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f18f4103750 0x7f18f4103b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:34:46.781 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:34:46.780+0000 7f18f8a00700 1 --2- 172.21.15.87:0/2565355354 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f18f4104100 0x7f18f4108120 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:34:46.781 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:34:46.780+0000 7f18f8a00700 1 -- 172.21.15.87:0/2565355354 >> 172.21.15.87:0/2565355354 conn(0x7f18f407a600 msgr2=0x7f18f407aa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:34:46.781 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:34:46.780+0000 7f18f8a00700 1 -- 172.21.15.87:0/2565355354 shutdown_connections 2024-05-08T05:34:46.782 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:34:46 smithi087 ceph-mon[29523]: pgmap v594: 97 pgs: 97 active+clean; 153 MiB data, 1012 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-05-08T05:34:46.783 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:34:46.780+0000 7f18f8a00700 1 -- 172.21.15.87:0/2565355354 wait complete. 2024-05-08T05:34:46.783 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:34:46.781+0000 7f18f8a00700 1 Processor -- start 2024-05-08T05:34:46.783 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:34:46.781+0000 7f18f8a00700 1 -- start start 2024-05-08T05:34:46.783 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:34:46.782+0000 7f18f8a00700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f18f4103750 0x7f18f419bdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:34:46.783 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:34:46.782+0000 7f18f8a00700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f18f4104100 0x7f18f419c310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:34:46.783 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:34:46.782+0000 7f18f8a00700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f18f4108850 0x7f18f41a06a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:34:46.783 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:34:46.782+0000 7f18f8a00700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f18f4113680 con 0x7f18f4108850 2024-05-08T05:34:46.783 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:34:46.782+0000 7f18f8a00700 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f18f4113500 con 0x7f18f4104100 2024-05-08T05:34:46.783 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:34:46.782+0000 7f18f8a00700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f18f4113800 con 0x7f18f4103750 2024-05-08T05:34:46.784 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:34:46.782+0000 7f18f1e00700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f18f4103750 0x7f18f419bdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:34:46.784 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:34:46.782+0000 7f18f1e00700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f18f4103750 0x7f18f419bdd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.87:42038/0 (socket says 172.21.15.87:42038) 2024-05-08T05:34:46.784 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:34:46.782+0000 7f18f2800700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f18f4108850 0x7f18f41a06a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:34:46.784 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:34:46.782+0000 7f18f1e00700 1 -- 172.21.15.87:0/3204614640 learned_addr learned my addr 172.21.15.87:0/3204614640 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T05:34:46.784 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:34:46.782+0000 7f18f1400700 1 --2- 172.21.15.87:0/3204614640 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f18f4104100 0x7f18f419c310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:34:46.784 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:34:46.782+0000 7f18f1e00700 1 -- 172.21.15.87:0/3204614640 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f18f4104100 msgr2=0x7f18f419c310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:34:46.784 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:34:46.782+0000 7f18f1e00700 1 --2- 172.21.15.87:0/3204614640 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f18f4104100 0x7f18f419c310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:34:46.784 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:34:46.783+0000 7f18f1e00700 1 -- 172.21.15.87:0/3204614640 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f18f4108850 msgr2=0x7f18f41a06a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:34:46.784 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:34:46.783+0000 7f18f1e00700 1 --2- 172.21.15.87:0/3204614640 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f18f4108850 0x7f18f41a06a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:34:46.785 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:34:46.783+0000 7f18f1e00700 1 -- 172.21.15.87:0/3204614640 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f18f41a0de0 con 0x7f18f4103750 2024-05-08T05:34:46.785 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:34:46.783+0000 7f18f1e00700 1 --2- 172.21.15.87:0/3204614640 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f18f4103750 0x7f18f419bdd0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f18e400ec10 tx=0x7f18e400ef20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:34:46.786 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:34:46.783+0000 7f18eaa00700 1 -- 172.21.15.87:0/3204614640 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18e400cc90 con 0x7f18f4103750 2024-05-08T05:34:46.786 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:34:46.783+0000 7f18eaa00700 1 -- 172.21.15.87:0/3204614640 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f18e400ce30 con 0x7f18f4103750 2024-05-08T05:34:46.786 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:34:46.783+0000 7f18eaa00700 1 -- 172.21.15.87:0/3204614640 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18e4010430 con 0x7f18f4103750 2024-05-08T05:34:46.786 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:34:46.783+0000 7f18f8a00700 1 -- 172.21.15.87:0/3204614640 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f18f41a10d0 con 0x7f18f4103750 2024-05-08T05:34:46.786 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:34:46.783+0000 7f18f8a00700 1 -- 172.21.15.87:0/3204614640 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f18f41a8950 con 0x7f18f4103750 2024-05-08T05:34:46.786 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:34:46.784+0000 7f18f8a00700 1 -- 172.21.15.87:0/3204614640 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f18f406a190 con 0x7f18f4103750 2024-05-08T05:34:46.787 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:34:46.787+0000 7f18eaa00700 1 -- 172.21.15.87:0/3204614640 <== mon.1 v2:172.21.15.160:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7f18e4004000 con 0x7f18f4103750 2024-05-08T05:34:46.789 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:34:46 smithi160 ceph-mon[34827]: pgmap v594: 97 pgs: 97 active+clean; 153 MiB data, 1012 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-05-08T05:34:46.789 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:34:46.788+0000 7f18eaa00700 1 --2- 172.21.15.87:0/3204614640 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f18d80b2900 0x7f18d80b4dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:34:46.789 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:34:46.788+0000 7f18eaa00700 1 -- 172.21.15.87:0/3204614640 <== mon.1 v2:172.21.15.160:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8448+0+0 (secure 0 0 0) 0x7f18e40e2510 con 0x7f18f4103750 2024-05-08T05:34:46.789 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:34:46.788+0000 7f18f1400700 1 --2- 172.21.15.87:0/3204614640 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f18d80b2900 0x7f18d80b4dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:34:46.789 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:34:46.789+0000 7f18f1400700 1 --2- 172.21.15.87:0/3204614640 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f18d80b2900 0x7f18d80b4dc0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f18f4077730 tx=0x7f18e0019040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:34:46.793 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:34:46.793+0000 7f18eaa00700 1 -- 172.21.15.87:0/3204614640 <== mon.1 v2:172.21.15.160:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f18e40aa120 con 0x7f18f4103750 2024-05-08T05:34:46.886 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:34:46 smithi090 ceph-mon[34526]: pgmap v594: 97 pgs: 97 active+clean; 153 MiB data, 1012 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-05-08T05:34:47.076 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:34:47.076+0000 7f18f8a00700 1 -- 172.21.15.87:0/3204614640 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7f18f41a8bc0 con 0x7f18f4103750 2024-05-08T05:34:47.547 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:34:47.546+0000 7f18eaa00700 1 -- 172.21.15.87:0/3204614640 <== mon.1 v2:172.21.15.160:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v32) ==== 104+0+0 (secure 0 0 0) 0x7f18e40b21a0 con 0x7f18f4103750 2024-05-08T05:34:47.551 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:34:47.550+0000 7f18f8a00700 1 -- 172.21.15.87:0/3204614640 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f18d80b2900 msgr2=0x7f18d80b4dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:34:47.551 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:34:47.550+0000 7f18f8a00700 1 --2- 172.21.15.87:0/3204614640 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f18d80b2900 0x7f18d80b4dc0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f18f4077730 tx=0x7f18e0019040 comp rx=0 tx=0).stop 2024-05-08T05:34:47.551 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:34:47.551+0000 7f18f8a00700 1 -- 172.21.15.87:0/3204614640 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f18f4103750 msgr2=0x7f18f419bdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:34:47.551 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:34:47.551+0000 7f18f8a00700 1 --2- 172.21.15.87:0/3204614640 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f18f4103750 0x7f18f419bdd0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f18e400ec10 tx=0x7f18e400ef20 comp rx=0 tx=0).stop 2024-05-08T05:34:47.551 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:34:47.551+0000 7f18f8a00700 1 -- 172.21.15.87:0/3204614640 shutdown_connections 2024-05-08T05:34:47.552 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:34:47.551+0000 7f18f8a00700 1 --2- 172.21.15.87:0/3204614640 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f18f4108850 0x7f18f41a06a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:34:47.552 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:34:47.551+0000 7f18f8a00700 1 --2- 172.21.15.87:0/3204614640 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f18d80b2900 0x7f18d80b4dc0 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:34:47.552 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:34:47.551+0000 7f18f8a00700 1 --2- 172.21.15.87:0/3204614640 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f18f4103750 0x7f18f419bdd0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:34:47.552 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:34:47.551+0000 7f18f8a00700 1 --2- 172.21.15.87:0/3204614640 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f18f4104100 0x7f18f419c310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:34:47.552 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:34:47.551+0000 7f18f8a00700 1 -- 172.21.15.87:0/3204614640 >> 172.21.15.87:0/3204614640 conn(0x7f18f407a600 msgr2=0x7f18f4101b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:34:47.552 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:34:47.551+0000 7f18f8a00700 1 -- 172.21.15.87:0/3204614640 shutdown_connections 2024-05-08T05:34:47.552 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:34:47.551+0000 7f18f8a00700 1 -- 172.21.15.87:0/3204614640 wait complete. 2024-05-08T05:34:47.923 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:34:47 smithi087 ceph-mon[29523]: from='client.? 172.21.15.87:0/3204614640' entity='client.admin' cmd=[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]: dispatch 2024-05-08T05:34:47.923 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:34:47 smithi087 ceph-mon[29523]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]: dispatch 2024-05-08T05:34:47.983 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:34:47 smithi090 ceph-mon[34526]: from='client.? 172.21.15.87:0/3204614640' entity='client.admin' cmd=[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]: dispatch 2024-05-08T05:34:47.983 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:34:47 smithi090 ceph-mon[34526]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]: dispatch 2024-05-08T05:34:48.038 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:34:47 smithi160 ceph-mon[34827]: from='client.? 172.21.15.87:0/3204614640' entity='client.admin' cmd=[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]: dispatch 2024-05-08T05:34:48.039 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:34:47 smithi160 ceph-mon[34827]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]: dispatch 2024-05-08T05:34:48.342 DEBUG:teuthology.orchestra.run.smithi087:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid eeeb813e-0cf9-11ef-bc97-c7b262605968 -- ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-05-08T05:34:48.816 INFO:teuthology.orchestra.run.smithi087.stderr:Inferring config /var/lib/ceph/eeeb813e-0cf9-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T05:34:48.953 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:34:48 smithi087 ceph-mon[29523]: pgmap v595: 97 pgs: 97 active+clean; 153 MiB data, 1012 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-05-08T05:34:48.953 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:34:48 smithi087 ceph-mon[29523]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-05-08T05:34:48.953 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:34:48 smithi087 ceph-mon[29523]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-05-08T05:34:48.953 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:34:48 smithi087 ceph-mon[29523]: Cluster is now healthy 2024-05-08T05:34:48.953 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:34:48 smithi087 ceph-mon[29523]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]': finished 2024-05-08T05:34:48.953 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:34:48 smithi087 ceph-mon[29523]: fsmap 12 up:standby 2024-05-08T05:34:48.983 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:34:48 smithi090 ceph-mon[34526]: pgmap v595: 97 pgs: 97 active+clean; 153 MiB data, 1012 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-05-08T05:34:48.983 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:34:48 smithi090 ceph-mon[34526]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-05-08T05:34:48.983 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:34:48 smithi090 ceph-mon[34526]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-05-08T05:34:48.984 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:34:48 smithi090 ceph-mon[34526]: Cluster is now healthy 2024-05-08T05:34:48.984 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:34:48 smithi090 ceph-mon[34526]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]': finished 2024-05-08T05:34:48.984 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:34:48 smithi090 ceph-mon[34526]: fsmap 12 up:standby 2024-05-08T05:34:49.039 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:34:48 smithi160 ceph-mon[34827]: pgmap v595: 97 pgs: 97 active+clean; 153 MiB data, 1012 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-05-08T05:34:49.039 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:34:48 smithi160 ceph-mon[34827]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-05-08T05:34:49.039 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:34:48 smithi160 ceph-mon[34827]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-05-08T05:34:49.039 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:34:48 smithi160 ceph-mon[34827]: Cluster is now healthy 2024-05-08T05:34:49.039 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:34:48 smithi160 ceph-mon[34827]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]': finished 2024-05-08T05:34:49.039 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:34:48 smithi160 ceph-mon[34827]: fsmap 12 up:standby 2024-05-08T05:34:50.804 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:34:50.784+0000 7f3166c00700 1 -- 172.21.15.87:0/1856894297 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3160105ed0 msgr2=0x7f3160106360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:34:50.805 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:34:50.784+0000 7f3166c00700 1 --2- 172.21.15.87:0/1856894297 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3160105ed0 0x7f3160106360 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f315800b0a0 tx=0x7f315800b3b0 comp rx=0 tx=0).stop 2024-05-08T05:34:50.805 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:34:50.785+0000 7f3166c00700 1 -- 172.21.15.87:0/1856894297 shutdown_connections 2024-05-08T05:34:50.805 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:34:50.785+0000 7f3166c00700 1 --2- 172.21.15.87:0/1856894297 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3160105ed0 0x7f3160106360 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:34:50.805 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:34:50.785+0000 7f3166c00700 1 --2- 172.21.15.87:0/1856894297 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f31601083c0 0x7f316006ba40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:34:50.805 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:34:50.785+0000 7f3166c00700 1 --2- 172.21.15.87:0/1856894297 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f316006bf80 0x7f316006c3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:34:50.805 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:34:50.785+0000 7f3166c00700 1 -- 172.21.15.87:0/1856894297 >> 172.21.15.87:0/1856894297 conn(0x7f3160079310 msgr2=0x7f3160079720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:34:50.805 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:34:50.785+0000 7f3166c00700 1 -- 172.21.15.87:0/1856894297 shutdown_connections 2024-05-08T05:34:50.805 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:34:50.785+0000 7f3166c00700 1 -- 172.21.15.87:0/1856894297 wait complete. 2024-05-08T05:34:50.805 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:34:50.786+0000 7f3166c00700 1 Processor -- start 2024-05-08T05:34:50.805 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:34:50.786+0000 7f3166c00700 1 -- start start 2024-05-08T05:34:50.806 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:34:50.787+0000 7f3166c00700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f316006bf80 0x7f31601a01b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:34:50.806 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:34:50.787+0000 7f3166c00700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3160105ed0 0x7f31601a06f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:34:50.806 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:34:50.787+0000 7f3166c00700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f31601083c0 0x7f31601a4a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:34:50.806 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:34:50.787+0000 7f3166c00700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f3160119c80 con 0x7f316006bf80 2024-05-08T05:34:50.806 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:34:50.787+0000 7f3166c00700 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f3160119b00 con 0x7f3160105ed0 2024-05-08T05:34:50.806 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:34:50.787+0000 7f3166c00700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f3160119e00 con 0x7f31601083c0 2024-05-08T05:34:50.806 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:34:50.787+0000 7f315fe00700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f316006bf80 0x7f31601a01b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:34:50.806 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:34:50.787+0000 7f315fe00700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f316006bf80 0x7f31601a01b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:57218/0 (socket says 172.21.15.87:57218) 2024-05-08T05:34:50.806 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:34:50.787+0000 7f315fe00700 1 -- 172.21.15.87:0/2835453104 learned_addr learned my addr 172.21.15.87:0/2835453104 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T05:34:50.806 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:34:50.787+0000 7f315f400700 1 --2- 172.21.15.87:0/2835453104 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3160105ed0 0x7f31601a06f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:34:50.806 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:34:50.787+0000 7f3164c00700 1 --2- 172.21.15.87:0/2835453104 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f31601083c0 0x7f31601a4a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:34:50.806 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:34:50.788+0000 7f315fe00700 1 -- 172.21.15.87:0/2835453104 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f31601083c0 msgr2=0x7f31601a4a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:34:50.806 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:34:50.788+0000 7f315fe00700 1 --2- 172.21.15.87:0/2835453104 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f31601083c0 0x7f31601a4a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:34:50.807 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:34:50.788+0000 7f315fe00700 1 -- 172.21.15.87:0/2835453104 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3160105ed0 msgr2=0x7f31601a06f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:34:50.807 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:34:50.788+0000 7f315fe00700 1 --2- 172.21.15.87:0/2835453104 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3160105ed0 0x7f31601a06f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:34:50.807 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:34:50.788+0000 7f315fe00700 1 -- 172.21.15.87:0/2835453104 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f31601a51c0 con 0x7f316006bf80 2024-05-08T05:34:50.807 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:34:50.788+0000 7f315f400700 1 --2- 172.21.15.87:0/2835453104 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3160105ed0 0x7f31601a06f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T05:34:50.807 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:34:50.788+0000 7f315fe00700 1 --2- 172.21.15.87:0/2835453104 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f316006bf80 0x7f31601a01b0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f315000d980 tx=0x7f315000dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:34:50.807 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:34:50.788+0000 7f315cc00700 1 -- 172.21.15.87:0/2835453104 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3150016070 con 0x7f316006bf80 2024-05-08T05:34:50.807 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:34:50.788+0000 7f3166c00700 1 -- 172.21.15.87:0/2835453104 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f31601a54b0 con 0x7f316006bf80 2024-05-08T05:34:50.807 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:34:50.788+0000 7f315cc00700 1 -- 172.21.15.87:0/2835453104 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3150004830 con 0x7f316006bf80 2024-05-08T05:34:50.807 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:34:50.788+0000 7f315cc00700 1 -- 172.21.15.87:0/2835453104 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3150005540 con 0x7f316006bf80 2024-05-08T05:34:50.807 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:34:50.788+0000 7f3166c00700 1 -- 172.21.15.87:0/2835453104 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f31601acd30 con 0x7f316006bf80 2024-05-08T05:34:50.807 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:34:50.789+0000 7f3166c00700 1 -- 172.21.15.87:0/2835453104 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f316006a190 con 0x7f316006bf80 2024-05-08T05:34:50.807 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:34:50.792+0000 7f315cc00700 1 -- 172.21.15.87:0/2835453104 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7f3150004220 con 0x7f316006bf80 2024-05-08T05:34:50.807 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:34:50.793+0000 7f315cc00700 1 --2- 172.21.15.87:0/2835453104 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f31440b2880 0x7f31440b4d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:34:50.807 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:34:50.794+0000 7f315cc00700 1 -- 172.21.15.87:0/2835453104 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8448+0+0 (secure 0 0 0) 0x7f31500e25c0 con 0x7f316006bf80 2024-05-08T05:34:50.808 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:34:50.794+0000 7f315f400700 1 --2- 172.21.15.87:0/2835453104 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f31440b2880 0x7f31440b4d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:34:50.808 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:34:50.794+0000 7f315f400700 1 --2- 172.21.15.87:0/2835453104 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f31440b2880 0x7f31440b4d40 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f316006bd80 tx=0x7f314c009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:34:50.808 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:34:50.796+0000 7f315cc00700 1 -- 172.21.15.87:0/2835453104 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f315001f020 con 0x7f316006bf80 2024-05-08T05:34:50.808 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:34:50 smithi087 ceph-mon[29523]: pgmap v596: 97 pgs: 97 active+clean; 153 MiB data, 1012 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-05-08T05:34:50.983 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:34:50 smithi090 ceph-mon[34526]: pgmap v596: 97 pgs: 97 active+clean; 153 MiB data, 1012 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-05-08T05:34:51.032 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:34:51.031+0000 7f3166c00700 1 -- 172.21.15.87:0/2835453104 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7f31601acf60 con 0x7f316006bf80 2024-05-08T05:34:51.038 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:34:50 smithi160 ceph-mon[34827]: pgmap v596: 97 pgs: 97 active+clean; 153 MiB data, 1012 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-05-08T05:34:51.561 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:34:51.561+0000 7f315cc00700 1 -- 172.21.15.87:0/2835453104 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v84) ==== 181+0+0 (secure 0 0 0) 0x7f31500aa1d0 con 0x7f316006bf80 2024-05-08T05:34:51.567 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:34:51.566+0000 7f3166c00700 1 -- 172.21.15.87:0/2835453104 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f31440b2880 msgr2=0x7f31440b4d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:34:51.567 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:34:51.566+0000 7f3166c00700 1 --2- 172.21.15.87:0/2835453104 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f31440b2880 0x7f31440b4d40 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f316006bd80 tx=0x7f314c009260 comp rx=0 tx=0).stop 2024-05-08T05:34:51.567 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:34:51.566+0000 7f3166c00700 1 -- 172.21.15.87:0/2835453104 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f316006bf80 msgr2=0x7f31601a01b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:34:51.567 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:34:51.566+0000 7f3166c00700 1 --2- 172.21.15.87:0/2835453104 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f316006bf80 0x7f31601a01b0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f315000d980 tx=0x7f315000dc90 comp rx=0 tx=0).stop 2024-05-08T05:34:51.568 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:34:51.567+0000 7f3166c00700 1 -- 172.21.15.87:0/2835453104 shutdown_connections 2024-05-08T05:34:51.568 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:34:51.567+0000 7f3166c00700 1 --2- 172.21.15.87:0/2835453104 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f31440b2880 0x7f31440b4d40 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:34:51.568 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:34:51.567+0000 7f3166c00700 1 --2- 172.21.15.87:0/2835453104 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f31601083c0 0x7f31601a4a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:34:51.568 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:34:51.567+0000 7f3166c00700 1 --2- 172.21.15.87:0/2835453104 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f316006bf80 0x7f31601a01b0 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:34:51.568 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:34:51.567+0000 7f3166c00700 1 --2- 172.21.15.87:0/2835453104 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3160105ed0 0x7f31601a06f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:34:51.568 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:34:51.567+0000 7f3166c00700 1 -- 172.21.15.87:0/2835453104 >> 172.21.15.87:0/2835453104 conn(0x7f3160079310 msgr2=0x7f3160104eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:34:51.568 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:34:51.568+0000 7f3166c00700 1 -- 172.21.15.87:0/2835453104 shutdown_connections 2024-05-08T05:34:51.569 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:34:51.568+0000 7f3166c00700 1 -- 172.21.15.87:0/2835453104 wait complete. 2024-05-08T05:34:51.570 INFO:teuthology.orchestra.run.smithi087.stderr:pool 'cephfs_metadata' removed 2024-05-08T05:34:51.935 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:34:51 smithi087 ceph-mon[29523]: from='client.? 172.21.15.87:0/2835453104' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]: dispatch 2024-05-08T05:34:51.983 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:34:51 smithi090 ceph-mon[34526]: from='client.? 172.21.15.87:0/2835453104' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]: dispatch 2024-05-08T05:34:52.038 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:34:51 smithi160 ceph-mon[34827]: from='client.? 172.21.15.87:0/2835453104' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]: dispatch 2024-05-08T05:34:52.332 DEBUG:teuthology.orchestra.run.smithi087:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid eeeb813e-0cf9-11ef-bc97-c7b262605968 -- ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-05-08T05:34:52.778 INFO:teuthology.orchestra.run.smithi087.stderr:Inferring config /var/lib/ceph/eeeb813e-0cf9-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T05:34:52.926 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:34:52 smithi087 ceph-mon[29523]: pgmap v597: 97 pgs: 97 active+clean; 153 MiB data, 1012 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-05-08T05:34:52.926 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:34:52 smithi087 ceph-mon[29523]: from='client.? 172.21.15.87:0/2835453104' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]': finished 2024-05-08T05:34:52.926 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:34:52 smithi087 ceph-mon[29523]: osdmap e84: 12 total, 12 up, 12 in 2024-05-08T05:34:52.983 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:34:52 smithi090 ceph-mon[34526]: pgmap v597: 97 pgs: 97 active+clean; 153 MiB data, 1012 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-05-08T05:34:52.983 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:34:52 smithi090 ceph-mon[34526]: from='client.? 172.21.15.87:0/2835453104' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]': finished 2024-05-08T05:34:52.984 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:34:52 smithi090 ceph-mon[34526]: osdmap e84: 12 total, 12 up, 12 in 2024-05-08T05:34:53.038 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:34:52 smithi160 ceph-mon[34827]: pgmap v597: 97 pgs: 97 active+clean; 153 MiB data, 1012 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-05-08T05:34:53.038 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:34:52 smithi160 ceph-mon[34827]: from='client.? 172.21.15.87:0/2835453104' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]': finished 2024-05-08T05:34:53.039 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:34:52 smithi160 ceph-mon[34827]: osdmap e84: 12 total, 12 up, 12 in 2024-05-08T05:34:54.830 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:34:54.828+0000 7f3bf1800700 1 -- 172.21.15.87:0/2055487297 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3bec105f90 msgr2=0x7f3bec1124a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:34:54.830 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:34:54.828+0000 7f3bf1800700 1 --2- 172.21.15.87:0/2055487297 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3bec105f90 0x7f3bec1124a0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f3be400b0a0 tx=0x7f3be400b3b0 comp rx=0 tx=0).stop 2024-05-08T05:34:54.830 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:34:54 smithi087 ceph-mon[29523]: pgmap v599: 65 pgs: 65 active+clean; 577 KiB data, 944 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-08T05:34:54.831 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:34:54.828+0000 7f3bf1800700 1 -- 172.21.15.87:0/2055487297 shutdown_connections 2024-05-08T05:34:54.831 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:34:54.828+0000 7f3bf1800700 1 --2- 172.21.15.87:0/2055487297 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3bec105f90 0x7f3bec1124a0 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:34:54.831 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:34:54.828+0000 7f3bf1800700 1 --2- 172.21.15.87:0/2055487297 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3bec10b660 0x7f3bec10ba40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:34:54.832 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:34:54.828+0000 7f3bf1800700 1 --2- 172.21.15.87:0/2055487297 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3bec1055d0 0x7f3bec105a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:34:54.832 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:34:54.828+0000 7f3bf1800700 1 -- 172.21.15.87:0/2055487297 >> 172.21.15.87:0/2055487297 conn(0x7f3bec1010c0 msgr2=0x7f3bec1034e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:34:54.832 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:34:54.828+0000 7f3bf1800700 1 -- 172.21.15.87:0/2055487297 shutdown_connections 2024-05-08T05:34:54.832 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:34:54.828+0000 7f3bf1800700 1 -- 172.21.15.87:0/2055487297 wait complete. 2024-05-08T05:34:54.832 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:34:54.829+0000 7f3bf1800700 1 Processor -- start 2024-05-08T05:34:54.832 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:34:54.829+0000 7f3bf1800700 1 -- start start 2024-05-08T05:34:54.832 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:34:54.830+0000 7f3bf1800700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3bec1055d0 0x7f3bec1a1800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:34:54.832 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:34:54.830+0000 7f3bf1800700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3bec105f90 0x7f3bec1a1d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:34:54.832 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:34:54.830+0000 7f3bf1800700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3bec10b660 0x7f3bec19b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:34:54.832 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:34:54.830+0000 7f3bf1800700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f3bec115800 con 0x7f3bec105f90 2024-05-08T05:34:54.832 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:34:54.830+0000 7f3bf1800700 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f3bec115680 con 0x7f3bec1055d0 2024-05-08T05:34:54.832 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:34:54.830+0000 7f3bf1800700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f3bec115980 con 0x7f3bec10b660 2024-05-08T05:34:54.832 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:34:54.830+0000 7f3beb400700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3bec105f90 0x7f3bec1a1d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:34:54.832 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:34:54.830+0000 7f3bebe00700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3bec1055d0 0x7f3bec1a1800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:34:54.833 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:34:54.830+0000 7f3bebe00700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3bec1055d0 0x7f3bec1a1800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.87:53050/0 (socket says 172.21.15.87:53050) 2024-05-08T05:34:54.833 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:34:54.830+0000 7f3beb400700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3bec105f90 0x7f3bec1a1d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:57246/0 (socket says 172.21.15.87:57246) 2024-05-08T05:34:54.833 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:34:54.830+0000 7f3bebe00700 1 -- 172.21.15.87:0/2256290191 learned_addr learned my addr 172.21.15.87:0/2256290191 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T05:34:54.833 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:34:54.830+0000 7f3bf0e00700 1 --2- 172.21.15.87:0/2256290191 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3bec10b660 0x7f3bec19b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:34:54.834 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:34:54.831+0000 7f3bebe00700 1 -- 172.21.15.87:0/2256290191 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3bec10b660 msgr2=0x7f3bec19b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:34:54.834 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:34:54.831+0000 7f3bebe00700 1 --2- 172.21.15.87:0/2256290191 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3bec10b660 0x7f3bec19b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:34:54.834 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:34:54.831+0000 7f3bebe00700 1 -- 172.21.15.87:0/2256290191 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3bec105f90 msgr2=0x7f3bec1a1d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:34:54.834 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:34:54.831+0000 7f3bebe00700 1 --2- 172.21.15.87:0/2256290191 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3bec105f90 0x7f3bec1a1d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:34:54.834 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:34:54.831+0000 7f3bebe00700 1 -- 172.21.15.87:0/2256290191 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3bec19c120 con 0x7f3bec1055d0 2024-05-08T05:34:54.834 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:34:54.831+0000 7f3beb400700 1 --2- 172.21.15.87:0/2256290191 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3bec105f90 0x7f3bec1a1d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T05:34:54.834 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:34:54.831+0000 7f3bebe00700 1 --2- 172.21.15.87:0/2256290191 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3bec1055d0 0x7f3bec1a1800 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f3bdc00ea50 tx=0x7f3bdc00ed60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:34:54.834 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:34:54.831+0000 7f3be8c00700 1 -- 172.21.15.87:0/2256290191 <== mon.2 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3bdc00cbd0 con 0x7f3bec1055d0 2024-05-08T05:34:54.834 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:34:54.831+0000 7f3be8c00700 1 -- 172.21.15.87:0/2256290191 <== mon.2 v2:172.21.15.90:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3bdc00cd70 con 0x7f3bec1055d0 2024-05-08T05:34:54.834 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:34:54.831+0000 7f3bf1800700 1 -- 172.21.15.87:0/2256290191 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3bec19c410 con 0x7f3bec1055d0 2024-05-08T05:34:54.834 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:34:54.832+0000 7f3be8c00700 1 -- 172.21.15.87:0/2256290191 <== mon.2 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3bdc018680 con 0x7f3bec1055d0 2024-05-08T05:34:54.835 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:34:54.832+0000 7f3bf1800700 1 -- 172.21.15.87:0/2256290191 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3bec1a86d0 con 0x7f3bec1055d0 2024-05-08T05:34:54.835 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:34:54.833+0000 7f3bf1800700 1 -- 172.21.15.87:0/2256290191 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3bec06a190 con 0x7f3bec1055d0 2024-05-08T05:34:54.836 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:34:54.835+0000 7f3be8c00700 1 -- 172.21.15.87:0/2256290191 <== mon.2 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7f3bdc01f020 con 0x7f3bec1055d0 2024-05-08T05:34:54.838 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:34:54.836+0000 7f3be8c00700 1 --2- 172.21.15.87:0/2256290191 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f3bd00b2900 0x7f3bd00b4dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:34:54.838 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:34:54.837+0000 7f3be8c00700 1 -- 172.21.15.87:0/2256290191 <== mon.2 v2:172.21.15.90:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 7944+0+0 (secure 0 0 0) 0x7f3bdc0e2200 con 0x7f3bec1055d0 2024-05-08T05:34:54.838 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:34:54.837+0000 7f3beb400700 1 --2- 172.21.15.87:0/2256290191 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f3bd00b2900 0x7f3bd00b4dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:34:54.838 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:34:54.837+0000 7f3beb400700 1 --2- 172.21.15.87:0/2256290191 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f3bd00b2900 0x7f3bd00b4dc0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f3bec102ef0 tx=0x7f3bd8009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:34:54.840 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:34:54.839+0000 7f3be8c00700 1 -- 172.21.15.87:0/2256290191 <== mon.2 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f3bdc0a9ff0 con 0x7f3bec1055d0 2024-05-08T05:34:54.983 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:34:54 smithi090 ceph-mon[34526]: pgmap v599: 65 pgs: 65 active+clean; 577 KiB data, 944 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-08T05:34:55.038 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:34:54 smithi160 ceph-mon[34827]: pgmap v599: 65 pgs: 65 active+clean; 577 KiB data, 944 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-08T05:34:55.073 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:34:55.072+0000 7f3bf1800700 1 -- 172.21.15.87:0/2256290191 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7f3bec1a8900 con 0x7f3bec1055d0 2024-05-08T05:34:55.583 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:34:55.581+0000 7f3be8c00700 1 -- 172.21.15.87:0/2256290191 <== mon.2 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v85) ==== 169+0+0 (secure 0 0 0) 0x7f3bdc0b2070 con 0x7f3bec1055d0 2024-05-08T05:34:55.588 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:34:55.586+0000 7f3bf1800700 1 -- 172.21.15.87:0/2256290191 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f3bd00b2900 msgr2=0x7f3bd00b4dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:34:55.588 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:34:55.586+0000 7f3bf1800700 1 --2- 172.21.15.87:0/2256290191 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f3bd00b2900 0x7f3bd00b4dc0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f3bec102ef0 tx=0x7f3bd8009260 comp rx=0 tx=0).stop 2024-05-08T05:34:55.588 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:34:55.586+0000 7f3bf1800700 1 -- 172.21.15.87:0/2256290191 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3bec1055d0 msgr2=0x7f3bec1a1800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:34:55.588 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:34:55.586+0000 7f3bf1800700 1 --2- 172.21.15.87:0/2256290191 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3bec1055d0 0x7f3bec1a1800 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f3bdc00ea50 tx=0x7f3bdc00ed60 comp rx=0 tx=0).stop 2024-05-08T05:34:55.589 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:34:55.588+0000 7f3bf1800700 1 -- 172.21.15.87:0/2256290191 shutdown_connections 2024-05-08T05:34:55.589 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:34:55.588+0000 7f3bf1800700 1 --2- 172.21.15.87:0/2256290191 >> [v2:172.21.15.87:6800/1189186457,v1:172.21.15.87:6801/1189186457] conn(0x7f3bd00b2900 0x7f3bd00b4dc0 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:34:55.589 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:34:55.588+0000 7f3bf1800700 1 --2- 172.21.15.87:0/2256290191 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3bec10b660 0x7f3bec19b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:34:55.589 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:34:55.588+0000 7f3bf1800700 1 --2- 172.21.15.87:0/2256290191 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3bec1055d0 0x7f3bec1a1800 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:34:55.589 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:34:55.588+0000 7f3bf1800700 1 --2- 172.21.15.87:0/2256290191 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3bec105f90 0x7f3bec1a1d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:34:55.589 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:34:55.588+0000 7f3bf1800700 1 -- 172.21.15.87:0/2256290191 >> 172.21.15.87:0/2256290191 conn(0x7f3bec1010c0 msgr2=0x7f3bec1092f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:34:55.590 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:34:55.589+0000 7f3bf1800700 1 -- 172.21.15.87:0/2256290191 shutdown_connections 2024-05-08T05:34:55.590 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T05:34:55.589+0000 7f3bf1800700 1 -- 172.21.15.87:0/2256290191 wait complete. 2024-05-08T05:34:55.593 INFO:teuthology.orchestra.run.smithi087.stderr:pool 'cephfs_data' removed 2024-05-08T05:34:55.950 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:34:55 smithi087 ceph-mon[29523]: from='client.? 172.21.15.87:0/2256290191' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]: dispatch 2024-05-08T05:34:55.951 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:34:55 smithi087 ceph-mon[29523]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]: dispatch 2024-05-08T05:34:55.983 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:34:55 smithi090 ceph-mon[34526]: from='client.? 172.21.15.87:0/2256290191' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]: dispatch 2024-05-08T05:34:55.983 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:34:55 smithi090 ceph-mon[34526]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]: dispatch 2024-05-08T05:34:56.038 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:34:55 smithi160 ceph-mon[34827]: from='client.? 172.21.15.87:0/2256290191' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]: dispatch 2024-05-08T05:34:56.039 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:34:55 smithi160 ceph-mon[34827]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]: dispatch 2024-05-08T05:34:56.359 DEBUG:teuthology.orchestra.run.smithi087:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-05-08T05:34:56.427 DEBUG:teuthology.orchestra.run.smithi090:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-05-08T05:34:56.455 DEBUG:teuthology.orchestra.run.smithi160:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-05-08T05:34:56.482 INFO:tasks.cephadm:Cleaning up testdir ceph.* files... 2024-05-08T05:34:56.482 DEBUG:teuthology.orchestra.run.smithi087:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-05-08T05:34:56.527 DEBUG:teuthology.orchestra.run.smithi090:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-05-08T05:34:56.542 DEBUG:teuthology.orchestra.run.smithi160:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-05-08T05:34:56.556 INFO:tasks.cephadm:Stopping all daemons... 2024-05-08T05:34:56.557 INFO:tasks.cephadm.mon.a:Stopping mon.a... 2024-05-08T05:34:56.557 DEBUG:teuthology.orchestra.run.smithi087:> sudo systemctl stop ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968@mon.a 2024-05-08T05:34:56.733 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:34:56 smithi090 ceph-mon[34526]: pgmap v600: 65 pgs: 65 active+clean; 577 KiB data, 683 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-08T05:34:56.733 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:34:56 smithi090 ceph-mon[34526]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]': finished 2024-05-08T05:34:56.733 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:34:56 smithi090 ceph-mon[34526]: osdmap e85: 12 total, 12 up, 12 in 2024-05-08T05:34:56.733 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:34:56 smithi090 ceph-mon[34526]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T05:34:56.788 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:34:56 smithi160 ceph-mon[34827]: pgmap v600: 65 pgs: 65 active+clean; 577 KiB data, 683 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-08T05:34:56.788 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:34:56 smithi160 ceph-mon[34827]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]': finished 2024-05-08T05:34:56.788 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:34:56 smithi160 ceph-mon[34827]: osdmap e85: 12 total, 12 up, 12 in 2024-05-08T05:34:56.789 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:34:56 smithi160 ceph-mon[34827]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T05:34:56.958 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:34:56 smithi087 ceph-mon[29523]: pgmap v600: 65 pgs: 65 active+clean; 577 KiB data, 683 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-08T05:34:56.958 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:34:56 smithi087 ceph-mon[29523]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]': finished 2024-05-08T05:34:56.958 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:34:56 smithi087 ceph-mon[29523]: osdmap e85: 12 total, 12 up, 12 in 2024-05-08T05:34:56.959 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:34:56 smithi087 ceph-mon[29523]: from='mgr.14152 172.21.15.87:0/2327281680' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T05:34:56.959 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:34:56 smithi087 systemd[1]: Stopping Ceph mon.a for eeeb813e-0cf9-11ef-bc97-c7b262605968... 2024-05-08T05:34:57.430 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:34:57 smithi087 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-mon-a[29519]: 2024-05-08T05:34:57.097+0000 7f12e2800700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-05-08T05:34:57.430 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:34:57 smithi087 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-mon-a[29519]: 2024-05-08T05:34:57.097+0000 7f12e2800700 -1 mon.a@0(leader) e3 *** Got Signal Terminated *** 2024-05-08T05:34:57.430 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:34:57 smithi087 podman[96662]: 2024-05-08 05:34:57.150097957 +0000 UTC m=+0.202538441 container died a734a965374b987d174d01573bfbf349ec0955099f881849964b5e9127b3d8ab (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a, name=ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-mon-a, CEPH_POINT_RELEASE=, ceph=True, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240507, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, RELEASE=wip-57676-3-bee299f) 2024-05-08T05:34:58.056 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:34:57 smithi087 podman[96662]: 2024-05-08 05:34:57.742450277 +0000 UTC m=+0.794890790 container cleanup a734a965374b987d174d01573bfbf349ec0955099f881849964b5e9127b3d8ab (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a, name=ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-mon-a, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , ceph=True, GIT_CLEAN=True, org.label-schema.build-date=20240507, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, RELEASE=wip-57676-3-bee299f, CEPH_POINT_RELEASE=) 2024-05-08T05:34:58.056 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:34:57 smithi087 bash[96662]: ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-mon-a 2024-05-08T05:34:58.313 INFO:journalctl@ceph.mon.a.smithi087.stdout:May 08 05:34:58 smithi087 podman[96683]: 2024-05-08 05:34:58.055238915 +0000 UTC m=+0.894082955 container remove a734a965374b987d174d01573bfbf349ec0955099f881849964b5e9127b3d8ab (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a, name=ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-mon-a, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240507, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-57676-3-bee299f, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_CLEAN=True) 2024-05-08T05:34:58.347 DEBUG:teuthology.orchestra.run.smithi087:> sudo pkill -f 'journalctl -f -n 0 -u ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968@mon.a.service' 2024-05-08T05:34:58.483 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-08T05:34:58.483 INFO:tasks.cephadm.mon.a:Stopped mon.a 2024-05-08T05:34:58.483 INFO:tasks.cephadm.mon.c:Stopping mon.b... 2024-05-08T05:34:58.483 DEBUG:teuthology.orchestra.run.smithi090:> sudo systemctl stop ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968@mon.b 2024-05-08T05:34:58.786 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:34:58 smithi090 systemd[1]: Stopping Ceph mon.b for eeeb813e-0cf9-11ef-bc97-c7b262605968... 2024-05-08T05:34:59.119 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:34:58 smithi090 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-mon-b[34522]: 2024-05-08T05:34:58.784+0000 7fa922bf2700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.b -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-05-08T05:34:59.119 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:34:58 smithi090 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-mon-b[34522]: 2024-05-08T05:34:58.784+0000 7fa922bf2700 -1 mon.b@2(peon) e3 *** Got Signal Terminated *** 2024-05-08T05:34:59.119 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:34:58 smithi090 podman[68527]: 2024-05-08 05:34:58.856868423 +0000 UTC m=+0.175813871 container died aa13368ec9bc64f9b16f6008f6d1565cbb52659f648dc98ab25c7bc42d721a12 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c, name=ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-mon-b, ceph=True, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, GIT_CLEAN=True, RELEASE=wip-57676-3-bee299f, org.label-schema.build-date=20240507, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image) 2024-05-08T05:34:59.483 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:34:59 smithi090 podman[68527]: 2024-05-08 05:34:59.219232512 +0000 UTC m=+0.538177968 container cleanup aa13368ec9bc64f9b16f6008f6d1565cbb52659f648dc98ab25c7bc42d721a12 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c, name=ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-mon-b, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, ceph=True, RELEASE=wip-57676-3-bee299f, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240507) 2024-05-08T05:34:59.483 INFO:journalctl@ceph.mon.b.smithi090.stdout:May 08 05:34:59 smithi090 bash[68527]: ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-mon-b 2024-05-08T05:34:59.589 DEBUG:teuthology.orchestra.run.smithi090:> sudo pkill -f 'journalctl -f -n 0 -u ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968@mon.b.service' 2024-05-08T05:34:59.636 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-08T05:34:59.636 INFO:tasks.cephadm.mon.c:Stopped mon.b 2024-05-08T05:34:59.636 INFO:tasks.cephadm.mon.c:Stopping mon.c... 2024-05-08T05:34:59.636 DEBUG:teuthology.orchestra.run.smithi160:> sudo systemctl stop ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968@mon.c 2024-05-08T05:34:59.954 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:34:59 smithi160 systemd[1]: Stopping Ceph mon.c for eeeb813e-0cf9-11ef-bc97-c7b262605968... 2024-05-08T05:35:00.220 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:34:59 smithi160 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-mon-c[34809]: 2024-05-08T05:34:59.953+0000 7f859cab3700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.c -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-05-08T05:35:00.220 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:34:59 smithi160 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-mon-c[34809]: 2024-05-08T05:34:59.953+0000 7f859cab3700 -1 mon.c@1(peon) e3 *** Got Signal Terminated *** 2024-05-08T05:35:00.488 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:35:00 smithi160 podman[69443]: 2024-05-08 05:35:00.220103981 +0000 UTC m=+0.383888448 container died fa092eda2d2b3e7f8ae79501805e661a0c0c425b6bb1fd9e53e725e38b80c68a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c, name=ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-mon-c, maintainer=Guillaume Abrioux , GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240507, RELEASE=wip-57676-3-bee299f, ceph=True, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0) 2024-05-08T05:35:00.789 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:35:00 smithi160 podman[69443]: 2024-05-08 05:35:00.595817997 +0000 UTC m=+0.759602469 container cleanup fa092eda2d2b3e7f8ae79501805e661a0c0c425b6bb1fd9e53e725e38b80c68a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c, name=ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-mon-c, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, RELEASE=wip-57676-3-bee299f, ceph=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240507) 2024-05-08T05:35:00.789 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 08 05:35:00 smithi160 bash[69443]: ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-mon-c 2024-05-08T05:35:01.012 DEBUG:teuthology.orchestra.run.smithi160:> sudo pkill -f 'journalctl -f -n 0 -u ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968@mon.c.service' 2024-05-08T05:35:01.054 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-08T05:35:01.054 INFO:tasks.cephadm.mon.c:Stopped mon.c 2024-05-08T05:35:01.055 INFO:tasks.cephadm.mgr.x:Stopping mgr.x... 2024-05-08T05:35:01.055 DEBUG:teuthology.orchestra.run.smithi087:> sudo systemctl stop ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968@mgr.x 2024-05-08T05:35:01.458 INFO:journalctl@ceph.mgr.x.smithi087.stdout:May 08 05:35:01 smithi087 systemd[1]: Stopping Ceph mgr.x for eeeb813e-0cf9-11ef-bc97-c7b262605968... 2024-05-08T05:35:01.959 INFO:journalctl@ceph.mgr.x.smithi087.stdout:May 08 05:35:01 smithi087 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-mgr-x[29765]: 2024-05-08T05:35:01.606+0000 7f6e38a00700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mgr -n mgr.x -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-05-08T05:35:01.959 INFO:journalctl@ceph.mgr.x.smithi087.stdout:May 08 05:35:01 smithi087 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-mgr-x[29765]: 2024-05-08T05:35:01.606+0000 7f6e38a00700 -1 mgr handle_mgr_signal *** Got signal Terminated *** 2024-05-08T05:35:01.959 INFO:journalctl@ceph.mgr.x.smithi087.stdout:May 08 05:35:01 smithi087 podman[96804]: 2024-05-08 05:35:01.700049891 +0000 UTC m=+0.255071584 container died 5f6ec6edab8d324166b0b30d541025f501361185ddb87d9f9ea0d02c47ca8404 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a, name=ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-mgr-x, RELEASE=wip-57676-3-bee299f, org.label-schema.license=GPLv2, org.label-schema.build-date=20240507, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.schema-version=1.0) 2024-05-08T05:35:02.404 INFO:journalctl@ceph.mgr.x.smithi087.stdout:May 08 05:35:02 smithi087 podman[96804]: 2024-05-08 05:35:02.142582701 +0000 UTC m=+0.697604408 container cleanup 5f6ec6edab8d324166b0b30d541025f501361185ddb87d9f9ea0d02c47ca8404 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a, name=ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-mgr-x, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240507, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, ceph=True, GIT_BRANCH=HEAD, RELEASE=wip-57676-3-bee299f, io.buildah.version=1.33.5) 2024-05-08T05:35:02.404 INFO:journalctl@ceph.mgr.x.smithi087.stdout:May 08 05:35:02 smithi087 bash[96804]: ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-mgr-x 2024-05-08T05:35:02.708 INFO:journalctl@ceph.mgr.x.smithi087.stdout:May 08 05:35:02 smithi087 podman[96818]: 2024-05-08 05:35:02.402349264 +0000 UTC m=+0.685903776 container remove 5f6ec6edab8d324166b0b30d541025f501361185ddb87d9f9ea0d02c47ca8404 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a, name=ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-mgr-x, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, RELEASE=wip-57676-3-bee299f, ceph=True, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240507, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image) 2024-05-08T05:35:02.926 DEBUG:teuthology.orchestra.run.smithi087:> sudo pkill -f 'journalctl -f -n 0 -u ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968@mgr.x.service' 2024-05-08T05:35:03.037 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-08T05:35:03.037 INFO:tasks.cephadm.mgr.x:Stopped mgr.x 2024-05-08T05:35:03.038 INFO:tasks.cephadm.mgr.y:Stopping mgr.y... 2024-05-08T05:35:03.038 DEBUG:teuthology.orchestra.run.smithi090:> sudo systemctl stop ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968@mgr.y 2024-05-08T05:35:03.378 INFO:journalctl@ceph.mgr.y.smithi090.stdout:May 08 05:35:03 smithi090 systemd[1]: Stopping Ceph mgr.y for eeeb813e-0cf9-11ef-bc97-c7b262605968... 2024-05-08T05:35:03.652 INFO:journalctl@ceph.mgr.y.smithi090.stdout:May 08 05:35:03 smithi090 podman[68650]: 2024-05-08 05:35:03.37858272 +0000 UTC m=+0.140499512 container died 3bdf571c19ca6c4dca43744eb8f32abe9a188d9ea5f2a8ea0d9f62bb49ab0cf9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c, name=ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-mgr-y, RELEASE=wip-57676-3-bee299f, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_CLEAN=True, ceph=True, GIT_BRANCH=HEAD, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240507, org.label-schema.name=CentOS Stream 8 Base Image) 2024-05-08T05:35:03.983 INFO:journalctl@ceph.mgr.y.smithi090.stdout:May 08 05:35:03 smithi090 podman[68650]: 2024-05-08 05:35:03.743038045 +0000 UTC m=+0.504954834 container cleanup 3bdf571c19ca6c4dca43744eb8f32abe9a188d9ea5f2a8ea0d9f62bb49ab0cf9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c, name=ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-mgr-y, ceph=True, org.label-schema.build-date=20240507, org.label-schema.license=GPLv2, RELEASE=wip-57676-3-bee299f, CEPH_POINT_RELEASE=, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0) 2024-05-08T05:35:03.983 INFO:journalctl@ceph.mgr.y.smithi090.stdout:May 08 05:35:03 smithi090 bash[68650]: ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-mgr-y 2024-05-08T05:35:04.162 DEBUG:teuthology.orchestra.run.smithi090:> sudo pkill -f 'journalctl -f -n 0 -u ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968@mgr.y.service' 2024-05-08T05:35:04.195 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-08T05:35:04.196 INFO:tasks.cephadm.mgr.y:Stopped mgr.y 2024-05-08T05:35:04.196 INFO:tasks.cephadm.mgr.z:Stopping mgr.z... 2024-05-08T05:35:04.196 DEBUG:teuthology.orchestra.run.smithi160:> sudo systemctl stop ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968@mgr.z 2024-05-08T05:35:04.512 INFO:journalctl@ceph.mgr.z.smithi160.stdout:May 08 05:35:04 smithi160 systemd[1]: Stopping Ceph mgr.z for eeeb813e-0cf9-11ef-bc97-c7b262605968... 2024-05-08T05:35:04.788 INFO:journalctl@ceph.mgr.z.smithi160.stdout:May 08 05:35:04 smithi160 podman[69566]: 2024-05-08 05:35:04.51290499 +0000 UTC m=+0.124488624 container died e76bf39dc4c4ae85f8fb9476b65d925a66e858f9aa340c36e448f1aa2e31c591 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c, name=ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-mgr-z, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_CLEAN=True, CEPH_POINT_RELEASE=, RELEASE=wip-57676-3-bee299f, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240507, ceph=True, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image) 2024-05-08T05:35:05.143 INFO:journalctl@ceph.mgr.z.smithi160.stdout:May 08 05:35:04 smithi160 podman[69566]: 2024-05-08 05:35:04.900285239 +0000 UTC m=+0.511868864 container cleanup e76bf39dc4c4ae85f8fb9476b65d925a66e858f9aa340c36e448f1aa2e31c591 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c, name=ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-mgr-z, org.label-schema.schema-version=1.0, RELEASE=wip-57676-3-bee299f, org.label-schema.build-date=20240507, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_CLEAN=True, io.buildah.version=1.33.5, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, GIT_BRANCH=HEAD, ceph=True, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux ) 2024-05-08T05:35:05.143 INFO:journalctl@ceph.mgr.z.smithi160.stdout:May 08 05:35:04 smithi160 bash[69566]: ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-mgr-z 2024-05-08T05:35:05.312 DEBUG:teuthology.orchestra.run.smithi160:> sudo pkill -f 'journalctl -f -n 0 -u ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968@mgr.z.service' 2024-05-08T05:35:05.344 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-08T05:35:05.345 INFO:tasks.cephadm.mgr.z:Stopped mgr.z 2024-05-08T05:35:05.345 INFO:tasks.cephadm.osd.0:Stopping osd.0... 2024-05-08T05:35:05.345 DEBUG:teuthology.orchestra.run.smithi087:> sudo systemctl stop ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968@osd.0 2024-05-08T05:35:05.708 INFO:journalctl@ceph.osd.0.smithi087.stdout:May 08 05:35:05 smithi087 systemd[1]: Stopping Ceph osd.0 for eeeb813e-0cf9-11ef-bc97-c7b262605968... 2024-05-08T05:35:06.208 INFO:journalctl@ceph.osd.0.smithi087.stdout:May 08 05:35:05 smithi087 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-0[44115]: 2024-05-08T05:35:05.910+0000 7f7f3de00700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.0 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-05-08T05:35:06.209 INFO:journalctl@ceph.osd.0.smithi087.stdout:May 08 05:35:05 smithi087 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-0[44115]: 2024-05-08T05:35:05.910+0000 7f7f3de00700 -1 osd.0 85 *** Got signal Terminated *** 2024-05-08T05:35:06.209 INFO:journalctl@ceph.osd.0.smithi087.stdout:May 08 05:35:05 smithi087 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-0[44115]: 2024-05-08T05:35:05.910+0000 7f7f3de00700 -1 osd.0 85 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-05-08T05:35:11.761 INFO:journalctl@ceph.osd.0.smithi087.stdout:May 08 05:35:11 smithi087 podman[96923]: 2024-05-08 05:35:11.462612838 +0000 UTC m=+5.707126748 container died 8bd16d592244bc4e17ca8b7e742b61eba7126b789b2e5577745f7899435c7e54 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c, name=ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-0, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-57676-3-bee299f, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240507, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504) 2024-05-08T05:35:12.208 INFO:journalctl@ceph.osd.0.smithi087.stdout:May 08 05:35:11 smithi087 podman[96923]: 2024-05-08 05:35:11.988592571 +0000 UTC m=+6.233106497 container cleanup 8bd16d592244bc4e17ca8b7e742b61eba7126b789b2e5577745f7899435c7e54 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c, name=ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-0, ceph=True, GIT_BRANCH=HEAD, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, RELEASE=wip-57676-3-bee299f, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240507, io.buildah.version=1.33.5, GIT_CLEAN=True) 2024-05-08T05:35:12.208 INFO:journalctl@ceph.osd.0.smithi087.stdout:May 08 05:35:11 smithi087 bash[96923]: ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-0 2024-05-08T05:35:12.708 INFO:journalctl@ceph.osd.0.smithi087.stdout:May 08 05:35:12 smithi087 podman[96943]: 2024-05-08 05:35:12.340736479 +0000 UTC m=+0.862158671 container remove 8bd16d592244bc4e17ca8b7e742b61eba7126b789b2e5577745f7899435c7e54 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c, name=ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-0, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, RELEASE=wip-57676-3-bee299f, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, ceph=True, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.build-date=20240507, org.label-schema.vendor=CentOS) 2024-05-08T05:35:13.521 INFO:journalctl@ceph.osd.0.smithi087.stdout:May 08 05:35:13 smithi087 podman[97029]: 2024-05-08 05:35:13.129310806 +0000 UTC m=+0.036570449 image pull 352576a2df49fbab3aeeba1effbcb7a94815e8fc1f120a55ddc340b4ee63b8ce quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c 2024-05-08T05:35:13.521 INFO:journalctl@ceph.osd.0.smithi087.stdout:May 08 05:35:13 smithi087 podman[97029]: 2024-05-08 05:35:13.241533934 +0000 UTC m=+0.148793607 container create 33b39170c6dad557297686fcfb9434f16eeac1f949bc436eafd4b8857f2a31ba (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c, name=ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-0-deactivate, org.label-schema.build-date=20240507, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, RELEASE=wip-57676-3-bee299f, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_CLEAN=True) 2024-05-08T05:35:13.522 INFO:journalctl@ceph.osd.0.smithi087.stdout:May 08 05:35:13 smithi087 podman[97029]: 2024-05-08 05:35:13.520408841 +0000 UTC m=+0.427668524 container init 33b39170c6dad557297686fcfb9434f16eeac1f949bc436eafd4b8857f2a31ba (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c, name=ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-0-deactivate, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, GIT_CLEAN=True, RELEASE=wip-57676-3-bee299f, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240507) 2024-05-08T05:35:13.958 INFO:journalctl@ceph.osd.0.smithi087.stdout:May 08 05:35:13 smithi087 podman[97029]: 2024-05-08 05:35:13.532237244 +0000 UTC m=+0.439496889 container start 33b39170c6dad557297686fcfb9434f16eeac1f949bc436eafd4b8857f2a31ba (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c, name=ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-0-deactivate, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.build-date=20240507, RELEASE=wip-57676-3-bee299f, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-05-08T05:35:13.958 INFO:journalctl@ceph.osd.0.smithi087.stdout:May 08 05:35:13 smithi087 podman[97029]: 2024-05-08 05:35:13.61892405 +0000 UTC m=+0.526183773 container attach 33b39170c6dad557297686fcfb9434f16eeac1f949bc436eafd4b8857f2a31ba (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c, name=ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-0-deactivate, org.label-schema.build-date=20240507, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, ceph=True, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, RELEASE=wip-57676-3-bee299f, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, GIT_CLEAN=True, maintainer=Guillaume Abrioux ) 2024-05-08T05:35:14.326 INFO:journalctl@ceph.osd.0.smithi087.stdout:May 08 05:35:13 smithi087 podman[97029]: 2024-05-08 05:35:13.986311604 +0000 UTC m=+0.893571250 container died 33b39170c6dad557297686fcfb9434f16eeac1f949bc436eafd4b8857f2a31ba (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c, name=ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-0-deactivate, GIT_BRANCH=HEAD, org.label-schema.build-date=20240507, RELEASE=wip-57676-3-bee299f, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS) 2024-05-08T05:35:14.735 DEBUG:teuthology.orchestra.run.smithi087:> sudo pkill -f 'journalctl -f -n 0 -u ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968@osd.0.service' 2024-05-08T05:35:14.846 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-08T05:35:14.846 INFO:tasks.cephadm.osd.0:Stopped osd.0 2024-05-08T05:35:14.846 INFO:tasks.cephadm.osd.1:Stopping osd.1... 2024-05-08T05:35:14.846 DEBUG:teuthology.orchestra.run.smithi090:> sudo systemctl stop ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968@osd.1 2024-05-08T05:35:15.157 INFO:journalctl@ceph.osd.1.smithi090.stdout:May 08 05:35:14 smithi090 systemd[1]: Stopping Ceph osd.1 for eeeb813e-0cf9-11ef-bc97-c7b262605968... 2024-05-08T05:35:15.483 INFO:journalctl@ceph.osd.1.smithi090.stdout:May 08 05:35:15 smithi090 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-1[39118]: 2024-05-08T05:35:15.157+0000 7f18946c0700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.1 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-05-08T05:35:15.483 INFO:journalctl@ceph.osd.1.smithi090.stdout:May 08 05:35:15 smithi090 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-1[39118]: 2024-05-08T05:35:15.157+0000 7f18946c0700 -1 osd.1 85 *** Got signal Terminated *** 2024-05-08T05:35:15.483 INFO:journalctl@ceph.osd.1.smithi090.stdout:May 08 05:35:15 smithi090 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-1[39118]: 2024-05-08T05:35:15.157+0000 7f18946c0700 -1 osd.1 85 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-05-08T05:35:20.877 INFO:journalctl@ceph.osd.1.smithi090.stdout:May 08 05:35:20 smithi090 podman[68776]: 2024-05-08 05:35:20.584657607 +0000 UTC m=+5.549698404 container died 1e0283141b4edaa52c7d31a320704987f623a931290faaebc82144fbea9f01ac (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c, name=ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-1, ceph=True, RELEASE=wip-57676-3-bee299f, CEPH_POINT_RELEASE=, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.build-date=20240507, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, GIT_CLEAN=True, org.label-schema.license=GPLv2) 2024-05-08T05:35:21.227 INFO:journalctl@ceph.osd.1.smithi090.stdout:May 08 05:35:20 smithi090 podman[68776]: 2024-05-08 05:35:20.975949147 +0000 UTC m=+5.940989939 container cleanup 1e0283141b4edaa52c7d31a320704987f623a931290faaebc82144fbea9f01ac (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c, name=ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-1, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_CLEAN=True, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.build-date=20240507, RELEASE=wip-57676-3-bee299f) 2024-05-08T05:35:21.227 INFO:journalctl@ceph.osd.1.smithi090.stdout:May 08 05:35:20 smithi090 bash[68776]: ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-1 2024-05-08T05:35:21.483 INFO:journalctl@ceph.osd.1.smithi090.stdout:May 08 05:35:21 smithi090 podman[68793]: 2024-05-08 05:35:21.227346061 +0000 UTC m=+0.637004439 container remove 1e0283141b4edaa52c7d31a320704987f623a931290faaebc82144fbea9f01ac (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c, name=ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-1, io.buildah.version=1.33.5, RELEASE=wip-57676-3-bee299f, ceph=True, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240507, org.label-schema.name=CentOS Stream 8 Base Image) 2024-05-08T05:35:21.864 INFO:journalctl@ceph.osd.1.smithi090.stdout:May 08 05:35:21 smithi090 podman[68881]: 2024-05-08 05:35:21.447214122 +0000 UTC m=+0.017966723 image pull 352576a2df49fbab3aeeba1effbcb7a94815e8fc1f120a55ddc340b4ee63b8ce quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c 2024-05-08T05:35:21.864 INFO:journalctl@ceph.osd.1.smithi090.stdout:May 08 05:35:21 smithi090 podman[68881]: 2024-05-08 05:35:21.553617949 +0000 UTC m=+0.124370581 container create e512c1b5f2fb876125af45bf84b04a40e223bc0d82710eb772f32fcb369cd695 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c, name=ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-1-deactivate, org.label-schema.schema-version=1.0, ceph=True, maintainer=Guillaume Abrioux , GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, org.label-schema.build-date=20240507, RELEASE=wip-57676-3-bee299f, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, CEPH_POINT_RELEASE=) 2024-05-08T05:35:21.864 INFO:journalctl@ceph.osd.1.smithi090.stdout:May 08 05:35:21 smithi090 podman[68881]: 2024-05-08 05:35:21.772831355 +0000 UTC m=+0.343583945 container init e512c1b5f2fb876125af45bf84b04a40e223bc0d82710eb772f32fcb369cd695 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c, name=ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-1-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-57676-3-bee299f, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.build-date=20240507, org.label-schema.schema-version=1.0, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS) 2024-05-08T05:35:21.864 INFO:journalctl@ceph.osd.1.smithi090.stdout:May 08 05:35:21 smithi090 podman[68881]: 2024-05-08 05:35:21.775866967 +0000 UTC m=+0.346619560 container start e512c1b5f2fb876125af45bf84b04a40e223bc0d82710eb772f32fcb369cd695 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c, name=ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-1-deactivate, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240507, GIT_BRANCH=HEAD, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.schema-version=1.0, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, RELEASE=wip-57676-3-bee299f, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5) 2024-05-08T05:35:22.234 INFO:journalctl@ceph.osd.1.smithi090.stdout:May 08 05:35:21 smithi090 podman[68881]: 2024-05-08 05:35:21.864521795 +0000 UTC m=+0.435274396 container attach e512c1b5f2fb876125af45bf84b04a40e223bc0d82710eb772f32fcb369cd695 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c, name=ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-1-deactivate, io.buildah.version=1.33.5, ceph=True, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240507, CEPH_POINT_RELEASE=, RELEASE=wip-57676-3-bee299f, maintainer=Guillaume Abrioux , GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-05-08T05:35:22.234 INFO:journalctl@ceph.osd.1.smithi090.stdout:May 08 05:35:22 smithi090 podman[68881]: 2024-05-08 05:35:22.068066798 +0000 UTC m=+0.638819397 container died e512c1b5f2fb876125af45bf84b04a40e223bc0d82710eb772f32fcb369cd695 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c, name=ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-1-deactivate, ceph=True, org.label-schema.build-date=20240507, RELEASE=wip-57676-3-bee299f, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, io.buildah.version=1.33.5) 2024-05-08T05:35:22.686 DEBUG:teuthology.orchestra.run.smithi090:> sudo pkill -f 'journalctl -f -n 0 -u ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968@osd.1.service' 2024-05-08T05:35:22.724 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-08T05:35:22.724 INFO:tasks.cephadm.osd.1:Stopped osd.1 2024-05-08T05:35:22.724 INFO:tasks.cephadm.osd.2:Stopping osd.2... 2024-05-08T05:35:22.724 DEBUG:teuthology.orchestra.run.smithi160:> sudo systemctl stop ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968@osd.2 2024-05-08T05:35:23.012 INFO:journalctl@ceph.osd.2.smithi160.stdout:May 08 05:35:22 smithi160 systemd[1]: Stopping Ceph osd.2 for eeeb813e-0cf9-11ef-bc97-c7b262605968... 2024-05-08T05:35:23.288 INFO:journalctl@ceph.osd.2.smithi160.stdout:May 08 05:35:23 smithi160 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-2[39945]: 2024-05-08T05:35:23.011+0000 7f38cf291700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.2 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-05-08T05:35:23.289 INFO:journalctl@ceph.osd.2.smithi160.stdout:May 08 05:35:23 smithi160 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-2[39945]: 2024-05-08T05:35:23.011+0000 7f38cf291700 -1 osd.2 85 *** Got signal Terminated *** 2024-05-08T05:35:23.289 INFO:journalctl@ceph.osd.2.smithi160.stdout:May 08 05:35:23 smithi160 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-2[39945]: 2024-05-08T05:35:23.011+0000 7f38cf291700 -1 osd.2 85 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-05-08T05:35:28.789 INFO:journalctl@ceph.osd.2.smithi160.stdout:May 08 05:35:28 smithi160 podman[69702]: 2024-05-08 05:35:28.510534874 +0000 UTC m=+5.584636293 container died 2d51adbd9866b578d783ac670560f88eadceffd0f8874652af004aac3bd94cd8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c, name=ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-2, org.label-schema.license=GPLv2, GIT_CLEAN=True, RELEASE=wip-57676-3-bee299f, ceph=True, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.build-date=20240507, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux ) 2024-05-08T05:35:29.288 INFO:journalctl@ceph.osd.2.smithi160.stdout:May 08 05:35:28 smithi160 podman[69702]: 2024-05-08 05:35:28.820203184 +0000 UTC m=+5.894304610 container cleanup 2d51adbd9866b578d783ac670560f88eadceffd0f8874652af004aac3bd94cd8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c, name=ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-2, GIT_BRANCH=HEAD, org.label-schema.build-date=20240507, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, ceph=True, io.buildah.version=1.33.5, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-57676-3-bee299f, CEPH_POINT_RELEASE=) 2024-05-08T05:35:29.289 INFO:journalctl@ceph.osd.2.smithi160.stdout:May 08 05:35:28 smithi160 bash[69702]: ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-2 2024-05-08T05:35:29.289 INFO:journalctl@ceph.osd.2.smithi160.stdout:May 08 05:35:29 smithi160 podman[69721]: 2024-05-08 05:35:29.029962033 +0000 UTC m=+0.513325951 container remove 2d51adbd9866b578d783ac670560f88eadceffd0f8874652af004aac3bd94cd8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c, name=ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-2, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240507, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_CLEAN=True, CEPH_POINT_RELEASE=, ceph=True, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-57676-3-bee299f) 2024-05-08T05:35:29.733 INFO:journalctl@ceph.osd.2.smithi160.stdout:May 08 05:35:29 smithi160 podman[69813]: 2024-05-08 05:35:29.335714313 +0000 UTC m=+0.017997579 image pull 352576a2df49fbab3aeeba1effbcb7a94815e8fc1f120a55ddc340b4ee63b8ce quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c 2024-05-08T05:35:29.733 INFO:journalctl@ceph.osd.2.smithi160.stdout:May 08 05:35:29 smithi160 podman[69813]: 2024-05-08 05:35:29.472569989 +0000 UTC m=+0.154853271 container create c9a07dbc5c627c7b64176d107a0263067d7850953621a1329829984a550332b6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c, name=ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-2-deactivate, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, ceph=True, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240507, RELEASE=wip-57676-3-bee299f) 2024-05-08T05:35:29.733 INFO:journalctl@ceph.osd.2.smithi160.stdout:May 08 05:35:29 smithi160 podman[69813]: 2024-05-08 05:35:29.733123972 +0000 UTC m=+0.415407211 container init c9a07dbc5c627c7b64176d107a0263067d7850953621a1329829984a550332b6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c, name=ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-2-deactivate, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_CLEAN=True, ceph=True, maintainer=Guillaume Abrioux , RELEASE=wip-57676-3-bee299f, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240507, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0) 2024-05-08T05:35:30.033 INFO:journalctl@ceph.osd.2.smithi160.stdout:May 08 05:35:29 smithi160 podman[69813]: 2024-05-08 05:35:29.736880578 +0000 UTC m=+0.419163818 container start c9a07dbc5c627c7b64176d107a0263067d7850953621a1329829984a550332b6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c, name=ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-2-deactivate, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240507, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-57676-3-bee299f, GIT_CLEAN=True, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504) 2024-05-08T05:35:30.033 INFO:journalctl@ceph.osd.2.smithi160.stdout:May 08 05:35:29 smithi160 podman[69813]: 2024-05-08 05:35:29.816431694 +0000 UTC m=+0.498714944 container attach c9a07dbc5c627c7b64176d107a0263067d7850953621a1329829984a550332b6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c, name=ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-2-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, GIT_BRANCH=HEAD, org.label-schema.build-date=20240507, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, RELEASE=wip-57676-3-bee299f, maintainer=Guillaume Abrioux ) 2024-05-08T05:35:30.288 INFO:journalctl@ceph.osd.2.smithi160.stdout:May 08 05:35:30 smithi160 podman[69813]: 2024-05-08 05:35:30.034223195 +0000 UTC m=+0.716506462 container died c9a07dbc5c627c7b64176d107a0263067d7850953621a1329829984a550332b6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c, name=ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-2-deactivate, GIT_CLEAN=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, ceph=True, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240507, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, RELEASE=wip-57676-3-bee299f, org.label-schema.schema-version=1.0, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504) 2024-05-08T05:35:30.632 DEBUG:teuthology.orchestra.run.smithi160:> sudo pkill -f 'journalctl -f -n 0 -u ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968@osd.2.service' 2024-05-08T05:35:30.670 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-08T05:35:30.671 INFO:tasks.cephadm.osd.2:Stopped osd.2 2024-05-08T05:35:30.671 INFO:tasks.cephadm.osd.3:Stopping osd.3... 2024-05-08T05:35:30.671 DEBUG:teuthology.orchestra.run.smithi087:> sudo systemctl stop ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968@osd.3 2024-05-08T05:35:31.180 INFO:journalctl@ceph.osd.3.smithi087.stdout:May 08 05:35:30 smithi087 systemd[1]: Stopping Ceph osd.3 for eeeb813e-0cf9-11ef-bc97-c7b262605968... 2024-05-08T05:35:31.460 INFO:journalctl@ceph.osd.3.smithi087.stdout:May 08 05:35:31 smithi087 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-3[51046]: 2024-05-08T05:35:31.273+0000 7f7306e00700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.3 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-05-08T05:35:31.460 INFO:journalctl@ceph.osd.3.smithi087.stdout:May 08 05:35:31 smithi087 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-3[51046]: 2024-05-08T05:35:31.273+0000 7f7306e00700 -1 osd.3 85 *** Got signal Terminated *** 2024-05-08T05:35:31.460 INFO:journalctl@ceph.osd.3.smithi087.stdout:May 08 05:35:31 smithi087 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-3[51046]: 2024-05-08T05:35:31.273+0000 7f7306e00700 -1 osd.3 85 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-05-08T05:35:32.208 INFO:journalctl@ceph.osd.3.smithi087.stdout:May 08 05:35:32 smithi087 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-3[51046]: 2024-05-08T05:35:32.026+0000 7f7302600700 -1 osd.3 85 heartbeat_check: no reply from 172.21.15.87:6806 osd.0 since back 2024-05-08T05:35:10.576231+0000 front 2024-05-08T05:35:10.575953+0000 (oldest deadline 2024-05-08T05:35:31.675597+0000) 2024-05-08T05:35:33.049 INFO:journalctl@ceph.osd.9.smithi087.stdout:May 08 05:35:32 smithi087 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-9[64574]: 2024-05-08T05:35:32.766+0000 7fb2f9800700 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.87:6806 osd.0 since back 2024-05-08T05:35:08.464101+0000 front 2024-05-08T05:35:08.464047+0000 (oldest deadline 2024-05-08T05:35:31.964171+0000) 2024-05-08T05:35:33.458 INFO:journalctl@ceph.osd.3.smithi087.stdout:May 08 05:35:33 smithi087 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-3[51046]: 2024-05-08T05:35:33.048+0000 7f7302600700 -1 osd.3 85 heartbeat_check: no reply from 172.21.15.87:6806 osd.0 since back 2024-05-08T05:35:10.576231+0000 front 2024-05-08T05:35:10.575953+0000 (oldest deadline 2024-05-08T05:35:31.675597+0000) 2024-05-08T05:35:34.208 INFO:journalctl@ceph.osd.9.smithi087.stdout:May 08 05:35:33 smithi087 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-9[64574]: 2024-05-08T05:35:33.806+0000 7fb2f9800700 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.87:6806 osd.0 since back 2024-05-08T05:35:08.464101+0000 front 2024-05-08T05:35:08.464047+0000 (oldest deadline 2024-05-08T05:35:31.964171+0000) 2024-05-08T05:35:34.209 INFO:journalctl@ceph.osd.3.smithi087.stdout:May 08 05:35:34 smithi087 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-3[51046]: 2024-05-08T05:35:34.013+0000 7f7302600700 -1 osd.3 85 heartbeat_check: no reply from 172.21.15.87:6806 osd.0 since back 2024-05-08T05:35:10.576231+0000 front 2024-05-08T05:35:10.575953+0000 (oldest deadline 2024-05-08T05:35:31.675597+0000) 2024-05-08T05:35:34.983 INFO:journalctl@ceph.osd.10.smithi090.stdout:May 08 05:35:34 smithi090 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-10[59300]: 2024-05-08T05:35:34.561+0000 7f515bdbb700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.87:6806 osd.0 since back 2024-05-08T05:35:09.330796+0000 front 2024-05-08T05:35:09.330921+0000 (oldest deadline 2024-05-08T05:35:34.030784+0000) 2024-05-08T05:35:35.042 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 08 05:35:34 smithi160 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-11[60042]: 2024-05-08T05:35:34.563+0000 7f0620c06700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.87:6806 osd.0 since back 2024-05-08T05:35:07.779525+0000 front 2024-05-08T05:35:07.779646+0000 (oldest deadline 2024-05-08T05:35:33.579761+0000) 2024-05-08T05:35:35.042 INFO:journalctl@ceph.osd.9.smithi087.stdout:May 08 05:35:34 smithi087 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-9[64574]: 2024-05-08T05:35:34.766+0000 7fb2f9800700 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.87:6806 osd.0 since back 2024-05-08T05:35:08.464101+0000 front 2024-05-08T05:35:08.464047+0000 (oldest deadline 2024-05-08T05:35:31.964171+0000) 2024-05-08T05:35:35.458 INFO:journalctl@ceph.osd.3.smithi087.stdout:May 08 05:35:35 smithi087 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-3[51046]: 2024-05-08T05:35:35.041+0000 7f7302600700 -1 osd.3 85 heartbeat_check: no reply from 172.21.15.87:6806 osd.0 since back 2024-05-08T05:35:10.576231+0000 front 2024-05-08T05:35:10.575953+0000 (oldest deadline 2024-05-08T05:35:31.675597+0000) 2024-05-08T05:35:35.894 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 08 05:35:35 smithi160 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-11[60042]: 2024-05-08T05:35:35.564+0000 7f0620c06700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.87:6806 osd.0 since back 2024-05-08T05:35:07.779525+0000 front 2024-05-08T05:35:07.779646+0000 (oldest deadline 2024-05-08T05:35:33.579761+0000) 2024-05-08T05:35:35.983 INFO:journalctl@ceph.osd.10.smithi090.stdout:May 08 05:35:35 smithi090 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-10[59300]: 2024-05-08T05:35:35.544+0000 7f515bdbb700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.87:6806 osd.0 since back 2024-05-08T05:35:09.330796+0000 front 2024-05-08T05:35:09.330921+0000 (oldest deadline 2024-05-08T05:35:34.030784+0000) 2024-05-08T05:35:36.066 INFO:journalctl@ceph.osd.9.smithi087.stdout:May 08 05:35:35 smithi087 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-9[64574]: 2024-05-08T05:35:35.784+0000 7fb2f9800700 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.87:6806 osd.0 since back 2024-05-08T05:35:08.464101+0000 front 2024-05-08T05:35:08.464047+0000 (oldest deadline 2024-05-08T05:35:31.964171+0000) 2024-05-08T05:35:36.288 INFO:journalctl@ceph.osd.5.smithi160.stdout:May 08 05:35:35 smithi160 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-5[46734]: 2024-05-08T05:35:35.894+0000 7f63301cd700 -1 osd.5 85 heartbeat_check: no reply from 172.21.15.87:6806 osd.0 since back 2024-05-08T05:35:10.763693+0000 front 2024-05-08T05:35:10.763544+0000 (oldest deadline 2024-05-08T05:35:35.463411+0000) 2024-05-08T05:35:36.458 INFO:journalctl@ceph.osd.3.smithi087.stdout:May 08 05:35:36 smithi087 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-3[51046]: 2024-05-08T05:35:36.065+0000 7f7302600700 -1 osd.3 85 heartbeat_check: no reply from 172.21.15.87:6806 osd.0 since back 2024-05-08T05:35:10.576231+0000 front 2024-05-08T05:35:10.575953+0000 (oldest deadline 2024-05-08T05:35:31.675597+0000) 2024-05-08T05:35:36.937 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 08 05:35:36 smithi160 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-11[60042]: 2024-05-08T05:35:36.554+0000 7f0620c06700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.87:6806 osd.0 since back 2024-05-08T05:35:07.779525+0000 front 2024-05-08T05:35:07.779646+0000 (oldest deadline 2024-05-08T05:35:33.579761+0000) 2024-05-08T05:35:36.983 INFO:journalctl@ceph.osd.10.smithi090.stdout:May 08 05:35:36 smithi090 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-10[59300]: 2024-05-08T05:35:36.564+0000 7f515bdbb700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.87:6806 osd.0 since back 2024-05-08T05:35:09.330796+0000 front 2024-05-08T05:35:09.330921+0000 (oldest deadline 2024-05-08T05:35:34.030784+0000) 2024-05-08T05:35:37.209 INFO:journalctl@ceph.osd.3.smithi087.stdout:May 08 05:35:36 smithi087 podman[97134]: 2024-05-08 05:35:36.882021028 +0000 UTC m=+5.761315989 container died 7ab6c382333bc01b5eadc075f267bfb29d835534d2e59e5c390a07739494a94b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c, name=ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-3, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, RELEASE=wip-57676-3-bee299f, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240507, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=) 2024-05-08T05:35:37.209 INFO:journalctl@ceph.osd.9.smithi087.stdout:May 08 05:35:36 smithi087 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-9[64574]: 2024-05-08T05:35:36.764+0000 7fb2f9800700 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.87:6806 osd.0 since back 2024-05-08T05:35:08.464101+0000 front 2024-05-08T05:35:08.464047+0000 (oldest deadline 2024-05-08T05:35:31.964171+0000) 2024-05-08T05:35:37.288 INFO:journalctl@ceph.osd.5.smithi160.stdout:May 08 05:35:36 smithi160 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-5[46734]: 2024-05-08T05:35:36.937+0000 7f63301cd700 -1 osd.5 85 heartbeat_check: no reply from 172.21.15.87:6806 osd.0 since back 2024-05-08T05:35:10.763693+0000 front 2024-05-08T05:35:10.763544+0000 (oldest deadline 2024-05-08T05:35:35.463411+0000) 2024-05-08T05:35:37.514 INFO:journalctl@ceph.osd.3.smithi087.stdout:May 08 05:35:37 smithi087 podman[97134]: 2024-05-08 05:35:37.433386165 +0000 UTC m=+6.312681094 container cleanup 7ab6c382333bc01b5eadc075f267bfb29d835534d2e59e5c390a07739494a94b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c, name=ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-3, ceph=True, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, RELEASE=wip-57676-3-bee299f, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240507, org.label-schema.vendor=CentOS, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD) 2024-05-08T05:35:37.514 INFO:journalctl@ceph.osd.3.smithi087.stdout:May 08 05:35:37 smithi087 bash[97134]: ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-3 2024-05-08T05:35:37.958 INFO:journalctl@ceph.osd.3.smithi087.stdout:May 08 05:35:37 smithi087 podman[97165]: 2024-05-08 05:35:37.626582927 +0000 UTC m=+0.720780195 container remove 7ab6c382333bc01b5eadc075f267bfb29d835534d2e59e5c390a07739494a94b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c, name=ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-3, RELEASE=wip-57676-3-bee299f, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.build-date=20240507, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True) 2024-05-08T05:35:37.959 INFO:journalctl@ceph.osd.9.smithi087.stdout:May 08 05:35:37 smithi087 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-9[64574]: 2024-05-08T05:35:37.728+0000 7fb2f9800700 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.87:6806 osd.0 since back 2024-05-08T05:35:08.464101+0000 front 2024-05-08T05:35:08.464047+0000 (oldest deadline 2024-05-08T05:35:31.964171+0000) 2024-05-08T05:35:37.959 INFO:journalctl@ceph.osd.6.smithi087.stdout:May 08 05:35:37 smithi087 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-6[58000]: 2024-05-08T05:35:37.513+0000 7f1aca000700 -1 osd.6 85 heartbeat_check: no reply from 172.21.15.87:6806 osd.0 since back 2024-05-08T05:35:10.790888+0000 front 2024-05-08T05:35:10.790808+0000 (oldest deadline 2024-05-08T05:35:36.690826+0000) 2024-05-08T05:35:37.982 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 08 05:35:37 smithi160 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-11[60042]: 2024-05-08T05:35:37.587+0000 7f0620c06700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.87:6806 osd.0 since back 2024-05-08T05:35:07.779525+0000 front 2024-05-08T05:35:07.779646+0000 (oldest deadline 2024-05-08T05:35:33.579761+0000) 2024-05-08T05:35:37.983 INFO:journalctl@ceph.osd.10.smithi090.stdout:May 08 05:35:37 smithi090 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-10[59300]: 2024-05-08T05:35:37.608+0000 7f515bdbb700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.87:6806 osd.0 since back 2024-05-08T05:35:09.330796+0000 front 2024-05-08T05:35:09.330921+0000 (oldest deadline 2024-05-08T05:35:34.030784+0000) 2024-05-08T05:35:38.288 INFO:journalctl@ceph.osd.5.smithi160.stdout:May 08 05:35:37 smithi160 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-5[46734]: 2024-05-08T05:35:37.982+0000 7f63301cd700 -1 osd.5 85 heartbeat_check: no reply from 172.21.15.87:6806 osd.0 since back 2024-05-08T05:35:10.763693+0000 front 2024-05-08T05:35:10.763544+0000 (oldest deadline 2024-05-08T05:35:35.463411+0000) 2024-05-08T05:35:38.740 INFO:journalctl@ceph.osd.9.smithi087.stdout:May 08 05:35:38 smithi087 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-9[64574]: 2024-05-08T05:35:38.687+0000 7fb2f9800700 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.87:6806 osd.0 since back 2024-05-08T05:35:08.464101+0000 front 2024-05-08T05:35:08.464047+0000 (oldest deadline 2024-05-08T05:35:31.964171+0000) 2024-05-08T05:35:38.740 INFO:journalctl@ceph.osd.6.smithi087.stdout:May 08 05:35:38 smithi087 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-6[58000]: 2024-05-08T05:35:38.474+0000 7f1aca000700 -1 osd.6 85 heartbeat_check: no reply from 172.21.15.87:6806 osd.0 since back 2024-05-08T05:35:10.790888+0000 front 2024-05-08T05:35:10.790808+0000 (oldest deadline 2024-05-08T05:35:36.690826+0000) 2024-05-08T05:35:38.741 INFO:journalctl@ceph.osd.3.smithi087.stdout:May 08 05:35:38 smithi087 podman[97254]: 2024-05-08 05:35:38.370640198 +0000 UTC m=+0.033885852 image pull 352576a2df49fbab3aeeba1effbcb7a94815e8fc1f120a55ddc340b4ee63b8ce quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c 2024-05-08T05:35:38.741 INFO:journalctl@ceph.osd.3.smithi087.stdout:May 08 05:35:38 smithi087 podman[97254]: 2024-05-08 05:35:38.469413728 +0000 UTC m=+0.132659419 container create 4a284ce1f92abb3c036cf8da3797d8719cb740443fb3744be01d8a80a6ad6726 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c, name=ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-3-deactivate, GIT_CLEAN=True, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240507, RELEASE=wip-57676-3-bee299f, org.label-schema.schema-version=1.0, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-05-08T05:35:38.788 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 08 05:35:38 smithi160 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-11[60042]: 2024-05-08T05:35:38.537+0000 7f0620c06700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.87:6806 osd.0 since back 2024-05-08T05:35:07.779525+0000 front 2024-05-08T05:35:07.779646+0000 (oldest deadline 2024-05-08T05:35:33.579761+0000) 2024-05-08T05:35:38.983 INFO:journalctl@ceph.osd.10.smithi090.stdout:May 08 05:35:38 smithi090 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-10[59300]: 2024-05-08T05:35:38.621+0000 7f515bdbb700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.87:6806 osd.0 since back 2024-05-08T05:35:09.330796+0000 front 2024-05-08T05:35:09.330921+0000 (oldest deadline 2024-05-08T05:35:34.030784+0000) 2024-05-08T05:35:39.197 INFO:journalctl@ceph.osd.3.smithi087.stdout:May 08 05:35:38 smithi087 podman[97254]: 2024-05-08 05:35:38.739773277 +0000 UTC m=+0.403018975 container init 4a284ce1f92abb3c036cf8da3797d8719cb740443fb3744be01d8a80a6ad6726 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c, name=ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-3-deactivate, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.build-date=20240507, RELEASE=wip-57676-3-bee299f, org.label-schema.license=GPLv2, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504) 2024-05-08T05:35:39.197 INFO:journalctl@ceph.osd.3.smithi087.stdout:May 08 05:35:38 smithi087 podman[97254]: 2024-05-08 05:35:38.751014466 +0000 UTC m=+0.414260144 container start 4a284ce1f92abb3c036cf8da3797d8719cb740443fb3744be01d8a80a6ad6726 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c, name=ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-3-deactivate, org.label-schema.build-date=20240507, org.label-schema.license=GPLv2, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-57676-3-bee299f, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True) 2024-05-08T05:35:39.197 INFO:journalctl@ceph.osd.3.smithi087.stdout:May 08 05:35:38 smithi087 podman[97254]: 2024-05-08 05:35:38.847088309 +0000 UTC m=+0.510333986 container attach 4a284ce1f92abb3c036cf8da3797d8719cb740443fb3744be01d8a80a6ad6726 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c, name=ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-3-deactivate, ceph=True, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.build-date=20240507, RELEASE=wip-57676-3-bee299f, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504) 2024-05-08T05:35:39.288 INFO:journalctl@ceph.osd.5.smithi160.stdout:May 08 05:35:38 smithi160 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-5[46734]: 2024-05-08T05:35:38.981+0000 7f63301cd700 -1 osd.5 85 heartbeat_check: no reply from 172.21.15.87:6806 osd.0 since back 2024-05-08T05:35:10.763693+0000 front 2024-05-08T05:35:10.763544+0000 (oldest deadline 2024-05-08T05:35:35.463411+0000) 2024-05-08T05:35:39.458 INFO:journalctl@ceph.osd.3.smithi087.stdout:May 08 05:35:39 smithi087 podman[97254]: 2024-05-08 05:35:39.19707025 +0000 UTC m=+0.860315959 container died 4a284ce1f92abb3c036cf8da3797d8719cb740443fb3744be01d8a80a6ad6726 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c, name=ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-3-deactivate, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.build-date=20240507, org.label-schema.license=GPLv2, ceph=True, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, maintainer=Guillaume Abrioux , RELEASE=wip-57676-3-bee299f, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image) 2024-05-08T05:35:39.788 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 08 05:35:39 smithi160 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-11[60042]: 2024-05-08T05:35:39.510+0000 7f0620c06700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.87:6806 osd.0 since back 2024-05-08T05:35:07.779525+0000 front 2024-05-08T05:35:07.779646+0000 (oldest deadline 2024-05-08T05:35:33.579761+0000) 2024-05-08T05:35:39.919 INFO:journalctl@ceph.osd.9.smithi087.stdout:May 08 05:35:39 smithi087 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-9[64574]: 2024-05-08T05:35:39.716+0000 7fb2f9800700 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.87:6806 osd.0 since back 2024-05-08T05:35:08.464101+0000 front 2024-05-08T05:35:08.464047+0000 (oldest deadline 2024-05-08T05:35:31.964171+0000) 2024-05-08T05:35:39.919 INFO:journalctl@ceph.osd.6.smithi087.stdout:May 08 05:35:39 smithi087 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-6[58000]: 2024-05-08T05:35:39.469+0000 7f1aca000700 -1 osd.6 85 heartbeat_check: no reply from 172.21.15.87:6806 osd.0 since back 2024-05-08T05:35:10.790888+0000 front 2024-05-08T05:35:10.790808+0000 (oldest deadline 2024-05-08T05:35:36.690826+0000) 2024-05-08T05:35:39.970 DEBUG:teuthology.orchestra.run.smithi087:> sudo pkill -f 'journalctl -f -n 0 -u ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968@osd.3.service' 2024-05-08T05:35:39.983 INFO:journalctl@ceph.osd.10.smithi090.stdout:May 08 05:35:39 smithi090 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-10[59300]: 2024-05-08T05:35:39.645+0000 7f515bdbb700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.87:6806 osd.0 since back 2024-05-08T05:35:09.330796+0000 front 2024-05-08T05:35:09.330921+0000 (oldest deadline 2024-05-08T05:35:34.030784+0000) 2024-05-08T05:35:40.086 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-08T05:35:40.087 INFO:tasks.cephadm.osd.3:Stopped osd.3 2024-05-08T05:35:40.087 INFO:tasks.cephadm.osd.4:Stopping osd.4... 2024-05-08T05:35:40.087 DEBUG:teuthology.orchestra.run.smithi090:> sudo systemctl stop ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968@osd.4 2024-05-08T05:35:40.288 INFO:journalctl@ceph.osd.5.smithi160.stdout:May 08 05:35:39 smithi160 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-5[46734]: 2024-05-08T05:35:39.970+0000 7f63301cd700 -1 osd.5 85 heartbeat_check: no reply from 172.21.15.87:6806 osd.0 since back 2024-05-08T05:35:10.763693+0000 front 2024-05-08T05:35:10.763544+0000 (oldest deadline 2024-05-08T05:35:35.463411+0000) 2024-05-08T05:35:40.399 INFO:journalctl@ceph.osd.4.smithi090.stdout:May 08 05:35:40 smithi090 systemd[1]: Stopping Ceph osd.4 for eeeb813e-0cf9-11ef-bc97-c7b262605968... 2024-05-08T05:35:40.733 INFO:journalctl@ceph.osd.10.smithi090.stdout:May 08 05:35:40 smithi090 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-10[59300]: 2024-05-08T05:35:40.617+0000 7f515bdbb700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.87:6806 osd.0 since back 2024-05-08T05:35:09.330796+0000 front 2024-05-08T05:35:09.330921+0000 (oldest deadline 2024-05-08T05:35:34.030784+0000) 2024-05-08T05:35:40.734 INFO:journalctl@ceph.osd.4.smithi090.stdout:May 08 05:35:40 smithi090 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-4[45654]: 2024-05-08T05:35:40.398+0000 7f0edbfd8700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.4 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-05-08T05:35:40.734 INFO:journalctl@ceph.osd.4.smithi090.stdout:May 08 05:35:40 smithi090 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-4[45654]: 2024-05-08T05:35:40.398+0000 7f0edbfd8700 -1 osd.4 85 *** Got signal Terminated *** 2024-05-08T05:35:40.734 INFO:journalctl@ceph.osd.4.smithi090.stdout:May 08 05:35:40 smithi090 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-4[45654]: 2024-05-08T05:35:40.398+0000 7f0edbfd8700 -1 osd.4 85 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-05-08T05:35:40.752 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 08 05:35:40 smithi160 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-11[60042]: 2024-05-08T05:35:40.490+0000 7f0620c06700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.87:6806 osd.0 since back 2024-05-08T05:35:07.779525+0000 front 2024-05-08T05:35:07.779646+0000 (oldest deadline 2024-05-08T05:35:33.579761+0000) 2024-05-08T05:35:40.958 INFO:journalctl@ceph.osd.6.smithi087.stdout:May 08 05:35:40 smithi087 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-6[58000]: 2024-05-08T05:35:40.518+0000 7f1aca000700 -1 osd.6 85 heartbeat_check: no reply from 172.21.15.87:6806 osd.0 since back 2024-05-08T05:35:10.790888+0000 front 2024-05-08T05:35:10.790808+0000 (oldest deadline 2024-05-08T05:35:36.690826+0000) 2024-05-08T05:35:40.958 INFO:journalctl@ceph.osd.9.smithi087.stdout:May 08 05:35:40 smithi087 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-9[64574]: 2024-05-08T05:35:40.714+0000 7fb2f9800700 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.87:6806 osd.0 since back 2024-05-08T05:35:08.464101+0000 front 2024-05-08T05:35:08.464047+0000 (oldest deadline 2024-05-08T05:35:31.964171+0000) 2024-05-08T05:35:41.038 INFO:journalctl@ceph.osd.5.smithi160.stdout:May 08 05:35:40 smithi160 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-5[46734]: 2024-05-08T05:35:40.920+0000 7f63301cd700 -1 osd.5 85 heartbeat_check: no reply from 172.21.15.87:6806 osd.0 since back 2024-05-08T05:35:10.763693+0000 front 2024-05-08T05:35:10.763544+0000 (oldest deadline 2024-05-08T05:35:35.463411+0000) 2024-05-08T05:35:41.763 INFO:journalctl@ceph.osd.6.smithi087.stdout:May 08 05:35:41 smithi087 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-6[58000]: 2024-05-08T05:35:41.500+0000 7f1aca000700 -1 osd.6 85 heartbeat_check: no reply from 172.21.15.87:6806 osd.0 since back 2024-05-08T05:35:10.790888+0000 front 2024-05-08T05:35:10.790808+0000 (oldest deadline 2024-05-08T05:35:36.690826+0000) 2024-05-08T05:35:41.764 INFO:journalctl@ceph.osd.6.smithi087.stdout:May 08 05:35:41 smithi087 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-6[58000]: 2024-05-08T05:35:41.500+0000 7f1aca000700 -1 osd.6 85 heartbeat_check: no reply from 172.21.15.90:6804 osd.1 since back 2024-05-08T05:35:16.691953+0000 front 2024-05-08T05:35:16.691883+0000 (oldest deadline 2024-05-08T05:35:40.792085+0000) 2024-05-08T05:35:41.788 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 08 05:35:41 smithi160 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-11[60042]: 2024-05-08T05:35:41.481+0000 7f0620c06700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.87:6806 osd.0 since back 2024-05-08T05:35:07.779525+0000 front 2024-05-08T05:35:07.779646+0000 (oldest deadline 2024-05-08T05:35:33.579761+0000) 2024-05-08T05:35:41.983 INFO:journalctl@ceph.osd.10.smithi090.stdout:May 08 05:35:41 smithi090 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-10[59300]: 2024-05-08T05:35:41.603+0000 7f515bdbb700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.87:6806 osd.0 since back 2024-05-08T05:35:09.330796+0000 front 2024-05-08T05:35:09.330921+0000 (oldest deadline 2024-05-08T05:35:34.030784+0000) 2024-05-08T05:35:42.208 INFO:journalctl@ceph.osd.9.smithi087.stdout:May 08 05:35:41 smithi087 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-9[64574]: 2024-05-08T05:35:41.762+0000 7fb2f9800700 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.87:6806 osd.0 since back 2024-05-08T05:35:08.464101+0000 front 2024-05-08T05:35:08.464047+0000 (oldest deadline 2024-05-08T05:35:31.964171+0000) 2024-05-08T05:35:42.208 INFO:journalctl@ceph.osd.9.smithi087.stdout:May 08 05:35:41 smithi087 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-9[64574]: 2024-05-08T05:35:41.762+0000 7fb2f9800700 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.90:6804 osd.1 since back 2024-05-08T05:35:15.466623+0000 front 2024-05-08T05:35:15.467083+0000 (oldest deadline 2024-05-08T05:35:41.366632+0000) 2024-05-08T05:35:42.288 INFO:journalctl@ceph.osd.5.smithi160.stdout:May 08 05:35:41 smithi160 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-5[46734]: 2024-05-08T05:35:41.968+0000 7f63301cd700 -1 osd.5 85 heartbeat_check: no reply from 172.21.15.87:6806 osd.0 since back 2024-05-08T05:35:10.763693+0000 front 2024-05-08T05:35:10.763544+0000 (oldest deadline 2024-05-08T05:35:35.463411+0000) 2024-05-08T05:35:42.768 INFO:journalctl@ceph.osd.6.smithi087.stdout:May 08 05:35:42 smithi087 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-6[58000]: 2024-05-08T05:35:42.500+0000 7f1aca000700 -1 osd.6 85 heartbeat_check: no reply from 172.21.15.87:6806 osd.0 since back 2024-05-08T05:35:10.790888+0000 front 2024-05-08T05:35:10.790808+0000 (oldest deadline 2024-05-08T05:35:36.690826+0000) 2024-05-08T05:35:42.768 INFO:journalctl@ceph.osd.6.smithi087.stdout:May 08 05:35:42 smithi087 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-6[58000]: 2024-05-08T05:35:42.500+0000 7f1aca000700 -1 osd.6 85 heartbeat_check: no reply from 172.21.15.90:6804 osd.1 since back 2024-05-08T05:35:16.691953+0000 front 2024-05-08T05:35:16.691883+0000 (oldest deadline 2024-05-08T05:35:40.792085+0000) 2024-05-08T05:35:42.788 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 08 05:35:42 smithi160 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-11[60042]: 2024-05-08T05:35:42.504+0000 7f0620c06700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.87:6806 osd.0 since back 2024-05-08T05:35:07.779525+0000 front 2024-05-08T05:35:07.779646+0000 (oldest deadline 2024-05-08T05:35:33.579761+0000) 2024-05-08T05:35:42.983 INFO:journalctl@ceph.osd.10.smithi090.stdout:May 08 05:35:42 smithi090 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-10[59300]: 2024-05-08T05:35:42.595+0000 7f515bdbb700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.87:6806 osd.0 since back 2024-05-08T05:35:09.330796+0000 front 2024-05-08T05:35:09.330921+0000 (oldest deadline 2024-05-08T05:35:34.030784+0000) 2024-05-08T05:35:43.208 INFO:journalctl@ceph.osd.9.smithi087.stdout:May 08 05:35:42 smithi087 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-9[64574]: 2024-05-08T05:35:42.767+0000 7fb2f9800700 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.87:6806 osd.0 since back 2024-05-08T05:35:08.464101+0000 front 2024-05-08T05:35:08.464047+0000 (oldest deadline 2024-05-08T05:35:31.964171+0000) 2024-05-08T05:35:43.208 INFO:journalctl@ceph.osd.9.smithi087.stdout:May 08 05:35:42 smithi087 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-9[64574]: 2024-05-08T05:35:42.767+0000 7fb2f9800700 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.90:6804 osd.1 since back 2024-05-08T05:35:15.466623+0000 front 2024-05-08T05:35:15.467083+0000 (oldest deadline 2024-05-08T05:35:41.366632+0000) 2024-05-08T05:35:43.288 INFO:journalctl@ceph.osd.5.smithi160.stdout:May 08 05:35:42 smithi160 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-5[46734]: 2024-05-08T05:35:42.968+0000 7f63301cd700 -1 osd.5 85 heartbeat_check: no reply from 172.21.15.87:6806 osd.0 since back 2024-05-08T05:35:10.763693+0000 front 2024-05-08T05:35:10.763544+0000 (oldest deadline 2024-05-08T05:35:35.463411+0000) 2024-05-08T05:35:43.739 INFO:journalctl@ceph.osd.6.smithi087.stdout:May 08 05:35:43 smithi087 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-6[58000]: 2024-05-08T05:35:43.479+0000 7f1aca000700 -1 osd.6 85 heartbeat_check: no reply from 172.21.15.87:6806 osd.0 since back 2024-05-08T05:35:10.790888+0000 front 2024-05-08T05:35:10.790808+0000 (oldest deadline 2024-05-08T05:35:36.690826+0000) 2024-05-08T05:35:43.739 INFO:journalctl@ceph.osd.6.smithi087.stdout:May 08 05:35:43 smithi087 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-6[58000]: 2024-05-08T05:35:43.479+0000 7f1aca000700 -1 osd.6 85 heartbeat_check: no reply from 172.21.15.90:6804 osd.1 since back 2024-05-08T05:35:16.691953+0000 front 2024-05-08T05:35:16.691883+0000 (oldest deadline 2024-05-08T05:35:40.792085+0000) 2024-05-08T05:35:43.789 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 08 05:35:43 smithi160 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-11[60042]: 2024-05-08T05:35:43.534+0000 7f0620c06700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.87:6806 osd.0 since back 2024-05-08T05:35:07.779525+0000 front 2024-05-08T05:35:07.779646+0000 (oldest deadline 2024-05-08T05:35:33.579761+0000) 2024-05-08T05:35:43.983 INFO:journalctl@ceph.osd.10.smithi090.stdout:May 08 05:35:43 smithi090 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-10[59300]: 2024-05-08T05:35:43.607+0000 7f515bdbb700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.87:6806 osd.0 since back 2024-05-08T05:35:09.330796+0000 front 2024-05-08T05:35:09.330921+0000 (oldest deadline 2024-05-08T05:35:34.030784+0000) 2024-05-08T05:35:44.208 INFO:journalctl@ceph.osd.9.smithi087.stdout:May 08 05:35:43 smithi087 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-9[64574]: 2024-05-08T05:35:43.738+0000 7fb2f9800700 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.87:6806 osd.0 since back 2024-05-08T05:35:08.464101+0000 front 2024-05-08T05:35:08.464047+0000 (oldest deadline 2024-05-08T05:35:31.964171+0000) 2024-05-08T05:35:44.208 INFO:journalctl@ceph.osd.9.smithi087.stdout:May 08 05:35:43 smithi087 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-9[64574]: 2024-05-08T05:35:43.738+0000 7fb2f9800700 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.90:6804 osd.1 since back 2024-05-08T05:35:15.466623+0000 front 2024-05-08T05:35:15.467083+0000 (oldest deadline 2024-05-08T05:35:41.366632+0000) 2024-05-08T05:35:44.288 INFO:journalctl@ceph.osd.5.smithi160.stdout:May 08 05:35:44 smithi160 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-5[46734]: 2024-05-08T05:35:44.010+0000 7f63301cd700 -1 osd.5 85 heartbeat_check: no reply from 172.21.15.87:6806 osd.0 since back 2024-05-08T05:35:10.763693+0000 front 2024-05-08T05:35:10.763544+0000 (oldest deadline 2024-05-08T05:35:35.463411+0000) 2024-05-08T05:35:44.289 INFO:journalctl@ceph.osd.8.smithi160.stdout:May 08 05:35:44 smithi160 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-8[53438]: 2024-05-08T05:35:44.203+0000 7f9baa4b7700 -1 osd.8 85 heartbeat_check: no reply from 172.21.15.90:6804 osd.1 since back 2024-05-08T05:35:19.849347+0000 front 2024-05-08T05:35:19.849487+0000 (oldest deadline 2024-05-08T05:35:43.349410+0000) 2024-05-08T05:35:44.733 INFO:journalctl@ceph.osd.10.smithi090.stdout:May 08 05:35:44 smithi090 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-10[59300]: 2024-05-08T05:35:44.653+0000 7f515bdbb700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.87:6806 osd.0 since back 2024-05-08T05:35:09.330796+0000 front 2024-05-08T05:35:09.330921+0000 (oldest deadline 2024-05-08T05:35:34.030784+0000) 2024-05-08T05:35:44.733 INFO:journalctl@ceph.osd.7.smithi090.stdout:May 08 05:35:44 smithi090 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-7[52517]: 2024-05-08T05:35:44.417+0000 7f2f232a5700 -1 osd.7 85 heartbeat_check: no reply from 172.21.15.90:6804 osd.1 since back 2024-05-08T05:35:19.451959+0000 front 2024-05-08T05:35:19.451987+0000 (oldest deadline 2024-05-08T05:35:43.552168+0000) 2024-05-08T05:35:44.958 INFO:journalctl@ceph.osd.6.smithi087.stdout:May 08 05:35:44 smithi087 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-6[58000]: 2024-05-08T05:35:44.519+0000 7f1aca000700 -1 osd.6 85 heartbeat_check: no reply from 172.21.15.87:6806 osd.0 since back 2024-05-08T05:35:10.790888+0000 front 2024-05-08T05:35:10.790808+0000 (oldest deadline 2024-05-08T05:35:36.690826+0000) 2024-05-08T05:35:44.958 INFO:journalctl@ceph.osd.6.smithi087.stdout:May 08 05:35:44 smithi087 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-6[58000]: 2024-05-08T05:35:44.519+0000 7f1aca000700 -1 osd.6 85 heartbeat_check: no reply from 172.21.15.90:6804 osd.1 since back 2024-05-08T05:35:16.691953+0000 front 2024-05-08T05:35:16.691883+0000 (oldest deadline 2024-05-08T05:35:40.792085+0000) 2024-05-08T05:35:44.959 INFO:journalctl@ceph.osd.9.smithi087.stdout:May 08 05:35:44 smithi087 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-9[64574]: 2024-05-08T05:35:44.721+0000 7fb2f9800700 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.87:6806 osd.0 since back 2024-05-08T05:35:08.464101+0000 front 2024-05-08T05:35:08.464047+0000 (oldest deadline 2024-05-08T05:35:31.964171+0000) 2024-05-08T05:35:44.959 INFO:journalctl@ceph.osd.9.smithi087.stdout:May 08 05:35:44 smithi087 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-9[64574]: 2024-05-08T05:35:44.721+0000 7fb2f9800700 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.90:6804 osd.1 since back 2024-05-08T05:35:15.466623+0000 front 2024-05-08T05:35:15.467083+0000 (oldest deadline 2024-05-08T05:35:41.366632+0000) 2024-05-08T05:35:44.993 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 08 05:35:44 smithi160 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-11[60042]: 2024-05-08T05:35:44.557+0000 7f0620c06700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.87:6806 osd.0 since back 2024-05-08T05:35:07.779525+0000 front 2024-05-08T05:35:07.779646+0000 (oldest deadline 2024-05-08T05:35:33.579761+0000) 2024-05-08T05:35:45.288 INFO:journalctl@ceph.osd.8.smithi160.stdout:May 08 05:35:45 smithi160 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-8[53438]: 2024-05-08T05:35:45.163+0000 7f9baa4b7700 -1 osd.8 85 heartbeat_check: no reply from 172.21.15.90:6804 osd.1 since back 2024-05-08T05:35:19.849347+0000 front 2024-05-08T05:35:19.849487+0000 (oldest deadline 2024-05-08T05:35:43.349410+0000) 2024-05-08T05:35:45.289 INFO:journalctl@ceph.osd.5.smithi160.stdout:May 08 05:35:44 smithi160 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-5[46734]: 2024-05-08T05:35:44.993+0000 7f63301cd700 -1 osd.5 85 heartbeat_check: no reply from 172.21.15.87:6806 osd.0 since back 2024-05-08T05:35:10.763693+0000 front 2024-05-08T05:35:10.763544+0000 (oldest deadline 2024-05-08T05:35:35.463411+0000) 2024-05-08T05:35:45.733 INFO:journalctl@ceph.osd.7.smithi090.stdout:May 08 05:35:45 smithi090 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-7[52517]: 2024-05-08T05:35:45.425+0000 7f2f232a5700 -1 osd.7 85 heartbeat_check: no reply from 172.21.15.90:6804 osd.1 since back 2024-05-08T05:35:19.451959+0000 front 2024-05-08T05:35:19.451987+0000 (oldest deadline 2024-05-08T05:35:43.552168+0000) 2024-05-08T05:35:45.733 INFO:journalctl@ceph.osd.10.smithi090.stdout:May 08 05:35:45 smithi090 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-10[59300]: 2024-05-08T05:35:45.645+0000 7f515bdbb700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.87:6806 osd.0 since back 2024-05-08T05:35:09.330796+0000 front 2024-05-08T05:35:09.330921+0000 (oldest deadline 2024-05-08T05:35:34.030784+0000) 2024-05-08T05:35:45.950 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 08 05:35:45 smithi160 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-11[60042]: 2024-05-08T05:35:45.569+0000 7f0620c06700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.87:6806 osd.0 since back 2024-05-08T05:35:07.779525+0000 front 2024-05-08T05:35:07.779646+0000 (oldest deadline 2024-05-08T05:35:33.579761+0000) 2024-05-08T05:35:45.950 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 08 05:35:45 smithi160 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-11[60042]: 2024-05-08T05:35:45.569+0000 7f0620c06700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.90:6804 osd.1 since back 2024-05-08T05:35:19.381805+0000 front 2024-05-08T05:35:19.381693+0000 (oldest deadline 2024-05-08T05:35:45.281608+0000) 2024-05-08T05:35:45.958 INFO:journalctl@ceph.osd.6.smithi087.stdout:May 08 05:35:45 smithi087 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-6[58000]: 2024-05-08T05:35:45.570+0000 7f1aca000700 -1 osd.6 85 heartbeat_check: no reply from 172.21.15.87:6806 osd.0 since back 2024-05-08T05:35:10.790888+0000 front 2024-05-08T05:35:10.790808+0000 (oldest deadline 2024-05-08T05:35:36.690826+0000) 2024-05-08T05:35:45.958 INFO:journalctl@ceph.osd.6.smithi087.stdout:May 08 05:35:45 smithi087 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-6[58000]: 2024-05-08T05:35:45.570+0000 7f1aca000700 -1 osd.6 85 heartbeat_check: no reply from 172.21.15.90:6804 osd.1 since back 2024-05-08T05:35:16.691953+0000 front 2024-05-08T05:35:16.691883+0000 (oldest deadline 2024-05-08T05:35:40.792085+0000) 2024-05-08T05:35:45.959 INFO:journalctl@ceph.osd.9.smithi087.stdout:May 08 05:35:45 smithi087 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-9[64574]: 2024-05-08T05:35:45.759+0000 7fb2f9800700 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.87:6806 osd.0 since back 2024-05-08T05:35:08.464101+0000 front 2024-05-08T05:35:08.464047+0000 (oldest deadline 2024-05-08T05:35:31.964171+0000) 2024-05-08T05:35:45.959 INFO:journalctl@ceph.osd.9.smithi087.stdout:May 08 05:35:45 smithi087 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-9[64574]: 2024-05-08T05:35:45.759+0000 7fb2f9800700 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.90:6804 osd.1 since back 2024-05-08T05:35:15.466623+0000 front 2024-05-08T05:35:15.467083+0000 (oldest deadline 2024-05-08T05:35:41.366632+0000) 2024-05-08T05:35:46.102 INFO:journalctl@ceph.osd.4.smithi090.stdout:May 08 05:35:45 smithi090 podman[69001]: 2024-05-08 05:35:45.819139844 +0000 UTC m=+5.540700005 container died 35582fe80c2c197c9d60afb63ae2dfa860c211e53a5c990551fc721ea5031b9e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c, name=ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-4, CEPH_POINT_RELEASE=, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.build-date=20240507, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, RELEASE=wip-57676-3-bee299f, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True) 2024-05-08T05:35:46.288 INFO:journalctl@ceph.osd.8.smithi160.stdout:May 08 05:35:46 smithi160 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-8[53438]: 2024-05-08T05:35:46.126+0000 7f9baa4b7700 -1 osd.8 85 heartbeat_check: no reply from 172.21.15.90:6804 osd.1 since back 2024-05-08T05:35:19.849347+0000 front 2024-05-08T05:35:19.849487+0000 (oldest deadline 2024-05-08T05:35:43.349410+0000) 2024-05-08T05:35:46.289 INFO:journalctl@ceph.osd.5.smithi160.stdout:May 08 05:35:45 smithi160 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-5[46734]: 2024-05-08T05:35:45.950+0000 7f63301cd700 -1 osd.5 85 heartbeat_check: no reply from 172.21.15.87:6806 osd.0 since back 2024-05-08T05:35:10.763693+0000 front 2024-05-08T05:35:10.763544+0000 (oldest deadline 2024-05-08T05:35:35.463411+0000) 2024-05-08T05:35:46.289 INFO:journalctl@ceph.osd.5.smithi160.stdout:May 08 05:35:45 smithi160 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-5[46734]: 2024-05-08T05:35:45.950+0000 7f63301cd700 -1 osd.5 85 heartbeat_check: no reply from 172.21.15.90:6804 osd.1 since back 2024-05-08T05:35:19.564413+0000 front 2024-05-08T05:35:19.564532+0000 (oldest deadline 2024-05-08T05:35:45.464563+0000) 2024-05-08T05:35:46.422 INFO:journalctl@ceph.osd.4.smithi090.stdout:May 08 05:35:46 smithi090 podman[69001]: 2024-05-08 05:35:46.201556436 +0000 UTC m=+5.923116594 container cleanup 35582fe80c2c197c9d60afb63ae2dfa860c211e53a5c990551fc721ea5031b9e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c, name=ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-4, maintainer=Guillaume Abrioux , GIT_CLEAN=True, RELEASE=wip-57676-3-bee299f, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.build-date=20240507, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD) 2024-05-08T05:35:46.422 INFO:journalctl@ceph.osd.4.smithi090.stdout:May 08 05:35:46 smithi090 bash[69001]: ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-4 2024-05-08T05:35:46.733 INFO:journalctl@ceph.osd.7.smithi090.stdout:May 08 05:35:46 smithi090 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-7[52517]: 2024-05-08T05:35:46.421+0000 7f2f232a5700 -1 osd.7 85 heartbeat_check: no reply from 172.21.15.90:6804 osd.1 since back 2024-05-08T05:35:19.451959+0000 front 2024-05-08T05:35:19.451987+0000 (oldest deadline 2024-05-08T05:35:43.552168+0000) 2024-05-08T05:35:46.734 INFO:journalctl@ceph.osd.4.smithi090.stdout:May 08 05:35:46 smithi090 podman[69018]: 2024-05-08 05:35:46.461578191 +0000 UTC m=+0.644884461 container remove 35582fe80c2c197c9d60afb63ae2dfa860c211e53a5c990551fc721ea5031b9e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c, name=ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-4, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, org.label-schema.license=GPLv2, GIT_CLEAN=True, RELEASE=wip-57676-3-bee299f, GIT_BRANCH=HEAD, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.build-date=20240507, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS) 2024-05-08T05:35:46.734 INFO:journalctl@ceph.osd.10.smithi090.stdout:May 08 05:35:46 smithi090 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-10[59300]: 2024-05-08T05:35:46.607+0000 7f515bdbb700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.87:6806 osd.0 since back 2024-05-08T05:35:09.330796+0000 front 2024-05-08T05:35:09.330921+0000 (oldest deadline 2024-05-08T05:35:34.030784+0000) 2024-05-08T05:35:46.734 INFO:journalctl@ceph.osd.10.smithi090.stdout:May 08 05:35:46 smithi090 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-10[59300]: 2024-05-08T05:35:46.607+0000 7f515bdbb700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.90:6804 osd.1 since back 2024-05-08T05:35:16.331661+0000 front 2024-05-08T05:35:16.331685+0000 (oldest deadline 2024-05-08T05:35:45.732387+0000) 2024-05-08T05:35:46.791 INFO:journalctl@ceph.osd.6.smithi087.stdout:May 08 05:35:46 smithi087 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-6[58000]: 2024-05-08T05:35:46.530+0000 7f1aca000700 -1 osd.6 85 heartbeat_check: no reply from 172.21.15.87:6806 osd.0 since back 2024-05-08T05:35:10.790888+0000 front 2024-05-08T05:35:10.790808+0000 (oldest deadline 2024-05-08T05:35:36.690826+0000) 2024-05-08T05:35:46.791 INFO:journalctl@ceph.osd.6.smithi087.stdout:May 08 05:35:46 smithi087 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-6[58000]: 2024-05-08T05:35:46.530+0000 7f1aca000700 -1 osd.6 85 heartbeat_check: no reply from 172.21.15.90:6804 osd.1 since back 2024-05-08T05:35:16.691953+0000 front 2024-05-08T05:35:16.691883+0000 (oldest deadline 2024-05-08T05:35:40.792085+0000) 2024-05-08T05:35:46.928 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 08 05:35:46 smithi160 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-11[60042]: 2024-05-08T05:35:46.595+0000 7f0620c06700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.87:6806 osd.0 since back 2024-05-08T05:35:07.779525+0000 front 2024-05-08T05:35:07.779646+0000 (oldest deadline 2024-05-08T05:35:33.579761+0000) 2024-05-08T05:35:46.928 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 08 05:35:46 smithi160 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-11[60042]: 2024-05-08T05:35:46.595+0000 7f0620c06700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.90:6804 osd.1 since back 2024-05-08T05:35:19.381805+0000 front 2024-05-08T05:35:19.381693+0000 (oldest deadline 2024-05-08T05:35:45.281608+0000) 2024-05-08T05:35:47.082 INFO:journalctl@ceph.osd.4.smithi090.stdout:May 08 05:35:46 smithi090 podman[69104]: 2024-05-08 05:35:46.719041133 +0000 UTC m=+0.018013463 image pull 352576a2df49fbab3aeeba1effbcb7a94815e8fc1f120a55ddc340b4ee63b8ce quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c 2024-05-08T05:35:47.082 INFO:journalctl@ceph.osd.4.smithi090.stdout:May 08 05:35:46 smithi090 podman[69104]: 2024-05-08 05:35:46.846367633 +0000 UTC m=+0.145339948 container create 7c701514ba3bbf45ba4c238852b883e2cb980087153a6beef5f45a66e5ac6a17 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c, name=ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-4-deactivate, org.label-schema.build-date=20240507, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , RELEASE=wip-57676-3-bee299f, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-05-08T05:35:47.208 INFO:journalctl@ceph.osd.9.smithi087.stdout:May 08 05:35:46 smithi087 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-9[64574]: 2024-05-08T05:35:46.790+0000 7fb2f9800700 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.87:6806 osd.0 since back 2024-05-08T05:35:08.464101+0000 front 2024-05-08T05:35:08.464047+0000 (oldest deadline 2024-05-08T05:35:31.964171+0000) 2024-05-08T05:35:47.208 INFO:journalctl@ceph.osd.9.smithi087.stdout:May 08 05:35:46 smithi087 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-9[64574]: 2024-05-08T05:35:46.790+0000 7fb2f9800700 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.90:6804 osd.1 since back 2024-05-08T05:35:15.466623+0000 front 2024-05-08T05:35:15.467083+0000 (oldest deadline 2024-05-08T05:35:41.366632+0000) 2024-05-08T05:35:47.288 INFO:journalctl@ceph.osd.8.smithi160.stdout:May 08 05:35:47 smithi160 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-8[53438]: 2024-05-08T05:35:47.107+0000 7f9baa4b7700 -1 osd.8 85 heartbeat_check: no reply from 172.21.15.90:6804 osd.1 since back 2024-05-08T05:35:19.849347+0000 front 2024-05-08T05:35:19.849487+0000 (oldest deadline 2024-05-08T05:35:43.349410+0000) 2024-05-08T05:35:47.289 INFO:journalctl@ceph.osd.5.smithi160.stdout:May 08 05:35:46 smithi160 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-5[46734]: 2024-05-08T05:35:46.928+0000 7f63301cd700 -1 osd.5 85 heartbeat_check: no reply from 172.21.15.87:6806 osd.0 since back 2024-05-08T05:35:10.763693+0000 front 2024-05-08T05:35:10.763544+0000 (oldest deadline 2024-05-08T05:35:35.463411+0000) 2024-05-08T05:35:47.289 INFO:journalctl@ceph.osd.5.smithi160.stdout:May 08 05:35:46 smithi160 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-5[46734]: 2024-05-08T05:35:46.928+0000 7f63301cd700 -1 osd.5 85 heartbeat_check: no reply from 172.21.15.90:6804 osd.1 since back 2024-05-08T05:35:19.564413+0000 front 2024-05-08T05:35:19.564532+0000 (oldest deadline 2024-05-08T05:35:45.464563+0000) 2024-05-08T05:35:47.386 INFO:journalctl@ceph.osd.4.smithi090.stdout:May 08 05:35:47 smithi090 podman[69104]: 2024-05-08 05:35:47.082513992 +0000 UTC m=+0.381486309 container init 7c701514ba3bbf45ba4c238852b883e2cb980087153a6beef5f45a66e5ac6a17 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c, name=ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-4-deactivate, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, org.label-schema.build-date=20240507, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-57676-3-bee299f, maintainer=Guillaume Abrioux , ceph=True, CEPH_POINT_RELEASE=) 2024-05-08T05:35:47.386 INFO:journalctl@ceph.osd.4.smithi090.stdout:May 08 05:35:47 smithi090 podman[69104]: 2024-05-08 05:35:47.085894096 +0000 UTC m=+0.384866409 container start 7c701514ba3bbf45ba4c238852b883e2cb980087153a6beef5f45a66e5ac6a17 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c, name=ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-4-deactivate, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, org.label-schema.build-date=20240507, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-57676-3-bee299f, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux ) 2024-05-08T05:35:47.386 INFO:journalctl@ceph.osd.4.smithi090.stdout:May 08 05:35:47 smithi090 podman[69104]: 2024-05-08 05:35:47.173988129 +0000 UTC m=+0.472960450 container attach 7c701514ba3bbf45ba4c238852b883e2cb980087153a6beef5f45a66e5ac6a17 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c, name=ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-4-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240507, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, RELEASE=wip-57676-3-bee299f, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, io.buildah.version=1.33.5, ceph=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD) 2024-05-08T05:35:47.695 INFO:journalctl@ceph.osd.7.smithi090.stdout:May 08 05:35:47 smithi090 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-7[52517]: 2024-05-08T05:35:47.394+0000 7f2f232a5700 -1 osd.7 85 heartbeat_check: no reply from 172.21.15.90:6804 osd.1 since back 2024-05-08T05:35:19.451959+0000 front 2024-05-08T05:35:19.451987+0000 (oldest deadline 2024-05-08T05:35:43.552168+0000) 2024-05-08T05:35:47.696 INFO:journalctl@ceph.osd.4.smithi090.stdout:May 08 05:35:47 smithi090 podman[69104]: 2024-05-08 05:35:47.386349351 +0000 UTC m=+0.685321664 container died 7c701514ba3bbf45ba4c238852b883e2cb980087153a6beef5f45a66e5ac6a17 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c, name=ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-4-deactivate, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-57676-3-bee299f, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, ceph=True, GIT_CLEAN=True, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240507) 2024-05-08T05:35:47.696 INFO:journalctl@ceph.osd.10.smithi090.stdout:May 08 05:35:47 smithi090 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-10[59300]: 2024-05-08T05:35:47.615+0000 7f515bdbb700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.87:6806 osd.0 since back 2024-05-08T05:35:09.330796+0000 front 2024-05-08T05:35:09.330921+0000 (oldest deadline 2024-05-08T05:35:34.030784+0000) 2024-05-08T05:35:47.696 INFO:journalctl@ceph.osd.10.smithi090.stdout:May 08 05:35:47 smithi090 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-10[59300]: 2024-05-08T05:35:47.615+0000 7f515bdbb700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.90:6804 osd.1 since back 2024-05-08T05:35:16.331661+0000 front 2024-05-08T05:35:16.331685+0000 (oldest deadline 2024-05-08T05:35:45.732387+0000) 2024-05-08T05:35:47.956 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 08 05:35:47 smithi160 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-11[60042]: 2024-05-08T05:35:47.631+0000 7f0620c06700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.87:6806 osd.0 since back 2024-05-08T05:35:07.779525+0000 front 2024-05-08T05:35:07.779646+0000 (oldest deadline 2024-05-08T05:35:33.579761+0000) 2024-05-08T05:35:47.956 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 08 05:35:47 smithi160 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-11[60042]: 2024-05-08T05:35:47.631+0000 7f0620c06700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.90:6804 osd.1 since back 2024-05-08T05:35:19.381805+0000 front 2024-05-08T05:35:19.381693+0000 (oldest deadline 2024-05-08T05:35:45.281608+0000) 2024-05-08T05:35:47.958 INFO:journalctl@ceph.osd.6.smithi087.stdout:May 08 05:35:47 smithi087 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-6[58000]: 2024-05-08T05:35:47.549+0000 7f1aca000700 -1 osd.6 85 heartbeat_check: no reply from 172.21.15.87:6806 osd.0 since back 2024-05-08T05:35:10.790888+0000 front 2024-05-08T05:35:10.790808+0000 (oldest deadline 2024-05-08T05:35:36.690826+0000) 2024-05-08T05:35:47.958 INFO:journalctl@ceph.osd.6.smithi087.stdout:May 08 05:35:47 smithi087 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-6[58000]: 2024-05-08T05:35:47.549+0000 7f1aca000700 -1 osd.6 85 heartbeat_check: no reply from 172.21.15.90:6804 osd.1 since back 2024-05-08T05:35:16.691953+0000 front 2024-05-08T05:35:16.691883+0000 (oldest deadline 2024-05-08T05:35:40.792085+0000) 2024-05-08T05:35:47.958 INFO:journalctl@ceph.osd.9.smithi087.stdout:May 08 05:35:47 smithi087 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-9[64574]: 2024-05-08T05:35:47.756+0000 7fb2f9800700 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.87:6806 osd.0 since back 2024-05-08T05:35:08.464101+0000 front 2024-05-08T05:35:08.464047+0000 (oldest deadline 2024-05-08T05:35:31.964171+0000) 2024-05-08T05:35:47.959 INFO:journalctl@ceph.osd.9.smithi087.stdout:May 08 05:35:47 smithi087 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-9[64574]: 2024-05-08T05:35:47.756+0000 7fb2f9800700 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.90:6804 osd.1 since back 2024-05-08T05:35:15.466623+0000 front 2024-05-08T05:35:15.467083+0000 (oldest deadline 2024-05-08T05:35:41.366632+0000) 2024-05-08T05:35:48.039 DEBUG:teuthology.orchestra.run.smithi090:> sudo pkill -f 'journalctl -f -n 0 -u ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968@osd.4.service' 2024-05-08T05:35:48.078 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-08T05:35:48.078 INFO:tasks.cephadm.osd.4:Stopped osd.4 2024-05-08T05:35:48.078 INFO:tasks.cephadm.osd.5:Stopping osd.5... 2024-05-08T05:35:48.079 DEBUG:teuthology.orchestra.run.smithi160:> sudo systemctl stop ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968@osd.5 2024-05-08T05:35:48.288 INFO:journalctl@ceph.osd.8.smithi160.stdout:May 08 05:35:48 smithi160 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-8[53438]: 2024-05-08T05:35:48.077+0000 7f9baa4b7700 -1 osd.8 85 heartbeat_check: no reply from 172.21.15.90:6804 osd.1 since back 2024-05-08T05:35:19.849347+0000 front 2024-05-08T05:35:19.849487+0000 (oldest deadline 2024-05-08T05:35:43.349410+0000) 2024-05-08T05:35:48.289 INFO:journalctl@ceph.osd.5.smithi160.stdout:May 08 05:35:47 smithi160 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-5[46734]: 2024-05-08T05:35:47.956+0000 7f63301cd700 -1 osd.5 85 heartbeat_check: no reply from 172.21.15.87:6806 osd.0 since back 2024-05-08T05:35:10.763693+0000 front 2024-05-08T05:35:10.763544+0000 (oldest deadline 2024-05-08T05:35:35.463411+0000) 2024-05-08T05:35:48.289 INFO:journalctl@ceph.osd.5.smithi160.stdout:May 08 05:35:47 smithi160 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-5[46734]: 2024-05-08T05:35:47.956+0000 7f63301cd700 -1 osd.5 85 heartbeat_check: no reply from 172.21.15.90:6804 osd.1 since back 2024-05-08T05:35:19.564413+0000 front 2024-05-08T05:35:19.564532+0000 (oldest deadline 2024-05-08T05:35:45.464563+0000) 2024-05-08T05:35:48.289 INFO:journalctl@ceph.osd.5.smithi160.stdout:May 08 05:35:48 smithi160 systemd[1]: Stopping Ceph osd.5 for eeeb813e-0cf9-11ef-bc97-c7b262605968... 2024-05-08T05:35:48.733 INFO:journalctl@ceph.osd.7.smithi090.stdout:May 08 05:35:48 smithi090 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-7[52517]: 2024-05-08T05:35:48.401+0000 7f2f232a5700 -1 osd.7 85 heartbeat_check: no reply from 172.21.15.90:6804 osd.1 since back 2024-05-08T05:35:19.451959+0000 front 2024-05-08T05:35:19.451987+0000 (oldest deadline 2024-05-08T05:35:43.552168+0000) 2024-05-08T05:35:48.734 INFO:journalctl@ceph.osd.10.smithi090.stdout:May 08 05:35:48 smithi090 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-10[59300]: 2024-05-08T05:35:48.622+0000 7f515bdbb700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.87:6806 osd.0 since back 2024-05-08T05:35:09.330796+0000 front 2024-05-08T05:35:09.330921+0000 (oldest deadline 2024-05-08T05:35:34.030784+0000) 2024-05-08T05:35:48.734 INFO:journalctl@ceph.osd.10.smithi090.stdout:May 08 05:35:48 smithi090 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-10[59300]: 2024-05-08T05:35:48.622+0000 7f515bdbb700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.90:6804 osd.1 since back 2024-05-08T05:35:16.331661+0000 front 2024-05-08T05:35:16.331685+0000 (oldest deadline 2024-05-08T05:35:45.732387+0000) 2024-05-08T05:35:48.788 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 08 05:35:48 smithi160 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-11[60042]: 2024-05-08T05:35:48.594+0000 7f0620c06700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.87:6806 osd.0 since back 2024-05-08T05:35:07.779525+0000 front 2024-05-08T05:35:07.779646+0000 (oldest deadline 2024-05-08T05:35:33.579761+0000) 2024-05-08T05:35:48.789 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 08 05:35:48 smithi160 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-11[60042]: 2024-05-08T05:35:48.594+0000 7f0620c06700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.90:6804 osd.1 since back 2024-05-08T05:35:19.381805+0000 front 2024-05-08T05:35:19.381693+0000 (oldest deadline 2024-05-08T05:35:45.281608+0000) 2024-05-08T05:35:48.789 INFO:journalctl@ceph.osd.5.smithi160.stdout:May 08 05:35:48 smithi160 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-5[46734]: 2024-05-08T05:35:48.397+0000 7f6333bd9700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.5 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-05-08T05:35:48.789 INFO:journalctl@ceph.osd.5.smithi160.stdout:May 08 05:35:48 smithi160 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-5[46734]: 2024-05-08T05:35:48.397+0000 7f6333bd9700 -1 osd.5 85 *** Got signal Terminated *** 2024-05-08T05:35:48.789 INFO:journalctl@ceph.osd.5.smithi160.stdout:May 08 05:35:48 smithi160 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-5[46734]: 2024-05-08T05:35:48.397+0000 7f6333bd9700 -1 osd.5 85 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-05-08T05:35:48.959 INFO:journalctl@ceph.osd.6.smithi087.stdout:May 08 05:35:48 smithi087 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-6[58000]: 2024-05-08T05:35:48.593+0000 7f1aca000700 -1 osd.6 85 heartbeat_check: no reply from 172.21.15.87:6806 osd.0 since back 2024-05-08T05:35:10.790888+0000 front 2024-05-08T05:35:10.790808+0000 (oldest deadline 2024-05-08T05:35:36.690826+0000) 2024-05-08T05:35:48.959 INFO:journalctl@ceph.osd.6.smithi087.stdout:May 08 05:35:48 smithi087 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-6[58000]: 2024-05-08T05:35:48.593+0000 7f1aca000700 -1 osd.6 85 heartbeat_check: no reply from 172.21.15.90:6804 osd.1 since back 2024-05-08T05:35:16.691953+0000 front 2024-05-08T05:35:16.691883+0000 (oldest deadline 2024-05-08T05:35:40.792085+0000) 2024-05-08T05:35:48.959 INFO:journalctl@ceph.osd.9.smithi087.stdout:May 08 05:35:48 smithi087 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-9[64574]: 2024-05-08T05:35:48.766+0000 7fb2f9800700 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.87:6806 osd.0 since back 2024-05-08T05:35:08.464101+0000 front 2024-05-08T05:35:08.464047+0000 (oldest deadline 2024-05-08T05:35:31.964171+0000) 2024-05-08T05:35:48.959 INFO:journalctl@ceph.osd.9.smithi087.stdout:May 08 05:35:48 smithi087 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-9[64574]: 2024-05-08T05:35:48.766+0000 7fb2f9800700 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.90:6804 osd.1 since back 2024-05-08T05:35:15.466623+0000 front 2024-05-08T05:35:15.467083+0000 (oldest deadline 2024-05-08T05:35:41.366632+0000) 2024-05-08T05:35:49.288 INFO:journalctl@ceph.osd.8.smithi160.stdout:May 08 05:35:49 smithi160 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-8[53438]: 2024-05-08T05:35:49.108+0000 7f9baa4b7700 -1 osd.8 85 heartbeat_check: no reply from 172.21.15.90:6804 osd.1 since back 2024-05-08T05:35:19.849347+0000 front 2024-05-08T05:35:19.849487+0000 (oldest deadline 2024-05-08T05:35:43.349410+0000) 2024-05-08T05:35:49.289 INFO:journalctl@ceph.osd.5.smithi160.stdout:May 08 05:35:48 smithi160 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-5[46734]: 2024-05-08T05:35:48.940+0000 7f63301cd700 -1 osd.5 85 heartbeat_check: no reply from 172.21.15.87:6806 osd.0 since back 2024-05-08T05:35:10.763693+0000 front 2024-05-08T05:35:10.763544+0000 (oldest deadline 2024-05-08T05:35:35.463411+0000) 2024-05-08T05:35:49.289 INFO:journalctl@ceph.osd.5.smithi160.stdout:May 08 05:35:48 smithi160 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-5[46734]: 2024-05-08T05:35:48.940+0000 7f63301cd700 -1 osd.5 85 heartbeat_check: no reply from 172.21.15.90:6804 osd.1 since back 2024-05-08T05:35:19.564413+0000 front 2024-05-08T05:35:19.564532+0000 (oldest deadline 2024-05-08T05:35:45.464563+0000) 2024-05-08T05:35:49.733 INFO:journalctl@ceph.osd.7.smithi090.stdout:May 08 05:35:49 smithi090 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-7[52517]: 2024-05-08T05:35:49.411+0000 7f2f232a5700 -1 osd.7 85 heartbeat_check: no reply from 172.21.15.90:6804 osd.1 since back 2024-05-08T05:35:19.451959+0000 front 2024-05-08T05:35:19.451987+0000 (oldest deadline 2024-05-08T05:35:43.552168+0000) 2024-05-08T05:35:49.734 INFO:journalctl@ceph.osd.10.smithi090.stdout:May 08 05:35:49 smithi090 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-10[59300]: 2024-05-08T05:35:49.574+0000 7f515bdbb700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.87:6806 osd.0 since back 2024-05-08T05:35:09.330796+0000 front 2024-05-08T05:35:09.330921+0000 (oldest deadline 2024-05-08T05:35:34.030784+0000) 2024-05-08T05:35:49.734 INFO:journalctl@ceph.osd.10.smithi090.stdout:May 08 05:35:49 smithi090 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-10[59300]: 2024-05-08T05:35:49.574+0000 7f515bdbb700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.90:6804 osd.1 since back 2024-05-08T05:35:16.331661+0000 front 2024-05-08T05:35:16.331685+0000 (oldest deadline 2024-05-08T05:35:45.732387+0000) 2024-05-08T05:35:49.955 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 08 05:35:49 smithi160 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-11[60042]: 2024-05-08T05:35:49.596+0000 7f0620c06700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.87:6806 osd.0 since back 2024-05-08T05:35:07.779525+0000 front 2024-05-08T05:35:07.779646+0000 (oldest deadline 2024-05-08T05:35:33.579761+0000) 2024-05-08T05:35:49.956 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 08 05:35:49 smithi160 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-11[60042]: 2024-05-08T05:35:49.596+0000 7f0620c06700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.90:6804 osd.1 since back 2024-05-08T05:35:19.381805+0000 front 2024-05-08T05:35:19.381693+0000 (oldest deadline 2024-05-08T05:35:45.281608+0000) 2024-05-08T05:35:49.960 INFO:journalctl@ceph.osd.6.smithi087.stdout:May 08 05:35:49 smithi087 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-6[58000]: 2024-05-08T05:35:49.590+0000 7f1aca000700 -1 osd.6 85 heartbeat_check: no reply from 172.21.15.87:6806 osd.0 since back 2024-05-08T05:35:10.790888+0000 front 2024-05-08T05:35:10.790808+0000 (oldest deadline 2024-05-08T05:35:36.690826+0000) 2024-05-08T05:35:49.960 INFO:journalctl@ceph.osd.6.smithi087.stdout:May 08 05:35:49 smithi087 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-6[58000]: 2024-05-08T05:35:49.590+0000 7f1aca000700 -1 osd.6 85 heartbeat_check: no reply from 172.21.15.90:6804 osd.1 since back 2024-05-08T05:35:16.691953+0000 front 2024-05-08T05:35:16.691883+0000 (oldest deadline 2024-05-08T05:35:40.792085+0000) 2024-05-08T05:35:49.960 INFO:journalctl@ceph.osd.9.smithi087.stdout:May 08 05:35:49 smithi087 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-9[64574]: 2024-05-08T05:35:49.752+0000 7fb2f9800700 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.87:6806 osd.0 since back 2024-05-08T05:35:08.464101+0000 front 2024-05-08T05:35:08.464047+0000 (oldest deadline 2024-05-08T05:35:31.964171+0000) 2024-05-08T05:35:49.960 INFO:journalctl@ceph.osd.9.smithi087.stdout:May 08 05:35:49 smithi087 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-9[64574]: 2024-05-08T05:35:49.752+0000 7fb2f9800700 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.90:6804 osd.1 since back 2024-05-08T05:35:15.466623+0000 front 2024-05-08T05:35:15.467083+0000 (oldest deadline 2024-05-08T05:35:41.366632+0000) 2024-05-08T05:35:49.960 INFO:journalctl@ceph.osd.9.smithi087.stdout:May 08 05:35:49 smithi087 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-9[64574]: 2024-05-08T05:35:49.752+0000 7fb2f9800700 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-05-08T05:35:24.868777+0000 front 2024-05-08T05:35:24.868646+0000 (oldest deadline 2024-05-08T05:35:48.968629+0000) 2024-05-08T05:35:50.289 INFO:journalctl@ceph.osd.8.smithi160.stdout:May 08 05:35:50 smithi160 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-8[53438]: 2024-05-08T05:35:50.136+0000 7f9baa4b7700 -1 osd.8 85 heartbeat_check: no reply from 172.21.15.90:6804 osd.1 since back 2024-05-08T05:35:19.849347+0000 front 2024-05-08T05:35:19.849487+0000 (oldest deadline 2024-05-08T05:35:43.349410+0000) 2024-05-08T05:35:50.289 INFO:journalctl@ceph.osd.5.smithi160.stdout:May 08 05:35:49 smithi160 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-5[46734]: 2024-05-08T05:35:49.955+0000 7f63301cd700 -1 osd.5 85 heartbeat_check: no reply from 172.21.15.87:6806 osd.0 since back 2024-05-08T05:35:10.763693+0000 front 2024-05-08T05:35:10.763544+0000 (oldest deadline 2024-05-08T05:35:35.463411+0000) 2024-05-08T05:35:50.289 INFO:journalctl@ceph.osd.5.smithi160.stdout:May 08 05:35:49 smithi160 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-5[46734]: 2024-05-08T05:35:49.955+0000 7f63301cd700 -1 osd.5 85 heartbeat_check: no reply from 172.21.15.90:6804 osd.1 since back 2024-05-08T05:35:19.564413+0000 front 2024-05-08T05:35:19.564532+0000 (oldest deadline 2024-05-08T05:35:45.464563+0000) 2024-05-08T05:35:50.734 INFO:journalctl@ceph.osd.7.smithi090.stdout:May 08 05:35:50 smithi090 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-7[52517]: 2024-05-08T05:35:50.438+0000 7f2f232a5700 -1 osd.7 85 heartbeat_check: no reply from 172.21.15.90:6804 osd.1 since back 2024-05-08T05:35:19.451959+0000 front 2024-05-08T05:35:19.451987+0000 (oldest deadline 2024-05-08T05:35:43.552168+0000) 2024-05-08T05:35:50.734 INFO:journalctl@ceph.osd.7.smithi090.stdout:May 08 05:35:50 smithi090 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-7[52517]: 2024-05-08T05:35:50.438+0000 7f2f232a5700 -1 osd.7 85 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-05-08T05:35:23.552784+0000 front 2024-05-08T05:35:23.552870+0000 (oldest deadline 2024-05-08T05:35:49.452918+0000) 2024-05-08T05:35:50.734 INFO:journalctl@ceph.osd.10.smithi090.stdout:May 08 05:35:50 smithi090 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-10[59300]: 2024-05-08T05:35:50.570+0000 7f515bdbb700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.87:6806 osd.0 since back 2024-05-08T05:35:09.330796+0000 front 2024-05-08T05:35:09.330921+0000 (oldest deadline 2024-05-08T05:35:34.030784+0000) 2024-05-08T05:35:50.734 INFO:journalctl@ceph.osd.10.smithi090.stdout:May 08 05:35:50 smithi090 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-10[59300]: 2024-05-08T05:35:50.570+0000 7f515bdbb700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.90:6804 osd.1 since back 2024-05-08T05:35:16.331661+0000 front 2024-05-08T05:35:16.331685+0000 (oldest deadline 2024-05-08T05:35:45.732387+0000) 2024-05-08T05:35:50.734 INFO:journalctl@ceph.osd.10.smithi090.stdout:May 08 05:35:50 smithi090 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-10[59300]: 2024-05-08T05:35:50.570+0000 7f515bdbb700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-05-08T05:35:25.732967+0000 front 2024-05-08T05:35:25.732895+0000 (oldest deadline 2024-05-08T05:35:49.733521+0000) 2024-05-08T05:35:50.958 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 08 05:35:50 smithi160 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-11[60042]: 2024-05-08T05:35:50.591+0000 7f0620c06700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.87:6806 osd.0 since back 2024-05-08T05:35:07.779525+0000 front 2024-05-08T05:35:07.779646+0000 (oldest deadline 2024-05-08T05:35:33.579761+0000) 2024-05-08T05:35:50.958 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 08 05:35:50 smithi160 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-11[60042]: 2024-05-08T05:35:50.591+0000 7f0620c06700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.90:6804 osd.1 since back 2024-05-08T05:35:19.381805+0000 front 2024-05-08T05:35:19.381693+0000 (oldest deadline 2024-05-08T05:35:45.281608+0000) 2024-05-08T05:35:50.959 INFO:journalctl@ceph.osd.6.smithi087.stdout:May 08 05:35:50 smithi087 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-6[58000]: 2024-05-08T05:35:50.632+0000 7f1aca000700 -1 osd.6 85 heartbeat_check: no reply from 172.21.15.87:6806 osd.0 since back 2024-05-08T05:35:10.790888+0000 front 2024-05-08T05:35:10.790808+0000 (oldest deadline 2024-05-08T05:35:36.690826+0000) 2024-05-08T05:35:50.959 INFO:journalctl@ceph.osd.6.smithi087.stdout:May 08 05:35:50 smithi087 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-6[58000]: 2024-05-08T05:35:50.632+0000 7f1aca000700 -1 osd.6 85 heartbeat_check: no reply from 172.21.15.90:6804 osd.1 since back 2024-05-08T05:35:16.691953+0000 front 2024-05-08T05:35:16.691883+0000 (oldest deadline 2024-05-08T05:35:40.792085+0000) 2024-05-08T05:35:50.959 INFO:journalctl@ceph.osd.9.smithi087.stdout:May 08 05:35:50 smithi087 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-9[64574]: 2024-05-08T05:35:50.735+0000 7fb2f9800700 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.87:6806 osd.0 since back 2024-05-08T05:35:08.464101+0000 front 2024-05-08T05:35:08.464047+0000 (oldest deadline 2024-05-08T05:35:31.964171+0000) 2024-05-08T05:35:50.959 INFO:journalctl@ceph.osd.9.smithi087.stdout:May 08 05:35:50 smithi087 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-9[64574]: 2024-05-08T05:35:50.735+0000 7fb2f9800700 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.90:6804 osd.1 since back 2024-05-08T05:35:15.466623+0000 front 2024-05-08T05:35:15.467083+0000 (oldest deadline 2024-05-08T05:35:41.366632+0000) 2024-05-08T05:35:50.959 INFO:journalctl@ceph.osd.9.smithi087.stdout:May 08 05:35:50 smithi087 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-9[64574]: 2024-05-08T05:35:50.735+0000 7fb2f9800700 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-05-08T05:35:24.868777+0000 front 2024-05-08T05:35:24.868646+0000 (oldest deadline 2024-05-08T05:35:48.968629+0000) 2024-05-08T05:35:51.288 INFO:journalctl@ceph.osd.8.smithi160.stdout:May 08 05:35:51 smithi160 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-8[53438]: 2024-05-08T05:35:51.109+0000 7f9baa4b7700 -1 osd.8 85 heartbeat_check: no reply from 172.21.15.90:6804 osd.1 since back 2024-05-08T05:35:19.849347+0000 front 2024-05-08T05:35:19.849487+0000 (oldest deadline 2024-05-08T05:35:43.349410+0000) 2024-05-08T05:35:51.289 INFO:journalctl@ceph.osd.5.smithi160.stdout:May 08 05:35:50 smithi160 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-5[46734]: 2024-05-08T05:35:50.957+0000 7f63301cd700 -1 osd.5 85 heartbeat_check: no reply from 172.21.15.87:6806 osd.0 since back 2024-05-08T05:35:10.763693+0000 front 2024-05-08T05:35:10.763544+0000 (oldest deadline 2024-05-08T05:35:35.463411+0000) 2024-05-08T05:35:51.289 INFO:journalctl@ceph.osd.5.smithi160.stdout:May 08 05:35:50 smithi160 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-5[46734]: 2024-05-08T05:35:50.957+0000 7f63301cd700 -1 osd.5 85 heartbeat_check: no reply from 172.21.15.90:6804 osd.1 since back 2024-05-08T05:35:19.564413+0000 front 2024-05-08T05:35:19.564532+0000 (oldest deadline 2024-05-08T05:35:45.464563+0000) 2024-05-08T05:35:51.733 INFO:journalctl@ceph.osd.10.smithi090.stdout:May 08 05:35:51 smithi090 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-10[59300]: 2024-05-08T05:35:51.575+0000 7f515bdbb700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.87:6806 osd.0 since back 2024-05-08T05:35:09.330796+0000 front 2024-05-08T05:35:09.330921+0000 (oldest deadline 2024-05-08T05:35:34.030784+0000) 2024-05-08T05:35:51.733 INFO:journalctl@ceph.osd.10.smithi090.stdout:May 08 05:35:51 smithi090 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-10[59300]: 2024-05-08T05:35:51.575+0000 7f515bdbb700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.90:6804 osd.1 since back 2024-05-08T05:35:16.331661+0000 front 2024-05-08T05:35:16.331685+0000 (oldest deadline 2024-05-08T05:35:45.732387+0000) 2024-05-08T05:35:51.733 INFO:journalctl@ceph.osd.10.smithi090.stdout:May 08 05:35:51 smithi090 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-10[59300]: 2024-05-08T05:35:51.575+0000 7f515bdbb700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-05-08T05:35:25.732967+0000 front 2024-05-08T05:35:25.732895+0000 (oldest deadline 2024-05-08T05:35:49.733521+0000) 2024-05-08T05:35:51.734 INFO:journalctl@ceph.osd.7.smithi090.stdout:May 08 05:35:51 smithi090 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-7[52517]: 2024-05-08T05:35:51.421+0000 7f2f232a5700 -1 osd.7 85 heartbeat_check: no reply from 172.21.15.90:6804 osd.1 since back 2024-05-08T05:35:19.451959+0000 front 2024-05-08T05:35:19.451987+0000 (oldest deadline 2024-05-08T05:35:43.552168+0000) 2024-05-08T05:35:51.734 INFO:journalctl@ceph.osd.7.smithi090.stdout:May 08 05:35:51 smithi090 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-7[52517]: 2024-05-08T05:35:51.421+0000 7f2f232a5700 -1 osd.7 85 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-05-08T05:35:23.552784+0000 front 2024-05-08T05:35:23.552870+0000 (oldest deadline 2024-05-08T05:35:49.452918+0000) 2024-05-08T05:35:51.788 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 08 05:35:51 smithi160 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-11[60042]: 2024-05-08T05:35:51.552+0000 7f0620c06700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.87:6806 osd.0 since back 2024-05-08T05:35:07.779525+0000 front 2024-05-08T05:35:07.779646+0000 (oldest deadline 2024-05-08T05:35:33.579761+0000) 2024-05-08T05:35:51.789 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 08 05:35:51 smithi160 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-11[60042]: 2024-05-08T05:35:51.552+0000 7f0620c06700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.90:6804 osd.1 since back 2024-05-08T05:35:19.381805+0000 front 2024-05-08T05:35:19.381693+0000 (oldest deadline 2024-05-08T05:35:45.281608+0000) 2024-05-08T05:35:51.789 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 08 05:35:51 smithi160 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-11[60042]: 2024-05-08T05:35:51.552+0000 7f0620c06700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-05-08T05:35:25.282081+0000 front 2024-05-08T05:35:25.282130+0000 (oldest deadline 2024-05-08T05:35:51.182290+0000) 2024-05-08T05:35:51.958 INFO:journalctl@ceph.osd.6.smithi087.stdout:May 08 05:35:51 smithi087 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-6[58000]: 2024-05-08T05:35:51.681+0000 7f1aca000700 -1 osd.6 85 heartbeat_check: no reply from 172.21.15.87:6806 osd.0 since back 2024-05-08T05:35:10.790888+0000 front 2024-05-08T05:35:10.790808+0000 (oldest deadline 2024-05-08T05:35:36.690826+0000) 2024-05-08T05:35:51.958 INFO:journalctl@ceph.osd.6.smithi087.stdout:May 08 05:35:51 smithi087 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-6[58000]: 2024-05-08T05:35:51.681+0000 7f1aca000700 -1 osd.6 85 heartbeat_check: no reply from 172.21.15.90:6804 osd.1 since back 2024-05-08T05:35:16.691953+0000 front 2024-05-08T05:35:16.691883+0000 (oldest deadline 2024-05-08T05:35:40.792085+0000) 2024-05-08T05:35:51.959 INFO:journalctl@ceph.osd.9.smithi087.stdout:May 08 05:35:51 smithi087 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-9[64574]: 2024-05-08T05:35:51.694+0000 7fb2f9800700 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.87:6806 osd.0 since back 2024-05-08T05:35:08.464101+0000 front 2024-05-08T05:35:08.464047+0000 (oldest deadline 2024-05-08T05:35:31.964171+0000) 2024-05-08T05:35:51.959 INFO:journalctl@ceph.osd.9.smithi087.stdout:May 08 05:35:51 smithi087 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-9[64574]: 2024-05-08T05:35:51.694+0000 7fb2f9800700 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.90:6804 osd.1 since back 2024-05-08T05:35:15.466623+0000 front 2024-05-08T05:35:15.467083+0000 (oldest deadline 2024-05-08T05:35:41.366632+0000) 2024-05-08T05:35:51.959 INFO:journalctl@ceph.osd.9.smithi087.stdout:May 08 05:35:51 smithi087 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-9[64574]: 2024-05-08T05:35:51.694+0000 7fb2f9800700 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-05-08T05:35:24.868777+0000 front 2024-05-08T05:35:24.868646+0000 (oldest deadline 2024-05-08T05:35:48.968629+0000) 2024-05-08T05:35:52.288 INFO:journalctl@ceph.osd.5.smithi160.stdout:May 08 05:35:51 smithi160 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-5[46734]: 2024-05-08T05:35:51.938+0000 7f63301cd700 -1 osd.5 85 heartbeat_check: no reply from 172.21.15.87:6806 osd.0 since back 2024-05-08T05:35:10.763693+0000 front 2024-05-08T05:35:10.763544+0000 (oldest deadline 2024-05-08T05:35:35.463411+0000) 2024-05-08T05:35:52.289 INFO:journalctl@ceph.osd.5.smithi160.stdout:May 08 05:35:51 smithi160 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-5[46734]: 2024-05-08T05:35:51.938+0000 7f63301cd700 -1 osd.5 85 heartbeat_check: no reply from 172.21.15.90:6804 osd.1 since back 2024-05-08T05:35:19.564413+0000 front 2024-05-08T05:35:19.564532+0000 (oldest deadline 2024-05-08T05:35:45.464563+0000) 2024-05-08T05:35:52.289 INFO:journalctl@ceph.osd.8.smithi160.stdout:May 08 05:35:52 smithi160 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-8[53438]: 2024-05-08T05:35:52.078+0000 7f9baa4b7700 -1 osd.8 85 heartbeat_check: no reply from 172.21.15.90:6804 osd.1 since back 2024-05-08T05:35:19.849347+0000 front 2024-05-08T05:35:19.849487+0000 (oldest deadline 2024-05-08T05:35:43.349410+0000) 2024-05-08T05:35:52.289 INFO:journalctl@ceph.osd.8.smithi160.stdout:May 08 05:35:52 smithi160 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-8[53438]: 2024-05-08T05:35:52.078+0000 7f9baa4b7700 -1 osd.8 85 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-05-08T05:35:27.950958+0000 front 2024-05-08T05:35:27.950938+0000 (oldest deadline 2024-05-08T05:35:51.451162+0000) 2024-05-08T05:35:52.733 INFO:journalctl@ceph.osd.7.smithi090.stdout:May 08 05:35:52 smithi090 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-7[52517]: 2024-05-08T05:35:52.391+0000 7f2f232a5700 -1 osd.7 85 heartbeat_check: no reply from 172.21.15.90:6804 osd.1 since back 2024-05-08T05:35:19.451959+0000 front 2024-05-08T05:35:19.451987+0000 (oldest deadline 2024-05-08T05:35:43.552168+0000) 2024-05-08T05:35:52.733 INFO:journalctl@ceph.osd.7.smithi090.stdout:May 08 05:35:52 smithi090 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-7[52517]: 2024-05-08T05:35:52.391+0000 7f2f232a5700 -1 osd.7 85 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-05-08T05:35:23.552784+0000 front 2024-05-08T05:35:23.552870+0000 (oldest deadline 2024-05-08T05:35:49.452918+0000) 2024-05-08T05:35:52.734 INFO:journalctl@ceph.osd.10.smithi090.stdout:May 08 05:35:52 smithi090 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-10[59300]: 2024-05-08T05:35:52.607+0000 7f515bdbb700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.87:6806 osd.0 since back 2024-05-08T05:35:09.330796+0000 front 2024-05-08T05:35:09.330921+0000 (oldest deadline 2024-05-08T05:35:34.030784+0000) 2024-05-08T05:35:52.734 INFO:journalctl@ceph.osd.10.smithi090.stdout:May 08 05:35:52 smithi090 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-10[59300]: 2024-05-08T05:35:52.607+0000 7f515bdbb700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.90:6804 osd.1 since back 2024-05-08T05:35:16.331661+0000 front 2024-05-08T05:35:16.331685+0000 (oldest deadline 2024-05-08T05:35:45.732387+0000) 2024-05-08T05:35:52.734 INFO:journalctl@ceph.osd.10.smithi090.stdout:May 08 05:35:52 smithi090 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-10[59300]: 2024-05-08T05:35:52.607+0000 7f515bdbb700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-05-08T05:35:25.732967+0000 front 2024-05-08T05:35:25.732895+0000 (oldest deadline 2024-05-08T05:35:49.733521+0000) 2024-05-08T05:35:52.902 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 08 05:35:52 smithi160 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-11[60042]: 2024-05-08T05:35:52.570+0000 7f0620c06700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.87:6806 osd.0 since back 2024-05-08T05:35:07.779525+0000 front 2024-05-08T05:35:07.779646+0000 (oldest deadline 2024-05-08T05:35:33.579761+0000) 2024-05-08T05:35:52.902 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 08 05:35:52 smithi160 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-11[60042]: 2024-05-08T05:35:52.570+0000 7f0620c06700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.90:6804 osd.1 since back 2024-05-08T05:35:19.381805+0000 front 2024-05-08T05:35:19.381693+0000 (oldest deadline 2024-05-08T05:35:45.281608+0000) 2024-05-08T05:35:52.902 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 08 05:35:52 smithi160 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-11[60042]: 2024-05-08T05:35:52.570+0000 7f0620c06700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-05-08T05:35:25.282081+0000 front 2024-05-08T05:35:25.282130+0000 (oldest deadline 2024-05-08T05:35:51.182290+0000) 2024-05-08T05:35:52.958 INFO:journalctl@ceph.osd.6.smithi087.stdout:May 08 05:35:52 smithi087 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-6[58000]: 2024-05-08T05:35:52.685+0000 7f1aca000700 -1 osd.6 85 heartbeat_check: no reply from 172.21.15.87:6806 osd.0 since back 2024-05-08T05:35:10.790888+0000 front 2024-05-08T05:35:10.790808+0000 (oldest deadline 2024-05-08T05:35:36.690826+0000) 2024-05-08T05:35:52.958 INFO:journalctl@ceph.osd.6.smithi087.stdout:May 08 05:35:52 smithi087 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-6[58000]: 2024-05-08T05:35:52.685+0000 7f1aca000700 -1 osd.6 85 heartbeat_check: no reply from 172.21.15.90:6804 osd.1 since back 2024-05-08T05:35:16.691953+0000 front 2024-05-08T05:35:16.691883+0000 (oldest deadline 2024-05-08T05:35:40.792085+0000) 2024-05-08T05:35:52.959 INFO:journalctl@ceph.osd.9.smithi087.stdout:May 08 05:35:52 smithi087 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-9[64574]: 2024-05-08T05:35:52.691+0000 7fb2f9800700 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.87:6806 osd.0 since back 2024-05-08T05:35:08.464101+0000 front 2024-05-08T05:35:08.464047+0000 (oldest deadline 2024-05-08T05:35:31.964171+0000) 2024-05-08T05:35:52.959 INFO:journalctl@ceph.osd.9.smithi087.stdout:May 08 05:35:52 smithi087 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-9[64574]: 2024-05-08T05:35:52.691+0000 7fb2f9800700 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.90:6804 osd.1 since back 2024-05-08T05:35:15.466623+0000 front 2024-05-08T05:35:15.467083+0000 (oldest deadline 2024-05-08T05:35:41.366632+0000) 2024-05-08T05:35:52.959 INFO:journalctl@ceph.osd.9.smithi087.stdout:May 08 05:35:52 smithi087 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-9[64574]: 2024-05-08T05:35:52.691+0000 7fb2f9800700 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-05-08T05:35:24.868777+0000 front 2024-05-08T05:35:24.868646+0000 (oldest deadline 2024-05-08T05:35:48.968629+0000) 2024-05-08T05:35:53.288 INFO:journalctl@ceph.osd.8.smithi160.stdout:May 08 05:35:53 smithi160 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-8[53438]: 2024-05-08T05:35:53.099+0000 7f9baa4b7700 -1 osd.8 85 heartbeat_check: no reply from 172.21.15.90:6804 osd.1 since back 2024-05-08T05:35:19.849347+0000 front 2024-05-08T05:35:19.849487+0000 (oldest deadline 2024-05-08T05:35:43.349410+0000) 2024-05-08T05:35:53.289 INFO:journalctl@ceph.osd.8.smithi160.stdout:May 08 05:35:53 smithi160 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-8[53438]: 2024-05-08T05:35:53.099+0000 7f9baa4b7700 -1 osd.8 85 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-05-08T05:35:27.950958+0000 front 2024-05-08T05:35:27.950938+0000 (oldest deadline 2024-05-08T05:35:51.451162+0000) 2024-05-08T05:35:53.289 INFO:journalctl@ceph.osd.5.smithi160.stdout:May 08 05:35:52 smithi160 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-5[46734]: 2024-05-08T05:35:52.902+0000 7f63301cd700 -1 osd.5 85 heartbeat_check: no reply from 172.21.15.87:6806 osd.0 since back 2024-05-08T05:35:10.763693+0000 front 2024-05-08T05:35:10.763544+0000 (oldest deadline 2024-05-08T05:35:35.463411+0000) 2024-05-08T05:35:53.289 INFO:journalctl@ceph.osd.5.smithi160.stdout:May 08 05:35:52 smithi160 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-5[46734]: 2024-05-08T05:35:52.902+0000 7f63301cd700 -1 osd.5 85 heartbeat_check: no reply from 172.21.15.90:6804 osd.1 since back 2024-05-08T05:35:19.564413+0000 front 2024-05-08T05:35:19.564532+0000 (oldest deadline 2024-05-08T05:35:45.464563+0000) 2024-05-08T05:35:53.289 INFO:journalctl@ceph.osd.5.smithi160.stdout:May 08 05:35:52 smithi160 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-5[46734]: 2024-05-08T05:35:52.902+0000 7f63301cd700 -1 osd.5 85 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-05-08T05:35:26.966604+0000 front 2024-05-08T05:35:26.966665+0000 (oldest deadline 2024-05-08T05:35:52.866847+0000) 2024-05-08T05:35:53.733 INFO:journalctl@ceph.osd.7.smithi090.stdout:May 08 05:35:53 smithi090 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-7[52517]: 2024-05-08T05:35:53.382+0000 7f2f232a5700 -1 osd.7 85 heartbeat_check: no reply from 172.21.15.90:6804 osd.1 since back 2024-05-08T05:35:19.451959+0000 front 2024-05-08T05:35:19.451987+0000 (oldest deadline 2024-05-08T05:35:43.552168+0000) 2024-05-08T05:35:53.734 INFO:journalctl@ceph.osd.7.smithi090.stdout:May 08 05:35:53 smithi090 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-7[52517]: 2024-05-08T05:35:53.382+0000 7f2f232a5700 -1 osd.7 85 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-05-08T05:35:23.552784+0000 front 2024-05-08T05:35:23.552870+0000 (oldest deadline 2024-05-08T05:35:49.452918+0000) 2024-05-08T05:35:53.734 INFO:journalctl@ceph.osd.10.smithi090.stdout:May 08 05:35:53 smithi090 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-10[59300]: 2024-05-08T05:35:53.598+0000 7f515bdbb700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.87:6806 osd.0 since back 2024-05-08T05:35:09.330796+0000 front 2024-05-08T05:35:09.330921+0000 (oldest deadline 2024-05-08T05:35:34.030784+0000) 2024-05-08T05:35:53.734 INFO:journalctl@ceph.osd.10.smithi090.stdout:May 08 05:35:53 smithi090 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-10[59300]: 2024-05-08T05:35:53.598+0000 7f515bdbb700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.90:6804 osd.1 since back 2024-05-08T05:35:16.331661+0000 front 2024-05-08T05:35:16.331685+0000 (oldest deadline 2024-05-08T05:35:45.732387+0000) 2024-05-08T05:35:53.734 INFO:journalctl@ceph.osd.10.smithi090.stdout:May 08 05:35:53 smithi090 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-10[59300]: 2024-05-08T05:35:53.598+0000 7f515bdbb700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-05-08T05:35:25.732967+0000 front 2024-05-08T05:35:25.732895+0000 (oldest deadline 2024-05-08T05:35:49.733521+0000) 2024-05-08T05:35:53.846 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 08 05:35:53 smithi160 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-11[60042]: 2024-05-08T05:35:53.581+0000 7f0620c06700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.87:6806 osd.0 since back 2024-05-08T05:35:07.779525+0000 front 2024-05-08T05:35:07.779646+0000 (oldest deadline 2024-05-08T05:35:33.579761+0000) 2024-05-08T05:35:53.847 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 08 05:35:53 smithi160 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-11[60042]: 2024-05-08T05:35:53.581+0000 7f0620c06700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.90:6804 osd.1 since back 2024-05-08T05:35:19.381805+0000 front 2024-05-08T05:35:19.381693+0000 (oldest deadline 2024-05-08T05:35:45.281608+0000) 2024-05-08T05:35:53.847 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 08 05:35:53 smithi160 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-11[60042]: 2024-05-08T05:35:53.581+0000 7f0620c06700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-05-08T05:35:25.282081+0000 front 2024-05-08T05:35:25.282130+0000 (oldest deadline 2024-05-08T05:35:51.182290+0000) 2024-05-08T05:35:53.958 INFO:journalctl@ceph.osd.9.smithi087.stdout:May 08 05:35:53 smithi087 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-9[64574]: 2024-05-08T05:35:53.689+0000 7fb2f9800700 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.87:6806 osd.0 since back 2024-05-08T05:35:08.464101+0000 front 2024-05-08T05:35:08.464047+0000 (oldest deadline 2024-05-08T05:35:31.964171+0000) 2024-05-08T05:35:53.958 INFO:journalctl@ceph.osd.9.smithi087.stdout:May 08 05:35:53 smithi087 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-9[64574]: 2024-05-08T05:35:53.689+0000 7fb2f9800700 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.90:6804 osd.1 since back 2024-05-08T05:35:15.466623+0000 front 2024-05-08T05:35:15.467083+0000 (oldest deadline 2024-05-08T05:35:41.366632+0000) 2024-05-08T05:35:53.959 INFO:journalctl@ceph.osd.9.smithi087.stdout:May 08 05:35:53 smithi087 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-9[64574]: 2024-05-08T05:35:53.689+0000 7fb2f9800700 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-05-08T05:35:24.868777+0000 front 2024-05-08T05:35:24.868646+0000 (oldest deadline 2024-05-08T05:35:48.968629+0000) 2024-05-08T05:35:53.959 INFO:journalctl@ceph.osd.6.smithi087.stdout:May 08 05:35:53 smithi087 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-6[58000]: 2024-05-08T05:35:53.734+0000 7f1aca000700 -1 osd.6 85 heartbeat_check: no reply from 172.21.15.87:6806 osd.0 since back 2024-05-08T05:35:10.790888+0000 front 2024-05-08T05:35:10.790808+0000 (oldest deadline 2024-05-08T05:35:36.690826+0000) 2024-05-08T05:35:53.959 INFO:journalctl@ceph.osd.6.smithi087.stdout:May 08 05:35:53 smithi087 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-6[58000]: 2024-05-08T05:35:53.734+0000 7f1aca000700 -1 osd.6 85 heartbeat_check: no reply from 172.21.15.90:6804 osd.1 since back 2024-05-08T05:35:16.691953+0000 front 2024-05-08T05:35:16.691883+0000 (oldest deadline 2024-05-08T05:35:40.792085+0000) 2024-05-08T05:35:53.959 INFO:journalctl@ceph.osd.6.smithi087.stdout:May 08 05:35:53 smithi087 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-6[58000]: 2024-05-08T05:35:53.734+0000 7f1aca000700 -1 osd.6 85 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-05-08T05:35:26.094576+0000 front 2024-05-08T05:35:26.094145+0000 (oldest deadline 2024-05-08T05:35:53.695622+0000) 2024-05-08T05:35:54.123 INFO:journalctl@ceph.osd.5.smithi160.stdout:May 08 05:35:53 smithi160 podman[69934]: 2024-05-08 05:35:53.846244316 +0000 UTC m=+5.565388429 container died 6ba6725224e93470dd3c191e609de6efdf3fe0bb36137a247f39bff1b72981bd (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c, name=ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-5, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, RELEASE=wip-57676-3-bee299f, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.build-date=20240507, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, ceph=True) 2024-05-08T05:35:54.123 INFO:journalctl@ceph.osd.8.smithi160.stdout:May 08 05:35:54 smithi160 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-8[53438]: 2024-05-08T05:35:54.088+0000 7f9baa4b7700 -1 osd.8 85 heartbeat_check: no reply from 172.21.15.90:6804 osd.1 since back 2024-05-08T05:35:19.849347+0000 front 2024-05-08T05:35:19.849487+0000 (oldest deadline 2024-05-08T05:35:43.349410+0000) 2024-05-08T05:35:54.123 INFO:journalctl@ceph.osd.8.smithi160.stdout:May 08 05:35:54 smithi160 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-8[53438]: 2024-05-08T05:35:54.088+0000 7f9baa4b7700 -1 osd.8 85 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-05-08T05:35:27.950958+0000 front 2024-05-08T05:35:27.950938+0000 (oldest deadline 2024-05-08T05:35:51.451162+0000) 2024-05-08T05:35:54.465 INFO:journalctl@ceph.osd.5.smithi160.stdout:May 08 05:35:54 smithi160 podman[69934]: 2024-05-08 05:35:54.222684388 +0000 UTC m=+5.941828544 container cleanup 6ba6725224e93470dd3c191e609de6efdf3fe0bb36137a247f39bff1b72981bd (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c, name=ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-5, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240507, ceph=True, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, RELEASE=wip-57676-3-bee299f, GIT_CLEAN=True) 2024-05-08T05:35:54.465 INFO:journalctl@ceph.osd.5.smithi160.stdout:May 08 05:35:54 smithi160 bash[69934]: ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-5 2024-05-08T05:35:54.733 INFO:journalctl@ceph.osd.7.smithi090.stdout:May 08 05:35:54 smithi090 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-7[52517]: 2024-05-08T05:35:54.374+0000 7f2f232a5700 -1 osd.7 85 heartbeat_check: no reply from 172.21.15.90:6804 osd.1 since back 2024-05-08T05:35:19.451959+0000 front 2024-05-08T05:35:19.451987+0000 (oldest deadline 2024-05-08T05:35:43.552168+0000) 2024-05-08T05:35:54.734 INFO:journalctl@ceph.osd.7.smithi090.stdout:May 08 05:35:54 smithi090 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-7[52517]: 2024-05-08T05:35:54.374+0000 7f2f232a5700 -1 osd.7 85 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-05-08T05:35:23.552784+0000 front 2024-05-08T05:35:23.552870+0000 (oldest deadline 2024-05-08T05:35:49.452918+0000) 2024-05-08T05:35:54.734 INFO:journalctl@ceph.osd.10.smithi090.stdout:May 08 05:35:54 smithi090 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-10[59300]: 2024-05-08T05:35:54.622+0000 7f515bdbb700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.87:6806 osd.0 since back 2024-05-08T05:35:09.330796+0000 front 2024-05-08T05:35:09.330921+0000 (oldest deadline 2024-05-08T05:35:34.030784+0000) 2024-05-08T05:35:54.734 INFO:journalctl@ceph.osd.10.smithi090.stdout:May 08 05:35:54 smithi090 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-10[59300]: 2024-05-08T05:35:54.622+0000 7f515bdbb700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.90:6804 osd.1 since back 2024-05-08T05:35:16.331661+0000 front 2024-05-08T05:35:16.331685+0000 (oldest deadline 2024-05-08T05:35:45.732387+0000) 2024-05-08T05:35:54.734 INFO:journalctl@ceph.osd.10.smithi090.stdout:May 08 05:35:54 smithi090 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-10[59300]: 2024-05-08T05:35:54.622+0000 7f515bdbb700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-05-08T05:35:25.732967+0000 front 2024-05-08T05:35:25.732895+0000 (oldest deadline 2024-05-08T05:35:49.733521+0000) 2024-05-08T05:35:54.790 INFO:journalctl@ceph.osd.5.smithi160.stdout:May 08 05:35:54 smithi160 podman[69951]: 2024-05-08 05:35:54.465204182 +0000 UTC m=+0.619811845 container remove 6ba6725224e93470dd3c191e609de6efdf3fe0bb36137a247f39bff1b72981bd (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c, name=ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-5, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, org.label-schema.build-date=20240507, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, RELEASE=wip-57676-3-bee299f) 2024-05-08T05:35:54.790 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 08 05:35:54 smithi160 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-11[60042]: 2024-05-08T05:35:54.597+0000 7f0620c06700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.87:6806 osd.0 since back 2024-05-08T05:35:07.779525+0000 front 2024-05-08T05:35:07.779646+0000 (oldest deadline 2024-05-08T05:35:33.579761+0000) 2024-05-08T05:35:54.790 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 08 05:35:54 smithi160 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-11[60042]: 2024-05-08T05:35:54.597+0000 7f0620c06700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.90:6804 osd.1 since back 2024-05-08T05:35:19.381805+0000 front 2024-05-08T05:35:19.381693+0000 (oldest deadline 2024-05-08T05:35:45.281608+0000) 2024-05-08T05:35:54.790 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 08 05:35:54 smithi160 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-11[60042]: 2024-05-08T05:35:54.597+0000 7f0620c06700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-05-08T05:35:25.282081+0000 front 2024-05-08T05:35:25.282130+0000 (oldest deadline 2024-05-08T05:35:51.182290+0000) 2024-05-08T05:35:54.958 INFO:journalctl@ceph.osd.6.smithi087.stdout:May 08 05:35:54 smithi087 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-6[58000]: 2024-05-08T05:35:54.728+0000 7f1aca000700 -1 osd.6 85 heartbeat_check: no reply from 172.21.15.87:6806 osd.0 since back 2024-05-08T05:35:10.790888+0000 front 2024-05-08T05:35:10.790808+0000 (oldest deadline 2024-05-08T05:35:36.690826+0000) 2024-05-08T05:35:54.959 INFO:journalctl@ceph.osd.6.smithi087.stdout:May 08 05:35:54 smithi087 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-6[58000]: 2024-05-08T05:35:54.728+0000 7f1aca000700 -1 osd.6 85 heartbeat_check: no reply from 172.21.15.90:6804 osd.1 since back 2024-05-08T05:35:16.691953+0000 front 2024-05-08T05:35:16.691883+0000 (oldest deadline 2024-05-08T05:35:40.792085+0000) 2024-05-08T05:35:54.959 INFO:journalctl@ceph.osd.6.smithi087.stdout:May 08 05:35:54 smithi087 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-6[58000]: 2024-05-08T05:35:54.728+0000 7f1aca000700 -1 osd.6 85 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-05-08T05:35:26.094576+0000 front 2024-05-08T05:35:26.094145+0000 (oldest deadline 2024-05-08T05:35:53.695622+0000) 2024-05-08T05:35:54.959 INFO:journalctl@ceph.osd.9.smithi087.stdout:May 08 05:35:54 smithi087 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-9[64574]: 2024-05-08T05:35:54.654+0000 7fb2f9800700 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.87:6806 osd.0 since back 2024-05-08T05:35:08.464101+0000 front 2024-05-08T05:35:08.464047+0000 (oldest deadline 2024-05-08T05:35:31.964171+0000) 2024-05-08T05:35:54.959 INFO:journalctl@ceph.osd.9.smithi087.stdout:May 08 05:35:54 smithi087 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-9[64574]: 2024-05-08T05:35:54.654+0000 7fb2f9800700 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.90:6804 osd.1 since back 2024-05-08T05:35:15.466623+0000 front 2024-05-08T05:35:15.467083+0000 (oldest deadline 2024-05-08T05:35:41.366632+0000) 2024-05-08T05:35:54.959 INFO:journalctl@ceph.osd.9.smithi087.stdout:May 08 05:35:54 smithi087 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-9[64574]: 2024-05-08T05:35:54.654+0000 7fb2f9800700 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-05-08T05:35:24.868777+0000 front 2024-05-08T05:35:24.868646+0000 (oldest deadline 2024-05-08T05:35:48.968629+0000) 2024-05-08T05:35:55.052 INFO:journalctl@ceph.osd.5.smithi160.stdout:May 08 05:35:54 smithi160 podman[70040]: 2024-05-08 05:35:54.699980866 +0000 UTC m=+0.017865818 image pull 352576a2df49fbab3aeeba1effbcb7a94815e8fc1f120a55ddc340b4ee63b8ce quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c 2024-05-08T05:35:55.052 INFO:journalctl@ceph.osd.5.smithi160.stdout:May 08 05:35:54 smithi160 podman[70040]: 2024-05-08 05:35:54.815988875 +0000 UTC m=+0.133873836 container create 6d4985a65dbef111cca8276a6067fd26e601877cdd76a9172feae2626af0b604 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c, name=ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-5-deactivate, ceph=True, org.label-schema.build-date=20240507, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, RELEASE=wip-57676-3-bee299f, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image) 2024-05-08T05:35:55.347 INFO:journalctl@ceph.osd.8.smithi160.stdout:May 08 05:35:55 smithi160 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-8[53438]: 2024-05-08T05:35:55.089+0000 7f9baa4b7700 -1 osd.8 85 heartbeat_check: no reply from 172.21.15.90:6804 osd.1 since back 2024-05-08T05:35:19.849347+0000 front 2024-05-08T05:35:19.849487+0000 (oldest deadline 2024-05-08T05:35:43.349410+0000) 2024-05-08T05:35:55.347 INFO:journalctl@ceph.osd.8.smithi160.stdout:May 08 05:35:55 smithi160 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-8[53438]: 2024-05-08T05:35:55.089+0000 7f9baa4b7700 -1 osd.8 85 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-05-08T05:35:27.950958+0000 front 2024-05-08T05:35:27.950938+0000 (oldest deadline 2024-05-08T05:35:51.451162+0000) 2024-05-08T05:35:55.347 INFO:journalctl@ceph.osd.5.smithi160.stdout:May 08 05:35:55 smithi160 podman[70040]: 2024-05-08 05:35:55.052408293 +0000 UTC m=+0.370293212 container init 6d4985a65dbef111cca8276a6067fd26e601877cdd76a9172feae2626af0b604 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c, name=ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-5-deactivate, org.label-schema.vendor=CentOS, ceph=True, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, RELEASE=wip-57676-3-bee299f, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240507, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=) 2024-05-08T05:35:55.347 INFO:journalctl@ceph.osd.5.smithi160.stdout:May 08 05:35:55 smithi160 podman[70040]: 2024-05-08 05:35:55.055870168 +0000 UTC m=+0.373755088 container start 6d4985a65dbef111cca8276a6067fd26e601877cdd76a9172feae2626af0b604 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c, name=ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-5-deactivate, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, ceph=True, maintainer=Guillaume Abrioux , GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240507, RELEASE=wip-57676-3-bee299f, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504) 2024-05-08T05:35:55.347 INFO:journalctl@ceph.osd.5.smithi160.stdout:May 08 05:35:55 smithi160 podman[70040]: 2024-05-08 05:35:55.16006853 +0000 UTC m=+0.477953455 container attach 6d4985a65dbef111cca8276a6067fd26e601877cdd76a9172feae2626af0b604 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c, name=ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-5-deactivate, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.vendor=CentOS, RELEASE=wip-57676-3-bee299f, org.label-schema.build-date=20240507, io.buildah.version=1.33.5, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-05-08T05:35:55.697 INFO:journalctl@ceph.osd.5.smithi160.stdout:May 08 05:35:55 smithi160 podman[70040]: 2024-05-08 05:35:55.347689173 +0000 UTC m=+0.665574109 container died 6d4985a65dbef111cca8276a6067fd26e601877cdd76a9172feae2626af0b604 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c, name=ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-5-deactivate, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, ceph=True, GIT_CLEAN=True, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, GIT_BRANCH=HEAD, org.label-schema.build-date=20240507, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, RELEASE=wip-57676-3-bee299f, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image) 2024-05-08T05:35:55.697 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 08 05:35:55 smithi160 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-11[60042]: 2024-05-08T05:35:55.593+0000 7f0620c06700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.87:6806 osd.0 since back 2024-05-08T05:35:07.779525+0000 front 2024-05-08T05:35:07.779646+0000 (oldest deadline 2024-05-08T05:35:33.579761+0000) 2024-05-08T05:35:55.697 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 08 05:35:55 smithi160 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-11[60042]: 2024-05-08T05:35:55.593+0000 7f0620c06700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.90:6804 osd.1 since back 2024-05-08T05:35:19.381805+0000 front 2024-05-08T05:35:19.381693+0000 (oldest deadline 2024-05-08T05:35:45.281608+0000) 2024-05-08T05:35:55.697 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 08 05:35:55 smithi160 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-11[60042]: 2024-05-08T05:35:55.593+0000 7f0620c06700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-05-08T05:35:25.282081+0000 front 2024-05-08T05:35:25.282130+0000 (oldest deadline 2024-05-08T05:35:51.182290+0000) 2024-05-08T05:35:55.733 INFO:journalctl@ceph.osd.7.smithi090.stdout:May 08 05:35:55 smithi090 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-7[52517]: 2024-05-08T05:35:55.378+0000 7f2f232a5700 -1 osd.7 85 heartbeat_check: no reply from 172.21.15.90:6804 osd.1 since back 2024-05-08T05:35:19.451959+0000 front 2024-05-08T05:35:19.451987+0000 (oldest deadline 2024-05-08T05:35:43.552168+0000) 2024-05-08T05:35:55.733 INFO:journalctl@ceph.osd.7.smithi090.stdout:May 08 05:35:55 smithi090 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-7[52517]: 2024-05-08T05:35:55.378+0000 7f2f232a5700 -1 osd.7 85 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-05-08T05:35:23.552784+0000 front 2024-05-08T05:35:23.552870+0000 (oldest deadline 2024-05-08T05:35:49.452918+0000) 2024-05-08T05:35:55.734 INFO:journalctl@ceph.osd.10.smithi090.stdout:May 08 05:35:55 smithi090 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-10[59300]: 2024-05-08T05:35:55.593+0000 7f515bdbb700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.87:6806 osd.0 since back 2024-05-08T05:35:09.330796+0000 front 2024-05-08T05:35:09.330921+0000 (oldest deadline 2024-05-08T05:35:34.030784+0000) 2024-05-08T05:35:55.734 INFO:journalctl@ceph.osd.10.smithi090.stdout:May 08 05:35:55 smithi090 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-10[59300]: 2024-05-08T05:35:55.593+0000 7f515bdbb700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.90:6804 osd.1 since back 2024-05-08T05:35:16.331661+0000 front 2024-05-08T05:35:16.331685+0000 (oldest deadline 2024-05-08T05:35:45.732387+0000) 2024-05-08T05:35:55.734 INFO:journalctl@ceph.osd.10.smithi090.stdout:May 08 05:35:55 smithi090 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-10[59300]: 2024-05-08T05:35:55.593+0000 7f515bdbb700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-05-08T05:35:25.732967+0000 front 2024-05-08T05:35:25.732895+0000 (oldest deadline 2024-05-08T05:35:49.733521+0000) 2024-05-08T05:35:55.958 INFO:journalctl@ceph.osd.6.smithi087.stdout:May 08 05:35:55 smithi087 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-6[58000]: 2024-05-08T05:35:55.768+0000 7f1aca000700 -1 osd.6 85 heartbeat_check: no reply from 172.21.15.87:6806 osd.0 since back 2024-05-08T05:35:10.790888+0000 front 2024-05-08T05:35:10.790808+0000 (oldest deadline 2024-05-08T05:35:36.690826+0000) 2024-05-08T05:35:55.958 INFO:journalctl@ceph.osd.6.smithi087.stdout:May 08 05:35:55 smithi087 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-6[58000]: 2024-05-08T05:35:55.768+0000 7f1aca000700 -1 osd.6 85 heartbeat_check: no reply from 172.21.15.90:6804 osd.1 since back 2024-05-08T05:35:16.691953+0000 front 2024-05-08T05:35:16.691883+0000 (oldest deadline 2024-05-08T05:35:40.792085+0000) 2024-05-08T05:35:55.959 INFO:journalctl@ceph.osd.6.smithi087.stdout:May 08 05:35:55 smithi087 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-6[58000]: 2024-05-08T05:35:55.768+0000 7f1aca000700 -1 osd.6 85 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-05-08T05:35:26.094576+0000 front 2024-05-08T05:35:26.094145+0000 (oldest deadline 2024-05-08T05:35:53.695622+0000) 2024-05-08T05:35:55.959 INFO:journalctl@ceph.osd.9.smithi087.stdout:May 08 05:35:55 smithi087 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-9[64574]: 2024-05-08T05:35:55.694+0000 7fb2f9800700 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.87:6806 osd.0 since back 2024-05-08T05:35:08.464101+0000 front 2024-05-08T05:35:08.464047+0000 (oldest deadline 2024-05-08T05:35:31.964171+0000) 2024-05-08T05:35:55.959 INFO:journalctl@ceph.osd.9.smithi087.stdout:May 08 05:35:55 smithi087 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-9[64574]: 2024-05-08T05:35:55.694+0000 7fb2f9800700 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.90:6804 osd.1 since back 2024-05-08T05:35:15.466623+0000 front 2024-05-08T05:35:15.467083+0000 (oldest deadline 2024-05-08T05:35:41.366632+0000) 2024-05-08T05:35:55.959 INFO:journalctl@ceph.osd.9.smithi087.stdout:May 08 05:35:55 smithi087 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-9[64574]: 2024-05-08T05:35:55.694+0000 7fb2f9800700 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-05-08T05:35:24.868777+0000 front 2024-05-08T05:35:24.868646+0000 (oldest deadline 2024-05-08T05:35:48.968629+0000) 2024-05-08T05:35:56.030 DEBUG:teuthology.orchestra.run.smithi160:> sudo pkill -f 'journalctl -f -n 0 -u ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968@osd.5.service' 2024-05-08T05:35:56.067 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-08T05:35:56.067 INFO:tasks.cephadm.osd.5:Stopped osd.5 2024-05-08T05:35:56.068 INFO:tasks.cephadm.osd.6:Stopping osd.6... 2024-05-08T05:35:56.068 DEBUG:teuthology.orchestra.run.smithi087:> sudo systemctl stop ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968@osd.6 2024-05-08T05:35:56.288 INFO:journalctl@ceph.osd.8.smithi160.stdout:May 08 05:35:56 smithi160 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-8[53438]: 2024-05-08T05:35:56.128+0000 7f9baa4b7700 -1 osd.8 85 heartbeat_check: no reply from 172.21.15.90:6804 osd.1 since back 2024-05-08T05:35:19.849347+0000 front 2024-05-08T05:35:19.849487+0000 (oldest deadline 2024-05-08T05:35:43.349410+0000) 2024-05-08T05:35:56.288 INFO:journalctl@ceph.osd.8.smithi160.stdout:May 08 05:35:56 smithi160 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-8[53438]: 2024-05-08T05:35:56.128+0000 7f9baa4b7700 -1 osd.8 85 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-05-08T05:35:27.950958+0000 front 2024-05-08T05:35:27.950938+0000 (oldest deadline 2024-05-08T05:35:51.451162+0000) 2024-05-08T05:35:56.458 INFO:journalctl@ceph.osd.6.smithi087.stdout:May 08 05:35:56 smithi087 systemd[1]: Stopping Ceph osd.6 for eeeb813e-0cf9-11ef-bc97-c7b262605968... 2024-05-08T05:35:56.733 INFO:journalctl@ceph.osd.7.smithi090.stdout:May 08 05:35:56 smithi090 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-7[52517]: 2024-05-08T05:35:56.401+0000 7f2f232a5700 -1 osd.7 85 heartbeat_check: no reply from 172.21.15.90:6804 osd.1 since back 2024-05-08T05:35:19.451959+0000 front 2024-05-08T05:35:19.451987+0000 (oldest deadline 2024-05-08T05:35:43.552168+0000) 2024-05-08T05:35:56.733 INFO:journalctl@ceph.osd.7.smithi090.stdout:May 08 05:35:56 smithi090 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-7[52517]: 2024-05-08T05:35:56.401+0000 7f2f232a5700 -1 osd.7 85 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-05-08T05:35:23.552784+0000 front 2024-05-08T05:35:23.552870+0000 (oldest deadline 2024-05-08T05:35:49.452918+0000) 2024-05-08T05:35:56.733 INFO:journalctl@ceph.osd.10.smithi090.stdout:May 08 05:35:56 smithi090 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-10[59300]: 2024-05-08T05:35:56.637+0000 7f515bdbb700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.87:6806 osd.0 since back 2024-05-08T05:35:09.330796+0000 front 2024-05-08T05:35:09.330921+0000 (oldest deadline 2024-05-08T05:35:34.030784+0000) 2024-05-08T05:35:56.734 INFO:journalctl@ceph.osd.10.smithi090.stdout:May 08 05:35:56 smithi090 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-10[59300]: 2024-05-08T05:35:56.637+0000 7f515bdbb700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.90:6804 osd.1 since back 2024-05-08T05:35:16.331661+0000 front 2024-05-08T05:35:16.331685+0000 (oldest deadline 2024-05-08T05:35:45.732387+0000) 2024-05-08T05:35:56.734 INFO:journalctl@ceph.osd.10.smithi090.stdout:May 08 05:35:56 smithi090 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-10[59300]: 2024-05-08T05:35:56.638+0000 7f515bdbb700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-05-08T05:35:25.732967+0000 front 2024-05-08T05:35:25.732895+0000 (oldest deadline 2024-05-08T05:35:49.733521+0000) 2024-05-08T05:35:56.959 INFO:journalctl@ceph.osd.9.smithi087.stdout:May 08 05:35:56 smithi087 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-9[64574]: 2024-05-08T05:35:56.705+0000 7fb2f9800700 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.87:6806 osd.0 since back 2024-05-08T05:35:08.464101+0000 front 2024-05-08T05:35:08.464047+0000 (oldest deadline 2024-05-08T05:35:31.964171+0000) 2024-05-08T05:35:56.959 INFO:journalctl@ceph.osd.9.smithi087.stdout:May 08 05:35:56 smithi087 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-9[64574]: 2024-05-08T05:35:56.705+0000 7fb2f9800700 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.90:6804 osd.1 since back 2024-05-08T05:35:15.466623+0000 front 2024-05-08T05:35:15.467083+0000 (oldest deadline 2024-05-08T05:35:41.366632+0000) 2024-05-08T05:35:56.959 INFO:journalctl@ceph.osd.9.smithi087.stdout:May 08 05:35:56 smithi087 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-9[64574]: 2024-05-08T05:35:56.705+0000 7fb2f9800700 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-05-08T05:35:24.868777+0000 front 2024-05-08T05:35:24.868646+0000 (oldest deadline 2024-05-08T05:35:48.968629+0000) 2024-05-08T05:35:56.959 INFO:journalctl@ceph.osd.6.smithi087.stdout:May 08 05:35:56 smithi087 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-6[58000]: 2024-05-08T05:35:56.626+0000 7f1ad3800700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.6 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-05-08T05:35:56.959 INFO:journalctl@ceph.osd.6.smithi087.stdout:May 08 05:35:56 smithi087 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-6[58000]: 2024-05-08T05:35:56.626+0000 7f1ad3800700 -1 osd.6 85 *** Got signal Terminated *** 2024-05-08T05:35:56.959 INFO:journalctl@ceph.osd.6.smithi087.stdout:May 08 05:35:56 smithi087 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-6[58000]: 2024-05-08T05:35:56.626+0000 7f1ad3800700 -1 osd.6 85 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-05-08T05:35:56.959 INFO:journalctl@ceph.osd.6.smithi087.stdout:May 08 05:35:56 smithi087 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-6[58000]: 2024-05-08T05:35:56.815+0000 7f1aca000700 -1 osd.6 85 heartbeat_check: no reply from 172.21.15.87:6806 osd.0 since back 2024-05-08T05:35:10.790888+0000 front 2024-05-08T05:35:10.790808+0000 (oldest deadline 2024-05-08T05:35:36.690826+0000) 2024-05-08T05:35:56.959 INFO:journalctl@ceph.osd.6.smithi087.stdout:May 08 05:35:56 smithi087 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-6[58000]: 2024-05-08T05:35:56.815+0000 7f1aca000700 -1 osd.6 85 heartbeat_check: no reply from 172.21.15.90:6804 osd.1 since back 2024-05-08T05:35:16.691953+0000 front 2024-05-08T05:35:16.691883+0000 (oldest deadline 2024-05-08T05:35:40.792085+0000) 2024-05-08T05:35:56.959 INFO:journalctl@ceph.osd.6.smithi087.stdout:May 08 05:35:56 smithi087 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-6[58000]: 2024-05-08T05:35:56.815+0000 7f1aca000700 -1 osd.6 85 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-05-08T05:35:26.094576+0000 front 2024-05-08T05:35:26.094145+0000 (oldest deadline 2024-05-08T05:35:53.695622+0000) 2024-05-08T05:35:57.038 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 08 05:35:56 smithi160 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-11[60042]: 2024-05-08T05:35:56.573+0000 7f0620c06700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.87:6806 osd.0 since back 2024-05-08T05:35:07.779525+0000 front 2024-05-08T05:35:07.779646+0000 (oldest deadline 2024-05-08T05:35:33.579761+0000) 2024-05-08T05:35:57.038 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 08 05:35:56 smithi160 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-11[60042]: 2024-05-08T05:35:56.573+0000 7f0620c06700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.90:6804 osd.1 since back 2024-05-08T05:35:19.381805+0000 front 2024-05-08T05:35:19.381693+0000 (oldest deadline 2024-05-08T05:35:45.281608+0000) 2024-05-08T05:35:57.038 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 08 05:35:56 smithi160 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-11[60042]: 2024-05-08T05:35:56.573+0000 7f0620c06700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-05-08T05:35:25.282081+0000 front 2024-05-08T05:35:25.282130+0000 (oldest deadline 2024-05-08T05:35:51.182290+0000) 2024-05-08T05:35:57.538 INFO:journalctl@ceph.osd.8.smithi160.stdout:May 08 05:35:57 smithi160 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-8[53438]: 2024-05-08T05:35:57.154+0000 7f9baa4b7700 -1 osd.8 85 heartbeat_check: no reply from 172.21.15.90:6804 osd.1 since back 2024-05-08T05:35:19.849347+0000 front 2024-05-08T05:35:19.849487+0000 (oldest deadline 2024-05-08T05:35:43.349410+0000) 2024-05-08T05:35:57.538 INFO:journalctl@ceph.osd.8.smithi160.stdout:May 08 05:35:57 smithi160 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-8[53438]: 2024-05-08T05:35:57.154+0000 7f9baa4b7700 -1 osd.8 85 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-05-08T05:35:27.950958+0000 front 2024-05-08T05:35:27.950938+0000 (oldest deadline 2024-05-08T05:35:51.451162+0000) 2024-05-08T05:35:57.662 INFO:journalctl@ceph.osd.7.smithi090.stdout:May 08 05:35:57 smithi090 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-7[52517]: 2024-05-08T05:35:57.404+0000 7f2f232a5700 -1 osd.7 85 heartbeat_check: no reply from 172.21.15.90:6804 osd.1 since back 2024-05-08T05:35:19.451959+0000 front 2024-05-08T05:35:19.451987+0000 (oldest deadline 2024-05-08T05:35:43.552168+0000) 2024-05-08T05:35:57.662 INFO:journalctl@ceph.osd.7.smithi090.stdout:May 08 05:35:57 smithi090 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-7[52517]: 2024-05-08T05:35:57.404+0000 7f2f232a5700 -1 osd.7 85 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-05-08T05:35:23.552784+0000 front 2024-05-08T05:35:23.552870+0000 (oldest deadline 2024-05-08T05:35:49.452918+0000) 2024-05-08T05:35:57.983 INFO:journalctl@ceph.osd.10.smithi090.stdout:May 08 05:35:57 smithi090 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-10[59300]: 2024-05-08T05:35:57.662+0000 7f515bdbb700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.87:6806 osd.0 since back 2024-05-08T05:35:09.330796+0000 front 2024-05-08T05:35:09.330921+0000 (oldest deadline 2024-05-08T05:35:34.030784+0000) 2024-05-08T05:35:57.983 INFO:journalctl@ceph.osd.10.smithi090.stdout:May 08 05:35:57 smithi090 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-10[59300]: 2024-05-08T05:35:57.662+0000 7f515bdbb700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.90:6804 osd.1 since back 2024-05-08T05:35:16.331661+0000 front 2024-05-08T05:35:16.331685+0000 (oldest deadline 2024-05-08T05:35:45.732387+0000) 2024-05-08T05:35:57.983 INFO:journalctl@ceph.osd.10.smithi090.stdout:May 08 05:35:57 smithi090 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-10[59300]: 2024-05-08T05:35:57.662+0000 7f515bdbb700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-05-08T05:35:25.732967+0000 front 2024-05-08T05:35:25.732895+0000 (oldest deadline 2024-05-08T05:35:49.733521+0000) 2024-05-08T05:35:58.038 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 08 05:35:57 smithi160 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-11[60042]: 2024-05-08T05:35:57.575+0000 7f0620c06700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.87:6806 osd.0 since back 2024-05-08T05:35:07.779525+0000 front 2024-05-08T05:35:07.779646+0000 (oldest deadline 2024-05-08T05:35:33.579761+0000) 2024-05-08T05:35:58.038 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 08 05:35:57 smithi160 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-11[60042]: 2024-05-08T05:35:57.575+0000 7f0620c06700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.90:6804 osd.1 since back 2024-05-08T05:35:19.381805+0000 front 2024-05-08T05:35:19.381693+0000 (oldest deadline 2024-05-08T05:35:45.281608+0000) 2024-05-08T05:35:58.039 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 08 05:35:57 smithi160 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-11[60042]: 2024-05-08T05:35:57.575+0000 7f0620c06700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-05-08T05:35:25.282081+0000 front 2024-05-08T05:35:25.282130+0000 (oldest deadline 2024-05-08T05:35:51.182290+0000) 2024-05-08T05:35:58.209 INFO:journalctl@ceph.osd.6.smithi087.stdout:May 08 05:35:57 smithi087 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-6[58000]: 2024-05-08T05:35:57.835+0000 7f1aca000700 -1 osd.6 85 heartbeat_check: no reply from 172.21.15.87:6806 osd.0 since back 2024-05-08T05:35:10.790888+0000 front 2024-05-08T05:35:10.790808+0000 (oldest deadline 2024-05-08T05:35:36.690826+0000) 2024-05-08T05:35:58.209 INFO:journalctl@ceph.osd.6.smithi087.stdout:May 08 05:35:57 smithi087 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-6[58000]: 2024-05-08T05:35:57.835+0000 7f1aca000700 -1 osd.6 85 heartbeat_check: no reply from 172.21.15.90:6804 osd.1 since back 2024-05-08T05:35:16.691953+0000 front 2024-05-08T05:35:16.691883+0000 (oldest deadline 2024-05-08T05:35:40.792085+0000) 2024-05-08T05:35:58.209 INFO:journalctl@ceph.osd.6.smithi087.stdout:May 08 05:35:57 smithi087 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-6[58000]: 2024-05-08T05:35:57.835+0000 7f1aca000700 -1 osd.6 85 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-05-08T05:35:26.094576+0000 front 2024-05-08T05:35:26.094145+0000 (oldest deadline 2024-05-08T05:35:53.695622+0000) 2024-05-08T05:35:58.209 INFO:journalctl@ceph.osd.9.smithi087.stdout:May 08 05:35:57 smithi087 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-9[64574]: 2024-05-08T05:35:57.735+0000 7fb2f9800700 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.87:6806 osd.0 since back 2024-05-08T05:35:08.464101+0000 front 2024-05-08T05:35:08.464047+0000 (oldest deadline 2024-05-08T05:35:31.964171+0000) 2024-05-08T05:35:58.209 INFO:journalctl@ceph.osd.9.smithi087.stdout:May 08 05:35:57 smithi087 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-9[64574]: 2024-05-08T05:35:57.735+0000 7fb2f9800700 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.90:6804 osd.1 since back 2024-05-08T05:35:15.466623+0000 front 2024-05-08T05:35:15.467083+0000 (oldest deadline 2024-05-08T05:35:41.366632+0000) 2024-05-08T05:35:58.209 INFO:journalctl@ceph.osd.9.smithi087.stdout:May 08 05:35:57 smithi087 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-9[64574]: 2024-05-08T05:35:57.735+0000 7fb2f9800700 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-05-08T05:35:24.868777+0000 front 2024-05-08T05:35:24.868646+0000 (oldest deadline 2024-05-08T05:35:48.968629+0000) 2024-05-08T05:35:58.538 INFO:journalctl@ceph.osd.8.smithi160.stdout:May 08 05:35:58 smithi160 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-8[53438]: 2024-05-08T05:35:58.161+0000 7f9baa4b7700 -1 osd.8 85 heartbeat_check: no reply from 172.21.15.90:6804 osd.1 since back 2024-05-08T05:35:19.849347+0000 front 2024-05-08T05:35:19.849487+0000 (oldest deadline 2024-05-08T05:35:43.349410+0000) 2024-05-08T05:35:58.539 INFO:journalctl@ceph.osd.8.smithi160.stdout:May 08 05:35:58 smithi160 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-8[53438]: 2024-05-08T05:35:58.161+0000 7f9baa4b7700 -1 osd.8 85 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-05-08T05:35:27.950958+0000 front 2024-05-08T05:35:27.950938+0000 (oldest deadline 2024-05-08T05:35:51.451162+0000) 2024-05-08T05:35:58.733 INFO:journalctl@ceph.osd.7.smithi090.stdout:May 08 05:35:58 smithi090 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-7[52517]: 2024-05-08T05:35:58.451+0000 7f2f232a5700 -1 osd.7 85 heartbeat_check: no reply from 172.21.15.90:6804 osd.1 since back 2024-05-08T05:35:19.451959+0000 front 2024-05-08T05:35:19.451987+0000 (oldest deadline 2024-05-08T05:35:43.552168+0000) 2024-05-08T05:35:58.733 INFO:journalctl@ceph.osd.7.smithi090.stdout:May 08 05:35:58 smithi090 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-7[52517]: 2024-05-08T05:35:58.451+0000 7f2f232a5700 -1 osd.7 85 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-05-08T05:35:23.552784+0000 front 2024-05-08T05:35:23.552870+0000 (oldest deadline 2024-05-08T05:35:49.452918+0000) 2024-05-08T05:35:58.734 INFO:journalctl@ceph.osd.10.smithi090.stdout:May 08 05:35:58 smithi090 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-10[59300]: 2024-05-08T05:35:58.672+0000 7f515bdbb700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.87:6806 osd.0 since back 2024-05-08T05:35:09.330796+0000 front 2024-05-08T05:35:09.330921+0000 (oldest deadline 2024-05-08T05:35:34.030784+0000) 2024-05-08T05:35:58.734 INFO:journalctl@ceph.osd.10.smithi090.stdout:May 08 05:35:58 smithi090 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-10[59300]: 2024-05-08T05:35:58.672+0000 7f515bdbb700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.90:6804 osd.1 since back 2024-05-08T05:35:16.331661+0000 front 2024-05-08T05:35:16.331685+0000 (oldest deadline 2024-05-08T05:35:45.732387+0000) 2024-05-08T05:35:58.734 INFO:journalctl@ceph.osd.10.smithi090.stdout:May 08 05:35:58 smithi090 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-10[59300]: 2024-05-08T05:35:58.672+0000 7f515bdbb700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-05-08T05:35:25.732967+0000 front 2024-05-08T05:35:25.732895+0000 (oldest deadline 2024-05-08T05:35:49.733521+0000) 2024-05-08T05:35:58.734 INFO:journalctl@ceph.osd.10.smithi090.stdout:May 08 05:35:58 smithi090 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-10[59300]: 2024-05-08T05:35:58.672+0000 7f515bdbb700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.87:6814 osd.3 since back 2024-05-08T05:35:34.935373+0000 front 2024-05-08T05:35:34.935510+0000 (oldest deadline 2024-05-08T05:35:58.335621+0000) 2024-05-08T05:35:59.038 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 08 05:35:58 smithi160 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-11[60042]: 2024-05-08T05:35:58.576+0000 7f0620c06700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.87:6806 osd.0 since back 2024-05-08T05:35:07.779525+0000 front 2024-05-08T05:35:07.779646+0000 (oldest deadline 2024-05-08T05:35:33.579761+0000) 2024-05-08T05:35:59.038 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 08 05:35:58 smithi160 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-11[60042]: 2024-05-08T05:35:58.576+0000 7f0620c06700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.90:6804 osd.1 since back 2024-05-08T05:35:19.381805+0000 front 2024-05-08T05:35:19.381693+0000 (oldest deadline 2024-05-08T05:35:45.281608+0000) 2024-05-08T05:35:59.039 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 08 05:35:58 smithi160 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-11[60042]: 2024-05-08T05:35:58.576+0000 7f0620c06700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-05-08T05:35:25.282081+0000 front 2024-05-08T05:35:25.282130+0000 (oldest deadline 2024-05-08T05:35:51.182290+0000) 2024-05-08T05:35:59.208 INFO:journalctl@ceph.osd.6.smithi087.stdout:May 08 05:35:58 smithi087 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-6[58000]: 2024-05-08T05:35:58.847+0000 7f1aca000700 -1 osd.6 85 heartbeat_check: no reply from 172.21.15.87:6806 osd.0 since back 2024-05-08T05:35:10.790888+0000 front 2024-05-08T05:35:10.790808+0000 (oldest deadline 2024-05-08T05:35:36.690826+0000) 2024-05-08T05:35:59.209 INFO:journalctl@ceph.osd.6.smithi087.stdout:May 08 05:35:58 smithi087 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-6[58000]: 2024-05-08T05:35:58.847+0000 7f1aca000700 -1 osd.6 85 heartbeat_check: no reply from 172.21.15.90:6804 osd.1 since back 2024-05-08T05:35:16.691953+0000 front 2024-05-08T05:35:16.691883+0000 (oldest deadline 2024-05-08T05:35:40.792085+0000) 2024-05-08T05:35:59.209 INFO:journalctl@ceph.osd.6.smithi087.stdout:May 08 05:35:58 smithi087 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-6[58000]: 2024-05-08T05:35:58.847+0000 7f1aca000700 -1 osd.6 85 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-05-08T05:35:26.094576+0000 front 2024-05-08T05:35:26.094145+0000 (oldest deadline 2024-05-08T05:35:53.695622+0000) 2024-05-08T05:35:59.209 INFO:journalctl@ceph.osd.9.smithi087.stdout:May 08 05:35:58 smithi087 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-9[64574]: 2024-05-08T05:35:58.766+0000 7fb2f9800700 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.87:6806 osd.0 since back 2024-05-08T05:35:08.464101+0000 front 2024-05-08T05:35:08.464047+0000 (oldest deadline 2024-05-08T05:35:31.964171+0000) 2024-05-08T05:35:59.209 INFO:journalctl@ceph.osd.9.smithi087.stdout:May 08 05:35:58 smithi087 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-9[64574]: 2024-05-08T05:35:58.766+0000 7fb2f9800700 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.90:6804 osd.1 since back 2024-05-08T05:35:15.466623+0000 front 2024-05-08T05:35:15.467083+0000 (oldest deadline 2024-05-08T05:35:41.366632+0000) 2024-05-08T05:35:59.209 INFO:journalctl@ceph.osd.9.smithi087.stdout:May 08 05:35:58 smithi087 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-9[64574]: 2024-05-08T05:35:58.766+0000 7fb2f9800700 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-05-08T05:35:24.868777+0000 front 2024-05-08T05:35:24.868646+0000 (oldest deadline 2024-05-08T05:35:48.968629+0000) 2024-05-08T05:35:59.538 INFO:journalctl@ceph.osd.8.smithi160.stdout:May 08 05:35:59 smithi160 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-8[53438]: 2024-05-08T05:35:59.143+0000 7f9baa4b7700 -1 osd.8 85 heartbeat_check: no reply from 172.21.15.90:6804 osd.1 since back 2024-05-08T05:35:19.849347+0000 front 2024-05-08T05:35:19.849487+0000 (oldest deadline 2024-05-08T05:35:43.349410+0000) 2024-05-08T05:35:59.539 INFO:journalctl@ceph.osd.8.smithi160.stdout:May 08 05:35:59 smithi160 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-8[53438]: 2024-05-08T05:35:59.143+0000 7f9baa4b7700 -1 osd.8 85 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-05-08T05:35:27.950958+0000 front 2024-05-08T05:35:27.950938+0000 (oldest deadline 2024-05-08T05:35:51.451162+0000) 2024-05-08T05:35:59.733 INFO:journalctl@ceph.osd.7.smithi090.stdout:May 08 05:35:59 smithi090 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-7[52517]: 2024-05-08T05:35:59.478+0000 7f2f232a5700 -1 osd.7 85 heartbeat_check: no reply from 172.21.15.90:6804 osd.1 since back 2024-05-08T05:35:19.451959+0000 front 2024-05-08T05:35:19.451987+0000 (oldest deadline 2024-05-08T05:35:43.552168+0000) 2024-05-08T05:35:59.733 INFO:journalctl@ceph.osd.7.smithi090.stdout:May 08 05:35:59 smithi090 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-7[52517]: 2024-05-08T05:35:59.478+0000 7f2f232a5700 -1 osd.7 85 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-05-08T05:35:23.552784+0000 front 2024-05-08T05:35:23.552870+0000 (oldest deadline 2024-05-08T05:35:49.452918+0000) 2024-05-08T05:35:59.733 INFO:journalctl@ceph.osd.7.smithi090.stdout:May 08 05:35:59 smithi090 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-7[52517]: 2024-05-08T05:35:59.478+0000 7f2f232a5700 -1 osd.7 85 heartbeat_check: no reply from 172.21.15.87:6814 osd.3 since back 2024-05-08T05:35:32.755227+0000 front 2024-05-08T05:35:32.755164+0000 (oldest deadline 2024-05-08T05:35:58.655042+0000) 2024-05-08T05:35:59.734 INFO:journalctl@ceph.osd.10.smithi090.stdout:May 08 05:35:59 smithi090 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-10[59300]: 2024-05-08T05:35:59.685+0000 7f515bdbb700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.87:6806 osd.0 since back 2024-05-08T05:35:09.330796+0000 front 2024-05-08T05:35:09.330921+0000 (oldest deadline 2024-05-08T05:35:34.030784+0000) 2024-05-08T05:35:59.734 INFO:journalctl@ceph.osd.10.smithi090.stdout:May 08 05:35:59 smithi090 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-10[59300]: 2024-05-08T05:35:59.685+0000 7f515bdbb700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.90:6804 osd.1 since back 2024-05-08T05:35:16.331661+0000 front 2024-05-08T05:35:16.331685+0000 (oldest deadline 2024-05-08T05:35:45.732387+0000) 2024-05-08T05:35:59.734 INFO:journalctl@ceph.osd.10.smithi090.stdout:May 08 05:35:59 smithi090 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-10[59300]: 2024-05-08T05:35:59.685+0000 7f515bdbb700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-05-08T05:35:25.732967+0000 front 2024-05-08T05:35:25.732895+0000 (oldest deadline 2024-05-08T05:35:49.733521+0000) 2024-05-08T05:35:59.734 INFO:journalctl@ceph.osd.10.smithi090.stdout:May 08 05:35:59 smithi090 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-10[59300]: 2024-05-08T05:35:59.685+0000 7f515bdbb700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.87:6814 osd.3 since back 2024-05-08T05:35:34.935373+0000 front 2024-05-08T05:35:34.935510+0000 (oldest deadline 2024-05-08T05:35:58.335621+0000) 2024-05-08T05:36:00.038 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 08 05:35:59 smithi160 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-11[60042]: 2024-05-08T05:35:59.575+0000 7f0620c06700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.87:6806 osd.0 since back 2024-05-08T05:35:07.779525+0000 front 2024-05-08T05:35:07.779646+0000 (oldest deadline 2024-05-08T05:35:33.579761+0000) 2024-05-08T05:36:00.038 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 08 05:35:59 smithi160 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-11[60042]: 2024-05-08T05:35:59.575+0000 7f0620c06700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.90:6804 osd.1 since back 2024-05-08T05:35:19.381805+0000 front 2024-05-08T05:35:19.381693+0000 (oldest deadline 2024-05-08T05:35:45.281608+0000) 2024-05-08T05:36:00.039 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 08 05:35:59 smithi160 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-11[60042]: 2024-05-08T05:35:59.575+0000 7f0620c06700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-05-08T05:35:25.282081+0000 front 2024-05-08T05:35:25.282130+0000 (oldest deadline 2024-05-08T05:35:51.182290+0000) 2024-05-08T05:36:00.209 INFO:journalctl@ceph.osd.9.smithi087.stdout:May 08 05:35:59 smithi087 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-9[64574]: 2024-05-08T05:35:59.799+0000 7fb2f9800700 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.87:6806 osd.0 since back 2024-05-08T05:35:08.464101+0000 front 2024-05-08T05:35:08.464047+0000 (oldest deadline 2024-05-08T05:35:31.964171+0000) 2024-05-08T05:36:00.209 INFO:journalctl@ceph.osd.9.smithi087.stdout:May 08 05:35:59 smithi087 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-9[64574]: 2024-05-08T05:35:59.799+0000 7fb2f9800700 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.90:6804 osd.1 since back 2024-05-08T05:35:15.466623+0000 front 2024-05-08T05:35:15.467083+0000 (oldest deadline 2024-05-08T05:35:41.366632+0000) 2024-05-08T05:36:00.209 INFO:journalctl@ceph.osd.9.smithi087.stdout:May 08 05:35:59 smithi087 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-9[64574]: 2024-05-08T05:35:59.799+0000 7fb2f9800700 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-05-08T05:35:24.868777+0000 front 2024-05-08T05:35:24.868646+0000 (oldest deadline 2024-05-08T05:35:48.968629+0000) 2024-05-08T05:36:00.209 INFO:journalctl@ceph.osd.6.smithi087.stdout:May 08 05:35:59 smithi087 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-6[58000]: 2024-05-08T05:35:59.805+0000 7f1aca000700 -1 osd.6 85 heartbeat_check: no reply from 172.21.15.87:6806 osd.0 since back 2024-05-08T05:35:10.790888+0000 front 2024-05-08T05:35:10.790808+0000 (oldest deadline 2024-05-08T05:35:36.690826+0000) 2024-05-08T05:36:00.209 INFO:journalctl@ceph.osd.6.smithi087.stdout:May 08 05:35:59 smithi087 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-6[58000]: 2024-05-08T05:35:59.805+0000 7f1aca000700 -1 osd.6 85 heartbeat_check: no reply from 172.21.15.90:6804 osd.1 since back 2024-05-08T05:35:16.691953+0000 front 2024-05-08T05:35:16.691883+0000 (oldest deadline 2024-05-08T05:35:40.792085+0000) 2024-05-08T05:36:00.209 INFO:journalctl@ceph.osd.6.smithi087.stdout:May 08 05:35:59 smithi087 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-6[58000]: 2024-05-08T05:35:59.805+0000 7f1aca000700 -1 osd.6 85 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-05-08T05:35:26.094576+0000 front 2024-05-08T05:35:26.094145+0000 (oldest deadline 2024-05-08T05:35:53.695622+0000) 2024-05-08T05:36:00.209 INFO:journalctl@ceph.osd.6.smithi087.stdout:May 08 05:35:59 smithi087 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-6[58000]: 2024-05-08T05:35:59.805+0000 7f1aca000700 -1 osd.6 85 heartbeat_check: no reply from 172.21.15.87:6814 osd.3 since back 2024-05-08T05:35:33.696518+0000 front 2024-05-08T05:35:33.696751+0000 (oldest deadline 2024-05-08T05:35:58.996799+0000) 2024-05-08T05:36:00.538 INFO:journalctl@ceph.osd.8.smithi160.stdout:May 08 05:36:00 smithi160 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-8[53438]: 2024-05-08T05:36:00.191+0000 7f9baa4b7700 -1 osd.8 85 heartbeat_check: no reply from 172.21.15.90:6804 osd.1 since back 2024-05-08T05:35:19.849347+0000 front 2024-05-08T05:35:19.849487+0000 (oldest deadline 2024-05-08T05:35:43.349410+0000) 2024-05-08T05:36:00.539 INFO:journalctl@ceph.osd.8.smithi160.stdout:May 08 05:36:00 smithi160 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-8[53438]: 2024-05-08T05:36:00.191+0000 7f9baa4b7700 -1 osd.8 85 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-05-08T05:35:27.950958+0000 front 2024-05-08T05:35:27.950938+0000 (oldest deadline 2024-05-08T05:35:51.451162+0000) 2024-05-08T05:36:00.698 INFO:journalctl@ceph.osd.7.smithi090.stdout:May 08 05:36:00 smithi090 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-7[52517]: 2024-05-08T05:36:00.431+0000 7f2f232a5700 -1 osd.7 85 heartbeat_check: no reply from 172.21.15.90:6804 osd.1 since back 2024-05-08T05:35:19.451959+0000 front 2024-05-08T05:35:19.451987+0000 (oldest deadline 2024-05-08T05:35:43.552168+0000) 2024-05-08T05:36:00.698 INFO:journalctl@ceph.osd.7.smithi090.stdout:May 08 05:36:00 smithi090 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-7[52517]: 2024-05-08T05:36:00.431+0000 7f2f232a5700 -1 osd.7 85 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-05-08T05:35:23.552784+0000 front 2024-05-08T05:35:23.552870+0000 (oldest deadline 2024-05-08T05:35:49.452918+0000) 2024-05-08T05:36:00.698 INFO:journalctl@ceph.osd.7.smithi090.stdout:May 08 05:36:00 smithi090 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-7[52517]: 2024-05-08T05:36:00.431+0000 7f2f232a5700 -1 osd.7 85 heartbeat_check: no reply from 172.21.15.87:6814 osd.3 since back 2024-05-08T05:35:32.755227+0000 front 2024-05-08T05:35:32.755164+0000 (oldest deadline 2024-05-08T05:35:58.655042+0000) 2024-05-08T05:36:00.983 INFO:journalctl@ceph.osd.10.smithi090.stdout:May 08 05:36:00 smithi090 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-10[59300]: 2024-05-08T05:36:00.698+0000 7f515bdbb700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.87:6806 osd.0 since back 2024-05-08T05:35:09.330796+0000 front 2024-05-08T05:35:09.330921+0000 (oldest deadline 2024-05-08T05:35:34.030784+0000) 2024-05-08T05:36:00.983 INFO:journalctl@ceph.osd.10.smithi090.stdout:May 08 05:36:00 smithi090 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-10[59300]: 2024-05-08T05:36:00.698+0000 7f515bdbb700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.90:6804 osd.1 since back 2024-05-08T05:35:16.331661+0000 front 2024-05-08T05:35:16.331685+0000 (oldest deadline 2024-05-08T05:35:45.732387+0000) 2024-05-08T05:36:00.984 INFO:journalctl@ceph.osd.10.smithi090.stdout:May 08 05:36:00 smithi090 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-10[59300]: 2024-05-08T05:36:00.698+0000 7f515bdbb700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-05-08T05:35:25.732967+0000 front 2024-05-08T05:35:25.732895+0000 (oldest deadline 2024-05-08T05:35:49.733521+0000) 2024-05-08T05:36:00.984 INFO:journalctl@ceph.osd.10.smithi090.stdout:May 08 05:36:00 smithi090 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-10[59300]: 2024-05-08T05:36:00.698+0000 7f515bdbb700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.87:6814 osd.3 since back 2024-05-08T05:35:34.935373+0000 front 2024-05-08T05:35:34.935510+0000 (oldest deadline 2024-05-08T05:35:58.335621+0000) 2024-05-08T05:36:01.039 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 08 05:36:00 smithi160 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-11[60042]: 2024-05-08T05:36:00.540+0000 7f0620c06700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.87:6806 osd.0 since back 2024-05-08T05:35:07.779525+0000 front 2024-05-08T05:35:07.779646+0000 (oldest deadline 2024-05-08T05:35:33.579761+0000) 2024-05-08T05:36:01.039 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 08 05:36:00 smithi160 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-11[60042]: 2024-05-08T05:36:00.541+0000 7f0620c06700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.90:6804 osd.1 since back 2024-05-08T05:35:19.381805+0000 front 2024-05-08T05:35:19.381693+0000 (oldest deadline 2024-05-08T05:35:45.281608+0000) 2024-05-08T05:36:01.039 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 08 05:36:00 smithi160 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-11[60042]: 2024-05-08T05:36:00.541+0000 7f0620c06700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-05-08T05:35:25.282081+0000 front 2024-05-08T05:35:25.282130+0000 (oldest deadline 2024-05-08T05:35:51.182290+0000) 2024-05-08T05:36:01.111 INFO:journalctl@ceph.osd.6.smithi087.stdout:May 08 05:36:00 smithi087 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-6[58000]: 2024-05-08T05:36:00.806+0000 7f1aca000700 -1 osd.6 85 heartbeat_check: no reply from 172.21.15.87:6806 osd.0 since back 2024-05-08T05:35:10.790888+0000 front 2024-05-08T05:35:10.790808+0000 (oldest deadline 2024-05-08T05:35:36.690826+0000) 2024-05-08T05:36:01.111 INFO:journalctl@ceph.osd.6.smithi087.stdout:May 08 05:36:00 smithi087 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-6[58000]: 2024-05-08T05:36:00.806+0000 7f1aca000700 -1 osd.6 85 heartbeat_check: no reply from 172.21.15.90:6804 osd.1 since back 2024-05-08T05:35:16.691953+0000 front 2024-05-08T05:35:16.691883+0000 (oldest deadline 2024-05-08T05:35:40.792085+0000) 2024-05-08T05:36:01.111 INFO:journalctl@ceph.osd.6.smithi087.stdout:May 08 05:36:00 smithi087 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-6[58000]: 2024-05-08T05:36:00.806+0000 7f1aca000700 -1 osd.6 85 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-05-08T05:35:26.094576+0000 front 2024-05-08T05:35:26.094145+0000 (oldest deadline 2024-05-08T05:35:53.695622+0000) 2024-05-08T05:36:01.111 INFO:journalctl@ceph.osd.6.smithi087.stdout:May 08 05:36:00 smithi087 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-6[58000]: 2024-05-08T05:36:00.806+0000 7f1aca000700 -1 osd.6 85 heartbeat_check: no reply from 172.21.15.87:6814 osd.3 since back 2024-05-08T05:35:33.696518+0000 front 2024-05-08T05:35:33.696751+0000 (oldest deadline 2024-05-08T05:35:58.996799+0000) 2024-05-08T05:36:01.112 INFO:journalctl@ceph.osd.9.smithi087.stdout:May 08 05:36:00 smithi087 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-9[64574]: 2024-05-08T05:36:00.835+0000 7fb2f9800700 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.87:6806 osd.0 since back 2024-05-08T05:35:08.464101+0000 front 2024-05-08T05:35:08.464047+0000 (oldest deadline 2024-05-08T05:35:31.964171+0000) 2024-05-08T05:36:01.112 INFO:journalctl@ceph.osd.9.smithi087.stdout:May 08 05:36:00 smithi087 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-9[64574]: 2024-05-08T05:36:00.835+0000 7fb2f9800700 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.90:6804 osd.1 since back 2024-05-08T05:35:15.466623+0000 front 2024-05-08T05:35:15.467083+0000 (oldest deadline 2024-05-08T05:35:41.366632+0000) 2024-05-08T05:36:01.112 INFO:journalctl@ceph.osd.9.smithi087.stdout:May 08 05:36:00 smithi087 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-9[64574]: 2024-05-08T05:36:00.835+0000 7fb2f9800700 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-05-08T05:35:24.868777+0000 front 2024-05-08T05:35:24.868646+0000 (oldest deadline 2024-05-08T05:35:48.968629+0000) 2024-05-08T05:36:01.112 INFO:journalctl@ceph.osd.9.smithi087.stdout:May 08 05:36:00 smithi087 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-9[64574]: 2024-05-08T05:36:00.835+0000 7fb2f9800700 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.87:6814 osd.3 since back 2024-05-08T05:35:32.470732+0000 front 2024-05-08T05:35:32.471202+0000 (oldest deadline 2024-05-08T05:36:00.071563+0000) 2024-05-08T05:36:01.538 INFO:journalctl@ceph.osd.8.smithi160.stdout:May 08 05:36:01 smithi160 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-8[53438]: 2024-05-08T05:36:01.205+0000 7f9baa4b7700 -1 osd.8 85 heartbeat_check: no reply from 172.21.15.90:6804 osd.1 since back 2024-05-08T05:35:19.849347+0000 front 2024-05-08T05:35:19.849487+0000 (oldest deadline 2024-05-08T05:35:43.349410+0000) 2024-05-08T05:36:01.539 INFO:journalctl@ceph.osd.8.smithi160.stdout:May 08 05:36:01 smithi160 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-8[53438]: 2024-05-08T05:36:01.205+0000 7f9baa4b7700 -1 osd.8 85 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-05-08T05:35:27.950958+0000 front 2024-05-08T05:35:27.950938+0000 (oldest deadline 2024-05-08T05:35:51.451162+0000) 2024-05-08T05:36:01.539 INFO:journalctl@ceph.osd.8.smithi160.stdout:May 08 05:36:01 smithi160 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-8[53438]: 2024-05-08T05:36:01.206+0000 7f9baa4b7700 -1 osd.8 85 heartbeat_check: no reply from 172.21.15.87:6814 osd.3 since back 2024-05-08T05:35:34.352349+0000 front 2024-05-08T05:35:34.352493+0000 (oldest deadline 2024-05-08T05:36:00.252195+0000) 2024-05-08T05:36:01.732 INFO:journalctl@ceph.osd.7.smithi090.stdout:May 08 05:36:01 smithi090 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-7[52517]: 2024-05-08T05:36:01.444+0000 7f2f232a5700 -1 osd.7 85 heartbeat_check: no reply from 172.21.15.90:6804 osd.1 since back 2024-05-08T05:35:19.451959+0000 front 2024-05-08T05:35:19.451987+0000 (oldest deadline 2024-05-08T05:35:43.552168+0000) 2024-05-08T05:36:01.732 INFO:journalctl@ceph.osd.7.smithi090.stdout:May 08 05:36:01 smithi090 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-7[52517]: 2024-05-08T05:36:01.444+0000 7f2f232a5700 -1 osd.7 85 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-05-08T05:35:23.552784+0000 front 2024-05-08T05:35:23.552870+0000 (oldest deadline 2024-05-08T05:35:49.452918+0000) 2024-05-08T05:36:01.732 INFO:journalctl@ceph.osd.7.smithi090.stdout:May 08 05:36:01 smithi090 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-7[52517]: 2024-05-08T05:36:01.444+0000 7f2f232a5700 -1 osd.7 85 heartbeat_check: no reply from 172.21.15.87:6814 osd.3 since back 2024-05-08T05:35:32.755227+0000 front 2024-05-08T05:35:32.755164+0000 (oldest deadline 2024-05-08T05:35:58.655042+0000) 2024-05-08T05:36:01.983 INFO:journalctl@ceph.osd.10.smithi090.stdout:May 08 05:36:01 smithi090 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-10[59300]: 2024-05-08T05:36:01.731+0000 7f515bdbb700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.87:6806 osd.0 since back 2024-05-08T05:35:09.330796+0000 front 2024-05-08T05:35:09.330921+0000 (oldest deadline 2024-05-08T05:35:34.030784+0000) 2024-05-08T05:36:01.983 INFO:journalctl@ceph.osd.10.smithi090.stdout:May 08 05:36:01 smithi090 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-10[59300]: 2024-05-08T05:36:01.731+0000 7f515bdbb700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.90:6804 osd.1 since back 2024-05-08T05:35:16.331661+0000 front 2024-05-08T05:35:16.331685+0000 (oldest deadline 2024-05-08T05:35:45.732387+0000) 2024-05-08T05:36:01.983 INFO:journalctl@ceph.osd.10.smithi090.stdout:May 08 05:36:01 smithi090 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-10[59300]: 2024-05-08T05:36:01.731+0000 7f515bdbb700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-05-08T05:35:25.732967+0000 front 2024-05-08T05:35:25.732895+0000 (oldest deadline 2024-05-08T05:35:49.733521+0000) 2024-05-08T05:36:01.984 INFO:journalctl@ceph.osd.10.smithi090.stdout:May 08 05:36:01 smithi090 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-10[59300]: 2024-05-08T05:36:01.731+0000 7f515bdbb700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.87:6814 osd.3 since back 2024-05-08T05:35:34.935373+0000 front 2024-05-08T05:35:34.935510+0000 (oldest deadline 2024-05-08T05:35:58.335621+0000) 2024-05-08T05:36:02.038 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 08 05:36:01 smithi160 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-11[60042]: 2024-05-08T05:36:01.572+0000 7f0620c06700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.87:6806 osd.0 since back 2024-05-08T05:35:07.779525+0000 front 2024-05-08T05:35:07.779646+0000 (oldest deadline 2024-05-08T05:35:33.579761+0000) 2024-05-08T05:36:02.039 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 08 05:36:01 smithi160 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-11[60042]: 2024-05-08T05:36:01.572+0000 7f0620c06700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.90:6804 osd.1 since back 2024-05-08T05:35:19.381805+0000 front 2024-05-08T05:35:19.381693+0000 (oldest deadline 2024-05-08T05:35:45.281608+0000) 2024-05-08T05:36:02.039 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 08 05:36:01 smithi160 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-11[60042]: 2024-05-08T05:36:01.572+0000 7f0620c06700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-05-08T05:35:25.282081+0000 front 2024-05-08T05:35:25.282130+0000 (oldest deadline 2024-05-08T05:35:51.182290+0000) 2024-05-08T05:36:02.039 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 08 05:36:01 smithi160 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-11[60042]: 2024-05-08T05:36:01.572+0000 7f0620c06700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.87:6814 osd.3 since back 2024-05-08T05:35:35.784273+0000 front 2024-05-08T05:35:35.784316+0000 (oldest deadline 2024-05-08T05:36:01.084003+0000) 2024-05-08T05:36:02.138 INFO:journalctl@ceph.osd.9.smithi087.stdout:May 08 05:36:01 smithi087 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-9[64574]: 2024-05-08T05:36:01.874+0000 7fb2f9800700 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.87:6806 osd.0 since back 2024-05-08T05:35:08.464101+0000 front 2024-05-08T05:35:08.464047+0000 (oldest deadline 2024-05-08T05:35:31.964171+0000) 2024-05-08T05:36:02.138 INFO:journalctl@ceph.osd.9.smithi087.stdout:May 08 05:36:01 smithi087 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-9[64574]: 2024-05-08T05:36:01.874+0000 7fb2f9800700 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.90:6804 osd.1 since back 2024-05-08T05:35:15.466623+0000 front 2024-05-08T05:35:15.467083+0000 (oldest deadline 2024-05-08T05:35:41.366632+0000) 2024-05-08T05:36:02.138 INFO:journalctl@ceph.osd.9.smithi087.stdout:May 08 05:36:01 smithi087 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-9[64574]: 2024-05-08T05:36:01.874+0000 7fb2f9800700 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-05-08T05:35:24.868777+0000 front 2024-05-08T05:35:24.868646+0000 (oldest deadline 2024-05-08T05:35:48.968629+0000) 2024-05-08T05:36:02.138 INFO:journalctl@ceph.osd.9.smithi087.stdout:May 08 05:36:01 smithi087 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-9[64574]: 2024-05-08T05:36:01.874+0000 7fb2f9800700 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.87:6814 osd.3 since back 2024-05-08T05:35:32.470732+0000 front 2024-05-08T05:35:32.471202+0000 (oldest deadline 2024-05-08T05:36:00.071563+0000) 2024-05-08T05:36:02.458 INFO:journalctl@ceph.osd.6.smithi087.stdout:May 08 05:36:02 smithi087 podman[97358]: 2024-05-08 05:36:02.232088218 +0000 UTC m=+5.734676622 container died 352140cdcac63a0702999e4fe0a7e9645f35974fad8042c53ca885f68d6ac456 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c, name=ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-6, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, GIT_CLEAN=True, RELEASE=wip-57676-3-bee299f, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240507) 2024-05-08T05:36:02.538 INFO:journalctl@ceph.osd.8.smithi160.stdout:May 08 05:36:02 smithi160 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-8[53438]: 2024-05-08T05:36:02.218+0000 7f9baa4b7700 -1 osd.8 85 heartbeat_check: no reply from 172.21.15.90:6804 osd.1 since back 2024-05-08T05:35:19.849347+0000 front 2024-05-08T05:35:19.849487+0000 (oldest deadline 2024-05-08T05:35:43.349410+0000) 2024-05-08T05:36:02.539 INFO:journalctl@ceph.osd.8.smithi160.stdout:May 08 05:36:02 smithi160 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-8[53438]: 2024-05-08T05:36:02.218+0000 7f9baa4b7700 -1 osd.8 85 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-05-08T05:35:27.950958+0000 front 2024-05-08T05:35:27.950938+0000 (oldest deadline 2024-05-08T05:35:51.451162+0000) 2024-05-08T05:36:02.539 INFO:journalctl@ceph.osd.8.smithi160.stdout:May 08 05:36:02 smithi160 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-8[53438]: 2024-05-08T05:36:02.218+0000 7f9baa4b7700 -1 osd.8 85 heartbeat_check: no reply from 172.21.15.87:6814 osd.3 since back 2024-05-08T05:35:34.352349+0000 front 2024-05-08T05:35:34.352493+0000 (oldest deadline 2024-05-08T05:36:00.252195+0000) 2024-05-08T05:36:02.733 INFO:journalctl@ceph.osd.7.smithi090.stdout:May 08 05:36:02 smithi090 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-7[52517]: 2024-05-08T05:36:02.476+0000 7f2f232a5700 -1 osd.7 85 heartbeat_check: no reply from 172.21.15.90:6804 osd.1 since back 2024-05-08T05:35:19.451959+0000 front 2024-05-08T05:35:19.451987+0000 (oldest deadline 2024-05-08T05:35:43.552168+0000) 2024-05-08T05:36:02.734 INFO:journalctl@ceph.osd.7.smithi090.stdout:May 08 05:36:02 smithi090 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-7[52517]: 2024-05-08T05:36:02.476+0000 7f2f232a5700 -1 osd.7 85 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-05-08T05:35:23.552784+0000 front 2024-05-08T05:35:23.552870+0000 (oldest deadline 2024-05-08T05:35:49.452918+0000) 2024-05-08T05:36:02.734 INFO:journalctl@ceph.osd.7.smithi090.stdout:May 08 05:36:02 smithi090 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-7[52517]: 2024-05-08T05:36:02.476+0000 7f2f232a5700 -1 osd.7 85 heartbeat_check: no reply from 172.21.15.87:6814 osd.3 since back 2024-05-08T05:35:32.755227+0000 front 2024-05-08T05:35:32.755164+0000 (oldest deadline 2024-05-08T05:35:58.655042+0000) 2024-05-08T05:36:02.734 INFO:journalctl@ceph.osd.10.smithi090.stdout:May 08 05:36:02 smithi090 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-10[59300]: 2024-05-08T05:36:02.699+0000 7f515bdbb700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.87:6806 osd.0 since back 2024-05-08T05:35:09.330796+0000 front 2024-05-08T05:35:09.330921+0000 (oldest deadline 2024-05-08T05:35:34.030784+0000) 2024-05-08T05:36:02.734 INFO:journalctl@ceph.osd.10.smithi090.stdout:May 08 05:36:02 smithi090 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-10[59300]: 2024-05-08T05:36:02.699+0000 7f515bdbb700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.90:6804 osd.1 since back 2024-05-08T05:35:16.331661+0000 front 2024-05-08T05:35:16.331685+0000 (oldest deadline 2024-05-08T05:35:45.732387+0000) 2024-05-08T05:36:02.734 INFO:journalctl@ceph.osd.10.smithi090.stdout:May 08 05:36:02 smithi090 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-10[59300]: 2024-05-08T05:36:02.699+0000 7f515bdbb700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-05-08T05:35:25.732967+0000 front 2024-05-08T05:35:25.732895+0000 (oldest deadline 2024-05-08T05:35:49.733521+0000) 2024-05-08T05:36:02.734 INFO:journalctl@ceph.osd.10.smithi090.stdout:May 08 05:36:02 smithi090 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-10[59300]: 2024-05-08T05:36:02.699+0000 7f515bdbb700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.87:6814 osd.3 since back 2024-05-08T05:35:34.935373+0000 front 2024-05-08T05:35:34.935510+0000 (oldest deadline 2024-05-08T05:35:58.335621+0000) 2024-05-08T05:36:02.745 INFO:journalctl@ceph.osd.6.smithi087.stdout:May 08 05:36:02 smithi087 podman[97358]: 2024-05-08 05:36:02.736171435 +0000 UTC m=+6.238759879 container cleanup 352140cdcac63a0702999e4fe0a7e9645f35974fad8042c53ca885f68d6ac456 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c, name=ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-6, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, GIT_CLEAN=True, org.label-schema.build-date=20240507, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-57676-3-bee299f, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, ceph=True, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS) 2024-05-08T05:36:02.745 INFO:journalctl@ceph.osd.6.smithi087.stdout:May 08 05:36:02 smithi087 bash[97358]: ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-6 2024-05-08T05:36:03.038 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 08 05:36:02 smithi160 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-11[60042]: 2024-05-08T05:36:02.621+0000 7f0620c06700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.87:6806 osd.0 since back 2024-05-08T05:35:07.779525+0000 front 2024-05-08T05:35:07.779646+0000 (oldest deadline 2024-05-08T05:35:33.579761+0000) 2024-05-08T05:36:03.039 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 08 05:36:02 smithi160 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-11[60042]: 2024-05-08T05:36:02.621+0000 7f0620c06700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.90:6804 osd.1 since back 2024-05-08T05:35:19.381805+0000 front 2024-05-08T05:35:19.381693+0000 (oldest deadline 2024-05-08T05:35:45.281608+0000) 2024-05-08T05:36:03.039 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 08 05:36:02 smithi160 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-11[60042]: 2024-05-08T05:36:02.621+0000 7f0620c06700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-05-08T05:35:25.282081+0000 front 2024-05-08T05:35:25.282130+0000 (oldest deadline 2024-05-08T05:35:51.182290+0000) 2024-05-08T05:36:03.039 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 08 05:36:02 smithi160 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-11[60042]: 2024-05-08T05:36:02.621+0000 7f0620c06700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.87:6814 osd.3 since back 2024-05-08T05:35:35.784273+0000 front 2024-05-08T05:35:35.784316+0000 (oldest deadline 2024-05-08T05:36:01.084003+0000) 2024-05-08T05:36:03.208 INFO:journalctl@ceph.osd.6.smithi087.stdout:May 08 05:36:03 smithi087 podman[97377]: 2024-05-08 05:36:03.045893556 +0000 UTC m=+0.805847301 container remove 352140cdcac63a0702999e4fe0a7e9645f35974fad8042c53ca885f68d6ac456 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c, name=ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-6, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, ceph=True, RELEASE=wip-57676-3-bee299f, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240507, CEPH_POINT_RELEASE=, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, io.buildah.version=1.33.5) 2024-05-08T05:36:03.209 INFO:journalctl@ceph.osd.9.smithi087.stdout:May 08 05:36:02 smithi087 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-9[64574]: 2024-05-08T05:36:02.900+0000 7fb2f9800700 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.87:6806 osd.0 since back 2024-05-08T05:35:08.464101+0000 front 2024-05-08T05:35:08.464047+0000 (oldest deadline 2024-05-08T05:35:31.964171+0000) 2024-05-08T05:36:03.209 INFO:journalctl@ceph.osd.9.smithi087.stdout:May 08 05:36:02 smithi087 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-9[64574]: 2024-05-08T05:36:02.900+0000 7fb2f9800700 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.90:6804 osd.1 since back 2024-05-08T05:35:15.466623+0000 front 2024-05-08T05:35:15.467083+0000 (oldest deadline 2024-05-08T05:35:41.366632+0000) 2024-05-08T05:36:03.209 INFO:journalctl@ceph.osd.9.smithi087.stdout:May 08 05:36:02 smithi087 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-9[64574]: 2024-05-08T05:36:02.900+0000 7fb2f9800700 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-05-08T05:35:24.868777+0000 front 2024-05-08T05:35:24.868646+0000 (oldest deadline 2024-05-08T05:35:48.968629+0000) 2024-05-08T05:36:03.210 INFO:journalctl@ceph.osd.9.smithi087.stdout:May 08 05:36:02 smithi087 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-9[64574]: 2024-05-08T05:36:02.900+0000 7fb2f9800700 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.87:6814 osd.3 since back 2024-05-08T05:35:32.470732+0000 front 2024-05-08T05:35:32.471202+0000 (oldest deadline 2024-05-08T05:36:00.071563+0000) 2024-05-08T05:36:03.538 INFO:journalctl@ceph.osd.8.smithi160.stdout:May 08 05:36:03 smithi160 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-8[53438]: 2024-05-08T05:36:03.238+0000 7f9baa4b7700 -1 osd.8 85 heartbeat_check: no reply from 172.21.15.90:6804 osd.1 since back 2024-05-08T05:35:19.849347+0000 front 2024-05-08T05:35:19.849487+0000 (oldest deadline 2024-05-08T05:35:43.349410+0000) 2024-05-08T05:36:03.539 INFO:journalctl@ceph.osd.8.smithi160.stdout:May 08 05:36:03 smithi160 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-8[53438]: 2024-05-08T05:36:03.238+0000 7f9baa4b7700 -1 osd.8 85 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-05-08T05:35:27.950958+0000 front 2024-05-08T05:35:27.950938+0000 (oldest deadline 2024-05-08T05:35:51.451162+0000) 2024-05-08T05:36:03.539 INFO:journalctl@ceph.osd.8.smithi160.stdout:May 08 05:36:03 smithi160 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-8[53438]: 2024-05-08T05:36:03.238+0000 7f9baa4b7700 -1 osd.8 85 heartbeat_check: no reply from 172.21.15.87:6814 osd.3 since back 2024-05-08T05:35:34.352349+0000 front 2024-05-08T05:35:34.352493+0000 (oldest deadline 2024-05-08T05:36:00.252195+0000) 2024-05-08T05:36:03.733 INFO:journalctl@ceph.osd.7.smithi090.stdout:May 08 05:36:03 smithi090 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-7[52517]: 2024-05-08T05:36:03.471+0000 7f2f232a5700 -1 osd.7 85 heartbeat_check: no reply from 172.21.15.90:6804 osd.1 since back 2024-05-08T05:35:19.451959+0000 front 2024-05-08T05:35:19.451987+0000 (oldest deadline 2024-05-08T05:35:43.552168+0000) 2024-05-08T05:36:03.733 INFO:journalctl@ceph.osd.7.smithi090.stdout:May 08 05:36:03 smithi090 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-7[52517]: 2024-05-08T05:36:03.471+0000 7f2f232a5700 -1 osd.7 85 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-05-08T05:35:23.552784+0000 front 2024-05-08T05:35:23.552870+0000 (oldest deadline 2024-05-08T05:35:49.452918+0000) 2024-05-08T05:36:03.733 INFO:journalctl@ceph.osd.7.smithi090.stdout:May 08 05:36:03 smithi090 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-7[52517]: 2024-05-08T05:36:03.471+0000 7f2f232a5700 -1 osd.7 85 heartbeat_check: no reply from 172.21.15.87:6814 osd.3 since back 2024-05-08T05:35:32.755227+0000 front 2024-05-08T05:35:32.755164+0000 (oldest deadline 2024-05-08T05:35:58.655042+0000) 2024-05-08T05:36:03.734 INFO:journalctl@ceph.osd.10.smithi090.stdout:May 08 05:36:03 smithi090 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-10[59300]: 2024-05-08T05:36:03.703+0000 7f515bdbb700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.87:6806 osd.0 since back 2024-05-08T05:35:09.330796+0000 front 2024-05-08T05:35:09.330921+0000 (oldest deadline 2024-05-08T05:35:34.030784+0000) 2024-05-08T05:36:03.734 INFO:journalctl@ceph.osd.10.smithi090.stdout:May 08 05:36:03 smithi090 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-10[59300]: 2024-05-08T05:36:03.703+0000 7f515bdbb700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.90:6804 osd.1 since back 2024-05-08T05:35:16.331661+0000 front 2024-05-08T05:35:16.331685+0000 (oldest deadline 2024-05-08T05:35:45.732387+0000) 2024-05-08T05:36:03.734 INFO:journalctl@ceph.osd.10.smithi090.stdout:May 08 05:36:03 smithi090 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-10[59300]: 2024-05-08T05:36:03.703+0000 7f515bdbb700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-05-08T05:35:25.732967+0000 front 2024-05-08T05:35:25.732895+0000 (oldest deadline 2024-05-08T05:35:49.733521+0000) 2024-05-08T05:36:03.734 INFO:journalctl@ceph.osd.10.smithi090.stdout:May 08 05:36:03 smithi090 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-10[59300]: 2024-05-08T05:36:03.703+0000 7f515bdbb700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.87:6814 osd.3 since back 2024-05-08T05:35:34.935373+0000 front 2024-05-08T05:35:34.935510+0000 (oldest deadline 2024-05-08T05:35:58.335621+0000) 2024-05-08T05:36:04.012 INFO:journalctl@ceph.osd.9.smithi087.stdout:May 08 05:36:03 smithi087 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-9[64574]: 2024-05-08T05:36:03.917+0000 7fb2f9800700 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.87:6806 osd.0 since back 2024-05-08T05:35:08.464101+0000 front 2024-05-08T05:35:08.464047+0000 (oldest deadline 2024-05-08T05:35:31.964171+0000) 2024-05-08T05:36:04.013 INFO:journalctl@ceph.osd.9.smithi087.stdout:May 08 05:36:03 smithi087 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-9[64574]: 2024-05-08T05:36:03.918+0000 7fb2f9800700 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.90:6804 osd.1 since back 2024-05-08T05:35:15.466623+0000 front 2024-05-08T05:35:15.467083+0000 (oldest deadline 2024-05-08T05:35:41.366632+0000) 2024-05-08T05:36:04.013 INFO:journalctl@ceph.osd.9.smithi087.stdout:May 08 05:36:03 smithi087 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-9[64574]: 2024-05-08T05:36:03.918+0000 7fb2f9800700 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-05-08T05:35:24.868777+0000 front 2024-05-08T05:35:24.868646+0000 (oldest deadline 2024-05-08T05:35:48.968629+0000) 2024-05-08T05:36:04.013 INFO:journalctl@ceph.osd.9.smithi087.stdout:May 08 05:36:03 smithi087 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-9[64574]: 2024-05-08T05:36:03.918+0000 7fb2f9800700 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.87:6814 osd.3 since back 2024-05-08T05:35:32.470732+0000 front 2024-05-08T05:35:32.471202+0000 (oldest deadline 2024-05-08T05:36:00.071563+0000) 2024-05-08T05:36:04.013 INFO:journalctl@ceph.osd.6.smithi087.stdout:May 08 05:36:03 smithi087 podman[97473]: 2024-05-08 05:36:03.621574788 +0000 UTC m=+0.033885743 image pull 352576a2df49fbab3aeeba1effbcb7a94815e8fc1f120a55ddc340b4ee63b8ce quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c 2024-05-08T05:36:04.013 INFO:journalctl@ceph.osd.6.smithi087.stdout:May 08 05:36:03 smithi087 podman[97473]: 2024-05-08 05:36:03.721767695 +0000 UTC m=+0.134078650 container create 02d9ef6b68d01bab23766079fbfe89f812f5b77862ccb8caabdede13c8301c09 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c, name=ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-6-deactivate, org.label-schema.schema-version=1.0, GIT_CLEAN=True, RELEASE=wip-57676-3-bee299f, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.build-date=20240507, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504) 2024-05-08T05:36:04.013 INFO:journalctl@ceph.osd.6.smithi087.stdout:May 08 05:36:04 smithi087 podman[97473]: 2024-05-08 05:36:04.011863367 +0000 UTC m=+0.424174389 container init 02d9ef6b68d01bab23766079fbfe89f812f5b77862ccb8caabdede13c8301c09 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c, name=ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-6-deactivate, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240507, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, GIT_CLEAN=True, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-57676-3-bee299f, ceph=True) 2024-05-08T05:36:04.038 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 08 05:36:03 smithi160 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-11[60042]: 2024-05-08T05:36:03.668+0000 7f0620c06700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.87:6806 osd.0 since back 2024-05-08T05:35:07.779525+0000 front 2024-05-08T05:35:07.779646+0000 (oldest deadline 2024-05-08T05:35:33.579761+0000) 2024-05-08T05:36:04.038 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 08 05:36:03 smithi160 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-11[60042]: 2024-05-08T05:36:03.668+0000 7f0620c06700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.90:6804 osd.1 since back 2024-05-08T05:35:19.381805+0000 front 2024-05-08T05:35:19.381693+0000 (oldest deadline 2024-05-08T05:35:45.281608+0000) 2024-05-08T05:36:04.039 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 08 05:36:03 smithi160 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-11[60042]: 2024-05-08T05:36:03.668+0000 7f0620c06700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-05-08T05:35:25.282081+0000 front 2024-05-08T05:35:25.282130+0000 (oldest deadline 2024-05-08T05:35:51.182290+0000) 2024-05-08T05:36:04.039 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 08 05:36:03 smithi160 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-11[60042]: 2024-05-08T05:36:03.668+0000 7f0620c06700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.87:6814 osd.3 since back 2024-05-08T05:35:35.784273+0000 front 2024-05-08T05:35:35.784316+0000 (oldest deadline 2024-05-08T05:36:01.084003+0000) 2024-05-08T05:36:04.458 INFO:journalctl@ceph.osd.6.smithi087.stdout:May 08 05:36:04 smithi087 podman[97473]: 2024-05-08 05:36:04.022893151 +0000 UTC m=+0.435204149 container start 02d9ef6b68d01bab23766079fbfe89f812f5b77862ccb8caabdede13c8301c09 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c, name=ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-6-deactivate, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.build-date=20240507, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-57676-3-bee299f, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True) 2024-05-08T05:36:04.458 INFO:journalctl@ceph.osd.6.smithi087.stdout:May 08 05:36:04 smithi087 podman[97473]: 2024-05-08 05:36:04.124569495 +0000 UTC m=+0.536880514 container attach 02d9ef6b68d01bab23766079fbfe89f812f5b77862ccb8caabdede13c8301c09 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c, name=ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-6-deactivate, ceph=True, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-57676-3-bee299f, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240507, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504) 2024-05-08T05:36:04.538 INFO:journalctl@ceph.osd.8.smithi160.stdout:May 08 05:36:04 smithi160 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-8[53438]: 2024-05-08T05:36:04.256+0000 7f9baa4b7700 -1 osd.8 85 heartbeat_check: no reply from 172.21.15.90:6804 osd.1 since back 2024-05-08T05:35:19.849347+0000 front 2024-05-08T05:35:19.849487+0000 (oldest deadline 2024-05-08T05:35:43.349410+0000) 2024-05-08T05:36:04.539 INFO:journalctl@ceph.osd.8.smithi160.stdout:May 08 05:36:04 smithi160 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-8[53438]: 2024-05-08T05:36:04.256+0000 7f9baa4b7700 -1 osd.8 85 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-05-08T05:35:27.950958+0000 front 2024-05-08T05:35:27.950938+0000 (oldest deadline 2024-05-08T05:35:51.451162+0000) 2024-05-08T05:36:04.539 INFO:journalctl@ceph.osd.8.smithi160.stdout:May 08 05:36:04 smithi160 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-8[53438]: 2024-05-08T05:36:04.256+0000 7f9baa4b7700 -1 osd.8 85 heartbeat_check: no reply from 172.21.15.87:6814 osd.3 since back 2024-05-08T05:35:34.352349+0000 front 2024-05-08T05:35:34.352493+0000 (oldest deadline 2024-05-08T05:36:00.252195+0000) 2024-05-08T05:36:04.733 INFO:journalctl@ceph.osd.7.smithi090.stdout:May 08 05:36:04 smithi090 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-7[52517]: 2024-05-08T05:36:04.463+0000 7f2f232a5700 -1 osd.7 85 heartbeat_check: no reply from 172.21.15.90:6804 osd.1 since back 2024-05-08T05:35:19.451959+0000 front 2024-05-08T05:35:19.451987+0000 (oldest deadline 2024-05-08T05:35:43.552168+0000) 2024-05-08T05:36:04.733 INFO:journalctl@ceph.osd.7.smithi090.stdout:May 08 05:36:04 smithi090 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-7[52517]: 2024-05-08T05:36:04.463+0000 7f2f232a5700 -1 osd.7 85 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-05-08T05:35:23.552784+0000 front 2024-05-08T05:35:23.552870+0000 (oldest deadline 2024-05-08T05:35:49.452918+0000) 2024-05-08T05:36:04.733 INFO:journalctl@ceph.osd.7.smithi090.stdout:May 08 05:36:04 smithi090 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-7[52517]: 2024-05-08T05:36:04.463+0000 7f2f232a5700 -1 osd.7 85 heartbeat_check: no reply from 172.21.15.87:6814 osd.3 since back 2024-05-08T05:35:32.755227+0000 front 2024-05-08T05:35:32.755164+0000 (oldest deadline 2024-05-08T05:35:58.655042+0000) 2024-05-08T05:36:04.734 INFO:journalctl@ceph.osd.10.smithi090.stdout:May 08 05:36:04 smithi090 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-10[59300]: 2024-05-08T05:36:04.695+0000 7f515bdbb700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.87:6806 osd.0 since back 2024-05-08T05:35:09.330796+0000 front 2024-05-08T05:35:09.330921+0000 (oldest deadline 2024-05-08T05:35:34.030784+0000) 2024-05-08T05:36:04.734 INFO:journalctl@ceph.osd.10.smithi090.stdout:May 08 05:36:04 smithi090 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-10[59300]: 2024-05-08T05:36:04.695+0000 7f515bdbb700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.90:6804 osd.1 since back 2024-05-08T05:35:16.331661+0000 front 2024-05-08T05:35:16.331685+0000 (oldest deadline 2024-05-08T05:35:45.732387+0000) 2024-05-08T05:36:04.734 INFO:journalctl@ceph.osd.10.smithi090.stdout:May 08 05:36:04 smithi090 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-10[59300]: 2024-05-08T05:36:04.695+0000 7f515bdbb700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-05-08T05:35:25.732967+0000 front 2024-05-08T05:35:25.732895+0000 (oldest deadline 2024-05-08T05:35:49.733521+0000) 2024-05-08T05:36:04.734 INFO:journalctl@ceph.osd.10.smithi090.stdout:May 08 05:36:04 smithi090 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-10[59300]: 2024-05-08T05:36:04.695+0000 7f515bdbb700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.87:6814 osd.3 since back 2024-05-08T05:35:34.935373+0000 front 2024-05-08T05:35:34.935510+0000 (oldest deadline 2024-05-08T05:35:58.335621+0000) 2024-05-08T05:36:04.757 INFO:journalctl@ceph.osd.6.smithi087.stdout:May 08 05:36:04 smithi087 podman[97473]: 2024-05-08 05:36:04.473093225 +0000 UTC m=+0.885404179 container died 02d9ef6b68d01bab23766079fbfe89f812f5b77862ccb8caabdede13c8301c09 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c, name=ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-6-deactivate, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, RELEASE=wip-57676-3-bee299f, org.label-schema.build-date=20240507, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, maintainer=Guillaume Abrioux , ceph=True, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0) 2024-05-08T05:36:05.038 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 08 05:36:04 smithi160 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-11[60042]: 2024-05-08T05:36:04.673+0000 7f0620c06700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.87:6806 osd.0 since back 2024-05-08T05:35:07.779525+0000 front 2024-05-08T05:35:07.779646+0000 (oldest deadline 2024-05-08T05:35:33.579761+0000) 2024-05-08T05:36:05.039 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 08 05:36:04 smithi160 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-11[60042]: 2024-05-08T05:36:04.673+0000 7f0620c06700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.90:6804 osd.1 since back 2024-05-08T05:35:19.381805+0000 front 2024-05-08T05:35:19.381693+0000 (oldest deadline 2024-05-08T05:35:45.281608+0000) 2024-05-08T05:36:05.039 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 08 05:36:04 smithi160 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-11[60042]: 2024-05-08T05:36:04.673+0000 7f0620c06700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-05-08T05:35:25.282081+0000 front 2024-05-08T05:35:25.282130+0000 (oldest deadline 2024-05-08T05:35:51.182290+0000) 2024-05-08T05:36:05.039 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 08 05:36:04 smithi160 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-11[60042]: 2024-05-08T05:36:04.673+0000 7f0620c06700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.87:6814 osd.3 since back 2024-05-08T05:35:35.784273+0000 front 2024-05-08T05:35:35.784316+0000 (oldest deadline 2024-05-08T05:36:01.084003+0000) 2024-05-08T05:36:05.162 INFO:journalctl@ceph.osd.9.smithi087.stdout:May 08 05:36:04 smithi087 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-9[64574]: 2024-05-08T05:36:04.885+0000 7fb2f9800700 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.87:6806 osd.0 since back 2024-05-08T05:35:08.464101+0000 front 2024-05-08T05:35:08.464047+0000 (oldest deadline 2024-05-08T05:35:31.964171+0000) 2024-05-08T05:36:05.162 INFO:journalctl@ceph.osd.9.smithi087.stdout:May 08 05:36:04 smithi087 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-9[64574]: 2024-05-08T05:36:04.885+0000 7fb2f9800700 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.90:6804 osd.1 since back 2024-05-08T05:35:15.466623+0000 front 2024-05-08T05:35:15.467083+0000 (oldest deadline 2024-05-08T05:35:41.366632+0000) 2024-05-08T05:36:05.162 INFO:journalctl@ceph.osd.9.smithi087.stdout:May 08 05:36:04 smithi087 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-9[64574]: 2024-05-08T05:36:04.885+0000 7fb2f9800700 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-05-08T05:35:24.868777+0000 front 2024-05-08T05:35:24.868646+0000 (oldest deadline 2024-05-08T05:35:48.968629+0000) 2024-05-08T05:36:05.162 INFO:journalctl@ceph.osd.9.smithi087.stdout:May 08 05:36:04 smithi087 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-9[64574]: 2024-05-08T05:36:04.885+0000 7fb2f9800700 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.87:6814 osd.3 since back 2024-05-08T05:35:32.470732+0000 front 2024-05-08T05:35:32.471202+0000 (oldest deadline 2024-05-08T05:36:00.071563+0000) 2024-05-08T05:36:05.208 DEBUG:teuthology.orchestra.run.smithi087:> sudo pkill -f 'journalctl -f -n 0 -u ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968@osd.6.service' 2024-05-08T05:36:05.321 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-08T05:36:05.321 INFO:tasks.cephadm.osd.6:Stopped osd.6 2024-05-08T05:36:05.321 INFO:tasks.cephadm.osd.7:Stopping osd.7... 2024-05-08T05:36:05.321 DEBUG:teuthology.orchestra.run.smithi090:> sudo systemctl stop ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968@osd.7 2024-05-08T05:36:05.538 INFO:journalctl@ceph.osd.8.smithi160.stdout:May 08 05:36:05 smithi160 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-8[53438]: 2024-05-08T05:36:05.226+0000 7f9baa4b7700 -1 osd.8 85 heartbeat_check: no reply from 172.21.15.90:6804 osd.1 since back 2024-05-08T05:35:19.849347+0000 front 2024-05-08T05:35:19.849487+0000 (oldest deadline 2024-05-08T05:35:43.349410+0000) 2024-05-08T05:36:05.539 INFO:journalctl@ceph.osd.8.smithi160.stdout:May 08 05:36:05 smithi160 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-8[53438]: 2024-05-08T05:36:05.226+0000 7f9baa4b7700 -1 osd.8 85 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-05-08T05:35:27.950958+0000 front 2024-05-08T05:35:27.950938+0000 (oldest deadline 2024-05-08T05:35:51.451162+0000) 2024-05-08T05:36:05.539 INFO:journalctl@ceph.osd.8.smithi160.stdout:May 08 05:36:05 smithi160 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-8[53438]: 2024-05-08T05:36:05.226+0000 7f9baa4b7700 -1 osd.8 85 heartbeat_check: no reply from 172.21.15.87:6814 osd.3 since back 2024-05-08T05:35:34.352349+0000 front 2024-05-08T05:35:34.352493+0000 (oldest deadline 2024-05-08T05:36:00.252195+0000) 2024-05-08T05:36:05.619 INFO:journalctl@ceph.osd.7.smithi090.stdout:May 08 05:36:05 smithi090 systemd[1]: Stopping Ceph osd.7 for eeeb813e-0cf9-11ef-bc97-c7b262605968... 2024-05-08T05:36:05.619 INFO:journalctl@ceph.osd.7.smithi090.stdout:May 08 05:36:05 smithi090 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-7[52517]: 2024-05-08T05:36:05.434+0000 7f2f232a5700 -1 osd.7 85 heartbeat_check: no reply from 172.21.15.90:6804 osd.1 since back 2024-05-08T05:35:19.451959+0000 front 2024-05-08T05:35:19.451987+0000 (oldest deadline 2024-05-08T05:35:43.552168+0000) 2024-05-08T05:36:05.619 INFO:journalctl@ceph.osd.7.smithi090.stdout:May 08 05:36:05 smithi090 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-7[52517]: 2024-05-08T05:36:05.434+0000 7f2f232a5700 -1 osd.7 85 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-05-08T05:35:23.552784+0000 front 2024-05-08T05:35:23.552870+0000 (oldest deadline 2024-05-08T05:35:49.452918+0000) 2024-05-08T05:36:05.619 INFO:journalctl@ceph.osd.7.smithi090.stdout:May 08 05:36:05 smithi090 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-7[52517]: 2024-05-08T05:36:05.434+0000 7f2f232a5700 -1 osd.7 85 heartbeat_check: no reply from 172.21.15.87:6814 osd.3 since back 2024-05-08T05:35:32.755227+0000 front 2024-05-08T05:35:32.755164+0000 (oldest deadline 2024-05-08T05:35:58.655042+0000) 2024-05-08T05:36:05.983 INFO:journalctl@ceph.osd.7.smithi090.stdout:May 08 05:36:05 smithi090 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-7[52517]: 2024-05-08T05:36:05.617+0000 7f2f2acb9700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.7 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-05-08T05:36:05.983 INFO:journalctl@ceph.osd.7.smithi090.stdout:May 08 05:36:05 smithi090 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-7[52517]: 2024-05-08T05:36:05.617+0000 7f2f2acb9700 -1 osd.7 85 *** Got signal Terminated *** 2024-05-08T05:36:05.983 INFO:journalctl@ceph.osd.7.smithi090.stdout:May 08 05:36:05 smithi090 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-7[52517]: 2024-05-08T05:36:05.617+0000 7f2f2acb9700 -1 osd.7 85 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-05-08T05:36:05.984 INFO:journalctl@ceph.osd.10.smithi090.stdout:May 08 05:36:05 smithi090 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-10[59300]: 2024-05-08T05:36:05.678+0000 7f515bdbb700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.87:6806 osd.0 since back 2024-05-08T05:35:09.330796+0000 front 2024-05-08T05:35:09.330921+0000 (oldest deadline 2024-05-08T05:35:34.030784+0000) 2024-05-08T05:36:05.984 INFO:journalctl@ceph.osd.10.smithi090.stdout:May 08 05:36:05 smithi090 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-10[59300]: 2024-05-08T05:36:05.678+0000 7f515bdbb700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.90:6804 osd.1 since back 2024-05-08T05:35:16.331661+0000 front 2024-05-08T05:35:16.331685+0000 (oldest deadline 2024-05-08T05:35:45.732387+0000) 2024-05-08T05:36:05.984 INFO:journalctl@ceph.osd.10.smithi090.stdout:May 08 05:36:05 smithi090 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-10[59300]: 2024-05-08T05:36:05.678+0000 7f515bdbb700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-05-08T05:35:25.732967+0000 front 2024-05-08T05:35:25.732895+0000 (oldest deadline 2024-05-08T05:35:49.733521+0000) 2024-05-08T05:36:05.984 INFO:journalctl@ceph.osd.10.smithi090.stdout:May 08 05:36:05 smithi090 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-10[59300]: 2024-05-08T05:36:05.678+0000 7f515bdbb700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.87:6814 osd.3 since back 2024-05-08T05:35:34.935373+0000 front 2024-05-08T05:35:34.935510+0000 (oldest deadline 2024-05-08T05:35:58.335621+0000) 2024-05-08T05:36:06.038 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 08 05:36:05 smithi160 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-11[60042]: 2024-05-08T05:36:05.684+0000 7f0620c06700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.87:6806 osd.0 since back 2024-05-08T05:35:07.779525+0000 front 2024-05-08T05:35:07.779646+0000 (oldest deadline 2024-05-08T05:35:33.579761+0000) 2024-05-08T05:36:06.039 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 08 05:36:05 smithi160 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-11[60042]: 2024-05-08T05:36:05.684+0000 7f0620c06700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.90:6804 osd.1 since back 2024-05-08T05:35:19.381805+0000 front 2024-05-08T05:35:19.381693+0000 (oldest deadline 2024-05-08T05:35:45.281608+0000) 2024-05-08T05:36:06.039 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 08 05:36:05 smithi160 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-11[60042]: 2024-05-08T05:36:05.684+0000 7f0620c06700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-05-08T05:35:25.282081+0000 front 2024-05-08T05:35:25.282130+0000 (oldest deadline 2024-05-08T05:35:51.182290+0000) 2024-05-08T05:36:06.039 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 08 05:36:05 smithi160 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-11[60042]: 2024-05-08T05:36:05.684+0000 7f0620c06700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.87:6814 osd.3 since back 2024-05-08T05:35:35.784273+0000 front 2024-05-08T05:35:35.784316+0000 (oldest deadline 2024-05-08T05:36:01.084003+0000) 2024-05-08T05:36:06.208 INFO:journalctl@ceph.osd.9.smithi087.stdout:May 08 05:36:05 smithi087 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-9[64574]: 2024-05-08T05:36:05.861+0000 7fb2f9800700 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.87:6806 osd.0 since back 2024-05-08T05:35:08.464101+0000 front 2024-05-08T05:35:08.464047+0000 (oldest deadline 2024-05-08T05:35:31.964171+0000) 2024-05-08T05:36:06.209 INFO:journalctl@ceph.osd.9.smithi087.stdout:May 08 05:36:05 smithi087 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-9[64574]: 2024-05-08T05:36:05.861+0000 7fb2f9800700 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.90:6804 osd.1 since back 2024-05-08T05:35:15.466623+0000 front 2024-05-08T05:35:15.467083+0000 (oldest deadline 2024-05-08T05:35:41.366632+0000) 2024-05-08T05:36:06.209 INFO:journalctl@ceph.osd.9.smithi087.stdout:May 08 05:36:05 smithi087 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-9[64574]: 2024-05-08T05:36:05.861+0000 7fb2f9800700 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-05-08T05:35:24.868777+0000 front 2024-05-08T05:35:24.868646+0000 (oldest deadline 2024-05-08T05:35:48.968629+0000) 2024-05-08T05:36:06.209 INFO:journalctl@ceph.osd.9.smithi087.stdout:May 08 05:36:05 smithi087 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-9[64574]: 2024-05-08T05:36:05.861+0000 7fb2f9800700 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.87:6814 osd.3 since back 2024-05-08T05:35:32.470732+0000 front 2024-05-08T05:35:32.471202+0000 (oldest deadline 2024-05-08T05:36:00.071563+0000) 2024-05-08T05:36:06.538 INFO:journalctl@ceph.osd.8.smithi160.stdout:May 08 05:36:06 smithi160 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-8[53438]: 2024-05-08T05:36:06.225+0000 7f9baa4b7700 -1 osd.8 85 heartbeat_check: no reply from 172.21.15.90:6804 osd.1 since back 2024-05-08T05:35:19.849347+0000 front 2024-05-08T05:35:19.849487+0000 (oldest deadline 2024-05-08T05:35:43.349410+0000) 2024-05-08T05:36:06.539 INFO:journalctl@ceph.osd.8.smithi160.stdout:May 08 05:36:06 smithi160 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-8[53438]: 2024-05-08T05:36:06.225+0000 7f9baa4b7700 -1 osd.8 85 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-05-08T05:35:27.950958+0000 front 2024-05-08T05:35:27.950938+0000 (oldest deadline 2024-05-08T05:35:51.451162+0000) 2024-05-08T05:36:06.539 INFO:journalctl@ceph.osd.8.smithi160.stdout:May 08 05:36:06 smithi160 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-8[53438]: 2024-05-08T05:36:06.225+0000 7f9baa4b7700 -1 osd.8 85 heartbeat_check: no reply from 172.21.15.87:6814 osd.3 since back 2024-05-08T05:35:34.352349+0000 front 2024-05-08T05:35:34.352493+0000 (oldest deadline 2024-05-08T05:36:00.252195+0000) 2024-05-08T05:36:06.733 INFO:journalctl@ceph.osd.7.smithi090.stdout:May 08 05:36:06 smithi090 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-7[52517]: 2024-05-08T05:36:06.464+0000 7f2f232a5700 -1 osd.7 85 heartbeat_check: no reply from 172.21.15.90:6804 osd.1 since back 2024-05-08T05:35:19.451959+0000 front 2024-05-08T05:35:19.451987+0000 (oldest deadline 2024-05-08T05:35:43.552168+0000) 2024-05-08T05:36:06.733 INFO:journalctl@ceph.osd.7.smithi090.stdout:May 08 05:36:06 smithi090 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-7[52517]: 2024-05-08T05:36:06.464+0000 7f2f232a5700 -1 osd.7 85 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-05-08T05:35:23.552784+0000 front 2024-05-08T05:35:23.552870+0000 (oldest deadline 2024-05-08T05:35:49.452918+0000) 2024-05-08T05:36:06.733 INFO:journalctl@ceph.osd.7.smithi090.stdout:May 08 05:36:06 smithi090 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-7[52517]: 2024-05-08T05:36:06.464+0000 7f2f232a5700 -1 osd.7 85 heartbeat_check: no reply from 172.21.15.87:6814 osd.3 since back 2024-05-08T05:35:32.755227+0000 front 2024-05-08T05:35:32.755164+0000 (oldest deadline 2024-05-08T05:35:58.655042+0000) 2024-05-08T05:36:06.734 INFO:journalctl@ceph.osd.10.smithi090.stdout:May 08 05:36:06 smithi090 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-10[59300]: 2024-05-08T05:36:06.707+0000 7f515bdbb700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.87:6806 osd.0 since back 2024-05-08T05:35:09.330796+0000 front 2024-05-08T05:35:09.330921+0000 (oldest deadline 2024-05-08T05:35:34.030784+0000) 2024-05-08T05:36:06.734 INFO:journalctl@ceph.osd.10.smithi090.stdout:May 08 05:36:06 smithi090 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-10[59300]: 2024-05-08T05:36:06.707+0000 7f515bdbb700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.90:6804 osd.1 since back 2024-05-08T05:35:16.331661+0000 front 2024-05-08T05:35:16.331685+0000 (oldest deadline 2024-05-08T05:35:45.732387+0000) 2024-05-08T05:36:06.734 INFO:journalctl@ceph.osd.10.smithi090.stdout:May 08 05:36:06 smithi090 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-10[59300]: 2024-05-08T05:36:06.707+0000 7f515bdbb700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-05-08T05:35:25.732967+0000 front 2024-05-08T05:35:25.732895+0000 (oldest deadline 2024-05-08T05:35:49.733521+0000) 2024-05-08T05:36:06.734 INFO:journalctl@ceph.osd.10.smithi090.stdout:May 08 05:36:06 smithi090 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-10[59300]: 2024-05-08T05:36:06.707+0000 7f515bdbb700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.87:6814 osd.3 since back 2024-05-08T05:35:34.935373+0000 front 2024-05-08T05:35:34.935510+0000 (oldest deadline 2024-05-08T05:35:58.335621+0000) 2024-05-08T05:36:06.734 INFO:journalctl@ceph.osd.10.smithi090.stdout:May 08 05:36:06 smithi090 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-10[59300]: 2024-05-08T05:36:06.707+0000 7f515bdbb700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.90:6812 osd.4 since back 2024-05-08T05:35:43.536890+0000 front 2024-05-08T05:35:43.536927+0000 (oldest deadline 2024-05-08T05:36:05.837136+0000) 2024-05-08T05:36:07.038 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 08 05:36:06 smithi160 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-11[60042]: 2024-05-08T05:36:06.682+0000 7f0620c06700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.87:6806 osd.0 since back 2024-05-08T05:35:07.779525+0000 front 2024-05-08T05:35:07.779646+0000 (oldest deadline 2024-05-08T05:35:33.579761+0000) 2024-05-08T05:36:07.038 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 08 05:36:06 smithi160 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-11[60042]: 2024-05-08T05:36:06.682+0000 7f0620c06700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.90:6804 osd.1 since back 2024-05-08T05:35:19.381805+0000 front 2024-05-08T05:35:19.381693+0000 (oldest deadline 2024-05-08T05:35:45.281608+0000) 2024-05-08T05:36:07.038 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 08 05:36:06 smithi160 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-11[60042]: 2024-05-08T05:36:06.682+0000 7f0620c06700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-05-08T05:35:25.282081+0000 front 2024-05-08T05:35:25.282130+0000 (oldest deadline 2024-05-08T05:35:51.182290+0000) 2024-05-08T05:36:07.039 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 08 05:36:06 smithi160 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-11[60042]: 2024-05-08T05:36:06.682+0000 7f0620c06700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.87:6814 osd.3 since back 2024-05-08T05:35:35.784273+0000 front 2024-05-08T05:35:35.784316+0000 (oldest deadline 2024-05-08T05:36:01.084003+0000) 2024-05-08T05:36:07.208 INFO:journalctl@ceph.osd.9.smithi087.stdout:May 08 05:36:06 smithi087 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-9[64574]: 2024-05-08T05:36:06.883+0000 7fb2f9800700 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.87:6806 osd.0 since back 2024-05-08T05:35:08.464101+0000 front 2024-05-08T05:35:08.464047+0000 (oldest deadline 2024-05-08T05:35:31.964171+0000) 2024-05-08T05:36:07.209 INFO:journalctl@ceph.osd.9.smithi087.stdout:May 08 05:36:06 smithi087 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-9[64574]: 2024-05-08T05:36:06.883+0000 7fb2f9800700 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.90:6804 osd.1 since back 2024-05-08T05:35:15.466623+0000 front 2024-05-08T05:35:15.467083+0000 (oldest deadline 2024-05-08T05:35:41.366632+0000) 2024-05-08T05:36:07.209 INFO:journalctl@ceph.osd.9.smithi087.stdout:May 08 05:36:06 smithi087 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-9[64574]: 2024-05-08T05:36:06.883+0000 7fb2f9800700 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-05-08T05:35:24.868777+0000 front 2024-05-08T05:35:24.868646+0000 (oldest deadline 2024-05-08T05:35:48.968629+0000) 2024-05-08T05:36:07.209 INFO:journalctl@ceph.osd.9.smithi087.stdout:May 08 05:36:06 smithi087 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-9[64574]: 2024-05-08T05:36:06.883+0000 7fb2f9800700 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.87:6814 osd.3 since back 2024-05-08T05:35:32.470732+0000 front 2024-05-08T05:35:32.471202+0000 (oldest deadline 2024-05-08T05:36:00.071563+0000) 2024-05-08T05:36:07.539 INFO:journalctl@ceph.osd.8.smithi160.stdout:May 08 05:36:07 smithi160 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-8[53438]: 2024-05-08T05:36:07.208+0000 7f9baa4b7700 -1 osd.8 85 heartbeat_check: no reply from 172.21.15.90:6804 osd.1 since back 2024-05-08T05:35:19.849347+0000 front 2024-05-08T05:35:19.849487+0000 (oldest deadline 2024-05-08T05:35:43.349410+0000) 2024-05-08T05:36:07.539 INFO:journalctl@ceph.osd.8.smithi160.stdout:May 08 05:36:07 smithi160 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-8[53438]: 2024-05-08T05:36:07.208+0000 7f9baa4b7700 -1 osd.8 85 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-05-08T05:35:27.950958+0000 front 2024-05-08T05:35:27.950938+0000 (oldest deadline 2024-05-08T05:35:51.451162+0000) 2024-05-08T05:36:07.540 INFO:journalctl@ceph.osd.8.smithi160.stdout:May 08 05:36:07 smithi160 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-8[53438]: 2024-05-08T05:36:07.208+0000 7f9baa4b7700 -1 osd.8 85 heartbeat_check: no reply from 172.21.15.87:6814 osd.3 since back 2024-05-08T05:35:34.352349+0000 front 2024-05-08T05:35:34.352493+0000 (oldest deadline 2024-05-08T05:36:00.252195+0000) 2024-05-08T05:36:07.540 INFO:journalctl@ceph.osd.8.smithi160.stdout:May 08 05:36:07 smithi160 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-8[53438]: 2024-05-08T05:36:07.208+0000 7f9baa4b7700 -1 osd.8 85 heartbeat_check: no reply from 172.21.15.90:6812 osd.4 since back 2024-05-08T05:35:44.953321+0000 front 2024-05-08T05:35:44.953169+0000 (oldest deadline 2024-05-08T05:36:07.153468+0000) 2024-05-08T05:36:07.733 INFO:journalctl@ceph.osd.7.smithi090.stdout:May 08 05:36:07 smithi090 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-7[52517]: 2024-05-08T05:36:07.481+0000 7f2f232a5700 -1 osd.7 85 heartbeat_check: no reply from 172.21.15.90:6804 osd.1 since back 2024-05-08T05:35:19.451959+0000 front 2024-05-08T05:35:19.451987+0000 (oldest deadline 2024-05-08T05:35:43.552168+0000) 2024-05-08T05:36:07.733 INFO:journalctl@ceph.osd.7.smithi090.stdout:May 08 05:36:07 smithi090 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-7[52517]: 2024-05-08T05:36:07.481+0000 7f2f232a5700 -1 osd.7 85 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-05-08T05:35:23.552784+0000 front 2024-05-08T05:35:23.552870+0000 (oldest deadline 2024-05-08T05:35:49.452918+0000) 2024-05-08T05:36:07.734 INFO:journalctl@ceph.osd.7.smithi090.stdout:May 08 05:36:07 smithi090 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-7[52517]: 2024-05-08T05:36:07.481+0000 7f2f232a5700 -1 osd.7 85 heartbeat_check: no reply from 172.21.15.87:6814 osd.3 since back 2024-05-08T05:35:32.755227+0000 front 2024-05-08T05:35:32.755164+0000 (oldest deadline 2024-05-08T05:35:58.655042+0000) 2024-05-08T05:36:07.734 INFO:journalctl@ceph.osd.7.smithi090.stdout:May 08 05:36:07 smithi090 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-7[52517]: 2024-05-08T05:36:07.481+0000 7f2f232a5700 -1 osd.7 85 heartbeat_check: no reply from 172.21.15.90:6812 osd.4 since back 2024-05-08T05:35:42.155919+0000 front 2024-05-08T05:35:42.155983+0000 (oldest deadline 2024-05-08T05:36:06.855974+0000) 2024-05-08T05:36:08.038 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 08 05:36:07 smithi160 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-11[60042]: 2024-05-08T05:36:07.677+0000 7f0620c06700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.87:6806 osd.0 since back 2024-05-08T05:35:07.779525+0000 front 2024-05-08T05:35:07.779646+0000 (oldest deadline 2024-05-08T05:35:33.579761+0000) 2024-05-08T05:36:08.039 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 08 05:36:07 smithi160 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-11[60042]: 2024-05-08T05:36:07.677+0000 7f0620c06700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.90:6804 osd.1 since back 2024-05-08T05:35:19.381805+0000 front 2024-05-08T05:35:19.381693+0000 (oldest deadline 2024-05-08T05:35:45.281608+0000) 2024-05-08T05:36:08.039 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 08 05:36:07 smithi160 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-11[60042]: 2024-05-08T05:36:07.677+0000 7f0620c06700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-05-08T05:35:25.282081+0000 front 2024-05-08T05:35:25.282130+0000 (oldest deadline 2024-05-08T05:35:51.182290+0000) 2024-05-08T05:36:08.039 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 08 05:36:07 smithi160 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-11[60042]: 2024-05-08T05:36:07.677+0000 7f0620c06700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.87:6814 osd.3 since back 2024-05-08T05:35:35.784273+0000 front 2024-05-08T05:35:35.784316+0000 (oldest deadline 2024-05-08T05:36:01.084003+0000) 2024-05-08T05:36:08.039 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 08 05:36:07 smithi160 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-11[60042]: 2024-05-08T05:36:07.677+0000 7f0620c06700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.90:6812 osd.4 since back 2024-05-08T05:35:45.085478+0000 front 2024-05-08T05:35:45.085623+0000 (oldest deadline 2024-05-08T05:36:06.785423+0000) 2024-05-08T05:36:08.208 INFO:journalctl@ceph.osd.9.smithi087.stdout:May 08 05:36:07 smithi087 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-9[64574]: 2024-05-08T05:36:07.914+0000 7fb2f9800700 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.87:6806 osd.0 since back 2024-05-08T05:35:08.464101+0000 front 2024-05-08T05:35:08.464047+0000 (oldest deadline 2024-05-08T05:35:31.964171+0000) 2024-05-08T05:36:08.209 INFO:journalctl@ceph.osd.9.smithi087.stdout:May 08 05:36:07 smithi087 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-9[64574]: 2024-05-08T05:36:07.914+0000 7fb2f9800700 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.90:6804 osd.1 since back 2024-05-08T05:35:15.466623+0000 front 2024-05-08T05:35:15.467083+0000 (oldest deadline 2024-05-08T05:35:41.366632+0000) 2024-05-08T05:36:08.209 INFO:journalctl@ceph.osd.9.smithi087.stdout:May 08 05:36:07 smithi087 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-9[64574]: 2024-05-08T05:36:07.914+0000 7fb2f9800700 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-05-08T05:35:24.868777+0000 front 2024-05-08T05:35:24.868646+0000 (oldest deadline 2024-05-08T05:35:48.968629+0000) 2024-05-08T05:36:08.209 INFO:journalctl@ceph.osd.9.smithi087.stdout:May 08 05:36:07 smithi087 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-9[64574]: 2024-05-08T05:36:07.914+0000 7fb2f9800700 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.87:6814 osd.3 since back 2024-05-08T05:35:32.470732+0000 front 2024-05-08T05:35:32.471202+0000 (oldest deadline 2024-05-08T05:36:00.071563+0000) 2024-05-08T05:36:08.233 INFO:journalctl@ceph.osd.10.smithi090.stdout:May 08 05:36:07 smithi090 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-10[59300]: 2024-05-08T05:36:07.743+0000 7f515bdbb700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.87:6806 osd.0 since back 2024-05-08T05:35:09.330796+0000 front 2024-05-08T05:35:09.330921+0000 (oldest deadline 2024-05-08T05:35:34.030784+0000) 2024-05-08T05:36:08.233 INFO:journalctl@ceph.osd.10.smithi090.stdout:May 08 05:36:07 smithi090 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-10[59300]: 2024-05-08T05:36:07.743+0000 7f515bdbb700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.90:6804 osd.1 since back 2024-05-08T05:35:16.331661+0000 front 2024-05-08T05:35:16.331685+0000 (oldest deadline 2024-05-08T05:35:45.732387+0000) 2024-05-08T05:36:08.233 INFO:journalctl@ceph.osd.10.smithi090.stdout:May 08 05:36:07 smithi090 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-10[59300]: 2024-05-08T05:36:07.743+0000 7f515bdbb700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-05-08T05:35:25.732967+0000 front 2024-05-08T05:35:25.732895+0000 (oldest deadline 2024-05-08T05:35:49.733521+0000) 2024-05-08T05:36:08.234 INFO:journalctl@ceph.osd.10.smithi090.stdout:May 08 05:36:07 smithi090 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-10[59300]: 2024-05-08T05:36:07.743+0000 7f515bdbb700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.87:6814 osd.3 since back 2024-05-08T05:35:34.935373+0000 front 2024-05-08T05:35:34.935510+0000 (oldest deadline 2024-05-08T05:35:58.335621+0000) 2024-05-08T05:36:08.234 INFO:journalctl@ceph.osd.10.smithi090.stdout:May 08 05:36:07 smithi090 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-10[59300]: 2024-05-08T05:36:07.743+0000 7f515bdbb700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.90:6812 osd.4 since back 2024-05-08T05:35:43.536890+0000 front 2024-05-08T05:35:43.536927+0000 (oldest deadline 2024-05-08T05:36:05.837136+0000) 2024-05-08T05:36:08.538 INFO:journalctl@ceph.osd.8.smithi160.stdout:May 08 05:36:08 smithi160 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-8[53438]: 2024-05-08T05:36:08.162+0000 7f9baa4b7700 -1 osd.8 85 heartbeat_check: no reply from 172.21.15.90:6804 osd.1 since back 2024-05-08T05:35:19.849347+0000 front 2024-05-08T05:35:19.849487+0000 (oldest deadline 2024-05-08T05:35:43.349410+0000) 2024-05-08T05:36:08.538 INFO:journalctl@ceph.osd.8.smithi160.stdout:May 08 05:36:08 smithi160 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-8[53438]: 2024-05-08T05:36:08.162+0000 7f9baa4b7700 -1 osd.8 85 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-05-08T05:35:27.950958+0000 front 2024-05-08T05:35:27.950938+0000 (oldest deadline 2024-05-08T05:35:51.451162+0000) 2024-05-08T05:36:08.539 INFO:journalctl@ceph.osd.8.smithi160.stdout:May 08 05:36:08 smithi160 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-8[53438]: 2024-05-08T05:36:08.162+0000 7f9baa4b7700 -1 osd.8 85 heartbeat_check: no reply from 172.21.15.87:6814 osd.3 since back 2024-05-08T05:35:34.352349+0000 front 2024-05-08T05:35:34.352493+0000 (oldest deadline 2024-05-08T05:36:00.252195+0000) 2024-05-08T05:36:08.539 INFO:journalctl@ceph.osd.8.smithi160.stdout:May 08 05:36:08 smithi160 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-8[53438]: 2024-05-08T05:36:08.162+0000 7f9baa4b7700 -1 osd.8 85 heartbeat_check: no reply from 172.21.15.90:6812 osd.4 since back 2024-05-08T05:35:44.953321+0000 front 2024-05-08T05:35:44.953169+0000 (oldest deadline 2024-05-08T05:36:07.153468+0000) 2024-05-08T05:36:08.733 INFO:journalctl@ceph.osd.7.smithi090.stdout:May 08 05:36:08 smithi090 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-7[52517]: 2024-05-08T05:36:08.443+0000 7f2f232a5700 -1 osd.7 85 heartbeat_check: no reply from 172.21.15.90:6804 osd.1 since back 2024-05-08T05:35:19.451959+0000 front 2024-05-08T05:35:19.451987+0000 (oldest deadline 2024-05-08T05:35:43.552168+0000) 2024-05-08T05:36:08.734 INFO:journalctl@ceph.osd.7.smithi090.stdout:May 08 05:36:08 smithi090 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-7[52517]: 2024-05-08T05:36:08.443+0000 7f2f232a5700 -1 osd.7 85 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-05-08T05:35:23.552784+0000 front 2024-05-08T05:35:23.552870+0000 (oldest deadline 2024-05-08T05:35:49.452918+0000) 2024-05-08T05:36:08.734 INFO:journalctl@ceph.osd.7.smithi090.stdout:May 08 05:36:08 smithi090 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-7[52517]: 2024-05-08T05:36:08.443+0000 7f2f232a5700 -1 osd.7 85 heartbeat_check: no reply from 172.21.15.87:6814 osd.3 since back 2024-05-08T05:35:32.755227+0000 front 2024-05-08T05:35:32.755164+0000 (oldest deadline 2024-05-08T05:35:58.655042+0000) 2024-05-08T05:36:08.734 INFO:journalctl@ceph.osd.7.smithi090.stdout:May 08 05:36:08 smithi090 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-7[52517]: 2024-05-08T05:36:08.443+0000 7f2f232a5700 -1 osd.7 85 heartbeat_check: no reply from 172.21.15.90:6812 osd.4 since back 2024-05-08T05:35:42.155919+0000 front 2024-05-08T05:35:42.155983+0000 (oldest deadline 2024-05-08T05:36:06.855974+0000) 2024-05-08T05:36:09.039 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 08 05:36:08 smithi160 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-11[60042]: 2024-05-08T05:36:08.691+0000 7f0620c06700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.87:6806 osd.0 since back 2024-05-08T05:35:07.779525+0000 front 2024-05-08T05:35:07.779646+0000 (oldest deadline 2024-05-08T05:35:33.579761+0000) 2024-05-08T05:36:09.039 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 08 05:36:08 smithi160 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-11[60042]: 2024-05-08T05:36:08.691+0000 7f0620c06700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.90:6804 osd.1 since back 2024-05-08T05:35:19.381805+0000 front 2024-05-08T05:35:19.381693+0000 (oldest deadline 2024-05-08T05:35:45.281608+0000) 2024-05-08T05:36:09.039 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 08 05:36:08 smithi160 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-11[60042]: 2024-05-08T05:36:08.691+0000 7f0620c06700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-05-08T05:35:25.282081+0000 front 2024-05-08T05:35:25.282130+0000 (oldest deadline 2024-05-08T05:35:51.182290+0000) 2024-05-08T05:36:09.039 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 08 05:36:08 smithi160 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-11[60042]: 2024-05-08T05:36:08.691+0000 7f0620c06700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.87:6814 osd.3 since back 2024-05-08T05:35:35.784273+0000 front 2024-05-08T05:35:35.784316+0000 (oldest deadline 2024-05-08T05:36:01.084003+0000) 2024-05-08T05:36:09.039 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 08 05:36:08 smithi160 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-11[60042]: 2024-05-08T05:36:08.691+0000 7f0620c06700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.90:6812 osd.4 since back 2024-05-08T05:35:45.085478+0000 front 2024-05-08T05:35:45.085623+0000 (oldest deadline 2024-05-08T05:36:06.785423+0000) 2024-05-08T05:36:09.208 INFO:journalctl@ceph.osd.9.smithi087.stdout:May 08 05:36:08 smithi087 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-9[64574]: 2024-05-08T05:36:08.887+0000 7fb2f9800700 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.87:6806 osd.0 since back 2024-05-08T05:35:08.464101+0000 front 2024-05-08T05:35:08.464047+0000 (oldest deadline 2024-05-08T05:35:31.964171+0000) 2024-05-08T05:36:09.208 INFO:journalctl@ceph.osd.9.smithi087.stdout:May 08 05:36:08 smithi087 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-9[64574]: 2024-05-08T05:36:08.887+0000 7fb2f9800700 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.90:6804 osd.1 since back 2024-05-08T05:35:15.466623+0000 front 2024-05-08T05:35:15.467083+0000 (oldest deadline 2024-05-08T05:35:41.366632+0000) 2024-05-08T05:36:09.209 INFO:journalctl@ceph.osd.9.smithi087.stdout:May 08 05:36:08 smithi087 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-9[64574]: 2024-05-08T05:36:08.887+0000 7fb2f9800700 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-05-08T05:35:24.868777+0000 front 2024-05-08T05:35:24.868646+0000 (oldest deadline 2024-05-08T05:35:48.968629+0000) 2024-05-08T05:36:09.209 INFO:journalctl@ceph.osd.9.smithi087.stdout:May 08 05:36:08 smithi087 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-9[64574]: 2024-05-08T05:36:08.887+0000 7fb2f9800700 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.87:6814 osd.3 since back 2024-05-08T05:35:32.470732+0000 front 2024-05-08T05:35:32.471202+0000 (oldest deadline 2024-05-08T05:36:00.071563+0000) 2024-05-08T05:36:09.233 INFO:journalctl@ceph.osd.10.smithi090.stdout:May 08 05:36:08 smithi090 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-10[59300]: 2024-05-08T05:36:08.759+0000 7f515bdbb700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.87:6806 osd.0 since back 2024-05-08T05:35:09.330796+0000 front 2024-05-08T05:35:09.330921+0000 (oldest deadline 2024-05-08T05:35:34.030784+0000) 2024-05-08T05:36:09.234 INFO:journalctl@ceph.osd.10.smithi090.stdout:May 08 05:36:08 smithi090 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-10[59300]: 2024-05-08T05:36:08.760+0000 7f515bdbb700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.90:6804 osd.1 since back 2024-05-08T05:35:16.331661+0000 front 2024-05-08T05:35:16.331685+0000 (oldest deadline 2024-05-08T05:35:45.732387+0000) 2024-05-08T05:36:09.234 INFO:journalctl@ceph.osd.10.smithi090.stdout:May 08 05:36:08 smithi090 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-10[59300]: 2024-05-08T05:36:08.760+0000 7f515bdbb700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-05-08T05:35:25.732967+0000 front 2024-05-08T05:35:25.732895+0000 (oldest deadline 2024-05-08T05:35:49.733521+0000) 2024-05-08T05:36:09.234 INFO:journalctl@ceph.osd.10.smithi090.stdout:May 08 05:36:08 smithi090 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-10[59300]: 2024-05-08T05:36:08.760+0000 7f515bdbb700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.87:6814 osd.3 since back 2024-05-08T05:35:34.935373+0000 front 2024-05-08T05:35:34.935510+0000 (oldest deadline 2024-05-08T05:35:58.335621+0000) 2024-05-08T05:36:09.234 INFO:journalctl@ceph.osd.10.smithi090.stdout:May 08 05:36:08 smithi090 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-10[59300]: 2024-05-08T05:36:08.760+0000 7f515bdbb700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.90:6812 osd.4 since back 2024-05-08T05:35:43.536890+0000 front 2024-05-08T05:35:43.536927+0000 (oldest deadline 2024-05-08T05:36:05.837136+0000) 2024-05-08T05:36:09.538 INFO:journalctl@ceph.osd.8.smithi160.stdout:May 08 05:36:09 smithi160 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-8[53438]: 2024-05-08T05:36:09.158+0000 7f9baa4b7700 -1 osd.8 85 heartbeat_check: no reply from 172.21.15.90:6804 osd.1 since back 2024-05-08T05:35:19.849347+0000 front 2024-05-08T05:35:19.849487+0000 (oldest deadline 2024-05-08T05:35:43.349410+0000) 2024-05-08T05:36:09.539 INFO:journalctl@ceph.osd.8.smithi160.stdout:May 08 05:36:09 smithi160 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-8[53438]: 2024-05-08T05:36:09.158+0000 7f9baa4b7700 -1 osd.8 85 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-05-08T05:35:27.950958+0000 front 2024-05-08T05:35:27.950938+0000 (oldest deadline 2024-05-08T05:35:51.451162+0000) 2024-05-08T05:36:09.539 INFO:journalctl@ceph.osd.8.smithi160.stdout:May 08 05:36:09 smithi160 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-8[53438]: 2024-05-08T05:36:09.158+0000 7f9baa4b7700 -1 osd.8 85 heartbeat_check: no reply from 172.21.15.87:6814 osd.3 since back 2024-05-08T05:35:34.352349+0000 front 2024-05-08T05:35:34.352493+0000 (oldest deadline 2024-05-08T05:36:00.252195+0000) 2024-05-08T05:36:09.539 INFO:journalctl@ceph.osd.8.smithi160.stdout:May 08 05:36:09 smithi160 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-8[53438]: 2024-05-08T05:36:09.158+0000 7f9baa4b7700 -1 osd.8 85 heartbeat_check: no reply from 172.21.15.90:6812 osd.4 since back 2024-05-08T05:35:44.953321+0000 front 2024-05-08T05:35:44.953169+0000 (oldest deadline 2024-05-08T05:36:07.153468+0000) 2024-05-08T05:36:09.733 INFO:journalctl@ceph.osd.7.smithi090.stdout:May 08 05:36:09 smithi090 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-7[52517]: 2024-05-08T05:36:09.474+0000 7f2f232a5700 -1 osd.7 85 heartbeat_check: no reply from 172.21.15.90:6804 osd.1 since back 2024-05-08T05:35:19.451959+0000 front 2024-05-08T05:35:19.451987+0000 (oldest deadline 2024-05-08T05:35:43.552168+0000) 2024-05-08T05:36:09.734 INFO:journalctl@ceph.osd.7.smithi090.stdout:May 08 05:36:09 smithi090 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-7[52517]: 2024-05-08T05:36:09.474+0000 7f2f232a5700 -1 osd.7 85 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-05-08T05:35:23.552784+0000 front 2024-05-08T05:35:23.552870+0000 (oldest deadline 2024-05-08T05:35:49.452918+0000) 2024-05-08T05:36:09.734 INFO:journalctl@ceph.osd.7.smithi090.stdout:May 08 05:36:09 smithi090 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-7[52517]: 2024-05-08T05:36:09.474+0000 7f2f232a5700 -1 osd.7 85 heartbeat_check: no reply from 172.21.15.87:6814 osd.3 since back 2024-05-08T05:35:32.755227+0000 front 2024-05-08T05:35:32.755164+0000 (oldest deadline 2024-05-08T05:35:58.655042+0000) 2024-05-08T05:36:09.734 INFO:journalctl@ceph.osd.7.smithi090.stdout:May 08 05:36:09 smithi090 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-7[52517]: 2024-05-08T05:36:09.474+0000 7f2f232a5700 -1 osd.7 85 heartbeat_check: no reply from 172.21.15.90:6812 osd.4 since back 2024-05-08T05:35:42.155919+0000 front 2024-05-08T05:35:42.155983+0000 (oldest deadline 2024-05-08T05:36:06.855974+0000) 2024-05-08T05:36:10.038 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 08 05:36:09 smithi160 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-11[60042]: 2024-05-08T05:36:09.695+0000 7f0620c06700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.87:6806 osd.0 since back 2024-05-08T05:35:07.779525+0000 front 2024-05-08T05:35:07.779646+0000 (oldest deadline 2024-05-08T05:35:33.579761+0000) 2024-05-08T05:36:10.039 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 08 05:36:09 smithi160 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-11[60042]: 2024-05-08T05:36:09.695+0000 7f0620c06700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.90:6804 osd.1 since back 2024-05-08T05:35:19.381805+0000 front 2024-05-08T05:35:19.381693+0000 (oldest deadline 2024-05-08T05:35:45.281608+0000) 2024-05-08T05:36:10.039 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 08 05:36:09 smithi160 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-11[60042]: 2024-05-08T05:36:09.695+0000 7f0620c06700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-05-08T05:35:25.282081+0000 front 2024-05-08T05:35:25.282130+0000 (oldest deadline 2024-05-08T05:35:51.182290+0000) 2024-05-08T05:36:10.039 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 08 05:36:09 smithi160 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-11[60042]: 2024-05-08T05:36:09.695+0000 7f0620c06700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.87:6814 osd.3 since back 2024-05-08T05:35:35.784273+0000 front 2024-05-08T05:35:35.784316+0000 (oldest deadline 2024-05-08T05:36:01.084003+0000) 2024-05-08T05:36:10.039 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 08 05:36:09 smithi160 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-11[60042]: 2024-05-08T05:36:09.695+0000 7f0620c06700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.90:6812 osd.4 since back 2024-05-08T05:35:45.085478+0000 front 2024-05-08T05:35:45.085623+0000 (oldest deadline 2024-05-08T05:36:06.785423+0000) 2024-05-08T05:36:10.208 INFO:journalctl@ceph.osd.9.smithi087.stdout:May 08 05:36:09 smithi087 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-9[64574]: 2024-05-08T05:36:09.929+0000 7fb2f9800700 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.87:6806 osd.0 since back 2024-05-08T05:35:08.464101+0000 front 2024-05-08T05:35:08.464047+0000 (oldest deadline 2024-05-08T05:35:31.964171+0000) 2024-05-08T05:36:10.209 INFO:journalctl@ceph.osd.9.smithi087.stdout:May 08 05:36:09 smithi087 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-9[64574]: 2024-05-08T05:36:09.929+0000 7fb2f9800700 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.90:6804 osd.1 since back 2024-05-08T05:35:15.466623+0000 front 2024-05-08T05:35:15.467083+0000 (oldest deadline 2024-05-08T05:35:41.366632+0000) 2024-05-08T05:36:10.209 INFO:journalctl@ceph.osd.9.smithi087.stdout:May 08 05:36:09 smithi087 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-9[64574]: 2024-05-08T05:36:09.929+0000 7fb2f9800700 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-05-08T05:35:24.868777+0000 front 2024-05-08T05:35:24.868646+0000 (oldest deadline 2024-05-08T05:35:48.968629+0000) 2024-05-08T05:36:10.209 INFO:journalctl@ceph.osd.9.smithi087.stdout:May 08 05:36:09 smithi087 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-9[64574]: 2024-05-08T05:36:09.929+0000 7fb2f9800700 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.87:6814 osd.3 since back 2024-05-08T05:35:32.470732+0000 front 2024-05-08T05:35:32.471202+0000 (oldest deadline 2024-05-08T05:36:00.071563+0000) 2024-05-08T05:36:10.209 INFO:journalctl@ceph.osd.9.smithi087.stdout:May 08 05:36:09 smithi087 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-9[64574]: 2024-05-08T05:36:09.929+0000 7fb2f9800700 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.90:6812 osd.4 since back 2024-05-08T05:35:43.573743+0000 front 2024-05-08T05:35:43.574046+0000 (oldest deadline 2024-05-08T05:36:09.473468+0000) 2024-05-08T05:36:10.233 INFO:journalctl@ceph.osd.10.smithi090.stdout:May 08 05:36:09 smithi090 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-10[59300]: 2024-05-08T05:36:09.787+0000 7f515bdbb700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.87:6806 osd.0 since back 2024-05-08T05:35:09.330796+0000 front 2024-05-08T05:35:09.330921+0000 (oldest deadline 2024-05-08T05:35:34.030784+0000) 2024-05-08T05:36:10.233 INFO:journalctl@ceph.osd.10.smithi090.stdout:May 08 05:36:09 smithi090 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-10[59300]: 2024-05-08T05:36:09.787+0000 7f515bdbb700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.90:6804 osd.1 since back 2024-05-08T05:35:16.331661+0000 front 2024-05-08T05:35:16.331685+0000 (oldest deadline 2024-05-08T05:35:45.732387+0000) 2024-05-08T05:36:10.233 INFO:journalctl@ceph.osd.10.smithi090.stdout:May 08 05:36:09 smithi090 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-10[59300]: 2024-05-08T05:36:09.787+0000 7f515bdbb700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-05-08T05:35:25.732967+0000 front 2024-05-08T05:35:25.732895+0000 (oldest deadline 2024-05-08T05:35:49.733521+0000) 2024-05-08T05:36:10.233 INFO:journalctl@ceph.osd.10.smithi090.stdout:May 08 05:36:09 smithi090 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-10[59300]: 2024-05-08T05:36:09.787+0000 7f515bdbb700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.87:6814 osd.3 since back 2024-05-08T05:35:34.935373+0000 front 2024-05-08T05:35:34.935510+0000 (oldest deadline 2024-05-08T05:35:58.335621+0000) 2024-05-08T05:36:10.234 INFO:journalctl@ceph.osd.10.smithi090.stdout:May 08 05:36:09 smithi090 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-10[59300]: 2024-05-08T05:36:09.787+0000 7f515bdbb700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.90:6812 osd.4 since back 2024-05-08T05:35:43.536890+0000 front 2024-05-08T05:35:43.536927+0000 (oldest deadline 2024-05-08T05:36:05.837136+0000) 2024-05-08T05:36:10.538 INFO:journalctl@ceph.osd.8.smithi160.stdout:May 08 05:36:10 smithi160 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-8[53438]: 2024-05-08T05:36:10.155+0000 7f9baa4b7700 -1 osd.8 85 heartbeat_check: no reply from 172.21.15.90:6804 osd.1 since back 2024-05-08T05:35:19.849347+0000 front 2024-05-08T05:35:19.849487+0000 (oldest deadline 2024-05-08T05:35:43.349410+0000) 2024-05-08T05:36:10.539 INFO:journalctl@ceph.osd.8.smithi160.stdout:May 08 05:36:10 smithi160 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-8[53438]: 2024-05-08T05:36:10.155+0000 7f9baa4b7700 -1 osd.8 85 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-05-08T05:35:27.950958+0000 front 2024-05-08T05:35:27.950938+0000 (oldest deadline 2024-05-08T05:35:51.451162+0000) 2024-05-08T05:36:10.539 INFO:journalctl@ceph.osd.8.smithi160.stdout:May 08 05:36:10 smithi160 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-8[53438]: 2024-05-08T05:36:10.155+0000 7f9baa4b7700 -1 osd.8 85 heartbeat_check: no reply from 172.21.15.87:6814 osd.3 since back 2024-05-08T05:35:34.352349+0000 front 2024-05-08T05:35:34.352493+0000 (oldest deadline 2024-05-08T05:36:00.252195+0000) 2024-05-08T05:36:10.539 INFO:journalctl@ceph.osd.8.smithi160.stdout:May 08 05:36:10 smithi160 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-8[53438]: 2024-05-08T05:36:10.155+0000 7f9baa4b7700 -1 osd.8 85 heartbeat_check: no reply from 172.21.15.90:6812 osd.4 since back 2024-05-08T05:35:44.953321+0000 front 2024-05-08T05:35:44.953169+0000 (oldest deadline 2024-05-08T05:36:07.153468+0000) 2024-05-08T05:36:10.806 INFO:journalctl@ceph.osd.7.smithi090.stdout:May 08 05:36:10 smithi090 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-7[52517]: 2024-05-08T05:36:10.499+0000 7f2f232a5700 -1 osd.7 85 heartbeat_check: no reply from 172.21.15.90:6804 osd.1 since back 2024-05-08T05:35:19.451959+0000 front 2024-05-08T05:35:19.451987+0000 (oldest deadline 2024-05-08T05:35:43.552168+0000) 2024-05-08T05:36:10.806 INFO:journalctl@ceph.osd.7.smithi090.stdout:May 08 05:36:10 smithi090 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-7[52517]: 2024-05-08T05:36:10.499+0000 7f2f232a5700 -1 osd.7 85 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-05-08T05:35:23.552784+0000 front 2024-05-08T05:35:23.552870+0000 (oldest deadline 2024-05-08T05:35:49.452918+0000) 2024-05-08T05:36:10.807 INFO:journalctl@ceph.osd.7.smithi090.stdout:May 08 05:36:10 smithi090 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-7[52517]: 2024-05-08T05:36:10.499+0000 7f2f232a5700 -1 osd.7 85 heartbeat_check: no reply from 172.21.15.87:6814 osd.3 since back 2024-05-08T05:35:32.755227+0000 front 2024-05-08T05:35:32.755164+0000 (oldest deadline 2024-05-08T05:35:58.655042+0000) 2024-05-08T05:36:10.807 INFO:journalctl@ceph.osd.7.smithi090.stdout:May 08 05:36:10 smithi090 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-7[52517]: 2024-05-08T05:36:10.499+0000 7f2f232a5700 -1 osd.7 85 heartbeat_check: no reply from 172.21.15.90:6812 osd.4 since back 2024-05-08T05:35:42.155919+0000 front 2024-05-08T05:35:42.155983+0000 (oldest deadline 2024-05-08T05:36:06.855974+0000) 2024-05-08T05:36:11.038 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 08 05:36:10 smithi160 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-11[60042]: 2024-05-08T05:36:10.716+0000 7f0620c06700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.87:6806 osd.0 since back 2024-05-08T05:35:07.779525+0000 front 2024-05-08T05:35:07.779646+0000 (oldest deadline 2024-05-08T05:35:33.579761+0000) 2024-05-08T05:36:11.039 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 08 05:36:10 smithi160 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-11[60042]: 2024-05-08T05:36:10.716+0000 7f0620c06700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.90:6804 osd.1 since back 2024-05-08T05:35:19.381805+0000 front 2024-05-08T05:35:19.381693+0000 (oldest deadline 2024-05-08T05:35:45.281608+0000) 2024-05-08T05:36:11.039 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 08 05:36:10 smithi160 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-11[60042]: 2024-05-08T05:36:10.716+0000 7f0620c06700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-05-08T05:35:25.282081+0000 front 2024-05-08T05:35:25.282130+0000 (oldest deadline 2024-05-08T05:35:51.182290+0000) 2024-05-08T05:36:11.039 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 08 05:36:10 smithi160 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-11[60042]: 2024-05-08T05:36:10.716+0000 7f0620c06700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.87:6814 osd.3 since back 2024-05-08T05:35:35.784273+0000 front 2024-05-08T05:35:35.784316+0000 (oldest deadline 2024-05-08T05:36:01.084003+0000) 2024-05-08T05:36:11.039 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 08 05:36:10 smithi160 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-11[60042]: 2024-05-08T05:36:10.716+0000 7f0620c06700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.90:6812 osd.4 since back 2024-05-08T05:35:45.085478+0000 front 2024-05-08T05:35:45.085623+0000 (oldest deadline 2024-05-08T05:36:06.785423+0000) 2024-05-08T05:36:11.102 INFO:journalctl@ceph.osd.10.smithi090.stdout:May 08 05:36:10 smithi090 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-10[59300]: 2024-05-08T05:36:10.806+0000 7f515bdbb700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.87:6806 osd.0 since back 2024-05-08T05:35:09.330796+0000 front 2024-05-08T05:35:09.330921+0000 (oldest deadline 2024-05-08T05:35:34.030784+0000) 2024-05-08T05:36:11.102 INFO:journalctl@ceph.osd.10.smithi090.stdout:May 08 05:36:10 smithi090 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-10[59300]: 2024-05-08T05:36:10.806+0000 7f515bdbb700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.90:6804 osd.1 since back 2024-05-08T05:35:16.331661+0000 front 2024-05-08T05:35:16.331685+0000 (oldest deadline 2024-05-08T05:35:45.732387+0000) 2024-05-08T05:36:11.102 INFO:journalctl@ceph.osd.10.smithi090.stdout:May 08 05:36:10 smithi090 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-10[59300]: 2024-05-08T05:36:10.806+0000 7f515bdbb700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-05-08T05:35:25.732967+0000 front 2024-05-08T05:35:25.732895+0000 (oldest deadline 2024-05-08T05:35:49.733521+0000) 2024-05-08T05:36:11.102 INFO:journalctl@ceph.osd.10.smithi090.stdout:May 08 05:36:10 smithi090 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-10[59300]: 2024-05-08T05:36:10.806+0000 7f515bdbb700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.87:6814 osd.3 since back 2024-05-08T05:35:34.935373+0000 front 2024-05-08T05:35:34.935510+0000 (oldest deadline 2024-05-08T05:35:58.335621+0000) 2024-05-08T05:36:11.102 INFO:journalctl@ceph.osd.10.smithi090.stdout:May 08 05:36:10 smithi090 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-10[59300]: 2024-05-08T05:36:10.806+0000 7f515bdbb700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.90:6812 osd.4 since back 2024-05-08T05:35:43.536890+0000 front 2024-05-08T05:35:43.536927+0000 (oldest deadline 2024-05-08T05:36:05.837136+0000) 2024-05-08T05:36:11.208 INFO:journalctl@ceph.osd.9.smithi087.stdout:May 08 05:36:10 smithi087 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-9[64574]: 2024-05-08T05:36:10.939+0000 7fb2f9800700 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.87:6806 osd.0 since back 2024-05-08T05:35:08.464101+0000 front 2024-05-08T05:35:08.464047+0000 (oldest deadline 2024-05-08T05:35:31.964171+0000) 2024-05-08T05:36:11.208 INFO:journalctl@ceph.osd.9.smithi087.stdout:May 08 05:36:10 smithi087 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-9[64574]: 2024-05-08T05:36:10.939+0000 7fb2f9800700 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.90:6804 osd.1 since back 2024-05-08T05:35:15.466623+0000 front 2024-05-08T05:35:15.467083+0000 (oldest deadline 2024-05-08T05:35:41.366632+0000) 2024-05-08T05:36:11.209 INFO:journalctl@ceph.osd.9.smithi087.stdout:May 08 05:36:10 smithi087 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-9[64574]: 2024-05-08T05:36:10.939+0000 7fb2f9800700 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-05-08T05:35:24.868777+0000 front 2024-05-08T05:35:24.868646+0000 (oldest deadline 2024-05-08T05:35:48.968629+0000) 2024-05-08T05:36:11.209 INFO:journalctl@ceph.osd.9.smithi087.stdout:May 08 05:36:10 smithi087 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-9[64574]: 2024-05-08T05:36:10.939+0000 7fb2f9800700 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.87:6814 osd.3 since back 2024-05-08T05:35:32.470732+0000 front 2024-05-08T05:35:32.471202+0000 (oldest deadline 2024-05-08T05:36:00.071563+0000) 2024-05-08T05:36:11.209 INFO:journalctl@ceph.osd.9.smithi087.stdout:May 08 05:36:10 smithi087 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-9[64574]: 2024-05-08T05:36:10.939+0000 7fb2f9800700 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.90:6812 osd.4 since back 2024-05-08T05:35:43.573743+0000 front 2024-05-08T05:35:43.574046+0000 (oldest deadline 2024-05-08T05:36:09.473468+0000) 2024-05-08T05:36:11.313 INFO:journalctl@ceph.osd.8.smithi160.stdout:May 08 05:36:11 smithi160 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-8[53438]: 2024-05-08T05:36:11.138+0000 7f9baa4b7700 -1 osd.8 85 heartbeat_check: no reply from 172.21.15.90:6804 osd.1 since back 2024-05-08T05:35:19.849347+0000 front 2024-05-08T05:35:19.849487+0000 (oldest deadline 2024-05-08T05:35:43.349410+0000) 2024-05-08T05:36:11.313 INFO:journalctl@ceph.osd.8.smithi160.stdout:May 08 05:36:11 smithi160 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-8[53438]: 2024-05-08T05:36:11.138+0000 7f9baa4b7700 -1 osd.8 85 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-05-08T05:35:27.950958+0000 front 2024-05-08T05:35:27.950938+0000 (oldest deadline 2024-05-08T05:35:51.451162+0000) 2024-05-08T05:36:11.313 INFO:journalctl@ceph.osd.8.smithi160.stdout:May 08 05:36:11 smithi160 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-8[53438]: 2024-05-08T05:36:11.138+0000 7f9baa4b7700 -1 osd.8 85 heartbeat_check: no reply from 172.21.15.87:6814 osd.3 since back 2024-05-08T05:35:34.352349+0000 front 2024-05-08T05:35:34.352493+0000 (oldest deadline 2024-05-08T05:36:00.252195+0000) 2024-05-08T05:36:11.313 INFO:journalctl@ceph.osd.8.smithi160.stdout:May 08 05:36:11 smithi160 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-8[53438]: 2024-05-08T05:36:11.138+0000 7f9baa4b7700 -1 osd.8 85 heartbeat_check: no reply from 172.21.15.90:6812 osd.4 since back 2024-05-08T05:35:44.953321+0000 front 2024-05-08T05:35:44.953169+0000 (oldest deadline 2024-05-08T05:36:07.153468+0000) 2024-05-08T05:36:11.414 INFO:journalctl@ceph.osd.7.smithi090.stdout:May 08 05:36:11 smithi090 podman[69220]: 2024-05-08 05:36:11.102132084 +0000 UTC m=+5.589563822 container died 0fca968170c4f565dc5e0f2d934ef6cd53fdb8d016f668f46ecf57d6f0370bf0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c, name=ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-7, GIT_CLEAN=True, org.label-schema.build-date=20240507, org.label-schema.license=GPLv2, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, RELEASE=wip-57676-3-bee299f, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image) 2024-05-08T05:36:11.733 INFO:journalctl@ceph.osd.7.smithi090.stdout:May 08 05:36:11 smithi090 podman[69220]: 2024-05-08 05:36:11.51330055 +0000 UTC m=+6.000732289 container cleanup 0fca968170c4f565dc5e0f2d934ef6cd53fdb8d016f668f46ecf57d6f0370bf0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c, name=ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-7, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, GIT_CLEAN=True, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, RELEASE=wip-57676-3-bee299f, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240507, ceph=True) 2024-05-08T05:36:11.733 INFO:journalctl@ceph.osd.7.smithi090.stdout:May 08 05:36:11 smithi090 bash[69220]: ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-7 2024-05-08T05:36:12.038 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 08 05:36:11 smithi160 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-11[60042]: 2024-05-08T05:36:11.681+0000 7f0620c06700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.87:6806 osd.0 since back 2024-05-08T05:35:07.779525+0000 front 2024-05-08T05:35:07.779646+0000 (oldest deadline 2024-05-08T05:35:33.579761+0000) 2024-05-08T05:36:12.038 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 08 05:36:11 smithi160 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-11[60042]: 2024-05-08T05:36:11.681+0000 7f0620c06700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.90:6804 osd.1 since back 2024-05-08T05:35:19.381805+0000 front 2024-05-08T05:35:19.381693+0000 (oldest deadline 2024-05-08T05:35:45.281608+0000) 2024-05-08T05:36:12.039 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 08 05:36:11 smithi160 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-11[60042]: 2024-05-08T05:36:11.681+0000 7f0620c06700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-05-08T05:35:25.282081+0000 front 2024-05-08T05:35:25.282130+0000 (oldest deadline 2024-05-08T05:35:51.182290+0000) 2024-05-08T05:36:12.039 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 08 05:36:11 smithi160 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-11[60042]: 2024-05-08T05:36:11.681+0000 7f0620c06700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.87:6814 osd.3 since back 2024-05-08T05:35:35.784273+0000 front 2024-05-08T05:35:35.784316+0000 (oldest deadline 2024-05-08T05:36:01.084003+0000) 2024-05-08T05:36:12.039 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 08 05:36:11 smithi160 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-11[60042]: 2024-05-08T05:36:11.681+0000 7f0620c06700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.90:6812 osd.4 since back 2024-05-08T05:35:45.085478+0000 front 2024-05-08T05:35:45.085623+0000 (oldest deadline 2024-05-08T05:36:06.785423+0000) 2024-05-08T05:36:12.186 INFO:journalctl@ceph.osd.7.smithi090.stdout:May 08 05:36:11 smithi090 podman[69237]: 2024-05-08 05:36:11.74816385 +0000 UTC m=+0.643142382 container remove 0fca968170c4f565dc5e0f2d934ef6cd53fdb8d016f668f46ecf57d6f0370bf0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c, name=ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-7, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.build-date=20240507, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, RELEASE=wip-57676-3-bee299f, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5) 2024-05-08T05:36:12.186 INFO:journalctl@ceph.osd.10.smithi090.stdout:May 08 05:36:11 smithi090 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-10[59300]: 2024-05-08T05:36:11.802+0000 7f515bdbb700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.87:6806 osd.0 since back 2024-05-08T05:35:09.330796+0000 front 2024-05-08T05:35:09.330921+0000 (oldest deadline 2024-05-08T05:35:34.030784+0000) 2024-05-08T05:36:12.186 INFO:journalctl@ceph.osd.10.smithi090.stdout:May 08 05:36:11 smithi090 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-10[59300]: 2024-05-08T05:36:11.802+0000 7f515bdbb700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.90:6804 osd.1 since back 2024-05-08T05:35:16.331661+0000 front 2024-05-08T05:35:16.331685+0000 (oldest deadline 2024-05-08T05:35:45.732387+0000) 2024-05-08T05:36:12.186 INFO:journalctl@ceph.osd.10.smithi090.stdout:May 08 05:36:11 smithi090 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-10[59300]: 2024-05-08T05:36:11.802+0000 7f515bdbb700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-05-08T05:35:25.732967+0000 front 2024-05-08T05:35:25.732895+0000 (oldest deadline 2024-05-08T05:35:49.733521+0000) 2024-05-08T05:36:12.186 INFO:journalctl@ceph.osd.10.smithi090.stdout:May 08 05:36:11 smithi090 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-10[59300]: 2024-05-08T05:36:11.802+0000 7f515bdbb700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.87:6814 osd.3 since back 2024-05-08T05:35:34.935373+0000 front 2024-05-08T05:35:34.935510+0000 (oldest deadline 2024-05-08T05:35:58.335621+0000) 2024-05-08T05:36:12.186 INFO:journalctl@ceph.osd.10.smithi090.stdout:May 08 05:36:11 smithi090 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-10[59300]: 2024-05-08T05:36:11.802+0000 7f515bdbb700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.90:6812 osd.4 since back 2024-05-08T05:35:43.536890+0000 front 2024-05-08T05:35:43.536927+0000 (oldest deadline 2024-05-08T05:36:05.837136+0000) 2024-05-08T05:36:12.208 INFO:journalctl@ceph.osd.9.smithi087.stdout:May 08 05:36:11 smithi087 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-9[64574]: 2024-05-08T05:36:11.928+0000 7fb2f9800700 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.87:6806 osd.0 since back 2024-05-08T05:35:08.464101+0000 front 2024-05-08T05:35:08.464047+0000 (oldest deadline 2024-05-08T05:35:31.964171+0000) 2024-05-08T05:36:12.208 INFO:journalctl@ceph.osd.9.smithi087.stdout:May 08 05:36:11 smithi087 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-9[64574]: 2024-05-08T05:36:11.928+0000 7fb2f9800700 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.90:6804 osd.1 since back 2024-05-08T05:35:15.466623+0000 front 2024-05-08T05:35:15.467083+0000 (oldest deadline 2024-05-08T05:35:41.366632+0000) 2024-05-08T05:36:12.209 INFO:journalctl@ceph.osd.9.smithi087.stdout:May 08 05:36:11 smithi087 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-9[64574]: 2024-05-08T05:36:11.928+0000 7fb2f9800700 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-05-08T05:35:24.868777+0000 front 2024-05-08T05:35:24.868646+0000 (oldest deadline 2024-05-08T05:35:48.968629+0000) 2024-05-08T05:36:12.209 INFO:journalctl@ceph.osd.9.smithi087.stdout:May 08 05:36:11 smithi087 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-9[64574]: 2024-05-08T05:36:11.928+0000 7fb2f9800700 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.87:6814 osd.3 since back 2024-05-08T05:35:32.470732+0000 front 2024-05-08T05:35:32.471202+0000 (oldest deadline 2024-05-08T05:36:00.071563+0000) 2024-05-08T05:36:12.209 INFO:journalctl@ceph.osd.9.smithi087.stdout:May 08 05:36:11 smithi087 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-9[64574]: 2024-05-08T05:36:11.928+0000 7fb2f9800700 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.90:6812 osd.4 since back 2024-05-08T05:35:43.573743+0000 front 2024-05-08T05:35:43.574046+0000 (oldest deadline 2024-05-08T05:36:09.473468+0000) 2024-05-08T05:36:12.452 INFO:journalctl@ceph.osd.7.smithi090.stdout:May 08 05:36:12 smithi090 podman[69327]: 2024-05-08 05:36:12.088971483 +0000 UTC m=+0.018021155 image pull 352576a2df49fbab3aeeba1effbcb7a94815e8fc1f120a55ddc340b4ee63b8ce quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c 2024-05-08T05:36:12.453 INFO:journalctl@ceph.osd.7.smithi090.stdout:May 08 05:36:12 smithi090 podman[69327]: 2024-05-08 05:36:12.22421468 +0000 UTC m=+0.153264353 container create cc858bcf8fad32a63313117538f60c7119291ccd3b87b4465e53e91cce543bc9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c, name=ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-7-deactivate, RELEASE=wip-57676-3-bee299f, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.build-date=20240507, GIT_CLEAN=True) 2024-05-08T05:36:12.453 INFO:journalctl@ceph.osd.7.smithi090.stdout:May 08 05:36:12 smithi090 podman[69327]: 2024-05-08 05:36:12.452692718 +0000 UTC m=+0.381742397 container init cc858bcf8fad32a63313117538f60c7119291ccd3b87b4465e53e91cce543bc9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c, name=ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-7-deactivate, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, RELEASE=wip-57676-3-bee299f, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.build-date=20240507, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5) 2024-05-08T05:36:12.539 INFO:journalctl@ceph.osd.8.smithi160.stdout:May 08 05:36:12 smithi160 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-8[53438]: 2024-05-08T05:36:12.113+0000 7f9baa4b7700 -1 osd.8 85 heartbeat_check: no reply from 172.21.15.90:6804 osd.1 since back 2024-05-08T05:35:19.849347+0000 front 2024-05-08T05:35:19.849487+0000 (oldest deadline 2024-05-08T05:35:43.349410+0000) 2024-05-08T05:36:12.539 INFO:journalctl@ceph.osd.8.smithi160.stdout:May 08 05:36:12 smithi160 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-8[53438]: 2024-05-08T05:36:12.113+0000 7f9baa4b7700 -1 osd.8 85 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-05-08T05:35:27.950958+0000 front 2024-05-08T05:35:27.950938+0000 (oldest deadline 2024-05-08T05:35:51.451162+0000) 2024-05-08T05:36:12.539 INFO:journalctl@ceph.osd.8.smithi160.stdout:May 08 05:36:12 smithi160 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-8[53438]: 2024-05-08T05:36:12.113+0000 7f9baa4b7700 -1 osd.8 85 heartbeat_check: no reply from 172.21.15.87:6814 osd.3 since back 2024-05-08T05:35:34.352349+0000 front 2024-05-08T05:35:34.352493+0000 (oldest deadline 2024-05-08T05:36:00.252195+0000) 2024-05-08T05:36:12.539 INFO:journalctl@ceph.osd.8.smithi160.stdout:May 08 05:36:12 smithi160 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-8[53438]: 2024-05-08T05:36:12.113+0000 7f9baa4b7700 -1 osd.8 85 heartbeat_check: no reply from 172.21.15.90:6812 osd.4 since back 2024-05-08T05:35:44.953321+0000 front 2024-05-08T05:35:44.953169+0000 (oldest deadline 2024-05-08T05:36:07.153468+0000) 2024-05-08T05:36:12.733 INFO:journalctl@ceph.osd.7.smithi090.stdout:May 08 05:36:12 smithi090 podman[69327]: 2024-05-08 05:36:12.456106162 +0000 UTC m=+0.385155836 container start cc858bcf8fad32a63313117538f60c7119291ccd3b87b4465e53e91cce543bc9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c, name=ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-7-deactivate, RELEASE=wip-57676-3-bee299f, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240507, ceph=True, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2) 2024-05-08T05:36:12.733 INFO:journalctl@ceph.osd.7.smithi090.stdout:May 08 05:36:12 smithi090 podman[69327]: 2024-05-08 05:36:12.545322552 +0000 UTC m=+0.474372239 container attach cc858bcf8fad32a63313117538f60c7119291ccd3b87b4465e53e91cce543bc9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c, name=ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-7-deactivate, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, ceph=True, RELEASE=wip-57676-3-bee299f, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240507, org.label-schema.schema-version=1.0) 2024-05-08T05:36:13.038 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 08 05:36:12 smithi160 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-11[60042]: 2024-05-08T05:36:12.644+0000 7f0620c06700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.87:6806 osd.0 since back 2024-05-08T05:35:07.779525+0000 front 2024-05-08T05:35:07.779646+0000 (oldest deadline 2024-05-08T05:35:33.579761+0000) 2024-05-08T05:36:13.039 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 08 05:36:12 smithi160 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-11[60042]: 2024-05-08T05:36:12.644+0000 7f0620c06700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.90:6804 osd.1 since back 2024-05-08T05:35:19.381805+0000 front 2024-05-08T05:35:19.381693+0000 (oldest deadline 2024-05-08T05:35:45.281608+0000) 2024-05-08T05:36:13.039 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 08 05:36:12 smithi160 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-11[60042]: 2024-05-08T05:36:12.644+0000 7f0620c06700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-05-08T05:35:25.282081+0000 front 2024-05-08T05:35:25.282130+0000 (oldest deadline 2024-05-08T05:35:51.182290+0000) 2024-05-08T05:36:13.039 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 08 05:36:12 smithi160 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-11[60042]: 2024-05-08T05:36:12.644+0000 7f0620c06700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.87:6814 osd.3 since back 2024-05-08T05:35:35.784273+0000 front 2024-05-08T05:35:35.784316+0000 (oldest deadline 2024-05-08T05:36:01.084003+0000) 2024-05-08T05:36:13.039 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 08 05:36:12 smithi160 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-11[60042]: 2024-05-08T05:36:12.644+0000 7f0620c06700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.90:6812 osd.4 since back 2024-05-08T05:35:45.085478+0000 front 2024-05-08T05:35:45.085623+0000 (oldest deadline 2024-05-08T05:36:06.785423+0000) 2024-05-08T05:36:13.057 INFO:journalctl@ceph.osd.7.smithi090.stdout:May 08 05:36:12 smithi090 podman[69327]: 2024-05-08 05:36:12.747560753 +0000 UTC m=+0.676610419 container died cc858bcf8fad32a63313117538f60c7119291ccd3b87b4465e53e91cce543bc9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c, name=ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-7-deactivate, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.build-date=20240507, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, RELEASE=wip-57676-3-bee299f, io.buildah.version=1.33.5) 2024-05-08T05:36:13.057 INFO:journalctl@ceph.osd.10.smithi090.stdout:May 08 05:36:12 smithi090 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-10[59300]: 2024-05-08T05:36:12.840+0000 7f515bdbb700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.87:6806 osd.0 since back 2024-05-08T05:35:09.330796+0000 front 2024-05-08T05:35:09.330921+0000 (oldest deadline 2024-05-08T05:35:34.030784+0000) 2024-05-08T05:36:13.058 INFO:journalctl@ceph.osd.10.smithi090.stdout:May 08 05:36:12 smithi090 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-10[59300]: 2024-05-08T05:36:12.840+0000 7f515bdbb700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.90:6804 osd.1 since back 2024-05-08T05:35:16.331661+0000 front 2024-05-08T05:35:16.331685+0000 (oldest deadline 2024-05-08T05:35:45.732387+0000) 2024-05-08T05:36:13.058 INFO:journalctl@ceph.osd.10.smithi090.stdout:May 08 05:36:12 smithi090 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-10[59300]: 2024-05-08T05:36:12.840+0000 7f515bdbb700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-05-08T05:35:25.732967+0000 front 2024-05-08T05:35:25.732895+0000 (oldest deadline 2024-05-08T05:35:49.733521+0000) 2024-05-08T05:36:13.058 INFO:journalctl@ceph.osd.10.smithi090.stdout:May 08 05:36:12 smithi090 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-10[59300]: 2024-05-08T05:36:12.840+0000 7f515bdbb700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.87:6814 osd.3 since back 2024-05-08T05:35:34.935373+0000 front 2024-05-08T05:35:34.935510+0000 (oldest deadline 2024-05-08T05:35:58.335621+0000) 2024-05-08T05:36:13.058 INFO:journalctl@ceph.osd.10.smithi090.stdout:May 08 05:36:12 smithi090 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-10[59300]: 2024-05-08T05:36:12.840+0000 7f515bdbb700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.90:6812 osd.4 since back 2024-05-08T05:35:43.536890+0000 front 2024-05-08T05:35:43.536927+0000 (oldest deadline 2024-05-08T05:36:05.837136+0000) 2024-05-08T05:36:13.202 INFO:journalctl@ceph.osd.9.smithi087.stdout:May 08 05:36:12 smithi087 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-9[64574]: 2024-05-08T05:36:12.915+0000 7fb2f9800700 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.87:6806 osd.0 since back 2024-05-08T05:35:08.464101+0000 front 2024-05-08T05:35:08.464047+0000 (oldest deadline 2024-05-08T05:35:31.964171+0000) 2024-05-08T05:36:13.202 INFO:journalctl@ceph.osd.9.smithi087.stdout:May 08 05:36:12 smithi087 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-9[64574]: 2024-05-08T05:36:12.915+0000 7fb2f9800700 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.90:6804 osd.1 since back 2024-05-08T05:35:15.466623+0000 front 2024-05-08T05:35:15.467083+0000 (oldest deadline 2024-05-08T05:35:41.366632+0000) 2024-05-08T05:36:13.202 INFO:journalctl@ceph.osd.9.smithi087.stdout:May 08 05:36:12 smithi087 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-9[64574]: 2024-05-08T05:36:12.915+0000 7fb2f9800700 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-05-08T05:35:24.868777+0000 front 2024-05-08T05:35:24.868646+0000 (oldest deadline 2024-05-08T05:35:48.968629+0000) 2024-05-08T05:36:13.202 INFO:journalctl@ceph.osd.9.smithi087.stdout:May 08 05:36:12 smithi087 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-9[64574]: 2024-05-08T05:36:12.915+0000 7fb2f9800700 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.87:6814 osd.3 since back 2024-05-08T05:35:32.470732+0000 front 2024-05-08T05:35:32.471202+0000 (oldest deadline 2024-05-08T05:36:00.071563+0000) 2024-05-08T05:36:13.202 INFO:journalctl@ceph.osd.9.smithi087.stdout:May 08 05:36:12 smithi087 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-9[64574]: 2024-05-08T05:36:12.915+0000 7fb2f9800700 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.90:6812 osd.4 since back 2024-05-08T05:35:43.573743+0000 front 2024-05-08T05:35:43.574046+0000 (oldest deadline 2024-05-08T05:36:09.473468+0000) 2024-05-08T05:36:13.377 DEBUG:teuthology.orchestra.run.smithi090:> sudo pkill -f 'journalctl -f -n 0 -u ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968@osd.7.service' 2024-05-08T05:36:13.414 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-08T05:36:13.415 INFO:tasks.cephadm.osd.7:Stopped osd.7 2024-05-08T05:36:13.415 INFO:tasks.cephadm.osd.8:Stopping osd.8... 2024-05-08T05:36:13.415 DEBUG:teuthology.orchestra.run.smithi160:> sudo systemctl stop ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968@osd.8 2024-05-08T05:36:13.441 INFO:journalctl@ceph.osd.8.smithi160.stdout:May 08 05:36:13 smithi160 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-8[53438]: 2024-05-08T05:36:13.112+0000 7f9baa4b7700 -1 osd.8 85 heartbeat_check: no reply from 172.21.15.90:6804 osd.1 since back 2024-05-08T05:35:19.849347+0000 front 2024-05-08T05:35:19.849487+0000 (oldest deadline 2024-05-08T05:35:43.349410+0000) 2024-05-08T05:36:13.441 INFO:journalctl@ceph.osd.8.smithi160.stdout:May 08 05:36:13 smithi160 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-8[53438]: 2024-05-08T05:36:13.112+0000 7f9baa4b7700 -1 osd.8 85 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-05-08T05:35:27.950958+0000 front 2024-05-08T05:35:27.950938+0000 (oldest deadline 2024-05-08T05:35:51.451162+0000) 2024-05-08T05:36:13.441 INFO:journalctl@ceph.osd.8.smithi160.stdout:May 08 05:36:13 smithi160 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-8[53438]: 2024-05-08T05:36:13.112+0000 7f9baa4b7700 -1 osd.8 85 heartbeat_check: no reply from 172.21.15.87:6814 osd.3 since back 2024-05-08T05:35:34.352349+0000 front 2024-05-08T05:35:34.352493+0000 (oldest deadline 2024-05-08T05:36:00.252195+0000) 2024-05-08T05:36:13.441 INFO:journalctl@ceph.osd.8.smithi160.stdout:May 08 05:36:13 smithi160 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-8[53438]: 2024-05-08T05:36:13.112+0000 7f9baa4b7700 -1 osd.8 85 heartbeat_check: no reply from 172.21.15.90:6812 osd.4 since back 2024-05-08T05:35:44.953321+0000 front 2024-05-08T05:35:44.953169+0000 (oldest deadline 2024-05-08T05:36:07.153468+0000) 2024-05-08T05:36:13.716 INFO:journalctl@ceph.osd.8.smithi160.stdout:May 08 05:36:13 smithi160 systemd[1]: Stopping Ceph osd.8 for eeeb813e-0cf9-11ef-bc97-c7b262605968... 2024-05-08T05:36:13.716 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 08 05:36:13 smithi160 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-11[60042]: 2024-05-08T05:36:13.689+0000 7f0620c06700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.87:6806 osd.0 since back 2024-05-08T05:35:07.779525+0000 front 2024-05-08T05:35:07.779646+0000 (oldest deadline 2024-05-08T05:35:33.579761+0000) 2024-05-08T05:36:13.716 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 08 05:36:13 smithi160 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-11[60042]: 2024-05-08T05:36:13.689+0000 7f0620c06700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.90:6804 osd.1 since back 2024-05-08T05:35:19.381805+0000 front 2024-05-08T05:35:19.381693+0000 (oldest deadline 2024-05-08T05:35:45.281608+0000) 2024-05-08T05:36:13.716 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 08 05:36:13 smithi160 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-11[60042]: 2024-05-08T05:36:13.689+0000 7f0620c06700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-05-08T05:35:25.282081+0000 front 2024-05-08T05:35:25.282130+0000 (oldest deadline 2024-05-08T05:35:51.182290+0000) 2024-05-08T05:36:13.716 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 08 05:36:13 smithi160 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-11[60042]: 2024-05-08T05:36:13.689+0000 7f0620c06700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.87:6814 osd.3 since back 2024-05-08T05:35:35.784273+0000 front 2024-05-08T05:35:35.784316+0000 (oldest deadline 2024-05-08T05:36:01.084003+0000) 2024-05-08T05:36:13.716 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 08 05:36:13 smithi160 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-11[60042]: 2024-05-08T05:36:13.689+0000 7f0620c06700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.90:6812 osd.4 since back 2024-05-08T05:35:45.085478+0000 front 2024-05-08T05:35:45.085623+0000 (oldest deadline 2024-05-08T05:36:06.785423+0000) 2024-05-08T05:36:13.983 INFO:journalctl@ceph.osd.10.smithi090.stdout:May 08 05:36:13 smithi090 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-10[59300]: 2024-05-08T05:36:13.818+0000 7f515bdbb700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.87:6806 osd.0 since back 2024-05-08T05:35:09.330796+0000 front 2024-05-08T05:35:09.330921+0000 (oldest deadline 2024-05-08T05:35:34.030784+0000) 2024-05-08T05:36:13.984 INFO:journalctl@ceph.osd.10.smithi090.stdout:May 08 05:36:13 smithi090 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-10[59300]: 2024-05-08T05:36:13.818+0000 7f515bdbb700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.90:6804 osd.1 since back 2024-05-08T05:35:16.331661+0000 front 2024-05-08T05:35:16.331685+0000 (oldest deadline 2024-05-08T05:35:45.732387+0000) 2024-05-08T05:36:13.984 INFO:journalctl@ceph.osd.10.smithi090.stdout:May 08 05:36:13 smithi090 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-10[59300]: 2024-05-08T05:36:13.818+0000 7f515bdbb700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-05-08T05:35:25.732967+0000 front 2024-05-08T05:35:25.732895+0000 (oldest deadline 2024-05-08T05:35:49.733521+0000) 2024-05-08T05:36:13.984 INFO:journalctl@ceph.osd.10.smithi090.stdout:May 08 05:36:13 smithi090 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-10[59300]: 2024-05-08T05:36:13.818+0000 7f515bdbb700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.87:6814 osd.3 since back 2024-05-08T05:35:34.935373+0000 front 2024-05-08T05:35:34.935510+0000 (oldest deadline 2024-05-08T05:35:58.335621+0000) 2024-05-08T05:36:13.984 INFO:journalctl@ceph.osd.10.smithi090.stdout:May 08 05:36:13 smithi090 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-10[59300]: 2024-05-08T05:36:13.818+0000 7f515bdbb700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.90:6812 osd.4 since back 2024-05-08T05:35:43.536890+0000 front 2024-05-08T05:35:43.536927+0000 (oldest deadline 2024-05-08T05:36:05.837136+0000) 2024-05-08T05:36:14.038 INFO:journalctl@ceph.osd.8.smithi160.stdout:May 08 05:36:13 smithi160 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-8[53438]: 2024-05-08T05:36:13.714+0000 7f9badec3700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.8 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-05-08T05:36:14.039 INFO:journalctl@ceph.osd.8.smithi160.stdout:May 08 05:36:13 smithi160 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-8[53438]: 2024-05-08T05:36:13.714+0000 7f9badec3700 -1 osd.8 85 *** Got signal Terminated *** 2024-05-08T05:36:14.039 INFO:journalctl@ceph.osd.8.smithi160.stdout:May 08 05:36:13 smithi160 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-8[53438]: 2024-05-08T05:36:13.714+0000 7f9badec3700 -1 osd.8 85 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-05-08T05:36:14.208 INFO:journalctl@ceph.osd.9.smithi087.stdout:May 08 05:36:13 smithi087 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-9[64574]: 2024-05-08T05:36:13.920+0000 7fb2f9800700 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.87:6806 osd.0 since back 2024-05-08T05:35:08.464101+0000 front 2024-05-08T05:35:08.464047+0000 (oldest deadline 2024-05-08T05:35:31.964171+0000) 2024-05-08T05:36:14.209 INFO:journalctl@ceph.osd.9.smithi087.stdout:May 08 05:36:13 smithi087 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-9[64574]: 2024-05-08T05:36:13.920+0000 7fb2f9800700 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.90:6804 osd.1 since back 2024-05-08T05:35:15.466623+0000 front 2024-05-08T05:35:15.467083+0000 (oldest deadline 2024-05-08T05:35:41.366632+0000) 2024-05-08T05:36:14.209 INFO:journalctl@ceph.osd.9.smithi087.stdout:May 08 05:36:13 smithi087 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-9[64574]: 2024-05-08T05:36:13.920+0000 7fb2f9800700 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-05-08T05:35:24.868777+0000 front 2024-05-08T05:35:24.868646+0000 (oldest deadline 2024-05-08T05:35:48.968629+0000) 2024-05-08T05:36:14.209 INFO:journalctl@ceph.osd.9.smithi087.stdout:May 08 05:36:13 smithi087 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-9[64574]: 2024-05-08T05:36:13.920+0000 7fb2f9800700 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.87:6814 osd.3 since back 2024-05-08T05:35:32.470732+0000 front 2024-05-08T05:35:32.471202+0000 (oldest deadline 2024-05-08T05:36:00.071563+0000) 2024-05-08T05:36:14.209 INFO:journalctl@ceph.osd.9.smithi087.stdout:May 08 05:36:13 smithi087 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-9[64574]: 2024-05-08T05:36:13.920+0000 7fb2f9800700 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.90:6812 osd.4 since back 2024-05-08T05:35:43.573743+0000 front 2024-05-08T05:35:43.574046+0000 (oldest deadline 2024-05-08T05:36:09.473468+0000) 2024-05-08T05:36:14.538 INFO:journalctl@ceph.osd.8.smithi160.stdout:May 08 05:36:14 smithi160 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-8[53438]: 2024-05-08T05:36:14.112+0000 7f9baa4b7700 -1 osd.8 85 heartbeat_check: no reply from 172.21.15.90:6804 osd.1 since back 2024-05-08T05:35:19.849347+0000 front 2024-05-08T05:35:19.849487+0000 (oldest deadline 2024-05-08T05:35:43.349410+0000) 2024-05-08T05:36:14.539 INFO:journalctl@ceph.osd.8.smithi160.stdout:May 08 05:36:14 smithi160 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-8[53438]: 2024-05-08T05:36:14.112+0000 7f9baa4b7700 -1 osd.8 85 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-05-08T05:35:27.950958+0000 front 2024-05-08T05:35:27.950938+0000 (oldest deadline 2024-05-08T05:35:51.451162+0000) 2024-05-08T05:36:14.539 INFO:journalctl@ceph.osd.8.smithi160.stdout:May 08 05:36:14 smithi160 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-8[53438]: 2024-05-08T05:36:14.112+0000 7f9baa4b7700 -1 osd.8 85 heartbeat_check: no reply from 172.21.15.87:6814 osd.3 since back 2024-05-08T05:35:34.352349+0000 front 2024-05-08T05:35:34.352493+0000 (oldest deadline 2024-05-08T05:36:00.252195+0000) 2024-05-08T05:36:14.539 INFO:journalctl@ceph.osd.8.smithi160.stdout:May 08 05:36:14 smithi160 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-8[53438]: 2024-05-08T05:36:14.112+0000 7f9baa4b7700 -1 osd.8 85 heartbeat_check: no reply from 172.21.15.90:6812 osd.4 since back 2024-05-08T05:35:44.953321+0000 front 2024-05-08T05:35:44.953169+0000 (oldest deadline 2024-05-08T05:36:07.153468+0000) 2024-05-08T05:36:15.038 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 08 05:36:14 smithi160 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-11[60042]: 2024-05-08T05:36:14.689+0000 7f0620c06700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.87:6806 osd.0 since back 2024-05-08T05:35:07.779525+0000 front 2024-05-08T05:35:07.779646+0000 (oldest deadline 2024-05-08T05:35:33.579761+0000) 2024-05-08T05:36:15.039 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 08 05:36:14 smithi160 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-11[60042]: 2024-05-08T05:36:14.689+0000 7f0620c06700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.90:6804 osd.1 since back 2024-05-08T05:35:19.381805+0000 front 2024-05-08T05:35:19.381693+0000 (oldest deadline 2024-05-08T05:35:45.281608+0000) 2024-05-08T05:36:15.039 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 08 05:36:14 smithi160 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-11[60042]: 2024-05-08T05:36:14.689+0000 7f0620c06700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-05-08T05:35:25.282081+0000 front 2024-05-08T05:35:25.282130+0000 (oldest deadline 2024-05-08T05:35:51.182290+0000) 2024-05-08T05:36:15.039 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 08 05:36:14 smithi160 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-11[60042]: 2024-05-08T05:36:14.689+0000 7f0620c06700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.87:6814 osd.3 since back 2024-05-08T05:35:35.784273+0000 front 2024-05-08T05:35:35.784316+0000 (oldest deadline 2024-05-08T05:36:01.084003+0000) 2024-05-08T05:36:15.039 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 08 05:36:14 smithi160 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-11[60042]: 2024-05-08T05:36:14.689+0000 7f0620c06700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.90:6812 osd.4 since back 2024-05-08T05:35:45.085478+0000 front 2024-05-08T05:35:45.085623+0000 (oldest deadline 2024-05-08T05:36:06.785423+0000) 2024-05-08T05:36:15.208 INFO:journalctl@ceph.osd.9.smithi087.stdout:May 08 05:36:14 smithi087 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-9[64574]: 2024-05-08T05:36:14.902+0000 7fb2f9800700 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.87:6806 osd.0 since back 2024-05-08T05:35:08.464101+0000 front 2024-05-08T05:35:08.464047+0000 (oldest deadline 2024-05-08T05:35:31.964171+0000) 2024-05-08T05:36:15.209 INFO:journalctl@ceph.osd.9.smithi087.stdout:May 08 05:36:14 smithi087 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-9[64574]: 2024-05-08T05:36:14.902+0000 7fb2f9800700 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.90:6804 osd.1 since back 2024-05-08T05:35:15.466623+0000 front 2024-05-08T05:35:15.467083+0000 (oldest deadline 2024-05-08T05:35:41.366632+0000) 2024-05-08T05:36:15.209 INFO:journalctl@ceph.osd.9.smithi087.stdout:May 08 05:36:14 smithi087 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-9[64574]: 2024-05-08T05:36:14.902+0000 7fb2f9800700 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-05-08T05:35:24.868777+0000 front 2024-05-08T05:35:24.868646+0000 (oldest deadline 2024-05-08T05:35:48.968629+0000) 2024-05-08T05:36:15.209 INFO:journalctl@ceph.osd.9.smithi087.stdout:May 08 05:36:14 smithi087 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-9[64574]: 2024-05-08T05:36:14.902+0000 7fb2f9800700 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.87:6814 osd.3 since back 2024-05-08T05:35:32.470732+0000 front 2024-05-08T05:35:32.471202+0000 (oldest deadline 2024-05-08T05:36:00.071563+0000) 2024-05-08T05:36:15.209 INFO:journalctl@ceph.osd.9.smithi087.stdout:May 08 05:36:14 smithi087 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-9[64574]: 2024-05-08T05:36:14.902+0000 7fb2f9800700 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.90:6812 osd.4 since back 2024-05-08T05:35:43.573743+0000 front 2024-05-08T05:35:43.574046+0000 (oldest deadline 2024-05-08T05:36:09.473468+0000) 2024-05-08T05:36:15.209 INFO:journalctl@ceph.osd.9.smithi087.stdout:May 08 05:36:14 smithi087 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-9[64574]: 2024-05-08T05:36:14.902+0000 7fb2f9800700 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.160:6812 osd.5 since back 2024-05-08T05:35:49.474324+0000 front 2024-05-08T05:35:49.474399+0000 (oldest deadline 2024-05-08T05:36:14.174227+0000) 2024-05-08T05:36:15.233 INFO:journalctl@ceph.osd.10.smithi090.stdout:May 08 05:36:14 smithi090 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-10[59300]: 2024-05-08T05:36:14.791+0000 7f515bdbb700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.87:6806 osd.0 since back 2024-05-08T05:35:09.330796+0000 front 2024-05-08T05:35:09.330921+0000 (oldest deadline 2024-05-08T05:35:34.030784+0000) 2024-05-08T05:36:15.233 INFO:journalctl@ceph.osd.10.smithi090.stdout:May 08 05:36:14 smithi090 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-10[59300]: 2024-05-08T05:36:14.791+0000 7f515bdbb700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.90:6804 osd.1 since back 2024-05-08T05:35:16.331661+0000 front 2024-05-08T05:35:16.331685+0000 (oldest deadline 2024-05-08T05:35:45.732387+0000) 2024-05-08T05:36:15.233 INFO:journalctl@ceph.osd.10.smithi090.stdout:May 08 05:36:14 smithi090 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-10[59300]: 2024-05-08T05:36:14.791+0000 7f515bdbb700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-05-08T05:35:25.732967+0000 front 2024-05-08T05:35:25.732895+0000 (oldest deadline 2024-05-08T05:35:49.733521+0000) 2024-05-08T05:36:15.233 INFO:journalctl@ceph.osd.10.smithi090.stdout:May 08 05:36:14 smithi090 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-10[59300]: 2024-05-08T05:36:14.791+0000 7f515bdbb700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.87:6814 osd.3 since back 2024-05-08T05:35:34.935373+0000 front 2024-05-08T05:35:34.935510+0000 (oldest deadline 2024-05-08T05:35:58.335621+0000) 2024-05-08T05:36:15.234 INFO:journalctl@ceph.osd.10.smithi090.stdout:May 08 05:36:14 smithi090 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-10[59300]: 2024-05-08T05:36:14.791+0000 7f515bdbb700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.90:6812 osd.4 since back 2024-05-08T05:35:43.536890+0000 front 2024-05-08T05:35:43.536927+0000 (oldest deadline 2024-05-08T05:36:05.837136+0000) 2024-05-08T05:36:15.538 INFO:journalctl@ceph.osd.8.smithi160.stdout:May 08 05:36:15 smithi160 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-8[53438]: 2024-05-08T05:36:15.133+0000 7f9baa4b7700 -1 osd.8 85 heartbeat_check: no reply from 172.21.15.90:6804 osd.1 since back 2024-05-08T05:35:19.849347+0000 front 2024-05-08T05:35:19.849487+0000 (oldest deadline 2024-05-08T05:35:43.349410+0000) 2024-05-08T05:36:15.538 INFO:journalctl@ceph.osd.8.smithi160.stdout:May 08 05:36:15 smithi160 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-8[53438]: 2024-05-08T05:36:15.133+0000 7f9baa4b7700 -1 osd.8 85 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-05-08T05:35:27.950958+0000 front 2024-05-08T05:35:27.950938+0000 (oldest deadline 2024-05-08T05:35:51.451162+0000) 2024-05-08T05:36:15.539 INFO:journalctl@ceph.osd.8.smithi160.stdout:May 08 05:36:15 smithi160 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-8[53438]: 2024-05-08T05:36:15.133+0000 7f9baa4b7700 -1 osd.8 85 heartbeat_check: no reply from 172.21.15.87:6814 osd.3 since back 2024-05-08T05:35:34.352349+0000 front 2024-05-08T05:35:34.352493+0000 (oldest deadline 2024-05-08T05:36:00.252195+0000) 2024-05-08T05:36:15.539 INFO:journalctl@ceph.osd.8.smithi160.stdout:May 08 05:36:15 smithi160 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-8[53438]: 2024-05-08T05:36:15.133+0000 7f9baa4b7700 -1 osd.8 85 heartbeat_check: no reply from 172.21.15.90:6812 osd.4 since back 2024-05-08T05:35:44.953321+0000 front 2024-05-08T05:35:44.953169+0000 (oldest deadline 2024-05-08T05:36:07.153468+0000) 2024-05-08T05:36:16.038 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 08 05:36:15 smithi160 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-11[60042]: 2024-05-08T05:36:15.729+0000 7f0620c06700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.87:6806 osd.0 since back 2024-05-08T05:35:07.779525+0000 front 2024-05-08T05:35:07.779646+0000 (oldest deadline 2024-05-08T05:35:33.579761+0000) 2024-05-08T05:36:16.039 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 08 05:36:15 smithi160 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-11[60042]: 2024-05-08T05:36:15.729+0000 7f0620c06700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.90:6804 osd.1 since back 2024-05-08T05:35:19.381805+0000 front 2024-05-08T05:35:19.381693+0000 (oldest deadline 2024-05-08T05:35:45.281608+0000) 2024-05-08T05:36:16.039 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 08 05:36:15 smithi160 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-11[60042]: 2024-05-08T05:36:15.729+0000 7f0620c06700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-05-08T05:35:25.282081+0000 front 2024-05-08T05:35:25.282130+0000 (oldest deadline 2024-05-08T05:35:51.182290+0000) 2024-05-08T05:36:16.039 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 08 05:36:15 smithi160 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-11[60042]: 2024-05-08T05:36:15.729+0000 7f0620c06700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.87:6814 osd.3 since back 2024-05-08T05:35:35.784273+0000 front 2024-05-08T05:35:35.784316+0000 (oldest deadline 2024-05-08T05:36:01.084003+0000) 2024-05-08T05:36:16.039 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 08 05:36:15 smithi160 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-11[60042]: 2024-05-08T05:36:15.729+0000 7f0620c06700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.90:6812 osd.4 since back 2024-05-08T05:35:45.085478+0000 front 2024-05-08T05:35:45.085623+0000 (oldest deadline 2024-05-08T05:36:06.785423+0000) 2024-05-08T05:36:16.208 INFO:journalctl@ceph.osd.9.smithi087.stdout:May 08 05:36:15 smithi087 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-9[64574]: 2024-05-08T05:36:15.867+0000 7fb2f9800700 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.87:6806 osd.0 since back 2024-05-08T05:35:08.464101+0000 front 2024-05-08T05:35:08.464047+0000 (oldest deadline 2024-05-08T05:35:31.964171+0000) 2024-05-08T05:36:16.209 INFO:journalctl@ceph.osd.9.smithi087.stdout:May 08 05:36:15 smithi087 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-9[64574]: 2024-05-08T05:36:15.867+0000 7fb2f9800700 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.90:6804 osd.1 since back 2024-05-08T05:35:15.466623+0000 front 2024-05-08T05:35:15.467083+0000 (oldest deadline 2024-05-08T05:35:41.366632+0000) 2024-05-08T05:36:16.209 INFO:journalctl@ceph.osd.9.smithi087.stdout:May 08 05:36:15 smithi087 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-9[64574]: 2024-05-08T05:36:15.867+0000 7fb2f9800700 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-05-08T05:35:24.868777+0000 front 2024-05-08T05:35:24.868646+0000 (oldest deadline 2024-05-08T05:35:48.968629+0000) 2024-05-08T05:36:16.209 INFO:journalctl@ceph.osd.9.smithi087.stdout:May 08 05:36:15 smithi087 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-9[64574]: 2024-05-08T05:36:15.867+0000 7fb2f9800700 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.87:6814 osd.3 since back 2024-05-08T05:35:32.470732+0000 front 2024-05-08T05:35:32.471202+0000 (oldest deadline 2024-05-08T05:36:00.071563+0000) 2024-05-08T05:36:16.209 INFO:journalctl@ceph.osd.9.smithi087.stdout:May 08 05:36:15 smithi087 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-9[64574]: 2024-05-08T05:36:15.867+0000 7fb2f9800700 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.90:6812 osd.4 since back 2024-05-08T05:35:43.573743+0000 front 2024-05-08T05:35:43.574046+0000 (oldest deadline 2024-05-08T05:36:09.473468+0000) 2024-05-08T05:36:16.209 INFO:journalctl@ceph.osd.9.smithi087.stdout:May 08 05:36:15 smithi087 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-9[64574]: 2024-05-08T05:36:15.867+0000 7fb2f9800700 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.160:6812 osd.5 since back 2024-05-08T05:35:49.474324+0000 front 2024-05-08T05:35:49.474399+0000 (oldest deadline 2024-05-08T05:36:14.174227+0000) 2024-05-08T05:36:16.233 INFO:journalctl@ceph.osd.10.smithi090.stdout:May 08 05:36:15 smithi090 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-10[59300]: 2024-05-08T05:36:15.789+0000 7f515bdbb700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.87:6806 osd.0 since back 2024-05-08T05:35:09.330796+0000 front 2024-05-08T05:35:09.330921+0000 (oldest deadline 2024-05-08T05:35:34.030784+0000) 2024-05-08T05:36:16.233 INFO:journalctl@ceph.osd.10.smithi090.stdout:May 08 05:36:15 smithi090 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-10[59300]: 2024-05-08T05:36:15.789+0000 7f515bdbb700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.90:6804 osd.1 since back 2024-05-08T05:35:16.331661+0000 front 2024-05-08T05:35:16.331685+0000 (oldest deadline 2024-05-08T05:35:45.732387+0000) 2024-05-08T05:36:16.233 INFO:journalctl@ceph.osd.10.smithi090.stdout:May 08 05:36:15 smithi090 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-10[59300]: 2024-05-08T05:36:15.789+0000 7f515bdbb700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-05-08T05:35:25.732967+0000 front 2024-05-08T05:35:25.732895+0000 (oldest deadline 2024-05-08T05:35:49.733521+0000) 2024-05-08T05:36:16.234 INFO:journalctl@ceph.osd.10.smithi090.stdout:May 08 05:36:15 smithi090 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-10[59300]: 2024-05-08T05:36:15.789+0000 7f515bdbb700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.87:6814 osd.3 since back 2024-05-08T05:35:34.935373+0000 front 2024-05-08T05:35:34.935510+0000 (oldest deadline 2024-05-08T05:35:58.335621+0000) 2024-05-08T05:36:16.234 INFO:journalctl@ceph.osd.10.smithi090.stdout:May 08 05:36:15 smithi090 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-10[59300]: 2024-05-08T05:36:15.789+0000 7f515bdbb700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.90:6812 osd.4 since back 2024-05-08T05:35:43.536890+0000 front 2024-05-08T05:35:43.536927+0000 (oldest deadline 2024-05-08T05:36:05.837136+0000) 2024-05-08T05:36:16.234 INFO:journalctl@ceph.osd.10.smithi090.stdout:May 08 05:36:15 smithi090 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-10[59300]: 2024-05-08T05:36:15.789+0000 7f515bdbb700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.160:6812 osd.5 since back 2024-05-08T05:35:49.239047+0000 front 2024-05-08T05:35:49.238934+0000 (oldest deadline 2024-05-08T05:36:15.138762+0000) 2024-05-08T05:36:16.538 INFO:journalctl@ceph.osd.8.smithi160.stdout:May 08 05:36:16 smithi160 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-8[53438]: 2024-05-08T05:36:16.128+0000 7f9baa4b7700 -1 osd.8 85 heartbeat_check: no reply from 172.21.15.90:6804 osd.1 since back 2024-05-08T05:35:19.849347+0000 front 2024-05-08T05:35:19.849487+0000 (oldest deadline 2024-05-08T05:35:43.349410+0000) 2024-05-08T05:36:16.539 INFO:journalctl@ceph.osd.8.smithi160.stdout:May 08 05:36:16 smithi160 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-8[53438]: 2024-05-08T05:36:16.128+0000 7f9baa4b7700 -1 osd.8 85 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-05-08T05:35:27.950958+0000 front 2024-05-08T05:35:27.950938+0000 (oldest deadline 2024-05-08T05:35:51.451162+0000) 2024-05-08T05:36:16.539 INFO:journalctl@ceph.osd.8.smithi160.stdout:May 08 05:36:16 smithi160 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-8[53438]: 2024-05-08T05:36:16.128+0000 7f9baa4b7700 -1 osd.8 85 heartbeat_check: no reply from 172.21.15.87:6814 osd.3 since back 2024-05-08T05:35:34.352349+0000 front 2024-05-08T05:35:34.352493+0000 (oldest deadline 2024-05-08T05:36:00.252195+0000) 2024-05-08T05:36:16.539 INFO:journalctl@ceph.osd.8.smithi160.stdout:May 08 05:36:16 smithi160 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-8[53438]: 2024-05-08T05:36:16.128+0000 7f9baa4b7700 -1 osd.8 85 heartbeat_check: no reply from 172.21.15.90:6812 osd.4 since back 2024-05-08T05:35:44.953321+0000 front 2024-05-08T05:35:44.953169+0000 (oldest deadline 2024-05-08T05:36:07.153468+0000) 2024-05-08T05:36:16.539 INFO:journalctl@ceph.osd.8.smithi160.stdout:May 08 05:36:16 smithi160 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-8[53438]: 2024-05-08T05:36:16.128+0000 7f9baa4b7700 -1 osd.8 85 heartbeat_check: no reply from 172.21.15.160:6812 osd.5 since back 2024-05-08T05:35:50.054257+0000 front 2024-05-08T05:35:50.054282+0000 (oldest deadline 2024-05-08T05:36:15.354325+0000) 2024-05-08T05:36:17.039 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 08 05:36:16 smithi160 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-11[60042]: 2024-05-08T05:36:16.736+0000 7f0620c06700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.87:6806 osd.0 since back 2024-05-08T05:35:07.779525+0000 front 2024-05-08T05:35:07.779646+0000 (oldest deadline 2024-05-08T05:35:33.579761+0000) 2024-05-08T05:36:17.039 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 08 05:36:16 smithi160 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-11[60042]: 2024-05-08T05:36:16.736+0000 7f0620c06700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.90:6804 osd.1 since back 2024-05-08T05:35:19.381805+0000 front 2024-05-08T05:35:19.381693+0000 (oldest deadline 2024-05-08T05:35:45.281608+0000) 2024-05-08T05:36:17.039 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 08 05:36:16 smithi160 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-11[60042]: 2024-05-08T05:36:16.736+0000 7f0620c06700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-05-08T05:35:25.282081+0000 front 2024-05-08T05:35:25.282130+0000 (oldest deadline 2024-05-08T05:35:51.182290+0000) 2024-05-08T05:36:17.039 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 08 05:36:16 smithi160 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-11[60042]: 2024-05-08T05:36:16.736+0000 7f0620c06700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.87:6814 osd.3 since back 2024-05-08T05:35:35.784273+0000 front 2024-05-08T05:35:35.784316+0000 (oldest deadline 2024-05-08T05:36:01.084003+0000) 2024-05-08T05:36:17.039 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 08 05:36:16 smithi160 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-11[60042]: 2024-05-08T05:36:16.736+0000 7f0620c06700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.90:6812 osd.4 since back 2024-05-08T05:35:45.085478+0000 front 2024-05-08T05:35:45.085623+0000 (oldest deadline 2024-05-08T05:36:06.785423+0000) 2024-05-08T05:36:17.208 INFO:journalctl@ceph.osd.9.smithi087.stdout:May 08 05:36:16 smithi087 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-9[64574]: 2024-05-08T05:36:16.887+0000 7fb2f9800700 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.87:6806 osd.0 since back 2024-05-08T05:35:08.464101+0000 front 2024-05-08T05:35:08.464047+0000 (oldest deadline 2024-05-08T05:35:31.964171+0000) 2024-05-08T05:36:17.209 INFO:journalctl@ceph.osd.9.smithi087.stdout:May 08 05:36:16 smithi087 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-9[64574]: 2024-05-08T05:36:16.887+0000 7fb2f9800700 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.90:6804 osd.1 since back 2024-05-08T05:35:15.466623+0000 front 2024-05-08T05:35:15.467083+0000 (oldest deadline 2024-05-08T05:35:41.366632+0000) 2024-05-08T05:36:17.209 INFO:journalctl@ceph.osd.9.smithi087.stdout:May 08 05:36:16 smithi087 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-9[64574]: 2024-05-08T05:36:16.887+0000 7fb2f9800700 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-05-08T05:35:24.868777+0000 front 2024-05-08T05:35:24.868646+0000 (oldest deadline 2024-05-08T05:35:48.968629+0000) 2024-05-08T05:36:17.209 INFO:journalctl@ceph.osd.9.smithi087.stdout:May 08 05:36:16 smithi087 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-9[64574]: 2024-05-08T05:36:16.887+0000 7fb2f9800700 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.87:6814 osd.3 since back 2024-05-08T05:35:32.470732+0000 front 2024-05-08T05:35:32.471202+0000 (oldest deadline 2024-05-08T05:36:00.071563+0000) 2024-05-08T05:36:17.209 INFO:journalctl@ceph.osd.9.smithi087.stdout:May 08 05:36:16 smithi087 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-9[64574]: 2024-05-08T05:36:16.887+0000 7fb2f9800700 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.90:6812 osd.4 since back 2024-05-08T05:35:43.573743+0000 front 2024-05-08T05:35:43.574046+0000 (oldest deadline 2024-05-08T05:36:09.473468+0000) 2024-05-08T05:36:17.209 INFO:journalctl@ceph.osd.9.smithi087.stdout:May 08 05:36:16 smithi087 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-9[64574]: 2024-05-08T05:36:16.887+0000 7fb2f9800700 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.160:6812 osd.5 since back 2024-05-08T05:35:49.474324+0000 front 2024-05-08T05:35:49.474399+0000 (oldest deadline 2024-05-08T05:36:14.174227+0000) 2024-05-08T05:36:17.233 INFO:journalctl@ceph.osd.10.smithi090.stdout:May 08 05:36:16 smithi090 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-10[59300]: 2024-05-08T05:36:16.739+0000 7f515bdbb700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.87:6806 osd.0 since back 2024-05-08T05:35:09.330796+0000 front 2024-05-08T05:35:09.330921+0000 (oldest deadline 2024-05-08T05:35:34.030784+0000) 2024-05-08T05:36:17.233 INFO:journalctl@ceph.osd.10.smithi090.stdout:May 08 05:36:16 smithi090 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-10[59300]: 2024-05-08T05:36:16.739+0000 7f515bdbb700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.90:6804 osd.1 since back 2024-05-08T05:35:16.331661+0000 front 2024-05-08T05:35:16.331685+0000 (oldest deadline 2024-05-08T05:35:45.732387+0000) 2024-05-08T05:36:17.234 INFO:journalctl@ceph.osd.10.smithi090.stdout:May 08 05:36:16 smithi090 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-10[59300]: 2024-05-08T05:36:16.739+0000 7f515bdbb700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-05-08T05:35:25.732967+0000 front 2024-05-08T05:35:25.732895+0000 (oldest deadline 2024-05-08T05:35:49.733521+0000) 2024-05-08T05:36:17.234 INFO:journalctl@ceph.osd.10.smithi090.stdout:May 08 05:36:16 smithi090 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-10[59300]: 2024-05-08T05:36:16.739+0000 7f515bdbb700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.87:6814 osd.3 since back 2024-05-08T05:35:34.935373+0000 front 2024-05-08T05:35:34.935510+0000 (oldest deadline 2024-05-08T05:35:58.335621+0000) 2024-05-08T05:36:17.234 INFO:journalctl@ceph.osd.10.smithi090.stdout:May 08 05:36:16 smithi090 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-10[59300]: 2024-05-08T05:36:16.739+0000 7f515bdbb700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.90:6812 osd.4 since back 2024-05-08T05:35:43.536890+0000 front 2024-05-08T05:35:43.536927+0000 (oldest deadline 2024-05-08T05:36:05.837136+0000) 2024-05-08T05:36:17.234 INFO:journalctl@ceph.osd.10.smithi090.stdout:May 08 05:36:16 smithi090 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-10[59300]: 2024-05-08T05:36:16.739+0000 7f515bdbb700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.160:6812 osd.5 since back 2024-05-08T05:35:49.239047+0000 front 2024-05-08T05:35:49.238934+0000 (oldest deadline 2024-05-08T05:36:15.138762+0000) 2024-05-08T05:36:17.538 INFO:journalctl@ceph.osd.8.smithi160.stdout:May 08 05:36:17 smithi160 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-8[53438]: 2024-05-08T05:36:17.117+0000 7f9baa4b7700 -1 osd.8 85 heartbeat_check: no reply from 172.21.15.90:6804 osd.1 since back 2024-05-08T05:35:19.849347+0000 front 2024-05-08T05:35:19.849487+0000 (oldest deadline 2024-05-08T05:35:43.349410+0000) 2024-05-08T05:36:17.539 INFO:journalctl@ceph.osd.8.smithi160.stdout:May 08 05:36:17 smithi160 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-8[53438]: 2024-05-08T05:36:17.117+0000 7f9baa4b7700 -1 osd.8 85 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-05-08T05:35:27.950958+0000 front 2024-05-08T05:35:27.950938+0000 (oldest deadline 2024-05-08T05:35:51.451162+0000) 2024-05-08T05:36:17.539 INFO:journalctl@ceph.osd.8.smithi160.stdout:May 08 05:36:17 smithi160 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-8[53438]: 2024-05-08T05:36:17.117+0000 7f9baa4b7700 -1 osd.8 85 heartbeat_check: no reply from 172.21.15.87:6814 osd.3 since back 2024-05-08T05:35:34.352349+0000 front 2024-05-08T05:35:34.352493+0000 (oldest deadline 2024-05-08T05:36:00.252195+0000) 2024-05-08T05:36:17.539 INFO:journalctl@ceph.osd.8.smithi160.stdout:May 08 05:36:17 smithi160 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-8[53438]: 2024-05-08T05:36:17.117+0000 7f9baa4b7700 -1 osd.8 85 heartbeat_check: no reply from 172.21.15.90:6812 osd.4 since back 2024-05-08T05:35:44.953321+0000 front 2024-05-08T05:35:44.953169+0000 (oldest deadline 2024-05-08T05:36:07.153468+0000) 2024-05-08T05:36:17.539 INFO:journalctl@ceph.osd.8.smithi160.stdout:May 08 05:36:17 smithi160 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-8[53438]: 2024-05-08T05:36:17.117+0000 7f9baa4b7700 -1 osd.8 85 heartbeat_check: no reply from 172.21.15.160:6812 osd.5 since back 2024-05-08T05:35:50.054257+0000 front 2024-05-08T05:35:50.054282+0000 (oldest deadline 2024-05-08T05:36:15.354325+0000) 2024-05-08T05:36:17.983 INFO:journalctl@ceph.osd.10.smithi090.stdout:May 08 05:36:17 smithi090 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-10[59300]: 2024-05-08T05:36:17.719+0000 7f515bdbb700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.87:6806 osd.0 since back 2024-05-08T05:35:09.330796+0000 front 2024-05-08T05:35:09.330921+0000 (oldest deadline 2024-05-08T05:35:34.030784+0000) 2024-05-08T05:36:17.983 INFO:journalctl@ceph.osd.10.smithi090.stdout:May 08 05:36:17 smithi090 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-10[59300]: 2024-05-08T05:36:17.719+0000 7f515bdbb700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.90:6804 osd.1 since back 2024-05-08T05:35:16.331661+0000 front 2024-05-08T05:35:16.331685+0000 (oldest deadline 2024-05-08T05:35:45.732387+0000) 2024-05-08T05:36:17.984 INFO:journalctl@ceph.osd.10.smithi090.stdout:May 08 05:36:17 smithi090 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-10[59300]: 2024-05-08T05:36:17.719+0000 7f515bdbb700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-05-08T05:35:25.732967+0000 front 2024-05-08T05:35:25.732895+0000 (oldest deadline 2024-05-08T05:35:49.733521+0000) 2024-05-08T05:36:17.984 INFO:journalctl@ceph.osd.10.smithi090.stdout:May 08 05:36:17 smithi090 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-10[59300]: 2024-05-08T05:36:17.719+0000 7f515bdbb700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.87:6814 osd.3 since back 2024-05-08T05:35:34.935373+0000 front 2024-05-08T05:35:34.935510+0000 (oldest deadline 2024-05-08T05:35:58.335621+0000) 2024-05-08T05:36:17.984 INFO:journalctl@ceph.osd.10.smithi090.stdout:May 08 05:36:17 smithi090 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-10[59300]: 2024-05-08T05:36:17.719+0000 7f515bdbb700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.90:6812 osd.4 since back 2024-05-08T05:35:43.536890+0000 front 2024-05-08T05:35:43.536927+0000 (oldest deadline 2024-05-08T05:36:05.837136+0000) 2024-05-08T05:36:17.984 INFO:journalctl@ceph.osd.10.smithi090.stdout:May 08 05:36:17 smithi090 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-10[59300]: 2024-05-08T05:36:17.719+0000 7f515bdbb700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.160:6812 osd.5 since back 2024-05-08T05:35:49.239047+0000 front 2024-05-08T05:35:49.238934+0000 (oldest deadline 2024-05-08T05:36:15.138762+0000) 2024-05-08T05:36:18.038 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 08 05:36:17 smithi160 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-11[60042]: 2024-05-08T05:36:17.753+0000 7f0620c06700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.87:6806 osd.0 since back 2024-05-08T05:35:07.779525+0000 front 2024-05-08T05:35:07.779646+0000 (oldest deadline 2024-05-08T05:35:33.579761+0000) 2024-05-08T05:36:18.039 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 08 05:36:17 smithi160 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-11[60042]: 2024-05-08T05:36:17.753+0000 7f0620c06700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.90:6804 osd.1 since back 2024-05-08T05:35:19.381805+0000 front 2024-05-08T05:35:19.381693+0000 (oldest deadline 2024-05-08T05:35:45.281608+0000) 2024-05-08T05:36:18.039 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 08 05:36:17 smithi160 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-11[60042]: 2024-05-08T05:36:17.753+0000 7f0620c06700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-05-08T05:35:25.282081+0000 front 2024-05-08T05:35:25.282130+0000 (oldest deadline 2024-05-08T05:35:51.182290+0000) 2024-05-08T05:36:18.039 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 08 05:36:17 smithi160 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-11[60042]: 2024-05-08T05:36:17.753+0000 7f0620c06700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.87:6814 osd.3 since back 2024-05-08T05:35:35.784273+0000 front 2024-05-08T05:35:35.784316+0000 (oldest deadline 2024-05-08T05:36:01.084003+0000) 2024-05-08T05:36:18.039 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 08 05:36:17 smithi160 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-11[60042]: 2024-05-08T05:36:17.754+0000 7f0620c06700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.90:6812 osd.4 since back 2024-05-08T05:35:45.085478+0000 front 2024-05-08T05:35:45.085623+0000 (oldest deadline 2024-05-08T05:36:06.785423+0000) 2024-05-08T05:36:18.208 INFO:journalctl@ceph.osd.9.smithi087.stdout:May 08 05:36:17 smithi087 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-9[64574]: 2024-05-08T05:36:17.903+0000 7fb2f9800700 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.87:6806 osd.0 since back 2024-05-08T05:35:08.464101+0000 front 2024-05-08T05:35:08.464047+0000 (oldest deadline 2024-05-08T05:35:31.964171+0000) 2024-05-08T05:36:18.209 INFO:journalctl@ceph.osd.9.smithi087.stdout:May 08 05:36:17 smithi087 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-9[64574]: 2024-05-08T05:36:17.903+0000 7fb2f9800700 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.90:6804 osd.1 since back 2024-05-08T05:35:15.466623+0000 front 2024-05-08T05:35:15.467083+0000 (oldest deadline 2024-05-08T05:35:41.366632+0000) 2024-05-08T05:36:18.209 INFO:journalctl@ceph.osd.9.smithi087.stdout:May 08 05:36:17 smithi087 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-9[64574]: 2024-05-08T05:36:17.903+0000 7fb2f9800700 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-05-08T05:35:24.868777+0000 front 2024-05-08T05:35:24.868646+0000 (oldest deadline 2024-05-08T05:35:48.968629+0000) 2024-05-08T05:36:18.209 INFO:journalctl@ceph.osd.9.smithi087.stdout:May 08 05:36:17 smithi087 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-9[64574]: 2024-05-08T05:36:17.903+0000 7fb2f9800700 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.87:6814 osd.3 since back 2024-05-08T05:35:32.470732+0000 front 2024-05-08T05:35:32.471202+0000 (oldest deadline 2024-05-08T05:36:00.071563+0000) 2024-05-08T05:36:18.209 INFO:journalctl@ceph.osd.9.smithi087.stdout:May 08 05:36:17 smithi087 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-9[64574]: 2024-05-08T05:36:17.903+0000 7fb2f9800700 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.90:6812 osd.4 since back 2024-05-08T05:35:43.573743+0000 front 2024-05-08T05:35:43.574046+0000 (oldest deadline 2024-05-08T05:36:09.473468+0000) 2024-05-08T05:36:18.209 INFO:journalctl@ceph.osd.9.smithi087.stdout:May 08 05:36:17 smithi087 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-9[64574]: 2024-05-08T05:36:17.903+0000 7fb2f9800700 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.160:6812 osd.5 since back 2024-05-08T05:35:49.474324+0000 front 2024-05-08T05:35:49.474399+0000 (oldest deadline 2024-05-08T05:36:14.174227+0000) 2024-05-08T05:36:18.538 INFO:journalctl@ceph.osd.8.smithi160.stdout:May 08 05:36:18 smithi160 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-8[53438]: 2024-05-08T05:36:18.153+0000 7f9baa4b7700 -1 osd.8 85 heartbeat_check: no reply from 172.21.15.90:6804 osd.1 since back 2024-05-08T05:35:19.849347+0000 front 2024-05-08T05:35:19.849487+0000 (oldest deadline 2024-05-08T05:35:43.349410+0000) 2024-05-08T05:36:18.539 INFO:journalctl@ceph.osd.8.smithi160.stdout:May 08 05:36:18 smithi160 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-8[53438]: 2024-05-08T05:36:18.153+0000 7f9baa4b7700 -1 osd.8 85 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-05-08T05:35:27.950958+0000 front 2024-05-08T05:35:27.950938+0000 (oldest deadline 2024-05-08T05:35:51.451162+0000) 2024-05-08T05:36:18.539 INFO:journalctl@ceph.osd.8.smithi160.stdout:May 08 05:36:18 smithi160 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-8[53438]: 2024-05-08T05:36:18.153+0000 7f9baa4b7700 -1 osd.8 85 heartbeat_check: no reply from 172.21.15.87:6814 osd.3 since back 2024-05-08T05:35:34.352349+0000 front 2024-05-08T05:35:34.352493+0000 (oldest deadline 2024-05-08T05:36:00.252195+0000) 2024-05-08T05:36:18.539 INFO:journalctl@ceph.osd.8.smithi160.stdout:May 08 05:36:18 smithi160 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-8[53438]: 2024-05-08T05:36:18.153+0000 7f9baa4b7700 -1 osd.8 85 heartbeat_check: no reply from 172.21.15.90:6812 osd.4 since back 2024-05-08T05:35:44.953321+0000 front 2024-05-08T05:35:44.953169+0000 (oldest deadline 2024-05-08T05:36:07.153468+0000) 2024-05-08T05:36:18.539 INFO:journalctl@ceph.osd.8.smithi160.stdout:May 08 05:36:18 smithi160 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-8[53438]: 2024-05-08T05:36:18.153+0000 7f9baa4b7700 -1 osd.8 85 heartbeat_check: no reply from 172.21.15.160:6812 osd.5 since back 2024-05-08T05:35:50.054257+0000 front 2024-05-08T05:35:50.054282+0000 (oldest deadline 2024-05-08T05:36:15.354325+0000) 2024-05-08T05:36:18.983 INFO:journalctl@ceph.osd.10.smithi090.stdout:May 08 05:36:18 smithi090 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-10[59300]: 2024-05-08T05:36:18.693+0000 7f515bdbb700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.87:6806 osd.0 since back 2024-05-08T05:35:09.330796+0000 front 2024-05-08T05:35:09.330921+0000 (oldest deadline 2024-05-08T05:35:34.030784+0000) 2024-05-08T05:36:18.983 INFO:journalctl@ceph.osd.10.smithi090.stdout:May 08 05:36:18 smithi090 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-10[59300]: 2024-05-08T05:36:18.693+0000 7f515bdbb700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.90:6804 osd.1 since back 2024-05-08T05:35:16.331661+0000 front 2024-05-08T05:35:16.331685+0000 (oldest deadline 2024-05-08T05:35:45.732387+0000) 2024-05-08T05:36:18.983 INFO:journalctl@ceph.osd.10.smithi090.stdout:May 08 05:36:18 smithi090 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-10[59300]: 2024-05-08T05:36:18.693+0000 7f515bdbb700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-05-08T05:35:25.732967+0000 front 2024-05-08T05:35:25.732895+0000 (oldest deadline 2024-05-08T05:35:49.733521+0000) 2024-05-08T05:36:18.983 INFO:journalctl@ceph.osd.10.smithi090.stdout:May 08 05:36:18 smithi090 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-10[59300]: 2024-05-08T05:36:18.693+0000 7f515bdbb700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.87:6814 osd.3 since back 2024-05-08T05:35:34.935373+0000 front 2024-05-08T05:35:34.935510+0000 (oldest deadline 2024-05-08T05:35:58.335621+0000) 2024-05-08T05:36:18.984 INFO:journalctl@ceph.osd.10.smithi090.stdout:May 08 05:36:18 smithi090 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-10[59300]: 2024-05-08T05:36:18.693+0000 7f515bdbb700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.90:6812 osd.4 since back 2024-05-08T05:35:43.536890+0000 front 2024-05-08T05:35:43.536927+0000 (oldest deadline 2024-05-08T05:36:05.837136+0000) 2024-05-08T05:36:18.984 INFO:journalctl@ceph.osd.10.smithi090.stdout:May 08 05:36:18 smithi090 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-10[59300]: 2024-05-08T05:36:18.693+0000 7f515bdbb700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.160:6812 osd.5 since back 2024-05-08T05:35:49.239047+0000 front 2024-05-08T05:35:49.238934+0000 (oldest deadline 2024-05-08T05:36:15.138762+0000) 2024-05-08T05:36:19.038 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 08 05:36:18 smithi160 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-11[60042]: 2024-05-08T05:36:18.768+0000 7f0620c06700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.87:6806 osd.0 since back 2024-05-08T05:35:07.779525+0000 front 2024-05-08T05:35:07.779646+0000 (oldest deadline 2024-05-08T05:35:33.579761+0000) 2024-05-08T05:36:19.039 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 08 05:36:18 smithi160 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-11[60042]: 2024-05-08T05:36:18.768+0000 7f0620c06700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.90:6804 osd.1 since back 2024-05-08T05:35:19.381805+0000 front 2024-05-08T05:35:19.381693+0000 (oldest deadline 2024-05-08T05:35:45.281608+0000) 2024-05-08T05:36:19.039 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 08 05:36:18 smithi160 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-11[60042]: 2024-05-08T05:36:18.768+0000 7f0620c06700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-05-08T05:35:25.282081+0000 front 2024-05-08T05:35:25.282130+0000 (oldest deadline 2024-05-08T05:35:51.182290+0000) 2024-05-08T05:36:19.039 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 08 05:36:18 smithi160 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-11[60042]: 2024-05-08T05:36:18.768+0000 7f0620c06700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.87:6814 osd.3 since back 2024-05-08T05:35:35.784273+0000 front 2024-05-08T05:35:35.784316+0000 (oldest deadline 2024-05-08T05:36:01.084003+0000) 2024-05-08T05:36:19.039 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 08 05:36:18 smithi160 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-11[60042]: 2024-05-08T05:36:18.768+0000 7f0620c06700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.90:6812 osd.4 since back 2024-05-08T05:35:45.085478+0000 front 2024-05-08T05:35:45.085623+0000 (oldest deadline 2024-05-08T05:36:06.785423+0000) 2024-05-08T05:36:19.208 INFO:journalctl@ceph.osd.9.smithi087.stdout:May 08 05:36:18 smithi087 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-9[64574]: 2024-05-08T05:36:18.890+0000 7fb2f9800700 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.87:6806 osd.0 since back 2024-05-08T05:35:08.464101+0000 front 2024-05-08T05:35:08.464047+0000 (oldest deadline 2024-05-08T05:35:31.964171+0000) 2024-05-08T05:36:19.209 INFO:journalctl@ceph.osd.9.smithi087.stdout:May 08 05:36:18 smithi087 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-9[64574]: 2024-05-08T05:36:18.890+0000 7fb2f9800700 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.90:6804 osd.1 since back 2024-05-08T05:35:15.466623+0000 front 2024-05-08T05:35:15.467083+0000 (oldest deadline 2024-05-08T05:35:41.366632+0000) 2024-05-08T05:36:19.209 INFO:journalctl@ceph.osd.9.smithi087.stdout:May 08 05:36:18 smithi087 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-9[64574]: 2024-05-08T05:36:18.890+0000 7fb2f9800700 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-05-08T05:35:24.868777+0000 front 2024-05-08T05:35:24.868646+0000 (oldest deadline 2024-05-08T05:35:48.968629+0000) 2024-05-08T05:36:19.209 INFO:journalctl@ceph.osd.9.smithi087.stdout:May 08 05:36:18 smithi087 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-9[64574]: 2024-05-08T05:36:18.890+0000 7fb2f9800700 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.87:6814 osd.3 since back 2024-05-08T05:35:32.470732+0000 front 2024-05-08T05:35:32.471202+0000 (oldest deadline 2024-05-08T05:36:00.071563+0000) 2024-05-08T05:36:19.209 INFO:journalctl@ceph.osd.9.smithi087.stdout:May 08 05:36:18 smithi087 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-9[64574]: 2024-05-08T05:36:18.890+0000 7fb2f9800700 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.90:6812 osd.4 since back 2024-05-08T05:35:43.573743+0000 front 2024-05-08T05:35:43.574046+0000 (oldest deadline 2024-05-08T05:36:09.473468+0000) 2024-05-08T05:36:19.209 INFO:journalctl@ceph.osd.9.smithi087.stdout:May 08 05:36:18 smithi087 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-9[64574]: 2024-05-08T05:36:18.890+0000 7fb2f9800700 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.160:6812 osd.5 since back 2024-05-08T05:35:49.474324+0000 front 2024-05-08T05:35:49.474399+0000 (oldest deadline 2024-05-08T05:36:14.174227+0000) 2024-05-08T05:36:19.336 INFO:journalctl@ceph.osd.8.smithi160.stdout:May 08 05:36:19 smithi160 podman[70158]: 2024-05-08 05:36:19.072386795 +0000 UTC m=+5.460498552 container died 34b574c6dd3dab3e094323417df1dcae180eba49dc1b87269314992bbefc443b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c, name=ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-8, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, RELEASE=wip-57676-3-bee299f, org.label-schema.build-date=20240507, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, ceph=True) 2024-05-08T05:36:19.710 INFO:journalctl@ceph.osd.8.smithi160.stdout:May 08 05:36:19 smithi160 podman[70158]: 2024-05-08 05:36:19.43420785 +0000 UTC m=+5.822319606 container cleanup 34b574c6dd3dab3e094323417df1dcae180eba49dc1b87269314992bbefc443b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c, name=ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-8, RELEASE=wip-57676-3-bee299f, ceph=True, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, io.buildah.version=1.33.5, org.label-schema.build-date=20240507, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux ) 2024-05-08T05:36:19.710 INFO:journalctl@ceph.osd.8.smithi160.stdout:May 08 05:36:19 smithi160 bash[70158]: ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-8 2024-05-08T05:36:20.038 INFO:journalctl@ceph.osd.8.smithi160.stdout:May 08 05:36:19 smithi160 podman[70176]: 2024-05-08 05:36:19.710285423 +0000 UTC m=+0.634184663 container remove 34b574c6dd3dab3e094323417df1dcae180eba49dc1b87269314992bbefc443b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c, name=ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-8, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-57676-3-bee299f, org.label-schema.build-date=20240507, CEPH_POINT_RELEASE=, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_CLEAN=True, io.buildah.version=1.33.5) 2024-05-08T05:36:20.039 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 08 05:36:19 smithi160 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-11[60042]: 2024-05-08T05:36:19.774+0000 7f0620c06700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.87:6806 osd.0 since back 2024-05-08T05:35:07.779525+0000 front 2024-05-08T05:35:07.779646+0000 (oldest deadline 2024-05-08T05:35:33.579761+0000) 2024-05-08T05:36:20.039 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 08 05:36:19 smithi160 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-11[60042]: 2024-05-08T05:36:19.774+0000 7f0620c06700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.90:6804 osd.1 since back 2024-05-08T05:35:19.381805+0000 front 2024-05-08T05:35:19.381693+0000 (oldest deadline 2024-05-08T05:35:45.281608+0000) 2024-05-08T05:36:20.039 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 08 05:36:19 smithi160 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-11[60042]: 2024-05-08T05:36:19.774+0000 7f0620c06700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-05-08T05:35:25.282081+0000 front 2024-05-08T05:35:25.282130+0000 (oldest deadline 2024-05-08T05:35:51.182290+0000) 2024-05-08T05:36:20.039 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 08 05:36:19 smithi160 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-11[60042]: 2024-05-08T05:36:19.774+0000 7f0620c06700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.87:6814 osd.3 since back 2024-05-08T05:35:35.784273+0000 front 2024-05-08T05:35:35.784316+0000 (oldest deadline 2024-05-08T05:36:01.084003+0000) 2024-05-08T05:36:20.039 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 08 05:36:19 smithi160 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-11[60042]: 2024-05-08T05:36:19.774+0000 7f0620c06700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.90:6812 osd.4 since back 2024-05-08T05:35:45.085478+0000 front 2024-05-08T05:35:45.085623+0000 (oldest deadline 2024-05-08T05:36:06.785423+0000) 2024-05-08T05:36:20.039 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 08 05:36:19 smithi160 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-11[60042]: 2024-05-08T05:36:19.774+0000 7f0620c06700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.160:6812 osd.5 since back 2024-05-08T05:35:52.586893+0000 front 2024-05-08T05:35:52.587009+0000 (oldest deadline 2024-05-08T05:36:19.587408+0000) 2024-05-08T05:36:20.208 INFO:journalctl@ceph.osd.9.smithi087.stdout:May 08 05:36:19 smithi087 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-9[64574]: 2024-05-08T05:36:19.847+0000 7fb2f9800700 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.87:6806 osd.0 since back 2024-05-08T05:35:08.464101+0000 front 2024-05-08T05:35:08.464047+0000 (oldest deadline 2024-05-08T05:35:31.964171+0000) 2024-05-08T05:36:20.209 INFO:journalctl@ceph.osd.9.smithi087.stdout:May 08 05:36:19 smithi087 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-9[64574]: 2024-05-08T05:36:19.847+0000 7fb2f9800700 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.90:6804 osd.1 since back 2024-05-08T05:35:15.466623+0000 front 2024-05-08T05:35:15.467083+0000 (oldest deadline 2024-05-08T05:35:41.366632+0000) 2024-05-08T05:36:20.209 INFO:journalctl@ceph.osd.9.smithi087.stdout:May 08 05:36:19 smithi087 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-9[64574]: 2024-05-08T05:36:19.847+0000 7fb2f9800700 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-05-08T05:35:24.868777+0000 front 2024-05-08T05:35:24.868646+0000 (oldest deadline 2024-05-08T05:35:48.968629+0000) 2024-05-08T05:36:20.209 INFO:journalctl@ceph.osd.9.smithi087.stdout:May 08 05:36:19 smithi087 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-9[64574]: 2024-05-08T05:36:19.847+0000 7fb2f9800700 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.87:6814 osd.3 since back 2024-05-08T05:35:32.470732+0000 front 2024-05-08T05:35:32.471202+0000 (oldest deadline 2024-05-08T05:36:00.071563+0000) 2024-05-08T05:36:20.209 INFO:journalctl@ceph.osd.9.smithi087.stdout:May 08 05:36:19 smithi087 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-9[64574]: 2024-05-08T05:36:19.847+0000 7fb2f9800700 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.90:6812 osd.4 since back 2024-05-08T05:35:43.573743+0000 front 2024-05-08T05:35:43.574046+0000 (oldest deadline 2024-05-08T05:36:09.473468+0000) 2024-05-08T05:36:20.209 INFO:journalctl@ceph.osd.9.smithi087.stdout:May 08 05:36:19 smithi087 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-9[64574]: 2024-05-08T05:36:19.847+0000 7fb2f9800700 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.160:6812 osd.5 since back 2024-05-08T05:35:49.474324+0000 front 2024-05-08T05:35:49.474399+0000 (oldest deadline 2024-05-08T05:36:14.174227+0000) 2024-05-08T05:36:20.233 INFO:journalctl@ceph.osd.10.smithi090.stdout:May 08 05:36:19 smithi090 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-10[59300]: 2024-05-08T05:36:19.741+0000 7f515bdbb700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.87:6806 osd.0 since back 2024-05-08T05:35:09.330796+0000 front 2024-05-08T05:35:09.330921+0000 (oldest deadline 2024-05-08T05:35:34.030784+0000) 2024-05-08T05:36:20.233 INFO:journalctl@ceph.osd.10.smithi090.stdout:May 08 05:36:19 smithi090 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-10[59300]: 2024-05-08T05:36:19.741+0000 7f515bdbb700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.90:6804 osd.1 since back 2024-05-08T05:35:16.331661+0000 front 2024-05-08T05:35:16.331685+0000 (oldest deadline 2024-05-08T05:35:45.732387+0000) 2024-05-08T05:36:20.233 INFO:journalctl@ceph.osd.10.smithi090.stdout:May 08 05:36:19 smithi090 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-10[59300]: 2024-05-08T05:36:19.741+0000 7f515bdbb700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-05-08T05:35:25.732967+0000 front 2024-05-08T05:35:25.732895+0000 (oldest deadline 2024-05-08T05:35:49.733521+0000) 2024-05-08T05:36:20.233 INFO:journalctl@ceph.osd.10.smithi090.stdout:May 08 05:36:19 smithi090 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-10[59300]: 2024-05-08T05:36:19.741+0000 7f515bdbb700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.87:6814 osd.3 since back 2024-05-08T05:35:34.935373+0000 front 2024-05-08T05:35:34.935510+0000 (oldest deadline 2024-05-08T05:35:58.335621+0000) 2024-05-08T05:36:20.233 INFO:journalctl@ceph.osd.10.smithi090.stdout:May 08 05:36:19 smithi090 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-10[59300]: 2024-05-08T05:36:19.741+0000 7f515bdbb700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.90:6812 osd.4 since back 2024-05-08T05:35:43.536890+0000 front 2024-05-08T05:35:43.536927+0000 (oldest deadline 2024-05-08T05:36:05.837136+0000) 2024-05-08T05:36:20.234 INFO:journalctl@ceph.osd.10.smithi090.stdout:May 08 05:36:19 smithi090 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-10[59300]: 2024-05-08T05:36:19.741+0000 7f515bdbb700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.160:6812 osd.5 since back 2024-05-08T05:35:49.239047+0000 front 2024-05-08T05:35:49.238934+0000 (oldest deadline 2024-05-08T05:36:15.138762+0000) 2024-05-08T05:36:20.355 INFO:journalctl@ceph.osd.8.smithi160.stdout:May 08 05:36:20 smithi160 podman[70267]: 2024-05-08 05:36:19.955681325 +0000 UTC m=+0.018223461 image pull 352576a2df49fbab3aeeba1effbcb7a94815e8fc1f120a55ddc340b4ee63b8ce quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c 2024-05-08T05:36:20.355 INFO:journalctl@ceph.osd.8.smithi160.stdout:May 08 05:36:20 smithi160 podman[70267]: 2024-05-08 05:36:20.061044102 +0000 UTC m=+0.123586228 container create dc0d2a1d4604dd92d9689d66c248f0cfc14ef18eac5de2975f01e855967c16aa (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c, name=ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-8-deactivate, org.label-schema.build-date=20240507, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, RELEASE=wip-57676-3-bee299f, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_CLEAN=True, ceph=True) 2024-05-08T05:36:20.355 INFO:journalctl@ceph.osd.8.smithi160.stdout:May 08 05:36:20 smithi160 podman[70267]: 2024-05-08 05:36:20.280409515 +0000 UTC m=+0.342951642 container init dc0d2a1d4604dd92d9689d66c248f0cfc14ef18eac5de2975f01e855967c16aa (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c, name=ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-8-deactivate, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, org.label-schema.build-date=20240507, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, GIT_CLEAN=True, ceph=True, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-57676-3-bee299f) 2024-05-08T05:36:20.355 INFO:journalctl@ceph.osd.8.smithi160.stdout:May 08 05:36:20 smithi160 podman[70267]: 2024-05-08 05:36:20.283415921 +0000 UTC m=+0.345958057 container start dc0d2a1d4604dd92d9689d66c248f0cfc14ef18eac5de2975f01e855967c16aa (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c, name=ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-8-deactivate, io.buildah.version=1.33.5, GIT_CLEAN=True, org.label-schema.license=GPLv2, ceph=True, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, RELEASE=wip-57676-3-bee299f, GIT_BRANCH=HEAD, org.label-schema.build-date=20240507, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=) 2024-05-08T05:36:20.355 INFO:journalctl@ceph.osd.8.smithi160.stdout:May 08 05:36:20 smithi160 podman[70267]: 2024-05-08 05:36:20.355148959 +0000 UTC m=+0.417691089 container attach dc0d2a1d4604dd92d9689d66c248f0cfc14ef18eac5de2975f01e855967c16aa (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c, name=ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-8-deactivate, ceph=True, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.build-date=20240507, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, RELEASE=wip-57676-3-bee299f, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-05-08T05:36:20.745 INFO:journalctl@ceph.osd.8.smithi160.stdout:May 08 05:36:20 smithi160 podman[70267]: 2024-05-08 05:36:20.577085847 +0000 UTC m=+0.639627974 container died dc0d2a1d4604dd92d9689d66c248f0cfc14ef18eac5de2975f01e855967c16aa (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c, name=ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-8-deactivate, GIT_BRANCH=HEAD, org.label-schema.build-date=20240507, io.buildah.version=1.33.5, ceph=True, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-57676-3-bee299f, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux ) 2024-05-08T05:36:21.038 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 08 05:36:20 smithi160 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-11[60042]: 2024-05-08T05:36:20.744+0000 7f0620c06700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.87:6806 osd.0 since back 2024-05-08T05:35:07.779525+0000 front 2024-05-08T05:35:07.779646+0000 (oldest deadline 2024-05-08T05:35:33.579761+0000) 2024-05-08T05:36:21.039 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 08 05:36:20 smithi160 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-11[60042]: 2024-05-08T05:36:20.744+0000 7f0620c06700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.90:6804 osd.1 since back 2024-05-08T05:35:19.381805+0000 front 2024-05-08T05:35:19.381693+0000 (oldest deadline 2024-05-08T05:35:45.281608+0000) 2024-05-08T05:36:21.039 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 08 05:36:20 smithi160 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-11[60042]: 2024-05-08T05:36:20.744+0000 7f0620c06700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-05-08T05:35:25.282081+0000 front 2024-05-08T05:35:25.282130+0000 (oldest deadline 2024-05-08T05:35:51.182290+0000) 2024-05-08T05:36:21.039 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 08 05:36:20 smithi160 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-11[60042]: 2024-05-08T05:36:20.744+0000 7f0620c06700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.87:6814 osd.3 since back 2024-05-08T05:35:35.784273+0000 front 2024-05-08T05:35:35.784316+0000 (oldest deadline 2024-05-08T05:36:01.084003+0000) 2024-05-08T05:36:21.039 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 08 05:36:20 smithi160 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-11[60042]: 2024-05-08T05:36:20.744+0000 7f0620c06700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.90:6812 osd.4 since back 2024-05-08T05:35:45.085478+0000 front 2024-05-08T05:35:45.085623+0000 (oldest deadline 2024-05-08T05:36:06.785423+0000) 2024-05-08T05:36:21.039 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 08 05:36:20 smithi160 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-11[60042]: 2024-05-08T05:36:20.744+0000 7f0620c06700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.160:6812 osd.5 since back 2024-05-08T05:35:52.586893+0000 front 2024-05-08T05:35:52.587009+0000 (oldest deadline 2024-05-08T05:36:19.587408+0000) 2024-05-08T05:36:21.135 INFO:journalctl@ceph.osd.10.smithi090.stdout:May 08 05:36:20 smithi090 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-10[59300]: 2024-05-08T05:36:20.767+0000 7f515bdbb700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.87:6806 osd.0 since back 2024-05-08T05:35:09.330796+0000 front 2024-05-08T05:35:09.330921+0000 (oldest deadline 2024-05-08T05:35:34.030784+0000) 2024-05-08T05:36:21.135 INFO:journalctl@ceph.osd.10.smithi090.stdout:May 08 05:36:20 smithi090 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-10[59300]: 2024-05-08T05:36:20.767+0000 7f515bdbb700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.90:6804 osd.1 since back 2024-05-08T05:35:16.331661+0000 front 2024-05-08T05:35:16.331685+0000 (oldest deadline 2024-05-08T05:35:45.732387+0000) 2024-05-08T05:36:21.135 INFO:journalctl@ceph.osd.10.smithi090.stdout:May 08 05:36:20 smithi090 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-10[59300]: 2024-05-08T05:36:20.767+0000 7f515bdbb700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-05-08T05:35:25.732967+0000 front 2024-05-08T05:35:25.732895+0000 (oldest deadline 2024-05-08T05:35:49.733521+0000) 2024-05-08T05:36:21.135 INFO:journalctl@ceph.osd.10.smithi090.stdout:May 08 05:36:20 smithi090 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-10[59300]: 2024-05-08T05:36:20.767+0000 7f515bdbb700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.87:6814 osd.3 since back 2024-05-08T05:35:34.935373+0000 front 2024-05-08T05:35:34.935510+0000 (oldest deadline 2024-05-08T05:35:58.335621+0000) 2024-05-08T05:36:21.135 INFO:journalctl@ceph.osd.10.smithi090.stdout:May 08 05:36:20 smithi090 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-10[59300]: 2024-05-08T05:36:20.767+0000 7f515bdbb700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.90:6812 osd.4 since back 2024-05-08T05:35:43.536890+0000 front 2024-05-08T05:35:43.536927+0000 (oldest deadline 2024-05-08T05:36:05.837136+0000) 2024-05-08T05:36:21.135 INFO:journalctl@ceph.osd.10.smithi090.stdout:May 08 05:36:20 smithi090 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-10[59300]: 2024-05-08T05:36:20.767+0000 7f515bdbb700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.160:6812 osd.5 since back 2024-05-08T05:35:49.239047+0000 front 2024-05-08T05:35:49.238934+0000 (oldest deadline 2024-05-08T05:36:15.138762+0000) 2024-05-08T05:36:21.208 INFO:journalctl@ceph.osd.9.smithi087.stdout:May 08 05:36:20 smithi087 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-9[64574]: 2024-05-08T05:36:20.889+0000 7fb2f9800700 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.87:6806 osd.0 since back 2024-05-08T05:35:08.464101+0000 front 2024-05-08T05:35:08.464047+0000 (oldest deadline 2024-05-08T05:35:31.964171+0000) 2024-05-08T05:36:21.209 INFO:journalctl@ceph.osd.9.smithi087.stdout:May 08 05:36:20 smithi087 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-9[64574]: 2024-05-08T05:36:20.889+0000 7fb2f9800700 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.90:6804 osd.1 since back 2024-05-08T05:35:15.466623+0000 front 2024-05-08T05:35:15.467083+0000 (oldest deadline 2024-05-08T05:35:41.366632+0000) 2024-05-08T05:36:21.209 INFO:journalctl@ceph.osd.9.smithi087.stdout:May 08 05:36:20 smithi087 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-9[64574]: 2024-05-08T05:36:20.889+0000 7fb2f9800700 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-05-08T05:35:24.868777+0000 front 2024-05-08T05:35:24.868646+0000 (oldest deadline 2024-05-08T05:35:48.968629+0000) 2024-05-08T05:36:21.209 INFO:journalctl@ceph.osd.9.smithi087.stdout:May 08 05:36:20 smithi087 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-9[64574]: 2024-05-08T05:36:20.889+0000 7fb2f9800700 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.87:6814 osd.3 since back 2024-05-08T05:35:32.470732+0000 front 2024-05-08T05:35:32.471202+0000 (oldest deadline 2024-05-08T05:36:00.071563+0000) 2024-05-08T05:36:21.209 INFO:journalctl@ceph.osd.9.smithi087.stdout:May 08 05:36:20 smithi087 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-9[64574]: 2024-05-08T05:36:20.889+0000 7fb2f9800700 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.90:6812 osd.4 since back 2024-05-08T05:35:43.573743+0000 front 2024-05-08T05:35:43.574046+0000 (oldest deadline 2024-05-08T05:36:09.473468+0000) 2024-05-08T05:36:21.209 INFO:journalctl@ceph.osd.9.smithi087.stdout:May 08 05:36:20 smithi087 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-9[64574]: 2024-05-08T05:36:20.889+0000 7fb2f9800700 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.160:6812 osd.5 since back 2024-05-08T05:35:49.474324+0000 front 2024-05-08T05:35:49.474399+0000 (oldest deadline 2024-05-08T05:36:14.174227+0000) 2024-05-08T05:36:21.256 DEBUG:teuthology.orchestra.run.smithi160:> sudo pkill -f 'journalctl -f -n 0 -u ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968@osd.8.service' 2024-05-08T05:36:21.334 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-08T05:36:21.335 INFO:tasks.cephadm.osd.8:Stopped osd.8 2024-05-08T05:36:21.335 INFO:tasks.cephadm.osd.9:Stopping osd.9... 2024-05-08T05:36:21.335 DEBUG:teuthology.orchestra.run.smithi087:> sudo systemctl stop ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968@osd.9 2024-05-08T05:36:21.708 INFO:journalctl@ceph.osd.9.smithi087.stdout:May 08 05:36:21 smithi087 systemd[1]: Stopping Ceph osd.9 for eeeb813e-0cf9-11ef-bc97-c7b262605968... 2024-05-08T05:36:21.983 INFO:journalctl@ceph.osd.10.smithi090.stdout:May 08 05:36:21 smithi090 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-10[59300]: 2024-05-08T05:36:21.730+0000 7f515bdbb700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.87:6806 osd.0 since back 2024-05-08T05:35:09.330796+0000 front 2024-05-08T05:35:09.330921+0000 (oldest deadline 2024-05-08T05:35:34.030784+0000) 2024-05-08T05:36:21.983 INFO:journalctl@ceph.osd.10.smithi090.stdout:May 08 05:36:21 smithi090 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-10[59300]: 2024-05-08T05:36:21.730+0000 7f515bdbb700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.90:6804 osd.1 since back 2024-05-08T05:35:16.331661+0000 front 2024-05-08T05:35:16.331685+0000 (oldest deadline 2024-05-08T05:35:45.732387+0000) 2024-05-08T05:36:21.984 INFO:journalctl@ceph.osd.10.smithi090.stdout:May 08 05:36:21 smithi090 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-10[59300]: 2024-05-08T05:36:21.730+0000 7f515bdbb700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-05-08T05:35:25.732967+0000 front 2024-05-08T05:35:25.732895+0000 (oldest deadline 2024-05-08T05:35:49.733521+0000) 2024-05-08T05:36:21.984 INFO:journalctl@ceph.osd.10.smithi090.stdout:May 08 05:36:21 smithi090 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-10[59300]: 2024-05-08T05:36:21.730+0000 7f515bdbb700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.87:6814 osd.3 since back 2024-05-08T05:35:34.935373+0000 front 2024-05-08T05:35:34.935510+0000 (oldest deadline 2024-05-08T05:35:58.335621+0000) 2024-05-08T05:36:21.984 INFO:journalctl@ceph.osd.10.smithi090.stdout:May 08 05:36:21 smithi090 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-10[59300]: 2024-05-08T05:36:21.730+0000 7f515bdbb700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.90:6812 osd.4 since back 2024-05-08T05:35:43.536890+0000 front 2024-05-08T05:35:43.536927+0000 (oldest deadline 2024-05-08T05:36:05.837136+0000) 2024-05-08T05:36:21.984 INFO:journalctl@ceph.osd.10.smithi090.stdout:May 08 05:36:21 smithi090 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-10[59300]: 2024-05-08T05:36:21.730+0000 7f515bdbb700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.160:6812 osd.5 since back 2024-05-08T05:35:49.239047+0000 front 2024-05-08T05:35:49.238934+0000 (oldest deadline 2024-05-08T05:36:15.138762+0000) 2024-05-08T05:36:22.038 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 08 05:36:21 smithi160 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-11[60042]: 2024-05-08T05:36:21.785+0000 7f0620c06700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.87:6806 osd.0 since back 2024-05-08T05:35:07.779525+0000 front 2024-05-08T05:35:07.779646+0000 (oldest deadline 2024-05-08T05:35:33.579761+0000) 2024-05-08T05:36:22.039 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 08 05:36:21 smithi160 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-11[60042]: 2024-05-08T05:36:21.785+0000 7f0620c06700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.90:6804 osd.1 since back 2024-05-08T05:35:19.381805+0000 front 2024-05-08T05:35:19.381693+0000 (oldest deadline 2024-05-08T05:35:45.281608+0000) 2024-05-08T05:36:22.039 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 08 05:36:21 smithi160 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-11[60042]: 2024-05-08T05:36:21.785+0000 7f0620c06700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-05-08T05:35:25.282081+0000 front 2024-05-08T05:35:25.282130+0000 (oldest deadline 2024-05-08T05:35:51.182290+0000) 2024-05-08T05:36:22.039 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 08 05:36:21 smithi160 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-11[60042]: 2024-05-08T05:36:21.785+0000 7f0620c06700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.87:6814 osd.3 since back 2024-05-08T05:35:35.784273+0000 front 2024-05-08T05:35:35.784316+0000 (oldest deadline 2024-05-08T05:36:01.084003+0000) 2024-05-08T05:36:22.039 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 08 05:36:21 smithi160 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-11[60042]: 2024-05-08T05:36:21.785+0000 7f0620c06700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.90:6812 osd.4 since back 2024-05-08T05:35:45.085478+0000 front 2024-05-08T05:35:45.085623+0000 (oldest deadline 2024-05-08T05:36:06.785423+0000) 2024-05-08T05:36:22.039 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 08 05:36:21 smithi160 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-11[60042]: 2024-05-08T05:36:21.785+0000 7f0620c06700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.160:6812 osd.5 since back 2024-05-08T05:35:52.586893+0000 front 2024-05-08T05:35:52.587009+0000 (oldest deadline 2024-05-08T05:36:19.587408+0000) 2024-05-08T05:36:22.209 INFO:journalctl@ceph.osd.9.smithi087.stdout:May 08 05:36:21 smithi087 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-9[64574]: 2024-05-08T05:36:21.858+0000 7fb2f9800700 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.87:6806 osd.0 since back 2024-05-08T05:35:08.464101+0000 front 2024-05-08T05:35:08.464047+0000 (oldest deadline 2024-05-08T05:35:31.964171+0000) 2024-05-08T05:36:22.209 INFO:journalctl@ceph.osd.9.smithi087.stdout:May 08 05:36:21 smithi087 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-9[64574]: 2024-05-08T05:36:21.858+0000 7fb2f9800700 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.90:6804 osd.1 since back 2024-05-08T05:35:15.466623+0000 front 2024-05-08T05:35:15.467083+0000 (oldest deadline 2024-05-08T05:35:41.366632+0000) 2024-05-08T05:36:22.209 INFO:journalctl@ceph.osd.9.smithi087.stdout:May 08 05:36:21 smithi087 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-9[64574]: 2024-05-08T05:36:21.858+0000 7fb2f9800700 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-05-08T05:35:24.868777+0000 front 2024-05-08T05:35:24.868646+0000 (oldest deadline 2024-05-08T05:35:48.968629+0000) 2024-05-08T05:36:22.209 INFO:journalctl@ceph.osd.9.smithi087.stdout:May 08 05:36:21 smithi087 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-9[64574]: 2024-05-08T05:36:21.858+0000 7fb2f9800700 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.87:6814 osd.3 since back 2024-05-08T05:35:32.470732+0000 front 2024-05-08T05:35:32.471202+0000 (oldest deadline 2024-05-08T05:36:00.071563+0000) 2024-05-08T05:36:22.209 INFO:journalctl@ceph.osd.9.smithi087.stdout:May 08 05:36:21 smithi087 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-9[64574]: 2024-05-08T05:36:21.858+0000 7fb2f9800700 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.90:6812 osd.4 since back 2024-05-08T05:35:43.573743+0000 front 2024-05-08T05:35:43.574046+0000 (oldest deadline 2024-05-08T05:36:09.473468+0000) 2024-05-08T05:36:22.209 INFO:journalctl@ceph.osd.9.smithi087.stdout:May 08 05:36:21 smithi087 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-9[64574]: 2024-05-08T05:36:21.858+0000 7fb2f9800700 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.160:6812 osd.5 since back 2024-05-08T05:35:49.474324+0000 front 2024-05-08T05:35:49.474399+0000 (oldest deadline 2024-05-08T05:36:14.174227+0000) 2024-05-08T05:36:22.209 INFO:journalctl@ceph.osd.9.smithi087.stdout:May 08 05:36:21 smithi087 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-9[64574]: 2024-05-08T05:36:21.903+0000 7fb303000700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.9 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-05-08T05:36:22.209 INFO:journalctl@ceph.osd.9.smithi087.stdout:May 08 05:36:21 smithi087 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-9[64574]: 2024-05-08T05:36:21.903+0000 7fb303000700 -1 osd.9 85 *** Got signal Terminated *** 2024-05-08T05:36:22.209 INFO:journalctl@ceph.osd.9.smithi087.stdout:May 08 05:36:21 smithi087 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-9[64574]: 2024-05-08T05:36:21.903+0000 7fb303000700 -1 osd.9 85 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-05-08T05:36:22.983 INFO:journalctl@ceph.osd.10.smithi090.stdout:May 08 05:36:22 smithi090 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-10[59300]: 2024-05-08T05:36:22.696+0000 7f515bdbb700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.87:6806 osd.0 since back 2024-05-08T05:35:09.330796+0000 front 2024-05-08T05:35:09.330921+0000 (oldest deadline 2024-05-08T05:35:34.030784+0000) 2024-05-08T05:36:22.983 INFO:journalctl@ceph.osd.10.smithi090.stdout:May 08 05:36:22 smithi090 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-10[59300]: 2024-05-08T05:36:22.696+0000 7f515bdbb700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.90:6804 osd.1 since back 2024-05-08T05:35:16.331661+0000 front 2024-05-08T05:35:16.331685+0000 (oldest deadline 2024-05-08T05:35:45.732387+0000) 2024-05-08T05:36:22.984 INFO:journalctl@ceph.osd.10.smithi090.stdout:May 08 05:36:22 smithi090 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-10[59300]: 2024-05-08T05:36:22.696+0000 7f515bdbb700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-05-08T05:35:25.732967+0000 front 2024-05-08T05:35:25.732895+0000 (oldest deadline 2024-05-08T05:35:49.733521+0000) 2024-05-08T05:36:22.984 INFO:journalctl@ceph.osd.10.smithi090.stdout:May 08 05:36:22 smithi090 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-10[59300]: 2024-05-08T05:36:22.696+0000 7f515bdbb700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.87:6814 osd.3 since back 2024-05-08T05:35:34.935373+0000 front 2024-05-08T05:35:34.935510+0000 (oldest deadline 2024-05-08T05:35:58.335621+0000) 2024-05-08T05:36:22.984 INFO:journalctl@ceph.osd.10.smithi090.stdout:May 08 05:36:22 smithi090 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-10[59300]: 2024-05-08T05:36:22.696+0000 7f515bdbb700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.90:6812 osd.4 since back 2024-05-08T05:35:43.536890+0000 front 2024-05-08T05:35:43.536927+0000 (oldest deadline 2024-05-08T05:36:05.837136+0000) 2024-05-08T05:36:22.984 INFO:journalctl@ceph.osd.10.smithi090.stdout:May 08 05:36:22 smithi090 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-10[59300]: 2024-05-08T05:36:22.696+0000 7f515bdbb700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.160:6812 osd.5 since back 2024-05-08T05:35:49.239047+0000 front 2024-05-08T05:35:49.238934+0000 (oldest deadline 2024-05-08T05:36:15.138762+0000) 2024-05-08T05:36:23.208 INFO:journalctl@ceph.osd.9.smithi087.stdout:May 08 05:36:22 smithi087 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-9[64574]: 2024-05-08T05:36:22.896+0000 7fb2f9800700 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.87:6806 osd.0 since back 2024-05-08T05:35:08.464101+0000 front 2024-05-08T05:35:08.464047+0000 (oldest deadline 2024-05-08T05:35:31.964171+0000) 2024-05-08T05:36:23.209 INFO:journalctl@ceph.osd.9.smithi087.stdout:May 08 05:36:22 smithi087 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-9[64574]: 2024-05-08T05:36:22.896+0000 7fb2f9800700 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.90:6804 osd.1 since back 2024-05-08T05:35:15.466623+0000 front 2024-05-08T05:35:15.467083+0000 (oldest deadline 2024-05-08T05:35:41.366632+0000) 2024-05-08T05:36:23.209 INFO:journalctl@ceph.osd.9.smithi087.stdout:May 08 05:36:22 smithi087 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-9[64574]: 2024-05-08T05:36:22.896+0000 7fb2f9800700 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-05-08T05:35:24.868777+0000 front 2024-05-08T05:35:24.868646+0000 (oldest deadline 2024-05-08T05:35:48.968629+0000) 2024-05-08T05:36:23.209 INFO:journalctl@ceph.osd.9.smithi087.stdout:May 08 05:36:22 smithi087 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-9[64574]: 2024-05-08T05:36:22.896+0000 7fb2f9800700 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.87:6814 osd.3 since back 2024-05-08T05:35:32.470732+0000 front 2024-05-08T05:35:32.471202+0000 (oldest deadline 2024-05-08T05:36:00.071563+0000) 2024-05-08T05:36:23.209 INFO:journalctl@ceph.osd.9.smithi087.stdout:May 08 05:36:22 smithi087 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-9[64574]: 2024-05-08T05:36:22.896+0000 7fb2f9800700 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.90:6812 osd.4 since back 2024-05-08T05:35:43.573743+0000 front 2024-05-08T05:35:43.574046+0000 (oldest deadline 2024-05-08T05:36:09.473468+0000) 2024-05-08T05:36:23.209 INFO:journalctl@ceph.osd.9.smithi087.stdout:May 08 05:36:22 smithi087 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-9[64574]: 2024-05-08T05:36:22.896+0000 7fb2f9800700 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.160:6812 osd.5 since back 2024-05-08T05:35:49.474324+0000 front 2024-05-08T05:35:49.474399+0000 (oldest deadline 2024-05-08T05:36:14.174227+0000) 2024-05-08T05:36:23.289 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 08 05:36:22 smithi160 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-11[60042]: 2024-05-08T05:36:22.808+0000 7f0620c06700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.87:6806 osd.0 since back 2024-05-08T05:35:07.779525+0000 front 2024-05-08T05:35:07.779646+0000 (oldest deadline 2024-05-08T05:35:33.579761+0000) 2024-05-08T05:36:23.289 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 08 05:36:22 smithi160 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-11[60042]: 2024-05-08T05:36:22.808+0000 7f0620c06700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.90:6804 osd.1 since back 2024-05-08T05:35:19.381805+0000 front 2024-05-08T05:35:19.381693+0000 (oldest deadline 2024-05-08T05:35:45.281608+0000) 2024-05-08T05:36:23.289 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 08 05:36:22 smithi160 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-11[60042]: 2024-05-08T05:36:22.808+0000 7f0620c06700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-05-08T05:35:25.282081+0000 front 2024-05-08T05:35:25.282130+0000 (oldest deadline 2024-05-08T05:35:51.182290+0000) 2024-05-08T05:36:23.289 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 08 05:36:22 smithi160 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-11[60042]: 2024-05-08T05:36:22.808+0000 7f0620c06700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.87:6814 osd.3 since back 2024-05-08T05:35:35.784273+0000 front 2024-05-08T05:35:35.784316+0000 (oldest deadline 2024-05-08T05:36:01.084003+0000) 2024-05-08T05:36:23.289 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 08 05:36:22 smithi160 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-11[60042]: 2024-05-08T05:36:22.808+0000 7f0620c06700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.90:6812 osd.4 since back 2024-05-08T05:35:45.085478+0000 front 2024-05-08T05:35:45.085623+0000 (oldest deadline 2024-05-08T05:36:06.785423+0000) 2024-05-08T05:36:23.289 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 08 05:36:22 smithi160 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-11[60042]: 2024-05-08T05:36:22.808+0000 7f0620c06700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.160:6812 osd.5 since back 2024-05-08T05:35:52.586893+0000 front 2024-05-08T05:35:52.587009+0000 (oldest deadline 2024-05-08T05:36:19.587408+0000) 2024-05-08T05:36:23.984 INFO:journalctl@ceph.osd.10.smithi090.stdout:May 08 05:36:23 smithi090 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-10[59300]: 2024-05-08T05:36:23.706+0000 7f515bdbb700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.87:6806 osd.0 since back 2024-05-08T05:35:09.330796+0000 front 2024-05-08T05:35:09.330921+0000 (oldest deadline 2024-05-08T05:35:34.030784+0000) 2024-05-08T05:36:23.984 INFO:journalctl@ceph.osd.10.smithi090.stdout:May 08 05:36:23 smithi090 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-10[59300]: 2024-05-08T05:36:23.706+0000 7f515bdbb700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.90:6804 osd.1 since back 2024-05-08T05:35:16.331661+0000 front 2024-05-08T05:35:16.331685+0000 (oldest deadline 2024-05-08T05:35:45.732387+0000) 2024-05-08T05:36:23.984 INFO:journalctl@ceph.osd.10.smithi090.stdout:May 08 05:36:23 smithi090 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-10[59300]: 2024-05-08T05:36:23.706+0000 7f515bdbb700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-05-08T05:35:25.732967+0000 front 2024-05-08T05:35:25.732895+0000 (oldest deadline 2024-05-08T05:35:49.733521+0000) 2024-05-08T05:36:23.984 INFO:journalctl@ceph.osd.10.smithi090.stdout:May 08 05:36:23 smithi090 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-10[59300]: 2024-05-08T05:36:23.706+0000 7f515bdbb700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.87:6814 osd.3 since back 2024-05-08T05:35:34.935373+0000 front 2024-05-08T05:35:34.935510+0000 (oldest deadline 2024-05-08T05:35:58.335621+0000) 2024-05-08T05:36:23.984 INFO:journalctl@ceph.osd.10.smithi090.stdout:May 08 05:36:23 smithi090 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-10[59300]: 2024-05-08T05:36:23.706+0000 7f515bdbb700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.90:6812 osd.4 since back 2024-05-08T05:35:43.536890+0000 front 2024-05-08T05:35:43.536927+0000 (oldest deadline 2024-05-08T05:36:05.837136+0000) 2024-05-08T05:36:23.984 INFO:journalctl@ceph.osd.10.smithi090.stdout:May 08 05:36:23 smithi090 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-10[59300]: 2024-05-08T05:36:23.706+0000 7f515bdbb700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.160:6812 osd.5 since back 2024-05-08T05:35:49.239047+0000 front 2024-05-08T05:35:49.238934+0000 (oldest deadline 2024-05-08T05:36:15.138762+0000) 2024-05-08T05:36:23.984 INFO:journalctl@ceph.osd.10.smithi090.stdout:May 08 05:36:23 smithi090 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-10[59300]: 2024-05-08T05:36:23.706+0000 7f515bdbb700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.87:6822 osd.6 since back 2024-05-08T05:35:59.239824+0000 front 2024-05-08T05:35:59.239934+0000 (oldest deadline 2024-05-08T05:36:22.739584+0000) 2024-05-08T05:36:24.208 INFO:journalctl@ceph.osd.9.smithi087.stdout:May 08 05:36:23 smithi087 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-9[64574]: 2024-05-08T05:36:23.854+0000 7fb2f9800700 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.87:6806 osd.0 since back 2024-05-08T05:35:08.464101+0000 front 2024-05-08T05:35:08.464047+0000 (oldest deadline 2024-05-08T05:35:31.964171+0000) 2024-05-08T05:36:24.209 INFO:journalctl@ceph.osd.9.smithi087.stdout:May 08 05:36:23 smithi087 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-9[64574]: 2024-05-08T05:36:23.854+0000 7fb2f9800700 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.90:6804 osd.1 since back 2024-05-08T05:35:15.466623+0000 front 2024-05-08T05:35:15.467083+0000 (oldest deadline 2024-05-08T05:35:41.366632+0000) 2024-05-08T05:36:24.209 INFO:journalctl@ceph.osd.9.smithi087.stdout:May 08 05:36:23 smithi087 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-9[64574]: 2024-05-08T05:36:23.854+0000 7fb2f9800700 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-05-08T05:35:24.868777+0000 front 2024-05-08T05:35:24.868646+0000 (oldest deadline 2024-05-08T05:35:48.968629+0000) 2024-05-08T05:36:24.209 INFO:journalctl@ceph.osd.9.smithi087.stdout:May 08 05:36:23 smithi087 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-9[64574]: 2024-05-08T05:36:23.854+0000 7fb2f9800700 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.87:6814 osd.3 since back 2024-05-08T05:35:32.470732+0000 front 2024-05-08T05:35:32.471202+0000 (oldest deadline 2024-05-08T05:36:00.071563+0000) 2024-05-08T05:36:24.209 INFO:journalctl@ceph.osd.9.smithi087.stdout:May 08 05:36:23 smithi087 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-9[64574]: 2024-05-08T05:36:23.854+0000 7fb2f9800700 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.90:6812 osd.4 since back 2024-05-08T05:35:43.573743+0000 front 2024-05-08T05:35:43.574046+0000 (oldest deadline 2024-05-08T05:36:09.473468+0000) 2024-05-08T05:36:24.209 INFO:journalctl@ceph.osd.9.smithi087.stdout:May 08 05:36:23 smithi087 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-9[64574]: 2024-05-08T05:36:23.854+0000 7fb2f9800700 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.160:6812 osd.5 since back 2024-05-08T05:35:49.474324+0000 front 2024-05-08T05:35:49.474399+0000 (oldest deadline 2024-05-08T05:36:14.174227+0000) 2024-05-08T05:36:24.288 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 08 05:36:23 smithi160 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-11[60042]: 2024-05-08T05:36:23.822+0000 7f0620c06700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.87:6806 osd.0 since back 2024-05-08T05:35:07.779525+0000 front 2024-05-08T05:35:07.779646+0000 (oldest deadline 2024-05-08T05:35:33.579761+0000) 2024-05-08T05:36:24.288 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 08 05:36:23 smithi160 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-11[60042]: 2024-05-08T05:36:23.822+0000 7f0620c06700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.90:6804 osd.1 since back 2024-05-08T05:35:19.381805+0000 front 2024-05-08T05:35:19.381693+0000 (oldest deadline 2024-05-08T05:35:45.281608+0000) 2024-05-08T05:36:24.288 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 08 05:36:23 smithi160 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-11[60042]: 2024-05-08T05:36:23.822+0000 7f0620c06700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-05-08T05:35:25.282081+0000 front 2024-05-08T05:35:25.282130+0000 (oldest deadline 2024-05-08T05:35:51.182290+0000) 2024-05-08T05:36:24.289 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 08 05:36:23 smithi160 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-11[60042]: 2024-05-08T05:36:23.822+0000 7f0620c06700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.87:6814 osd.3 since back 2024-05-08T05:35:35.784273+0000 front 2024-05-08T05:35:35.784316+0000 (oldest deadline 2024-05-08T05:36:01.084003+0000) 2024-05-08T05:36:24.289 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 08 05:36:23 smithi160 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-11[60042]: 2024-05-08T05:36:23.822+0000 7f0620c06700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.90:6812 osd.4 since back 2024-05-08T05:35:45.085478+0000 front 2024-05-08T05:35:45.085623+0000 (oldest deadline 2024-05-08T05:36:06.785423+0000) 2024-05-08T05:36:24.289 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 08 05:36:23 smithi160 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-11[60042]: 2024-05-08T05:36:23.822+0000 7f0620c06700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.160:6812 osd.5 since back 2024-05-08T05:35:52.586893+0000 front 2024-05-08T05:35:52.587009+0000 (oldest deadline 2024-05-08T05:36:19.587408+0000) 2024-05-08T05:36:25.039 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 08 05:36:24 smithi160 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-11[60042]: 2024-05-08T05:36:24.784+0000 7f0620c06700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.87:6806 osd.0 since back 2024-05-08T05:35:07.779525+0000 front 2024-05-08T05:35:07.779646+0000 (oldest deadline 2024-05-08T05:35:33.579761+0000) 2024-05-08T05:36:25.039 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 08 05:36:24 smithi160 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-11[60042]: 2024-05-08T05:36:24.784+0000 7f0620c06700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.90:6804 osd.1 since back 2024-05-08T05:35:19.381805+0000 front 2024-05-08T05:35:19.381693+0000 (oldest deadline 2024-05-08T05:35:45.281608+0000) 2024-05-08T05:36:25.039 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 08 05:36:24 smithi160 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-11[60042]: 2024-05-08T05:36:24.784+0000 7f0620c06700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-05-08T05:35:25.282081+0000 front 2024-05-08T05:35:25.282130+0000 (oldest deadline 2024-05-08T05:35:51.182290+0000) 2024-05-08T05:36:25.039 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 08 05:36:24 smithi160 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-11[60042]: 2024-05-08T05:36:24.784+0000 7f0620c06700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.87:6814 osd.3 since back 2024-05-08T05:35:35.784273+0000 front 2024-05-08T05:35:35.784316+0000 (oldest deadline 2024-05-08T05:36:01.084003+0000) 2024-05-08T05:36:25.039 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 08 05:36:24 smithi160 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-11[60042]: 2024-05-08T05:36:24.784+0000 7f0620c06700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.90:6812 osd.4 since back 2024-05-08T05:35:45.085478+0000 front 2024-05-08T05:35:45.085623+0000 (oldest deadline 2024-05-08T05:36:06.785423+0000) 2024-05-08T05:36:25.039 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 08 05:36:24 smithi160 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-11[60042]: 2024-05-08T05:36:24.784+0000 7f0620c06700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.160:6812 osd.5 since back 2024-05-08T05:35:52.586893+0000 front 2024-05-08T05:35:52.587009+0000 (oldest deadline 2024-05-08T05:36:19.587408+0000) 2024-05-08T05:36:25.208 INFO:journalctl@ceph.osd.9.smithi087.stdout:May 08 05:36:24 smithi087 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-9[64574]: 2024-05-08T05:36:24.883+0000 7fb2f9800700 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.87:6806 osd.0 since back 2024-05-08T05:35:08.464101+0000 front 2024-05-08T05:35:08.464047+0000 (oldest deadline 2024-05-08T05:35:31.964171+0000) 2024-05-08T05:36:25.209 INFO:journalctl@ceph.osd.9.smithi087.stdout:May 08 05:36:24 smithi087 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-9[64574]: 2024-05-08T05:36:24.883+0000 7fb2f9800700 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.90:6804 osd.1 since back 2024-05-08T05:35:15.466623+0000 front 2024-05-08T05:35:15.467083+0000 (oldest deadline 2024-05-08T05:35:41.366632+0000) 2024-05-08T05:36:25.209 INFO:journalctl@ceph.osd.9.smithi087.stdout:May 08 05:36:24 smithi087 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-9[64574]: 2024-05-08T05:36:24.883+0000 7fb2f9800700 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-05-08T05:35:24.868777+0000 front 2024-05-08T05:35:24.868646+0000 (oldest deadline 2024-05-08T05:35:48.968629+0000) 2024-05-08T05:36:25.209 INFO:journalctl@ceph.osd.9.smithi087.stdout:May 08 05:36:24 smithi087 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-9[64574]: 2024-05-08T05:36:24.883+0000 7fb2f9800700 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.87:6814 osd.3 since back 2024-05-08T05:35:32.470732+0000 front 2024-05-08T05:35:32.471202+0000 (oldest deadline 2024-05-08T05:36:00.071563+0000) 2024-05-08T05:36:25.209 INFO:journalctl@ceph.osd.9.smithi087.stdout:May 08 05:36:24 smithi087 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-9[64574]: 2024-05-08T05:36:24.883+0000 7fb2f9800700 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.90:6812 osd.4 since back 2024-05-08T05:35:43.573743+0000 front 2024-05-08T05:35:43.574046+0000 (oldest deadline 2024-05-08T05:36:09.473468+0000) 2024-05-08T05:36:25.209 INFO:journalctl@ceph.osd.9.smithi087.stdout:May 08 05:36:24 smithi087 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-9[64574]: 2024-05-08T05:36:24.883+0000 7fb2f9800700 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.160:6812 osd.5 since back 2024-05-08T05:35:49.474324+0000 front 2024-05-08T05:35:49.474399+0000 (oldest deadline 2024-05-08T05:36:14.174227+0000) 2024-05-08T05:36:25.233 INFO:journalctl@ceph.osd.10.smithi090.stdout:May 08 05:36:24 smithi090 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-10[59300]: 2024-05-08T05:36:24.752+0000 7f515bdbb700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.87:6806 osd.0 since back 2024-05-08T05:35:09.330796+0000 front 2024-05-08T05:35:09.330921+0000 (oldest deadline 2024-05-08T05:35:34.030784+0000) 2024-05-08T05:36:25.233 INFO:journalctl@ceph.osd.10.smithi090.stdout:May 08 05:36:24 smithi090 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-10[59300]: 2024-05-08T05:36:24.752+0000 7f515bdbb700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.90:6804 osd.1 since back 2024-05-08T05:35:16.331661+0000 front 2024-05-08T05:35:16.331685+0000 (oldest deadline 2024-05-08T05:35:45.732387+0000) 2024-05-08T05:36:25.233 INFO:journalctl@ceph.osd.10.smithi090.stdout:May 08 05:36:24 smithi090 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-10[59300]: 2024-05-08T05:36:24.752+0000 7f515bdbb700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-05-08T05:35:25.732967+0000 front 2024-05-08T05:35:25.732895+0000 (oldest deadline 2024-05-08T05:35:49.733521+0000) 2024-05-08T05:36:25.233 INFO:journalctl@ceph.osd.10.smithi090.stdout:May 08 05:36:24 smithi090 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-10[59300]: 2024-05-08T05:36:24.752+0000 7f515bdbb700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.87:6814 osd.3 since back 2024-05-08T05:35:34.935373+0000 front 2024-05-08T05:35:34.935510+0000 (oldest deadline 2024-05-08T05:35:58.335621+0000) 2024-05-08T05:36:25.234 INFO:journalctl@ceph.osd.10.smithi090.stdout:May 08 05:36:24 smithi090 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-10[59300]: 2024-05-08T05:36:24.752+0000 7f515bdbb700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.90:6812 osd.4 since back 2024-05-08T05:35:43.536890+0000 front 2024-05-08T05:35:43.536927+0000 (oldest deadline 2024-05-08T05:36:05.837136+0000) 2024-05-08T05:36:25.234 INFO:journalctl@ceph.osd.10.smithi090.stdout:May 08 05:36:24 smithi090 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-10[59300]: 2024-05-08T05:36:24.752+0000 7f515bdbb700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.160:6812 osd.5 since back 2024-05-08T05:35:49.239047+0000 front 2024-05-08T05:35:49.238934+0000 (oldest deadline 2024-05-08T05:36:15.138762+0000) 2024-05-08T05:36:25.234 INFO:journalctl@ceph.osd.10.smithi090.stdout:May 08 05:36:24 smithi090 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-10[59300]: 2024-05-08T05:36:24.752+0000 7f515bdbb700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.87:6822 osd.6 since back 2024-05-08T05:35:59.239824+0000 front 2024-05-08T05:35:59.239934+0000 (oldest deadline 2024-05-08T05:36:22.739584+0000) 2024-05-08T05:36:26.038 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 08 05:36:25 smithi160 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-11[60042]: 2024-05-08T05:36:25.741+0000 7f0620c06700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.87:6806 osd.0 since back 2024-05-08T05:35:07.779525+0000 front 2024-05-08T05:35:07.779646+0000 (oldest deadline 2024-05-08T05:35:33.579761+0000) 2024-05-08T05:36:26.039 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 08 05:36:25 smithi160 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-11[60042]: 2024-05-08T05:36:25.741+0000 7f0620c06700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.90:6804 osd.1 since back 2024-05-08T05:35:19.381805+0000 front 2024-05-08T05:35:19.381693+0000 (oldest deadline 2024-05-08T05:35:45.281608+0000) 2024-05-08T05:36:26.039 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 08 05:36:25 smithi160 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-11[60042]: 2024-05-08T05:36:25.741+0000 7f0620c06700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-05-08T05:35:25.282081+0000 front 2024-05-08T05:35:25.282130+0000 (oldest deadline 2024-05-08T05:35:51.182290+0000) 2024-05-08T05:36:26.039 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 08 05:36:25 smithi160 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-11[60042]: 2024-05-08T05:36:25.741+0000 7f0620c06700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.87:6814 osd.3 since back 2024-05-08T05:35:35.784273+0000 front 2024-05-08T05:35:35.784316+0000 (oldest deadline 2024-05-08T05:36:01.084003+0000) 2024-05-08T05:36:26.039 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 08 05:36:25 smithi160 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-11[60042]: 2024-05-08T05:36:25.741+0000 7f0620c06700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.90:6812 osd.4 since back 2024-05-08T05:35:45.085478+0000 front 2024-05-08T05:35:45.085623+0000 (oldest deadline 2024-05-08T05:36:06.785423+0000) 2024-05-08T05:36:26.039 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 08 05:36:25 smithi160 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-11[60042]: 2024-05-08T05:36:25.741+0000 7f0620c06700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.160:6812 osd.5 since back 2024-05-08T05:35:52.586893+0000 front 2024-05-08T05:35:52.587009+0000 (oldest deadline 2024-05-08T05:36:19.587408+0000) 2024-05-08T05:36:26.209 INFO:journalctl@ceph.osd.9.smithi087.stdout:May 08 05:36:25 smithi087 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-9[64574]: 2024-05-08T05:36:25.906+0000 7fb2f9800700 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.87:6806 osd.0 since back 2024-05-08T05:35:08.464101+0000 front 2024-05-08T05:35:08.464047+0000 (oldest deadline 2024-05-08T05:35:31.964171+0000) 2024-05-08T05:36:26.209 INFO:journalctl@ceph.osd.9.smithi087.stdout:May 08 05:36:25 smithi087 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-9[64574]: 2024-05-08T05:36:25.906+0000 7fb2f9800700 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.90:6804 osd.1 since back 2024-05-08T05:35:15.466623+0000 front 2024-05-08T05:35:15.467083+0000 (oldest deadline 2024-05-08T05:35:41.366632+0000) 2024-05-08T05:36:26.209 INFO:journalctl@ceph.osd.9.smithi087.stdout:May 08 05:36:25 smithi087 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-9[64574]: 2024-05-08T05:36:25.906+0000 7fb2f9800700 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-05-08T05:35:24.868777+0000 front 2024-05-08T05:35:24.868646+0000 (oldest deadline 2024-05-08T05:35:48.968629+0000) 2024-05-08T05:36:26.209 INFO:journalctl@ceph.osd.9.smithi087.stdout:May 08 05:36:25 smithi087 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-9[64574]: 2024-05-08T05:36:25.906+0000 7fb2f9800700 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.87:6814 osd.3 since back 2024-05-08T05:35:32.470732+0000 front 2024-05-08T05:35:32.471202+0000 (oldest deadline 2024-05-08T05:36:00.071563+0000) 2024-05-08T05:36:26.209 INFO:journalctl@ceph.osd.9.smithi087.stdout:May 08 05:36:25 smithi087 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-9[64574]: 2024-05-08T05:36:25.906+0000 7fb2f9800700 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.90:6812 osd.4 since back 2024-05-08T05:35:43.573743+0000 front 2024-05-08T05:35:43.574046+0000 (oldest deadline 2024-05-08T05:36:09.473468+0000) 2024-05-08T05:36:26.209 INFO:journalctl@ceph.osd.9.smithi087.stdout:May 08 05:36:25 smithi087 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-9[64574]: 2024-05-08T05:36:25.906+0000 7fb2f9800700 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.160:6812 osd.5 since back 2024-05-08T05:35:49.474324+0000 front 2024-05-08T05:35:49.474399+0000 (oldest deadline 2024-05-08T05:36:14.174227+0000) 2024-05-08T05:36:26.209 INFO:journalctl@ceph.osd.9.smithi087.stdout:May 08 05:36:25 smithi087 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-9[64574]: 2024-05-08T05:36:25.906+0000 7fb2f9800700 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.87:6822 osd.6 since back 2024-05-08T05:36:01.077232+0000 front 2024-05-08T05:36:01.077434+0000 (oldest deadline 2024-05-08T05:36:25.777245+0000) 2024-05-08T05:36:26.233 INFO:journalctl@ceph.osd.10.smithi090.stdout:May 08 05:36:25 smithi090 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-10[59300]: 2024-05-08T05:36:25.760+0000 7f515bdbb700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.87:6806 osd.0 since back 2024-05-08T05:35:09.330796+0000 front 2024-05-08T05:35:09.330921+0000 (oldest deadline 2024-05-08T05:35:34.030784+0000) 2024-05-08T05:36:26.234 INFO:journalctl@ceph.osd.10.smithi090.stdout:May 08 05:36:25 smithi090 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-10[59300]: 2024-05-08T05:36:25.760+0000 7f515bdbb700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.90:6804 osd.1 since back 2024-05-08T05:35:16.331661+0000 front 2024-05-08T05:35:16.331685+0000 (oldest deadline 2024-05-08T05:35:45.732387+0000) 2024-05-08T05:36:26.234 INFO:journalctl@ceph.osd.10.smithi090.stdout:May 08 05:36:25 smithi090 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-10[59300]: 2024-05-08T05:36:25.760+0000 7f515bdbb700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-05-08T05:35:25.732967+0000 front 2024-05-08T05:35:25.732895+0000 (oldest deadline 2024-05-08T05:35:49.733521+0000) 2024-05-08T05:36:26.234 INFO:journalctl@ceph.osd.10.smithi090.stdout:May 08 05:36:25 smithi090 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-10[59300]: 2024-05-08T05:36:25.760+0000 7f515bdbb700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.87:6814 osd.3 since back 2024-05-08T05:35:34.935373+0000 front 2024-05-08T05:35:34.935510+0000 (oldest deadline 2024-05-08T05:35:58.335621+0000) 2024-05-08T05:36:26.234 INFO:journalctl@ceph.osd.10.smithi090.stdout:May 08 05:36:25 smithi090 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-10[59300]: 2024-05-08T05:36:25.760+0000 7f515bdbb700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.90:6812 osd.4 since back 2024-05-08T05:35:43.536890+0000 front 2024-05-08T05:35:43.536927+0000 (oldest deadline 2024-05-08T05:36:05.837136+0000) 2024-05-08T05:36:26.234 INFO:journalctl@ceph.osd.10.smithi090.stdout:May 08 05:36:25 smithi090 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-10[59300]: 2024-05-08T05:36:25.760+0000 7f515bdbb700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.160:6812 osd.5 since back 2024-05-08T05:35:49.239047+0000 front 2024-05-08T05:35:49.238934+0000 (oldest deadline 2024-05-08T05:36:15.138762+0000) 2024-05-08T05:36:26.234 INFO:journalctl@ceph.osd.10.smithi090.stdout:May 08 05:36:25 smithi090 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-10[59300]: 2024-05-08T05:36:25.760+0000 7f515bdbb700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.87:6822 osd.6 since back 2024-05-08T05:35:59.239824+0000 front 2024-05-08T05:35:59.239934+0000 (oldest deadline 2024-05-08T05:36:22.739584+0000) 2024-05-08T05:36:27.038 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 08 05:36:26 smithi160 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-11[60042]: 2024-05-08T05:36:26.740+0000 7f0620c06700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.87:6806 osd.0 since back 2024-05-08T05:35:07.779525+0000 front 2024-05-08T05:35:07.779646+0000 (oldest deadline 2024-05-08T05:35:33.579761+0000) 2024-05-08T05:36:27.039 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 08 05:36:26 smithi160 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-11[60042]: 2024-05-08T05:36:26.740+0000 7f0620c06700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.90:6804 osd.1 since back 2024-05-08T05:35:19.381805+0000 front 2024-05-08T05:35:19.381693+0000 (oldest deadline 2024-05-08T05:35:45.281608+0000) 2024-05-08T05:36:27.039 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 08 05:36:26 smithi160 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-11[60042]: 2024-05-08T05:36:26.740+0000 7f0620c06700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-05-08T05:35:25.282081+0000 front 2024-05-08T05:35:25.282130+0000 (oldest deadline 2024-05-08T05:35:51.182290+0000) 2024-05-08T05:36:27.039 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 08 05:36:26 smithi160 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-11[60042]: 2024-05-08T05:36:26.740+0000 7f0620c06700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.87:6814 osd.3 since back 2024-05-08T05:35:35.784273+0000 front 2024-05-08T05:35:35.784316+0000 (oldest deadline 2024-05-08T05:36:01.084003+0000) 2024-05-08T05:36:27.039 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 08 05:36:26 smithi160 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-11[60042]: 2024-05-08T05:36:26.740+0000 7f0620c06700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.90:6812 osd.4 since back 2024-05-08T05:35:45.085478+0000 front 2024-05-08T05:35:45.085623+0000 (oldest deadline 2024-05-08T05:36:06.785423+0000) 2024-05-08T05:36:27.039 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 08 05:36:26 smithi160 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-11[60042]: 2024-05-08T05:36:26.740+0000 7f0620c06700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.160:6812 osd.5 since back 2024-05-08T05:35:52.586893+0000 front 2024-05-08T05:35:52.587009+0000 (oldest deadline 2024-05-08T05:36:19.587408+0000) 2024-05-08T05:36:27.233 INFO:journalctl@ceph.osd.10.smithi090.stdout:May 08 05:36:26 smithi090 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-10[59300]: 2024-05-08T05:36:26.739+0000 7f515bdbb700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.87:6806 osd.0 since back 2024-05-08T05:35:09.330796+0000 front 2024-05-08T05:35:09.330921+0000 (oldest deadline 2024-05-08T05:35:34.030784+0000) 2024-05-08T05:36:27.234 INFO:journalctl@ceph.osd.10.smithi090.stdout:May 08 05:36:26 smithi090 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-10[59300]: 2024-05-08T05:36:26.739+0000 7f515bdbb700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.90:6804 osd.1 since back 2024-05-08T05:35:16.331661+0000 front 2024-05-08T05:35:16.331685+0000 (oldest deadline 2024-05-08T05:35:45.732387+0000) 2024-05-08T05:36:27.234 INFO:journalctl@ceph.osd.10.smithi090.stdout:May 08 05:36:26 smithi090 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-10[59300]: 2024-05-08T05:36:26.739+0000 7f515bdbb700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-05-08T05:35:25.732967+0000 front 2024-05-08T05:35:25.732895+0000 (oldest deadline 2024-05-08T05:35:49.733521+0000) 2024-05-08T05:36:27.234 INFO:journalctl@ceph.osd.10.smithi090.stdout:May 08 05:36:26 smithi090 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-10[59300]: 2024-05-08T05:36:26.739+0000 7f515bdbb700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.87:6814 osd.3 since back 2024-05-08T05:35:34.935373+0000 front 2024-05-08T05:35:34.935510+0000 (oldest deadline 2024-05-08T05:35:58.335621+0000) 2024-05-08T05:36:27.234 INFO:journalctl@ceph.osd.10.smithi090.stdout:May 08 05:36:26 smithi090 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-10[59300]: 2024-05-08T05:36:26.739+0000 7f515bdbb700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.90:6812 osd.4 since back 2024-05-08T05:35:43.536890+0000 front 2024-05-08T05:35:43.536927+0000 (oldest deadline 2024-05-08T05:36:05.837136+0000) 2024-05-08T05:36:27.234 INFO:journalctl@ceph.osd.10.smithi090.stdout:May 08 05:36:26 smithi090 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-10[59300]: 2024-05-08T05:36:26.739+0000 7f515bdbb700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.160:6812 osd.5 since back 2024-05-08T05:35:49.239047+0000 front 2024-05-08T05:35:49.238934+0000 (oldest deadline 2024-05-08T05:36:15.138762+0000) 2024-05-08T05:36:27.234 INFO:journalctl@ceph.osd.10.smithi090.stdout:May 08 05:36:26 smithi090 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-10[59300]: 2024-05-08T05:36:26.739+0000 7f515bdbb700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.87:6822 osd.6 since back 2024-05-08T05:35:59.239824+0000 front 2024-05-08T05:35:59.239934+0000 (oldest deadline 2024-05-08T05:36:22.739584+0000) 2024-05-08T05:36:27.635 INFO:journalctl@ceph.osd.9.smithi087.stdout:May 08 05:36:27 smithi087 podman[97578]: 2024-05-08 05:36:27.376508409 +0000 UTC m=+5.625575804 container died 8d848a9644a91b683516a34496cf33007674a1fd279ec15d27970ff124daf2b0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c, name=ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-9, RELEASE=wip-57676-3-bee299f, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240507, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, GIT_CLEAN=True, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-05-08T05:36:27.888 INFO:journalctl@ceph.osd.9.smithi087.stdout:May 08 05:36:27 smithi087 podman[97578]: 2024-05-08 05:36:27.854967085 +0000 UTC m=+6.104034495 container cleanup 8d848a9644a91b683516a34496cf33007674a1fd279ec15d27970ff124daf2b0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c, name=ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-9, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-57676-3-bee299f, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.build-date=20240507, ceph=True) 2024-05-08T05:36:27.888 INFO:journalctl@ceph.osd.9.smithi087.stdout:May 08 05:36:27 smithi087 bash[97578]: ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-9 2024-05-08T05:36:28.039 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 08 05:36:27 smithi160 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-11[60042]: 2024-05-08T05:36:27.726+0000 7f0620c06700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.87:6806 osd.0 since back 2024-05-08T05:35:07.779525+0000 front 2024-05-08T05:35:07.779646+0000 (oldest deadline 2024-05-08T05:35:33.579761+0000) 2024-05-08T05:36:28.039 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 08 05:36:27 smithi160 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-11[60042]: 2024-05-08T05:36:27.726+0000 7f0620c06700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.90:6804 osd.1 since back 2024-05-08T05:35:19.381805+0000 front 2024-05-08T05:35:19.381693+0000 (oldest deadline 2024-05-08T05:35:45.281608+0000) 2024-05-08T05:36:28.039 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 08 05:36:27 smithi160 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-11[60042]: 2024-05-08T05:36:27.726+0000 7f0620c06700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-05-08T05:35:25.282081+0000 front 2024-05-08T05:35:25.282130+0000 (oldest deadline 2024-05-08T05:35:51.182290+0000) 2024-05-08T05:36:28.039 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 08 05:36:27 smithi160 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-11[60042]: 2024-05-08T05:36:27.726+0000 7f0620c06700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.87:6814 osd.3 since back 2024-05-08T05:35:35.784273+0000 front 2024-05-08T05:35:35.784316+0000 (oldest deadline 2024-05-08T05:36:01.084003+0000) 2024-05-08T05:36:28.040 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 08 05:36:27 smithi160 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-11[60042]: 2024-05-08T05:36:27.726+0000 7f0620c06700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.90:6812 osd.4 since back 2024-05-08T05:35:45.085478+0000 front 2024-05-08T05:35:45.085623+0000 (oldest deadline 2024-05-08T05:36:06.785423+0000) 2024-05-08T05:36:28.040 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 08 05:36:27 smithi160 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-11[60042]: 2024-05-08T05:36:27.726+0000 7f0620c06700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.160:6812 osd.5 since back 2024-05-08T05:35:52.586893+0000 front 2024-05-08T05:35:52.587009+0000 (oldest deadline 2024-05-08T05:36:19.587408+0000) 2024-05-08T05:36:28.208 INFO:journalctl@ceph.osd.9.smithi087.stdout:May 08 05:36:28 smithi087 podman[97598]: 2024-05-08 05:36:28.131451931 +0000 UTC m=+0.741854976 container remove 8d848a9644a91b683516a34496cf33007674a1fd279ec15d27970ff124daf2b0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c, name=ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-9, GIT_CLEAN=True, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240507, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, RELEASE=wip-57676-3-bee299f) 2024-05-08T05:36:28.233 INFO:journalctl@ceph.osd.10.smithi090.stdout:May 08 05:36:27 smithi090 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-10[59300]: 2024-05-08T05:36:27.789+0000 7f515bdbb700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.87:6806 osd.0 since back 2024-05-08T05:35:09.330796+0000 front 2024-05-08T05:35:09.330921+0000 (oldest deadline 2024-05-08T05:35:34.030784+0000) 2024-05-08T05:36:28.233 INFO:journalctl@ceph.osd.10.smithi090.stdout:May 08 05:36:27 smithi090 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-10[59300]: 2024-05-08T05:36:27.789+0000 7f515bdbb700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.90:6804 osd.1 since back 2024-05-08T05:35:16.331661+0000 front 2024-05-08T05:35:16.331685+0000 (oldest deadline 2024-05-08T05:35:45.732387+0000) 2024-05-08T05:36:28.233 INFO:journalctl@ceph.osd.10.smithi090.stdout:May 08 05:36:27 smithi090 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-10[59300]: 2024-05-08T05:36:27.789+0000 7f515bdbb700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-05-08T05:35:25.732967+0000 front 2024-05-08T05:35:25.732895+0000 (oldest deadline 2024-05-08T05:35:49.733521+0000) 2024-05-08T05:36:28.233 INFO:journalctl@ceph.osd.10.smithi090.stdout:May 08 05:36:27 smithi090 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-10[59300]: 2024-05-08T05:36:27.789+0000 7f515bdbb700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.87:6814 osd.3 since back 2024-05-08T05:35:34.935373+0000 front 2024-05-08T05:35:34.935510+0000 (oldest deadline 2024-05-08T05:35:58.335621+0000) 2024-05-08T05:36:28.233 INFO:journalctl@ceph.osd.10.smithi090.stdout:May 08 05:36:27 smithi090 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-10[59300]: 2024-05-08T05:36:27.789+0000 7f515bdbb700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.90:6812 osd.4 since back 2024-05-08T05:35:43.536890+0000 front 2024-05-08T05:35:43.536927+0000 (oldest deadline 2024-05-08T05:36:05.837136+0000) 2024-05-08T05:36:28.233 INFO:journalctl@ceph.osd.10.smithi090.stdout:May 08 05:36:27 smithi090 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-10[59300]: 2024-05-08T05:36:27.789+0000 7f515bdbb700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.160:6812 osd.5 since back 2024-05-08T05:35:49.239047+0000 front 2024-05-08T05:35:49.238934+0000 (oldest deadline 2024-05-08T05:36:15.138762+0000) 2024-05-08T05:36:28.233 INFO:journalctl@ceph.osd.10.smithi090.stdout:May 08 05:36:27 smithi090 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-10[59300]: 2024-05-08T05:36:27.789+0000 7f515bdbb700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.87:6822 osd.6 since back 2024-05-08T05:35:59.239824+0000 front 2024-05-08T05:35:59.239934+0000 (oldest deadline 2024-05-08T05:36:22.739584+0000) 2024-05-08T05:36:29.038 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 08 05:36:28 smithi160 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-11[60042]: 2024-05-08T05:36:28.764+0000 7f0620c06700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.87:6806 osd.0 since back 2024-05-08T05:35:07.779525+0000 front 2024-05-08T05:35:07.779646+0000 (oldest deadline 2024-05-08T05:35:33.579761+0000) 2024-05-08T05:36:29.039 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 08 05:36:28 smithi160 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-11[60042]: 2024-05-08T05:36:28.764+0000 7f0620c06700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.90:6804 osd.1 since back 2024-05-08T05:35:19.381805+0000 front 2024-05-08T05:35:19.381693+0000 (oldest deadline 2024-05-08T05:35:45.281608+0000) 2024-05-08T05:36:29.039 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 08 05:36:28 smithi160 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-11[60042]: 2024-05-08T05:36:28.764+0000 7f0620c06700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-05-08T05:35:25.282081+0000 front 2024-05-08T05:35:25.282130+0000 (oldest deadline 2024-05-08T05:35:51.182290+0000) 2024-05-08T05:36:29.039 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 08 05:36:28 smithi160 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-11[60042]: 2024-05-08T05:36:28.765+0000 7f0620c06700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.87:6814 osd.3 since back 2024-05-08T05:35:35.784273+0000 front 2024-05-08T05:35:35.784316+0000 (oldest deadline 2024-05-08T05:36:01.084003+0000) 2024-05-08T05:36:29.039 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 08 05:36:28 smithi160 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-11[60042]: 2024-05-08T05:36:28.765+0000 7f0620c06700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.90:6812 osd.4 since back 2024-05-08T05:35:45.085478+0000 front 2024-05-08T05:35:45.085623+0000 (oldest deadline 2024-05-08T05:36:06.785423+0000) 2024-05-08T05:36:29.039 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 08 05:36:28 smithi160 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-11[60042]: 2024-05-08T05:36:28.765+0000 7f0620c06700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.160:6812 osd.5 since back 2024-05-08T05:35:52.586893+0000 front 2024-05-08T05:35:52.587009+0000 (oldest deadline 2024-05-08T05:36:19.587408+0000) 2024-05-08T05:36:29.209 INFO:journalctl@ceph.osd.9.smithi087.stdout:May 08 05:36:28 smithi087 podman[97685]: 2024-05-08 05:36:28.852623441 +0000 UTC m=+0.036018335 image pull 352576a2df49fbab3aeeba1effbcb7a94815e8fc1f120a55ddc340b4ee63b8ce quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c 2024-05-08T05:36:29.209 INFO:journalctl@ceph.osd.9.smithi087.stdout:May 08 05:36:28 smithi087 podman[97685]: 2024-05-08 05:36:28.999096064 +0000 UTC m=+0.182490988 container create cdbbe1b29f367c489d7f47beb6b65a56bbcbf931fa8ed7b29b1ee11e6a37a086 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c, name=ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-9-deactivate, org.label-schema.build-date=20240507, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, RELEASE=wip-57676-3-bee299f, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, ceph=True, GIT_CLEAN=True, GIT_BRANCH=HEAD, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-05-08T05:36:29.233 INFO:journalctl@ceph.osd.10.smithi090.stdout:May 08 05:36:28 smithi090 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-10[59300]: 2024-05-08T05:36:28.811+0000 7f515bdbb700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.87:6806 osd.0 since back 2024-05-08T05:35:09.330796+0000 front 2024-05-08T05:35:09.330921+0000 (oldest deadline 2024-05-08T05:35:34.030784+0000) 2024-05-08T05:36:29.233 INFO:journalctl@ceph.osd.10.smithi090.stdout:May 08 05:36:28 smithi090 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-10[59300]: 2024-05-08T05:36:28.811+0000 7f515bdbb700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.90:6804 osd.1 since back 2024-05-08T05:35:16.331661+0000 front 2024-05-08T05:35:16.331685+0000 (oldest deadline 2024-05-08T05:35:45.732387+0000) 2024-05-08T05:36:29.233 INFO:journalctl@ceph.osd.10.smithi090.stdout:May 08 05:36:28 smithi090 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-10[59300]: 2024-05-08T05:36:28.811+0000 7f515bdbb700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-05-08T05:35:25.732967+0000 front 2024-05-08T05:35:25.732895+0000 (oldest deadline 2024-05-08T05:35:49.733521+0000) 2024-05-08T05:36:29.233 INFO:journalctl@ceph.osd.10.smithi090.stdout:May 08 05:36:28 smithi090 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-10[59300]: 2024-05-08T05:36:28.811+0000 7f515bdbb700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.87:6814 osd.3 since back 2024-05-08T05:35:34.935373+0000 front 2024-05-08T05:35:34.935510+0000 (oldest deadline 2024-05-08T05:35:58.335621+0000) 2024-05-08T05:36:29.233 INFO:journalctl@ceph.osd.10.smithi090.stdout:May 08 05:36:28 smithi090 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-10[59300]: 2024-05-08T05:36:28.811+0000 7f515bdbb700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.90:6812 osd.4 since back 2024-05-08T05:35:43.536890+0000 front 2024-05-08T05:35:43.536927+0000 (oldest deadline 2024-05-08T05:36:05.837136+0000) 2024-05-08T05:36:29.234 INFO:journalctl@ceph.osd.10.smithi090.stdout:May 08 05:36:28 smithi090 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-10[59300]: 2024-05-08T05:36:28.811+0000 7f515bdbb700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.160:6812 osd.5 since back 2024-05-08T05:35:49.239047+0000 front 2024-05-08T05:35:49.238934+0000 (oldest deadline 2024-05-08T05:36:15.138762+0000) 2024-05-08T05:36:29.234 INFO:journalctl@ceph.osd.10.smithi090.stdout:May 08 05:36:28 smithi090 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-10[59300]: 2024-05-08T05:36:28.811+0000 7f515bdbb700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.87:6822 osd.6 since back 2024-05-08T05:35:59.239824+0000 front 2024-05-08T05:35:59.239934+0000 (oldest deadline 2024-05-08T05:36:22.739584+0000) 2024-05-08T05:36:29.708 INFO:journalctl@ceph.osd.9.smithi087.stdout:May 08 05:36:29 smithi087 podman[97685]: 2024-05-08 05:36:29.294084287 +0000 UTC m=+0.477479200 container init cdbbe1b29f367c489d7f47beb6b65a56bbcbf931fa8ed7b29b1ee11e6a37a086 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c, name=ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-9-deactivate, ceph=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240507, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, GIT_CLEAN=True, org.label-schema.vendor=CentOS, RELEASE=wip-57676-3-bee299f) 2024-05-08T05:36:29.709 INFO:journalctl@ceph.osd.9.smithi087.stdout:May 08 05:36:29 smithi087 podman[97685]: 2024-05-08 05:36:29.305077663 +0000 UTC m=+0.488472573 container start cdbbe1b29f367c489d7f47beb6b65a56bbcbf931fa8ed7b29b1ee11e6a37a086 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c, name=ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-9-deactivate, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, RELEASE=wip-57676-3-bee299f, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.license=GPLv2, org.label-schema.build-date=20240507, GIT_BRANCH=HEAD, ceph=True) 2024-05-08T05:36:29.709 INFO:journalctl@ceph.osd.9.smithi087.stdout:May 08 05:36:29 smithi087 podman[97685]: 2024-05-08 05:36:29.393010277 +0000 UTC m=+0.576405238 container attach cdbbe1b29f367c489d7f47beb6b65a56bbcbf931fa8ed7b29b1ee11e6a37a086 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c, name=ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-9-deactivate, ceph=True, io.buildah.version=1.33.5, GIT_CLEAN=True, RELEASE=wip-57676-3-bee299f, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.build-date=20240507, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image) 2024-05-08T05:36:30.038 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 08 05:36:29 smithi160 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-11[60042]: 2024-05-08T05:36:29.744+0000 7f0620c06700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.87:6806 osd.0 since back 2024-05-08T05:35:07.779525+0000 front 2024-05-08T05:35:07.779646+0000 (oldest deadline 2024-05-08T05:35:33.579761+0000) 2024-05-08T05:36:30.039 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 08 05:36:29 smithi160 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-11[60042]: 2024-05-08T05:36:29.744+0000 7f0620c06700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.90:6804 osd.1 since back 2024-05-08T05:35:19.381805+0000 front 2024-05-08T05:35:19.381693+0000 (oldest deadline 2024-05-08T05:35:45.281608+0000) 2024-05-08T05:36:30.039 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 08 05:36:29 smithi160 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-11[60042]: 2024-05-08T05:36:29.744+0000 7f0620c06700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-05-08T05:35:25.282081+0000 front 2024-05-08T05:35:25.282130+0000 (oldest deadline 2024-05-08T05:35:51.182290+0000) 2024-05-08T05:36:30.039 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 08 05:36:29 smithi160 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-11[60042]: 2024-05-08T05:36:29.745+0000 7f0620c06700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.87:6814 osd.3 since back 2024-05-08T05:35:35.784273+0000 front 2024-05-08T05:35:35.784316+0000 (oldest deadline 2024-05-08T05:36:01.084003+0000) 2024-05-08T05:36:30.039 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 08 05:36:29 smithi160 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-11[60042]: 2024-05-08T05:36:29.745+0000 7f0620c06700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.90:6812 osd.4 since back 2024-05-08T05:35:45.085478+0000 front 2024-05-08T05:35:45.085623+0000 (oldest deadline 2024-05-08T05:36:06.785423+0000) 2024-05-08T05:36:30.039 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 08 05:36:29 smithi160 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-11[60042]: 2024-05-08T05:36:29.745+0000 7f0620c06700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.160:6812 osd.5 since back 2024-05-08T05:35:52.586893+0000 front 2024-05-08T05:35:52.587009+0000 (oldest deadline 2024-05-08T05:36:19.587408+0000) 2024-05-08T05:36:30.109 INFO:journalctl@ceph.osd.9.smithi087.stdout:May 08 05:36:29 smithi087 podman[97685]: 2024-05-08 05:36:29.772145723 +0000 UTC m=+0.955540640 container died cdbbe1b29f367c489d7f47beb6b65a56bbcbf931fa8ed7b29b1ee11e6a37a086 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c, name=ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-9-deactivate, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, GIT_BRANCH=HEAD, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.build-date=20240507, org.label-schema.schema-version=1.0, RELEASE=wip-57676-3-bee299f, io.buildah.version=1.33.5) 2024-05-08T05:36:30.233 INFO:journalctl@ceph.osd.10.smithi090.stdout:May 08 05:36:29 smithi090 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-10[59300]: 2024-05-08T05:36:29.808+0000 7f515bdbb700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.87:6806 osd.0 since back 2024-05-08T05:35:09.330796+0000 front 2024-05-08T05:35:09.330921+0000 (oldest deadline 2024-05-08T05:35:34.030784+0000) 2024-05-08T05:36:30.233 INFO:journalctl@ceph.osd.10.smithi090.stdout:May 08 05:36:29 smithi090 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-10[59300]: 2024-05-08T05:36:29.808+0000 7f515bdbb700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.90:6804 osd.1 since back 2024-05-08T05:35:16.331661+0000 front 2024-05-08T05:35:16.331685+0000 (oldest deadline 2024-05-08T05:35:45.732387+0000) 2024-05-08T05:36:30.233 INFO:journalctl@ceph.osd.10.smithi090.stdout:May 08 05:36:29 smithi090 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-10[59300]: 2024-05-08T05:36:29.808+0000 7f515bdbb700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-05-08T05:35:25.732967+0000 front 2024-05-08T05:35:25.732895+0000 (oldest deadline 2024-05-08T05:35:49.733521+0000) 2024-05-08T05:36:30.234 INFO:journalctl@ceph.osd.10.smithi090.stdout:May 08 05:36:29 smithi090 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-10[59300]: 2024-05-08T05:36:29.808+0000 7f515bdbb700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.87:6814 osd.3 since back 2024-05-08T05:35:34.935373+0000 front 2024-05-08T05:35:34.935510+0000 (oldest deadline 2024-05-08T05:35:58.335621+0000) 2024-05-08T05:36:30.234 INFO:journalctl@ceph.osd.10.smithi090.stdout:May 08 05:36:29 smithi090 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-10[59300]: 2024-05-08T05:36:29.808+0000 7f515bdbb700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.90:6812 osd.4 since back 2024-05-08T05:35:43.536890+0000 front 2024-05-08T05:35:43.536927+0000 (oldest deadline 2024-05-08T05:36:05.837136+0000) 2024-05-08T05:36:30.234 INFO:journalctl@ceph.osd.10.smithi090.stdout:May 08 05:36:29 smithi090 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-10[59300]: 2024-05-08T05:36:29.808+0000 7f515bdbb700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.160:6812 osd.5 since back 2024-05-08T05:35:49.239047+0000 front 2024-05-08T05:35:49.238934+0000 (oldest deadline 2024-05-08T05:36:15.138762+0000) 2024-05-08T05:36:30.234 INFO:journalctl@ceph.osd.10.smithi090.stdout:May 08 05:36:29 smithi090 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-10[59300]: 2024-05-08T05:36:29.808+0000 7f515bdbb700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.87:6822 osd.6 since back 2024-05-08T05:35:59.239824+0000 front 2024-05-08T05:35:59.239934+0000 (oldest deadline 2024-05-08T05:36:22.739584+0000) 2024-05-08T05:36:30.519 DEBUG:teuthology.orchestra.run.smithi087:> sudo pkill -f 'journalctl -f -n 0 -u ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968@osd.9.service' 2024-05-08T05:36:30.611 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-08T05:36:30.612 INFO:tasks.cephadm.osd.9:Stopped osd.9 2024-05-08T05:36:30.612 INFO:tasks.cephadm.osd.10:Stopping osd.10... 2024-05-08T05:36:30.612 DEBUG:teuthology.orchestra.run.smithi090:> sudo systemctl stop ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968@osd.10 2024-05-08T05:36:30.929 INFO:journalctl@ceph.osd.10.smithi090.stdout:May 08 05:36:30 smithi090 systemd[1]: Stopping Ceph osd.10 for eeeb813e-0cf9-11ef-bc97-c7b262605968... 2024-05-08T05:36:30.930 INFO:journalctl@ceph.osd.10.smithi090.stdout:May 08 05:36:30 smithi090 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-10[59300]: 2024-05-08T05:36:30.783+0000 7f515bdbb700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.87:6806 osd.0 since back 2024-05-08T05:35:09.330796+0000 front 2024-05-08T05:35:09.330921+0000 (oldest deadline 2024-05-08T05:35:34.030784+0000) 2024-05-08T05:36:30.930 INFO:journalctl@ceph.osd.10.smithi090.stdout:May 08 05:36:30 smithi090 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-10[59300]: 2024-05-08T05:36:30.783+0000 7f515bdbb700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.90:6804 osd.1 since back 2024-05-08T05:35:16.331661+0000 front 2024-05-08T05:35:16.331685+0000 (oldest deadline 2024-05-08T05:35:45.732387+0000) 2024-05-08T05:36:30.930 INFO:journalctl@ceph.osd.10.smithi090.stdout:May 08 05:36:30 smithi090 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-10[59300]: 2024-05-08T05:36:30.783+0000 7f515bdbb700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-05-08T05:35:25.732967+0000 front 2024-05-08T05:35:25.732895+0000 (oldest deadline 2024-05-08T05:35:49.733521+0000) 2024-05-08T05:36:30.930 INFO:journalctl@ceph.osd.10.smithi090.stdout:May 08 05:36:30 smithi090 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-10[59300]: 2024-05-08T05:36:30.783+0000 7f515bdbb700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.87:6814 osd.3 since back 2024-05-08T05:35:34.935373+0000 front 2024-05-08T05:35:34.935510+0000 (oldest deadline 2024-05-08T05:35:58.335621+0000) 2024-05-08T05:36:30.930 INFO:journalctl@ceph.osd.10.smithi090.stdout:May 08 05:36:30 smithi090 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-10[59300]: 2024-05-08T05:36:30.783+0000 7f515bdbb700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.90:6812 osd.4 since back 2024-05-08T05:35:43.536890+0000 front 2024-05-08T05:35:43.536927+0000 (oldest deadline 2024-05-08T05:36:05.837136+0000) 2024-05-08T05:36:30.930 INFO:journalctl@ceph.osd.10.smithi090.stdout:May 08 05:36:30 smithi090 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-10[59300]: 2024-05-08T05:36:30.783+0000 7f515bdbb700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.160:6812 osd.5 since back 2024-05-08T05:35:49.239047+0000 front 2024-05-08T05:35:49.238934+0000 (oldest deadline 2024-05-08T05:36:15.138762+0000) 2024-05-08T05:36:30.930 INFO:journalctl@ceph.osd.10.smithi090.stdout:May 08 05:36:30 smithi090 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-10[59300]: 2024-05-08T05:36:30.783+0000 7f515bdbb700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.87:6822 osd.6 since back 2024-05-08T05:35:59.239824+0000 front 2024-05-08T05:35:59.239934+0000 (oldest deadline 2024-05-08T05:36:22.739584+0000) 2024-05-08T05:36:30.930 INFO:journalctl@ceph.osd.10.smithi090.stdout:May 08 05:36:30 smithi090 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-10[59300]: 2024-05-08T05:36:30.929+0000 7f51637cf700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.10 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-05-08T05:36:30.930 INFO:journalctl@ceph.osd.10.smithi090.stdout:May 08 05:36:30 smithi090 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-10[59300]: 2024-05-08T05:36:30.929+0000 7f51637cf700 -1 osd.10 85 *** Got signal Terminated *** 2024-05-08T05:36:30.930 INFO:journalctl@ceph.osd.10.smithi090.stdout:May 08 05:36:30 smithi090 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-10[59300]: 2024-05-08T05:36:30.929+0000 7f51637cf700 -1 osd.10 85 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-05-08T05:36:31.039 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 08 05:36:30 smithi160 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-11[60042]: 2024-05-08T05:36:30.714+0000 7f0620c06700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.87:6806 osd.0 since back 2024-05-08T05:35:07.779525+0000 front 2024-05-08T05:35:07.779646+0000 (oldest deadline 2024-05-08T05:35:33.579761+0000) 2024-05-08T05:36:31.039 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 08 05:36:30 smithi160 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-11[60042]: 2024-05-08T05:36:30.714+0000 7f0620c06700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.90:6804 osd.1 since back 2024-05-08T05:35:19.381805+0000 front 2024-05-08T05:35:19.381693+0000 (oldest deadline 2024-05-08T05:35:45.281608+0000) 2024-05-08T05:36:31.039 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 08 05:36:30 smithi160 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-11[60042]: 2024-05-08T05:36:30.714+0000 7f0620c06700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-05-08T05:35:25.282081+0000 front 2024-05-08T05:35:25.282130+0000 (oldest deadline 2024-05-08T05:35:51.182290+0000) 2024-05-08T05:36:31.039 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 08 05:36:30 smithi160 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-11[60042]: 2024-05-08T05:36:30.714+0000 7f0620c06700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.87:6814 osd.3 since back 2024-05-08T05:35:35.784273+0000 front 2024-05-08T05:35:35.784316+0000 (oldest deadline 2024-05-08T05:36:01.084003+0000) 2024-05-08T05:36:31.039 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 08 05:36:30 smithi160 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-11[60042]: 2024-05-08T05:36:30.714+0000 7f0620c06700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.90:6812 osd.4 since back 2024-05-08T05:35:45.085478+0000 front 2024-05-08T05:35:45.085623+0000 (oldest deadline 2024-05-08T05:36:06.785423+0000) 2024-05-08T05:36:31.039 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 08 05:36:30 smithi160 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-11[60042]: 2024-05-08T05:36:30.714+0000 7f0620c06700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.160:6812 osd.5 since back 2024-05-08T05:35:52.586893+0000 front 2024-05-08T05:35:52.587009+0000 (oldest deadline 2024-05-08T05:36:19.587408+0000) 2024-05-08T05:36:32.039 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 08 05:36:31 smithi160 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-11[60042]: 2024-05-08T05:36:31.700+0000 7f0620c06700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.87:6806 osd.0 since back 2024-05-08T05:35:07.779525+0000 front 2024-05-08T05:35:07.779646+0000 (oldest deadline 2024-05-08T05:35:33.579761+0000) 2024-05-08T05:36:32.039 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 08 05:36:31 smithi160 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-11[60042]: 2024-05-08T05:36:31.700+0000 7f0620c06700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.90:6804 osd.1 since back 2024-05-08T05:35:19.381805+0000 front 2024-05-08T05:35:19.381693+0000 (oldest deadline 2024-05-08T05:35:45.281608+0000) 2024-05-08T05:36:32.039 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 08 05:36:31 smithi160 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-11[60042]: 2024-05-08T05:36:31.700+0000 7f0620c06700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-05-08T05:35:25.282081+0000 front 2024-05-08T05:35:25.282130+0000 (oldest deadline 2024-05-08T05:35:51.182290+0000) 2024-05-08T05:36:32.039 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 08 05:36:31 smithi160 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-11[60042]: 2024-05-08T05:36:31.700+0000 7f0620c06700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.87:6814 osd.3 since back 2024-05-08T05:35:35.784273+0000 front 2024-05-08T05:35:35.784316+0000 (oldest deadline 2024-05-08T05:36:01.084003+0000) 2024-05-08T05:36:32.039 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 08 05:36:31 smithi160 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-11[60042]: 2024-05-08T05:36:31.700+0000 7f0620c06700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.90:6812 osd.4 since back 2024-05-08T05:35:45.085478+0000 front 2024-05-08T05:35:45.085623+0000 (oldest deadline 2024-05-08T05:36:06.785423+0000) 2024-05-08T05:36:32.039 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 08 05:36:31 smithi160 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-11[60042]: 2024-05-08T05:36:31.700+0000 7f0620c06700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.160:6812 osd.5 since back 2024-05-08T05:35:52.586893+0000 front 2024-05-08T05:35:52.587009+0000 (oldest deadline 2024-05-08T05:36:19.587408+0000) 2024-05-08T05:36:32.189 INFO:journalctl@ceph.osd.10.smithi090.stdout:May 08 05:36:31 smithi090 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-10[59300]: 2024-05-08T05:36:31.761+0000 7f515bdbb700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.87:6806 osd.0 since back 2024-05-08T05:35:09.330796+0000 front 2024-05-08T05:35:09.330921+0000 (oldest deadline 2024-05-08T05:35:34.030784+0000) 2024-05-08T05:36:32.189 INFO:journalctl@ceph.osd.10.smithi090.stdout:May 08 05:36:31 smithi090 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-10[59300]: 2024-05-08T05:36:31.761+0000 7f515bdbb700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.90:6804 osd.1 since back 2024-05-08T05:35:16.331661+0000 front 2024-05-08T05:35:16.331685+0000 (oldest deadline 2024-05-08T05:35:45.732387+0000) 2024-05-08T05:36:32.189 INFO:journalctl@ceph.osd.10.smithi090.stdout:May 08 05:36:31 smithi090 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-10[59300]: 2024-05-08T05:36:31.761+0000 7f515bdbb700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-05-08T05:35:25.732967+0000 front 2024-05-08T05:35:25.732895+0000 (oldest deadline 2024-05-08T05:35:49.733521+0000) 2024-05-08T05:36:32.189 INFO:journalctl@ceph.osd.10.smithi090.stdout:May 08 05:36:31 smithi090 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-10[59300]: 2024-05-08T05:36:31.761+0000 7f515bdbb700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.87:6814 osd.3 since back 2024-05-08T05:35:34.935373+0000 front 2024-05-08T05:35:34.935510+0000 (oldest deadline 2024-05-08T05:35:58.335621+0000) 2024-05-08T05:36:32.189 INFO:journalctl@ceph.osd.10.smithi090.stdout:May 08 05:36:31 smithi090 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-10[59300]: 2024-05-08T05:36:31.761+0000 7f515bdbb700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.90:6812 osd.4 since back 2024-05-08T05:35:43.536890+0000 front 2024-05-08T05:35:43.536927+0000 (oldest deadline 2024-05-08T05:36:05.837136+0000) 2024-05-08T05:36:32.189 INFO:journalctl@ceph.osd.10.smithi090.stdout:May 08 05:36:31 smithi090 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-10[59300]: 2024-05-08T05:36:31.761+0000 7f515bdbb700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.160:6812 osd.5 since back 2024-05-08T05:35:49.239047+0000 front 2024-05-08T05:35:49.238934+0000 (oldest deadline 2024-05-08T05:36:15.138762+0000) 2024-05-08T05:36:32.189 INFO:journalctl@ceph.osd.10.smithi090.stdout:May 08 05:36:31 smithi090 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-10[59300]: 2024-05-08T05:36:31.761+0000 7f515bdbb700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.87:6822 osd.6 since back 2024-05-08T05:35:59.239824+0000 front 2024-05-08T05:35:59.239934+0000 (oldest deadline 2024-05-08T05:36:22.739584+0000) 2024-05-08T05:36:32.983 INFO:journalctl@ceph.osd.10.smithi090.stdout:May 08 05:36:32 smithi090 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-10[59300]: 2024-05-08T05:36:32.727+0000 7f515bdbb700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.87:6806 osd.0 since back 2024-05-08T05:35:09.330796+0000 front 2024-05-08T05:35:09.330921+0000 (oldest deadline 2024-05-08T05:35:34.030784+0000) 2024-05-08T05:36:32.984 INFO:journalctl@ceph.osd.10.smithi090.stdout:May 08 05:36:32 smithi090 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-10[59300]: 2024-05-08T05:36:32.727+0000 7f515bdbb700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.90:6804 osd.1 since back 2024-05-08T05:35:16.331661+0000 front 2024-05-08T05:35:16.331685+0000 (oldest deadline 2024-05-08T05:35:45.732387+0000) 2024-05-08T05:36:32.984 INFO:journalctl@ceph.osd.10.smithi090.stdout:May 08 05:36:32 smithi090 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-10[59300]: 2024-05-08T05:36:32.727+0000 7f515bdbb700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-05-08T05:35:25.732967+0000 front 2024-05-08T05:35:25.732895+0000 (oldest deadline 2024-05-08T05:35:49.733521+0000) 2024-05-08T05:36:32.984 INFO:journalctl@ceph.osd.10.smithi090.stdout:May 08 05:36:32 smithi090 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-10[59300]: 2024-05-08T05:36:32.727+0000 7f515bdbb700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.87:6814 osd.3 since back 2024-05-08T05:35:34.935373+0000 front 2024-05-08T05:35:34.935510+0000 (oldest deadline 2024-05-08T05:35:58.335621+0000) 2024-05-08T05:36:32.984 INFO:journalctl@ceph.osd.10.smithi090.stdout:May 08 05:36:32 smithi090 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-10[59300]: 2024-05-08T05:36:32.727+0000 7f515bdbb700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.90:6812 osd.4 since back 2024-05-08T05:35:43.536890+0000 front 2024-05-08T05:35:43.536927+0000 (oldest deadline 2024-05-08T05:36:05.837136+0000) 2024-05-08T05:36:32.984 INFO:journalctl@ceph.osd.10.smithi090.stdout:May 08 05:36:32 smithi090 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-10[59300]: 2024-05-08T05:36:32.727+0000 7f515bdbb700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.160:6812 osd.5 since back 2024-05-08T05:35:49.239047+0000 front 2024-05-08T05:35:49.238934+0000 (oldest deadline 2024-05-08T05:36:15.138762+0000) 2024-05-08T05:36:32.984 INFO:journalctl@ceph.osd.10.smithi090.stdout:May 08 05:36:32 smithi090 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-10[59300]: 2024-05-08T05:36:32.727+0000 7f515bdbb700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.87:6822 osd.6 since back 2024-05-08T05:35:59.239824+0000 front 2024-05-08T05:35:59.239934+0000 (oldest deadline 2024-05-08T05:36:22.739584+0000) 2024-05-08T05:36:33.038 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 08 05:36:32 smithi160 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-11[60042]: 2024-05-08T05:36:32.664+0000 7f0620c06700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.87:6806 osd.0 since back 2024-05-08T05:35:07.779525+0000 front 2024-05-08T05:35:07.779646+0000 (oldest deadline 2024-05-08T05:35:33.579761+0000) 2024-05-08T05:36:33.038 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 08 05:36:32 smithi160 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-11[60042]: 2024-05-08T05:36:32.664+0000 7f0620c06700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.90:6804 osd.1 since back 2024-05-08T05:35:19.381805+0000 front 2024-05-08T05:35:19.381693+0000 (oldest deadline 2024-05-08T05:35:45.281608+0000) 2024-05-08T05:36:33.039 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 08 05:36:32 smithi160 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-11[60042]: 2024-05-08T05:36:32.664+0000 7f0620c06700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-05-08T05:35:25.282081+0000 front 2024-05-08T05:35:25.282130+0000 (oldest deadline 2024-05-08T05:35:51.182290+0000) 2024-05-08T05:36:33.039 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 08 05:36:32 smithi160 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-11[60042]: 2024-05-08T05:36:32.664+0000 7f0620c06700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.87:6814 osd.3 since back 2024-05-08T05:35:35.784273+0000 front 2024-05-08T05:35:35.784316+0000 (oldest deadline 2024-05-08T05:36:01.084003+0000) 2024-05-08T05:36:33.039 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 08 05:36:32 smithi160 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-11[60042]: 2024-05-08T05:36:32.664+0000 7f0620c06700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.90:6812 osd.4 since back 2024-05-08T05:35:45.085478+0000 front 2024-05-08T05:35:45.085623+0000 (oldest deadline 2024-05-08T05:36:06.785423+0000) 2024-05-08T05:36:33.039 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 08 05:36:32 smithi160 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-11[60042]: 2024-05-08T05:36:32.664+0000 7f0620c06700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.160:6812 osd.5 since back 2024-05-08T05:35:52.586893+0000 front 2024-05-08T05:35:52.587009+0000 (oldest deadline 2024-05-08T05:36:19.587408+0000) 2024-05-08T05:36:34.038 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 08 05:36:33 smithi160 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-11[60042]: 2024-05-08T05:36:33.640+0000 7f0620c06700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.87:6806 osd.0 since back 2024-05-08T05:35:07.779525+0000 front 2024-05-08T05:35:07.779646+0000 (oldest deadline 2024-05-08T05:35:33.579761+0000) 2024-05-08T05:36:34.039 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 08 05:36:33 smithi160 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-11[60042]: 2024-05-08T05:36:33.640+0000 7f0620c06700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.90:6804 osd.1 since back 2024-05-08T05:35:19.381805+0000 front 2024-05-08T05:35:19.381693+0000 (oldest deadline 2024-05-08T05:35:45.281608+0000) 2024-05-08T05:36:34.039 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 08 05:36:33 smithi160 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-11[60042]: 2024-05-08T05:36:33.640+0000 7f0620c06700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-05-08T05:35:25.282081+0000 front 2024-05-08T05:35:25.282130+0000 (oldest deadline 2024-05-08T05:35:51.182290+0000) 2024-05-08T05:36:34.039 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 08 05:36:33 smithi160 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-11[60042]: 2024-05-08T05:36:33.640+0000 7f0620c06700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.87:6814 osd.3 since back 2024-05-08T05:35:35.784273+0000 front 2024-05-08T05:35:35.784316+0000 (oldest deadline 2024-05-08T05:36:01.084003+0000) 2024-05-08T05:36:34.039 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 08 05:36:33 smithi160 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-11[60042]: 2024-05-08T05:36:33.640+0000 7f0620c06700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.90:6812 osd.4 since back 2024-05-08T05:35:45.085478+0000 front 2024-05-08T05:35:45.085623+0000 (oldest deadline 2024-05-08T05:36:06.785423+0000) 2024-05-08T05:36:34.039 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 08 05:36:33 smithi160 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-11[60042]: 2024-05-08T05:36:33.640+0000 7f0620c06700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.160:6812 osd.5 since back 2024-05-08T05:35:52.586893+0000 front 2024-05-08T05:35:52.587009+0000 (oldest deadline 2024-05-08T05:36:19.587408+0000) 2024-05-08T05:36:34.233 INFO:journalctl@ceph.osd.10.smithi090.stdout:May 08 05:36:33 smithi090 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-10[59300]: 2024-05-08T05:36:33.735+0000 7f515bdbb700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.87:6806 osd.0 since back 2024-05-08T05:35:09.330796+0000 front 2024-05-08T05:35:09.330921+0000 (oldest deadline 2024-05-08T05:35:34.030784+0000) 2024-05-08T05:36:34.234 INFO:journalctl@ceph.osd.10.smithi090.stdout:May 08 05:36:33 smithi090 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-10[59300]: 2024-05-08T05:36:33.735+0000 7f515bdbb700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.90:6804 osd.1 since back 2024-05-08T05:35:16.331661+0000 front 2024-05-08T05:35:16.331685+0000 (oldest deadline 2024-05-08T05:35:45.732387+0000) 2024-05-08T05:36:34.234 INFO:journalctl@ceph.osd.10.smithi090.stdout:May 08 05:36:33 smithi090 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-10[59300]: 2024-05-08T05:36:33.735+0000 7f515bdbb700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-05-08T05:35:25.732967+0000 front 2024-05-08T05:35:25.732895+0000 (oldest deadline 2024-05-08T05:35:49.733521+0000) 2024-05-08T05:36:34.234 INFO:journalctl@ceph.osd.10.smithi090.stdout:May 08 05:36:33 smithi090 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-10[59300]: 2024-05-08T05:36:33.735+0000 7f515bdbb700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.87:6814 osd.3 since back 2024-05-08T05:35:34.935373+0000 front 2024-05-08T05:35:34.935510+0000 (oldest deadline 2024-05-08T05:35:58.335621+0000) 2024-05-08T05:36:34.234 INFO:journalctl@ceph.osd.10.smithi090.stdout:May 08 05:36:33 smithi090 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-10[59300]: 2024-05-08T05:36:33.735+0000 7f515bdbb700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.90:6812 osd.4 since back 2024-05-08T05:35:43.536890+0000 front 2024-05-08T05:35:43.536927+0000 (oldest deadline 2024-05-08T05:36:05.837136+0000) 2024-05-08T05:36:34.234 INFO:journalctl@ceph.osd.10.smithi090.stdout:May 08 05:36:33 smithi090 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-10[59300]: 2024-05-08T05:36:33.735+0000 7f515bdbb700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.160:6812 osd.5 since back 2024-05-08T05:35:49.239047+0000 front 2024-05-08T05:35:49.238934+0000 (oldest deadline 2024-05-08T05:36:15.138762+0000) 2024-05-08T05:36:34.235 INFO:journalctl@ceph.osd.10.smithi090.stdout:May 08 05:36:33 smithi090 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-10[59300]: 2024-05-08T05:36:33.735+0000 7f515bdbb700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.87:6822 osd.6 since back 2024-05-08T05:35:59.239824+0000 front 2024-05-08T05:35:59.239934+0000 (oldest deadline 2024-05-08T05:36:22.739584+0000) 2024-05-08T05:36:34.983 INFO:journalctl@ceph.osd.10.smithi090.stdout:May 08 05:36:34 smithi090 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-10[59300]: 2024-05-08T05:36:34.718+0000 7f515bdbb700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.87:6806 osd.0 since back 2024-05-08T05:35:09.330796+0000 front 2024-05-08T05:35:09.330921+0000 (oldest deadline 2024-05-08T05:35:34.030784+0000) 2024-05-08T05:36:34.983 INFO:journalctl@ceph.osd.10.smithi090.stdout:May 08 05:36:34 smithi090 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-10[59300]: 2024-05-08T05:36:34.718+0000 7f515bdbb700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.90:6804 osd.1 since back 2024-05-08T05:35:16.331661+0000 front 2024-05-08T05:35:16.331685+0000 (oldest deadline 2024-05-08T05:35:45.732387+0000) 2024-05-08T05:36:34.983 INFO:journalctl@ceph.osd.10.smithi090.stdout:May 08 05:36:34 smithi090 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-10[59300]: 2024-05-08T05:36:34.718+0000 7f515bdbb700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-05-08T05:35:25.732967+0000 front 2024-05-08T05:35:25.732895+0000 (oldest deadline 2024-05-08T05:35:49.733521+0000) 2024-05-08T05:36:34.984 INFO:journalctl@ceph.osd.10.smithi090.stdout:May 08 05:36:34 smithi090 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-10[59300]: 2024-05-08T05:36:34.718+0000 7f515bdbb700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.87:6814 osd.3 since back 2024-05-08T05:35:34.935373+0000 front 2024-05-08T05:35:34.935510+0000 (oldest deadline 2024-05-08T05:35:58.335621+0000) 2024-05-08T05:36:34.984 INFO:journalctl@ceph.osd.10.smithi090.stdout:May 08 05:36:34 smithi090 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-10[59300]: 2024-05-08T05:36:34.718+0000 7f515bdbb700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.90:6812 osd.4 since back 2024-05-08T05:35:43.536890+0000 front 2024-05-08T05:35:43.536927+0000 (oldest deadline 2024-05-08T05:36:05.837136+0000) 2024-05-08T05:36:34.984 INFO:journalctl@ceph.osd.10.smithi090.stdout:May 08 05:36:34 smithi090 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-10[59300]: 2024-05-08T05:36:34.718+0000 7f515bdbb700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.160:6812 osd.5 since back 2024-05-08T05:35:49.239047+0000 front 2024-05-08T05:35:49.238934+0000 (oldest deadline 2024-05-08T05:36:15.138762+0000) 2024-05-08T05:36:34.984 INFO:journalctl@ceph.osd.10.smithi090.stdout:May 08 05:36:34 smithi090 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-10[59300]: 2024-05-08T05:36:34.718+0000 7f515bdbb700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.87:6822 osd.6 since back 2024-05-08T05:35:59.239824+0000 front 2024-05-08T05:35:59.239934+0000 (oldest deadline 2024-05-08T05:36:22.739584+0000) 2024-05-08T05:36:35.038 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 08 05:36:34 smithi160 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-11[60042]: 2024-05-08T05:36:34.642+0000 7f0620c06700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.87:6806 osd.0 since back 2024-05-08T05:35:07.779525+0000 front 2024-05-08T05:35:07.779646+0000 (oldest deadline 2024-05-08T05:35:33.579761+0000) 2024-05-08T05:36:35.039 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 08 05:36:34 smithi160 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-11[60042]: 2024-05-08T05:36:34.642+0000 7f0620c06700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.90:6804 osd.1 since back 2024-05-08T05:35:19.381805+0000 front 2024-05-08T05:35:19.381693+0000 (oldest deadline 2024-05-08T05:35:45.281608+0000) 2024-05-08T05:36:35.039 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 08 05:36:34 smithi160 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-11[60042]: 2024-05-08T05:36:34.642+0000 7f0620c06700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-05-08T05:35:25.282081+0000 front 2024-05-08T05:35:25.282130+0000 (oldest deadline 2024-05-08T05:35:51.182290+0000) 2024-05-08T05:36:35.039 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 08 05:36:34 smithi160 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-11[60042]: 2024-05-08T05:36:34.642+0000 7f0620c06700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.87:6814 osd.3 since back 2024-05-08T05:35:35.784273+0000 front 2024-05-08T05:35:35.784316+0000 (oldest deadline 2024-05-08T05:36:01.084003+0000) 2024-05-08T05:36:35.039 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 08 05:36:34 smithi160 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-11[60042]: 2024-05-08T05:36:34.642+0000 7f0620c06700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.90:6812 osd.4 since back 2024-05-08T05:35:45.085478+0000 front 2024-05-08T05:35:45.085623+0000 (oldest deadline 2024-05-08T05:36:06.785423+0000) 2024-05-08T05:36:35.039 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 08 05:36:34 smithi160 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-11[60042]: 2024-05-08T05:36:34.642+0000 7f0620c06700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.160:6812 osd.5 since back 2024-05-08T05:35:52.586893+0000 front 2024-05-08T05:35:52.587009+0000 (oldest deadline 2024-05-08T05:36:19.587408+0000) 2024-05-08T05:36:36.039 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 08 05:36:35 smithi160 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-11[60042]: 2024-05-08T05:36:35.659+0000 7f0620c06700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.87:6806 osd.0 since back 2024-05-08T05:35:07.779525+0000 front 2024-05-08T05:35:07.779646+0000 (oldest deadline 2024-05-08T05:35:33.579761+0000) 2024-05-08T05:36:36.039 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 08 05:36:35 smithi160 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-11[60042]: 2024-05-08T05:36:35.659+0000 7f0620c06700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.90:6804 osd.1 since back 2024-05-08T05:35:19.381805+0000 front 2024-05-08T05:35:19.381693+0000 (oldest deadline 2024-05-08T05:35:45.281608+0000) 2024-05-08T05:36:36.039 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 08 05:36:35 smithi160 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-11[60042]: 2024-05-08T05:36:35.659+0000 7f0620c06700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-05-08T05:35:25.282081+0000 front 2024-05-08T05:35:25.282130+0000 (oldest deadline 2024-05-08T05:35:51.182290+0000) 2024-05-08T05:36:36.039 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 08 05:36:35 smithi160 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-11[60042]: 2024-05-08T05:36:35.659+0000 7f0620c06700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.87:6814 osd.3 since back 2024-05-08T05:35:35.784273+0000 front 2024-05-08T05:35:35.784316+0000 (oldest deadline 2024-05-08T05:36:01.084003+0000) 2024-05-08T05:36:36.039 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 08 05:36:35 smithi160 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-11[60042]: 2024-05-08T05:36:35.659+0000 7f0620c06700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.90:6812 osd.4 since back 2024-05-08T05:35:45.085478+0000 front 2024-05-08T05:35:45.085623+0000 (oldest deadline 2024-05-08T05:36:06.785423+0000) 2024-05-08T05:36:36.039 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 08 05:36:35 smithi160 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-11[60042]: 2024-05-08T05:36:35.659+0000 7f0620c06700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.160:6812 osd.5 since back 2024-05-08T05:35:52.586893+0000 front 2024-05-08T05:35:52.587009+0000 (oldest deadline 2024-05-08T05:36:19.587408+0000) 2024-05-08T05:36:36.039 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 08 05:36:35 smithi160 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-11[60042]: 2024-05-08T05:36:35.659+0000 7f0620c06700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.90:6820 osd.7 since back 2024-05-08T05:36:07.789000+0000 front 2024-05-08T05:36:07.788955+0000 (oldest deadline 2024-05-08T05:36:35.389283+0000) 2024-05-08T05:36:36.233 INFO:journalctl@ceph.osd.10.smithi090.stdout:May 08 05:36:35 smithi090 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-10[59300]: 2024-05-08T05:36:35.743+0000 7f515bdbb700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.87:6806 osd.0 since back 2024-05-08T05:35:09.330796+0000 front 2024-05-08T05:35:09.330921+0000 (oldest deadline 2024-05-08T05:35:34.030784+0000) 2024-05-08T05:36:36.233 INFO:journalctl@ceph.osd.10.smithi090.stdout:May 08 05:36:35 smithi090 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-10[59300]: 2024-05-08T05:36:35.743+0000 7f515bdbb700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.90:6804 osd.1 since back 2024-05-08T05:35:16.331661+0000 front 2024-05-08T05:35:16.331685+0000 (oldest deadline 2024-05-08T05:35:45.732387+0000) 2024-05-08T05:36:36.234 INFO:journalctl@ceph.osd.10.smithi090.stdout:May 08 05:36:35 smithi090 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-10[59300]: 2024-05-08T05:36:35.743+0000 7f515bdbb700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-05-08T05:35:25.732967+0000 front 2024-05-08T05:35:25.732895+0000 (oldest deadline 2024-05-08T05:35:49.733521+0000) 2024-05-08T05:36:36.234 INFO:journalctl@ceph.osd.10.smithi090.stdout:May 08 05:36:35 smithi090 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-10[59300]: 2024-05-08T05:36:35.743+0000 7f515bdbb700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.87:6814 osd.3 since back 2024-05-08T05:35:34.935373+0000 front 2024-05-08T05:35:34.935510+0000 (oldest deadline 2024-05-08T05:35:58.335621+0000) 2024-05-08T05:36:36.234 INFO:journalctl@ceph.osd.10.smithi090.stdout:May 08 05:36:35 smithi090 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-10[59300]: 2024-05-08T05:36:35.743+0000 7f515bdbb700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.90:6812 osd.4 since back 2024-05-08T05:35:43.536890+0000 front 2024-05-08T05:35:43.536927+0000 (oldest deadline 2024-05-08T05:36:05.837136+0000) 2024-05-08T05:36:36.234 INFO:journalctl@ceph.osd.10.smithi090.stdout:May 08 05:36:35 smithi090 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-10[59300]: 2024-05-08T05:36:35.743+0000 7f515bdbb700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.160:6812 osd.5 since back 2024-05-08T05:35:49.239047+0000 front 2024-05-08T05:35:49.238934+0000 (oldest deadline 2024-05-08T05:36:15.138762+0000) 2024-05-08T05:36:36.234 INFO:journalctl@ceph.osd.10.smithi090.stdout:May 08 05:36:35 smithi090 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-10[59300]: 2024-05-08T05:36:35.743+0000 7f515bdbb700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.87:6822 osd.6 since back 2024-05-08T05:35:59.239824+0000 front 2024-05-08T05:35:59.239934+0000 (oldest deadline 2024-05-08T05:36:22.739584+0000) 2024-05-08T05:36:36.733 INFO:journalctl@ceph.osd.10.smithi090.stdout:May 08 05:36:36 smithi090 podman[69446]: 2024-05-08 05:36:36.36121184 +0000 UTC m=+5.553307029 container died 057a4c6a287ce8e68695e965ef31000c84b8285562366bdf8278f651641c3c73 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c, name=ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-10, RELEASE=wip-57676-3-bee299f, io.buildah.version=1.33.5, ceph=True, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240507, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS) 2024-05-08T05:36:37.039 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 08 05:36:36 smithi160 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-11[60042]: 2024-05-08T05:36:36.655+0000 7f0620c06700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.87:6806 osd.0 since back 2024-05-08T05:35:07.779525+0000 front 2024-05-08T05:35:07.779646+0000 (oldest deadline 2024-05-08T05:35:33.579761+0000) 2024-05-08T05:36:37.039 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 08 05:36:36 smithi160 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-11[60042]: 2024-05-08T05:36:36.655+0000 7f0620c06700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.90:6804 osd.1 since back 2024-05-08T05:35:19.381805+0000 front 2024-05-08T05:35:19.381693+0000 (oldest deadline 2024-05-08T05:35:45.281608+0000) 2024-05-08T05:36:37.039 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 08 05:36:36 smithi160 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-11[60042]: 2024-05-08T05:36:36.655+0000 7f0620c06700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-05-08T05:35:25.282081+0000 front 2024-05-08T05:35:25.282130+0000 (oldest deadline 2024-05-08T05:35:51.182290+0000) 2024-05-08T05:36:37.039 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 08 05:36:36 smithi160 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-11[60042]: 2024-05-08T05:36:36.655+0000 7f0620c06700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.87:6814 osd.3 since back 2024-05-08T05:35:35.784273+0000 front 2024-05-08T05:35:35.784316+0000 (oldest deadline 2024-05-08T05:36:01.084003+0000) 2024-05-08T05:36:37.039 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 08 05:36:36 smithi160 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-11[60042]: 2024-05-08T05:36:36.655+0000 7f0620c06700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.90:6812 osd.4 since back 2024-05-08T05:35:45.085478+0000 front 2024-05-08T05:35:45.085623+0000 (oldest deadline 2024-05-08T05:36:06.785423+0000) 2024-05-08T05:36:37.039 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 08 05:36:36 smithi160 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-11[60042]: 2024-05-08T05:36:36.655+0000 7f0620c06700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.160:6812 osd.5 since back 2024-05-08T05:35:52.586893+0000 front 2024-05-08T05:35:52.587009+0000 (oldest deadline 2024-05-08T05:36:19.587408+0000) 2024-05-08T05:36:37.039 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 08 05:36:36 smithi160 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-11[60042]: 2024-05-08T05:36:36.655+0000 7f0620c06700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.90:6820 osd.7 since back 2024-05-08T05:36:07.789000+0000 front 2024-05-08T05:36:07.788955+0000 (oldest deadline 2024-05-08T05:36:35.389283+0000) 2024-05-08T05:36:37.116 INFO:journalctl@ceph.osd.10.smithi090.stdout:May 08 05:36:36 smithi090 podman[69446]: 2024-05-08 05:36:36.898394861 +0000 UTC m=+6.090490045 container cleanup 057a4c6a287ce8e68695e965ef31000c84b8285562366bdf8278f651641c3c73 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c, name=ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-10, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-57676-3-bee299f, ceph=True, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.build-date=20240507, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504) 2024-05-08T05:36:37.116 INFO:journalctl@ceph.osd.10.smithi090.stdout:May 08 05:36:36 smithi090 bash[69446]: ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-10 2024-05-08T05:36:37.483 INFO:journalctl@ceph.osd.10.smithi090.stdout:May 08 05:36:37 smithi090 podman[69464]: 2024-05-08 05:36:37.116427137 +0000 UTC m=+0.754595331 container remove 057a4c6a287ce8e68695e965ef31000c84b8285562366bdf8278f651641c3c73 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c, name=ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-10, RELEASE=wip-57676-3-bee299f, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240507, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, ceph=True, GIT_CLEAN=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0) 2024-05-08T05:36:37.765 INFO:journalctl@ceph.osd.10.smithi090.stdout:May 08 05:36:37 smithi090 podman[69555]: 2024-05-08 05:36:37.417614681 +0000 UTC m=+0.018023068 image pull 352576a2df49fbab3aeeba1effbcb7a94815e8fc1f120a55ddc340b4ee63b8ce quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c 2024-05-08T05:36:37.765 INFO:journalctl@ceph.osd.10.smithi090.stdout:May 08 05:36:37 smithi090 podman[69555]: 2024-05-08 05:36:37.5347445 +0000 UTC m=+0.135152875 container create b45ce65cda7cd215aeb296b253a21082aba4c96b2bf5426d90822b6f48960db6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c, name=ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-10-deactivate, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, RELEASE=wip-57676-3-bee299f, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240507, io.buildah.version=1.33.5, GIT_CLEAN=True, ceph=True, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS) 2024-05-08T05:36:37.765 INFO:journalctl@ceph.osd.10.smithi090.stdout:May 08 05:36:37 smithi090 podman[69555]: 2024-05-08 05:36:37.76505801 +0000 UTC m=+0.365466393 container init b45ce65cda7cd215aeb296b253a21082aba4c96b2bf5426d90822b6f48960db6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c, name=ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-10-deactivate, ceph=True, RELEASE=wip-57676-3-bee299f, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.build-date=20240507, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5) 2024-05-08T05:36:38.039 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 08 05:36:37 smithi160 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-11[60042]: 2024-05-08T05:36:37.615+0000 7f0620c06700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.87:6806 osd.0 since back 2024-05-08T05:35:07.779525+0000 front 2024-05-08T05:35:07.779646+0000 (oldest deadline 2024-05-08T05:35:33.579761+0000) 2024-05-08T05:36:38.039 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 08 05:36:37 smithi160 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-11[60042]: 2024-05-08T05:36:37.615+0000 7f0620c06700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.90:6804 osd.1 since back 2024-05-08T05:35:19.381805+0000 front 2024-05-08T05:35:19.381693+0000 (oldest deadline 2024-05-08T05:35:45.281608+0000) 2024-05-08T05:36:38.039 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 08 05:36:37 smithi160 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-11[60042]: 2024-05-08T05:36:37.615+0000 7f0620c06700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-05-08T05:35:25.282081+0000 front 2024-05-08T05:35:25.282130+0000 (oldest deadline 2024-05-08T05:35:51.182290+0000) 2024-05-08T05:36:38.039 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 08 05:36:37 smithi160 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-11[60042]: 2024-05-08T05:36:37.615+0000 7f0620c06700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.87:6814 osd.3 since back 2024-05-08T05:35:35.784273+0000 front 2024-05-08T05:35:35.784316+0000 (oldest deadline 2024-05-08T05:36:01.084003+0000) 2024-05-08T05:36:38.039 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 08 05:36:37 smithi160 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-11[60042]: 2024-05-08T05:36:37.615+0000 7f0620c06700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.90:6812 osd.4 since back 2024-05-08T05:35:45.085478+0000 front 2024-05-08T05:35:45.085623+0000 (oldest deadline 2024-05-08T05:36:06.785423+0000) 2024-05-08T05:36:38.039 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 08 05:36:37 smithi160 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-11[60042]: 2024-05-08T05:36:37.615+0000 7f0620c06700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.160:6812 osd.5 since back 2024-05-08T05:35:52.586893+0000 front 2024-05-08T05:35:52.587009+0000 (oldest deadline 2024-05-08T05:36:19.587408+0000) 2024-05-08T05:36:38.039 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 08 05:36:37 smithi160 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-11[60042]: 2024-05-08T05:36:37.615+0000 7f0620c06700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.90:6820 osd.7 since back 2024-05-08T05:36:07.789000+0000 front 2024-05-08T05:36:07.788955+0000 (oldest deadline 2024-05-08T05:36:35.389283+0000) 2024-05-08T05:36:38.057 INFO:journalctl@ceph.osd.10.smithi090.stdout:May 08 05:36:37 smithi090 podman[69555]: 2024-05-08 05:36:37.768315403 +0000 UTC m=+0.368723779 container start b45ce65cda7cd215aeb296b253a21082aba4c96b2bf5426d90822b6f48960db6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c, name=ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-10-deactivate, org.label-schema.schema-version=1.0, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, CEPH_POINT_RELEASE=, RELEASE=wip-57676-3-bee299f, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240507, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux ) 2024-05-08T05:36:38.057 INFO:journalctl@ceph.osd.10.smithi090.stdout:May 08 05:36:37 smithi090 podman[69555]: 2024-05-08 05:36:37.847819714 +0000 UTC m=+0.448228094 container attach b45ce65cda7cd215aeb296b253a21082aba4c96b2bf5426d90822b6f48960db6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c, name=ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-10-deactivate, GIT_CLEAN=True, RELEASE=wip-57676-3-bee299f, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240507, CEPH_POINT_RELEASE=, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD) 2024-05-08T05:36:38.350 INFO:journalctl@ceph.osd.10.smithi090.stdout:May 08 05:36:38 smithi090 podman[69555]: 2024-05-08 05:36:38.058214926 +0000 UTC m=+0.658623308 container died b45ce65cda7cd215aeb296b253a21082aba4c96b2bf5426d90822b6f48960db6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c, name=ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-10-deactivate, org.label-schema.build-date=20240507, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, RELEASE=wip-57676-3-bee299f, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image) 2024-05-08T05:36:38.625 DEBUG:teuthology.orchestra.run.smithi090:> sudo pkill -f 'journalctl -f -n 0 -u ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968@osd.10.service' 2024-05-08T05:36:38.661 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-08T05:36:38.661 INFO:tasks.cephadm.osd.10:Stopped osd.10 2024-05-08T05:36:38.661 INFO:tasks.cephadm.osd.11:Stopping osd.11... 2024-05-08T05:36:38.662 DEBUG:teuthology.orchestra.run.smithi160:> sudo systemctl stop ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968@osd.11 2024-05-08T05:36:38.970 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 08 05:36:38 smithi160 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-11[60042]: 2024-05-08T05:36:38.661+0000 7f0620c06700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.87:6806 osd.0 since back 2024-05-08T05:35:07.779525+0000 front 2024-05-08T05:35:07.779646+0000 (oldest deadline 2024-05-08T05:35:33.579761+0000) 2024-05-08T05:36:38.970 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 08 05:36:38 smithi160 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-11[60042]: 2024-05-08T05:36:38.661+0000 7f0620c06700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.90:6804 osd.1 since back 2024-05-08T05:35:19.381805+0000 front 2024-05-08T05:35:19.381693+0000 (oldest deadline 2024-05-08T05:35:45.281608+0000) 2024-05-08T05:36:38.970 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 08 05:36:38 smithi160 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-11[60042]: 2024-05-08T05:36:38.661+0000 7f0620c06700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-05-08T05:35:25.282081+0000 front 2024-05-08T05:35:25.282130+0000 (oldest deadline 2024-05-08T05:35:51.182290+0000) 2024-05-08T05:36:38.970 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 08 05:36:38 smithi160 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-11[60042]: 2024-05-08T05:36:38.662+0000 7f0620c06700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.87:6814 osd.3 since back 2024-05-08T05:35:35.784273+0000 front 2024-05-08T05:35:35.784316+0000 (oldest deadline 2024-05-08T05:36:01.084003+0000) 2024-05-08T05:36:38.971 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 08 05:36:38 smithi160 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-11[60042]: 2024-05-08T05:36:38.662+0000 7f0620c06700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.90:6812 osd.4 since back 2024-05-08T05:35:45.085478+0000 front 2024-05-08T05:35:45.085623+0000 (oldest deadline 2024-05-08T05:36:06.785423+0000) 2024-05-08T05:36:38.971 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 08 05:36:38 smithi160 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-11[60042]: 2024-05-08T05:36:38.662+0000 7f0620c06700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.160:6812 osd.5 since back 2024-05-08T05:35:52.586893+0000 front 2024-05-08T05:35:52.587009+0000 (oldest deadline 2024-05-08T05:36:19.587408+0000) 2024-05-08T05:36:38.971 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 08 05:36:38 smithi160 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-11[60042]: 2024-05-08T05:36:38.662+0000 7f0620c06700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.90:6820 osd.7 since back 2024-05-08T05:36:07.789000+0000 front 2024-05-08T05:36:07.788955+0000 (oldest deadline 2024-05-08T05:36:35.389283+0000) 2024-05-08T05:36:38.971 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 08 05:36:38 smithi160 systemd[1]: Stopping Ceph osd.11 for eeeb813e-0cf9-11ef-bc97-c7b262605968... 2024-05-08T05:36:38.971 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 08 05:36:38 smithi160 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-11[60042]: 2024-05-08T05:36:38.969+0000 7f0624612700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.11 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-05-08T05:36:38.971 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 08 05:36:38 smithi160 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-11[60042]: 2024-05-08T05:36:38.969+0000 7f0624612700 -1 osd.11 85 *** Got signal Terminated *** 2024-05-08T05:36:38.971 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 08 05:36:38 smithi160 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-11[60042]: 2024-05-08T05:36:38.969+0000 7f0624612700 -1 osd.11 85 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-05-08T05:36:40.038 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 08 05:36:39 smithi160 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-11[60042]: 2024-05-08T05:36:39.652+0000 7f0620c06700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.87:6806 osd.0 since back 2024-05-08T05:35:07.779525+0000 front 2024-05-08T05:35:07.779646+0000 (oldest deadline 2024-05-08T05:35:33.579761+0000) 2024-05-08T05:36:40.039 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 08 05:36:39 smithi160 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-11[60042]: 2024-05-08T05:36:39.652+0000 7f0620c06700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.90:6804 osd.1 since back 2024-05-08T05:35:19.381805+0000 front 2024-05-08T05:35:19.381693+0000 (oldest deadline 2024-05-08T05:35:45.281608+0000) 2024-05-08T05:36:40.039 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 08 05:36:39 smithi160 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-11[60042]: 2024-05-08T05:36:39.652+0000 7f0620c06700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-05-08T05:35:25.282081+0000 front 2024-05-08T05:35:25.282130+0000 (oldest deadline 2024-05-08T05:35:51.182290+0000) 2024-05-08T05:36:40.039 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 08 05:36:39 smithi160 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-11[60042]: 2024-05-08T05:36:39.652+0000 7f0620c06700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.87:6814 osd.3 since back 2024-05-08T05:35:35.784273+0000 front 2024-05-08T05:35:35.784316+0000 (oldest deadline 2024-05-08T05:36:01.084003+0000) 2024-05-08T05:36:40.039 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 08 05:36:39 smithi160 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-11[60042]: 2024-05-08T05:36:39.652+0000 7f0620c06700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.90:6812 osd.4 since back 2024-05-08T05:35:45.085478+0000 front 2024-05-08T05:35:45.085623+0000 (oldest deadline 2024-05-08T05:36:06.785423+0000) 2024-05-08T05:36:40.039 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 08 05:36:39 smithi160 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-11[60042]: 2024-05-08T05:36:39.652+0000 7f0620c06700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.160:6812 osd.5 since back 2024-05-08T05:35:52.586893+0000 front 2024-05-08T05:35:52.587009+0000 (oldest deadline 2024-05-08T05:36:19.587408+0000) 2024-05-08T05:36:40.039 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 08 05:36:39 smithi160 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-11[60042]: 2024-05-08T05:36:39.652+0000 7f0620c06700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.90:6820 osd.7 since back 2024-05-08T05:36:07.789000+0000 front 2024-05-08T05:36:07.788955+0000 (oldest deadline 2024-05-08T05:36:35.389283+0000) 2024-05-08T05:36:41.038 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 08 05:36:40 smithi160 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-11[60042]: 2024-05-08T05:36:40.692+0000 7f0620c06700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.87:6806 osd.0 since back 2024-05-08T05:35:07.779525+0000 front 2024-05-08T05:35:07.779646+0000 (oldest deadline 2024-05-08T05:35:33.579761+0000) 2024-05-08T05:36:41.039 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 08 05:36:40 smithi160 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-11[60042]: 2024-05-08T05:36:40.692+0000 7f0620c06700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.90:6804 osd.1 since back 2024-05-08T05:35:19.381805+0000 front 2024-05-08T05:35:19.381693+0000 (oldest deadline 2024-05-08T05:35:45.281608+0000) 2024-05-08T05:36:41.039 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 08 05:36:40 smithi160 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-11[60042]: 2024-05-08T05:36:40.692+0000 7f0620c06700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-05-08T05:35:25.282081+0000 front 2024-05-08T05:35:25.282130+0000 (oldest deadline 2024-05-08T05:35:51.182290+0000) 2024-05-08T05:36:41.039 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 08 05:36:40 smithi160 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-11[60042]: 2024-05-08T05:36:40.692+0000 7f0620c06700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.87:6814 osd.3 since back 2024-05-08T05:35:35.784273+0000 front 2024-05-08T05:35:35.784316+0000 (oldest deadline 2024-05-08T05:36:01.084003+0000) 2024-05-08T05:36:41.039 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 08 05:36:40 smithi160 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-11[60042]: 2024-05-08T05:36:40.692+0000 7f0620c06700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.90:6812 osd.4 since back 2024-05-08T05:35:45.085478+0000 front 2024-05-08T05:35:45.085623+0000 (oldest deadline 2024-05-08T05:36:06.785423+0000) 2024-05-08T05:36:41.039 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 08 05:36:40 smithi160 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-11[60042]: 2024-05-08T05:36:40.692+0000 7f0620c06700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.160:6812 osd.5 since back 2024-05-08T05:35:52.586893+0000 front 2024-05-08T05:35:52.587009+0000 (oldest deadline 2024-05-08T05:36:19.587408+0000) 2024-05-08T05:36:41.039 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 08 05:36:40 smithi160 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-11[60042]: 2024-05-08T05:36:40.692+0000 7f0620c06700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.90:6820 osd.7 since back 2024-05-08T05:36:07.789000+0000 front 2024-05-08T05:36:07.788955+0000 (oldest deadline 2024-05-08T05:36:35.389283+0000) 2024-05-08T05:36:41.039 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 08 05:36:40 smithi160 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-11[60042]: 2024-05-08T05:36:40.692+0000 7f0620c06700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.160:6820 osd.8 since back 2024-05-08T05:36:15.389616+0000 front 2024-05-08T05:36:15.389645+0000 (oldest deadline 2024-05-08T05:36:40.089738+0000) 2024-05-08T05:36:41.940 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 08 05:36:41 smithi160 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-11[60042]: 2024-05-08T05:36:41.662+0000 7f0620c06700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.87:6806 osd.0 since back 2024-05-08T05:35:07.779525+0000 front 2024-05-08T05:35:07.779646+0000 (oldest deadline 2024-05-08T05:35:33.579761+0000) 2024-05-08T05:36:41.940 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 08 05:36:41 smithi160 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-11[60042]: 2024-05-08T05:36:41.662+0000 7f0620c06700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.90:6804 osd.1 since back 2024-05-08T05:35:19.381805+0000 front 2024-05-08T05:35:19.381693+0000 (oldest deadline 2024-05-08T05:35:45.281608+0000) 2024-05-08T05:36:41.940 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 08 05:36:41 smithi160 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-11[60042]: 2024-05-08T05:36:41.662+0000 7f0620c06700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-05-08T05:35:25.282081+0000 front 2024-05-08T05:35:25.282130+0000 (oldest deadline 2024-05-08T05:35:51.182290+0000) 2024-05-08T05:36:41.940 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 08 05:36:41 smithi160 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-11[60042]: 2024-05-08T05:36:41.662+0000 7f0620c06700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.87:6814 osd.3 since back 2024-05-08T05:35:35.784273+0000 front 2024-05-08T05:35:35.784316+0000 (oldest deadline 2024-05-08T05:36:01.084003+0000) 2024-05-08T05:36:41.940 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 08 05:36:41 smithi160 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-11[60042]: 2024-05-08T05:36:41.662+0000 7f0620c06700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.90:6812 osd.4 since back 2024-05-08T05:35:45.085478+0000 front 2024-05-08T05:35:45.085623+0000 (oldest deadline 2024-05-08T05:36:06.785423+0000) 2024-05-08T05:36:41.940 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 08 05:36:41 smithi160 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-11[60042]: 2024-05-08T05:36:41.662+0000 7f0620c06700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.160:6812 osd.5 since back 2024-05-08T05:35:52.586893+0000 front 2024-05-08T05:35:52.587009+0000 (oldest deadline 2024-05-08T05:36:19.587408+0000) 2024-05-08T05:36:41.940 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 08 05:36:41 smithi160 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-11[60042]: 2024-05-08T05:36:41.662+0000 7f0620c06700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.90:6820 osd.7 since back 2024-05-08T05:36:07.789000+0000 front 2024-05-08T05:36:07.788955+0000 (oldest deadline 2024-05-08T05:36:35.389283+0000) 2024-05-08T05:36:41.940 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 08 05:36:41 smithi160 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-11[60042]: 2024-05-08T05:36:41.662+0000 7f0620c06700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.160:6820 osd.8 since back 2024-05-08T05:36:15.389616+0000 front 2024-05-08T05:36:15.389645+0000 (oldest deadline 2024-05-08T05:36:40.089738+0000) 2024-05-08T05:36:43.038 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 08 05:36:42 smithi160 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-11[60042]: 2024-05-08T05:36:42.670+0000 7f0620c06700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.87:6806 osd.0 since back 2024-05-08T05:35:07.779525+0000 front 2024-05-08T05:35:07.779646+0000 (oldest deadline 2024-05-08T05:35:33.579761+0000) 2024-05-08T05:36:43.039 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 08 05:36:42 smithi160 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-11[60042]: 2024-05-08T05:36:42.670+0000 7f0620c06700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.90:6804 osd.1 since back 2024-05-08T05:35:19.381805+0000 front 2024-05-08T05:35:19.381693+0000 (oldest deadline 2024-05-08T05:35:45.281608+0000) 2024-05-08T05:36:43.039 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 08 05:36:42 smithi160 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-11[60042]: 2024-05-08T05:36:42.670+0000 7f0620c06700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-05-08T05:35:25.282081+0000 front 2024-05-08T05:35:25.282130+0000 (oldest deadline 2024-05-08T05:35:51.182290+0000) 2024-05-08T05:36:43.039 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 08 05:36:42 smithi160 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-11[60042]: 2024-05-08T05:36:42.670+0000 7f0620c06700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.87:6814 osd.3 since back 2024-05-08T05:35:35.784273+0000 front 2024-05-08T05:35:35.784316+0000 (oldest deadline 2024-05-08T05:36:01.084003+0000) 2024-05-08T05:36:43.039 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 08 05:36:42 smithi160 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-11[60042]: 2024-05-08T05:36:42.670+0000 7f0620c06700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.90:6812 osd.4 since back 2024-05-08T05:35:45.085478+0000 front 2024-05-08T05:35:45.085623+0000 (oldest deadline 2024-05-08T05:36:06.785423+0000) 2024-05-08T05:36:43.039 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 08 05:36:42 smithi160 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-11[60042]: 2024-05-08T05:36:42.670+0000 7f0620c06700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.160:6812 osd.5 since back 2024-05-08T05:35:52.586893+0000 front 2024-05-08T05:35:52.587009+0000 (oldest deadline 2024-05-08T05:36:19.587408+0000) 2024-05-08T05:36:43.039 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 08 05:36:42 smithi160 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-11[60042]: 2024-05-08T05:36:42.670+0000 7f0620c06700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.90:6820 osd.7 since back 2024-05-08T05:36:07.789000+0000 front 2024-05-08T05:36:07.788955+0000 (oldest deadline 2024-05-08T05:36:35.389283+0000) 2024-05-08T05:36:43.039 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 08 05:36:42 smithi160 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-11[60042]: 2024-05-08T05:36:42.670+0000 7f0620c06700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.160:6820 osd.8 since back 2024-05-08T05:36:15.389616+0000 front 2024-05-08T05:36:15.389645+0000 (oldest deadline 2024-05-08T05:36:40.089738+0000) 2024-05-08T05:36:44.038 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 08 05:36:43 smithi160 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-11[60042]: 2024-05-08T05:36:43.682+0000 7f0620c06700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.87:6806 osd.0 since back 2024-05-08T05:35:07.779525+0000 front 2024-05-08T05:35:07.779646+0000 (oldest deadline 2024-05-08T05:35:33.579761+0000) 2024-05-08T05:36:44.039 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 08 05:36:43 smithi160 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-11[60042]: 2024-05-08T05:36:43.682+0000 7f0620c06700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.90:6804 osd.1 since back 2024-05-08T05:35:19.381805+0000 front 2024-05-08T05:35:19.381693+0000 (oldest deadline 2024-05-08T05:35:45.281608+0000) 2024-05-08T05:36:44.039 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 08 05:36:43 smithi160 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-11[60042]: 2024-05-08T05:36:43.682+0000 7f0620c06700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-05-08T05:35:25.282081+0000 front 2024-05-08T05:35:25.282130+0000 (oldest deadline 2024-05-08T05:35:51.182290+0000) 2024-05-08T05:36:44.039 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 08 05:36:43 smithi160 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-11[60042]: 2024-05-08T05:36:43.682+0000 7f0620c06700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.87:6814 osd.3 since back 2024-05-08T05:35:35.784273+0000 front 2024-05-08T05:35:35.784316+0000 (oldest deadline 2024-05-08T05:36:01.084003+0000) 2024-05-08T05:36:44.039 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 08 05:36:43 smithi160 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-11[60042]: 2024-05-08T05:36:43.682+0000 7f0620c06700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.90:6812 osd.4 since back 2024-05-08T05:35:45.085478+0000 front 2024-05-08T05:35:45.085623+0000 (oldest deadline 2024-05-08T05:36:06.785423+0000) 2024-05-08T05:36:44.039 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 08 05:36:43 smithi160 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-11[60042]: 2024-05-08T05:36:43.682+0000 7f0620c06700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.160:6812 osd.5 since back 2024-05-08T05:35:52.586893+0000 front 2024-05-08T05:35:52.587009+0000 (oldest deadline 2024-05-08T05:36:19.587408+0000) 2024-05-08T05:36:44.039 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 08 05:36:43 smithi160 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-11[60042]: 2024-05-08T05:36:43.682+0000 7f0620c06700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.90:6820 osd.7 since back 2024-05-08T05:36:07.789000+0000 front 2024-05-08T05:36:07.788955+0000 (oldest deadline 2024-05-08T05:36:35.389283+0000) 2024-05-08T05:36:44.039 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 08 05:36:43 smithi160 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-11[60042]: 2024-05-08T05:36:43.682+0000 7f0620c06700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.160:6820 osd.8 since back 2024-05-08T05:36:15.389616+0000 front 2024-05-08T05:36:15.389645+0000 (oldest deadline 2024-05-08T05:36:40.089738+0000) 2024-05-08T05:36:44.752 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 08 05:36:44 smithi160 podman[70373]: 2024-05-08 05:36:44.424234445 +0000 UTC m=+5.568199739 container died b35307ac126400c92c369160312d0e0e75dc273624af240dce63bfbafd47f8d3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c, name=ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-11, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, GIT_CLEAN=True, RELEASE=wip-57676-3-bee299f, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.build-date=20240507, io.buildah.version=1.33.5, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504) 2024-05-08T05:36:44.752 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 08 05:36:44 smithi160 podman[70373]: 2024-05-08 05:36:44.752825745 +0000 UTC m=+5.896791044 container cleanup b35307ac126400c92c369160312d0e0e75dc273624af240dce63bfbafd47f8d3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c, name=ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-11, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240507, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, ceph=True, RELEASE=wip-57676-3-bee299f, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504) 2024-05-08T05:36:45.038 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 08 05:36:44 smithi160 bash[70373]: ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-11 2024-05-08T05:36:45.038 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 08 05:36:44 smithi160 podman[70391]: 2024-05-08 05:36:44.945368016 +0000 UTC m=+0.515529992 container remove b35307ac126400c92c369160312d0e0e75dc273624af240dce63bfbafd47f8d3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c, name=ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-11, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, org.label-schema.build-date=20240507, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, RELEASE=wip-57676-3-bee299f, ceph=True, io.buildah.version=1.33.5) 2024-05-08T05:36:45.618 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 08 05:36:45 smithi160 podman[70484]: 2024-05-08 05:36:45.271244334 +0000 UTC m=+0.018058907 image pull 352576a2df49fbab3aeeba1effbcb7a94815e8fc1f120a55ddc340b4ee63b8ce quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c 2024-05-08T05:36:45.618 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 08 05:36:45 smithi160 podman[70484]: 2024-05-08 05:36:45.388084575 +0000 UTC m=+0.134899133 container create 4cde4f47abfddaa4b00858b71d59ca6089c2e4ff16a17380521f4602377777b8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c, name=ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-11-deactivate, io.buildah.version=1.33.5, ceph=True, org.label-schema.build-date=20240507, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-57676-3-bee299f, CEPH_POINT_RELEASE=, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image) 2024-05-08T05:36:45.618 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 08 05:36:45 smithi160 podman[70484]: 2024-05-08 05:36:45.615532576 +0000 UTC m=+0.362347149 container init 4cde4f47abfddaa4b00858b71d59ca6089c2e4ff16a17380521f4602377777b8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c, name=ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-11-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240507, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, RELEASE=wip-57676-3-bee299f, CEPH_POINT_RELEASE=) 2024-05-08T05:36:45.618 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 08 05:36:45 smithi160 podman[70484]: 2024-05-08 05:36:45.618435993 +0000 UTC m=+0.365250558 container start 4cde4f47abfddaa4b00858b71d59ca6089c2e4ff16a17380521f4602377777b8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c, name=ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-11-deactivate, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.build-date=20240507, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, RELEASE=wip-57676-3-bee299f, CEPH_POINT_RELEASE=) 2024-05-08T05:36:45.914 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 08 05:36:45 smithi160 podman[70484]: 2024-05-08 05:36:45.698490048 +0000 UTC m=+0.445304608 container attach 4cde4f47abfddaa4b00858b71d59ca6089c2e4ff16a17380521f4602377777b8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c, name=ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-11-deactivate, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-57676-3-bee299f, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.build-date=20240507, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, GIT_BRANCH=HEAD, ceph=True, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5) 2024-05-08T05:36:46.209 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 08 05:36:45 smithi160 podman[70484]: 2024-05-08 05:36:45.914633664 +0000 UTC m=+0.661448235 container died 4cde4f47abfddaa4b00858b71d59ca6089c2e4ff16a17380521f4602377777b8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c, name=ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-osd-11-deactivate, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, org.label-schema.build-date=20240507, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, RELEASE=wip-57676-3-bee299f, org.label-schema.name=CentOS Stream 8 Base Image) 2024-05-08T05:36:46.503 DEBUG:teuthology.orchestra.run.smithi160:> sudo pkill -f 'journalctl -f -n 0 -u ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968@osd.11.service' 2024-05-08T05:36:46.541 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-08T05:36:46.541 INFO:tasks.cephadm.osd.11:Stopped osd.11 2024-05-08T05:36:46.541 INFO:tasks.cephadm.mds.a:Stopping mds.a... 2024-05-08T05:36:46.541 DEBUG:teuthology.orchestra.run.smithi087:> sudo systemctl stop ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968@mds.a 2024-05-08T05:36:46.958 INFO:journalctl@ceph.mds.a.smithi087.stdout:May 08 05:36:46 smithi087 systemd[1]: Stopping Ceph mds.a for eeeb813e-0cf9-11ef-bc97-c7b262605968... 2024-05-08T05:36:47.458 INFO:journalctl@ceph.mds.a.smithi087.stdout:May 08 05:36:47 smithi087 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-mds-a[71942]: 2024-05-08T05:36:47.114+0000 7f0406200700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-05-08T05:36:47.458 INFO:journalctl@ceph.mds.a.smithi087.stdout:May 08 05:36:47 smithi087 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-mds-a[71942]: 2024-05-08T05:36:47.114+0000 7f0406200700 -1 mds.a *** got signal Terminated *** 2024-05-08T05:36:51.429 INFO:journalctl@ceph.mds.a.smithi087.stdout:May 08 05:36:51 smithi087 podman[97804]: 2024-05-08 05:36:51.127567525 +0000 UTC m=+4.157317133 container died 650f7c6a8c2e260dd040430eb75a75a7031fe9abe12fc480fe6ea7f76fb393ef (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c, name=ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-mds-a, RELEASE=wip-57676-3-bee299f, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240507, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, ceph=True, org.label-schema.license=GPLv2) 2024-05-08T05:36:51.708 INFO:journalctl@ceph.mds.a.smithi087.stdout:May 08 05:36:51 smithi087 podman[97804]: 2024-05-08 05:36:51.640160223 +0000 UTC m=+4.669909825 container cleanup 650f7c6a8c2e260dd040430eb75a75a7031fe9abe12fc480fe6ea7f76fb393ef (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c, name=ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-mds-a, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, org.label-schema.build-date=20240507, org.label-schema.license=GPLv2, GIT_CLEAN=True, CEPH_POINT_RELEASE=, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-57676-3-bee299f, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux ) 2024-05-08T05:36:51.708 INFO:journalctl@ceph.mds.a.smithi087.stdout:May 08 05:36:51 smithi087 bash[97804]: ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-mds-a 2024-05-08T05:36:52.155 INFO:journalctl@ceph.mds.a.smithi087.stdout:May 08 05:36:51 smithi087 podman[97819]: 2024-05-08 05:36:51.899943697 +0000 UTC m=+0.750480223 container remove 650f7c6a8c2e260dd040430eb75a75a7031fe9abe12fc480fe6ea7f76fb393ef (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c, name=ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-mds-a, org.label-schema.build-date=20240507, org.label-schema.license=GPLv2, GIT_CLEAN=True, RELEASE=wip-57676-3-bee299f, org.label-schema.schema-version=1.0, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, GIT_BRANCH=HEAD) 2024-05-08T05:36:52.167 DEBUG:teuthology.orchestra.run.smithi087:> sudo pkill -f 'journalctl -f -n 0 -u ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968@mds.a.service' 2024-05-08T05:36:52.276 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-08T05:36:52.276 INFO:tasks.cephadm.mds.a:Stopped mds.a 2024-05-08T05:36:52.276 INFO:tasks.cephadm.mds.d:Stopping mds.d... 2024-05-08T05:36:52.276 DEBUG:teuthology.orchestra.run.smithi087:> sudo systemctl stop ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968@mds.d 2024-05-08T05:36:52.708 INFO:journalctl@ceph.mds.d.smithi087.stdout:May 08 05:36:52 smithi087 systemd[1]: Stopping Ceph mds.d for eeeb813e-0cf9-11ef-bc97-c7b262605968... 2024-05-08T05:36:53.208 INFO:journalctl@ceph.mds.d.smithi087.stdout:May 08 05:36:52 smithi087 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-mds-d[70694]: 2024-05-08T05:36:52.842+0000 7f27d9400700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.d -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-05-08T05:36:53.208 INFO:journalctl@ceph.mds.d.smithi087.stdout:May 08 05:36:52 smithi087 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-mds-d[70694]: 2024-05-08T05:36:52.842+0000 7f27d9400700 -1 mds.d *** got signal Terminated *** 2024-05-08T05:36:55.669 INFO:journalctl@ceph.mds.d.smithi087.stdout:May 08 05:36:55 smithi087 podman[97925]: 2024-05-08 05:36:55.338943065 +0000 UTC m=+2.626940032 container died 502d9a8af8b4181cd7550e5ae3e2b697216f26184d0fe3a907d1be7912de12e3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c, name=ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-mds-d, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, ceph=True, RELEASE=wip-57676-3-bee299f, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, GIT_CLEAN=True, org.label-schema.build-date=20240507) 2024-05-08T05:36:55.669 INFO:journalctl@ceph.mds.d.smithi087.stdout:May 08 05:36:55 smithi087 podman[97925]: 2024-05-08 05:36:55.66849195 +0000 UTC m=+2.956488913 container cleanup 502d9a8af8b4181cd7550e5ae3e2b697216f26184d0fe3a907d1be7912de12e3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c, name=ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-mds-d, ceph=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, RELEASE=wip-57676-3-bee299f, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240507) 2024-05-08T05:36:55.958 INFO:journalctl@ceph.mds.d.smithi087.stdout:May 08 05:36:55 smithi087 bash[97925]: ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-mds-d 2024-05-08T05:36:55.958 INFO:journalctl@ceph.mds.d.smithi087.stdout:May 08 05:36:55 smithi087 podman[97939]: 2024-05-08 05:36:55.89501062 +0000 UTC m=+0.538547021 container remove 502d9a8af8b4181cd7550e5ae3e2b697216f26184d0fe3a907d1be7912de12e3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c, name=ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-mds-d, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, RELEASE=wip-57676-3-bee299f, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240507, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, ceph=True, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.schema-version=1.0, GIT_CLEAN=True) 2024-05-08T05:36:56.395 DEBUG:teuthology.orchestra.run.smithi087:> sudo pkill -f 'journalctl -f -n 0 -u ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968@mds.d.service' 2024-05-08T05:36:56.497 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-08T05:36:56.497 INFO:tasks.cephadm.mds.d:Stopped mds.d 2024-05-08T05:36:56.497 INFO:tasks.cephadm.mds.g:Stopping mds.g... 2024-05-08T05:36:56.498 DEBUG:teuthology.orchestra.run.smithi087:> sudo systemctl stop ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968@mds.g 2024-05-08T05:36:56.958 INFO:journalctl@ceph.mds.g.smithi087.stdout:May 08 05:36:56 smithi087 systemd[1]: Stopping Ceph mds.g for eeeb813e-0cf9-11ef-bc97-c7b262605968... 2024-05-08T05:36:57.458 INFO:journalctl@ceph.mds.g.smithi087.stdout:May 08 05:36:57 smithi087 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-mds-g[71534]: 2024-05-08T05:36:57.121+0000 7f8d9ba00700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.g -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-05-08T05:36:57.459 INFO:journalctl@ceph.mds.g.smithi087.stdout:May 08 05:36:57 smithi087 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-mds-g[71534]: 2024-05-08T05:36:57.121+0000 7f8d9ba00700 -1 mds.g *** got signal Terminated *** 2024-05-08T05:36:59.935 INFO:journalctl@ceph.mds.g.smithi087.stdout:May 08 05:36:59 smithi087 podman[98045]: 2024-05-08 05:36:59.631422887 +0000 UTC m=+2.649231128 container died da5c165e8e9cd054955db744e6759768784db458bf31943b56d316dfe0804124 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c, name=ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-mds-g, org.label-schema.license=GPLv2, org.label-schema.build-date=20240507, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, RELEASE=wip-57676-3-bee299f, GIT_BRANCH=HEAD) 2024-05-08T05:37:00.208 INFO:journalctl@ceph.mds.g.smithi087.stdout:May 08 05:37:00 smithi087 podman[98045]: 2024-05-08 05:37:00.055944091 +0000 UTC m=+3.073752325 container cleanup da5c165e8e9cd054955db744e6759768784db458bf31943b56d316dfe0804124 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c, name=ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-mds-g, org.label-schema.build-date=20240507, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-57676-3-bee299f, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504) 2024-05-08T05:37:00.208 INFO:journalctl@ceph.mds.g.smithi087.stdout:May 08 05:37:00 smithi087 bash[98045]: ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-mds-g 2024-05-08T05:37:00.708 INFO:journalctl@ceph.mds.g.smithi087.stdout:May 08 05:37:00 smithi087 podman[98059]: 2024-05-08 05:37:00.331967185 +0000 UTC m=+0.678722648 container remove da5c165e8e9cd054955db744e6759768784db458bf31943b56d316dfe0804124 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c, name=ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-mds-g, ceph=True, GIT_BRANCH=HEAD, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240507, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_CLEAN=True, RELEASE=wip-57676-3-bee299f) 2024-05-08T05:37:00.903 DEBUG:teuthology.orchestra.run.smithi087:> sudo pkill -f 'journalctl -f -n 0 -u ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968@mds.g.service' 2024-05-08T05:37:01.007 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-08T05:37:01.007 INFO:tasks.cephadm.mds.g:Stopped mds.g 2024-05-08T05:37:01.008 INFO:tasks.cephadm.mds.j:Stopping mds.j... 2024-05-08T05:37:01.008 DEBUG:teuthology.orchestra.run.smithi087:> sudo systemctl stop ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968@mds.j 2024-05-08T05:37:01.208 INFO:journalctl@ceph.mds.j.smithi087.stdout:May 08 05:37:01 smithi087 systemd[1]: Stopping Ceph mds.j for eeeb813e-0cf9-11ef-bc97-c7b262605968... 2024-05-08T05:37:01.708 INFO:journalctl@ceph.mds.j.smithi087.stdout:May 08 05:37:01 smithi087 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-mds-j[70232]: 2024-05-08T05:37:01.531+0000 7f4059c00700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.j -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-05-08T05:37:01.708 INFO:journalctl@ceph.mds.j.smithi087.stdout:May 08 05:37:01 smithi087 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-mds-j[70232]: 2024-05-08T05:37:01.531+0000 7f4059c00700 -1 mds.j *** got signal Terminated *** 2024-05-08T05:37:05.800 INFO:journalctl@ceph.mds.j.smithi087.stdout:May 08 05:37:05 smithi087 podman[98166]: 2024-05-08 05:37:05.54755415 +0000 UTC m=+4.166379758 container died aa3efd62a6a6b9dba8de6909b42c36edaaef77ffc5f0f72d563673645a266281 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c, name=ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-mds-j, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_CLEAN=True, ceph=True, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, RELEASE=wip-57676-3-bee299f, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240507, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-05-08T05:37:06.086 INFO:journalctl@ceph.mds.j.smithi087.stdout:May 08 05:37:05 smithi087 podman[98166]: 2024-05-08 05:37:05.900907961 +0000 UTC m=+4.519733563 container cleanup aa3efd62a6a6b9dba8de6909b42c36edaaef77ffc5f0f72d563673645a266281 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c, name=ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-mds-j, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, RELEASE=wip-57676-3-bee299f, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, org.label-schema.build-date=20240507, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, ceph=True) 2024-05-08T05:37:06.086 INFO:journalctl@ceph.mds.j.smithi087.stdout:May 08 05:37:05 smithi087 bash[98166]: ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-mds-j 2024-05-08T05:37:06.458 INFO:journalctl@ceph.mds.j.smithi087.stdout:May 08 05:37:06 smithi087 podman[98191]: 2024-05-08 05:37:06.085261838 +0000 UTC m=+0.519288644 container remove aa3efd62a6a6b9dba8de6909b42c36edaaef77ffc5f0f72d563673645a266281 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c, name=ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-mds-j, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.build-date=20240507, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, RELEASE=wip-57676-3-bee299f, GIT_CLEAN=True) 2024-05-08T05:37:06.563 DEBUG:teuthology.orchestra.run.smithi087:> sudo pkill -f 'journalctl -f -n 0 -u ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968@mds.j.service' 2024-05-08T05:37:06.667 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-08T05:37:06.667 INFO:tasks.cephadm.mds.j:Stopped mds.j 2024-05-08T05:37:06.667 INFO:tasks.cephadm.mds.b:Stopping mds.b... 2024-05-08T05:37:06.667 DEBUG:teuthology.orchestra.run.smithi090:> sudo systemctl stop ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968@mds.b 2024-05-08T05:37:06.966 INFO:journalctl@ceph.mds.b.smithi090.stdout:May 08 05:37:06 smithi090 systemd[1]: Stopping Ceph mds.b for eeeb813e-0cf9-11ef-bc97-c7b262605968... 2024-05-08T05:37:07.233 INFO:journalctl@ceph.mds.b.smithi090.stdout:May 08 05:37:06 smithi090 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-mds-b[64959]: 2024-05-08T05:37:06.964+0000 7faa77562700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.b -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-05-08T05:37:07.233 INFO:journalctl@ceph.mds.b.smithi090.stdout:May 08 05:37:06 smithi090 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-mds-b[64959]: 2024-05-08T05:37:06.964+0000 7faa77562700 -1 mds.b *** got signal Terminated *** 2024-05-08T05:37:11.233 INFO:journalctl@ceph.mds.b.smithi090.stdout:May 08 05:37:10 smithi090 podman[69661]: 2024-05-08 05:37:10.97965061 +0000 UTC m=+4.125987443 container died a1364ec0143718cdf48f4d01596946d229e718f826baccd6951e1724aab313a9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c, name=ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-mds-b, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, RELEASE=wip-57676-3-bee299f, ceph=True, org.label-schema.build-date=20240507, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.vendor=CentOS) 2024-05-08T05:37:11.616 INFO:journalctl@ceph.mds.b.smithi090.stdout:May 08 05:37:11 smithi090 podman[69661]: 2024-05-08 05:37:11.340917788 +0000 UTC m=+4.487254631 container cleanup a1364ec0143718cdf48f4d01596946d229e718f826baccd6951e1724aab313a9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c, name=ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-mds-b, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240507, org.label-schema.license=GPLv2, RELEASE=wip-57676-3-bee299f, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image) 2024-05-08T05:37:11.617 INFO:journalctl@ceph.mds.b.smithi090.stdout:May 08 05:37:11 smithi090 bash[69661]: ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-mds-b 2024-05-08T05:37:11.715 DEBUG:teuthology.orchestra.run.smithi090:> sudo pkill -f 'journalctl -f -n 0 -u ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968@mds.b.service' 2024-05-08T05:37:11.749 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-08T05:37:11.749 INFO:tasks.cephadm.mds.b:Stopped mds.b 2024-05-08T05:37:11.749 INFO:tasks.cephadm.mds.e:Stopping mds.e... 2024-05-08T05:37:11.749 DEBUG:teuthology.orchestra.run.smithi090:> sudo systemctl stop ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968@mds.e 2024-05-08T05:37:11.983 INFO:journalctl@ceph.mds.e.smithi090.stdout:May 08 05:37:11 smithi090 systemd[1]: Stopping Ceph mds.e for eeeb813e-0cf9-11ef-bc97-c7b262605968... 2024-05-08T05:37:12.483 INFO:journalctl@ceph.mds.e.smithi090.stdout:May 08 05:37:12 smithi090 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-mds-e[64344]: 2024-05-08T05:37:12.086+0000 7ff078431700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.e -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-05-08T05:37:12.483 INFO:journalctl@ceph.mds.e.smithi090.stdout:May 08 05:37:12 smithi090 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-mds-e[64344]: 2024-05-08T05:37:12.086+0000 7ff078431700 -1 mds.e *** got signal Terminated *** 2024-05-08T05:37:14.513 INFO:journalctl@ceph.mds.e.smithi090.stdout:May 08 05:37:14 smithi090 podman[69794]: 2024-05-08 05:37:14.248408914 +0000 UTC m=+2.288163630 container died 60ee4ba8a65a4bb70f1305ae240f0b2c418045fc34b0ecebb6c08bb411def2a4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c, name=ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-mds-e, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.license=GPLv2, RELEASE=wip-57676-3-bee299f, ceph=True, org.label-schema.build-date=20240507, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=) 2024-05-08T05:37:14.791 INFO:journalctl@ceph.mds.e.smithi090.stdout:May 08 05:37:14 smithi090 podman[69794]: 2024-05-08 05:37:14.597466287 +0000 UTC m=+2.637221013 container cleanup 60ee4ba8a65a4bb70f1305ae240f0b2c418045fc34b0ecebb6c08bb411def2a4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c, name=ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-mds-e, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, RELEASE=wip-57676-3-bee299f, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240507, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , ceph=True, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504) 2024-05-08T05:37:14.791 INFO:journalctl@ceph.mds.e.smithi090.stdout:May 08 05:37:14 smithi090 bash[69794]: ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-mds-e 2024-05-08T05:37:15.000 DEBUG:teuthology.orchestra.run.smithi090:> sudo pkill -f 'journalctl -f -n 0 -u ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968@mds.e.service' 2024-05-08T05:37:15.032 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-08T05:37:15.032 INFO:tasks.cephadm.mds.e:Stopped mds.e 2024-05-08T05:37:15.033 INFO:tasks.cephadm.mds.h:Stopping mds.h... 2024-05-08T05:37:15.033 DEBUG:teuthology.orchestra.run.smithi090:> sudo systemctl stop ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968@mds.h 2024-05-08T05:37:15.343 INFO:journalctl@ceph.mds.h.smithi090.stdout:May 08 05:37:15 smithi090 systemd[1]: Stopping Ceph mds.h for eeeb813e-0cf9-11ef-bc97-c7b262605968... 2024-05-08T05:37:15.733 INFO:journalctl@ceph.mds.h.smithi090.stdout:May 08 05:37:15 smithi090 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-mds-h[64651]: 2024-05-08T05:37:15.342+0000 7f5c6b30f700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.h -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-05-08T05:37:15.733 INFO:journalctl@ceph.mds.h.smithi090.stdout:May 08 05:37:15 smithi090 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-mds-h[64651]: 2024-05-08T05:37:15.342+0000 7f5c6b30f700 -1 mds.h *** got signal Terminated *** 2024-05-08T05:37:19.733 INFO:journalctl@ceph.mds.h.smithi090.stdout:May 08 05:37:19 smithi090 podman[69914]: 2024-05-08 05:37:19.356612955 +0000 UTC m=+4.110091796 container died 029ff2ccc4fca9ff80c144a9bee81194bae4af007630a001b64edb1593b78239 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c, name=ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-mds-h, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240507, RELEASE=wip-57676-3-bee299f, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5) 2024-05-08T05:37:20.162 INFO:journalctl@ceph.mds.h.smithi090.stdout:May 08 05:37:19 smithi090 podman[69914]: 2024-05-08 05:37:19.911133215 +0000 UTC m=+4.664612045 container cleanup 029ff2ccc4fca9ff80c144a9bee81194bae4af007630a001b64edb1593b78239 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c, name=ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-mds-h, maintainer=Guillaume Abrioux , GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, RELEASE=wip-57676-3-bee299f, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240507, ceph=True, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2) 2024-05-08T05:37:20.162 INFO:journalctl@ceph.mds.h.smithi090.stdout:May 08 05:37:19 smithi090 bash[69914]: ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-mds-h 2024-05-08T05:37:20.285 DEBUG:teuthology.orchestra.run.smithi090:> sudo pkill -f 'journalctl -f -n 0 -u ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968@mds.h.service' 2024-05-08T05:37:20.316 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-08T05:37:20.316 INFO:tasks.cephadm.mds.h:Stopped mds.h 2024-05-08T05:37:20.316 INFO:tasks.cephadm.mds.k:Stopping mds.k... 2024-05-08T05:37:20.317 DEBUG:teuthology.orchestra.run.smithi090:> sudo systemctl stop ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968@mds.k 2024-05-08T05:37:20.483 INFO:journalctl@ceph.mds.k.smithi090.stdout:May 08 05:37:20 smithi090 systemd[1]: Stopping Ceph mds.k for eeeb813e-0cf9-11ef-bc97-c7b262605968... 2024-05-08T05:37:20.983 INFO:journalctl@ceph.mds.k.smithi090.stdout:May 08 05:37:20 smithi090 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-mds-k[64022]: 2024-05-08T05:37:20.623+0000 7f0301a2b700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.k -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-05-08T05:37:20.983 INFO:journalctl@ceph.mds.k.smithi090.stdout:May 08 05:37:20 smithi090 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-mds-k[64022]: 2024-05-08T05:37:20.623+0000 7f0301a2b700 -1 mds.k *** got signal Terminated *** 2024-05-08T05:37:24.234 INFO:journalctl@ceph.mds.k.smithi090.stdout:May 08 05:37:23 smithi090 podman[70036]: 2024-05-08 05:37:23.931202952 +0000 UTC m=+3.399208031 container died b0b0b09be1f62859c0ceff8af70608fe46e48ccc8a909f7d71d451b373e85eb1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c, name=ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-mds-k, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240507, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, RELEASE=wip-57676-3-bee299f, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD) 2024-05-08T05:37:24.654 INFO:journalctl@ceph.mds.k.smithi090.stdout:May 08 05:37:24 smithi090 podman[70036]: 2024-05-08 05:37:24.250762068 +0000 UTC m=+3.718767155 container cleanup b0b0b09be1f62859c0ceff8af70608fe46e48ccc8a909f7d71d451b373e85eb1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c, name=ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-mds-k, org.label-schema.build-date=20240507, GIT_BRANCH=HEAD, ceph=True, RELEASE=wip-57676-3-bee299f, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.vendor=CentOS) 2024-05-08T05:37:24.654 INFO:journalctl@ceph.mds.k.smithi090.stdout:May 08 05:37:24 smithi090 bash[70036]: ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-mds-k 2024-05-08T05:37:24.654 INFO:journalctl@ceph.mds.k.smithi090.stdout:May 08 05:37:24 smithi090 podman[70050]: 2024-05-08 05:37:24.435276176 +0000 UTC m=+0.506355024 container remove b0b0b09be1f62859c0ceff8af70608fe46e48ccc8a909f7d71d451b373e85eb1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c, name=ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-mds-k, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.build-date=20240507, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-57676-3-bee299f, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2) 2024-05-08T05:37:24.677 DEBUG:teuthology.orchestra.run.smithi090:> sudo pkill -f 'journalctl -f -n 0 -u ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968@mds.k.service' 2024-05-08T05:37:24.711 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-08T05:37:24.712 INFO:tasks.cephadm.mds.k:Stopped mds.k 2024-05-08T05:37:24.712 INFO:tasks.cephadm.mds.c:Stopping mds.c... 2024-05-08T05:37:24.712 DEBUG:teuthology.orchestra.run.smithi160:> sudo systemctl stop ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968@mds.c 2024-05-08T05:37:25.026 INFO:journalctl@ceph.mds.c.smithi160.stdout:May 08 05:37:24 smithi160 systemd[1]: Stopping Ceph mds.c for eeeb813e-0cf9-11ef-bc97-c7b262605968... 2024-05-08T05:37:25.288 INFO:journalctl@ceph.mds.c.smithi160.stdout:May 08 05:37:25 smithi160 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-mds-c[65466]: 2024-05-08T05:37:25.025+0000 7f75ae6b4700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.c -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-05-08T05:37:25.288 INFO:journalctl@ceph.mds.c.smithi160.stdout:May 08 05:37:25 smithi160 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-mds-c[65466]: 2024-05-08T05:37:25.025+0000 7f75ae6b4700 -1 mds.c *** got signal Terminated *** 2024-05-08T05:37:27.917 INFO:journalctl@ceph.mds.c.smithi160.stdout:May 08 05:37:27 smithi160 podman[70590]: 2024-05-08 05:37:27.593950453 +0000 UTC m=+2.688123474 container died 5afd6bd4357abf502453dfd49b176e5abecdd0121045e1d0eaf23ca6c5f48393 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c, name=ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-mds-c, RELEASE=wip-57676-3-bee299f, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.license=GPLv2, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240507) 2024-05-08T05:37:27.918 INFO:journalctl@ceph.mds.c.smithi160.stdout:May 08 05:37:27 smithi160 podman[70590]: 2024-05-08 05:37:27.918087217 +0000 UTC m=+3.012260227 container cleanup 5afd6bd4357abf502453dfd49b176e5abecdd0121045e1d0eaf23ca6c5f48393 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c, name=ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-mds-c, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-57676-3-bee299f, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240507, GIT_CLEAN=True, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2) 2024-05-08T05:37:28.288 INFO:journalctl@ceph.mds.c.smithi160.stdout:May 08 05:37:27 smithi160 bash[70590]: ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-mds-c 2024-05-08T05:37:28.288 INFO:journalctl@ceph.mds.c.smithi160.stdout:May 08 05:37:28 smithi160 podman[70616]: 2024-05-08 05:37:28.119808272 +0000 UTC m=+0.523775047 container remove 5afd6bd4357abf502453dfd49b176e5abecdd0121045e1d0eaf23ca6c5f48393 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c, name=ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-mds-c, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, maintainer=Guillaume Abrioux , RELEASE=wip-57676-3-bee299f, org.label-schema.build-date=20240507, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504) 2024-05-08T05:37:28.341 DEBUG:teuthology.orchestra.run.smithi160:> sudo pkill -f 'journalctl -f -n 0 -u ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968@mds.c.service' 2024-05-08T05:37:28.375 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-08T05:37:28.376 INFO:tasks.cephadm.mds.c:Stopped mds.c 2024-05-08T05:37:28.376 INFO:tasks.cephadm.mds.f:Stopping mds.f... 2024-05-08T05:37:28.376 DEBUG:teuthology.orchestra.run.smithi160:> sudo systemctl stop ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968@mds.f 2024-05-08T05:37:28.722 INFO:journalctl@ceph.mds.f.smithi160.stdout:May 08 05:37:28 smithi160 systemd[1]: Stopping Ceph mds.f for eeeb813e-0cf9-11ef-bc97-c7b262605968... 2024-05-08T05:37:29.039 INFO:journalctl@ceph.mds.f.smithi160.stdout:May 08 05:37:28 smithi160 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-mds-f[65156]: 2024-05-08T05:37:28.721+0000 7f6f48e79700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.f -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-05-08T05:37:29.039 INFO:journalctl@ceph.mds.f.smithi160.stdout:May 08 05:37:28 smithi160 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-mds-f[65156]: 2024-05-08T05:37:28.721+0000 7f6f48e79700 -1 mds.f *** got signal Terminated *** 2024-05-08T05:37:31.882 INFO:journalctl@ceph.mds.f.smithi160.stdout:May 08 05:37:31 smithi160 podman[70723]: 2024-05-08 05:37:31.584300305 +0000 UTC m=+2.995406159 container died b586ddc7bc7a6d52f749cfba9dcb64d86f1612f86744b6d8043cc4d10f5d21ed (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c, name=ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-mds-f, org.label-schema.vendor=CentOS, GIT_CLEAN=True, ceph=True, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , RELEASE=wip-57676-3-bee299f, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.build-date=20240507, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-05-08T05:37:32.191 INFO:journalctl@ceph.mds.f.smithi160.stdout:May 08 05:37:31 smithi160 podman[70723]: 2024-05-08 05:37:31.964936608 +0000 UTC m=+3.376042459 container cleanup b586ddc7bc7a6d52f749cfba9dcb64d86f1612f86744b6d8043cc4d10f5d21ed (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c, name=ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-mds-f, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, RELEASE=wip-57676-3-bee299f, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, ceph=True, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.build-date=20240507) 2024-05-08T05:37:32.191 INFO:journalctl@ceph.mds.f.smithi160.stdout:May 08 05:37:31 smithi160 bash[70723]: ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-mds-f 2024-05-08T05:37:32.314 DEBUG:teuthology.orchestra.run.smithi160:> sudo pkill -f 'journalctl -f -n 0 -u ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968@mds.f.service' 2024-05-08T05:37:32.345 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-08T05:37:32.346 INFO:tasks.cephadm.mds.f:Stopped mds.f 2024-05-08T05:37:32.346 INFO:tasks.cephadm.mds.i:Stopping mds.i... 2024-05-08T05:37:32.346 DEBUG:teuthology.orchestra.run.smithi160:> sudo systemctl stop ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968@mds.i 2024-05-08T05:37:32.538 INFO:journalctl@ceph.mds.i.smithi160.stdout:May 08 05:37:32 smithi160 systemd[1]: Stopping Ceph mds.i for eeeb813e-0cf9-11ef-bc97-c7b262605968... 2024-05-08T05:37:33.038 INFO:journalctl@ceph.mds.i.smithi160.stdout:May 08 05:37:32 smithi160 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-mds-i[65778]: 2024-05-08T05:37:32.660+0000 7f8c8e201700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.i -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-05-08T05:37:33.038 INFO:journalctl@ceph.mds.i.smithi160.stdout:May 08 05:37:32 smithi160 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-mds-i[65778]: 2024-05-08T05:37:32.660+0000 7f8c8e201700 -1 mds.i *** got signal Terminated *** 2024-05-08T05:37:35.945 INFO:journalctl@ceph.mds.i.smithi160.stdout:May 08 05:37:35 smithi160 podman[70847]: 2024-05-08 05:37:35.588857699 +0000 UTC m=+3.032890584 container died 5c35f6636ad12ecd21dddc0cc55304814dff163a7e010ea33dd0bcce4644c9f2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c, name=ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-mds-i, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, GIT_CLEAN=True, org.label-schema.build-date=20240507, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.license=GPLv2, RELEASE=wip-57676-3-bee299f, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , ceph=True) 2024-05-08T05:37:36.220 INFO:journalctl@ceph.mds.i.smithi160.stdout:May 08 05:37:36 smithi160 podman[70847]: 2024-05-08 05:37:36.019442593 +0000 UTC m=+3.463475519 container cleanup 5c35f6636ad12ecd21dddc0cc55304814dff163a7e010ea33dd0bcce4644c9f2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c, name=ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-mds-i, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, RELEASE=wip-57676-3-bee299f, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, ceph=True, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.build-date=20240507, org.label-schema.schema-version=1.0) 2024-05-08T05:37:36.220 INFO:journalctl@ceph.mds.i.smithi160.stdout:May 08 05:37:36 smithi160 bash[70847]: ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-mds-i 2024-05-08T05:37:36.448 DEBUG:teuthology.orchestra.run.smithi160:> sudo pkill -f 'journalctl -f -n 0 -u ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968@mds.i.service' 2024-05-08T05:37:36.470 INFO:journalctl@ceph.mds.i.smithi160.stdout:May 08 05:37:36 smithi160 podman[70859]: 2024-05-08 05:37:36.220543601 +0000 UTC m=+0.625772981 container remove 5c35f6636ad12ecd21dddc0cc55304814dff163a7e010ea33dd0bcce4644c9f2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c, name=ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-mds-i, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, ceph=True, org.label-schema.build-date=20240507, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-57676-3-bee299f) 2024-05-08T05:37:36.470 INFO:journalctl@ceph.mds.i.smithi160.stdout:May 08 05:37:36 smithi160 systemd[1]: ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968@mds.i.service: Deactivated successfully. 2024-05-08T05:37:36.470 INFO:journalctl@ceph.mds.i.smithi160.stdout:May 08 05:37:36 smithi160 systemd[1]: Stopped Ceph mds.i for eeeb813e-0cf9-11ef-bc97-c7b262605968. 2024-05-08T05:37:36.470 INFO:journalctl@ceph.mds.i.smithi160.stdout:May 08 05:37:36 smithi160 systemd[1]: ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968@mds.i.service: Consumed 49.281s CPU time. 2024-05-08T05:37:36.479 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-08T05:37:36.480 INFO:tasks.cephadm.mds.i:Stopped mds.i 2024-05-08T05:37:36.480 INFO:tasks.cephadm.mds.l:Stopping mds.l... 2024-05-08T05:37:36.480 DEBUG:teuthology.orchestra.run.smithi160:> sudo systemctl stop ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968@mds.l 2024-05-08T05:37:36.788 INFO:journalctl@ceph.mds.l.smithi160.stdout:May 08 05:37:36 smithi160 systemd[1]: Stopping Ceph mds.l for eeeb813e-0cf9-11ef-bc97-c7b262605968... 2024-05-08T05:37:37.288 INFO:journalctl@ceph.mds.l.smithi160.stdout:May 08 05:37:36 smithi160 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-mds-l[64852]: 2024-05-08T05:37:36.797+0000 7fb5432d4700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.l -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-05-08T05:37:37.289 INFO:journalctl@ceph.mds.l.smithi160.stdout:May 08 05:37:36 smithi160 ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-mds-l[64852]: 2024-05-08T05:37:36.797+0000 7fb5432d4700 -1 mds.l *** got signal Terminated *** 2024-05-08T05:37:41.231 INFO:journalctl@ceph.mds.l.smithi160.stdout:May 08 05:37:40 smithi160 podman[70967]: 2024-05-08 05:37:40.80283148 +0000 UTC m=+4.113199838 container died a62338cea060a15f4574abd7112ee9aba3d628a8a642376157a54d0fe4a4b53e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c, name=ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-mds-l, GIT_BRANCH=HEAD, org.label-schema.build-date=20240507, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-57676-3-bee299f, io.buildah.version=1.33.5, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, ceph=True) 2024-05-08T05:37:41.523 INFO:journalctl@ceph.mds.l.smithi160.stdout:May 08 05:37:41 smithi160 podman[70967]: 2024-05-08 05:37:41.314364227 +0000 UTC m=+4.624732580 container cleanup a62338cea060a15f4574abd7112ee9aba3d628a8a642376157a54d0fe4a4b53e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c, name=ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-mds-l, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, ceph=True, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.license=GPLv2, RELEASE=wip-57676-3-bee299f, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240507, CEPH_POINT_RELEASE=) 2024-05-08T05:37:41.523 INFO:journalctl@ceph.mds.l.smithi160.stdout:May 08 05:37:41 smithi160 bash[70967]: ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968-mds-l 2024-05-08T05:37:41.657 DEBUG:teuthology.orchestra.run.smithi160:> sudo pkill -f 'journalctl -f -n 0 -u ceph-eeeb813e-0cf9-11ef-bc97-c7b262605968@mds.l.service' 2024-05-08T05:37:41.687 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-08T05:37:41.687 INFO:tasks.cephadm.mds.l:Stopped mds.l 2024-05-08T05:37:41.688 DEBUG:teuthology.orchestra.run.smithi087:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid eeeb813e-0cf9-11ef-bc97-c7b262605968 --force --keep-logs 2024-05-08T05:37:42.011 INFO:teuthology.orchestra.run.smithi087.stdout:Deleting cluster with fsid: eeeb813e-0cf9-11ef-bc97-c7b262605968 2024-05-08T05:37:46.749 DEBUG:teuthology.orchestra.run.smithi090:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid eeeb813e-0cf9-11ef-bc97-c7b262605968 --force --keep-logs 2024-05-08T05:37:46.938 INFO:teuthology.orchestra.run.smithi090.stdout:Deleting cluster with fsid: eeeb813e-0cf9-11ef-bc97-c7b262605968 2024-05-08T05:37:49.307 DEBUG:teuthology.orchestra.run.smithi160:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid eeeb813e-0cf9-11ef-bc97-c7b262605968 --force --keep-logs 2024-05-08T05:37:49.498 INFO:teuthology.orchestra.run.smithi160.stdout:Deleting cluster with fsid: eeeb813e-0cf9-11ef-bc97-c7b262605968 2024-05-08T05:37:51.808 DEBUG:teuthology.orchestra.run.smithi087:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-05-08T05:37:51.902 DEBUG:teuthology.orchestra.run.smithi090:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-05-08T05:37:51.933 DEBUG:teuthology.orchestra.run.smithi160:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-05-08T05:37:51.963 INFO:tasks.cephadm:Archiving crash dumps... 2024-05-08T05:37:51.964 DEBUG:teuthology.misc:Transferring archived files from smithi087:/var/lib/ceph/eeeb813e-0cf9-11ef-bc97-c7b262605968/crash to /home/teuthworker/archive/vshankar-2024-05-08_04:00:39-fs:workload-wip-57676-3-testing-default-smithi/7697229/remote/smithi087/crash 2024-05-08T05:37:51.965 DEBUG:teuthology.orchestra.run.smithi087:> sudo tar c -f - -C /var/lib/ceph/eeeb813e-0cf9-11ef-bc97-c7b262605968/crash -- . 2024-05-08T05:37:52.051 INFO:teuthology.orchestra.run.smithi087.stderr:tar: /var/lib/ceph/eeeb813e-0cf9-11ef-bc97-c7b262605968/crash: Cannot open: No such file or directory 2024-05-08T05:37:52.051 INFO:teuthology.orchestra.run.smithi087.stderr:tar: Error is not recoverable: exiting now 2024-05-08T05:37:52.056 DEBUG:teuthology.misc:Transferring archived files from smithi090:/var/lib/ceph/eeeb813e-0cf9-11ef-bc97-c7b262605968/crash to /home/teuthworker/archive/vshankar-2024-05-08_04:00:39-fs:workload-wip-57676-3-testing-default-smithi/7697229/remote/smithi090/crash 2024-05-08T05:37:52.057 DEBUG:teuthology.orchestra.run.smithi090:> sudo tar c -f - -C /var/lib/ceph/eeeb813e-0cf9-11ef-bc97-c7b262605968/crash -- . 2024-05-08T05:37:52.108 INFO:teuthology.orchestra.run.smithi090.stderr:tar: /var/lib/ceph/eeeb813e-0cf9-11ef-bc97-c7b262605968/crash: Cannot open: No such file or directory 2024-05-08T05:37:52.108 INFO:teuthology.orchestra.run.smithi090.stderr:tar: Error is not recoverable: exiting now 2024-05-08T05:37:52.110 DEBUG:teuthology.misc:Transferring archived files from smithi160:/var/lib/ceph/eeeb813e-0cf9-11ef-bc97-c7b262605968/crash to /home/teuthworker/archive/vshankar-2024-05-08_04:00:39-fs:workload-wip-57676-3-testing-default-smithi/7697229/remote/smithi160/crash 2024-05-08T05:37:52.111 DEBUG:teuthology.orchestra.run.smithi160:> sudo tar c -f - -C /var/lib/ceph/eeeb813e-0cf9-11ef-bc97-c7b262605968/crash -- . 2024-05-08T05:37:52.150 INFO:teuthology.orchestra.run.smithi160.stderr:tar: /var/lib/ceph/eeeb813e-0cf9-11ef-bc97-c7b262605968/crash: Cannot open: No such file or directory 2024-05-08T05:37:52.150 INFO:teuthology.orchestra.run.smithi160.stderr:tar: Error is not recoverable: exiting now 2024-05-08T05:37:52.151 INFO:tasks.cephadm:Checking cluster log for badness... 2024-05-08T05:37:52.152 DEBUG:teuthology.orchestra.run.smithi087:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/eeeb813e-0cf9-11ef-bc97-c7b262605968/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v FS_DEGRADED | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v 'filesystem is online with fewer MDS than max_mds' | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'do not have an application enabled' | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'deprecated feature inline_data' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v PG_AVAILABILITY | egrep -v PG_DEGRADED | egrep -v 'Reduced data availability' | egrep -v 'slow metadata IO' | egrep -v SLOW_OPS | egrep -v 'slow request' | head -n 1 2024-05-08T05:37:52.257 INFO:tasks.cephadm:Compressing logs... 2024-05-08T05:37:52.258 DEBUG:teuthology.orchestra.run.smithi087:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-05-08T05:37:52.262 DEBUG:teuthology.orchestra.run.smithi090:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-05-08T05:37:52.266 DEBUG:teuthology.orchestra.run.smithi160:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-05-08T05:37:52.303 INFO:teuthology.orchestra.run.smithi160.stderr:find: ‘/var/log/rbd-target-api’gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-05-08T05:37:52.303 INFO:teuthology.orchestra.run.smithi160.stderr:: No such file or directory 2024-05-08T05:37:52.304 INFO:teuthology.orchestra.run.smithi160.stderr:gzip -5 --verbose -- /var/log/ceph/eeeb813e-0cf9-11ef-bc97-c7b262605968/ceph.log 2024-05-08T05:37:52.304 INFO:teuthology.orchestra.run.smithi160.stderr:/var/log/ceph/cephadm.log: gzip -5 --verbose -- /var/log/ceph/eeeb813e-0cf9-11ef-bc97-c7b262605968/ceph-osd.2.log 2024-05-08T05:37:52.304 INFO:teuthology.orchestra.run.smithi160.stderr:/var/log/ceph/eeeb813e-0cf9-11ef-bc97-c7b262605968/ceph.log: gzip -5 --verbose -- /var/log/ceph/eeeb813e-0cf9-11ef-bc97-c7b262605968/ceph-mds.f.log 2024-05-08T05:37:52.304 INFO:teuthology.orchestra.run.smithi160.stderr:/var/log/ceph/eeeb813e-0cf9-11ef-bc97-c7b262605968/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/eeeb813e-0cf9-11ef-bc97-c7b262605968/ceph.audit.log 2024-05-08T05:37:52.304 INFO:teuthology.orchestra.run.smithi160.stderr:/var/log/ceph/eeeb813e-0cf9-11ef-bc97-c7b262605968/ceph-mds.f.log: gzip -5 --verbose -- /var/log/ceph/eeeb813e-0cf9-11ef-bc97-c7b262605968/ceph-osd.5.log 2024-05-08T05:37:52.304 INFO:teuthology.orchestra.run.smithi160.stderr: 92.4% -- replaced with /var/log/ceph/cephadm.log.gz 2024-05-08T05:37:52.304 INFO:teuthology.orchestra.run.smithi160.stderr:/var/log/ceph/eeeb813e-0cf9-11ef-bc97-c7b262605968/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/eeeb813e-0cf9-11ef-bc97-c7b262605968/ceph-mds.c.log 2024-05-08T05:37:52.304 INFO:teuthology.orchestra.run.smithi160.stderr:gzip -5 --verbose -- /var/log/ceph/eeeb813e-0cf9-11ef-bc97-c7b262605968/ceph-mon.c.log 2024-05-08T05:37:52.304 INFO:teuthology.orchestra.run.smithi160.stderr:/var/log/ceph/eeeb813e-0cf9-11ef-bc97-c7b262605968/ceph-osd.5.log: /var/log/ceph/eeeb813e-0cf9-11ef-bc97-c7b262605968/ceph-mds.c.log: gzip -5 --verbose -- /var/log/ceph/eeeb813e-0cf9-11ef-bc97-c7b262605968/ceph-mgr.z.log 2024-05-08T05:37:52.304 INFO:teuthology.orchestra.run.smithi160.stderr:/var/log/ceph/eeeb813e-0cf9-11ef-bc97-c7b262605968/ceph-mon.c.log: gzip -5 --verbose -- /var/log/ceph/eeeb813e-0cf9-11ef-bc97-c7b262605968/ceph-mds.i.log 2024-05-08T05:37:52.304 INFO:teuthology.orchestra.run.smithi160.stderr: 86.8% -- replaced with /var/log/ceph/eeeb813e-0cf9-11ef-bc97-c7b262605968/ceph.log.gz 2024-05-08T05:37:52.305 INFO:teuthology.orchestra.run.smithi160.stderr:/var/log/ceph/eeeb813e-0cf9-11ef-bc97-c7b262605968/ceph-mgr.z.log: gzip -5 --verbose -- /var/log/ceph/eeeb813e-0cf9-11ef-bc97-c7b262605968/ceph.cephadm.log 2024-05-08T05:37:52.305 INFO:teuthology.orchestra.run.smithi160.stderr:/var/log/ceph/eeeb813e-0cf9-11ef-bc97-c7b262605968/ceph-mds.i.log: 90.4% -- replaced with /var/log/ceph/eeeb813e-0cf9-11ef-bc97-c7b262605968/ceph.audit.log.gz 2024-05-08T05:37:52.305 INFO:teuthology.orchestra.run.smithi160.stderr:gzip -5 --verbose -- /var/log/ceph/eeeb813e-0cf9-11ef-bc97-c7b262605968/ceph-osd.11.log 2024-05-08T05:37:52.305 INFO:teuthology.orchestra.run.smithi160.stderr:/var/log/ceph/eeeb813e-0cf9-11ef-bc97-c7b262605968/ceph.cephadm.log: 82.0% -- replaced with /var/log/ceph/eeeb813e-0cf9-11ef-bc97-c7b262605968/ceph.cephadm.log.gz 2024-05-08T05:37:52.305 INFO:teuthology.orchestra.run.smithi160.stderr:gzip -5 --verbose -- /var/log/ceph/eeeb813e-0cf9-11ef-bc97-c7b262605968/ceph-osd.8.log 2024-05-08T05:37:52.305 INFO:teuthology.orchestra.run.smithi160.stderr:/var/log/ceph/eeeb813e-0cf9-11ef-bc97-c7b262605968/ceph-osd.11.log: 92.7% -- replaced with /var/log/ceph/eeeb813e-0cf9-11ef-bc97-c7b262605968/ceph-mgr.z.log.gz 2024-05-08T05:37:52.305 INFO:teuthology.orchestra.run.smithi160.stderr:gzip -5 --verbose -- /var/log/ceph/eeeb813e-0cf9-11ef-bc97-c7b262605968/ceph-volume.log 2024-05-08T05:37:52.306 INFO:teuthology.orchestra.run.smithi090.stderr:find: ‘/var/log/rbd-target-api’gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-05-08T05:37:52.306 INFO:teuthology.orchestra.run.smithi090.stderr:: No such file or directory 2024-05-08T05:37:52.306 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/eeeb813e-0cf9-11ef-bc97-c7b262605968/ceph.log 2024-05-08T05:37:52.306 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/cephadm.log: gzip -5 --verbose -- /var/log/ceph/eeeb813e-0cf9-11ef-bc97-c7b262605968/ceph.audit.log 2024-05-08T05:37:52.306 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/eeeb813e-0cf9-11ef-bc97-c7b262605968/ceph.log: gzip -5 --verbose -- /var/log/ceph/eeeb813e-0cf9-11ef-bc97-c7b262605968/ceph-osd.7.log 2024-05-08T05:37:52.306 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/eeeb813e-0cf9-11ef-bc97-c7b262605968/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/eeeb813e-0cf9-11ef-bc97-c7b262605968/ceph-mds.b.log 2024-05-08T05:37:52.306 INFO:teuthology.orchestra.run.smithi090.stderr: 92.2% -- replaced with /var/log/ceph/cephadm.log.gz 2024-05-08T05:37:52.306 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/eeeb813e-0cf9-11ef-bc97-c7b262605968/ceph-osd.7.log: gzip -5 --verbose -- /var/log/ceph/eeeb813e-0cf9-11ef-bc97-c7b262605968/ceph-osd.4.log 2024-05-08T05:37:52.307 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/eeeb813e-0cf9-11ef-bc97-c7b262605968/ceph-mds.b.log: gzip -5 --verbose -- /var/log/ceph/eeeb813e-0cf9-11ef-bc97-c7b262605968/ceph-osd.1.log 2024-05-08T05:37:52.307 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/eeeb813e-0cf9-11ef-bc97-c7b262605968/ceph-osd.4.log: gzip -5 --verbose -- /var/log/ceph/eeeb813e-0cf9-11ef-bc97-c7b262605968/ceph-mgr.y.log 2024-05-08T05:37:52.307 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/eeeb813e-0cf9-11ef-bc97-c7b262605968/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/eeeb813e-0cf9-11ef-bc97-c7b262605968/ceph-mds.h.log 2024-05-08T05:37:52.307 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/eeeb813e-0cf9-11ef-bc97-c7b262605968/ceph-mgr.y.log: gzip -5 --verbose -- /var/log/ceph/eeeb813e-0cf9-11ef-bc97-c7b262605968/ceph-osd.10.log 2024-05-08T05:37:52.307 INFO:teuthology.orchestra.run.smithi090.stderr: 86.8% -- replaced with /var/log/ceph/eeeb813e-0cf9-11ef-bc97-c7b262605968/ceph.log.gz 2024-05-08T05:37:52.307 INFO:teuthology.orchestra.run.smithi090.stderr: 90.4% -- replaced with /var/log/ceph/eeeb813e-0cf9-11ef-bc97-c7b262605968/ceph.audit.log.gz 2024-05-08T05:37:52.307 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/eeeb813e-0cf9-11ef-bc97-c7b262605968/ceph-mds.h.log: gzip -5 --verbose -- /var/log/ceph/eeeb813e-0cf9-11ef-bc97-c7b262605968/ceph.cephadm.log 2024-05-08T05:37:52.307 INFO:teuthology.orchestra.run.smithi090.stderr:gzip/var/log/ceph/eeeb813e-0cf9-11ef-bc97-c7b262605968/ceph-osd.10.log: -5 --verbose -- /var/log/ceph/eeeb813e-0cf9-11ef-bc97-c7b262605968/ceph-mds.e.log 2024-05-08T05:37:52.307 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/eeeb813e-0cf9-11ef-bc97-c7b262605968/ceph.cephadm.log: 82.0% -- replaced with /var/log/ceph/eeeb813e-0cf9-11ef-bc97-c7b262605968/ceph.cephadm.log.gz 2024-05-08T05:37:52.307 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/eeeb813e-0cf9-11ef-bc97-c7b262605968/ceph-volume.log 2024-05-08T05:37:52.307 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/eeeb813e-0cf9-11ef-bc97-c7b262605968/ceph-mds.e.log: 92.6% -- replaced with /var/log/ceph/eeeb813e-0cf9-11ef-bc97-c7b262605968/ceph-mgr.y.log.gz 2024-05-08T05:37:52.307 INFO:teuthology.orchestra.run.smithi090.stderr: 94.5% -- replaced with /var/log/ceph/eeeb813e-0cf9-11ef-bc97-c7b262605968/ceph-mds.e.log.gz 2024-05-08T05:37:52.307 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/eeeb813e-0cf9-11ef-bc97-c7b262605968/ceph-mon.b.log 2024-05-08T05:37:52.307 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/eeeb813e-0cf9-11ef-bc97-c7b262605968/ceph-volume.log: gzip -5 --verbose -- /var/log/ceph/eeeb813e-0cf9-11ef-bc97-c7b262605968/ceph-mds.k.log 2024-05-08T05:37:52.313 INFO:teuthology.orchestra.run.smithi160.stderr:/var/log/ceph/eeeb813e-0cf9-11ef-bc97-c7b262605968/ceph-osd.8.log: gzip -5 --verbose -- /var/log/ceph/eeeb813e-0cf9-11ef-bc97-c7b262605968/ceph-mds.l.log 2024-05-08T05:37:52.314 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/eeeb813e-0cf9-11ef-bc97-c7b262605968/ceph-mon.b.log: 91.0% -- replaced with /var/log/ceph/eeeb813e-0cf9-11ef-bc97-c7b262605968/ceph-volume.log.gz 2024-05-08T05:37:52.317 INFO:teuthology.orchestra.run.smithi087.stderr:find: ‘/var/log/rbd-target-api’gzip -5 --verbose -- /var/log/ceph/cephadm.log: No such file or directory 2024-05-08T05:37:52.317 INFO:teuthology.orchestra.run.smithi087.stderr: 2024-05-08T05:37:52.318 INFO:teuthology.orchestra.run.smithi087.stderr:gzip -5 --verbose -- /var/log/ceph/eeeb813e-0cf9-11ef-bc97-c7b262605968/ceph.log 2024-05-08T05:37:52.319 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/cephadm.log: gzip -5 --verbose -- /var/log/ceph/eeeb813e-0cf9-11ef-bc97-c7b262605968/ceph.audit.log 2024-05-08T05:37:52.320 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/eeeb813e-0cf9-11ef-bc97-c7b262605968/ceph.log: gzip -5 --verbose -- /var/log/ceph/eeeb813e-0cf9-11ef-bc97-c7b262605968/ceph-mds.g.log 2024-05-08T05:37:52.321 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/eeeb813e-0cf9-11ef-bc97-c7b262605968/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/eeeb813e-0cf9-11ef-bc97-c7b262605968/ceph-mds.j.log 2024-05-08T05:37:52.322 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/eeeb813e-0cf9-11ef-bc97-c7b262605968/ceph-mds.g.log: 86.8% -- replaced with /var/log/ceph/eeeb813e-0cf9-11ef-bc97-c7b262605968/ceph.log.gz 2024-05-08T05:37:52.323 INFO:teuthology.orchestra.run.smithi087.stderr:gzip -5 --verbose -- /var/log/ceph/eeeb813e-0cf9-11ef-bc97-c7b262605968/ceph-osd.3.log 2024-05-08T05:37:52.324 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/eeeb813e-0cf9-11ef-bc97-c7b262605968/ceph-mds.j.log: 90.2% -- replaced with /var/log/ceph/eeeb813e-0cf9-11ef-bc97-c7b262605968/ceph.audit.log.gz 2024-05-08T05:37:52.324 INFO:teuthology.orchestra.run.smithi087.stderr:gzip -5 --verbose -- /var/log/ceph/eeeb813e-0cf9-11ef-bc97-c7b262605968/ceph-osd.0.log 2024-05-08T05:37:52.325 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/eeeb813e-0cf9-11ef-bc97-c7b262605968/ceph-osd.3.log: gzip -5 --verbose -- /var/log/ceph/eeeb813e-0cf9-11ef-bc97-c7b262605968/ceph-mgr.x.log 2024-05-08T05:37:52.326 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/eeeb813e-0cf9-11ef-bc97-c7b262605968/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/eeeb813e-0cf9-11ef-bc97-c7b262605968/ceph-mon.a.log 2024-05-08T05:37:52.328 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/eeeb813e-0cf9-11ef-bc97-c7b262605968/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/eeeb813e-0cf9-11ef-bc97-c7b262605968/ceph-osd.6.log 2024-05-08T05:37:52.329 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/eeeb813e-0cf9-11ef-bc97-c7b262605968/ceph-mon.a.log: 94.7% -- replaced with /var/log/ceph/eeeb813e-0cf9-11ef-bc97-c7b262605968/ceph-mds.j.log.gz 2024-05-08T05:37:52.329 INFO:teuthology.orchestra.run.smithi087.stderr: 93.9% -- replaced with /var/log/ceph/cephadm.log.gz 2024-05-08T05:37:52.332 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/eeeb813e-0cf9-11ef-bc97-c7b262605968/ceph-osd.6.log: gzip -5 --verbose -- /var/log/ceph/eeeb813e-0cf9-11ef-bc97-c7b262605968/ceph.cephadm.log 2024-05-08T05:37:52.332 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/eeeb813e-0cf9-11ef-bc97-c7b262605968/ceph-mds.k.log: 94.6% -- replaced with /var/log/ceph/eeeb813e-0cf9-11ef-bc97-c7b262605968/ceph-mds.k.log.gz 2024-05-08T05:37:52.333 INFO:teuthology.orchestra.run.smithi087.stderr:gzip -5 --verbose -- /var/log/ceph/eeeb813e-0cf9-11ef-bc97-c7b262605968/ceph-mds.a.log 2024-05-08T05:37:52.334 INFO:teuthology.orchestra.run.smithi160.stderr:/var/log/ceph/eeeb813e-0cf9-11ef-bc97-c7b262605968/ceph-volume.log: /var/log/ceph/eeeb813e-0cf9-11ef-bc97-c7b262605968/ceph-mds.l.log: 94.8% -- replaced with /var/log/ceph/eeeb813e-0cf9-11ef-bc97-c7b262605968/ceph-mds.l.log.gz 2024-05-08T05:37:52.334 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/eeeb813e-0cf9-11ef-bc97-c7b262605968/ceph.cephadm.log: 82.5% -- replaced with /var/log/ceph/eeeb813e-0cf9-11ef-bc97-c7b262605968/ceph.cephadm.log.gz 2024-05-08T05:37:52.335 INFO:teuthology.orchestra.run.smithi087.stderr:gzip -5 --verbose -- /var/log/ceph/eeeb813e-0cf9-11ef-bc97-c7b262605968/ceph-volume.log 2024-05-08T05:37:52.338 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/eeeb813e-0cf9-11ef-bc97-c7b262605968/ceph-mds.a.log: /var/log/ceph/eeeb813e-0cf9-11ef-bc97-c7b262605968/ceph-volume.log: gzip -5 --verbose -- /var/log/ceph/eeeb813e-0cf9-11ef-bc97-c7b262605968/ceph-mds.d.log 2024-05-08T05:37:52.339 INFO:teuthology.orchestra.run.smithi160.stderr: 91.0% -- replaced with /var/log/ceph/eeeb813e-0cf9-11ef-bc97-c7b262605968/ceph-volume.log.gz 2024-05-08T05:37:52.340 INFO:teuthology.orchestra.run.smithi087.stderr: 94.5% -- replaced with /var/log/ceph/eeeb813e-0cf9-11ef-bc97-c7b262605968/ceph-mds.a.log.gz 2024-05-08T05:37:52.341 INFO:teuthology.orchestra.run.smithi087.stderr:gzip -5 --verbose -- /var/log/ceph/eeeb813e-0cf9-11ef-bc97-c7b262605968/ceph-osd.9.log 2024-05-08T05:37:52.347 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/eeeb813e-0cf9-11ef-bc97-c7b262605968/ceph-mds.d.log: /var/log/ceph/eeeb813e-0cf9-11ef-bc97-c7b262605968/ceph-osd.9.log: 94.5% -- replaced with /var/log/ceph/eeeb813e-0cf9-11ef-bc97-c7b262605968/ceph-mds.d.log.gz 2024-05-08T05:37:52.359 INFO:teuthology.orchestra.run.smithi087.stderr: 90.9% -- replaced with /var/log/ceph/eeeb813e-0cf9-11ef-bc97-c7b262605968/ceph-volume.log.gz 2024-05-08T05:37:52.594 INFO:teuthology.orchestra.run.smithi087.stderr: 90.0% -- replaced with /var/log/ceph/eeeb813e-0cf9-11ef-bc97-c7b262605968/ceph-mgr.x.log.gz 2024-05-08T05:37:52.673 INFO:teuthology.orchestra.run.smithi160.stderr: 91.8% -- replaced with /var/log/ceph/eeeb813e-0cf9-11ef-bc97-c7b262605968/ceph-mon.c.log.gz 2024-05-08T05:37:52.702 INFO:teuthology.orchestra.run.smithi090.stderr: 91.8% -- replaced with /var/log/ceph/eeeb813e-0cf9-11ef-bc97-c7b262605968/ceph-mon.b.log.gz 2024-05-08T05:37:53.356 INFO:teuthology.orchestra.run.smithi087.stderr: 90.5% -- replaced with /var/log/ceph/eeeb813e-0cf9-11ef-bc97-c7b262605968/ceph-mon.a.log.gz 2024-05-08T05:37:53.360 INFO:teuthology.orchestra.run.smithi087.stderr: 93.6% -- replaced with /var/log/ceph/eeeb813e-0cf9-11ef-bc97-c7b262605968/ceph-osd.9.log.gz 2024-05-08T05:37:53.546 INFO:teuthology.orchestra.run.smithi090.stderr: 95.4% -- replaced with /var/log/ceph/eeeb813e-0cf9-11ef-bc97-c7b262605968/ceph-mds.h.log.gz 2024-05-08T05:37:53.853 INFO:teuthology.orchestra.run.smithi090.stderr: 93.6% -- replaced with /var/log/ceph/eeeb813e-0cf9-11ef-bc97-c7b262605968/ceph-osd.4.log.gz 2024-05-08T05:37:54.036 INFO:teuthology.orchestra.run.smithi160.stderr: 95.4% -- replaced with /var/log/ceph/eeeb813e-0cf9-11ef-bc97-c7b262605968/ceph-mds.f.log.gz 2024-05-08T05:37:54.299 INFO:teuthology.orchestra.run.smithi160.stderr: 95.2% -- replaced with /var/log/ceph/eeeb813e-0cf9-11ef-bc97-c7b262605968/ceph-mds.c.log.gz 2024-05-08T05:37:54.303 INFO:teuthology.orchestra.run.smithi087.stderr: 93.5% -- replaced with /var/log/ceph/eeeb813e-0cf9-11ef-bc97-c7b262605968/ceph-osd.3.log.gz 2024-05-08T05:37:54.346 INFO:teuthology.orchestra.run.smithi090.stderr: 93.6% -- replaced with /var/log/ceph/eeeb813e-0cf9-11ef-bc97-c7b262605968/ceph-osd.10.log.gz 2024-05-08T05:37:54.352 INFO:teuthology.orchestra.run.smithi160.stderr: 93.6% -- replaced with /var/log/ceph/eeeb813e-0cf9-11ef-bc97-c7b262605968/ceph-osd.8.log.gz 2024-05-08T05:37:54.396 INFO:teuthology.orchestra.run.smithi160.stderr: 93.7% -- replaced with /var/log/ceph/eeeb813e-0cf9-11ef-bc97-c7b262605968/ceph-osd.11.log.gz 2024-05-08T05:37:54.403 INFO:teuthology.orchestra.run.smithi090.stderr: 93.7% -- replaced with /var/log/ceph/eeeb813e-0cf9-11ef-bc97-c7b262605968/ceph-osd.1.log.gz 2024-05-08T05:37:54.417 INFO:teuthology.orchestra.run.smithi087.stderr: 93.6% -- replaced with /var/log/ceph/eeeb813e-0cf9-11ef-bc97-c7b262605968/ceph-osd.0.log.gz 2024-05-08T05:37:54.452 INFO:teuthology.orchestra.run.smithi160.stderr: 93.6% -- replaced with /var/log/ceph/eeeb813e-0cf9-11ef-bc97-c7b262605968/ceph-osd.2.log.gz 2024-05-08T05:37:54.469 INFO:teuthology.orchestra.run.smithi087.stderr: 93.6% -- replaced with /var/log/ceph/eeeb813e-0cf9-11ef-bc97-c7b262605968/ceph-osd.6.log.gz 2024-05-08T05:37:54.631 INFO:teuthology.orchestra.run.smithi160.stderr: 93.7% -- replaced with /var/log/ceph/eeeb813e-0cf9-11ef-bc97-c7b262605968/ceph-osd.5.log.gz 2024-05-08T05:37:54.746 INFO:teuthology.orchestra.run.smithi090.stderr: 93.8% -- replaced with /var/log/ceph/eeeb813e-0cf9-11ef-bc97-c7b262605968/ceph-osd.7.log.gz 2024-05-08T05:38:07.908 INFO:teuthology.orchestra.run.smithi160.stderr: 93.7% -- replaced with /var/log/ceph/eeeb813e-0cf9-11ef-bc97-c7b262605968/ceph-mds.i.log.gz 2024-05-08T05:38:07.910 INFO:teuthology.orchestra.run.smithi160.stderr: 2024-05-08T05:38:07.910 INFO:teuthology.orchestra.run.smithi160.stderr:real 0m15.629s 2024-05-08T05:38:07.910 INFO:teuthology.orchestra.run.smithi160.stderr:user 0m27.472s 2024-05-08T05:38:07.910 INFO:teuthology.orchestra.run.smithi160.stderr:sys 0m0.916s 2024-05-08T05:38:10.215 INFO:teuthology.orchestra.run.smithi087.stderr: 93.5% -- replaced with /var/log/ceph/eeeb813e-0cf9-11ef-bc97-c7b262605968/ceph-mds.g.log.gz 2024-05-08T05:38:10.220 INFO:teuthology.orchestra.run.smithi087.stderr: 2024-05-08T05:38:10.220 INFO:teuthology.orchestra.run.smithi087.stderr:real 0m17.925s 2024-05-08T05:38:10.221 INFO:teuthology.orchestra.run.smithi087.stderr:user 0m24.540s 2024-05-08T05:38:10.221 INFO:teuthology.orchestra.run.smithi087.stderr:sys 0m1.993s 2024-05-08T05:38:16.066 INFO:teuthology.orchestra.run.smithi090.stderr: 93.2% -- replaced with /var/log/ceph/eeeb813e-0cf9-11ef-bc97-c7b262605968/ceph-mds.b.log.gz 2024-05-08T05:38:16.068 INFO:teuthology.orchestra.run.smithi090.stderr: 2024-05-08T05:38:16.068 INFO:teuthology.orchestra.run.smithi090.stderr:real 0m23.789s 2024-05-08T05:38:16.068 INFO:teuthology.orchestra.run.smithi090.stderr:user 0m32.565s 2024-05-08T05:38:16.068 INFO:teuthology.orchestra.run.smithi090.stderr:sys 0m1.046s 2024-05-08T05:38:16.068 INFO:tasks.cephadm:Archiving logs... 2024-05-08T05:38:16.070 DEBUG:teuthology.misc:Transferring archived files from smithi087:/var/log/ceph to /home/teuthworker/archive/vshankar-2024-05-08_04:00:39-fs:workload-wip-57676-3-testing-default-smithi/7697229/remote/smithi087/log 2024-05-08T05:38:16.070 DEBUG:teuthology.orchestra.run.smithi087:> sudo tar c -f - -C /var/log/ceph -- . 2024-05-08T05:38:19.776 DEBUG:teuthology.misc:Transferring archived files from smithi090:/var/log/ceph to /home/teuthworker/archive/vshankar-2024-05-08_04:00:39-fs:workload-wip-57676-3-testing-default-smithi/7697229/remote/smithi090/log 2024-05-08T05:38:19.777 DEBUG:teuthology.orchestra.run.smithi090:> sudo tar c -f - -C /var/log/ceph -- . 2024-05-08T05:38:24.491 DEBUG:teuthology.misc:Transferring archived files from smithi160:/var/log/ceph to /home/teuthworker/archive/vshankar-2024-05-08_04:00:39-fs:workload-wip-57676-3-testing-default-smithi/7697229/remote/smithi160/log 2024-05-08T05:38:24.492 DEBUG:teuthology.orchestra.run.smithi160:> sudo tar c -f - -C /var/log/ceph -- . 2024-05-08T05:38:27.935 INFO:tasks.cephadm:Removing cluster... 2024-05-08T05:38:27.936 DEBUG:teuthology.orchestra.run.smithi087:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid eeeb813e-0cf9-11ef-bc97-c7b262605968 --force 2024-05-08T05:38:28.250 INFO:teuthology.orchestra.run.smithi087.stdout:Deleting cluster with fsid: eeeb813e-0cf9-11ef-bc97-c7b262605968 2024-05-08T05:38:28.844 DEBUG:teuthology.orchestra.run.smithi090:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid eeeb813e-0cf9-11ef-bc97-c7b262605968 --force 2024-05-08T05:38:29.032 INFO:teuthology.orchestra.run.smithi090.stdout:Deleting cluster with fsid: eeeb813e-0cf9-11ef-bc97-c7b262605968 2024-05-08T05:38:29.323 DEBUG:teuthology.orchestra.run.smithi160:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid eeeb813e-0cf9-11ef-bc97-c7b262605968 --force 2024-05-08T05:38:29.515 INFO:teuthology.orchestra.run.smithi160.stdout:Deleting cluster with fsid: eeeb813e-0cf9-11ef-bc97-c7b262605968 2024-05-08T05:38:29.794 INFO:tasks.cephadm:Removing cephadm ... 2024-05-08T05:38:29.794 DEBUG:teuthology.orchestra.run.smithi087:> rm -rf /home/ubuntu/cephtest/cephadm 2024-05-08T05:38:29.853 DEBUG:teuthology.orchestra.run.smithi090:> rm -rf /home/ubuntu/cephtest/cephadm 2024-05-08T05:38:29.869 DEBUG:teuthology.orchestra.run.smithi160:> rm -rf /home/ubuntu/cephtest/cephadm 2024-05-08T05:38:29.884 INFO:tasks.cephadm:Teardown complete 2024-05-08T05:38:29.884 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-05-08T05:38:29.895 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-05-08T05:38:29.896 DEBUG:teuthology.orchestra.run.smithi087:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-05-08T05:38:29.903 DEBUG:teuthology.orchestra.run.smithi090:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-05-08T05:38:29.912 DEBUG:teuthology.orchestra.run.smithi160:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-05-08T05:38:30.060 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-05-08T05:38:30.071 INFO:teuthology.task.clock:Checking final clock skew... 2024-05-08T05:38:30.071 DEBUG:teuthology.orchestra.run.smithi087:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-05-08T05:38:30.079 DEBUG:teuthology.orchestra.run.smithi090:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-05-08T05:38:30.081 DEBUG:teuthology.orchestra.run.smithi160:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-05-08T05:38:30.093 INFO:teuthology.orchestra.run.smithi090.stderr:bash: line 1: ntpq: command not found 2024-05-08T05:38:30.095 INFO:teuthology.orchestra.run.smithi160.stderr:bash: line 1: ntpq: command not found 2024-05-08T05:38:30.098 INFO:teuthology.orchestra.run.smithi090.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-05-08T05:38:30.098 INFO:teuthology.orchestra.run.smithi090.stdout:=============================================================================== 2024-05-08T05:38:30.098 INFO:teuthology.orchestra.run.smithi090.stdout:^* hv01.front.sepia.ceph.com 3 6 377 37 +167us[ +147us] +/- 64ms 2024-05-08T05:38:30.098 INFO:teuthology.orchestra.run.smithi090.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 37 -20us[ -20us] +/- 56ms 2024-05-08T05:38:30.099 INFO:teuthology.orchestra.run.smithi090.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 33 -181us[ -181us] +/- 70ms 2024-05-08T05:38:30.099 INFO:teuthology.orchestra.run.smithi090.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-05-08T05:38:30.100 INFO:teuthology.orchestra.run.smithi160.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-05-08T05:38:30.100 INFO:teuthology.orchestra.run.smithi160.stdout:=============================================================================== 2024-05-08T05:38:30.100 INFO:teuthology.orchestra.run.smithi160.stdout:^* hv01.front.sepia.ceph.com 3 7 377 34 +201us[ +167us] +/- 64ms 2024-05-08T05:38:30.100 INFO:teuthology.orchestra.run.smithi160.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 34 -34us[ -67us] +/- 56ms 2024-05-08T05:38:30.100 INFO:teuthology.orchestra.run.smithi160.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 37 -201us[ -235us] +/- 69ms 2024-05-08T05:38:30.100 INFO:teuthology.orchestra.run.smithi160.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-05-08T05:38:30.125 INFO:teuthology.orchestra.run.smithi087.stderr:bash: line 1: ntpq: command not found 2024-05-08T05:38:30.136 INFO:teuthology.orchestra.run.smithi087.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-05-08T05:38:30.136 INFO:teuthology.orchestra.run.smithi087.stdout:=============================================================================== 2024-05-08T05:38:30.136 INFO:teuthology.orchestra.run.smithi087.stdout:^* hv01.front.sepia.ceph.com 3 7 377 36 +166us[ +134us] +/- 64ms 2024-05-08T05:38:30.136 INFO:teuthology.orchestra.run.smithi087.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 34 -55us[ -55us] +/- 56ms 2024-05-08T05:38:30.136 INFO:teuthology.orchestra.run.smithi087.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 37 -224us[ -256us] +/- 69ms 2024-05-08T05:38:30.136 INFO:teuthology.orchestra.run.smithi087.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-05-08T05:38:30.137 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-05-08T05:38:30.148 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-05-08T05:38:30.148 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-05-08T05:38:30.165 DEBUG:teuthology.orchestra.run.smithi087:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-05-08T05:38:30.377 DEBUG:teuthology.orchestra.run.smithi090:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-05-08T05:38:30.443 DEBUG:teuthology.orchestra.run.smithi160:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-05-08T05:38:30.508 DEBUG:teuthology.orchestra.run.smithi087:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-05-08T05:38:30.600 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-08T05:38:30.601 DEBUG:teuthology.orchestra.run.smithi090:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-05-08T05:38:30.627 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-08T05:38:30.628 DEBUG:teuthology.orchestra.run.smithi160:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-05-08T05:38:30.654 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-08T05:38:30.655 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-05-08T05:38:30.666 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-05-08T05:38:30.706 INFO:teuthology.task.internal:Duration was 1861.398677 seconds 2024-05-08T05:38:30.707 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-05-08T05:38:30.732 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-05-08T05:38:30.732 DEBUG:teuthology.orchestra.run.smithi087:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-05-08T05:38:30.740 DEBUG:teuthology.orchestra.run.smithi090:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-05-08T05:38:30.742 DEBUG:teuthology.orchestra.run.smithi160:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-05-08T05:38:30.777 INFO:teuthology.orchestra.run.smithi090.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-05-08T05:38:30.778 INFO:teuthology.orchestra.run.smithi160.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-05-08T05:38:30.863 INFO:teuthology.orchestra.run.smithi087.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-05-08T05:38:31.291 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-05-08T05:38:31.291 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi087.front.sepia.ceph.com 2024-05-08T05:38:31.291 DEBUG:teuthology.orchestra.run.smithi087:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-05-08T05:38:31.354 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi090.front.sepia.ceph.com 2024-05-08T05:38:31.354 DEBUG:teuthology.orchestra.run.smithi090:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-05-08T05:38:31.379 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi160.front.sepia.ceph.com 2024-05-08T05:38:31.379 DEBUG:teuthology.orchestra.run.smithi160:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-05-08T05:38:31.406 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-05-08T05:38:31.406 DEBUG:teuthology.orchestra.run.smithi087:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-05-08T05:38:31.413 DEBUG:teuthology.orchestra.run.smithi090:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-05-08T05:38:31.422 DEBUG:teuthology.orchestra.run.smithi160:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-05-08T05:38:31.493 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-05-08T05:38:31.493 DEBUG:teuthology.orchestra.run.smithi087:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-05-08T05:38:31.498 DEBUG:teuthology.orchestra.run.smithi090:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-05-08T05:38:31.500 DEBUG:teuthology.orchestra.run.smithi160:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-05-08T05:38:32.314 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-05-08T05:38:32.326 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-05-08T05:38:32.326 DEBUG:teuthology.orchestra.run.smithi087:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-05-08T05:38:32.405 DEBUG:teuthology.orchestra.run.smithi090:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-05-08T05:38:32.431 DEBUG:teuthology.orchestra.run.smithi160:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-05-08T05:38:32.456 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-05-08T05:38:32.468 DEBUG:teuthology.orchestra.run.smithi087:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-05-08T05:38:32.475 DEBUG:teuthology.orchestra.run.smithi090:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-05-08T05:38:32.478 DEBUG:teuthology.orchestra.run.smithi160:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-05-08T05:38:32.499 INFO:teuthology.orchestra.run.smithi090.stdout:kernel.core_pattern = core 2024-05-08T05:38:32.518 INFO:teuthology.orchestra.run.smithi160.stdout:kernel.core_pattern = core 2024-05-08T05:38:32.565 INFO:teuthology.orchestra.run.smithi087.stdout:kernel.core_pattern = core 2024-05-08T05:38:32.604 DEBUG:teuthology.orchestra.run.smithi087:> test -e /home/ubuntu/cephtest/archive/coredump 2024-05-08T05:38:32.650 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-08T05:38:32.651 DEBUG:teuthology.orchestra.run.smithi090:> test -e /home/ubuntu/cephtest/archive/coredump 2024-05-08T05:38:32.666 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-08T05:38:32.666 DEBUG:teuthology.orchestra.run.smithi160:> test -e /home/ubuntu/cephtest/archive/coredump 2024-05-08T05:38:32.680 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-08T05:38:32.681 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-05-08T05:38:32.692 INFO:teuthology.task.internal:Transferring archived files... 2024-05-08T05:38:32.693 DEBUG:teuthology.misc:Transferring archived files from smithi087:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/vshankar-2024-05-08_04:00:39-fs:workload-wip-57676-3-testing-default-smithi/7697229/remote/smithi087 2024-05-08T05:38:32.693 DEBUG:teuthology.orchestra.run.smithi087:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-05-08T05:38:32.804 DEBUG:teuthology.misc:Transferring archived files from smithi090:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/vshankar-2024-05-08_04:00:39-fs:workload-wip-57676-3-testing-default-smithi/7697229/remote/smithi090 2024-05-08T05:38:32.804 DEBUG:teuthology.orchestra.run.smithi090:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-05-08T05:38:32.841 DEBUG:teuthology.misc:Transferring archived files from smithi160:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/vshankar-2024-05-08_04:00:39-fs:workload-wip-57676-3-testing-default-smithi/7697229/remote/smithi160 2024-05-08T05:38:32.842 DEBUG:teuthology.orchestra.run.smithi160:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-05-08T05:38:32.876 INFO:teuthology.task.internal:Removing archive directory... 2024-05-08T05:38:32.876 DEBUG:teuthology.orchestra.run.smithi087:> rm -rf -- /home/ubuntu/cephtest/archive 2024-05-08T05:38:32.885 DEBUG:teuthology.orchestra.run.smithi090:> rm -rf -- /home/ubuntu/cephtest/archive 2024-05-08T05:38:32.888 DEBUG:teuthology.orchestra.run.smithi160:> rm -rf -- /home/ubuntu/cephtest/archive 2024-05-08T05:38:32.933 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-05-08T05:38:32.945 INFO:teuthology.task.internal:Not uploading archives. 2024-05-08T05:38:32.946 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-05-08T05:38:32.966 INFO:teuthology.task.internal:Tidying up after the test... 2024-05-08T05:38:32.967 DEBUG:teuthology.orchestra.run.smithi087:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-05-08T05:38:32.974 DEBUG:teuthology.orchestra.run.smithi090:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-05-08T05:38:32.977 DEBUG:teuthology.orchestra.run.smithi160:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-05-08T05:38:32.990 INFO:teuthology.orchestra.run.smithi090.stdout: 262161 4 drwxr-xr-x 2 ubuntu ubuntu 4096 May 8 05:38 /home/ubuntu/cephtest 2024-05-08T05:38:32.991 INFO:teuthology.orchestra.run.smithi160.stdout: 262161 4 drwxr-xr-x 2 ubuntu ubuntu 4096 May 8 05:38 /home/ubuntu/cephtest 2024-05-08T05:38:33.023 INFO:teuthology.orchestra.run.smithi087.stdout: 393242 4 drwxr-xr-x 2 ubuntu ubuntu 4096 May 8 05:38 /home/ubuntu/cephtest 2024-05-08T05:38:33.026 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-05-08T05:38:33.040 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-05-08T05:38:33.094 INFO:teuthology.run:Summary data: client.0-kernel-sha1: 806ec36b21129f113ce356c007dd59694d340b37 description: fs:workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate 3-modules} clusters/1a11s-mds-1c-client-3node conf/{client mds mgr mon osd} mount/kclient/{base/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} ms_mode/crc wsync/yes} objectstore-ec/bluestore-bitmap omap_limit/10000 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts pg_health session_timeout} ranks/multi/{balancer/automatic export-check n/3 replication/always} standby-replay tasks/{0-subvolume/{with-no-extra-options} 1-check-counter 2-scrub/yes 3-snaps/no 4-flush/no 5-quiesce/no 6-workunit/suites/fsstress}} duration: 1861.3986773490906 flavor: default owner: scheduled_vshankar@teuthology success: true 2024-05-08T05:38:33.094 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-05-08T05:38:33.174 INFO:teuthology.run:pass